2021-12-17T18:07:45.689 INFO:root:teuthology version: 1.1.0-95a7d479 2021-12-17T18:07:45.690 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} --owner scheduled_teuthology@teuthology --name teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154 -- /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/orig.config.yaml 2021-12-17T18:07:45.736 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-12-17T18:07:45.802 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154 branch: octopus description: fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} email: ceph-qa@ceph.io first_in_suite: false job_id: '6567154' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: octopus ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - POOL_APP_NOT_ENABLED - has not responded to cap revoke by MDS for over - MDS_CLIENT_LATE_RELEASE - responding to mclientcaps log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 05c319fc280f505b26f579a01ab4d14d2f130a5b ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 05c319fc280f505b26f579a01ab4d14d2f130a5b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: octopus sha1: 05c319fc280f505b26f579a01ab4d14d2f130a5b owner: scheduled_teuthology@teuthology priority: 1000 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 - - client.2 sha1: 05c319fc280f505b26f579a01ab4d14d2f130a5b sleep_before_teardown: 0 suite: fs suite_branch: octopus suite_path: /home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 05c319fc280f505b26f579a01ab4d14d2f130a5b targets: smithi062.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfUBufYMmQE/6W6U1d2qdNEGlE39qw5S9VQAsAWpxbmPFx4UA2KnMqqgDhIfMBU/TUp1zGSpBOU0E7P7XGS0/xSKP8qffcSSv4qJ9qmEMVjuf1DBc460alm4N9HohtTxdzlhsBJbUKF5Hjb2WhMtsbapDMWMd3I6J9aX8I0bhgD0wz6dICd8bjF8tdDVRGyLhBtLigmu6qWTt1jS79c58eLDjKSizg0MqlZaiekof+f104ootGjZ9LWhxdPZ9OYOHdKZQi/fyGHkbGV0sHnuIe21jeHrYdIF98cbmVWxBtChMYiyirztlP5QclJOTk+oWIz/yFG/xK1etZF/Nj14yWTVdRmCFo65ovjFk5S21q9CHaftPZ5Y8mcnlvM1s8g+x7iRdW/z9a7R2td8V4Zu4/F2V+xYjFDuWioyZDLV9ifEYsh8+5Sz9pidiTFqE3FjmMLWGx7YSfBMdHzGN0jJW6tL21pvhW6dinI3dnmSS0QFFB/YZtVdewYSObuHw6z1U= smithi109.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZdOvKeKyuKUSRmHrJB4hBEDKZG/JKdo2WN4j/LQ4hUbw4PyRYqV6oHneaqI+Zu1OtJjw4aeamK+OdwNKwf06C0tjMcOWbhoxbMkCCnqU2PALQwXxSvXR9PV/cSallmMdmTiqSVpXsewxptusCVYodSn+IrNI4Fq1Z5bFE7QoThSPBe1YXbg7gBa6MgqCXGKSOTIS+Y2ofPXPOTMR84KPoTW55/2lt2jhW4rVXOTrTms0cHVtsdWgGnWoCJ4/aaE7g6TMibQLSVdHhQfH1Ytai80SFN+WoPnlp6JOJ2p9++2NGiKis/shpYt5C1xWeoDI/T7RTUvIYPlF1zNPlFhCHwe04QIrp0a9taCs94DOXF+C/yy+aCRkMtwId+Lk4qtpiFun4xvynG67u/nMIRbwadsLyR1n4gW97lMKPpgKBbRHwzGTWO/HjR6LCwiJAAHeo1QPAT4uDqjUzSm2FJEO4tSYI6v+9/mTj0GyNa4PRFq9t/6rRdGWIo98xUE5GrRE= smithi125.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCdIvTwDfAt7ahn6QxY62AadhSNVc6otdPHzhdONE1+EnSgiwr50flLNqIol7FE3jYp1YvfZStD0MEPWayORoBF9nlGnpxQhBXIycvR5UzhEj/NnOiRgopI7wDPyjqkfBNkal7rc2/IfwJte20avBtMylw87BqlDIaXgkZs871PqlcbQy0r56xgN8/Mn0M58Tof6rqdfLJowC9p/IISrzYC9D/yf5gEtqJU8hT+tv1pojs3kvALcV8Ly2CVmUv5EgZbWQoYI6tVW7yXdaYzgz+6vKbNNXrAaxXPySo7FhOh6rJ+k7su1s1f+BRZqWMu1eSje2Y3d7uI+JYYIwHVtLdZNjoroPHBSUZb1Bwg9evLvd2QMujJYa6k1OrX9GTINri/4Nr9u/dKVV69tLYaLLLg7Ms5F+c499LByX96EZ7QnS+GNaU/9ESHMdCJkTpGDzyZFM9hNME+3O/obyqZRQGj16f1gNcL24EWKqZzt6uPyNofClWndLuyliio7ci+Hz8= smithi158.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBYm9ByhcusERLDFrCsFCi7cg1FDWbrzf0O6NihjZpYIQ+CiXNT2STAe6M/B0W6uIdjn46jiqSpP3IXMq11KLTHPVDAPVLtT4Btx9y+now8y6fOjoYT5L/pTuuQY1a0JszL2NbdCDo/31nq1kuFr75SHpRHwYcUq7gXoN1wtfJwFjKml+7TIQrNepEls1uySBtiLtZsJUYVoS1Y5i4H4/nnvG0CeHCfhGiLc0hap77RIans1KjDf6LO6ILvqKC5uMAAgUFt9ZGbfIFwhWcAuYM+ZvwQwdTZDHKp7MCUQQpP3qT+W83/PoaKaNahz0QhhZBQFi5VoDMKXLqLtkvGW0TAHIOvAjLxReTXcVlkYZOEp+exY2onE8D82GXM6kRwpIvZ0Fr10nGMwQbu9O0C3P/M1C6Nq60knoGqOKkew3Ka9lJGqiOk1zcF5jfTBwQpjc7w7YtCpSQ39L93d7vsU3++oxs5UX1A+nnvBAHVv09rW+FvqyX/nhdYZRYzwY28JU= smithi192.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPudE3DsI92/Y5wpMDUvRgef34YNtH1QMHcjws5lgKAyPE+BJkEsbdOHPuJTThjgUbqAlF2SLAJ16MF490eMkfyB45YgU7kIToRHMJnFfu7ZWn6QdjuuHOXHRNUfholr5//O+OOsPwjwBBaUHLfy5TIv6u7lYSxvtEKl67aqr93mTk2R/EoUXLPC04XN1I8oORziplNHs+qxxSUZRSiVHStS5qY6XvmGwJECsEvneiLBVfww7lnQLH715XYAy1QUzj1kvbfnlKDZBopOyKRaS/J76a6OnVxuyvSazByx393ZZ2Fgit/g/+G09ivnl/LTeBBkTGSS+aNVqDsR0dMrm7dQ2d8Gvv9Y5xFQyHg9R5NlfkG1huhzYeF3+0WuoSO454M8SyNa4nkp5zfKk85yigqr+V49cRNf+psmGSFS5IuenduAEfg5yIt11X0qHWiaNKWvt3IluVjx6P+fu1Ojy3OGDC8jnk9ITFQt7k4QfLlQW0kfDDh7+g2y+Ns/el+Z0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_misc teuthology_branch: master teuthology_sha1: 95a7d4799b562f3bbb5ec66107094963abd62fa1 timestamp: 2021-12-17_04:10:02 tube: smithi user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.20261 2021-12-17T18:07:45.802 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa; will attempt to use it 2021-12-17T18:07:45.803 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks 2021-12-17T18:07:45.804 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-12-17T18:07:45.806 INFO:teuthology.task.internal:Checking packages... 2021-12-17T18:07:45.826 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '05c319fc280f505b26f579a01ab4d14d2f130a5b' 2021-12-17T18:07:45.827 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-12-17T18:07:45.827 INFO:teuthology.packaging:ref: None 2021-12-17T18:07:45.827 INFO:teuthology.packaging:tag: None 2021-12-17T18:07:45.828 INFO:teuthology.packaging:branch: octopus 2021-12-17T18:07:45.828 INFO:teuthology.packaging:sha1: 05c319fc280f505b26f579a01ab4d14d2f130a5b 2021-12-17T18:07:45.829 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-12-17T18:07:46.136 INFO:teuthology.task.internal:Found packages for ceph version 15.2.15-105-g05c319fc-1focal 2021-12-17T18:07:46.136 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-12-17T18:07:46.144 INFO:teuthology.task.internal:no buildpackages task found 2021-12-17T18:07:46.145 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-12-17T18:07:46.217 INFO:teuthology.task.internal:Saving configuration 2021-12-17T18:07:46.235 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-12-17T18:07:46.326 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-17T18:07:46.357 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-12-17 18:00:49.099068', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINHirBouG7eea9myTF3d1wMducWEokt9/qZybdZalKsD'} 2021-12-17T18:07:46.380 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi109.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-12-17 18:00:49.101160', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIC1bsl3h2skxSs6rFoNCqANndgoLiavpEPBcaVDiRNKt'} 2021-12-17T18:07:46.402 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-12-17 18:00:49.098038', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAS8k7bk+HBH/NfEjH0UGoTpGL/LwhxZK3uFK8wbmZ6i'} 2021-12-17T18:07:46.425 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-12-17 18:00:49.096703', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO1YEwKjCi+hGh1VFfa/jZfV/rgeczhDYOk2s0JTNL+q'} 2021-12-17T18:07:46.448 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-12-17 18:00:49.100071', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIL+ruloa3WaVpOVwp13RHZ41vhrr72f985GTIE9ob2F9'} 2021-12-17T18:07:46.448 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-12-17T18:07:46.461 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-12-17T18:07:46.461 INFO:teuthology.task.internal:roles: ubuntu@smithi109.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-12-17T18:07:46.462 INFO:teuthology.task.internal:roles: ubuntu@smithi125.front.sepia.ceph.com - ['client.0'] 2021-12-17T18:07:46.462 INFO:teuthology.task.internal:roles: ubuntu@smithi158.front.sepia.ceph.com - ['client.1'] 2021-12-17T18:07:46.462 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['client.2'] 2021-12-17T18:07:46.462 INFO:teuthology.run_tasks:Running task console_log... 2021-12-17T18:07:46.681 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7eff01707bf8>, signals=[15]) 2021-12-17T18:07:46.682 INFO:teuthology.run_tasks:Running task internal.connect... 2021-12-17T18:07:46.690 INFO:teuthology.task.internal:Opening connections... 2021-12-17T18:07:46.691 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2021-12-17T18:07:46.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:07:46.750 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi109.front.sepia.ceph.com 2021-12-17T18:07:46.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:07:46.806 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi125.front.sepia.ceph.com 2021-12-17T18:07:46.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:07:46.861 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi158.front.sepia.ceph.com 2021-12-17T18:07:46.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:07:46.912 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2021-12-17T18:07:46.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:07:46.963 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-12-17T18:07:46.974 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2021-12-17T18:07:46.982 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2021-12-17T18:07:46.983 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2021-12-17T18:07:47.031 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu" 2021-12-17T18:07:47.032 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-17T18:07:47.032 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu 2021-12-17T18:07:47.032 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian 2021-12-17T18:07:47.032 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-17T18:07:47.033 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="20.04" 2021-12-17T18:07:47.033 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-17T18:07:47.033 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-17T18:07:47.033 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-17T18:07:47.034 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-17T18:07:47.034 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=focal 2021-12-17T18:07:47.034 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=focal 2021-12-17T18:07:47.036 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2021-12-17T18:07:47.055 DEBUG:teuthology.orchestra.run.smithi109:> uname -m 2021-12-17T18:07:47.063 INFO:teuthology.orchestra.run.smithi109.stdout:x86_64 2021-12-17T18:07:47.063 DEBUG:teuthology.orchestra.run.smithi109:> cat /etc/os-release 2021-12-17T18:07:47.112 INFO:teuthology.orchestra.run.smithi109.stdout:NAME="Ubuntu" 2021-12-17T18:07:47.112 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-17T18:07:47.113 INFO:teuthology.orchestra.run.smithi109.stdout:ID=ubuntu 2021-12-17T18:07:47.113 INFO:teuthology.orchestra.run.smithi109.stdout:ID_LIKE=debian 2021-12-17T18:07:47.113 INFO:teuthology.orchestra.run.smithi109.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-17T18:07:47.113 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION_ID="20.04" 2021-12-17T18:07:47.113 INFO:teuthology.orchestra.run.smithi109.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-17T18:07:47.114 INFO:teuthology.orchestra.run.smithi109.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-17T18:07:47.114 INFO:teuthology.orchestra.run.smithi109.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-17T18:07:47.114 INFO:teuthology.orchestra.run.smithi109.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-17T18:07:47.114 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION_CODENAME=focal 2021-12-17T18:07:47.115 INFO:teuthology.orchestra.run.smithi109.stdout:UBUNTU_CODENAME=focal 2021-12-17T18:07:47.115 INFO:teuthology.lock.ops:Updating smithi109.front.sepia.ceph.com on lock server 2021-12-17T18:07:47.132 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2021-12-17T18:07:47.139 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2021-12-17T18:07:47.140 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2021-12-17T18:07:47.146 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Ubuntu" 2021-12-17T18:07:47.146 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-17T18:07:47.147 INFO:teuthology.orchestra.run.smithi125.stdout:ID=ubuntu 2021-12-17T18:07:47.147 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE=debian 2021-12-17T18:07:47.147 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-17T18:07:47.147 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="20.04" 2021-12-17T18:07:47.148 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-17T18:07:47.148 INFO:teuthology.orchestra.run.smithi125.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-17T18:07:47.148 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-17T18:07:47.148 INFO:teuthology.orchestra.run.smithi125.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-17T18:07:47.149 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_CODENAME=focal 2021-12-17T18:07:47.149 INFO:teuthology.orchestra.run.smithi125.stdout:UBUNTU_CODENAME=focal 2021-12-17T18:07:47.149 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2021-12-17T18:07:47.168 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2021-12-17T18:07:47.175 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2021-12-17T18:07:47.176 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2021-12-17T18:07:47.222 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Ubuntu" 2021-12-17T18:07:47.222 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-17T18:07:47.222 INFO:teuthology.orchestra.run.smithi158.stdout:ID=ubuntu 2021-12-17T18:07:47.223 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE=debian 2021-12-17T18:07:47.223 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-17T18:07:47.223 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="20.04" 2021-12-17T18:07:47.224 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-17T18:07:47.224 INFO:teuthology.orchestra.run.smithi158.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-17T18:07:47.224 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-17T18:07:47.224 INFO:teuthology.orchestra.run.smithi158.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-17T18:07:47.225 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_CODENAME=focal 2021-12-17T18:07:47.225 INFO:teuthology.orchestra.run.smithi158.stdout:UBUNTU_CODENAME=focal 2021-12-17T18:07:47.225 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2021-12-17T18:07:47.243 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2021-12-17T18:07:47.250 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2021-12-17T18:07:47.251 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2021-12-17T18:07:47.257 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Ubuntu" 2021-12-17T18:07:47.257 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-17T18:07:47.258 INFO:teuthology.orchestra.run.smithi192.stdout:ID=ubuntu 2021-12-17T18:07:47.258 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE=debian 2021-12-17T18:07:47.258 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-17T18:07:47.258 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="20.04" 2021-12-17T18:07:47.259 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-17T18:07:47.259 INFO:teuthology.orchestra.run.smithi192.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-17T18:07:47.259 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-17T18:07:47.259 INFO:teuthology.orchestra.run.smithi192.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-17T18:07:47.260 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_CODENAME=focal 2021-12-17T18:07:47.260 INFO:teuthology.orchestra.run.smithi192.stdout:UBUNTU_CODENAME=focal 2021-12-17T18:07:47.260 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2021-12-17T18:07:47.278 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-12-17T18:07:47.299 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-12-17T18:07:47.334 INFO:teuthology.task.internal:Checking for old test directory... 2021-12-17T18:07:47.334 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2021-12-17T18:07:47.337 DEBUG:teuthology.orchestra.run.smithi109:> test '!' -e /home/ubuntu/cephtest 2021-12-17T18:07:47.340 DEBUG:teuthology.orchestra.run.smithi125:> test '!' -e /home/ubuntu/cephtest 2021-12-17T18:07:47.342 DEBUG:teuthology.orchestra.run.smithi158:> test '!' -e /home/ubuntu/cephtest 2021-12-17T18:07:47.345 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2021-12-17T18:07:47.352 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-12-17T18:07:47.424 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-12-17T18:07:47.424 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2021-12-17T18:07:47.427 DEBUG:teuthology.orchestra.run.smithi109:> test -z $(ls -A /var/lib/ceph) 2021-12-17T18:07:47.429 DEBUG:teuthology.orchestra.run.smithi125:> test -z $(ls -A /var/lib/ceph) 2021-12-17T18:07:47.431 DEBUG:teuthology.orchestra.run.smithi158:> test -z $(ls -A /var/lib/ceph) 2021-12-17T18:07:47.434 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2021-12-17T18:07:47.454 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-12-17T18:07:47.614 INFO:teuthology.run_tasks:Running task kernel... 2021-12-17T18:07:47.633 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2021-12-17T18:07:47.634 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-12-17T18:07:47.635 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2021-12-17T18:07:47.636 DEBUG:teuthology.orchestra.run.smithi109:> uname -r 2021-12-17T18:07:47.636 DEBUG:teuthology.orchestra.run.smithi125:> uname -r 2021-12-17T18:07:47.637 DEBUG:teuthology.orchestra.run.smithi158:> uname -r 2021-12-17T18:07:47.637 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2021-12-17T18:07:47.644 INFO:teuthology.orchestra.run.smithi158.stdout:5.4.0-88-generic 2021-12-17T18:07:47.645 INFO:teuthology.task.kernel:Running kernel on smithi158: 5.4.0-88-generic 2021-12-17T18:07:47.645 DEBUG:teuthology.orchestra.run.smithi158:> sudo apt-get clean 2021-12-17T18:07:47.648 INFO:teuthology.orchestra.run.smithi192.stdout:5.4.0-88-generic 2021-12-17T18:07:47.649 INFO:teuthology.orchestra.run.smithi062.stdout:5.4.0-88-generic 2021-12-17T18:07:47.649 INFO:teuthology.orchestra.run.smithi109.stdout:5.4.0-88-generic 2021-12-17T18:07:47.649 INFO:teuthology.orchestra.run.smithi125.stdout:5.4.0-88-generic 2021-12-17T18:07:47.650 INFO:teuthology.task.kernel:Running kernel on smithi192: 5.4.0-88-generic 2021-12-17T18:07:47.650 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get clean 2021-12-17T18:07:47.651 INFO:teuthology.task.kernel:Running kernel on smithi062: 5.4.0-88-generic 2021-12-17T18:07:47.651 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get clean 2021-12-17T18:07:47.651 INFO:teuthology.task.kernel:Running kernel on smithi109: 5.4.0-88-generic 2021-12-17T18:07:47.652 DEBUG:teuthology.orchestra.run.smithi109:> sudo apt-get clean 2021-12-17T18:07:47.652 INFO:teuthology.task.kernel:Running kernel on smithi125: 5.4.0-88-generic 2021-12-17T18:07:47.653 DEBUG:teuthology.orchestra.run.smithi125:> sudo apt-get clean 2021-12-17T18:07:47.739 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get update 2021-12-17T18:07:47.761 DEBUG:teuthology.orchestra.run.smithi158:> sudo apt-get update 2021-12-17T18:07:47.770 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2021-12-17T18:07:47.773 DEBUG:teuthology.orchestra.run.smithi125:> sudo apt-get update 2021-12-17T18:07:47.806 DEBUG:teuthology.orchestra.run.smithi109:> sudo apt-get update 2021-12-17T18:07:47.951 INFO:teuthology.orchestra.run.smithi125.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-12-17T18:07:48.052 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-12-17T18:07:48.052 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-12-17T18:07:48.053 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-12-17T18:07:48.053 INFO:teuthology.orchestra.run.smithi158.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-12-17T18:07:48.053 INFO:teuthology.orchestra.run.smithi125.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-12-17T18:07:48.062 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-12-17T18:07:48.064 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-12-17T18:07:48.103 INFO:teuthology.orchestra.run.smithi109.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-12-17T18:07:48.109 INFO:teuthology.orchestra.run.smithi109.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-12-17T18:07:48.110 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-12-17T18:07:48.112 INFO:teuthology.orchestra.run.smithi158.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-12-17T18:07:48.124 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-12-17T18:07:48.136 INFO:teuthology.orchestra.run.smithi125.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-12-17T18:07:48.164 INFO:teuthology.orchestra.run.smithi109.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-12-17T18:07:48.250 INFO:teuthology.orchestra.run.smithi125.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [345 kB] 2021-12-17T18:07:48.324 INFO:teuthology.orchestra.run.smithi125.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,069 kB] 2021-12-17T18:07:48.360 INFO:teuthology.orchestra.run.smithi125.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [197 kB] 2021-12-17T18:07:48.376 INFO:teuthology.orchestra.run.smithi125.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [9,096 B] 2021-12-17T18:07:48.377 INFO:teuthology.orchestra.run.smithi125.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [566 kB] 2021-12-17T18:07:48.378 INFO:teuthology.orchestra.run.smithi125.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.5 kB] 2021-12-17T18:07:48.379 INFO:teuthology.orchestra.run.smithi125.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [80.9 kB] 2021-12-17T18:07:48.381 INFO:teuthology.orchestra.run.smithi125.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-12-17T18:07:48.381 INFO:teuthology.orchestra.run.smithi125.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [525 kB] 2021-12-17T18:07:48.388 INFO:teuthology.orchestra.run.smithi125.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [668 kB] 2021-12-17T18:07:48.397 INFO:teuthology.orchestra.run.smithi125.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [112 kB] 2021-12-17T18:07:48.398 INFO:teuthology.orchestra.run.smithi125.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [13.0 kB] 2021-12-17T18:07:48.412 INFO:teuthology.orchestra.run.smithi125.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-12-17T18:07:48.413 INFO:teuthology.orchestra.run.smithi125.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-12-17T18:07:48.413 INFO:teuthology.orchestra.run.smithi125.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-12-17T18:07:48.442 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2021-12-17T18:07:48.454 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2021-12-17T18:07:48.465 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2021-12-17T18:07:48.471 INFO:teuthology.orchestra.run.smithi125.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2021-12-17T18:07:48.502 INFO:teuthology.orchestra.run.smithi109.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2021-12-17T18:07:48.522 INFO:teuthology.orchestra.run.smithi158.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,069 kB] 2021-12-17T18:07:48.533 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [345 kB] 2021-12-17T18:07:48.548 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [345 kB] 2021-12-17T18:07:48.583 INFO:teuthology.orchestra.run.smithi109.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,069 kB] 2021-12-17T18:07:48.599 INFO:teuthology.orchestra.run.smithi125.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [574 kB] 2021-12-17T18:07:48.669 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [574 kB] 2021-12-17T18:07:48.671 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,400 kB] 2021-12-17T18:07:48.690 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,400 kB] 2021-12-17T18:07:48.726 INFO:teuthology.orchestra.run.smithi109.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [574 kB] 2021-12-17T18:07:48.775 INFO:teuthology.orchestra.run.smithi125.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,400 kB] 2021-12-17T18:07:48.779 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,069 kB] 2021-12-17T18:07:48.795 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,069 kB] 2021-12-17T18:07:48.906 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [345 kB] 2021-12-17T18:07:48.922 INFO:teuthology.orchestra.run.smithi158.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [197 kB] 2021-12-17T18:07:48.930 INFO:teuthology.orchestra.run.smithi158.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [9,096 B] 2021-12-17T18:07:48.931 INFO:teuthology.orchestra.run.smithi158.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [566 kB] 2021-12-17T18:07:48.932 INFO:teuthology.orchestra.run.smithi125.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [283 kB] 2021-12-17T18:07:48.946 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,400 kB] 2021-12-17T18:07:48.953 INFO:teuthology.orchestra.run.smithi125.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.6 kB] 2021-12-17T18:07:48.954 INFO:teuthology.orchestra.run.smithi125.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [616 kB] 2021-12-17T18:07:48.955 INFO:teuthology.orchestra.run.smithi158.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.5 kB] 2021-12-17T18:07:48.956 INFO:teuthology.orchestra.run.smithi158.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [80.9 kB] 2021-12-17T18:07:48.985 INFO:teuthology.orchestra.run.smithi125.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.8 kB] 2021-12-17T18:07:48.986 INFO:teuthology.orchestra.run.smithi125.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [88.1 kB] 2021-12-17T18:07:48.989 INFO:teuthology.orchestra.run.smithi192.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [197 kB] 2021-12-17T18:07:48.990 INFO:teuthology.orchestra.run.smithi125.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-12-17T18:07:48.990 INFO:teuthology.orchestra.run.smithi125.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [654 kB] 2021-12-17T18:07:48.990 INFO:teuthology.orchestra.run.smithi109.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [345 kB] 2021-12-17T18:07:49.005 INFO:teuthology.orchestra.run.smithi192.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [9,096 B] 2021-12-17T18:07:49.006 INFO:teuthology.orchestra.run.smithi192.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.5 kB] 2021-12-17T18:07:49.008 INFO:teuthology.orchestra.run.smithi192.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [566 kB] 2021-12-17T18:07:49.009 INFO:teuthology.orchestra.run.smithi109.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [197 kB] 2021-12-17T18:07:49.009 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [197 kB] 2021-12-17T18:07:49.015 INFO:teuthology.orchestra.run.smithi158.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-12-17T18:07:49.015 INFO:teuthology.orchestra.run.smithi158.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [525 kB] 2021-12-17T18:07:49.016 INFO:teuthology.orchestra.run.smithi125.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [884 kB] 2021-12-17T18:07:49.019 INFO:teuthology.orchestra.run.smithi109.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,400 kB] 2021-12-17T18:07:49.023 INFO:teuthology.orchestra.run.smithi109.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [9,096 B] 2021-12-17T18:07:49.024 INFO:teuthology.orchestra.run.smithi109.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.5 kB] 2021-12-17T18:07:49.024 INFO:teuthology.orchestra.run.smithi109.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [566 kB] 2021-12-17T18:07:49.032 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [9,096 B] 2021-12-17T18:07:49.034 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.5 kB] 2021-12-17T18:07:49.037 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [566 kB] 2021-12-17T18:07:49.040 INFO:teuthology.orchestra.run.smithi158.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [668 kB] 2021-12-17T18:07:49.067 INFO:teuthology.orchestra.run.smithi109.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [80.9 kB] 2021-12-17T18:07:49.069 INFO:teuthology.orchestra.run.smithi158.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [112 kB] 2021-12-17T18:07:49.073 INFO:teuthology.orchestra.run.smithi125.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [193 kB] 2021-12-17T18:07:49.075 INFO:teuthology.orchestra.run.smithi158.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [13.0 kB] 2021-12-17T18:07:49.080 INFO:teuthology.orchestra.run.smithi125.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [20.0 kB] 2021-12-17T18:07:49.084 INFO:teuthology.orchestra.run.smithi192.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [80.9 kB] 2021-12-17T18:07:49.089 INFO:teuthology.orchestra.run.smithi192.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-12-17T18:07:49.090 INFO:teuthology.orchestra.run.smithi192.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [668 kB] 2021-12-17T18:07:49.090 INFO:teuthology.orchestra.run.smithi158.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [574 kB] 2021-12-17T18:07:49.105 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [574 kB] 2021-12-17T18:07:49.108 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [80.9 kB] 2021-12-17T18:07:49.111 INFO:teuthology.orchestra.run.smithi158.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [283 kB] 2021-12-17T18:07:49.113 INFO:teuthology.orchestra.run.smithi125.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,456 B] 2021-12-17T18:07:49.113 INFO:teuthology.orchestra.run.smithi125.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.8 kB] 2021-12-17T18:07:49.114 INFO:teuthology.orchestra.run.smithi125.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,928 B] 2021-12-17T18:07:49.115 INFO:teuthology.orchestra.run.smithi125.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-12-17T18:07:49.116 INFO:teuthology.orchestra.run.smithi125.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [42.0 kB] 2021-12-17T18:07:49.116 INFO:teuthology.orchestra.run.smithi109.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-12-17T18:07:49.117 INFO:teuthology.orchestra.run.smithi109.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [525 kB] 2021-12-17T18:07:49.118 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-12-17T18:07:49.118 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [525 kB] 2021-12-17T18:07:49.160 INFO:teuthology.orchestra.run.smithi158.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-12-17T18:07:49.172 INFO:teuthology.orchestra.run.smithi125.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [34.5 kB] 2021-12-17T18:07:49.173 INFO:teuthology.orchestra.run.smithi125.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [10.0 kB] 2021-12-17T18:07:49.224 INFO:teuthology.orchestra.run.smithi158.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.6 kB] 2021-12-17T18:07:49.225 INFO:teuthology.orchestra.run.smithi158.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.8 kB] 2021-12-17T18:07:49.226 INFO:teuthology.orchestra.run.smithi158.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [616 kB] 2021-12-17T18:07:49.229 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [283 kB] 2021-12-17T18:07:49.234 INFO:teuthology.orchestra.run.smithi192.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [283 kB] 2021-12-17T18:07:49.237 INFO:teuthology.orchestra.run.smithi192.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [525 kB] 2021-12-17T18:07:49.238 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.6 kB] 2021-12-17T18:07:49.238 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.8 kB] 2021-12-17T18:07:49.240 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [616 kB] 2021-12-17T18:07:49.245 INFO:teuthology.orchestra.run.smithi109.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [668 kB] 2021-12-17T18:07:49.251 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [668 kB] 2021-12-17T18:07:49.253 INFO:teuthology.orchestra.run.smithi192.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [112 kB] 2021-12-17T18:07:49.255 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [88.1 kB] 2021-12-17T18:07:49.256 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-12-17T18:07:49.256 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [654 kB] 2021-12-17T18:07:49.260 INFO:teuthology.orchestra.run.smithi158.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-12-17T18:07:49.261 INFO:teuthology.orchestra.run.smithi158.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-12-17T18:07:49.261 INFO:teuthology.orchestra.run.smithi192.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [13.0 kB] 2021-12-17T18:07:49.262 INFO:teuthology.orchestra.run.smithi192.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-12-17T18:07:49.262 INFO:teuthology.orchestra.run.smithi192.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-12-17T18:07:49.263 INFO:teuthology.orchestra.run.smithi192.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-12-17T18:07:49.263 INFO:teuthology.orchestra.run.smithi125.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [864 B] 2021-12-17T18:07:49.263 INFO:teuthology.orchestra.run.smithi125.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [18.9 kB] 2021-12-17T18:07:49.264 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [884 kB] 2021-12-17T18:07:49.265 INFO:teuthology.orchestra.run.smithi125.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [10.5 kB] 2021-12-17T18:07:49.265 INFO:teuthology.orchestra.run.smithi125.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [7,492 B] 2021-12-17T18:07:49.265 INFO:teuthology.orchestra.run.smithi125.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [636 B] 2021-12-17T18:07:49.267 INFO:teuthology.orchestra.run.smithi109.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [112 kB] 2021-12-17T18:07:49.267 INFO:teuthology.orchestra.run.smithi109.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [283 kB] 2021-12-17T18:07:49.268 INFO:teuthology.orchestra.run.smithi109.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [13.0 kB] 2021-12-17T18:07:49.268 INFO:teuthology.orchestra.run.smithi109.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-12-17T18:07:49.268 INFO:teuthology.orchestra.run.smithi109.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-12-17T18:07:49.268 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [112 kB] 2021-12-17T18:07:49.269 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [13.0 kB] 2021-12-17T18:07:49.269 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-12-17T18:07:49.269 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-12-17T18:07:49.269 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-12-17T18:07:49.270 INFO:teuthology.orchestra.run.smithi192.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.6 kB] 2021-12-17T18:07:49.271 INFO:teuthology.orchestra.run.smithi192.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [616 kB] 2021-12-17T18:07:49.271 INFO:teuthology.orchestra.run.smithi109.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-12-17T18:07:49.271 INFO:teuthology.orchestra.run.smithi109.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.6 kB] 2021-12-17T18:07:49.271 INFO:teuthology.orchestra.run.smithi109.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [616 kB] 2021-12-17T18:07:49.274 INFO:teuthology.orchestra.run.smithi109.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.8 kB] 2021-12-17T18:07:49.275 INFO:teuthology.orchestra.run.smithi109.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [88.1 kB] 2021-12-17T18:07:49.278 INFO:teuthology.orchestra.run.smithi192.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.8 kB] 2021-12-17T18:07:49.279 INFO:teuthology.orchestra.run.smithi192.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [88.1 kB] 2021-12-17T18:07:49.279 INFO:teuthology.orchestra.run.smithi109.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-12-17T18:07:49.279 INFO:teuthology.orchestra.run.smithi109.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [654 kB] 2021-12-17T18:07:49.280 INFO:teuthology.orchestra.run.smithi158.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [88.1 kB] 2021-12-17T18:07:49.280 INFO:teuthology.orchestra.run.smithi192.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-12-17T18:07:49.281 INFO:teuthology.orchestra.run.smithi192.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [654 kB] 2021-12-17T18:07:49.281 INFO:teuthology.orchestra.run.smithi158.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-12-17T18:07:49.282 INFO:teuthology.orchestra.run.smithi158.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [654 kB] 2021-12-17T18:07:49.284 INFO:teuthology.orchestra.run.smithi192.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [884 kB] 2021-12-17T18:07:49.291 INFO:teuthology.orchestra.run.smithi158.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [884 kB] 2021-12-17T18:07:49.297 INFO:teuthology.orchestra.run.smithi158.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [193 kB] 2021-12-17T18:07:49.298 INFO:teuthology.orchestra.run.smithi158.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [20.0 kB] 2021-12-17T18:07:49.312 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [193 kB] 2021-12-17T18:07:49.314 INFO:teuthology.orchestra.run.smithi192.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [193 kB] 2021-12-17T18:07:49.325 INFO:teuthology.orchestra.run.smithi192.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [20.0 kB] 2021-12-17T18:07:49.326 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [20.0 kB] 2021-12-17T18:07:49.343 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.8 kB] 2021-12-17T18:07:49.344 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,456 B] 2021-12-17T18:07:49.345 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,928 B] 2021-12-17T18:07:49.346 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-12-17T18:07:49.346 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [42.0 kB] 2021-12-17T18:07:49.350 INFO:teuthology.orchestra.run.smithi109.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [884 kB] 2021-12-17T18:07:49.362 INFO:teuthology.orchestra.run.smithi192.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.8 kB] 2021-12-17T18:07:49.363 INFO:teuthology.orchestra.run.smithi192.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,456 B] 2021-12-17T18:07:49.364 INFO:teuthology.orchestra.run.smithi192.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,928 B] 2021-12-17T18:07:49.364 INFO:teuthology.orchestra.run.smithi192.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-12-17T18:07:49.365 INFO:teuthology.orchestra.run.smithi192.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [42.0 kB] 2021-12-17T18:07:49.374 INFO:teuthology.orchestra.run.smithi158.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,456 B] 2021-12-17T18:07:49.374 INFO:teuthology.orchestra.run.smithi158.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.8 kB] 2021-12-17T18:07:49.375 INFO:teuthology.orchestra.run.smithi158.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,928 B] 2021-12-17T18:07:49.376 INFO:teuthology.orchestra.run.smithi158.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-12-17T18:07:49.376 INFO:teuthology.orchestra.run.smithi158.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [34.5 kB] 2021-12-17T18:07:49.377 INFO:teuthology.orchestra.run.smithi158.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [42.0 kB] 2021-12-17T18:07:49.390 INFO:teuthology.orchestra.run.smithi109.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [193 kB] 2021-12-17T18:07:49.399 INFO:teuthology.orchestra.run.smithi192.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [34.5 kB] 2021-12-17T18:07:49.399 INFO:teuthology.orchestra.run.smithi109.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [20.0 kB] 2021-12-17T18:07:49.400 INFO:teuthology.orchestra.run.smithi192.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [10.0 kB] 2021-12-17T18:07:49.401 INFO:teuthology.orchestra.run.smithi192.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [864 B] 2021-12-17T18:07:49.401 INFO:teuthology.orchestra.run.smithi109.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,456 B] 2021-12-17T18:07:49.401 INFO:teuthology.orchestra.run.smithi109.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.8 kB] 2021-12-17T18:07:49.402 INFO:teuthology.orchestra.run.smithi109.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,928 B] 2021-12-17T18:07:49.403 INFO:teuthology.orchestra.run.smithi109.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-12-17T18:07:49.403 INFO:teuthology.orchestra.run.smithi109.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [34.5 kB] 2021-12-17T18:07:49.404 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [34.5 kB] 2021-12-17T18:07:49.405 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [10.0 kB] 2021-12-17T18:07:49.405 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [864 B] 2021-12-17T18:07:49.431 INFO:teuthology.orchestra.run.smithi158.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [10.0 kB] 2021-12-17T18:07:49.432 INFO:teuthology.orchestra.run.smithi158.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [864 B] 2021-12-17T18:07:49.432 INFO:teuthology.orchestra.run.smithi158.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [18.9 kB] 2021-12-17T18:07:49.433 INFO:teuthology.orchestra.run.smithi158.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [10.5 kB] 2021-12-17T18:07:49.434 INFO:teuthology.orchestra.run.smithi109.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [42.0 kB] 2021-12-17T18:07:49.435 INFO:teuthology.orchestra.run.smithi109.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [10.0 kB] 2021-12-17T18:07:49.481 INFO:teuthology.orchestra.run.smithi192.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [10.5 kB] 2021-12-17T18:07:49.481 INFO:teuthology.orchestra.run.smithi192.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [18.9 kB] 2021-12-17T18:07:49.482 INFO:teuthology.orchestra.run.smithi192.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [7,492 B] 2021-12-17T18:07:49.482 INFO:teuthology.orchestra.run.smithi192.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [636 B] 2021-12-17T18:07:49.487 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [18.9 kB] 2021-12-17T18:07:49.488 INFO:teuthology.orchestra.run.smithi062.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [10.5 kB] 2021-12-17T18:07:49.488 INFO:teuthology.orchestra.run.smithi062.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [7,492 B] 2021-12-17T18:07:49.489 INFO:teuthology.orchestra.run.smithi062.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [636 B] 2021-12-17T18:07:49.513 INFO:teuthology.orchestra.run.smithi158.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [7,492 B] 2021-12-17T18:07:49.514 INFO:teuthology.orchestra.run.smithi158.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [636 B] 2021-12-17T18:07:49.516 INFO:teuthology.orchestra.run.smithi109.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [864 B] 2021-12-17T18:07:49.517 INFO:teuthology.orchestra.run.smithi109.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [18.9 kB] 2021-12-17T18:07:49.517 INFO:teuthology.orchestra.run.smithi109.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [10.5 kB] 2021-12-17T18:07:49.518 INFO:teuthology.orchestra.run.smithi109.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [7,492 B] 2021-12-17T18:07:49.519 INFO:teuthology.orchestra.run.smithi109.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [636 B] 2021-12-17T18:07:52.428 INFO:teuthology.orchestra.run.smithi125.stdout:Fetched 8,885 kB in 2s (5,729 kB/s) 2021-12-17T18:07:52.825 INFO:teuthology.orchestra.run.smithi109.stdout:Fetched 8,885 kB in 2s (4,434 kB/s) 2021-12-17T18:07:52.835 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 8,885 kB in 2s (4,351 kB/s) 2021-12-17T18:07:52.841 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 8,885 kB in 2s (4,558 kB/s) 2021-12-17T18:07:53.157 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 8,885 kB in 2s (4,230 kB/s) 2021-12-17T18:07:53.605 INFO:teuthology.orchestra.run.smithi125.stdout:Reading package lists... 2021-12-17T18:07:53.628 DEBUG:teuthology.orchestra.run.smithi125:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-12-17T18:07:53.695 INFO:teuthology.orchestra.run.smithi125.stdout:Reading package lists... 2021-12-17T18:07:53.865 INFO:teuthology.orchestra.run.smithi125.stdout:Building dependency tree... 2021-12-17T18:07:53.866 INFO:teuthology.orchestra.run.smithi125.stdout:Reading state information... 2021-12-17T18:07:53.990 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2021-12-17T18:07:53.999 INFO:teuthology.orchestra.run.smithi125.stdout:The following package was automatically installed and is no longer required: 2021-12-17T18:07:54.000 INFO:teuthology.orchestra.run.smithi125.stdout: libllvm11 2021-12-17T18:07:54.000 INFO:teuthology.orchestra.run.smithi125.stdout:Use 'sudo apt autoremove' to remove it. 2021-12-17T18:07:54.000 INFO:teuthology.orchestra.run.smithi125.stdout:The following additional packages will be installed: 2021-12-17T18:07:54.001 INFO:teuthology.orchestra.run.smithi125.stdout: linux-generic linux-headers-5.4.0-91 linux-headers-5.4.0-91-generic 2021-12-17T18:07:54.001 INFO:teuthology.orchestra.run.smithi125.stdout: linux-headers-generic linux-image-5.4.0-91-generic 2021-12-17T18:07:54.001 INFO:teuthology.orchestra.run.smithi125.stdout: linux-modules-5.4.0-91-generic linux-modules-extra-5.4.0-91-generic 2021-12-17T18:07:54.002 INFO:teuthology.orchestra.run.smithi125.stdout:Suggested packages: 2021-12-17T18:07:54.003 INFO:teuthology.orchestra.run.smithi125.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-12-17T18:07:54.003 INFO:teuthology.orchestra.run.smithi125.stdout:Recommended packages: 2021-12-17T18:07:54.004 INFO:teuthology.orchestra.run.smithi125.stdout: thermald 2021-12-17T18:07:54.005 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2021-12-17T18:07:54.015 DEBUG:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-12-17T18:07:54.027 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-12-17T18:07:54.050 INFO:teuthology.orchestra.run.smithi109.stdout:Reading package lists... 2021-12-17T18:07:54.053 INFO:teuthology.orchestra.run.smithi125.stdout:The following NEW packages will be installed: 2021-12-17T18:07:54.054 INFO:teuthology.orchestra.run.smithi125.stdout: linux-headers-5.4.0-91 linux-headers-5.4.0-91-generic 2021-12-17T18:07:54.054 INFO:teuthology.orchestra.run.smithi125.stdout: linux-image-5.4.0-91-generic linux-modules-5.4.0-91-generic 2021-12-17T18:07:54.055 INFO:teuthology.orchestra.run.smithi125.stdout: linux-modules-extra-5.4.0-91-generic 2021-12-17T18:07:54.056 INFO:teuthology.orchestra.run.smithi125.stdout:The following packages will be upgraded: 2021-12-17T18:07:54.056 INFO:teuthology.orchestra.run.smithi125.stdout: linux-generic linux-headers-generic linux-image-generic 2021-12-17T18:07:54.074 DEBUG:teuthology.orchestra.run.smithi109:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-12-17T18:07:54.080 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2021-12-17T18:07:54.092 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2021-12-17T18:07:54.187 INFO:teuthology.orchestra.run.smithi109.stdout:Reading package lists... 2021-12-17T18:07:54.230 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2021-12-17T18:07:54.231 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2021-12-17T18:07:54.237 INFO:teuthology.orchestra.run.smithi125.stdout:3 upgraded, 5 newly installed, 0 to remove and 83 not upgraded. 2021-12-17T18:07:54.237 INFO:teuthology.orchestra.run.smithi125.stdout:Need to get 75.6 MB of archives. 2021-12-17T18:07:54.237 INFO:teuthology.orchestra.run.smithi125.stdout:After this operation, 378 MB of additional disk space will be used. 2021-12-17T18:07:54.238 INFO:teuthology.orchestra.run.smithi125.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-91-generic amd64 5.4.0-91.102 [14.8 MB] 2021-12-17T18:07:54.260 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2021-12-17T18:07:54.261 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2021-12-17T18:07:54.310 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2021-12-17T18:07:54.333 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-12-17T18:07:54.341 INFO:teuthology.orchestra.run.smithi109.stdout:Building dependency tree... 2021-12-17T18:07:54.341 INFO:teuthology.orchestra.run.smithi109.stdout:Reading state information... 2021-12-17T18:07:54.362 INFO:teuthology.orchestra.run.smithi158.stdout:The following package was automatically installed and is no longer required: 2021-12-17T18:07:54.363 INFO:teuthology.orchestra.run.smithi158.stdout: libllvm11 2021-12-17T18:07:54.363 INFO:teuthology.orchestra.run.smithi158.stdout:Use 'sudo apt autoremove' to remove it. 2021-12-17T18:07:54.364 INFO:teuthology.orchestra.run.smithi158.stdout:The following additional packages will be installed: 2021-12-17T18:07:54.364 INFO:teuthology.orchestra.run.smithi158.stdout: linux-generic linux-headers-5.4.0-91 linux-headers-5.4.0-91-generic 2021-12-17T18:07:54.364 INFO:teuthology.orchestra.run.smithi158.stdout: linux-headers-generic linux-image-5.4.0-91-generic 2021-12-17T18:07:54.365 INFO:teuthology.orchestra.run.smithi158.stdout: linux-modules-5.4.0-91-generic linux-modules-extra-5.4.0-91-generic 2021-12-17T18:07:54.365 INFO:teuthology.orchestra.run.smithi158.stdout:Suggested packages: 2021-12-17T18:07:54.366 INFO:teuthology.orchestra.run.smithi158.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-12-17T18:07:54.366 INFO:teuthology.orchestra.run.smithi158.stdout:Recommended packages: 2021-12-17T18:07:54.367 INFO:teuthology.orchestra.run.smithi158.stdout: thermald 2021-12-17T18:07:54.395 INFO:teuthology.orchestra.run.smithi192.stdout:The following package was automatically installed and is no longer required: 2021-12-17T18:07:54.396 INFO:teuthology.orchestra.run.smithi192.stdout: libllvm11 2021-12-17T18:07:54.396 INFO:teuthology.orchestra.run.smithi192.stdout:Use 'sudo apt autoremove' to remove it. 2021-12-17T18:07:54.397 INFO:teuthology.orchestra.run.smithi192.stdout:The following additional packages will be installed: 2021-12-17T18:07:54.397 INFO:teuthology.orchestra.run.smithi192.stdout: linux-generic linux-headers-5.4.0-91 linux-headers-5.4.0-91-generic 2021-12-17T18:07:54.397 INFO:teuthology.orchestra.run.smithi192.stdout: linux-headers-generic linux-image-5.4.0-91-generic 2021-12-17T18:07:54.397 INFO:teuthology.orchestra.run.smithi192.stdout: linux-modules-5.4.0-91-generic linux-modules-extra-5.4.0-91-generic 2021-12-17T18:07:54.398 INFO:teuthology.orchestra.run.smithi192.stdout:Suggested packages: 2021-12-17T18:07:54.398 INFO:teuthology.orchestra.run.smithi192.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-12-17T18:07:54.398 INFO:teuthology.orchestra.run.smithi192.stdout:Recommended packages: 2021-12-17T18:07:54.399 INFO:teuthology.orchestra.run.smithi192.stdout: thermald 2021-12-17T18:07:54.400 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2021-12-17T18:07:54.421 INFO:teuthology.orchestra.run.smithi158.stdout:The following NEW packages will be installed: 2021-12-17T18:07:54.421 INFO:teuthology.orchestra.run.smithi158.stdout: linux-headers-5.4.0-91 linux-headers-5.4.0-91-generic 2021-12-17T18:07:54.421 INFO:teuthology.orchestra.run.smithi158.stdout: linux-image-5.4.0-91-generic linux-modules-5.4.0-91-generic 2021-12-17T18:07:54.422 INFO:teuthology.orchestra.run.smithi158.stdout: linux-modules-extra-5.4.0-91-generic 2021-12-17T18:07:54.423 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages will be upgraded: 2021-12-17T18:07:54.423 INFO:teuthology.orchestra.run.smithi158.stdout: linux-generic linux-headers-generic linux-image-generic 2021-12-17T18:07:54.453 INFO:teuthology.orchestra.run.smithi192.stdout:The following NEW packages will be installed: 2021-12-17T18:07:54.454 INFO:teuthology.orchestra.run.smithi192.stdout: linux-headers-5.4.0-91 linux-headers-5.4.0-91-generic 2021-12-17T18:07:54.454 INFO:teuthology.orchestra.run.smithi192.stdout: linux-image-5.4.0-91-generic linux-modules-5.4.0-91-generic 2021-12-17T18:07:54.454 INFO:teuthology.orchestra.run.smithi192.stdout: linux-modules-extra-5.4.0-91-generic 2021-12-17T18:07:54.455 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages will be upgraded: 2021-12-17T18:07:54.456 INFO:teuthology.orchestra.run.smithi192.stdout: linux-generic linux-headers-generic linux-image-generic 2021-12-17T18:07:54.472 INFO:teuthology.orchestra.run.smithi109.stdout:The following package was automatically installed and is no longer required: 2021-12-17T18:07:54.473 INFO:teuthology.orchestra.run.smithi109.stdout: libllvm11 2021-12-17T18:07:54.473 INFO:teuthology.orchestra.run.smithi109.stdout:Use 'sudo apt autoremove' to remove it. 2021-12-17T18:07:54.474 INFO:teuthology.orchestra.run.smithi109.stdout:The following additional packages will be installed: 2021-12-17T18:07:54.474 INFO:teuthology.orchestra.run.smithi109.stdout: linux-generic linux-headers-5.4.0-91 linux-headers-5.4.0-91-generic 2021-12-17T18:07:54.474 INFO:teuthology.orchestra.run.smithi109.stdout: linux-headers-generic linux-image-5.4.0-91-generic 2021-12-17T18:07:54.475 INFO:teuthology.orchestra.run.smithi109.stdout: linux-modules-5.4.0-91-generic linux-modules-extra-5.4.0-91-generic 2021-12-17T18:07:54.475 INFO:teuthology.orchestra.run.smithi109.stdout:Suggested packages: 2021-12-17T18:07:54.475 INFO:teuthology.orchestra.run.smithi109.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-12-17T18:07:54.476 INFO:teuthology.orchestra.run.smithi109.stdout:Recommended packages: 2021-12-17T18:07:54.476 INFO:teuthology.orchestra.run.smithi109.stdout: thermald 2021-12-17T18:07:54.527 INFO:teuthology.orchestra.run.smithi109.stdout:The following NEW packages will be installed: 2021-12-17T18:07:54.527 INFO:teuthology.orchestra.run.smithi109.stdout: linux-headers-5.4.0-91 linux-headers-5.4.0-91-generic 2021-12-17T18:07:54.527 INFO:teuthology.orchestra.run.smithi109.stdout: linux-image-5.4.0-91-generic linux-modules-5.4.0-91-generic 2021-12-17T18:07:54.527 INFO:teuthology.orchestra.run.smithi109.stdout: linux-modules-extra-5.4.0-91-generic 2021-12-17T18:07:54.528 INFO:teuthology.orchestra.run.smithi109.stdout:The following packages will be upgraded: 2021-12-17T18:07:54.529 INFO:teuthology.orchestra.run.smithi109.stdout: linux-generic linux-headers-generic linux-image-generic 2021-12-17T18:07:54.573 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2021-12-17T18:07:54.574 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2021-12-17T18:07:54.655 INFO:teuthology.orchestra.run.smithi192.stdout:3 upgraded, 5 newly installed, 0 to remove and 83 not upgraded. 2021-12-17T18:07:54.655 INFO:teuthology.orchestra.run.smithi192.stdout:Need to get 75.6 MB of archives. 2021-12-17T18:07:54.656 INFO:teuthology.orchestra.run.smithi192.stdout:After this operation, 378 MB of additional disk space will be used. 2021-12-17T18:07:54.656 INFO:teuthology.orchestra.run.smithi192.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-91-generic amd64 5.4.0-91.102 [14.8 MB] 2021-12-17T18:07:54.668 INFO:teuthology.orchestra.run.smithi158.stdout:3 upgraded, 5 newly installed, 0 to remove and 83 not upgraded. 2021-12-17T18:07:54.668 INFO:teuthology.orchestra.run.smithi158.stdout:Need to get 75.6 MB of archives. 2021-12-17T18:07:54.669 INFO:teuthology.orchestra.run.smithi158.stdout:After this operation, 378 MB of additional disk space will be used. 2021-12-17T18:07:54.669 INFO:teuthology.orchestra.run.smithi158.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-91-generic amd64 5.4.0-91.102 [14.8 MB] 2021-12-17T18:07:54.720 INFO:teuthology.orchestra.run.smithi109.stdout:3 upgraded, 5 newly installed, 0 to remove and 83 not upgraded. 2021-12-17T18:07:54.720 INFO:teuthology.orchestra.run.smithi109.stdout:Need to get 75.6 MB of archives. 2021-12-17T18:07:54.721 INFO:teuthology.orchestra.run.smithi109.stdout:After this operation, 378 MB of additional disk space will be used. 2021-12-17T18:07:54.721 INFO:teuthology.orchestra.run.smithi109.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-91-generic amd64 5.4.0-91.102 [14.8 MB] 2021-12-17T18:07:54.722 INFO:teuthology.orchestra.run.smithi062.stdout:The following package was automatically installed and is no longer required: 2021-12-17T18:07:54.723 INFO:teuthology.orchestra.run.smithi062.stdout: libllvm11 2021-12-17T18:07:54.723 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove it. 2021-12-17T18:07:54.725 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2021-12-17T18:07:54.725 INFO:teuthology.orchestra.run.smithi062.stdout: linux-generic linux-headers-5.4.0-91 linux-headers-5.4.0-91-generic 2021-12-17T18:07:54.725 INFO:teuthology.orchestra.run.smithi062.stdout: linux-headers-generic linux-image-5.4.0-91-generic 2021-12-17T18:07:54.726 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-5.4.0-91-generic linux-modules-extra-5.4.0-91-generic 2021-12-17T18:07:54.726 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2021-12-17T18:07:54.726 INFO:teuthology.orchestra.run.smithi062.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-12-17T18:07:54.726 INFO:teuthology.orchestra.run.smithi062.stdout:Recommended packages: 2021-12-17T18:07:54.727 INFO:teuthology.orchestra.run.smithi062.stdout: thermald 2021-12-17T18:07:54.764 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2021-12-17T18:07:54.765 INFO:teuthology.orchestra.run.smithi062.stdout: linux-headers-5.4.0-91 linux-headers-5.4.0-91-generic 2021-12-17T18:07:54.765 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.4.0-91-generic linux-modules-5.4.0-91-generic 2021-12-17T18:07:54.765 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-extra-5.4.0-91-generic 2021-12-17T18:07:54.766 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages will be upgraded: 2021-12-17T18:07:54.766 INFO:teuthology.orchestra.run.smithi062.stdout: linux-generic linux-headers-generic linux-image-generic 2021-12-17T18:07:54.948 INFO:teuthology.orchestra.run.smithi062.stdout:3 upgraded, 5 newly installed, 0 to remove and 83 not upgraded. 2021-12-17T18:07:54.948 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 75.6 MB of archives. 2021-12-17T18:07:54.949 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 378 MB of additional disk space will be used. 2021-12-17T18:07:54.949 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-91-generic amd64 5.4.0-91.102 [14.8 MB] 2021-12-17T18:07:55.448 INFO:teuthology.orchestra.run.smithi125.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-91-generic amd64 5.4.0-91.102 [8,992 kB] 2021-12-17T18:07:55.893 INFO:teuthology.orchestra.run.smithi125.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-91-generic amd64 5.4.0-91.102 [39.4 MB] 2021-12-17T18:07:56.117 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-91-generic amd64 5.4.0-91.102 [8,992 kB] 2021-12-17T18:07:56.300 INFO:teuthology.orchestra.run.smithi109.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-91-generic amd64 5.4.0-91.102 [8,992 kB] 2021-12-17T18:07:56.461 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-91-generic amd64 5.4.0-91.102 [39.4 MB] 2021-12-17T18:07:56.549 INFO:teuthology.orchestra.run.smithi158.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-91-generic amd64 5.4.0-91.102 [8,992 kB] 2021-12-17T18:07:56.552 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-91-generic amd64 5.4.0-91.102 [8,992 kB] 2021-12-17T18:07:56.584 INFO:teuthology.orchestra.run.smithi109.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-91-generic amd64 5.4.0-91.102 [39.4 MB] 2021-12-17T18:07:57.107 INFO:teuthology.orchestra.run.smithi158.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-91-generic amd64 5.4.0-91.102 [39.4 MB] 2021-12-17T18:07:57.107 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-91-generic amd64 5.4.0-91.102 [39.4 MB] 2021-12-17T18:07:58.722 INFO:teuthology.orchestra.run.smithi125.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.91.95 [1,896 B] 2021-12-17T18:07:58.722 INFO:teuthology.orchestra.run.smithi125.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.91.95 [2,572 B] 2021-12-17T18:07:58.723 INFO:teuthology.orchestra.run.smithi125.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-91 all 5.4.0-91.102 [11.0 MB] 2021-12-17T18:07:59.020 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.91.95 [1,896 B] 2021-12-17T18:07:59.021 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.91.95 [2,572 B] 2021-12-17T18:07:59.021 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-91 all 5.4.0-91.102 [11.0 MB] 2021-12-17T18:07:59.104 INFO:teuthology.orchestra.run.smithi125.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-91-generic amd64 5.4.0-91.102 [1,406 kB] 2021-12-17T18:07:59.134 INFO:teuthology.orchestra.run.smithi109.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.91.95 [1,896 B] 2021-12-17T18:07:59.134 INFO:teuthology.orchestra.run.smithi109.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.91.95 [2,572 B] 2021-12-17T18:07:59.135 INFO:teuthology.orchestra.run.smithi109.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-91 all 5.4.0-91.102 [11.0 MB] 2021-12-17T18:07:59.139 INFO:teuthology.orchestra.run.smithi125.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.91.95 [2,440 B] 2021-12-17T18:07:59.348 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-91-generic amd64 5.4.0-91.102 [1,406 kB] 2021-12-17T18:07:59.383 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.91.95 [2,440 B] 2021-12-17T18:07:59.409 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.91.95 [1,896 B] 2021-12-17T18:07:59.442 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.91.95 [2,572 B] 2021-12-17T18:07:59.443 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-91 all 5.4.0-91.102 [11.0 MB] 2021-12-17T18:07:59.476 INFO:teuthology.orchestra.run.smithi109.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-91-generic amd64 5.4.0-91.102 [1,406 kB] 2021-12-17T18:07:59.519 INFO:teuthology.orchestra.run.smithi109.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.91.95 [2,440 B] 2021-12-17T18:07:59.529 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.91.95 [1,896 B] 2021-12-17T18:07:59.554 INFO:teuthology.orchestra.run.smithi125.stdout:Fetched 75.6 MB in 5s (14.9 MB/s) 2021-12-17T18:07:59.596 INFO:teuthology.orchestra.run.smithi158.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.91.95 [2,572 B] 2021-12-17T18:07:59.596 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-91 all 5.4.0-91.102 [11.0 MB] 2021-12-17T18:07:59.741 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package linux-modules-5.4.0-91-generic. 2021-12-17T18:07:59.799 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 75.6 MB in 5s (15.4 MB/s) 2021-12-17T18:07:59.826 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-91-generic amd64 5.4.0-91.102 [1,406 kB] 2021-12-17T18:07:59.846 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.91.95 [2,440 B] 2021-12-17T18:07:59.910 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-91-generic amd64 5.4.0-91.102 [1,406 kB] 2021-12-17T18:07:59.924 INFO:teuthology.orchestra.run.smithi109.stdout:Fetched 75.6 MB in 5s (15.2 MB/s) 2021-12-17T18:07:59.944 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-modules-5.4.0-91-generic. 2021-12-17T18:07:59.956 INFO:teuthology.orchestra.run.smithi158.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.91.95 [2,440 B] 2021-12-17T18:08:00.085 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package linux-modules-5.4.0-91-generic. 2021-12-17T18:08:00.270 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 75.6 MB in 5s (14.9 MB/s) 2021-12-17T18:08:00.356 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 75.6 MB in 6s (13.7 MB/s) 2021-12-17T18:08:00.442 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-modules-5.4.0-91-generic. 2021-12-17T18:08:00.555 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package linux-modules-5.4.0-91-generic. 2021-12-17T18:08:01.560 INFO:teuthology.orchestra.run.smithi125.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-12-17T18:08:01.567 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../0-linux-modules-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:01.713 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking linux-modules-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:01.745 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-12-17T18:08:01.752 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../0-linux-modules-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:01.908 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-modules-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:01.960 INFO:teuthology.orchestra.run.smithi109.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-12-17T18:08:01.968 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../0-linux-modules-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:02.095 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking linux-modules-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:02.247 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-12-17T18:08:02.255 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../0-linux-modules-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:02.431 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-modules-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:02.492 INFO:teuthology.orchestra.run.smithi158.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-12-17T18:08:02.499 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../0-linux-modules-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:02.688 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-modules-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:03.751 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package linux-image-5.4.0-91-generic. 2021-12-17T18:08:03.769 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../1-linux-image-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:03.866 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking linux-image-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:03.886 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-image-5.4.0-91-generic. 2021-12-17T18:08:03.902 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../1-linux-image-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:04.006 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-image-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:04.100 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package linux-image-5.4.0-91-generic. 2021-12-17T18:08:04.116 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../1-linux-image-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:04.198 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking linux-image-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:04.542 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-image-5.4.0-91-generic. 2021-12-17T18:08:04.559 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../1-linux-image-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:04.649 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-image-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:04.881 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-91-generic. 2021-12-17T18:08:04.894 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:04.937 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking linux-modules-extra-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:04.997 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-91-generic. 2021-12-17T18:08:05.015 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:05.024 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package linux-image-5.4.0-91-generic. 2021-12-17T18:08:05.040 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../1-linux-image-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:05.056 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-modules-extra-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:05.138 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-image-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:05.181 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-91-generic. 2021-12-17T18:08:05.199 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:05.240 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking linux-modules-extra-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:05.661 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-91-generic. 2021-12-17T18:08:05.680 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:05.744 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-modules-extra-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:06.145 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-91-generic. 2021-12-17T18:08:06.160 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:06.220 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-modules-extra-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:09.934 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../3-linux-generic_5.4.0.91.95_amd64.deb ... 2021-12-17T18:08:10.054 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-generic (5.4.0.91.95) over (5.4.0.88.92) ... 2021-12-17T18:08:10.054 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../3-linux-generic_5.4.0.91.95_amd64.deb ... 2021-12-17T18:08:10.176 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking linux-generic (5.4.0.91.95) over (5.4.0.88.92) ... 2021-12-17T18:08:10.391 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.91.95_amd64.deb ... 2021-12-17T18:08:10.433 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../3-linux-generic_5.4.0.91.95_amd64.deb ... 2021-12-17T18:08:10.520 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.91.95_amd64.deb ... 2021-12-17T18:08:10.528 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-image-generic (5.4.0.91.95) over (5.4.0.88.92) ... 2021-12-17T18:08:10.581 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking linux-generic (5.4.0.91.95) over (5.4.0.88.92) ... 2021-12-17T18:08:10.648 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking linux-image-generic (5.4.0.91.95) over (5.4.0.88.92) ... 2021-12-17T18:08:10.777 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../3-linux-generic_5.4.0.91.95_amd64.deb ... 2021-12-17T18:08:10.876 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-headers-5.4.0-91. 2021-12-17T18:08:10.893 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../5-linux-headers-5.4.0-91_5.4.0-91.102_all.deb ... 2021-12-17T18:08:10.894 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.91.95_amd64.deb ... 2021-12-17T18:08:10.900 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-generic (5.4.0.91.95) over (5.4.0.88.92) ... 2021-12-17T18:08:10.936 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-headers-5.4.0-91 (5.4.0-91.102) ... 2021-12-17T18:08:10.990 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package linux-headers-5.4.0-91. 2021-12-17T18:08:11.007 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../5-linux-headers-5.4.0-91_5.4.0-91.102_all.deb ... 2021-12-17T18:08:11.011 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking linux-image-generic (5.4.0.91.95) over (5.4.0.88.92) ... 2021-12-17T18:08:11.050 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking linux-headers-5.4.0-91 (5.4.0-91.102) ... 2021-12-17T18:08:11.227 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.91.95_amd64.deb ... 2021-12-17T18:08:11.320 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../3-linux-generic_5.4.0.91.95_amd64.deb ... 2021-12-17T18:08:11.359 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package linux-headers-5.4.0-91. 2021-12-17T18:08:11.376 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../5-linux-headers-5.4.0-91_5.4.0-91.102_all.deb ... 2021-12-17T18:08:11.380 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-image-generic (5.4.0.91.95) over (5.4.0.88.92) ... 2021-12-17T18:08:11.410 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking linux-headers-5.4.0-91 (5.4.0-91.102) ... 2021-12-17T18:08:11.445 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-generic (5.4.0.91.95) over (5.4.0.88.92) ... 2021-12-17T18:08:11.738 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-headers-5.4.0-91. 2021-12-17T18:08:11.754 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../5-linux-headers-5.4.0-91_5.4.0-91.102_all.deb ... 2021-12-17T18:08:11.786 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.91.95_amd64.deb ... 2021-12-17T18:08:11.797 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-5.4.0-91 (5.4.0-91.102) ... 2021-12-17T18:08:11.937 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-image-generic (5.4.0.91.95) over (5.4.0.88.92) ... 2021-12-17T18:08:12.272 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package linux-headers-5.4.0-91. 2021-12-17T18:08:12.290 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../5-linux-headers-5.4.0-91_5.4.0-91.102_all.deb ... 2021-12-17T18:08:12.322 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-headers-5.4.0-91 (5.4.0-91.102) ... 2021-12-17T18:08:17.409 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package linux-headers-5.4.0-91-generic. 2021-12-17T18:08:17.433 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../6-linux-headers-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:17.475 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking linux-headers-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:17.577 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package linux-headers-5.4.0-91-generic. 2021-12-17T18:08:17.601 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../6-linux-headers-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:17.643 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking linux-headers-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:17.726 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-headers-5.4.0-91-generic. 2021-12-17T18:08:17.752 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../6-linux-headers-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:17.792 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-headers-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:18.045 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-headers-5.4.0-91-generic. 2021-12-17T18:08:18.070 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../6-linux-headers-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:18.111 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:18.886 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package linux-headers-5.4.0-91-generic. 2021-12-17T18:08:18.910 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../6-linux-headers-5.4.0-91-generic_5.4.0-91.102_amd64.deb ... 2021-12-17T18:08:18.977 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-headers-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:20.200 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.91.95_amd64.deb ... 2021-12-17T18:08:20.326 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking linux-headers-generic (5.4.0.91.95) over (5.4.0.88.92) ... 2021-12-17T18:08:20.358 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.91.95_amd64.deb ... 2021-12-17T18:08:20.492 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-headers-generic (5.4.0.91.95) over (5.4.0.88.92) ... 2021-12-17T18:08:20.685 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up linux-headers-5.4.0-91 (5.4.0-91.102) ... 2021-12-17T18:08:20.805 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up linux-headers-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:20.870 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-headers-5.4.0-91 (5.4.0-91.102) ... 2021-12-17T18:08:20.932 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up linux-modules-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:20.997 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-headers-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:21.118 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.91.95_amd64.deb ... 2021-12-17T18:08:21.123 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-modules-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:21.245 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-generic (5.4.0.91.95) over (5.4.0.88.92) ... 2021-12-17T18:08:21.508 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.91.95_amd64.deb ... 2021-12-17T18:08:21.644 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-5.4.0-91 (5.4.0-91.102) ... 2021-12-17T18:08:21.650 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking linux-headers-generic (5.4.0.91.95) over (5.4.0.88.92) ... 2021-12-17T18:08:21.774 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:21.875 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-modules-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:22.025 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up linux-headers-5.4.0-91 (5.4.0-91.102) ... 2021-12-17T18:08:22.145 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up linux-headers-generic (5.4.0.91.95) ... 2021-12-17T18:08:22.146 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up linux-headers-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:22.211 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.91.95_amd64.deb ... 2021-12-17T18:08:22.273 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up linux-modules-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:22.296 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up linux-image-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:22.317 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-headers-generic (5.4.0.91.95) ... 2021-12-17T18:08:22.336 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-headers-generic (5.4.0.91.95) over (5.4.0.88.92) ... 2021-12-17T18:08:22.706 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-headers-5.4.0-91 (5.4.0-91.102) ... 2021-12-17T18:08:22.808 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-headers-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:22.912 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-image-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:22.959 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-modules-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:23.077 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-generic (5.4.0.91.95) ... 2021-12-17T18:08:23.220 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-image-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:23.399 INFO:teuthology.orchestra.run.smithi109.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-12-17T18:08:23.399 INFO:teuthology.orchestra.run.smithi109.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-12-17T18:08:23.399 INFO:teuthology.orchestra.run.smithi109.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-91-generic 2021-12-17T18:08:23.400 INFO:teuthology.orchestra.run.smithi109.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:23.499 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up linux-headers-generic (5.4.0.91.95) ... 2021-12-17T18:08:23.625 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up linux-image-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:24.040 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up linux-modules-extra-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:24.047 INFO:teuthology.orchestra.run.smithi192.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-12-17T18:08:24.047 INFO:teuthology.orchestra.run.smithi192.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-12-17T18:08:24.047 INFO:teuthology.orchestra.run.smithi192.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-91-generic 2021-12-17T18:08:24.047 INFO:teuthology.orchestra.run.smithi192.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:24.162 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-headers-generic (5.4.0.91.95) ... 2021-12-17T18:08:24.196 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-modules-extra-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:24.296 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-image-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:24.602 INFO:teuthology.orchestra.run.smithi062.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-12-17T18:08:24.603 INFO:teuthology.orchestra.run.smithi062.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-12-17T18:08:24.603 INFO:teuthology.orchestra.run.smithi062.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-91-generic 2021-12-17T18:08:24.603 INFO:teuthology.orchestra.run.smithi062.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:24.744 INFO:teuthology.orchestra.run.smithi125.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-12-17T18:08:24.744 INFO:teuthology.orchestra.run.smithi125.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-12-17T18:08:24.745 INFO:teuthology.orchestra.run.smithi125.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-91-generic 2021-12-17T18:08:24.745 INFO:teuthology.orchestra.run.smithi125.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:24.886 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up linux-modules-extra-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:25.241 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up linux-image-generic (5.4.0.91.95) ... 2021-12-17T18:08:25.356 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-image-generic (5.4.0.91.95) ... 2021-12-17T18:08:25.367 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up linux-generic (5.4.0.91.95) ... 2021-12-17T18:08:25.449 INFO:teuthology.orchestra.run.smithi158.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-12-17T18:08:25.449 INFO:teuthology.orchestra.run.smithi158.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-12-17T18:08:25.449 INFO:teuthology.orchestra.run.smithi158.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-91-generic 2021-12-17T18:08:25.449 INFO:teuthology.orchestra.run.smithi158.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:25.482 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-generic (5.4.0.91.95) ... 2021-12-17T18:08:25.494 INFO:teuthology.orchestra.run.smithi109.stdout:Processing triggers for linux-image-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:25.583 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for linux-image-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:25.672 INFO:teuthology.orchestra.run.smithi109.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-12-17T18:08:25.673 INFO:teuthology.orchestra.run.smithi109.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:25.783 INFO:teuthology.orchestra.run.smithi192.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-12-17T18:08:25.783 INFO:teuthology.orchestra.run.smithi192.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:26.039 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-modules-extra-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:26.202 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-modules-extra-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:26.287 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up linux-image-generic (5.4.0.91.95) ... 2021-12-17T18:08:26.780 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up linux-generic (5.4.0.91.95) ... 2021-12-17T18:08:26.907 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for linux-image-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:27.100 INFO:teuthology.orchestra.run.smithi125.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-12-17T18:08:27.100 INFO:teuthology.orchestra.run.smithi125.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:27.240 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-image-generic (5.4.0.91.95) ... 2021-12-17T18:08:27.366 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-generic (5.4.0.91.95) ... 2021-12-17T18:08:27.367 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-image-generic (5.4.0.91.95) ... 2021-12-17T18:08:27.468 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for linux-image-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:27.493 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-generic (5.4.0.91.95) ... 2021-12-17T18:08:27.644 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for linux-image-5.4.0-91-generic (5.4.0-91.102) ... 2021-12-17T18:08:27.752 INFO:teuthology.orchestra.run.smithi062.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-12-17T18:08:27.753 INFO:teuthology.orchestra.run.smithi062.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:27.848 INFO:teuthology.orchestra.run.smithi158.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-12-17T18:08:27.849 INFO:teuthology.orchestra.run.smithi158.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:47.728 INFO:teuthology.orchestra.run.smithi109.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-12-17T18:08:47.730 INFO:teuthology.orchestra.run.smithi109.stdout:Sourcing file `/etc/default/grub' 2021-12-17T18:08:47.752 INFO:teuthology.orchestra.run.smithi109.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-12-17T18:08:47.782 INFO:teuthology.orchestra.run.smithi109.stdout:Generating grub configuration file ... 2021-12-17T18:08:47.783 INFO:teuthology.orchestra.run.smithi192.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-12-17T18:08:47.783 INFO:teuthology.orchestra.run.smithi192.stdout:Sourcing file `/etc/default/grub' 2021-12-17T18:08:47.804 INFO:teuthology.orchestra.run.smithi192.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-12-17T18:08:47.827 INFO:teuthology.orchestra.run.smithi192.stdout:Generating grub configuration file ... 2021-12-17T18:08:48.153 INFO:teuthology.orchestra.run.smithi109.stdout:Found linux image: /boot/vmlinuz-5.4.0-91-generic 2021-12-17T18:08:48.180 INFO:teuthology.orchestra.run.smithi109.stdout:Found initrd image: /boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:48.191 INFO:teuthology.orchestra.run.smithi192.stdout:Found linux image: /boot/vmlinuz-5.4.0-91-generic 2021-12-17T18:08:48.213 INFO:teuthology.orchestra.run.smithi192.stdout:Found initrd image: /boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:48.610 INFO:teuthology.orchestra.run.smithi109.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-12-17T18:08:48.622 INFO:teuthology.orchestra.run.smithi109.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-12-17T18:08:48.631 INFO:teuthology.orchestra.run.smithi192.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-12-17T18:08:48.645 INFO:teuthology.orchestra.run.smithi192.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-12-17T18:08:48.744 INFO:teuthology.orchestra.run.smithi109.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-12-17T18:08:48.755 INFO:teuthology.orchestra.run.smithi109.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-12-17T18:08:48.758 INFO:teuthology.orchestra.run.smithi192.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-12-17T18:08:48.769 INFO:teuthology.orchestra.run.smithi192.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-12-17T18:08:49.382 INFO:teuthology.orchestra.run.smithi125.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-12-17T18:08:49.382 INFO:teuthology.orchestra.run.smithi125.stdout:Sourcing file `/etc/default/grub' 2021-12-17T18:08:49.409 INFO:teuthology.orchestra.run.smithi125.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-12-17T18:08:49.432 INFO:teuthology.orchestra.run.smithi125.stdout:Generating grub configuration file ... 2021-12-17T18:08:49.837 INFO:teuthology.orchestra.run.smithi125.stdout:Found linux image: /boot/vmlinuz-5.4.0-91-generic 2021-12-17T18:08:49.867 INFO:teuthology.orchestra.run.smithi125.stdout:Found initrd image: /boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:49.890 INFO:teuthology.orchestra.run.smithi158.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-12-17T18:08:49.891 INFO:teuthology.orchestra.run.smithi158.stdout:Sourcing file `/etc/default/grub' 2021-12-17T18:08:49.904 INFO:teuthology.orchestra.run.smithi158.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-12-17T18:08:49.935 INFO:teuthology.orchestra.run.smithi158.stdout:Generating grub configuration file ... 2021-12-17T18:08:50.154 INFO:teuthology.orchestra.run.smithi062.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-12-17T18:08:50.154 INFO:teuthology.orchestra.run.smithi062.stdout:Sourcing file `/etc/default/grub' 2021-12-17T18:08:50.179 INFO:teuthology.orchestra.run.smithi062.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-12-17T18:08:50.192 INFO:teuthology.orchestra.run.smithi062.stdout:Generating grub configuration file ... 2021-12-17T18:08:50.302 INFO:teuthology.orchestra.run.smithi125.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-12-17T18:08:50.314 INFO:teuthology.orchestra.run.smithi125.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-12-17T18:08:50.349 INFO:teuthology.orchestra.run.smithi158.stdout:Found linux image: /boot/vmlinuz-5.4.0-91-generic 2021-12-17T18:08:50.378 INFO:teuthology.orchestra.run.smithi158.stdout:Found initrd image: /boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:50.423 INFO:teuthology.orchestra.run.smithi125.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-12-17T18:08:50.434 INFO:teuthology.orchestra.run.smithi125.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-12-17T18:08:50.524 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.4.0-91-generic 2021-12-17T18:08:50.547 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:50.797 INFO:teuthology.orchestra.run.smithi158.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-12-17T18:08:50.808 INFO:teuthology.orchestra.run.smithi158.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-12-17T18:08:50.911 INFO:teuthology.orchestra.run.smithi158.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-12-17T18:08:50.923 INFO:teuthology.orchestra.run.smithi158.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-12-17T18:08:50.968 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-12-17T18:08:50.979 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-12-17T18:08:51.085 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-12-17T18:08:51.097 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-12-17T18:08:51.400 INFO:teuthology.orchestra.run.smithi109.stdout:done 2021-12-17T18:08:51.404 INFO:teuthology.orchestra.run.smithi192.stdout:done 2021-12-17T18:08:51.776 DEBUG:teuthology.orchestra.run.smithi109:> dpkg -s linux-image-generic 2021-12-17T18:08:51.842 DEBUG:teuthology.orchestra.run.smithi192:> dpkg -s linux-image-generic 2021-12-17T18:08:51.855 INFO:teuthology.orchestra.run.smithi109.stdout:Package: linux-image-generic 2021-12-17T18:08:51.855 INFO:teuthology.orchestra.run.smithi109.stdout:Status: install ok installed 2021-12-17T18:08:51.856 INFO:teuthology.orchestra.run.smithi109.stdout:Priority: optional 2021-12-17T18:08:51.856 INFO:teuthology.orchestra.run.smithi109.stdout:Section: kernel 2021-12-17T18:08:51.856 INFO:teuthology.orchestra.run.smithi109.stdout:Installed-Size: 18 2021-12-17T18:08:51.856 INFO:teuthology.orchestra.run.smithi109.stdout:Maintainer: Ubuntu Kernel Team 2021-12-17T18:08:51.856 INFO:teuthology.orchestra.run.smithi109.stdout:Architecture: amd64 2021-12-17T18:08:51.857 INFO:teuthology.orchestra.run.smithi109.stdout:Source: linux-meta 2021-12-17T18:08:51.857 INFO:teuthology.orchestra.run.smithi109.stdout:Version: 5.4.0.91.95 2021-12-17T18:08:51.857 INFO:teuthology.orchestra.run.smithi109.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2021-12-17T18:08:51.857 INFO:teuthology.orchestra.run.smithi109.stdout:Depends: linux-image-5.4.0-91-generic, linux-modules-extra-5.4.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2021-12-17T18:08:51.858 INFO:teuthology.orchestra.run.smithi109.stdout:Recommends: thermald 2021-12-17T18:08:51.858 INFO:teuthology.orchestra.run.smithi109.stdout:Description: Generic Linux kernel image 2021-12-17T18:08:51.858 INFO:teuthology.orchestra.run.smithi109.stdout: This package will always depend on the latest generic kernel image 2021-12-17T18:08:51.858 INFO:teuthology.orchestra.run.smithi109.stdout: available. 2021-12-17T18:08:51.859 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-91-generic 2021-12-17T18:08:51.859 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-12-17T18:08:51.859 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-12-17T18:08:51.860 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-12-17T18:08:51.860 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi109.front.sepia.ceph.com, path=None, version=distro) 2021-12-17T18:08:51.861 DEBUG:teuthology.orchestra.run.smithi109:> sudo apt-get clean 2021-12-17T18:08:51.869 INFO:teuthology.orchestra.run.smithi192.stdout:Package: linux-image-generic 2021-12-17T18:08:51.869 INFO:teuthology.orchestra.run.smithi192.stdout:Status: install ok installed 2021-12-17T18:08:51.869 INFO:teuthology.orchestra.run.smithi192.stdout:Priority: optional 2021-12-17T18:08:51.870 INFO:teuthology.orchestra.run.smithi192.stdout:Section: kernel 2021-12-17T18:08:51.870 INFO:teuthology.orchestra.run.smithi192.stdout:Installed-Size: 18 2021-12-17T18:08:51.870 INFO:teuthology.orchestra.run.smithi192.stdout:Maintainer: Ubuntu Kernel Team 2021-12-17T18:08:51.870 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: amd64 2021-12-17T18:08:51.871 INFO:teuthology.orchestra.run.smithi192.stdout:Source: linux-meta 2021-12-17T18:08:51.871 INFO:teuthology.orchestra.run.smithi192.stdout:Version: 5.4.0.91.95 2021-12-17T18:08:51.871 INFO:teuthology.orchestra.run.smithi192.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2021-12-17T18:08:51.871 INFO:teuthology.orchestra.run.smithi192.stdout:Depends: linux-image-5.4.0-91-generic, linux-modules-extra-5.4.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2021-12-17T18:08:51.872 INFO:teuthology.orchestra.run.smithi192.stdout:Recommends: thermald 2021-12-17T18:08:51.872 INFO:teuthology.orchestra.run.smithi192.stdout:Description: Generic Linux kernel image 2021-12-17T18:08:51.872 INFO:teuthology.orchestra.run.smithi192.stdout: This package will always depend on the latest generic kernel image 2021-12-17T18:08:51.872 INFO:teuthology.orchestra.run.smithi192.stdout: available. 2021-12-17T18:08:51.874 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-91-generic 2021-12-17T18:08:51.874 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-12-17T18:08:51.874 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-12-17T18:08:51.874 INFO:teuthology.task.kernel:Installing distro kernel on client.2... 2021-12-17T18:08:51.875 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi192.front.sepia.ceph.com, path=None, version=distro) 2021-12-17T18:08:51.875 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get clean 2021-12-17T18:08:51.955 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get update 2021-12-17T18:08:51.973 DEBUG:teuthology.orchestra.run.smithi109:> sudo apt-get update 2021-12-17T18:08:52.123 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-12-17T18:08:52.136 INFO:teuthology.orchestra.run.smithi109.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-12-17T18:08:52.233 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-12-17T18:08:52.250 INFO:teuthology.orchestra.run.smithi109.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-12-17T18:08:52.346 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-12-17T18:08:52.361 INFO:teuthology.orchestra.run.smithi109.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-12-17T18:08:52.462 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-12-17T18:08:52.473 INFO:teuthology.orchestra.run.smithi109.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-12-17T18:08:53.073 INFO:teuthology.orchestra.run.smithi125.stdout:done 2021-12-17T18:08:53.507 DEBUG:teuthology.orchestra.run.smithi125:> dpkg -s linux-image-generic 2021-12-17T18:08:53.518 INFO:teuthology.orchestra.run.smithi158.stdout:done 2021-12-17T18:08:53.539 INFO:teuthology.orchestra.run.smithi125.stdout:Package: linux-image-generic 2021-12-17T18:08:53.540 INFO:teuthology.orchestra.run.smithi125.stdout:Status: install ok installed 2021-12-17T18:08:53.540 INFO:teuthology.orchestra.run.smithi125.stdout:Priority: optional 2021-12-17T18:08:53.540 INFO:teuthology.orchestra.run.smithi125.stdout:Section: kernel 2021-12-17T18:08:53.540 INFO:teuthology.orchestra.run.smithi125.stdout:Installed-Size: 18 2021-12-17T18:08:53.541 INFO:teuthology.orchestra.run.smithi125.stdout:Maintainer: Ubuntu Kernel Team 2021-12-17T18:08:53.541 INFO:teuthology.orchestra.run.smithi125.stdout:Architecture: amd64 2021-12-17T18:08:53.541 INFO:teuthology.orchestra.run.smithi125.stdout:Source: linux-meta 2021-12-17T18:08:53.541 INFO:teuthology.orchestra.run.smithi125.stdout:Version: 5.4.0.91.95 2021-12-17T18:08:53.542 INFO:teuthology.orchestra.run.smithi125.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2021-12-17T18:08:53.542 INFO:teuthology.orchestra.run.smithi125.stdout:Depends: linux-image-5.4.0-91-generic, linux-modules-extra-5.4.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2021-12-17T18:08:53.542 INFO:teuthology.orchestra.run.smithi125.stdout:Recommends: thermald 2021-12-17T18:08:53.542 INFO:teuthology.orchestra.run.smithi125.stdout:Description: Generic Linux kernel image 2021-12-17T18:08:53.543 INFO:teuthology.orchestra.run.smithi125.stdout: This package will always depend on the latest generic kernel image 2021-12-17T18:08:53.543 INFO:teuthology.orchestra.run.smithi125.stdout: available. 2021-12-17T18:08:53.543 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-91-generic 2021-12-17T18:08:53.544 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-12-17T18:08:53.544 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-12-17T18:08:53.544 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2021-12-17T18:08:53.544 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi125.front.sepia.ceph.com, path=None, version=distro) 2021-12-17T18:08:53.545 DEBUG:teuthology.orchestra.run.smithi125:> sudo apt-get clean 2021-12-17T18:08:53.623 DEBUG:teuthology.orchestra.run.smithi125:> sudo apt-get update 2021-12-17T18:08:53.636 INFO:teuthology.orchestra.run.smithi109.stdout:Reading package lists... 2021-12-17T18:08:53.641 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2021-12-17T18:08:53.660 DEBUG:teuthology.orchestra.run.smithi109:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-12-17T18:08:53.664 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-12-17T18:08:53.724 INFO:teuthology.orchestra.run.smithi109.stdout:Reading package lists... 2021-12-17T18:08:53.729 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2021-12-17T18:08:53.743 INFO:teuthology.orchestra.run.smithi062.stdout:done 2021-12-17T18:08:53.892 INFO:teuthology.orchestra.run.smithi109.stdout:Building dependency tree... 2021-12-17T18:08:53.893 INFO:teuthology.orchestra.run.smithi109.stdout:Reading state information... 2021-12-17T18:08:53.897 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2021-12-17T18:08:53.898 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2021-12-17T18:08:53.911 INFO:teuthology.orchestra.run.smithi125.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-12-17T18:08:53.912 INFO:teuthology.orchestra.run.smithi125.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-12-17T18:08:53.956 DEBUG:teuthology.orchestra.run.smithi158:> dpkg -s linux-image-generic 2021-12-17T18:08:53.992 INFO:teuthology.orchestra.run.smithi158.stdout:Package: linux-image-generic 2021-12-17T18:08:53.993 INFO:teuthology.orchestra.run.smithi158.stdout:Status: install ok installed 2021-12-17T18:08:53.993 INFO:teuthology.orchestra.run.smithi158.stdout:Priority: optional 2021-12-17T18:08:53.993 INFO:teuthology.orchestra.run.smithi158.stdout:Section: kernel 2021-12-17T18:08:53.993 INFO:teuthology.orchestra.run.smithi158.stdout:Installed-Size: 18 2021-12-17T18:08:53.994 INFO:teuthology.orchestra.run.smithi158.stdout:Maintainer: Ubuntu Kernel Team 2021-12-17T18:08:53.994 INFO:teuthology.orchestra.run.smithi158.stdout:Architecture: amd64 2021-12-17T18:08:53.994 INFO:teuthology.orchestra.run.smithi158.stdout:Source: linux-meta 2021-12-17T18:08:53.994 INFO:teuthology.orchestra.run.smithi158.stdout:Version: 5.4.0.91.95 2021-12-17T18:08:53.994 INFO:teuthology.orchestra.run.smithi158.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2021-12-17T18:08:53.995 INFO:teuthology.orchestra.run.smithi158.stdout:Depends: linux-image-5.4.0-91-generic, linux-modules-extra-5.4.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2021-12-17T18:08:53.995 INFO:teuthology.orchestra.run.smithi158.stdout:Recommends: thermald 2021-12-17T18:08:53.995 INFO:teuthology.orchestra.run.smithi158.stdout:Description: Generic Linux kernel image 2021-12-17T18:08:53.995 INFO:teuthology.orchestra.run.smithi158.stdout: This package will always depend on the latest generic kernel image 2021-12-17T18:08:53.996 INFO:teuthology.orchestra.run.smithi158.stdout: available. 2021-12-17T18:08:53.996 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-91-generic 2021-12-17T18:08:53.996 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-12-17T18:08:53.996 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-12-17T18:08:53.997 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2021-12-17T18:08:53.997 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi158.front.sepia.ceph.com, path=None, version=distro) 2021-12-17T18:08:53.997 DEBUG:teuthology.orchestra.run.smithi158:> sudo apt-get clean 2021-12-17T18:08:54.004 INFO:teuthology.orchestra.run.smithi125.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-12-17T18:08:54.035 INFO:teuthology.orchestra.run.smithi109.stdout:linux-image-generic is already the newest version (5.4.0.91.95). 2021-12-17T18:08:54.036 INFO:teuthology.orchestra.run.smithi109.stdout:The following packages were automatically installed and are no longer required: 2021-12-17T18:08:54.036 INFO:teuthology.orchestra.run.smithi109.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-12-17T18:08:54.036 INFO:teuthology.orchestra.run.smithi109.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-12-17T18:08:54.037 INFO:teuthology.orchestra.run.smithi109.stdout: linux-modules-extra-5.4.0-66-generic 2021-12-17T18:08:54.037 INFO:teuthology.orchestra.run.smithi109.stdout:Use 'sudo apt autoremove' to remove them. 2021-12-17T18:08:54.043 INFO:teuthology.orchestra.run.smithi192.stdout:linux-image-generic is already the newest version (5.4.0.91.95). 2021-12-17T18:08:54.043 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages were automatically installed and are no longer required: 2021-12-17T18:08:54.043 INFO:teuthology.orchestra.run.smithi192.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-12-17T18:08:54.044 INFO:teuthology.orchestra.run.smithi192.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-12-17T18:08:54.044 INFO:teuthology.orchestra.run.smithi192.stdout: linux-modules-extra-5.4.0-66-generic 2021-12-17T18:08:54.044 INFO:teuthology.orchestra.run.smithi192.stdout:Use 'sudo apt autoremove' to remove them. 2021-12-17T18:08:54.075 INFO:teuthology.orchestra.run.smithi109.stdout:0 upgraded, 0 newly installed, 0 to remove and 83 not upgraded. 2021-12-17T18:08:54.078 DEBUG:teuthology.orchestra.run.smithi109:> dpkg -s linux-image-generic 2021-12-17T18:08:54.082 INFO:teuthology.orchestra.run.smithi192.stdout:0 upgraded, 0 newly installed, 0 to remove and 83 not upgraded. 2021-12-17T18:08:54.084 DEBUG:teuthology.orchestra.run.smithi192:> dpkg -s linux-image-generic 2021-12-17T18:08:54.093 DEBUG:teuthology.orchestra.run.smithi158:> sudo apt-get update 2021-12-17T18:08:54.098 INFO:teuthology.orchestra.run.smithi109.stdout:Package: linux-image-generic 2021-12-17T18:08:54.098 INFO:teuthology.orchestra.run.smithi109.stdout:Status: install ok installed 2021-12-17T18:08:54.099 INFO:teuthology.orchestra.run.smithi109.stdout:Priority: optional 2021-12-17T18:08:54.099 INFO:teuthology.orchestra.run.smithi109.stdout:Section: kernel 2021-12-17T18:08:54.099 INFO:teuthology.orchestra.run.smithi109.stdout:Installed-Size: 18 2021-12-17T18:08:54.099 INFO:teuthology.orchestra.run.smithi109.stdout:Maintainer: Ubuntu Kernel Team 2021-12-17T18:08:54.099 INFO:teuthology.orchestra.run.smithi109.stdout:Architecture: amd64 2021-12-17T18:08:54.100 INFO:teuthology.orchestra.run.smithi109.stdout:Source: linux-meta 2021-12-17T18:08:54.100 INFO:teuthology.orchestra.run.smithi109.stdout:Version: 5.4.0.91.95 2021-12-17T18:08:54.101 INFO:teuthology.orchestra.run.smithi109.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2021-12-17T18:08:54.101 INFO:teuthology.orchestra.run.smithi109.stdout:Depends: linux-image-5.4.0-91-generic, linux-modules-extra-5.4.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2021-12-17T18:08:54.101 INFO:teuthology.orchestra.run.smithi109.stdout:Recommends: thermald 2021-12-17T18:08:54.102 INFO:teuthology.orchestra.run.smithi109.stdout:Description: Generic Linux kernel image 2021-12-17T18:08:54.102 INFO:teuthology.orchestra.run.smithi109.stdout: This package will always depend on the latest generic kernel image 2021-12-17T18:08:54.102 INFO:teuthology.orchestra.run.smithi109.stdout: available. 2021-12-17T18:08:54.104 DEBUG:teuthology.orchestra.run.smithi109:> mktemp 2021-12-17T18:08:54.107 INFO:teuthology.orchestra.run.smithi192.stdout:Package: linux-image-generic 2021-12-17T18:08:54.107 INFO:teuthology.orchestra.run.smithi192.stdout:Status: install ok installed 2021-12-17T18:08:54.108 INFO:teuthology.orchestra.run.smithi192.stdout:Priority: optional 2021-12-17T18:08:54.108 INFO:teuthology.orchestra.run.smithi192.stdout:Section: kernel 2021-12-17T18:08:54.109 INFO:teuthology.orchestra.run.smithi192.stdout:Installed-Size: 18 2021-12-17T18:08:54.109 INFO:teuthology.orchestra.run.smithi192.stdout:Maintainer: Ubuntu Kernel Team 2021-12-17T18:08:54.110 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: amd64 2021-12-17T18:08:54.110 INFO:teuthology.orchestra.run.smithi192.stdout:Source: linux-meta 2021-12-17T18:08:54.111 INFO:teuthology.orchestra.run.smithi192.stdout:Version: 5.4.0.91.95 2021-12-17T18:08:54.111 INFO:teuthology.orchestra.run.smithi192.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2021-12-17T18:08:54.112 INFO:teuthology.orchestra.run.smithi192.stdout:Depends: linux-image-5.4.0-91-generic, linux-modules-extra-5.4.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2021-12-17T18:08:54.112 INFO:teuthology.orchestra.run.smithi192.stdout:Recommends: thermald 2021-12-17T18:08:54.112 INFO:teuthology.orchestra.run.smithi192.stdout:Description: Generic Linux kernel image 2021-12-17T18:08:54.113 INFO:teuthology.orchestra.run.smithi192.stdout: This package will always depend on the latest generic kernel image 2021-12-17T18:08:54.113 INFO:teuthology.orchestra.run.smithi192.stdout: available. 2021-12-17T18:08:54.114 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2021-12-17T18:08:54.116 INFO:teuthology.orchestra.run.smithi109.stdout:/tmp/tmp.2Kspz4lFMt 2021-12-17T18:08:54.117 DEBUG:teuthology.orchestra.run.smithi109:> sudo cp /boot/grub/grub.cfg /tmp/tmp.2Kspz4lFMt 2021-12-17T18:08:54.123 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.mOoKFVWT7X 2021-12-17T18:08:54.124 DEBUG:teuthology.orchestra.run.smithi192:> sudo cp /boot/grub/grub.cfg /tmp/tmp.mOoKFVWT7X 2021-12-17T18:08:54.154 DEBUG:teuthology.orchestra.run.smithi062:> dpkg -s linux-image-generic 2021-12-17T18:08:54.154 INFO:teuthology.orchestra.run.smithi125.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-12-17T18:08:54.173 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod 0666 /tmp/tmp.2Kspz4lFMt 2021-12-17T18:08:54.180 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.mOoKFVWT7X 2021-12-17T18:08:54.187 INFO:teuthology.orchestra.run.smithi062.stdout:Package: linux-image-generic 2021-12-17T18:08:54.187 INFO:teuthology.orchestra.run.smithi062.stdout:Status: install ok installed 2021-12-17T18:08:54.187 INFO:teuthology.orchestra.run.smithi062.stdout:Priority: optional 2021-12-17T18:08:54.188 INFO:teuthology.orchestra.run.smithi062.stdout:Section: kernel 2021-12-17T18:08:54.188 INFO:teuthology.orchestra.run.smithi062.stdout:Installed-Size: 18 2021-12-17T18:08:54.188 INFO:teuthology.orchestra.run.smithi062.stdout:Maintainer: Ubuntu Kernel Team 2021-12-17T18:08:54.188 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: amd64 2021-12-17T18:08:54.189 INFO:teuthology.orchestra.run.smithi062.stdout:Source: linux-meta 2021-12-17T18:08:54.189 INFO:teuthology.orchestra.run.smithi062.stdout:Version: 5.4.0.91.95 2021-12-17T18:08:54.189 INFO:teuthology.orchestra.run.smithi062.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2021-12-17T18:08:54.189 INFO:teuthology.orchestra.run.smithi062.stdout:Depends: linux-image-5.4.0-91-generic, linux-modules-extra-5.4.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2021-12-17T18:08:54.190 INFO:teuthology.orchestra.run.smithi062.stdout:Recommends: thermald 2021-12-17T18:08:54.190 INFO:teuthology.orchestra.run.smithi062.stdout:Description: Generic Linux kernel image 2021-12-17T18:08:54.190 INFO:teuthology.orchestra.run.smithi062.stdout: This package will always depend on the latest generic kernel image 2021-12-17T18:08:54.190 INFO:teuthology.orchestra.run.smithi062.stdout: available. 2021-12-17T18:08:54.191 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-91-generic 2021-12-17T18:08:54.191 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-12-17T18:08:54.191 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-12-17T18:08:54.192 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-12-17T18:08:54.192 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=None, version=distro) 2021-12-17T18:08:54.192 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get clean 2021-12-17T18:08:54.217 DEBUG:teuthology.orchestra.remote:smithi109:/tmp/tmp.2Kspz4lFMt is 10KB 2021-12-17T18:08:54.223 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.mOoKFVWT7X is 10KB 2021-12-17T18:08:54.229 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-12-17T18:08:54.235 DEBUG:teuthology.orchestra.run.smithi109:> rm -fr /tmp/tmp.2Kspz4lFMt 2021-12-17T18:08:54.243 DEBUG:teuthology.orchestra.run.smithi109:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-12-17T18:08:54.274 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.mOoKFVWT7X 2021-12-17T18:08:54.276 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2021-12-17T18:08:54.283 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-12-17T18:08:54.297 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2021-12-17T18:08:54.298 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-12-17T18:08:54.298 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-12-17T18:08:54.301 DEBUG:teuthology.orchestra.run.smithi109:> set -ex 2021-12-17T18:08:54.302 DEBUG:teuthology.orchestra.run.smithi109:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-12-17T18:08:54.302 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-12-17T18:08:54.340 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-12-17T18:08:54.347 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-91-generic 2021-12-17T18:08:54.347 DEBUG:teuthology.orchestra.run.smithi192:> sudo update-grub 2021-12-17T18:08:54.348 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-91-generic 2021-12-17T18:08:54.349 DEBUG:teuthology.orchestra.run.smithi109:> sudo update-grub 2021-12-17T18:08:54.422 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-12-17T18:08:54.505 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-12-17T18:08:54.543 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-12-17T18:08:54.543 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-12-17T18:08:54.614 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-12-17T18:08:54.716 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-12-17T18:08:55.422 INFO:teuthology.orchestra.run.smithi125.stdout:Reading package lists... 2021-12-17T18:08:55.446 DEBUG:teuthology.orchestra.run.smithi125:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-12-17T18:08:55.510 INFO:teuthology.orchestra.run.smithi125.stdout:Reading package lists... 2021-12-17T18:08:55.642 INFO:teuthology.orchestra.run.smithi109.stderr:Sourcing file `/etc/default/grub' 2021-12-17T18:08:55.644 INFO:teuthology.orchestra.run.smithi109.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-12-17T18:08:55.664 INFO:teuthology.orchestra.run.smithi109.stderr:Generating grub configuration file ... 2021-12-17T18:08:55.682 INFO:teuthology.orchestra.run.smithi192.stderr:Sourcing file `/etc/default/grub' 2021-12-17T18:08:55.684 INFO:teuthology.orchestra.run.smithi192.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-12-17T18:08:55.691 INFO:teuthology.orchestra.run.smithi125.stdout:Building dependency tree... 2021-12-17T18:08:55.692 INFO:teuthology.orchestra.run.smithi125.stdout:Reading state information... 2021-12-17T18:08:55.700 INFO:teuthology.orchestra.run.smithi192.stderr:Generating grub configuration file ... 2021-12-17T18:08:55.754 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2021-12-17T18:08:55.777 DEBUG:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-12-17T18:08:55.838 INFO:teuthology.orchestra.run.smithi125.stdout:linux-image-generic is already the newest version (5.4.0.91.95). 2021-12-17T18:08:55.838 INFO:teuthology.orchestra.run.smithi125.stdout:The following packages were automatically installed and are no longer required: 2021-12-17T18:08:55.838 INFO:teuthology.orchestra.run.smithi125.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-12-17T18:08:55.838 INFO:teuthology.orchestra.run.smithi125.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-12-17T18:08:55.839 INFO:teuthology.orchestra.run.smithi125.stdout: linux-modules-extra-5.4.0-66-generic 2021-12-17T18:08:55.839 INFO:teuthology.orchestra.run.smithi125.stdout:Use 'sudo apt autoremove' to remove them. 2021-12-17T18:08:55.841 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2021-12-17T18:08:55.879 INFO:teuthology.orchestra.run.smithi125.stdout:0 upgraded, 0 newly installed, 0 to remove and 83 not upgraded. 2021-12-17T18:08:55.881 DEBUG:teuthology.orchestra.run.smithi125:> dpkg -s linux-image-generic 2021-12-17T18:08:55.904 INFO:teuthology.orchestra.run.smithi125.stdout:Package: linux-image-generic 2021-12-17T18:08:55.904 INFO:teuthology.orchestra.run.smithi125.stdout:Status: install ok installed 2021-12-17T18:08:55.904 INFO:teuthology.orchestra.run.smithi125.stdout:Priority: optional 2021-12-17T18:08:55.905 INFO:teuthology.orchestra.run.smithi125.stdout:Section: kernel 2021-12-17T18:08:55.905 INFO:teuthology.orchestra.run.smithi125.stdout:Installed-Size: 18 2021-12-17T18:08:55.905 INFO:teuthology.orchestra.run.smithi125.stdout:Maintainer: Ubuntu Kernel Team 2021-12-17T18:08:55.905 INFO:teuthology.orchestra.run.smithi125.stdout:Architecture: amd64 2021-12-17T18:08:55.906 INFO:teuthology.orchestra.run.smithi125.stdout:Source: linux-meta 2021-12-17T18:08:55.906 INFO:teuthology.orchestra.run.smithi125.stdout:Version: 5.4.0.91.95 2021-12-17T18:08:55.906 INFO:teuthology.orchestra.run.smithi125.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2021-12-17T18:08:55.906 INFO:teuthology.orchestra.run.smithi125.stdout:Depends: linux-image-5.4.0-91-generic, linux-modules-extra-5.4.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2021-12-17T18:08:55.907 INFO:teuthology.orchestra.run.smithi125.stdout:Recommends: thermald 2021-12-17T18:08:55.907 INFO:teuthology.orchestra.run.smithi125.stdout:Description: Generic Linux kernel image 2021-12-17T18:08:55.907 INFO:teuthology.orchestra.run.smithi125.stdout: This package will always depend on the latest generic kernel image 2021-12-17T18:08:55.907 INFO:teuthology.orchestra.run.smithi125.stdout: available. 2021-12-17T18:08:55.908 DEBUG:teuthology.orchestra.run.smithi125:> mktemp 2021-12-17T18:08:55.912 INFO:teuthology.orchestra.run.smithi125.stdout:/tmp/tmp.xa6hTOvXMe 2021-12-17T18:08:55.913 DEBUG:teuthology.orchestra.run.smithi125:> sudo cp /boot/grub/grub.cfg /tmp/tmp.xa6hTOvXMe 2021-12-17T18:08:55.915 INFO:teuthology.orchestra.run.smithi109.stderr:Found linux image: /boot/vmlinuz-5.4.0-91-generic 2021-12-17T18:08:55.927 INFO:teuthology.orchestra.run.smithi109.stderr:Found initrd image: /boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:55.956 INFO:teuthology.orchestra.run.smithi192.stderr:Found linux image: /boot/vmlinuz-5.4.0-91-generic 2021-12-17T18:08:55.968 INFO:teuthology.orchestra.run.smithi192.stderr:Found initrd image: /boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:55.977 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0666 /tmp/tmp.xa6hTOvXMe 2021-12-17T18:08:56.009 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2021-12-17T18:08:56.010 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2021-12-17T18:08:56.021 DEBUG:teuthology.orchestra.remote:smithi125:/tmp/tmp.xa6hTOvXMe is 10KB 2021-12-17T18:08:56.035 DEBUG:teuthology.orchestra.run.smithi125:> rm -fr /tmp/tmp.xa6hTOvXMe 2021-12-17T18:08:56.042 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-12-17T18:08:56.089 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2021-12-17T18:08:56.098 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2021-12-17T18:08:56.099 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-12-17T18:08:56.099 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-12-17T18:08:56.112 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-12-17T18:08:56.146 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-91-generic 2021-12-17T18:08:56.147 DEBUG:teuthology.orchestra.run.smithi125:> sudo update-grub 2021-12-17T18:08:56.148 INFO:teuthology.orchestra.run.smithi158.stdout:linux-image-generic is already the newest version (5.4.0.91.95). 2021-12-17T18:08:56.148 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages were automatically installed and are no longer required: 2021-12-17T18:08:56.149 INFO:teuthology.orchestra.run.smithi158.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-12-17T18:08:56.149 INFO:teuthology.orchestra.run.smithi158.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-12-17T18:08:56.149 INFO:teuthology.orchestra.run.smithi158.stdout: linux-modules-extra-5.4.0-66-generic 2021-12-17T18:08:56.149 INFO:teuthology.orchestra.run.smithi158.stdout:Use 'sudo apt autoremove' to remove them. 2021-12-17T18:08:56.181 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2021-12-17T18:08:56.183 INFO:teuthology.orchestra.run.smithi158.stdout:0 upgraded, 0 newly installed, 0 to remove and 83 not upgraded. 2021-12-17T18:08:56.185 DEBUG:teuthology.orchestra.run.smithi158:> dpkg -s linux-image-generic 2021-12-17T18:08:56.205 INFO:teuthology.orchestra.run.smithi158.stdout:Package: linux-image-generic 2021-12-17T18:08:56.205 INFO:teuthology.orchestra.run.smithi158.stdout:Status: install ok installed 2021-12-17T18:08:56.205 INFO:teuthology.orchestra.run.smithi158.stdout:Priority: optional 2021-12-17T18:08:56.205 INFO:teuthology.orchestra.run.smithi158.stdout:Section: kernel 2021-12-17T18:08:56.206 INFO:teuthology.orchestra.run.smithi158.stdout:Installed-Size: 18 2021-12-17T18:08:56.206 INFO:teuthology.orchestra.run.smithi158.stdout:Maintainer: Ubuntu Kernel Team 2021-12-17T18:08:56.206 INFO:teuthology.orchestra.run.smithi158.stdout:Architecture: amd64 2021-12-17T18:08:56.206 INFO:teuthology.orchestra.run.smithi158.stdout:Source: linux-meta 2021-12-17T18:08:56.207 INFO:teuthology.orchestra.run.smithi158.stdout:Version: 5.4.0.91.95 2021-12-17T18:08:56.207 INFO:teuthology.orchestra.run.smithi158.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2021-12-17T18:08:56.207 INFO:teuthology.orchestra.run.smithi158.stdout:Depends: linux-image-5.4.0-91-generic, linux-modules-extra-5.4.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2021-12-17T18:08:56.207 INFO:teuthology.orchestra.run.smithi158.stdout:Recommends: thermald 2021-12-17T18:08:56.208 INFO:teuthology.orchestra.run.smithi158.stdout:Description: Generic Linux kernel image 2021-12-17T18:08:56.208 INFO:teuthology.orchestra.run.smithi158.stdout: This package will always depend on the latest generic kernel image 2021-12-17T18:08:56.208 INFO:teuthology.orchestra.run.smithi158.stdout: available. 2021-12-17T18:08:56.208 DEBUG:teuthology.orchestra.run.smithi158:> mktemp 2021-12-17T18:08:56.213 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.pc72fbAeAw 2021-12-17T18:08:56.213 DEBUG:teuthology.orchestra.run.smithi158:> sudo cp /boot/grub/grub.cfg /tmp/tmp.pc72fbAeAw 2021-12-17T18:08:56.272 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.pc72fbAeAw 2021-12-17T18:08:56.305 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.pc72fbAeAw is 10KB 2021-12-17T18:08:56.311 INFO:teuthology.orchestra.run.smithi109.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-12-17T18:08:56.319 DEBUG:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.pc72fbAeAw 2021-12-17T18:08:56.323 INFO:teuthology.orchestra.run.smithi109.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-12-17T18:08:56.325 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-12-17T18:08:56.353 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2021-12-17T18:08:56.354 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2021-12-17T18:08:56.382 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2021-12-17T18:08:56.382 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-12-17T18:08:56.382 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-12-17T18:08:56.386 INFO:teuthology.orchestra.run.smithi192.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-12-17T18:08:56.398 INFO:teuthology.orchestra.run.smithi192.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-12-17T18:08:56.421 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-91-generic 2021-12-17T18:08:56.422 DEBUG:teuthology.orchestra.run.smithi158:> sudo update-grub 2021-12-17T18:08:56.423 INFO:teuthology.orchestra.run.smithi109.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-12-17T18:08:56.433 INFO:teuthology.orchestra.run.smithi109.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-12-17T18:08:56.494 INFO:teuthology.orchestra.run.smithi192.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-12-17T18:08:56.505 INFO:teuthology.orchestra.run.smithi062.stdout:linux-image-generic is already the newest version (5.4.0.91.95). 2021-12-17T18:08:56.505 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2021-12-17T18:08:56.505 INFO:teuthology.orchestra.run.smithi062.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-12-17T18:08:56.505 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-12-17T18:08:56.506 INFO:teuthology.orchestra.run.smithi192.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-12-17T18:08:56.506 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-extra-5.4.0-66-generic 2021-12-17T18:08:56.507 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2021-12-17T18:08:56.544 INFO:teuthology.orchestra.run.smithi062.stdout:0 upgraded, 0 newly installed, 0 to remove and 83 not upgraded. 2021-12-17T18:08:56.546 DEBUG:teuthology.orchestra.run.smithi062:> dpkg -s linux-image-generic 2021-12-17T18:08:56.569 INFO:teuthology.orchestra.run.smithi062.stdout:Package: linux-image-generic 2021-12-17T18:08:56.570 INFO:teuthology.orchestra.run.smithi062.stdout:Status: install ok installed 2021-12-17T18:08:56.570 INFO:teuthology.orchestra.run.smithi062.stdout:Priority: optional 2021-12-17T18:08:56.570 INFO:teuthology.orchestra.run.smithi062.stdout:Section: kernel 2021-12-17T18:08:56.570 INFO:teuthology.orchestra.run.smithi062.stdout:Installed-Size: 18 2021-12-17T18:08:56.571 INFO:teuthology.orchestra.run.smithi062.stdout:Maintainer: Ubuntu Kernel Team 2021-12-17T18:08:56.571 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: amd64 2021-12-17T18:08:56.571 INFO:teuthology.orchestra.run.smithi062.stdout:Source: linux-meta 2021-12-17T18:08:56.571 INFO:teuthology.orchestra.run.smithi062.stdout:Version: 5.4.0.91.95 2021-12-17T18:08:56.571 INFO:teuthology.orchestra.run.smithi062.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2021-12-17T18:08:56.572 INFO:teuthology.orchestra.run.smithi062.stdout:Depends: linux-image-5.4.0-91-generic, linux-modules-extra-5.4.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2021-12-17T18:08:56.572 INFO:teuthology.orchestra.run.smithi062.stdout:Recommends: thermald 2021-12-17T18:08:56.572 INFO:teuthology.orchestra.run.smithi062.stdout:Description: Generic Linux kernel image 2021-12-17T18:08:56.572 INFO:teuthology.orchestra.run.smithi062.stdout: This package will always depend on the latest generic kernel image 2021-12-17T18:08:56.573 INFO:teuthology.orchestra.run.smithi062.stdout: available. 2021-12-17T18:08:56.573 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-12-17T18:08:56.580 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.bZvBYKbtz7 2021-12-17T18:08:56.580 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub/grub.cfg /tmp/tmp.bZvBYKbtz7 2021-12-17T18:08:56.638 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.bZvBYKbtz7 2021-12-17T18:08:56.687 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.bZvBYKbtz7 is 10KB 2021-12-17T18:08:56.703 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.bZvBYKbtz7 2021-12-17T18:08:56.711 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-12-17T18:08:56.769 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-12-17T18:08:56.770 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-12-17T18:08:56.770 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-12-17T18:08:56.810 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-91-generic 2021-12-17T18:08:56.811 DEBUG:teuthology.orchestra.run.smithi062:> sudo update-grub 2021-12-17T18:08:57.518 INFO:teuthology.orchestra.run.smithi125.stderr:Sourcing file `/etc/default/grub' 2021-12-17T18:08:57.520 INFO:teuthology.orchestra.run.smithi125.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-12-17T18:08:57.530 INFO:teuthology.orchestra.run.smithi125.stderr:Generating grub configuration file ... 2021-12-17T18:08:57.770 INFO:teuthology.orchestra.run.smithi125.stderr:Found linux image: /boot/vmlinuz-5.4.0-91-generic 2021-12-17T18:08:57.781 INFO:teuthology.orchestra.run.smithi125.stderr:Found initrd image: /boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:57.824 INFO:teuthology.orchestra.run.smithi158.stderr:Sourcing file `/etc/default/grub' 2021-12-17T18:08:57.826 INFO:teuthology.orchestra.run.smithi158.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-12-17T18:08:57.833 INFO:teuthology.orchestra.run.smithi158.stderr:Generating grub configuration file ... 2021-12-17T18:08:58.082 INFO:teuthology.orchestra.run.smithi109.stderr:done 2021-12-17T18:08:58.084 DEBUG:teuthology.orchestra.run.smithi109:> sudo shutdown -r now 2021-12-17T18:08:58.096 INFO:teuthology.orchestra.run.smithi158.stderr:Found linux image: /boot/vmlinuz-5.4.0-91-generic 2021-12-17T18:08:58.107 INFO:teuthology.orchestra.run.smithi158.stderr:Found initrd image: /boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:58.118 INFO:teuthology.orchestra.run.smithi192.stderr:done 2021-12-17T18:08:58.120 DEBUG:teuthology.orchestra.run.smithi192:> sudo shutdown -r now 2021-12-17T18:08:58.141 INFO:teuthology.orchestra.run.smithi125.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-12-17T18:08:58.153 INFO:teuthology.orchestra.run.smithi125.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-12-17T18:08:58.247 INFO:teuthology.orchestra.run.smithi125.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-12-17T18:08:58.258 INFO:teuthology.orchestra.run.smithi125.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-12-17T18:08:58.321 INFO:teuthology.orchestra.run.smithi062.stderr:Sourcing file `/etc/default/grub' 2021-12-17T18:08:58.323 INFO:teuthology.orchestra.run.smithi062.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-12-17T18:08:58.341 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2021-12-17T18:08:58.488 INFO:teuthology.orchestra.run.smithi158.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-12-17T18:08:58.500 INFO:teuthology.orchestra.run.smithi158.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-12-17T18:08:58.583 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.4.0-91-generic 2021-12-17T18:08:58.595 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.4.0-91-generic 2021-12-17T18:08:58.595 INFO:teuthology.orchestra.run.smithi158.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-12-17T18:08:58.607 INFO:teuthology.orchestra.run.smithi158.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-12-17T18:08:58.964 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-12-17T18:08:58.976 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-12-17T18:08:59.073 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-12-17T18:08:59.084 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-12-17T18:08:59.913 INFO:teuthology.orchestra.run.smithi125.stderr:done 2021-12-17T18:08:59.914 DEBUG:teuthology.orchestra.run.smithi125:> sudo shutdown -r now 2021-12-17T18:09:00.239 INFO:teuthology.orchestra.run.smithi158.stderr:done 2021-12-17T18:09:00.241 DEBUG:teuthology.orchestra.run.smithi158:> sudo shutdown -r now 2021-12-17T18:09:00.723 INFO:teuthology.orchestra.run.smithi062.stderr:done 2021-12-17T18:09:00.724 DEBUG:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2021-12-17T18:09:28.115 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-12-17T18:09:28.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi109.front.sepia.ceph.com' 2021-12-17T18:09:28.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:09:28.123 INFO:teuthology.task.kernel:Checking client client.2 for new kernel version... 2021-12-17T18:09:28.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2021-12-17T18:09:28.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:09:29.919 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2021-12-17T18:09:29.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2021-12-17T18:09:29.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:09:30.245 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2021-12-17T18:09:30.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2021-12-17T18:09:30.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:09:30.727 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-12-17T18:09:30.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2021-12-17T18:09:30.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:10:46.492 DEBUG:teuthology.orchestra.remote:timed out 2021-12-17T18:10:46.496 DEBUG:teuthology.orchestra.remote:timed out 2021-12-17T18:10:48.236 DEBUG:teuthology.orchestra.remote:timed out 2021-12-17T18:10:48.752 DEBUG:teuthology.orchestra.remote:timed out 2021-12-17T18:10:49.264 DEBUG:teuthology.orchestra.remote:timed out 2021-12-17T18:11:16.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi109.front.sepia.ceph.com' 2021-12-17T18:11:16.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:11:16.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2021-12-17T18:11:16.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:11:16.734 DEBUG:teuthology.orchestra.run.smithi192:> true 2021-12-17T18:11:16.777 DEBUG:teuthology.orchestra.run.smithi109:> true 2021-12-17T18:11:17.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2021-12-17T18:11:17.366 INFO:teuthology.task.kernel:Checking kernel version of client.2, want "5.4.0-91-generic"... 2021-12-17T18:11:17.368 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2021-12-17T18:11:17.374 INFO:teuthology.orchestra.run.smithi192.stdout:5.4.0-91-generic 2021-12-17T18:11:17.375 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-91-generic vs 5.4.0-91-generic 2021-12-17T18:11:17.375 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-12-17T18:11:17.376 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-12-17T18:11:17.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi109.front.sepia.ceph.com' 2021-12-17T18:11:17.384 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-91-generic"... 2021-12-17T18:11:17.384 DEBUG:teuthology.orchestra.run.smithi109:> uname -r 2021-12-17T18:11:17.391 INFO:teuthology.orchestra.run.smithi109.stdout:5.4.0-91-generic 2021-12-17T18:11:17.391 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-91-generic vs 5.4.0-91-generic 2021-12-17T18:11:17.391 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-12-17T18:11:17.392 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-12-17T18:11:18.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2021-12-17T18:11:18.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:11:18.377 INFO:teuthology.task.kernel:Enabling kdb on client.2... 2021-12-17T18:11:18.377 DEBUG:teuthology.orchestra.run.smithi192:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-12-17T18:11:18.393 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-12-17T18:11:18.393 DEBUG:teuthology.orchestra.run.smithi109:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-12-17T18:11:18.462 INFO:teuthology.orchestra.run.smithi109.stdout:ttyS1 2021-12-17T18:11:18.467 INFO:teuthology.orchestra.run.smithi192.stdout:ttyS1 2021-12-17T18:11:18.486 DEBUG:teuthology.orchestra.run.smithi125:> true 2021-12-17T18:11:18.492 DEBUG:teuthology.parallel:result is None 2021-12-17T18:11:18.495 DEBUG:teuthology.parallel:result is None 2021-12-17T18:11:18.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2021-12-17T18:11:18.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:11:18.984 DEBUG:teuthology.orchestra.run.smithi158:> true 2021-12-17T18:11:19.095 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2021-12-17T18:11:19.096 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.4.0-91-generic"... 2021-12-17T18:11:19.096 DEBUG:teuthology.orchestra.run.smithi125:> uname -r 2021-12-17T18:11:19.145 INFO:teuthology.orchestra.run.smithi125.stdout:5.4.0-91-generic 2021-12-17T18:11:19.146 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-91-generic vs 5.4.0-91-generic 2021-12-17T18:11:19.146 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-12-17T18:11:19.146 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-12-17T18:11:19.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2021-12-17T18:11:19.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:11:19.465 DEBUG:teuthology.orchestra.run.smithi062:> true 2021-12-17T18:11:19.575 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2021-12-17T18:11:19.576 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.4.0-91-generic"... 2021-12-17T18:11:19.576 DEBUG:teuthology.orchestra.run.smithi158:> uname -r 2021-12-17T18:11:19.584 INFO:teuthology.orchestra.run.smithi158.stdout:5.4.0-91-generic 2021-12-17T18:11:19.584 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-91-generic vs 5.4.0-91-generic 2021-12-17T18:11:19.584 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-12-17T18:11:19.585 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-12-17T18:11:20.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2021-12-17T18:11:20.082 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-91-generic"... 2021-12-17T18:11:20.083 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2021-12-17T18:11:20.090 INFO:teuthology.orchestra.run.smithi062.stdout:5.4.0-91-generic 2021-12-17T18:11:20.090 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-91-generic vs 5.4.0-91-generic 2021-12-17T18:11:20.091 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-12-17T18:11:20.091 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-12-17T18:11:20.147 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2021-12-17T18:11:20.148 DEBUG:teuthology.orchestra.run.smithi125:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-12-17T18:11:20.224 INFO:teuthology.orchestra.run.smithi125.stdout:ttyS1 2021-12-17T18:11:20.250 DEBUG:teuthology.parallel:result is None 2021-12-17T18:11:20.585 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2021-12-17T18:11:20.586 DEBUG:teuthology.orchestra.run.smithi158:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-12-17T18:11:20.656 INFO:teuthology.orchestra.run.smithi158.stdout:ttyS1 2021-12-17T18:11:20.672 DEBUG:teuthology.parallel:result is None 2021-12-17T18:11:21.092 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-12-17T18:11:21.093 DEBUG:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-12-17T18:11:21.145 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2021-12-17T18:11:21.166 DEBUG:teuthology.parallel:result is None 2021-12-17T18:11:21.166 INFO:teuthology.run_tasks:Running task internal.base... 2021-12-17T18:11:21.174 INFO:teuthology.task.internal:Creating test directory... 2021-12-17T18:11:21.175 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-12-17T18:11:21.177 DEBUG:teuthology.orchestra.run.smithi109:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-12-17T18:11:21.180 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-12-17T18:11:21.183 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-12-17T18:11:21.186 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-12-17T18:11:21.194 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-12-17T18:11:21.217 INFO:teuthology.run_tasks:Running task internal.archive... 2021-12-17T18:11:21.291 INFO:teuthology.task.internal:Creating archive directory... 2021-12-17T18:11:21.292 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-12-17T18:11:21.295 DEBUG:teuthology.orchestra.run.smithi109:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-12-17T18:11:21.298 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-12-17T18:11:21.301 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-12-17T18:11:21.303 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-12-17T18:11:21.330 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-12-17T18:11:21.341 INFO:teuthology.task.internal:Enabling coredump saving... 2021-12-17T18:11:21.341 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-12-17T18:11:21.349 DEBUG:teuthology.orchestra.run.smithi109:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-12-17T18:11:21.351 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-12-17T18:11:21.354 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-12-17T18:11:21.357 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-12-17T18:11:21.369 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-12-17T18:11:21.373 INFO:teuthology.orchestra.run.smithi109.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-12-17T18:11:21.373 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-12-17T18:11:21.380 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-12-17T18:11:21.380 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-12-17T18:11:21.382 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-12-17T18:11:21.383 INFO:teuthology.orchestra.run.smithi109.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-12-17T18:11:21.386 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-12-17T18:11:21.391 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-12-17T18:11:21.397 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-12-17T18:11:21.398 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-12-17T18:11:21.409 INFO:teuthology.task.internal:Configuring sudo... 2021-12-17T18:11:21.410 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-12-17T18:11:21.412 DEBUG:teuthology.orchestra.run.smithi109:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-12-17T18:11:21.430 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-12-17T18:11:21.433 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-12-17T18:11:21.436 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-12-17T18:11:21.453 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-12-17T18:11:21.464 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-12-17T18:11:21.464 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-12-17T18:11:21.473 DEBUG:teuthology.orchestra.run.smithi109:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-12-17T18:11:21.476 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-12-17T18:11:21.478 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-12-17T18:11:21.480 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-12-17T18:11:21.488 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-12-17T18:11:21.495 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-12-17T18:11:21.502 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-12-17T18:11:21.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-12-17T18:11:21.574 DEBUG:teuthology.orchestra.run.smithi109:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-12-17T18:11:21.581 DEBUG:teuthology.orchestra.run.smithi109:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-12-17T18:11:21.589 DEBUG:teuthology.orchestra.run.smithi109:> set -ex 2021-12-17T18:11:21.589 DEBUG:teuthology.orchestra.run.smithi109:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-12-17T18:11:21.610 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-12-17T18:11:21.618 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-12-17T18:11:21.625 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2021-12-17T18:11:21.625 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-12-17T18:11:21.645 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-12-17T18:11:21.652 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-12-17T18:11:21.659 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2021-12-17T18:11:21.659 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-12-17T18:11:21.686 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-12-17T18:11:21.694 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-12-17T18:11:21.701 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2021-12-17T18:11:21.702 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-12-17T18:11:21.723 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2021-12-17T18:11:21.725 DEBUG:teuthology.orchestra.run.smithi109:> sudo service rsyslog restart 2021-12-17T18:11:21.728 DEBUG:teuthology.orchestra.run.smithi125:> sudo service rsyslog restart 2021-12-17T18:11:21.730 DEBUG:teuthology.orchestra.run.smithi158:> sudo service rsyslog restart 2021-12-17T18:11:21.733 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2021-12-17T18:11:21.814 INFO:teuthology.run_tasks:Running task internal.timer... 2021-12-17T18:11:21.825 INFO:teuthology.task.internal:Starting timer... 2021-12-17T18:11:21.825 INFO:teuthology.run_tasks:Running task pcp... 2021-12-17T18:11:21.910 INFO:teuthology.run_tasks:Running task selinux... 2021-12-17T18:11:21.951 DEBUG:teuthology.task.selinux:Excluding smithi062: OS 'ubuntu' does not support SELinux 2021-12-17T18:11:21.952 DEBUG:teuthology.task.selinux:Excluding smithi109: OS 'ubuntu' does not support SELinux 2021-12-17T18:11:21.952 DEBUG:teuthology.task.selinux:Excluding smithi125: OS 'ubuntu' does not support SELinux 2021-12-17T18:11:21.952 DEBUG:teuthology.task.selinux:Excluding smithi158: OS 'ubuntu' does not support SELinux 2021-12-17T18:11:21.952 DEBUG:teuthology.task.selinux:Excluding smithi192: OS 'ubuntu' does not support SELinux 2021-12-17T18:11:21.953 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-12-17T18:11:21.953 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-12-17T18:11:21.953 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-12-17T18:11:21.954 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-12-17T18:11:21.994 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2021-12-17T18:11:22.000 INFO:teuthology.repo_utils:Fetching master from origin 2021-12-17T18:11:22.033 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-12-17T18:11:22.053 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-12-17T18:11:22.054 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi062.front.sepia.ceph.com,smithi109.front.sepia.ceph.com,smithi125.front.sepia.ceph.com,smithi158.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-12-17T18:11:22.442 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-12-17T18:11:23.299 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-12-17T18:11:26.292 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-12-17T18:11:26.406 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:26 +0000 (0:00:00.132) 0:00:00.132 ******* 2021-12-17T18:11:26.420 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:26 +0000 (0:00:00.013) 0:00:00.145 ******* 2021-12-17T18:11:26.432 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:26 +0000 (0:00:00.012) 0:00:00.158 ******* 2021-12-17T18:11:26.445 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:26 +0000 (0:00:00.012) 0:00:00.170 ******* 2021-12-17T18:11:26.458 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:26 +0000 (0:00:00.013) 0:00:00.184 ******* 2021-12-17T18:11:28.586 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-12-17T18:11:28.588 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi062.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi062.front.sepia.ceph.com] 2021-12-17T18:11:28.622 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi192.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi192.front.sepia.ceph.com] 2021-12-17T18:11:28.633 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi158.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2021-12-17T18:11:28.635 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] 2021-12-17T18:11:28.663 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:28 +0000 (0:00:02.204) 0:00:02.388 ******* 2021-12-17T18:11:28.702 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi109.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi109.front.sepia.ceph.com] 2021-12-17T18:11:28.742 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:28 +0000 (0:00:00.079) 0:00:02.468 ******* 2021-12-17T18:11:28.767 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:28 +0000 (0:00:00.024) 0:00:02.492 ******* 2021-12-17T18:11:28.796 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:28 +0000 (0:00:00.028) 0:00:02.521 ******* 2021-12-17T18:11:28.807 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi125.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi125.front.sepia.ceph.com] 2021-12-17T18:11:28.864 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:28 +0000 (0:00:00.068) 0:00:02.590 ******* 2021-12-17T18:11:28.881 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-12-17T18:11:28.883 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-12-17T18:11:28.908 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:28 +0000 (0:00:00.043) 0:00:02.633 ******* 2021-12-17T18:11:28.929 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:28 +0000 (0:00:00.020) 0:00:02.654 ******* 2021-12-17T18:11:28.935 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-12-17T18:11:28.937 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-12-17T18:11:28.962 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:28 +0000 (0:00:00.032) 0:00:02.687 ******* 2021-12-17T18:11:28.985 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:28 +0000 (0:00:00.023) 0:00:02.710 ******* 2021-12-17T18:11:29.003 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-12-17T18:11:29.028 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:29 +0000 (0:00:00.042) 0:00:02.753 ******* 2021-12-17T18:11:29.407 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-12-17T18:11:29.408 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} ok: [smithi109.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-12-17T18:11:29.410 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-12-17T18:11:29.433 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:29 +0000 (0:00:00.406) 0:00:03.159 ******* 2021-12-17T18:11:29.455 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:29 +0000 (0:00:00.021) 0:00:03.180 ******* 2021-12-17T18:11:29.478 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:29 +0000 (0:00:00.023) 0:00:03.204 ******* 2021-12-17T18:11:29.487 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-12-17T18:11:29.488 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-12-17T18:11:29.516 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:29 +0000 (0:00:00.037) 0:00:03.241 ******* 2021-12-17T18:11:29.540 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:29 +0000 (0:00:00.023) 0:00:03.265 ******* 2021-12-17T18:11:29.547 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-12-17T18:11:29.549 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:29.575 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:29 +0000 (0:00:00.034) 0:00:03.300 ******* 2021-12-17T18:11:29.605 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:29 +0000 (0:00:00.030) 0:00:03.330 ******* 2021-12-17T18:11:29.636 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:29 +0000 (0:00:00.030) 0:00:03.361 ******* 2021-12-17T18:11:29.643 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:29.645 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:29.670 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:29 +0000 (0:00:00.033) 0:00:03.395 ******* 2021-12-17T18:11:29.691 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:29 +0000 (0:00:00.021) 0:00:03.416 ******* 2021-12-17T18:11:29.917 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-12-17T18:11:29.919 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:11:29.942 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:29 +0000 (0:00:00.251) 0:00:03.668 ******* 2021-12-17T18:11:29.965 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:29 +0000 (0:00:00.022) 0:00:03.690 ******* 2021-12-17T18:11:29.972 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:11:29.973 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:11:29.975 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:11:30.001 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:29 +0000 (0:00:00.036) 0:00:03.726 ******* 2021-12-17T18:11:30.024 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:30 +0000 (0:00:00.023) 0:00:03.749 ******* 2021-12-17T18:11:30.047 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:30 +0000 (0:00:00.022) 0:00:03.772 ******* 2021-12-17T18:11:30.823 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-12-17T18:11:30.825 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-12-17T18:11:30.827 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-12-17T18:11:30.849 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:30 +0000 (0:00:00.802) 0:00:04.574 ******* 2021-12-17T18:11:30.870 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:30 +0000 (0:00:00.021) 0:00:04.596 ******* 2021-12-17T18:11:30.891 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:30 +0000 (0:00:00.021) 0:00:04.617 ******* 2021-12-17T18:11:30.917 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:30 +0000 (0:00:00.025) 0:00:04.642 ******* 2021-12-17T18:11:30.924 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-12-17T18:11:30.951 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:30 +0000 (0:00:00.033) 0:00:04.676 ******* 2021-12-17T18:11:31.313 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-12-17T18:11:31.315 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-12-17T18:11:31.316 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2021-12-17T18:11:31.318 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2021-12-17T18:11:31.320 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEz 2021-12-17T18:11:31.322 INFO:teuthology.task.ansible.out:IKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-12-17T18:11:31.362 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-12-17T18:11:31.363 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2021-12-17T18:11:31.365 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2021-12-17T18:11:31.367 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-12-17T18:11:31.488 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-12-17T18:11:31.490 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-12-17T18:11:31.505 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-12-17T18:11:31.506 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:31 +0000 (0:00:00.554) 0:00:05.230 ******* 2021-12-17T18:11:32.209 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] 2021-12-17T18:11:32.232 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] 2021-12-17T18:11:32.257 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] 2021-12-17T18:11:32.280 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] 2021-12-17T18:11:32.301 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] 2021-12-17T18:11:32.322 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** Friday 17 December 2021 18:11:32 +0000 (0:00:00.817) 0:00:06.048 ******* 2021-12-17T18:11:32.351 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-12-17T18:11:32.373 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-12-17T18:11:32.399 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-12-17T18:11:32.418 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-12-17T18:11:32.429 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-12-17T18:11:32.435 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-12-17T18:11:32.594 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:32 +0000 (0:00:00.271) 0:00:06.319 ******* 2021-12-17T18:11:32.617 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:32 +0000 (0:00:00.023) 0:00:06.342 ******* 2021-12-17T18:11:32.641 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:32 +0000 (0:00:00.023) 0:00:06.366 ******* 2021-12-17T18:11:32.664 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:32 +0000 (0:00:00.022) 0:00:06.389 ******* 2021-12-17T18:11:32.689 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:32 +0000 (0:00:00.025) 0:00:06.414 ******* 2021-12-17T18:11:33.492 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi062.front.sepia.ceph.com] 2021-12-17T18:11:33.533 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] 2021-12-17T18:11:33.691 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] 2021-12-17T18:11:33.704 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] 2021-12-17T18:11:33.715 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] 2021-12-17T18:11:33.746 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-12-17T18:11:33.748 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:33 +0000 (0:00:01.057) 0:00:07.472 ******* 2021-12-17T18:11:33.835 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:33 +0000 (0:00:00.088) 0:00:07.560 ******* 2021-12-17T18:11:33.861 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:33 +0000 (0:00:00.026) 0:00:07.587 ******* 2021-12-17T18:11:33.888 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:33 +0000 (0:00:00.026) 0:00:07.613 ******* 2021-12-17T18:11:33.915 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:33 +0000 (0:00:00.026) 0:00:07.640 ******* 2021-12-17T18:11:34.272 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-12-17T18:11:34.276 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.204666", "end": "2021-12-17 18:11:34.248623", "rc": 0, "start": "2021-12-17 18:11:34.043957", "stderr": "", "stderr_lines": [], "stdout": "271ee3bd41c26a34f5caf35e3fcae76aca032a42", "stdout_lines": ["271ee3bd41c26a34f5caf35e3fcae76aca032a42"]} 2021-12-17T18:11:34.300 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.385) 0:00:08.025 ******* 2021-12-17T18:11:34.308 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.198274", "end": "2021-12-17 18:11:34.255840", "rc": 0, "start": "2021-12-17 18:11:34.057566", "stderr": "", "stderr_lines": [], "stdout": "271ee3bd41c26a34f5caf35e3fcae76aca032a42", "stdout_lines": ["271ee3bd41c26a34f5caf35e3fcae76aca032a42"]} 2021-12-17T18:11:34.336 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.036) 0:00:08.062 ******* 2021-12-17T18:11:34.345 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.207483", "end": "2021-12-17 18:11:34.295171", "rc": 0, "start": "2021-12-17 18:11:34.087688", "stderr": "", "stderr_lines": [], "stdout": "271ee3bd41c26a34f5caf35e3fcae76aca032a42", "stdout_lines": ["271ee3bd41c26a34f5caf35e3fcae76aca032a42"]} 2021-12-17T18:11:34.372 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.035) 0:00:08.097 ******* 2021-12-17T18:11:34.379 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.233077", "end": "2021-12-17 18:11:34.329675", "rc": 0, "start": "2021-12-17 18:11:34.096598", "stderr": "", "stderr_lines": [], "stdout": "271ee3bd41c26a34f5caf35e3fcae76aca032a42", "stdout_lines": ["271ee3bd41c26a34f5caf35e3fcae76aca032a42"]} 2021-12-17T18:11:34.380 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.210299", "end": "2021-12-17 18:11:34.348863", "rc": 0, "start": "2021-12-17 18:11:34.138564", "stderr": "", "stderr_lines": [], "stdout": "271ee3bd41c26a34f5caf35e3fcae76aca032a42", "stdout_lines": ["271ee3bd41c26a34f5caf35e3fcae76aca032a42"]} 2021-12-17T18:11:34.409 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.037) 0:00:08.135 ******* 2021-12-17T18:11:34.433 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.023) 0:00:08.159 ******* 2021-12-17T18:11:34.451 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-12-17T18:11:34.453 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.017373", "end": "2021-12-17 18:11:34.109437", "failed_when_result": false, "rc": 0, "start": "2021-12-17 18:11:34.092064", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-12-17T18:11:34.484 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.050) 0:00:08.209 ******* 2021-12-17T18:11:34.493 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.016820", "end": "2021-12-17 18:11:34.765588", "failed_when_result": false, "rc": 0, "start": "2021-12-17 18:11:34.748768", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-12-17T18:11:34.521 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.037) 0:00:08.246 ******* 2021-12-17T18:11:34.529 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.017883", "end": "2021-12-17 18:11:34.261871", "failed_when_result": false, "rc": 0, "start": "2021-12-17 18:11:34.243988", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-12-17T18:11:34.566 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.044) 0:00:08.291 ******* 2021-12-17T18:11:34.574 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013042", "end": "2021-12-17 18:11:34.330365", "failed_when_result": false, "rc": 0, "start": "2021-12-17 18:11:34.317323", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-12-17T18:11:34.576 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:34.603 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.036) 0:00:08.328 ******* 2021-12-17T18:11:34.627 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.023) 0:00:08.352 ******* 2021-12-17T18:11:34.635 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-12-17T18:11:34.636 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.022264", "end": "2021-12-17 18:11:34.578957", "failed_when_result": false, "rc": 0, "start": "2021-12-17 18:11:34.556693", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:34.637 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:34.664 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.037) 0:00:08.389 ******* 2021-12-17T18:11:34.689 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.024) 0:00:08.414 ******* 2021-12-17T18:11:34.712 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.022) 0:00:08.437 ******* 2021-12-17T18:11:34.718 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-12-17T18:11:34.720 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:34.748 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.035) 0:00:08.472 ******* 2021-12-17T18:11:34.770 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.022) 0:00:08.495 ******* 2021-12-17T18:11:34.778 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-12-17T18:11:34.779 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:34.805 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.035) 0:00:08.530 ******* 2021-12-17T18:11:34.828 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.022) 0:00:08.553 ******* 2021-12-17T18:11:34.835 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-12-17T18:11:34.837 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove managed_admin_users from managed_users] *************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:34.862 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.034) 0:00:08.588 ******* 2021-12-17T18:11:34.886 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.023) 0:00:08.611 ******* 2021-12-17T18:11:34.893 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-12-17T18:11:34.894 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove managed_admin_users from managed_users] *************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:34.926 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.040) 0:00:08.652 ******* 2021-12-17T18:11:34.952 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.025) 0:00:08.677 ******* 2021-12-17T18:11:34.962 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:34.987 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:34 +0000 (0:00:00.035) 0:00:08.713 ******* 2021-12-17T18:11:34.997 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:35.000 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Filter the managed_users list] ******************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:35.025 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.037) 0:00:08.751 ******* 2021-12-17T18:11:35.049 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.023) 0:00:08.774 ******* 2021-12-17T18:11:35.072 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.023) 0:00:08.798 ******* 2021-12-17T18:11:35.079 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-12-17T18:11:35.081 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Filter the managed_users list] ******************************************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:35.107 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.034) 0:00:08.832 ******* 2021-12-17T18:11:35.130 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.022) 0:00:08.855 ******* 2021-12-17T18:11:35.137 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-12-17T18:11:35.139 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:35.164 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.034) 0:00:08.889 ******* 2021-12-17T18:11:35.186 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.022) 0:00:08.911 ******* 2021-12-17T18:11:35.194 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:35.195 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:35.221 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.034) 0:00:08.946 ******* 2021-12-17T18:11:35.243 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.022) 0:00:08.969 ******* 2021-12-17T18:11:35.250 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-12-17T18:11:35.252 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:35.283 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.039) 0:00:09.008 ******* 2021-12-17T18:11:35.323 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:35.347 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.064) 0:00:09.073 ******* 2021-12-17T18:11:35.354 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-12-17T18:11:35.355 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:35.357 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:11:35.383 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.035) 0:00:09.108 ******* 2021-12-17T18:11:35.406 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.022) 0:00:09.131 ******* 2021-12-17T18:11:35.416 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:11:35.416 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:11:35.445 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.039) 0:00:09.170 ******* 2021-12-17T18:11:35.469 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.024) 0:00:09.194 ******* 2021-12-17T18:11:35.478 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-12-17T18:11:35.479 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:11:35.505 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.035) 0:00:09.230 ******* 2021-12-17T18:11:35.587 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-12-17T18:11:35.589 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:11:35.614 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.108) 0:00:09.339 ******* 2021-12-17T18:11:35.622 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-12-17T18:11:35.624 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-12-17T18:11:35.687 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-12-17T18:11:35.689 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [Create all admin users with sudo access.] ******************************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-12-17T18:11:35.715 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:35 +0000 (0:00:00.100) 0:00:09.440 ******* 2021-12-17T18:11:35.721 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-12-17T18:11:35.766 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-12-17T18:11:35.831 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-12-17T18:11:35.853 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-12-17T18:11:35.865 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-12-17T18:11:35.919 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-12-17T18:11:35.962 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-12-17T18:11:35.985 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-12-17T18:11:35.998 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-12-17T18:11:35.999 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-12-17T18:11:36.064 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-12-17T18:11:36.107 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-12-17T18:11:36.119 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-12-17T18:11:36.141 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-12-17T18:11:36.142 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-12-17T18:11:36.209 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-12-17T18:11:36.253 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-12-17T18:11:36.264 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-12-17T18:11:36.277 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-12-17T18:11:36.289 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-12-17T18:11:36.354 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-12-17T18:11:36.397 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-12-17T18:11:36.409 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-12-17T18:11:36.422 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-12-17T18:11:36.435 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-12-17T18:11:36.499 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-12-17T18:11:36.543 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-12-17T18:11:36.556 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-12-17T18:11:36.558 INFO:teuthology.task.ansible.out: 2021-12-17T18:11:36.580 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-12-17T18:11:36.581 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-12-17T18:11:36.658 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-12-17T18:11:36.691 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-12-17T18:11:36.703 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-12-17T18:11:36.715 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-12-17T18:11:36.727 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-12-17T18:11:36.802 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-12-17T18:11:36.835 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-12-17T18:11:36.856 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-12-17T18:11:36.868 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-12-17T18:11:36.869 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-12-17T18:11:36.965 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-12-17T18:11:36.976 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-12-17T18:11:37.008 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-12-17T18:11:37.009 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-12-17T18:11:37.011 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-12-17T18:11:37.108 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-12-17T18:11:37.119 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-12-17T18:11:37.153 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-12-17T18:11:37.155 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-12-17T18:11:37.157 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-12-17T18:11:37.254 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-12-17T18:11:37.266 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-12-17T18:11:37.299 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-12-17T18:11:37.300 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-12-17T18:11:37.301 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-12-17T18:11:37.399 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-12-17T18:11:37.411 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-12-17T18:11:37.443 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-12-17T18:11:37.444 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-12-17T18:11:37.457 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-12-17T18:11:37.543 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-12-17T18:11:37.556 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-12-17T18:11:37.590 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-12-17T18:11:37.591 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-12-17T18:11:37.603 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-12-17T18:11:37.688 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-12-17T18:11:37.700 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-12-17T18:11:37.736 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-12-17T18:11:37.738 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-12-17T18:11:37.751 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-12-17T18:11:37.852 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-12-17T18:11:37.854 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-12-17T18:11:37.878 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-12-17T18:11:37.890 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-12-17T18:11:37.903 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-12-17T18:11:38.000 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-12-17T18:11:38.011 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-12-17T18:11:38.023 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-12-17T18:11:38.035 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-12-17T18:11:38.047 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-12-17T18:11:38.143 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-12-17T18:11:38.155 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-12-17T18:11:38.167 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-12-17T18:11:38.178 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-12-17T18:11:38.190 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-12-17T18:11:38.285 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-12-17T18:11:38.296 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-12-17T18:11:38.308 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-12-17T18:11:38.332 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-12-17T18:11:38.343 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-12-17T18:11:38.428 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-12-17T18:11:38.441 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-12-17T18:11:38.464 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-12-17T18:11:38.475 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-12-17T18:11:38.477 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-12-17T18:11:38.572 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-12-17T18:11:38.595 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-12-17T18:11:38.608 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-12-17T18:11:38.620 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-12-17T18:11:38.632 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-12-17T18:11:38.717 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-12-17T18:11:38.740 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-12-17T18:11:38.752 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-12-17T18:11:38.763 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-12-17T18:11:38.775 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-12-17T18:11:38.860 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-12-17T18:11:38.882 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-12-17T18:11:38.916 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-12-17T18:11:38.918 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-12-17T18:11:39.014 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-12-17T18:11:39.025 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-12-17T18:11:39.048 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-12-17T18:11:39.060 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-12-17T18:11:39.062 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-12-17T18:11:39.156 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-12-17T18:11:39.179 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-12-17T18:11:39.190 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-12-17T18:11:39.204 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-12-17T18:11:39.205 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-12-17T18:11:39.300 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-12-17T18:11:39.322 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-12-17T18:11:39.334 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-12-17T18:11:39.345 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-12-17T18:11:39.357 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-12-17T18:11:39.444 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-12-17T18:11:39.466 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-12-17T18:11:39.488 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-12-17T18:11:39.490 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-12-17T18:11:39.492 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-12-17T18:11:39.597 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-12-17T18:11:39.609 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-12-17T18:11:39.631 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-12-17T18:11:39.642 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-12-17T18:11:39.643 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-12-17T18:11:39.740 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-12-17T18:11:39.762 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-12-17T18:11:39.773 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-12-17T18:11:39.785 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-12-17T18:11:39.786 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-12-17T18:11:39.882 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-12-17T18:11:39.905 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-12-17T18:11:39.917 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-12-17T18:11:39.929 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-12-17T18:11:39.931 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-12-17T18:11:40.029 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-12-17T18:11:40.051 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-12-17T18:11:40.063 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-12-17T18:11:40.076 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-12-17T18:11:40.077 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-12-17T18:11:40.174 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-12-17T18:11:40.197 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-12-17T18:11:40.199 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-12-17T18:11:40.211 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-12-17T18:11:40.222 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-12-17T18:11:40.329 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-12-17T18:11:40.354 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-12-17T18:11:40.355 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-12-17T18:11:40.366 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-12-17T18:11:40.367 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-12-17T18:11:40.467 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-12-17T18:11:40.490 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-12-17T18:11:40.502 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-12-17T18:11:40.504 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-12-17T18:11:40.611 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-12-17T18:11:40.633 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-12-17T18:11:40.646 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-12-17T18:11:40.649 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-12-17T18:11:40.659 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-12-17T18:11:40.767 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-12-17T18:11:40.778 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-12-17T18:11:40.792 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-12-17T18:11:40.792 INFO:teuthology.task.ansible.out: 2021-12-17T18:11:40.794 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-12-17T18:11:40.805 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-12-17T18:11:40.910 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-12-17T18:11:40.932 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-12-17T18:11:40.944 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-12-17T18:11:40.945 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-12-17T18:11:40.946 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-12-17T18:11:41.052 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-12-17T18:11:41.074 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-12-17T18:11:41.085 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-12-17T18:11:41.086 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-12-17T18:11:41.098 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-12-17T18:11:41.203 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-12-17T18:11:41.215 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-12-17T18:11:41.227 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-12-17T18:11:41.239 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-12-17T18:11:41.240 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-12-17T18:11:41.347 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-12-17T18:11:41.358 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-12-17T18:11:41.380 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-12-17T18:11:41.381 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-12-17T18:11:41.383 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-12-17T18:11:41.489 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-12-17T18:11:41.511 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-12-17T18:11:41.535 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-12-17T18:11:41.536 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-12-17T18:11:41.538 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-12-17T18:11:41.633 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-12-17T18:11:41.655 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-12-17T18:11:41.677 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-12-17T18:11:41.678 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-12-17T18:11:41.680 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-12-17T18:11:41.775 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-12-17T18:11:41.798 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-12-17T18:11:41.819 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-12-17T18:11:41.831 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-12-17T18:11:41.833 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-12-17T18:11:41.928 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-12-17T18:11:41.940 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-12-17T18:11:41.974 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-12-17T18:11:41.978 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-12-17T18:11:42.072 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-12-17T18:11:42.083 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-12-17T18:11:42.116 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-12-17T18:11:42.118 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-12-17T18:11:42.129 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-12-17T18:11:42.215 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-12-17T18:11:42.237 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-12-17T18:11:42.260 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-12-17T18:11:42.261 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-12-17T18:11:42.272 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-12-17T18:11:42.358 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-12-17T18:11:42.380 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-12-17T18:11:42.403 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-12-17T18:11:42.414 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-12-17T18:11:42.415 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-12-17T18:11:42.502 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-12-17T18:11:42.524 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-12-17T18:11:42.546 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-12-17T18:11:42.547 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-12-17T18:11:42.559 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-12-17T18:11:42.654 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-12-17T18:11:42.665 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-12-17T18:11:42.687 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-12-17T18:11:42.699 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-12-17T18:11:42.700 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-12-17T18:11:42.796 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-12-17T18:11:42.807 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-12-17T18:11:42.831 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-12-17T18:11:42.844 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-12-17T18:11:42.846 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-12-17T18:11:42.935 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-12-17T18:11:42.947 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-12-17T18:11:42.980 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-12-17T18:11:42.982 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-12-17T18:11:42.983 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-12-17T18:11:43.079 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-12-17T18:11:43.090 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-12-17T18:11:43.127 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-12-17T18:11:43.128 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-12-17T18:11:43.140 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-12-17T18:11:43.226 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-12-17T18:11:43.238 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-12-17T18:11:43.271 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-12-17T18:11:43.272 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-12-17T18:11:43.284 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-12-17T18:11:43.369 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-12-17T18:11:43.381 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-12-17T18:11:43.415 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-12-17T18:11:43.416 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-12-17T18:11:43.428 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-12-17T18:11:43.515 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-12-17T18:11:43.526 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-12-17T18:11:43.560 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-12-17T18:11:43.561 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-12-17T18:11:43.573 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-12-17T18:11:43.668 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-12-17T18:11:43.670 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-12-17T18:11:43.701 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-12-17T18:11:43.702 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-12-17T18:11:43.724 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-12-17T18:11:43.810 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-12-17T18:11:43.811 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-12-17T18:11:43.843 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-12-17T18:11:43.844 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-12-17T18:11:43.878 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-12-17T18:11:43.954 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-12-17T18:11:43.954 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-12-17T18:11:43.999 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-12-17T18:11:44.000 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-12-17T18:11:44.034 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-12-17T18:11:44.100 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-12-17T18:11:44.101 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-12-17T18:11:44.144 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-12-17T18:11:44.145 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-12-17T18:11:44.188 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-12-17T18:11:44.241 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-12-17T18:11:44.242 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-12-17T18:11:44.288 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-12-17T18:11:44.289 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-12-17T18:11:44.333 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-12-17T18:11:44.387 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-12-17T18:11:44.388 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-12-17T18:11:44.432 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-12-17T18:11:44.433 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-12-17T18:11:44.478 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-12-17T18:11:44.533 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-12-17T18:11:44.534 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-12-17T18:11:44.567 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-12-17T18:11:44.579 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-12-17T18:11:44.622 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-12-17T18:11:44.676 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-12-17T18:11:44.687 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-12-17T18:11:44.720 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-12-17T18:11:44.723 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-12-17T18:11:44.766 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-12-17T18:11:44.819 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-12-17T18:11:44.830 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-12-17T18:11:44.853 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-12-17T18:11:44.854 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-12-17T18:11:44.919 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-12-17T18:11:44.962 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-12-17T18:11:44.973 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-12-17T18:11:44.996 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-12-17T18:11:44.996 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-12-17T18:11:45.061 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-12-17T18:11:45.104 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-12-17T18:11:45.126 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-12-17T18:11:45.138 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-12-17T18:11:45.139 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-12-17T18:11:45.204 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-12-17T18:11:45.259 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-12-17T18:11:45.271 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-12-17T18:11:45.283 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-12-17T18:11:45.284 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-12-17T18:11:45.359 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-12-17T18:11:45.391 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-12-17T18:11:45.428 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-12-17T18:11:45.430 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-12-17T18:11:45.504 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-12-17T18:11:45.537 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-12-17T18:11:45.559 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-12-17T18:11:45.560 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-12-17T18:11:45.571 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-12-17T18:11:45.646 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-12-17T18:11:45.679 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-12-17T18:11:45.702 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-12-17T18:11:45.703 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-12-17T18:11:45.716 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-12-17T18:11:45.791 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-12-17T18:11:45.825 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-12-17T18:11:45.848 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-12-17T18:11:45.849 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-12-17T18:11:45.863 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-12-17T18:11:45.938 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-12-17T18:11:45.970 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-12-17T18:11:45.992 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-12-17T18:11:45.993 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-12-17T18:11:46.005 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-12-17T18:11:46.090 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-12-17T18:11:46.112 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-12-17T18:11:46.134 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-12-17T18:11:46.135 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-12-17T18:11:46.147 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-12-17T18:11:46.244 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-12-17T18:11:46.256 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-12-17T18:11:46.279 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-12-17T18:11:46.280 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-12-17T18:11:46.292 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-12-17T18:11:46.387 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-12-17T18:11:46.399 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-12-17T18:11:46.421 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-12-17T18:11:46.422 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-12-17T18:11:46.444 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-12-17T18:11:46.534 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-12-17T18:11:46.547 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-12-17T18:11:46.569 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-12-17T18:11:46.582 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-12-17T18:11:46.593 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-12-17T18:11:46.678 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-12-17T18:11:46.689 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-12-17T18:11:46.712 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-12-17T18:11:46.713 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-12-17T18:11:46.735 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-12-17T18:11:46.820 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-12-17T18:11:46.832 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-12-17T18:11:46.856 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-12-17T18:11:46.857 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-12-17T18:11:46.880 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-12-17T18:11:46.978 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-12-17T18:11:47.002 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-12-17T18:11:47.004 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-12-17T18:11:47.028 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-12-17T18:11:47.123 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-12-17T18:11:47.125 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-12-17T18:11:47.146 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-12-17T18:11:47.148 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-12-17T18:11:47.170 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-12-17T18:11:47.172 INFO:teuthology.task.ansible.out: 2021-12-17T18:11:47.267 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-12-17T18:11:47.268 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-12-17T18:11:47.297 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-12-17T18:11:47.307 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-12-17T18:11:47.320 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-12-17T18:11:47.407 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-12-17T18:11:47.419 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-12-17T18:11:47.442 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-12-17T18:11:47.443 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-12-17T18:11:47.455 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-12-17T18:11:47.550 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-12-17T18:11:47.562 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-12-17T18:11:47.584 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-12-17T18:11:47.585 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-12-17T18:11:47.597 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-12-17T18:11:47.693 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-12-17T18:11:47.705 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-12-17T18:11:47.727 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-12-17T18:11:47.740 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-12-17T18:11:47.752 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-12-17T18:11:47.847 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-12-17T18:11:47.848 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-12-17T18:11:47.870 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-12-17T18:11:47.882 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-12-17T18:11:47.894 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-12-17T18:11:47.990 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-12-17T18:11:47.992 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-12-17T18:11:48.013 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-12-17T18:11:48.026 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-12-17T18:11:48.038 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-12-17T18:11:48.133 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-12-17T18:11:48.134 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-12-17T18:11:48.167 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-12-17T18:11:48.179 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-12-17T18:11:48.180 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-12-17T18:11:48.276 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-12-17T18:11:48.288 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-12-17T18:11:48.310 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-12-17T18:11:48.322 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-12-17T18:11:48.334 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-12-17T18:11:48.419 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-12-17T18:11:48.431 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-12-17T18:11:48.453 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-12-17T18:11:48.455 INFO:teuthology.task.ansible.out: 2021-12-17T18:11:48.466 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-12-17T18:11:48.467 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-12-17T18:11:48.564 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-12-17T18:11:48.576 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-12-17T18:11:48.598 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-12-17T18:11:48.599 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-12-17T18:11:48.621 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-12-17T18:11:48.716 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-12-17T18:11:48.717 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-12-17T18:11:48.739 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-12-17T18:11:48.741 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-12-17T18:11:48.754 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-12-17T18:11:48.851 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-12-17T18:11:48.862 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-12-17T18:11:48.884 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-12-17T18:11:48.885 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-12-17T18:11:48.897 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-12-17T18:11:49.004 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-12-17T18:11:49.005 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-12-17T18:11:49.027 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-12-17T18:11:49.038 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-12-17T18:11:49.039 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-12-17T18:11:49.145 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-12-17T18:11:49.146 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-12-17T18:11:49.168 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-12-17T18:11:49.180 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-12-17T18:11:49.192 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-12-17T18:11:49.288 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-12-17T18:11:49.299 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-12-17T18:11:49.311 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-12-17T18:11:49.322 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-12-17T18:11:49.345 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-12-17T18:11:49.430 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-12-17T18:11:49.441 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-12-17T18:11:49.463 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-12-17T18:11:49.477 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-12-17T18:11:49.490 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-12-17T18:11:49.575 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-12-17T18:11:49.587 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-12-17T18:11:49.599 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-12-17T18:11:49.622 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-12-17T18:11:49.644 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-12-17T18:11:49.719 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-12-17T18:11:49.731 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-12-17T18:11:49.753 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-12-17T18:11:49.765 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-12-17T18:11:49.787 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-12-17T18:11:49.861 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-12-17T18:11:49.883 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-12-17T18:11:49.895 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-12-17T18:11:49.907 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-12-17T18:11:49.930 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-12-17T18:11:50.015 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-12-17T18:11:50.027 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-12-17T18:11:50.039 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-12-17T18:11:50.062 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-12-17T18:11:50.074 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-12-17T18:11:50.161 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-12-17T18:11:50.162 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-12-17T18:11:50.184 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-12-17T18:11:50.196 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-12-17T18:11:50.217 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-12-17T18:11:50.302 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-12-17T18:11:50.303 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-12-17T18:11:50.325 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-12-17T18:11:50.337 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-12-17T18:11:50.370 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-12-17T18:11:50.444 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-12-17T18:11:50.445 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-12-17T18:11:50.468 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-12-17T18:11:50.480 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-12-17T18:11:50.513 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-12-17T18:11:50.589 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-12-17T18:11:50.601 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-12-17T18:11:50.613 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-12-17T18:11:50.635 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-12-17T18:11:50.658 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-12-17T18:11:50.732 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-12-17T18:11:50.744 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-12-17T18:11:50.770 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-12-17T18:11:50.781 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-12-17T18:11:50.793 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-12-17T18:11:50.879 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-12-17T18:11:50.891 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-12-17T18:11:50.914 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-12-17T18:11:50.916 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-12-17T18:11:50.938 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-12-17T18:11:51.023 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-12-17T18:11:51.034 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-12-17T18:11:51.057 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-12-17T18:11:51.059 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-12-17T18:11:51.091 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-12-17T18:11:51.168 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-12-17T18:11:51.179 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-12-17T18:11:51.203 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-12-17T18:11:51.205 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-12-17T18:11:51.228 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-12-17T18:11:51.324 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-12-17T18:11:51.326 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-12-17T18:11:51.347 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-12-17T18:11:51.360 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-12-17T18:11:51.382 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-12-17T18:11:51.467 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-12-17T18:11:51.468 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-12-17T18:11:51.491 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-12-17T18:11:51.503 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-12-17T18:11:51.525 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-12-17T18:11:51.610 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-12-17T18:11:51.612 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-12-17T18:11:51.634 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-12-17T18:11:51.646 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-12-17T18:11:51.668 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-12-17T18:11:51.763 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-12-17T18:11:51.764 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-12-17T18:11:51.775 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-12-17T18:11:51.787 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-12-17T18:11:51.809 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-12-17T18:11:51.905 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-12-17T18:11:51.959 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-12-17T18:11:51.962 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-12-17T18:11:52.059 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-12-17T18:11:52.070 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-12-17T18:11:52.084 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-12-17T18:11:52.086 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-12-17T18:11:52.108 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-12-17T18:11:52.204 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-12-17T18:11:52.204 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-12-17T18:11:52.227 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-12-17T18:11:52.239 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-12-17T18:11:52.250 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-12-17T18:11:52.346 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-12-17T18:11:52.347 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-12-17T18:11:52.369 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-12-17T18:11:52.381 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-12-17T18:11:52.392 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-12-17T18:11:52.488 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-12-17T18:11:52.490 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-12-17T18:11:52.511 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-12-17T18:11:52.523 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-12-17T18:11:52.534 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-12-17T18:11:52.634 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-12-17T18:11:52.636 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-12-17T18:11:52.658 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-12-17T18:11:52.669 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-12-17T18:11:52.691 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-12-17T18:11:52.776 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-12-17T18:11:52.778 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-12-17T18:11:52.798 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-12-17T18:11:52.810 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-12-17T18:11:52.843 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-12-17T18:11:52.918 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-12-17T18:11:52.919 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-12-17T18:11:52.956 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-12-17T18:11:52.968 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-12-17T18:11:52.990 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-12-17T18:11:53.066 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-12-17T18:11:53.068 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-12-17T18:11:53.089 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-12-17T18:11:53.112 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-12-17T18:11:53.134 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-12-17T18:11:53.209 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-12-17T18:11:53.221 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-12-17T18:11:53.232 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-12-17T18:11:53.256 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-12-17T18:11:53.280 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-12-17T18:11:53.355 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-12-17T18:11:53.356 INFO:teuthology.task.ansible.out: 2021-12-17T18:11:53.368 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-12-17T18:11:53.379 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-12-17T18:11:53.401 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-12-17T18:11:53.423 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-12-17T18:11:53.499 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-12-17T18:11:53.510 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-12-17T18:11:53.522 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-12-17T18:11:53.544 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-12-17T18:11:53.566 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-12-17T18:11:53.651 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-12-17T18:11:53.652 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-12-17T18:11:53.664 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-12-17T18:11:53.686 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-12-17T18:11:53.708 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-12-17T18:11:53.794 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-12-17T18:11:53.806 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-12-17T18:11:53.808 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-12-17T18:11:53.828 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-12-17T18:11:53.850 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-12-17T18:11:53.947 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-12-17T18:11:53.959 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-12-17T18:11:53.961 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-12-17T18:11:53.972 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-12-17T18:11:53.995 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-12-17T18:11:54.080 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-12-17T18:11:54.103 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-12-17T18:11:54.104 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-12-17T18:11:54.116 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-12-17T18:11:54.152 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-12-17T18:11:54.226 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-12-17T18:11:54.248 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-12-17T18:11:54.249 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-12-17T18:11:54.261 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-12-17T18:11:54.294 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-12-17T18:11:54.367 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-12-17T18:11:54.400 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-12-17T18:11:54.402 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-12-17T18:11:54.413 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-12-17T18:11:54.435 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-12-17T18:11:54.511 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-12-17T18:11:54.543 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-12-17T18:11:54.546 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-12-17T18:11:54.556 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-12-17T18:11:54.579 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-12-17T18:11:54.654 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-12-17T18:11:54.688 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-12-17T18:11:54.690 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-12-17T18:11:54.703 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-12-17T18:11:54.736 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-12-17T18:11:54.802 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-12-17T18:11:54.835 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-12-17T18:11:54.837 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-12-17T18:11:54.851 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-12-17T18:11:54.852 INFO:teuthology.task.ansible.out: 2021-12-17T18:11:54.897 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-12-17T18:11:54.952 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-12-17T18:11:54.990 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-12-17T18:11:54.992 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-12-17T18:11:55.002 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-12-17T18:11:55.035 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-12-17T18:11:55.099 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-12-17T18:11:55.121 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-12-17T18:11:55.133 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-12-17T18:11:55.144 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-12-17T18:11:55.177 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-12-17T18:11:55.241 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-12-17T18:11:55.273 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-12-17T18:11:55.275 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-12-17T18:11:55.286 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-12-17T18:11:55.331 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-12-17T18:11:55.386 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-12-17T18:11:55.409 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-12-17T18:11:55.423 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-12-17T18:11:55.436 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-12-17T18:11:55.480 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-12-17T18:11:55.534 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-12-17T18:11:55.556 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-12-17T18:11:55.567 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-12-17T18:11:55.579 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-12-17T18:11:55.621 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-12-17T18:11:55.674 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-12-17T18:11:55.707 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-12-17T18:11:55.709 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-12-17T18:11:55.719 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-12-17T18:11:55.762 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-12-17T18:11:55.826 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-12-17T18:11:55.859 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-12-17T18:11:55.860 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-12-17T18:11:55.862 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-12-17T18:11:55.917 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-12-17T18:11:55.961 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-12-17T18:11:56.004 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-12-17T18:11:56.005 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-12-17T18:11:56.017 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-12-17T18:11:56.019 INFO:teuthology.task.ansible.out: 2021-12-17T18:11:56.061 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-12-17T18:11:56.104 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-12-17T18:11:56.148 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-12-17T18:11:56.159 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-12-17T18:11:56.162 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-12-17T18:11:56.204 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-12-17T18:11:56.248 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-12-17T18:11:56.291 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-12-17T18:11:56.303 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-12-17T18:11:56.304 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-12-17T18:11:56.358 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-12-17T18:11:56.402 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-12-17T18:11:56.434 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-12-17T18:11:56.446 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-12-17T18:11:56.458 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-12-17T18:11:56.490 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-12-17T18:11:56.543 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-12-17T18:11:56.587 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-12-17T18:11:56.588 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-12-17T18:11:56.611 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-12-17T18:11:56.644 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-12-17T18:11:56.687 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-12-17T18:11:56.729 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-12-17T18:11:56.730 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-12-17T18:11:56.763 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-12-17T18:11:56.785 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-12-17T18:11:56.828 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-12-17T18:11:56.875 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-12-17T18:11:56.876 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-12-17T18:11:56.898 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-12-17T18:11:56.931 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-12-17T18:11:56.974 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-12-17T18:11:57.018 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-12-17T18:11:57.019 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-12-17T18:11:57.041 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-12-17T18:11:57.084 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-12-17T18:11:57.117 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-12-17T18:11:57.159 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-12-17T18:11:57.160 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-12-17T18:11:57.193 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-12-17T18:11:57.225 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-12-17T18:11:57.258 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-12-17T18:11:57.304 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-12-17T18:11:57.305 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-12-17T18:11:57.338 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-12-17T18:11:57.370 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-12-17T18:11:57.404 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-12-17T18:11:57.458 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-12-17T18:11:57.459 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-12-17T18:11:57.482 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-12-17T18:11:57.514 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-12-17T18:11:57.547 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-12-17T18:11:57.601 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-12-17T18:11:57.602 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-12-17T18:11:57.634 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-12-17T18:11:57.637 INFO:teuthology.task.ansible.out: 2021-12-17T18:11:57.657 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-12-17T18:11:57.689 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-12-17T18:11:57.742 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-12-17T18:11:57.754 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-12-17T18:11:57.776 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-12-17T18:11:57.797 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-12-17T18:11:57.882 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-12-17T18:11:57.936 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-12-17T18:11:57.937 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-12-17T18:11:58.033 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-12-17T18:11:58.285 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-12-17T18:11:58.286 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-12-17T18:11:58.464 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-12-17T18:11:58.539 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-12-17T18:11:58.561 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-12-17T18:11:58.749 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10125, "groups": "sudo", "home": "/home/oro", "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "name": "oro", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10124} 2021-12-17T18:11:58.823 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10125, "groups": "sudo", "home": "/home/oro", "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "name": "oro", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10124} 2021-12-17T18:11:58.981 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10125, "groups": "sudo", "home": "/home/oro", "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "name": "oro", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10124} 2021-12-17T18:11:59.066 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10125, "groups": "sudo", "home": "/home/oro", "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "name": "oro", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10124} 2021-12-17T18:11:59.100 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10125, "groups": "sudo", "home": "/home/oro", "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "name": "oro", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10124} 2021-12-17T18:11:59.290 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10126, "groups": "sudo", "home": "/home/mrfreezeex", "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "name": "mrfreezeex", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10125} 2021-12-17T18:11:59.301 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10126, "groups": "sudo", "home": "/home/mrfreezeex", "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "name": "mrfreezeex", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10125} 2021-12-17T18:11:59.478 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10126, "groups": "sudo", "home": "/home/mrfreezeex", "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "name": "mrfreezeex", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10125} 2021-12-17T18:11:59.501 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:59 +0000 (0:00:23.786) 0:00:33.226 ******* 2021-12-17T18:11:59.523 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:11:59 +0000 (0:00:00.021) 0:00:33.248 ******* 2021-12-17T18:11:59.826 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-12-17T18:11:59.827 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** changed: [smithi062.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10126, "groups": "sudo", "home": "/home/mrfreezeex", "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "name": "mrfreezeex", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10125} TASK [Create all users without sudo access.] *********************************** 2021-12-17T18:11:59.854 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-12-17T18:11:59.906 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10126, "groups": "sudo", "home": "/home/mrfreezeex", "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "name": "mrfreezeex", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10125} 2021-12-17T18:12:00.009 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:00 +0000 (0:00:00.486) 0:00:33.735 ******* 2021-12-17T18:12:00.033 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:00 +0000 (0:00:00.023) 0:00:33.758 ******* 2021-12-17T18:12:00.057 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:00 +0000 (0:00:00.024) 0:00:33.783 ******* 2021-12-17T18:12:00.083 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:00 +0000 (0:00:00.025) 0:00:33.808 ******* 2021-12-17T18:12:00.107 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:00 +0000 (0:00:00.024) 0:00:33.832 ******* 2021-12-17T18:12:00.115 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-12-17T18:12:00.152 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:00 +0000 (0:00:00.045) 0:00:33.877 ******* 2021-12-17T18:12:00.161 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-12-17T18:12:00.164 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-12-17T18:12:00.165 INFO:teuthology.task.ansible.out: QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2021-12-17T18:12:00.167 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2021-12-17T18:12:00.168 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2021-12-17T18:12:00.170 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "v 2021-12-17T18:12:00.171 INFO:teuthology.task.ansible.out:asu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2021-12-17T18:12:00.172 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2021-12-17T18:12:00.174 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-12-17T18:12:00.175 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2021-12-17T18:12:00.177 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2021-12-17T18:12:00.179 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "k 2021-12-17T18:12:00.179 INFO:teuthology.task.ansible.out:hiremat@kotresh-T490s 7o9Jj 2021-12-17T18:12:00.181 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2021-12-17T18:12:00.182 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a 2021-12-17T18:12:00.184 INFO:teuthology.task.ansible.out:28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": " 2021-12-17T18:12:00.186 INFO:teuthology.task.ansible.out:zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}]}, "changed": false} TASK [Create all users without sudo access.] *********************************** TASK [Merge managed_users and managed_admin users] ***************************** 2021-12-17T18:12:00.187 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda7 2021-12-17T18:12:00.188 INFO:teuthology.task.ansible.out:28e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO 2021-12-17T18:12:00.190 INFO:teuthology.task.ansible.out:7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M9 2021-12-17T18:12:00.191 INFO:teuthology.task.ansible.out:0unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6 2021-12-17T18:12:00.193 INFO:teuthology.task.ansible.out:rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9eb 2021-12-17T18:12:00.194 INFO:teuthology.task.ansible.out:ba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de2 2021-12-17T18:12:00.195 INFO:teuthology.task.ansible.out:08ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d82 2021-12-17T18:12:00.197 INFO:teuthology.task.ansible.out:4f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a 2021-12-17T18:12:00.198 INFO:teuthology.task.ansible.out:95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf 2021-12-17T18:12:00.200 INFO:teuthology.task.ansible.out:0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {" 2021-12-17T18:12:00.200 INFO:teuthology.task.ansible.out:name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", 2021-12-17T18:12:00.202 INFO:teuthology.task.ansible.out:"ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e 2021-12-17T18:12:00.204 INFO:teuthology.task.ansible.out:852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJ 2021-12-17T18:12:00.205 INFO:teuthology.task.ansible.out:QdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipa 2021-12-17T18:12:00.207 INFO:teuthology.task.ansible.out:lma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe19049 2021-12-17T18:12:00.209 INFO:teuthology.task.ansible.out:0e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5 2021-12-17T18:12:00.209 INFO:teuthology.task.ansible.out:299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn 2021-12-17T18:12:00.211 INFO:teuthology.task.ansible.out:": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}]}, "changed": false} 2021-12-17T18:12:00.212 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-12-17T18:12:00.240 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:00 +0000 (0:00:00.088) 0:00:33.966 ******* 2021-12-17T18:12:00.268 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:00 +0000 (0:00:00.027) 0:00:33.993 ******* 2021-12-17T18:12:00.307 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:00 +0000 (0:00:00.039) 0:00:34.032 ******* 2021-12-17T18:12:00.348 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:00 +0000 (0:00:00.040) 0:00:34.073 ******* 2021-12-17T18:12:00.359 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-12-17T18:12:00.362 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-12-17T18:12:00.363 INFO:teuthology.task.ansible.out: QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2021-12-17T18:12:00.365 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2021-12-17T18:12:00.367 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2021-12-17T18:12:00.368 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9eb 2021-12-17T18:12:00.369 INFO:teuthology.task.ansible.out:ba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2021-12-17T18:12:00.371 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2021-12-17T18:12:00.372 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-12-17T18:12:00.374 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2021-12-17T18:12:00.375 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2021-12-17T18:12:00.377 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jj 2021-12-17T18:12:00.378 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2021-12-17T18:12:00.381 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a 2021-12-17T18:12:00.382 INFO:teuthology.task.ansible.out:28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5 2021-12-17T18:12:00.383 INFO:teuthology.task.ansible.out:299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": " 2021-12-17T18:12:00.384 INFO:teuthology.task.ansible.out:zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}]}, "changed": false} 2021-12-17T18:12:00.415 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:00 +0000 (0:00:00.066) 0:00:34.140 ******* 2021-12-17T18:12:00.430 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-12-17T18:12:00.432 INFO:teuthology.task.ansible.out: QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2021-12-17T18:12:00.434 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2021-12-17T18:12:00.435 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2021-12-17T18:12:00.437 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9eb 2021-12-17T18:12:00.437 INFO:teuthology.task.ansible.out:ba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2021-12-17T18:12:00.439 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2021-12-17T18:12:00.441 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-12-17T18:12:00.442 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2021-12-17T18:12:00.444 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2021-12-17T18:12:00.446 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jj 2021-12-17T18:12:00.447 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2021-12-17T18:12:00.449 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a 2021-12-17T18:12:00.450 INFO:teuthology.task.ansible.out:28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": " 2021-12-17T18:12:00.452 INFO:teuthology.task.ansible.out:zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}]}, "changed": false} ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {" 2021-12-17T18:12:00.454 INFO:teuthology.task.ansible.out:name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzey 2021-12-17T18:12:00.455 INFO:teuthology.task.ansible.out:CosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovp 2021-12-17T18:12:00.457 INFO:teuthology.task.ansible.out:n": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc5 2021-12-17T18:12:00.459 INFO:teuthology.task.ansible.out:4a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9eb 2021-12-17T18:12:00.459 INFO:teuthology.task.ansible.out:ba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nn 2021-12-17T18:12:00.461 INFO:teuthology.task.ansible.out:hm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb3 2021-12-17T18:12:00.462 INFO:teuthology.task.ansible.out:1ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f9 2021-12-17T18:12:00.464 INFO:teuthology.task.ansible.out:89be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a2 2021-12-17T18:12:00.466 INFO:teuthology.task.ansible.out:20d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {" 2021-12-17T18:12:00.466 INFO:teuthology.task.ansible.out:name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a36 2021-12-17T18:12:00.468 INFO:teuthology.task.ansible.out:5539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded0 2021-12-17T18:12:00.469 INFO:teuthology.task.ansible.out:2aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424 2021-12-17T18:12:00.471 INFO:teuthology.task.ansible.out:caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi 2021-12-17T18:12:00.473 INFO:teuthology.task.ansible.out:Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec66 2021-12-17T18:12:00.474 INFO:teuthology.task.ansible.out:9f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-u 2021-12-17T18:12:00.476 INFO:teuthology.task.ansible.out:buntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}]}, "changed": false} 2021-12-17T18:12:00.505 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:00 +0000 (0:00:00.090) 0:00:34.231 ******* 2021-12-17T18:12:00.533 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:00 +0000 (0:00:00.026) 0:00:34.258 ******* 2021-12-17T18:12:01.239 INFO:teuthology.task.ansible.out:FAILED - RETRYING: Clone the keys repo (5 retries left). 2021-12-17T18:12:01.251 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-12-17T18:12:01.252 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"after": "271ee3bd41c26a34f5caf35e3fcae76aca032a42", "attempts": 1, "before": "271ee3bd41c26a34f5caf35e3fcae76aca032a42", "changed": false, "remote_url_changed": false} 2021-12-17T18:12:01.276 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:01 +0000 (0:00:00.743) 0:00:35.001 ******* 2021-12-17T18:12:01.326 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"after": "271ee3bd41c26a34f5caf35e3fcae76aca032a42", "attempts": 1, "before": "271ee3bd41c26a34f5caf35e3fcae76aca032a42", "changed": false, "remote_url_changed": false} 2021-12-17T18:12:01.352 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:01 +0000 (0:00:00.076) 0:00:35.078 ******* 2021-12-17T18:12:01.361 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"after": "271ee3bd41c26a34f5caf35e3fcae76aca032a42", "attempts": 1, "before": "271ee3bd41c26a34f5caf35e3fcae76aca032a42", "changed": false, "remote_url_changed": false} 2021-12-17T18:12:01.389 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:01 +0000 (0:00:00.036) 0:00:35.114 ******* 2021-12-17T18:12:01.397 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"after": "271ee3bd41c26a34f5caf35e3fcae76aca032a42", "attempts": 1, "before": "271ee3bd41c26a34f5caf35e3fcae76aca032a42", "changed": false, "remote_url_changed": false} 2021-12-17T18:12:01.425 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:01 +0000 (0:00:00.035) 0:00:35.150 ******* 2021-12-17T18:12:01.527 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:01.529 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-12-17T18:12:01.591 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-12-17T18:12:01.623 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-12-17T18:12:01.666 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-12-17T18:12:01.720 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-12-17T18:12:01.731 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-12-17T18:12:01.754 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-12-17T18:12:01.809 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-12-17T18:12:01.853 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-12-17T18:12:01.864 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-12-17T18:12:01.886 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-12-17T18:12:01.940 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-12-17T18:12:01.941 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-12-17T18:12:01.982 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-12-17T18:12:01.984 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-12-17T18:12:01.993 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-12-17T18:12:02.026 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-12-17T18:12:02.027 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-12-17T18:12:02.068 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-12-17T18:12:02.122 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-12-17T18:12:02.124 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-12-17T18:12:02.125 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-12-17T18:12:02.155 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-12-17T18:12:02.210 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-12-17T18:12:02.212 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-12-17T18:12:02.253 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-12-17T18:12:02.254 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPO 2021-12-17T18:12:02.256 INFO:teuthology.task.ansible.out:mnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-12-17T18:12:02.297 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-12-17T18:12:02.299 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-12-17T18:12:02.340 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-12-17T18:12:02.384 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-12-17T18:12:02.386 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-12-17T18:12:02.387 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-12-17T18:12:02.417 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-12-17T18:12:02.480 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-12-17T18:12:02.513 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-12-17T18:12:02.524 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-12-17T18:12:02.546 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-12-17T18:12:02.548 INFO:teuthology.task.ansible.out: 2021-12-17T18:12:02.610 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-12-17T18:12:02.622 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:02.655 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-12-17T18:12:02.657 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvW 2021-12-17T18:12:02.659 INFO:teuthology.task.ansible.out:rwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:02.689 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-12-17T18:12:02.690 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:02.752 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-12-17T18:12:02.754 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-12-17T18:12:02.785 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-12-17T18:12:02.787 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-12-17T18:12:02.788 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-12-17T18:12:02.796 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:02.828 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-12-17T18:12:02.830 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-12-17T18:12:02.903 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-12-17T18:12:02.905 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:02.915 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:02.926 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-12-17T18:12:02.928 INFO:teuthology.task.ansible.out:son", "validate_certs": true} ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZit 2021-12-17T18:12:02.930 INFO:teuthology.task.ansible.out:Hbg/isbU5RMBl6H48wHAVSK2/uTfMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-12-17T18:12:02.939 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:02.941 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:02.963 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-12-17T18:12:02.965 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-12-17T18:12:02.975 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:02.987 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:03.052 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-12-17T18:12:03.074 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-12-17T18:12:03.075 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-12-17T18:12:03.085 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:03.085 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-12-17T18:12:03.087 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:03.118 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-12-17T18:12:03.182 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-12-17T18:12:03.184 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-12-17T18:12:03.215 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-12-17T18:12:03.216 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-12-17T18:12:03.226 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-12-17T18:12:03.248 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-12-17T18:12:03.250 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-12-17T18:12:03.322 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-12-17T18:12:03.344 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-12-17T18:12:03.355 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-12-17T18:12:03.357 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-12-17T18:12:03.378 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-12-17T18:12:03.474 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-12-17T18:12:03.485 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-12-17T18:12:03.497 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-12-17T18:12:03.508 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-12-17T18:12:03.509 INFO:teuthology.task.ansible.out: 2021-12-17T18:12:03.603 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-12-17T18:12:03.614 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-12-17T18:12:03.626 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-12-17T18:12:03.647 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-12-17T18:12:03.743 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-12-17T18:12:03.745 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-12-17T18:12:03.754 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-12-17T18:12:03.766 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-12-17T18:12:03.768 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-12-17T18:12:03.777 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-12-17T18:12:03.779 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-12-17T18:12:03.873 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-12-17T18:12:03.875 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-12-17T18:12:03.894 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-12-17T18:12:03.896 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-12-17T18:12:03.906 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-12-17T18:12:03.908 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJo 2021-12-17T18:12:03.910 INFO:teuthology.task.ansible.out:SrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-12-17T18:12:04.011 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-12-17T18:12:04.033 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-12-17T18:12:04.035 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-12-17T18:12:04.045 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-12-17T18:12:04.140 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-12-17T18:12:04.162 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-12-17T18:12:04.183 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-12-17T18:12:04.185 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-12-17T18:12:04.279 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-12-17T18:12:04.280 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-12-17T18:12:04.290 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-12-17T18:12:04.332 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-12-17T18:12:04.335 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible 2021-12-17T18:12:04.337 INFO:teuthology.task.ansible.out:_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5 2021-12-17T18:12:04.338 INFO:teuthology.task.ansible.out:tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-12-17T18:12:04.408 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-12-17T18:12:04.441 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-12-17T18:12:04.442 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-12-17T18:12:04.463 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-12-17T18:12:04.474 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-12-17T18:12:04.548 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-12-17T18:12:04.569 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-12-17T18:12:04.591 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-12-17T18:12:04.613 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-12-17T18:12:04.676 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-12-17T18:12:04.719 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-12-17T18:12:04.730 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-12-17T18:12:04.742 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-12-17T18:12:04.817 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-12-17T18:12:04.860 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-12-17T18:12:04.861 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-12-17T18:12:04.873 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-12-17T18:12:04.947 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-12-17T18:12:04.990 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-12-17T18:12:05.002 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-12-17T18:12:05.013 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-12-17T18:12:05.077 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-12-17T18:12:05.079 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-12-17T18:12:05.120 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-12-17T18:12:05.122 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-12-17T18:12:05.132 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-12-17T18:12:05.143 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-12-17T18:12:05.144 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-12-17T18:12:05.217 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-12-17T18:12:05.249 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-12-17T18:12:05.260 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-12-17T18:12:05.262 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-12-17T18:12:05.272 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-12-17T18:12:05.347 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-12-17T18:12:05.379 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-12-17T18:12:05.390 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-12-17T18:12:05.402 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-12-17T18:12:05.479 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-12-17T18:12:05.511 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-12-17T18:12:05.522 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-12-17T18:12:05.534 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-12-17T18:12:05.607 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-12-17T18:12:05.650 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-12-17T18:12:05.652 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-12-17T18:12:05.662 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-12-17T18:12:05.746 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-12-17T18:12:05.779 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-12-17T18:12:05.780 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-12-17T18:12:05.791 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-12-17T18:12:05.886 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-12-17T18:12:05.908 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-12-17T18:12:05.909 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-12-17T18:12:05.931 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-12-17T18:12:06.015 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-12-17T18:12:06.037 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-12-17T18:12:06.048 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-12-17T18:12:06.070 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-12-17T18:12:06.155 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-12-17T18:12:06.157 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-12-17T18:12:06.177 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-12-17T18:12:06.177 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-12-17T18:12:06.179 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-12-17T18:12:06.199 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-12-17T18:12:06.201 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-12-17T18:12:06.284 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-12-17T18:12:06.285 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-12-17T18:12:06.305 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-12-17T18:12:06.307 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgn 2021-12-17T18:12:06.309 INFO:teuthology.task.ansible.out:oB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-12-17T18:12:06.338 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-12-17T18:12:06.340 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-12-17T18:12:06.423 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-12-17T18:12:06.445 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-12-17T18:12:06.446 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-12-17T18:12:06.467 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-12-17T18:12:06.552 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-12-17T18:12:06.575 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-12-17T18:12:06.577 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-12-17T18:12:06.598 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-12-17T18:12:06.684 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-12-17T18:12:06.706 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-12-17T18:12:06.707 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-12-17T18:12:06.728 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-12-17T18:12:06.834 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-12-17T18:12:06.836 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-12-17T18:12:06.845 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-12-17T18:12:06.847 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-12-17T18:12:06.849 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-12-17T18:12:06.911 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-12-17T18:12:06.913 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-12-17T18:12:06.964 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-12-17T18:12:06.966 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-12-17T18:12:06.968 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-12-17T18:12:06.986 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-12-17T18:12:06.988 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-12-17T18:12:06.990 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-12-17T18:12:06.998 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-12-17T18:12:07.000 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-12-17T18:12:07.052 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-12-17T18:12:07.053 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-12-17T18:12:07.055 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-12-17T18:12:07.104 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-12-17T18:12:07.116 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-12-17T18:12:07.127 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-12-17T18:12:07.129 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-12-17T18:12:07.130 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-12-17T18:12:07.181 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-12-17T18:12:07.234 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-12-17T18:12:07.245 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-12-17T18:12:07.267 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-12-17T18:12:07.313 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-12-17T18:12:07.367 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-12-17T18:12:07.388 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-12-17T18:12:07.390 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-12-17T18:12:07.442 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-12-17T18:12:07.495 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-12-17T18:12:07.517 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-12-17T18:12:07.529 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-12-17T18:12:07.582 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-12-17T18:12:07.637 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-12-17T18:12:07.659 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-12-17T18:12:07.671 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-12-17T18:12:07.714 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-12-17T18:12:07.768 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-12-17T18:12:07.770 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-12-17T18:12:07.790 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-12-17T18:12:07.802 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-12-17T18:12:07.803 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-12-17T18:12:07.845 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-12-17T18:12:07.847 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-12-17T18:12:07.919 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-12-17T18:12:07.921 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} changed: [smithi062.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-12-17T18:12:07.952 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-12-17T18:12:07.996 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-12-17T18:12:08.059 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-12-17T18:12:08.070 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-12-17T18:12:08.081 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-12-17T18:12:08.124 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-12-17T18:12:08.188 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-12-17T18:12:08.190 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-12-17T18:12:08.210 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-12-17T18:12:08.210 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-12-17T18:12:08.212 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-12-17T18:12:08.253 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-12-17T18:12:08.255 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-12-17T18:12:08.338 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-12-17T18:12:08.340 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-12-17T18:12:08.342 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-12-17T18:12:08.393 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-12-17T18:12:08.477 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-12-17T18:12:08.479 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-12-17T18:12:08.521 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-12-17T18:12:08.606 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-12-17T18:12:08.607 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/autho 2021-12-17T18:12:08.609 INFO:teuthology.task.ansible.out:rized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcP 2021-12-17T18:12:08.611 INFO:teuthology.task.ansible.out:l+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-12-17T18:12:08.662 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-12-17T18:12:08.664 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-12-17T18:12:08.737 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-12-17T18:12:08.739 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-12-17T18:12:08.741 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir 2021-12-17T18:12:08.742 INFO:teuthology.task.ansible.out:": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-12-17T18:12:08.791 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-12-17T18:12:08.866 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-12-17T18:12:08.868 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-12-17T18:12:08.921 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-12-17T18:12:09.006 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-12-17T18:12:09.009 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs" 2021-12-17T18:12:09.010 INFO:teuthology.task.ansible.out:: true} 2021-12-17T18:12:09.050 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-12-17T18:12:09.135 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-12-17T18:12:09.137 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-12-17T18:12:09.148 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-12-17T18:12:09.180 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-12-17T18:12:09.275 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-12-17T18:12:09.286 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-12-17T18:12:09.288 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-12-17T18:12:09.340 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-12-17T18:12:09.425 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-12-17T18:12:09.427 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJS 2021-12-17T18:12:09.429 INFO:teuthology.task.ansible.out:NTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-12-17T18:12:09.479 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-12-17T18:12:09.554 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-12-17T18:12:09.565 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-12-17T18:12:09.567 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-12-17T18:12:09.620 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-12-17T18:12:09.684 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-12-17T18:12:09.696 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-12-17T18:12:09.709 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-12-17T18:12:09.752 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-12-17T18:12:09.815 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-12-17T18:12:09.847 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-12-17T18:12:09.849 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-12-17T18:12:09.880 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-12-17T18:12:09.944 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-12-17T18:12:09.976 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-12-17T18:12:09.978 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-12-17T18:12:10.019 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-12-17T18:12:10.083 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-12-17T18:12:10.105 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-12-17T18:12:10.106 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-12-17T18:12:10.148 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-12-17T18:12:10.212 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-12-17T18:12:10.235 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-12-17T18:12:10.236 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-12-17T18:12:10.278 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-12-17T18:12:10.342 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-12-17T18:12:10.363 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-12-17T18:12:10.375 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-12-17T18:12:10.407 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-12-17T18:12:10.481 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-12-17T18:12:10.503 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-12-17T18:12:10.514 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-12-17T18:12:10.546 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-12-17T18:12:10.622 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-12-17T18:12:10.633 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-12-17T18:12:10.665 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-12-17T18:12:10.687 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-12-17T18:12:10.762 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-12-17T18:12:10.783 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-12-17T18:12:10.805 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-12-17T18:12:10.827 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-12-17T18:12:10.891 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-12-17T18:12:10.913 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-12-17T18:12:10.934 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-12-17T18:12:10.967 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-12-17T18:12:11.030 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-12-17T18:12:11.052 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-12-17T18:12:11.063 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-12-17T18:12:11.106 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-12-17T18:12:11.160 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-12-17T18:12:11.181 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-12-17T18:12:11.203 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-12-17T18:12:11.235 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-12-17T18:12:11.289 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-12-17T18:12:11.322 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-12-17T18:12:11.333 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-12-17T18:12:11.366 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-12-17T18:12:11.419 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-12-17T18:12:11.420 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-12-17T18:12:11.452 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-12-17T18:12:11.463 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-12-17T18:12:11.465 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-12-17T18:12:11.496 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-12-17T18:12:11.497 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-12-17T18:12:11.559 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-12-17T18:12:11.592 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-12-17T18:12:11.593 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-12-17T18:12:11.603 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-12-17T18:12:11.625 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-12-17T18:12:11.690 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-12-17T18:12:11.722 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-12-17T18:12:11.733 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-12-17T18:12:11.755 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-12-17T18:12:11.818 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-12-17T18:12:11.851 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-12-17T18:12:11.862 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi109.front.sepia.ceph.com] => {"after": "271ee3bd41c26a34f5caf35e3fcae76aca032a42", "attempts": 2, "before": "271ee3bd41c26a34f5caf35e3fcae76aca032a42", "changed": false, "remote_url_changed": false} 2021-12-17T18:12:11.863 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-12-17T18:12:11.887 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:11 +0000 (0:00:10.462) 0:00:45.612 ******* 2021-12-17T18:12:11.896 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-12-17T18:12:11.949 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-12-17T18:12:11.951 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-12-17T18:12:11.993 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-12-17T18:12:11.995 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-12-17T18:12:11.997 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-12-17T18:12:12.026 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-12-17T18:12:12.028 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-12-17T18:12:12.080 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-12-17T18:12:12.123 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-12-17T18:12:12.134 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-12-17T18:12:12.136 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2 2021-12-17T18:12:12.138 INFO:teuthology.task.ansible.out:CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-12-17T18:12:12.157 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-12-17T18:12:12.211 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-12-17T18:12:12.253 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-12-17T18:12:12.264 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-12-17T18:12:12.266 INFO:teuthology.task.ansible.out: ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-12-17T18:12:12.287 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-12-17T18:12:12.351 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-12-17T18:12:12.394 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-12-17T18:12:12.396 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-12-17T18:12:12.407 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-12-17T18:12:12.429 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-12-17T18:12:12.482 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-12-17T18:12:12.525 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-12-17T18:12:12.528 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-12-17T18:12:12.536 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-12-17T18:12:12.548 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-12-17T18:12:12.559 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-12-17T18:12:12.612 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-12-17T18:12:12.655 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-12-17T18:12:12.676 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-12-17T18:12:12.678 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-12-17T18:12:12.699 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-12-17T18:12:12.752 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-12-17T18:12:12.795 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-12-17T18:12:12.797 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-12-17T18:12:12.807 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", " 2021-12-17T18:12:12.809 INFO:teuthology.task.ansible.out:changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-12-17T18:12:12.829 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-12-17T18:12:12.892 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-12-17T18:12:12.924 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-12-17T18:12:12.936 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-12-17T18:12:12.947 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-12-17T18:12:12.969 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-12-17T18:12:13.022 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-12-17T18:12:13.024 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-12-17T18:12:13.065 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-12-17T18:12:13.076 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-12-17T18:12:13.087 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-12-17T18:12:13.089 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-12-17T18:12:13.098 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-12-17T18:12:13.100 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-12-17T18:12:13.152 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-12-17T18:12:13.195 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-12-17T18:12:13.197 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:13.207 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-12-17T18:12:13.209 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-12-17T18:12:13.219 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-12-17T18:12:13.230 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-12-17T18:12:13.284 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-12-17T18:12:13.326 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-12-17T18:12:13.328 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-12-17T18:12:13.338 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-12-17T18:12:13.360 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-12-17T18:12:13.361 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-12-17T18:12:13.414 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-12-17T18:12:13.457 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-12-17T18:12:13.459 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-12-17T18:12:13.468 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-12-17T18:12:13.470 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:13.480 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:13.491 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-12-17T18:12:13.493 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-12-17T18:12:13.546 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-12-17T18:12:13.599 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-12-17T18:12:13.610 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-12-17T18:12:13.622 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-12-17T18:12:13.633 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-12-17T18:12:13.687 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-12-17T18:12:13.730 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-12-17T18:12:13.741 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-12-17T18:12:13.743 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-12-17T18:12:13.763 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-12-17T18:12:13.774 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-12-17T18:12:13.817 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-12-17T18:12:13.870 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-12-17T18:12:13.871 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-12-17T18:12:13.893 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-12-17T18:12:13.904 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-12-17T18:12:13.948 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-12-17T18:12:13.949 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-12-17T18:12:14.001 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-12-17T18:12:14.002 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-12-17T18:12:14.034 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-12-17T18:12:14.036 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWe 2021-12-17T18:12:14.038 INFO:teuthology.task.ansible.out:uU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-12-17T18:12:14.078 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-12-17T18:12:14.131 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-12-17T18:12:14.133 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-12-17T18:12:14.164 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-12-17T18:12:14.166 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-12-17T18:12:14.208 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-12-17T18:12:14.261 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-12-17T18:12:14.283 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-12-17T18:12:14.286 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-12-17T18:12:14.295 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-12-17T18:12:14.297 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-12-17T18:12:14.339 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-12-17T18:12:14.392 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-12-17T18:12:14.414 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-12-17T18:12:14.416 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-12-17T18:12:14.425 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-12-17T18:12:14.427 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-12-17T18:12:14.469 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-12-17T18:12:14.522 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-12-17T18:12:14.556 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-12-17T18:12:14.556 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-12-17T18:12:14.558 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-12-17T18:12:14.601 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-12-17T18:12:14.685 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-12-17T18:12:14.687 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-12-17T18:12:14.697 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-12-17T18:12:14.699 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-12-17T18:12:14.741 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-12-17T18:12:14.815 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-12-17T18:12:14.836 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-12-17T18:12:14.838 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-12-17T18:12:14.848 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-12-17T18:12:14.850 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-12-17T18:12:14.880 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-12-17T18:12:14.954 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-12-17T18:12:14.965 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-12-17T18:12:14.977 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-12-17T18:12:14.979 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-12-17T18:12:15.011 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-12-17T18:12:15.087 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-12-17T18:12:15.109 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-12-17T18:12:15.111 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= k 2021-12-17T18:12:15.113 INFO:teuthology.task.ansible.out:achau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-12-17T18:12:15.142 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-12-17T18:12:15.216 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-12-17T18:12:15.238 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-12-17T18:12:15.249 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-12-17T18:12:15.261 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-12-17T18:12:15.272 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-12-17T18:12:15.346 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-12-17T18:12:15.378 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-12-17T18:12:15.380 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-12-17T18:12:15.401 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-12-17T18:12:15.412 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-12-17T18:12:15.476 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-12-17T18:12:15.509 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-12-17T18:12:15.510 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-12-17T18:12:15.531 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-12-17T18:12:15.543 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-12-17T18:12:15.606 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-12-17T18:12:15.638 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-12-17T18:12:15.640 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-12-17T18:12:15.671 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-12-17T18:12:15.673 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-12-17T18:12:15.736 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-12-17T18:12:15.768 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-12-17T18:12:15.769 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-12-17T18:12:15.801 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-12-17T18:12:15.803 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-12-17T18:12:15.876 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-12-17T18:12:15.908 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-12-17T18:12:15.910 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-12-17T18:12:15.931 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-12-17T18:12:15.943 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-12-17T18:12:16.007 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-12-17T18:12:16.040 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qea 2021-12-17T18:12:16.041 INFO:teuthology.task.ansible.out:SQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-12-17T18:12:16.061 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-12-17T18:12:16.073 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-12-17T18:12:16.136 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-12-17T18:12:16.169 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-12-17T18:12:16.169 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-12-17T18:12:16.191 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-12-17T18:12:16.203 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-12-17T18:12:16.205 INFO:teuthology.task.ansible.out: 2021-12-17T18:12:16.267 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-12-17T18:12:16.300 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-12-17T18:12:16.311 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-12-17T18:12:16.322 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-12-17T18:12:16.333 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-12-17T18:12:16.397 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-12-17T18:12:16.429 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-12-17T18:12:16.440 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-12-17T18:12:16.451 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-12-17T18:12:16.463 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-12-17T18:12:16.464 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-12-17T18:12:16.536 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-12-17T18:12:16.569 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-12-17T18:12:16.571 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFT 2021-12-17T18:12:16.572 INFO:teuthology.task.ansible.out:Vsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-12-17T18:12:16.591 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-12-17T18:12:16.592 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-12-17T18:12:16.666 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-12-17T18:12:16.668 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-12-17T18:12:16.698 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-12-17T18:12:16.699 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-12-17T18:12:16.732 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-12-17T18:12:16.735 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-12-17T18:12:16.796 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-12-17T18:12:16.828 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-12-17T18:12:16.839 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-12-17T18:12:16.862 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-12-17T18:12:16.863 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-12-17T18:12:16.865 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-12-17T18:12:16.926 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-12-17T18:12:16.968 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-12-17T18:12:16.970 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-12-17T18:12:17.001 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-12-17T18:12:17.002 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-12-17T18:12:17.065 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-12-17T18:12:17.118 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-12-17T18:12:17.130 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-12-17T18:12:17.141 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-12-17T18:12:17.142 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-12-17T18:12:17.216 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-12-17T18:12:17.248 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-12-17T18:12:17.259 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-12-17T18:12:17.270 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-12-17T18:12:17.282 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-12-17T18:12:17.346 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-12-17T18:12:17.388 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-12-17T18:12:17.399 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-12-17T18:12:17.411 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-12-17T18:12:17.422 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-12-17T18:12:17.425 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-12-17T18:12:17.486 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-12-17T18:12:17.546 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "vali 2021-12-17T18:12:17.548 INFO:teuthology.task.ansible.out:date_certs": true} ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-12-17T18:12:17.556 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-12-17T18:12:17.558 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-12-17T18:12:17.560 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-12-17T18:12:17.640 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-12-17T18:12:17.663 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-12-17T18:12:17.688 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-12-17T18:12:17.690 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-12-17T18:12:17.711 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-12-17T18:12:17.795 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-12-17T18:12:17.797 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-12-17T18:12:17.839 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-12-17T18:12:17.839 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-12-17T18:12:17.861 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-12-17T18:12:17.935 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-12-17T18:12:17.947 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-12-17T18:12:17.969 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-12-17T18:12:17.971 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-12-17T18:12:17.991 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-12-17T18:12:18.075 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-12-17T18:12:18.077 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-12-17T18:12:18.097 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-12-17T18:12:18.099 INFO:teuthology.task.ansible.out: ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-12-17T18:12:18.131 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-12-17T18:12:18.204 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-12-17T18:12:18.216 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-12-17T18:12:18.238 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-12-17T18:12:18.260 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "k 2021-12-17T18:12:18.262 INFO:teuthology.task.ansible.out:eyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-12-17T18:12:18.345 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-12-17T18:12:18.356 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "k 2021-12-17T18:12:18.358 INFO:teuthology.task.ansible.out:eyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-12-17T18:12:18.369 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "k 2021-12-17T18:12:18.370 INFO:teuthology.task.ansible.out:eyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-12-17T18:12:18.389 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-12-17T18:12:18.391 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-12-17T18:12:18.401 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-12-17T18:12:18.486 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-12-17T18:12:18.498 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "k 2021-12-17T18:12:18.499 INFO:teuthology.task.ansible.out:eyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-12-17T18:12:18.509 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-12-17T18:12:18.543 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-12-17T18:12:18.554 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-12-17T18:12:18.629 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-12-17T18:12:18.640 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-12-17T18:12:18.641 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-12-17T18:12:18.673 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-12-17T18:12:18.675 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-12-17T18:12:18.684 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-12-17T18:12:18.789 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-12-17T18:12:18.791 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-12-17T18:12:18.793 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYo 2021-12-17T18:12:18.795 INFO:teuthology.task.ansible.out:FYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-12-17T18:12:18.802 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-12-17T18:12:18.824 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-12-17T18:12:18.826 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-12-17T18:12:18.919 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-12-17T18:12:18.931 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-12-17T18:12:18.933 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-12-17T18:12:18.935 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-12-17T18:12:18.955 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-12-17T18:12:18.957 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-12-17T18:12:19.061 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-12-17T18:12:19.073 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-12-17T18:12:19.075 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-12-17T18:12:19.085 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-12-17T18:12:19.087 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-12-17T18:12:19.212 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-12-17T18:12:19.214 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg 2021-12-17T18:12:19.215 INFO:teuthology.task.ansible.out:1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-12-17T18:12:19.225 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-12-17T18:12:19.226 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6 2021-12-17T18:12:19.228 INFO:teuthology.task.ansible.out:YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-12-17T18:12:19.341 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-12-17T18:12:19.352 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-12-17T18:12:19.353 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-12-17T18:12:19.365 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-12-17T18:12:19.377 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-12-17T18:12:19.474 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-12-17T18:12:19.485 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-12-17T18:12:19.487 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-12-17T18:12:19.497 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-12-17T18:12:19.508 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-12-17T18:12:19.615 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-12-17T18:12:19.617 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-12-17T18:12:19.618 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-12-17T18:12:19.631 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-12-17T18:12:19.642 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-12-17T18:12:19.749 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-12-17T18:12:19.751 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-12-17T18:12:19.763 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-12-17T18:12:19.765 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-12-17T18:12:19.777 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-12-17T18:12:19.885 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-12-17T18:12:19.887 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-12-17T18:12:19.910 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-12-17T18:12:19.911 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-12-17T18:12:19.913 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-12-17T18:12:20.021 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-12-17T18:12:20.022 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-12-17T18:12:20.035 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-12-17T18:12:20.037 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-12-17T18:12:20.050 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-12-17T18:12:20.148 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-12-17T18:12:20.149 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-12-17T18:12:20.172 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-12-17T18:12:20.173 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-12-17T18:12:20.175 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-12-17T18:12:20.285 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-12-17T18:12:20.286 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-12-17T18:12:20.309 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-12-17T18:12:20.312 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-12-17T18:12:20.331 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-12-17T18:12:20.417 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-12-17T18:12:20.419 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-12-17T18:12:20.440 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-12-17T18:12:20.441 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-12-17T18:12:20.473 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-12-17T18:12:20.549 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxh 2021-12-17T18:12:20.551 INFO:teuthology.task.ansible.out:iMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-12-17T18:12:20.570 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-12-17T18:12:20.581 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-12-17T18:12:20.603 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-12-17T18:12:20.677 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-12-17T18:12:20.678 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-12-17T18:12:20.700 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-12-17T18:12:20.711 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-12-17T18:12:20.733 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-12-17T18:12:20.808 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-12-17T18:12:20.820 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-12-17T18:12:20.842 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-12-17T18:12:20.855 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-12-17T18:12:20.866 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-12-17T18:12:20.941 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-12-17T18:12:20.953 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-12-17T18:12:20.975 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-12-17T18:12:20.987 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-12-17T18:12:21.010 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-12-17T18:12:21.074 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-12-17T18:12:21.085 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-12-17T18:12:21.109 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-12-17T18:12:21.122 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-12-17T18:12:21.133 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-12-17T18:12:21.231 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-12-17T18:12:21.242 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-12-17T18:12:21.254 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-12-17T18:12:21.265 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-12-17T18:12:21.277 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-12-17T18:12:21.373 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-12-17T18:12:21.375 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-12-17T18:12:21.386 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-12-17T18:12:21.408 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-12-17T18:12:21.419 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-12-17T18:12:21.516 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-12-17T18:12:21.528 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-12-17T18:12:21.530 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-12-17T18:12:21.552 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-12-17T18:12:21.563 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-12-17T18:12:21.660 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-12-17T18:12:21.671 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-12-17T18:12:21.683 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-12-17T18:12:21.684 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-12-17T18:12:21.706 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-12-17T18:12:21.795 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-12-17T18:12:21.817 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-12-17T18:12:21.819 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-12-17T18:12:21.852 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-12-17T18:12:21.853 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-12-17T18:12:21.927 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAqZvQXoWrH8ZaQ9Y8KK1B9JBCuD8Zspp2mWtjrWXGotKBCSGdDn3QSDEFtwpoK6vXZ3BijhUmrQ1bNUSo59556+T+wpfJAPJjuvB9i7A2lKSX74heuDl0QhJwHdt9mbCtpZ//7+IU0srzTn5qKwJ16GXeomgcyOZmefSGi/sbn0wRUR/UGA/LOJ3EK0nXcxyrv3iDfv75KRL87kaXtPRJRvSlXB5PSuDQtIoXhzMuD4nnh879Gwy0sYE/FUXcbl7LQb+/9rNJLE2POVNjArGv7RMp3y0K3k2/02AjbZvQwhfuIVayzTpmUiGY2Fo6hJRkH8ZT0aYF8uotfweGK18EYw== rsa-key-20151116", "key_options": null, "keyfile": "/home/oro/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oro", "validate_certs": true} 2021-12-17T18:12:21.949 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-12-17T18:12:21.951 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-12-17T18:12:21.984 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-12-17T18:12:21.995 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-12-17T18:12:22.081 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIADWYnXrwweaWs8/3gaUDctlaelfSPRh0Cs3G2SHbER0 mrfreezeex@inferno", "key_options": null, "keyfile": "/home/mrfreezeex/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mrfreezeex", "validate_certs": true} changed: [smithi062.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAqZvQXoWrH8ZaQ9Y8KK1B9JBCuD8Zspp2mWtjrWXGotKBCSGdDn3QSDEFtwpoK6vXZ3BijhUmrQ1bNUSo59556+T+wpfJAPJjuvB9i7A2lKSX74heuDl0QhJwHdt9mbCtpZ//7+IU0srzTn5qKwJ16GXeomgcyOZmefSGi/sbn0wRUR/UGA/LOJ3EK0nXcxyrv3iDfv75KRL87kaXtPRJRvSlXB5PSuDQtIoXhzMuD4nnh879Gwy0sYE/FUXcbl7LQb+/9rNJLE2POVNjArGv7RMp3y0K3k2/02AjbZvQwhfuIVayzTpmUiGY2Fo6hJRkH8ZT0aYF8uotfweGK18EYw== rsa-key-20151116", "key_options": null, "keyfile": "/home/oro/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oro", "validate_certs": true} 2021-12-17T18:12:22.082 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-12-17T18:12:22.085 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-12-17T18:12:22.161 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAqZvQXoWrH8ZaQ9Y8KK1B9JBCuD8Zspp2mWtjrWXGotKBCSGdDn3QSDEFtwpoK6vXZ3BijhUmrQ1bNUSo59556+T+wpfJAPJjuvB9i7A2lKSX74heuDl0QhJwHdt9mbCtpZ//7+IU0srzTn5qKwJ16GXeomgcyOZmefSGi/sbn0wRUR/UGA/LOJ3EK0nXcxyrv3iDfv75KRL87kaXtPRJRvSlXB5PSuDQtIoXhzMuD4nnh879Gwy0sYE/FUXcbl7LQb+/9rNJLE2POVNjArGv7RMp3y0K3k2/02AjbZvQwhfuIVayzTpmUiGY2Fo6hJRkH8ZT0aYF8uotfweGK18EYw== rsa-key-20151116", "key_options": null, "keyfile": "/home/oro/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oro", "validate_certs": true} 2021-12-17T18:12:22.163 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-12-17T18:12:22.187 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:22 +0000 (0:00:10.299) 0:00:55.912 ******* 2021-12-17T18:12:22.213 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-12-17T18:12:22.215 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIADWYnXrwweaWs8/3gaUDctlaelfSPRh0Cs3G2SHbER0 mrfreezeex@inferno", "key_options": null, "keyfile": "/home/mrfreezeex/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mrfreezeex", "validate_certs": true} 2021-12-17T18:12:22.290 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIADWYnXrwweaWs8/3gaUDctlaelfSPRh0Cs3G2SHbER0 mrfreezeex@inferno", "key_options": null, "keyfile": "/home/mrfreezeex/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mrfreezeex", "validate_certs": true} 2021-12-17T18:12:22.291 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAqZvQXoWrH8ZaQ9Y8KK1B9JBCuD8Zspp2mWtjrWXGotKBCSGdDn3QSDEFtwpoK6vXZ3BijhUmrQ1bNUSo59556+T+wpfJAPJjuvB9i7A2lKSX74heuDl0QhJwHdt9mbCtpZ//7+IU0srzTn5qKwJ16GXeomgcyOZmefSGi/sbn0wRUR/UGA/LOJ3EK0nXcxyrv3iDfv75KRL87kaXtPRJRvSlXB5PSuDQtIoXhzMuD4nnh879Gwy0sYE/FUXcbl7LQb+/9rNJLE2POVNjArGv7RMp3y0K3k2/02AjbZvQwhfuIVayzTpmUiGY2Fo6hJRkH8ZT0aYF8uotfweGK18EYw== rsa-key-20151116", "key_options": null, "keyfile": "/home/oro/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oro", "validate_certs": true} 2021-12-17T18:12:22.346 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.348 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166a 2021-12-17T18:12:22.350 INFO:teuthology.task.ansible.out:f59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: 2021-12-17T18:12:22.352 INFO:teuthology.task.ansible.out: [smithi125.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.373 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:22 +0000 (0:00:00.186) 0:00:56.099 ******* 2021-12-17T18:12:22.400 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:22 +0000 (0:00:00.026) 0:00:56.125 ******* 2021-12-17T18:12:22.410 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.411 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.413 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-12-17T18:12:22.413 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIADWYnXrwweaWs8/3gaUDctlaelfSPRh0Cs3G2SHbER0 mrfreezeex@inferno", "key_options": null, "keyfile": "/home/mrfreezeex/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mrfreezeex", "validate_certs": true} 2021-12-17T18:12:22.493 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-12-17T18:12:22.494 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMze 2021-12-17T18:12:22.496 INFO:teuthology.task.ansible.out:yCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOH 2021-12-17T18:12:22.498 INFO:teuthology.task.ansible.out:E8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PR 2021-12-17T18:12:22.499 INFO:teuthology.task.ansible.out:RFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n 2021-12-17T18:12:22.501 INFO:teuthology.task.ansible.out:'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": 2021-12-17T18:12:22.502 INFO:teuthology.task.ansible.out: "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.530 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:22 +0000 (0:00:00.130) 0:00:56.256 ******* 2021-12-17T18:12:22.538 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.539 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.540 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.541 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211 2021-12-17T18:12:22.542 INFO:teuthology.task.ansible.out:c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.543 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.607 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08R 2021-12-17T18:12:22.614 INFO:teuthology.task.ansible.out:rDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-12-17T18:12:22.617 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-12-17T18:12:22.618 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-12-17T18:12:22.619 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.633 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.636 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.645 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.647 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.657 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.659 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffce 2021-12-17T18:12:22.662 INFO:teuthology.task.ansible.out:b28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.671 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.674 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.683 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-12-17T18:12:22.698 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.709 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.753 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:22.754 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-12-17T18:12:22.776 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi125.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-12-17T18:12:22.790 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.802 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.816 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.817 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-12-17T18:12:22.830 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-12-17T18:12:22.832 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.843 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.845 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.855 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.857 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.869 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-12-17T18:12:22.870 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.871 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.882 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.896 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.897 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:22.898 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-12-17T18:12:22.899 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.913 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.924 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.936 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.937 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.950 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.964 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-12-17T18:12:22.966 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.967 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.969 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.969 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.983 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.985 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.986 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:22.988 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.000 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-12-17T18:12:23.002 INFO:teuthology.task.ansible.out: skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.003 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.004 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e 2021-12-17T18:12:23.006 INFO:teuthology.task.ansible.out:316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.016 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.018 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.019 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.030 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.032 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/h 2021-12-17T18:12:23.033 INFO:teuthology.task.ansible.out:ome/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-12-17T18:12:23.042 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-12-17T18:12:23.043 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-12-17T18:12:23.045 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.045 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": 2021-12-17T18:12:23.047 INFO:teuthology.task.ansible.out: "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.057 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.059 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.059 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed" 2021-12-17T18:12:23.061 INFO:teuthology.task.ansible.out:: false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.070 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.073 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.085 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.087 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi15 2021-12-17T18:12:23.088 INFO:teuthology.task.ansible.out:8.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.099 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.101 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.101 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'bhubbard' 2021-12-17T18:12:23.103 INFO:teuthology.task.ansible.out:, 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.113 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.115 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.115 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.116 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ov 2021-12-17T18:12:23.117 INFO:teuthology.task.ansible.out:pn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.127 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-12-17T18:12:23.129 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.129 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.130 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d5 2021-12-17T18:12:23.131 INFO:teuthology.task.ansible.out:7e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.141 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.143 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea 2021-12-17T18:12:23.145 INFO:teuthology.task.ansible.out: eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) 2021-12-17T18:12:23.146 INFO:teuthology.task.ansible.out: => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'c 2021-12-17T18:12:23.148 INFO:teuthology.task.ansible.out:meno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.158 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.159 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.159 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.159 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.160 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.161 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.173 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.175 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.175 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.176 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:23.176 INFO:teuthology.task.ansible.out:ok: 2021-12-17T18:12:23.178 INFO:teuthology.task.ansible.out:[smithi109.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilki 2021-12-17T18:12:23.179 INFO:teuthology.task.ansible.out:n@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.189 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.190 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.191 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.191 INFO:teuthology.task.ansible.out:skipping: [smi 2021-12-17T18:12:23.193 INFO:teuthology.task.ansible.out:thi125.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.202 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.203 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.203 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.204 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.204 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.205 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95b 2021-12-17T18:12:23.206 INFO:teuthology.task.ansible.out:a057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.217 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.218 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.219 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.219 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "o 2021-12-17T18:12:23.221 INFO:teuthology.task.ansible.out:vpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.232 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.233 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.234 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", " 2021-12-17T18:12:23.235 INFO:teuthology.task.ansible.out:changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.c 2021-12-17T18:12:23.237 INFO:teuthology.task.ansible.out:om GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.246 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.248 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.248 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.249 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name 2021-12-17T18:12:23.250 INFO:teuthology.task.ansible.out:": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.260 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.262 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.262 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.262 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"nam 2021-12-17T18:12:23.264 INFO:teuthology.task.ansible.out:e": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.275 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.275 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.277 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.278 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836 2021-12-17T18:12:23.279 INFO:teuthology.task.ansible.out:fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.289 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.290 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.291 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.292 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.293 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.294 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.295 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.296 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.296 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trust 2021-12-17T18:12:23.298 INFO:teuthology.task.ansible.out:y SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.310 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.310 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.312 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.313 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:23.313 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXN 2021-12-17T18:12:23.315 INFO:teuthology.task.ansible.out:ON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.316 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.318 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.319 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.320 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.321 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.323 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.325 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.335 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.337 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.337 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.338 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abe 2021-12-17T18:12:23.339 INFO:teuthology.task.ansible.out:d3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.350 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.352 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.352 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.353 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.354 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "l 2021-12-17T18:12:23.355 INFO:teuthology.task.ansible.out:mb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.367 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.368 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.369 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.369 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovp 2021-12-17T18:12:23.371 INFO:teuthology.task.ansible.out:n': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.382 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.383 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.385 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.386 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.387 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.387 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.388 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.388 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item 2021-12-17T18:12:23.391 INFO:teuthology.task.ansible.out:": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.399 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.401 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.401 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.402 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu 2021-12-17T18:12:23.403 INFO:teuthology.task.ansible.out:+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.414 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.416 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.416 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'} 2021-12-17T18:12:23.418 INFO:teuthology.task.ansible.out:) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.429 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.430 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.431 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.432 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.432 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.434 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.434 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.436 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.447 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.448 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.450 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.450 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.452 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.452 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b807 2021-12-17T18:12:23.454 INFO:teuthology.task.ansible.out:8fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.464 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.465 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.465 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.466 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.466 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.467 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, " 2021-12-17T18:12:23.468 INFO:teuthology.task.ansible.out:item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.469 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.480 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.481 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.482 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.484 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.484 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.495 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.497 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.498 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2 2021-12-17T18:12:23.500 INFO:teuthology.task.ansible.out:352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.510 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.512 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.514 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengl 2021-12-17T18:12:23.514 INFO:teuthology.task.ansible.out:and@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63d 2021-12-17T18:12:23.516 INFO:teuthology.task.ansible.out:b4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.525 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.525 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.526 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.526 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.526 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.527 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item" 2021-12-17T18:12:23.529 INFO:teuthology.task.ansible.out:: {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.529 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e5 2021-12-17T18:12:23.531 INFO:teuthology.task.ansible.out:73f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.540 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.542 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.543 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.543 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'prsrivas', ' 2021-12-17T18:12:23.545 INFO:teuthology.task.ansible.out:ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.554 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.556 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.556 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"an 2021-12-17T18:12:23.558 INFO:teuthology.task.ansible.out:sible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.568 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.570 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.571 INFO:teuthology.task.ansible.out: skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.583 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.584 INFO:teuthology.task.ansible.out: 2021-12-17T18:12:23.585 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.586 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.586 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", " 2021-12-17T18:12:23.588 INFO:teuthology.task.ansible.out:ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-12-17T18:12:23.590 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.590 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cf 2021-12-17T18:12:23.592 INFO:teuthology.task.ansible.out:e00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.602 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.604 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.604 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.606 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.607 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.618 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.620 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.620 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc97 2021-12-17T18:12:23.622 INFO:teuthology.task.ansible.out:9ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.632 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.634 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.635 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.635 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.637 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.637 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.638 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.649 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.651 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.651 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.652 INFO:teuthology.task.ansible.out:skipping: [smithi125.fro 2021-12-17T18:12:23.653 INFO:teuthology.task.ansible.out:nt.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.663 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.665 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.665 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.666 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtom 2021-12-17T18:12:23.667 INFO:teuthology.task.ansible.out:gs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.669 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.670 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.681 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.682 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.683 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.683 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name" 2021-12-17T18:12:23.685 INFO:teuthology.task.ansible.out:: "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.696 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.698 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.700 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.700 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.701 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "ite 2021-12-17T18:12:23.703 INFO:teuthology.task.ansible.out:m": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.714 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.715 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.717 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.720 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:23.721 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc9 2021-12-17T18:12:23.723 INFO:teuthology.task.ansible.out:5CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.local", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-12-17T18:12:23.734 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-12-17T18:12:23.736 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.737 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.739 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.741 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.741 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.742 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.743 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.744 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.744 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6o 2021-12-17T18:12:23.746 INFO:teuthology.task.ansible.out:bPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.755 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.757 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.757 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.758 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "a 2021-12-17T18:12:23.759 INFO:teuthology.task.ansible.out:rjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.761 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.771 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.773 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.773 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.774 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item" 2021-12-17T18:12:23.775 INFO:teuthology.task.ansible.out:, "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.785 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.787 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.788 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.789 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.800 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.802 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.802 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.803 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name 2021-12-17T18:12:23.804 INFO:teuthology.task.ansible.out:": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.814 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.815 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.816 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.816 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.817 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.817 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": { 2021-12-17T18:12:23.819 INFO:teuthology.task.ansible.out:"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.854 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.856 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.858 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.858 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.859 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.860 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.861 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.862 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.864 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.865 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.866 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-12-17T18:12:23.868 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.868 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.869 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a9962 2021-12-17T18:12:23.870 INFO:teuthology.task.ansible.out:0a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.904 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:23 +0000 (0:00:01.373) 0:00:57.629 ******* 2021-12-17T18:12:23.912 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.913 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.915 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.917 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.918 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.918 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'sudh 2021-12-17T18:12:23.920 INFO:teuthology.task.ansible.out:anaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", " 2021-12-17T18:12:23.921 INFO:teuthology.task.ansible.out:ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.922 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.922 INFO:teuthology.task.ansible.out:skippin 2021-12-17T18:12:23.924 INFO:teuthology.task.ansible.out:g: [smithi158.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.925 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark 2021-12-17T18:12:23.927 INFO:teuthology.task.ansible.out:", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.937 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.938 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.939 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.940 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.940 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.940 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": 2021-12-17T18:12:23.942 INFO:teuthology.task.ansible.out: false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.943 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw a 2021-12-17T18:12:23.944 INFO:teuthology.task.ansible.out:bcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.953 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.955 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.966 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.968 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.989 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.991 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:23.992 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-12-17T18:12:23.992 INFO:teuthology.task.ansible.out: 2021-12-17T18:12:23.992 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiaz 2021-12-17T18:12:23.994 INFO:teuthology.task.ansible.out:bou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.017 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:24 +0000 (0:00:00.113) 0:00:57.743 ******* 2021-12-17T18:12:24.044 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:24 +0000 (0:00:00.026) 0:00:57.769 ******* 2021-12-17T18:12:24.052 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.053 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.054 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.075 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.102 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:24 +0000 (0:00:00.057) 0:00:57.827 ******* 2021-12-17T18:12:24.111 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.113 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.114 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.114 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.114 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.116 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-12-17T18:12:24.117 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi192.front.se 2021-12-17T18:12:24.118 INFO:teuthology.task.ansible.out:pia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.145 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:24 +0000 (0:00:00.043) 0:00:57.870 ******* 2021-12-17T18:12:24.154 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.156 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.156 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.158 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.168 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.170 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} TASK [Filter the revoked_users list] ******************************************* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-12-17T18:12:24.170 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.198 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:24 +0000 (0:00:00.052) 0:00:57.923 ******* 2021-12-17T18:12:24.206 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.207 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.209 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.209 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.210 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.221 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.222 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.232 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.234 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:24.264 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:24.265 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [smithi125.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-12-17T18:12:24.289 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:24 +0000 (0:00:00.091) 0:00:58.015 ******* 2021-12-17T18:12:24.361 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-12-17T18:12:24.383 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:24.385 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-12-17T18:12:24.405 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:24.406 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-12-17T18:12:24.407 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-12-17T18:12:24.504 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-12-17T18:12:24.515 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-12-17T18:12:24.517 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-12-17T18:12:24.542 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:24 +0000 (0:00:00.252) 0:00:58.267 ******* 2021-12-17T18:12:24.551 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:24.553 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} ok: [smithi158.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-12-17T18:12:24.650 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-12-17T18:12:24.652 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@ 2021-12-17T18:12:24.653 INFO:teuthology.task.ansible.out:redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-12-17T18:12:24.662 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:24.664 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-12-17T18:12:24.780 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:24.781 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [smithi062.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-12-17T18:12:24.804 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-12-17T18:12:24.825 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-12-17T18:12:24.910 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:24.912 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [smithi192.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-12-17T18:12:24.922 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-12-17T18:12:24.933 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-12-17T18:12:24.955 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-12-17T18:12:25.042 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:25.044 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-12-17T18:12:25.053 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:25.055 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} ok: [smithi062.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-12-17T18:12:25.065 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-12-17T18:12:25.088 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-12-17T18:12:25.182 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:25.184 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [smithi192.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-12-17T18:12:25.205 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-12-17T18:12:25.228 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-12-17T18:12:25.313 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:25.316 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-12-17T18:12:25.325 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:25.327 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-12-17T18:12:25.347 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-12-17T18:12:25.359 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-12-17T18:12:25.370 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-12-17T18:12:25.444 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:25.446 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-12-17T18:12:25.466 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:25.468 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-12-17T18:12:25.477 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-12-17T18:12:25.499 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-12-17T18:12:25.510 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-12-17T18:12:25.574 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:25.575 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-12-17T18:12:25.606 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:25.608 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-12-17T18:12:25.618 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-12-17T18:12:25.629 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-12-17T18:12:25.651 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-12-17T18:12:25.715 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:25.717 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-12-17T18:12:25.747 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:25.749 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-12-17T18:12:25.759 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-12-17T18:12:25.770 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-12-17T18:12:25.792 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-12-17T18:12:25.856 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:25.858 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-12-17T18:12:25.888 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:25.890 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-12-17T18:12:25.900 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-12-17T18:12:25.911 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-12-17T18:12:25.933 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-12-17T18:12:25.986 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:25.988 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-12-17T18:12:26.018 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:26.020 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-12-17T18:12:26.030 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-12-17T18:12:26.052 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-12-17T18:12:26.074 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-12-17T18:12:26.127 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:26.129 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-12-17T18:12:26.159 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:26.161 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-12-17T18:12:26.182 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-12-17T18:12:26.182 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-12-17T18:12:26.215 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-12-17T18:12:26.258 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:26.260 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-12-17T18:12:26.291 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:26.293 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-12-17T18:12:26.313 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-12-17T18:12:26.315 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-12-17T18:12:26.358 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-12-17T18:12:26.390 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:26.392 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-12-17T18:12:26.454 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:26.455 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} ok: [smithi158.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-12-17T18:12:26.498 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-12-17T18:12:26.530 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:26.532 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-12-17T18:12:26.583 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi192.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-12-17T18:12:26.584 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-12-17T18:12:26.607 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-12-17T18:12:26.649 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-12-17T18:12:26.660 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:26.662 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-12-17T18:12:26.726 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi158.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} ok: [smithi192.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-12-17T18:12:26.748 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-12-17T18:12:26.781 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-12-17T18:12:26.792 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-12-17T18:12:26.857 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:26.859 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} ok: [smithi192.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-12-17T18:12:26.881 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-12-17T18:12:26.913 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-12-17T18:12:26.924 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:26.926 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-12-17T18:12:26.999 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:27.001 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} ok: [smithi158.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-12-17T18:12:27.011 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-12-17T18:12:27.056 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:27.058 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-12-17T18:12:27.132 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:27.134 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} ok: [smithi192.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-12-17T18:12:27.155 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-12-17T18:12:27.188 INFO:teuthology.task.ansible.out: 2021-12-17T18:12:27.189 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7T 2021-12-17T18:12:27.191 INFO:teuthology.task.ansible.out:gpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [smithi062.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-12-17T18:12:27.268 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-12-17T18:12:27.270 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-12-17T18:12:27.291 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-12-17T18:12:27.323 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:27.329 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-12-17T18:12:27.334 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:27.336 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-12-17T18:12:27.398 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-12-17T18:12:27.410 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-12-17T18:12:27.421 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-12-17T18:12:27.475 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:27.476 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-12-17T18:12:27.488 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:27.489 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-12-17T18:12:27.531 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-12-17T18:12:27.553 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-12-17T18:12:27.565 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-12-17T18:12:27.608 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:27.609 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-12-17T18:12:27.619 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:27.620 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-12-17T18:12:27.673 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-12-17T18:12:27.696 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-12-17T18:12:27.707 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-12-17T18:12:27.751 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-12-17T18:12:27.762 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:27.764 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-12-17T18:12:27.817 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:27.818 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-12-17T18:12:27.828 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-12-17T18:12:27.840 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-12-17T18:12:27.894 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-12-17T18:12:27.906 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-12-17T18:12:27.948 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:27.950 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-12-17T18:12:27.971 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-12-17T18:12:27.971 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-12-17T18:12:28.035 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-12-17T18:12:28.057 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:28.060 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-12-17T18:12:28.080 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:28.081 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-12-17T18:12:28.113 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-12-17T18:12:28.117 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-12-17T18:12:28.181 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-12-17T18:12:28.183 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-12-17T18:12:28.224 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:28.226 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-12-17T18:12:28.247 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-12-17T18:12:28.248 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-12-17T18:12:28.313 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-12-17T18:12:28.315 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-12-17T18:12:28.358 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi158.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-12-17T18:12:28.380 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-12-17T18:12:28.392 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-12-17T18:12:28.456 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:28.457 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [smithi062.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-12-17T18:12:28.500 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-12-17T18:12:28.522 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-12-17T18:12:28.524 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-12-17T18:12:28.587 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:28.589 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:28.590 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-12-17T18:12:28.633 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-12-17T18:12:28.655 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-12-17T18:12:28.656 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-12-17T18:12:28.720 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:28.722 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-12-17T18:12:28.732 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:28.734 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-12-17T18:12:28.765 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-12-17T18:12:28.798 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-12-17T18:12:28.800 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-12-17T18:12:28.863 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:28.865 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-12-17T18:12:28.874 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:28.877 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-12-17T18:12:28.918 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-12-17T18:12:28.940 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-12-17T18:12:28.942 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-12-17T18:12:29.006 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-12-17T18:12:29.008 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi109.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE05 2021-12-17T18:12:29.009 INFO:teuthology.task.ansible.out:54Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-12-17T18:12:29.050 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:29.052 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-12-17T18:12:29.073 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-12-17T18:12:29.085 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-12-17T18:12:29.138 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:29.140 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [smithi062.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-12-17T18:12:29.193 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-12-17T18:12:29.204 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-12-17T18:12:29.216 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-12-17T18:12:29.281 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-12-17T18:12:29.293 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:29.294 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-12-17T18:12:29.337 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:29.339 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-12-17T18:12:29.350 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-12-17T18:12:29.352 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-12-17T18:12:29.418 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-12-17T18:12:29.420 INFO:teuthology.task.ansible.out: 2021-12-17T18:12:29.440 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:29.441 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-12-17T18:12:29.443 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-12-17T18:12:29.483 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:29.485 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-12-17T18:12:29.495 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-12-17T18:12:29.495 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-12-17T18:12:29.550 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-12-17T18:12:29.561 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:29.563 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-12-17T18:12:29.625 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:29.626 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-12-17T18:12:29.628 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-12-17T18:12:29.629 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-12-17T18:12:29.693 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-12-17T18:12:29.726 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-12-17T18:12:29.759 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:29.760 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-12-17T18:12:29.762 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-12-17T18:12:29.773 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-12-17T18:12:29.826 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-12-17T18:12:29.859 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:29.861 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-12-17T18:12:29.902 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi192.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-12-17T18:12:29.904 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-12-17T18:12:29.915 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-12-17T18:12:29.957 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-12-17T18:12:29.991 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-12-17T18:12:30.034 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:30.036 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} ok: [smithi192.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-12-17T18:12:30.047 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-12-17T18:12:30.100 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-12-17T18:12:30.133 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:30.136 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-12-17T18:12:30.166 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:30.168 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} ok: [smithi125.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-12-17T18:12:30.179 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-12-17T18:12:30.181 INFO:teuthology.task.ansible.out: 2021-12-17T18:12:30.233 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-12-17T18:12:30.286 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:30.288 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-12-17T18:12:30.309 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi192.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} ok: [smithi125.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-12-17T18:12:30.322 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-12-17T18:12:30.382 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-12-17T18:12:30.425 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:30.427 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-12-17T18:12:30.437 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:30.439 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-12-17T18:12:30.449 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-12-17T18:12:30.460 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-12-17T18:12:30.524 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-12-17T18:12:30.567 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:30.569 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-12-17T18:12:30.579 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:30.581 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} ok: [smithi125.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-12-17T18:12:30.592 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-12-17T18:12:30.667 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-12-17T18:12:30.710 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-12-17T18:12:30.712 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-12-17T18:12:30.713 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi125.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-12-17T18:12:30.735 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-12-17T18:12:30.809 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-12-17T18:12:30.852 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-12-17T18:12:30.854 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [smithi125.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-12-17T18:12:30.869 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-12-17T18:12:30.942 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-12-17T18:12:30.985 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:30.987 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-12-17T18:12:30.997 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:30.999 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} ok: [smithi192.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-12-17T18:12:31.020 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-12-17T18:12:31.084 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-12-17T18:12:31.117 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:31.118 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-12-17T18:12:31.142 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi192.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-12-17T18:12:31.143 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-12-17T18:12:31.155 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-12-17T18:12:31.219 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-12-17T18:12:31.252 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:31.254 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-12-17T18:12:31.274 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:31.276 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} ok: [smithi192.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-12-17T18:12:31.287 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-12-17T18:12:31.361 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-12-17T18:12:31.382 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:31.384 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-12-17T18:12:31.405 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi125.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-12-17T18:12:31.416 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-12-17T18:12:31.429 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-12-17T18:12:31.493 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-12-17T18:12:31.527 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:31.528 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-12-17T18:12:31.538 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:31.540 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-12-17T18:12:31.550 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-12-17T18:12:31.562 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-12-17T18:12:31.638 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-12-17T18:12:31.661 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:31.663 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-12-17T18:12:31.673 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:31.674 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-12-17T18:12:31.685 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-12-17T18:12:31.697 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-12-17T18:12:31.773 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-12-17T18:12:31.784 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-12-17T18:12:31.819 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:31.821 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} ok: [smithi192.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-12-17T18:12:31.844 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-12-17T18:12:32.030 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:32 +0000 (0:00:07.487) 0:01:05.755 ******* 2021-12-17T18:12:32.039 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-12-17T18:12:32.040 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:32.041 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-12-17T18:12:32.042 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi192.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-12-17T18:12:32.043 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-12-17T18:12:32.069 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-12-17T18:12:32.097 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:32 +0000 (0:00:00.067) 0:01:05.822 ******* 2021-12-17T18:12:32.131 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:32.133 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [smithi192.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-12-17T18:12:32.160 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:32 +0000 (0:00:00.063) 0:01:05.886 ******* 2021-12-17T18:12:32.225 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:32.227 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [smithi192.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-12-17T18:12:32.369 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-12-17T18:12:32.372 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-12-17T18:12:32.378 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:32.419 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:32 +0000 (0:00:00.258) 0:01:06.144 ******* 2021-12-17T18:12:32.510 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:32.512 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-12-17T18:12:32.575 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-12-17T18:12:32.577 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "checksum": "09dde075805f5d4bdea4ecc07cef18b8cc5cbdf3", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "2cf30c8356ea33991eb6921c31aaa08a", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1639764752.1858127-13412-184975549465372/source", "state": "file", "uid": 0} changed: [smithi125.front.sepia.ceph.com] => {"changed": true, "checksum": "09dde075805f5d4bdea4ecc07cef18b8cc5cbdf3", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "2cf30c8356ea33991eb6921c31aaa08a", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1639764752.1159756-13405-65104295960211/source", "state": "file", "uid": 0} 2021-12-17T18:12:32.602 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:32 +0000 (0:00:00.183) 0:01:06.328 ******* 2021-12-17T18:12:32.625 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:32 +0000 (0:00:00.022) 0:01:06.350 ******* 2021-12-17T18:12:32.643 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "checksum": "09dde075805f5d4bdea4ecc07cef18b8cc5cbdf3", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "2cf30c8356ea33991eb6921c31aaa08a", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1639764752.2537823-13432-108346382329515/source", "state": "file", "uid": 0} 2021-12-17T18:12:32.645 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi109.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-12-17T18:12:32.670 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:32 +0000 (0:00:00.044) 0:01:06.395 ******* 2021-12-17T18:12:32.677 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-12-17T18:12:32.680 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => { "msg": "Host smithi125.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-12-17T18:12:32.707 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:32 +0000 (0:00:00.037) 0:01:06.432 ******* 2021-12-17T18:12:32.715 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => { "msg": "Host smithi158.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-12-17T18:12:32.742 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:32 +0000 (0:00:00.035) 0:01:06.468 ******* 2021-12-17T18:12:32.751 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => { "msg": "Host smithi062.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-12-17T18:12:32.781 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:32 +0000 (0:00:00.037) 0:01:06.506 ******* 2021-12-17T18:12:32.790 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-12-17T18:12:32.792 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAqZvQXoWrH8ZaQ9Y8KK1B9JBCuD8Zspp2mWtjrWXGotKBCSGdDn3QSDEFtwpoK6vXZ3BijhUmrQ1bNUSo59556+T+wpfJAPJjuvB9i7A2lKSX74heuDl0QhJwHdt9mbCtpZ//7+IU0srzTn5qKwJ16GXeomgcyOZmefSGi/sbn0wRUR/UGA/LOJ3EK0nXcxyrv3iDfv75KRL87kaXtPRJRvSlXB5PSuDQtIoXhzMuD4nnh879Gwy0sYE/FUXcbl7LQb+/9rNJLE2POVNjArGv7RMp3y0K3k2/02AjbZvQwhfuIVayzTpmUiGY2Fo6hJRkH8ZT0aYF8uotfweGK18EYw== rsa-key-20151116", "key_options": null, "keyfile": "/home/oro/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oro", "validate_certs": true} TASK [common : Including major version specific variables.] ******************** ok: [smithi125.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-12-17T18:12:32.819 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:32 +0000 (0:00:00.038) 0:01:06.544 ******* 2021-12-17T18:12:32.828 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-12-17T18:12:32.856 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:32 +0000 (0:00:00.036) 0:01:06.581 ******* 2021-12-17T18:12:32.864 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-12-17T18:12:32.900 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:32 +0000 (0:00:00.044) 0:01:06.625 ******* 2021-12-17T18:12:32.909 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-12-17T18:12:32.910 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "checksum": "09dde075805f5d4bdea4ecc07cef18b8cc5cbdf3", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "2cf30c8356ea33991eb6921c31aaa08a", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1639764752.5049922-13465-7558338317676/source", "state": "file", "uid": 0} TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:32.912 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi109.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIADWYnXrwweaWs8/3gaUDctlaelfSPRh0Cs3G2SHbER0 mrfreezeex@inferno", "key_options": null, "keyfile": "/home/mrfreezeex/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mrfreezeex", "validate_certs": true} 2021-12-17T18:12:32.946 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:32 +0000 (0:00:00.046) 0:01:06.671 ******* 2021-12-17T18:12:32.971 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:32 +0000 (0:00:00.024) 0:01:06.696 ******* 2021-12-17T18:12:33.035 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-12-17T18:12:33.037 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.061 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.090) 0:01:06.786 ******* 2021-12-17T18:12:33.086 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.024) 0:01:06.811 ******* 2021-12-17T18:12:33.111 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.024) 0:01:06.836 ******* 2021-12-17T18:12:33.135 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.024) 0:01:06.860 ******* 2021-12-17T18:12:33.146 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi192.front.sepia.ceph.com] => { "msg": "Host smithi192.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.177 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.042) 0:01:06.903 ******* 2021-12-17T18:12:33.203 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.025) 0:01:06.929 ******* 2021-12-17T18:12:33.211 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-12-17T18:12:33.213 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.213 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.215 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.217 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd 2021-12-17T18:12:33.218 INFO:teuthology.task.ansible.out:0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.219 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deff 2021-12-17T18:12:33.221 INFO:teuthology.task.ansible.out:ceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.247 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.043) 0:01:06.972 ******* 2021-12-17T18:12:33.271 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.024) 0:01:06.996 ******* 2021-12-17T18:12:33.280 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.282 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.282 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi192.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-12-17T18:12:33.309 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.037) 0:01:07.034 ******* 2021-12-17T18:12:33.339 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.029) 0:01:07.064 ******* 2021-12-17T18:12:33.347 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-12-17T18:12:33.348 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.375 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.036) 0:01:07.100 ******* 2021-12-17T18:12:33.401 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.025) 0:01:07.126 ******* 2021-12-17T18:12:33.409 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-12-17T18:12:33.411 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": " 2021-12-17T18:12:33.412 INFO:teuthology.task.ansible.out:Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.413 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reaso 2021-12-17T18:12:33.414 INFO:teuthology.task.ansible.out:n": "Conditional result was False"} 2021-12-17T18:12:33.440 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.038) 0:01:07.165 ******* 2021-12-17T18:12:33.464 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.024) 0:01:07.189 ******* 2021-12-17T18:12:33.472 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-12-17T18:12:33.474 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.500 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.035) 0:01:07.226 ******* 2021-12-17T18:12:33.525 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.024) 0:01:07.250 ******* 2021-12-17T18:12:33.532 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.534 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-12-17T18:12:33.560 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.036) 0:01:07.286 ******* 2021-12-17T18:12:33.569 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-12-17T18:12:33.570 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.572 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.597 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.036) 0:01:07.323 ******* 2021-12-17T18:12:33.619 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.021) 0:01:07.345 ******* 2021-12-17T18:12:33.626 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-12-17T18:12:33.629 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.654 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.035) 0:01:07.380 ******* 2021-12-17T18:12:33.662 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-12-17T18:12:33.664 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi109.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", " 2021-12-17T18:12:33.665 INFO:teuthology.task.ansible.out:validate_certs": true} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.694 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.039) 0:01:07.419 ******* 2021-12-17T18:12:33.701 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-12-17T18:12:33.703 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.704 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e11563 2021-12-17T18:12:33.705 INFO:teuthology.task.ansible.out:82fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.706 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02T 2021-12-17T18:12:33.707 INFO:teuthology.task.ansible.out:ZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.735 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.041) 0:01:07.461 ******* 2021-12-17T18:12:33.759 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.023) 0:01:07.485 ******* 2021-12-17T18:12:33.767 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.768 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.769 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.770 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.771 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.771 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_ 2021-12-17T18:12:33.773 INFO:teuthology.task.ansible.out:loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.773 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ********************** 2021-12-17T18:12:33.775 INFO:teuthology.task.ansible.out:******* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.775 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.802 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.042) 0:01:07.527 ******* 2021-12-17T18:12:33.828 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.025) 0:01:07.553 ******* 2021-12-17T18:12:33.836 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.837 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.838 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.839 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.839 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.840 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed 2021-12-17T18:12:33.842 INFO:teuthology.task.ansible.out:": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": fal 2021-12-17T18:12:33.844 INFO:teuthology.task.ansible.out:se, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.868 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.040) 0:01:07.594 ******* 2021-12-17T18:12:33.891 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.022) 0:01:07.616 ******* 2021-12-17T18:12:33.899 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.899 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.901 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.901 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.902 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.903 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.904 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.904 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.930 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.039) 0:01:07.656 ******* 2021-12-17T18:12:33.954 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.023) 0:01:07.679 ******* 2021-12-17T18:12:33.962 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.964 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.964 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.966 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi125.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:33.966 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:33.967 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-12-17T18:12:33.967 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.967 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional r 2021-12-17T18:12:33.969 INFO:teuthology.task.ansible.out:esult was False"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.969 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:33.997 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:33 +0000 (0:00:00.042) 0:01:07.722 ******* 2021-12-17T18:12:34.022 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.024) 0:01:07.747 ******* 2021-12-17T18:12:34.030 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.031 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.032 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.033 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi062.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:34.033 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:34.034 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba5 2021-12-17T18:12:34.036 INFO:teuthology.task.ansible.out:59a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.061 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.039) 0:01:07.787 ******* 2021-12-17T18:12:34.069 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-12-17T18:12:34.071 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.072 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.073 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedo 2021-12-17T18:12:34.074 INFO:teuthology.task.ansible.out:ra OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} TASK [common : Set have_entitlements] ****************************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.075 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.101 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.040) 0:01:07.827 ******* 2021-12-17T18:12:34.135 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.033) 0:01:07.860 ******* 2021-12-17T18:12:34.144 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.146 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.146 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.147 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.147 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-12-17T18:12:34.148 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c 2021-12-17T18:12:34.149 INFO:teuthology.task.ansible.out:8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.150 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7 2021-12-17T18:12:34.151 INFO:teuthology.task.ansible.out:uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} TASK [common : Set have_entitlements] ****************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.152 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.152 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.178 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.043) 0:01:07.903 ******* 2021-12-17T18:12:34.204 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.026) 0:01:07.930 ******* 2021-12-17T18:12:34.213 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.214 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.215 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.216 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.217 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.218 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.218 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.219 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'shyukr 2021-12-17T18:12:34.220 INFO:teuthology.task.ansible.out:i', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi158.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.247 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.042) 0:01:07.973 ******* 2021-12-17T18:12:34.273 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.025) 0:01:07.998 ******* 2021-12-17T18:12:34.280 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.282 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.284 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.284 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.285 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.285 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.285 INFO:teuthology.task.ansible.out: TASK [common 2021-12-17T18:12:34.287 INFO:teuthology.task.ansible.out:: Install yum on Fedora 22 and later] ***************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.312 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.039) 0:01:08.038 ******* 2021-12-17T18:12:34.340 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.027) 0:01:08.065 ******* 2021-12-17T18:12:34.348 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.350 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.351 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.352 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.353 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.354 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.354 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.355 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.355 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e 2021-12-17T18:12:34.357 INFO:teuthology.task.ansible.out:43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.384 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.043) 0:01:08.109 ******* 2021-12-17T18:12:34.408 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.024) 0:01:08.134 ******* 2021-12-17T18:12:34.417 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.419 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.419 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.419 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-12-17T18:12:34.420 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.420 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_l 2021-12-17T18:12:34.422 INFO:teuthology.task.ansible.out:oop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.422 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.450 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.041) 0:01:08.175 ******* 2021-12-17T18:12:34.475 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.025) 0:01:08.201 ******* 2021-12-17T18:12:34.484 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-12-17T18:12:34.486 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.486 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.486 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.487 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var 2021-12-17T18:12:34.488 INFO:teuthology.task.ansible.out:": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi125.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:34.489 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.490 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.492 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.492 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.520 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.044) 0:01:08.245 ******* 2021-12-17T18:12:34.551 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.031) 0:01:08.276 ******* 2021-12-17T18:12:34.560 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.562 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.564 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.566 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.566 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.568 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.593 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.042) 0:01:08.319 ******* 2021-12-17T18:12:34.602 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-12-17T18:12:34.604 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi192.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-12-17T18:12:34.606 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.607 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.608 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'su 2021-12-17T18:12:34.610 INFO:teuthology.task.ansible.out:dhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional res 2021-12-17T18:12:34.611 INFO:teuthology.task.ansible.out:ult was False"} 2021-12-17T18:12:34.636 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.042) 0:01:08.361 ******* 2021-12-17T18:12:34.661 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.024) 0:01:08.386 ******* 2021-12-17T18:12:34.668 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.670 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.672 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.673 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi109.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.699 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.038) 0:01:08.424 ******* 2021-12-17T18:12:34.723 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.023) 0:01:08.448 ******* 2021-12-17T18:12:34.750 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-12-17T18:12:34.752 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set have_entitlements] ****************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.776 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.053) 0:01:08.502 ******* 2021-12-17T18:12:34.801 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.023) 0:01:08.525 ******* 2021-12-17T18:12:34.823 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.022) 0:01:08.548 ******* 2021-12-17T18:12:34.830 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-12-17T18:12:34.832 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:34.858 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.035) 0:01:08.584 ******* 2021-12-17T18:12:34.888 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.029) 0:01:08.613 ******* 2021-12-17T18:12:34.901 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-12-17T18:12:34.903 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:34.929 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.041) 0:01:08.654 ******* 2021-12-17T18:12:34.978 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:34 +0000 (0:00:00.048) 0:01:08.703 ******* 2021-12-17T18:12:35.010 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.032) 0:01:08.735 ******* 2021-12-17T18:12:35.018 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-12-17T18:12:35.020 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:35.046 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.036) 0:01:08.772 ******* 2021-12-17T18:12:35.070 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.023) 0:01:08.795 ******* 2021-12-17T18:12:35.079 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the releasever] ********************************************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:35.106 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.035) 0:01:08.831 ******* 2021-12-17T18:12:35.129 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.023) 0:01:08.854 ******* 2021-12-17T18:12:35.136 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-12-17T18:12:35.138 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:35.163 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.034) 0:01:08.888 ******* 2021-12-17T18:12:35.171 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-12-17T18:12:35.173 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-12-17T18:12:35.199 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.035) 0:01:08.924 ******* 2021-12-17T18:12:35.206 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-12-17T18:12:35.208 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi192.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:35.234 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.035) 0:01:08.959 ******* 2021-12-17T18:12:35.257 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.023) 0:01:08.983 ******* 2021-12-17T18:12:35.265 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-12-17T18:12:35.267 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:35.300 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.041) 0:01:09.025 ******* 2021-12-17T18:12:35.308 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-12-17T18:12:35.310 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-12-17T18:12:35.311 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:35.337 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.038) 0:01:09.063 ******* 2021-12-17T18:12:35.364 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.026) 0:01:09.089 ******* 2021-12-17T18:12:35.373 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-12-17T18:12:35.374 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:35.403 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.038) 0:01:09.128 ******* 2021-12-17T18:12:35.429 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.025) 0:01:09.154 ******* 2021-12-17T18:12:35.435 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-12-17T18:12:35.437 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-12-17T18:12:35.438 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:35.465 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.036) 0:01:09.190 ******* 2021-12-17T18:12:35.498 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.032) 0:01:09.223 ******* 2021-12-17T18:12:35.508 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-12-17T18:12:35.510 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Register with subscription-manager.] **************************** skipping: [smithi192.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:35.538 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.040) 0:01:09.263 ******* 2021-12-17T18:12:35.563 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.025) 0:01:09.289 ******* 2021-12-17T18:12:35.571 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-12-17T18:12:35.573 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-12-17T18:12:35.599 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.035) 0:01:09.324 ******* 2021-12-17T18:12:35.606 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-12-17T18:12:35.608 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:35.633 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.034) 0:01:09.358 ******* 2021-12-17T18:12:35.639 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-12-17T18:12:35.641 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:35.666 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.032) 0:01:09.391 ******* 2021-12-17T18:12:35.696 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.030) 0:01:09.421 ******* 2021-12-17T18:12:35.704 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-12-17T18:12:35.706 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-12-17T18:12:35.708 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:35.733 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.037) 0:01:09.458 ******* 2021-12-17T18:12:35.756 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.023) 0:01:09.482 ******* 2021-12-17T18:12:35.765 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-12-17T18:12:35.767 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : List CDN releases available to system] ************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:35.795 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.038) 0:01:09.520 ******* 2021-12-17T18:12:35.819 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.023) 0:01:09.544 ******* 2021-12-17T18:12:35.826 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-12-17T18:12:35.828 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:35.854 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.035) 0:01:09.580 ******* 2021-12-17T18:12:35.877 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.022) 0:01:09.602 ******* 2021-12-17T18:12:35.885 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:35.887 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-12-17T18:12:35.897 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:35.923 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.046) 0:01:09.649 ******* 2021-12-17T18:12:35.930 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-12-17T18:12:35.933 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:35.958 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.034) 0:01:09.683 ******* 2021-12-17T18:12:35.983 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:35 +0000 (0:00:00.025) 0:01:09.708 ******* 2021-12-17T18:12:35.991 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-12-17T18:12:35.993 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-12-17T18:12:35.994 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.021 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.038) 0:01:09.746 ******* 2021-12-17T18:12:36.046 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.025) 0:01:09.771 ******* 2021-12-17T18:12:36.055 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-12-17T18:12:36.057 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.088 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.041) 0:01:09.813 ******* 2021-12-17T18:12:36.115 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.026) 0:01:09.840 ******* 2021-12-17T18:12:36.124 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-12-17T18:12:36.126 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-12-17T18:12:36.127 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.155 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.039) 0:01:09.880 ******* 2021-12-17T18:12:36.182 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.026) 0:01:09.907 ******* 2021-12-17T18:12:36.190 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-12-17T18:12:36.191 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi192.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:36.219 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.036) 0:01:09.944 ******* 2021-12-17T18:12:36.248 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.029) 0:01:09.973 ******* 2021-12-17T18:12:36.259 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-12-17T18:12:36.261 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:36.261 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-12-17T18:12:36.263 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.291 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.043) 0:01:10.016 ******* 2021-12-17T18:12:36.316 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.024) 0:01:10.041 ******* 2021-12-17T18:12:36.323 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-12-17T18:12:36.325 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Clean yum cache] ************************************************ skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.351 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.035) 0:01:10.076 ******* 2021-12-17T18:12:36.376 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.024) 0:01:10.101 ******* 2021-12-17T18:12:36.382 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-12-17T18:12:36.384 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-12-17T18:12:36.386 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.412 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.035) 0:01:10.137 ******* 2021-12-17T18:12:36.436 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.023) 0:01:10.161 ******* 2021-12-17T18:12:36.443 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-12-17T18:12:36.445 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.474 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.038) 0:01:10.200 ******* 2021-12-17T18:12:36.483 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-12-17T18:12:36.485 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.512 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.037) 0:01:10.237 ******* 2021-12-17T18:12:36.519 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:36.521 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Enable necessary rhsm repos] ************************************ 2021-12-17T18:12:36.521 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.548 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.036) 0:01:10.273 ******* 2021-12-17T18:12:36.571 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.023) 0:01:10.296 ******* 2021-12-17T18:12:36.578 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-12-17T18:12:36.580 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Store list of enabled repos] ************************************ skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.606 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.034) 0:01:10.331 ******* 2021-12-17T18:12:36.629 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.023) 0:01:10.354 ******* 2021-12-17T18:12:36.636 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-12-17T18:12:36.637 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.663 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.034) 0:01:10.388 ******* 2021-12-17T18:12:36.670 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-12-17T18:12:36.672 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.699 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.036) 0:01:10.424 ******* 2021-12-17T18:12:36.721 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.022) 0:01:10.447 ******* 2021-12-17T18:12:36.729 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-12-17T18:12:36.731 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.758 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.035) 0:01:10.482 ******* 2021-12-17T18:12:36.765 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.793 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.035) 0:01:10.518 ******* 2021-12-17T18:12:36.801 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:36.803 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-12-17T18:12:36.804 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.804 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.806 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-12-17T18:12:36.806 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:36.832 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.039) 0:01:10.558 ******* 2021-12-17T18:12:36.864 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.032) 0:01:10.590 ******* 2021-12-17T18:12:36.874 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-12-17T18:12:36.876 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.904 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.039) 0:01:10.629 ******* 2021-12-17T18:12:36.919 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.922 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-12-17T18:12:36.923 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:36.924 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-12-17T18:12:36.950 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.046) 0:01:10.675 ******* 2021-12-17T18:12:36.975 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:36 +0000 (0:00:00.024) 0:01:10.700 ******* 2021-12-17T18:12:36.983 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-12-17T18:12:36.985 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.011 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.036) 0:01:10.737 ******* 2021-12-17T18:12:37.036 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.024) 0:01:10.761 ******* 2021-12-17T18:12:37.044 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-12-17T18:12:37.045 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.046 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.073 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.037) 0:01:10.799 ******* 2021-12-17T18:12:37.097 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.024) 0:01:10.823 ******* 2021-12-17T18:12:37.106 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:37.108 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi192.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:37.135 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.037) 0:01:10.860 ******* 2021-12-17T18:12:37.159 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.023) 0:01:10.884 ******* 2021-12-17T18:12:37.166 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-12-17T18:12:37.168 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.196 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.035) 0:01:10.920 ******* 2021-12-17T18:12:37.203 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-12-17T18:12:37.215 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-12-17T18:12:37.217 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.241 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.046) 0:01:10.966 ******* 2021-12-17T18:12:37.248 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.281 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.039) 0:01:11.006 ******* 2021-12-17T18:12:37.331 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-12-17T18:12:37.354 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-12-17T18:12:37.355 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.379 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.098) 0:01:11.104 ******* 2021-12-17T18:12:37.388 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-12-17T18:12:37.388 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.418 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.039) 0:01:11.144 ******* 2021-12-17T18:12:37.427 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-12-17T18:12:37.428 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.012386", "end": "2021-12-17 18:12:37.682170", "rc": 0, "start": "2021-12-17 18:12:37.669784", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-12-17T18:12:37.457 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.038) 0:01:11.183 ******* 2021-12-17T18:12:37.466 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-12-17T18:12:37.468 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-12-17T18:12:37.497 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.039) 0:01:11.223 ******* 2021-12-17T18:12:37.505 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-12-17T18:12:37.507 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.204544", "end": "2021-12-17 18:12:37.221033", "rc": 0, "start": "2021-12-17 18:12:37.016489", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-12-17T18:12:37.507 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi158.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.508 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.536 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.039) 0:01:11.262 ******* 2021-12-17T18:12:37.562 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.025) 0:01:11.287 ******* 2021-12-17T18:12:37.572 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-12-17T18:12:37.574 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.601 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.038) 0:01:11.326 ******* 2021-12-17T18:12:37.609 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.611 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.613 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.640 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.039) 0:01:11.365 ******* 2021-12-17T18:12:37.663 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.022) 0:01:11.388 ******* 2021-12-17T18:12:37.671 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-12-17T18:12:37.672 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.673 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-12-17T18:12:37.673 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.700 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.037) 0:01:11.425 ******* 2021-12-17T18:12:37.724 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.024) 0:01:11.450 ******* 2021-12-17T18:12:37.733 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:37.735 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-12-17T18:12:37.766 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.041) 0:01:11.491 ******* 2021-12-17T18:12:37.774 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-12-17T18:12:37.776 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.804 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.038) 0:01:11.530 ******* 2021-12-17T18:12:37.857 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:37.859 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-12-17T18:12:37.880 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-12-17T18:12:37.881 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:37.905 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.100) 0:01:11.630 ******* 2021-12-17T18:12:37.924 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-12-17T18:12:37.925 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.014969", "end": "2021-12-17 18:12:37.688733", "rc": 0, "start": "2021-12-17 18:12:37.673764", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-12-17T18:12:37.952 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:37 +0000 (0:00:00.047) 0:01:11.678 ******* 2021-12-17T18:12:37.994 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-12-17T18:12:38.026 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:38.050 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:38 +0000 (0:00:00.098) 0:01:11.776 ******* 2021-12-17T18:12:38.102 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-12-17T18:12:38.104 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.020614", "end": "2021-12-17 18:12:38.097434", "rc": 0, "start": "2021-12-17 18:12:38.076820", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-12-17T18:12:38.129 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:38 +0000 (0:00:00.078) 0:01:11.854 ******* 2021-12-17T18:12:38.137 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:38.168 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:38 +0000 (0:00:00.038) 0:01:11.893 ******* 2021-12-17T18:12:38.176 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:38.178 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-12-17T18:12:38.199 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:38.227 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:38 +0000 (0:00:00.058) 0:01:11.951 ******* 2021-12-17T18:12:38.264 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:38.266 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-12-17T18:12:38.297 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-12-17T18:12:38.299 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-common.service grub-initrd-fallback.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-initrd-fallback.service grub-common.service"}} 2021-12-17T18:12:38.310 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-common.service grub-initrd-fallback.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2021-12-17T18:12:38.311 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:38.334 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:38 +0000 (0:00:00.108) 0:01:12.059 ******* 2021-12-17T18:12:38.405 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:38.406 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-12-17T18:12:38.417 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-12-17T18:12:38.419 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-common.service grub-initrd-fallback.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-initrd-fallback.service grub-common.service"}} 2021-12-17T18:12:38.471 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-12-17T18:12:38.484 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-12-17T18:12:38.550 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:38.552 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-12-17T18:12:38.606 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-12-17T18:12:38.608 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-12-17T18:12:38.619 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-common.service grub-initrd-fallback.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2021-12-17T18:12:38.641 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-12-17T18:12:38.653 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-12-17T18:12:38.686 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:38.688 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-12-17T18:12:38.782 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-12-17T18:12:38.784 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-12-17T18:12:38.794 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-12-17T18:12:38.818 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-12-17T18:12:38.825 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-12-17T18:12:38.854 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:38 +0000 (0:00:00.520) 0:01:12.579 ******* 2021-12-17T18:12:38.863 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-12-17T18:12:38.865 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-12-17T18:12:38.894 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:38 +0000 (0:00:00.039) 0:01:12.619 ******* 2021-12-17T18:12:38.915 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-12-17T18:12:38.916 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:38.946 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:38 +0000 (0:00:00.051) 0:01:12.671 ******* 2021-12-17T18:12:38.964 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:38.965 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-12-17T18:12:38.966 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-12-17T18:12:38.969 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-12-17T18:12:38.974 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-12-17T18:12:38.976 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Mask sleep units] *********************************************** ok: [smithi192.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-12-17T18:12:39.001 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:38 +0000 (0:00:00.055) 0:01:12.726 ******* 2021-12-17T18:12:39.026 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.025) 0:01:12.751 ******* 2021-12-17T18:12:39.034 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:39.061 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.034) 0:01:12.786 ******* 2021-12-17T18:12:39.079 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:39.106 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.044) 0:01:12.831 ******* 2021-12-17T18:12:39.113 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:39.115 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} TASK [common : Get the current timezone] *************************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:39.150 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.042) 0:01:12.874 ******* 2021-12-17T18:12:39.160 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-12-17T18:12:39.162 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Mask sleep units] *********************************************** ok: [smithi192.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-12-17T18:12:39.191 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.042) 0:01:12.916 ******* 2021-12-17T18:12:39.214 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.022) 0:01:12.939 ******* 2021-12-17T18:12:39.245 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-12-17T18:12:39.323 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-12-17T18:12:39.325 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:39.348 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.134) 0:01:13.073 ******* 2021-12-17T18:12:39.379 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:39.381 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-12-17T18:12:39.382 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:39.413 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.065) 0:01:13.139 ******* 2021-12-17T18:12:39.435 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-12-17T18:12:39.437 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:39.612 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.199) 0:01:13.338 ******* 2021-12-17T18:12:39.621 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-12-17T18:12:39.623 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-12-17T18:12:39.625 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:39.651 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.038) 0:01:13.376 ******* 2021-12-17T18:12:39.677 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.026) 0:01:13.402 ******* 2021-12-17T18:12:39.686 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-12-17T18:12:39.688 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-12-17T18:12:39.717 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.039) 0:01:13.442 ******* 2021-12-17T18:12:39.725 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-12-17T18:12:39.727 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:39.755 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.037) 0:01:13.480 ******* 2021-12-17T18:12:39.781 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.025) 0:01:13.506 ******* 2021-12-17T18:12:39.789 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-12-17T18:12:39.791 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:39.819 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.039) 0:01:13.545 ******* 2021-12-17T18:12:39.846 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.026) 0:01:13.571 ******* 2021-12-17T18:12:39.855 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:39.857 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-12-17T18:12:39.889 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:39.914 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.068) 0:01:13.639 ******* 2021-12-17T18:12:39.922 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-12-17T18:12:39.924 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:39.949 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:39 +0000 (0:00:00.035) 0:01:13.675 ******* 2021-12-17T18:12:39.957 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:39.959 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-12-17T18:12:40.024 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:40.048 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:40 +0000 (0:00:00.098) 0:01:13.774 ******* 2021-12-17T18:12:40.065 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:40.067 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-12-17T18:12:40.119 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:40.143 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:40 +0000 (0:00:00.095) 0:01:13.869 ******* 2021-12-17T18:12:40.202 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:40.204 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-12-17T18:12:40.224 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-12-17T18:12:40.226 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.335191", "end": "2021-12-17 18:12:40.500347", "rc": 0, "start": "2021-12-17 18:12:40.165156", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:12:40.259 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:40 +0000 (0:00:00.115) 0:01:13.985 ******* 2021-12-17T18:12:40.330 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-12-17T18:12:40.332 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:40.354 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:40 +0000 (0:00:00.094) 0:01:14.079 ******* 2021-12-17T18:12:40.362 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:40.364 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-12-17T18:12:40.479 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-12-17T18:12:40.511 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-12-17T18:12:40.513 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.231433", "end": "2021-12-17 18:12:40.500461", "rc": 0, "start": "2021-12-17 18:12:40.269028", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:12:40.538 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:40 +0000 (0:00:00.183) 0:01:14.263 ******* 2021-12-17T18:12:40.609 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-12-17T18:12:40.611 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-12-17T18:12:40.635 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:40 +0000 (0:00:00.097) 0:01:14.360 ******* 2021-12-17T18:12:40.664 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-12-17T18:12:40.666 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.121839", "end": "2021-12-17 18:12:40.927645", "rc": 0, "start": "2021-12-17 18:12:40.805806", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:12:40.691 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:40 +0000 (0:00:00.055) 0:01:14.416 ******* 2021-12-17T18:12:40.741 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-12-17T18:12:40.743 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.687439", "end": "2021-12-17 18:12:40.500496", "rc": 0, "start": "2021-12-17 18:12:39.813057", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:12:40.767 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:40 +0000 (0:00:00.075) 0:01:14.492 ******* 2021-12-17T18:12:40.775 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:40.777 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} TASK [common : Set the hardware clock] ***************************************** changed: [smithi125.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.849923", "end": "2021-12-17 18:12:40.505802", "rc": 0, "start": "2021-12-17 18:12:39.655879", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:12:40.803 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:40 +0000 (0:00:00.036) 0:01:14.528 ******* 2021-12-17T18:12:40.832 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-12-17T18:12:40.834 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:40.858 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:40 +0000 (0:00:00.055) 0:01:14.584 ******* 2021-12-17T18:12:40.877 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:40.903 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:40 +0000 (0:00:00.044) 0:01:14.628 ******* 2021-12-17T18:12:40.910 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:40.912 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-12-17T18:12:40.933 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-12-17T18:12:40.935 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.114078", "end": "2021-12-17 18:12:40.915544", "rc": 0, "start": "2021-12-17 18:12:40.801466", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:12:40.959 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:40 +0000 (0:00:00.055) 0:01:14.684 ******* 2021-12-17T18:12:41.030 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi109.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-12-17T18:12:41.167 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-12-17T18:12:41.169 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.116898", "end": "2021-12-17 18:12:40.926687", "rc": 0, "start": "2021-12-17 18:12:40.809789", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:12:41.193 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:41 +0000 (0:00:00.234) 0:01:14.919 ******* 2021-12-17T18:12:41.222 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.116050", "end": "2021-12-17 18:12:40.953804", "rc": 0, "start": "2021-12-17 18:12:40.837754", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:12:41.253 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:41 +0000 (0:00:00.059) 0:01:14.978 ******* 2021-12-17T18:12:41.295 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-12-17T18:12:41.297 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-12-17T18:12:41.432 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-12-17T18:12:41.570 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-12-17T18:12:41.698 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-12-17T18:12:41.836 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-12-17T18:12:41.963 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-12-17T18:12:42.101 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-12-17T18:12:42.240 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-12-17T18:12:42.378 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-12-17T18:12:42.515 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-12-17T18:12:42.590 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:42 +0000 (0:00:01.336) 0:01:16.315 ******* 2021-12-17T18:12:43.064 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-12-17T18:12:43.066 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"changed": true, "checksum": "09dde075805f5d4bdea4ecc07cef18b8cc5cbdf3", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "2cf30c8356ea33991eb6921c31aaa08a", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1639764762.6789742-14629-268122644127006/source", "state": "file", "uid": 0} 2021-12-17T18:12:43.087 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:43 +0000 (0:00:00.498) 0:01:16.813 ******* 2021-12-17T18:12:43.159 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-12-17T18:12:43.161 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => { "msg": "Host smithi109.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-12-17T18:12:43.190 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:43 +0000 (0:00:00.102) 0:01:16.915 ******* 2021-12-17T18:12:43.263 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-12-17T18:12:43.264 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-12-17T18:12:43.299 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:43 +0000 (0:00:00.109) 0:01:17.024 ******* 2021-12-17T18:12:43.370 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-12-17T18:12:43.372 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:43.395 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:43 +0000 (0:00:00.095) 0:01:17.120 ******* 2021-12-17T18:12:43.467 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:43.491 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:43 +0000 (0:00:00.095) 0:01:17.216 ******* 2021-12-17T18:12:43.562 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:43.586 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:43 +0000 (0:00:00.095) 0:01:17.311 ******* 2021-12-17T18:12:43.656 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-12-17T18:12:43.658 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:43.680 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:43 +0000 (0:00:00.093) 0:01:17.405 ******* 2021-12-17T18:12:43.750 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:43.781 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:43 +0000 (0:00:00.101) 0:01:17.506 ******* 2021-12-17T18:12:43.853 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-12-17T18:12:43.854 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:43.878 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:43 +0000 (0:00:00.096) 0:01:17.603 ******* 2021-12-17T18:12:43.949 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-12-17T18:12:43.950 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:43.973 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:43 +0000 (0:00:00.095) 0:01:17.699 ******* 2021-12-17T18:12:44.044 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-12-17T18:12:44.046 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:44.073 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:44 +0000 (0:00:00.099) 0:01:17.798 ******* 2021-12-17T18:12:44.145 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-12-17T18:12:44.147 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi109.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:44.170 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:44 +0000 (0:00:00.096) 0:01:17.895 ******* 2021-12-17T18:12:44.231 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:44.256 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:44 +0000 (0:00:00.086) 0:01:17.981 ******* 2021-12-17T18:12:44.328 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-12-17T18:12:44.329 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:44.352 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:44 +0000 (0:00:00.096) 0:01:18.078 ******* 2021-12-17T18:12:44.423 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-12-17T18:12:44.425 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:44.447 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:44 +0000 (0:00:00.094) 0:01:18.172 ******* 2021-12-17T18:12:44.517 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-12-17T18:12:44.519 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:44.542 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:44 +0000 (0:00:00.094) 0:01:18.267 ******* 2021-12-17T18:12:44.593 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** ok: [smithi062.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:12:44.617 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:44 +0000 (0:00:00.075) 0:01:18.343 ******* 2021-12-17T18:12:44.625 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-12-17T18:12:44.627 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:44.652 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:44 +0000 (0:00:00.034) 0:01:18.378 ******* 2021-12-17T18:12:44.723 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-12-17T18:12:44.724 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:44.747 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:44 +0000 (0:00:00.094) 0:01:18.472 ******* 2021-12-17T18:12:44.808 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-12-17T18:12:44.809 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:12:44.833 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:44 +0000 (0:00:00.085) 0:01:18.558 ******* 2021-12-17T18:12:44.841 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-12-17T18:12:44.842 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:44.868 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:44 +0000 (0:00:00.035) 0:01:18.594 ******* 2021-12-17T18:12:44.877 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-12-17T18:12:44.878 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:12:44.905 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:44 +0000 (0:00:00.036) 0:01:18.630 ******* 2021-12-17T18:12:44.943 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-12-17T18:12:44.945 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:44.978 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:44 +0000 (0:00:00.073) 0:01:18.703 ******* 2021-12-17T18:12:44.997 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-12-17T18:12:44.999 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:12:45.026 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.047) 0:01:18.751 ******* 2021-12-17T18:12:45.044 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-12-17T18:12:45.046 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:45.070 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.044) 0:01:18.796 ******* 2021-12-17T18:12:45.132 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-12-17T18:12:45.134 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:45.156 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.085) 0:01:18.882 ******* 2021-12-17T18:12:45.216 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-12-17T18:12:45.218 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:45.242 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.085) 0:01:18.967 ******* 2021-12-17T18:12:45.313 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:45.337 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.095) 0:01:19.063 ******* 2021-12-17T18:12:45.388 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-12-17T18:12:45.389 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:12:45.414 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.076) 0:01:19.140 ******* 2021-12-17T18:12:45.424 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-12-17T18:12:45.425 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:45.452 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.037) 0:01:19.177 ******* 2021-12-17T18:12:45.492 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-12-17T18:12:45.494 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:45.518 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.065) 0:01:19.243 ******* 2021-12-17T18:12:45.526 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-12-17T18:12:45.528 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:45.555 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.036) 0:01:19.280 ******* 2021-12-17T18:12:45.573 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-12-17T18:12:45.575 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:12:45.600 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.045) 0:01:19.325 ******* 2021-12-17T18:12:45.630 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-12-17T18:12:45.632 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:45.632 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi125.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:12:45.658 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.058) 0:01:19.383 ******* 2021-12-17T18:12:45.691 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.033) 0:01:19.417 ******* 2021-12-17T18:12:45.700 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:45.727 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.035) 0:01:19.452 ******* 2021-12-17T18:12:45.745 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-12-17T18:12:45.747 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:45.773 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.046) 0:01:19.498 ******* 2021-12-17T18:12:45.781 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-12-17T18:12:45.783 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:12:45.810 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.036) 0:01:19.535 ******* 2021-12-17T18:12:45.834 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.024) 0:01:19.559 ******* 2021-12-17T18:12:45.855 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-12-17T18:12:45.857 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:45.882 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.047) 0:01:19.607 ******* 2021-12-17T18:12:45.905 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-12-17T18:12:45.907 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:45.932 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.050) 0:01:19.657 ******* 2021-12-17T18:12:45.940 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-12-17T18:12:45.942 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-12-17T18:12:45.969 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:45 +0000 (0:00:00.037) 0:01:19.694 ******* 2021-12-17T18:12:45.978 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-12-17T18:12:45.980 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:46.006 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:46 +0000 (0:00:00.036) 0:01:19.731 ******* 2021-12-17T18:12:46.078 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-12-17T18:12:46.080 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:46.103 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:46 +0000 (0:00:00.096) 0:01:19.828 ******* 2021-12-17T18:12:46.133 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-12-17T18:12:46.135 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-12-17T18:12:46.160 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:46 +0000 (0:00:00.057) 0:01:19.885 ******* 2021-12-17T18:12:46.180 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-12-17T18:12:46.183 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:46.209 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:46 +0000 (0:00:00.049) 0:01:19.935 ******* 2021-12-17T18:12:46.218 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-12-17T18:12:46.220 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-12-17T18:12:46.250 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:46 +0000 (0:00:00.040) 0:01:19.975 ******* 2021-12-17T18:12:46.279 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-12-17T18:12:46.281 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:46.305 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:46 +0000 (0:00:00.054) 0:01:20.030 ******* 2021-12-17T18:12:46.323 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-12-17T18:12:46.325 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-12-17T18:12:46.353 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:46 +0000 (0:00:00.048) 0:01:20.079 ******* 2021-12-17T18:12:46.383 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-12-17T18:12:46.385 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:46.413 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:46 +0000 (0:00:00.059) 0:01:20.138 ******* 2021-12-17T18:12:46.485 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-12-17T18:12:46.487 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:46.513 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:46 +0000 (0:00:00.100) 0:01:20.238 ******* 2021-12-17T18:12:46.586 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-12-17T18:12:46.588 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:46.611 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:46 +0000 (0:00:00.098) 0:01:20.337 ******* 2021-12-17T18:12:46.730 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-12-17T18:12:46.731 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:12:46.757 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:46 +0000 (0:00:00.145) 0:01:20.482 ******* 2021-12-17T18:12:46.808 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-12-17T18:12:46.810 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.012906", "end": "2021-12-17 18:12:46.461062", "rc": 0, "start": "2021-12-17 18:12:46.448156", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-12-17T18:12:46.834 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:46 +0000 (0:00:00.077) 0:01:20.559 ******* 2021-12-17T18:12:46.904 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-12-17T18:12:46.906 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:46.929 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:46 +0000 (0:00:00.095) 0:01:20.655 ******* 2021-12-17T18:12:46.954 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:46 +0000 (0:00:00.024) 0:01:20.680 ******* 2021-12-17T18:12:46.986 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-12-17T18:12:46.992 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:12:47.013 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:47 +0000 (0:00:00.058) 0:01:20.738 ******* 2021-12-17T18:12:47.020 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-12-17T18:12:47.021 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:47.046 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:47 +0000 (0:00:00.033) 0:01:20.771 ******* 2021-12-17T18:12:47.106 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:12:47.137 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:47 +0000 (0:00:00.090) 0:01:20.862 ******* 2021-12-17T18:12:47.176 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-12-17T18:12:47.178 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-12-17T18:12:47.305 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-12-17T18:12:47.307 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2021-12-17T18:12:47.382 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-12-17T18:12:47.386 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-12-17T18:12:47.415 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-12-17T18:12:47.490 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-12-17T18:12:47.492 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-12-17T18:12:47.503 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-12-17T18:12:47.504 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-12-17T18:12:47.536 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-12-17T18:12:47.665 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** ok: [smithi109.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-12-17T18:12:47.730 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-12-17T18:12:47.732 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-12-17T18:12:47.743 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-12-17T18:12:47.819 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-12-17T18:12:47.846 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:47 +0000 (0:00:00.709) 0:01:21.571 ******* 2021-12-17T18:12:47.854 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-12-17T18:12:47.854 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-12-17T18:12:47.884 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:47 +0000 (0:00:00.038) 0:01:21.609 ******* 2021-12-17T18:12:47.893 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-12-17T18:12:47.895 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-12-17T18:12:47.953 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:47.977 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:47 +0000 (0:00:00.093) 0:01:21.702 ******* 2021-12-17T18:12:47.995 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-12-17T18:12:47.996 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:12:48.021 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:48 +0000 (0:00:00.043) 0:01:21.746 ******* 2021-12-17T18:12:48.039 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-12-17T18:12:48.041 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-12-17T18:12:48.067 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:48 +0000 (0:00:00.046) 0:01:21.792 ******* 2021-12-17T18:12:48.074 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-12-17T18:12:48.076 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi125.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-12-17T18:12:48.106 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:48 +0000 (0:00:00.038) 0:01:21.831 ******* 2021-12-17T18:12:48.129 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:48 +0000 (0:00:00.023) 0:01:21.855 ******* 2021-12-17T18:12:48.181 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:48.210 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:48 +0000 (0:00:00.080) 0:01:21.935 ******* 2021-12-17T18:12:48.261 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi158.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} Friday 17 December 2021 18:12:48 +0000 (0:00:00.038) 0:01:21.974 ******* 2021-12-17T18:12:48.273 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:48 +0000 (0:00:00.024) 0:01:21.998 ******* 2021-12-17T18:12:48.282 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:12:48.283 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:48.310 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:48 +0000 (0:00:00.036) 0:01:22.035 ******* 2021-12-17T18:12:48.332 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:48 +0000 (0:00:00.022) 0:01:22.058 ******* 2021-12-17T18:12:48.372 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-12-17T18:12:48.374 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:48.405 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:48 +0000 (0:00:00.072) 0:01:22.130 ******* 2021-12-17T18:12:48.413 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-12-17T18:12:48.414 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:12:48.443 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:48 +0000 (0:00:00.037) 0:01:22.168 ******* 2021-12-17T18:12:48.450 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-12-17T18:12:48.451 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-12-17T18:12:48.644 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-12-17T18:12:48.699 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-12-17T18:12:48.710 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-12-17T18:12:48.818 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-12-17T18:12:48.861 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-12-17T18:12:48.863 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.316294", "end": "2021-12-17 18:12:48.510953", "rc": 0, "start": "2021-12-17 18:12:48.194659", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:12:48.887 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:48 +0000 (0:00:00.444) 0:01:22.612 ******* 2021-12-17T18:12:48.949 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi192.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-12-17T18:12:48.960 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-12-17T18:12:48.962 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:48.986 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:48 +0000 (0:00:00.099) 0:01:22.711 ******* 2021-12-17T18:12:49.017 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi125.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-12-17T18:12:49.030 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-12-17T18:12:49.103 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.114) 0:01:22.826 ******* 2021-12-17T18:12:49.131 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-12-17T18:12:49.144 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-12-17T18:12:49.146 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-12-17T18:12:49.175 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.069) 0:01:22.896 ******* 2021-12-17T18:12:49.199 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-12-17T18:12:49.201 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:49.223 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.052) 0:01:22.948 ******* 2021-12-17T18:12:49.262 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-12-17T18:12:49.264 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:49.274 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:49.286 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:49.287 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi192.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-12-17T18:12:49.316 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.092) 0:01:23.041 ******* 2021-12-17T18:12:49.348 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.031) 0:01:23.073 ******* 2021-12-17T18:12:49.356 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-12-17T18:12:49.357 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.128007", "end": "2021-12-17 18:12:48.960599", "rc": 0, "start": "2021-12-17 18:12:48.832592", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:12:49.358 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-12-17T18:12:49.358 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-12-17T18:12:49.397 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.049) 0:01:23.123 ******* 2021-12-17T18:12:49.424 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.026) 0:01:23.149 ******* 2021-12-17T18:12:49.431 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-12-17T18:12:49.433 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include apt_system vars] **************************************** ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-12-17T18:12:49.463 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.040) 0:01:23.189 ******* 2021-12-17T18:12:49.488 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.024) 0:01:23.213 ******* 2021-12-17T18:12:49.496 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-12-17T18:12:49.497 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-12-17T18:12:49.498 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-12-17T18:12:49.526 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.037) 0:01:23.251 ******* 2021-12-17T18:12:49.550 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.023) 0:01:23.275 ******* 2021-12-17T18:12:49.556 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-12-17T18:12:49.558 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi125.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:49.584 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.034) 0:01:23.309 ******* 2021-12-17T18:12:49.606 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.021) 0:01:23.331 ******* 2021-12-17T18:12:49.613 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-12-17T18:12:49.615 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-12-17T18:12:49.640 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.033) 0:01:23.365 ******* 2021-12-17T18:12:49.647 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-12-17T18:12:49.649 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:49.649 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:49.649 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:49.651 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:49.675 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.035) 0:01:23.401 ******* 2021-12-17T18:12:49.684 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:49.686 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} TASK [common : Check for epel] ************************************************* skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:49.711 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.035) 0:01:23.436 ******* 2021-12-17T18:12:49.734 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.023) 0:01:23.460 ******* 2021-12-17T18:12:49.743 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-12-17T18:12:49.745 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:49.769 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.035) 0:01:23.495 ******* 2021-12-17T18:12:49.778 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-12-17T18:12:49.780 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:49.780 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:49.780 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi158.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:49.807 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.037) 0:01:23.533 ******* 2021-12-17T18:12:49.836 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.028) 0:01:23.561 ******* 2021-12-17T18:12:49.845 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:49.871 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:49 +0000 (0:00:00.035) 0:01:23.597 ******* 2021-12-17T18:12:50.187 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-12-17T18:12:50.189 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:12:50.214 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:50 +0000 (0:00:00.342) 0:01:23.939 ******* 2021-12-17T18:12:50.464 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:12:50.490 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:50 +0000 (0:00:00.276) 0:01:24.215 ******* 2021-12-17T18:12:50.530 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:12:50.562 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:50 +0000 (0:00:00.071) 0:01:24.287 ******* 2021-12-17T18:12:50.582 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-12-17T18:12:50.584 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-12-17T18:12:50.584 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-12-17T18:12:50.585 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:12:50.616 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:50 +0000 (0:00:00.054) 0:01:24.341 ******* 2021-12-17T18:12:50.651 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:50 +0000 (0:00:00.035) 0:01:24.377 ******* 2021-12-17T18:12:50.653 INFO:teuthology.task.ansible.out: 2021-12-17T18:12:50.854 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-12-17T18:12:50.856 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-12-17T18:12:50.883 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:50 +0000 (0:00:00.231) 0:01:24.608 ******* 2021-12-17T18:12:50.891 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-12-17T18:12:50.922 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:50 +0000 (0:00:00.039) 0:01:24.648 ******* 2021-12-17T18:12:50.993 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-12-17T18:12:50.995 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-12-17T18:12:51.025 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.102) 0:01:24.751 ******* 2021-12-17T18:12:51.048 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.022) 0:01:24.773 ******* 2021-12-17T18:12:51.186 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi062.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-12-17T18:12:51.239 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-12-17T18:12:51.241 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-12-17T18:12:51.273 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.224) 0:01:24.998 ******* 2021-12-17T18:12:51.301 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-12-17T18:12:51.328 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.054) 0:01:25.053 ******* 2021-12-17T18:12:51.339 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-12-17T18:12:51.339 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-12-17T18:12:51.381 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.053) 0:01:25.106 ******* 2021-12-17T18:12:51.399 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-12-17T18:12:51.401 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-12-17T18:12:51.425 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.043) 0:01:25.150 ******* 2021-12-17T18:12:51.433 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-12-17T18:12:51.434 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:51.435 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-12-17T18:12:51.435 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-12-17T18:12:51.463 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.037) 0:01:25.188 ******* 2021-12-17T18:12:51.494 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-12-17T18:12:51.495 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-12-17T18:12:51.495 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:51.519 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.056) 0:01:25.245 ******* 2021-12-17T18:12:51.538 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-12-17T18:12:51.540 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-12-17T18:12:51.564 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.045) 0:01:25.290 ******* 2021-12-17T18:12:51.572 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:51.598 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.033) 0:01:25.323 ******* 2021-12-17T18:12:51.607 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-12-17T18:12:51.610 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:51.637 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.038) 0:01:25.362 ******* 2021-12-17T18:12:51.644 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-12-17T18:12:51.645 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-12-17T18:12:51.673 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.036) 0:01:25.399 ******* 2021-12-17T18:12:51.681 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-12-17T18:12:51.683 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:51.707 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.033) 0:01:25.433 ******* 2021-12-17T18:12:51.715 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-12-17T18:12:51.717 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-12-17T18:12:51.719 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:51.747 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.039) 0:01:25.473 ******* 2021-12-17T18:12:51.778 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.030) 0:01:25.503 ******* 2021-12-17T18:12:51.786 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-12-17T18:12:51.787 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:51.813 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.035) 0:01:25.538 ******* 2021-12-17T18:12:51.836 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.023) 0:01:25.561 ******* 2021-12-17T18:12:51.844 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-12-17T18:12:51.846 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:51.873 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.037) 0:01:25.599 ******* 2021-12-17T18:12:51.880 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:51.908 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.034) 0:01:25.633 ******* 2021-12-17T18:12:51.916 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-12-17T18:12:51.918 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:51.944 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.035) 0:01:25.669 ******* 2021-12-17T18:12:51.951 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:51.952 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-12-17T18:12:51.952 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-12-17T18:12:51.979 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:51 +0000 (0:00:00.035) 0:01:25.705 ******* 2021-12-17T18:12:52.003 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.023) 0:01:25.729 ******* 2021-12-17T18:12:52.171 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-12-17T18:12:52.203 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.199) 0:01:25.928 ******* 2021-12-17T18:12:52.211 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-12-17T18:12:52.213 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:10:38 UTC", "ActiveEnterTimestampMonotonic": "14041443", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount systemd-tmpfiles-setup.service systemd-journald.socket time-sync.target system.slice nss-lookup.target sysinit.target network.target remote-fs.target var-run.mount local-fs.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:10:38 UTC", "AssertTimestampMonotonic": "14039981", "Before": "getty@tty1.service plymouth-quit.service shutdown.target xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:10:38 UTC", "Co 2021-12-17T18:12:52.215 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "14039981", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "834", "ExecMainStartTimestamp": "Fri 2021-12-17 18:10:38 UTC", "ExecMainStartTimestampMonotonic": "14041298", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-12-17 18:10:38 UTC] ; stop_time=[n/a] ; pid=834 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Fri 2021-12-17 18:10:38 UTC] ; stop_time=[n/a] ; pid=834 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-12-17T18:12:52.217 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-12-17 18:10:38 UTC", "InactiveExitTimestampMonotonic": "14041443", "InvocationID": "d140180ff0ae488d9e93ed7920301bc7", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "834", "MemoryAccounting": "yes", "MemoryCurrent": "1310720", "MemoryD 2021-12-17T18:12:52.219 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:10:38 UTC", "StateChangeTimestampMonotonic": "14041443", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-12-17T18:12:52.221 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38332", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-12-17T18:12:52.240 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.037) 0:01:25.965 ******* 2021-12-17T18:12:52.270 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-12-17T18:12:52.272 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:52.295 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.054) 0:01:26.020 ******* 2021-12-17T18:12:52.303 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-12-17T18:12:52.305 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-12-17T18:12:52.337 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.042) 0:01:26.062 ******* 2021-12-17T18:12:52.345 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:52.373 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.035) 0:01:26.098 ******* 2021-12-17T18:12:52.380 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-12-17T18:12:52.382 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-12-17T18:12:52.408 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.035) 0:01:26.134 ******* 2021-12-17T18:12:52.416 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-12-17T18:12:52.418 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:52.445 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.036) 0:01:26.171 ******* 2021-12-17T18:12:52.455 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-12-17T18:12:52.457 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:10:36 UTC", "ActiveEnterTimestampMonotonic": "16638019", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target time-sync.target network.target -.mount sysinit.target remote-fs.target system.slice var-run.mount systemd-journald.socket local-fs.target basic.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:10:36 UTC", "AssertTimestampMonotonic": "16620343", "Before": "shutdown.target xdm.service multi-user.target getty@tty1.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:10:36 UTC", "Co 2021-12-17T18:12:52.459 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "16620343", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "894", "ExecMainStartTimestamp": "Fri 2021-12-17 18:10:36 UTC", "ExecMainStartTimestampMonotonic": "16637845", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-12-17 18:10:36 UTC] ; stop_time=[n/a] ; pid=894 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Fri 2021-12-17 18:10:36 UTC] ; stop_time=[n/a] ; pid=894 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-12-17T18:12:52.460 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-12-17 18:10:36 UTC", "InactiveExitTimestampMonotonic": "16638019", "InvocationID": "71dc224cd920447eb842bb45354829be", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127772", "LimitNPROCSoft": "127772", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127772", "LimitSIGPENDINGSoft": "127772", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "894", "MemoryAccounting": "yes", "MemoryCurrent": "1310720", "MemoryD 2021-12-17T18:12:52.462 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:10:36 UTC", "StateChangeTimestampMonotonic": "16638019", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-12-17T18:12:52.463 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38331", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-12-17T18:12:52.485 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.040) 0:01:26.211 ******* 2021-12-17T18:12:52.493 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-12-17T18:12:52.495 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:52.519 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.033) 0:01:26.244 ******* 2021-12-17T18:12:52.527 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-12-17T18:12:52.528 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:52.565 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.046) 0:01:26.290 ******* 2021-12-17T18:12:52.576 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-12-17T18:12:52.578 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:52.606 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.040) 0:01:26.331 ******* 2021-12-17T18:12:52.615 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-12-17T18:12:52.616 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:10:36 UTC", "ActiveEnterTimestampMonotonic": "15700155", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target basic.target sysinit.target network.target time-sync.target local-fs.target -.mount systemd-tmpfiles-setup.service systemd-journald.socket var-run.mount system.slice nss-lookup.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:10:36 UTC", "AssertTimestampMonotonic": "15643720", "Before": "plymouth-quit.service xdm.service getty@tty1.service multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:10:36 UTC", "Co 2021-12-17T18:12:52.618 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15643719", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "891", "ExecMainStartTimestamp": "Fri 2021-12-17 18:10:36 UTC", "ExecMainStartTimestampMonotonic": "15699988", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-12-17 18:10:36 UTC] ; stop_time=[n/a] ; pid=891 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Fri 2021-12-17 18:10:36 UTC] ; stop_time=[n/a] ; pid=891 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-12-17T18:12:52.619 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-12-17 18:10:36 UTC", "InactiveExitTimestampMonotonic": "15700155", "InvocationID": "a462f208773844e39b4059c81fbe6606", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "891", "MemoryAccounting": "yes", "MemoryCurrent": "1216512", "MemoryD 2021-12-17T18:12:52.622 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:10:36 UTC", "StateChangeTimestampMonotonic": "15700155", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-12-17T18:12:52.623 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38331", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:52.642 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.035) 0:01:26.367 ******* 2021-12-17T18:12:52.669 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.026) 0:01:26.394 ******* 2021-12-17T18:12:52.676 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-12-17T18:12:52.677 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:11:01 UTC", "ActiveEnterTimestampMonotonic": "16160757", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket basic.target time-sync.target sysinit.target remote-fs.target system.slice local-fs.target var-run.mount network.target nss-lookup.target systemd-tmpfiles-setup.service -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:11:01 UTC", "AssertTimestampMonotonic": "16155634", "Before": "xdm.service shutdown.target plymouth-quit.service getty@tty1.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:11:01 UTC", "Co 2021-12-17T18:12:52.679 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "16155634", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "895", "ExecMainStartTimestamp": "Fri 2021-12-17 18:11:01 UTC", "ExecMainStartTimestampMonotonic": "16160527", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-12-17 18:11:01 UTC] ; stop_time=[n/a] ; pid=895 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Fri 2021-12-17 18:11:01 UTC] ; stop_time=[n/a] ; pid=895 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-12-17T18:12:52.681 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-12-17 18:11:01 UTC", "InactiveExitTimestampMonotonic": "16160757", "InvocationID": "feb9211611984335a9d7e720c6fc8bcc", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "895", "MemoryAccounting": "yes", "MemoryCurrent": "1368064", "MemoryD 2021-12-17T18:12:52.682 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:11:01 UTC", "StateChangeTimestampMonotonic": "16160757", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-12-17T18:12:52.685 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", 2021-12-17T18:12:52.685 INFO:teuthology.task.ansible.out: "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38331", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-12-17T18:12:52.687 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:52.688 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:52.713 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.044) 0:01:26.439 ******* 2021-12-17T18:12:52.736 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.022) 0:01:26.461 ******* 2021-12-17T18:12:52.759 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.023) 0:01:26.485 ******* 2021-12-17T18:12:52.767 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-12-17T18:12:52.768 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:52.769 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:52.793 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.033) 0:01:26.519 ******* 2021-12-17T18:12:52.816 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.022) 0:01:26.541 ******* 2021-12-17T18:12:52.839 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.022) 0:01:26.564 ******* 2021-12-17T18:12:52.847 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-12-17T18:12:52.848 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:52.875 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.035) 0:01:26.600 ******* 2021-12-17T18:12:52.896 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.021) 0:01:26.622 ******* 2021-12-17T18:12:52.919 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.022) 0:01:26.644 ******* 2021-12-17T18:12:52.927 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-12-17T18:12:52.928 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:52.952 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.033) 0:01:26.678 ******* 2021-12-17T18:12:52.975 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:52 +0000 (0:00:00.022) 0:01:26.700 ******* 2021-12-17T18:12:52.982 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-12-17T18:12:52.984 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:53.013 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.038) 0:01:26.738 ******* 2021-12-17T18:12:53.042 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.028) 0:01:26.767 ******* 2021-12-17T18:12:53.070 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.027) 0:01:26.795 ******* 2021-12-17T18:12:53.077 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-12-17T18:12:53.079 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include package type specific vars.] ************************** ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-12-17T18:12:53.080 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:53.105 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.035) 0:01:26.830 ******* 2021-12-17T18:12:53.128 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.022) 0:01:26.853 ******* 2021-12-17T18:12:53.152 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.024) 0:01:26.878 ******* 2021-12-17T18:12:53.160 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-12-17T18:12:53.162 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including distro specific variables.] ************************* ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-12-17T18:12:53.164 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-12-17T18:12:53.166 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:53.190 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.037) 0:01:26.915 ******* 2021-12-17T18:12:53.213 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.023) 0:01:26.939 ******* 2021-12-17T18:12:53.237 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.023) 0:01:26.962 ******* 2021-12-17T18:12:53.243 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-12-17T18:12:53.244 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Update apt cache] *********************************************** ok: [smithi109.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:12:53.246 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-12-17T18:12:53.247 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:53.272 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.035) 0:01:26.997 ******* 2021-12-17T18:12:53.294 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.022) 0:01:27.020 ******* 2021-12-17T18:12:53.320 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.025) 0:01:27.045 ******* 2021-12-17T18:12:53.356 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.034) 0:01:27.080 ******* 2021-12-17T18:12:53.363 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-12-17T18:12:53.365 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including version specific variables.] ************************ ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-12-17T18:12:53.366 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-12-17T18:12:53.366 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:53.394 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.039) 0:01:27.120 ******* 2021-12-17T18:12:53.419 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.024) 0:01:27.144 ******* 2021-12-17T18:12:53.445 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.025) 0:01:27.170 ******* 2021-12-17T18:12:53.459 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-12-17T18:12:53.461 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include package type specific vars.] ************************** ok: [smithi125.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-12-17T18:12:53.488 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.043) 0:01:27.213 ******* 2021-12-17T18:12:53.513 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.022) 0:01:27.235 ******* 2021-12-17T18:12:53.518 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-12-17T18:12:53.520 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:53.545 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.034) 0:01:27.270 ******* 2021-12-17T18:12:53.552 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-12-17T18:12:53.554 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-12-17T18:12:53.556 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:53.581 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.035) 0:01:27.306 ******* 2021-12-17T18:12:53.602 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.021) 0:01:27.327 ******* 2021-12-17T18:12:53.609 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-12-17T18:12:53.611 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:53.636 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.033) 0:01:27.361 ******* 2021-12-17T18:12:53.657 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.020) 0:01:27.382 ******* 2021-12-17T18:12:53.667 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-12-17T18:12:53.669 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-12-17T18:12:53.670 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:53.696 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.039) 0:01:27.422 ******* 2021-12-17T18:12:53.729 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.032) 0:01:27.454 ******* 2021-12-17T18:12:53.736 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:53.764 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.035) 0:01:27.489 ******* 2021-12-17T18:12:53.772 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-12-17T18:12:53.773 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} TASK [common : nrpe - Build SELinux policy package] **************************** 2021-12-17T18:12:53.774 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:53.774 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-12-17T18:12:53.775 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-12-17T18:12:53.801 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.036) 0:01:27.526 ******* 2021-12-17T18:12:53.825 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.023) 0:01:27.550 ******* 2021-12-17T18:12:53.848 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.023) 0:01:27.573 ******* 2021-12-17T18:12:53.855 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-12-17T18:12:53.857 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:53.883 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.034) 0:01:27.608 ******* 2021-12-17T18:12:53.907 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.023) 0:01:27.632 ******* 2021-12-17T18:12:53.913 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-12-17T18:12:53.915 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:53.941 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.034) 0:01:27.666 ******* 2021-12-17T18:12:53.964 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.023) 0:01:27.690 ******* 2021-12-17T18:12:53.972 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-12-17T18:12:53.976 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-12-17T18:12:54.000 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:53 +0000 (0:00:00.035) 0:01:27.725 ******* 2021-12-17T18:12:54.022 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.021) 0:01:27.746 ******* 2021-12-17T18:12:54.029 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:54.031 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi109.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:12:54.055 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.033) 0:01:27.780 ******* 2021-12-17T18:12:54.086 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.030) 0:01:27.811 ******* 2021-12-17T18:12:54.093 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-12-17T18:12:54.094 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:54.251 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.165) 0:01:27.977 ******* 2021-12-17T18:12:54.274 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.022) 0:01:27.999 ******* 2021-12-17T18:12:54.282 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-12-17T18:12:54.284 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} TASK [testnode : Include package type specific vars.] ************************** ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-12-17T18:12:54.285 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-12-17T18:12:54.313 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.039) 0:01:28.039 ******* 2021-12-17T18:12:54.337 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.023) 0:01:28.062 ******* 2021-12-17T18:12:54.360 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.023) 0:01:28.086 ******* 2021-12-17T18:12:54.366 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-12-17T18:12:54.367 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-12-17T18:12:54.371 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:54.400 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.039) 0:01:28.126 ******* 2021-12-17T18:12:54.424 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.023) 0:01:28.149 ******* 2021-12-17T18:12:54.431 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-12-17T18:12:54.432 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-12-17T18:12:54.461 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.037) 0:01:28.187 ******* 2021-12-17T18:12:54.469 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-12-17T18:12:54.470 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including distro specific variables.] ************************* ok: [smithi158.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-12-17T18:12:54.499 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.037) 0:01:28.224 ******* 2021-12-17T18:12:54.522 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.022) 0:01:28.247 ******* 2021-12-17T18:12:54.529 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-12-17T18:12:54.531 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-12-17T18:12:54.557 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.035) 0:01:28.283 ******* 2021-12-17T18:12:54.566 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-12-17T18:12:54.594 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.036) 0:01:28.319 ******* 2021-12-17T18:12:54.613 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi192.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} TASK [common : Add krb5 config file] ******************************************* ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-12-17T18:12:54.646 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.051) 0:01:28.371 ******* 2021-12-17T18:12:54.669 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.023) 0:01:28.395 ******* 2021-12-17T18:12:54.678 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-12-17T18:12:54.680 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-12-17T18:12:54.680 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-12-17T18:12:54.707 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.037) 0:01:28.432 ******* 2021-12-17T18:12:54.731 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.024) 0:01:28.457 ******* 2021-12-17T18:12:54.750 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-12-17T18:12:54.752 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-12-17T18:12:54.779 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.047) 0:01:28.504 ******* 2021-12-17T18:12:54.809 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-12-17T18:12:54.810 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [testnode : Set hostname var] ********************************************* ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi062"}, "changed": false} 2021-12-17T18:12:54.834 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.054) 0:01:28.559 ******* 2021-12-17T18:12:54.857 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.023) 0:01:28.582 ******* 2021-12-17T18:12:54.875 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-12-17T18:12:54.877 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-12-17T18:12:54.902 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:54 +0000 (0:00:00.045) 0:01:28.627 ******* 2021-12-17T18:12:54.996 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-12-17T18:12:55.022 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:55 +0000 (0:00:00.120) 0:01:28.747 ******* 2021-12-17T18:12:55.043 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-12-17T18:12:55.073 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:55 +0000 (0:00:00.050) 0:01:28.798 ******* 2021-12-17T18:12:55.082 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-12-17T18:12:55.084 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:55.110 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:55 +0000 (0:00:00.036) 0:01:28.835 ******* 2021-12-17T18:12:55.117 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:55.144 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:55 +0000 (0:00:00.034) 0:01:28.870 ******* 2021-12-17T18:12:55.152 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-12-17T18:12:55.154 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:55.184 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:55 +0000 (0:00:00.039) 0:01:28.909 ******* 2021-12-17T18:12:55.208 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:55 +0000 (0:00:00.024) 0:01:28.933 ******* 2021-12-17T18:12:55.217 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:55.245 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:55 +0000 (0:00:00.036) 0:01:28.970 ******* 2021-12-17T18:12:55.254 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-12-17T18:12:55.256 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi125"}, "changed": false} 2021-12-17T18:12:55.285 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:55 +0000 (0:00:00.039) 0:01:29.010 ******* 2021-12-17T18:12:55.314 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi109.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:12:55.341 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:55 +0000 (0:00:00.056) 0:01:29.066 ******* 2021-12-17T18:12:55.381 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-12-17T18:12:55.383 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-12-17T18:12:55.409 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:55 +0000 (0:00:00.068) 0:01:29.135 ******* 2021-12-17T18:12:55.428 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-12-17T18:12:55.454 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:55 +0000 (0:00:00.044) 0:01:29.180 ******* 2021-12-17T18:12:55.685 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-12-17T18:12:55.687 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi125.front.sepia.ceph.com", "ansible_hostname": "smithi125", "ansible_nodename": "smithi125"}, "changed": true, "name": "smithi125"} 2021-12-17T18:12:55.711 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:55 +0000 (0:00:00.256) 0:01:29.436 ******* 2021-12-17T18:12:55.718 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi062.front.sepia.ceph.com", "ansible_hostname": "smithi062", "ansible_nodename": "smithi062"}, "changed": true, "name": "smithi062"} 2021-12-17T18:12:55.720 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-12-17T18:12:55.721 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-12-17T18:12:55.749 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:55 +0000 (0:00:00.038) 0:01:29.474 ******* 2021-12-17T18:12:55.844 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-12-17T18:12:55.847 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-12-17T18:12:55.872 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:55 +0000 (0:00:00.122) 0:01:29.597 ******* 2021-12-17T18:12:55.891 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-12-17T18:12:55.916 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:55 +0000 (0:00:00.044) 0:01:29.641 ******* 2021-12-17T18:12:55.922 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-12-17T18:12:55.924 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi192"}, "changed": false} 2021-12-17T18:12:55.956 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:55 +0000 (0:00:00.039) 0:01:29.681 ******* 2021-12-17T18:12:55.964 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi158"}, "changed": false} 2021-12-17T18:12:55.991 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:55 +0000 (0:00:00.034) 0:01:29.716 ******* 2021-12-17T18:12:56.031 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-12-17T18:12:56.032 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-12-17T18:12:56.042 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-12-17T18:12:56.044 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-12-17T18:12:56.070 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:56 +0000 (0:00:00.079) 0:01:29.795 ******* 2021-12-17T18:12:56.101 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-12-17T18:12:56.128 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:56 +0000 (0:00:00.057) 0:01:29.853 ******* 2021-12-17T18:12:56.339 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-12-17T18:12:56.340 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-12-17T18:12:56.376 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:56 +0000 (0:00:00.248) 0:01:30.101 ******* 2021-12-17T18:12:56.386 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi192.front.sepia.ceph.com", "ansible_hostname": "smithi192", "ansible_nodename": "smithi192"}, "changed": true, "name": "smithi192"} 2021-12-17T18:12:56.417 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:56 +0000 (0:00:00.040) 0:01:30.142 ******* 2021-12-17T18:12:56.424 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-12-17T18:12:56.426 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} TASK [testnode : Set the system's hostname] ************************************ changed: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi158.front.sepia.ceph.com", "ansible_hostname": "smithi158", "ansible_nodename": "smithi158"}, "changed": true, "name": "smithi158"} 2021-12-17T18:12:56.453 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:56 +0000 (0:00:00.035) 0:01:30.178 ******* 2021-12-17T18:12:56.476 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:56 +0000 (0:00:00.023) 0:01:30.201 ******* 2021-12-17T18:12:56.484 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-12-17T18:12:56.486 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-12-17T18:12:56.512 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:56 +0000 (0:00:00.036) 0:01:30.237 ******* 2021-12-17T18:12:56.520 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-12-17T18:12:56.521 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:12:56.547 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:56 +0000 (0:00:00.034) 0:01:30.272 ******* 2021-12-17T18:12:56.756 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-12-17T18:12:56.758 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-12-17T18:12:56.782 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:56 +0000 (0:00:00.235) 0:01:30.508 ******* 2021-12-17T18:12:56.812 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-12-17T18:12:56.850 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:56 +0000 (0:00:00.067) 0:01:30.575 ******* 2021-12-17T18:12:56.892 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-12-17T18:12:56.894 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-12-17T18:12:56.936 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-12-17T18:12:56.937 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-12-17T18:12:56.963 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:56 +0000 (0:00:00.113) 0:01:30.688 ******* 2021-12-17T18:12:56.965 INFO:teuthology.task.ansible.out: 2021-12-17T18:12:56.993 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-12-17T18:12:56.995 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-12-17T18:12:56.997 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.020 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.057) 0:01:30.746 ******* 2021-12-17T18:12:57.046 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.025) 0:01:30.771 ******* 2021-12-17T18:12:57.064 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.090 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.043) 0:01:30.815 ******* 2021-12-17T18:12:57.097 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-12-17T18:12:57.101 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.122 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.032) 0:01:30.848 ******* 2021-12-17T18:12:57.130 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.158 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.035) 0:01:30.883 ******* 2021-12-17T18:12:57.165 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-12-17T18:12:57.167 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.192 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.034) 0:01:30.918 ******* 2021-12-17T18:12:57.224 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.031) 0:01:30.949 ******* 2021-12-17T18:12:57.231 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.232 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-12-17T18:12:57.233 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-12-17T18:12:57.234 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload ssh_config] ******************************************** 2021-12-17T18:12:57.235 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-12-17T18:12:57.262 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.038) 0:01:30.987 ******* 2021-12-17T18:12:57.286 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.023) 0:01:31.011 ******* 2021-12-17T18:12:57.309 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.023) 0:01:31.035 ******* 2021-12-17T18:12:57.316 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-12-17T18:12:57.318 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.353 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.041) 0:01:31.076 ******* 2021-12-17T18:12:57.366 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-12-17T18:12:57.368 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.393 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.042) 0:01:31.118 ******* 2021-12-17T18:12:57.401 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.426 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.033) 0:01:31.151 ******* 2021-12-17T18:12:57.433 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-12-17T18:12:57.435 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.459 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.033) 0:01:31.185 ******* 2021-12-17T18:12:57.466 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.492 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.032) 0:01:31.217 ******* 2021-12-17T18:12:57.499 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-12-17T18:12:57.501 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.525 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.033) 0:01:31.250 ******* 2021-12-17T18:12:57.533 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-12-17T18:12:57.535 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-12-17T18:12:57.537 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.561 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.035) 0:01:31.286 ******* 2021-12-17T18:12:57.584 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.023) 0:01:31.310 ******* 2021-12-17T18:12:57.593 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-12-17T18:12:57.595 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.621 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.036) 0:01:31.347 ******* 2021-12-17T18:12:57.644 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.022) 0:01:31.369 ******* 2021-12-17T18:12:57.651 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-12-17T18:12:57.653 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} TASK [testnode : set_fact] ***************************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.678 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.034) 0:01:31.403 ******* 2021-12-17T18:12:57.700 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.021) 0:01:31.425 ******* 2021-12-17T18:12:57.708 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.709 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-12-17T18:12:57.709 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-12-17T18:12:57.740 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.039) 0:01:31.465 ******* 2021-12-17T18:12:57.763 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.023) 0:01:31.488 ******* 2021-12-17T18:12:57.771 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-12-17T18:12:57.773 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [common : Check for epel] ************************************************* skipping: [smithi109.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:12:57.773 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-12-17T18:12:57.774 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-12-17T18:12:57.776 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* skipping: [smithi125.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.801 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.037) 0:01:31.526 ******* 2021-12-17T18:12:57.823 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.021) 0:01:31.548 ******* 2021-12-17T18:12:57.846 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.023) 0:01:31.571 ******* 2021-12-17T18:12:57.872 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.025) 0:01:31.597 ******* 2021-12-17T18:12:57.879 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-12-17T18:12:57.881 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install nrpe without epel] ************************************** skipping: [smithi109.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.881 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.906 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.034) 0:01:31.632 ******* 2021-12-17T18:12:57.930 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.023) 0:01:31.655 ******* 2021-12-17T18:12:57.937 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-12-17T18:12:57.938 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install nrpe without epel] ************************************** skipping: [smithi109.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.940 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:57.941 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-12-17T18:12:57.967 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.037) 0:01:31.692 ******* 2021-12-17T18:12:57.991 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:57 +0000 (0:00:00.023) 0:01:31.716 ******* 2021-12-17T18:12:58.017 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.026) 0:01:31.742 ******* 2021-12-17T18:12:58.046 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.029) 0:01:31.772 ******* 2021-12-17T18:12:58.053 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-12-17T18:12:58.055 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-12-17T18:12:58.056 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-12-17T18:12:58.085 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.039) 0:01:31.811 ******* 2021-12-17T18:12:58.108 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.022) 0:01:31.833 ******* 2021-12-17T18:12:58.131 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.022) 0:01:31.856 ******* 2021-12-17T18:12:58.160 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.029) 0:01:31.885 ******* 2021-12-17T18:12:58.168 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-12-17T18:12:58.170 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable copr repos] ******************************************** 2021-12-17T18:12:58.195 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.035) 0:01:31.921 ******* 2021-12-17T18:12:58.218 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.022) 0:01:31.943 ******* 2021-12-17T18:12:58.224 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-12-17T18:12:58.226 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG] ************************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:58.250 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.032) 0:01:31.975 ******* 2021-12-17T18:12:58.272 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.022) 0:01:31.998 ******* 2021-12-17T18:12:58.297 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.024) 0:01:32.022 ******* 2021-12-17T18:12:58.304 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-12-17T18:12:58.305 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi062.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:58.306 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:58.307 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-12-17T18:12:58.332 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.034) 0:01:32.057 ******* 2021-12-17T18:12:58.354 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.021) 0:01:32.079 ******* 2021-12-17T18:12:58.376 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.022) 0:01:32.101 ******* 2021-12-17T18:12:58.383 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-12-17T18:12:58.385 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG] ************************************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:58.414 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.038) 0:01:32.140 ******* 2021-12-17T18:12:58.437 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.022) 0:01:32.162 ******* 2021-12-17T18:12:58.460 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.022) 0:01:32.185 ******* 2021-12-17T18:12:58.468 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-12-17T18:12:58.470 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:58.470 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi125.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:58.472 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:58.496 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.036) 0:01:32.221 ******* 2021-12-17T18:12:58.519 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.023) 0:01:32.245 ******* 2021-12-17T18:12:58.527 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:58.529 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-12-17T18:12:58.529 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:58.530 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:58.555 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.035) 0:01:32.280 ******* 2021-12-17T18:12:58.590 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.034) 0:01:32.315 ******* 2021-12-17T18:12:58.613 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.022) 0:01:32.338 ******* 2021-12-17T18:12:58.619 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-12-17T18:12:58.621 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:58.647 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.034) 0:01:32.372 ******* 2021-12-17T18:12:58.670 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.023) 0:01:32.395 ******* 2021-12-17T18:12:58.694 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.024) 0:01:32.420 ******* 2021-12-17T18:12:58.702 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-12-17T18:12:58.705 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:58.730 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.035) 0:01:32.455 ******* 2021-12-17T18:12:58.758 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.027) 0:01:32.483 ******* 2021-12-17T18:12:58.783 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.024) 0:01:32.508 ******* 2021-12-17T18:12:58.791 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-12-17T18:12:58.793 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:58.817 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.034) 0:01:32.543 ******* 2021-12-17T18:12:58.840 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.022) 0:01:32.565 ******* 2021-12-17T18:12:58.863 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.023) 0:01:32.589 ******* 2021-12-17T18:12:58.871 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-12-17T18:12:58.872 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:12:58.873 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:58.873 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:58.873 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:58.900 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.036) 0:01:32.626 ******* 2021-12-17T18:12:58.922 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.021) 0:01:32.647 ******* 2021-12-17T18:12:58.945 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.022) 0:01:32.670 ******* 2021-12-17T18:12:58.967 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.022) 0:01:32.692 ******* 2021-12-17T18:12:58.974 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-12-17T18:12:58.975 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.002 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:58 +0000 (0:00:00.034) 0:01:32.727 ******* 2021-12-17T18:12:59.024 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.021) 0:01:32.749 ******* 2021-12-17T18:12:59.045 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.021) 0:01:32.770 ******* 2021-12-17T18:12:59.053 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-12-17T18:12:59.056 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.056 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.057 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.091 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.045) 0:01:32.816 ******* 2021-12-17T18:12:59.115 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.023) 0:01:32.840 ******* 2021-12-17T18:12:59.139 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.024) 0:01:32.864 ******* 2021-12-17T18:12:59.147 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-12-17T18:12:59.148 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.174 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.034) 0:01:32.899 ******* 2021-12-17T18:12:59.198 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.024) 0:01:32.923 ******* 2021-12-17T18:12:59.205 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-12-17T18:12:59.207 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.233 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.035) 0:01:32.959 ******* 2021-12-17T18:12:59.257 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.023) 0:01:32.982 ******* 2021-12-17T18:12:59.282 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.024) 0:01:33.007 ******* 2021-12-17T18:12:59.290 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:12:59.291 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.292 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-12-17T18:12:59.293 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.320 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.037) 0:01:33.045 ******* 2021-12-17T18:12:59.342 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.022) 0:01:33.068 ******* 2021-12-17T18:12:59.366 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.023) 0:01:33.091 ******* 2021-12-17T18:12:59.389 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.023) 0:01:33.114 ******* 2021-12-17T18:12:59.397 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-12-17T18:12:59.399 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.399 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.434 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.045) 0:01:33.159 ******* 2021-12-17T18:12:59.458 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.023) 0:01:33.183 ******* 2021-12-17T18:12:59.488 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.029) 0:01:33.213 ******* 2021-12-17T18:12:59.498 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-12-17T18:12:59.499 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.501 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.501 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.526 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.038) 0:01:33.252 ******* 2021-12-17T18:12:59.549 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.022) 0:01:33.274 ******* 2021-12-17T18:12:59.571 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.022) 0:01:33.297 ******* 2021-12-17T18:12:59.578 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-12-17T18:12:59.580 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.605 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.034) 0:01:33.331 ******* 2021-12-17T18:12:59.628 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.022) 0:01:33.353 ******* 2021-12-17T18:12:59.649 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.021) 0:01:33.375 ******* 2021-12-17T18:12:59.655 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-12-17T18:12:59.657 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.683 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.033) 0:01:33.408 ******* 2021-12-17T18:12:59.705 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.021) 0:01:33.430 ******* 2021-12-17T18:12:59.726 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.021) 0:01:33.451 ******* 2021-12-17T18:12:59.734 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-12-17T18:12:59.735 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-12-17T18:12:59.736 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.736 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.765 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.039) 0:01:33.491 ******* 2021-12-17T18:12:59.790 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.023) 0:01:33.515 ******* 2021-12-17T18:12:59.814 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.024) 0:01:33.539 ******* 2021-12-17T18:12:59.838 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.024) 0:01:33.564 ******* 2021-12-17T18:12:59.846 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-12-17T18:12:59.848 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.874 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.035) 0:01:33.599 ******* 2021-12-17T18:12:59.896 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.022) 0:01:33.622 ******* 2021-12-17T18:12:59.919 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.022) 0:01:33.644 ******* 2021-12-17T18:12:59.925 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-12-17T18:12:59.926 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-12-17T18:12:59.927 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.927 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:12:59.953 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.034) 0:01:33.679 ******* 2021-12-17T18:12:59.976 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.023) 0:01:33.702 ******* 2021-12-17T18:12:59.999 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:12:59 +0000 (0:00:00.022) 0:01:33.724 ******* 2021-12-17T18:13:00.005 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-12-17T18:13:00.006 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-12-17T18:13:00.006 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-12-17T18:13:00.008 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:00.033 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.034) 0:01:33.758 ******* 2021-12-17T18:13:00.056 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.022) 0:01:33.781 ******* 2021-12-17T18:13:00.088 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.032) 0:01:33.813 ******* 2021-12-17T18:13:00.096 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-12-17T18:13:00.098 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi109.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-12-17T18:13:00.100 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:00.124 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.036) 0:01:33.849 ******* 2021-12-17T18:13:00.148 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.023) 0:01:33.873 ******* 2021-12-17T18:13:00.173 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.025) 0:01:33.899 ******* 2021-12-17T18:13:00.179 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-12-17T18:13:00.181 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for custom repos] *************************************** 2021-12-17T18:13:00.181 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005441", "end": "2021-12-17 18:13:00.449419", "rc": 0, "start": "2021-12-17 18:13:00.443978", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:13:00.183 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:00.209 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.035) 0:01:33.934 ******* 2021-12-17T18:13:00.232 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.022) 0:01:33.957 ******* 2021-12-17T18:13:00.255 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.022) 0:01:33.980 ******* 2021-12-17T18:13:00.279 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.023) 0:01:34.004 ******* 2021-12-17T18:13:00.287 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-12-17T18:13:00.288 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove custom repos] ****************************************** 2021-12-17T18:13:00.289 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi109.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-12-17T18:13:00.290 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:00.314 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.035) 0:01:34.039 ******* 2021-12-17T18:13:00.337 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.023) 0:01:34.063 ******* 2021-12-17T18:13:00.362 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.024) 0:01:34.087 ******* 2021-12-17T18:13:00.385 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.023) 0:01:34.111 ******* 2021-12-17T18:13:00.392 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-12-17T18:13:00.394 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:00.435 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.049) 0:01:34.161 ******* 2021-12-17T18:13:00.463 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.027) 0:01:34.188 ******* 2021-12-17T18:13:00.489 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.026) 0:01:34.214 ******* 2021-12-17T18:13:00.497 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-12-17T18:13:00.499 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:00.528 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.039) 0:01:34.253 ******* 2021-12-17T18:13:00.535 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:00.548 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:00.550 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:00.579 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.050) 0:01:34.305 ******* 2021-12-17T18:13:00.587 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-12-17T18:13:00.589 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:00.623 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.044) 0:01:34.349 ******* 2021-12-17T18:13:00.631 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:00.632 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-12-17T18:13:00.632 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005349", "end": "2021-12-17 18:13:00.350214", "rc": 0, "start": "2021-12-17 18:13:00.344865", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:13:00.660 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.036) 0:01:34.386 ******* 2021-12-17T18:13:00.689 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.028) 0:01:34.415 ******* 2021-12-17T18:13:00.700 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:13:00.702 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set apt preferences] ****************************************** 2021-12-17T18:13:00.702 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-12-17T18:13:00.704 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-12-17T18:13:00.733 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.043) 0:01:34.458 ******* 2021-12-17T18:13:00.757 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.023) 0:01:34.482 ******* 2021-12-17T18:13:00.781 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.023) 0:01:34.506 ******* 2021-12-17T18:13:00.788 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:13:00.790 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add sources list] ********************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:00.791 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-12-17T18:13:00.816 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.035) 0:01:34.542 ******* 2021-12-17T18:13:00.847 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.030) 0:01:34.573 ******* 2021-12-17T18:13:00.871 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.023) 0:01:34.596 ******* 2021-12-17T18:13:00.880 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-12-17T18:13:00.882 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:00.908 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.036) 0:01:34.633 ******* 2021-12-17T18:13:00.916 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:00.943 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.035) 0:01:34.669 ******* 2021-12-17T18:13:00.951 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-12-17T18:13:00.953 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:00.978 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:00 +0000 (0:00:00.034) 0:01:34.704 ******* 2021-12-17T18:13:00.986 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.014 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.036) 0:01:34.740 ******* 2021-12-17T18:13:01.025 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.053 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.038) 0:01:34.778 ******* 2021-12-17T18:13:01.061 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.087 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.034) 0:01:34.813 ******* 2021-12-17T18:13:01.097 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-12-17T18:13:01.099 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:10:37 UTC", "ActiveEnterTimestampMonotonic": "16424954", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target nss-lookup.target basic.target network.target systemd-journald.socket -.mount var-run.mount remote-fs.target local-fs.target system.slice systemd-tmpfiles-setup.service sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:10:37 UTC", "AssertTimestampMonotonic": "16412429", "Before": "plymouth-quit.service getty@tty1.service xdm.service multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:10:37 UTC", "Co 2021-12-17T18:13:01.102 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "16412427", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "898", "ExecMainStartTimestamp": "Fri 2021-12-17 18:10:37 UTC", "ExecMainStartTimestampMonotonic": "16424769", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-12-17 18:10:37 UTC] ; stop_time=[n/a] ; pid=898 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Fri 2021-12-17 18:10:37 UTC] ; stop_time=[n/a] ; pid=898 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-12-17T18:13:01.107 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-12-17 18:10:37 UTC", "InactiveExitTimestampMonotonic": "16424954", "InvocationID": "fc0d2d5eea16415d8bdf047849543372", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "898", "MemoryAccounting": "yes", "MemoryCurrent": "1306624", "MemoryD 2021-12-17T18:13:01.109 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:10:37 UTC", "StateChangeTimestampMonotonic": "16424954", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-12-17T18:13:01.110 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38331", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.127 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.039) 0:01:34.853 ******* 2021-12-17T18:13:01.151 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.023) 0:01:34.876 ******* 2021-12-17T18:13:01.158 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-12-17T18:13:01.160 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.161 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-12-17T18:13:01.161 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.187 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.035) 0:01:34.912 ******* 2021-12-17T18:13:01.218 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.029) 0:01:34.942 ******* 2021-12-17T18:13:01.241 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.024) 0:01:34.966 ******* 2021-12-17T18:13:01.254 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-12-17T18:13:01.256 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add sources list] ********************************************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.287 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.045) 0:01:35.011 ******* 2021-12-17T18:13:01.311 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.024) 0:01:35.036 ******* 2021-12-17T18:13:01.338 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.027) 0:01:35.063 ******* 2021-12-17T18:13:01.348 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-12-17T18:13:01.350 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.390 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.051) 0:01:35.115 ******* 2021-12-17T18:13:01.417 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.026) 0:01:35.142 ******* 2021-12-17T18:13:01.425 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-12-17T18:13:01.426 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.426 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-12-17T18:13:01.427 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.453 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.036) 0:01:35.178 ******* 2021-12-17T18:13:01.477 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.024) 0:01:35.203 ******* 2021-12-17T18:13:01.485 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-12-17T18:13:01.487 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.512 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.035) 0:01:35.238 ******* 2021-12-17T18:13:01.537 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.023) 0:01:35.261 ******* 2021-12-17T18:13:01.543 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-12-17T18:13:01.545 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.570 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.033) 0:01:35.295 ******* 2021-12-17T18:13:01.577 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-12-17T18:13:01.579 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.610 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.040) 0:01:35.336 ******* 2021-12-17T18:13:01.636 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.025) 0:01:35.361 ******* 2021-12-17T18:13:01.644 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-12-17T18:13:01.645 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.672 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.035) 0:01:35.397 ******* 2021-12-17T18:13:01.697 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.025) 0:01:35.422 ******* 2021-12-17T18:13:01.705 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-12-17T18:13:01.707 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.732 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.035) 0:01:35.457 ******* 2021-12-17T18:13:01.739 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-12-17T18:13:01.741 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.765 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.033) 0:01:35.491 ******* 2021-12-17T18:13:01.789 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.023) 0:01:35.515 ******* 2021-12-17T18:13:01.797 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.799 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.823 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.033) 0:01:35.549 ******* 2021-12-17T18:13:01.847 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.023) 0:01:35.572 ******* 2021-12-17T18:13:01.855 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-12-17T18:13:01.857 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.883 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.035) 0:01:35.608 ******* 2021-12-17T18:13:01.909 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.026) 0:01:35.635 ******* 2021-12-17T18:13:01.917 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-12-17T18:13:01.919 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.943 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.034) 0:01:35.669 ******* 2021-12-17T18:13:01.951 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-12-17T18:13:01.953 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:01.982 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:01 +0000 (0:00:00.038) 0:01:35.708 ******* 2021-12-17T18:13:02.006 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.023) 0:01:35.732 ******* 2021-12-17T18:13:02.015 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:02.041 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.034) 0:01:35.766 ******* 2021-12-17T18:13:02.048 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-12-17T18:13:02.049 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-12-17T18:13:02.051 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-12-17T18:13:02.052 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:02.075 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.034) 0:01:35.801 ******* 2021-12-17T18:13:02.098 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.022) 0:01:35.824 ******* 2021-12-17T18:13:02.107 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:02.133 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.035) 0:01:35.859 ******* 2021-12-17T18:13:02.140 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-12-17T18:13:02.141 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-12-17T18:13:02.143 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:02.168 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.034) 0:01:35.894 ******* 2021-12-17T18:13:02.193 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.024) 0:01:35.918 ******* 2021-12-17T18:13:02.202 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:02.228 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.035) 0:01:35.953 ******* 2021-12-17T18:13:02.235 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi109.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-12-17T18:13:02.238 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* ok: [smithi062.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:02.261 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.033) 0:01:35.987 ******* 2021-12-17T18:13:02.283 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.022) 0:01:36.009 ******* 2021-12-17T18:13:02.293 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:02.321 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.037) 0:01:36.046 ******* 2021-12-17T18:13:02.329 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-12-17T18:13:02.330 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:02.369 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.048) 0:01:36.094 ******* 2021-12-17T18:13:02.381 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:02.408 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.039) 0:01:36.134 ******* 2021-12-17T18:13:02.417 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-12-17T18:13:02.418 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-12-17T18:13:02.419 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:02.445 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.036) 0:01:36.170 ******* 2021-12-17T18:13:02.470 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.024) 0:01:36.195 ******* 2021-12-17T18:13:02.478 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:02.507 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.037) 0:01:36.233 ******* 2021-12-17T18:13:02.515 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-12-17T18:13:02.517 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:02.546 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.036) 0:01:36.270 ******* 2021-12-17T18:13:02.552 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:02.579 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.034) 0:01:36.304 ******* 2021-12-17T18:13:02.586 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-12-17T18:13:02.587 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:02.611 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.032) 0:01:36.337 ******* 2021-12-17T18:13:02.617 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-12-17T18:13:02.619 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:02.645 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.033) 0:01:36.370 ******* 2021-12-17T18:13:02.668 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.023) 0:01:36.393 ******* 2021-12-17T18:13:02.675 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-12-17T18:13:02.677 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:02.702 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.033) 0:01:36.427 ******* 2021-12-17T18:13:02.730 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-12-17T18:13:02.732 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:02.754 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.052) 0:01:36.479 ******* 2021-12-17T18:13:02.761 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-12-17T18:13:02.763 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005334", "end": "2021-12-17 18:13:02.748518", "rc": 0, "start": "2021-12-17 18:13:02.743184", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:13:02.798 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.043) 0:01:36.523 ******* 2021-12-17T18:13:02.827 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005492", "end": "2021-12-17 18:13:02.591223", "rc": 0, "start": "2021-12-17 18:13:02.585731", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:13:02.855 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.057) 0:01:36.580 ******* 2021-12-17T18:13:02.863 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-12-17T18:13:02.889 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.033) 0:01:36.614 ******* 2021-12-17T18:13:02.924 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.034) 0:01:36.649 ******* 2021-12-17T18:13:02.931 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-12-17T18:13:02.933 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-12-17T18:13:02.959 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:02 +0000 (0:00:00.035) 0:01:36.684 ******* 2021-12-17T18:13:03.243 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-12-17T18:13:03.244 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-12-17T18:13:03.272 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:03 +0000 (0:00:00.313) 0:01:36.997 ******* 2021-12-17T18:13:03.280 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-12-17T18:13:03.282 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-12-17T18:13:03.282 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-12-17T18:13:03.311 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:03 +0000 (0:00:00.039) 0:01:37.036 ******* 2021-12-17T18:13:03.337 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:03 +0000 (0:00:00.026) 0:01:37.063 ******* 2021-12-17T18:13:03.345 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-12-17T18:13:03.347 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:03.373 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:03 +0000 (0:00:00.036) 0:01:37.099 ******* 2021-12-17T18:13:03.385 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:03.386 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-12-17T18:13:03.386 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-12-17T18:13:03.388 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-12-17T18:13:03.390 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-12-17T18:13:03.416 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:03 +0000 (0:00:00.042) 0:01:37.141 ******* 2021-12-17T18:13:03.440 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:03 +0000 (0:00:00.023) 0:01:37.165 ******* 2021-12-17T18:13:03.474 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:03 +0000 (0:00:00.034) 0:01:37.199 ******* 2021-12-17T18:13:03.482 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-12-17T18:13:03.484 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi109"}, "changed": false} 2021-12-17T18:13:03.675 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:03 +0000 (0:00:00.200) 0:01:37.400 ******* 2021-12-17T18:13:04.000 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-12-17T18:13:04.002 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:13:04.025 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:04 +0000 (0:00:00.350) 0:01:37.751 ******* 2021-12-17T18:13:04.056 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-12-17T18:13:04.081 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:04 +0000 (0:00:00.056) 0:01:37.807 ******* 2021-12-17T18:13:04.090 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-12-17T18:13:04.091 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi109.front.sepia.ceph.com", "ansible_hostname": "smithi109", "ansible_nodename": "smithi109"}, "changed": true, "name": "smithi109"} 2021-12-17T18:13:04.118 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:04 +0000 (0:00:00.036) 0:01:37.843 ******* 2021-12-17T18:13:04.148 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-12-17T18:13:04.150 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:13:04.176 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:04 +0000 (0:00:00.057) 0:01:37.901 ******* 2021-12-17T18:13:04.206 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-12-17T18:13:04.231 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:04 +0000 (0:00:00.055) 0:01:37.957 ******* 2021-12-17T18:13:04.262 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-12-17T18:13:04.264 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.031838", "end": "2021-12-17 18:13:04.527123", "rc": 0, "start": "2021-12-17 18:13:04.495285", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:13:04.288 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:04 +0000 (0:00:00.056) 0:01:38.014 ******* 2021-12-17T18:13:04.402 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.035208", "end": "2021-12-17 18:13:04.142162", "rc": 0, "start": "2021-12-17 18:13:04.106954", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:13:04.442 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:04 +0000 (0:00:00.153) 0:01:38.168 ******* 2021-12-17T18:13:04.452 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-12-17T18:13:04.454 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-12-17T18:13:04.466 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-12-17T18:13:04.468 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-12-17T18:13:04.504 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:04 +0000 (0:00:00.060) 0:01:38.228 ******* 2021-12-17T18:13:04.692 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-12-17T18:13:04.693 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-12-17T18:13:04.841 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-12-17T18:13:04.843 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-12-17T18:13:04.865 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:04 +0000 (0:00:00.361) 0:01:38.590 ******* 2021-12-17T18:13:05.346 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-12-17T18:13:05.348 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-12-17T18:13:05.369 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:05 +0000 (0:00:00.504) 0:01:39.095 ******* 2021-12-17T18:13:05.397 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-12-17T18:13:05.399 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:05.422 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:05 +0000 (0:00:00.051) 0:01:39.146 ******* 2021-12-17T18:13:05.438 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-12-17T18:13:05.440 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-12-17T18:13:05.464 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:05 +0000 (0:00:00.043) 0:01:39.189 ******* 2021-12-17T18:13:05.472 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-12-17T18:13:05.474 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:05.500 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:05 +0000 (0:00:00.035) 0:01:39.225 ******* 2021-12-17T18:13:05.528 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-12-17T18:13:05.529 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:05.552 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:05 +0000 (0:00:00.052) 0:01:39.278 ******* 2021-12-17T18:13:05.580 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-12-17T18:13:05.582 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:05.605 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:05 +0000 (0:00:00.052) 0:01:39.331 ******* 2021-12-17T18:13:05.633 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-12-17T18:13:05.635 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:05.657 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:05 +0000 (0:00:00.051) 0:01:39.383 ******* 2021-12-17T18:13:05.685 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-12-17T18:13:05.687 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:05.709 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:05 +0000 (0:00:00.051) 0:01:39.434 ******* 2021-12-17T18:13:05.716 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-12-17T18:13:05.718 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-12-17T18:13:05.743 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:05 +0000 (0:00:00.033) 0:01:39.468 ******* 2021-12-17T18:13:05.749 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-12-17T18:13:05.751 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:05.776 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:05 +0000 (0:00:00.033) 0:01:39.501 ******* 2021-12-17T18:13:05.804 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-12-17T18:13:05.805 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:05.827 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:05 +0000 (0:00:00.051) 0:01:39.553 ******* 2021-12-17T18:13:05.855 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:13:05.857 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:05.886 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:05 +0000 (0:00:00.058) 0:01:39.612 ******* 2021-12-17T18:13:05.925 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-12-17T18:13:05.927 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:05.950 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:05 +0000 (0:00:00.063) 0:01:39.675 ******* 2021-12-17T18:13:05.978 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-12-17T18:13:05.980 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:06.002 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:05 +0000 (0:00:00.052) 0:01:39.727 ******* 2021-12-17T18:13:06.030 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-12-17T18:13:06.054 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.052) 0:01:39.780 ******* 2021-12-17T18:13:06.083 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-12-17T18:13:06.107 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.052) 0:01:39.832 ******* 2021-12-17T18:13:06.136 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-12-17T18:13:06.160 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.052) 0:01:39.885 ******* 2021-12-17T18:13:06.178 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-12-17T18:13:06.180 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:13:06.204 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.043) 0:01:39.929 ******* 2021-12-17T18:13:06.213 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-12-17T18:13:06.214 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:06.239 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.034) 0:01:39.964 ******* 2021-12-17T18:13:06.247 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-12-17T18:13:06.274 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.035) 0:01:40.000 ******* 2021-12-17T18:13:06.283 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-12-17T18:13:06.285 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:06.296 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:06.322 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.047) 0:01:40.047 ******* 2021-12-17T18:13:06.351 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-12-17T18:13:06.352 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:06.375 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.053) 0:01:40.100 ******* 2021-12-17T18:13:06.403 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:13:06.405 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:06.428 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.053) 0:01:40.154 ******* 2021-12-17T18:13:06.446 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-12-17T18:13:06.448 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.031442", "end": "2021-12-17 18:13:06.209718", "rc": 0, "start": "2021-12-17 18:13:06.178276", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:13:06.475 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.047) 0:01:40.201 ******* 2021-12-17T18:13:06.483 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-12-17T18:13:06.484 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install python-apt] ******************************************* ok: [smithi192.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:13:06.512 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.037) 0:01:40.238 ******* 2021-12-17T18:13:06.536 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.023) 0:01:40.261 ******* 2021-12-17T18:13:06.542 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-12-17T18:13:06.544 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:06.568 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.032) 0:01:40.294 ******* 2021-12-17T18:13:06.576 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-12-17T18:13:06.602 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.033) 0:01:40.327 ******* 2021-12-17T18:13:06.609 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-12-17T18:13:06.611 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update apt cache.] ******************************************** ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:13:06.638 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.035) 0:01:40.363 ******* 2021-12-17T18:13:06.660 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.022) 0:01:40.385 ******* 2021-12-17T18:13:06.689 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-12-17T18:13:06.691 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:06.713 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.052) 0:01:40.438 ******* 2021-12-17T18:13:06.741 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:06.765 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.052) 0:01:40.491 ******* 2021-12-17T18:13:06.783 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-12-17T18:13:06.785 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.031836", "end": "2021-12-17 18:13:06.762591", "rc": 0, "start": "2021-12-17 18:13:06.730755", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:13:06.810 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.044) 0:01:40.535 ******* 2021-12-17T18:13:06.816 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-12-17T18:13:06.818 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update apt cache.] ******************************************** ok: [smithi125.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:13:06.845 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.034) 0:01:40.569 ******* 2021-12-17T18:13:06.869 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.024) 0:01:40.594 ******* 2021-12-17T18:13:06.876 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-12-17T18:13:06.880 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:06.916 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.045) 0:01:40.640 ******* 2021-12-17T18:13:06.944 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:06.969 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:06 +0000 (0:00:00.054) 0:01:40.694 ******* 2021-12-17T18:13:06.997 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-12-17T18:13:06.999 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:07.021 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:07 +0000 (0:00:00.052) 0:01:40.746 ******* 2021-12-17T18:13:07.061 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-12-17T18:13:07.062 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:07.085 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:07 +0000 (0:00:00.063) 0:01:40.810 ******* 2021-12-17T18:13:07.113 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-12-17T18:13:07.115 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:07.137 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:07 +0000 (0:00:00.052) 0:01:40.862 ******* 2021-12-17T18:13:07.167 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-12-17T18:13:07.169 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:07.191 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:07 +0000 (0:00:00.053) 0:01:40.916 ******* 2021-12-17T18:13:07.218 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-12-17T18:13:07.220 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:07.243 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:07 +0000 (0:00:00.052) 0:01:40.968 ******* 2021-12-17T18:13:07.272 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-12-17T18:13:07.273 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:07.296 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:07 +0000 (0:00:00.053) 0:01:41.022 ******* 2021-12-17T18:13:07.326 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:07.354 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:07 +0000 (0:00:00.057) 0:01:41.079 ******* 2021-12-17T18:13:07.383 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-12-17T18:13:07.385 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:07.407 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:07 +0000 (0:00:00.053) 0:01:41.132 ******* 2021-12-17T18:13:07.435 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-12-17T18:13:07.436 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:07.458 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:07 +0000 (0:00:00.051) 0:01:41.184 ******* 2021-12-17T18:13:07.486 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-12-17T18:13:07.488 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:07.510 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:07 +0000 (0:00:00.051) 0:01:41.235 ******* 2021-12-17T18:13:07.666 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-12-17T18:13:07.668 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005312", "end": "2021-12-17 18:13:07.319167", "rc": 0, "start": "2021-12-17 18:13:07.313855", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:13:07.698 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:07 +0000 (0:00:00.187) 0:01:41.423 ******* 2021-12-17T18:13:07.727 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-12-17T18:13:07.755 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:07 +0000 (0:00:00.057) 0:01:41.481 ******* 2021-12-17T18:13:08.118 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-12-17T18:13:08.120 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-12-17T18:13:08.142 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:08 +0000 (0:00:00.386) 0:01:41.867 ******* 2021-12-17T18:13:08.181 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-12-17T18:13:08.183 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:08.206 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:08 +0000 (0:00:00.063) 0:01:41.931 ******* 2021-12-17T18:13:08.838 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-12-17T18:13:08.840 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:13:08.864 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:08 +0000 (0:00:00.658) 0:01:42.589 ******* 2021-12-17T18:13:09.137 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:13:09.162 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:09 +0000 (0:00:00.298) 0:01:42.888 ******* 2021-12-17T18:13:09.301 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-12-17T18:13:09.303 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-12-17T18:13:10.272 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-12-17T18:13:10.297 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:10 +0000 (0:00:01.134) 0:01:44.022 ******* 2021-12-17T18:13:11.000 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-12-17T18:13:11.002 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:13:11.024 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:11 +0000 (0:00:00.727) 0:01:44.749 ******* 2021-12-17T18:13:11.053 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-12-17T18:13:11.077 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:11 +0000 (0:00:00.053) 0:01:44.802 ******* 2021-12-17T18:13:11.253 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-12-17T18:13:11.255 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.031005", "end": "2021-12-17 18:13:10.905154", "rc": 0, "start": "2021-12-17 18:13:10.874149", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:13:11.277 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:11 +0000 (0:00:00.200) 0:01:45.003 ******* 2021-12-17T18:13:13.615 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-12-17T18:13:13.617 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:13:13.639 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:13 +0000 (0:00:02.362) 0:01:47.365 ******* 2021-12-17T18:13:14.856 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-12-17T18:13:14.858 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 77 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2021-12-17T18:13:14.860 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 77 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2021-12-17T18:13:14.861 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-12-17T18:13:14.883 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:14 +0000 (0:00:01.243) 0:01:48.608 ******* 2021-12-17T18:13:14.893 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 77 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2021-12-17T18:13:14.895 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 77 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2021-12-17T18:13:14.897 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-12-17T18:13:14.920 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:14 +0000 (0:00:00.037) 0:01:48.646 ******* 2021-12-17T18:13:17.211 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 77 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2021-12-17T18:13:17.212 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 77 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2021-12-17T18:13:17.214 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-12-17T18:13:17.242 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:17 +0000 (0:00:02.322) 0:01:50.968 ******* 2021-12-17T18:13:17.251 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 77 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2021-12-17T18:13:17.252 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 77 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2021-12-17T18:13:17.254 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-12-17T18:13:17.279 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:17 +0000 (0:00:00.036) 0:01:51.004 ******* 2021-12-17T18:13:21.880 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 77 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2021-12-17T18:13:21.882 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 77 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2021-12-17T18:13:21.884 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-12-17T18:13:21.906 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:21 +0000 (0:00:04.626) 0:01:55.631 ******* 2021-12-17T18:13:29.949 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-12-17T18:13:29.951 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 73 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [11 2021-12-17T18:13:29.952 INFO:teuthology.task.ansible.out:81 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1811 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and a 2021-12-17T18:13:29.954 INFO:teuthology.task.ansible.out:re no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 73 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1811 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databa 2021-12-17T18:13:29.955 INFO:teuthology.task.ansible.out:se ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-12-17T18:13:29.977 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:29 +0000 (0:00:08.071) 0:02:03.702 ******* 2021-12-17T18:13:30.006 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-12-17T18:13:30.008 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:30.037 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:30 +0000 (0:00:00.059) 0:02:03.762 ******* 2021-12-17T18:13:30.808 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-12-17T18:13:30.810 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 73 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [11 2021-12-17T18:13:30.812 INFO:teuthology.task.ansible.out:81 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1802 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and a 2021-12-17T18:13:30.814 INFO:teuthology.task.ansible.out:re no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 73 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1802 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databa 2021-12-17T18:13:30.815 INFO:teuthology.task.ansible.out:se ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-12-17T18:13:30.834 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:30 +0000 (0:00:00.797) 0:02:04.560 ******* 2021-12-17T18:13:30.864 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-12-17T18:13:30.866 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:30.888 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:30 +0000 (0:00:00.053) 0:02:04.614 ******* 2021-12-17T18:13:32.898 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-12-17T18:13:32.900 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 73 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [11 2021-12-17T18:13:32.902 INFO:teuthology.task.ansible.out:81 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1833 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and a 2021-12-17T18:13:32.903 INFO:teuthology.task.ansible.out:re no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 73 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1833 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databa 2021-12-17T18:13:32.905 INFO:teuthology.task.ansible.out:se ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-12-17T18:13:32.924 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:32 +0000 (0:00:02.036) 0:02:06.650 ******* 2021-12-17T18:13:32.953 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-12-17T18:13:32.954 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:32.979 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:32 +0000 (0:00:00.053) 0:02:06.704 ******* 2021-12-17T18:13:33.326 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-12-17T18:13:33.327 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 73 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [11 2021-12-17T18:13:33.329 INFO:teuthology.task.ansible.out:81 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1839 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and a 2021-12-17T18:13:33.330 INFO:teuthology.task.ansible.out:re no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 73 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1839 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databa 2021-12-17T18:13:33.332 INFO:teuthology.task.ansible.out:se ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-12-17T18:13:33.354 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:33 +0000 (0:00:00.375) 0:02:07.079 ******* 2021-12-17T18:13:33.390 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-12-17T18:13:33.392 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:33.415 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:33 +0000 (0:00:00.060) 0:02:07.140 ******* 2021-12-17T18:13:38.073 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-12-17T18:13:38.075 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 73 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [11 2021-12-17T18:13:38.077 INFO:teuthology.task.ansible.out:81 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1785 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and a 2021-12-17T18:13:38.078 INFO:teuthology.task.ansible.out:re no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 73 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1785 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databa 2021-12-17T18:13:38.080 INFO:teuthology.task.ansible.out:se ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-12-17T18:13:38.099 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:38 +0000 (0:00:04.683) 0:02:11.824 ******* 2021-12-17T18:13:38.127 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-12-17T18:13:38.129 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:38.151 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:38 +0000 (0:00:00.052) 0:02:11.876 ******* 2021-12-17T18:13:42.921 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-12-17T18:13:42.922 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 71 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 q 2021-12-17T18:13:42.924 INFO:teuthology.task.ansible.out:emu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 2s (6974 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3u 2021-12-17T18:13:42.925 INFO:teuthology.task.ansible.out:buntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrad 2021-12-17T18:13:42.927 INFO:teuthology.task.ansible.out:ed, 6 newly installed, 0 to remove and 71 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 2s (6974 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ... 2021-12-17T18:13:42.929 INFO:teuthology.task.ansible.out:", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-12-17T18:13:42.948 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:42 +0000 (0:00:04.796) 0:02:16.673 ******* 2021-12-17T18:13:43.320 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 71 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 q 2021-12-17T18:13:43.322 INFO:teuthology.task.ansible.out:emu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 2s (8143 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3u 2021-12-17T18:13:43.324 INFO:teuthology.task.ansible.out:buntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrad 2021-12-17T18:13:43.325 INFO:teuthology.task.ansible.out:ed, 6 newly installed, 0 to remove and 71 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 2s (8143 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ... 2021-12-17T18:13:43.327 INFO:teuthology.task.ansible.out:", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selectin 2021-12-17T18:13:43.328 INFO:teuthology.task.ansible.out:g previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-12-17T18:13:43.355 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:43 +0000 (0:00:00.406) 0:02:17.080 ******* 2021-12-17T18:13:43.641 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-12-17T18:13:43.643 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:13:43.667 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:43 +0000 (0:00:00.311) 0:02:17.392 ******* 2021-12-17T18:13:44.076 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:13:44.103 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:44 +0000 (0:00:00.435) 0:02:17.827 ******* 2021-12-17T18:13:44.353 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-12-17T18:13:44.355 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:13:44.380 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:44 +0000 (0:00:00.278) 0:02:18.105 ******* 2021-12-17T18:13:44.515 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-12-17T18:13:44.540 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:44 +0000 (0:00:00.159) 0:02:18.265 ******* 2021-12-17T18:13:44.567 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-12-17T18:13:44.569 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:44.596 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:44 +0000 (0:00:00.056) 0:02:18.321 ******* 2021-12-17T18:13:44.740 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-12-17T18:13:44.742 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-12-17T18:13:44.765 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:44 +0000 (0:00:00.168) 0:02:18.490 ******* 2021-12-17T18:13:44.816 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-12-17T18:13:44.818 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:13:44.844 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:44 +0000 (0:00:00.079) 0:02:18.570 ******* 2021-12-17T18:13:45.000 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-12-17T18:13:45.002 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-12-17T18:13:45.033 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:45 +0000 (0:00:00.188) 0:02:18.759 ******* 2021-12-17T18:13:45.068 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-12-17T18:13:45.070 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:45.092 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:45 +0000 (0:00:00.058) 0:02:18.818 ******* 2021-12-17T18:13:45.227 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-12-17T18:13:45.229 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-12-17T18:13:45.251 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:45 +0000 (0:00:00.159) 0:02:18.977 ******* 2021-12-17T18:13:45.259 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-12-17T18:13:45.260 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-12-17T18:13:45.285 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:45 +0000 (0:00:00.033) 0:02:19.010 ******* 2021-12-17T18:13:45.421 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-12-17T18:13:45.422 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-12-17T18:13:45.447 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:45 +0000 (0:00:00.161) 0:02:19.172 ******* 2021-12-17T18:13:45.570 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 71 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ub 2021-12-17T18:13:45.572 INFO:teuthology.task.ansible.out:untu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 2s (7805 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-syste 2021-12-17T18:13:45.574 INFO:teuthology.task.ansible.out:m-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The fo 2021-12-17T18:13:45.576 INFO:teuthology.task.ansible.out:llowing packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgraded, 6 newly installed, 0 to remove and 71 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 2s (7805 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14- 2021-12-17T18:13:45.578 INFO:teuthology.task.ansible.out:0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mi 2021-12-17T18:13:45.581 INFO:teuthology.task.ansible.out:me-support (3.64ubuntu1) ..."]} 2021-12-17T18:13:45.597 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:45 +0000 (0:00:00.150) 0:02:19.322 ******* 2021-12-17T18:13:45.610 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-12-17T18:13:45.612 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:13:45.639 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:45 +0000 (0:00:00.042) 0:02:19.364 ******* 2021-12-17T18:13:45.659 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-12-17T18:13:45.661 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-12-17T18:13:45.686 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:45 +0000 (0:00:00.047) 0:02:19.412 ******* 2021-12-17T18:13:45.861 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi062.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-12-17T18:13:45.890 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:45 +0000 (0:00:00.204) 0:02:19.616 ******* 2021-12-17T18:13:45.909 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-12-17T18:13:45.910 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:13:27 UTC", "ActiveEnterTimestampMonotonic": "187401593", "ActiveExitTimestamp": "Fri 2021-12-17 18:13:27 UTC", "ActiveExitTimestampMonotonic": "187314758", "ActiveState": "active", "After": "network.target systemd-journald.socket remote-fs.target system.slice systemd-tmpfiles-setup.service -.mount sysinit.target nss-lookup.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:13:27 UTC", "AssertTimestampMonotonic": "187365345", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:13:27 UTC", "ConditionTimestampMonotonic": "187365344", "ConfigurationDirec 2021-12-17T18:13:45.912 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6509", "ExecMainStartTimestamp": "Fri 2021-12-17 18:13:27 UTC", "ExecMainStartTimestampMonotonic": "187401560", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-12-17T18:13:45.914 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-12-17 18:13:27 UTC", "InactiveEnterTimestampMonotonic": "187363942", "InactiveExitTimestamp": "Fri 2021-12-17 18:13:27 UTC", "InactiveExitTimestampMonotonic": "187367818", "InvocationID": "446b77644fef4ae793f48660288ff6e2", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127772", "LimitNPROCSoft": "127772", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127772", "LimitSIGPENDINGSoft": "127772", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6509", "MemoryAccounting": "yes", "MemoryCurrent": "6950912", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-12-17T18:13:45.915 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:13:27 UTC", "StateChangeTimestampMonotonic": "187401593", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-12-17T18:13:45.917 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-12-17T18:13:45.937 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:45 +0000 (0:00:00.046) 0:02:19.662 ******* 2021-12-17T18:13:45.966 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-12-17T18:13:45.968 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:45.990 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:45 +0000 (0:00:00.053) 0:02:19.716 ******* 2021-12-17T18:13:46.019 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-12-17T18:13:46.021 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.043 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.053) 0:02:19.769 ******* 2021-12-17T18:13:46.051 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-12-17T18:13:46.051 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:13:46.076 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.033) 0:02:19.802 ******* 2021-12-17T18:13:46.083 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-12-17T18:13:46.085 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.109 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.032) 0:02:19.835 ******* 2021-12-17T18:13:46.137 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-12-17T18:13:46.139 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.161 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.051) 0:02:19.886 ******* 2021-12-17T18:13:46.187 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-12-17T18:13:46.189 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.211 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.050) 0:02:19.936 ******* 2021-12-17T18:13:46.239 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-12-17T18:13:46.241 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.263 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.051) 0:02:19.988 ******* 2021-12-17T18:13:46.291 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-12-17T18:13:46.293 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.315 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.052) 0:02:20.040 ******* 2021-12-17T18:13:46.338 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.023) 0:02:20.063 ******* 2021-12-17T18:13:46.345 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-12-17T18:13:46.347 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.348 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-12-17T18:13:46.349 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:13:28 UTC", "ActiveEnterTimestampMonotonic": "184923767", "ActiveExitTimestamp": "Fri 2021-12-17 18:13:28 UTC", "ActiveExitTimestampMonotonic": "184842238", "ActiveState": "active", "After": "-.mount nss-lookup.target remote-fs.target systemd-journald.socket sysinit.target system.slice systemd-tmpfiles-setup.service basic.target network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:13:28 UTC", "AssertTimestampMonotonic": "184889584", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:13:28 UTC", "ConditionTimestampMonotonic": "184889584", "ConfigurationDirec 2021-12-17T18:13:46.351 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6510", "ExecMainStartTimestamp": "Fri 2021-12-17 18:13:28 UTC", "ExecMainStartTimestampMonotonic": "184923734", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-12-17T18:13:46.353 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-12-17 18:13:28 UTC", "InactiveEnterTimestampMonotonic": "184888554", "InactiveExitTimestamp": "Fri 2021-12-17 18:13:28 UTC", "InactiveExitTimestampMonotonic": "184891454", "InvocationID": "606adbb9c4f94516ac58efd7bb193db1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6510", "MemoryAccounting": "yes", "MemoryCurrent": "6885376", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-12-17T18:13:46.354 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:13:28 UTC", "StateChangeTimestampMonotonic": "184923767", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-12-17T18:13:46.356 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38332", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-12-17T18:13:46.378 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.040) 0:02:20.104 ******* 2021-12-17T18:13:46.401 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.022) 0:02:20.126 ******* 2021-12-17T18:13:46.409 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-12-17T18:13:46.410 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.434 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.033) 0:02:20.160 ******* 2021-12-17T18:13:46.442 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:13:46.443 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.467 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.032) 0:02:20.192 ******* 2021-12-17T18:13:46.473 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-12-17T18:13:46.475 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.498 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.031) 0:02:20.224 ******* 2021-12-17T18:13:46.505 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-12-17T18:13:46.507 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.530 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.031) 0:02:20.256 ******* 2021-12-17T18:13:46.537 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-12-17T18:13:46.539 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.562 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.032) 0:02:20.288 ******* 2021-12-17T18:13:46.570 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-12-17T18:13:46.572 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.595 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.032) 0:02:20.320 ******* 2021-12-17T18:13:46.602 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-12-17T18:13:46.604 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.627 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.031) 0:02:20.352 ******* 2021-12-17T18:13:46.633 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-12-17T18:13:46.635 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.659 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.031) 0:02:20.384 ******* 2021-12-17T18:13:46.666 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-12-17T18:13:46.667 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.691 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.031) 0:02:20.416 ******* 2021-12-17T18:13:46.698 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-12-17T18:13:46.700 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.723 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.032) 0:02:20.449 ******* 2021-12-17T18:13:46.730 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-12-17T18:13:46.732 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.759 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.035) 0:02:20.485 ******* 2021-12-17T18:13:46.767 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-12-17T18:13:46.769 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.792 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.032) 0:02:20.517 ******* 2021-12-17T18:13:46.799 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-12-17T18:13:46.801 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.825 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.032) 0:02:20.550 ******* 2021-12-17T18:13:46.832 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-12-17T18:13:46.833 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.857 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.032) 0:02:20.582 ******* 2021-12-17T18:13:46.864 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-12-17T18:13:46.866 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.889 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.032) 0:02:20.614 ******* 2021-12-17T18:13:46.896 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-12-17T18:13:46.898 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.922 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.032) 0:02:20.647 ******* 2021-12-17T18:13:46.929 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:13:46.931 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.954 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.032) 0:02:20.679 ******* 2021-12-17T18:13:46.962 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-12-17T18:13:46.964 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:46.987 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:46 +0000 (0:00:00.033) 0:02:20.712 ******* 2021-12-17T18:13:46.995 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-12-17T18:13:46.996 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.020 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.032) 0:02:20.745 ******* 2021-12-17T18:13:47.027 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-12-17T18:13:47.029 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.053 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.032) 0:02:20.778 ******* 2021-12-17T18:13:47.060 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-12-17T18:13:47.062 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} TASK [testnode : Install packages] ********************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.086 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.033) 0:02:20.811 ******* 2021-12-17T18:13:47.108 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.021) 0:02:20.833 ******* 2021-12-17T18:13:47.114 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-12-17T18:13:47.116 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.148 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.040) 0:02:20.873 ******* 2021-12-17T18:13:47.171 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.023) 0:02:20.896 ******* 2021-12-17T18:13:47.179 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.204 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.033) 0:02:20.930 ******* 2021-12-17T18:13:47.213 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.238 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.033) 0:02:20.963 ******* 2021-12-17T18:13:47.245 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-12-17T18:13:47.247 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-12-17T18:13:47.273 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.035) 0:02:20.998 ******* 2021-12-17T18:13:47.296 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.023) 0:02:21.022 ******* 2021-12-17T18:13:47.304 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-12-17T18:13:47.306 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.335 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.038) 0:02:21.060 ******* 2021-12-17T18:13:47.360 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.025) 0:02:21.085 ******* 2021-12-17T18:13:47.368 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-12-17T18:13:47.370 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.401 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.041) 0:02:21.127 ******* 2021-12-17T18:13:47.433 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.031) 0:02:21.158 ******* 2021-12-17T18:13:47.443 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-12-17T18:13:47.445 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.470 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.037) 0:02:21.195 ******* 2021-12-17T18:13:47.493 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.022) 0:02:21.218 ******* 2021-12-17T18:13:47.512 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-12-17T18:13:47.513 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.544 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.050) 0:02:21.269 ******* 2021-12-17T18:13:47.553 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-12-17T18:13:47.554 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.578 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.034) 0:02:21.303 ******* 2021-12-17T18:13:47.585 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-12-17T18:13:47.586 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.588 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-12-17T18:13:47.613 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.034) 0:02:21.338 ******* 2021-12-17T18:13:47.637 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.023) 0:02:21.362 ******* 2021-12-17T18:13:47.644 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-12-17T18:13:47.646 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.671 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.034) 0:02:21.397 ******* 2021-12-17T18:13:47.680 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-12-17T18:13:47.681 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.706 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.034) 0:02:21.432 ******* 2021-12-17T18:13:47.714 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-12-17T18:13:47.715 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.740 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.033) 0:02:21.465 ******* 2021-12-17T18:13:47.748 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-12-17T18:13:47.749 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.773 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.033) 0:02:21.498 ******* 2021-12-17T18:13:47.781 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-12-17T18:13:47.782 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.806 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.033) 0:02:21.531 ******* 2021-12-17T18:13:47.813 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-12-17T18:13:47.814 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.839 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.032) 0:02:21.564 ******* 2021-12-17T18:13:47.866 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.889 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.050) 0:02:21.615 ******* 2021-12-17T18:13:47.917 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-12-17T18:13:47.919 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:47.941 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.052) 0:02:21.667 ******* 2021-12-17T18:13:47.960 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-12-17T18:13:47.962 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-12-17T18:13:47.990 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:47 +0000 (0:00:00.048) 0:02:21.715 ******* 2021-12-17T18:13:47.998 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-12-17T18:13:48.000 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/fuse.conf.] *************************************** ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-12-17T18:13:48.026 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:48 +0000 (0:00:00.036) 0:02:21.751 ******* 2021-12-17T18:13:48.049 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:48 +0000 (0:00:00.023) 0:02:21.775 ******* 2021-12-17T18:13:48.057 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-12-17T18:13:48.059 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:48.086 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:48 +0000 (0:00:00.036) 0:02:21.811 ******* 2021-12-17T18:13:48.230 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-12-17T18:13:48.232 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-12-17T18:13:48.258 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:48 +0000 (0:00:00.171) 0:02:21.982 ******* 2021-12-17T18:13:48.282 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:48 +0000 (0:00:00.024) 0:02:22.007 ******* 2021-12-17T18:13:48.333 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-12-17T18:13:48.334 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-12-17T18:13:48.363 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:48 +0000 (0:00:00.080) 0:02:22.088 ******* 2021-12-17T18:13:48.392 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-12-17T18:13:48.394 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:48.418 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:48 +0000 (0:00:00.054) 0:02:22.143 ******* 2021-12-17T18:13:48.437 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:13:48.465 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:48 +0000 (0:00:00.046) 0:02:22.190 ******* 2021-12-17T18:13:48.587 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi192.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 71 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ub 2021-12-17T18:13:48.589 INFO:teuthology.task.ansible.out:untu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 4s (3264 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-syste 2021-12-17T18:13:48.591 INFO:teuthology.task.ansible.out:m-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The fo 2021-12-17T18:13:48.592 INFO:teuthology.task.ansible.out:llowing packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgraded, 6 newly installed, 0 to remove and 71 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 4s (3264 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14- 2021-12-17T18:13:48.594 INFO:teuthology.task.ansible.out:0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mi 2021-12-17T18:13:48.595 INFO:teuthology.task.ansible.out:me-support (3.64ubuntu1) ..."]} 2021-12-17T18:13:48.617 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:48 +0000 (0:00:00.151) 0:02:22.341 ******* 2021-12-17T18:13:48.624 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-12-17T18:13:48.625 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-12-17T18:13:48.652 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:48 +0000 (0:00:00.035) 0:02:22.377 ******* 2021-12-17T18:13:48.680 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:48.710 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:48 +0000 (0:00:00.058) 0:02:22.436 ******* 2021-12-17T18:13:48.741 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-12-17T18:13:48.743 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:13:30 UTC", "ActiveEnterTimestampMonotonic": "165191442", "ActiveExitTimestamp": "Fri 2021-12-17 18:13:30 UTC", "ActiveExitTimestampMonotonic": "165111097", "ActiveState": "active", "After": "remote-fs.target systemd-tmpfiles-setup.service systemd-journald.socket -.mount network.target basic.target sysinit.target nss-lookup.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:13:30 UTC", "AssertTimestampMonotonic": "165159343", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:13:30 UTC", "ConditionTimestampMonotonic": "165159342", "ConfigurationDirec 2021-12-17T18:13:48.744 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6546", "ExecMainStartTimestamp": "Fri 2021-12-17 18:13:30 UTC", "ExecMainStartTimestampMonotonic": "165191423", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-12-17T18:13:48.747 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-12-17 18:13:30 UTC", "InactiveEnterTimestampMonotonic": "165157812", "InactiveExitTimestamp": "Fri 2021-12-17 18:13:30 UTC", "InactiveExitTimestampMonotonic": "165162188", "InvocationID": "c26d3533ab4140f581ee03d88da4c85b", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6546", "MemoryAccounting": "yes", "MemoryCurrent": "6832128", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-12-17T18:13:48.749 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:13:30 UTC", "StateChangeTimestampMonotonic": "165191442", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-12-17T18:13:48.750 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-12-17T18:13:48.771 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:48 +0000 (0:00:00.060) 0:02:22.497 ******* 2021-12-17T18:13:48.779 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-12-17T18:13:48.781 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-12-17T18:13:48.807 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:48 +0000 (0:00:00.035) 0:02:22.532 ******* 2021-12-17T18:13:48.816 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:48.842 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:48 +0000 (0:00:00.035) 0:02:22.568 ******* 2021-12-17T18:13:48.870 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-12-17T18:13:48.872 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:48.894 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:48 +0000 (0:00:00.052) 0:02:22.620 ******* 2021-12-17T18:13:48.923 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:48.947 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:48 +0000 (0:00:00.052) 0:02:22.672 ******* 2021-12-17T18:13:48.975 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:48.999 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:48 +0000 (0:00:00.052) 0:02:22.724 ******* 2021-12-17T18:13:49.027 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-12-17T18:13:49.029 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:49.051 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.052) 0:02:22.777 ******* 2021-12-17T18:13:49.070 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-12-17T18:13:49.072 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-12-17T18:13:49.095 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.043) 0:02:22.821 ******* 2021-12-17T18:13:49.104 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-12-17T18:13:49.105 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:49.130 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.035) 0:02:22.856 ******* 2021-12-17T18:13:49.150 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-12-17T18:13:49.153 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-12-17T18:13:49.176 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.045) 0:02:22.901 ******* 2021-12-17T18:13:49.184 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-12-17T18:13:49.185 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:49.219 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.042) 0:02:22.944 ******* 2021-12-17T18:13:49.220 INFO:teuthology.task.ansible.out: 2021-12-17T18:13:49.248 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-12-17T18:13:49.250 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:49.273 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.054) 0:02:22.998 ******* 2021-12-17T18:13:49.301 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-12-17T18:13:49.303 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} TASK [testnode : set_fact] ***************************************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:49.326 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.053) 0:02:23.052 ******* 2021-12-17T18:13:49.351 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.024) 0:02:23.076 ******* 2021-12-17T18:13:49.367 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-12-17T18:13:49.369 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:49.395 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.044) 0:02:23.120 ******* 2021-12-17T18:13:49.434 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-12-17T18:13:49.436 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:49.459 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.064) 0:02:23.185 ******* 2021-12-17T18:13:49.468 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-12-17T18:13:49.470 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-12-17T18:13:49.499 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.039) 0:02:23.224 ******* 2021-12-17T18:13:49.506 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-12-17T18:13:49.508 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:49.546 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.047) 0:02:23.271 ******* 2021-12-17T18:13:49.553 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-12-17T18:13:49.555 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-12-17T18:13:49.580 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.033) 0:02:23.305 ******* 2021-12-17T18:13:49.587 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:49.629 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.049) 0:02:23.354 ******* 2021-12-17T18:13:49.660 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-12-17T18:13:49.662 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:49.684 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.055) 0:02:23.410 ******* 2021-12-17T18:13:49.713 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-12-17T18:13:49.715 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:49.737 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.053) 0:02:23.463 ******* 2021-12-17T18:13:49.745 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-12-17T18:13:49.747 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:13:49.789 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.051) 0:02:23.515 ******* 2021-12-17T18:13:49.801 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-12-17T18:13:49.803 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:49.834 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.044) 0:02:23.559 ******* 2021-12-17T18:13:49.843 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-12-17T18:13:49.845 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:49.869 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.035) 0:02:23.595 ******* 2021-12-17T18:13:49.878 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-12-17T18:13:49.880 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-12-17T18:13:49.881 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:49.907 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.037) 0:02:23.632 ******* 2021-12-17T18:13:49.932 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.025) 0:02:23.657 ******* 2021-12-17T18:13:49.941 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-12-17T18:13:49.944 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:49.970 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:49 +0000 (0:00:00.037) 0:02:23.695 ******* 2021-12-17T18:13:49.978 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-12-17T18:13:49.980 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.005 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.035) 0:02:23.731 ******* 2021-12-17T18:13:50.013 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.040 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.034) 0:02:23.766 ******* 2021-12-17T18:13:50.048 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-12-17T18:13:50.051 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages with --no-install-recommends] **************** ok: [smithi192.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-12-17T18:13:50.051 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:13:50.077 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.036) 0:02:23.802 ******* 2021-12-17T18:13:50.101 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.023) 0:02:23.826 ******* 2021-12-17T18:13:50.123 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.022) 0:02:23.848 ******* 2021-12-17T18:13:50.130 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-12-17T18:13:50.132 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.158 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.035) 0:02:23.883 ******* 2021-12-17T18:13:50.189 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.031) 0:02:23.915 ******* 2021-12-17T18:13:50.215 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.025) 0:02:23.941 ******* 2021-12-17T18:13:50.224 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-12-17T18:13:50.226 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.263 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.047) 0:02:23.988 ******* 2021-12-17T18:13:50.286 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.023) 0:02:24.012 ******* 2021-12-17T18:13:50.293 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-12-17T18:13:50.296 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.323 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.036) 0:02:24.048 ******* 2021-12-17T18:13:50.358 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.035) 0:02:24.084 ******* 2021-12-17T18:13:50.382 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.023) 0:02:24.107 ******* 2021-12-17T18:13:50.388 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:13:50.390 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.416 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.033) 0:02:24.141 ******* 2021-12-17T18:13:50.438 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.022) 0:02:24.163 ******* 2021-12-17T18:13:50.460 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.021) 0:02:24.185 ******* 2021-12-17T18:13:50.468 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-12-17T18:13:50.469 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.494 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.034) 0:02:24.220 ******* 2021-12-17T18:13:50.518 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.023) 0:02:24.243 ******* 2021-12-17T18:13:50.526 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-12-17T18:13:50.528 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi125.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.529 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.529 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.563 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.045) 0:02:24.289 ******* 2021-12-17T18:13:50.572 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.573 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Check for NVMe drive] ***************************************** 2021-12-17T18:13:50.574 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-12-17T18:13:50.574 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.575 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.575 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.576 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.576 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.577 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.577 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.601 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.037) 0:02:24.326 ******* 2021-12-17T18:13:50.610 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.612 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-12-17T18:13:50.614 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.641 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.039) 0:02:24.366 ******* 2021-12-17T18:13:50.668 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.027) 0:02:24.393 ******* 2021-12-17T18:13:50.676 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-12-17T18:13:50.678 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.678 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.680 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi062.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.680 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.681 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.707 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.038) 0:02:24.432 ******* 2021-12-17T18:13:50.715 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-12-17T18:13:50.716 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-12-17T18:13:50.716 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.718 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi062.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.718 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.718 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.719 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.746 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.038) 0:02:24.471 ******* 2021-12-17T18:13:50.754 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.756 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.786 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.039) 0:02:24.511 ******* 2021-12-17T18:13:50.793 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-12-17T18:13:50.796 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.821 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.035) 0:02:24.547 ******* 2021-12-17T18:13:50.873 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-12-17T18:13:50.875 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003234", "end": "2021-12-17 18:13:50.846844", "rc": 0, "start": "2021-12-17 18:13:50.843610", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock"]} 2021-12-17T18:13:50.903 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.081) 0:02:24.628 ******* 2021-12-17T18:13:50.933 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-12-17T18:13:50.934 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 71 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 q 2021-12-17T18:13:50.936 INFO:teuthology.task.ansible.out:emu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 2s (7506 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3u 2021-12-17T18:13:50.938 INFO:teuthology.task.ansible.out:buntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrad 2021-12-17T18:13:50.939 INFO:teuthology.task.ansible.out:ed, 6 newly installed, 0 to remove and 71 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 2s (7506 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ... 2021-12-17T18:13:50.941 INFO:teuthology.task.ansible.out:", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} TASK [testnode : Mark system down if NVMe card mi 2021-12-17T18:13:50.943 INFO:teuthology.task.ansible.out:ssing] ************************ skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:50.963 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.060) 0:02:24.688 ******* 2021-12-17T18:13:50.995 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:50 +0000 (0:00:00.031) 0:02:24.720 ******* 2021-12-17T18:13:51.003 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-12-17T18:13:51.005 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003800", "end": "2021-12-17 18:13:50.973305", "rc": 0, "start": "2021-12-17 18:13:50.969505", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock"]} 2021-12-17T18:13:51.034 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.039) 0:02:24.759 ******* 2021-12-17T18:13:51.063 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.029) 0:02:24.789 ******* 2021-12-17T18:13:51.071 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-12-17T18:13:51.073 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/fuse.conf.] *************************************** ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-12-17T18:13:51.073 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:51.102 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.038) 0:02:24.828 ******* 2021-12-17T18:13:51.129 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.025) 0:02:24.854 ******* 2021-12-17T18:13:51.154 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.025) 0:02:24.879 ******* 2021-12-17T18:13:51.160 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-12-17T18:13:51.162 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:51.188 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.034) 0:02:24.913 ******* 2021-12-17T18:13:51.197 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-12-17T18:13:51.199 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:51.224 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.036) 0:02:24.950 ******* 2021-12-17T18:13:51.233 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:51.263 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.039) 0:02:24.989 ******* 2021-12-17T18:13:51.336 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-12-17T18:13:51.338 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-12-17T18:13:51.364 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.100) 0:02:25.089 ******* 2021-12-17T18:13:51.414 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-12-17T18:13:51.416 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-12-17T18:13:51.456 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.092) 0:02:25.181 ******* 2021-12-17T18:13:51.487 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-12-17T18:13:51.489 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:51.517 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.060) 0:02:25.242 ******* 2021-12-17T18:13:51.525 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-12-17T18:13:51.528 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:13:51.552 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.035) 0:02:25.277 ******* 2021-12-17T18:13:51.644 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-12-17T18:13:51.646 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:13:51.671 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.118) 0:02:25.396 ******* 2021-12-17T18:13:51.824 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-12-17T18:13:51.825 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:13:31 UTC", "ActiveEnterTimestampMonotonic": "189889920", "ActiveExitTimestamp": "Fri 2021-12-17 18:13:30 UTC", "ActiveExitTimestampMonotonic": "189805140", "ActiveState": "active", "After": "sysinit.target systemd-tmpfiles-setup.service basic.target network.target remote-fs.target system.slice -.mount nss-lookup.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:13:30 UTC", "AssertTimestampMonotonic": "189853617", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:13:30 UTC", "ConditionTimestampMonotonic": "189853617", "ConfigurationDirec 2021-12-17T18:13:51.827 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6581", "ExecMainStartTimestamp": "Fri 2021-12-17 18:13:31 UTC", "ExecMainStartTimestampMonotonic": "189889902", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-12-17T18:13:51.829 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-12-17 18:13:30 UTC", "InactiveEnterTimestampMonotonic": "189852511", "InactiveExitTimestamp": "Fri 2021-12-17 18:13:30 UTC", "InactiveExitTimestampMonotonic": "189855920", "InvocationID": "82f8cbead97a41f685fb304b89149d1d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6581", "MemoryAccounting": "yes", "MemoryCurrent": "6828032", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-12-17T18:13:51.831 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:13:31 UTC", "StateChangeTimestampMonotonic": "189889920", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-12-17T18:13:51.833 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-12-17T18:13:51.850 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.179) 0:02:25.576 ******* 2021-12-17T18:13:51.868 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-12-17T18:13:51.870 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-12-17T18:13:51.894 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.043) 0:02:25.619 ******* 2021-12-17T18:13:51.902 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-12-17T18:13:51.903 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:51.903 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-12-17T18:13:51.904 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:13:51.931 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.037) 0:02:25.656 ******* 2021-12-17T18:13:51.953 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.022) 0:02:25.679 ******* 2021-12-17T18:13:51.961 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-12-17T18:13:51.963 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:51.988 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:51 +0000 (0:00:00.034) 0:02:25.713 ******* 2021-12-17T18:13:51.996 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-12-17T18:13:51.998 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.029 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.040) 0:02:25.754 ******* 2021-12-17T18:13:52.064 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.035) 0:02:25.789 ******* 2021-12-17T18:13:52.074 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-12-17T18:13:52.076 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item={'block_used': 14050995, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226044113, 'size_available': 925876686848, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187083, 'block_size': 4096, 'inode_available': 60867893}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226044113, "block_size": 4096, "block_total": 240095108, "block_used": 14050995, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867893, "inode_total": 61054976, "inode_used": 187083, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925876686848, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-12-17T18:13:52.076 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-12-17T18:13:52.077 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.102 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.037) 0:02:25.827 ******* 2021-12-17T18:13:52.124 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.022) 0:02:25.850 ******* 2021-12-17T18:13:52.132 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-12-17T18:13:52.134 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.160 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.034) 0:02:25.884 ******* 2021-12-17T18:13:52.166 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-12-17T18:13:52.168 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'block_used': 14050998, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226044110, 'size_available': 925876674560, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187083, 'block_size': 4096, 'inode_available': 60867893}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226044110, "block_size": 4096, "block_total": 240095108, "block_used": 14050998, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867893, "inode_total": 61054976, "inode_used": 187083, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925876674560, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-12-17T18:13:52.195 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.035) 0:02:25.920 ******* 2021-12-17T18:13:52.203 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-12-17T18:13:52.205 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.236 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.041) 0:02:25.961 ******* 2021-12-17T18:13:52.244 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-12-17T18:13:52.246 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-12-17T18:13:52.274 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.037) 0:02:25.999 ******* 2021-12-17T18:13:52.282 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-12-17T18:13:52.284 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009472", "end": "2021-12-17 18:13:52.253721", "rc": 0, "start": "2021-12-17 18:13:52.244249", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-12-17T18:13:52.284 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.311 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.036) 0:02:26.036 ******* 2021-12-17T18:13:52.335 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.024) 0:02:26.061 ******* 2021-12-17T18:13:52.354 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-12-17T18:13:52.358 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009755", "end": "2021-12-17 18:13:52.620661", "rc": 0, "start": "2021-12-17 18:13:52.610906", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi125.front.sepia.ceph.com] => (item={'block_used': 14050995, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226044113, 'size_available': 925876686848, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187083, 'block_size': 4096, 'inode_available': 60867893}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226044113, "block_size": 4096, "block_total": 240095108, "block_used": 14050995, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867893, "inode_total": 61054976, "inode_used": 187083, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925876686848, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.380 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.045) 0:02:26.106 ******* 2021-12-17T18:13:52.408 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.027) 0:02:26.133 ******* 2021-12-17T18:13:52.416 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-12-17T18:13:52.418 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.420 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi062.front.sepia.ceph.com] => (item={'block_used': 14050998, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226044110, 'size_available': 925876674560, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187083, 'block_size': 4096, 'inode_available': 60867893}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226044110, "block_size": 4096, "block_total": 240095108, "block_used": 14050998, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867893, "inode_total": 61054976, "inode_used": 187083, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925876674560, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.446 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.037) 0:02:26.171 ******* 2021-12-17T18:13:52.469 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.023) 0:02:26.194 ******* 2021-12-17T18:13:52.492 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.023) 0:02:26.217 ******* 2021-12-17T18:13:52.499 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-12-17T18:13:52.526 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.033) 0:02:26.251 ******* 2021-12-17T18:13:52.549 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.022) 0:02:26.274 ******* 2021-12-17T18:13:52.557 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-12-17T18:13:52.558 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.585 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.035) 0:02:26.310 ******* 2021-12-17T18:13:52.592 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:52.594 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.605 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-12-17T18:13:52.607 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-12-17T18:13:52.635 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.050) 0:02:26.360 ******* 2021-12-17T18:13:52.644 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-12-17T18:13:52.645 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.672 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.036) 0:02:26.397 ******* 2021-12-17T18:13:52.696 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.024) 0:02:26.422 ******* 2021-12-17T18:13:52.706 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-12-17T18:13:52.708 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.733 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.037) 0:02:26.459 ******* 2021-12-17T18:13:52.740 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:13:52.742 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.768 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.034) 0:02:26.493 ******* 2021-12-17T18:13:52.785 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:52.787 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.797 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.822 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.054) 0:02:26.548 ******* 2021-12-17T18:13:52.829 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-12-17T18:13:52.831 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:13:52.858 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.034) 0:02:26.582 ******* 2021-12-17T18:13:52.864 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-12-17T18:13:52.866 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.890 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.033) 0:02:26.615 ******* 2021-12-17T18:13:52.897 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-12-17T18:13:52.899 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.924 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.034) 0:02:26.649 ******* 2021-12-17T18:13:52.947 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.022) 0:02:26.672 ******* 2021-12-17T18:13:52.955 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-12-17T18:13:52.956 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:52.981 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:52 +0000 (0:00:00.034) 0:02:26.707 ******* 2021-12-17T18:13:52.988 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-12-17T18:13:52.989 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.014 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.032) 0:02:26.739 ******* 2021-12-17T18:13:53.020 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-12-17T18:13:53.022 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.053 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.039) 0:02:26.779 ******* 2021-12-17T18:13:53.060 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-12-17T18:13:53.062 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.248 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.194) 0:02:26.973 ******* 2021-12-17T18:13:53.255 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-12-17T18:13:53.257 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.282 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.033) 0:02:27.007 ******* 2021-12-17T18:13:53.289 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-12-17T18:13:53.291 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/fuse.conf.] *************************************** ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-12-17T18:13:53.316 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.033) 0:02:27.041 ******* 2021-12-17T18:13:53.339 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.023) 0:02:27.064 ******* 2021-12-17T18:13:53.349 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-12-17T18:13:53.351 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.379 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.039) 0:02:27.104 ******* 2021-12-17T18:13:53.385 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-12-17T18:13:53.387 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.412 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.033) 0:02:27.138 ******* 2021-12-17T18:13:53.420 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-12-17T18:13:53.421 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.448 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.035) 0:02:27.173 ******* 2021-12-17T18:13:53.456 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:13:53.458 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-12-17T18:13:53.487 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.039) 0:02:27.212 ******* 2021-12-17T18:13:53.494 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-12-17T18:13:53.496 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi109.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-12-17T18:13:53.522 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.035) 0:02:27.248 ******* 2021-12-17T18:13:53.546 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.023) 0:02:27.272 ******* 2021-12-17T18:13:53.554 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-12-17T18:13:53.556 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.567 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.569 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.579 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-12-17T18:13:53.581 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** ok: [smithi158.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-12-17T18:13:53.605 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.059) 0:02:27.331 ******* 2021-12-17T18:13:53.613 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.615 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.626 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.628 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.638 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.639 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi158.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.667 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.061) 0:02:27.392 ******* 2021-12-17T18:13:53.698 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.031) 0:02:27.423 ******* 2021-12-17T18:13:53.705 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-12-17T18:13:53.707 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:13:53.736 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.037) 0:02:27.461 ******* 2021-12-17T18:13:53.746 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-12-17T18:13:53.748 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.777 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.040) 0:02:27.502 ******* 2021-12-17T18:13:53.806 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-12-17T18:13:53.808 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.834 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.057) 0:02:27.559 ******* 2021-12-17T18:13:53.863 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.889 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.055) 0:02:27.615 ******* 2021-12-17T18:13:53.897 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-12-17T18:13:53.899 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003981", "end": "2021-12-17 18:13:53.848121", "rc": 0, "start": "2021-12-17 18:13:53.844140", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock"]} 2021-12-17T18:13:53.929 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.039) 0:02:27.655 ******* 2021-12-17T18:13:53.937 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-12-17T18:13:53.939 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:53.966 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:53 +0000 (0:00:00.036) 0:02:27.691 ******* 2021-12-17T18:13:53.974 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-12-17T18:13:53.975 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.007 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.040) 0:02:27.732 ******* 2021-12-17T18:13:54.015 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-12-17T18:13:54.017 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop apache2] ************************************************* 2021-12-17T18:13:54.019 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:13:35 UTC", "ActiveEnterTimestampMonotonic": "194247056", "ActiveExitTimestamp": "Fri 2021-12-17 18:13:35 UTC", "ActiveExitTimestampMonotonic": "194162826", "ActiveState": "active", "After": "network.target systemd-journald.socket nss-lookup.target basic.target -.mount systemd-tmpfiles-setup.service system.slice sysinit.target remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:13:35 UTC", "AssertTimestampMonotonic": "194213410", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:13:35 UTC", "ConditionTimestampMonotonic": "194213409", "ConfigurationDirec 2021-12-17T18:13:54.021 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6520", "ExecMainStartTimestamp": "Fri 2021-12-17 18:13:35 UTC", "ExecMainStartTimestampMonotonic": "194247030", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-12-17T18:13:54.023 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-12-17 18:13:35 UTC", "InactiveEnterTimestampMonotonic": "194211995", "InactiveExitTimestamp": "Fri 2021-12-17 18:13:35 UTC", "InactiveExitTimestampMonotonic": "194215996", "InvocationID": "4ffcff568cac4b52bffc9cb552ea74eb", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6520", "MemoryAccounting": "yes", "MemoryCurrent": "6836224", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-12-17T18:13:54.024 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:13:35 UTC", "StateChangeTimestampMonotonic": "194247056", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-12-17T18:13:54.026 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-12-17T18:13:54.046 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.039) 0:02:27.772 ******* 2021-12-17T18:13:54.070 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.024) 0:02:27.796 ******* 2021-12-17T18:13:54.077 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-12-17T18:13:54.079 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.104 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.033) 0:02:27.829 ******* 2021-12-17T18:13:54.134 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.030) 0:02:27.860 ******* 2021-12-17T18:13:54.143 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-12-17T18:13:54.145 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.169 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.035) 0:02:27.895 ******* 2021-12-17T18:13:54.195 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.025) 0:02:27.920 ******* 2021-12-17T18:13:54.202 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-12-17T18:13:54.203 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.229 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.033) 0:02:27.954 ******* 2021-12-17T18:13:54.236 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-12-17T18:13:54.238 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set grub config.] ********************************************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.265 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.036) 0:02:27.990 ******* 2021-12-17T18:13:54.293 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.027) 0:02:28.018 ******* 2021-12-17T18:13:54.300 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-12-17T18:13:54.302 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.328 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.034) 0:02:28.053 ******* 2021-12-17T18:13:54.355 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-12-17T18:13:54.356 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.379 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.051) 0:02:28.104 ******* 2021-12-17T18:13:54.406 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:54.408 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSEj1R0Yy1BvDd6Thg5DdXccQmdDwLJotS'], 'uuids': ['5fd91140-0df7-4b70-b3c3-c5cd5e89551f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.398717", "end": "2021-12-17 18:13:54.376507", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSEj1R0Yy1BvDd6Thg5DdXccQmdDwLJotS"], "labels": [], "masters": [], "uuids": ["5fd91140-0df7-4b70-b3c3-c5cd5e89551f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:52.977790", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Rebuild 2021-12-17T18:13:54.410 INFO:teuthology.task.ansible.out: rpmdb] ************************************************ skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.432 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.052) 0:02:28.157 ******* 2021-12-17T18:13:54.439 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:54.441 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.444 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-12-17T18:13:54.469 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.037) 0:02:28.194 ******* 2021-12-17T18:13:54.476 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-12-17T18:13:54.478 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.503 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.033) 0:02:28.228 ******* 2021-12-17T18:13:54.541 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-12-17T18:13:54.543 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.566 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.063) 0:02:28.291 ******* 2021-12-17T18:13:54.574 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:54.575 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6PZMrPZ0Ryl6ceSTTj6FXG264zw1NTsg3'], 'uuids': ['f6b2ea8b-93d1-4a66-891a-3c4b16ce3bda']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.629783", "end": "2021-12-17 18:13:54.520794", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6PZMrPZ0Ryl6ceSTTj6FXG264zw1NTsg3"], "labels": [], "masters": [], "uuids": ["f6b2ea8b-93d1-4a66-891a-3c4b16ce3bda"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:52.891011", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:13:54.577 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.579 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.589 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.624 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.058) 0:02:28.350 ******* 2021-12-17T18:13:54.653 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.683 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.058) 0:02:28.408 ******* 2021-12-17T18:13:54.714 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-12-17T18:13:54.716 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.739 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.056) 0:02:28.465 ******* 2021-12-17T18:13:54.768 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-12-17T18:13:54.770 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.793 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.053) 0:02:28.518 ******* 2021-12-17T18:13:54.810 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-12-17T18:13:54.812 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-12-17T18:13:54.836 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.042) 0:02:28.561 ******* 2021-12-17T18:13:54.844 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-12-17T18:13:54.846 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.871 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.035) 0:02:28.596 ******* 2021-12-17T18:13:54.879 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-12-17T18:13:54.881 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.906 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.034) 0:02:28.631 ******* 2021-12-17T18:13:54.913 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-12-17T18:13:54.915 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:54.940 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.034) 0:02:28.665 ******* 2021-12-17T18:13:54.948 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-12-17T18:13:54.950 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:13:54.977 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:54 +0000 (0:00:00.036) 0:02:28.702 ******* 2021-12-17T18:13:54.984 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-12-17T18:13:54.985 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:55.010 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:55 +0000 (0:00:00.033) 0:02:28.735 ******* 2021-12-17T18:13:55.018 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-12-17T18:13:55.160 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 17 December 2021 18:13:55 +0000 (0:00:00.036) 0:02:28.771 ******* TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 17 December 2021 18:13:55 +0000 (0:00:00.034) 0:02:28.806 ******* TASK [testnode : Set root disk] ************************************************ ok: [smithi158.front.sepia.ceph.com] => (item={'block_used': 14050989, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226044119, 'size_available': 925876711424, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187083, 'block_size': 4096, 'inode_available': 60867893}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226044119, "block_size": 4096, "block_total": 240095108, "block_used": 14050989, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867893, "inode_total": 61054976, "inode_used": 187083, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925876711424, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} Friday 17 December 2021 18:13:55 +0000 (0:00:00.051) 0:02:28.857 ******* TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:55.167 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:55 +0000 (0:00:00.035) 0:02:28.893 ******* 2021-12-17T18:13:55.196 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:55.221 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:55 +0000 (0:00:00.053) 0:02:28.946 ******* 2021-12-17T18:13:55.249 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:55.274 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:55 +0000 (0:00:00.053) 0:02:29.000 ******* 2021-12-17T18:13:55.281 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-12-17T18:13:55.282 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-12-17T18:13:55.284 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009474", "end": "2021-12-17 18:13:55.046232", "rc": 0, "start": "2021-12-17 18:13:55.036758", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:13:55.310 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:55 +0000 (0:00:00.035) 0:02:29.035 ******* 2021-12-17T18:13:55.333 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:55 +0000 (0:00:00.023) 0:02:29.058 ******* 2021-12-17T18:13:55.340 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-12-17T18:13:55.342 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:55.369 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:55 +0000 (0:00:00.036) 0:02:29.094 ******* 2021-12-17T18:13:55.377 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-12-17T18:13:55.380 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'block_used': 14050989, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226044119, 'size_available': 925876711424, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187083, 'block_size': 4096, 'inode_available': 60867893}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226044119, "block_size": 4096, "block_total": 240095108, "block_used": 14050989, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867893, "inode_total": 61054976, "inode_used": 187083, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925876711424, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:55.407 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:55 +0000 (0:00:00.038) 0:02:29.132 ******* 2021-12-17T18:13:55.415 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-12-17T18:13:55.417 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:55.453 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:55 +0000 (0:00:00.045) 0:02:29.178 ******* 2021-12-17T18:13:55.462 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-12-17T18:13:55.488 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:55 +0000 (0:00:00.034) 0:02:29.213 ******* 2021-12-17T18:13:55.495 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-12-17T18:13:55.497 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:55.522 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:55 +0000 (0:00:00.034) 0:02:29.247 ******* 2021-12-17T18:13:55.553 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:55.555 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:55.565 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:55.589 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:55 +0000 (0:00:00.066) 0:02:29.314 ******* 2021-12-17T18:13:55.627 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-12-17T18:13:55.629 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:55.669 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:55 +0000 (0:00:00.080) 0:02:29.394 ******* 2021-12-17T18:13:55.688 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:55.689 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSFLBCDwaQ1zwhr5F6hJJGDHDiwOCPZuiR'], 'uuids': ['15eedbb8-3234-46c4-a9e5-b84a235d152d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.122170", "end": "2021-12-17 18:13:55.648683", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSFLBCDwaQ1zwhr5F6hJJGDHDiwOCPZuiR"], "labels": [], "masters": [], "uuids": ["15eedbb8-3234-46c4-a9e5-b84a235d152d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:54.526513", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:13:55.691 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W5SV', 'wwn-0x5000c50087b99812'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1', 'wwn-0x5000c50087b99812-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50087b99812', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4W5SV', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV", "wwn-0x5000c50087b99812"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1", "wwn-0x5000c50087b99812-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W5SV", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b99812"}}, 2021-12-17T18:13:55.693 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-12-17T18:13:55.693 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-12-17T18:13:55.694 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-12-17T18:13:55.695 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:55.720 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:55 +0000 (0:00:00.050) 0:02:29.445 ******* 2021-12-17T18:13:55.745 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:55 +0000 (0:00:00.025) 0:02:29.470 ******* 2021-12-17T18:13:55.754 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:55.781 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:55 +0000 (0:00:00.036) 0:02:29.507 ******* 2021-12-17T18:13:55.825 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:55.827 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6YYVvuMgvClgedG2nPq3j1rSD3VuIBKpd'], 'uuids': ['e8e8268d-f593-4570-bf30-dd33d6d02692']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.130308", "end": "2021-12-17 18:13:55.793351", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6YYVvuMgvClgedG2nPq3j1rSD3VuIBKpd"], "labels": [], "masters": [], "uuids": ["e8e8268d-f593-4570-bf30-dd33d6d02692"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:54.663043", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:13:55.841 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHY2', 'wwn-0x5000c50091e1abc3'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHY2-part1', 'wwn-0x5000c50091e1abc3-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e1abc3', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QHY2', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHY2", "wwn-0x5000c50091e1abc3"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHY2-part1", "wwn-0x5000c50091e1abc3-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QHY2", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e1abc3"}}, 2021-12-17T18:13:55.842 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-12-17T18:13:55.951 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-12-17T18:13:55.953 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-12-17T18:13:55.977 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:55 +0000 (0:00:00.195) 0:02:29.703 ******* 2021-12-17T18:13:56.092 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-12-17T18:13:56.094 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-12-17T18:13:56.120 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:56 +0000 (0:00:00.142) 0:02:29.845 ******* 2021-12-17T18:13:56.265 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-12-17T18:13:56.267 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:13:56.302 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:56 +0000 (0:00:00.182) 0:02:30.027 ******* 2021-12-17T18:13:56.329 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-12-17T18:13:56.330 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.353 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:56 +0000 (0:00:00.051) 0:02:30.079 ******* 2021-12-17T18:13:56.377 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:56 +0000 (0:00:00.023) 0:02:30.103 ******* 2021-12-17T18:13:56.383 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-12-17T18:13:56.385 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.423 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:56 +0000 (0:00:00.046) 0:02:30.149 ******* 2021-12-17T18:13:56.432 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-12-17T18:13:56.434 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.460 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:56 +0000 (0:00:00.036) 0:02:30.186 ******* 2021-12-17T18:13:56.487 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-12-17T18:13:56.489 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.538 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:56 +0000 (0:00:00.078) 0:02:30.264 ******* 2021-12-17T18:13:56.570 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-12-17T18:13:56.571 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.596 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:56 +0000 (0:00:00.057) 0:02:30.321 ******* 2021-12-17T18:13:56.625 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-12-17T18:13:56.627 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.650 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:56 +0000 (0:00:00.053) 0:02:30.375 ******* 2021-12-17T18:13:56.690 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:13:56.691 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-12-17T18:13:56.716 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:56 +0000 (0:00:00.066) 0:02:30.441 ******* 2021-12-17T18:13:56.768 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi192.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.771 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-12-17T18:13:56.796 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:56 +0000 (0:00:00.080) 0:02:30.522 ******* 2021-12-17T18:13:56.806 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi192.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.808 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.810 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi192.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.821 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.823 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.832 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.834 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.844 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.845 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.855 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.884 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:56 +0000 (0:00:00.088) 0:02:30.610 ******* 2021-12-17T18:13:56.964 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:56.966 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-1csLoh-6yXs-3WtT-OFYF-csfc-80RC-gmLSJ8', 'nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN', 'nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.143963", "end": "2021-12-17 18:13:56.931816", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-1csLoh-6yXs-3WtT-OFYF-csfc-80RC-gmLSJ8", "nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN", "nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:55.787853", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-12-17T18:13:56.968 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:13:56.979 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:56.980 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:57.080 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-12-17T18:13:57.081 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003989", "end": "2021-12-17 18:13:57.056109", "rc": 0, "start": "2021-12-17 18:13:57.052120", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock"]} 2021-12-17T18:13:57.108 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:57 +0000 (0:00:00.223) 0:02:30.834 ******* 2021-12-17T18:13:57.130 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:57.131 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-xFFojh-Czbo-aWiK-fB9d-Ay5k-LSoA-e2z1xE', 'nvme-INTEL_SSDPEDMD400G4_PHFT62040123400BGN', 'nvme-nvme.8086-50484654363230343031323334303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.158528", "end": "2021-12-17 18:13:57.095590", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-xFFojh-Czbo-aWiK-fB9d-Ay5k-LSoA-e2z1xE", "nvme-INTEL_SSDPEDMD400G4_PHFT62040123400BGN", "nvme-nvme.8086-50484654363230343031323334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:55.937062", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-12-17T18:13:57.133 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:13:57.144 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:57.145 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-12-17T18:13:57.145 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-12-17T18:13:57.146 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:57.147 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:57.172 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:57 +0000 (0:00:00.063) 0:02:30.897 ******* 2021-12-17T18:13:57.200 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:57 +0000 (0:00:00.027) 0:02:30.925 ******* 2021-12-17T18:13:57.229 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-12-17T18:13:57.231 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:57.255 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:57 +0000 (0:00:00.055) 0:02:30.980 ******* 2021-12-17T18:13:57.284 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:57.285 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2sNhA4eFGcjaQdh4ioExPSNiHXtYEm1BO'], 'uuids': ['ac273a06-151e-4771-b138-45699aef5ace']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.595597", "end": "2021-12-17 18:13:57.036166", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2sNhA4eFGcjaQdh4ioExPSNiHXtYEm1BO"], "labels": [], "masters": [], "uuids": ["ac273a06-151e-4771-b138-45699aef5ace"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:55.440569", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:13:57.287 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-12-17T18:13:57.287 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:57.288 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:57.288 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:57.314 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:57 +0000 (0:00:00.059) 0:02:31.039 ******* 2021-12-17T18:13:57.321 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:57.524 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-12-17T18:13:57.526 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-12-17T18:13:57.561 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:57 +0000 (0:00:00.247) 0:02:31.287 ******* 2021-12-17T18:13:57.708 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-12-17T18:13:57.710 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:13:57.734 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:57 +0000 (0:00:00.172) 0:02:31.459 ******* 2021-12-17T18:13:57.763 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-12-17T18:13:57.765 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:57.787 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:57 +0000 (0:00:00.053) 0:02:31.513 ******* 2021-12-17T18:13:57.815 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-12-17T18:13:57.817 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:57.840 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:57 +0000 (0:00:00.052) 0:02:31.565 ******* 2021-12-17T18:13:57.870 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-12-17T18:13:57.872 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:57.895 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:57 +0000 (0:00:00.055) 0:02:31.620 ******* 2021-12-17T18:13:57.923 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-12-17T18:13:57.924 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:57.947 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:57 +0000 (0:00:00.052) 0:02:31.672 ******* 2021-12-17T18:13:57.987 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-12-17T18:13:57.988 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi192.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:13:58.012 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:58 +0000 (0:00:00.064) 0:02:31.737 ******* 2021-12-17T18:13:58.035 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:58 +0000 (0:00:00.023) 0:02:31.761 ******* 2021-12-17T18:13:58.054 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:13:58.056 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-12-17T18:13:58.078 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:58 +0000 (0:00:00.042) 0:02:31.803 ******* 2021-12-17T18:13:58.085 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-12-17T18:13:58.087 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.113 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:58 +0000 (0:00:00.033) 0:02:31.837 ******* 2021-12-17T18:13:58.129 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-12-17T18:13:58.131 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.141 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.152 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.154 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi192.front.sepia.ceph.com] => (item={'block_used': 14050990, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226044118, 'size_available': 925876707328, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187083, 'block_size': 4096, 'inode_available': 60867893}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226044118, "block_size": 4096, "block_total": 240095108, "block_used": 14050990, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867893, "inode_total": 61054976, "inode_used": 187083, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925876707328, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-12-17T18:13:58.155 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi109.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.180 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:58 +0000 (0:00:00.068) 0:02:31.905 ******* 2021-12-17T18:13:58.190 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.192 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi109.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.204 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.204 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.216 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.217 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.249 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:58 +0000 (0:00:00.068) 0:02:31.974 ******* 2021-12-17T18:13:58.257 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:58.259 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSYjlvBQmpjKiVfeMwDaiTESPDVKXZGu4X'], 'uuids': ['9f85a10f-0a3c-4122-8c0f-3b72c691632e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.126350", "end": "2021-12-17 18:13:58.204567", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSYjlvBQmpjKiVfeMwDaiTESPDVKXZGu4X"], "labels": [], "masters": [], "uuids": ["9f85a10f-0a3c-4122-8c0f-3b72c691632e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:57.078217", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:13:58.259 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.s 2021-12-17T18:13:58.261 INFO:teuthology.task.ansible.out:epia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.325 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009687", "end": "2021-12-17 18:13:58.316837", "rc": 0, "start": "2021-12-17 18:13:58.307150", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:13:58.361 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:58 +0000 (0:00:00.112) 0:02:32.087 ******* 2021-12-17T18:13:58.401 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-12-17T18:13:58.403 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'block_used': 14050990, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226044118, 'size_available': 925876707328, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187083, 'block_size': 4096, 'inode_available': 60867893}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226044118, "block_size": 4096, "block_total": 240095108, "block_used": 14050990, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867893, "inode_total": 61054976, "inode_used": 187083, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925876707328, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.437 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:58 +0000 (0:00:00.075) 0:02:32.163 ******* 2021-12-17T18:13:58.445 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:58.446 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6QgVry7I7eNRIOFttJeZ9VwZvhvqYyxDd'], 'uuids': ['fc60e083-249d-4b20-8580-f296060fd580']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.141809", "end": "2021-12-17 18:13:58.399683", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6QgVry7I7eNRIOFttJeZ9VwZvhvqYyxDd"], "labels": [], "masters": [], "uuids": ["fc60e083-249d-4b20-8580-f296060fd580"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:57.257874", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:13:58.448 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.460 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.462 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi109.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003176", "end": "2021-12-17 18:13:58.440689", "rc": 0, "start": "2021-12-17 18:13:58.437513", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock"]} 2021-12-17T18:13:58.487 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:58 +0000 (0:00:00.050) 0:02:32.213 ******* 2021-12-17T18:13:58.511 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:58 +0000 (0:00:00.023) 0:02:32.236 ******* 2021-12-17T18:13:58.528 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-12-17T18:13:58.530 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.557 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:58 +0000 (0:00:00.046) 0:02:32.282 ******* 2021-12-17T18:13:58.565 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:58.566 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.568 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2eXMMbBEBJTWvjbDG8tA8Ac4KxnS27nfO'], 'uuids': ['5067ab4d-45c5-46d0-bee5-30266aa26813']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.136803", "end": "2021-12-17 18:13:58.322203", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2eXMMbBEBJTWvjbDG8tA8Ac4KxnS27nfO"], "labels": [], "masters": [], "uuids": ["5067ab4d-45c5-46d0-bee5-30266aa26813"]}, "model": null, "partitions": {}, "removable": "0", "rotat 2021-12-17T18:13:58.570 INFO:teuthology.task.ansible.out:ional": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:57.185400", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:13:58.580 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLCL', 'wwn-0x5000c50092940704'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLCL-part1', 'wwn-0x5000c50092940704-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092940704', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XLCL', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLCL", "wwn-0x5000c50092940704"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLCL-part1", "wwn-0x5000c50092940704-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XLCL", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092940704"}}, 2021-12-17T18:13:58.582 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.592 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.617 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:58 +0000 (0:00:00.060) 0:02:32.343 ******* 2021-12-17T18:13:58.645 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-12-17T18:13:58.647 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:58.671 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:58 +0000 (0:00:00.053) 0:02:32.396 ******* 2021-12-17T18:13:59.360 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-12-17T18:13:59.362 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:13:59.384 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:59 +0000 (0:00:00.713) 0:02:33.110 ******* 2021-12-17T18:13:59.411 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-12-17T18:13:59.413 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:59.435 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:59 +0000 (0:00:00.051) 0:02:33.161 ******* 2021-12-17T18:13:59.487 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-12-17T18:13:59.489 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item={'block_used': 14050990, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226044118, 'size_available': 925876707328, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187083, 'block_size': 4096, 'inode_available': 60867893}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226044118, "block_size": 4096, "block_total": 240095108, "block_used": 14050990, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867893, "inode_total": 61054976, "inode_used": 187083, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925876707328, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-12-17T18:13:59.490 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:59.490 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSnWp15kdby1ebJPbfz52ixWZ38uxOoLcA'], 'uuids': ['3b86998e-61fd-4e73-9c39-b15254cc7b14']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.108296", "end": "2021-12-17 18:13:59.463618", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSnWp15kdby1ebJPbfz52ixWZ38uxOoLcA"], "labels": [], "masters": [], "uuids": ["3b86998e-61fd-4e73-9c3 2021-12-17T18:13:59.492 INFO:teuthology.task.ansible.out:9-b15254cc7b14"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:58.355322", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:13:59.515 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:59 +0000 (0:00:00.079) 0:02:33.240 ******* 2021-12-17T18:13:59.524 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:59.661 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-12-17T18:13:59.663 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009422", "end": "2021-12-17 18:13:59.643719", "rc": 0, "start": "2021-12-17 18:13:59.634297", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:13:59.691 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:59 +0000 (0:00:00.175) 0:02:33.416 ******* 2021-12-17T18:13:59.708 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:59.710 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6ACRUwfx2YHsN3xGco67w68Sd3ydMWTGC'], 'uuids': ['32a80ec7-449c-4f30-9ee3-149b19882002']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.127148", "end": "2021-12-17 18:13:59.676570", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6ACRUwfx2YHsN3xGco67w68Sd3ydMWTGC"], "labels": [], "masters": [], "uuids": ["32a80ec7-449c-4f30-9ee3-149b19882002"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:58.549422", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:13:59.711 INFO:teuthology.task.ansible.out:skipping: [smithi125.front 2021-12-17T18:13:59.712 INFO:teuthology.task.ansible.out:.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:59.732 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-12-17T18:13:59.734 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'block_used': 14050990, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226044118, 'size_available': 925876707328, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187083, 'block_size': 4096, 'inode_available': 60867893}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226044118, "block_size": 4096, "block_total": 240095108, "block_used": 14050990, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867893, "inode_total": 61054976, "inode_used": 187083, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925876707328, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:59.757 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:59 +0000 (0:00:00.066) 0:02:33.483 ******* 2021-12-17T18:13:59.785 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-12-17T18:13:59.809 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:13:59 +0000 (0:00:00.051) 0:02:33.534 ******* 2021-12-17T18:13:59.837 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:13:59.838 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-ywqB7b-6MoY-J3GE-Afov-AGle-Ci50-RHYglc', 'nvme-INTEL_SSDPED1D480GA_PHMB7475005A480DGN', 'nvme-nvme.8086-50484d42373437353030354134383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.130429", "end": "2021-12-17 18:13:59.595692", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-ywqB7b-6MoY-J3GE-Afov-AGle-Ci50-RHYglc", "nvme-INTEL_SSDPED1D480GA_PHMB7475005A480DGN", "nvme-nvme.8086-50484d42373437353030354134383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:58.465263", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You 2021-12-17T18:13:59.840 INFO:teuthology.task.ansible.out:may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:13:59.849 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:59.861 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:13:59.862 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:00.241 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN3YPJ4xAp760gBjizP48AQVDnNCjHlQhwX'], 'uuids': ['39b2c767-7e20-4f6d-a7a4-a4d7c6031c73']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.552911", "end": "2021-12-17 18:14:00.221868", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN3YPJ4xAp760gBjizP48AQVDnNCjHlQhwX"], "labels": [], "masters": [], "uuids": ["39b2c767-7e20-4f6d-a7a4-a4d7c6031c73"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:58.668957", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:14:00.253 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:00.265 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:00.784 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSty5vvKfMeEw4TRa2iYqTXC42dw6tiMVR'], 'uuids': ['3d3dc309-075a-474c-8cdc-9361b87dcbe7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.135045", "end": "2021-12-17 18:14:00.740131", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSty5vvKfMeEw4TRa2iYqTXC42dw6tiMVR"], "labels": [], "masters": [], "uuids": ["3d3dc309-075a-474c-8cdc-9361b87dcbe7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:59.605086", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:14:00.820 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:00 +0000 (0:00:01.011) 0:02:34.545 ******* 2021-12-17T18:14:00.870 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:00.872 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:00.957 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:14:00.959 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6D06bHtVf0LbsyphmpzFW1D3buK3ZeCcE'], 'uuids': ['17fb3d47-3e58-4985-b32b-56d2a2d12ac9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.109471", "end": "2021-12-17 18:14:00.925822", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6D06bHtVf0LbsyphmpzFW1D3buK3ZeCcE"], "labels": [], "masters": [], "uuids": ["17fb3d47-3e58-4985-b32b-56d2a2d12ac9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:59.816351", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:14:00.997 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:00 +0000 (0:00:00.177) 0:02:34.723 ******* 2021-12-17T18:14:01.048 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:01.050 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:01.123 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:14:01.125 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2BkJxBWgbA2p0PsK8Stf1iVxfb449eBUl'], 'uuids': ['2c29a032-ab3e-41c7-9215-479c36f3dabd']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.138247", "end": "2021-12-17 18:14:00.879220", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2BkJxBWgbA2p0PsK8Stf1iVxfb449eBUl"], "labels": [], "masters": [], "uuids": ["2c29a032-ab3e-41c7-9215-479c36f3dabd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:59.740973", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:14:01.135 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:01.136 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:01.169 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:01.171 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSEj1R0Yy1BvDd6Thg5DdXccQmdDwLJotS'], 'uuids': ['5fd91140-0df7-4b70-b3c3-c5cd5e89551f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.159867", "end": "2021-12-17 18:14:01.141732", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSEj1R0Yy1BvDd6Thg5DdXccQmdDwLJotS"], "labels": [], "masters": [], "uuids": ["5fd91140-0df7-4b70-b3c3-c5cd5e89551f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:00.981865", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155005 s, 744 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155005 s, 744 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:01.181 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:01.182 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:01.342 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6PZMrPZ0Ryl6ceSTTj6FXG264zw1NTsg3'], 'uuids': ['f6b2ea8b-93d1-4a66-891a-3c4b16ce3bda']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.166989", "end": "2021-12-17 18:14:01.320489", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6PZMrPZ0Ryl6ceSTTj6FXG264zw1NTsg3"], "labels": [], "masters": [], "uuids": ["f6b2ea8b-93d1-4a66-891a-3c4b16ce3bda"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:01.153500", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.161989 s, 712 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.161989 s, 712 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:01.354 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:01.365 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:01.483 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSFLBCDwaQ1zwhr5F6hJJGDHDiwOCPZuiR'], 'uuids': ['15eedbb8-3234-46c4-a9e5-b84a235d152d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.164266", "end": "2021-12-17 18:14:01.451256", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSFLBCDwaQ1zwhr5F6hJJGDHDiwOCPZuiR"], "labels": [], "masters": [], "uuids": ["15eedbb8-3234-46c4-a9e5-b84a235d152d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:01.286990", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159362 s, 724 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159362 s, 724 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:01.485 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W5SV', 'wwn-0x5000c50087b99812'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1', 'wwn-0x5000c50087b99812-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50087b99812', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4W5SV', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV", "wwn-0x5000c50087b99812"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1", "wwn-0x5000c50087b99812-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W5SV", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b99812"}}, 2021-12-17T18:14:01.486 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-12-17T18:14:01.528 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:14:01.530 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN3m9p7Llb7J7Hgyd0zZ1kxYX7h8wXfpgAK'], 'uuids': ['4aa39260-0453-4f57-bf25-a5eb18270bff']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.119971", "end": "2021-12-17 18:14:01.511283", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN3m9p7Llb7J7Hgyd0zZ1kxYX7h8wXfpgAK"], "labels": [], "masters": [], "uuids": ["4aa39260-0453-4f57-bf25-a5eb18270bff"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:00.391312", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:14:01.540 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLLK', 'wwn-0x5000c50092939e0b'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLLK-part1', 'wwn-0x5000c50092939e0b-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092939e0b', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XLLK', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLLK", "wwn-0x5000c50092939e0b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLLK-part1", "wwn-0x5000c50092939e0b-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XLLK", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092939e0b"}}, 2021-12-17T18:14:01.542 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-12-17T18:14:01.668 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:01.669 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6YYVvuMgvClgedG2nPq3j1rSD3VuIBKpd'], 'uuids': ['e8e8268d-f593-4570-bf30-dd33d6d02692']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.171075", "end": "2021-12-17 18:14:01.635388", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6YYVvuMgvClgedG2nPq3j1rSD3VuIBKpd"], "labels": [], "masters": [], "uuids": ["e8e8268d-f593-4570-bf30-dd33d6d02692"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:01.464313", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.166015 s, 695 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.166015 s, 695 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:01.680 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHY2', 'wwn-0x5000c50091e1abc3'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHY2-part1', 'wwn-0x5000c50091e1abc3-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e1abc3', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QHY2', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHY2", "wwn-0x5000c50091e1abc3"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHY2-part1", "wwn-0x5000c50091e1abc3-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QHY2", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e1abc3"}}, 2021-12-17T18:14:01.681 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-1csLoh-6yXs-3WtT-OFYF-csfc-80RC-gmLSJ8', 'nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN', 'nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.058765", "end": "2021-12-17 18:14:01.646722", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-1csLoh-6yXs-3WtT-OFYF-csfc-80RC-gmLSJ8", "nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN", "nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:01.587957", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 2021-12-17T18:14:01.683 INFO:teuthology.task.ansible.out:MB, 110 MiB) copied, 0.0538731 s, 2.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0538731 s, 2.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:01.693 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:01.704 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:01.737 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:14:01.739 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrE8yA234JvNG7k6EuNCipFhGNSFDQVWiDp'], 'uuids': ['ff893468-9870-498d-bd70-369e22ed5250']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.742243", "end": "2021-12-17 18:14:01.703977", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrE8yA234JvNG7k6EuNCipFhGNSFDQVWiDp"], "labels": [], "masters": [], "uuids": ["ff893468-9870-498d-bd70-369e22ed5250"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:13:59.961734", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi109.front 2021-12-17T18:14:01.740 INFO:teuthology.task.ansible.out:.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:01.750 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:01.867 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:01.869 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-xFFojh-Czbo-aWiK-fB9d-Ay5k-LSoA-e2z1xE', 'nvme-INTEL_SSDPEDMD400G4_PHFT62040123400BGN', 'nvme-nvme.8086-50484654363230343031323334303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.054299", "end": "2021-12-17 18:14:01.835735", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-xFFojh-Czbo-aWiK-fB9d-Ay5k-LSoA-e2z1xE", "nvme-INTEL_SSDPEDMD400G4_PHFT62040123400BGN", "nvme-nvme.8086-50484654363230343031323334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:01.781436", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0510588 s, 2.3 GB/s", "std 2021-12-17T18:14:01.870 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0510588 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:01.881 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:01.997 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSYjlvBQmpjKiVfeMwDaiTESPDVKXZGu4X'], 'uuids': ['9f85a10f-0a3c-4122-8c0f-3b72c691632e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.161816", "end": "2021-12-17 18:14:01.973155", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSYjlvBQmpjKiVfeMwDaiTESPDVKXZGu4X"], "labels": [], "masters": [], "uuids": ["9f85a10f-0a3c-4122-8c0f-3b72c691632e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:01.811339", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156872 s, 735 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156872 s, 735 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:02.009 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:02.021 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:02.170 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6QgVry7I7eNRIOFttJeZ9VwZvhvqYyxDd'], 'uuids': ['fc60e083-249d-4b20-8580-f296060fd580']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.155939", "end": "2021-12-17 18:14:02.139005", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6QgVry7I7eNRIOFttJeZ9VwZvhvqYyxDd"], "labels": [], "masters": [], "uuids": ["fc60e083-249d-4b20-8580-f296060fd580"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:01.983066", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.151177 s, 763 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.151177 s, 763 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:02.182 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:02.193 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:02.320 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSnWp15kdby1ebJPbfz52ixWZ38uxOoLcA'], 'uuids': ['3b86998e-61fd-4e73-9c39-b15254cc7b14']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.167753", "end": "2021-12-17 18:14:02.289661", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSnWp15kdby1ebJPbfz52ixWZ38uxOoLcA"], "labels": [], "masters": [], "uuids": ["3b86998e-61fd-4e73-9c39-b15254cc7b14"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:02.121908", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.162838 s, 708 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.162838 s, 708 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:02.332 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:02.395 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:14:02.397 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2vRq05DIenc52ARBsaOfJ0gPZl89nMcx2'], 'uuids': ['1108a7f9-7d60-454c-bb67-e841f227cb54']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.127752", "end": "2021-12-17 18:14:02.154872", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2vRq05DIenc52ARBsaOfJ0gPZl89nMcx2"], "labels": [], "masters": [], "uuids": ["1108a7f9-7d60-454c-bb67-e841f227cb54"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:01.027120", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:14:02.407 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:02.482 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:02.484 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6ACRUwfx2YHsN3xGco67w68Sd3ydMWTGC'], 'uuids': ['32a80ec7-449c-4f30-9ee3-149b19882002']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.168358", "end": "2021-12-17 18:14:02.457350", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6ACRUwfx2YHsN3xGco67w68Sd3ydMWTGC"], "labels": [], "masters": [], "uuids": ["32a80ec7-449c-4f30-9ee3-149b19882002"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:02.288992", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.163656 s, 705 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.163656 s, 705 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:02.495 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:02.623 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSty5vvKfMeEw4TRa2iYqTXC42dw6tiMVR'], 'uuids': ['3d3dc309-075a-474c-8cdc-9361b87dcbe7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.157510", "end": "2021-12-17 18:14:02.596349", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-u2PV63VBGocp7hV1GB5jTpIEcfzYv5oSty5vvKfMeEw4TRa2iYqTXC42dw6tiMVR"], "labels": [], "masters": [], "uuids": ["3d3dc309-075a-474c-8cdc-9361b87dcbe7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:02.438839", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.152514 s, 756 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.152514 s, 756 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:02.667 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:02 +0000 (0:00:01.670) 0:02:36.393 ******* 2021-12-17T18:14:02.781 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6D06bHtVf0LbsyphmpzFW1D3buK3ZeCcE'], 'uuids': ['17fb3d47-3e58-4985-b32b-56d2a2d12ac9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.163405", "end": "2021-12-17 18:14:02.756166", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-d5zKemagj8N3cdsuwgOsnxACVbYiDZD6D06bHtVf0LbsyphmpzFW1D3buK3ZeCcE"], "labels": [], "masters": [], "uuids": ["17fb3d47-3e58-4985-b32b-56d2a2d12ac9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:02.592761", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158655 s, 727 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158655 s, 727 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:02.830 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:02 +0000 (0:00:00.161) 0:02:36.555 ******* 2021-12-17T18:14:02.858 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:14:02.860 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-kdQqyF-jNa1-MbhD-HZzK-e4aR-0nF2-QuaHRB', 'nvme-INTEL_SSDPEDMD400G4_PHFT620500NN400BGN', 'nvme-nvme.8086-504846543632303530304e4e34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.181637", "end": "2021-12-17 18:14:02.831600", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-kdQqyF-jNa1-MbhD-HZzK-e4aR-0nF2-QuaHRB", "nvme-INTEL_SSDPEDMD400G4_PHFT620500NN400BGN", "nvme-nvme.8086-504846543632303530304e4e34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:01.649963", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-12-17T18:14:02.862 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:02.872 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:02.968 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-12-17T18:14:02.969 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.145682", "end": "2021-12-17 18:14:02.931640", "rc": 0, "start": "2021-12-17 18:14:02.785958", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:02.995 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:02 +0000 (0:00:00.165) 0:02:36.721 ******* 2021-12-17T18:14:03.025 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:14:03.026 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrEGODlfSeA9UuEZzRagaUnUjhHA970YIvx'], 'uuids': ['b94233a6-918b-49bf-a18f-07633dc1a38d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.143669", "end": "2021-12-17 18:14:02.991805", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrEGODlfSeA9UuEZzRagaUnUjhHA970YIvx"], "labels": [], "masters": [], "uuids": ["b94233a6-918b-49bf-a18f-07633dc1a38d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:01.848136", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:14:03.027 INFO:teuthology.task.ansible.out:skipping: [smithi109.front 2021-12-17T18:14:03.028 INFO:teuthology.task.ansible.out:.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QPMH', 'wwn-0x5000c50091e0bc82'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QPMH-part1', 'wwn-0x5000c50091e0bc82-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e0bc82', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QPMH', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QPMH", "wwn-0x5000c50091e0bc82"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QPMH-part1", "wwn-0x5000c50091e0bc82-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QPMH", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e0bc82"}}, "skip_reason": "Condition 2021-12-17T18:14:03.030 INFO:teuthology.task.ansible.out:al result was False"} 2021-12-17T18:14:03.116 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-12-17T18:14:03.117 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.132515", "end": "2021-12-17 18:14:03.079340", "rc": 0, "start": "2021-12-17 18:14:02.946825", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:03.142 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.146) 0:02:36.868 ******* 2021-12-17T18:14:03.213 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-12-17T18:14:03.214 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.074070", "end": "2021-12-17 18:14:03.188662", "rc": 0, "start": "2021-12-17 18:14:03.114592", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:03.239 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.097) 0:02:36.965 ******* 2021-12-17T18:14:03.268 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-12-17T18:14:03.296 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.056) 0:02:37.022 ******* 2021-12-17T18:14:03.324 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-12-17T18:14:03.326 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:03.351 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.054) 0:02:37.076 ******* 2021-12-17T18:14:03.369 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-12-17T18:14:03.370 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.079894", "end": "2021-12-17 18:14:03.340333", "rc": 0, "start": "2021-12-17 18:14:03.260439", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:03.393 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.041) 0:02:37.118 ******* 2021-12-17T18:14:03.399 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-12-17T18:14:03.401 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:03.423 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.030) 0:02:37.149 ******* 2021-12-17T18:14:03.430 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-12-17T18:14:03.457 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.033) 0:02:37.182 ******* 2021-12-17T18:14:03.463 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-12-17T18:14:03.465 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:03.491 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.034) 0:02:37.217 ******* 2021-12-17T18:14:03.499 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-12-17T18:14:03.501 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:03.526 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.035) 0:02:37.252 ******* 2021-12-17T18:14:03.533 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-12-17T18:14:03.535 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:03.558 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.031) 0:02:37.283 ******* 2021-12-17T18:14:03.565 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-12-17T18:14:03.567 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:03.591 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.033) 0:02:37.316 ******* 2021-12-17T18:14:03.621 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-12-17T18:14:03.623 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:03.656 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.065) 0:02:37.382 ******* 2021-12-17T18:14:03.684 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:14:03.686 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2XNGW2QghaE3nS8ReJztcU9YWOrPLGFQA'], 'uuids': ['e2e3b510-838a-4377-a349-97a0e418c14c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.134976", "end": "2021-12-17 18:14:03.433240", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2XNGW2QghaE3nS8ReJztcU9YWOrPLGFQA"], "labels": [], "masters": [], "uuids": ["e2e3b510-838a-4377-a349-97a0e418c14c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:02.298264", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Write / 2021-12-17T18:14:03.688 INFO:teuthology.task.ansible.out:scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:03.689 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:14:03.697 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-12-17T18:14:03.698 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:14:03.721 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.064) 0:02:37.446 ******* 2021-12-17T18:14:03.746 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.025) 0:02:37.472 ******* 2021-12-17T18:14:03.773 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.026) 0:02:37.498 ******* 2021-12-17T18:14:03.780 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-12-17T18:14:03.781 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'block_used': 14050998, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226044110, 'size_available': 925876674560, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187083, 'block_size': 4096, 'inode_available': 60867893}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226044110, "block_size": 4096, "block_total": 240095108, "block_used": 14050998, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867893, "inode_total": 61054976, "inode_used": 187083, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925876674560, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:03.809 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.035) 0:02:37.534 ******* 2021-12-17T18:14:03.827 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:03.829 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:03.839 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-12-17T18:14:03.841 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:03.864 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.055) 0:02:37.590 ******* 2021-12-17T18:14:03.882 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-12-17T18:14:03.884 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:14:03.907 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.042) 0:02:37.633 ******* 2021-12-17T18:14:03.914 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:03.916 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:03.941 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.033) 0:02:37.666 ******* 2021-12-17T18:14:03.948 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-12-17T18:14:03.950 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'block_used': 14050995, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226044113, 'size_available': 925876686848, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187083, 'block_size': 4096, 'inode_available': 60867893}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226044113, "block_size": 4096, "block_total": 240095108, "block_used": 14050995, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867893, "inode_total": 61054976, "inode_used": 187083, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925876686848, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:03.988 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:03 +0000 (0:00:00.047) 0:02:37.713 ******* 2021-12-17T18:14:03.995 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:03.997 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.026 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:04 +0000 (0:00:00.038) 0:02:37.751 ******* 2021-12-17T18:14:04.034 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-12-17T18:14:04.036 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.061 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:04 +0000 (0:00:00.034) 0:02:37.785 ******* 2021-12-17T18:14:04.069 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.094 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:04 +0000 (0:00:00.034) 0:02:37.819 ******* 2021-12-17T18:14:04.101 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:04.102 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2sNhA4eFGcjaQdh4ioExPSNiHXtYEm1BO'], 'uuids': ['ac273a06-151e-4771-b138-45699aef5ace']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.117194", "end": "2021-12-17 18:14:03.825901", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2sNhA4eFGcjaQdh4ioExPSNiHXtYEm1BO"], "labels": [], "masters": [], "uuids": ["ac273a06-151e-4771-b138-45699aef5ace"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:03.708707", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.112195 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.112195 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:04.104 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.106 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.106 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.131 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:04 +0000 (0:00:00.037) 0:02:37.857 ******* 2021-12-17T18:14:04.139 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-12-17T18:14:04.141 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.165 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:04 +0000 (0:00:00.034) 0:02:37.891 ******* 2021-12-17T18:14:04.172 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:04.174 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.198 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:04 +0000 (0:00:00.032) 0:02:37.924 ******* 2021-12-17T18:14:04.206 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-12-17T18:14:04.208 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.232 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:04 +0000 (0:00:00.033) 0:02:37.957 ******* 2021-12-17T18:14:04.240 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.267 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:04 +0000 (0:00:00.034) 0:02:37.992 ******* 2021-12-17T18:14:04.275 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:14:04.276 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN3XjE4qKLLSBe1sdykbMbEtudW1vqsZ7R1'], 'uuids': ['4151fb6d-948a-427d-9446-5a1e3f34d9c0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.240151", "end": "2021-12-17 18:14:04.225259", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN3XjE4qKLLSBe1sdykbMbEtudW1vqsZ7R1"], "labels": [], "masters": [], "uuids": ["4151fb6d-948a-427d-9446-5a1e3f34d9c0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:02.985108", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:14:04.278 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.279 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.301 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-12-17T18:14:04.303 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.328 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:04 +0000 (0:00:00.061) 0:02:38.054 ******* 2021-12-17T18:14:04.343 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:04.345 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2eXMMbBEBJTWvjbDG8tA8Ac4KxnS27nfO'], 'uuids': ['5067ab4d-45c5-46d0-bee5-30266aa26813']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.116533", "end": "2021-12-17 18:14:04.088500", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2eXMMbBEBJTWvjbDG8tA8Ac4KxnS27nfO"], "labels": [], "masters": [], "uuids": ["5067ab4d-45c5-46d0-bee5-30266aa26813"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:03.971967", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.111782 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.111782 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:04.346 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLCL', 'wwn-0x5000c50092940704'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], ' 2021-12-17T18:14:04.348 INFO:teuthology.task.ansible.out:labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLCL-part1', 'wwn-0x5000c50092940704-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092940704', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XLCL', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLCL", "wwn-0x5000c50092940704"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLCL-part1", "wwn-0x5000c50092940704-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XLCL", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092940704"}}, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:14:04.348 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-e2L8Sk-pN0J-cile 2021-12-17T18:14:04.350 INFO:teuthology.task.ansible.out:-491n-qZ0D-SCft-0Sf0A4', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204016X400BGN', 'nvme-nvme.8086-50484654363230343031365834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.185757", "end": "2021-12-17 18:14:04.316294", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-e2L8Sk-pN0J-cile-491n-qZ0D-SCft-0Sf0A4", "nvme-INTEL_SSDPEDMD400G4_PHFT6204016X400BGN", "nvme-nvme.8086-50484654363230343031365834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:03.130537", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:14:04.361 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.362 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.364 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.389 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:04 +0000 (0:00:00.060) 0:02:38.115 ******* 2021-12-17T18:14:04.514 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:04.515 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-ywqB7b-6MoY-J3GE-Afov-AGle-Ci50-RHYglc', 'nvme-INTEL_SSDPED1D480GA_PHMB7475005A480DGN', 'nvme-nvme.8086-50484d42373437353030354134383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.051449", "end": "2021-12-17 18:14:04.274958", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-ywqB7b-6MoY-J3GE-Afov-AGle-Ci50-RHYglc", "nvme-INTEL_SSDPED1D480GA_PHMB7475005A480DGN", "nvme-nvme.8086-50484d42373437353030354134383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:04.223509", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.046752 s, 2.5 GB/s", "stderr_lines": ["1 2021-12-17T18:14:04.517 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.046752 s, 2.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:04.526 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.538 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.779 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2BkJxBWgbA2p0PsK8Stf1iVxfb449eBUl'], 'uuids': ['2c29a032-ab3e-41c7-9215-479c36f3dabd']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.114304", "end": "2021-12-17 18:14:04.533440", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2BkJxBWgbA2p0PsK8Stf1iVxfb449eBUl"], "labels": [], "masters": [], "uuids": ["2c29a032-ab3e-41c7-9215-479c36f3dabd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:04.419136", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.109575 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.109575 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:04.781 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:04.792 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:05.002 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-12-17T18:14:05.004 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-12-17T18:14:05.032 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:05 +0000 (0:00:00.642) 0:02:38.757 ******* 2021-12-17T18:14:05.041 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:05.042 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2vRq05DIenc52ARBsaOfJ0gPZl89nMcx2'], 'uuids': ['1108a7f9-7d60-454c-bb67-e841f227cb54']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.117639", "end": "2021-12-17 18:14:04.791582", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2vRq05DIenc52ARBsaOfJ0gPZl89nMcx2"], "labels": [], "masters": [], "uuids": ["1108a7f9-7d60-454c-bb67-e841f227cb54"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:04.673943", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.112948 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.112948 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:05.043 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:05.055 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-12-17T18:14:05.057 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-12-17T18:14:05.082 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:05 +0000 (0:00:00.050) 0:02:38.808 ******* 2021-12-17T18:14:05.283 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:05.284 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2XNGW2QghaE3nS8ReJztcU9YWOrPLGFQA'], 'uuids': ['e2e3b510-838a-4377-a349-97a0e418c14c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.115416", "end": "2021-12-17 18:14:05.042258", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-60HlEY1Nm4QtvWnPHXmyMrLBqJdUgNr2XNGW2QghaE3nS8ReJztcU9YWOrPLGFQA"], "labels": [], "masters": [], "uuids": ["e2e3b510-838a-4377-a349-97a0e418c14c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:04.926842", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.111442 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.111442 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:05.319 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:05 +0000 (0:00:00.236) 0:02:39.045 ******* 2021-12-17T18:14:05.518 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:14:05.521 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN3XeagUNNPDseHkHEO63vasQ5KHp6AuBLZ'], 'uuids': ['ab970160-30e6-40c6-9631-c96edcebd013']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.111688", "end": "2021-12-17 18:14:05.488209", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN3XeagUNNPDseHkHEO63vasQ5KHp6AuBLZ"], "labels": [], "masters": [], "uuids": ["ab970160-30e6-40c6-9631-c96edcebd013"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:04.376521", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi192.front 2021-12-17T18:14:05.523 INFO:teuthology.task.ansible.out:.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:05.626 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-12-17T18:14:05.628 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.149972", "end": "2021-12-17 18:14:05.371554", "rc": 0, "start": "2021-12-17 18:14:05.221582", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:05.651 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:05 +0000 (0:00:00.331) 0:02:39.376 ******* 2021-12-17T18:14:05.659 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:14:05.660 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrEE4w4WO9TbkwrpSpCaFLHmlzdQQnLo9gJ'], 'uuids': ['490a6df0-2ea0-48a3-8f39-28d059e8094f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.159407", "end": "2021-12-17 18:14:05.622488", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrEE4w4WO9TbkwrpSpCaFLHmlzdQQnLo9gJ"], "labels": [], "masters": [], "uuids": ["490a6df0-2ea0-48a3-8f39-28d059e8094f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:04.463081", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:14:05.662 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:05.674 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:05.696 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:05.697 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:05.728 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:05.887 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-12-17T18:14:05.889 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.095522", "end": "2021-12-17 18:14:05.648568", "rc": 0, "start": "2021-12-17 18:14:05.553046", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:05.911 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:05 +0000 (0:00:00.259) 0:02:39.636 ******* 2021-12-17T18:14:05.939 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-12-17T18:14:05.965 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:05 +0000 (0:00:00.054) 0:02:39.691 ******* 2021-12-17T18:14:05.993 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-12-17T18:14:05.995 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:06.020 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:06 +0000 (0:00:00.054) 0:02:39.745 ******* 2021-12-17T18:14:06.048 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-12-17T18:14:06.049 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:06.072 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:06 +0000 (0:00:00.051) 0:02:39.797 ******* 2021-12-17T18:14:06.100 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-12-17T18:14:06.101 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:06.126 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:06 +0000 (0:00:00.054) 0:02:39.852 ******* 2021-12-17T18:14:06.134 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:06.135 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:06.157 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:06.185 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:06 +0000 (0:00:00.058) 0:02:39.910 ******* 2021-12-17T18:14:06.328 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-12-17T18:14:06.330 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:14:06.353 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:06 +0000 (0:00:00.168) 0:02:40.078 ******* 2021-12-17T18:14:06.391 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-12-17T18:14:06.393 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'block_used': 14050989, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226044119, 'size_available': 925876711424, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187083, 'block_size': 4096, 'inode_available': 60867893}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226044119, "block_size": 4096, "block_total": 240095108, "block_used": 14050989, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867893, "inode_total": 61054976, "inode_used": 187083, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925876711424, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:06.416 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:06 +0000 (0:00:00.063) 0:02:40.142 ******* 2021-12-17T18:14:06.444 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-12-17T18:14:06.446 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:06.468 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:06 +0000 (0:00:00.051) 0:02:40.194 ******* 2021-12-17T18:14:06.476 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:06.478 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:06.499 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:06.523 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:06 +0000 (0:00:00.055) 0:02:40.249 ******* 2021-12-17T18:14:06.531 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:06.533 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:06.554 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:06.578 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:06 +0000 (0:00:00.054) 0:02:40.303 ******* 2021-12-17T18:14:06.604 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-12-17T18:14:06.606 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:06.628 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:06 +0000 (0:00:00.050) 0:02:40.354 ******* 2021-12-17T18:14:06.656 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-12-17T18:14:06.658 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:06.680 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:06 +0000 (0:00:00.051) 0:02:40.405 ******* 2021-12-17T18:14:06.707 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-12-17T18:14:06.709 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:06.731 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:06 +0000 (0:00:00.051) 0:02:40.457 ******* 2021-12-17T18:14:06.759 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:14:06.761 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN34VUlM37mLYEcLid3TNVFgpGysKqcTGmq'], 'uuids': ['3ea69aa4-7672-42f0-a69a-725b4816f71f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.111121", "end": "2021-12-17 18:14:06.738323", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN34VUlM37mLYEcLid3TNVFgpGysKqcTGmq"], "labels": [], "masters": [], "uuids": ["3ea69aa4-7672-42f0-a69a-725b4816f71f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:05.627202", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:14:06.806 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:06 +0000 (0:00:00.074) 0:02:40.531 ******* 2021-12-17T18:14:06.846 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:06.848 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:06.868 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:06.870 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:06.932 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:06.934 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrEyDhvEaICENDbYjKAnqVGINUhTbaMQm5E'], 'uuids': ['2561190e-18d5-4e89-8264-abbcd5e6f413']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.139335", "end": "2021-12-17 18:14:06.906009", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrEyDhvEaICENDbYjKAnqVGINUhTbaMQm5E"], "labels": [], "masters": [], "uuids": ["2561190e-18d5-4e89-8264-abbcd5e6f413"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:05.766674", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using f 2021-12-17T18:14:06.936 INFO:teuthology.task.ansible.out:disk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:14:06.945 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:07.186 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:07.188 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN3YPJ4xAp760gBjizP48AQVDnNCjHlQhwX'], 'uuids': ['39b2c767-7e20-4f6d-a7a4-a4d7c6031c73']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.170890", "end": "2021-12-17 18:14:07.149527", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN3YPJ4xAp760gBjizP48AQVDnNCjHlQhwX"], "labels": [], "masters": [], "uuids": ["39b2c767-7e20-4f6d-a7a4-a4d7c6031c73"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:06.978637", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.165821 s, 696 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.165821 s, 696 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 2021-12-17T18:14:07.190 INFO:teuthology.task.ansible.out:'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:07.233 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:07.234 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:07.261 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:07 +0000 (0:00:00.455) 0:02:40.987 ******* 2021-12-17T18:14:07.269 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-12-17T18:14:07.271 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-12-17T18:14:07.298 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:07 +0000 (0:00:00.036) 0:02:41.023 ******* 2021-12-17T18:14:07.317 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:07.318 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:07.345 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:07 +0000 (0:00:00.047) 0:02:41.071 ******* 2021-12-17T18:14:07.410 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-12-17T18:14:07.411 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-12-17T18:14:07.437 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:07 +0000 (0:00:00.091) 0:02:41.162 ******* 2021-12-17T18:14:07.477 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:07.478 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN3m9p7Llb7J7Hgyd0zZ1kxYX7h8wXfpgAK'], 'uuids': ['4aa39260-0453-4f57-bf25-a5eb18270bff']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.161567", "end": "2021-12-17 18:14:07.455865", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN3m9p7Llb7J7Hgyd0zZ1kxYX7h8wXfpgAK"], "labels": [], "masters": [], "uuids": ["4aa39260-0453-4f57-bf25-a5eb18270bff"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:07.294298", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156501 s, 737 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156501 s, 737 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:07.490 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLLK', 'wwn-0x5000c50092939e0b'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLLK-part1', 'wwn-0x5000c50092939e0b-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092939e0b', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XLLK', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLLK", "wwn-0x5000c50092939e0b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLLK-part1", "wwn-0x5000c50092939e0b-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XLLK", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092939e0b"}}, 2021-12-17T18:14:07.491 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-12-17T18:14:07.517 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:07 +0000 (0:00:00.080) 0:02:41.243 ******* 2021-12-17T18:14:07.599 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-12-17T18:14:07.601 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:07.676 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:07.677 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:07.678 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-kdQqyF-jNa1-MbhD-HZzK-e4aR-0nF2-QuaHRB', 'nvme-INTEL_SSDPEDMD400G4_PHFT620500NN400BGN', 'nvme-nvme.8086-504846543632303530304e4e34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.058984", "end": "2021-12-17 18:14:07.651485", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-kdQqyF-jNa1-MbhD-HZzK-e4aR-0nF2-QuaHRB", "nvme-INTEL_SSDPEDMD400G4_PHFT620500NN400BGN", "nvme-nvme.8086-504846543632303530304e4e34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:07.592501", "stderr": "110+0 records in\n110+0 2021-12-17T18:14:07.679 INFO:teuthology.task.ansible.out: records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0539308 s, 2.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0539308 s, 2.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:07.690 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:07.701 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:07.713 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-12-17T18:14:07.714 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:07.745 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:07.747 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:07.799 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-12-17T18:14:07.801 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:07.832 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:07.918 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:07.951 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:07.962 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:07.990 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:07 +0000 (0:00:00.472) 0:02:41.715 ******* 2021-12-17T18:14:08.008 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:08.010 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN3XjE4qKLLSBe1sdykbMbEtudW1vqsZ7R1'], 'uuids': ['4151fb6d-948a-427d-9446-5a1e3f34d9c0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.161400", "end": "2021-12-17 18:14:07.976676", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN3XjE4qKLLSBe1sdykbMbEtudW1vqsZ7R1"], "labels": [], "masters": [], "uuids": ["4151fb6d-948a-427d-9446-5a1e3f34d9c0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:07.815276", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156431 s, 737 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156431 s, 737 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:08.011 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 's 2021-12-17T18:14:08.012 INFO:teuthology.task.ansible.out:ize': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:08.022 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:08.023 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-12-17T18:14:08.023 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:08.049 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:08 +0000 (0:00:00.058) 0:02:41.774 ******* 2021-12-17T18:14:08.056 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-12-17T18:14:08.058 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:08.085 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:08 +0000 (0:00:00.036) 0:02:41.811 ******* 2021-12-17T18:14:08.093 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-12-17T18:14:08.095 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:08.124 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:08 +0000 (0:00:00.038) 0:02:41.849 ******* 2021-12-17T18:14:08.132 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:08.134 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Create filesystems] ******************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:08.159 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:08 +0000 (0:00:00.035) 0:02:41.885 ******* 2021-12-17T18:14:08.187 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-12-17T18:14:08.189 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:08.212 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:08 +0000 (0:00:00.052) 0:02:41.938 ******* 2021-12-17T18:14:08.221 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-12-17T18:14:08.221 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrEwPNpCRad2YY7Gk4X3S8Lk0ejzCUkVt58'], 'uuids': ['5ef3a51e-7c13-4311-900e-d31ca66da9d6']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.140420", "end": "2021-12-17 18:14:08.187219", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrEwPNpCRad2YY7Gk4X3S8Lk0ejzCUkVt58"], "labels": [], "masters": [], "uuids": ["5ef3a51e-7c13-4311-900e-d31ca66da9d6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:07.046799", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-12-17T18:14:08.270 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:08 +0000 (0:00:00.057) 0:02:41.995 ******* 2021-12-17T18:14:08.279 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-12-17T18:14:08.281 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:08.309 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:08 +0000 (0:00:00.038) 0:02:42.034 ******* 2021-12-17T18:14:08.317 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:08.319 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN3XeagUNNPDseHkHEO63vasQ5KHp6AuBLZ'], 'uuids': ['ab970160-30e6-40c6-9631-c96edcebd013']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.162070", "end": "2021-12-17 18:14:08.282257", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN3XeagUNNPDseHkHEO63vasQ5KHp6AuBLZ"], "labels": [], "masters": [], "uuids": ["ab970160-30e6-40c6-9631-c96edcebd013"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:08.120187", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157036 s, 735 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157036 s, 735 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:08.330 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:08.332 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:08.343 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-12-17T18:14:08.345 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-12-17T18:14:08.369 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:08 +0000 (0:00:00.060) 0:02:42.095 ******* 2021-12-17T18:14:08.377 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-12-17T18:14:08.379 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:08.405 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:08 +0000 (0:00:00.035) 0:02:42.130 ******* 2021-12-17T18:14:08.444 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-12-17T18:14:08.469 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:08 +0000 (0:00:00.063) 0:02:42.194 ******* 2021-12-17T18:14:08.509 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:08.511 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:08.607 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:08.609 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN34VUlM37mLYEcLid3TNVFgpGysKqcTGmq'], 'uuids': ['3ea69aa4-7672-42f0-a69a-725b4816f71f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.163161", "end": "2021-12-17 18:14:08.583463", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-eWuOOqM8Us1hE4TRTxwKs5btF6uQjQN34VUlM37mLYEcLid3TNVFgpGysKqcTGmq"], "labels": [], "masters": [], "uuids": ["3ea69aa4-7672-42f0-a69a-725b4816f71f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:08.420302", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158176 s, 729 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158176 s, 729 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:08.627 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrE8yA234JvNG7k6EuNCipFhGNSFDQVWiDp'], 'uuids': ['ff893468-9870-498d-bd70-369e22ed5250']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.160542", "end": "2021-12-17 18:14:08.585408", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrE8yA234JvNG7k6EuNCipFhGNSFDQVWiDp"], "labels": [], "masters": [], "uuids": ["ff893468-9870-498d-bd70-369e22ed5250"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:08.424866", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155549 s, 742 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155549 s, 742 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:08.653 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:08 +0000 (0:00:00.183) 0:02:42.378 ******* 2021-12-17T18:14:08.659 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:08.661 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:08.875 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-12-17T18:14:08.877 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true} changed: [smithi125.front.sepia.ceph.com] => {"changed": true} 2021-12-17T18:14:08.906 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:08 +0000 (0:00:00.253) 0:02:42.631 ******* 2021-12-17T18:14:08.932 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:08 +0000 (0:00:00.025) 0:02:42.657 ******* 2021-12-17T18:14:08.943 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:08.945 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi192.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.119239", "end": "2021-12-17 18:14:08.891117", "rc": 0, "start": "2021-12-17 18:14:08.771878", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:08.946 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrEGODlfSeA9UuEZzRagaUnUjhHA970YIvx'], 'uuids': ['b94233a6-918b-49bf-a18f-07633dc1a38d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.172997", "end": "2021-12-17 18:14:08.912822", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrEGODlfSeA9UuEZzRagaUnUjhHA970YIvx"], "labels": [], "masters": [], "uuids": ["b94233a6-918b-49bf-a18f-07633dc1a38d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:08.739825", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.16803 s, 686 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.16803 s, 686 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:08.948 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QPMH', 'wwn-0x5000c50091e0bc82'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QPMH-part1', 'wwn-0x5000c50091e0bc82-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e0bc82', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QPMH', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QPMH", "wwn-0x5000c50091e0bc82"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QPMH-part1", "wwn-0x5000c50091e0bc82-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QPMH", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e0bc82"}}, 2021-12-17T18:14:08.950 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-12-17T18:14:08.975 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:08 +0000 (0:00:00.043) 0:02:42.700 ******* 2021-12-17T18:14:09.134 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-e2L8Sk-pN0J-cile-491n-qZ0D-SCft-0Sf0A4', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204016X400BGN', 'nvme-nvme.8086-50484654363230343031365834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.058905", "end": "2021-12-17 18:14:09.111018", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-e2L8Sk-pN0J-cile-491n-qZ0D-SCft-0Sf0A4", "nvme-INTEL_SSDPEDMD400G4_PHFT6204016X400BGN", "nvme-nvme.8086-50484654363230343031365834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:09.052113", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0540122 s, 2.1 GB/s", "std 2021-12-17T18:14:09.136 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0540122 s, 2.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:09.147 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:09.148 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:09.213 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-12-17T18:14:09.215 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.099168", "end": "2021-12-17 18:14:09.200170", "rc": 0, "start": "2021-12-17 18:14:09.101002", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:09.243 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.268) 0:02:42.969 ******* 2021-12-17T18:14:09.274 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-12-17T18:14:09.301 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.057) 0:02:43.026 ******* 2021-12-17T18:14:09.308 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:09.309 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:09.338 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.037) 0:02:43.063 ******* 2021-12-17T18:14:09.345 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-12-17T18:14:09.347 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:09.377 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.038) 0:02:43.102 ******* 2021-12-17T18:14:09.383 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-12-17T18:14:09.385 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-12-17T18:14:09.411 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.034) 0:02:43.136 ******* 2021-12-17T18:14:09.432 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.021) 0:02:43.157 ******* 2021-12-17T18:14:09.439 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-12-17T18:14:09.440 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:09.465 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.032) 0:02:43.190 ******* 2021-12-17T18:14:09.494 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.029) 0:02:43.220 ******* 2021-12-17T18:14:09.502 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:09.503 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrEE4w4WO9TbkwrpSpCaFLHmlzdQQnLo9gJ'], 'uuids': ['490a6df0-2ea0-48a3-8f39-28d059e8094f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.163016", "end": "2021-12-17 18:14:09.419675", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrEE4w4WO9TbkwrpSpCaFLHmlzdQQnLo9gJ"], "labels": [], "masters": [], "uuids": ["490a6df0-2ea0-48a3-8f39-28d059e8094f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:09.256659", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157912 s, 730 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157912 s, 730 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:09.504 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:09.506 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:09.508 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-12-17T18:14:09.508 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:09.532 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.037) 0:02:43.257 ******* 2021-12-17T18:14:09.555 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.023) 0:02:43.280 ******* 2021-12-17T18:14:09.578 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.022) 0:02:43.303 ******* 2021-12-17T18:14:09.584 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-12-17T18:14:09.586 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:09.612 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.034) 0:02:43.337 ******* 2021-12-17T18:14:09.635 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.022) 0:02:43.360 ******* 2021-12-17T18:14:09.669 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.034) 0:02:43.395 ******* 2021-12-17T18:14:09.676 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-12-17T18:14:09.678 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:09.703 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.034) 0:02:43.429 ******* 2021-12-17T18:14:09.726 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.022) 0:02:43.451 ******* 2021-12-17T18:14:09.735 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:09.762 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.036) 0:02:43.487 ******* 2021-12-17T18:14:09.770 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-12-17T18:14:09.771 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:09.773 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:09.775 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrEyDhvEaICENDbYjKAnqVGINUhTbaMQm5E'], 'uuids': ['2561190e-18d5-4e89-8264-abbcd5e6f413']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.161851", "end": "2021-12-17 18:14:09.729008", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrEyDhvEaICENDbYjKAnqVGINUhTbaMQm5E"], "labels": [], "masters": [], "uuids": ["2561190e-18d5-4e89-8264-abbcd5e6f413"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:09.567157", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156969 s, 735 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156969 s, 735 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:09.776 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'remov 2021-12-17T18:14:09.778 INFO:teuthology.task.ansible.out:able': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:09.802 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.040) 0:02:43.528 ******* 2021-12-17T18:14:09.865 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-12-17T18:14:09.867 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} TASK [testnode : Write /scratch_devs] ****************************************** 2021-12-17T18:14:09.868 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:09.897 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.094) 0:02:43.622 ******* 2021-12-17T18:14:09.905 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-12-17T18:14:09.907 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:14:09.941 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.044) 0:02:43.667 ******* 2021-12-17T18:14:09.961 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-12-17T18:14:09.963 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-12-17T18:14:09.989 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:09 +0000 (0:00:00.047) 0:02:43.714 ******* 2021-12-17T18:14:09.998 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-12-17T18:14:10.000 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'block_used': 14050990, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226044118, 'size_available': 925876707328, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187083, 'block_size': 4096, 'inode_available': 60867893}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226044118, "block_size": 4096, "block_total": 240095108, "block_used": 14050990, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867893, "inode_total": 61054976, "inode_used": 187083, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925876707328, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:10.001 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:10.029 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.040) 0:02:43.754 ******* 2021-12-17T18:14:10.046 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-12-17T18:14:10.048 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:10.072 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.043) 0:02:43.798 ******* 2021-12-17T18:14:10.081 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-12-17T18:14:10.082 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrEwPNpCRad2YY7Gk4X3S8Lk0ejzCUkVt58'], 'uuids': ['5ef3a51e-7c13-4311-900e-d31ca66da9d6']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.163029", "end": "2021-12-17 18:14:10.029531", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-m5Zca7FNhUTx9VSAw9mRfs9mHU8ySQrEwPNpCRad2YY7Gk4X3S8Lk0ejzCUkVt58"], "labels": [], "masters": [], "uuids": ["5ef3a51e-7c13-4311-900e-d31ca66da9d6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-12-17 18:14:09.866502", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158238 s, 729 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158238 s, 729 MB/s"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:10.094 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-12-17T18:14:10.096 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:10.121 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.048) 0:02:43.846 ******* 2021-12-17T18:14:10.147 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.026) 0:02:43.873 ******* 2021-12-17T18:14:10.155 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-12-17T18:14:10.156 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:10.158 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:10.162 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-12-17T18:14:10.163 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:10.188 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.040) 0:02:43.913 ******* 2021-12-17T18:14:10.211 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.022) 0:02:43.936 ******* 2021-12-17T18:14:10.219 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:10.221 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:10.246 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.035) 0:02:43.972 ******* 2021-12-17T18:14:10.253 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-12-17T18:14:10.255 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:10.279 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.033) 0:02:44.005 ******* 2021-12-17T18:14:10.287 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:10.288 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:10.317 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.038) 0:02:44.043 ******* 2021-12-17T18:14:10.325 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-12-17T18:14:10.326 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:10.352 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.034) 0:02:44.077 ******* 2021-12-17T18:14:10.358 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-12-17T18:14:10.360 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:10.385 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.033) 0:02:44.111 ******* 2021-12-17T18:14:10.413 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-12-17T18:14:10.415 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.137122", "end": "2021-12-17 18:14:10.376091", "rc": 0, "start": "2021-12-17 18:14:10.238969", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:10.440 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.054) 0:02:44.165 ******* 2021-12-17T18:14:10.464 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.023) 0:02:44.189 ******* 2021-12-17T18:14:10.472 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-12-17T18:14:10.473 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-12-17T18:14:10.500 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.036) 0:02:44.225 ******* 2021-12-17T18:14:10.508 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-12-17T18:14:10.509 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:10.536 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.036) 0:02:44.262 ******* 2021-12-17T18:14:10.560 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.023) 0:02:44.286 ******* 2021-12-17T18:14:10.568 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-12-17T18:14:10.570 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-12-17T18:14:10.595 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.034) 0:02:44.321 ******* 2021-12-17T18:14:10.604 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-12-17T18:14:10.606 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-12-17T18:14:10.631 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.035) 0:02:44.357 ******* 2021-12-17T18:14:10.670 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-12-17T18:14:10.672 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.087715", "end": "2021-12-17 18:14:10.641114", "rc": 0, "start": "2021-12-17 18:14:10.553399", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:10.696 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.065) 0:02:44.422 ******* 2021-12-17T18:14:10.724 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-12-17T18:14:10.751 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.054) 0:02:44.476 ******* 2021-12-17T18:14:10.779 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-12-17T18:14:10.780 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:10.814 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.063) 0:02:44.539 ******* 2021-12-17T18:14:10.833 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-12-17T18:14:10.835 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true} 2021-12-17T18:14:10.869 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.055) 0:02:44.595 ******* 2021-12-17T18:14:10.879 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-12-17T18:14:10.881 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:10.881 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-12-17T18:14:10.882 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-12-17T18:14:10.911 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.041) 0:02:44.636 ******* 2021-12-17T18:14:10.940 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.028) 0:02:44.665 ******* 2021-12-17T18:14:10.959 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-12-17T18:14:10.985 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:10 +0000 (0:00:00.045) 0:02:44.710 ******* 2021-12-17T18:14:10.993 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-12-17T18:14:10.995 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:11.026 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.040) 0:02:44.751 ******* 2021-12-17T18:14:11.056 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-12-17T18:14:11.058 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:11.086 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.060) 0:02:44.811 ******* 2021-12-17T18:14:11.094 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-12-17T18:14:11.096 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-12-17T18:14:11.097 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-12-17T18:14:11.126 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.039) 0:02:44.851 ******* 2021-12-17T18:14:11.149 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.023) 0:02:44.875 ******* 2021-12-17T18:14:11.156 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-12-17T18:14:11.158 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:11.184 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.035) 0:02:44.910 ******* 2021-12-17T18:14:11.212 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:11.236 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.051) 0:02:44.962 ******* 2021-12-17T18:14:11.246 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-12-17T18:14:11.248 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-12-17T18:14:11.274 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.037) 0:02:44.999 ******* 2021-12-17T18:14:11.281 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-12-17T18:14:11.283 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:11.315 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.040) 0:02:45.040 ******* 2021-12-17T18:14:11.333 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-12-17T18:14:11.335 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'block_used': 14050990, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226044118, 'size_available': 925876707328, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187083, 'block_size': 4096, 'inode_available': 60867893}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226044118, "block_size": 4096, "block_total": 240095108, "block_used": 14050990, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867893, "inode_total": 61054976, "inode_used": 187083, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925876707328, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:11.359 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.043) 0:02:45.084 ******* 2021-12-17T18:14:11.366 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-12-17T18:14:11.368 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:11.393 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.033) 0:02:45.118 ******* 2021-12-17T18:14:11.399 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-12-17T18:14:11.401 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:11.427 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.034) 0:02:45.152 ******* 2021-12-17T18:14:11.455 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:11.457 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:11.479 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.052) 0:02:45.205 ******* 2021-12-17T18:14:11.508 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:11.510 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:11.533 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.053) 0:02:45.258 ******* 2021-12-17T18:14:11.555 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-12-17T18:14:11.556 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-12-17T18:14:11.589 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.055) 0:02:45.314 ******* 2021-12-17T18:14:11.596 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-12-17T18:14:11.598 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:11.625 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.035) 0:02:45.349 ******* 2021-12-17T18:14:11.632 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:11.633 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:14:11.666 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.042) 0:02:45.392 ******* 2021-12-17T18:14:11.681 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-12-17T18:14:11.682 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi125.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:14:11.718 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.051) 0:02:45.443 ******* 2021-12-17T18:14:11.743 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.025) 0:02:45.468 ******* 2021-12-17T18:14:11.753 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-12-17T18:14:11.755 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:11.783 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.040) 0:02:45.508 ******* 2021-12-17T18:14:11.818 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.034) 0:02:45.543 ******* 2021-12-17T18:14:11.954 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-12-17T18:14:11.956 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.125998", "end": "2021-12-17 18:14:11.928652", "rc": 0, "start": "2021-12-17 18:14:11.802654", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-12-17T18:14:11.980 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:11 +0000 (0:00:00.161) 0:02:45.705 ******* 2021-12-17T18:14:12.010 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-12-17T18:14:12.011 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:12.034 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:12 +0000 (0:00:00.054) 0:02:45.759 ******* 2021-12-17T18:14:12.042 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:12.044 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:12.064 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:12.088 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:12 +0000 (0:00:00.053) 0:02:45.813 ******* 2021-12-17T18:14:12.169 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-12-17T18:14:12.171 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-12-17T18:14:12.197 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:12 +0000 (0:00:00.108) 0:02:45.922 ******* 2021-12-17T18:14:12.299 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-12-17T18:14:12.301 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.406369", "end": "2021-12-17 18:14:12.274321", "rc": 0, "start": "2021-12-17 18:14:11.867952", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-12-17T18:14:12.325 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:12 +0000 (0:00:00.128) 0:02:46.051 ******* 2021-12-17T18:14:12.335 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-12-17T18:14:12.336 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-12-17T18:14:12.363 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:12 +0000 (0:00:00.037) 0:02:46.088 ******* 2021-12-17T18:14:12.371 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-12-17T18:14:12.372 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:12.398 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:12 +0000 (0:00:00.035) 0:02:46.123 ******* 2021-12-17T18:14:12.428 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:12.430 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:12.453 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:12 +0000 (0:00:00.055) 0:02:46.178 ******* 2021-12-17T18:14:12.545 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-12-17T18:14:12.547 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-12-17T18:14:12.571 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:12 +0000 (0:00:00.118) 0:02:46.297 ******* 2021-12-17T18:14:12.789 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-12-17T18:14:12.791 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:14:12.815 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:12 +0000 (0:00:00.243) 0:02:46.540 ******* 2021-12-17T18:14:12.823 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:12.825 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:12.846 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-12-17T18:14:12.847 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:12.877 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:12 +0000 (0:00:00.061) 0:02:46.602 ******* 2021-12-17T18:14:12.884 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:12.885 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:13.138 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-12-17T18:14:13.140 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:14:13.164 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:13 +0000 (0:00:00.287) 0:02:46.890 ******* 2021-12-17T18:14:13.204 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-12-17T18:14:13.206 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:13.228 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:13 +0000 (0:00:00.063) 0:02:46.953 ******* 2021-12-17T18:14:13.235 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-12-17T18:14:13.237 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-12-17T18:14:13.263 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:13 +0000 (0:00:00.035) 0:02:46.989 ******* 2021-12-17T18:14:13.271 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:13.273 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:13.275 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:13.276 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-12-17T18:14:13.276 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:14:13.303 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:13 +0000 (0:00:00.039) 0:02:47.028 ******* 2021-12-17T18:14:13.327 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:13 +0000 (0:00:00.023) 0:02:47.052 ******* 2021-12-17T18:14:13.333 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-12-17T18:14:13.334 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:13.362 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:13 +0000 (0:00:00.034) 0:02:47.087 ******* 2021-12-17T18:14:13.477 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-12-17T18:14:13.479 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-12-17T18:14:13.504 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:13 +0000 (0:00:00.142) 0:02:47.229 ******* 2021-12-17T18:14:13.564 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-12-17T18:14:13.566 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.110336", "end": "2021-12-17 18:14:13.319461", "rc": 0, "start": "2021-12-17 18:14:13.209125", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-12-17T18:14:13.591 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:13 +0000 (0:00:00.087) 0:02:47.317 ******* 2021-12-17T18:14:13.600 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-12-17T18:14:13.601 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:10:38 UTC", "ActiveEnterTimestampMonotonic": "14102241", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service basic.target system.slice sysinit.target -.mount network.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:10:37 UTC", "AssertTimestampMonotonic": "13887823", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:10:37 UTC", "ConditionTimestampMonotonic": "13887822", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-12-17T18:14:13.603 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "830", "ExecMainStartTimestamp": "Fri 2021-12-17 18:10:38 UTC", "ExecMainStartTimestampMonotonic": "14102218", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-12-17 18:10:37 UTC", "InactiveExitTimestampMonotonic": "13888738", "InvocationID": "e8f9497cc0364a48801c1aba0ff4a264", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-12-17T18:14:13.605 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "830", "MemoryAccounting": "yes", "MemoryCurrent": "3846144", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "Requi 2021-12-17T18:14:13.606 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:10:38 UTC", "StateChangeTimestampMonotonic": "14102241", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38332", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": 2021-12-17T18:14:13.608 INFO:teuthology.task.ansible.out: "file", "uid": 0} 2021-12-17T18:14:13.634 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:13 +0000 (0:00:00.042) 0:02:47.360 ******* 2021-12-17T18:14:13.663 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:13 +0000 (0:00:00.029) 0:02:47.389 ******* 2021-12-17T18:14:13.672 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:13.673 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:13.674 INFO:teuthology.task.ansible.out: 2021-12-17T18:14:13.678 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-12-17T18:14:13.678 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:13.680 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} TASK [testnode : Write /scratch_devs] ****************************************** 2021-12-17T18:14:13.680 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:13.865 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:13 +0000 (0:00:00.202) 0:02:47.591 ******* 2021-12-17T18:14:13.890 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:13 +0000 (0:00:00.024) 0:02:47.616 ******* 2021-12-17T18:14:13.900 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-12-17T18:14:13.902 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:13.927 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:13 +0000 (0:00:00.036) 0:02:47.652 ******* 2021-12-17T18:14:13.934 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:13.936 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} TASK [testnode : Write /scratch_devs] ****************************************** 2021-12-17T18:14:13.936 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:13.938 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:13.963 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:13 +0000 (0:00:00.036) 0:02:47.689 ******* 2021-12-17T18:14:13.987 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:13 +0000 (0:00:00.023) 0:02:47.712 ******* 2021-12-17T18:14:14.004 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-12-17T18:14:14.006 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:14.032 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:14 +0000 (0:00:00.044) 0:02:47.757 ******* 2021-12-17T18:14:14.041 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-12-17T18:14:14.043 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:14.044 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:14.045 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-12-17T18:14:14.045 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:14.079 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:14 +0000 (0:00:00.046) 0:02:47.804 ******* 2021-12-17T18:14:14.108 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-12-17T18:14:14.109 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:14.132 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:14 +0000 (0:00:00.053) 0:02:47.858 ******* 2021-12-17T18:14:14.140 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-12-17T18:14:14.142 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:10:33 UTC", "ActiveEnterTimestampMonotonic": "13596702", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service system.slice basic.target -.mount sysinit.target systemd-journald.socket network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:10:33 UTC", "AssertTimestampMonotonic": "13464205", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:10:33 UTC", "ConditionTimestampMonotonic": "13464204", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-12-17T18:14:14.144 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "819", "ExecMainStartTimestamp": "Fri 2021-12-17 18:10:33 UTC", "ExecMainStartTimestampMonotonic": "13596689", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-12-17 18:10:33 UTC", "InactiveExitTimestampMonotonic": "13465181", "InvocationID": "a706202ecbbf46d594655f361f7b66ee", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-12-17T18:14:14.145 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127772", "LimitNPROCSoft": "127772", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127772", "LimitSIGPENDINGSoft": "127772", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "819", "MemoryAccounting": "yes", "MemoryCurrent": "3624960", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "Requi 2021-12-17T18:14:14.147 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:10:33 UTC", "StateChangeTimestampMonotonic": "13596702", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-12-17T18:14:14.169 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:14 +0000 (0:00:00.036) 0:02:47.894 ******* 2021-12-17T18:14:14.176 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-12-17T18:14:14.178 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:14.202 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:14 +0000 (0:00:00.032) 0:02:47.927 ******* 2021-12-17T18:14:14.208 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:14.210 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-12-17T18:14:14.241 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:14 +0000 (0:00:00.039) 0:02:47.966 ******* 2021-12-17T18:14:14.279 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:14.281 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-12-17T18:14:14.302 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:14 +0000 (0:00:00.061) 0:02:48.028 ******* 2021-12-17T18:14:14.329 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-12-17T18:14:14.331 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:14.353 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:14 +0000 (0:00:00.050) 0:02:48.078 ******* 2021-12-17T18:14:14.360 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-12-17T18:14:14.362 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:14.387 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:14 +0000 (0:00:00.034) 0:02:48.113 ******* 2021-12-17T18:14:14.415 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-12-17T18:14:14.417 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-12-17T18:14:14.442 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:14 +0000 (0:00:00.054) 0:02:48.167 ******* 2021-12-17T18:14:14.450 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-12-17T18:14:14.451 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-12-17T18:14:14.477 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:14 +0000 (0:00:00.035) 0:02:48.202 ******* 2021-12-17T18:14:14.589 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-12-17T18:14:14.591 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-12-17T18:14:14.615 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:14 +0000 (0:00:00.137) 0:02:48.340 ******* 2021-12-17T18:14:14.665 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-12-17T18:14:14.667 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:14:14.692 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:14 +0000 (0:00:00.076) 0:02:48.417 ******* 2021-12-17T18:14:14.722 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-12-17T18:14:14.723 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:14.747 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:14 +0000 (0:00:00.055) 0:02:48.472 ******* 2021-12-17T18:14:14.756 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-12-17T18:14:14.758 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true} 2021-12-17T18:14:14.792 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:14 +0000 (0:00:00.045) 0:02:48.518 ******* 2021-12-17T18:14:14.801 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-12-17T18:14:14.801 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:14.887 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:15.004 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:15.036 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-12-17T18:14:15.038 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-12-17T18:14:15.065 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.272) 0:02:48.790 ******* 2021-12-17T18:14:15.092 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-12-17T18:14:15.093 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:15.120 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.055) 0:02:48.846 ******* 2021-12-17T18:14:15.158 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.037) 0:02:48.883 ******* 2021-12-17T18:14:15.166 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-12-17T18:14:15.166 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-12-17T18:14:15.168 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:15.168 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:15.170 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-12-17T18:14:15.196 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.037) 0:02:48.921 ******* 2021-12-17T18:14:15.219 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.023) 0:02:48.944 ******* 2021-12-17T18:14:15.227 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-12-17T18:14:15.228 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:15.229 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:15.255 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.035) 0:02:48.980 ******* 2021-12-17T18:14:15.278 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.023) 0:02:49.004 ******* 2021-12-17T18:14:15.302 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.023) 0:02:49.027 ******* 2021-12-17T18:14:15.310 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-12-17T18:14:15.311 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:15.336 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.034) 0:02:49.061 ******* 2021-12-17T18:14:15.344 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-12-17T18:14:15.346 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:15.372 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.035) 0:02:49.097 ******* 2021-12-17T18:14:15.395 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.023) 0:02:49.121 ******* 2021-12-17T18:14:15.424 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-12-17T18:14:15.426 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:15.449 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.053) 0:02:49.174 ******* 2021-12-17T18:14:15.457 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-12-17T18:14:15.458 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:10:59 UTC", "ActiveEnterTimestampMonotonic": "14180029", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice systemd-tmpfiles-setup.service sysinit.target systemd-journald.socket -.mount network.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:10:59 UTC", "AssertTimestampMonotonic": "14051516", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:10:59 UTC", "ConditionTimestampMonotonic": "14051515", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-12-17T18:14:15.460 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "829", "ExecMainStartTimestamp": "Fri 2021-12-17 18:10:59 UTC", "ExecMainStartTimestampMonotonic": "14180016", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-12-17 18:10:59 UTC", "InactiveExitTimestampMonotonic": "14052562", "InvocationID": "0dd4b1fc14f84dd19ad8f99ed7714fea", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-12-17T18:14:15.462 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "829", "MemoryAccounting": "yes", "MemoryCurrent": "3723264", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "Requi 2021-12-17T18:14:15.463 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:10:59 UTC", "StateChangeTimestampMonotonic": "14180029", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi125.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:14:15.494 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.044) 0:02:49.219 ******* 2021-12-17T18:14:15.520 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.025) 0:02:49.244 ******* 2021-12-17T18:14:15.528 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-12-17T18:14:15.531 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:15.557 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.038) 0:02:49.283 ******* 2021-12-17T18:14:15.582 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.024) 0:02:49.307 ******* 2021-12-17T18:14:15.605 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.023) 0:02:49.331 ******* 2021-12-17T18:14:15.615 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:15.617 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-12-17T18:14:15.644 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.038) 0:02:49.370 ******* 2021-12-17T18:14:15.668 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.023) 0:02:49.393 ******* 2021-12-17T18:14:15.676 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-12-17T18:14:15.677 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-12-17T18:14:15.706 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.037) 0:02:49.431 ******* 2021-12-17T18:14:15.713 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:15.715 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-12-17T18:14:15.741 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.034) 0:02:49.466 ******* 2021-12-17T18:14:15.768 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-12-17T18:14:15.770 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:15.793 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.052) 0:02:49.518 ******* 2021-12-17T18:14:15.800 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-12-17T18:14:15.802 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-12-17T18:14:15.828 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.034) 0:02:49.553 ******* 2021-12-17T18:14:15.835 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-12-17T18:14:15.836 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:15.863 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:15 +0000 (0:00:00.034) 0:02:49.588 ******* 2021-12-17T18:14:15.973 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-12-17T18:14:15.975 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"changed": true} 2021-12-17T18:14:16.008 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:16 +0000 (0:00:00.144) 0:02:49.733 ******* 2021-12-17T18:14:16.016 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-12-17T18:14:16.018 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-12-17T18:14:16.047 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:16 +0000 (0:00:00.039) 0:02:49.772 ******* 2021-12-17T18:14:16.225 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-12-17T18:14:16.227 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-12-17T18:14:16.252 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:16 +0000 (0:00:00.204) 0:02:49.977 ******* 2021-12-17T18:14:16.259 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-12-17T18:14:16.261 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-12-17T18:14:16.287 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:16 +0000 (0:00:00.034) 0:02:50.012 ******* 2021-12-17T18:14:16.293 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-12-17T18:14:16.294 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-12-17T18:14:16.320 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:16 +0000 (0:00:00.033) 0:02:50.045 ******* 2021-12-17T18:14:16.328 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-12-17T18:14:16.330 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:16.355 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:16 +0000 (0:00:00.034) 0:02:50.080 ******* 2021-12-17T18:14:16.382 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-12-17T18:14:16.385 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:16.406 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:16 +0000 (0:00:00.051) 0:02:50.132 ******* 2021-12-17T18:14:16.434 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-12-17T18:14:16.436 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:16.458 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:16 +0000 (0:00:00.051) 0:02:50.183 ******* 2021-12-17T18:14:16.486 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:16.509 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:16 +0000 (0:00:00.051) 0:02:50.235 ******* 2021-12-17T18:14:16.590 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-12-17T18:14:16.592 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-12-17T18:14:16.617 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:16 +0000 (0:00:00.107) 0:02:50.342 ******* 2021-12-17T18:14:16.677 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-12-17T18:14:16.679 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-12-17T18:14:16.704 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:16 +0000 (0:00:00.086) 0:02:50.429 ******* 2021-12-17T18:14:16.805 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-12-17T18:14:16.807 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:14:16.831 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:16 +0000 (0:00:00.127) 0:02:50.557 ******* 2021-12-17T18:14:16.860 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-12-17T18:14:16.862 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:16.893 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:16 +0000 (0:00:00.061) 0:02:50.618 ******* 2021-12-17T18:14:16.919 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:16 +0000 (0:00:00.026) 0:02:50.645 ******* 2021-12-17T18:14:17.095 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-12-17T18:14:17.097 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-12-17T18:14:17.120 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:17 +0000 (0:00:00.200) 0:02:50.845 ******* 2021-12-17T18:14:17.241 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-12-17T18:14:17.243 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-12-17T18:14:17.268 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:17 +0000 (0:00:00.147) 0:02:50.993 ******* 2021-12-17T18:14:17.296 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-12-17T18:14:17.298 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:14:17.324 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:17 +0000 (0:00:00.055) 0:02:51.049 ******* 2021-12-17T18:14:17.553 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-12-17T18:14:17.555 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-12-17T18:14:17.581 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:17 +0000 (0:00:00.257) 0:02:51.306 ******* 2021-12-17T18:14:17.600 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-12-17T18:14:17.601 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.125650", "end": "2021-12-17 18:14:17.574161", "rc": 0, "start": "2021-12-17 18:14:17.448511", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-12-17T18:14:17.629 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:17 +0000 (0:00:00.047) 0:02:51.354 ******* 2021-12-17T18:14:17.636 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-12-17T18:14:17.638 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-12-17T18:14:17.665 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:17 +0000 (0:00:00.036) 0:02:51.390 ******* 2021-12-17T18:14:17.673 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-12-17T18:14:17.674 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:17.700 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:17 +0000 (0:00:00.035) 0:02:51.426 ******* 2021-12-17T18:14:17.728 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-12-17T18:14:17.730 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:17.754 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:17 +0000 (0:00:00.053) 0:02:51.479 ******* 2021-12-17T18:14:18.349 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-12-17T18:14:18.351 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:14:18.383 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:18 +0000 (0:00:00.628) 0:02:52.108 ******* 2021-12-17T18:14:18.444 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-12-17T18:14:18.446 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:14:18.470 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:18 +0000 (0:00:00.086) 0:02:52.195 ******* 2021-12-17T18:14:18.497 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-12-17T18:14:18.498 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:18.524 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:18 +0000 (0:00:00.053) 0:02:52.249 ******* 2021-12-17T18:14:18.542 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-12-17T18:14:18.544 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-12-17T18:14:18.570 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:18 +0000 (0:00:00.046) 0:02:52.296 ******* 2021-12-17T18:14:18.601 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-12-17T18:14:18.628 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:18 +0000 (0:00:00.057) 0:02:52.354 ******* 2021-12-17T18:14:18.658 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-12-17T18:14:18.660 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.119950", "end": "2021-12-17 18:14:18.627210", "rc": 0, "start": "2021-12-17 18:14:18.507260", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-12-17T18:14:18.685 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:18 +0000 (0:00:00.056) 0:02:52.410 ******* 2021-12-17T18:14:18.714 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-12-17T18:14:18.715 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:18.738 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:18 +0000 (0:00:00.052) 0:02:52.463 ******* 2021-12-17T18:14:18.765 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-12-17T18:14:18.766 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:18.789 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:18 +0000 (0:00:00.050) 0:02:52.514 ******* 2021-12-17T18:14:18.858 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-12-17T18:14:18.860 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-12-17T18:14:18.884 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:18 +0000 (0:00:00.095) 0:02:52.609 ******* 2021-12-17T18:14:18.911 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-12-17T18:14:18.913 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:18.935 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:18 +0000 (0:00:00.051) 0:02:52.661 ******* 2021-12-17T18:14:19.110 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-12-17T18:14:19.112 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false} 2021-12-17T18:14:19.135 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.199) 0:02:52.860 ******* 2021-12-17T18:14:19.153 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-12-17T18:14:19.155 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:10:35 UTC", "ActiveEnterTimestampMonotonic": "14027820", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target systemd-journald.socket network.target sysinit.target systemd-tmpfiles-setup.service system.slice -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:10:35 UTC", "AssertTimestampMonotonic": "13927422", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:10:35 UTC", "ConditionTimestampMonotonic": "13927420", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-12-17T18:14:19.156 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "829", "ExecMainStartTimestamp": "Fri 2021-12-17 18:10:35 UTC", "ExecMainStartTimestampMonotonic": "14027805", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-12-17 18:10:35 UTC", "InactiveExitTimestampMonotonic": "13928346", "InvocationID": "aad43f6ff3824d2ea45c5f5efc61225f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-12-17T18:14:19.162 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "829", "MemoryAccounting": "yes", "MemoryCurrent": "3727360", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "Requi 2021-12-17T18:14:19.164 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:10:35 UTC", "StateChangeTimestampMonotonic": "14027820", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-12-17T18:14:19.186 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.050) 0:02:52.911 ******* 2021-12-17T18:14:19.193 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-12-17T18:14:19.195 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi062.front.sepia.ceph.com] => {"changed": false} 2021-12-17T18:14:19.219 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.033) 0:02:52.944 ******* 2021-12-17T18:14:19.241 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.022) 0:02:52.967 ******* 2021-12-17T18:14:19.248 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:19.250 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} TASK [testnode : Set interface] ************************************************ ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-12-17T18:14:19.276 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.034) 0:02:53.001 ******* 2021-12-17T18:14:19.298 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.022) 0:02:53.023 ******* 2021-12-17T18:14:19.335 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:19.337 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-12-17T18:14:19.359 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.061) 0:02:53.084 ******* 2021-12-17T18:14:19.386 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-12-17T18:14:19.388 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:19.419 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.059) 0:02:53.144 ******* 2021-12-17T18:14:19.439 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-12-17T18:14:19.441 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1639764361.7593644, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1639764361.7553644, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1639764361.7553644, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-12-17T18:14:19.470 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.048) 0:02:53.193 ******* 2021-12-17T18:14:19.476 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-12-17T18:14:19.477 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-12-17T18:14:19.478 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1639764369.1074262, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1639764369.1034262, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1639764369.1034262, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-12-17T18:14:19.505 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.037) 0:02:53.231 ******* 2021-12-17T18:14:19.528 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.023) 0:02:53.254 ******* 2021-12-17T18:14:19.557 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-12-17T18:14:19.559 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:19.581 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.052) 0:02:53.307 ******* 2021-12-17T18:14:19.728 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-12-17T18:14:19.730 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-12-17T18:14:19.754 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.172) 0:02:53.480 ******* 2021-12-17T18:14:19.762 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-12-17T18:14:19.797 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.042) 0:02:53.522 ******* 2021-12-17T18:14:19.805 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-12-17T18:14:19.806 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-12-17T18:14:19.832 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.034) 0:02:53.557 ******* 2021-12-17T18:14:19.841 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-12-17T18:14:19.867 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.035) 0:02:53.592 ******* 2021-12-17T18:14:19.875 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-12-17T18:14:19.880 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:19.902 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.034) 0:02:53.627 ******* 2021-12-17T18:14:19.910 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-12-17T18:14:19.910 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-12-17T18:14:19.913 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the ntp.conf file.] ************************************ 2021-12-17T18:14:19.914 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-12-17T18:14:19.941 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.038) 0:02:53.666 ******* 2021-12-17T18:14:19.965 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.024) 0:02:53.690 ******* 2021-12-17T18:14:19.987 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:19 +0000 (0:00:00.021) 0:02:53.712 ******* 2021-12-17T18:14:19.995 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-12-17T18:14:19.997 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.022 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.035) 0:02:53.748 ******* 2021-12-17T18:14:20.071 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-12-17T18:14:20.097 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.075) 0:02:53.823 ******* 2021-12-17T18:14:20.137 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-12-17T18:14:20.163 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.065) 0:02:53.889 ******* 2021-12-17T18:14:20.234 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-12-17T18:14:20.235 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:10:35 UTC", "ActiveEnterTimestampMonotonic": "14058141", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service network.target sysinit.target systemd-journald.socket system.slice basic.target -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:10:34 UTC", "AssertTimestampMonotonic": "13896254", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:10:34 UTC", "ConditionTimestampMonotonic": "13896253", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-12-17T18:14:20.237 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "832", "ExecMainStartTimestamp": "Fri 2021-12-17 18:10:35 UTC", "ExecMainStartTimestampMonotonic": "14058127", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-12-17 18:10:34 UTC", "InactiveExitTimestampMonotonic": "13897266", "InvocationID": "1a51f72c98334219a42c2332254bcc99", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-12-17T18:14:20.239 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "832", "MemoryAccounting": "yes", "MemoryCurrent": "3588096", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "Requi 2021-12-17T18:14:20.239 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:10:35 UTC", "StateChangeTimestampMonotonic": "14058141", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-12-17T18:14:20.262 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.098) 0:02:53.987 ******* 2021-12-17T18:14:20.269 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-12-17T18:14:20.271 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-12-17T18:14:20.302 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.040) 0:02:54.028 ******* 2021-12-17T18:14:20.311 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:20.312 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-12-17T18:14:20.336 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.034) 0:02:54.062 ******* 2021-12-17T18:14:20.343 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-12-17T18:14:20.345 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi125.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-12-17T18:14:20.370 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.033) 0:02:54.096 ******* 2021-12-17T18:14:20.393 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.022) 0:02:54.118 ******* 2021-12-17T18:14:20.400 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:20.402 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-12-17T18:14:20.427 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.034) 0:02:54.153 ******* 2021-12-17T18:14:20.434 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-12-17T18:14:20.435 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.436 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.436 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.437 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi062.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.438 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.466 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.038) 0:02:54.191 ******* 2021-12-17T18:14:20.494 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.028) 0:02:54.219 ******* 2021-12-17T18:14:20.502 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-12-17T18:14:20.504 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi192.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:14:20.536 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.042) 0:02:54.262 ******* 2021-12-17T18:14:20.563 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.026) 0:02:54.288 ******* 2021-12-17T18:14:20.570 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-12-17T18:14:20.572 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.573 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.574 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi125.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.574 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-12-17T18:14:20.575 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.576 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-12-17T18:14:20.578 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi158.front.sepia.ceph.com] => {"changed": false} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi125.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.579 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.605 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.041) 0:02:54.330 ******* 2021-12-17T18:14:20.627 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.021) 0:02:54.352 ******* 2021-12-17T18:14:20.650 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.023) 0:02:54.375 ******* 2021-12-17T18:14:20.658 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-12-17T18:14:20.659 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Define net_to_configure var] ********************************** 2021-12-17T18:14:20.660 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.695 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.045) 0:02:54.420 ******* 2021-12-17T18:14:20.720 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.024) 0:02:54.445 ******* 2021-12-17T18:14:20.728 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.729 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.730 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.732 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-12-17T18:14:20.732 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi125.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.734 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.735 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.761 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.041) 0:02:54.486 ******* 2021-12-17T18:14:20.784 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.023) 0:02:54.510 ******* 2021-12-17T18:14:20.806 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.021) 0:02:54.532 ******* 2021-12-17T18:14:20.813 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-12-17T18:14:20.814 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.844 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.037) 0:02:54.569 ******* 2021-12-17T18:14:20.870 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.025) 0:02:54.595 ******* 2021-12-17T18:14:20.876 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-12-17T18:14:20.877 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.902 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.032) 0:02:54.627 ******* 2021-12-17T18:14:20.908 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-12-17T18:14:20.910 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-12-17T18:14:20.934 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.032) 0:02:54.660 ******* 2021-12-17T18:14:20.956 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.021) 0:02:54.681 ******* 2021-12-17T18:14:20.963 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-12-17T18:14:20.965 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:20.993 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:20 +0000 (0:00:00.037) 0:02:54.719 ******* 2021-12-17T18:14:21.017 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.024) 0:02:54.743 ******* 2021-12-17T18:14:21.024 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-12-17T18:14:21.025 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1639764416.9673967, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1639764416.9633968, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1639764416.9633968, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-12-17T18:14:21.026 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:21.060 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.042) 0:02:54.785 ******* 2021-12-17T18:14:21.084 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.023) 0:02:54.809 ******* 2021-12-17T18:14:21.091 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-12-17T18:14:21.093 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:21.121 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.037) 0:02:54.846 ******* 2021-12-17T18:14:21.143 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.021) 0:02:54.868 ******* 2021-12-17T18:14:21.150 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-12-17T18:14:21.151 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:21.177 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.033) 0:02:54.902 ******* 2021-12-17T18:14:21.183 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-12-17T18:14:21.185 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:21.214 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.037) 0:02:54.940 ******* 2021-12-17T18:14:21.245 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-12-17T18:14:21.247 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:21.272 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.057) 0:02:54.997 ******* 2021-12-17T18:14:21.280 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-12-17T18:14:21.282 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-12-17T18:14:21.309 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.036) 0:02:55.034 ******* 2021-12-17T18:14:21.317 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-12-17T18:14:21.319 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:21.350 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.040) 0:02:55.075 ******* 2021-12-17T18:14:21.358 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-12-17T18:14:21.360 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-12-17T18:14:21.385 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.035) 0:02:55.110 ******* 2021-12-17T18:14:21.393 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-12-17T18:14:21.395 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-12-17T18:14:21.396 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010270", "end": "2021-12-17 18:14:21.349677", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-12-17 18:14:21.339407", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:21.397 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-12-17T18:14:21.422 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.037) 0:02:55.148 ******* 2021-12-17T18:14:21.448 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.025) 0:02:55.173 ******* 2021-12-17T18:14:21.457 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-12-17T18:14:21.459 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:21.498 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.049) 0:02:55.223 ******* 2021-12-17T18:14:21.548 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-12-17T18:14:21.550 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006151", "end": "2021-12-17 18:14:21.509503", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-12-17 18:14:21.503352", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:21.582 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-12-17T18:14:21.583 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:14:21.609 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.110) 0:02:55.334 ******* 2021-12-17T18:14:21.629 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-12-17T18:14:21.631 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010211", "end": "2021-12-17 18:14:21.593642", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-12-17 18:14:21.583431", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:21.641 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-12-17T18:14:21.642 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:21.666 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.056) 0:02:55.391 ******* 2021-12-17T18:14:21.685 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-12-17T18:14:21.686 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-12-17T18:14:21.713 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.047) 0:02:55.439 ******* 2021-12-17T18:14:21.722 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-12-17T18:14:21.722 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005418", "end": "2021-12-17 18:14:21.678166", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-12-17 18:14:21.672748", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:21.787 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006112", "end": "2021-12-17 18:14:21.755696", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-12-17 18:14:21.749584", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:21.851 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-12-17T18:14:21.852 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-12-17T18:14:21.879 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.165) 0:02:55.604 ******* 2021-12-17T18:14:21.898 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-12-17T18:14:21.900 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.025960", "end": "2021-12-17 18:14:21.853754", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-12-17 18:14:21.827794", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:21.901 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-12-17T18:14:21.902 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-12-17T18:14:21.929 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.049) 0:02:55.654 ******* 2021-12-17T18:14:21.954 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.024) 0:02:55.679 ******* 2021-12-17T18:14:21.963 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-12-17T18:14:21.965 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005495", "end": "2021-12-17 18:14:21.917470", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-12-17 18:14:21.911975", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-12-17T18:14:21.989 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:21 +0000 (0:00:00.035) 0:02:55.715 ******* 2021-12-17T18:14:21.997 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-12-17T18:14:21.999 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.024 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:22 +0000 (0:00:00.034) 0:02:55.749 ******* 2021-12-17T18:14:22.031 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-12-17T18:14:22.033 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.061 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-12-17T18:14:22.063 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.084 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.086 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.109 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:22 +0000 (0:00:00.084) 0:02:55.834 ******* 2021-12-17T18:14:22.137 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-12-17T18:14:22.139 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.031841", "end": "2021-12-17 18:14:22.109021", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-12-17 18:14:22.077180", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:22.172 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:22 +0000 (0:00:00.062) 0:02:55.897 ******* 2021-12-17T18:14:22.181 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-12-17T18:14:22.182 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.183 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.185 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.196 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.198 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-12-17T18:14:22.221 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:22 +0000 (0:00:00.049) 0:02:55.947 ******* 2021-12-17T18:14:22.245 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:22 +0000 (0:00:00.023) 0:02:55.971 ******* 2021-12-17T18:14:22.253 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-12-17T18:14:22.254 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.278 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:22.280 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.315 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:22 +0000 (0:00:00.070) 0:02:56.041 ******* 2021-12-17T18:14:22.322 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-12-17T18:14:22.323 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-12-17T18:14:22.348 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:22 +0000 (0:00:00.032) 0:02:56.073 ******* 2021-12-17T18:14:22.355 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-12-17T18:14:22.357 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.383 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:22 +0000 (0:00:00.035) 0:02:56.108 ******* 2021-12-17T18:14:22.412 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-12-17T18:14:22.414 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.440 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:22 +0000 (0:00:00.057) 0:02:56.166 ******* 2021-12-17T18:14:22.469 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-12-17T18:14:22.471 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.494 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:22 +0000 (0:00:00.053) 0:02:56.219 ******* 2021-12-17T18:14:22.522 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-12-17T18:14:22.524 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.549 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:22 +0000 (0:00:00.054) 0:02:56.274 ******* 2021-12-17T18:14:22.577 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-12-17T18:14:22.579 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.603 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:22 +0000 (0:00:00.054) 0:02:56.328 ******* 2021-12-17T18:14:22.631 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-12-17T18:14:22.632 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.664 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:22 +0000 (0:00:00.061) 0:02:56.390 ******* 2021-12-17T18:14:22.693 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-12-17T18:14:22.694 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:22.717 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:22 +0000 (0:00:00.052) 0:02:56.442 ******* 2021-12-17T18:14:22.922 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-12-17T18:14:22.924 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010565", "end": "2021-12-17 18:14:22.887471", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-12-17 18:14:22.876906", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:23.080 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006082", "end": "2021-12-17 18:14:23.048653", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-12-17 18:14:23.042571", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:23.227 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005358", "end": "2021-12-17 18:14:23.196973", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-12-17 18:14:23.191615", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:23.384 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.019511", "end": "2021-12-17 18:14:23.357944", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-12-17 18:14:23.338433", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:23.410 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:23 +0000 (0:00:00.692) 0:02:57.135 ******* 2021-12-17T18:14:23.438 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-12-17T18:14:23.461 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:23 +0000 (0:00:00.050) 0:02:57.186 ******* 2021-12-17T18:14:23.487 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-12-17T18:14:23.489 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:23.856 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-12-17T18:14:23.857 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-12-17T18:14:23.879 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:23 +0000 (0:00:00.418) 0:02:57.604 ******* 2021-12-17T18:14:24.386 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-12-17T18:14:24.387 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false} 2021-12-17T18:14:24.410 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:24 +0000 (0:00:00.530) 0:02:58.135 ******* 2021-12-17T18:14:24.436 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-12-17T18:14:24.438 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-12-17T18:14:24.463 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:24 +0000 (0:00:00.053) 0:02:58.188 ******* 2021-12-17T18:14:24.657 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-12-17T18:14:24.659 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1639764374.0903113, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1639764374.0863113, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1639764374.0863113, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-12-17T18:14:24.682 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:24 +0000 (0:00:00.219) 0:02:58.408 ******* 2021-12-17T18:14:24.700 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-12-17T18:14:24.701 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-12-17T18:14:24.726 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:24 +0000 (0:00:00.043) 0:02:58.451 ******* 2021-12-17T18:14:24.858 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-12-17T18:14:24.860 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-12-17T18:14:24.885 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:24 +0000 (0:00:00.158) 0:02:58.610 ******* 2021-12-17T18:14:24.913 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-12-17T18:14:24.915 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-12-17T18:14:24.937 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:24 +0000 (0:00:00.051) 0:02:58.662 ******* 2021-12-17T18:14:24.964 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-12-17T18:14:24.965 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:24.987 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:24 +0000 (0:00:00.050) 0:02:58.713 ******* 2021-12-17T18:14:25.171 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-12-17T18:14:25.173 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-12-17T18:14:25.195 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:25 +0000 (0:00:00.208) 0:02:58.921 ******* 2021-12-17T18:14:25.254 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-12-17T18:14:25.256 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false} 2021-12-17T18:14:25.280 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:25 +0000 (0:00:00.084) 0:02:59.005 ******* 2021-12-17T18:14:25.307 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-12-17T18:14:25.309 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-12-17T18:14:25.330 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:25 +0000 (0:00:00.050) 0:02:59.056 ******* 2021-12-17T18:14:25.369 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-12-17T18:14:25.370 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-12-17T18:14:25.395 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:25 +0000 (0:00:00.064) 0:02:59.120 ******* 2021-12-17T18:14:25.421 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-12-17T18:14:25.423 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:25.444 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:25 +0000 (0:00:00.049) 0:02:59.170 ******* 2021-12-17T18:14:25.481 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-12-17T18:14:25.483 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-12-17T18:14:25.493 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-12-17T18:14:25.494 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-12-17T18:14:25.519 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:25 +0000 (0:00:00.074) 0:02:59.244 ******* 2021-12-17T18:14:25.525 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-12-17T18:14:25.526 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1639764370.98743, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1639764370.9834301, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1639764370.9834301, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-12-17T18:14:25.561 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:25 +0000 (0:00:00.041) 0:02:59.286 ******* 2021-12-17T18:14:25.569 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-12-17T18:14:25.570 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:25.572 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:25.573 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:25.584 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:25.586 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:25.612 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:25 +0000 (0:00:00.051) 0:02:59.337 ******* 2021-12-17T18:14:25.640 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:25.642 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:25.668 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:25 +0000 (0:00:00.055) 0:02:59.393 ******* 2021-12-17T18:14:25.695 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-12-17T18:14:25.697 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:25.720 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:25 +0000 (0:00:00.052) 0:02:59.445 ******* 2021-12-17T18:14:25.738 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-12-17T18:14:25.739 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-12-17T18:14:25.762 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:25 +0000 (0:00:00.042) 0:02:59.488 ******* 2021-12-17T18:14:25.769 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-12-17T18:14:25.770 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:25.799 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:25 +0000 (0:00:00.036) 0:02:59.525 ******* 2021-12-17T18:14:25.805 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-12-17T18:14:25.807 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-12-17T18:14:25.831 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:25 +0000 (0:00:00.031) 0:02:59.557 ******* 2021-12-17T18:14:25.838 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-12-17T18:14:25.839 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:25.863 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:25 +0000 (0:00:00.032) 0:02:59.589 ******* 2021-12-17T18:14:25.869 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-12-17T18:14:25.871 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:25.895 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:25 +0000 (0:00:00.031) 0:02:59.621 ******* 2021-12-17T18:14:25.901 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-12-17T18:14:25.903 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:25.930 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:25 +0000 (0:00:00.034) 0:02:59.655 ******* 2021-12-17T18:14:25.958 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-12-17T18:14:25.959 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:25.984 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:25 +0000 (0:00:00.053) 0:02:59.709 ******* 2021-12-17T18:14:26.012 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-12-17T18:14:26.014 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.038 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:26 +0000 (0:00:00.054) 0:02:59.763 ******* 2021-12-17T18:14:26.143 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi109.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} Friday 17 December 2021 18:14:26 +0000 (0:00:00.057) 0:02:59.821 ******* Friday 17 December 2021 18:14:26 +0000 (0:00:00.024) 0:02:59.846 ******* 2021-12-17T18:14:26.277 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-12-17T18:14:26.279 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-12-17T18:14:26.305 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:26 +0000 (0:00:00.184) 0:03:00.030 ******* 2021-12-17T18:14:26.334 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-12-17T18:14:26.337 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010620", "end": "2021-12-17 18:14:26.303197", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-12-17 18:14:26.292577", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.360 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:26 +0000 (0:00:00.055) 0:03:00.085 ******* 2021-12-17T18:14:26.398 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-12-17T18:14:26.400 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.410 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.412 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.422 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.447 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:26 +0000 (0:00:00.087) 0:03:00.172 ******* 2021-12-17T18:14:26.496 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-12-17T18:14:26.498 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi109.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.508 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.510 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi192.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006115", "end": "2021-12-17 18:14:26.473999", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-12-17 18:14:26.467884", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi109.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.521 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.523 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.552 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:26 +0000 (0:00:00.104) 0:03:00.277 ******* 2021-12-17T18:14:26.590 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-12-17T18:14:26.592 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.617 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:26 +0000 (0:00:00.065) 0:03:00.342 ******* 2021-12-17T18:14:26.644 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-12-17T18:14:26.646 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.668 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:26 +0000 (0:00:00.051) 0:03:00.394 ******* 2021-12-17T18:14:26.675 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-12-17T18:14:26.677 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005388", "end": "2021-12-17 18:14:26.631121", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-12-17 18:14:26.625733", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:26.698 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-12-17T18:14:26.699 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.723 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:26 +0000 (0:00:00.055) 0:03:00.449 ******* 2021-12-17T18:14:26.751 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-12-17T18:14:26.753 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.775 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:26 +0000 (0:00:00.051) 0:03:00.500 ******* 2021-12-17T18:14:26.802 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-12-17T18:14:26.803 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.827 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:26 +0000 (0:00:00.052) 0:03:00.553 ******* 2021-12-17T18:14:26.845 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-12-17T18:14:26.846 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.031127", "end": "2021-12-17 18:14:26.814267", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-12-17 18:14:26.783140", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:26.871 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:26 +0000 (0:00:00.043) 0:03:00.596 ******* 2021-12-17T18:14:26.878 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-12-17T18:14:26.880 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.909 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:26 +0000 (0:00:00.038) 0:03:00.635 ******* 2021-12-17T18:14:26.916 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-12-17T18:14:26.941 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:26 +0000 (0:00:00.032) 0:03:00.667 ******* 2021-12-17T18:14:26.948 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-12-17T18:14:26.949 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:26.976 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:26 +0000 (0:00:00.034) 0:03:00.701 ******* 2021-12-17T18:14:26.983 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-12-17T18:14:26.984 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:27.009 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:27.031 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:27 +0000 (0:00:00.055) 0:03:00.757 ******* 2021-12-17T18:14:27.242 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-12-17T18:14:27.244 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010552", "end": "2021-12-17 18:14:27.206018", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-12-17 18:14:27.195466", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:27.400 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006168", "end": "2021-12-17 18:14:27.367940", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-12-17 18:14:27.361772", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:27.549 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005619", "end": "2021-12-17 18:14:27.523741", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-12-17 18:14:27.518122", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:27.726 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.026848", "end": "2021-12-17 18:14:27.700294", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-12-17 18:14:27.673446", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:27.751 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:27 +0000 (0:00:00.719) 0:03:01.476 ******* 2021-12-17T18:14:27.778 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-12-17T18:14:27.807 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:27 +0000 (0:00:00.056) 0:03:01.533 ******* 2021-12-17T18:14:27.835 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-12-17T18:14:27.836 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:27.904 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-12-17T18:14:27.928 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:27 +0000 (0:00:00.120) 0:03:01.653 ******* 2021-12-17T18:14:27.952 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:27 +0000 (0:00:00.024) 0:03:01.678 ******* 2021-12-17T18:14:27.977 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:27 +0000 (0:00:00.024) 0:03:01.702 ******* 2021-12-17T18:14:28.003 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:28 +0000 (0:00:00.025) 0:03:01.728 ******* 2021-12-17T18:14:28.030 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:28 +0000 (0:00:00.026) 0:03:01.755 ******* 2021-12-17T18:14:28.961 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi062.front.sepia.ceph.com] 2021-12-17T18:14:29.187 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:01.157) 0:03:02.913 ******* 2021-12-17T18:14:29.203 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] 2021-12-17T18:14:29.215 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] 2021-12-17T18:14:29.226 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] 2021-12-17T18:14:29.236 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] 2021-12-17T18:14:29.244 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-12-17T18:14:29.245 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-12-17T18:14:29.267 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.079) 0:03:02.992 ******* 2021-12-17T18:14:29.325 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-12-17T18:14:29.327 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:29.347 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.079) 0:03:03.072 ******* 2021-12-17T18:14:29.370 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.023) 0:03:03.096 ******* 2021-12-17T18:14:29.396 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.025) 0:03:03.121 ******* 2021-12-17T18:14:29.419 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.022) 0:03:03.144 ******* 2021-12-17T18:14:29.448 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.029) 0:03:03.173 ******* 2021-12-17T18:14:29.454 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-12-17T18:14:29.456 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io", "python3-setuptools", "python3-pip"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-12-17T18:14:29.456 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi109.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-12-17T18:14:29.457 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-12-17T18:14:29.457 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-12-17T18:14:29.482 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.034) 0:03:03.207 ******* 2021-12-17T18:14:29.506 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.023) 0:03:03.231 ******* 2021-12-17T18:14:29.530 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.023) 0:03:03.255 ******* 2021-12-17T18:14:29.553 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.023) 0:03:03.279 ******* 2021-12-17T18:14:29.561 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-12-17T18:14:29.563 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:29.587 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.033) 0:03:03.312 ******* 2021-12-17T18:14:29.610 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.022) 0:03:03.335 ******* 2021-12-17T18:14:29.633 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.023) 0:03:03.359 ******* 2021-12-17T18:14:29.640 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:29.640 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-12-17T18:14:29.641 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io", "python3-setuptools", "python3-pip"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-12-17T18:14:29.667 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.033) 0:03:03.392 ******* 2021-12-17T18:14:29.692 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.024) 0:03:03.417 ******* 2021-12-17T18:14:29.700 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io", "python3-setuptools", "python3-pip"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-12-17T18:14:29.702 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:29.729 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.037) 0:03:03.454 ******* 2021-12-17T18:14:29.750 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.021) 0:03:03.475 ******* 2021-12-17T18:14:29.757 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-12-17T18:14:29.759 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io", "python3-setuptools", "python3-pip"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-12-17T18:14:29.794 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.044) 0:03:03.519 ******* 2021-12-17T18:14:29.813 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io", "python3-setuptools", "python3-pip"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-12-17T18:14:29.839 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:29 +0000 (0:00:00.044) 0:03:03.564 ******* 2021-12-17T18:14:46.884 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-12-17T18:14:46.886 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 70 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (12.5 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", 2021-12-17T18:14:46.888 INFO:teuthology.task.ansible.out:"Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 70 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (12.5 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-12-17T18:14:46.914 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:46 +0000 (0:00:17.075) 0:03:20.640 ******* 2021-12-17T18:14:46.945 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:46.974 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:46 +0000 (0:00:00.059) 0:03:20.700 ******* 2021-12-17T18:14:47.015 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-12-17T18:14:47.043 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:47 +0000 (0:00:00.068) 0:03:20.768 ******* 2021-12-17T18:14:47.158 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-12-17T18:14:47.160 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 70 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (11.0 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", 2021-12-17T18:14:47.161 INFO:teuthology.task.ansible.out:"Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 70 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (11.0 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-12-17T18:14:47.191 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:47 +0000 (0:00:00.147) 0:03:20.916 ******* 2021-12-17T18:14:47.221 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-12-17T18:14:47.223 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:47.250 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:47 +0000 (0:00:00.059) 0:03:20.975 ******* 2021-12-17T18:14:47.258 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-12-17T18:14:47.259 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:47.282 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-12-17T18:14:47.284 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 70 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (11.2 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", 2021-12-17T18:14:47.285 INFO:teuthology.task.ansible.out:"Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 70 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (11.2 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} TASK [container-host : set_fact] *********************************************** ok: [smithi125.front.sepia.ceph.com] => {"ansible_facts": {"container_service 2021-12-17T18:14:47.287 INFO:teuthology.task.ansible.out:_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-12-17T18:14:47.308 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:47 +0000 (0:00:00.058) 0:03:21.033 ******* 2021-12-17T18:14:47.332 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:47 +0000 (0:00:00.023) 0:03:21.057 ******* 2021-12-17T18:14:47.360 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-12-17T18:14:47.362 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:47.384 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:47 +0000 (0:00:00.052) 0:03:21.110 ******* 2021-12-17T18:14:47.413 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-12-17T18:14:47.414 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:47.425 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-12-17T18:14:47.427 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-12-17T18:14:47.452 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:47 +0000 (0:00:00.067) 0:03:21.177 ******* 2021-12-17T18:14:47.474 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:47 +0000 (0:00:00.022) 0:03:21.200 ******* 2021-12-17T18:14:47.513 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-12-17T18:14:47.515 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:47.690 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:47.692 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:47.716 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:47 +0000 (0:00:00.241) 0:03:21.441 ******* 2021-12-17T18:14:47.859 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:47.886 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:47 +0000 (0:00:00.170) 0:03:21.612 ******* 2021-12-17T18:14:47.893 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-12-17T18:14:47.895 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-12-17T18:14:48.031 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-12-17T18:14:48.033 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 70 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 4s (9458 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", 2021-12-17T18:14:48.035 INFO:teuthology.task.ansible.out:"Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 70 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 4s (9458 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-12-17T18:14:48.057 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:48 +0000 (0:00:00.170) 0:03:21.783 ******* 2021-12-17T18:14:48.087 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-12-17T18:14:48.089 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:48.110 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:48 +0000 (0:00:00.053) 0:03:21.836 ******* 2021-12-17T18:14:48.149 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi109.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-12-17T18:14:48.174 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:48 +0000 (0:00:00.063) 0:03:21.899 ******* 2021-12-17T18:14:48.181 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-12-17T18:14:48.181 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-12-17T18:14:48.277 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-12-17T18:14:48.305 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:48 +0000 (0:00:00.131) 0:03:22.030 ******* 2021-12-17T18:14:48.334 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-12-17T18:14:48.377 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-12-17T18:14:48.379 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:48.536 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:48.564 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:48 +0000 (0:00:00.258) 0:03:22.289 ******* 2021-12-17T18:14:48.571 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-12-17T18:14:48.573 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-12-17T18:14:48.600 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:48 +0000 (0:00:00.036) 0:03:22.326 ******* 2021-12-17T18:14:48.724 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-12-17T18:14:48.751 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:48 +0000 (0:00:00.150) 0:03:22.476 ******* 2021-12-17T18:14:49.009 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-12-17T18:14:49.084 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-12-17T18:14:49.086 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:14:49.114 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:49 +0000 (0:00:00.363) 0:03:22.839 ******* 2021-12-17T18:14:49.384 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:14:49.411 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:49 +0000 (0:00:00.296) 0:03:23.136 ******* 2021-12-17T18:14:49.419 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-12-17T18:14:49.419 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-12-17T18:14:49.449 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:49 +0000 (0:00:00.038) 0:03:23.174 ******* 2021-12-17T18:14:49.531 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-12-17T18:14:49.533 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"cache_update_time": 1639764470, "cache_updated": false, "changed": false} 2021-12-17T18:14:49.558 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:49 +0000 (0:00:00.108) 0:03:23.283 ******* 2021-12-17T18:14:50.240 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} 2021-12-17T18:14:50.266 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:50 +0000 (0:00:00.708) 0:03:23.991 ******* 2021-12-17T18:14:52.166 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-12-17T18:14:52.168 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 70 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 8s (4430 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", 2021-12-17T18:14:52.169 INFO:teuthology.task.ansible.out:"Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 70 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 8s (4430 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-12-17T18:14:52.192 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:52 +0000 (0:00:01.926) 0:03:25.917 ******* 2021-12-17T18:14:52.221 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-12-17T18:14:52.222 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:52.244 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:52 +0000 (0:00:00.052) 0:03:25.970 ******* 2021-12-17T18:14:52.274 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-12-17T18:14:52.276 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-12-17T18:14:52.299 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:52 +0000 (0:00:00.054) 0:03:26.024 ******* 2021-12-17T18:14:52.508 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-12-17T18:14:52.510 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:52.688 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-12-17T18:14:52.714 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:52 +0000 (0:00:00.414) 0:03:26.439 ******* 2021-12-17T18:14:53.173 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-12-17T18:14:53.175 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-12-17T18:14:53.248 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-12-17T18:14:53.250 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-x5ysrrep\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-x5ysrrep"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-x5ysrrep\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=a366e6aac59edcd1dcaa0cf930b8f4d337f685e94c74d18532c078d8c9bbd068\n Stored in directory: /tmp/pip-ephem-wheel-cache-q5w94cak/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/reg 2021-12-17T18:14:53.252 INFO:teuthology.task.ansible.out:istries-conf-ctl to ./pip-req-build-x5ysrrep", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=a366e6aac59edcd1dcaa0cf930b8f4d337f685e94c74d18532c078d8c9bbd068", " Stored in directory: /tmp/pip-ephem-wheel-cache-q5w94cak/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-12-17T18:14:53.274 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:53 +0000 (0:00:00.560) 0:03:27.000 ******* 2021-12-17T18:14:53.471 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-12-17T18:14:53.473 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1639764400.7558432, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-12-17T18:14:53.498 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:53 +0000 (0:00:00.223) 0:03:27.223 ******* 2021-12-17T18:14:53.537 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-12-17T18:14:53.539 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:53.568 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:53 +0000 (0:00:00.070) 0:03:27.294 ******* 2021-12-17T18:14:53.575 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-12-17T18:14:53.576 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-12-17T18:14:53.605 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:53 +0000 (0:00:00.036) 0:03:27.330 ******* 2021-12-17T18:14:53.759 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-12-17T18:14:53.760 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-ou7aom7c\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-ou7aom7c"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-ou7aom7c\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=4b6a09577e5d1e7dcf90bd26530589943aef4b008a4af7531ccf110f15e2ace9\n Stored in directory: /tmp/pip-ephem-wheel-cache-c2i3izku/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/reg 2021-12-17T18:14:53.762 INFO:teuthology.task.ansible.out:istries-conf-ctl to ./pip-req-build-ou7aom7c", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=4b6a09577e5d1e7dcf90bd26530589943aef4b008a4af7531ccf110f15e2ace9", " Stored in directory: /tmp/pip-ephem-wheel-cache-c2i3izku/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-12-17T18:14:53.792 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:53 +0000 (0:00:00.186) 0:03:27.517 ******* 2021-12-17T18:14:53.800 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-2n311usv\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-2n311usv"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-2n311usv\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=4b6a09577e5d1e7dcf90bd26530589943aef4b008a4af7531ccf110f15e2ace9\n Stored in directory: /tmp/pip-ephem-wheel-cache-n1plw35b/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/reg 2021-12-17T18:14:53.803 INFO:teuthology.task.ansible.out:istries-conf-ctl to ./pip-req-build-2n311usv", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=4b6a09577e5d1e7dcf90bd26530589943aef4b008a4af7531ccf110f15e2ace9", " Stored in directory: /tmp/pip-ephem-wheel-cache-n1plw35b/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-12-17T18:14:53.828 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:53 +0000 (0:00:00.036) 0:03:27.553 ******* 2021-12-17T18:14:53.837 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-12-17T18:14:53.838 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.074585", "end": "2021-12-17 18:14:53.806107", "rc": 0, "start": "2021-12-17 18:14:53.731522", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:53.865 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:53 +0000 (0:00:00.036) 0:03:27.590 ******* 2021-12-17T18:14:54.002 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-12-17T18:14:54.004 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1639764356.4707966, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-12-17T18:14:54.031 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:54 +0000 (0:00:00.166) 0:03:27.756 ******* 2021-12-17T18:14:54.039 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1639764344.271845, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-12-17T18:14:54.070 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:54 +0000 (0:00:00.038) 0:03:27.795 ******* 2021-12-17T18:14:54.077 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-12-17T18:14:54.079 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:54.107 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:54 +0000 (0:00:00.037) 0:03:27.832 ******* 2021-12-17T18:14:54.114 INFO:teuthology.task.ansible.out:skipping: [smithi125.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:54.144 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:54 +0000 (0:00:00.036) 0:03:27.869 ******* 2021-12-17T18:14:54.393 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-12-17T18:14:54.395 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.084834", "end": "2021-12-17 18:14:54.364601", "rc": 0, "start": "2021-12-17 18:14:54.279767", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:54.419 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:54 +0000 (0:00:00.275) 0:03:28.144 ******* 2021-12-17T18:14:54.426 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-12-17T18:14:54.428 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1639764469, "cache_updated": false, "changed": false} TASK [container-host : Add local docker.io registry mirror] ******************** changed: [smithi125.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.086320", "end": "2021-12-17 18:14:54.395888", "rc": 0, "start": "2021-12-17 18:14:54.309568", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:54.454 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:54 +0000 (0:00:00.035) 0:03:28.180 ******* 2021-12-17T18:14:54.481 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:54 +0000 (0:00:00.026) 0:03:28.207 ******* 2021-12-17T18:14:54.515 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-12-17T18:14:54.517 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-d8fd4den\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-d8fd4den"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-d8fd4den\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=4b6a09577e5d1e7dcf90bd26530589943aef4b008a4af7531ccf110f15e2ace9\n Stored in directory: /tmp/pip-ephem-wheel-cache-wsrctjkk/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/reg 2021-12-17T18:14:54.518 INFO:teuthology.task.ansible.out:istries-conf-ctl to ./pip-req-build-d8fd4den", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=4b6a09577e5d1e7dcf90bd26530589943aef4b008a4af7531ccf110f15e2ace9", " Stored in directory: /tmp/pip-ephem-wheel-cache-wsrctjkk/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-12-17T18:14:54.541 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:54 +0000 (0:00:00.059) 0:03:28.267 ******* 2021-12-17T18:14:54.748 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-12-17T18:14:54.750 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1639764353.3999135, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-12-17T18:14:54.779 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:54 +0000 (0:00:00.238) 0:03:28.505 ******* 2021-12-17T18:14:54.818 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-12-17T18:14:54.819 INFO:teuthology.task.ansible.out:skipping: [smithi109.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:54.842 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:54 +0000 (0:00:00.062) 0:03:28.567 ******* 2021-12-17T18:14:55.101 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-12-17T18:14:55.103 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.074101", "end": "2021-12-17 18:14:55.080268", "rc": 0, "start": "2021-12-17 18:14:55.006167", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:55.125 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:55 +0000 (0:00:00.282) 0:03:28.850 ******* 2021-12-17T18:14:55.686 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-12-17T18:14:55.688 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:14:42 UTC", "ActiveEnterTimestampMonotonic": "237613016", "ActiveExitTimestamp": "Fri 2021-12-17 18:14:41 UTC", "ActiveExitTimestampMonotonic": "236577483", "ActiveState": "active", "After": "sysinit.target network-online.target docker.socket firewalld.service containerd.service systemd-journald.socket basic.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:14:41 UTC", "AssertTimestampMonotonic": "236587598", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:14:41 UTC", "ConditionTimestampMonotonic": "236587598", "ConfigurationDirectoryMode": "0755" 2021-12-17T18:14:55.690 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8347", "ExecMainStartTimestamp": "Fri 2021-12-17 18:14:41 UTC", "ExecMainStartTimestampMonotonic": "236588349", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2021-12-17T18:14:55.691 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-12-17 18:14:41 UTC", "InactiveEnterTimestampMonotonic": "236581068", "InactiveExitTimestamp": "Fri 2021-12-17 18:14:41 UTC", "InactiveExitTimestampMonotonic": "236589238", "InvocationID": "d09484b3d7fa400aa554d104c7c20dfd", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8347", "MemoryAccounting": "yes", "MemoryCurrent": "46497792", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2021-12-17T18:14:55.693 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket sysinit.target system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:14:42 UTC", "StateChangeTimestampMonotonic": "237613016", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "17", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStart 2021-12-17T18:14:55.693 INFO:teuthology.task.ansible.out:USec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2021-12-17T18:14:55.695 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-12-17T18:14:56.268 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:14:43 UTC", "ActiveEnterTimestampMonotonic": "262771786", "ActiveExitTimestamp": "Fri 2021-12-17 18:14:42 UTC", "ActiveExitTimestampMonotonic": "261729511", "ActiveState": "active", "After": "system.slice containerd.service sysinit.target network-online.target firewalld.service docker.socket basic.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:14:42 UTC", "AssertTimestampMonotonic": "261745728", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:14:42 UTC", "ConditionTimestampMonotonic": "261745727", "ConfigurationDirectoryMode": "0755" 2021-12-17T18:14:56.271 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8282", "ExecMainStartTimestamp": "Fri 2021-12-17 18:14:42 UTC", "ExecMainStartTimestampMonotonic": "261747023", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2021-12-17T18:14:56.272 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-12-17 18:14:42 UTC", "InactiveEnterTimestampMonotonic": "261737482", "InactiveExitTimestamp": "Fri 2021-12-17 18:14:42 UTC", "InactiveExitTimestampMonotonic": "261747908", "InvocationID": "1e7eafb0fe884843b5da21d9fadc2166", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127772", "LimitSIGPENDINGSoft": "127772", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8282", "MemoryAccounting": "yes", "MemoryCurrent": "45965312", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2021-12-17T18:14:56.274 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:14:43 UTC", "StateChangeTimestampMonotonic": "262771786", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "16", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2021-12-17T18:14:56.276 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-12-17T18:14:56.296 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:14:43 UTC", "ActiveEnterTimestampMonotonic": "262148099", "ActiveExitTimestamp": "Fri 2021-12-17 18:14:42 UTC", "ActiveExitTimestampMonotonic": "261105198", "ActiveState": "active", "After": "network-online.target containerd.service docker.socket system.slice firewalld.service systemd-journald.socket basic.target sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:14:42 UTC", "AssertTimestampMonotonic": "261116898", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:14:42 UTC", "ConditionTimestampMonotonic": "261116898", "ConfigurationDirectoryMode": "0755" 2021-12-17T18:14:56.298 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8413", "ExecMainStartTimestamp": "Fri 2021-12-17 18:14:42 UTC", "ExecMainStartTimestampMonotonic": "261118036", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2021-12-17T18:14:56.300 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-12-17 18:14:42 UTC", "InactiveEnterTimestampMonotonic": "261110417", "InactiveExitTimestamp": "Fri 2021-12-17 18:14:42 UTC", "InactiveExitTimestampMonotonic": "261119149", "InvocationID": "d59dd4d587a14f8db444115225af8bdc", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8413", "MemoryAccounting": "yes", "MemoryCurrent": "45670400", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2021-12-17T18:14:56.301 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:14:43 UTC", "StateChangeTimestampMonotonic": "262148099", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "14", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2021-12-17T18:14:56.303 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "ini 2021-12-17T18:14:56.303 INFO:teuthology.task.ansible.out:t", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-12-17T18:14:57.052 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:14:43 UTC", "ActiveEnterTimestampMonotonic": "262572632", "ActiveExitTimestamp": "Fri 2021-12-17 18:14:42 UTC", "ActiveExitTimestampMonotonic": "261439006", "ActiveState": "active", "After": "system.slice network-online.target docker.socket systemd-journald.socket sysinit.target firewalld.service containerd.service basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:14:42 UTC", "AssertTimestampMonotonic": "261452810", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:14:42 UTC", "ConditionTimestampMonotonic": "261452809", "ConfigurationDirectoryMode": "0755" 2021-12-17T18:14:57.053 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8313", "ExecMainStartTimestamp": "Fri 2021-12-17 18:14:42 UTC", "ExecMainStartTimestampMonotonic": "261453920", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2021-12-17T18:14:57.055 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-12-17 18:14:42 UTC", "InactiveEnterTimestampMonotonic": "261445354", "InactiveExitTimestamp": "Fri 2021-12-17 18:14:42 UTC", "InactiveExitTimestampMonotonic": "261454863", "InvocationID": "6c6ea9b84d554637b0443c6c3b8f5d9b", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8313", "MemoryAccounting": "yes", "MemoryCurrent": "46579712", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2021-12-17T18:14:57.057 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket sysinit.target system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:14:43 UTC", "StateChangeTimestampMonotonic": "262572632", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "16", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2021-12-17T18:14:57.058 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-12-17T18:14:58.787 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-12-17T18:14:58.789 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-zo_qw7iz\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-zo_qw7iz"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-zo_qw7iz\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=408a1610d87d0dbc1da33e5092a0a067259ce55d5226bd862c1bfb853db382b1\n Stored in directory: /tmp/pip-ephem-wheel-cache-q1kqxj5q/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/reg 2021-12-17T18:14:58.791 INFO:teuthology.task.ansible.out:istries-conf-ctl to ./pip-req-build-zo_qw7iz", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=408a1610d87d0dbc1da33e5092a0a067259ce55d5226bd862c1bfb853db382b1", " Stored in directory: /tmp/pip-ephem-wheel-cache-q1kqxj5q/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-12-17T18:14:58.811 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:58 +0000 (0:00:03.686) 0:03:32.537 ******* 2021-12-17T18:14:59.018 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-12-17T18:14:59.019 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1639764353.4038587, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-12-17T18:14:59.044 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:59 +0000 (0:00:00.232) 0:03:32.770 ******* 2021-12-17T18:14:59.083 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-12-17T18:14:59.084 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-12-17T18:14:59.107 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:59 +0000 (0:00:00.062) 0:03:32.833 ******* 2021-12-17T18:14:59.377 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-12-17T18:14:59.379 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.075053", "end": "2021-12-17 18:14:59.352641", "rc": 0, "start": "2021-12-17 18:14:59.277588", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-12-17T18:14:59.401 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:14:59 +0000 (0:00:00.294) 0:03:33.127 ******* 2021-12-17T18:15:01.250 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-12-17T18:15:01.251 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-12-17 18:14:48 UTC", "ActiveEnterTimestampMonotonic": "264243991", "ActiveExitTimestamp": "Fri 2021-12-17 18:14:47 UTC", "ActiveExitTimestampMonotonic": "263223453", "ActiveState": "active", "After": "docker.socket network-online.target firewalld.service containerd.service system.slice sysinit.target systemd-journald.socket basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-12-17 18:14:47 UTC", "AssertTimestampMonotonic": "263236954", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-12-17 18:14:47 UTC", "ConditionTimestampMonotonic": "263236953", "ConfigurationDirectoryMode": "0755" 2021-12-17T18:15:01.252 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8335", "ExecMainStartTimestamp": "Fri 2021-12-17 18:14:47 UTC", "ExecMainStartTimestampMonotonic": "263237826", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2021-12-17T18:15:01.254 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-12-17 18:14:47 UTC", "InactiveEnterTimestampMonotonic": "263230939", "InactiveExitTimestamp": "Fri 2021-12-17 18:14:47 UTC", "InactiveExitTimestampMonotonic": "263238694", "InvocationID": "46a92b198c73427abfe814e73b01f1df", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8335", "MemoryAccounting": "yes", "MemoryCurrent": "45441024", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2021-12-17T18:15:01.256 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-12-17 18:14:48 UTC", "StateChangeTimestampMonotonic": "264243991", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "15", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStart 2021-12-17T18:15:01.256 INFO:teuthology.task.ansible.out:USec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2021-12-17T18:15:01.258 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-12-17T18:15:01.329 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-12-17T18:15:01.330 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-12-17T18:15:01.332 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-12-17T18:15:01.334 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-12-17T18:15:01.350 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Friday 17 December 2021 18:15:01 +0000 (0:00:01.948) 0:03:35.075 ******* 2021-12-17T18:15:02.360 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] 2021-12-17T18:15:02.387 INFO:teuthology.task.ansible.out:ok: [smithi109.front.sepia.ceph.com] 2021-12-17T18:15:02.408 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] 2021-12-17T18:15:02.431 INFO:teuthology.task.ansible.out:ok: [smithi125.front.sepia.ceph.com] 2021-12-17T18:15:03.403 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] 2021-12-17T18:15:03.423 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** 2021-12-17T18:15:03.425 INFO:teuthology.task.ansible.out:Friday 17 December 2021 18:15:03 +0000 (0:00:02.073) 0:03:37.149 ******* 2021-12-17T18:15:03.612 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-12-17T18:15:03.634 INFO:teuthology.task.ansible.out:changed: [smithi109.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-12-17T18:15:03.656 INFO:teuthology.task.ansible.out:changed: [smithi125.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-12-17T18:15:03.689 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-12-17T18:15:03.711 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-12-17T18:15:03.714 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi062.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 2021-12-17T18:15:03.715 INFO:teuthology.task.ansible.out:smithi109.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 smithi125.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 smithi158.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 smithi192.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 Friday 17 December 2021 18:15:03 +0000 (0:00:00.290) 0:03:37.439 ******* =============================================================================== Create all admin users with sudo access. ------------------------------- 23.79s container-host : Install container packages ---------------------------- 17.08s users : Update authorized_keys using the keys repo --------------------- 10.30s testnode : Upgrade packages --------------------------------------------- 8.07s testnode : Install packages --------------------------------------------- 4.80s testnode : Update apt cache. -------------------------------------------- 2.36s Gathering Facts --------------------------------------------------------- 2.20s Gathering Facts --------------------------------------------------------- 2.07s container-host : Restart docker service --------------------------------- 1.95s testnode : Ensure packages are not present. ----------------------------- 1.24s Gathering Facts --------------------------------------------------------- 1.16s Gathering Facts --------------------------------------------------------- 1.06s testnode : Zap all non-root disks --------------------------------------- 1.01s Gathering Facts --------------------------------------------------------- 0.82s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.80s users : Clone the keys repo --------------------------------------------- 0.74s testnode : Install python-apt ---------------- 2021-12-17T18:15:03.717 INFO:teuthology.task.ansible.out:--------------------------- 0.73s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.72s testnode : Make sure apt dependencies are installed --------------------- 0.71s testnode : Install apt keys --------------------------------------------- 0.66s 2021-12-17T18:15:04.120 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi109.front.sepia.ceph.com'), Remote(name='ubuntu@smithi125.front.sepia.ceph.com'), Remote(name='ubuntu@smithi158.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2021-12-17T18:15:04.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2021-12-17T18:15:04.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:15:04.172 DEBUG:teuthology.orchestra.run.smithi062:> true 2021-12-17T18:15:04.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi109.front.sepia.ceph.com' 2021-12-17T18:15:04.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:15:04.342 DEBUG:teuthology.orchestra.run.smithi109:> true 2021-12-17T18:15:04.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2021-12-17T18:15:04.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:15:04.519 DEBUG:teuthology.orchestra.run.smithi125:> true 2021-12-17T18:15:04.636 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2021-12-17T18:15:04.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:15:04.684 DEBUG:teuthology.orchestra.run.smithi158:> true 2021-12-17T18:15:04.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2021-12-17T18:15:04.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-12-17T18:15:04.853 DEBUG:teuthology.orchestra.run.smithi192:> true 2021-12-17T18:15:04.972 INFO:teuthology.run_tasks:Running task clock... 2021-12-17T18:15:04.983 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-12-17T18:15:04.984 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-12-17T18:15:04.986 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-12-17T18:15:04.989 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-12-17T18:15:04.989 DEBUG:teuthology.orchestra.run.smithi109:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-12-17T18:15:04.992 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-12-17T18:15:04.992 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-12-17T18:15:04.995 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-12-17T18:15:04.995 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-12-17T18:15:04.998 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-12-17T18:15:04.998 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-12-17T18:15:05.021 INFO:teuthology.orchestra.run.smithi062.stdout:17 Dec 18:15:05 ntpd[9729]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-12-17T18:15:05.022 INFO:teuthology.orchestra.run.smithi062.stdout:17 Dec 18:15:05 ntpd[9729]: Command line: ntpd -gq 2021-12-17T18:15:05.023 INFO:teuthology.orchestra.run.smithi062.stdout:17 Dec 18:15:05 ntpd[9729]: proto: precision = 0.180 usec (-22) 2021-12-17T18:15:05.023 INFO:teuthology.orchestra.run.smithi062.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-12-17T18:15:05.024 INFO:teuthology.orchestra.run.smithi062.stdout:17 Dec 18:15:05 ntpd[9729]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-12-17T18:15:05.024 INFO:teuthology.orchestra.run.smithi062.stdout:17 Dec 18:15:05 ntpd[9729]: restrict ::: KOD does nothing without LIMITED. 2021-12-17T18:15:05.024 INFO:teuthology.orchestra.run.smithi062.stderr:restrict ::: KOD does nothing without LIMITED. 2021-12-17T18:15:05.025 INFO:teuthology.orchestra.run.smithi062.stdout:17 Dec 18:15:05 ntpd[9729]: Listen and drop on 0 v6wildcard [::]:123 2021-12-17T18:15:05.026 INFO:teuthology.orchestra.run.smithi062.stdout:17 Dec 18:15:05 ntpd[9729]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-12-17T18:15:05.026 INFO:teuthology.orchestra.run.smithi062.stdout:17 Dec 18:15:05 ntpd[9729]: Listen normally on 2 lo 127.0.0.1:123 2021-12-17T18:15:05.026 INFO:teuthology.orchestra.run.smithi062.stdout:17 Dec 18:15:05 ntpd[9729]: Listen normally on 3 enp3s0f1 172.21.15.62:123 2021-12-17T18:15:05.026 INFO:teuthology.orchestra.run.smithi062.stdout:17 Dec 18:15:05 ntpd[9729]: Listen normally on 4 lo [::1]:123 2021-12-17T18:15:05.027 INFO:teuthology.orchestra.run.smithi062.stdout:17 Dec 18:15:05 ntpd[9729]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:febb:d1c3%5]:123 2021-12-17T18:15:05.027 INFO:teuthology.orchestra.run.smithi062.stdout:17 Dec 18:15:05 ntpd[9729]: Listening on routing socket on fd #22 for interface updates 2021-12-17T18:15:05.028 INFO:teuthology.orchestra.run.smithi158.stdout:17 Dec 18:15:05 ntpd[9755]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-12-17T18:15:05.028 INFO:teuthology.orchestra.run.smithi158.stdout:17 Dec 18:15:05 ntpd[9755]: Command line: ntpd -gq 2021-12-17T18:15:05.028 INFO:teuthology.orchestra.run.smithi158.stdout:17 Dec 18:15:05 ntpd[9755]: proto: precision = 0.065 usec (-24) 2021-12-17T18:15:05.029 INFO:teuthology.orchestra.run.smithi158.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-12-17T18:15:05.029 INFO:teuthology.orchestra.run.smithi109.stdout:17 Dec 18:15:05 ntpd[9726]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-12-17T18:15:05.030 INFO:teuthology.orchestra.run.smithi109.stdout:17 Dec 18:15:05 ntpd[9726]: Command line: ntpd -gq 2021-12-17T18:15:05.030 INFO:teuthology.orchestra.run.smithi109.stdout:17 Dec 18:15:05 ntpd[9726]: proto: precision = 0.097 usec (-23) 2021-12-17T18:15:05.030 INFO:teuthology.orchestra.run.smithi109.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-12-17T18:15:05.031 INFO:teuthology.orchestra.run.smithi158.stdout:17 Dec 18:15:05 ntpd[9755]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-12-17T18:15:05.031 INFO:teuthology.orchestra.run.smithi158.stderr:restrict ::: KOD does nothing without LIMITED. 2021-12-17T18:15:05.032 INFO:teuthology.orchestra.run.smithi109.stdout:17 Dec 18:15:05 ntpd[9726]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-12-17T18:15:05.032 INFO:teuthology.orchestra.run.smithi109.stderr:restrict ::: KOD does nothing without LIMITED. 2021-12-17T18:15:05.035 INFO:teuthology.orchestra.run.smithi192.stdout:17 Dec 18:15:05 ntpd[9818]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-12-17T18:15:05.035 INFO:teuthology.orchestra.run.smithi192.stdout:17 Dec 18:15:05 ntpd[9818]: Command line: ntpd -gq 2021-12-17T18:15:05.036 INFO:teuthology.orchestra.run.smithi192.stdout:17 Dec 18:15:05 ntpd[9818]: proto: precision = 0.296 usec (-22) 2021-12-17T18:15:05.036 INFO:teuthology.orchestra.run.smithi125.stdout:17 Dec 18:15:05 ntpd[9691]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-12-17T18:15:05.036 INFO:teuthology.orchestra.run.smithi125.stdout:17 Dec 18:15:05 ntpd[9691]: Command line: ntpd -gq 2021-12-17T18:15:05.037 INFO:teuthology.orchestra.run.smithi125.stdout:17 Dec 18:15:05 ntpd[9691]: proto: precision = 0.090 usec (-23) 2021-12-17T18:15:05.037 INFO:teuthology.orchestra.run.smithi158.stdout:17 Dec 18:15:05 ntpd[9755]: restrict ::: KOD does nothing without LIMITED. 2021-12-17T18:15:05.037 INFO:teuthology.orchestra.run.smithi158.stdout:17 Dec 18:15:05 ntpd[9755]: Listen and drop on 0 v6wildcard [::]:123 2021-12-17T18:15:05.037 INFO:teuthology.orchestra.run.smithi158.stdout:17 Dec 18:15:05 ntpd[9755]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-12-17T18:15:05.038 INFO:teuthology.orchestra.run.smithi158.stdout:17 Dec 18:15:05 ntpd[9755]: Listen normally on 2 lo 127.0.0.1:123 2021-12-17T18:15:05.038 INFO:teuthology.orchestra.run.smithi158.stdout:17 Dec 18:15:05 ntpd[9755]: Listen normally on 3 enp3s0f1 172.21.15.158:123 2021-12-17T18:15:05.038 INFO:teuthology.orchestra.run.smithi158.stdout:17 Dec 18:15:05 ntpd[9755]: Listen normally on 4 lo [::1]:123 2021-12-17T18:15:05.038 INFO:teuthology.orchestra.run.smithi158.stdout:17 Dec 18:15:05 ntpd[9755]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:726f%5]:123 2021-12-17T18:15:05.039 INFO:teuthology.orchestra.run.smithi158.stdout:17 Dec 18:15:05 ntpd[9755]: Listening on routing socket on fd #22 for interface updates 2021-12-17T18:15:05.039 INFO:teuthology.orchestra.run.smithi192.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-12-17T18:15:05.039 INFO:teuthology.orchestra.run.smithi125.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-12-17T18:15:05.040 INFO:teuthology.orchestra.run.smithi109.stdout:17 Dec 18:15:05 ntpd[9726]: restrict ::: KOD does nothing without LIMITED. 2021-12-17T18:15:05.040 INFO:teuthology.orchestra.run.smithi109.stdout:17 Dec 18:15:05 ntpd[9726]: Listen and drop on 0 v6wildcard [::]:123 2021-12-17T18:15:05.040 INFO:teuthology.orchestra.run.smithi109.stdout:17 Dec 18:15:05 ntpd[9726]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-12-17T18:15:05.040 INFO:teuthology.orchestra.run.smithi109.stdout:17 Dec 18:15:05 ntpd[9726]: Listen normally on 2 lo 127.0.0.1:123 2021-12-17T18:15:05.040 INFO:teuthology.orchestra.run.smithi109.stdout:17 Dec 18:15:05 ntpd[9726]: Listen normally on 3 enp3s0f1 172.21.15.109:123 2021-12-17T18:15:05.041 INFO:teuthology.orchestra.run.smithi109.stdout:17 Dec 18:15:05 ntpd[9726]: Listen normally on 4 lo [::1]:123 2021-12-17T18:15:05.041 INFO:teuthology.orchestra.run.smithi109.stdout:17 Dec 18:15:05 ntpd[9726]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d729%5]:123 2021-12-17T18:15:05.041 INFO:teuthology.orchestra.run.smithi109.stdout:17 Dec 18:15:05 ntpd[9726]: Listening on routing socket on fd #22 for interface updates 2021-12-17T18:15:05.042 INFO:teuthology.orchestra.run.smithi192.stdout:17 Dec 18:15:05 ntpd[9818]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-12-17T18:15:05.042 INFO:teuthology.orchestra.run.smithi192.stdout:17 Dec 18:15:05 ntpd[9818]: restrict ::: KOD does nothing without LIMITED. 2021-12-17T18:15:05.042 INFO:teuthology.orchestra.run.smithi125.stdout:17 Dec 18:15:05 ntpd[9691]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-12-17T18:15:05.043 INFO:teuthology.orchestra.run.smithi192.stderr:restrict ::: KOD does nothing without LIMITED. 2021-12-17T18:15:05.043 INFO:teuthology.orchestra.run.smithi125.stderr:restrict ::: KOD does nothing without LIMITED. 2021-12-17T18:15:05.045 INFO:teuthology.orchestra.run.smithi192.stdout:17 Dec 18:15:05 ntpd[9818]: Listen and drop on 0 v6wildcard [::]:123 2021-12-17T18:15:05.046 INFO:teuthology.orchestra.run.smithi192.stdout:17 Dec 18:15:05 ntpd[9818]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-12-17T18:15:05.046 INFO:teuthology.orchestra.run.smithi192.stdout:17 Dec 18:15:05 ntpd[9818]: Listen normally on 2 lo 127.0.0.1:123 2021-12-17T18:15:05.046 INFO:teuthology.orchestra.run.smithi192.stdout:17 Dec 18:15:05 ntpd[9818]: Listen normally on 3 enp3s0f1 172.21.15.192:123 2021-12-17T18:15:05.046 INFO:teuthology.orchestra.run.smithi192.stdout:17 Dec 18:15:05 ntpd[9818]: Listen normally on 4 lo [::1]:123 2021-12-17T18:15:05.047 INFO:teuthology.orchestra.run.smithi192.stdout:17 Dec 18:15:05 ntpd[9818]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8049%5]:123 2021-12-17T18:15:05.047 INFO:teuthology.orchestra.run.smithi192.stdout:17 Dec 18:15:05 ntpd[9818]: Listening on routing socket on fd #22 for interface updates 2021-12-17T18:15:05.047 INFO:teuthology.orchestra.run.smithi125.stdout:17 Dec 18:15:05 ntpd[9691]: restrict ::: KOD does nothing without LIMITED. 2021-12-17T18:15:05.047 INFO:teuthology.orchestra.run.smithi125.stdout:17 Dec 18:15:05 ntpd[9691]: Listen and drop on 0 v6wildcard [::]:123 2021-12-17T18:15:05.048 INFO:teuthology.orchestra.run.smithi125.stdout:17 Dec 18:15:05 ntpd[9691]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-12-17T18:15:05.048 INFO:teuthology.orchestra.run.smithi125.stdout:17 Dec 18:15:05 ntpd[9691]: Listen normally on 2 lo 127.0.0.1:123 2021-12-17T18:15:05.048 INFO:teuthology.orchestra.run.smithi125.stdout:17 Dec 18:15:05 ntpd[9691]: Listen normally on 3 enp3s0f1 172.21.15.125:123 2021-12-17T18:15:05.048 INFO:teuthology.orchestra.run.smithi125.stdout:17 Dec 18:15:05 ntpd[9691]: Listen normally on 4 lo [::1]:123 2021-12-17T18:15:05.049 INFO:teuthology.orchestra.run.smithi125.stdout:17 Dec 18:15:05 ntpd[9691]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d739%5]:123 2021-12-17T18:15:05.049 INFO:teuthology.orchestra.run.smithi125.stdout:17 Dec 18:15:05 ntpd[9691]: Listening on routing socket on fd #22 for interface updates 2021-12-17T18:15:06.023 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:06 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:06.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:06 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:06.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:06 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:06.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:06 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:06.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:06 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:06.025 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:06 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:06.025 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:06 ntpd[9729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:06.025 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:06 ntpd[9729]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:06.025 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:06 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:06.026 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:06 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:06.026 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:06 ntpd[9729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:06.026 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:06 ntpd[9729]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:06.028 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:06 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:06.028 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:06 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:06.028 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:06 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:06.029 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:06 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:06.029 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:06 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:06.029 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:06 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:06.029 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:06 ntpd[9726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:06.029 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:06 ntpd[9726]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:06.030 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:06 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:06.030 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:06 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:06.030 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:06 ntpd[9726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:06.030 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:06 ntpd[9726]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:06.032 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:06 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:06.032 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:06 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:06.033 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:06 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:06.033 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:06 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:06.033 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:06 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:06.033 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:06 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:06.033 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:06 ntpd[9691]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:06.034 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:06 ntpd[9691]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:06.034 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:06 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:06.034 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:06 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:06.034 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:06 ntpd[9691]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:06.035 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:06 ntpd[9691]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:07.023 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:07 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:07.023 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:07 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:07.023 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:07 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:07.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:07 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:07.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:07 ntpd[9729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:07.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:07 ntpd[9729]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:07.028 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:07 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:07.028 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:07 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:07.029 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:07 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:07.029 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:07 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:07.029 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:07 ntpd[9755]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:07.029 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:07 ntpd[9755]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:07.034 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:07 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:07.035 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:07 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:07.035 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:07 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:07.035 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:07 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:07.035 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:07 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:07.036 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:07 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:07.036 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:07 ntpd[9818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:07.036 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:07 ntpd[9818]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:07.037 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:07 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:07.037 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:07 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:07.037 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:07 ntpd[9818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:07.037 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:07 ntpd[9818]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:08.023 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:08 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:08.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:08 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:08.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:08 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:08.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:08 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:08.025 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:08 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:08.025 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:08 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:08.025 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:08 ntpd[9729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:08.025 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:08 ntpd[9729]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:08.025 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:08 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:08.026 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:08 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:08.026 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:08 ntpd[9729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:08.026 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:08 ntpd[9729]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:08.028 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:08 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:08.028 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:08 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:08.028 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:08 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:08.029 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:08 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:08.029 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:08 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:08.029 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:08 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:08.029 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:08 ntpd[9726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:08.030 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:08 ntpd[9726]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:08.030 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:08 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:08.030 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:08 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:08.030 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:08 ntpd[9726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:08.030 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:08 ntpd[9726]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:08.032 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:08 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:08.033 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:08 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:08.033 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:08 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:08.033 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:08 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:08.033 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:08 ntpd[9755]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:08.034 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:08 ntpd[9755]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:08.034 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:08 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:08.035 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:08 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:08.035 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:08 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:08.035 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:08 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:08.035 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:08 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:08.036 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:08 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:08.036 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:08 ntpd[9691]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:08.036 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:08 ntpd[9691]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:08.036 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:08 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:08.037 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:08 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:08.037 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:08 ntpd[9691]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:08.037 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:08 ntpd[9691]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:08.038 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:08 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:08.038 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:08 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:08.039 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:08 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:08.039 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:08 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:08.039 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:08 ntpd[9818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:08.039 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:08 ntpd[9818]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:09.023 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:09 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:09.023 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:09 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:09.023 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:09 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:09.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:09 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:09.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:09 ntpd[9729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:09.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:09 ntpd[9729]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:09.027 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:09 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:09.027 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:09 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:09.027 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:09 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:09.028 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:09 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:09.028 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:09 ntpd[9726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:09.028 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:09 ntpd[9726]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:09.030 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:09 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:09.031 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:09 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:09.031 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:09 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:09.031 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:09 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:09.031 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:09 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:09.032 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:09 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:09.032 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:09 ntpd[9755]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:09.032 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:09 ntpd[9755]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:09.032 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:09 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:09.032 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:09 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:09.033 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:09 ntpd[9755]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:09.033 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:09 ntpd[9755]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:09.034 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:09 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:09.035 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:09 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:09.035 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:09 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:09.035 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:09 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:09.035 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:09 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:09.036 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:09 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:09.036 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:09 ntpd[9818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:09.036 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:09 ntpd[9818]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:09.036 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:09 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:09.037 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:09 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:09.037 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:09 ntpd[9818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:09.037 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:09 ntpd[9818]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:10.027 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.027 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.028 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.028 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.029 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.029 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.030 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.030 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.030 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:10.031 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:10.031 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.032 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.032 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:10.033 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:10.033 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.033 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.034 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:10.034 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:10 ntpd[9729]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:10.045 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:10 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.046 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:10 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.046 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:10 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.047 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:10 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.047 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:10 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.047 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:10 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.048 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:10 ntpd[9818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:10.048 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:10 ntpd[9818]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:10.049 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:10 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.049 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:10 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.050 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:10 ntpd[9818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:10.050 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:10 ntpd[9818]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:10.053 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:10 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.054 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:10 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.054 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:10 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.055 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:10 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.055 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:10 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.056 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:10 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.056 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:10 ntpd[9755]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:10.056 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:10 ntpd[9755]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:10.056 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:10 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.057 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:10 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.057 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:10 ntpd[9755]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:10.057 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:10 ntpd[9755]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:10.058 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.058 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.058 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.058 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.059 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.059 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.059 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.060 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.060 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.060 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.061 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:10.061 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:10.062 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.062 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.062 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:10.063 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:10.063 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.063 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.064 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:10.064 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:10.064 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.064 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.064 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:10.065 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:10 ntpd[9691]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:10.065 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.065 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.065 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.066 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.066 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.066 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.067 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.067 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.067 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:10.067 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:10.068 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.068 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.068 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:10.068 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:10.069 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:10.069 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:10.069 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:10.069 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:10 ntpd[9726]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:11.023 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:11 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:11.023 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:11 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:11.023 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:11 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:11.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:11 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:11.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:11 ntpd[9729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:11.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:11 ntpd[9729]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:11.027 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:11 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:11.027 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:11 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:11.027 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:11 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:11.028 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:11 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:11.028 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:11 ntpd[9726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:11.028 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:11 ntpd[9726]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:11.030 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:11 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:11.031 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:11 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:11.031 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:11 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:11.031 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:11 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:11.031 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:11 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:11.032 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:11 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:11.032 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:11 ntpd[9755]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:11.032 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:11 ntpd[9755]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:11.032 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:11 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:11.032 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:11 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:11.033 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:11 ntpd[9755]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:11.033 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:11 ntpd[9755]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:11.034 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:11 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:11.035 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:11 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:11.035 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:11 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:11.035 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:11 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:11.035 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:11 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:11.036 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:11 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:11.036 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:11 ntpd[9818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:11.036 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:11 ntpd[9818]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:11.036 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:11 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:11.037 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:11 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:11.037 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:11 ntpd[9818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:11.037 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:11 ntpd[9818]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:12.023 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:12 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:12 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:12 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:12 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.024 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:12 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.025 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:12 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.025 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:12 ntpd[9729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.025 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:12 ntpd[9729]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.025 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:12 ntpd[9729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:12.026 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:12 ntpd[9729]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:12.026 INFO:teuthology.orchestra.run.smithi062.stdout:17 Dec 18:15:12 ntpd[9729]: ntpd: time slew -0.000928 s 2021-12-17T18:15:12.026 INFO:teuthology.orchestra.run.smithi062.stdout:ntpd: time slew -0.000928s 2021-12-17T18:15:12.027 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:12 ntpd[9729]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-12-17T18:15:12.027 INFO:teuthology.orchestra.run.smithi062.stderr:17 Dec 18:15:12 ntpd[9729]: can't open /var/log/ntpstats/loopstats.20211217: Permission denied 2021-12-17T18:15:12.030 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:12 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.030 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:12 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.030 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:12 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.031 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:12 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.031 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:12 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.031 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:12 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.031 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:12 ntpd[9726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.032 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:12 ntpd[9726]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.032 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:12 ntpd[9726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:12.032 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:12 ntpd[9726]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:12.033 INFO:teuthology.orchestra.run.smithi109.stdout:17 Dec 18:15:12 ntpd[9726]: ntpd: time slew +0.000594 s 2021-12-17T18:15:12.033 INFO:teuthology.orchestra.run.smithi109.stdout:ntpd: time slew +0.000594s 2021-12-17T18:15:12.034 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:12 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.034 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:12 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.034 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:12 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.035 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:12 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.035 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:12 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.035 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:12 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.035 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:12 ntpd[9755]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:12.036 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:12 ntpd[9755]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:12.036 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:12 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.036 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:12 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.036 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:12 ntpd[9755]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:12.036 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:12 ntpd[9755]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:12.037 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:12 ntpd[9726]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-12-17T18:15:12.037 INFO:teuthology.orchestra.run.smithi109.stderr:17 Dec 18:15:12 ntpd[9726]: can't open /var/log/ntpstats/loopstats.20211217: Permission denied 2021-12-17T18:15:12.040 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:12 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.040 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:12 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.040 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:12 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.040 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:12 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.041 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:12 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.041 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:12 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.041 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:12 ntpd[9818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:12.041 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:12 ntpd[9818]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:12.041 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:12 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.042 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:12 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.042 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:12 ntpd[9818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:12.042 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:12 ntpd[9818]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:12.043 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.043 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.043 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.044 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.044 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.044 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.044 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.044 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.045 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.045 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.045 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:12.045 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:12.046 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:12.046 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:12.046 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:12.046 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:12.047 INFO:teuthology.orchestra.run.smithi125.stdout:17 Dec 18:15:12 ntpd[9691]: ntpd: time slew +0.000857 s 2021-12-17T18:15:12.047 INFO:teuthology.orchestra.run.smithi125.stdout:ntpd: time slew +0.000857s 2021-12-17T18:15:12.047 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-12-17T18:15:12.048 INFO:teuthology.orchestra.run.smithi125.stderr:17 Dec 18:15:12 ntpd[9691]: can't open /var/log/ntpstats/loopstats.20211217: Permission denied 2021-12-17T18:15:12.088 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2021-12-17T18:15:12.089 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2021-12-17T18:15:12.089 INFO:teuthology.orchestra.run.smithi062.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:12.089 INFO:teuthology.orchestra.run.smithi062.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:12.089 INFO:teuthology.orchestra.run.smithi062.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:12.090 INFO:teuthology.orchestra.run.smithi062.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:12.097 INFO:teuthology.orchestra.run.smithi109.stdout: remote refid st t when poll reach delay offset jitter 2021-12-17T18:15:12.098 INFO:teuthology.orchestra.run.smithi109.stdout:============================================================================== 2021-12-17T18:15:12.098 INFO:teuthology.orchestra.run.smithi109.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:12.098 INFO:teuthology.orchestra.run.smithi109.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:12.098 INFO:teuthology.orchestra.run.smithi109.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:12.099 INFO:teuthology.orchestra.run.smithi109.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:12.264 INFO:teuthology.orchestra.run.smithi125.stdout: remote refid st t when poll reach delay offset jitter 2021-12-17T18:15:12.265 INFO:teuthology.orchestra.run.smithi125.stdout:============================================================================== 2021-12-17T18:15:12.265 INFO:teuthology.orchestra.run.smithi125.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:12.265 INFO:teuthology.orchestra.run.smithi125.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:12.266 INFO:teuthology.orchestra.run.smithi125.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:12.266 INFO:teuthology.orchestra.run.smithi125.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:13.029 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:13 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:13.029 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:13 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:13.029 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:13 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:13.030 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:13 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:13.030 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:13 ntpd[9755]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:13.030 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:13 ntpd[9755]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:13.030 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:13 ntpd[9755]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:13.031 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:13 ntpd[9755]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:13.031 INFO:teuthology.orchestra.run.smithi158.stdout:17 Dec 18:15:13 ntpd[9755]: ntpd: time slew +0.000952 s 2021-12-17T18:15:13.032 INFO:teuthology.orchestra.run.smithi158.stdout:ntpd: time slew +0.000952s 2021-12-17T18:15:13.032 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:13 ntpd[9755]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-12-17T18:15:13.032 INFO:teuthology.orchestra.run.smithi158.stderr:17 Dec 18:15:13 ntpd[9755]: can't open /var/log/ntpstats/loopstats.20211217: Permission denied 2021-12-17T18:15:13.034 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:13 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:13.034 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:13 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:13.035 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:13 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:13.035 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:13 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:13.035 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:13 ntpd[9818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-12-17T18:15:13.035 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:13 ntpd[9818]: can't open /var/log/ntpstats/rawstats.20211217: Permission denied 2021-12-17T18:15:13.036 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:13 ntpd[9818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-12-17T18:15:13.036 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:13 ntpd[9818]: can't open /var/log/ntpstats/peerstats.20211217: Permission denied 2021-12-17T18:15:13.036 INFO:teuthology.orchestra.run.smithi192.stdout:17 Dec 18:15:13 ntpd[9818]: ntpd: time slew +0.000989 s 2021-12-17T18:15:13.037 INFO:teuthology.orchestra.run.smithi192.stdout:ntpd: time slew +0.000989s 2021-12-17T18:15:13.037 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:13 ntpd[9818]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-12-17T18:15:13.037 INFO:teuthology.orchestra.run.smithi192.stderr:17 Dec 18:15:13 ntpd[9818]: can't open /var/log/ntpstats/loopstats.20211217: Permission denied 2021-12-17T18:15:13.095 INFO:teuthology.orchestra.run.smithi192.stdout: remote refid st t when poll reach delay offset jitter 2021-12-17T18:15:13.095 INFO:teuthology.orchestra.run.smithi192.stdout:============================================================================== 2021-12-17T18:15:13.096 INFO:teuthology.orchestra.run.smithi192.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:13.096 INFO:teuthology.orchestra.run.smithi192.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:13.096 INFO:teuthology.orchestra.run.smithi192.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:13.096 INFO:teuthology.orchestra.run.smithi192.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:13.108 INFO:teuthology.orchestra.run.smithi158.stdout: remote refid st t when poll reach delay offset jitter 2021-12-17T18:15:13.108 INFO:teuthology.orchestra.run.smithi158.stdout:============================================================================== 2021-12-17T18:15:13.109 INFO:teuthology.orchestra.run.smithi158.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:13.109 INFO:teuthology.orchestra.run.smithi158.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:13.109 INFO:teuthology.orchestra.run.smithi158.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:13.110 INFO:teuthology.orchestra.run.smithi158.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-12-17T18:15:13.111 INFO:teuthology.run_tasks:Running task install... 2021-12-17T18:15:13.123 DEBUG:teuthology.task.install:project ceph 2021-12-17T18:15:13.124 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '05c319fc280f505b26f579a01ab4d14d2f130a5b'}} 2021-12-17T18:15:13.124 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '05c319fc280f505b26f579a01ab4d14d2f130a5b'} 2021-12-17T18:15:13.125 INFO:teuthology.task.install:Using flavor: default 2021-12-17T18:15:13.131 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-12-17T18:15:13.132 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2021-12-17T18:15:13.132 DEBUG:teuthology.orchestra.run.smithi062:> sudo lsb_release -is 2021-12-17T18:15:13.183 INFO:teuthology.orchestra.run.smithi062.stdout:Ubuntu 2021-12-17T18:15:13.188 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-12-17T18:15:13.189 DEBUG:teuthology.orchestra.run.smithi109:> sudo lsb_release -is 2021-12-17T18:15:13.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-key list | grep Ceph 2021-12-17T18:15:13.241 INFO:teuthology.orchestra.run.smithi109.stdout:Ubuntu 2021-12-17T18:15:13.246 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-12-17T18:15:13.247 DEBUG:teuthology.orchestra.run.smithi125:> sudo lsb_release -is 2021-12-17T18:15:13.247 DEBUG:teuthology.orchestra.run.smithi109:> sudo apt-key list | grep Ceph 2021-12-17T18:15:13.292 INFO:teuthology.orchestra.run.smithi062.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-12-17T18:15:13.297 INFO:teuthology.orchestra.run.smithi125.stdout:Ubuntu 2021-12-17T18:15:13.303 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-12-17T18:15:13.303 DEBUG:teuthology.orchestra.run.smithi158:> sudo lsb_release -is 2021-12-17T18:15:13.304 DEBUG:teuthology.orchestra.run.smithi125:> sudo apt-key list | grep Ceph 2021-12-17T18:15:13.343 INFO:teuthology.orchestra.run.smithi109.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-12-17T18:15:13.352 INFO:teuthology.orchestra.run.smithi158.stdout:Ubuntu 2021-12-17T18:15:13.356 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-12-17T18:15:13.356 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph.com (release key) 2021-12-17T18:15:13.358 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-12-17T18:15:13.361 DEBUG:teuthology.orchestra.run.smithi192:> sudo lsb_release -is 2021-12-17T18:15:13.362 DEBUG:teuthology.orchestra.run.smithi062:> sudo lsb_release -is 2021-12-17T18:15:13.363 DEBUG:teuthology.orchestra.run.smithi158:> sudo apt-key list | grep Ceph 2021-12-17T18:15:13.401 INFO:teuthology.orchestra.run.smithi109.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-12-17T18:15:13.402 INFO:teuthology.orchestra.run.smithi109.stdout:uid [ unknown] Ceph.com (release key) 2021-12-17T18:15:13.402 INFO:teuthology.orchestra.run.smithi125.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-12-17T18:15:13.403 DEBUG:teuthology.orchestra.run.smithi109:> sudo lsb_release -is 2021-12-17T18:15:13.413 INFO:teuthology.orchestra.run.smithi192.stdout:Ubuntu 2021-12-17T18:15:13.414 INFO:teuthology.orchestra.run.smithi062.stdout:Ubuntu 2021-12-17T18:15:13.418 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-12-17T18:15:13.419 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-key list | grep Ceph 2021-12-17T18:15:13.420 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-12-17T18:15:13.421 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-12-17T18:15:13.421 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-12-17T18:15:13.421 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=05c319fc280f505b26f579a01ab4d14d2f130a5b 2021-12-17T18:15:13.450 INFO:teuthology.orchestra.run.smithi109.stdout:Ubuntu 2021-12-17T18:15:13.456 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-12-17T18:15:13.456 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-12-17T18:15:13.456 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-12-17T18:15:13.457 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=05c319fc280f505b26f579a01ab4d14d2f130a5b 2021-12-17T18:15:13.469 INFO:teuthology.orchestra.run.smithi158.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-12-17T18:15:13.470 INFO:teuthology.orchestra.run.smithi125.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-12-17T18:15:13.470 INFO:teuthology.orchestra.run.smithi125.stdout:uid [ unknown] Ceph.com (release key) 2021-12-17T18:15:13.471 DEBUG:teuthology.orchestra.run.smithi125:> sudo lsb_release -is 2021-12-17T18:15:13.518 INFO:teuthology.orchestra.run.smithi125.stdout:Ubuntu 2021-12-17T18:15:13.521 INFO:teuthology.orchestra.run.smithi158.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-12-17T18:15:13.521 INFO:teuthology.orchestra.run.smithi158.stdout:uid [ unknown] Ceph.com (release key) 2021-12-17T18:15:13.522 DEBUG:teuthology.orchestra.run.smithi158:> sudo lsb_release -is 2021-12-17T18:15:13.524 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-12-17T18:15:13.524 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-12-17T18:15:13.524 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-12-17T18:15:13.525 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=05c319fc280f505b26f579a01ab4d14d2f130a5b 2021-12-17T18:15:13.530 INFO:teuthology.orchestra.run.smithi192.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-12-17T18:15:13.574 INFO:teuthology.orchestra.run.smithi158.stdout:Ubuntu 2021-12-17T18:15:13.580 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-12-17T18:15:13.580 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-12-17T18:15:13.581 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-12-17T18:15:13.581 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=05c319fc280f505b26f579a01ab4d14d2f130a5b 2021-12-17T18:15:13.590 INFO:teuthology.orchestra.run.smithi192.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-12-17T18:15:13.591 INFO:teuthology.orchestra.run.smithi192.stdout:uid [ unknown] Ceph.com (release key) 2021-12-17T18:15:13.592 DEBUG:teuthology.orchestra.run.smithi192:> sudo lsb_release -is 2021-12-17T18:15:13.628 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default/ 2021-12-17T18:15:13.629 INFO:teuthology.task.install.deb:Package version is 15.2.15-105-g05c319fc-1focal 2021-12-17T18:15:13.638 INFO:teuthology.orchestra.run.smithi192.stdout:Ubuntu 2021-12-17T18:15:13.644 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-12-17T18:15:13.644 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-12-17T18:15:13.644 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-12-17T18:15:13.645 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=05c319fc280f505b26f579a01ab4d14d2f130a5b 2021-12-17T18:15:13.682 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default/ 2021-12-17T18:15:13.683 INFO:teuthology.task.install.deb:Package version is 15.2.15-105-g05c319fc-1focal 2021-12-17T18:15:13.750 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default/ 2021-12-17T18:15:13.750 INFO:teuthology.task.install.deb:Package version is 15.2.15-105-g05c319fc-1focal 2021-12-17T18:15:13.788 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default/ 2021-12-17T18:15:13.788 INFO:teuthology.task.install.deb:Package version is 15.2.15-105-g05c319fc-1focal 2021-12-17T18:15:13.808 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-12-17T18:15:13.808 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-12-17T18:15:13.826 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2021-12-17T18:15:13.859 DEBUG:teuthology.orchestra.run.smithi109:> set -ex 2021-12-17T18:15:13.859 DEBUG:teuthology.orchestra.run.smithi109:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-12-17T18:15:13.865 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default/ 2021-12-17T18:15:13.866 INFO:teuthology.task.install.deb:Package version is 15.2.15-105-g05c319fc-1focal 2021-12-17T18:15:13.876 DEBUG:teuthology.orchestra.run.smithi109:> sudo apt-get update 2021-12-17T18:15:13.926 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2021-12-17T18:15:13.926 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-12-17T18:15:13.943 DEBUG:teuthology.orchestra.run.smithi125:> sudo apt-get update 2021-12-17T18:15:13.960 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2021-12-17T18:15:13.961 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-12-17T18:15:13.977 DEBUG:teuthology.orchestra.run.smithi158:> sudo apt-get update 2021-12-17T18:15:14.041 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2021-12-17T18:15:14.041 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-12-17T18:15:14.058 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get update 2021-12-17T18:15:14.134 INFO:teuthology.orchestra.run.smithi125.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-12-17T18:15:14.145 INFO:teuthology.orchestra.run.smithi109.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-12-17T18:15:14.145 INFO:teuthology.orchestra.run.smithi109.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal InRelease 2021-12-17T18:15:14.151 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-12-17T18:15:14.152 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal InRelease 2021-12-17T18:15:14.153 INFO:teuthology.orchestra.run.smithi109.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-12-17T18:15:14.154 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-12-17T18:15:14.167 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-12-17T18:15:14.180 INFO:teuthology.orchestra.run.smithi109.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-12-17T18:15:14.189 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-12-17T18:15:14.215 INFO:teuthology.orchestra.run.smithi109.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal Release.gpg 2021-12-17T18:15:14.215 INFO:teuthology.orchestra.run.smithi109.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-12-17T18:15:14.221 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-12-17T18:15:14.228 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal Release.gpg 2021-12-17T18:15:14.245 INFO:teuthology.orchestra.run.smithi125.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-12-17T18:15:14.249 INFO:teuthology.orchestra.run.smithi109.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-12-17T18:15:14.250 INFO:teuthology.orchestra.run.smithi125.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal InRelease 2021-12-17T18:15:14.266 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main i386 Packages [3,063 B] 2021-12-17T18:15:14.281 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-12-17T18:15:14.284 INFO:teuthology.orchestra.run.smithi158.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal InRelease 2021-12-17T18:15:14.289 INFO:teuthology.orchestra.run.smithi125.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-12-17T18:15:14.302 INFO:teuthology.orchestra.run.smithi109.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-12-17T18:15:14.303 INFO:teuthology.orchestra.run.smithi109.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main i386 Packages [3,063 B] 2021-12-17T18:15:14.304 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-12-17T18:15:14.321 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-12-17T18:15:14.322 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-12-17T18:15:14.328 INFO:teuthology.orchestra.run.smithi125.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal Release.gpg 2021-12-17T18:15:14.328 INFO:teuthology.orchestra.run.smithi125.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-12-17T18:15:14.355 INFO:teuthology.orchestra.run.smithi192.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal InRelease 2021-12-17T18:15:14.361 INFO:teuthology.orchestra.run.smithi158.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal Release.gpg 2021-12-17T18:15:14.363 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-12-17T18:15:14.365 INFO:teuthology.orchestra.run.smithi125.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main i386 Packages [3,063 B] 2021-12-17T18:15:14.377 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-12-17T18:15:14.377 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2021-12-17T18:15:14.389 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-12-17T18:15:14.399 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-12-17T18:15:14.410 INFO:teuthology.orchestra.run.smithi125.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-12-17T18:15:14.425 INFO:teuthology.orchestra.run.smithi192.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal Release.gpg 2021-12-17T18:15:14.438 INFO:teuthology.orchestra.run.smithi125.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-12-17T18:15:14.446 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-12-17T18:15:14.447 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-12-17T18:15:14.460 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-12-17T18:15:14.460 INFO:teuthology.orchestra.run.smithi158.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main i386 Packages [3,063 B] 2021-12-17T18:15:14.513 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main i386 Packages [3,063 B] 2021-12-17T18:15:14.530 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-12-17T18:15:14.774 INFO:teuthology.orchestra.run.smithi125.stdout:Fetched 26.5 kB in 1s (42.1 kB/s) 2021-12-17T18:15:14.811 INFO:teuthology.orchestra.run.smithi109.stdout:Fetched 26.5 kB in 1s (34.2 kB/s) 2021-12-17T18:15:14.822 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 26.5 kB in 1s (41.3 kB/s) 2021-12-17T18:15:14.841 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 26.5 kB in 1s (33.3 kB/s) 2021-12-17T18:15:15.026 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 26.5 kB in 1s (35.0 kB/s) 2021-12-17T18:15:15.579 INFO:teuthology.orchestra.run.smithi125.stdout:Reading package lists... 2021-12-17T18:15:15.601 DEBUG:teuthology.orchestra.run.smithi125:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-105-g05c319fc-1focal cephadm=15.2.15-105-g05c319fc-1focal ceph-mds=15.2.15-105-g05c319fc-1focal ceph-mgr=15.2.15-105-g05c319fc-1focal ceph-common=15.2.15-105-g05c319fc-1focal ceph-fuse=15.2.15-105-g05c319fc-1focal ceph-test=15.2.15-105-g05c319fc-1focal radosgw=15.2.15-105-g05c319fc-1focal python3-rados=15.2.15-105-g05c319fc-1focal python3-rgw=15.2.15-105-g05c319fc-1focal python3-cephfs=15.2.15-105-g05c319fc-1focal python3-rbd=15.2.15-105-g05c319fc-1focal libcephfs2=15.2.15-105-g05c319fc-1focal libcephfs-dev=15.2.15-105-g05c319fc-1focal librados2=15.2.15-105-g05c319fc-1focal librbd1=15.2.15-105-g05c319fc-1focal rbd-fuse=15.2.15-105-g05c319fc-1focal python3-cephfs=15.2.15-105-g05c319fc-1focal cephfs-shell=15.2.15-105-g05c319fc-1focal 2021-12-17T18:15:15.615 INFO:teuthology.orchestra.run.smithi109.stdout:Reading package lists... 2021-12-17T18:15:15.635 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2021-12-17T18:15:15.637 DEBUG:teuthology.orchestra.run.smithi109:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-105-g05c319fc-1focal cephadm=15.2.15-105-g05c319fc-1focal ceph-mds=15.2.15-105-g05c319fc-1focal ceph-mgr=15.2.15-105-g05c319fc-1focal ceph-common=15.2.15-105-g05c319fc-1focal ceph-fuse=15.2.15-105-g05c319fc-1focal ceph-test=15.2.15-105-g05c319fc-1focal radosgw=15.2.15-105-g05c319fc-1focal python3-rados=15.2.15-105-g05c319fc-1focal python3-rgw=15.2.15-105-g05c319fc-1focal python3-cephfs=15.2.15-105-g05c319fc-1focal python3-rbd=15.2.15-105-g05c319fc-1focal libcephfs2=15.2.15-105-g05c319fc-1focal libcephfs-dev=15.2.15-105-g05c319fc-1focal librados2=15.2.15-105-g05c319fc-1focal librbd1=15.2.15-105-g05c319fc-1focal rbd-fuse=15.2.15-105-g05c319fc-1focal python3-cephfs=15.2.15-105-g05c319fc-1focal cephfs-shell=15.2.15-105-g05c319fc-1focal 2021-12-17T18:15:15.658 DEBUG:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-105-g05c319fc-1focal cephadm=15.2.15-105-g05c319fc-1focal ceph-mds=15.2.15-105-g05c319fc-1focal ceph-mgr=15.2.15-105-g05c319fc-1focal ceph-common=15.2.15-105-g05c319fc-1focal ceph-fuse=15.2.15-105-g05c319fc-1focal ceph-test=15.2.15-105-g05c319fc-1focal radosgw=15.2.15-105-g05c319fc-1focal python3-rados=15.2.15-105-g05c319fc-1focal python3-rgw=15.2.15-105-g05c319fc-1focal python3-cephfs=15.2.15-105-g05c319fc-1focal python3-rbd=15.2.15-105-g05c319fc-1focal libcephfs2=15.2.15-105-g05c319fc-1focal libcephfs-dev=15.2.15-105-g05c319fc-1focal librados2=15.2.15-105-g05c319fc-1focal librbd1=15.2.15-105-g05c319fc-1focal rbd-fuse=15.2.15-105-g05c319fc-1focal python3-cephfs=15.2.15-105-g05c319fc-1focal cephfs-shell=15.2.15-105-g05c319fc-1focal 2021-12-17T18:15:15.664 INFO:teuthology.orchestra.run.smithi125.stdout:Reading package lists... 2021-12-17T18:15:15.673 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2021-12-17T18:15:15.695 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-105-g05c319fc-1focal cephadm=15.2.15-105-g05c319fc-1focal ceph-mds=15.2.15-105-g05c319fc-1focal ceph-mgr=15.2.15-105-g05c319fc-1focal ceph-common=15.2.15-105-g05c319fc-1focal ceph-fuse=15.2.15-105-g05c319fc-1focal ceph-test=15.2.15-105-g05c319fc-1focal radosgw=15.2.15-105-g05c319fc-1focal python3-rados=15.2.15-105-g05c319fc-1focal python3-rgw=15.2.15-105-g05c319fc-1focal python3-cephfs=15.2.15-105-g05c319fc-1focal python3-rbd=15.2.15-105-g05c319fc-1focal libcephfs2=15.2.15-105-g05c319fc-1focal libcephfs-dev=15.2.15-105-g05c319fc-1focal librados2=15.2.15-105-g05c319fc-1focal librbd1=15.2.15-105-g05c319fc-1focal rbd-fuse=15.2.15-105-g05c319fc-1focal python3-cephfs=15.2.15-105-g05c319fc-1focal cephfs-shell=15.2.15-105-g05c319fc-1focal 2021-12-17T18:15:15.703 INFO:teuthology.orchestra.run.smithi109.stdout:Reading package lists... 2021-12-17T18:15:15.730 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2021-12-17T18:15:15.762 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2021-12-17T18:15:15.832 INFO:teuthology.orchestra.run.smithi125.stdout:Building dependency tree... 2021-12-17T18:15:15.833 INFO:teuthology.orchestra.run.smithi125.stdout:Reading state information... 2021-12-17T18:15:15.841 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2021-12-17T18:15:15.864 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-105-g05c319fc-1focal cephadm=15.2.15-105-g05c319fc-1focal ceph-mds=15.2.15-105-g05c319fc-1focal ceph-mgr=15.2.15-105-g05c319fc-1focal ceph-common=15.2.15-105-g05c319fc-1focal ceph-fuse=15.2.15-105-g05c319fc-1focal ceph-test=15.2.15-105-g05c319fc-1focal radosgw=15.2.15-105-g05c319fc-1focal python3-rados=15.2.15-105-g05c319fc-1focal python3-rgw=15.2.15-105-g05c319fc-1focal python3-cephfs=15.2.15-105-g05c319fc-1focal python3-rbd=15.2.15-105-g05c319fc-1focal libcephfs2=15.2.15-105-g05c319fc-1focal libcephfs-dev=15.2.15-105-g05c319fc-1focal librados2=15.2.15-105-g05c319fc-1focal librbd1=15.2.15-105-g05c319fc-1focal rbd-fuse=15.2.15-105-g05c319fc-1focal python3-cephfs=15.2.15-105-g05c319fc-1focal cephfs-shell=15.2.15-105-g05c319fc-1focal 2021-12-17T18:15:15.871 INFO:teuthology.orchestra.run.smithi109.stdout:Building dependency tree... 2021-12-17T18:15:15.871 INFO:teuthology.orchestra.run.smithi109.stdout:Reading state information... 2021-12-17T18:15:15.898 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2021-12-17T18:15:15.899 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2021-12-17T18:15:15.933 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2021-12-17T18:15:15.935 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2021-12-17T18:15:15.935 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2021-12-17T18:15:15.974 INFO:teuthology.orchestra.run.smithi125.stdout:The following packages were automatically installed and are no longer required: 2021-12-17T18:15:15.975 INFO:teuthology.orchestra.run.smithi125.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-12-17T18:15:15.975 INFO:teuthology.orchestra.run.smithi125.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-12-17T18:15:15.975 INFO:teuthology.orchestra.run.smithi125.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-12-17T18:15:15.977 INFO:teuthology.orchestra.run.smithi125.stdout: linux-modules-extra-5.4.0-66-generic 2021-12-17T18:15:15.977 INFO:teuthology.orchestra.run.smithi125.stdout:Use 'sudo apt autoremove' to remove them. 2021-12-17T18:15:15.977 INFO:teuthology.orchestra.run.smithi125.stdout:The following additional packages will be installed: 2021-12-17T18:15:15.978 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-12-17T18:15:15.978 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-12-17T18:15:15.978 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-12-17T18:15:15.979 INFO:teuthology.orchestra.run.smithi125.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-12-17T18:15:15.979 INFO:teuthology.orchestra.run.smithi125.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-12-17T18:15:15.979 INFO:teuthology.orchestra.run.smithi125.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-12-17T18:15:15.979 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-12-17T18:15:15.980 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-12-17T18:15:15.980 INFO:teuthology.orchestra.run.smithi125.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-12-17T18:15:15.980 INFO:teuthology.orchestra.run.smithi125.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-12-17T18:15:15.980 INFO:teuthology.orchestra.run.smithi125.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-12-17T18:15:15.981 INFO:teuthology.orchestra.run.smithi125.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-12-17T18:15:15.981 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-12-17T18:15:15.981 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-12-17T18:15:15.981 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-12-17T18:15:15.982 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-12-17T18:15:15.982 INFO:teuthology.orchestra.run.smithi125.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-12-17T18:15:15.982 INFO:teuthology.orchestra.run.smithi125.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-12-17T18:15:15.982 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-12-17T18:15:15.983 INFO:teuthology.orchestra.run.smithi125.stdout: xmlstarlet 2021-12-17T18:15:15.983 INFO:teuthology.orchestra.run.smithi125.stdout:Suggested packages: 2021-12-17T18:15:15.983 INFO:teuthology.orchestra.run.smithi125.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-12-17T18:15:15.983 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-12-17T18:15:15.984 INFO:teuthology.orchestra.run.smithi125.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-12-17T18:15:15.984 INFO:teuthology.orchestra.run.smithi125.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-12-17T18:15:15.984 INFO:teuthology.orchestra.run.smithi125.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-12-17T18:15:15.984 INFO:teuthology.orchestra.run.smithi125.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-12-17T18:15:15.985 INFO:teuthology.orchestra.run.smithi125.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-12-17T18:15:15.985 INFO:teuthology.orchestra.run.smithi125.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-12-17T18:15:15.985 INFO:teuthology.orchestra.run.smithi125.stdout:Recommended packages: 2021-12-17T18:15:15.985 INFO:teuthology.orchestra.run.smithi125.stdout: btrfs-tools 2021-12-17T18:15:16.016 INFO:teuthology.orchestra.run.smithi109.stdout:The following packages were automatically installed and are no longer required: 2021-12-17T18:15:16.016 INFO:teuthology.orchestra.run.smithi109.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-12-17T18:15:16.017 INFO:teuthology.orchestra.run.smithi109.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-12-17T18:15:16.017 INFO:teuthology.orchestra.run.smithi109.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-12-17T18:15:16.017 INFO:teuthology.orchestra.run.smithi109.stdout: linux-modules-extra-5.4.0-66-generic 2021-12-17T18:15:16.017 INFO:teuthology.orchestra.run.smithi109.stdout:Use 'sudo apt autoremove' to remove them. 2021-12-17T18:15:16.018 INFO:teuthology.orchestra.run.smithi109.stdout:The following additional packages will be installed: 2021-12-17T18:15:16.018 INFO:teuthology.orchestra.run.smithi109.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-12-17T18:15:16.018 INFO:teuthology.orchestra.run.smithi109.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-12-17T18:15:16.018 INFO:teuthology.orchestra.run.smithi109.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-12-17T18:15:16.018 INFO:teuthology.orchestra.run.smithi109.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-12-17T18:15:16.019 INFO:teuthology.orchestra.run.smithi109.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-12-17T18:15:16.020 INFO:teuthology.orchestra.run.smithi109.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-12-17T18:15:16.020 INFO:teuthology.orchestra.run.smithi109.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-12-17T18:15:16.020 INFO:teuthology.orchestra.run.smithi109.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-12-17T18:15:16.021 INFO:teuthology.orchestra.run.smithi109.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-12-17T18:15:16.021 INFO:teuthology.orchestra.run.smithi109.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-12-17T18:15:16.021 INFO:teuthology.orchestra.run.smithi109.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-12-17T18:15:16.021 INFO:teuthology.orchestra.run.smithi109.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-12-17T18:15:16.022 INFO:teuthology.orchestra.run.smithi109.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-12-17T18:15:16.022 INFO:teuthology.orchestra.run.smithi109.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-12-17T18:15:16.022 INFO:teuthology.orchestra.run.smithi109.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-12-17T18:15:16.023 INFO:teuthology.orchestra.run.smithi109.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-12-17T18:15:16.023 INFO:teuthology.orchestra.run.smithi109.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-12-17T18:15:16.023 INFO:teuthology.orchestra.run.smithi109.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-12-17T18:15:16.023 INFO:teuthology.orchestra.run.smithi109.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-12-17T18:15:16.024 INFO:teuthology.orchestra.run.smithi109.stdout: xmlstarlet 2021-12-17T18:15:16.024 INFO:teuthology.orchestra.run.smithi109.stdout:Suggested packages: 2021-12-17T18:15:16.024 INFO:teuthology.orchestra.run.smithi109.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-12-17T18:15:16.024 INFO:teuthology.orchestra.run.smithi109.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-12-17T18:15:16.024 INFO:teuthology.orchestra.run.smithi109.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-12-17T18:15:16.025 INFO:teuthology.orchestra.run.smithi109.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-12-17T18:15:16.025 INFO:teuthology.orchestra.run.smithi109.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-12-17T18:15:16.025 INFO:teuthology.orchestra.run.smithi109.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-12-17T18:15:16.026 INFO:teuthology.orchestra.run.smithi109.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-12-17T18:15:16.026 INFO:teuthology.orchestra.run.smithi109.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-12-17T18:15:16.026 INFO:teuthology.orchestra.run.smithi109.stdout:Recommended packages: 2021-12-17T18:15:16.026 INFO:teuthology.orchestra.run.smithi109.stdout: btrfs-tools 2021-12-17T18:15:16.043 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages were automatically installed and are no longer required: 2021-12-17T18:15:16.044 INFO:teuthology.orchestra.run.smithi158.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-12-17T18:15:16.045 INFO:teuthology.orchestra.run.smithi158.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-12-17T18:15:16.045 INFO:teuthology.orchestra.run.smithi158.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-12-17T18:15:16.045 INFO:teuthology.orchestra.run.smithi158.stdout: linux-modules-extra-5.4.0-66-generic 2021-12-17T18:15:16.045 INFO:teuthology.orchestra.run.smithi158.stdout:Use 'sudo apt autoremove' to remove them. 2021-12-17T18:15:16.046 INFO:teuthology.orchestra.run.smithi158.stdout:The following additional packages will be installed: 2021-12-17T18:15:16.046 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-12-17T18:15:16.046 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-12-17T18:15:16.046 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-12-17T18:15:16.047 INFO:teuthology.orchestra.run.smithi158.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-12-17T18:15:16.048 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-12-17T18:15:16.049 INFO:teuthology.orchestra.run.smithi158.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-12-17T18:15:16.049 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-12-17T18:15:16.049 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-12-17T18:15:16.049 INFO:teuthology.orchestra.run.smithi158.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-12-17T18:15:16.050 INFO:teuthology.orchestra.run.smithi158.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-12-17T18:15:16.050 INFO:teuthology.orchestra.run.smithi158.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-12-17T18:15:16.050 INFO:teuthology.orchestra.run.smithi158.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-12-17T18:15:16.050 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-12-17T18:15:16.050 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-12-17T18:15:16.051 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-12-17T18:15:16.051 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-12-17T18:15:16.051 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-12-17T18:15:16.051 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-12-17T18:15:16.052 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-12-17T18:15:16.052 INFO:teuthology.orchestra.run.smithi158.stdout: xmlstarlet 2021-12-17T18:15:16.052 INFO:teuthology.orchestra.run.smithi158.stdout:Suggested packages: 2021-12-17T18:15:16.052 INFO:teuthology.orchestra.run.smithi158.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-12-17T18:15:16.052 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-12-17T18:15:16.053 INFO:teuthology.orchestra.run.smithi158.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-12-17T18:15:16.053 INFO:teuthology.orchestra.run.smithi158.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-12-17T18:15:16.053 INFO:teuthology.orchestra.run.smithi158.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-12-17T18:15:16.053 INFO:teuthology.orchestra.run.smithi158.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-12-17T18:15:16.054 INFO:teuthology.orchestra.run.smithi158.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-12-17T18:15:16.054 INFO:teuthology.orchestra.run.smithi158.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-12-17T18:15:16.054 INFO:teuthology.orchestra.run.smithi158.stdout:Recommended packages: 2021-12-17T18:15:16.054 INFO:teuthology.orchestra.run.smithi158.stdout: btrfs-tools 2021-12-17T18:15:16.083 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2021-12-17T18:15:16.083 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2021-12-17T18:15:16.086 INFO:teuthology.orchestra.run.smithi125.stdout:The following NEW packages will be installed: 2021-12-17T18:15:16.086 INFO:teuthology.orchestra.run.smithi125.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-12-17T18:15:16.086 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-12-17T18:15:16.087 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-12-17T18:15:16.087 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-12-17T18:15:16.087 INFO:teuthology.orchestra.run.smithi125.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-12-17T18:15:16.087 INFO:teuthology.orchestra.run.smithi125.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-12-17T18:15:16.088 INFO:teuthology.orchestra.run.smithi125.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-12-17T18:15:16.088 INFO:teuthology.orchestra.run.smithi125.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-12-17T18:15:16.088 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-12-17T18:15:16.088 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-12-17T18:15:16.089 INFO:teuthology.orchestra.run.smithi125.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-12-17T18:15:16.089 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-12-17T18:15:16.089 INFO:teuthology.orchestra.run.smithi125.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-12-17T18:15:16.090 INFO:teuthology.orchestra.run.smithi125.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-12-17T18:15:16.090 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-12-17T18:15:16.090 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-12-17T18:15:16.090 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-12-17T18:15:16.091 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-12-17T18:15:16.091 INFO:teuthology.orchestra.run.smithi125.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-12-17T18:15:16.091 INFO:teuthology.orchestra.run.smithi125.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-12-17T18:15:16.091 INFO:teuthology.orchestra.run.smithi125.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-12-17T18:15:16.092 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-12-17T18:15:16.092 INFO:teuthology.orchestra.run.smithi125.stdout:The following packages will be upgraded: 2021-12-17T18:15:16.092 INFO:teuthology.orchestra.run.smithi125.stdout: librados2 librbd1 2021-12-17T18:15:16.095 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2021-12-17T18:15:16.095 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-12-17T18:15:16.095 INFO:teuthology.orchestra.run.smithi062.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-12-17T18:15:16.096 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-12-17T18:15:16.096 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-extra-5.4.0-66-generic 2021-12-17T18:15:16.096 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2021-12-17T18:15:16.096 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2021-12-17T18:15:16.097 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-12-17T18:15:16.097 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-12-17T18:15:16.097 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-12-17T18:15:16.097 INFO:teuthology.orchestra.run.smithi062.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-12-17T18:15:16.098 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-12-17T18:15:16.098 INFO:teuthology.orchestra.run.smithi062.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-12-17T18:15:16.098 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-12-17T18:15:16.098 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-12-17T18:15:16.099 INFO:teuthology.orchestra.run.smithi062.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-12-17T18:15:16.099 INFO:teuthology.orchestra.run.smithi062.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-12-17T18:15:16.099 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-12-17T18:15:16.100 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-12-17T18:15:16.100 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-12-17T18:15:16.100 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-12-17T18:15:16.100 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-12-17T18:15:16.101 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-12-17T18:15:16.101 INFO:teuthology.orchestra.run.smithi062.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-12-17T18:15:16.101 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-12-17T18:15:16.101 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-12-17T18:15:16.102 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet 2021-12-17T18:15:16.102 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2021-12-17T18:15:16.102 INFO:teuthology.orchestra.run.smithi062.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-12-17T18:15:16.102 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-12-17T18:15:16.103 INFO:teuthology.orchestra.run.smithi062.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-12-17T18:15:16.103 INFO:teuthology.orchestra.run.smithi062.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-12-17T18:15:16.103 INFO:teuthology.orchestra.run.smithi062.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-12-17T18:15:16.103 INFO:teuthology.orchestra.run.smithi062.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-12-17T18:15:16.103 INFO:teuthology.orchestra.run.smithi062.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-12-17T18:15:16.104 INFO:teuthology.orchestra.run.smithi062.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-12-17T18:15:16.104 INFO:teuthology.orchestra.run.smithi062.stdout:Recommended packages: 2021-12-17T18:15:16.104 INFO:teuthology.orchestra.run.smithi062.stdout: btrfs-tools 2021-12-17T18:15:16.124 INFO:teuthology.orchestra.run.smithi109.stdout:The following NEW packages will be installed: 2021-12-17T18:15:16.124 INFO:teuthology.orchestra.run.smithi109.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-12-17T18:15:16.124 INFO:teuthology.orchestra.run.smithi109.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-12-17T18:15:16.125 INFO:teuthology.orchestra.run.smithi109.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-12-17T18:15:16.126 INFO:teuthology.orchestra.run.smithi109.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-12-17T18:15:16.126 INFO:teuthology.orchestra.run.smithi109.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-12-17T18:15:16.127 INFO:teuthology.orchestra.run.smithi109.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-12-17T18:15:16.127 INFO:teuthology.orchestra.run.smithi109.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-12-17T18:15:16.127 INFO:teuthology.orchestra.run.smithi109.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-12-17T18:15:16.127 INFO:teuthology.orchestra.run.smithi109.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-12-17T18:15:16.128 INFO:teuthology.orchestra.run.smithi109.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-12-17T18:15:16.128 INFO:teuthology.orchestra.run.smithi109.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-12-17T18:15:16.128 INFO:teuthology.orchestra.run.smithi109.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-12-17T18:15:16.128 INFO:teuthology.orchestra.run.smithi109.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-12-17T18:15:16.129 INFO:teuthology.orchestra.run.smithi109.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-12-17T18:15:16.129 INFO:teuthology.orchestra.run.smithi109.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-12-17T18:15:16.129 INFO:teuthology.orchestra.run.smithi109.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-12-17T18:15:16.129 INFO:teuthology.orchestra.run.smithi109.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-12-17T18:15:16.129 INFO:teuthology.orchestra.run.smithi109.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-12-17T18:15:16.130 INFO:teuthology.orchestra.run.smithi109.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-12-17T18:15:16.130 INFO:teuthology.orchestra.run.smithi109.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-12-17T18:15:16.130 INFO:teuthology.orchestra.run.smithi109.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-12-17T18:15:16.130 INFO:teuthology.orchestra.run.smithi109.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-12-17T18:15:16.131 INFO:teuthology.orchestra.run.smithi109.stdout:The following packages will be upgraded: 2021-12-17T18:15:16.131 INFO:teuthology.orchestra.run.smithi109.stdout: librados2 librbd1 2021-12-17T18:15:16.150 INFO:teuthology.orchestra.run.smithi158.stdout:The following NEW packages will be installed: 2021-12-17T18:15:16.150 INFO:teuthology.orchestra.run.smithi158.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-12-17T18:15:16.151 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-12-17T18:15:16.151 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-12-17T18:15:16.154 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-12-17T18:15:16.155 INFO:teuthology.orchestra.run.smithi158.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-12-17T18:15:16.155 INFO:teuthology.orchestra.run.smithi158.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-12-17T18:15:16.155 INFO:teuthology.orchestra.run.smithi158.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-12-17T18:15:16.155 INFO:teuthology.orchestra.run.smithi158.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-12-17T18:15:16.156 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-12-17T18:15:16.156 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-12-17T18:15:16.156 INFO:teuthology.orchestra.run.smithi158.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-12-17T18:15:16.156 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-12-17T18:15:16.157 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-12-17T18:15:16.157 INFO:teuthology.orchestra.run.smithi158.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-12-17T18:15:16.157 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-12-17T18:15:16.157 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-12-17T18:15:16.158 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-12-17T18:15:16.158 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-12-17T18:15:16.158 INFO:teuthology.orchestra.run.smithi158.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-12-17T18:15:16.158 INFO:teuthology.orchestra.run.smithi158.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-12-17T18:15:16.159 INFO:teuthology.orchestra.run.smithi158.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-12-17T18:15:16.159 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-12-17T18:15:16.159 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages will be upgraded: 2021-12-17T18:15:16.159 INFO:teuthology.orchestra.run.smithi158.stdout: librados2 librbd1 2021-12-17T18:15:16.195 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2021-12-17T18:15:16.196 INFO:teuthology.orchestra.run.smithi062.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-12-17T18:15:16.196 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-12-17T18:15:16.196 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-12-17T18:15:16.199 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-12-17T18:15:16.199 INFO:teuthology.orchestra.run.smithi062.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-12-17T18:15:16.199 INFO:teuthology.orchestra.run.smithi062.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-12-17T18:15:16.200 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-12-17T18:15:16.200 INFO:teuthology.orchestra.run.smithi062.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-12-17T18:15:16.200 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-12-17T18:15:16.201 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-12-17T18:15:16.201 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-12-17T18:15:16.201 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-12-17T18:15:16.201 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-12-17T18:15:16.202 INFO:teuthology.orchestra.run.smithi062.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-12-17T18:15:16.202 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-12-17T18:15:16.202 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-12-17T18:15:16.202 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-12-17T18:15:16.203 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-12-17T18:15:16.203 INFO:teuthology.orchestra.run.smithi062.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-12-17T18:15:16.203 INFO:teuthology.orchestra.run.smithi062.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-12-17T18:15:16.203 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-12-17T18:15:16.204 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-12-17T18:15:16.204 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages will be upgraded: 2021-12-17T18:15:16.204 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 librbd1 2021-12-17T18:15:16.211 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages were automatically installed and are no longer required: 2021-12-17T18:15:16.211 INFO:teuthology.orchestra.run.smithi192.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-12-17T18:15:16.211 INFO:teuthology.orchestra.run.smithi192.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-12-17T18:15:16.212 INFO:teuthology.orchestra.run.smithi192.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-12-17T18:15:16.212 INFO:teuthology.orchestra.run.smithi192.stdout: linux-modules-extra-5.4.0-66-generic 2021-12-17T18:15:16.212 INFO:teuthology.orchestra.run.smithi192.stdout:Use 'sudo apt autoremove' to remove them. 2021-12-17T18:15:16.212 INFO:teuthology.orchestra.run.smithi192.stdout:The following additional packages will be installed: 2021-12-17T18:15:16.213 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-12-17T18:15:16.213 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-12-17T18:15:16.214 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-12-17T18:15:16.215 INFO:teuthology.orchestra.run.smithi192.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-12-17T18:15:16.215 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-12-17T18:15:16.215 INFO:teuthology.orchestra.run.smithi192.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-12-17T18:15:16.215 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-12-17T18:15:16.216 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-12-17T18:15:16.216 INFO:teuthology.orchestra.run.smithi192.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-12-17T18:15:16.216 INFO:teuthology.orchestra.run.smithi192.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-12-17T18:15:16.216 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-12-17T18:15:16.217 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-12-17T18:15:16.217 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-12-17T18:15:16.218 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-12-17T18:15:16.218 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-12-17T18:15:16.218 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-12-17T18:15:16.219 INFO:teuthology.orchestra.run.smithi192.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-12-17T18:15:16.219 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-12-17T18:15:16.219 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-12-17T18:15:16.219 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet 2021-12-17T18:15:16.219 INFO:teuthology.orchestra.run.smithi192.stdout:Suggested packages: 2021-12-17T18:15:16.220 INFO:teuthology.orchestra.run.smithi192.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-12-17T18:15:16.220 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-12-17T18:15:16.220 INFO:teuthology.orchestra.run.smithi192.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-12-17T18:15:16.220 INFO:teuthology.orchestra.run.smithi192.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-12-17T18:15:16.221 INFO:teuthology.orchestra.run.smithi192.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-12-17T18:15:16.221 INFO:teuthology.orchestra.run.smithi192.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-12-17T18:15:16.221 INFO:teuthology.orchestra.run.smithi192.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-12-17T18:15:16.221 INFO:teuthology.orchestra.run.smithi192.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-12-17T18:15:16.222 INFO:teuthology.orchestra.run.smithi192.stdout:Recommended packages: 2021-12-17T18:15:16.222 INFO:teuthology.orchestra.run.smithi192.stdout: btrfs-tools 2021-12-17T18:15:16.276 INFO:teuthology.orchestra.run.smithi125.stdout:2 upgraded, 101 newly installed, 0 to remove and 70 not upgraded. 2021-12-17T18:15:16.277 INFO:teuthology.orchestra.run.smithi125.stdout:Need to get 153 MB of archives. 2021-12-17T18:15:16.277 INFO:teuthology.orchestra.run.smithi125.stdout:After this operation, 697 MB of additional disk space will be used. 2021-12-17T18:15:16.277 INFO:teuthology.orchestra.run.smithi125.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-12-17T18:15:16.294 INFO:teuthology.orchestra.run.smithi125.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-105-g05c319fc-1focal [1,694 kB] 2021-12-17T18:15:16.318 INFO:teuthology.orchestra.run.smithi109.stdout:2 upgraded, 101 newly installed, 0 to remove and 70 not upgraded. 2021-12-17T18:15:16.319 INFO:teuthology.orchestra.run.smithi109.stdout:Need to get 153 MB of archives. 2021-12-17T18:15:16.319 INFO:teuthology.orchestra.run.smithi109.stdout:After this operation, 697 MB of additional disk space will be used. 2021-12-17T18:15:16.319 INFO:teuthology.orchestra.run.smithi109.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-12-17T18:15:16.321 INFO:teuthology.orchestra.run.smithi192.stdout:The following NEW packages will be installed: 2021-12-17T18:15:16.321 INFO:teuthology.orchestra.run.smithi192.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-12-17T18:15:16.321 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-12-17T18:15:16.322 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-12-17T18:15:16.323 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-12-17T18:15:16.323 INFO:teuthology.orchestra.run.smithi192.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-12-17T18:15:16.323 INFO:teuthology.orchestra.run.smithi192.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-12-17T18:15:16.323 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-12-17T18:15:16.324 INFO:teuthology.orchestra.run.smithi192.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-12-17T18:15:16.324 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-12-17T18:15:16.324 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-12-17T18:15:16.324 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-12-17T18:15:16.325 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-12-17T18:15:16.325 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-12-17T18:15:16.325 INFO:teuthology.orchestra.run.smithi192.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-12-17T18:15:16.325 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-12-17T18:15:16.325 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-12-17T18:15:16.326 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-12-17T18:15:16.326 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-12-17T18:15:16.326 INFO:teuthology.orchestra.run.smithi192.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-12-17T18:15:16.326 INFO:teuthology.orchestra.run.smithi192.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-12-17T18:15:16.327 INFO:teuthology.orchestra.run.smithi192.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-12-17T18:15:16.327 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-12-17T18:15:16.327 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages will be upgraded: 2021-12-17T18:15:16.327 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 librbd1 2021-12-17T18:15:16.344 INFO:teuthology.orchestra.run.smithi158.stdout:2 upgraded, 101 newly installed, 0 to remove and 70 not upgraded. 2021-12-17T18:15:16.345 INFO:teuthology.orchestra.run.smithi158.stdout:Need to get 153 MB of archives. 2021-12-17T18:15:16.345 INFO:teuthology.orchestra.run.smithi158.stdout:After this operation, 697 MB of additional disk space will be used. 2021-12-17T18:15:16.345 INFO:teuthology.orchestra.run.smithi158.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-12-17T18:15:16.356 INFO:teuthology.orchestra.run.smithi109.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-105-g05c319fc-1focal [1,694 kB] 2021-12-17T18:15:16.360 INFO:teuthology.orchestra.run.smithi125.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-12-17T18:15:16.363 INFO:teuthology.orchestra.run.smithi158.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-105-g05c319fc-1focal [1,694 kB] 2021-12-17T18:15:16.367 INFO:teuthology.orchestra.run.smithi125.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-12-17T18:15:16.389 INFO:teuthology.orchestra.run.smithi062.stdout:2 upgraded, 101 newly installed, 0 to remove and 70 not upgraded. 2021-12-17T18:15:16.389 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 153 MB of archives. 2021-12-17T18:15:16.389 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 697 MB of additional disk space will be used. 2021-12-17T18:15:16.389 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-12-17T18:15:16.402 INFO:teuthology.orchestra.run.smithi109.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-12-17T18:15:16.426 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-105-g05c319fc-1focal [1,694 kB] 2021-12-17T18:15:16.429 INFO:teuthology.orchestra.run.smithi158.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-12-17T18:15:16.431 INFO:teuthology.orchestra.run.smithi109.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-12-17T18:15:16.458 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-12-17T18:15:16.472 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-12-17T18:15:16.476 INFO:teuthology.orchestra.run.smithi125.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-12-17T18:15:16.479 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-12-17T18:15:16.512 INFO:teuthology.orchestra.run.smithi192.stdout:2 upgraded, 101 newly installed, 0 to remove and 70 not upgraded. 2021-12-17T18:15:16.513 INFO:teuthology.orchestra.run.smithi192.stdout:Need to get 153 MB of archives. 2021-12-17T18:15:16.513 INFO:teuthology.orchestra.run.smithi192.stdout:After this operation, 697 MB of additional disk space will be used. 2021-12-17T18:15:16.513 INFO:teuthology.orchestra.run.smithi192.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-12-17T18:15:16.544 INFO:teuthology.orchestra.run.smithi125.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-105-g05c319fc-1focal [3,246 kB] 2021-12-17T18:15:16.546 INFO:teuthology.orchestra.run.smithi109.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-12-17T18:15:16.571 INFO:teuthology.orchestra.run.smithi158.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-12-17T18:15:16.573 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-105-g05c319fc-1focal [1,694 kB] 2021-12-17T18:15:16.588 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-12-17T18:15:16.596 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-12-17T18:15:16.625 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-12-17T18:15:16.632 INFO:teuthology.orchestra.run.smithi125.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-12-17T18:15:16.638 INFO:teuthology.orchestra.run.smithi125.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-12-17T18:15:16.651 INFO:teuthology.orchestra.run.smithi125.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-12-17T18:15:16.672 INFO:teuthology.orchestra.run.smithi109.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-105-g05c319fc-1focal [3,246 kB] 2021-12-17T18:15:16.674 INFO:teuthology.orchestra.run.smithi109.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-12-17T18:15:16.675 INFO:teuthology.orchestra.run.smithi109.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-12-17T18:15:16.693 INFO:teuthology.orchestra.run.smithi109.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-12-17T18:15:16.700 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-12-17T18:15:16.710 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-12-17T18:15:16.721 INFO:teuthology.orchestra.run.smithi158.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-12-17T18:15:16.737 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-12-17T18:15:16.739 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-12-17T18:15:16.739 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-12-17T18:15:16.740 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-12-17T18:15:16.759 INFO:teuthology.orchestra.run.smithi125.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-12-17T18:15:16.760 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-105-g05c319fc-1focal [3,246 kB] 2021-12-17T18:15:16.781 INFO:teuthology.orchestra.run.smithi125.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-12-17T18:15:16.787 INFO:teuthology.orchestra.run.smithi125.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-12-17T18:15:16.799 INFO:teuthology.orchestra.run.smithi109.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-12-17T18:15:16.812 INFO:teuthology.orchestra.run.smithi125.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-12-17T18:15:16.816 INFO:teuthology.orchestra.run.smithi125.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-12-17T18:15:16.820 INFO:teuthology.orchestra.run.smithi125.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-12-17T18:15:16.826 INFO:teuthology.orchestra.run.smithi109.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-12-17T18:15:16.828 INFO:teuthology.orchestra.run.smithi158.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-12-17T18:15:16.832 INFO:teuthology.orchestra.run.smithi109.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-12-17T18:15:16.835 INFO:teuthology.orchestra.run.smithi125.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-12-17T18:15:16.835 INFO:teuthology.orchestra.run.smithi125.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-12-17T18:15:16.838 INFO:teuthology.orchestra.run.smithi125.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-12-17T18:15:16.841 INFO:teuthology.orchestra.run.smithi125.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-105-g05c319fc-1focal [463 kB] 2021-12-17T18:15:16.846 INFO:teuthology.orchestra.run.smithi158.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-105-g05c319fc-1focal [3,246 kB] 2021-12-17T18:15:16.854 INFO:teuthology.orchestra.run.smithi158.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-12-17T18:15:16.855 INFO:teuthology.orchestra.run.smithi109.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-12-17T18:15:16.858 INFO:teuthology.orchestra.run.smithi109.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-12-17T18:15:16.859 INFO:teuthology.orchestra.run.smithi158.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-12-17T18:15:16.861 INFO:teuthology.orchestra.run.smithi109.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-12-17T18:15:16.862 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-12-17T18:15:16.869 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-12-17T18:15:16.874 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-12-17T18:15:16.876 INFO:teuthology.orchestra.run.smithi109.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-12-17T18:15:16.877 INFO:teuthology.orchestra.run.smithi109.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-12-17T18:15:16.879 INFO:teuthology.orchestra.run.smithi109.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-12-17T18:15:16.881 INFO:teuthology.orchestra.run.smithi125.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-12-17T18:15:16.884 INFO:teuthology.orchestra.run.smithi125.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-12-17T18:15:16.886 INFO:teuthology.orchestra.run.smithi158.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-12-17T18:15:16.886 INFO:teuthology.orchestra.run.smithi125.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-12-17T18:15:16.888 INFO:teuthology.orchestra.run.smithi158.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-12-17T18:15:16.889 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-12-17T18:15:16.891 INFO:teuthology.orchestra.run.smithi158.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-12-17T18:15:16.894 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-12-17T18:15:16.899 INFO:teuthology.orchestra.run.smithi125.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-105-g05c319fc-1focal [366 kB] 2021-12-17T18:15:16.900 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-12-17T18:15:16.905 INFO:teuthology.orchestra.run.smithi158.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-12-17T18:15:16.907 INFO:teuthology.orchestra.run.smithi158.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-12-17T18:15:16.907 INFO:teuthology.orchestra.run.smithi158.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-12-17T18:15:16.916 INFO:teuthology.orchestra.run.smithi125.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-105-g05c319fc-1focal [20.8 kB] 2021-12-17T18:15:16.917 INFO:teuthology.orchestra.run.smithi125.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-105-g05c319fc-1focal [156 kB] 2021-12-17T18:15:16.923 INFO:teuthology.orchestra.run.smithi109.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-12-17T18:15:16.925 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-12-17T18:15:16.926 INFO:teuthology.orchestra.run.smithi109.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-12-17T18:15:16.927 INFO:teuthology.orchestra.run.smithi109.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-12-17T18:15:16.931 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-12-17T18:15:16.933 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-12-17T18:15:16.948 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-12-17T18:15:16.949 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-12-17T18:15:16.950 INFO:teuthology.orchestra.run.smithi158.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-12-17T18:15:16.951 INFO:teuthology.orchestra.run.smithi125.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-105-g05c319fc-1focal [29.4 kB] 2021-12-17T18:15:16.951 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-12-17T18:15:16.953 INFO:teuthology.orchestra.run.smithi125.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-105-g05c319fc-1focal [363 kB] 2021-12-17T18:15:16.953 INFO:teuthology.orchestra.run.smithi158.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-12-17T18:15:16.954 INFO:teuthology.orchestra.run.smithi158.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-12-17T18:15:16.963 INFO:teuthology.orchestra.run.smithi125.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-12-17T18:15:16.966 INFO:teuthology.orchestra.run.smithi125.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-12-17T18:15:16.967 INFO:teuthology.orchestra.run.smithi125.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-12-17T18:15:16.971 INFO:teuthology.orchestra.run.smithi125.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-12-17T18:15:16.974 INFO:teuthology.orchestra.run.smithi125.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-12-17T18:15:16.975 INFO:teuthology.orchestra.run.smithi125.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-12-17T18:15:16.986 INFO:teuthology.orchestra.run.smithi125.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-105-g05c319fc-1focal [3,144 kB] 2021-12-17T18:15:16.990 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-12-17T18:15:16.993 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-12-17T18:15:16.994 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-12-17T18:15:16.994 INFO:teuthology.orchestra.run.smithi125.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-12-17T18:15:16.998 INFO:teuthology.orchestra.run.smithi192.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-12-17T18:15:17.005 INFO:teuthology.orchestra.run.smithi109.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-12-17T18:15:17.008 INFO:teuthology.orchestra.run.smithi109.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-12-17T18:15:17.011 INFO:teuthology.orchestra.run.smithi109.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-12-17T18:15:17.013 INFO:teuthology.orchestra.run.smithi109.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-12-17T18:15:17.017 INFO:teuthology.orchestra.run.smithi109.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-12-17T18:15:17.018 INFO:teuthology.orchestra.run.smithi109.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-12-17T18:15:17.021 INFO:teuthology.orchestra.run.smithi192.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-12-17T18:15:17.027 INFO:teuthology.orchestra.run.smithi109.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-105-g05c319fc-1focal [463 kB] 2021-12-17T18:15:17.027 INFO:teuthology.orchestra.run.smithi192.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-12-17T18:15:17.034 INFO:teuthology.orchestra.run.smithi158.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-12-17T18:15:17.036 INFO:teuthology.orchestra.run.smithi109.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-12-17T18:15:17.037 INFO:teuthology.orchestra.run.smithi158.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-12-17T18:15:17.038 INFO:teuthology.orchestra.run.smithi158.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-12-17T18:15:17.042 INFO:teuthology.orchestra.run.smithi158.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-12-17T18:15:17.045 INFO:teuthology.orchestra.run.smithi125.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-12-17T18:15:17.046 INFO:teuthology.orchestra.run.smithi158.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-12-17T18:15:17.046 INFO:teuthology.orchestra.run.smithi125.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-12-17T18:15:17.047 INFO:teuthology.orchestra.run.smithi158.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-12-17T18:15:17.048 INFO:teuthology.orchestra.run.smithi125.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-12-17T18:15:17.052 INFO:teuthology.orchestra.run.smithi192.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-12-17T18:15:17.057 INFO:teuthology.orchestra.run.smithi192.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-12-17T18:15:17.060 INFO:teuthology.orchestra.run.smithi192.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-12-17T18:15:17.065 INFO:teuthology.orchestra.run.smithi158.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-12-17T18:15:17.072 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-12-17T18:15:17.073 INFO:teuthology.orchestra.run.smithi192.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-12-17T18:15:17.074 INFO:teuthology.orchestra.run.smithi192.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-12-17T18:15:17.075 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-12-17T18:15:17.076 INFO:teuthology.orchestra.run.smithi192.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-12-17T18:15:17.077 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-12-17T18:15:17.081 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-12-17T18:15:17.084 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-12-17T18:15:17.084 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-12-17T18:15:17.088 INFO:teuthology.orchestra.run.smithi109.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-12-17T18:15:17.088 INFO:teuthology.orchestra.run.smithi109.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-12-17T18:15:17.090 INFO:teuthology.orchestra.run.smithi109.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-12-17T18:15:17.098 INFO:teuthology.orchestra.run.smithi109.stdout:Get:33 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-105-g05c319fc-1focal [366 kB] 2021-12-17T18:15:17.106 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-12-17T18:15:17.116 INFO:teuthology.orchestra.run.smithi158.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-12-17T18:15:17.117 INFO:teuthology.orchestra.run.smithi158.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-12-17T18:15:17.118 INFO:teuthology.orchestra.run.smithi192.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-12-17T18:15:17.118 INFO:teuthology.orchestra.run.smithi109.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-105-g05c319fc-1focal [20.8 kB] 2021-12-17T18:15:17.119 INFO:teuthology.orchestra.run.smithi158.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-12-17T18:15:17.119 INFO:teuthology.orchestra.run.smithi109.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-105-g05c319fc-1focal [156 kB] 2021-12-17T18:15:17.121 INFO:teuthology.orchestra.run.smithi192.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-12-17T18:15:17.122 INFO:teuthology.orchestra.run.smithi192.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-12-17T18:15:17.129 INFO:teuthology.orchestra.run.smithi125.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-12-17T18:15:17.133 INFO:teuthology.orchestra.run.smithi125.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-12-17T18:15:17.136 INFO:teuthology.orchestra.run.smithi125.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-12-17T18:15:17.136 INFO:teuthology.orchestra.run.smithi125.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-12-17T18:15:17.139 INFO:teuthology.orchestra.run.smithi125.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-12-17T18:15:17.141 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-105-g05c319fc-1focal [463 kB] 2021-12-17T18:15:17.141 INFO:teuthology.orchestra.run.smithi125.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-12-17T18:15:17.142 INFO:teuthology.orchestra.run.smithi125.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-12-17T18:15:17.154 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-12-17T18:15:17.155 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-12-17T18:15:17.156 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-12-17T18:15:17.169 INFO:teuthology.orchestra.run.smithi109.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-12-17T18:15:17.176 INFO:teuthology.orchestra.run.smithi109.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-12-17T18:15:17.176 INFO:teuthology.orchestra.run.smithi109.stdout:Get:38 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-105-g05c319fc-1focal [29.4 kB] 2021-12-17T18:15:17.178 INFO:teuthology.orchestra.run.smithi109.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-105-g05c319fc-1focal [363 kB] 2021-12-17T18:15:17.179 INFO:teuthology.orchestra.run.smithi109.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-12-17T18:15:17.180 INFO:teuthology.orchestra.run.smithi109.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-12-17T18:15:17.183 INFO:teuthology.orchestra.run.smithi109.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-12-17T18:15:17.183 INFO:teuthology.orchestra.run.smithi109.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-12-17T18:15:17.185 INFO:teuthology.orchestra.run.smithi109.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-12-17T18:15:17.197 INFO:teuthology.orchestra.run.smithi109.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-105-g05c319fc-1focal [3,144 kB] 2021-12-17T18:15:17.198 INFO:teuthology.orchestra.run.smithi158.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-12-17T18:15:17.200 INFO:teuthology.orchestra.run.smithi192.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-12-17T18:15:17.203 INFO:teuthology.orchestra.run.smithi192.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-12-17T18:15:17.204 INFO:teuthology.orchestra.run.smithi192.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-12-17T18:15:17.205 INFO:teuthology.orchestra.run.smithi158.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-12-17T18:15:17.207 INFO:teuthology.orchestra.run.smithi158.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-12-17T18:15:17.207 INFO:teuthology.orchestra.run.smithi158.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-12-17T18:15:17.208 INFO:teuthology.orchestra.run.smithi192.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-12-17T18:15:17.210 INFO:teuthology.orchestra.run.smithi158.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-12-17T18:15:17.212 INFO:teuthology.orchestra.run.smithi158.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-12-17T18:15:17.213 INFO:teuthology.orchestra.run.smithi192.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-12-17T18:15:17.215 INFO:teuthology.orchestra.run.smithi192.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-12-17T18:15:17.215 INFO:teuthology.orchestra.run.smithi158.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-12-17T18:15:17.216 INFO:teuthology.orchestra.run.smithi125.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-12-17T18:15:17.217 INFO:teuthology.orchestra.run.smithi125.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-12-17T18:15:17.220 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-105-g05c319fc-1focal [366 kB] 2021-12-17T18:15:17.234 INFO:teuthology.orchestra.run.smithi192.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-12-17T18:15:17.241 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-12-17T18:15:17.247 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-12-17T18:15:17.248 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-105-g05c319fc-1focal [20.8 kB] 2021-12-17T18:15:17.249 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-12-17T18:15:17.250 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-12-17T18:15:17.252 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-105-g05c319fc-1focal [156 kB] 2021-12-17T18:15:17.253 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-12-17T18:15:17.255 INFO:teuthology.orchestra.run.smithi062.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-12-17T18:15:17.256 INFO:teuthology.orchestra.run.smithi062.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-12-17T18:15:17.259 INFO:teuthology.orchestra.run.smithi109.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-12-17T18:15:17.260 INFO:teuthology.orchestra.run.smithi109.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-12-17T18:15:17.287 INFO:teuthology.orchestra.run.smithi158.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-12-17T18:15:17.288 INFO:teuthology.orchestra.run.smithi158.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-12-17T18:15:17.289 INFO:teuthology.orchestra.run.smithi192.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-12-17T18:15:17.291 INFO:teuthology.orchestra.run.smithi192.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-12-17T18:15:17.292 INFO:teuthology.orchestra.run.smithi192.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-12-17T18:15:17.314 INFO:teuthology.orchestra.run.smithi062.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-105-g05c319fc-1focal [29.4 kB] 2021-12-17T18:15:17.315 INFO:teuthology.orchestra.run.smithi062.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-105-g05c319fc-1focal [363 kB] 2021-12-17T18:15:17.335 INFO:teuthology.orchestra.run.smithi125.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-105-g05c319fc-1focal [116 kB] 2021-12-17T18:15:17.343 INFO:teuthology.orchestra.run.smithi062.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-105-g05c319fc-1focal [3,144 kB] 2021-12-17T18:15:17.343 INFO:teuthology.orchestra.run.smithi125.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-105-g05c319fc-1focal [361 kB] 2021-12-17T18:15:17.344 INFO:teuthology.orchestra.run.smithi062.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-12-17T18:15:17.344 INFO:teuthology.orchestra.run.smithi062.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-12-17T18:15:17.402 INFO:teuthology.orchestra.run.smithi125.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-105-g05c319fc-1focal [20.0 MB] 2021-12-17T18:15:17.407 INFO:teuthology.orchestra.run.smithi192.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-12-17T18:15:17.417 INFO:teuthology.orchestra.run.smithi192.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-12-17T18:15:17.545 INFO:teuthology.orchestra.run.smithi192.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-12-17T18:15:17.546 INFO:teuthology.orchestra.run.smithi192.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-12-17T18:15:17.549 INFO:teuthology.orchestra.run.smithi192.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-12-17T18:15:17.551 INFO:teuthology.orchestra.run.smithi192.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-12-17T18:15:17.553 INFO:teuthology.orchestra.run.smithi192.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-12-17T18:15:17.554 INFO:teuthology.orchestra.run.smithi192.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-12-17T18:15:17.555 INFO:teuthology.orchestra.run.smithi192.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-12-17T18:15:17.609 INFO:teuthology.orchestra.run.smithi158.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-105-g05c319fc-1focal [463 kB] 2021-12-17T18:15:17.619 INFO:teuthology.orchestra.run.smithi109.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-105-g05c319fc-1focal [116 kB] 2021-12-17T18:15:17.623 INFO:teuthology.orchestra.run.smithi109.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-105-g05c319fc-1focal [361 kB] 2021-12-17T18:15:17.677 INFO:teuthology.orchestra.run.smithi158.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-105-g05c319fc-1focal [366 kB] 2021-12-17T18:15:17.694 INFO:teuthology.orchestra.run.smithi109.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-105-g05c319fc-1focal [20.0 MB] 2021-12-17T18:15:17.751 INFO:teuthology.orchestra.run.smithi125.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-12-17T18:15:17.776 INFO:teuthology.orchestra.run.smithi158.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-105-g05c319fc-1focal [20.8 kB] 2021-12-17T18:15:17.777 INFO:teuthology.orchestra.run.smithi158.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-105-g05c319fc-1focal [156 kB] 2021-12-17T18:15:17.936 INFO:teuthology.orchestra.run.smithi125.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-12-17T18:15:17.938 INFO:teuthology.orchestra.run.smithi125.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-12-17T18:15:17.947 INFO:teuthology.orchestra.run.smithi062.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-105-g05c319fc-1focal [116 kB] 2021-12-17T18:15:17.952 INFO:teuthology.orchestra.run.smithi062.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-105-g05c319fc-1focal [361 kB] 2021-12-17T18:15:17.957 INFO:teuthology.orchestra.run.smithi158.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-105-g05c319fc-1focal [29.4 kB] 2021-12-17T18:15:17.958 INFO:teuthology.orchestra.run.smithi158.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-105-g05c319fc-1focal [363 kB] 2021-12-17T18:15:17.966 INFO:teuthology.orchestra.run.smithi158.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-105-g05c319fc-1focal [3,144 kB] 2021-12-17T18:15:17.969 INFO:teuthology.orchestra.run.smithi109.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-12-17T18:15:18.005 INFO:teuthology.orchestra.run.smithi062.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-105-g05c319fc-1focal [20.0 MB] 2021-12-17T18:15:18.006 INFO:teuthology.orchestra.run.smithi062.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-12-17T18:15:18.021 INFO:teuthology.orchestra.run.smithi125.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-12-17T18:15:18.022 INFO:teuthology.orchestra.run.smithi125.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-12-17T18:15:18.022 INFO:teuthology.orchestra.run.smithi125.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-12-17T18:15:18.023 INFO:teuthology.orchestra.run.smithi125.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-12-17T18:15:18.024 INFO:teuthology.orchestra.run.smithi125.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-12-17T18:15:18.025 INFO:teuthology.orchestra.run.smithi125.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-12-17T18:15:18.025 INFO:teuthology.orchestra.run.smithi125.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-12-17T18:15:18.028 INFO:teuthology.orchestra.run.smithi158.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-12-17T18:15:18.047 INFO:teuthology.orchestra.run.smithi158.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-12-17T18:15:18.061 INFO:teuthology.orchestra.run.smithi062.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-12-17T18:15:18.064 INFO:teuthology.orchestra.run.smithi062.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-12-17T18:15:18.100 INFO:teuthology.orchestra.run.smithi109.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-12-17T18:15:18.103 INFO:teuthology.orchestra.run.smithi109.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-12-17T18:15:18.110 INFO:teuthology.orchestra.run.smithi158.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-12-17T18:15:18.113 INFO:teuthology.orchestra.run.smithi125.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-12-17T18:15:18.113 INFO:teuthology.orchestra.run.smithi125.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-12-17T18:15:18.144 INFO:teuthology.orchestra.run.smithi062.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-12-17T18:15:18.144 INFO:teuthology.orchestra.run.smithi062.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-12-17T18:15:18.147 INFO:teuthology.orchestra.run.smithi062.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-12-17T18:15:18.148 INFO:teuthology.orchestra.run.smithi062.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-12-17T18:15:18.148 INFO:teuthology.orchestra.run.smithi062.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-12-17T18:15:18.150 INFO:teuthology.orchestra.run.smithi062.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-12-17T18:15:18.150 INFO:teuthology.orchestra.run.smithi062.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-12-17T18:15:18.159 INFO:teuthology.orchestra.run.smithi158.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-12-17T18:15:18.159 INFO:teuthology.orchestra.run.smithi158.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-12-17T18:15:18.161 INFO:teuthology.orchestra.run.smithi158.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-12-17T18:15:18.161 INFO:teuthology.orchestra.run.smithi158.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-12-17T18:15:18.162 INFO:teuthology.orchestra.run.smithi158.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-12-17T18:15:18.163 INFO:teuthology.orchestra.run.smithi158.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-12-17T18:15:18.164 INFO:teuthology.orchestra.run.smithi158.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-12-17T18:15:18.182 INFO:teuthology.orchestra.run.smithi109.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-12-17T18:15:18.183 INFO:teuthology.orchestra.run.smithi109.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-12-17T18:15:18.184 INFO:teuthology.orchestra.run.smithi109.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-12-17T18:15:18.185 INFO:teuthology.orchestra.run.smithi192.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-12-17T18:15:18.186 INFO:teuthology.orchestra.run.smithi109.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-12-17T18:15:18.192 INFO:teuthology.orchestra.run.smithi109.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-12-17T18:15:18.192 INFO:teuthology.orchestra.run.smithi109.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-12-17T18:15:18.192 INFO:teuthology.orchestra.run.smithi109.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-12-17T18:15:18.197 INFO:teuthology.orchestra.run.smithi062.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-12-17T18:15:18.198 INFO:teuthology.orchestra.run.smithi062.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-12-17T18:15:18.201 INFO:teuthology.orchestra.run.smithi125.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-12-17T18:15:18.206 INFO:teuthology.orchestra.run.smithi125.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-12-17T18:15:18.209 INFO:teuthology.orchestra.run.smithi125.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-12-17T18:15:18.212 INFO:teuthology.orchestra.run.smithi125.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-12-17T18:15:18.214 INFO:teuthology.orchestra.run.smithi125.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-12-17T18:15:18.214 INFO:teuthology.orchestra.run.smithi158.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-12-17T18:15:18.215 INFO:teuthology.orchestra.run.smithi158.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-12-17T18:15:18.216 INFO:teuthology.orchestra.run.smithi125.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-12-17T18:15:18.218 INFO:teuthology.orchestra.run.smithi125.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-12-17T18:15:18.219 INFO:teuthology.orchestra.run.smithi125.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-12-17T18:15:18.241 INFO:teuthology.orchestra.run.smithi192.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-12-17T18:15:18.244 INFO:teuthology.orchestra.run.smithi192.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-12-17T18:15:18.275 INFO:teuthology.orchestra.run.smithi109.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-12-17T18:15:18.276 INFO:teuthology.orchestra.run.smithi109.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-12-17T18:15:18.277 INFO:teuthology.orchestra.run.smithi109.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-12-17T18:15:18.283 INFO:teuthology.orchestra.run.smithi062.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-12-17T18:15:18.289 INFO:teuthology.orchestra.run.smithi062.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-12-17T18:15:18.291 INFO:teuthology.orchestra.run.smithi125.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-12-17T18:15:18.292 INFO:teuthology.orchestra.run.smithi062.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-12-17T18:15:18.295 INFO:teuthology.orchestra.run.smithi062.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-12-17T18:15:18.296 INFO:teuthology.orchestra.run.smithi062.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-12-17T18:15:18.296 INFO:teuthology.orchestra.run.smithi109.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-12-17T18:15:18.297 INFO:teuthology.orchestra.run.smithi125.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-12-17T18:15:18.299 INFO:teuthology.orchestra.run.smithi062.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-12-17T18:15:18.301 INFO:teuthology.orchestra.run.smithi062.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-12-17T18:15:18.305 INFO:teuthology.orchestra.run.smithi062.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-12-17T18:15:18.305 INFO:teuthology.orchestra.run.smithi109.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-12-17T18:15:18.307 INFO:teuthology.orchestra.run.smithi158.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-12-17T18:15:18.308 INFO:teuthology.orchestra.run.smithi109.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-12-17T18:15:18.312 INFO:teuthology.orchestra.run.smithi109.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-12-17T18:15:18.312 INFO:teuthology.orchestra.run.smithi158.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-12-17T18:15:18.315 INFO:teuthology.orchestra.run.smithi158.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-12-17T18:15:18.319 INFO:teuthology.orchestra.run.smithi158.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-12-17T18:15:18.320 INFO:teuthology.orchestra.run.smithi158.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-12-17T18:15:18.323 INFO:teuthology.orchestra.run.smithi158.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-12-17T18:15:18.324 INFO:teuthology.orchestra.run.smithi192.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-12-17T18:15:18.326 INFO:teuthology.orchestra.run.smithi158.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-12-17T18:15:18.327 INFO:teuthology.orchestra.run.smithi192.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-12-17T18:15:18.327 INFO:teuthology.orchestra.run.smithi192.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-12-17T18:15:18.328 INFO:teuthology.orchestra.run.smithi192.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-12-17T18:15:18.331 INFO:teuthology.orchestra.run.smithi109.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-12-17T18:15:18.331 INFO:teuthology.orchestra.run.smithi158.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-12-17T18:15:18.332 INFO:teuthology.orchestra.run.smithi192.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-12-17T18:15:18.333 INFO:teuthology.orchestra.run.smithi192.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-12-17T18:15:18.333 INFO:teuthology.orchestra.run.smithi192.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-12-17T18:15:18.335 INFO:teuthology.orchestra.run.smithi109.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-12-17T18:15:18.338 INFO:teuthology.orchestra.run.smithi109.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-12-17T18:15:18.352 INFO:teuthology.orchestra.run.smithi192.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-12-17T18:15:18.352 INFO:teuthology.orchestra.run.smithi192.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-12-17T18:15:18.365 INFO:teuthology.orchestra.run.smithi062.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-12-17T18:15:18.372 INFO:teuthology.orchestra.run.smithi062.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-12-17T18:15:18.372 INFO:teuthology.orchestra.run.smithi125.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-12-17T18:15:18.373 INFO:teuthology.orchestra.run.smithi125.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-12-17T18:15:18.374 INFO:teuthology.orchestra.run.smithi125.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-12-17T18:15:18.376 INFO:teuthology.orchestra.run.smithi125.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-12-17T18:15:18.389 INFO:teuthology.orchestra.run.smithi158.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-12-17T18:15:18.394 INFO:teuthology.orchestra.run.smithi125.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-12-17T18:15:18.394 INFO:teuthology.orchestra.run.smithi125.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-12-17T18:15:18.395 INFO:teuthology.orchestra.run.smithi125.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-12-17T18:15:18.396 INFO:teuthology.orchestra.run.smithi158.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-12-17T18:15:18.396 INFO:teuthology.orchestra.run.smithi125.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-12-17T18:15:18.401 INFO:teuthology.orchestra.run.smithi109.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-12-17T18:15:18.409 INFO:teuthology.orchestra.run.smithi109.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-12-17T18:15:18.410 INFO:teuthology.orchestra.run.smithi109.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-12-17T18:15:18.410 INFO:teuthology.orchestra.run.smithi109.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-12-17T18:15:18.411 INFO:teuthology.orchestra.run.smithi109.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-12-17T18:15:18.413 INFO:teuthology.orchestra.run.smithi109.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-12-17T18:15:18.434 INFO:teuthology.orchestra.run.smithi192.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-12-17T18:15:18.439 INFO:teuthology.orchestra.run.smithi192.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-12-17T18:15:18.442 INFO:teuthology.orchestra.run.smithi192.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-12-17T18:15:18.445 INFO:teuthology.orchestra.run.smithi192.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-12-17T18:15:18.447 INFO:teuthology.orchestra.run.smithi192.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-12-17T18:15:18.448 INFO:teuthology.orchestra.run.smithi062.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-12-17T18:15:18.449 INFO:teuthology.orchestra.run.smithi062.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-12-17T18:15:18.451 INFO:teuthology.orchestra.run.smithi192.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-12-17T18:15:18.452 INFO:teuthology.orchestra.run.smithi062.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-12-17T18:15:18.452 INFO:teuthology.orchestra.run.smithi192.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-12-17T18:15:18.453 INFO:teuthology.orchestra.run.smithi062.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-12-17T18:15:18.454 INFO:teuthology.orchestra.run.smithi192.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-12-17T18:15:18.460 INFO:teuthology.orchestra.run.smithi125.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-12-17T18:15:18.461 INFO:teuthology.orchestra.run.smithi125.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-12-17T18:15:18.471 INFO:teuthology.orchestra.run.smithi062.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-12-17T18:15:18.472 INFO:teuthology.orchestra.run.smithi062.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-12-17T18:15:18.473 INFO:teuthology.orchestra.run.smithi158.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-12-17T18:15:18.473 INFO:teuthology.orchestra.run.smithi062.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-12-17T18:15:18.473 INFO:teuthology.orchestra.run.smithi062.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-12-17T18:15:18.474 INFO:teuthology.orchestra.run.smithi158.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-12-17T18:15:18.474 INFO:teuthology.orchestra.run.smithi158.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-12-17T18:15:18.476 INFO:teuthology.orchestra.run.smithi158.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-12-17T18:15:18.484 INFO:teuthology.orchestra.run.smithi109.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-12-17T18:15:18.485 INFO:teuthology.orchestra.run.smithi109.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-12-17T18:15:18.487 INFO:teuthology.orchestra.run.smithi109.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-12-17T18:15:18.487 INFO:teuthology.orchestra.run.smithi109.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-12-17T18:15:18.496 INFO:teuthology.orchestra.run.smithi158.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-12-17T18:15:18.496 INFO:teuthology.orchestra.run.smithi158.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-12-17T18:15:18.497 INFO:teuthology.orchestra.run.smithi158.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-12-17T18:15:18.498 INFO:teuthology.orchestra.run.smithi158.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-12-17T18:15:18.516 INFO:teuthology.orchestra.run.smithi192.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-12-17T18:15:18.523 INFO:teuthology.orchestra.run.smithi192.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-12-17T18:15:18.531 INFO:teuthology.orchestra.run.smithi062.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-12-17T18:15:18.533 INFO:teuthology.orchestra.run.smithi062.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-12-17T18:15:18.537 INFO:teuthology.orchestra.run.smithi158.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-105-g05c319fc-1focal [116 kB] 2021-12-17T18:15:18.541 INFO:teuthology.orchestra.run.smithi125.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-12-17T18:15:18.545 INFO:teuthology.orchestra.run.smithi125.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-12-17T18:15:18.546 INFO:teuthology.orchestra.run.smithi158.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-105-g05c319fc-1focal [361 kB] 2021-12-17T18:15:18.554 INFO:teuthology.orchestra.run.smithi158.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-12-17T18:15:18.556 INFO:teuthology.orchestra.run.smithi158.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-12-17T18:15:18.566 INFO:teuthology.orchestra.run.smithi109.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-12-17T18:15:18.568 INFO:teuthology.orchestra.run.smithi109.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-12-17T18:15:18.569 INFO:teuthology.orchestra.run.smithi109.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-12-17T18:15:18.573 INFO:teuthology.orchestra.run.smithi109.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-12-17T18:15:18.594 INFO:teuthology.orchestra.run.smithi192.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-105-g05c319fc-1focal [3,246 kB] 2021-12-17T18:15:18.598 INFO:teuthology.orchestra.run.smithi192.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-12-17T18:15:18.599 INFO:teuthology.orchestra.run.smithi192.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-12-17T18:15:18.599 INFO:teuthology.orchestra.run.smithi192.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-12-17T18:15:18.601 INFO:teuthology.orchestra.run.smithi192.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-12-17T18:15:18.615 INFO:teuthology.orchestra.run.smithi062.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-12-17T18:15:18.619 INFO:teuthology.orchestra.run.smithi062.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-12-17T18:15:18.620 INFO:teuthology.orchestra.run.smithi192.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-12-17T18:15:18.621 INFO:teuthology.orchestra.run.smithi192.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-12-17T18:15:18.621 INFO:teuthology.orchestra.run.smithi192.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-12-17T18:15:18.622 INFO:teuthology.orchestra.run.smithi192.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-12-17T18:15:18.628 INFO:teuthology.orchestra.run.smithi158.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-105-g05c319fc-1focal [20.0 MB] 2021-12-17T18:15:18.636 INFO:teuthology.orchestra.run.smithi158.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-12-17T18:15:18.640 INFO:teuthology.orchestra.run.smithi158.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-12-17T18:15:18.680 INFO:teuthology.orchestra.run.smithi192.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-12-17T18:15:18.682 INFO:teuthology.orchestra.run.smithi192.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-12-17T18:15:18.762 INFO:teuthology.orchestra.run.smithi192.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-12-17T18:15:18.765 INFO:teuthology.orchestra.run.smithi192.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-12-17T18:15:20.126 INFO:teuthology.orchestra.run.smithi109.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-105-g05c319fc-1focal [5,336 kB] 2021-12-17T18:15:20.355 INFO:teuthology.orchestra.run.smithi125.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-105-g05c319fc-1focal [5,336 kB] 2021-12-17T18:15:20.414 INFO:teuthology.orchestra.run.smithi062.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-105-g05c319fc-1focal [5,336 kB] 2021-12-17T18:15:20.647 INFO:teuthology.orchestra.run.smithi109.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-105-g05c319fc-1focal [162 kB] 2021-12-17T18:15:20.667 INFO:teuthology.orchestra.run.smithi109.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-105-g05c319fc-1focal [1,402 kB] 2021-12-17T18:15:20.815 INFO:teuthology.orchestra.run.smithi125.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-105-g05c319fc-1focal [162 kB] 2021-12-17T18:15:20.830 INFO:teuthology.orchestra.run.smithi109.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-105-g05c319fc-1focal [6,172 kB] 2021-12-17T18:15:20.847 INFO:teuthology.orchestra.run.smithi125.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-105-g05c319fc-1focal [1,402 kB] 2021-12-17T18:15:21.013 INFO:teuthology.orchestra.run.smithi062.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-105-g05c319fc-1focal [162 kB] 2021-12-17T18:15:21.024 INFO:teuthology.orchestra.run.smithi062.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-105-g05c319fc-1focal [1,402 kB] 2021-12-17T18:15:21.026 INFO:teuthology.orchestra.run.smithi125.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-105-g05c319fc-1focal [6,172 kB] 2021-12-17T18:15:21.196 INFO:teuthology.orchestra.run.smithi062.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-105-g05c319fc-1focal [6,172 kB] 2021-12-17T18:15:21.389 INFO:teuthology.orchestra.run.smithi192.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-105-g05c319fc-1focal [463 kB] 2021-12-17T18:15:21.547 INFO:teuthology.orchestra.run.smithi109.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-105-g05c319fc-1focal [23.9 MB] 2021-12-17T18:15:21.729 INFO:teuthology.orchestra.run.smithi192.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-105-g05c319fc-1focal [366 kB] 2021-12-17T18:15:21.866 INFO:teuthology.orchestra.run.smithi125.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-105-g05c319fc-1focal [23.9 MB] 2021-12-17T18:15:21.960 INFO:teuthology.orchestra.run.smithi192.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-105-g05c319fc-1focal [20.8 kB] 2021-12-17T18:15:21.982 INFO:teuthology.orchestra.run.smithi062.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-105-g05c319fc-1focal [23.9 MB] 2021-12-17T18:15:22.004 INFO:teuthology.orchestra.run.smithi192.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-105-g05c319fc-1focal [156 kB] 2021-12-17T18:15:22.075 INFO:teuthology.orchestra.run.smithi192.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-105-g05c319fc-1focal [29.4 kB] 2021-12-17T18:15:22.130 INFO:teuthology.orchestra.run.smithi192.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-105-g05c319fc-1focal [363 kB] 2021-12-17T18:15:22.367 INFO:teuthology.orchestra.run.smithi192.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-105-g05c319fc-1focal [3,144 kB] 2021-12-17T18:15:22.607 INFO:teuthology.orchestra.run.smithi158.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-105-g05c319fc-1focal [5,336 kB] 2021-12-17T18:15:23.573 INFO:teuthology.orchestra.run.smithi158.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-105-g05c319fc-1focal [162 kB] 2021-12-17T18:15:23.610 INFO:teuthology.orchestra.run.smithi158.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-105-g05c319fc-1focal [1,402 kB] 2021-12-17T18:15:23.857 INFO:teuthology.orchestra.run.smithi158.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-105-g05c319fc-1focal [6,172 kB] 2021-12-17T18:15:24.130 INFO:teuthology.orchestra.run.smithi192.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-105-g05c319fc-1focal [116 kB] 2021-12-17T18:15:24.191 INFO:teuthology.orchestra.run.smithi192.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-105-g05c319fc-1focal [361 kB] 2021-12-17T18:15:24.373 INFO:teuthology.orchestra.run.smithi192.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-105-g05c319fc-1focal [20.0 MB] 2021-12-17T18:15:24.501 INFO:teuthology.orchestra.run.smithi109.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-105-g05c319fc-1focal [4,012 B] 2021-12-17T18:15:24.533 INFO:teuthology.orchestra.run.smithi109.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-105-g05c319fc-1focal [539 kB] 2021-12-17T18:15:24.544 INFO:teuthology.orchestra.run.smithi109.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-105-g05c319fc-1focal [2,006 kB] 2021-12-17T18:15:24.738 INFO:teuthology.orchestra.run.smithi109.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-105-g05c319fc-1focal [53.2 kB] 2021-12-17T18:15:24.741 INFO:teuthology.orchestra.run.smithi109.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-105-g05c319fc-1focal [58.2 kB] 2021-12-17T18:15:24.764 INFO:teuthology.orchestra.run.smithi109.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-105-g05c319fc-1focal [3,208 kB] 2021-12-17T18:15:24.983 INFO:teuthology.orchestra.run.smithi158.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-105-g05c319fc-1focal [23.9 MB] 2021-12-17T18:15:25.100 INFO:teuthology.orchestra.run.smithi062.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-105-g05c319fc-1focal [4,012 B] 2021-12-17T18:15:25.100 INFO:teuthology.orchestra.run.smithi062.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-105-g05c319fc-1focal [539 kB] 2021-12-17T18:15:25.120 INFO:teuthology.orchestra.run.smithi062.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-105-g05c319fc-1focal [2,006 kB] 2021-12-17T18:15:25.152 INFO:teuthology.orchestra.run.smithi109.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-105-g05c319fc-1focal [34.4 kB] 2021-12-17T18:15:25.154 INFO:teuthology.orchestra.run.smithi109.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-105-g05c319fc-1focal [7,888 kB] 2021-12-17T18:15:25.272 INFO:teuthology.orchestra.run.smithi125.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-105-g05c319fc-1focal [4,012 B] 2021-12-17T18:15:25.273 INFO:teuthology.orchestra.run.smithi125.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-105-g05c319fc-1focal [539 kB] 2021-12-17T18:15:25.280 INFO:teuthology.orchestra.run.smithi125.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-105-g05c319fc-1focal [2,006 kB] 2021-12-17T18:15:25.369 INFO:teuthology.orchestra.run.smithi062.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-105-g05c319fc-1focal [53.2 kB] 2021-12-17T18:15:25.372 INFO:teuthology.orchestra.run.smithi062.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-105-g05c319fc-1focal [58.2 kB] 2021-12-17T18:15:25.374 INFO:teuthology.orchestra.run.smithi062.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-105-g05c319fc-1focal [3,208 kB] 2021-12-17T18:15:25.585 INFO:teuthology.orchestra.run.smithi125.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-105-g05c319fc-1focal [53.2 kB] 2021-12-17T18:15:25.590 INFO:teuthology.orchestra.run.smithi125.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-105-g05c319fc-1focal [58.2 kB] 2021-12-17T18:15:25.595 INFO:teuthology.orchestra.run.smithi125.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-105-g05c319fc-1focal [3,208 kB] 2021-12-17T18:15:25.798 INFO:teuthology.orchestra.run.smithi062.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-105-g05c319fc-1focal [34.4 kB] 2021-12-17T18:15:25.801 INFO:teuthology.orchestra.run.smithi062.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-105-g05c319fc-1focal [7,888 kB] 2021-12-17T18:15:26.030 INFO:teuthology.orchestra.run.smithi125.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-105-g05c319fc-1focal [34.4 kB] 2021-12-17T18:15:26.033 INFO:teuthology.orchestra.run.smithi125.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-105-g05c319fc-1focal [7,888 kB] 2021-12-17T18:15:26.111 INFO:teuthology.orchestra.run.smithi109.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-105-g05c319fc-1focal [4,128 B] 2021-12-17T18:15:26.112 INFO:teuthology.orchestra.run.smithi109.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-105-g05c319fc-1focal [39.9 MB] 2021-12-17T18:15:26.844 INFO:teuthology.orchestra.run.smithi062.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-105-g05c319fc-1focal [4,128 B] 2021-12-17T18:15:26.844 INFO:teuthology.orchestra.run.smithi062.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-105-g05c319fc-1focal [39.9 MB] 2021-12-17T18:15:27.146 INFO:teuthology.orchestra.run.smithi125.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-105-g05c319fc-1focal [4,128 B] 2021-12-17T18:15:27.146 INFO:teuthology.orchestra.run.smithi125.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-105-g05c319fc-1focal [39.9 MB] 2021-12-17T18:15:29.509 INFO:teuthology.orchestra.run.smithi158.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-105-g05c319fc-1focal [4,012 B] 2021-12-17T18:15:29.510 INFO:teuthology.orchestra.run.smithi158.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-105-g05c319fc-1focal [539 kB] 2021-12-17T18:15:29.567 INFO:teuthology.orchestra.run.smithi158.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-105-g05c319fc-1focal [2,006 kB] 2021-12-17T18:15:29.930 INFO:teuthology.orchestra.run.smithi158.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-105-g05c319fc-1focal [53.2 kB] 2021-12-17T18:15:29.932 INFO:teuthology.orchestra.run.smithi158.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-105-g05c319fc-1focal [58.2 kB] 2021-12-17T18:15:29.943 INFO:teuthology.orchestra.run.smithi158.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-105-g05c319fc-1focal [3,208 kB] 2021-12-17T18:15:30.327 INFO:teuthology.orchestra.run.smithi192.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-105-g05c319fc-1focal [5,336 kB] 2021-12-17T18:15:30.549 INFO:teuthology.orchestra.run.smithi158.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-105-g05c319fc-1focal [34.4 kB] 2021-12-17T18:15:30.596 INFO:teuthology.orchestra.run.smithi158.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-105-g05c319fc-1focal [7,888 kB] 2021-12-17T18:15:31.286 INFO:teuthology.orchestra.run.smithi192.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-105-g05c319fc-1focal [162 kB] 2021-12-17T18:15:31.325 INFO:teuthology.orchestra.run.smithi192.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-105-g05c319fc-1focal [1,402 kB] 2021-12-17T18:15:31.595 INFO:teuthology.orchestra.run.smithi192.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-105-g05c319fc-1focal [6,172 kB] 2021-12-17T18:15:31.996 INFO:teuthology.orchestra.run.smithi109.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-105-g05c319fc-1focal [15.9 kB] 2021-12-17T18:15:31.997 INFO:teuthology.orchestra.run.smithi109.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-105-g05c319fc-1focal [18.1 kB] 2021-12-17T18:15:31.997 INFO:teuthology.orchestra.run.smithi109.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-105-g05c319fc-1focal [9,665 kB] 2021-12-17T18:15:32.127 INFO:teuthology.orchestra.run.smithi158.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-105-g05c319fc-1focal [4,128 B] 2021-12-17T18:15:32.133 INFO:teuthology.orchestra.run.smithi158.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-105-g05c319fc-1focal [39.9 MB] 2021-12-17T18:15:32.264 INFO:teuthology.orchestra.run.smithi062.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-105-g05c319fc-1focal [15.9 kB] 2021-12-17T18:15:32.265 INFO:teuthology.orchestra.run.smithi062.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-105-g05c319fc-1focal [18.1 kB] 2021-12-17T18:15:32.266 INFO:teuthology.orchestra.run.smithi062.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-105-g05c319fc-1focal [9,665 kB] 2021-12-17T18:15:32.701 INFO:teuthology.orchestra.run.smithi192.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-105-g05c319fc-1focal [23.9 MB] 2021-12-17T18:15:33.364 INFO:teuthology.orchestra.run.smithi062.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-105-g05c319fc-1focal [61.0 kB] 2021-12-17T18:15:33.500 INFO:teuthology.orchestra.run.smithi109.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-105-g05c319fc-1focal [61.0 kB] 2021-12-17T18:15:33.873 INFO:teuthology.orchestra.run.smithi125.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-105-g05c319fc-1focal [15.9 kB] 2021-12-17T18:15:33.874 INFO:teuthology.orchestra.run.smithi125.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-105-g05c319fc-1focal [18.1 kB] 2021-12-17T18:15:33.874 INFO:teuthology.orchestra.run.smithi125.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-105-g05c319fc-1focal [9,665 kB] 2021-12-17T18:15:33.972 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 153 MB in 17s (8,909 kB/s) 2021-12-17T18:15:34.092 INFO:teuthology.orchestra.run.smithi109.stdout:Fetched 153 MB in 17s (8,803 kB/s) 2021-12-17T18:15:34.133 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyperclip. 2021-12-17T18:15:34.201 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-12-17T18:15:34.207 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-12-17T18:15:34.215 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-pyperclip. 2021-12-17T18:15:34.258 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-12-17T18:15:34.284 INFO:teuthology.orchestra.run.smithi109.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-12-17T18:15:34.289 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-12-17T18:15:34.330 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-12-17T18:15:34.558 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-wcwidth. 2021-12-17T18:15:34.579 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-12-17T18:15:34.617 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-12-17T18:15:34.639 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-wcwidth. 2021-12-17T18:15:34.659 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-12-17T18:15:34.696 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-12-17T18:15:34.849 INFO:teuthology.orchestra.run.smithi125.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-105-g05c319fc-1focal [61.0 kB] 2021-12-17T18:15:34.889 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cmd2. 2021-12-17T18:15:34.909 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-12-17T18:15:34.964 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-12-17T18:15:35.023 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-cmd2. 2021-12-17T18:15:35.046 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-12-17T18:15:35.081 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-12-17T18:15:35.204 INFO:teuthology.orchestra.run.smithi192.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-105-g05c319fc-1focal [4,012 B] 2021-12-17T18:15:35.205 INFO:teuthology.orchestra.run.smithi192.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-105-g05c319fc-1focal [539 kB] 2021-12-17T18:15:35.216 INFO:teuthology.orchestra.run.smithi192.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-105-g05c319fc-1focal [2,006 kB] 2021-12-17T18:15:35.299 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-12-17T18:15:35.318 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-12-17T18:15:35.356 INFO:teuthology.orchestra.run.smithi192.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-105-g05c319fc-1focal [53.2 kB] 2021-12-17T18:15:35.358 INFO:teuthology.orchestra.run.smithi192.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-105-g05c319fc-1focal [58.2 kB] 2021-12-17T18:15:35.359 INFO:teuthology.orchestra.run.smithi192.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-105-g05c319fc-1focal [3,208 kB] 2021-12-17T18:15:35.402 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-12-17T18:15:35.417 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-12-17T18:15:35.436 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-12-17T18:15:35.485 INFO:teuthology.orchestra.run.smithi125.stdout:Fetched 153 MB in 19s (8,130 kB/s) 2021-12-17T18:15:35.519 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-12-17T18:15:35.591 INFO:teuthology.orchestra.run.smithi192.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-105-g05c319fc-1focal [34.4 kB] 2021-12-17T18:15:35.593 INFO:teuthology.orchestra.run.smithi192.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-105-g05c319fc-1focal [7,888 kB] 2021-12-17T18:15:35.639 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pyperclip. 2021-12-17T18:15:35.708 INFO:teuthology.orchestra.run.smithi125.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-12-17T18:15:35.713 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-12-17T18:15:35.754 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-12-17T18:15:35.772 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../004-librbd1_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:35.881 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../004-librbd1_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:35.897 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librbd1 (15.2.15-105-g05c319fc-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-12-17T18:15:36.005 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking librbd1 (15.2.15-105-g05c319fc-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-12-17T18:15:36.020 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-wcwidth. 2021-12-17T18:15:36.039 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-12-17T18:15:36.078 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-12-17T18:15:36.132 INFO:teuthology.orchestra.run.smithi192.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-105-g05c319fc-1focal [4,128 B] 2021-12-17T18:15:36.132 INFO:teuthology.orchestra.run.smithi192.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-105-g05c319fc-1focal [39.9 MB] 2021-12-17T18:15:36.158 INFO:teuthology.orchestra.run.smithi158.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-105-g05c319fc-1focal [15.9 kB] 2021-12-17T18:15:36.159 INFO:teuthology.orchestra.run.smithi158.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-105-g05c319fc-1focal [18.1 kB] 2021-12-17T18:15:36.160 INFO:teuthology.orchestra.run.smithi158.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-105-g05c319fc-1focal [9,665 kB] 2021-12-17T18:15:36.353 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-cmd2. 2021-12-17T18:15:36.371 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-12-17T18:15:36.412 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-12-17T18:15:36.469 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../005-librados2_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:36.565 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../005-librados2_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:36.585 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librados2 (15.2.15-105-g05c319fc-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-12-17T18:15:36.710 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking librados2 (15.2.15-105-g05c319fc-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-12-17T18:15:36.715 INFO:teuthology.orchestra.run.smithi158.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-105-g05c319fc-1focal [61.0 kB] 2021-12-17T18:15:36.767 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-12-17T18:15:36.789 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-12-17T18:15:36.868 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-12-17T18:15:37.181 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../004-librbd1_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:37.266 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs2. 2021-12-17T18:15:37.288 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:37.299 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking librbd1 (15.2.15-105-g05c319fc-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-12-17T18:15:37.333 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:37.360 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 153 MB in 21s (7,416 kB/s) 2021-12-17T18:15:37.389 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package libcephfs2. 2021-12-17T18:15:37.407 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:37.474 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking libcephfs2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:37.522 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyperclip. 2021-12-17T18:15:37.588 INFO:teuthology.orchestra.run.smithi158.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-12-17T18:15:37.594 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-12-17T18:15:37.635 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rados. 2021-12-17T18:15:37.642 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-12-17T18:15:37.655 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../007-python3-rados_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:37.685 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rados (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:37.774 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-rados. 2021-12-17T18:15:37.793 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../007-python3-rados_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:37.834 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-rados (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:37.861 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../005-librados2_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:37.970 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking librados2 (15.2.15-105-g05c319fc-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-12-17T18:15:37.991 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-wcwidth. 2021-12-17T18:15:38.011 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-12-17T18:15:38.036 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-12-17T18:15:38.043 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-12-17T18:15:38.059 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:15:38.104 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-argparse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:38.186 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-12-17T18:15:38.209 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:15:38.254 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-ceph-argparse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:38.311 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cmd2. 2021-12-17T18:15:38.330 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-12-17T18:15:38.361 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-12-17T18:15:38.397 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cephfs. 2021-12-17T18:15:38.416 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:38.455 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cephfs (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:38.583 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-cephfs. 2021-12-17T18:15:38.604 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:38.606 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libcephfs2. 2021-12-17T18:15:38.629 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:38.632 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-cephfs (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:38.664 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libcephfs2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:38.703 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-12-17T18:15:38.722 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-12-17T18:15:38.775 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-common. 2021-12-17T18:15:38.793 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:15:38.796 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-12-17T18:15:38.833 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:38.983 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-rados. 2021-12-17T18:15:38.985 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-ceph-common. 2021-12-17T18:15:39.004 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:15:39.005 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../007-python3-rados_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:39.043 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:39.050 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-rados (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:39.122 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../004-librbd1_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:39.144 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-prettytable. 2021-12-17T18:15:39.166 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-12-17T18:15:39.244 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-12-17T18:15:39.245 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librbd1 (15.2.15-105-g05c319fc-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-12-17T18:15:39.397 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-prettytable. 2021-12-17T18:15:39.416 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-12-17T18:15:39.420 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-12-17T18:15:39.439 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:15:39.455 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-12-17T18:15:39.478 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-ceph-argparse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:39.496 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rbd. 2021-12-17T18:15:39.519 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:39.563 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rbd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:39.741 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-rbd. 2021-12-17T18:15:39.760 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:39.786 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../005-librados2_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:39.787 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-cephfs. 2021-12-17T18:15:39.799 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-rbd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:39.807 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:39.846 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-cephfs (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:39.883 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-12-17T18:15:39.904 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-12-17T18:15:39.917 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librados2 (15.2.15-105-g05c319fc-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-12-17T18:15:39.941 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-12-17T18:15:40.182 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-ceph-common. 2021-12-17T18:15:40.194 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-12-17T18:15:40.200 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:15:40.213 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-12-17T18:15:40.232 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:40.252 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-12-17T18:15:40.269 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-12-17T18:15:40.288 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-12-17T18:15:40.327 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-12-17T18:15:40.330 INFO:teuthology.orchestra.run.smithi192.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-105-g05c319fc-1focal [15.9 kB] 2021-12-17T18:15:40.331 INFO:teuthology.orchestra.run.smithi192.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-105-g05c319fc-1focal [18.1 kB] 2021-12-17T18:15:40.332 INFO:teuthology.orchestra.run.smithi192.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-105-g05c319fc-1focal [9,665 kB] 2021-12-17T18:15:40.494 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-prettytable. 2021-12-17T18:15:40.512 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-12-17T18:15:40.552 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-12-17T18:15:40.606 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-12-17T18:15:40.609 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libcephfs2. 2021-12-17T18:15:40.625 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-12-17T18:15:40.628 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:40.664 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-12-17T18:15:40.668 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libcephfs2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:40.705 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librgw2. 2021-12-17T18:15:40.725 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../015-librgw2_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:40.764 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librgw2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:40.805 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-rbd. 2021-12-17T18:15:40.825 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:40.863 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-rbd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:40.954 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-rados. 2021-12-17T18:15:40.976 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../007-python3-rados_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:41.020 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-rados (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:41.042 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package librgw2. 2021-12-17T18:15:41.061 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../015-librgw2_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:41.100 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking librgw2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:41.274 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-12-17T18:15:41.275 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rgw. 2021-12-17T18:15:41.293 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:41.297 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-12-17T18:15:41.340 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-12-17T18:15:41.346 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:41.398 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-12-17T18:15:41.417 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:15:41.457 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-ceph-argparse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:41.601 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-12-17T18:15:41.622 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-12-17T18:15:41.651 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-12-17T18:15:41.661 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-rgw. 2021-12-17T18:15:41.668 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-12-17T18:15:41.680 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:41.687 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-12-17T18:15:41.711 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-rgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:41.714 INFO:teuthology.orchestra.run.smithi192.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/05c319fc280f505b26f579a01ab4d14d2f130a5b/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-105-g05c319fc-1focal [61.0 kB] 2021-12-17T18:15:41.726 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-12-17T18:15:41.762 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cephfs. 2021-12-17T18:15:41.784 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:41.812 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cephfs (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:41.954 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package librgw2. 2021-12-17T18:15:41.977 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../015-librgw2_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:42.021 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking librgw2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:42.022 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-12-17T18:15:42.043 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-12-17T18:15:42.090 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-12-17T18:15:42.159 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-ceph-common. 2021-12-17T18:15:42.182 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:15:42.221 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liboath0. 2021-12-17T18:15:42.225 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:42.241 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-12-17T18:15:42.280 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-12-17T18:15:42.350 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 153 MB in 25s (6,010 kB/s) 2021-12-17T18:15:42.434 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package liboath0. 2021-12-17T18:15:42.454 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-12-17T18:15:42.470 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyperclip. 2021-12-17T18:15:42.509 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-12-17T18:15:42.537 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-12-17T18:15:42.541 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libradosstriper1. 2021-12-17T18:15:42.543 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-12-17T18:15:42.548 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-rgw. 2021-12-17T18:15:42.560 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:42.570 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:42.571 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-prettytable. 2021-12-17T18:15:42.578 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-12-17T18:15:42.591 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libradosstriper1 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:42.592 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-12-17T18:15:42.614 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-rgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:42.629 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-12-17T18:15:42.778 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package libradosstriper1. 2021-12-17T18:15:42.796 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:42.828 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking libradosstriper1 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:42.857 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-rbd. 2021-12-17T18:15:42.876 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:42.906 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-wcwidth. 2021-12-17T18:15:42.915 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-rbd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:42.926 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-12-17T18:15:42.934 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-12-17T18:15:42.957 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-12-17T18:15:42.965 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-12-17T18:15:43.001 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-12-17T18:15:43.052 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-common. 2021-12-17T18:15:43.073 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../020-ceph-common_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:43.110 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:43.265 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package ceph-common. 2021-12-17T18:15:43.284 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../020-ceph-common_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:43.301 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cmd2. 2021-12-17T18:15:43.318 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-12-17T18:15:43.320 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-12-17T18:15:43.322 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package liboath0. 2021-12-17T18:15:43.338 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-12-17T18:15:43.340 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:43.341 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-12-17T18:15:43.352 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-12-17T18:15:43.372 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-12-17T18:15:43.376 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-12-17T18:15:43.710 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-12-17T18:15:43.715 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-12-17T18:15:43.716 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libradosstriper1. 2021-12-17T18:15:43.730 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-12-17T18:15:43.732 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-12-17T18:15:43.735 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:43.772 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-12-17T18:15:43.775 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libradosstriper1 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:43.793 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-12-17T18:15:44.084 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package librgw2. 2021-12-17T18:15:44.106 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../015-librgw2_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:44.149 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librgw2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:44.180 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../004-librbd1_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:44.203 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-common. 2021-12-17T18:15:44.225 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../020-ceph-common_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:44.269 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:44.289 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librbd1 (15.2.15-105-g05c319fc-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-12-17T18:15:44.702 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-rgw. 2021-12-17T18:15:44.721 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:44.761 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-rgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:44.850 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../005-librados2_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:44.963 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librados2 (15.2.15-105-g05c319fc-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-12-17T18:15:45.097 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-12-17T18:15:45.116 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-12-17T18:15:45.172 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-12-17T18:15:45.275 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-base. 2021-12-17T18:15:45.296 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../021-ceph-base_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:45.344 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-base (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:45.446 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package ceph-base. 2021-12-17T18:15:45.467 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../021-ceph-base_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:45.509 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liboath0. 2021-12-17T18:15:45.528 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-12-17T18:15:45.548 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking ceph-base (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:45.567 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-12-17T18:15:45.653 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libcephfs2. 2021-12-17T18:15:45.672 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:45.712 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libcephfs2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:45.888 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libradosstriper1. 2021-12-17T18:15:45.907 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:45.945 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libradosstriper1 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:46.061 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rados. 2021-12-17T18:15:46.080 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../007-python3-rados_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:46.113 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rados (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:46.357 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-common. 2021-12-17T18:15:46.358 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-base. 2021-12-17T18:15:46.363 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cryptography. 2021-12-17T18:15:46.377 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../021-ceph-base_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:46.379 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../020-ceph-common_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:46.382 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-12-17T18:15:46.407 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:46.421 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-12-17T18:15:46.426 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-base (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:46.493 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-cryptography. 2021-12-17T18:15:46.495 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-12-17T18:15:46.514 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-12-17T18:15:46.515 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:15:46.551 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-12-17T18:15:46.553 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-ceph-argparse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:46.742 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-openssl. 2021-12-17T18:15:46.761 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-12-17T18:15:46.798 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cephfs. 2021-12-17T18:15:46.799 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-12-17T18:15:46.815 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:46.847 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cephfs (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:46.972 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-openssl. 2021-12-17T18:15:46.994 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-12-17T18:15:47.038 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-12-17T18:15:47.333 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-12-17T18:15:47.352 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:15:47.391 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking ceph-mgr-modules-core (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:47.608 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-ceph-common. 2021-12-17T18:15:47.619 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-12-17T18:15:47.630 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:15:47.638 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:15:47.702 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-modules-core (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:47.822 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-cryptography. 2021-12-17T18:15:47.840 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-12-17T18:15:47.841 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:47.863 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-bcrypt. 2021-12-17T18:15:47.881 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-12-17T18:15:47.888 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-12-17T18:15:47.921 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-12-17T18:15:48.023 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-bcrypt. 2021-12-17T18:15:48.045 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-12-17T18:15:48.073 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-12-17T18:15:48.170 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-prettytable. 2021-12-17T18:15:48.191 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-12-17T18:15:48.228 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-12-17T18:15:48.292 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-openssl. 2021-12-17T18:15:48.311 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-12-17T18:15:48.335 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cherrypy3. 2021-12-17T18:15:48.351 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-12-17T18:15:48.356 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-12-17T18:15:48.444 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-12-17T18:15:48.490 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rbd. 2021-12-17T18:15:48.510 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:48.547 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rbd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:48.619 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-12-17T18:15:48.638 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:15:48.677 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr-modules-core (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:48.738 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jwt. 2021-12-17T18:15:48.757 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-base. 2021-12-17T18:15:48.758 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-12-17T18:15:48.775 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../021-ceph-base_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:48.796 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-12-17T18:15:48.817 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-base (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:48.891 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-12-17T18:15:48.915 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-12-17T18:15:48.924 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-cherrypy3. 2021-12-17T18:15:48.947 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-12-17T18:15:48.950 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-12-17T18:15:48.991 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-12-17T18:15:49.015 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-bcrypt. 2021-12-17T18:15:49.035 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-12-17T18:15:49.081 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-12-17T18:15:49.132 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-logutils. 2021-12-17T18:15:49.153 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-12-17T18:15:49.199 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-12-17T18:15:49.319 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-12-17T18:15:49.336 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-jwt. 2021-12-17T18:15:49.339 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-12-17T18:15:49.358 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-12-17T18:15:49.377 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-12-17T18:15:49.402 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-12-17T18:15:49.417 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-cherrypy3. 2021-12-17T18:15:49.436 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-12-17T18:15:49.452 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-markupsafe. 2021-12-17T18:15:49.472 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-12-17T18:15:49.492 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-12-17T18:15:49.510 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-12-17T18:15:49.720 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cryptography. 2021-12-17T18:15:49.740 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-12-17T18:15:49.755 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package librgw2. 2021-12-17T18:15:49.773 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-logutils. 2021-12-17T18:15:49.775 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../015-librgw2_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:49.786 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-12-17T18:15:49.792 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-12-17T18:15:49.813 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librgw2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:49.831 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-12-17T18:15:49.846 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-jwt. 2021-12-17T18:15:49.846 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-mako. 2021-12-17T18:15:49.867 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-12-17T18:15:49.868 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-12-17T18:15:49.904 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-12-17T18:15:49.904 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-12-17T18:15:50.109 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-markupsafe. 2021-12-17T18:15:50.128 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-12-17T18:15:50.192 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-12-17T18:15:50.199 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-logutils. 2021-12-17T18:15:50.221 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-12-17T18:15:50.233 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplegeneric. 2021-12-17T18:15:50.253 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-12-17T18:15:50.265 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-12-17T18:15:50.266 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-openssl. 2021-12-17T18:15:50.289 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-12-17T18:15:50.291 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-12-17T18:15:50.333 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-12-17T18:15:50.391 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rgw. 2021-12-17T18:15:50.410 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:50.452 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:50.462 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-mako. 2021-12-17T18:15:50.483 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-12-17T18:15:50.512 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-12-17T18:15:50.568 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-markupsafe. 2021-12-17T18:15:50.587 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-12-17T18:15:50.594 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-12-17T18:15:50.611 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-singledispatch. 2021-12-17T18:15:50.616 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:15:50.626 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-12-17T18:15:50.630 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-12-17T18:15:50.652 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-modules-core (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:50.669 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-12-17T18:15:50.760 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-12-17T18:15:50.782 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-12-17T18:15:50.818 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-12-17T18:15:50.842 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-simplegeneric. 2021-12-17T18:15:50.845 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-mako. 2021-12-17T18:15:50.860 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-12-17T18:15:50.866 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-12-17T18:15:50.895 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-12-17T18:15:50.899 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-12-17T18:15:50.938 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webob. 2021-12-17T18:15:50.958 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-12-17T18:15:50.997 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-12-17T18:15:51.032 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-bcrypt. 2021-12-17T18:15:51.052 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-12-17T18:15:51.091 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-12-17T18:15:51.191 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-simplegeneric. 2021-12-17T18:15:51.196 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liboath0. 2021-12-17T18:15:51.213 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-12-17T18:15:51.215 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-12-17T18:15:51.226 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-singledispatch. 2021-12-17T18:15:51.248 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-12-17T18:15:51.255 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-12-17T18:15:51.257 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-12-17T18:15:51.285 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-12-17T18:15:51.333 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-soupsieve. 2021-12-17T18:15:51.354 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-12-17T18:15:51.391 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-12-17T18:15:51.394 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cherrypy3. 2021-12-17T18:15:51.412 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-12-17T18:15:51.452 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-12-17T18:15:51.577 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-singledispatch. 2021-12-17T18:15:51.582 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libradosstriper1. 2021-12-17T18:15:51.595 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-12-17T18:15:51.605 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:51.612 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-webob. 2021-12-17T18:15:51.632 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-12-17T18:15:51.634 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-12-17T18:15:51.665 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libradosstriper1 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:51.670 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-12-17T18:15:51.728 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-bs4. 2021-12-17T18:15:51.747 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-12-17T18:15:51.786 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-12-17T18:15:51.806 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-jwt. 2021-12-17T18:15:51.827 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-12-17T18:15:51.889 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-12-17T18:15:51.921 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-webob. 2021-12-17T18:15:51.939 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-12-17T18:15:51.979 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-12-17T18:15:51.999 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-soupsieve. 2021-12-17T18:15:52.020 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-12-17T18:15:52.049 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-12-17T18:15:52.111 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-common. 2021-12-17T18:15:52.130 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../020-ceph-common_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:52.169 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:52.206 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-waitress. 2021-12-17T18:15:52.217 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-logutils. 2021-12-17T18:15:52.225 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-12-17T18:15:52.237 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-12-17T18:15:52.267 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-12-17T18:15:52.276 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-12-17T18:15:52.299 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-soupsieve. 2021-12-17T18:15:52.319 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-12-17T18:15:52.343 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-bs4. 2021-12-17T18:15:52.357 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-12-17T18:15:52.362 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-12-17T18:15:52.401 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-12-17T18:15:52.588 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-markupsafe. 2021-12-17T18:15:52.608 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-12-17T18:15:52.612 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-tempita. 2021-12-17T18:15:52.636 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-12-17T18:15:52.646 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-12-17T18:15:52.684 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-12-17T18:15:52.718 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-bs4. 2021-12-17T18:15:52.739 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-12-17T18:15:52.771 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-waitress. 2021-12-17T18:15:52.776 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-12-17T18:15:52.794 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-12-17T18:15:52.841 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-12-17T18:15:52.974 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-mako. 2021-12-17T18:15:52.995 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-12-17T18:15:53.003 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-paste. 2021-12-17T18:15:53.022 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-12-17T18:15:53.032 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-12-17T18:15:53.061 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-12-17T18:15:53.171 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-waitress. 2021-12-17T18:15:53.191 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-12-17T18:15:53.200 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-tempita. 2021-12-17T18:15:53.220 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-12-17T18:15:53.233 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-12-17T18:15:53.258 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-12-17T18:15:53.361 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-simplegeneric. 2021-12-17T18:15:53.380 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-12-17T18:15:53.398 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-12-17T18:15:53.419 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-12-17T18:15:53.420 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-12-17T18:15:53.464 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-12-17T18:15:53.499 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-tempita. 2021-12-17T18:15:53.521 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-12-17T18:15:53.558 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-12-17T18:15:53.586 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-paste. 2021-12-17T18:15:53.604 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-12-17T18:15:53.644 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-12-17T18:15:53.747 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-singledispatch. 2021-12-17T18:15:53.765 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-12-17T18:15:53.776 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastedeploy. 2021-12-17T18:15:53.795 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-12-17T18:15:53.813 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-12-17T18:15:53.834 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-12-17T18:15:53.843 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-paste. 2021-12-17T18:15:53.863 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-12-17T18:15:53.902 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-12-17T18:15:53.998 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-12-17T18:15:54.021 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-12-17T18:15:54.056 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-12-17T18:15:54.116 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-webob. 2021-12-17T18:15:54.136 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-12-17T18:15:54.162 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webtest. 2021-12-17T18:15:54.175 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-12-17T18:15:54.182 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-12-17T18:15:54.220 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-12-17T18:15:54.230 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-12-17T18:15:54.252 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-12-17T18:15:54.291 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-base. 2021-12-17T18:15:54.296 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-12-17T18:15:54.311 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../021-ceph-base_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:54.360 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-base (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:54.384 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-pastedeploy. 2021-12-17T18:15:54.404 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-12-17T18:15:54.442 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-12-17T18:15:54.494 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-soupsieve. 2021-12-17T18:15:54.515 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-12-17T18:15:54.531 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pecan. 2021-12-17T18:15:54.550 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-12-17T18:15:54.552 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-12-17T18:15:54.582 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pastedeploy. 2021-12-17T18:15:54.589 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-12-17T18:15:54.605 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-12-17T18:15:54.649 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-12-17T18:15:54.803 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-webtest. 2021-12-17T18:15:54.822 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-12-17T18:15:54.861 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-12-17T18:15:54.872 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-bs4. 2021-12-17T18:15:54.892 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-12-17T18:15:54.931 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-12-17T18:15:54.945 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-werkzeug. 2021-12-17T18:15:54.967 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-12-17T18:15:54.985 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-webtest. 2021-12-17T18:15:55.004 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-12-17T18:15:55.019 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-12-17T18:15:55.043 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-12-17T18:15:55.198 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-pecan. 2021-12-17T18:15:55.217 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-12-17T18:15:55.263 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cryptography. 2021-12-17T18:15:55.265 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-12-17T18:15:55.282 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-12-17T18:15:55.309 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-waitress. 2021-12-17T18:15:55.321 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-12-17T18:15:55.328 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-12-17T18:15:55.355 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pecan. 2021-12-17T18:15:55.374 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-12-17T18:15:55.379 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-12-17T18:15:55.413 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-12-17T18:15:55.440 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr. 2021-12-17T18:15:55.461 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:55.497 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:55.662 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-werkzeug. 2021-12-17T18:15:55.680 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-12-17T18:15:55.720 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-tempita. 2021-12-17T18:15:55.728 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-12-17T18:15:55.743 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-12-17T18:15:55.768 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-werkzeug. 2021-12-17T18:15:55.788 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-12-17T18:15:55.795 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-12-17T18:15:55.826 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-12-17T18:15:55.850 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-openssl. 2021-12-17T18:15:55.873 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-12-17T18:15:55.917 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-12-17T18:15:56.076 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mon. 2021-12-17T18:15:56.095 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:56.098 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-paste. 2021-12-17T18:15:56.117 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-12-17T18:15:56.140 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package ceph-mgr. 2021-12-17T18:15:56.157 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-12-17T18:15:56.159 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mon (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:56.160 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:56.186 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-12-17T18:15:56.198 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking ceph-mgr (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:56.205 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:15:56.229 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr. 2021-12-17T18:15:56.244 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-modules-core (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:56.250 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:56.287 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:56.497 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-12-17T18:15:56.512 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-12-17T18:15:56.577 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-12-17T18:15:56.640 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-bcrypt. 2021-12-17T18:15:56.659 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-12-17T18:15:56.698 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-12-17T18:15:56.718 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package ceph-mon. 2021-12-17T18:15:56.737 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:56.765 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mon. 2021-12-17T18:15:56.776 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking ceph-mon (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:56.786 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:56.824 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mon (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:56.863 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pastedeploy. 2021-12-17T18:15:56.886 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-12-17T18:15:56.930 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-12-17T18:15:57.035 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cherrypy3. 2021-12-17T18:15:57.057 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-12-17T18:15:57.110 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-12-17T18:15:57.183 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-webtest. 2021-12-17T18:15:57.203 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-12-17T18:15:57.233 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-12-17T18:15:57.287 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-osd. 2021-12-17T18:15:57.307 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:57.345 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-osd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:57.486 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pecan. 2021-12-17T18:15:57.504 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-jwt. 2021-12-17T18:15:57.505 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-12-17T18:15:57.524 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-12-17T18:15:57.561 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-12-17T18:15:57.562 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-12-17T18:15:57.805 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package ceph-osd. 2021-12-17T18:15:57.819 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-osd. 2021-12-17T18:15:57.826 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:57.838 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:57.864 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking ceph-osd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:57.875 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-werkzeug. 2021-12-17T18:15:57.891 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-logutils. 2021-12-17T18:15:57.893 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-12-17T18:15:57.894 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-osd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:57.913 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-12-17T18:15:57.933 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-12-17T18:15:58.285 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-12-17T18:15:58.345 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr. 2021-12-17T18:15:58.366 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:58.403 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:58.645 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-markupsafe. 2021-12-17T18:15:58.666 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-12-17T18:15:58.710 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-12-17T18:15:58.873 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mon. 2021-12-17T18:15:58.892 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:58.931 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mon (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:59.038 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-mako. 2021-12-17T18:15:59.057 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-12-17T18:15:59.096 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-12-17T18:15:59.465 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-simplegeneric. 2021-12-17T18:15:59.484 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-12-17T18:15:59.532 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-12-17T18:15:59.720 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph. 2021-12-17T18:15:59.741 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../047-ceph_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:59.778 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:15:59.868 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-singledispatch. 2021-12-17T18:15:59.888 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-12-17T18:15:59.911 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-osd. 2021-12-17T18:15:59.926 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-12-17T18:15:59.929 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:15:59.994 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-osd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:00.097 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-fuse. 2021-12-17T18:16:00.118 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:00.155 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:00.186 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package ceph. 2021-12-17T18:16:00.207 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../047-ceph_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:00.244 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking ceph (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:00.254 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-webob. 2021-12-17T18:16:00.273 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-12-17T18:16:00.299 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph. 2021-12-17T18:16:00.312 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-12-17T18:16:00.317 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../047-ceph_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:00.357 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:00.563 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package ceph-fuse. 2021-12-17T18:16:00.583 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mds. 2021-12-17T18:16:00.584 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:00.603 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:00.623 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-soupsieve. 2021-12-17T18:16:00.630 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking ceph-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:00.641 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mds (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:00.646 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-12-17T18:16:00.694 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-fuse. 2021-12-17T18:16:00.714 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:00.714 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-12-17T18:16:00.759 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:00.967 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package ceph-mds. 2021-12-17T18:16:00.989 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:01.017 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-bs4. 2021-12-17T18:16:01.025 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking ceph-mds (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:01.036 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-12-17T18:16:01.075 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-12-17T18:16:01.146 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mds. 2021-12-17T18:16:01.161 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephadm. 2021-12-17T18:16:01.164 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:01.181 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../050-cephadm_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:01.204 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mds (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:01.219 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:01.470 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-waitress. 2021-12-17T18:16:01.491 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-12-17T18:16:01.503 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package cephadm. 2021-12-17T18:16:01.527 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../050-cephadm_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:01.531 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jinja2. 2021-12-17T18:16:01.532 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-12-17T18:16:01.550 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-12-17T18:16:01.578 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:01.589 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-12-17T18:16:01.658 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package cephadm. 2021-12-17T18:16:01.678 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../050-cephadm_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:01.707 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:01.890 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-tempita. 2021-12-17T18:16:01.911 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-12-17T18:16:01.915 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-jinja2. 2021-12-17T18:16:01.935 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-12-17T18:16:01.942 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-12-17T18:16:01.947 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-12-17T18:16:01.961 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:01.998 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-12-17T18:16:02.000 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:02.068 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-jinja2. 2021-12-17T18:16:02.088 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-12-17T18:16:02.126 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-12-17T18:16:02.293 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-paste. 2021-12-17T18:16:02.312 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-12-17T18:16:02.318 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-12-17T18:16:02.337 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:02.337 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-repoze.lru. 2021-12-17T18:16:02.350 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-12-17T18:16:02.356 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-12-17T18:16:02.360 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph. 2021-12-17T18:16:02.380 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../047-ceph_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:02.395 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-12-17T18:16:02.401 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking ceph-mgr-cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:02.418 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:02.446 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-12-17T18:16:02.464 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:02.510 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr-cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:02.688 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-repoze.lru. 2021-12-17T18:16:02.703 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-12-17T18:16:02.706 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-12-17T18:16:02.714 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjs-underscore. 2021-12-17T18:16:02.723 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-12-17T18:16:02.734 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-12-17T18:16:02.737 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-12-17T18:16:02.738 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-fuse. 2021-12-17T18:16:02.759 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:02.761 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-12-17T18:16:02.772 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-12-17T18:16:02.795 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:02.824 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-repoze.lru. 2021-12-17T18:16:02.843 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-12-17T18:16:02.882 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-12-17T18:16:02.990 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package libjs-underscore. 2021-12-17T18:16:03.013 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-12-17T18:16:03.057 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-12-17T18:16:03.097 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pastedeploy. 2021-12-17T18:16:03.119 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-12-17T18:16:03.156 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-12-17T18:16:03.168 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libjs-underscore. 2021-12-17T18:16:03.187 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-12-17T18:16:03.234 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-12-17T18:16:03.241 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mds. 2021-12-17T18:16:03.260 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:03.307 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mds (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:03.360 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-12-17T18:16:03.379 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-12-17T18:16:03.418 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-12-17T18:16:03.458 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-webtest. 2021-12-17T18:16:03.467 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-12-17T18:16:03.479 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-12-17T18:16:03.486 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-12-17T18:16:03.520 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-12-17T18:16:03.525 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-12-17T18:16:03.542 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-12-17T18:16:03.549 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-12-17T18:16:03.587 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-12-17T18:16:03.788 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-routes. 2021-12-17T18:16:03.810 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-12-17T18:16:03.863 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-12-17T18:16:03.869 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package cephadm. 2021-12-17T18:16:03.889 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../050-cephadm_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:03.912 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-routes. 2021-12-17T18:16:03.927 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:03.928 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pecan. 2021-12-17T18:16:03.931 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-12-17T18:16:03.949 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-12-17T18:16:03.970 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-12-17T18:16:03.974 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-routes. 2021-12-17T18:16:03.992 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-12-17T18:16:04.019 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-12-17T18:16:04.031 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-12-17T18:16:04.250 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-12-17T18:16:04.256 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-jinja2. 2021-12-17T18:16:04.270 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:04.278 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-12-17T18:16:04.308 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking ceph-mgr-dashboard (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:04.322 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-12-17T18:16:04.373 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-12-17T18:16:04.374 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-werkzeug. 2021-12-17T18:16:04.393 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-12-17T18:16:04.396 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:04.397 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-12-17T18:16:04.412 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:04.449 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-dashboard (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:04.451 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr-dashboard (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:04.457 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-12-17T18:16:04.675 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-12-17T18:16:04.695 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:04.742 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:04.886 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr. 2021-12-17T18:16:04.907 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:04.944 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:05.120 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-repoze.lru. 2021-12-17T18:16:05.140 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-12-17T18:16:05.179 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-12-17T18:16:05.367 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-12-17T18:16:05.390 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:05.400 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-12-17T18:16:05.414 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-12-17T18:16:05.420 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:05.431 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libjs-underscore. 2021-12-17T18:16:05.434 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:05.438 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mon. 2021-12-17T18:16:05.441 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:05.451 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-12-17T18:16:05.458 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:05.461 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:05.472 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:05.491 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-12-17T18:16:05.505 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mon (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:05.767 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-12-17T18:16:05.778 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-decorator. 2021-12-17T18:16:05.788 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-12-17T18:16:05.799 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-12-17T18:16:05.808 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-decorator. 2021-12-17T18:16:05.819 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-decorator. 2021-12-17T18:16:05.825 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-12-17T18:16:05.831 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-12-17T18:16:05.838 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-12-17T18:16:05.844 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-12-17T18:16:05.874 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-12-17T18:16:05.877 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-12-17T18:16:06.147 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-12-17T18:16:06.167 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-12-17T18:16:06.169 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-12-17T18:16:06.171 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-routes. 2021-12-17T18:16:06.191 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-12-17T18:16:06.192 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-12-17T18:16:06.205 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-12-17T18:16:06.205 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-12-17T18:16:06.227 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-12-17T18:16:06.228 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-12-17T18:16:06.252 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-12-17T18:16:06.263 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-12-17T18:16:06.525 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-scipy. 2021-12-17T18:16:06.546 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-12-17T18:16:06.565 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-12-17T18:16:06.576 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-scipy. 2021-12-17T18:16:06.585 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:06.591 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-12-17T18:16:06.592 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-osd. 2021-12-17T18:16:06.593 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-12-17T18:16:06.611 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:06.616 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-scipy. 2021-12-17T18:16:06.623 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-dashboard (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:06.630 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-12-17T18:16:06.638 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-12-17T18:16:06.649 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-osd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:06.683 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-12-17T18:16:07.632 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-12-17T18:16:07.652 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:07.698 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:07.900 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-12-17T18:16:07.920 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-12-17T18:16:07.958 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:07.984 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-12-17T18:16:07.998 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-12-17T18:16:08.007 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-12-17T18:16:08.019 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-12-17T18:16:08.051 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:08.056 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:08.119 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-decorator. 2021-12-17T18:16:08.142 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-12-17T18:16:08.185 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-12-17T18:16:08.471 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-12-17T18:16:08.494 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-12-17T18:16:08.538 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-12-17T18:16:08.562 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-joblib. 2021-12-17T18:16:08.582 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-12-17T18:16:08.613 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-joblib. 2021-12-17T18:16:08.619 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-12-17T18:16:08.632 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-12-17T18:16:08.713 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-12-17T18:16:08.801 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-joblib. 2021-12-17T18:16:08.824 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-12-17T18:16:08.867 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-12-17T18:16:08.874 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-scipy. 2021-12-17T18:16:08.895 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-12-17T18:16:08.932 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-12-17T18:16:09.032 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-sklearn. 2021-12-17T18:16:09.052 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-12-17T18:16:09.055 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph. 2021-12-17T18:16:09.078 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../047-ceph_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:09.098 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:09.108 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-sklearn. 2021-12-17T18:16:09.122 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:09.130 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-12-17T18:16:09.175 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:09.271 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn. 2021-12-17T18:16:09.291 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-12-17T18:16:09.330 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:09.474 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-fuse. 2021-12-17T18:16:09.495 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:09.532 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:09.756 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-12-17T18:16:09.776 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:09.806 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:09.909 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-12-17T18:16:09.929 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:09.944 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mds. 2021-12-17T18:16:09.966 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:09.983 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:10.005 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-12-17T18:16:10.010 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mds (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:10.028 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:10.071 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:10.301 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-12-17T18:16:10.320 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-12-17T18:16:10.358 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:10.530 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephadm. 2021-12-17T18:16:10.551 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../050-cephadm_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:10.621 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:10.921 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-joblib. 2021-12-17T18:16:10.925 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-cachetools. 2021-12-17T18:16:10.940 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-12-17T18:16:10.941 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-jinja2. 2021-12-17T18:16:10.945 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-12-17T18:16:10.959 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-12-17T18:16:10.979 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-12-17T18:16:10.983 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-12-17T18:16:10.999 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-12-17T18:16:11.120 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-cachetools. 2021-12-17T18:16:11.143 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-12-17T18:16:11.186 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-12-17T18:16:11.216 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cachetools. 2021-12-17T18:16:11.236 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-12-17T18:16:11.274 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-12-17T18:16:11.320 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pyasn1. 2021-12-17T18:16:11.343 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-12-17T18:16:11.352 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-12-17T18:16:11.374 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:11.375 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-sklearn. 2021-12-17T18:16:11.386 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-12-17T18:16:11.396 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-12-17T18:16:11.419 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:11.441 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:11.515 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-pyasn1. 2021-12-17T18:16:11.536 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-12-17T18:16:11.572 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-12-17T18:16:11.585 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1. 2021-12-17T18:16:11.609 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-12-17T18:16:11.651 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-12-17T18:16:11.715 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-12-17T18:16:11.738 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-12-17T18:16:11.755 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-repoze.lru. 2021-12-17T18:16:11.775 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-12-17T18:16:11.781 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-12-17T18:16:11.813 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-12-17T18:16:11.893 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-12-17T18:16:11.913 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-12-17T18:16:11.943 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-12-17T18:16:12.022 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-12-17T18:16:12.042 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-12-17T18:16:12.088 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-12-17T18:16:12.093 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-rsa. 2021-12-17T18:16:12.107 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libjs-underscore. 2021-12-17T18:16:12.114 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-12-17T18:16:12.130 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-12-17T18:16:12.141 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-12-17T18:16:12.159 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-rsa (4.0-3) ... 2021-12-17T18:16:12.160 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:12.174 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-12-17T18:16:12.200 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:12.254 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-rsa. 2021-12-17T18:16:12.274 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-12-17T18:16:12.314 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-rsa (4.0-3) ... 2021-12-17T18:16:12.441 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rsa. 2021-12-17T18:16:12.451 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-12-17T18:16:12.462 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-12-17T18:16:12.471 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-12-17T18:16:12.499 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rsa (4.0-3) ... 2021-12-17T18:16:12.504 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-google-auth. 2021-12-17T18:16:12.524 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-12-17T18:16:12.534 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-12-17T18:16:12.562 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-12-17T18:16:12.658 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-google-auth. 2021-12-17T18:16:12.677 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-12-17T18:16:12.716 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-12-17T18:16:12.844 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-google-auth. 2021-12-17T18:16:12.865 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-routes. 2021-12-17T18:16:12.866 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-12-17T18:16:12.882 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-blinker. 2021-12-17T18:16:12.883 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-12-17T18:16:12.903 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-12-17T18:16:12.904 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-12-17T18:16:12.949 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-12-17T18:16:12.961 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-12-17T18:16:13.077 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-blinker. 2021-12-17T18:16:13.097 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-12-17T18:16:13.135 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-12-17T18:16:13.206 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-blinker. 2021-12-17T18:16:13.229 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-12-17T18:16:13.234 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-oauthlib. 2021-12-17T18:16:13.254 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-12-17T18:16:13.272 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-12-17T18:16:13.301 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-12-17T18:16:13.309 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-12-17T18:16:13.311 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cachetools. 2021-12-17T18:16:13.328 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:13.334 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-12-17T18:16:13.377 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-12-17T18:16:13.389 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-dashboard (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:13.464 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-oauthlib. 2021-12-17T18:16:13.485 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-12-17T18:16:13.522 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-12-17T18:16:13.600 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-oauthlib. 2021-12-17T18:16:13.620 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-12-17T18:16:13.654 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-12-17T18:16:13.666 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-12-17T18:16:13.677 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-12-17T18:16:13.721 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-12-17T18:16:13.722 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyasn1. 2021-12-17T18:16:13.741 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-12-17T18:16:13.780 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-12-17T18:16:13.911 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-12-17T18:16:13.931 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-12-17T18:16:13.970 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-12-17T18:16:13.996 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-12-17T18:16:14.015 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-12-17T18:16:14.057 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-websocket. 2021-12-17T18:16:14.070 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-12-17T18:16:14.076 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-12-17T18:16:14.116 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-12-17T18:16:14.126 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-12-17T18:16:14.145 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-12-17T18:16:14.184 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-12-17T18:16:14.330 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-websocket. 2021-12-17T18:16:14.350 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-12-17T18:16:14.368 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-12-17T18:16:14.388 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-12-17T18:16:14.390 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:14.398 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-websocket. 2021-12-17T18:16:14.418 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-12-17T18:16:14.434 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:14.435 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-kubernetes. 2021-12-17T18:16:14.456 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-12-17T18:16:14.457 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-12-17T18:16:14.493 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-12-17T18:16:14.520 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-rsa. 2021-12-17T18:16:14.540 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-12-17T18:16:14.578 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-rsa (4.0-3) ... 2021-12-17T18:16:14.733 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-kubernetes. 2021-12-17T18:16:14.746 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-decorator. 2021-12-17T18:16:14.754 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-12-17T18:16:14.765 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-12-17T18:16:14.784 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-kubernetes. 2021-12-17T18:16:14.791 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-12-17T18:16:14.805 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-12-17T18:16:14.842 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-12-17T18:16:14.847 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-12-17T18:16:14.890 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-google-auth. 2021-12-17T18:16:14.912 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-12-17T18:16:14.948 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-12-17T18:16:15.032 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-12-17T18:16:15.052 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:15.090 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:15.173 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-12-17T18:16:15.192 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-12-17T18:16:15.232 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-12-17T18:16:15.269 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-blinker. 2021-12-17T18:16:15.288 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-12-17T18:16:15.327 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-12-17T18:16:15.363 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-12-17T18:16:15.385 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:15.392 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libonig5:amd64. 2021-12-17T18:16:15.397 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-12-17T18:16:15.414 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-12-17T18:16:15.417 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:15.421 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:15.464 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:15.467 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-12-17T18:16:15.576 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-scipy. 2021-12-17T18:16:15.598 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-12-17T18:16:15.643 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-12-17T18:16:15.688 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-oauthlib. 2021-12-17T18:16:15.708 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-12-17T18:16:15.746 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-12-17T18:16:15.750 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libonig5:amd64. 2021-12-17T18:16:15.770 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-12-17T18:16:15.774 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package libonig5:amd64. 2021-12-17T18:16:15.796 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-12-17T18:16:15.808 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-12-17T18:16:15.837 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libjq1:amd64. 2021-12-17T18:16:15.841 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-12-17T18:16:15.857 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-12-17T18:16:15.886 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:16.103 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjq1:amd64. 2021-12-17T18:16:16.109 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-12-17T18:16:16.123 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-12-17T18:16:16.131 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-12-17T18:16:16.170 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:16.172 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package jq. 2021-12-17T18:16:16.174 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-12-17T18:16:16.195 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-12-17T18:16:16.219 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package libjq1:amd64. 2021-12-17T18:16:16.230 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:16.241 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-12-17T18:16:16.311 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:16.422 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package jq. 2021-12-17T18:16:16.443 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-12-17T18:16:16.480 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:16.486 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-websocket. 2021-12-17T18:16:16.491 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package socat. 2021-12-17T18:16:16.507 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-12-17T18:16:16.512 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-12-17T18:16:16.544 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-12-17T18:16:16.550 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking socat (1.7.3.3-2) ... 2021-12-17T18:16:16.580 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package jq. 2021-12-17T18:16:16.600 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-12-17T18:16:16.638 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:16.750 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package socat. 2021-12-17T18:16:16.770 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-12-17T18:16:16.808 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking socat (1.7.3.3-2) ... 2021-12-17T18:16:16.864 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-kubernetes. 2021-12-17T18:16:16.884 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-12-17T18:16:16.923 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-12-17T18:16:16.932 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package socat. 2021-12-17T18:16:16.953 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-12-17T18:16:16.991 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking socat (1.7.3.3-2) ... 2021-12-17T18:16:17.027 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-12-17T18:16:17.039 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-12-17T18:16:17.048 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-12-17T18:16:17.059 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-12-17T18:16:17.085 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:17.096 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-12-17T18:16:17.289 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-12-17T18:16:17.310 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-12-17T18:16:17.347 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-12-17T18:16:17.376 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package xmlstarlet. 2021-12-17T18:16:17.397 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-12-17T18:16:17.441 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-12-17T18:16:17.444 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-12-17T18:16:17.467 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:17.513 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:17.526 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-12-17T18:16:17.541 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-12-17T18:16:17.605 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-12-17T18:16:17.642 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package xmlstarlet. 2021-12-17T18:16:17.656 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-joblib. 2021-12-17T18:16:17.662 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-12-17T18:16:17.678 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-12-17T18:16:17.699 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-12-17T18:16:17.722 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-12-17T18:16:17.787 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-test. 2021-12-17T18:16:17.809 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../083-ceph-test_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:17.830 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libonig5:amd64. 2021-12-17T18:16:17.845 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-test (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:17.851 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-12-17T18:16:17.888 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-12-17T18:16:17.891 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package xmlstarlet. 2021-12-17T18:16:17.911 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-12-17T18:16:17.952 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-12-17T18:16:18.063 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-test. 2021-12-17T18:16:18.083 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../083-ceph-test_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:18.109 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-sklearn. 2021-12-17T18:16:18.120 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-test (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:18.129 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-12-17T18:16:18.167 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:18.300 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libjq1:amd64. 2021-12-17T18:16:18.320 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-12-17T18:16:18.329 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package ceph-test. 2021-12-17T18:16:18.349 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../083-ceph-test_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:18.358 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:18.412 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking ceph-test (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:18.636 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package jq. 2021-12-17T18:16:18.655 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-12-17T18:16:18.694 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:18.926 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-12-17T18:16:18.947 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package socat. 2021-12-17T18:16:18.947 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:18.969 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-12-17T18:16:18.984 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:19.014 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking socat (1.7.3.3-2) ... 2021-12-17T18:16:19.570 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-12-17T18:16:19.589 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-12-17T18:16:19.627 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-12-17T18:16:19.889 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package xmlstarlet. 2021-12-17T18:16:19.911 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-12-17T18:16:19.956 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-12-17T18:16:20.129 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cachetools. 2021-12-17T18:16:20.148 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-12-17T18:16:20.196 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-12-17T18:16:20.344 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-test. 2021-12-17T18:16:20.364 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../083-ceph-test_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:20.402 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-test (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:20.532 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyasn1. 2021-12-17T18:16:20.552 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-12-17T18:16:20.590 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-12-17T18:16:20.936 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-12-17T18:16:20.956 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-12-17T18:16:20.994 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-12-17T18:16:21.288 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rsa. 2021-12-17T18:16:21.310 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-12-17T18:16:21.355 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rsa (4.0-3) ... 2021-12-17T18:16:21.407 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-colorama. 2021-12-17T18:16:21.427 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-12-17T18:16:21.482 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-12-17T18:16:21.616 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-colorama. 2021-12-17T18:16:21.636 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-12-17T18:16:21.641 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-google-auth. 2021-12-17T18:16:21.663 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-12-17T18:16:21.674 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-12-17T18:16:21.700 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-12-17T18:16:21.743 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package cephfs-shell. 2021-12-17T18:16:21.762 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:21.801 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking cephfs-shell (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:21.867 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-colorama. 2021-12-17T18:16:21.886 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-12-17T18:16:21.924 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-12-17T18:16:21.977 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephfs-shell. 2021-12-17T18:16:21.998 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:22.036 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephfs-shell (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:22.037 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libcephfs-dev. 2021-12-17T18:16:22.053 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-blinker. 2021-12-17T18:16:22.058 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:22.072 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-12-17T18:16:22.103 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libcephfs-dev (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:22.111 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-12-17T18:16:22.169 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package cephfs-shell. 2021-12-17T18:16:22.189 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:22.253 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking cephfs-shell (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:22.271 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs-dev. 2021-12-17T18:16:22.293 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:22.321 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs-dev (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:22.432 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package nvme-cli. 2021-12-17T18:16:22.448 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-oauthlib. 2021-12-17T18:16:22.451 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-12-17T18:16:22.468 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-12-17T18:16:22.499 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-12-17T18:16:22.505 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package libcephfs-dev. 2021-12-17T18:16:22.506 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-12-17T18:16:22.525 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:22.563 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking libcephfs-dev (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:22.724 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package nvme-cli. 2021-12-17T18:16:22.744 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-12-17T18:16:22.801 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-12-17T18:16:22.860 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-12-17T18:16:22.879 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-atomicwrites. 2021-12-17T18:16:22.880 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-12-17T18:16:22.898 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-12-17T18:16:22.918 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-12-17T18:16:22.936 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-12-17T18:16:22.958 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package nvme-cli. 2021-12-17T18:16:22.980 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-12-17T18:16:23.034 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-12-17T18:16:23.174 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-atomicwrites. 2021-12-17T18:16:23.197 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-12-17T18:16:23.230 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-websocket. 2021-12-17T18:16:23.238 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-12-17T18:16:23.239 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-attr. 2021-12-17T18:16:23.249 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-12-17T18:16:23.259 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-12-17T18:16:23.288 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-12-17T18:16:23.298 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-12-17T18:16:23.456 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-atomicwrites. 2021-12-17T18:16:23.479 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-12-17T18:16:23.524 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-attr. 2021-12-17T18:16:23.530 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-12-17T18:16:23.544 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-12-17T18:16:23.582 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-12-17T18:16:23.617 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-webencodings. 2021-12-17T18:16:23.636 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-12-17T18:16:23.641 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-kubernetes. 2021-12-17T18:16:23.663 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-12-17T18:16:23.675 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-12-17T18:16:23.700 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-12-17T18:16:23.834 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-attr. 2021-12-17T18:16:23.853 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-12-17T18:16:23.917 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-12-17T18:16:23.936 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webencodings. 2021-12-17T18:16:23.956 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-12-17T18:16:23.978 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-html5lib. 2021-12-17T18:16:23.994 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-12-17T18:16:23.997 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-12-17T18:16:24.036 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-12-17T18:16:24.214 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-colorama. 2021-12-17T18:16:24.233 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-12-17T18:16:24.245 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-webencodings. 2021-12-17T18:16:24.262 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-12-17T18:16:24.267 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-12-17T18:16:24.272 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-12-17T18:16:24.282 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:24.297 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-html5lib. 2021-12-17T18:16:24.317 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-12-17T18:16:24.320 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:24.336 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-12-17T18:16:24.355 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-12-17T18:16:24.372 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-12-17T18:16:24.392 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-12-17T18:16:24.430 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-12-17T18:16:24.517 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package cephfs-shell. 2021-12-17T18:16:24.537 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:24.575 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking cephfs-shell (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:24.639 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-html5lib. 2021-12-17T18:16:24.649 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libonig5:amd64. 2021-12-17T18:16:24.662 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-12-17T18:16:24.671 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-12-17T18:16:24.706 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-12-17T18:16:24.719 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-12-17T18:16:24.733 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-12-17T18:16:24.754 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-12-17T18:16:24.792 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-12-17T18:16:24.828 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libcephfs-dev. 2021-12-17T18:16:24.849 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:24.903 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libcephfs-dev (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:24.915 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-packaging. 2021-12-17T18:16:24.936 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-12-17T18:16:24.984 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-packaging (20.3-1) ... 2021-12-17T18:16:25.060 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-12-17T18:16:25.083 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-12-17T18:16:25.093 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libjq1:amd64. 2021-12-17T18:16:25.114 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-12-17T18:16:25.151 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:25.154 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-12-17T18:16:25.240 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package nvme-cli. 2021-12-17T18:16:25.245 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-packaging. 2021-12-17T18:16:25.261 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-12-17T18:16:25.267 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-12-17T18:16:25.287 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pastescript. 2021-12-17T18:16:25.306 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-12-17T18:16:25.315 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-12-17T18:16:25.336 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-packaging (20.3-1) ... 2021-12-17T18:16:25.345 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-12-17T18:16:25.412 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package jq. 2021-12-17T18:16:25.433 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-12-17T18:16:25.471 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:25.630 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-packaging. 2021-12-17T18:16:25.640 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastescript. 2021-12-17T18:16:25.651 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-12-17T18:16:25.660 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-12-17T18:16:25.673 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pluggy. 2021-12-17T18:16:25.678 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-atomicwrites. 2021-12-17T18:16:25.693 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-12-17T18:16:25.695 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-packaging (20.3-1) ... 2021-12-17T18:16:25.697 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-12-17T18:16:25.700 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-12-17T18:16:25.731 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-12-17T18:16:25.737 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-12-17T18:16:25.757 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package socat. 2021-12-17T18:16:25.777 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-12-17T18:16:25.815 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking socat (1.7.3.3-2) ... 2021-12-17T18:16:26.024 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-pastescript. 2021-12-17T18:16:26.044 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-12-17T18:16:26.060 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pluggy. 2021-12-17T18:16:26.065 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-attr. 2021-12-17T18:16:26.067 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-psutil. 2021-12-17T18:16:26.079 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-12-17T18:16:26.081 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-12-17T18:16:26.087 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-12-17T18:16:26.091 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-12-17T18:16:26.118 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-12-17T18:16:26.126 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-12-17T18:16:26.131 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-12-17T18:16:26.329 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-12-17T18:16:26.348 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-12-17T18:16:26.387 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-12-17T18:16:26.421 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-psutil. 2021-12-17T18:16:26.444 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-pluggy. 2021-12-17T18:16:26.445 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-12-17T18:16:26.451 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-webencodings. 2021-12-17T18:16:26.454 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-py. 2021-12-17T18:16:26.464 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-12-17T18:16:26.471 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-12-17T18:16:26.473 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-12-17T18:16:26.487 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-12-17T18:16:26.510 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-12-17T18:16:26.510 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-12-17T18:16:26.511 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-12-17T18:16:26.707 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package xmlstarlet. 2021-12-17T18:16:26.731 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-12-17T18:16:26.774 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-12-17T18:16:26.821 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-html5lib. 2021-12-17T18:16:26.825 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pyinotify. 2021-12-17T18:16:26.841 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-py. 2021-12-17T18:16:26.843 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-12-17T18:16:26.847 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-12-17T18:16:26.855 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-psutil. 2021-12-17T18:16:26.863 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-12-17T18:16:26.875 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-12-17T18:16:26.887 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-12-17T18:16:26.892 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-12-17T18:16:26.898 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-12-17T18:16:26.914 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-12-17T18:16:27.178 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-test. 2021-12-17T18:16:27.198 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../083-ceph-test_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:27.209 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-py. 2021-12-17T18:16:27.224 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-12-17T18:16:27.228 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyinotify. 2021-12-17T18:16:27.228 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pytest. 2021-12-17T18:16:27.231 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-12-17T18:16:27.236 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-test (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:27.247 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-12-17T18:16:27.247 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-12-17T18:16:27.251 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-12-17T18:16:27.275 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-12-17T18:16:27.286 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-12-17T18:16:27.290 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-12-17T18:16:27.295 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-12-17T18:16:27.605 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-pyinotify. 2021-12-17T18:16:27.623 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pytest. 2021-12-17T18:16:27.627 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-12-17T18:16:27.643 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-12-17T18:16:27.658 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-simplejson. 2021-12-17T18:16:27.677 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-12-17T18:16:27.682 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-12-17T18:16:27.696 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-12-17T18:16:27.717 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-12-17T18:16:27.794 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-packaging. 2021-12-17T18:16:27.813 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-12-17T18:16:27.852 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-packaging (20.3-1) ... 2021-12-17T18:16:28.006 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-pytest. 2021-12-17T18:16:28.025 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-12-17T18:16:28.033 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplejson. 2021-12-17T18:16:28.053 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-12-17T18:16:28.097 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-12-17T18:16:28.116 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-12-17T18:16:28.155 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pastescript. 2021-12-17T18:16:28.175 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-12-17T18:16:28.209 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package radosgw. 2021-12-17T18:16:28.213 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-12-17T18:16:28.229 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../101-radosgw_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:28.267 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking radosgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:28.418 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package python3-simplejson. 2021-12-17T18:16:28.437 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-12-17T18:16:28.509 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-12-17T18:16:28.535 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pluggy. 2021-12-17T18:16:28.554 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-12-17T18:16:28.593 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-12-17T18:16:28.611 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package radosgw. 2021-12-17T18:16:28.631 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../101-radosgw_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:28.669 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking radosgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:28.963 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package radosgw. 2021-12-17T18:16:28.982 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../101-radosgw_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:29.021 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking radosgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:29.038 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-psutil. 2021-12-17T18:16:29.057 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-12-17T18:16:29.097 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-12-17T18:16:29.338 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package rbd-fuse. 2021-12-17T18:16:29.357 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:29.404 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking rbd-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:29.450 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-py. 2021-12-17T18:16:29.469 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-12-17T18:16:29.507 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-12-17T18:16:29.715 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package rbd-fuse. 2021-12-17T18:16:29.733 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-attr (19.3.0-2) ... 2021-12-17T18:16:29.737 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:29.781 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking rbd-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:29.861 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyinotify. 2021-12-17T18:16:29.880 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-12-17T18:16:29.919 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-12-17T18:16:30.067 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-12-17T18:16:30.082 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-attr (19.3.0-2) ... 2021-12-17T18:16:30.194 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-12-17T18:16:30.281 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pytest. 2021-12-17T18:16:30.303 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-12-17T18:16:30.303 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-12-17T18:16:30.347 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-12-17T18:16:30.436 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-12-17T18:16:30.496 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:30.542 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package rbd-fuse. 2021-12-17T18:16:30.554 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-12-17T18:16:30.563 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:30.633 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking rbd-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:30.680 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-12-17T18:16:30.728 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-simplejson. 2021-12-17T18:16:30.748 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-12-17T18:16:30.786 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-12-17T18:16:30.841 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-colorama. 2021-12-17T18:16:30.860 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-12-17T18:16:30.873 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:30.899 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-12-17T18:16:30.952 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-attr (19.3.0-2) ... 2021-12-17T18:16:31.115 INFO:teuthology.orchestra.run.smithi125.stdout:Adding system user cephadm....done 2021-12-17T18:16:31.169 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephfs-shell. 2021-12-17T18:16:31.188 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-105-g05c319fc-1focal_all.deb ... 2021-12-17T18:16:31.227 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephfs-shell (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:31.271 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package radosgw. 2021-12-17T18:16:31.277 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-12-17T18:16:31.291 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../101-radosgw_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:31.296 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-12-17T18:16:31.329 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking radosgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:31.447 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-12-17T18:16:31.479 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libcephfs-dev. 2021-12-17T18:16:31.493 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user cephadm....done 2021-12-17T18:16:31.503 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:31.571 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libcephfs-dev (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:31.573 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-12-17T18:16:31.612 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-12-17T18:16:31.688 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-12-17T18:16:31.767 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:31.905 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-12-17T18:16:32.031 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-12-17T18:16:32.039 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-12-17T18:16:32.041 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package nvme-cli. 2021-12-17T18:16:32.063 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-12-17T18:16:32.126 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-12-17T18:16:32.357 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-12-17T18:16:32.358 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-12-17T18:16:32.442 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package rbd-fuse. 2021-12-17T18:16:32.445 INFO:teuthology.orchestra.run.smithi109.stdout:Adding system user cephadm....done 2021-12-17T18:16:32.463 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:32.485 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-12-17T18:16:32.508 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking rbd-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:32.547 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-atomicwrites. 2021-12-17T18:16:32.566 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-12-17T18:16:32.605 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-12-17T18:16:32.606 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-12-17T18:16:32.742 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-12-17T18:16:32.806 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-attr (19.3.0-2) ... 2021-12-17T18:16:32.810 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-12-17T18:16:32.925 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-attr. 2021-12-17T18:16:32.944 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-12-17T18:16:32.967 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-12-17T18:16:32.974 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-12-17T18:16:33.018 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-12-17T18:16:33.122 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-12-17T18:16:33.220 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-12-17T18:16:33.223 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-12-17T18:16:33.260 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-12-17T18:16:33.286 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-webencodings. 2021-12-17T18:16:33.303 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-12-17T18:16:33.305 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-12-17T18:16:33.369 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-12-17T18:16:33.372 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-12-17T18:16:33.394 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-12-17T18:16:33.530 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-12-17T18:16:33.567 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:33.579 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-12-17T18:16:33.672 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-html5lib. 2021-12-17T18:16:33.692 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-12-17T18:16:33.721 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-12-17T18:16:33.730 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-12-17T18:16:33.815 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-12-17T18:16:34.099 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-12-17T18:16:34.148 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-12-17T18:16:34.204 INFO:teuthology.orchestra.run.smithi158.stdout:Adding system user cephadm....done 2021-12-17T18:16:34.228 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-12-17T18:16:34.242 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-12-17T18:16:34.263 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-12-17T18:16:34.325 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-12-17T18:16:34.424 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-12-17T18:16:34.449 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-12-17T18:16:34.581 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-ceph-argparse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:34.742 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-12-17T18:16:34.784 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-12-17T18:16:34.818 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-12-17T18:16:34.820 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-packaging. 2021-12-17T18:16:34.840 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-12-17T18:16:34.865 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:34.878 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-packaging (20.3-1) ... 2021-12-17T18:16:35.000 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-12-17T18:16:35.034 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-argparse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:35.087 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-12-17T18:16:35.087 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-12-17T18:16:35.182 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pastescript. 2021-12-17T18:16:35.201 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-12-17T18:16:35.212 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-12-17T18:16:35.265 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-12-17T18:16:35.276 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-12-17T18:16:35.335 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:35.395 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-12-17T18:16:35.461 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-12-17T18:16:35.555 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-12-17T18:16:35.594 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-12-17T18:16:35.627 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pluggy. 2021-12-17T18:16:35.648 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-12-17T18:16:35.687 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-ceph-argparse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:35.719 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-12-17T18:16:35.754 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-12-17T18:16:35.895 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-12-17T18:16:35.972 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:35.973 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-12-17T18:16:36.031 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-psutil. 2021-12-17T18:16:36.048 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-12-17T18:16:36.050 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-12-17T18:16:36.089 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-12-17T18:16:36.123 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-12-17T18:16:36.271 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-12-17T18:16:36.275 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-12-17T18:16:36.348 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-12-17T18:16:36.449 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-12-17T18:16:36.450 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-py. 2021-12-17T18:16:36.474 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-12-17T18:16:36.517 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-12-17T18:16:36.551 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-12-17T18:16:36.556 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-12-17T18:16:36.733 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-12-17T18:16:36.742 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-12-17T18:16:36.819 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-12-17T18:16:36.863 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyinotify. 2021-12-17T18:16:36.882 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-12-17T18:16:36.891 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-12-17T18:16:36.922 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-12-17T18:16:37.001 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-12-17T18:16:37.086 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-12-17T18:16:37.104 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-12-17T18:16:37.192 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-12-17T18:16:37.265 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pytest. 2021-12-17T18:16:37.287 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-12-17T18:16:37.327 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-12-17T18:16:37.331 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-12-17T18:16:37.415 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-ceph-argparse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:37.478 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-12-17T18:16:37.543 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-12-17T18:16:37.636 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-12-17T18:16:37.707 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:37.744 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-simplejson. 2021-12-17T18:16:37.766 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-12-17T18:16:37.771 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-12-17T18:16:37.813 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-12-17T18:16:37.841 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-12-17T18:16:37.861 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-packaging (20.3-1) ... 2021-12-17T18:16:37.963 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-12-17T18:16:38.131 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-12-17T18:16:38.136 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-12-17T18:16:38.162 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-12-17T18:16:38.256 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-packaging (20.3-1) ... 2021-12-17T18:16:38.288 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-12-17T18:16:38.289 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package radosgw. 2021-12-17T18:16:38.308 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../101-radosgw_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:38.347 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking radosgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:38.407 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-12-17T18:16:38.410 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-12-17T18:16:38.557 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-12-17T18:16:38.572 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-12-17T18:16:38.661 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-12-17T18:16:38.683 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-12-17T18:16:38.783 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-12-17T18:16:38.991 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-12-17T18:16:39.001 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-12-17T18:16:39.026 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-12-17T18:16:39.076 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-packaging (20.3-1) ... 2021-12-17T18:16:39.300 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-12-17T18:16:39.339 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-12-17T18:16:39.385 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package rbd-fuse. 2021-12-17T18:16:39.395 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-12-17T18:16:39.405 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-105-g05c319fc-1focal_amd64.deb ... 2021-12-17T18:16:39.419 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-12-17T18:16:39.468 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking rbd-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:39.520 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-12-17T18:16:39.674 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-12-17T18:16:39.677 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-12-17T18:16:39.762 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-12-17T18:16:39.764 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-attr (19.3.0-2) ... 2021-12-17T18:16:39.821 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-12-17T18:16:39.959 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-12-17T18:16:40.054 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up socat (1.7.3.3-2) ... 2021-12-17T18:16:40.122 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-12-17T18:16:40.123 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-12-17T18:16:40.180 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:40.231 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-12-17T18:16:40.249 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-12-17T18:16:40.301 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-12-17T18:16:40.391 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-12-17T18:16:40.473 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-12-17T18:16:40.507 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up socat (1.7.3.3-2) ... 2021-12-17T18:16:40.561 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-packaging (20.3-1) ... 2021-12-17T18:16:40.566 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-12-17T18:16:40.585 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:40.633 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:40.824 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-12-17T18:16:40.850 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-12-17T18:16:40.943 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-12-17T18:16:40.950 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-12-17T18:16:40.992 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-12-17T18:16:40.996 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-12-17T18:16:41.147 INFO:teuthology.orchestra.run.smithi192.stdout:Adding system user cephadm....done 2021-12-17T18:16:41.260 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-12-17T18:16:41.282 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-12-17T18:16:41.286 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-12-17T18:16:41.300 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-12-17T18:16:41.386 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-12-17T18:16:41.386 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up socat (1.7.3.3-2) ... 2021-12-17T18:16:41.415 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-12-17T18:16:41.537 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:41.651 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-12-17T18:16:41.677 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-12-17T18:16:41.704 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-12-17T18:16:41.727 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-12-17T18:16:41.841 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-12-17T18:16:41.852 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-12-17T18:16:41.944 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-12-17T18:16:41.970 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-12-17T18:16:41.982 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-12-17T18:16:42.045 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-12-17T18:16:42.179 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-12-17T18:16:42.226 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-12-17T18:16:42.284 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-12-17T18:16:42.321 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-12-17T18:16:42.355 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-12-17T18:16:42.386 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-12-17T18:16:42.411 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-12-17T18:16:42.472 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-12-17T18:16:42.674 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up socat (1.7.3.3-2) ... 2021-12-17T18:16:42.677 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-12-17T18:16:42.679 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-12-17T18:16:42.757 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-12-17T18:16:42.765 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-12-17T18:16:42.825 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:42.838 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-12-17T18:16:42.891 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-12-17T18:16:42.987 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-12-17T18:16:43.034 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-12-17T18:16:43.135 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-12-17T18:16:43.159 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-12-17T18:16:43.165 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-12-17T18:16:43.305 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-12-17T18:16:43.360 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-12-17T18:16:43.453 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-12-17T18:16:43.468 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-12-17T18:16:43.499 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-12-17T18:16:43.579 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-12-17T18:16:43.620 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-12-17T18:16:43.761 INFO:teuthology.orchestra.run.smithi125.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-12-17T18:16:43.792 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-12-17T18:16:43.797 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-12-17T18:16:43.854 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-12-17T18:16:43.864 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-12-17T18:16:43.919 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-12-17T18:16:43.990 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-12-17T18:16:44.007 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-12-17T18:16:44.137 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-12-17T18:16:44.139 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-ceph-argparse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:44.224 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-12-17T18:16:44.240 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-12-17T18:16:44.303 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-12-17T18:16:44.432 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:44.447 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-12-17T18:16:44.491 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-12-17T18:16:44.536 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-12-17T18:16:44.583 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-12-17T18:16:44.596 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-12-17T18:16:44.613 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-12-17T18:16:44.820 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-12-17T18:16:44.840 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-12-17T18:16:44.875 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-12-17T18:16:44.897 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-12-17T18:16:44.917 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-12-17T18:16:44.925 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-12-17T18:16:45.023 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-12-17T18:16:45.052 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-12-17T18:16:45.185 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-12-17T18:16:45.258 INFO:teuthology.orchestra.run.smithi109.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-12-17T18:16:45.282 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-12-17T18:16:45.316 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-12-17T18:16:45.372 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-12-17T18:16:45.408 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-12-17T18:16:45.478 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-12-17T18:16:45.534 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-12-17T18:16:45.534 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-12-17T18:16:45.634 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-12-17T18:16:45.664 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-12-17T18:16:45.694 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up librados2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:45.804 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-12-17T18:16:45.829 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-12-17T18:16:45.877 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-12-17T18:16:45.927 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-12-17T18:16:46.016 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-12-17T18:16:46.139 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-12-17T18:16:46.170 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librados2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:46.304 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-12-17T18:16:46.313 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-12-17T18:16:46.384 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-12-17T18:16:46.507 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-12-17T18:16:46.510 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-12-17T18:16:46.581 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-12-17T18:16:46.666 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-12-17T18:16:46.703 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-12-17T18:16:46.792 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-12-17T18:16:47.016 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-12-17T18:16:47.021 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-12-17T18:16:47.143 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-12-17T18:16:47.218 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up librgw2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:47.314 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up librados2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:47.344 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:47.366 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-12-17T18:16:47.411 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-packaging (20.3-1) ... 2021-12-17T18:16:47.461 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-12-17T18:16:47.464 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-12-17T18:16:47.516 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-12-17T18:16:47.638 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-12-17T18:16:47.695 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-12-17T18:16:47.805 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librgw2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:47.830 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-12-17T18:16:47.832 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-12-17T18:16:47.956 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:47.978 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-12-17T18:16:48.082 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-12-17T18:16:48.115 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-12-17T18:16:48.125 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-12-17T18:16:48.271 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librados2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:48.397 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-12-17T18:16:48.426 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-12-17T18:16:48.476 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-12-17T18:16:48.500 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-12-17T18:16:48.769 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-12-17T18:16:48.770 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libcephfs2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:48.809 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-12-17T18:16:48.871 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-12-17T18:16:48.912 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up librgw2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:49.008 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:49.053 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-12-17T18:16:49.135 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-12-17T18:16:49.173 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libradosstriper1 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:49.186 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-12-17T18:16:49.299 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-12-17T18:16:49.413 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:49.511 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-12-17T18:16:49.539 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up socat (1.7.3.3-2) ... 2021-12-17T18:16:49.539 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-12-17T18:16:49.633 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:49.690 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:49.804 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-12-17T18:16:49.867 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libradosstriper1 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:49.869 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librgw2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:49.991 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-12-17T18:16:49.995 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:50.009 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-12-17T18:16:50.106 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-12-17T18:16:50.121 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-12-17T18:16:50.312 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-12-17T18:16:50.370 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:50.422 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-12-17T18:16:50.441 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up libcephfs2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:50.502 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-12-17T18:16:50.542 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-12-17T18:16:50.682 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up librbd1 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:50.715 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-12-17T18:16:50.808 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-12-17T18:16:50.811 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-12-17T18:16:50.841 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-12-17T18:16:50.863 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up libradosstriper1 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:50.943 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-12-17T18:16:50.988 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-12-17T18:16:51.069 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-12-17T18:16:51.096 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-12-17T18:16:51.176 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-12-17T18:16:51.323 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:51.378 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:51.414 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libcephfs2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:51.460 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-12-17T18:16:51.466 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librbd1 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:51.504 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-rsa (4.0-3) ... 2021-12-17T18:16:51.540 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-12-17T18:16:51.594 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-12-17T18:16:51.720 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-12-17T18:16:51.762 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-12-17T18:16:51.789 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-12-17T18:16:51.859 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libradosstriper1 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:51.863 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-12-17T18:16:51.863 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-12-17T18:16:51.985 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-12-17T18:16:52.057 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr-modules-core (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:52.169 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-12-17T18:16:52.183 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:52.206 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:52.312 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:52.332 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rsa (4.0-3) ... 2021-12-17T18:16:52.362 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up librbd1 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:52.407 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-12-17T18:16:52.407 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-12-17T18:16:52.489 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-12-17T18:16:52.515 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-12-17T18:16:52.633 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-12-17T18:16:52.651 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-12-17T18:16:52.734 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-12-17T18:16:52.802 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-12-17T18:16:52.826 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libcephfs-dev (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:52.953 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-12-17T18:16:52.969 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-modules-core (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:53.019 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:53.095 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:53.145 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-rsa (4.0-3) ... 2021-12-17T18:16:53.198 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-12-17T18:16:53.254 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-12-17T18:16:53.328 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-12-17T18:16:53.328 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-12-17T18:16:53.336 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librbd1 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:53.454 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-12-17T18:16:53.462 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-12-17T18:16:53.463 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-12-17T18:16:53.547 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-12-17T18:16:53.568 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-12-17T18:16:53.588 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-12-17T18:16:53.714 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-12-17T18:16:53.763 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs-dev (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:53.765 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up ceph-mgr-modules-core (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:53.874 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-rados (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:53.889 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-12-17T18:16:53.892 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up ceph-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:53.903 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-12-17T18:16:54.001 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-rbd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:54.040 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:54.111 INFO:teuthology.orchestra.run.smithi109.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-12-17T18:16:54.112 INFO:teuthology.orchestra.run.smithi109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-12-17T18:16:54.135 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up rbd-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:54.190 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-12-17T18:16:54.191 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-rsa (4.0-3) ... 2021-12-17T18:16:54.229 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-12-17T18:16:54.263 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-routes (2.4.1-2) ... 2021-12-17T18:16:54.372 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-12-17T18:16:54.515 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-12-17T18:16:54.534 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up libcephfs-dev (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:54.550 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-12-17T18:16:54.633 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-12-17T18:16:54.660 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-12-17T18:16:54.841 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-12-17T18:16:54.884 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-12-17T18:16:54.923 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rados (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:54.935 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-rgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:54.972 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-12-17T18:16:55.061 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-cephfs (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:55.074 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rbd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:55.142 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librados2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:55.177 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-modules-core (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:55.200 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up rbd-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:55.275 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-12-17T18:16:55.310 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-12-17T18:16:55.312 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:55.326 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-routes (2.4.1-2) ... 2021-12-17T18:16:55.354 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up cephfs-shell (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:55.480 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-12-17T18:16:55.526 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-12-17T18:16:55.527 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-12-17T18:16:55.661 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-rados (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:55.720 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-12-17T18:16:55.829 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-rbd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:55.955 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up rbd-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:55.980 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libcephfs-dev (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:56.030 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:56.106 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-routes (2.4.1-2) ... 2021-12-17T18:16:56.140 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-12-17T18:16:56.156 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cephfs (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:56.366 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:56.425 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-12-17T18:16:56.457 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephfs-shell (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:56.517 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-12-17T18:16:56.584 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-12-17T18:16:56.743 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-12-17T18:16:56.769 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librgw2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:56.827 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-rgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:56.870 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:16:56.936 INFO:teuthology.orchestra.run.smithi125.stdout:Adding group ceph....done 2021-12-17T18:16:56.961 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-cephfs (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:56.971 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-12-17T18:16:57.096 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-rados (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:57.223 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-rbd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:57.287 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up cephfs-shell (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:57.322 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-12-17T18:16:57.329 INFO:teuthology.orchestra.run.smithi125.stdout:Adding system user ceph....done 2021-12-17T18:16:57.348 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up rbd-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:57.413 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-12-17T18:16:57.474 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-routes (2.4.1-2) ... 2021-12-17T18:16:57.506 INFO:teuthology.orchestra.run.smithi125.stdout:Setting system user ceph properties....done 2021-12-17T18:16:57.527 INFO:teuthology.orchestra.run.smithi125.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-12-17T18:16:57.529 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:57.615 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-12-17T18:16:57.678 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-12-17T18:16:57.872 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-12-17T18:16:57.916 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-12-17T18:16:57.981 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-12-17T18:16:58.124 INFO:teuthology.orchestra.run.smithi062.stdout:Adding group ceph....done 2021-12-17T18:16:58.207 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-rgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:58.260 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libcephfs2 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:58.333 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cephfs (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:58.350 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:58.361 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-12-17T18:16:58.427 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-test (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:58.476 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user ceph....done 2021-12-17T18:16:58.553 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up radosgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:58.617 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up cephfs-shell (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:58.627 INFO:teuthology.orchestra.run.smithi062.stdout:Setting system user ceph properties....done 2021-12-17T18:16:58.648 INFO:teuthology.orchestra.run.smithi062.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-12-17T18:16:58.664 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libradosstriper1 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:58.743 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-12-17T18:16:58.791 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-12-17T18:16:58.799 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-12-17T18:16:58.821 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-12-17T18:16:58.821 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-12-17T18:16:58.938 INFO:teuthology.orchestra.run.smithi109.stdout:Adding group ceph....done 2021-12-17T18:16:59.103 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-12-17T18:16:59.108 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-12-17T18:16:59.339 INFO:teuthology.orchestra.run.smithi109.stdout:Adding system user ceph....done 2021-12-17T18:16:59.430 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-base (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:59.515 INFO:teuthology.orchestra.run.smithi109.stdout:Setting system user ceph properties....done 2021-12-17T18:16:59.531 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-test (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:59.534 INFO:teuthology.orchestra.run.smithi109.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-12-17T18:16:59.658 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up radosgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:59.683 INFO:teuthology.orchestra.run.smithi109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-12-17T18:16:59.722 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:16:59.799 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-12-17T18:16:59.939 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-12-17T18:16:59.940 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-12-17T18:16:59.990 INFO:teuthology.orchestra.run.smithi109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-12-17T18:17:00.139 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librbd1 (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:00.241 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mds (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:00.265 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-12-17T18:17:00.292 INFO:teuthology.orchestra.run.smithi158.stdout:Adding group ceph....done 2021-12-17T18:17:00.416 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-12-17T18:17:00.461 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up ceph-test (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:00.468 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-12-17T18:17:00.469 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-12-17T18:17:00.534 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-12-17T18:17:00.551 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-base (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:00.587 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up radosgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:00.693 INFO:teuthology.orchestra.run.smithi158.stdout:Adding system user ceph....done 2021-12-17T18:17:00.845 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-12-17T18:17:00.864 INFO:teuthology.orchestra.run.smithi109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-12-17T18:17:00.864 INFO:teuthology.orchestra.run.smithi109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-12-17T18:17:00.876 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:00.903 INFO:teuthology.orchestra.run.smithi158.stdout:Setting system user ceph properties....done 2021-12-17T18:17:00.923 INFO:teuthology.orchestra.run.smithi158.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-12-17T18:17:00.970 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rsa (4.0-3) ... 2021-12-17T18:17:00.973 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-12-17T18:17:01.069 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-12-17T18:17:01.104 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-12-17T18:17:01.105 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-12-17T18:17:01.272 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-12-17T18:17:01.390 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-12-17T18:17:01.429 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mds (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:01.519 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:01.573 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up ceph-base (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:01.581 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-modules-core (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:01.661 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-12-17T18:17:01.662 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-12-17T18:17:01.678 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-osd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:01.741 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:01.858 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-test (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:01.966 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-12-17T18:17:01.967 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-12-17T18:17:01.981 INFO:teuthology.orchestra.run.smithi109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-12-17T18:17:01.984 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up radosgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:02.073 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:02.192 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-12-17T18:17:02.193 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-12-17T18:17:02.252 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-12-17T18:17:02.253 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-12-17T18:17:02.302 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-12-17T18:17:02.303 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-12-17T18:17:02.410 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up ceph-mds (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:02.417 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libcephfs-dev (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:02.543 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-12-17T18:17:02.606 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr-k8sevents (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:02.639 INFO:teuthology.orchestra.run.smithi109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-12-17T18:17:02.639 INFO:teuthology.orchestra.run.smithi109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-12-17T18:17:02.757 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:02.767 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:02.871 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-12-17T18:17:02.908 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mon (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:02.909 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-osd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:02.920 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-base (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:03.053 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up ceph-mgr (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:03.159 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-12-17T18:17:03.159 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-12-17T18:17:03.191 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-12-17T18:17:03.276 INFO:teuthology.orchestra.run.smithi109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-12-17T18:17:03.276 INFO:teuthology.orchestra.run.smithi109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-12-17T18:17:03.298 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-12-17T18:17:03.396 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-12-17T18:17:03.396 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-12-17T18:17:03.576 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr-cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:03.602 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rados (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:03.713 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:03.719 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:03.728 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rbd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:03.764 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mds (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:03.836 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-k8sevents (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:03.845 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr-dashboard (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:03.854 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up rbd-fuse (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:03.880 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up ceph-osd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:03.937 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:03.980 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-routes (2.4.1-2) ... 2021-12-17T18:17:03.989 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-12-17T18:17:04.012 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-12-17T18:17:04.012 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-12-17T18:17:04.063 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mon (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:04.265 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-12-17T18:17:04.321 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-12-17T18:17:04.321 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-12-17T18:17:04.374 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-12-17T18:17:04.380 INFO:teuthology.orchestra.run.smithi109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-12-17T18:17:04.380 INFO:teuthology.orchestra.run.smithi109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-12-17T18:17:04.457 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:04.680 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-12-17T18:17:04.681 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-12-17T18:17:04.684 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:04.750 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:04.799 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up ceph-mgr-k8sevents (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:04.911 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:04.925 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:05.040 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-dashboard (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:05.094 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up ceph-mon (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:05.155 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:05.315 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-12-17T18:17:05.318 INFO:teuthology.orchestra.run.smithi109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-12-17T18:17:05.318 INFO:teuthology.orchestra.run.smithi109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-12-17T18:17:05.377 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cephfs (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:05.460 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-osd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:05.661 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephfs-shell (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:05.756 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up ceph-mgr-cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:05.791 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-12-17T18:17:05.887 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-12-17T18:17:05.926 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up ceph (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:05.968 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-12-17T18:17:05.968 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-12-17T18:17:06.055 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up ceph-mgr-dashboard (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:06.199 INFO:teuthology.orchestra.run.smithi109.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-12-17T18:17:06.412 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-k8sevents (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:06.564 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:06.666 INFO:teuthology.orchestra.run.smithi109.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-12-17T18:17:06.707 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mon (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:06.708 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-common (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:06.931 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-12-17T18:17:06.931 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-12-17T18:17:07.052 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-12-17T18:17:07.302 INFO:teuthology.orchestra.run.smithi192.stdout:Adding group ceph....done 2021-12-17T18:17:07.367 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:07.476 INFO:teuthology.orchestra.run.smithi125.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-12-17T18:17:07.479 DEBUG:teuthology.orchestra.run.smithi125:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-12-17T18:17:07.518 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:07.547 INFO:teuthology.orchestra.run.smithi125.stdout:Reading package lists... 2021-12-17T18:17:07.619 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-dashboard (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:07.695 INFO:teuthology.orchestra.run.smithi192.stdout:Adding system user ceph....done 2021-12-17T18:17:07.716 INFO:teuthology.orchestra.run.smithi125.stdout:Building dependency tree... 2021-12-17T18:17:07.717 INFO:teuthology.orchestra.run.smithi125.stdout:Reading state information... 2021-12-17T18:17:07.747 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-12-17T18:17:07.862 INFO:teuthology.orchestra.run.smithi125.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-12-17T18:17:07.862 INFO:teuthology.orchestra.run.smithi125.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-12-17T18:17:07.863 INFO:teuthology.orchestra.run.smithi125.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-12-17T18:17:07.863 INFO:teuthology.orchestra.run.smithi125.stdout:The following packages were automatically installed and are no longer required: 2021-12-17T18:17:07.863 INFO:teuthology.orchestra.run.smithi125.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-12-17T18:17:07.864 INFO:teuthology.orchestra.run.smithi125.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-12-17T18:17:07.864 INFO:teuthology.orchestra.run.smithi125.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-12-17T18:17:07.864 INFO:teuthology.orchestra.run.smithi125.stdout: linux-modules-extra-5.4.0-66-generic 2021-12-17T18:17:07.864 INFO:teuthology.orchestra.run.smithi125.stdout:Use 'sudo apt autoremove' to remove them. 2021-12-17T18:17:07.865 INFO:teuthology.orchestra.run.smithi125.stdout:The following additional packages will be installed: 2021-12-17T18:17:07.865 INFO:teuthology.orchestra.run.smithi125.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2021-12-17T18:17:07.866 INFO:teuthology.orchestra.run.smithi125.stdout:Suggested packages: 2021-12-17T18:17:07.866 INFO:teuthology.orchestra.run.smithi125.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-12-17T18:17:07.880 INFO:teuthology.orchestra.run.smithi192.stdout:Setting system user ceph properties....done 2021-12-17T18:17:07.895 INFO:teuthology.orchestra.run.smithi125.stdout:The following NEW packages will be installed: 2021-12-17T18:17:07.895 INFO:teuthology.orchestra.run.smithi125.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-12-17T18:17:07.896 INFO:teuthology.orchestra.run.smithi125.stdout: libssl-dev 2021-12-17T18:17:07.896 INFO:teuthology.orchestra.run.smithi125.stdout:The following packages will be upgraded: 2021-12-17T18:17:07.897 INFO:teuthology.orchestra.run.smithi125.stdout: libssl1.1 2021-12-17T18:17:07.906 INFO:teuthology.orchestra.run.smithi192.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-12-17T18:17:08.039 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-12-17T18:17:08.054 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-12-17T18:17:08.079 INFO:teuthology.orchestra.run.smithi125.stdout:1 upgraded, 10 newly installed, 0 to remove and 69 not upgraded. 2021-12-17T18:17:08.079 INFO:teuthology.orchestra.run.smithi125.stdout:Need to get 4,235 kB of archives. 2021-12-17T18:17:08.080 INFO:teuthology.orchestra.run.smithi125.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-12-17T18:17:08.080 INFO:teuthology.orchestra.run.smithi125.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-12-17T18:17:08.355 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-12-17T18:17:08.539 INFO:teuthology.orchestra.run.smithi125.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.10 [1,322 kB] 2021-12-17T18:17:08.605 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-12-17T18:17:08.771 INFO:teuthology.orchestra.run.smithi125.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-12-17T18:17:08.810 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-test (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:08.831 INFO:teuthology.orchestra.run.smithi125.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-12-17T18:17:08.833 INFO:teuthology.orchestra.run.smithi125.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-12-17T18:17:08.840 INFO:teuthology.orchestra.run.smithi125.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-12-17T18:17:08.844 INFO:teuthology.orchestra.run.smithi125.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-12-17T18:17:08.845 INFO:teuthology.orchestra.run.smithi125.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-12-17T18:17:08.848 INFO:teuthology.orchestra.run.smithi125.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-12-17T18:17:08.848 INFO:teuthology.orchestra.run.smithi125.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-12-17T18:17:08.849 INFO:teuthology.orchestra.run.smithi125.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.10 [1,584 kB] 2021-12-17T18:17:08.935 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up radosgw (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:09.027 INFO:teuthology.orchestra.run.smithi062.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-12-17T18:17:09.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-12-17T18:17:09.102 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2021-12-17T18:17:09.201 INFO:teuthology.orchestra.run.smithi125.stdout:Preconfiguring packages ... 2021-12-17T18:17:09.202 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-12-17T18:17:09.202 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-12-17T18:17:09.277 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2021-12-17T18:17:09.278 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2021-12-17T18:17:09.295 INFO:teuthology.orchestra.run.smithi109.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-12-17T18:17:09.326 INFO:teuthology.orchestra.run.smithi125.stdout:Fetched 4,235 kB in 1s (4,217 kB/s) 2021-12-17T18:17:09.431 INFO:teuthology.orchestra.run.smithi062.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-12-17T18:17:09.431 INFO:teuthology.orchestra.run.smithi062.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-12-17T18:17:09.432 INFO:teuthology.orchestra.run.smithi062.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-12-17T18:17:09.432 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2021-12-17T18:17:09.432 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-12-17T18:17:09.433 INFO:teuthology.orchestra.run.smithi062.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-12-17T18:17:09.433 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-12-17T18:17:09.435 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-extra-5.4.0-66-generic 2021-12-17T18:17:09.435 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2021-12-17T18:17:09.436 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2021-12-17T18:17:09.436 INFO:teuthology.orchestra.run.smithi062.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2021-12-17T18:17:09.436 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2021-12-17T18:17:09.437 INFO:teuthology.orchestra.run.smithi062.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-12-17T18:17:09.463 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package flex. 2021-12-17T18:17:09.465 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2021-12-17T18:17:09.466 INFO:teuthology.orchestra.run.smithi062.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-12-17T18:17:09.466 INFO:teuthology.orchestra.run.smithi062.stdout: libssl-dev 2021-12-17T18:17:09.467 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages will be upgraded: 2021-12-17T18:17:09.468 INFO:teuthology.orchestra.run.smithi062.stdout: libssl1.1 2021-12-17T18:17:09.533 INFO:teuthology.orchestra.run.smithi125.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-12-17T18:17:09.539 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2021-12-17T18:17:09.579 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking flex (2.6.4-6.2) ... 2021-12-17T18:17:09.651 INFO:teuthology.orchestra.run.smithi062.stdout:1 upgraded, 10 newly installed, 0 to remove and 69 not upgraded. 2021-12-17T18:17:09.651 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 4,235 kB of archives. 2021-12-17T18:17:09.652 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-12-17T18:17:09.652 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-12-17T18:17:09.712 INFO:teuthology.orchestra.run.smithi109.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-12-17T18:17:09.715 DEBUG:teuthology.orchestra.run.smithi109:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-12-17T18:17:09.787 INFO:teuthology.orchestra.run.smithi109.stdout:Reading package lists... 2021-12-17T18:17:09.821 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-base (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:09.959 INFO:teuthology.orchestra.run.smithi109.stdout:Building dependency tree... 2021-12-17T18:17:09.960 INFO:teuthology.orchestra.run.smithi109.stdout:Reading state information... 2021-12-17T18:17:10.091 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.10 [1,322 kB] 2021-12-17T18:17:10.107 INFO:teuthology.orchestra.run.smithi109.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-12-17T18:17:10.107 INFO:teuthology.orchestra.run.smithi109.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-12-17T18:17:10.108 INFO:teuthology.orchestra.run.smithi109.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-12-17T18:17:10.108 INFO:teuthology.orchestra.run.smithi109.stdout:The following packages were automatically installed and are no longer required: 2021-12-17T18:17:10.108 INFO:teuthology.orchestra.run.smithi109.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-12-17T18:17:10.108 INFO:teuthology.orchestra.run.smithi109.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-12-17T18:17:10.109 INFO:teuthology.orchestra.run.smithi109.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-12-17T18:17:10.109 INFO:teuthology.orchestra.run.smithi109.stdout: linux-modules-extra-5.4.0-66-generic 2021-12-17T18:17:10.109 INFO:teuthology.orchestra.run.smithi109.stdout:Use 'sudo apt autoremove' to remove them. 2021-12-17T18:17:10.109 INFO:teuthology.orchestra.run.smithi109.stdout:The following additional packages will be installed: 2021-12-17T18:17:10.110 INFO:teuthology.orchestra.run.smithi109.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2021-12-17T18:17:10.110 INFO:teuthology.orchestra.run.smithi109.stdout:Suggested packages: 2021-12-17T18:17:10.110 INFO:teuthology.orchestra.run.smithi109.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-12-17T18:17:10.142 INFO:teuthology.orchestra.run.smithi109.stdout:The following NEW packages will be installed: 2021-12-17T18:17:10.142 INFO:teuthology.orchestra.run.smithi109.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-12-17T18:17:10.143 INFO:teuthology.orchestra.run.smithi109.stdout: libssl-dev 2021-12-17T18:17:10.144 INFO:teuthology.orchestra.run.smithi109.stdout:The following packages will be upgraded: 2021-12-17T18:17:10.145 INFO:teuthology.orchestra.run.smithi109.stdout: libssl1.1 2021-12-17T18:17:10.199 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-12-17T18:17:10.205 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.10_amd64.deb ... 2021-12-17T18:17:10.295 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-12-17T18:17:10.325 INFO:teuthology.orchestra.run.smithi109.stdout:1 upgraded, 10 newly installed, 0 to remove and 69 not upgraded. 2021-12-17T18:17:10.326 INFO:teuthology.orchestra.run.smithi109.stdout:Need to get 4,235 kB of archives. 2021-12-17T18:17:10.326 INFO:teuthology.orchestra.run.smithi109.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-12-17T18:17:10.326 INFO:teuthology.orchestra.run.smithi109.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-12-17T18:17:10.344 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-12-17T18:17:10.345 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-12-17T18:17:10.351 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-12-17T18:17:10.354 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-12-17T18:17:10.355 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-12-17T18:17:10.357 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-12-17T18:17:10.358 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-12-17T18:17:10.358 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.10 [1,584 kB] 2021-12-17T18:17:10.426 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.10) over (1.1.1f-1ubuntu2.8) ... 2021-12-17T18:17:10.616 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mds (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:10.658 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-12-17T18:17:10.727 INFO:teuthology.orchestra.run.smithi062.stdout:Preconfiguring packages ... 2021-12-17T18:17:10.849 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-12-17T18:17:10.849 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-12-17T18:17:10.869 INFO:teuthology.orchestra.run.smithi109.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.10 [1,322 kB] 2021-12-17T18:17:10.962 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 4,235 kB in 1s (4,488 kB/s) 2021-12-17T18:17:10.967 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package bison. 2021-12-17T18:17:10.988 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-12-17T18:17:11.061 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-12-17T18:17:11.078 INFO:teuthology.orchestra.run.smithi158.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-12-17T18:17:11.081 DEBUG:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-12-17T18:17:11.098 INFO:teuthology.orchestra.run.smithi109.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-12-17T18:17:11.105 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package flex. 2021-12-17T18:17:11.139 INFO:teuthology.orchestra.run.smithi109.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-12-17T18:17:11.140 INFO:teuthology.orchestra.run.smithi109.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-12-17T18:17:11.147 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2021-12-17T18:17:11.175 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-12-17T18:17:11.181 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2021-12-17T18:17:11.190 INFO:teuthology.orchestra.run.smithi109.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-12-17T18:17:11.192 INFO:teuthology.orchestra.run.smithi109.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-12-17T18:17:11.193 INFO:teuthology.orchestra.run.smithi109.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-12-17T18:17:11.195 INFO:teuthology.orchestra.run.smithi109.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-12-17T18:17:11.196 INFO:teuthology.orchestra.run.smithi109.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-12-17T18:17:11.196 INFO:teuthology.orchestra.run.smithi109.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.10 [1,584 kB] 2021-12-17T18:17:11.228 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking flex (2.6.4-6.2) ... 2021-12-17T18:17:11.267 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:11.316 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2021-12-17T18:17:11.317 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2021-12-17T18:17:11.463 INFO:teuthology.orchestra.run.smithi158.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-12-17T18:17:11.463 INFO:teuthology.orchestra.run.smithi158.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-12-17T18:17:11.464 INFO:teuthology.orchestra.run.smithi158.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-12-17T18:17:11.464 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages were automatically installed and are no longer required: 2021-12-17T18:17:11.464 INFO:teuthology.orchestra.run.smithi158.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-12-17T18:17:11.464 INFO:teuthology.orchestra.run.smithi158.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-12-17T18:17:11.465 INFO:teuthology.orchestra.run.smithi158.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-12-17T18:17:11.465 INFO:teuthology.orchestra.run.smithi158.stdout: linux-modules-extra-5.4.0-66-generic 2021-12-17T18:17:11.465 INFO:teuthology.orchestra.run.smithi158.stdout:Use 'sudo apt autoremove' to remove them. 2021-12-17T18:17:11.466 INFO:teuthology.orchestra.run.smithi158.stdout:The following additional packages will be installed: 2021-12-17T18:17:11.466 INFO:teuthology.orchestra.run.smithi158.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2021-12-17T18:17:11.467 INFO:teuthology.orchestra.run.smithi158.stdout:Suggested packages: 2021-12-17T18:17:11.467 INFO:teuthology.orchestra.run.smithi158.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-12-17T18:17:11.485 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-12-17T18:17:11.497 INFO:teuthology.orchestra.run.smithi158.stdout:The following NEW packages will be installed: 2021-12-17T18:17:11.498 INFO:teuthology.orchestra.run.smithi158.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-12-17T18:17:11.498 INFO:teuthology.orchestra.run.smithi158.stdout: libssl-dev 2021-12-17T18:17:11.499 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-12-17T18:17:11.499 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-12-17T18:17:11.500 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages will be upgraded: 2021-12-17T18:17:11.500 INFO:teuthology.orchestra.run.smithi158.stdout: libssl1.1 2021-12-17T18:17:11.505 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2021-12-17T18:17:11.544 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-12-17T18:17:11.569 INFO:teuthology.orchestra.run.smithi109.stdout:Preconfiguring packages ... 2021-12-17T18:17:11.680 INFO:teuthology.orchestra.run.smithi158.stdout:1 upgraded, 10 newly installed, 0 to remove and 69 not upgraded. 2021-12-17T18:17:11.681 INFO:teuthology.orchestra.run.smithi158.stdout:Need to get 4,235 kB of archives. 2021-12-17T18:17:11.681 INFO:teuthology.orchestra.run.smithi158.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-12-17T18:17:11.681 INFO:teuthology.orchestra.run.smithi158.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-12-17T18:17:11.695 INFO:teuthology.orchestra.run.smithi109.stdout:Fetched 4,235 kB in 1s (3,777 kB/s) 2021-12-17T18:17:11.811 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.10_amd64.deb ... 2021-12-17T18:17:11.880 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package dump. 2021-12-17T18:17:11.901 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2021-12-17T18:17:11.935 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package flex. 2021-12-17T18:17:11.939 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking dump (0.4b46-6) ... 2021-12-17T18:17:11.952 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:12.008 INFO:teuthology.orchestra.run.smithi109.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-12-17T18:17:12.013 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2021-12-17T18:17:12.026 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.10) over (1.1.1f-1ubuntu2.8) ... 2021-12-17T18:17:12.059 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking flex (2.6.4-6.2) ... 2021-12-17T18:17:12.112 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-osd (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:12.144 INFO:teuthology.orchestra.run.smithi158.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.10 [1,322 kB] 2021-12-17T18:17:12.267 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package indent. 2021-12-17T18:17:12.288 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2021-12-17T18:17:12.325 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking indent (2.2.12-1) ... 2021-12-17T18:17:12.349 INFO:teuthology.orchestra.run.smithi158.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-12-17T18:17:12.397 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-12-17T18:17:12.398 INFO:teuthology.orchestra.run.smithi158.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-12-17T18:17:12.405 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-12-17T18:17:12.407 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-12-17T18:17:12.407 INFO:teuthology.orchestra.run.smithi158.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-12-17T18:17:12.411 INFO:teuthology.orchestra.run.smithi158.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-12-17T18:17:12.411 INFO:teuthology.orchestra.run.smithi158.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-12-17T18:17:12.411 INFO:teuthology.orchestra.run.smithi158.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.10 [1,584 kB] 2021-12-17T18:17:12.536 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-12-17T18:17:12.538 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package bison. 2021-12-17T18:17:12.556 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2021-12-17T18:17:12.559 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-12-17T18:17:12.586 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-12-17T18:17:12.601 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-12-17T18:17:12.602 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-12-17T18:17:12.626 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-12-17T18:17:12.667 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.10_amd64.deb ... 2021-12-17T18:17:12.769 INFO:teuthology.orchestra.run.smithi158.stdout:Preconfiguring packages ... 2021-12-17T18:17:12.831 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.10) over (1.1.1f-1ubuntu2.8) ... 2021-12-17T18:17:12.832 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-12-17T18:17:12.852 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-12-17T18:17:12.889 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-12-17T18:17:12.912 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 4,235 kB in 1s (4,340 kB/s) 2021-12-17T18:17:13.042 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-12-17T18:17:13.063 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2021-12-17T18:17:13.074 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package flex. 2021-12-17T18:17:13.079 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-k8sevents (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:13.102 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-12-17T18:17:13.145 INFO:teuthology.orchestra.run.smithi158.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-12-17T18:17:13.151 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2021-12-17T18:17:13.197 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking flex (2.6.4-6.2) ... 2021-12-17T18:17:13.207 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:13.234 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libfl2:amd64. 2021-12-17T18:17:13.253 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2021-12-17T18:17:13.292 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:13.338 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mon (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:13.369 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package bison. 2021-12-17T18:17:13.390 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-12-17T18:17:13.465 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-12-17T18:17:13.470 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package dump. 2021-12-17T18:17:13.493 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2021-12-17T18:17:13.537 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking dump (0.4b46-6) ... 2021-12-17T18:17:13.560 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-12-17T18:17:13.561 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-12-17T18:17:13.570 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-12-17T18:17:13.592 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-12-17T18:17:13.621 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:13.799 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.10_amd64.deb ... 2021-12-17T18:17:13.815 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package indent. 2021-12-17T18:17:13.835 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2021-12-17T18:17:13.850 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-12-17T18:17:13.869 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.10_amd64.deb ... 2021-12-17T18:17:13.873 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking indent (2.2.12-1) ... 2021-12-17T18:17:13.907 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-12-17T18:17:13.908 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2021-12-17T18:17:13.928 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2021-12-17T18:17:13.965 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-12-17T18:17:14.004 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.10) over (1.1.1f-1ubuntu2.8) ... 2021-12-17T18:17:14.005 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-cephadm (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:14.152 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-12-17T18:17:14.158 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:14.171 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2021-12-17T18:17:14.210 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-12-17T18:17:14.259 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-dashboard (15.2.15-105-g05c319fc-1focal) ... 2021-12-17T18:17:14.350 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up flex (2.6.4-6.2) ... 2021-12-17T18:17:14.360 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package dump. 2021-12-17T18:17:14.381 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2021-12-17T18:17:14.418 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking dump (0.4b46-6) ... 2021-12-17T18:17:14.420 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-12-17T18:17:14.463 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-12-17T18:17:14.481 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.10) ... 2021-12-17T18:17:14.483 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-12-17T18:17:14.517 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package bison. 2021-12-17T18:17:14.521 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-12-17T18:17:14.536 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-12-17T18:17:14.579 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-12-17T18:17:14.685 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-12-17T18:17:14.764 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package indent. 2021-12-17T18:17:14.783 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2021-12-17T18:17:14.784 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-12-17T18:17:14.822 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking indent (2.2.12-1) ... 2021-12-17T18:17:14.869 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libfl2:amd64. 2021-12-17T18:17:14.890 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2021-12-17T18:17:14.909 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-12-17T18:17:14.927 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:15.035 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2021-12-17T18:17:15.040 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-12-17T18:17:15.059 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2021-12-17T18:17:15.098 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-12-17T18:17:15.100 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-12-17T18:17:15.122 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2021-12-17T18:17:15.145 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-12-17T18:17:15.172 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-12-17T18:17:15.191 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-12-17T18:17:15.192 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-12-17T18:17:15.230 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:15.246 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:15.347 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up dump (0.4b46-6) ... 2021-12-17T18:17:15.443 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package dump. 2021-12-17T18:17:15.451 INFO:teuthology.orchestra.run.smithi125.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-12-17T18:17:15.462 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2021-12-17T18:17:15.466 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-12-17T18:17:15.485 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-12-17T18:17:15.499 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-12-17T18:17:15.501 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking dump (0.4b46-6) ... 2021-12-17T18:17:15.520 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.10_amd64.deb ... 2021-12-17T18:17:15.524 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-12-17T18:17:15.557 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2021-12-17T18:17:15.599 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-12-17T18:17:15.714 INFO:teuthology.orchestra.run.smithi125.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-12-17T18:17:15.784 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up indent (2.2.12-1) ... 2021-12-17T18:17:15.910 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:15.920 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package libfl2:amd64. 2021-12-17T18:17:15.941 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2021-12-17T18:17:15.978 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:16.024 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package indent. 2021-12-17T18:17:16.029 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-12-17T18:17:16.043 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2021-12-17T18:17:16.082 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking indent (2.2.12-1) ... 2021-12-17T18:17:16.155 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-12-17T18:17:16.162 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up flex (2.6.4-6.2) ... 2021-12-17T18:17:16.264 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-12-17T18:17:16.284 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-12-17T18:17:16.290 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.10) ... 2021-12-17T18:17:16.323 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:16.351 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-12-17T18:17:16.374 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2021-12-17T18:17:16.418 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-12-17T18:17:16.601 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-12-17T18:17:16.612 INFO:teuthology.orchestra.run.smithi109.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-12-17T18:17:16.631 INFO:teuthology.orchestra.run.smithi109.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.10_amd64.deb ... 2021-12-17T18:17:16.670 INFO:teuthology.orchestra.run.smithi109.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2021-12-17T18:17:16.722 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-12-17T18:17:16.726 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-12-17T18:17:16.741 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-12-17T18:17:16.813 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-12-17T18:17:16.885 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2021-12-17T18:17:17.011 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-12-17T18:17:17.137 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:17.167 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libfl2:amd64. 2021-12-17T18:17:17.188 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2021-12-17T18:17:17.225 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:17.257 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up flex (2.6.4-6.2) ... 2021-12-17T18:17:17.272 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up dump (0.4b46-6) ... 2021-12-17T18:17:17.359 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.10) ... 2021-12-17T18:17:17.367 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-12-17T18:17:17.432 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-12-17T18:17:17.478 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-12-17T18:17:17.489 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-12-17T18:17:17.500 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-12-17T18:17:17.538 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-12-17T18:17:17.545 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:17.617 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up indent (2.2.12-1) ... 2021-12-17T18:17:17.694 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-12-17T18:17:17.751 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:17.820 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-12-17T18:17:17.856 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-12-17T18:17:17.876 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.10_amd64.deb ... 2021-12-17T18:17:17.878 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-12-17T18:17:17.923 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2021-12-17T18:17:17.924 INFO:teuthology.orchestra.run.smithi192.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-12-17T18:17:17.927 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-12-17T18:17:17.946 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2021-12-17T18:17:17.993 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2021-12-17T18:17:18.029 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-12-17T18:17:18.067 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-12-17T18:17:18.106 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-12-17T18:17:18.163 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2021-12-17T18:17:18.164 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2021-12-17T18:17:18.232 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:18.310 INFO:teuthology.orchestra.run.smithi192.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-12-17T18:17:18.311 INFO:teuthology.orchestra.run.smithi192.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-12-17T18:17:18.311 INFO:teuthology.orchestra.run.smithi192.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-12-17T18:17:18.311 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages were automatically installed and are no longer required: 2021-12-17T18:17:18.312 INFO:teuthology.orchestra.run.smithi192.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-12-17T18:17:18.312 INFO:teuthology.orchestra.run.smithi192.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-12-17T18:17:18.312 INFO:teuthology.orchestra.run.smithi192.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-12-17T18:17:18.313 INFO:teuthology.orchestra.run.smithi192.stdout: linux-modules-extra-5.4.0-66-generic 2021-12-17T18:17:18.313 INFO:teuthology.orchestra.run.smithi192.stdout:Use 'sudo apt autoremove' to remove them. 2021-12-17T18:17:18.314 INFO:teuthology.orchestra.run.smithi192.stdout:The following additional packages will be installed: 2021-12-17T18:17:18.314 INFO:teuthology.orchestra.run.smithi192.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2021-12-17T18:17:18.314 INFO:teuthology.orchestra.run.smithi192.stdout:Suggested packages: 2021-12-17T18:17:18.314 INFO:teuthology.orchestra.run.smithi192.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-12-17T18:17:18.333 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up dump (0.4b46-6) ... 2021-12-17T18:17:18.344 INFO:teuthology.orchestra.run.smithi192.stdout:The following NEW packages will be installed: 2021-12-17T18:17:18.345 INFO:teuthology.orchestra.run.smithi192.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-12-17T18:17:18.346 INFO:teuthology.orchestra.run.smithi192.stdout: libssl-dev 2021-12-17T18:17:18.347 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages will be upgraded: 2021-12-17T18:17:18.347 INFO:teuthology.orchestra.run.smithi192.stdout: libssl1.1 2021-12-17T18:17:18.374 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up flex (2.6.4-6.2) ... 2021-12-17T18:17:18.411 INFO:teuthology.orchestra.run.smithi109.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-12-17T18:17:18.468 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-12-17T18:17:18.496 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.10) ... 2021-12-17T18:17:18.530 INFO:teuthology.orchestra.run.smithi192.stdout:1 upgraded, 10 newly installed, 0 to remove and 69 not upgraded. 2021-12-17T18:17:18.531 INFO:teuthology.orchestra.run.smithi192.stdout:Need to get 4,235 kB of archives. 2021-12-17T18:17:18.531 INFO:teuthology.orchestra.run.smithi192.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-12-17T18:17:18.531 INFO:teuthology.orchestra.run.smithi192.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-12-17T18:17:18.583 INFO:teuthology.orchestra.run.smithi109.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-12-17T18:17:18.653 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up indent (2.2.12-1) ... 2021-12-17T18:17:18.750 INFO:teuthology.orchestra.run.smithi125.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-12-17T18:17:18.753 DEBUG:teuthology.parallel:result is None 2021-12-17T18:17:18.779 INFO:teuthology.orchestra.run.smithi109.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:18.817 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-12-17T18:17:18.935 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-12-17T18:17:18.939 INFO:teuthology.orchestra.run.smithi109.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-12-17T18:17:18.992 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.10 [1,322 kB] 2021-12-17T18:17:19.061 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2021-12-17T18:17:19.091 INFO:teuthology.orchestra.run.smithi109.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-12-17T18:17:19.187 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-12-17T18:17:19.197 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-12-17T18:17:19.246 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-12-17T18:17:19.246 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-12-17T18:17:19.252 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-12-17T18:17:19.254 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-12-17T18:17:19.255 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-12-17T18:17:19.257 INFO:teuthology.orchestra.run.smithi192.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-12-17T18:17:19.258 INFO:teuthology.orchestra.run.smithi192.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-12-17T18:17:19.259 INFO:teuthology.orchestra.run.smithi192.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.10 [1,584 kB] 2021-12-17T18:17:19.313 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:19.439 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up dump (0.4b46-6) ... 2021-12-17T18:17:19.535 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-12-17T18:17:19.617 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-12-17T18:17:19.619 INFO:teuthology.orchestra.run.smithi192.stdout:Preconfiguring packages ... 2021-12-17T18:17:19.707 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-12-17T18:17:19.742 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 4,235 kB in 1s (4,384 kB/s) 2021-12-17T18:17:19.777 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up indent (2.2.12-1) ... 2021-12-17T18:17:19.903 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:19.920 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package flex. 2021-12-17T18:17:19.923 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-12-17T18:17:19.990 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-12-17T18:17:19.995 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2021-12-17T18:17:20.030 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-12-17T18:17:20.034 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking flex (2.6.4-6.2) ... 2021-12-17T18:17:20.181 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-12-17T18:17:20.676 INFO:teuthology.orchestra.run.smithi062.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-12-17T18:17:20.678 DEBUG:teuthology.parallel:result is None 2021-12-17T18:17:20.717 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.10_amd64.deb ... 2021-12-17T18:17:20.975 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.10) over (1.1.1f-1ubuntu2.8) ... 2021-12-17T18:17:21.018 INFO:teuthology.orchestra.run.smithi109.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-12-17T18:17:21.505 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package bison. 2021-12-17T18:17:21.528 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-12-17T18:17:21.576 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-12-17T18:17:21.726 INFO:teuthology.orchestra.run.smithi109.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-12-17T18:17:21.730 DEBUG:teuthology.parallel:result is None 2021-12-17T18:17:22.008 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-12-17T18:17:22.031 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2021-12-17T18:17:22.036 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-12-17T18:17:22.083 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-12-17T18:17:22.453 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package dump. 2021-12-17T18:17:22.473 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2021-12-17T18:17:22.511 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking dump (0.4b46-6) ... 2021-12-17T18:17:22.753 INFO:teuthology.orchestra.run.smithi158.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-12-17T18:17:22.756 DEBUG:teuthology.parallel:result is None 2021-12-17T18:17:22.814 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package indent. 2021-12-17T18:17:22.836 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2021-12-17T18:17:22.865 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking indent (2.2.12-1) ... 2021-12-17T18:17:23.092 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-12-17T18:17:23.115 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2021-12-17T18:17:23.161 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-12-17T18:17:23.458 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-12-17T18:17:23.480 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-12-17T18:17:23.516 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-12-17T18:17:23.895 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libfl2:amd64. 2021-12-17T18:17:23.917 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2021-12-17T18:17:23.961 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:24.247 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-12-17T18:17:24.267 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-12-17T18:17:24.314 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:24.602 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-12-17T18:17:24.624 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.10_amd64.deb ... 2021-12-17T18:17:24.661 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2021-12-17T18:17:25.157 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up flex (2.6.4-6.2) ... 2021-12-17T18:17:25.274 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.10) ... 2021-12-17T18:17:25.592 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-12-17T18:17:25.693 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-12-17T18:17:25.920 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2021-12-17T18:17:26.079 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-12-17T18:17:26.205 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:26.332 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up dump (0.4b46-6) ... 2021-12-17T18:17:26.418 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-12-17T18:17:26.508 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-12-17T18:17:26.581 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-12-17T18:17:26.635 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up indent (2.2.12-1) ... 2021-12-17T18:17:26.749 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-12-17T18:17:26.896 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-12-17T18:17:27.056 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-12-17T18:17:28.959 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-12-17T18:17:29.691 INFO:teuthology.orchestra.run.smithi192.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-12-17T18:17:29.694 DEBUG:teuthology.parallel:result is None 2021-12-17T18:17:29.695 DEBUG:teuthology.orchestra.run.smithi062:> sudo lsb_release -is 2021-12-17T18:17:29.750 INFO:teuthology.orchestra.run.smithi062.stdout:Ubuntu 2021-12-17T18:17:29.756 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-12-17T18:17:29.757 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=05c319fc280f505b26f579a01ab4d14d2f130a5b 2021-12-17T18:17:29.996 DEBUG:teuthology.orchestra.run.smithi062:> dpkg-query -W -f '${Version}' ceph 2021-12-17T18:17:30.020 INFO:teuthology.orchestra.run.smithi062.stdout:15.2.15-105-g05c319fc-1focal 2021-12-17T18:17:30.021 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-105-g05c319fc-1focal 2021-12-17T18:17:30.022 INFO:teuthology.task.install:The correct ceph version 15.2.15-105-g05c319fc-1focal is installed. 2021-12-17T18:17:30.022 DEBUG:teuthology.orchestra.run.smithi109:> sudo lsb_release -is 2021-12-17T18:17:30.075 INFO:teuthology.orchestra.run.smithi109.stdout:Ubuntu 2021-12-17T18:17:30.081 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-12-17T18:17:30.082 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=05c319fc280f505b26f579a01ab4d14d2f130a5b 2021-12-17T18:17:30.289 DEBUG:teuthology.orchestra.run.smithi109:> dpkg-query -W -f '${Version}' ceph 2021-12-17T18:17:30.312 INFO:teuthology.orchestra.run.smithi109.stdout:15.2.15-105-g05c319fc-1focal 2021-12-17T18:17:30.313 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-105-g05c319fc-1focal 2021-12-17T18:17:30.313 INFO:teuthology.task.install:The correct ceph version 15.2.15-105-g05c319fc-1focal is installed. 2021-12-17T18:17:30.314 DEBUG:teuthology.orchestra.run.smithi125:> sudo lsb_release -is 2021-12-17T18:17:30.364 INFO:teuthology.orchestra.run.smithi125.stdout:Ubuntu 2021-12-17T18:17:30.371 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-12-17T18:17:30.372 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=05c319fc280f505b26f579a01ab4d14d2f130a5b 2021-12-17T18:17:30.580 DEBUG:teuthology.orchestra.run.smithi125:> dpkg-query -W -f '${Version}' ceph 2021-12-17T18:17:30.606 INFO:teuthology.orchestra.run.smithi125.stdout:15.2.15-105-g05c319fc-1focal 2021-12-17T18:17:30.607 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-105-g05c319fc-1focal 2021-12-17T18:17:30.607 INFO:teuthology.task.install:The correct ceph version 15.2.15-105-g05c319fc-1focal is installed. 2021-12-17T18:17:30.608 DEBUG:teuthology.orchestra.run.smithi158:> sudo lsb_release -is 2021-12-17T18:17:30.663 INFO:teuthology.orchestra.run.smithi158.stdout:Ubuntu 2021-12-17T18:17:30.666 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-12-17T18:17:30.667 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=05c319fc280f505b26f579a01ab4d14d2f130a5b 2021-12-17T18:17:30.883 DEBUG:teuthology.orchestra.run.smithi158:> dpkg-query -W -f '${Version}' ceph 2021-12-17T18:17:30.907 INFO:teuthology.orchestra.run.smithi158.stdout:15.2.15-105-g05c319fc-1focal 2021-12-17T18:17:30.908 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-105-g05c319fc-1focal 2021-12-17T18:17:30.908 INFO:teuthology.task.install:The correct ceph version 15.2.15-105-g05c319fc-1focal is installed. 2021-12-17T18:17:30.909 DEBUG:teuthology.orchestra.run.smithi192:> sudo lsb_release -is 2021-12-17T18:17:30.962 INFO:teuthology.orchestra.run.smithi192.stdout:Ubuntu 2021-12-17T18:17:30.967 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-12-17T18:17:30.967 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=05c319fc280f505b26f579a01ab4d14d2f130a5b 2021-12-17T18:17:31.189 DEBUG:teuthology.orchestra.run.smithi192:> dpkg-query -W -f '${Version}' ceph 2021-12-17T18:17:31.211 INFO:teuthology.orchestra.run.smithi192.stdout:15.2.15-105-g05c319fc-1focal 2021-12-17T18:17:31.211 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-105-g05c319fc-1focal 2021-12-17T18:17:31.212 INFO:teuthology.task.install:The correct ceph version 15.2.15-105-g05c319fc-1focal is installed. 2021-12-17T18:17:31.212 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-12-17T18:17:31.213 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-12-17T18:17:31.213 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-12-17T18:17:31.231 DEBUG:teuthology.orchestra.run.smithi109:> set -ex 2021-12-17T18:17:31.232 DEBUG:teuthology.orchestra.run.smithi109:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-12-17T18:17:31.249 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2021-12-17T18:17:31.249 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-12-17T18:17:31.267 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2021-12-17T18:17:31.267 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-12-17T18:17:31.285 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2021-12-17T18:17:31.285 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-12-17T18:17:31.305 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-12-17T18:17:31.306 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-12-17T18:17:31.307 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2021-12-17T18:17:31.325 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-12-17T18:17:31.337 DEBUG:teuthology.orchestra.run.smithi109:> set -ex 2021-12-17T18:17:31.338 DEBUG:teuthology.orchestra.run.smithi109:> sudo dd of=/usr/bin/daemon-helper 2021-12-17T18:17:31.356 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-12-17T18:17:31.415 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2021-12-17T18:17:31.415 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/daemon-helper 2021-12-17T18:17:31.432 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-12-17T18:17:31.489 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2021-12-17T18:17:31.490 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/daemon-helper 2021-12-17T18:17:31.507 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-12-17T18:17:31.523 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2021-12-17T18:17:31.523 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2021-12-17T18:17:31.543 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-12-17T18:17:31.602 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-12-17T18:17:31.603 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-12-17T18:17:31.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2021-12-17T18:17:31.620 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-12-17T18:17:31.683 DEBUG:teuthology.orchestra.run.smithi109:> set -ex 2021-12-17T18:17:31.683 DEBUG:teuthology.orchestra.run.smithi109:> sudo dd of=/usr/bin/adjust-ulimits 2021-12-17T18:17:31.698 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-12-17T18:17:31.752 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2021-12-17T18:17:31.752 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/adjust-ulimits 2021-12-17T18:17:31.769 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-12-17T18:17:31.826 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2021-12-17T18:17:31.826 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/adjust-ulimits 2021-12-17T18:17:31.843 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-12-17T18:17:31.853 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2021-12-17T18:17:31.854 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2021-12-17T18:17:31.871 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-12-17T18:17:31.886 INFO:teuthology.run_tasks:Running task ceph... 2021-12-17T18:17:31.949 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-12-17T18:17:31.950 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2021-12-17T18:17:31.953 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod 777 /var/log/ceph 2021-12-17T18:17:31.956 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 777 /var/log/ceph 2021-12-17T18:17:31.958 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 777 /var/log/ceph 2021-12-17T18:17:31.961 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /var/log/ceph 2021-12-17T18:17:31.975 INFO:tasks.ceph:Disabling ceph logrotate... 2021-12-17T18:17:31.976 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2021-12-17T18:17:32.010 DEBUG:teuthology.orchestra.run.smithi109:> sudo rm -f -- /etc/logrotate.d/ceph 2021-12-17T18:17:32.013 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /etc/logrotate.d/ceph 2021-12-17T18:17:32.015 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/logrotate.d/ceph 2021-12-17T18:17:32.018 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/logrotate.d/ceph 2021-12-17T18:17:32.032 INFO:tasks.ceph:Creating extra log directories... 2021-12-17T18:17:32.033 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-12-17T18:17:32.035 DEBUG:teuthology.orchestra.run.smithi109:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-12-17T18:17:32.072 DEBUG:teuthology.orchestra.run.smithi125:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-12-17T18:17:32.075 DEBUG:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-12-17T18:17:32.079 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-12-17T18:17:32.096 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2021-12-17T18:17:32.096 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2021-12-17T18:17:32.097 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2021-12-17T18:17:32.097 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-12-17T18:17:32.098 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-12-17T18:17:32.105 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-12-17T18:17:32.145 DEBUG:teuthology.orchestra.run.smithi109:> set -ex 2021-12-17T18:17:32.146 DEBUG:teuthology.orchestra.run.smithi109:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-12-17T18:17:32.154 DEBUG:teuthology.orchestra.run.smithi109:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-12-17T18:17:32.193 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2021-12-17T18:17:32.193 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-12-17T18:17:32.200 DEBUG:teuthology.orchestra.run.smithi125:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-12-17T18:17:32.280 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2021-12-17T18:17:32.281 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-12-17T18:17:32.289 DEBUG:teuthology.orchestra.run.smithi158:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-12-17T18:17:32.369 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2021-12-17T18:17:32.370 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-12-17T18:17:32.381 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-12-17T18:17:32.419 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-12-17T18:17:32.419 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-12-17T18:17:32.420 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154', 'branch': 'octopus', 'description': 'fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6567154', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'octopus'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '05c319fc280f505b26f579a01ab4d14d2f130a5b'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '05c319fc280f505b26f579a01ab4d14d2f130a5b'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'octopus', 'sha1': '05c319fc280f505b26f579a01ab4d14d2f130a5b'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 1000, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1'], ['client.2']], 'sha1': '05c319fc280f505b26f579a01ab4d14d2f130a5b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'octopus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '05c319fc280f505b26f579a01ab4d14d2f130a5b', 'targets': {'smithi062.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfUBufYMmQE/6W6U1d2qdNEGlE39qw5S9VQAsAWpxbmPFx4UA2KnMqqgDhIfMBU/TUp1zGSpBOU0E7P7XGS0/xSKP8qffcSSv4qJ9qmEMVjuf1DBc460alm4N9HohtTxdzlhsBJbUKF5Hjb2WhMtsbapDMWMd3I6J9aX8I0bhgD0wz6dICd8bjF8tdDVRGyLhBtLigmu6qWTt1jS79c58eLDjKSizg0MqlZaiekof+f104ootGjZ9LWhxdPZ9OYOHdKZQi/fyGHkbGV0sHnuIe21jeHrYdIF98cbmVWxBtChMYiyirztlP5QclJOTk+oWIz/yFG/xK1etZF/Nj14yWTVdRmCFo65ovjFk5S21q9CHaftPZ5Y8mcnlvM1s8g+x7iRdW/z9a7R2td8V4Zu4/F2V+xYjFDuWioyZDLV9ifEYsh8+5Sz9pidiTFqE3FjmMLWGx7YSfBMdHzGN0jJW6tL21pvhW6dinI3dnmSS0QFFB/YZtVdewYSObuHw6z1U=', 'smithi109.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZdOvKeKyuKUSRmHrJB4hBEDKZG/JKdo2WN4j/LQ4hUbw4PyRYqV6oHneaqI+Zu1OtJjw4aeamK+OdwNKwf06C0tjMcOWbhoxbMkCCnqU2PALQwXxSvXR9PV/cSallmMdmTiqSVpXsewxptusCVYodSn+IrNI4Fq1Z5bFE7QoThSPBe1YXbg7gBa6MgqCXGKSOTIS+Y2ofPXPOTMR84KPoTW55/2lt2jhW4rVXOTrTms0cHVtsdWgGnWoCJ4/aaE7g6TMibQLSVdHhQfH1Ytai80SFN+WoPnlp6JOJ2p9++2NGiKis/shpYt5C1xWeoDI/T7RTUvIYPlF1zNPlFhCHwe04QIrp0a9taCs94DOXF+C/yy+aCRkMtwId+Lk4qtpiFun4xvynG67u/nMIRbwadsLyR1n4gW97lMKPpgKBbRHwzGTWO/HjR6LCwiJAAHeo1QPAT4uDqjUzSm2FJEO4tSYI6v+9/mTj0GyNa4PRFq9t/6rRdGWIo98xUE5GrRE=', 'smithi125.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCdIvTwDfAt7ahn6QxY62AadhSNVc6otdPHzhdONE1+EnSgiwr50flLNqIol7FE3jYp1YvfZStD0MEPWayORoBF9nlGnpxQhBXIycvR5UzhEj/NnOiRgopI7wDPyjqkfBNkal7rc2/IfwJte20avBtMylw87BqlDIaXgkZs871PqlcbQy0r56xgN8/Mn0M58Tof6rqdfLJowC9p/IISrzYC9D/yf5gEtqJU8hT+tv1pojs3kvALcV8Ly2CVmUv5EgZbWQoYI6tVW7yXdaYzgz+6vKbNNXrAaxXPySo7FhOh6rJ+k7su1s1f+BRZqWMu1eSje2Y3d7uI+JYYIwHVtLdZNjoroPHBSUZb1Bwg9evLvd2QMujJYa6k1OrX9GTINri/4Nr9u/dKVV69tLYaLLLg7Ms5F+c499LByX96EZ7QnS+GNaU/9ESHMdCJkTpGDzyZFM9hNME+3O/obyqZRQGj16f1gNcL24EWKqZzt6uPyNofClWndLuyliio7ci+Hz8=', 'smithi158.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBYm9ByhcusERLDFrCsFCi7cg1FDWbrzf0O6NihjZpYIQ+CiXNT2STAe6M/B0W6uIdjn46jiqSpP3IXMq11KLTHPVDAPVLtT4Btx9y+now8y6fOjoYT5L/pTuuQY1a0JszL2NbdCDo/31nq1kuFr75SHpRHwYcUq7gXoN1wtfJwFjKml+7TIQrNepEls1uySBtiLtZsJUYVoS1Y5i4H4/nnvG0CeHCfhGiLc0hap77RIans1KjDf6LO6ILvqKC5uMAAgUFt9ZGbfIFwhWcAuYM+ZvwQwdTZDHKp7MCUQQpP3qT+W83/PoaKaNahz0QhhZBQFi5VoDMKXLqLtkvGW0TAHIOvAjLxReTXcVlkYZOEp+exY2onE8D82GXM6kRwpIvZ0Fr10nGMwQbu9O0C3P/M1C6Nq60knoGqOKkew3Ka9lJGqiOk1zcF5jfTBwQpjc7w7YtCpSQ39L93d7vsU3++oxs5UX1A+nnvBAHVv09rW+FvqyX/nhdYZRYzwY28JU=', 'smithi192.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPudE3DsI92/Y5wpMDUvRgef34YNtH1QMHcjws5lgKAyPE+BJkEsbdOHPuJTThjgUbqAlF2SLAJ16MF490eMkfyB45YgU7kIToRHMJnFfu7ZWn6QdjuuHOXHRNUfholr5//O+OOsPwjwBBaUHLfy5TIv6u7lYSxvtEKl67aqr93mTk2R/EoUXLPC04XN1I8oORziplNHs+qxxSUZRSiVHStS5qY6XvmGwJECsEvneiLBVfww7lnQLH715XYAy1QUzj1kvbfnlKDZBopOyKRaS/J76a6OnVxuyvSazByx393ZZ2Fgit/g/+G09ivnl/LTeBBkTGSS+aNVqDsR0dMrm7dQ2d8Gvv9Y5xFQyHg9R5NlfkG1huhzYeF3+0WuoSO454M8SyNa4nkp5zfKk85yigqr+V49cRNf+psmGSFS5IuenduAEfg5yIt11X0qHWiaNKWvt3IluVjx6P+fu1Ojy3OGDC8jnk9ITFQt7k4QfLlQW0kfDDh7+g2y+Ns/el+Z0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '05c319fc280f505b26f579a01ab4d14d2f130a5b'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_misc']}}], 'teuthology_branch': 'master', 'teuthology_sha1': '95a7d4799b562f3bbb5ec66107094963abd62fa1', 'timestamp': '2021-12-17_04:10:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.20261'} 2021-12-17T18:17:32.422 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-12-17T18:17:32.425 DEBUG:teuthology.orchestra.run.smithi109:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-12-17T18:17:32.427 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-12-17T18:17:32.430 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-12-17T18:17:32.433 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-12-17T18:17:32.471 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2021-12-17T18:17:32.474 DEBUG:teuthology.orchestra.run.smithi109:> sudo install -d -m0777 -- /var/run/ceph 2021-12-17T18:17:32.478 DEBUG:teuthology.orchestra.run.smithi125:> sudo install -d -m0777 -- /var/run/ceph 2021-12-17T18:17:32.480 DEBUG:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/run/ceph 2021-12-17T18:17:32.483 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/run/ceph 2021-12-17T18:17:32.499 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-12-17T18:17:32.499 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2021-12-17T18:17:32.506 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-12-17T18:17:32.507 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-12-17T18:17:32.555 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-12-17T18:17:32.556 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-12-17T18:17:32.556 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 348 Links: 1 2021-12-17T18:17:32.556 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-12-17T18:17:32.556 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2021-12-17 18:14:05.698069773 +0000 2021-12-17T18:17:32.557 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2021-12-17 18:14:05.694069883 +0000 2021-12-17T18:17:32.557 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2021-12-17 18:14:05.694069883 +0000 2021-12-17T18:17:32.557 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2021-12-17T18:17:32.566 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2021-12-17T18:17:32.566 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2021-12-17T18:17:32.567 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000395004 s, 1.3 MB/s 2021-12-17T18:17:32.571 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-12-17T18:17:32.578 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-12-17T18:17:32.579 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-12-17T18:17:32.579 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 353 Links: 1 2021-12-17T18:17:32.579 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-12-17T18:17:32.580 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2021-12-17 18:14:06.070059544 +0000 2021-12-17T18:17:32.580 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2021-12-17 18:14:06.066059654 +0000 2021-12-17T18:17:32.580 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2021-12-17 18:14:06.066059654 +0000 2021-12-17T18:17:32.581 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2021-12-17T18:17:32.586 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2021-12-17T18:17:32.587 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2021-12-17T18:17:32.587 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000372807 s, 1.4 MB/s 2021-12-17T18:17:32.590 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-12-17T18:17:32.597 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-12-17T18:17:32.598 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-12-17T18:17:32.598 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 359 Links: 1 2021-12-17T18:17:32.598 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-12-17T18:17:32.599 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2021-12-17 18:14:06.646043705 +0000 2021-12-17T18:17:32.599 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2021-12-17 18:14:06.474048434 +0000 2021-12-17T18:17:32.599 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2021-12-17 18:14:06.474048434 +0000 2021-12-17T18:17:32.599 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2021-12-17T18:17:32.605 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2021-12-17T18:17:32.606 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2021-12-17T18:17:32.606 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000392745 s, 1.3 MB/s 2021-12-17T18:17:32.611 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-12-17T18:17:32.618 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-12-17T18:17:32.619 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-12-17T18:17:32.619 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 368 Links: 1 2021-12-17T18:17:32.619 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-12-17T18:17:32.619 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2021-12-17 18:14:07.042032816 +0000 2021-12-17T18:17:32.620 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2021-12-17 18:14:06.890036995 +0000 2021-12-17T18:17:32.620 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2021-12-17 18:14:06.890036995 +0000 2021-12-17T18:17:32.620 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2021-12-17T18:17:32.627 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2021-12-17T18:17:32.627 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2021-12-17T18:17:32.628 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000408026 s, 1.3 MB/s 2021-12-17T18:17:32.632 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-12-17T18:17:32.632 DEBUG:teuthology.orchestra.run.smithi109:> set -ex 2021-12-17T18:17:32.633 DEBUG:teuthology.orchestra.run.smithi109:> dd if=/scratch_devs of=/dev/stdout 2021-12-17T18:17:32.640 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-12-17T18:17:32.640 DEBUG:teuthology.orchestra.run.smithi109:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-12-17T18:17:32.648 INFO:teuthology.orchestra.run.smithi109.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-12-17T18:17:32.648 INFO:teuthology.orchestra.run.smithi109.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-12-17T18:17:32.649 INFO:teuthology.orchestra.run.smithi109.stdout:Device: 6h/6d Inode: 348 Links: 1 2021-12-17T18:17:32.649 INFO:teuthology.orchestra.run.smithi109.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-12-17T18:17:32.650 INFO:teuthology.orchestra.run.smithi109.stdout:Access: 2021-12-17 18:14:12.778711303 +0000 2021-12-17T18:17:32.650 INFO:teuthology.orchestra.run.smithi109.stdout:Modify: 2021-12-17 18:14:12.774711413 +0000 2021-12-17T18:17:32.651 INFO:teuthology.orchestra.run.smithi109.stdout:Change: 2021-12-17 18:14:12.774711413 +0000 2021-12-17T18:17:32.651 INFO:teuthology.orchestra.run.smithi109.stdout: Birth: - 2021-12-17T18:17:32.659 INFO:teuthology.orchestra.run.smithi109.stderr:1+0 records in 2021-12-17T18:17:32.660 INFO:teuthology.orchestra.run.smithi109.stderr:1+0 records out 2021-12-17T18:17:32.660 INFO:teuthology.orchestra.run.smithi109.stderr:512 bytes copied, 0.000415503 s, 1.2 MB/s 2021-12-17T18:17:32.664 DEBUG:teuthology.orchestra.run.smithi109:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-12-17T18:17:32.671 INFO:teuthology.orchestra.run.smithi109.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-12-17T18:17:32.672 INFO:teuthology.orchestra.run.smithi109.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-12-17T18:17:32.672 INFO:teuthology.orchestra.run.smithi109.stdout:Device: 6h/6d Inode: 355 Links: 1 2021-12-17T18:17:32.672 INFO:teuthology.orchestra.run.smithi109.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-12-17T18:17:32.673 INFO:teuthology.orchestra.run.smithi109.stdout:Access: 2021-12-17 18:14:13.366695115 +0000 2021-12-17T18:17:32.673 INFO:teuthology.orchestra.run.smithi109.stdout:Modify: 2021-12-17 18:14:13.198699740 +0000 2021-12-17T18:17:32.673 INFO:teuthology.orchestra.run.smithi109.stdout:Change: 2021-12-17 18:14:13.198699740 +0000 2021-12-17T18:17:32.673 INFO:teuthology.orchestra.run.smithi109.stdout: Birth: - 2021-12-17T18:17:32.682 INFO:teuthology.orchestra.run.smithi109.stderr:1+0 records in 2021-12-17T18:17:32.682 INFO:teuthology.orchestra.run.smithi109.stderr:1+0 records out 2021-12-17T18:17:32.683 INFO:teuthology.orchestra.run.smithi109.stderr:512 bytes copied, 0.000389277 s, 1.3 MB/s 2021-12-17T18:17:32.687 DEBUG:teuthology.orchestra.run.smithi109:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-12-17T18:17:32.693 INFO:teuthology.orchestra.run.smithi109.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-12-17T18:17:32.694 INFO:teuthology.orchestra.run.smithi109.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-12-17T18:17:32.694 INFO:teuthology.orchestra.run.smithi109.stdout:Device: 6h/6d Inode: 363 Links: 1 2021-12-17T18:17:32.695 INFO:teuthology.orchestra.run.smithi109.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-12-17T18:17:32.695 INFO:teuthology.orchestra.run.smithi109.stdout:Access: 2021-12-17 18:14:13.738684874 +0000 2021-12-17T18:17:32.695 INFO:teuthology.orchestra.run.smithi109.stdout:Modify: 2021-12-17 18:14:13.582689169 +0000 2021-12-17T18:17:32.696 INFO:teuthology.orchestra.run.smithi109.stdout:Change: 2021-12-17 18:14:13.582689169 +0000 2021-12-17T18:17:32.696 INFO:teuthology.orchestra.run.smithi109.stdout: Birth: - 2021-12-17T18:17:32.701 INFO:teuthology.orchestra.run.smithi109.stderr:1+0 records in 2021-12-17T18:17:32.702 INFO:teuthology.orchestra.run.smithi109.stderr:1+0 records out 2021-12-17T18:17:32.702 INFO:teuthology.orchestra.run.smithi109.stderr:512 bytes copied, 0.00039079 s, 1.3 MB/s 2021-12-17T18:17:32.706 DEBUG:teuthology.orchestra.run.smithi109:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-12-17T18:17:32.757 INFO:teuthology.orchestra.run.smithi109.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-12-17T18:17:32.757 INFO:teuthology.orchestra.run.smithi109.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-12-17T18:17:32.758 INFO:teuthology.orchestra.run.smithi109.stdout:Device: 6h/6d Inode: 367 Links: 1 2021-12-17T18:17:32.758 INFO:teuthology.orchestra.run.smithi109.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-12-17T18:17:32.758 INFO:teuthology.orchestra.run.smithi109.stdout:Access: 2021-12-17 18:14:14.154673421 +0000 2021-12-17T18:17:32.758 INFO:teuthology.orchestra.run.smithi109.stdout:Modify: 2021-12-17 18:14:13.970678487 +0000 2021-12-17T18:17:32.759 INFO:teuthology.orchestra.run.smithi109.stdout:Change: 2021-12-17 18:14:13.970678487 +0000 2021-12-17T18:17:32.759 INFO:teuthology.orchestra.run.smithi109.stdout: Birth: - 2021-12-17T18:17:32.768 INFO:teuthology.orchestra.run.smithi109.stderr:1+0 records in 2021-12-17T18:17:32.768 INFO:teuthology.orchestra.run.smithi109.stderr:1+0 records out 2021-12-17T18:17:32.768 INFO:teuthology.orchestra.run.smithi109.stderr:512 bytes copied, 0.000412119 s, 1.2 MB/s 2021-12-17T18:17:32.772 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-12-17T18:17:32.773 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi109.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-12-17T18:17:32.773 INFO:tasks.ceph:Generating config... 2021-12-17T18:17:32.774 INFO:tasks.ceph:[client] client mount timeout = 600 2021-12-17T18:17:32.775 INFO:tasks.ceph:[client] debug client = 20 2021-12-17T18:17:32.775 INFO:tasks.ceph:[client] debug ms = 1 2021-12-17T18:17:32.776 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2021-12-17T18:17:32.777 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2021-12-17T18:17:32.777 INFO:tasks.ceph:[mds] debug mds = 20 2021-12-17T18:17:32.777 INFO:tasks.ceph:[mds] debug ms = 1 2021-12-17T18:17:32.778 INFO:tasks.ceph:[mds] mds bal frag = True 2021-12-17T18:17:32.778 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2021-12-17T18:17:32.778 INFO:tasks.ceph:[mds] mds bal merge size = 5 2021-12-17T18:17:32.779 INFO:tasks.ceph:[mds] mds bal split bits = 3 2021-12-17T18:17:32.779 INFO:tasks.ceph:[mds] mds bal split size = 100 2021-12-17T18:17:32.779 INFO:tasks.ceph:[mds] mds debug frag = True 2021-12-17T18:17:32.780 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2021-12-17T18:17:32.780 INFO:tasks.ceph:[mds] mds op complaint time = 180 2021-12-17T18:17:32.780 INFO:tasks.ceph:[mds] mds verify scatter = True 2021-12-17T18:17:32.781 INFO:tasks.ceph:[mds] osd op complaint time = 180 2021-12-17T18:17:32.781 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2021-12-17T18:17:32.781 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2021-12-17T18:17:32.782 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-12-17T18:17:32.782 INFO:tasks.ceph:[mgr] debug ms = 1 2021-12-17T18:17:32.782 INFO:tasks.ceph:[mon] debug mon = 20 2021-12-17T18:17:32.782 INFO:tasks.ceph:[mon] debug ms = 1 2021-12-17T18:17:32.783 INFO:tasks.ceph:[mon] debug paxos = 20 2021-12-17T18:17:32.783 INFO:tasks.ceph:[mon] mon op complaint time = 120 2021-12-17T18:17:32.783 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-12-17T18:17:32.784 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2021-12-17T18:17:32.784 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-12-17T18:17:32.784 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-12-17T18:17:32.785 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-12-17T18:17:32.785 INFO:tasks.ceph:[osd] debug ms = 1 2021-12-17T18:17:32.785 INFO:tasks.ceph:[osd] debug osd = 20 2021-12-17T18:17:32.785 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-12-17T18:17:32.786 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-12-17T18:17:32.787 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-12-17T18:17:32.787 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-12-17T18:17:32.788 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-12-17T18:17:32.788 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-12-17T18:17:32.788 INFO:tasks.ceph:[osd] osd op complaint time = 180 2021-12-17T18:17:32.789 INFO:tasks.ceph:Setting up mon.a... 2021-12-17T18:17:32.789 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-12-17T18:17:32.846 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.keyring 2021-12-17T18:17:32.849 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-12-17T18:17:32.879 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-12-17T18:17:32.893 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.62'), ('mon.b', '172.21.15.109'), ('mon.c', '[v2:172.21.15.109:3301,v1:172.21.15.109:6790]')] 2021-12-17T18:17:32.894 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.62 --add b 172.21.15.109 --addv c '[v2:172.21.15.109:3301,v1:172.21.15.109:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2021-12-17T18:17:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-12-17T18:17:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: generated fsid bd870ae2-2b3b-4717-8d94-b4a425d11882 2021-12-17T18:17:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 0 2021-12-17T18:17:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:fsid bd870ae2-2b3b-4717-8d94-b4a425d11882 2021-12-17T18:17:32.971 INFO:teuthology.orchestra.run.smithi062.stdout:last_changed 2021-12-17T18:17:32.967569+0000 2021-12-17T18:17:32.971 INFO:teuthology.orchestra.run.smithi062.stdout:created 2021-12-17T18:17:32.967569+0000 2021-12-17T18:17:32.971 INFO:teuthology.orchestra.run.smithi062.stdout:min_mon_release 0 (unknown) 2021-12-17T18:17:32.971 INFO:teuthology.orchestra.run.smithi062.stdout:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2021-12-17T18:17:32.972 INFO:teuthology.orchestra.run.smithi062.stdout:1: [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] mon.b 2021-12-17T18:17:32.972 INFO:teuthology.orchestra.run.smithi062.stdout:2: [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] mon.c 2021-12-17T18:17:32.972 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-12-17T18:17:32.974 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID bd870ae2-2b3b-4717-8d94-b4a425d11882... 2021-12-17T18:17:32.976 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-12-17T18:17:32.979 DEBUG:teuthology.orchestra.run.smithi109:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-12-17T18:17:32.982 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-12-17T18:17:32.985 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-12-17T18:17:32.987 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-12-17T18:17:33.013 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2021-12-17T18:17:33.014 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2021-12-17T18:17:33.014 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-12-17T18:17:33.014 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2021-12-17T18:17:33.015 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.015 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2021-12-17T18:17:33.015 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.015 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2021-12-17T18:17:33.016 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.016 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2021-12-17T18:17:33.016 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2021-12-17T18:17:33.016 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.016 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2021-12-17T18:17:33.017 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2021-12-17T18:17:33.017 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.017 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2021-12-17T18:17:33.017 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2021-12-17T18:17:33.018 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.018 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2021-12-17T18:17:33.018 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2021-12-17T18:17:33.018 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.018 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2021-12-17T18:17:33.019 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.019 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2021-12-17T18:17:33.019 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2021-12-17T18:17:33.019 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2021-12-17T18:17:33.020 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2021-12-17T18:17:33.020 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2021-12-17T18:17:33.020 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2021-12-17T18:17:33.020 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2021-12-17T18:17:33.020 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-12-17T18:17:33.021 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2021-12-17T18:17:33.021 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.021 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-12-17T18:17:33.021 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.021 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2021-12-17T18:17:33.022 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.022 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2021-12-17T18:17:33.022 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.022 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2021-12-17T18:17:33.023 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2021-12-17T18:17:33.023 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2021-12-17T18:17:33.023 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.62,172.21.15.109,[v2:172.21.15.109:3301,v1:172.21.15.109:6790]" 2021-12-17T18:17:33.023 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = bd870ae2-2b3b-4717-8d94-b4a425d11882 2021-12-17T18:17:33.023 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.024 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2021-12-17T18:17:33.024 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2021-12-17T18:17:33.024 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.024 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2021-12-17T18:17:33.025 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2021-12-17T18:17:33.025 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.025 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2021-12-17T18:17:33.025 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2021-12-17T18:17:33.025 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.026 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2021-12-17T18:17:33.026 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2021-12-17T18:17:33.026 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2021-12-17T18:17:33.026 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.027 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2021-12-17T18:17:33.027 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2021-12-17T18:17:33.027 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.027 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2021-12-17T18:17:33.027 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.028 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2021-12-17T18:17:33.028 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.028 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2021-12-17T18:17:33.028 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.028 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2021-12-17T18:17:33.029 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2021-12-17T18:17:33.029 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.029 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2021-12-17T18:17:33.029 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2021-12-17T18:17:33.030 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2021-12-17T18:17:33.030 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore compression mode = aggressive 2021-12-17T18:17:33.030 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2021-12-17T18:17:33.030 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 20 2021-12-17T18:17:33.030 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 20 2021-12-17T18:17:33.031 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-12-17T18:17:33.031 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2021-12-17T18:17:33.031 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 10 2021-12-17T18:17:33.031 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2021-12-17T18:17:33.032 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2021-12-17T18:17:33.032 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2021-12-17T18:17:33.032 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2021-12-17T18:17:33.032 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2021-12-17T18:17:33.032 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2021-12-17T18:17:33.033 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.033 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2021-12-17T18:17:33.033 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-12-17T18:17:33.033 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2021-12-17T18:17:33.033 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2021-12-17T18:17:33.034 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2021-12-17T18:17:33.034 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:17:33.034 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:17:33.034 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2021-12-17T18:17:33.035 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.035 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2021-12-17T18:17:33.035 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-12-17T18:17:33.035 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2021-12-17T18:17:33.036 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2021-12-17T18:17:33.036 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2021-12-17T18:17:33.037 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2021-12-17T18:17:33.037 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2021-12-17T18:17:33.037 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:17:33.037 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2021-12-17T18:17:33.038 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2021-12-17T18:17:33.038 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:17:33.038 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.038 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-12-17T18:17:33.039 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2021-12-17T18:17:33.039 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2021-12-17T18:17:33.039 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.039 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2021-12-17T18:17:33.039 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-12-17T18:17:33.040 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-12-17T18:17:33.040 INFO:teuthology.orchestra.run.smithi062.stdout: mon op complaint time = 120 2021-12-17T18:17:33.040 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:17:33.040 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2021-12-17T18:17:33.040 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2021-12-17T18:17:33.041 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2021-12-17T18:17:33.041 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2021-12-17T18:17:33.041 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-12-17T18:17:33.041 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-12-17T18:17:33.042 INFO:teuthology.orchestra.run.smithi062.stdout: client mount timeout = 600 2021-12-17T18:17:33.042 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2021-12-17T18:17:33.042 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-12-17T18:17:33.043 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 15m 2021-12-17T18:17:33.043 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 15m 2021-12-17T18:17:33.043 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2021-12-17T18:17:33.043 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2021-12-17T18:17:33.043 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2021-12-17T18:17:33.044 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2021-12-17T18:17:33.044 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2021-12-17T18:17:33.044 INFO:teuthology.orchestra.run.smithi062.stdout:[mds] 2021-12-17T18:17:33.044 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds = 20 2021-12-17T18:17:33.044 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-12-17T18:17:33.045 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal frag = True 2021-12-17T18:17:33.045 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal fragment size max = 10000 2021-12-17T18:17:33.045 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal merge size = 5 2021-12-17T18:17:33.045 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split bits = 3 2021-12-17T18:17:33.046 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split size = 100 2021-12-17T18:17:33.046 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug frag = True 2021-12-17T18:17:33.046 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug scatterstat = True 2021-12-17T18:17:33.046 INFO:teuthology.orchestra.run.smithi062.stdout: mds op complaint time = 180 2021-12-17T18:17:33.046 INFO:teuthology.orchestra.run.smithi062.stdout: mds verify scatter = True 2021-12-17T18:17:33.047 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2021-12-17T18:17:33.047 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 15m 2021-12-17T18:17:33.047 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 15m 2021-12-17T18:17:33.051 INFO:teuthology.orchestra.run.smithi158.stdout:[global] 2021-12-17T18:17:33.051 INFO:teuthology.orchestra.run.smithi158.stdout: chdir = "" 2021-12-17T18:17:33.051 INFO:teuthology.orchestra.run.smithi158.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-12-17T18:17:33.052 INFO:teuthology.orchestra.run.smithi158.stdout: auth supported = cephx 2021-12-17T18:17:33.052 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.052 INFO:teuthology.orchestra.run.smithi158.stdout: filestore xattr use omap = true 2021-12-17T18:17:33.052 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.053 INFO:teuthology.orchestra.run.smithi158.stdout: mon clock drift allowed = 1.000 2021-12-17T18:17:33.053 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.053 INFO:teuthology.orchestra.run.smithi158.stdout: osd crush chooseleaf type = 0 2021-12-17T18:17:33.053 INFO:teuthology.orchestra.run.smithi158.stdout: auth debug = true 2021-12-17T18:17:33.053 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.054 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on old message = true 2021-12-17T18:17:33.054 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on bug = true 2021-12-17T18:17:33.054 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.054 INFO:teuthology.orchestra.run.smithi158.stdout: mon max pg per osd = 10000 # >= luminous 2021-12-17T18:17:33.055 INFO:teuthology.orchestra.run.smithi158.stdout: mon pg warn max object skew = 0 2021-12-17T18:17:33.055 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.055 INFO:teuthology.orchestra.run.smithi158.stdout: # disable pg_autoscaler by default for new pools 2021-12-17T18:17:33.055 INFO:teuthology.orchestra.run.smithi158.stdout: osd_pool_default_pg_autoscale_mode = off 2021-12-17T18:17:33.055 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.056 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default size = 2 2021-12-17T18:17:33.056 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.056 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow primary affinity = true 2021-12-17T18:17:33.056 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow pg remap = true 2021-12-17T18:17:33.057 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on legacy crush tunables = false 2021-12-17T18:17:33.057 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on crush straw calc version zero = false 2021-12-17T18:17:33.057 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on no sortbitwise = false 2021-12-17T18:17:33.057 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on osd down out interval zero = false 2021-12-17T18:17:33.057 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on too few osds = false 2021-12-17T18:17:33.058 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-12-17T18:17:33.058 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_no_redundancy = false 2021-12-17T18:17:33.058 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.058 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-12-17T18:17:33.059 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.059 INFO:teuthology.orchestra.run.smithi158.stdout: osd default data pool replay window = 5 2021-12-17T18:17:33.059 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.059 INFO:teuthology.orchestra.run.smithi158.stdout: mon allow pool delete = true 2021-12-17T18:17:33.059 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.060 INFO:teuthology.orchestra.run.smithi158.stdout: mon cluster log file level = debug 2021-12-17T18:17:33.060 INFO:teuthology.orchestra.run.smithi158.stdout: debug asserts on shutdown = true 2021-12-17T18:17:33.060 INFO:teuthology.orchestra.run.smithi158.stdout: mon health detail to clog = false 2021-12-17T18:17:33.060 INFO:teuthology.orchestra.run.smithi158.stdout: mon host = "172.21.15.62,172.21.15.109,[v2:172.21.15.109:3301,v1:172.21.15.109:6790]" 2021-12-17T18:17:33.061 INFO:teuthology.orchestra.run.smithi158.stdout: fsid = bd870ae2-2b3b-4717-8d94-b4a425d11882 2021-12-17T18:17:33.061 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.061 INFO:teuthology.orchestra.run.smithi158.stdout:[osd] 2021-12-17T18:17:33.061 INFO:teuthology.orchestra.run.smithi158.stdout: osd journal size = 100 2021-12-17T18:17:33.061 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.062 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub load threshold = 5.0 2021-12-17T18:17:33.062 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub max interval = 600 2021-12-17T18:17:33.062 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.062 INFO:teuthology.orchestra.run.smithi158.stdout: osd recover clone overlap = true 2021-12-17T18:17:33.063 INFO:teuthology.orchestra.run.smithi158.stdout: osd recovery max chunk = 1048576 2021-12-17T18:17:33.063 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.063 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug shutdown = true 2021-12-17T18:17:33.063 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug op order = true 2021-12-17T18:17:33.063 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug verify stray on activate = true 2021-12-17T18:17:33.064 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.064 INFO:teuthology.orchestra.run.smithi158.stdout: osd open classes on start = true 2021-12-17T18:17:33.064 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug pg log writeout = true 2021-12-17T18:17:33.064 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.064 INFO:teuthology.orchestra.run.smithi158.stdout: osd deep scrub update digest min age = 30 2021-12-17T18:17:33.065 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.065 INFO:teuthology.orchestra.run.smithi158.stdout: osd map max advance = 10 2021-12-17T18:17:33.065 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.065 INFO:teuthology.orchestra.run.smithi158.stdout: journal zero on create = true 2021-12-17T18:17:33.066 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.066 INFO:teuthology.orchestra.run.smithi158.stdout: filestore ondisk finisher threads = 3 2021-12-17T18:17:33.066 INFO:teuthology.orchestra.run.smithi158.stdout: filestore apply finisher threads = 3 2021-12-17T18:17:33.066 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.066 INFO:teuthology.orchestra.run.smithi158.stdout: bdev debug aio = true 2021-12-17T18:17:33.067 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug misdirected ops = true 2021-12-17T18:17:33.067 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore block size = 96636764160 2021-12-17T18:17:33.067 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore compression mode = aggressive 2021-12-17T18:17:33.068 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore fsck on mount = True 2021-12-17T18:17:33.068 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluefs = 20 2021-12-17T18:17:33.068 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluestore = 20 2021-12-17T18:17:33.068 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2021-12-17T18:17:33.069 INFO:teuthology.orchestra.run.smithi158.stdout: debug osd = 20 2021-12-17T18:17:33.069 INFO:teuthology.orchestra.run.smithi158.stdout: debug rocksdb = 10 2021-12-17T18:17:33.069 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd backfillfull_ratio = 0.85 2021-12-17T18:17:33.069 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd full ratio = 0.9 2021-12-17T18:17:33.069 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd nearfull ratio = 0.8 2021-12-17T18:17:33.070 INFO:teuthology.orchestra.run.smithi158.stdout: osd failsafe full ratio = 0.95 2021-12-17T18:17:33.070 INFO:teuthology.orchestra.run.smithi158.stdout: osd objectstore = bluestore 2021-12-17T18:17:33.070 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2021-12-17T18:17:33.070 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.071 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr] 2021-12-17T18:17:33.071 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2021-12-17T18:17:33.071 INFO:teuthology.orchestra.run.smithi158.stdout: debug mgr = 20 2021-12-17T18:17:33.071 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2021-12-17T18:17:33.071 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2021-12-17T18:17:33.072 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:17:33.072 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:17:33.072 INFO:teuthology.orchestra.run.smithi158.stdout: mgr/telemetry/nag = false 2021-12-17T18:17:33.072 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.072 INFO:teuthology.orchestra.run.smithi158.stdout:[mon] 2021-12-17T18:17:33.073 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2021-12-17T18:17:33.073 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2021-12-17T18:17:33.073 INFO:teuthology.orchestra.run.smithi158.stdout: debug paxos = 20 2021-12-17T18:17:33.073 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2021-12-17T18:17:33.074 INFO:teuthology.orchestra.run.smithi158.stdout: mon data avail warn = 5 2021-12-17T18:17:33.074 INFO:teuthology.orchestra.run.smithi158.stdout: mon mgr mkfs grace = 240 2021-12-17T18:17:33.074 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:17:33.074 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd reporter subtree level = osd 2021-12-17T18:17:33.074 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd prime pg temp = true 2021-12-17T18:17:33.075 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:17:33.075 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.075 INFO:teuthology.orchestra.run.smithi158.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-12-17T18:17:33.075 INFO:teuthology.orchestra.run.smithi158.stdout: auth mon ticket ttl = 660 # 11m 2021-12-17T18:17:33.076 INFO:teuthology.orchestra.run.smithi158.stdout: auth service ticket ttl = 240 # 4m 2021-12-17T18:17:33.076 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.076 INFO:teuthology.orchestra.run.smithi158.stdout: # don't complain about insecure global_id in the test suite 2021-12-17T18:17:33.076 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-12-17T18:17:33.076 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-12-17T18:17:33.077 INFO:teuthology.orchestra.run.smithi158.stdout: mon op complaint time = 120 2021-12-17T18:17:33.077 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:17:33.077 INFO:teuthology.orchestra.run.smithi158.stdout:[client] 2021-12-17T18:17:33.077 INFO:teuthology.orchestra.run.smithi158.stdout: rgw cache enabled = true 2021-12-17T18:17:33.077 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable ops log = true 2021-12-17T18:17:33.078 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable usage log = true 2021-12-17T18:17:33.078 INFO:teuthology.orchestra.run.smithi158.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-12-17T18:17:33.078 INFO:teuthology.orchestra.run.smithi158.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-12-17T18:17:33.079 INFO:teuthology.orchestra.run.smithi158.stdout: client mount timeout = 600 2021-12-17T18:17:33.079 INFO:teuthology.orchestra.run.smithi158.stdout: debug client = 20 2021-12-17T18:17:33.079 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2021-12-17T18:17:33.079 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 15m 2021-12-17T18:17:33.080 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 15m 2021-12-17T18:17:33.080 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.a] 2021-12-17T18:17:33.080 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.b] 2021-12-17T18:17:33.080 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.c] 2021-12-17T18:17:33.080 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.a] 2021-12-17T18:17:33.081 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.b] 2021-12-17T18:17:33.081 INFO:teuthology.orchestra.run.smithi158.stdout:[mds] 2021-12-17T18:17:33.081 INFO:teuthology.orchestra.run.smithi158.stdout: debug mds = 20 2021-12-17T18:17:33.081 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2021-12-17T18:17:33.081 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal frag = True 2021-12-17T18:17:33.082 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal fragment size max = 10000 2021-12-17T18:17:33.082 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal merge size = 5 2021-12-17T18:17:33.082 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal split bits = 3 2021-12-17T18:17:33.082 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal split size = 100 2021-12-17T18:17:33.083 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug frag = True 2021-12-17T18:17:33.083 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug scatterstat = True 2021-12-17T18:17:33.083 INFO:teuthology.orchestra.run.smithi158.stdout: mds op complaint time = 180 2021-12-17T18:17:33.083 INFO:teuthology.orchestra.run.smithi158.stdout: mds verify scatter = True 2021-12-17T18:17:33.083 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2021-12-17T18:17:33.084 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 15m 2021-12-17T18:17:33.084 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 15m 2021-12-17T18:17:33.084 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2021-12-17T18:17:33.084 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2021-12-17T18:17:33.085 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-12-17T18:17:33.085 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2021-12-17T18:17:33.085 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.085 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2021-12-17T18:17:33.085 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.086 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2021-12-17T18:17:33.086 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.086 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2021-12-17T18:17:33.086 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2021-12-17T18:17:33.087 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.087 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2021-12-17T18:17:33.087 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2021-12-17T18:17:33.087 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.088 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2021-12-17T18:17:33.088 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2021-12-17T18:17:33.088 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.088 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2021-12-17T18:17:33.088 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2021-12-17T18:17:33.089 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.089 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2021-12-17T18:17:33.089 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.089 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2021-12-17T18:17:33.090 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2021-12-17T18:17:33.090 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2021-12-17T18:17:33.090 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2021-12-17T18:17:33.090 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2021-12-17T18:17:33.090 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2021-12-17T18:17:33.091 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2021-12-17T18:17:33.091 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-12-17T18:17:33.091 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2021-12-17T18:17:33.091 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.092 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-12-17T18:17:33.092 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.092 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2021-12-17T18:17:33.092 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.093 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2021-12-17T18:17:33.093 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.093 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2021-12-17T18:17:33.093 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2021-12-17T18:17:33.093 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2021-12-17T18:17:33.094 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = "172.21.15.62,172.21.15.109,[v2:172.21.15.109:3301,v1:172.21.15.109:6790]" 2021-12-17T18:17:33.094 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = bd870ae2-2b3b-4717-8d94-b4a425d11882 2021-12-17T18:17:33.094 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.095 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2021-12-17T18:17:33.095 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2021-12-17T18:17:33.095 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.095 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2021-12-17T18:17:33.096 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2021-12-17T18:17:33.096 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.096 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2021-12-17T18:17:33.096 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2021-12-17T18:17:33.097 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.097 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2021-12-17T18:17:33.097 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2021-12-17T18:17:33.097 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2021-12-17T18:17:33.097 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.098 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2021-12-17T18:17:33.098 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2021-12-17T18:17:33.098 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.098 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2021-12-17T18:17:33.099 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.099 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2021-12-17T18:17:33.099 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.099 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2021-12-17T18:17:33.099 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.100 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2021-12-17T18:17:33.100 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2021-12-17T18:17:33.100 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.100 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2021-12-17T18:17:33.101 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2021-12-17T18:17:33.101 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore block size = 96636764160 2021-12-17T18:17:33.101 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore compression mode = aggressive 2021-12-17T18:17:33.101 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore fsck on mount = True 2021-12-17T18:17:33.102 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluefs = 20 2021-12-17T18:17:33.102 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluestore = 20 2021-12-17T18:17:33.102 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2021-12-17T18:17:33.102 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 20 2021-12-17T18:17:33.102 INFO:teuthology.orchestra.run.smithi192.stdout: debug rocksdb = 10 2021-12-17T18:17:33.103 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull_ratio = 0.85 2021-12-17T18:17:33.103 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.9 2021-12-17T18:17:33.103 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.8 2021-12-17T18:17:33.103 INFO:teuthology.orchestra.run.smithi192.stdout: osd failsafe full ratio = 0.95 2021-12-17T18:17:33.104 INFO:teuthology.orchestra.run.smithi192.stdout: osd objectstore = bluestore 2021-12-17T18:17:33.104 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2021-12-17T18:17:33.104 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.104 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2021-12-17T18:17:33.104 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2021-12-17T18:17:33.105 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2021-12-17T18:17:33.105 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2021-12-17T18:17:33.105 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2021-12-17T18:17:33.105 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:17:33.106 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:17:33.106 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2021-12-17T18:17:33.106 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.106 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2021-12-17T18:17:33.106 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2021-12-17T18:17:33.107 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2021-12-17T18:17:33.107 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2021-12-17T18:17:33.107 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2021-12-17T18:17:33.107 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2021-12-17T18:17:33.108 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2021-12-17T18:17:33.108 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:17:33.108 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2021-12-17T18:17:33.108 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2021-12-17T18:17:33.108 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:17:33.109 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.109 INFO:teuthology.orchestra.run.smithi192.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-12-17T18:17:33.109 INFO:teuthology.orchestra.run.smithi192.stdout: auth mon ticket ttl = 660 # 11m 2021-12-17T18:17:33.109 INFO:teuthology.orchestra.run.smithi192.stdout: auth service ticket ttl = 240 # 4m 2021-12-17T18:17:33.109 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.110 INFO:teuthology.orchestra.run.smithi192.stdout: # don't complain about insecure global_id in the test suite 2021-12-17T18:17:33.110 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-12-17T18:17:33.110 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-12-17T18:17:33.110 INFO:teuthology.orchestra.run.smithi192.stdout: mon op complaint time = 120 2021-12-17T18:17:33.111 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:17:33.111 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2021-12-17T18:17:33.111 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2021-12-17T18:17:33.111 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2021-12-17T18:17:33.111 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2021-12-17T18:17:33.112 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-12-17T18:17:33.112 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-12-17T18:17:33.112 INFO:teuthology.orchestra.run.smithi192.stdout: client mount timeout = 600 2021-12-17T18:17:33.112 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2021-12-17T18:17:33.113 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2021-12-17T18:17:33.113 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 15m 2021-12-17T18:17:33.113 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 15m 2021-12-17T18:17:33.113 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2021-12-17T18:17:33.113 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.b] 2021-12-17T18:17:33.114 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.c] 2021-12-17T18:17:33.114 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2021-12-17T18:17:33.114 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2021-12-17T18:17:33.114 INFO:teuthology.orchestra.run.smithi192.stdout:[mds] 2021-12-17T18:17:33.115 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds = 20 2021-12-17T18:17:33.115 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2021-12-17T18:17:33.115 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal frag = True 2021-12-17T18:17:33.115 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal fragment size max = 10000 2021-12-17T18:17:33.115 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal merge size = 5 2021-12-17T18:17:33.116 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal split bits = 3 2021-12-17T18:17:33.116 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal split size = 100 2021-12-17T18:17:33.116 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug frag = True 2021-12-17T18:17:33.116 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug scatterstat = True 2021-12-17T18:17:33.116 INFO:teuthology.orchestra.run.smithi192.stdout: mds op complaint time = 180 2021-12-17T18:17:33.117 INFO:teuthology.orchestra.run.smithi192.stdout: mds verify scatter = True 2021-12-17T18:17:33.117 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2021-12-17T18:17:33.117 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 15m 2021-12-17T18:17:33.117 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 15m 2021-12-17T18:17:33.118 INFO:teuthology.orchestra.run.smithi125.stdout:[global] 2021-12-17T18:17:33.118 INFO:teuthology.orchestra.run.smithi125.stdout: chdir = "" 2021-12-17T18:17:33.118 INFO:teuthology.orchestra.run.smithi125.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-12-17T18:17:33.118 INFO:teuthology.orchestra.run.smithi125.stdout: auth supported = cephx 2021-12-17T18:17:33.119 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.119 INFO:teuthology.orchestra.run.smithi125.stdout: filestore xattr use omap = true 2021-12-17T18:17:33.119 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.119 INFO:teuthology.orchestra.run.smithi125.stdout: mon clock drift allowed = 1.000 2021-12-17T18:17:33.120 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.120 INFO:teuthology.orchestra.run.smithi125.stdout: osd crush chooseleaf type = 0 2021-12-17T18:17:33.120 INFO:teuthology.orchestra.run.smithi125.stdout: auth debug = true 2021-12-17T18:17:33.120 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.120 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on old message = true 2021-12-17T18:17:33.121 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on bug = true 2021-12-17T18:17:33.121 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.121 INFO:teuthology.orchestra.run.smithi125.stdout: mon max pg per osd = 10000 # >= luminous 2021-12-17T18:17:33.121 INFO:teuthology.orchestra.run.smithi125.stdout: mon pg warn max object skew = 0 2021-12-17T18:17:33.122 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.122 INFO:teuthology.orchestra.run.smithi125.stdout: # disable pg_autoscaler by default for new pools 2021-12-17T18:17:33.122 INFO:teuthology.orchestra.run.smithi125.stdout: osd_pool_default_pg_autoscale_mode = off 2021-12-17T18:17:33.122 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.123 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default size = 2 2021-12-17T18:17:33.123 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.123 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow primary affinity = true 2021-12-17T18:17:33.123 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow pg remap = true 2021-12-17T18:17:33.123 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on legacy crush tunables = false 2021-12-17T18:17:33.124 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on crush straw calc version zero = false 2021-12-17T18:17:33.124 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on no sortbitwise = false 2021-12-17T18:17:33.124 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on osd down out interval zero = false 2021-12-17T18:17:33.124 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on too few osds = false 2021-12-17T18:17:33.125 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-12-17T18:17:33.125 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_no_redundancy = false 2021-12-17T18:17:33.125 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.125 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-12-17T18:17:33.125 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.126 INFO:teuthology.orchestra.run.smithi125.stdout: osd default data pool replay window = 5 2021-12-17T18:17:33.126 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.126 INFO:teuthology.orchestra.run.smithi125.stdout: mon allow pool delete = true 2021-12-17T18:17:33.126 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.127 INFO:teuthology.orchestra.run.smithi125.stdout: mon cluster log file level = debug 2021-12-17T18:17:33.127 INFO:teuthology.orchestra.run.smithi125.stdout: debug asserts on shutdown = true 2021-12-17T18:17:33.127 INFO:teuthology.orchestra.run.smithi125.stdout: mon health detail to clog = false 2021-12-17T18:17:33.127 INFO:teuthology.orchestra.run.smithi125.stdout: mon host = "172.21.15.62,172.21.15.109,[v2:172.21.15.109:3301,v1:172.21.15.109:6790]" 2021-12-17T18:17:33.127 INFO:teuthology.orchestra.run.smithi125.stdout: fsid = bd870ae2-2b3b-4717-8d94-b4a425d11882 2021-12-17T18:17:33.128 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.128 INFO:teuthology.orchestra.run.smithi125.stdout:[osd] 2021-12-17T18:17:33.128 INFO:teuthology.orchestra.run.smithi125.stdout: osd journal size = 100 2021-12-17T18:17:33.128 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.129 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub load threshold = 5.0 2021-12-17T18:17:33.129 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub max interval = 600 2021-12-17T18:17:33.129 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.129 INFO:teuthology.orchestra.run.smithi125.stdout: osd recover clone overlap = true 2021-12-17T18:17:33.129 INFO:teuthology.orchestra.run.smithi125.stdout: osd recovery max chunk = 1048576 2021-12-17T18:17:33.130 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.130 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug shutdown = true 2021-12-17T18:17:33.130 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug op order = true 2021-12-17T18:17:33.130 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug verify stray on activate = true 2021-12-17T18:17:33.131 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.131 INFO:teuthology.orchestra.run.smithi125.stdout: osd open classes on start = true 2021-12-17T18:17:33.131 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug pg log writeout = true 2021-12-17T18:17:33.131 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.131 INFO:teuthology.orchestra.run.smithi125.stdout: osd deep scrub update digest min age = 30 2021-12-17T18:17:33.132 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.132 INFO:teuthology.orchestra.run.smithi125.stdout: osd map max advance = 10 2021-12-17T18:17:33.132 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.132 INFO:teuthology.orchestra.run.smithi125.stdout: journal zero on create = true 2021-12-17T18:17:33.133 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.133 INFO:teuthology.orchestra.run.smithi125.stdout: filestore ondisk finisher threads = 3 2021-12-17T18:17:33.133 INFO:teuthology.orchestra.run.smithi125.stdout: filestore apply finisher threads = 3 2021-12-17T18:17:33.133 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.133 INFO:teuthology.orchestra.run.smithi125.stdout: bdev debug aio = true 2021-12-17T18:17:33.134 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug misdirected ops = true 2021-12-17T18:17:33.134 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore block size = 96636764160 2021-12-17T18:17:33.134 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore compression mode = aggressive 2021-12-17T18:17:33.134 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore fsck on mount = True 2021-12-17T18:17:33.135 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluefs = 20 2021-12-17T18:17:33.135 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluestore = 20 2021-12-17T18:17:33.135 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2021-12-17T18:17:33.135 INFO:teuthology.orchestra.run.smithi125.stdout: debug osd = 20 2021-12-17T18:17:33.135 INFO:teuthology.orchestra.run.smithi125.stdout: debug rocksdb = 10 2021-12-17T18:17:33.136 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd backfillfull_ratio = 0.85 2021-12-17T18:17:33.136 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd full ratio = 0.9 2021-12-17T18:17:33.136 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd nearfull ratio = 0.8 2021-12-17T18:17:33.136 INFO:teuthology.orchestra.run.smithi125.stdout: osd failsafe full ratio = 0.95 2021-12-17T18:17:33.137 INFO:teuthology.orchestra.run.smithi125.stdout: osd objectstore = bluestore 2021-12-17T18:17:33.137 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2021-12-17T18:17:33.137 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.137 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr] 2021-12-17T18:17:33.137 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2021-12-17T18:17:33.138 INFO:teuthology.orchestra.run.smithi125.stdout: debug mgr = 20 2021-12-17T18:17:33.138 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2021-12-17T18:17:33.138 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2021-12-17T18:17:33.138 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:17:33.139 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:17:33.139 INFO:teuthology.orchestra.run.smithi125.stdout: mgr/telemetry/nag = false 2021-12-17T18:17:33.139 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.139 INFO:teuthology.orchestra.run.smithi125.stdout:[mon] 2021-12-17T18:17:33.140 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2021-12-17T18:17:33.140 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2021-12-17T18:17:33.140 INFO:teuthology.orchestra.run.smithi125.stdout: debug paxos = 20 2021-12-17T18:17:33.141 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2021-12-17T18:17:33.141 INFO:teuthology.orchestra.run.smithi125.stdout: mon data avail warn = 5 2021-12-17T18:17:33.141 INFO:teuthology.orchestra.run.smithi125.stdout: mon mgr mkfs grace = 240 2021-12-17T18:17:33.141 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:17:33.141 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd reporter subtree level = osd 2021-12-17T18:17:33.142 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd prime pg temp = true 2021-12-17T18:17:33.142 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:17:33.142 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.142 INFO:teuthology.orchestra.run.smithi125.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-12-17T18:17:33.143 INFO:teuthology.orchestra.run.smithi125.stdout: auth mon ticket ttl = 660 # 11m 2021-12-17T18:17:33.143 INFO:teuthology.orchestra.run.smithi125.stdout: auth service ticket ttl = 240 # 4m 2021-12-17T18:17:33.143 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.143 INFO:teuthology.orchestra.run.smithi125.stdout: # don't complain about insecure global_id in the test suite 2021-12-17T18:17:33.143 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-12-17T18:17:33.144 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-12-17T18:17:33.144 INFO:teuthology.orchestra.run.smithi125.stdout: mon op complaint time = 120 2021-12-17T18:17:33.144 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:17:33.144 INFO:teuthology.orchestra.run.smithi125.stdout:[client] 2021-12-17T18:17:33.145 INFO:teuthology.orchestra.run.smithi125.stdout: rgw cache enabled = true 2021-12-17T18:17:33.145 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable ops log = true 2021-12-17T18:17:33.145 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable usage log = true 2021-12-17T18:17:33.145 INFO:teuthology.orchestra.run.smithi125.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-12-17T18:17:33.145 INFO:teuthology.orchestra.run.smithi125.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-12-17T18:17:33.146 INFO:teuthology.orchestra.run.smithi125.stdout: client mount timeout = 600 2021-12-17T18:17:33.146 INFO:teuthology.orchestra.run.smithi125.stdout: debug client = 20 2021-12-17T18:17:33.146 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2021-12-17T18:17:33.146 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 15m 2021-12-17T18:17:33.147 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 15m 2021-12-17T18:17:33.147 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.a] 2021-12-17T18:17:33.147 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.b] 2021-12-17T18:17:33.147 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.c] 2021-12-17T18:17:33.147 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.a] 2021-12-17T18:17:33.148 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.b] 2021-12-17T18:17:33.148 INFO:teuthology.orchestra.run.smithi125.stdout:[mds] 2021-12-17T18:17:33.148 INFO:teuthology.orchestra.run.smithi125.stdout: debug mds = 20 2021-12-17T18:17:33.148 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2021-12-17T18:17:33.149 INFO:teuthology.orchestra.run.smithi125.stdout: mds bal frag = True 2021-12-17T18:17:33.149 INFO:teuthology.orchestra.run.smithi125.stdout: mds bal fragment size max = 10000 2021-12-17T18:17:33.149 INFO:teuthology.orchestra.run.smithi125.stdout: mds bal merge size = 5 2021-12-17T18:17:33.149 INFO:teuthology.orchestra.run.smithi125.stdout: mds bal split bits = 3 2021-12-17T18:17:33.149 INFO:teuthology.orchestra.run.smithi125.stdout: mds bal split size = 100 2021-12-17T18:17:33.150 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug frag = True 2021-12-17T18:17:33.150 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug scatterstat = True 2021-12-17T18:17:33.150 INFO:teuthology.orchestra.run.smithi125.stdout: mds op complaint time = 180 2021-12-17T18:17:33.150 INFO:teuthology.orchestra.run.smithi125.stdout: mds verify scatter = True 2021-12-17T18:17:33.151 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2021-12-17T18:17:33.151 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 15m 2021-12-17T18:17:33.151 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 15m 2021-12-17T18:17:33.151 INFO:teuthology.orchestra.run.smithi109.stdout:[global] 2021-12-17T18:17:33.151 INFO:teuthology.orchestra.run.smithi109.stdout: chdir = "" 2021-12-17T18:17:33.152 INFO:teuthology.orchestra.run.smithi109.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-12-17T18:17:33.152 INFO:teuthology.orchestra.run.smithi109.stdout: auth supported = cephx 2021-12-17T18:17:33.152 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.152 INFO:teuthology.orchestra.run.smithi109.stdout: filestore xattr use omap = true 2021-12-17T18:17:33.153 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.153 INFO:teuthology.orchestra.run.smithi109.stdout: mon clock drift allowed = 1.000 2021-12-17T18:17:33.153 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.153 INFO:teuthology.orchestra.run.smithi109.stdout: osd crush chooseleaf type = 0 2021-12-17T18:17:33.154 INFO:teuthology.orchestra.run.smithi109.stdout: auth debug = true 2021-12-17T18:17:33.154 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.154 INFO:teuthology.orchestra.run.smithi109.stdout: ms die on old message = true 2021-12-17T18:17:33.154 INFO:teuthology.orchestra.run.smithi109.stdout: ms die on bug = true 2021-12-17T18:17:33.154 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.155 INFO:teuthology.orchestra.run.smithi109.stdout: mon max pg per osd = 10000 # >= luminous 2021-12-17T18:17:33.155 INFO:teuthology.orchestra.run.smithi109.stdout: mon pg warn max object skew = 0 2021-12-17T18:17:33.155 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.155 INFO:teuthology.orchestra.run.smithi109.stdout: # disable pg_autoscaler by default for new pools 2021-12-17T18:17:33.156 INFO:teuthology.orchestra.run.smithi109.stdout: osd_pool_default_pg_autoscale_mode = off 2021-12-17T18:17:33.156 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.156 INFO:teuthology.orchestra.run.smithi109.stdout: osd pool default size = 2 2021-12-17T18:17:33.156 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.156 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd allow primary affinity = true 2021-12-17T18:17:33.157 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd allow pg remap = true 2021-12-17T18:17:33.157 INFO:teuthology.orchestra.run.smithi109.stdout: mon warn on legacy crush tunables = false 2021-12-17T18:17:33.157 INFO:teuthology.orchestra.run.smithi109.stdout: mon warn on crush straw calc version zero = false 2021-12-17T18:17:33.157 INFO:teuthology.orchestra.run.smithi109.stdout: mon warn on no sortbitwise = false 2021-12-17T18:17:33.158 INFO:teuthology.orchestra.run.smithi109.stdout: mon warn on osd down out interval zero = false 2021-12-17T18:17:33.158 INFO:teuthology.orchestra.run.smithi109.stdout: mon warn on too few osds = false 2021-12-17T18:17:33.158 INFO:teuthology.orchestra.run.smithi109.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-12-17T18:17:33.158 INFO:teuthology.orchestra.run.smithi109.stdout: mon_warn_on_pool_no_redundancy = false 2021-12-17T18:17:33.159 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.159 INFO:teuthology.orchestra.run.smithi109.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-12-17T18:17:33.159 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.159 INFO:teuthology.orchestra.run.smithi109.stdout: osd default data pool replay window = 5 2021-12-17T18:17:33.159 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.160 INFO:teuthology.orchestra.run.smithi109.stdout: mon allow pool delete = true 2021-12-17T18:17:33.160 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.160 INFO:teuthology.orchestra.run.smithi109.stdout: mon cluster log file level = debug 2021-12-17T18:17:33.160 INFO:teuthology.orchestra.run.smithi109.stdout: debug asserts on shutdown = true 2021-12-17T18:17:33.161 INFO:teuthology.orchestra.run.smithi109.stdout: mon health detail to clog = false 2021-12-17T18:17:33.161 INFO:teuthology.orchestra.run.smithi109.stdout: mon host = "172.21.15.62,172.21.15.109,[v2:172.21.15.109:3301,v1:172.21.15.109:6790]" 2021-12-17T18:17:33.161 INFO:teuthology.orchestra.run.smithi109.stdout: fsid = bd870ae2-2b3b-4717-8d94-b4a425d11882 2021-12-17T18:17:33.161 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.161 INFO:teuthology.orchestra.run.smithi109.stdout:[osd] 2021-12-17T18:17:33.162 INFO:teuthology.orchestra.run.smithi109.stdout: osd journal size = 100 2021-12-17T18:17:33.162 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.162 INFO:teuthology.orchestra.run.smithi109.stdout: osd scrub load threshold = 5.0 2021-12-17T18:17:33.162 INFO:teuthology.orchestra.run.smithi109.stdout: osd scrub max interval = 600 2021-12-17T18:17:33.163 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.163 INFO:teuthology.orchestra.run.smithi109.stdout: osd recover clone overlap = true 2021-12-17T18:17:33.163 INFO:teuthology.orchestra.run.smithi109.stdout: osd recovery max chunk = 1048576 2021-12-17T18:17:33.163 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.163 INFO:teuthology.orchestra.run.smithi109.stdout: osd debug shutdown = true 2021-12-17T18:17:33.164 INFO:teuthology.orchestra.run.smithi109.stdout: osd debug op order = true 2021-12-17T18:17:33.164 INFO:teuthology.orchestra.run.smithi109.stdout: osd debug verify stray on activate = true 2021-12-17T18:17:33.164 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.164 INFO:teuthology.orchestra.run.smithi109.stdout: osd open classes on start = true 2021-12-17T18:17:33.165 INFO:teuthology.orchestra.run.smithi109.stdout: osd debug pg log writeout = true 2021-12-17T18:17:33.165 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.165 INFO:teuthology.orchestra.run.smithi109.stdout: osd deep scrub update digest min age = 30 2021-12-17T18:17:33.165 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.165 INFO:teuthology.orchestra.run.smithi109.stdout: osd map max advance = 10 2021-12-17T18:17:33.166 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.166 INFO:teuthology.orchestra.run.smithi109.stdout: journal zero on create = true 2021-12-17T18:17:33.166 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.166 INFO:teuthology.orchestra.run.smithi109.stdout: filestore ondisk finisher threads = 3 2021-12-17T18:17:33.167 INFO:teuthology.orchestra.run.smithi109.stdout: filestore apply finisher threads = 3 2021-12-17T18:17:33.167 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.167 INFO:teuthology.orchestra.run.smithi109.stdout: bdev debug aio = true 2021-12-17T18:17:33.167 INFO:teuthology.orchestra.run.smithi109.stdout: osd debug misdirected ops = true 2021-12-17T18:17:33.168 INFO:teuthology.orchestra.run.smithi109.stdout: bluestore block size = 96636764160 2021-12-17T18:17:33.168 INFO:teuthology.orchestra.run.smithi109.stdout: bluestore compression mode = aggressive 2021-12-17T18:17:33.168 INFO:teuthology.orchestra.run.smithi109.stdout: bluestore fsck on mount = True 2021-12-17T18:17:33.168 INFO:teuthology.orchestra.run.smithi109.stdout: debug bluefs = 20 2021-12-17T18:17:33.168 INFO:teuthology.orchestra.run.smithi109.stdout: debug bluestore = 20 2021-12-17T18:17:33.169 INFO:teuthology.orchestra.run.smithi109.stdout: debug ms = 1 2021-12-17T18:17:33.169 INFO:teuthology.orchestra.run.smithi109.stdout: debug osd = 20 2021-12-17T18:17:33.169 INFO:teuthology.orchestra.run.smithi109.stdout: debug rocksdb = 10 2021-12-17T18:17:33.169 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd backfillfull_ratio = 0.85 2021-12-17T18:17:33.170 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd full ratio = 0.9 2021-12-17T18:17:33.170 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd nearfull ratio = 0.8 2021-12-17T18:17:33.170 INFO:teuthology.orchestra.run.smithi109.stdout: osd failsafe full ratio = 0.95 2021-12-17T18:17:33.170 INFO:teuthology.orchestra.run.smithi109.stdout: osd objectstore = bluestore 2021-12-17T18:17:33.170 INFO:teuthology.orchestra.run.smithi109.stdout: osd op complaint time = 180 2021-12-17T18:17:33.171 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.171 INFO:teuthology.orchestra.run.smithi109.stdout:[mgr] 2021-12-17T18:17:33.171 INFO:teuthology.orchestra.run.smithi109.stdout: debug ms = 1 2021-12-17T18:17:33.171 INFO:teuthology.orchestra.run.smithi109.stdout: debug mgr = 20 2021-12-17T18:17:33.172 INFO:teuthology.orchestra.run.smithi109.stdout: debug mon = 20 2021-12-17T18:17:33.172 INFO:teuthology.orchestra.run.smithi109.stdout: debug auth = 20 2021-12-17T18:17:33.172 INFO:teuthology.orchestra.run.smithi109.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:17:33.172 INFO:teuthology.orchestra.run.smithi109.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:17:33.172 INFO:teuthology.orchestra.run.smithi109.stdout: mgr/telemetry/nag = false 2021-12-17T18:17:33.173 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.173 INFO:teuthology.orchestra.run.smithi109.stdout:[mon] 2021-12-17T18:17:33.173 INFO:teuthology.orchestra.run.smithi109.stdout: debug ms = 1 2021-12-17T18:17:33.173 INFO:teuthology.orchestra.run.smithi109.stdout: debug mon = 20 2021-12-17T18:17:33.174 INFO:teuthology.orchestra.run.smithi109.stdout: debug paxos = 20 2021-12-17T18:17:33.174 INFO:teuthology.orchestra.run.smithi109.stdout: debug auth = 20 2021-12-17T18:17:33.174 INFO:teuthology.orchestra.run.smithi109.stdout: mon data avail warn = 5 2021-12-17T18:17:33.174 INFO:teuthology.orchestra.run.smithi109.stdout: mon mgr mkfs grace = 240 2021-12-17T18:17:33.175 INFO:teuthology.orchestra.run.smithi109.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:17:33.175 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd reporter subtree level = osd 2021-12-17T18:17:33.175 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd prime pg temp = true 2021-12-17T18:17:33.175 INFO:teuthology.orchestra.run.smithi109.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:17:33.175 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.176 INFO:teuthology.orchestra.run.smithi109.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-12-17T18:17:33.176 INFO:teuthology.orchestra.run.smithi109.stdout: auth mon ticket ttl = 660 # 11m 2021-12-17T18:17:33.176 INFO:teuthology.orchestra.run.smithi109.stdout: auth service ticket ttl = 240 # 4m 2021-12-17T18:17:33.176 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.177 INFO:teuthology.orchestra.run.smithi109.stdout: # don't complain about insecure global_id in the test suite 2021-12-17T18:17:33.177 INFO:teuthology.orchestra.run.smithi109.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-12-17T18:17:33.177 INFO:teuthology.orchestra.run.smithi109.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-12-17T18:17:33.177 INFO:teuthology.orchestra.run.smithi109.stdout: mon op complaint time = 120 2021-12-17T18:17:33.177 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:17:33.178 INFO:teuthology.orchestra.run.smithi109.stdout:[client] 2021-12-17T18:17:33.178 INFO:teuthology.orchestra.run.smithi109.stdout: rgw cache enabled = true 2021-12-17T18:17:33.178 INFO:teuthology.orchestra.run.smithi109.stdout: rgw enable ops log = true 2021-12-17T18:17:33.178 INFO:teuthology.orchestra.run.smithi109.stdout: rgw enable usage log = true 2021-12-17T18:17:33.179 INFO:teuthology.orchestra.run.smithi109.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-12-17T18:17:33.179 INFO:teuthology.orchestra.run.smithi109.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-12-17T18:17:33.179 INFO:teuthology.orchestra.run.smithi109.stdout: client mount timeout = 600 2021-12-17T18:17:33.179 INFO:teuthology.orchestra.run.smithi109.stdout: debug client = 20 2021-12-17T18:17:33.180 INFO:teuthology.orchestra.run.smithi109.stdout: debug ms = 1 2021-12-17T18:17:33.180 INFO:teuthology.orchestra.run.smithi109.stdout: rados mon op timeout = 15m 2021-12-17T18:17:33.180 INFO:teuthology.orchestra.run.smithi109.stdout: rados osd op timeout = 15m 2021-12-17T18:17:33.180 INFO:teuthology.orchestra.run.smithi109.stdout:[mon.a] 2021-12-17T18:17:33.180 INFO:teuthology.orchestra.run.smithi109.stdout:[mon.b] 2021-12-17T18:17:33.181 INFO:teuthology.orchestra.run.smithi109.stdout:[mon.c] 2021-12-17T18:17:33.181 INFO:teuthology.orchestra.run.smithi109.stdout:[mds.a] 2021-12-17T18:17:33.181 INFO:teuthology.orchestra.run.smithi109.stdout:[mds.b] 2021-12-17T18:17:33.181 INFO:teuthology.orchestra.run.smithi109.stdout:[mds] 2021-12-17T18:17:33.182 INFO:teuthology.orchestra.run.smithi109.stdout: debug mds = 20 2021-12-17T18:17:33.182 INFO:teuthology.orchestra.run.smithi109.stdout: debug ms = 1 2021-12-17T18:17:33.182 INFO:teuthology.orchestra.run.smithi109.stdout: mds bal frag = True 2021-12-17T18:17:33.182 INFO:teuthology.orchestra.run.smithi109.stdout: mds bal fragment size max = 10000 2021-12-17T18:17:33.183 INFO:teuthology.orchestra.run.smithi109.stdout: mds bal merge size = 5 2021-12-17T18:17:33.183 INFO:teuthology.orchestra.run.smithi109.stdout: mds bal split bits = 3 2021-12-17T18:17:33.183 INFO:teuthology.orchestra.run.smithi109.stdout: mds bal split size = 100 2021-12-17T18:17:33.183 INFO:teuthology.orchestra.run.smithi109.stdout: mds debug frag = True 2021-12-17T18:17:33.183 INFO:teuthology.orchestra.run.smithi109.stdout: mds debug scatterstat = True 2021-12-17T18:17:33.184 INFO:teuthology.orchestra.run.smithi109.stdout: mds op complaint time = 180 2021-12-17T18:17:33.184 INFO:teuthology.orchestra.run.smithi109.stdout: mds verify scatter = True 2021-12-17T18:17:33.184 INFO:teuthology.orchestra.run.smithi109.stdout: osd op complaint time = 180 2021-12-17T18:17:33.184 INFO:teuthology.orchestra.run.smithi109.stdout: rados mon op timeout = 15m 2021-12-17T18:17:33.185 INFO:teuthology.orchestra.run.smithi109.stdout: rados osd op timeout = 15m 2021-12-17T18:17:33.185 INFO:tasks.ceph:Creating admin key on mon.a... 2021-12-17T18:17:33.186 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-12-17T18:17:33.234 INFO:tasks.ceph:Copying monmap to all nodes... 2021-12-17T18:17:33.249 DEBUG:teuthology.orchestra.remote:smithi062:/etc/ceph/ceph.keyring is 206B 2021-12-17T18:17:33.272 DEBUG:teuthology.orchestra.remote:smithi062:/home/ubuntu/cephtest/ceph.monmap is 379B 2021-12-17T18:17:33.287 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2021-12-17T18:17:33.287 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-12-17T18:17:33.288 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2021-12-17T18:17:33.288 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-12-17T18:17:33.313 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-12-17T18:17:33.314 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-12-17T18:17:33.363 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi109.front.sepia.ceph.com 2021-12-17T18:17:33.364 DEBUG:teuthology.orchestra.run.smithi109:> set -ex 2021-12-17T18:17:33.364 DEBUG:teuthology.orchestra.run.smithi109:> sudo dd of=/etc/ceph/ceph.keyring 2021-12-17T18:17:33.364 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-12-17T18:17:33.390 DEBUG:teuthology.orchestra.run.smithi109:> set -ex 2021-12-17T18:17:33.391 DEBUG:teuthology.orchestra.run.smithi109:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-12-17T18:17:33.396 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi125.front.sepia.ceph.com 2021-12-17T18:17:33.397 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2021-12-17T18:17:33.397 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/ceph/ceph.keyring 2021-12-17T18:17:33.398 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-12-17T18:17:33.426 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2021-12-17T18:17:33.427 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-12-17T18:17:33.433 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi158.front.sepia.ceph.com 2021-12-17T18:17:33.433 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2021-12-17T18:17:33.434 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/ceph/ceph.keyring 2021-12-17T18:17:33.434 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-12-17T18:17:33.460 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2021-12-17T18:17:33.461 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-12-17T18:17:33.509 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi192.front.sepia.ceph.com 2021-12-17T18:17:33.510 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2021-12-17T18:17:33.510 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.keyring 2021-12-17T18:17:33.511 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-12-17T18:17:33.538 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2021-12-17T18:17:33.539 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-12-17T18:17:33.588 INFO:tasks.ceph:Setting up mon nodes... 2021-12-17T18:17:33.589 INFO:tasks.ceph:Setting up mgr nodes... 2021-12-17T18:17:33.589 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2021-12-17T18:17:33.635 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2021-12-17T18:17:33.638 DEBUG:teuthology.orchestra.run.smithi109:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-12-17T18:17:33.703 INFO:teuthology.orchestra.run.smithi109.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-12-17T18:17:33.706 INFO:tasks.ceph:Setting up mds nodes... 2021-12-17T18:17:33.707 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2021-12-17T18:17:33.752 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2021-12-17T18:17:33.755 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2021-12-17T18:17:33.816 DEBUG:teuthology.orchestra.run.smithi109:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2021-12-17T18:17:33.859 INFO:teuthology.orchestra.run.smithi109.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2021-12-17T18:17:33.862 DEBUG:teuthology.orchestra.run.smithi109:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2021-12-17T18:17:33.875 INFO:tasks.ceph_client:Setting up client nodes... 2021-12-17T18:17:33.876 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-12-17T18:17:33.927 INFO:teuthology.orchestra.run.smithi125.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-12-17T18:17:33.941 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-12-17T18:17:33.999 INFO:teuthology.orchestra.run.smithi158.stdout:creating /etc/ceph/ceph.client.1.keyring 2021-12-17T18:17:34.012 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2021-12-17T18:17:34.071 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.2.keyring 2021-12-17T18:17:34.085 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-12-17T18:17:34.086 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi109.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-12-17T18:17:34.087 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-12-17T18:17:34.104 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-12-17T18:17:34.105 INFO:tasks.ceph:role: osd.0 2021-12-17T18:17:34.105 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2021-12-17T18:17:34.105 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-12-17T18:17:34.680 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-12-17T18:17:34.680 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2021-12-17T18:17:34.680 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-12-17T18:17:34.681 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 2021-12-17T18:17:34.681 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-12-17T18:17:34.681 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2021-12-17T18:17:34.681 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-12-17T18:17:34.682 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-12-17T18:17:34.682 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-12-17T18:17:34.682 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-12-17T18:17:34.683 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2021-12-17T18:17:34.684 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-12-17T18:17:34.779 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-12-17T18:17:34.791 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:17:34.792 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2021-12-17T18:17:34.792 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-12-17T18:17:34.852 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-12-17T18:17:34.853 INFO:tasks.ceph:role: osd.1 2021-12-17T18:17:34.853 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2021-12-17T18:17:34.853 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-12-17T18:17:35.353 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-12-17T18:17:35.353 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2021-12-17T18:17:35.353 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-12-17T18:17:35.354 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 2021-12-17T18:17:35.354 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-12-17T18:17:35.354 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2021-12-17T18:17:35.354 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-12-17T18:17:35.355 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-12-17T18:17:35.355 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-12-17T18:17:35.355 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-12-17T18:17:35.358 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2021-12-17T18:17:35.358 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-12-17T18:17:35.393 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-12-17T18:17:35.448 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2021-12-17T18:17:35.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:17:35.450 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-12-17T18:17:35.467 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-12-17T18:17:35.468 INFO:tasks.ceph:role: osd.2 2021-12-17T18:17:35.468 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2021-12-17T18:17:35.468 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-12-17T18:17:35.950 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-12-17T18:17:35.950 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2021-12-17T18:17:35.951 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-12-17T18:17:35.951 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 2021-12-17T18:17:35.951 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-12-17T18:17:35.951 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2021-12-17T18:17:35.952 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-12-17T18:17:35.952 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-12-17T18:17:35.952 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-12-17T18:17:35.952 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-12-17T18:17:35.953 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2021-12-17T18:17:35.954 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-12-17T18:17:35.999 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-12-17T18:17:36.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:17:36.053 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2021-12-17T18:17:36.054 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-12-17T18:17:36.064 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-12-17T18:17:36.065 INFO:tasks.ceph:role: osd.3 2021-12-17T18:17:36.065 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com 2021-12-17T18:17:36.066 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-12-17T18:17:36.556 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-12-17T18:17:36.556 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2021-12-17T18:17:36.557 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-12-17T18:17:36.557 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 2021-12-17T18:17:36.557 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-12-17T18:17:36.557 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2021-12-17T18:17:36.558 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-12-17T18:17:36.558 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-12-17T18:17:36.558 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-12-17T18:17:36.558 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-12-17T18:17:36.560 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2021-12-17T18:17:36.560 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2021-12-17T18:17:36.612 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-12-17T18:17:36.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:17:36.626 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2021-12-17T18:17:36.626 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-12-17T18:17:36.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:36.715+0000 7f1d0e2dad80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-12-17T18:17:36.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:36.715+0000 7f1d0e2dad80 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-12-17T18:17:36.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:36.715+0000 7f1d0e2dad80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-12-17T18:17:36.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:36.715+0000 7f1d0e2dad80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-12-17T18:17:36.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:36.715+0000 7f1d0e2dad80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-12-17T18:17:36.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:36.723+0000 7f1d0e2dad80 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2021-12-17T18:17:36.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:36.751+0000 7f1d0e2dad80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-12-17T18:17:39.180 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-12-17T18:17:39.201 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-12-17T18:17:39.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:39.231+0000 7f27ca94cd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-12-17T18:17:39.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:39.231+0000 7f27ca94cd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-12-17T18:17:39.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:39.231+0000 7f27ca94cd80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-12-17T18:17:39.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:39.231+0000 7f27ca94cd80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-12-17T18:17:39.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:39.231+0000 7f27ca94cd80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-12-17T18:17:39.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:39.231+0000 7f27ca94cd80 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2021-12-17T18:17:39.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:39.251+0000 7f27ca94cd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-12-17T18:17:41.691 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-12-17T18:17:41.706 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-12-17T18:17:41.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:41.779+0000 7f5d72573d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-12-17T18:17:41.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:41.779+0000 7f5d72573d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-12-17T18:17:41.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:41.779+0000 7f5d72573d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-12-17T18:17:41.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:41.779+0000 7f5d72573d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-12-17T18:17:41.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:41.779+0000 7f5d72573d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-12-17T18:17:41.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:41.783+0000 7f5d72573d80 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2021-12-17T18:17:41.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:41.799+0000 7f5d72573d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-12-17T18:17:44.271 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-12-17T18:17:44.290 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-12-17T18:17:44.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:44.319+0000 7fe4489ecd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-12-17T18:17:44.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:44.319+0000 7fe4489ecd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-12-17T18:17:44.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:44.319+0000 7fe4489ecd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-12-17T18:17:44.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:44.319+0000 7fe4489ecd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-12-17T18:17:44.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:44.319+0000 7fe4489ecd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-12-17T18:17:44.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:44.319+0000 7fe4489ecd80 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2021-12-17T18:17:44.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:17:44.339+0000 7fe4489ecd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-12-17T18:17:46.783 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-12-17T18:17:46.840 DEBUG:teuthology.orchestra.run.smithi109:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-12-17T18:17:46.858 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-12-17T18:17:46.858 INFO:tasks.ceph:role: osd.4 2021-12-17T18:17:46.859 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi109.front.sepia.ceph.com 2021-12-17T18:17:46.859 DEBUG:teuthology.orchestra.run.smithi109:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-12-17T18:17:47.360 INFO:teuthology.orchestra.run.smithi109.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-12-17T18:17:47.361 INFO:teuthology.orchestra.run.smithi109.stdout: = sectsz=512 attr=2, projid32bit=1 2021-12-17T18:17:47.361 INFO:teuthology.orchestra.run.smithi109.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-12-17T18:17:47.361 INFO:teuthology.orchestra.run.smithi109.stdout: = reflink=1 2021-12-17T18:17:47.361 INFO:teuthology.orchestra.run.smithi109.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-12-17T18:17:47.361 INFO:teuthology.orchestra.run.smithi109.stdout: = sunit=0 swidth=0 blks 2021-12-17T18:17:47.362 INFO:teuthology.orchestra.run.smithi109.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-12-17T18:17:47.362 INFO:teuthology.orchestra.run.smithi109.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-12-17T18:17:47.362 INFO:teuthology.orchestra.run.smithi109.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-12-17T18:17:47.362 INFO:teuthology.orchestra.run.smithi109.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-12-17T18:17:47.364 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi109.front.sepia.ceph.com -o noatime 2021-12-17T18:17:47.364 DEBUG:teuthology.orchestra.run.smithi109:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2021-12-17T18:17:47.441 DEBUG:teuthology.orchestra.run.smithi109:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-12-17T18:17:47.454 INFO:teuthology.orchestra.run.smithi109.stderr:sudo: /sbin/restorecon: command not found 2021-12-17T18:17:47.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:17:47.456 DEBUG:teuthology.orchestra.run.smithi109:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-12-17T18:17:47.466 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-12-17T18:17:47.466 INFO:tasks.ceph:role: osd.5 2021-12-17T18:17:47.467 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi109.front.sepia.ceph.com 2021-12-17T18:17:47.467 DEBUG:teuthology.orchestra.run.smithi109:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-12-17T18:17:48.040 INFO:teuthology.orchestra.run.smithi109.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-12-17T18:17:48.040 INFO:teuthology.orchestra.run.smithi109.stdout: = sectsz=512 attr=2, projid32bit=1 2021-12-17T18:17:48.041 INFO:teuthology.orchestra.run.smithi109.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-12-17T18:17:48.041 INFO:teuthology.orchestra.run.smithi109.stdout: = reflink=1 2021-12-17T18:17:48.041 INFO:teuthology.orchestra.run.smithi109.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-12-17T18:17:48.041 INFO:teuthology.orchestra.run.smithi109.stdout: = sunit=0 swidth=0 blks 2021-12-17T18:17:48.042 INFO:teuthology.orchestra.run.smithi109.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-12-17T18:17:48.042 INFO:teuthology.orchestra.run.smithi109.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-12-17T18:17:48.042 INFO:teuthology.orchestra.run.smithi109.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-12-17T18:17:48.042 INFO:teuthology.orchestra.run.smithi109.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-12-17T18:17:48.044 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi109.front.sepia.ceph.com -o noatime 2021-12-17T18:17:48.044 DEBUG:teuthology.orchestra.run.smithi109:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2021-12-17T18:17:48.082 DEBUG:teuthology.orchestra.run.smithi109:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-12-17T18:17:48.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:17:48.094 INFO:teuthology.orchestra.run.smithi109.stderr:sudo: /sbin/restorecon: command not found 2021-12-17T18:17:48.094 DEBUG:teuthology.orchestra.run.smithi109:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2021-12-17T18:17:48.151 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-12-17T18:17:48.152 INFO:tasks.ceph:role: osd.6 2021-12-17T18:17:48.152 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi109.front.sepia.ceph.com 2021-12-17T18:17:48.152 DEBUG:teuthology.orchestra.run.smithi109:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-12-17T18:17:48.612 INFO:teuthology.orchestra.run.smithi109.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-12-17T18:17:48.612 INFO:teuthology.orchestra.run.smithi109.stdout: = sectsz=512 attr=2, projid32bit=1 2021-12-17T18:17:48.612 INFO:teuthology.orchestra.run.smithi109.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-12-17T18:17:48.613 INFO:teuthology.orchestra.run.smithi109.stdout: = reflink=1 2021-12-17T18:17:48.613 INFO:teuthology.orchestra.run.smithi109.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-12-17T18:17:48.613 INFO:teuthology.orchestra.run.smithi109.stdout: = sunit=0 swidth=0 blks 2021-12-17T18:17:48.614 INFO:teuthology.orchestra.run.smithi109.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-12-17T18:17:48.614 INFO:teuthology.orchestra.run.smithi109.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-12-17T18:17:48.614 INFO:teuthology.orchestra.run.smithi109.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-12-17T18:17:48.615 INFO:teuthology.orchestra.run.smithi109.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-12-17T18:17:48.616 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi109.front.sepia.ceph.com -o noatime 2021-12-17T18:17:48.616 DEBUG:teuthology.orchestra.run.smithi109:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2021-12-17T18:17:48.675 DEBUG:teuthology.orchestra.run.smithi109:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2021-12-17T18:17:48.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:17:48.688 INFO:teuthology.orchestra.run.smithi109.stderr:sudo: /sbin/restorecon: command not found 2021-12-17T18:17:48.689 DEBUG:teuthology.orchestra.run.smithi109:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2021-12-17T18:17:48.745 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-12-17T18:17:48.746 INFO:tasks.ceph:role: osd.7 2021-12-17T18:17:48.746 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi109.front.sepia.ceph.com 2021-12-17T18:17:48.746 DEBUG:teuthology.orchestra.run.smithi109:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-12-17T18:17:49.228 INFO:teuthology.orchestra.run.smithi109.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-12-17T18:17:49.228 INFO:teuthology.orchestra.run.smithi109.stdout: = sectsz=512 attr=2, projid32bit=1 2021-12-17T18:17:49.228 INFO:teuthology.orchestra.run.smithi109.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-12-17T18:17:49.229 INFO:teuthology.orchestra.run.smithi109.stdout: = reflink=1 2021-12-17T18:17:49.229 INFO:teuthology.orchestra.run.smithi109.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-12-17T18:17:49.229 INFO:teuthology.orchestra.run.smithi109.stdout: = sunit=0 swidth=0 blks 2021-12-17T18:17:49.230 INFO:teuthology.orchestra.run.smithi109.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-12-17T18:17:49.230 INFO:teuthology.orchestra.run.smithi109.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-12-17T18:17:49.230 INFO:teuthology.orchestra.run.smithi109.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-12-17T18:17:49.230 INFO:teuthology.orchestra.run.smithi109.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-12-17T18:17:49.232 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi109.front.sepia.ceph.com -o noatime 2021-12-17T18:17:49.233 DEBUG:teuthology.orchestra.run.smithi109:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2021-12-17T18:17:49.299 DEBUG:teuthology.orchestra.run.smithi109:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2021-12-17T18:17:49.312 INFO:teuthology.orchestra.run.smithi109.stderr:sudo: /sbin/restorecon: command not found 2021-12-17T18:17:49.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:17:49.314 DEBUG:teuthology.orchestra.run.smithi109:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-12-17T18:17:49.385 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:49.381+0000 7efc93510d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-12-17T18:17:49.390 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:49.385+0000 7efc93510d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-12-17T18:17:49.390 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:49.385+0000 7efc93510d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-12-17T18:17:49.390 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:49.385+0000 7efc93510d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-12-17T18:17:49.391 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:49.385+0000 7efc93510d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-12-17T18:17:49.397 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:49.393+0000 7efc93510d80 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2021-12-17T18:17:49.424 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:49.421+0000 7efc93510d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-12-17T18:17:51.853 DEBUG:teuthology.orchestra.run.smithi109:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-12-17T18:17:51.872 DEBUG:teuthology.orchestra.run.smithi109:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-12-17T18:17:51.956 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:51.953+0000 7ff4cc2f9d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-12-17T18:17:51.957 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:51.953+0000 7ff4cc2f9d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-12-17T18:17:51.957 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:51.953+0000 7ff4cc2f9d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-12-17T18:17:51.957 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:51.953+0000 7ff4cc2f9d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-12-17T18:17:51.958 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:51.953+0000 7ff4cc2f9d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-12-17T18:17:51.958 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:51.953+0000 7ff4cc2f9d80 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2021-12-17T18:17:51.975 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:51.973+0000 7ff4cc2f9d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-12-17T18:17:54.398 DEBUG:teuthology.orchestra.run.smithi109:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-12-17T18:17:54.417 DEBUG:teuthology.orchestra.run.smithi109:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-12-17T18:17:54.451 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:54.445+0000 7f4aab4e8d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2021-12-17T18:17:54.451 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:54.445+0000 7f4aab4e8d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2021-12-17T18:17:54.451 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:54.445+0000 7f4aab4e8d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-12-17T18:17:54.452 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:54.445+0000 7f4aab4e8d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-12-17T18:17:54.452 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:54.445+0000 7f4aab4e8d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-12-17T18:17:54.452 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:54.449+0000 7f4aab4e8d80 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2021-12-17T18:17:54.473 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:54.469+0000 7f4aab4e8d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-12-17T18:17:56.905 DEBUG:teuthology.orchestra.run.smithi109:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-12-17T18:17:56.964 DEBUG:teuthology.orchestra.run.smithi109:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-12-17T18:17:57.001 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:56.997+0000 7fcab86d5d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2021-12-17T18:17:57.001 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:56.997+0000 7fcab86d5d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2021-12-17T18:17:57.001 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:56.997+0000 7fcab86d5d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-12-17T18:17:57.002 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:56.997+0000 7fcab86d5d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-12-17T18:17:57.002 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:56.997+0000 7fcab86d5d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-12-17T18:17:57.003 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:56.997+0000 7fcab86d5d80 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2021-12-17T18:17:57.020 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:17:57.017+0000 7fcab86d5d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-12-17T18:17:59.437 DEBUG:teuthology.orchestra.run.smithi109:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-12-17T18:17:59.454 INFO:tasks.ceph:Reading keys from all nodes... 2021-12-17T18:17:59.455 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-12-17T18:17:59.463 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.HFbsqQHSVI 2021-12-17T18:17:59.463 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.HFbsqQHSVI 2021-12-17T18:17:59.477 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.HFbsqQHSVI 2021-12-17T18:17:59.548 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.HFbsqQHSVI is 56B 2021-12-17T18:17:59.564 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.HFbsqQHSVI 2021-12-17T18:17:59.571 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-12-17T18:17:59.623 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.dT2tW0FGvq 2021-12-17T18:17:59.624 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.dT2tW0FGvq 2021-12-17T18:17:59.641 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.dT2tW0FGvq 2021-12-17T18:17:59.708 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.dT2tW0FGvq is 56B 2021-12-17T18:17:59.723 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.dT2tW0FGvq 2021-12-17T18:17:59.730 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-12-17T18:17:59.779 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.zxFfEr5Peo 2021-12-17T18:17:59.779 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.zxFfEr5Peo 2021-12-17T18:17:59.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.zxFfEr5Peo 2021-12-17T18:17:59.860 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.zxFfEr5Peo is 56B 2021-12-17T18:17:59.875 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.zxFfEr5Peo 2021-12-17T18:17:59.883 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-12-17T18:17:59.931 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.6aRduyYany 2021-12-17T18:17:59.931 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.6aRduyYany 2021-12-17T18:17:59.949 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.6aRduyYany 2021-12-17T18:18:00.016 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.6aRduyYany is 56B 2021-12-17T18:18:00.032 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.6aRduyYany 2021-12-17T18:18:00.040 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-12-17T18:18:00.087 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.jK61dgRMmn 2021-12-17T18:18:00.087 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.jK61dgRMmn 2021-12-17T18:18:00.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.jK61dgRMmn 2021-12-17T18:18:00.125 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.jK61dgRMmn is 56B 2021-12-17T18:18:00.140 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.jK61dgRMmn 2021-12-17T18:18:00.147 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-12-17T18:18:00.195 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.MB16EEKbay 2021-12-17T18:18:00.195 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.MB16EEKbay 2021-12-17T18:18:00.213 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.MB16EEKbay 2021-12-17T18:18:00.275 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.MB16EEKbay is 56B 2021-12-17T18:18:00.291 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.MB16EEKbay 2021-12-17T18:18:00.297 DEBUG:teuthology.orchestra.run.smithi109:> mktemp 2021-12-17T18:18:00.305 INFO:teuthology.orchestra.run.smithi109.stdout:/tmp/tmp.dvp1UJ0T1E 2021-12-17T18:18:00.305 DEBUG:teuthology.orchestra.run.smithi109:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.dvp1UJ0T1E 2021-12-17T18:18:00.323 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod 0666 /tmp/tmp.dvp1UJ0T1E 2021-12-17T18:18:00.390 DEBUG:teuthology.orchestra.remote:smithi109:/tmp/tmp.dvp1UJ0T1E is 56B 2021-12-17T18:18:00.405 DEBUG:teuthology.orchestra.run.smithi109:> rm -fr /tmp/tmp.dvp1UJ0T1E 2021-12-17T18:18:00.412 DEBUG:teuthology.orchestra.run.smithi109:> mktemp 2021-12-17T18:18:00.461 INFO:teuthology.orchestra.run.smithi109.stdout:/tmp/tmp.0exbNRxUde 2021-12-17T18:18:00.461 DEBUG:teuthology.orchestra.run.smithi109:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.0exbNRxUde 2021-12-17T18:18:00.477 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod 0666 /tmp/tmp.0exbNRxUde 2021-12-17T18:18:00.503 DEBUG:teuthology.orchestra.remote:smithi109:/tmp/tmp.0exbNRxUde is 56B 2021-12-17T18:18:00.516 DEBUG:teuthology.orchestra.run.smithi109:> rm -fr /tmp/tmp.0exbNRxUde 2021-12-17T18:18:00.521 DEBUG:teuthology.orchestra.run.smithi109:> mktemp 2021-12-17T18:18:00.573 INFO:teuthology.orchestra.run.smithi109.stdout:/tmp/tmp.3H9Y6ltVgb 2021-12-17T18:18:00.573 DEBUG:teuthology.orchestra.run.smithi109:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.3H9Y6ltVgb 2021-12-17T18:18:00.588 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod 0666 /tmp/tmp.3H9Y6ltVgb 2021-12-17T18:18:00.613 DEBUG:teuthology.orchestra.remote:smithi109:/tmp/tmp.3H9Y6ltVgb is 56B 2021-12-17T18:18:00.629 DEBUG:teuthology.orchestra.run.smithi109:> rm -fr /tmp/tmp.3H9Y6ltVgb 2021-12-17T18:18:00.636 DEBUG:teuthology.orchestra.run.smithi109:> mktemp 2021-12-17T18:18:00.685 INFO:teuthology.orchestra.run.smithi109.stdout:/tmp/tmp.ZkkjpdJCv7 2021-12-17T18:18:00.685 DEBUG:teuthology.orchestra.run.smithi109:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.ZkkjpdJCv7 2021-12-17T18:18:00.702 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod 0666 /tmp/tmp.ZkkjpdJCv7 2021-12-17T18:18:00.766 DEBUG:teuthology.orchestra.remote:smithi109:/tmp/tmp.ZkkjpdJCv7 is 56B 2021-12-17T18:18:00.781 DEBUG:teuthology.orchestra.run.smithi109:> rm -fr /tmp/tmp.ZkkjpdJCv7 2021-12-17T18:18:00.786 DEBUG:teuthology.orchestra.run.smithi109:> mktemp 2021-12-17T18:18:00.841 INFO:teuthology.orchestra.run.smithi109.stdout:/tmp/tmp.KkBIaQC0AB 2021-12-17T18:18:00.841 DEBUG:teuthology.orchestra.run.smithi109:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.KkBIaQC0AB 2021-12-17T18:18:00.858 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod 0666 /tmp/tmp.KkBIaQC0AB 2021-12-17T18:18:00.926 DEBUG:teuthology.orchestra.remote:smithi109:/tmp/tmp.KkBIaQC0AB is 56B 2021-12-17T18:18:00.941 DEBUG:teuthology.orchestra.run.smithi109:> rm -fr /tmp/tmp.KkBIaQC0AB 2021-12-17T18:18:00.949 DEBUG:teuthology.orchestra.run.smithi109:> mktemp 2021-12-17T18:18:00.997 INFO:teuthology.orchestra.run.smithi109.stdout:/tmp/tmp.DPfQ4jtv78 2021-12-17T18:18:00.998 DEBUG:teuthology.orchestra.run.smithi109:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.DPfQ4jtv78 2021-12-17T18:18:01.016 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod 0666 /tmp/tmp.DPfQ4jtv78 2021-12-17T18:18:01.035 DEBUG:teuthology.orchestra.remote:smithi109:/tmp/tmp.DPfQ4jtv78 is 56B 2021-12-17T18:18:01.050 DEBUG:teuthology.orchestra.run.smithi109:> rm -fr /tmp/tmp.DPfQ4jtv78 2021-12-17T18:18:01.067 DEBUG:teuthology.orchestra.remote:smithi125:/etc/ceph/ceph.client.0.keyring is 59B 2021-12-17T18:18:01.094 DEBUG:teuthology.orchestra.remote:smithi158:/etc/ceph/ceph.client.1.keyring is 59B 2021-12-17T18:18:01.123 DEBUG:teuthology.orchestra.remote:smithi192:/etc/ceph/ceph.client.2.keyring is 59B 2021-12-17T18:18:01.138 INFO:tasks.ceph:Adding keys to all mons... 2021-12-17T18:18:01.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2021-12-17T18:18:01.141 DEBUG:teuthology.orchestra.run.smithi109:> sudo tee -a /etc/ceph/ceph.keyring 2021-12-17T18:18:01.154 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2021-12-17T18:18:01.154 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQA91LxhKdTGJRAArzUN3A1U5Efw0NG9Gw2Gcw== 2021-12-17T18:18:01.154 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2021-12-17T18:18:01.155 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQA91LxhxCS0LBAAtUlkgWYg4l3fQ2au7jMUDg== 2021-12-17T18:18:01.155 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2021-12-17T18:18:01.155 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBA1LxhJXzhKhAAUnxP3G5VuATkQLoDALFjVg== 2021-12-17T18:18:01.155 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2021-12-17T18:18:01.156 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBD1LxhregUDhAABrxQ2jQ4BwXvuWh/D9SkbQ== 2021-12-17T18:18:01.156 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2021-12-17T18:18:01.156 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBF1LxhOo/SLhAAhQQLW/VKFx1sgm8chnD5tw== 2021-12-17T18:18:01.156 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2021-12-17T18:18:01.156 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBI1LxhT2ZQExAA999j8V5bJAJ2PuaQqSkUOw== 2021-12-17T18:18:01.157 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2021-12-17T18:18:01.157 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQA91LxhzvntKRAAFQlg69Z6d2nWX0GxSshsMw== 2021-12-17T18:18:01.157 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2021-12-17T18:18:01.157 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQA91LxhoRJAMxAAP/NmDQRwJjYip2rxJsQlYg== 2021-12-17T18:18:01.158 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.4] 2021-12-17T18:18:01.158 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBN1LxhKBDzFhAAKmPF0FXnnfXtweo+6z9nxg== 2021-12-17T18:18:01.158 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.5] 2021-12-17T18:18:01.158 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBP1LxhtqkAORAAVaFLVNIUMs4Sytk8WRaGNA== 2021-12-17T18:18:01.159 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.6] 2021-12-17T18:18:01.159 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBS1LxhNtncGhAAgG64g1ie54CDp9Y7uldKQA== 2021-12-17T18:18:01.159 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.7] 2021-12-17T18:18:01.159 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBV1Lxh3DcDABAAHVskSVtoEJ8BxCCAs3ZDVA== 2021-12-17T18:18:01.160 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2021-12-17T18:18:01.160 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQA91Lxh9QhCNxAALkWTJorDpbt9yrikL7/NWg== 2021-12-17T18:18:01.160 INFO:teuthology.orchestra.run.smithi062.stdout:[client.1] 2021-12-17T18:18:01.160 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQA91Lxhxm52OxAAbqXVaqRDmt4Ezj9xyCEODQ== 2021-12-17T18:18:01.160 INFO:teuthology.orchestra.run.smithi062.stdout:[client.2] 2021-12-17T18:18:01.161 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQA+1LxhXu08BBAATRcUAZvMNg9ou4PLszDtmA== 2021-12-17T18:18:01.162 INFO:teuthology.orchestra.run.smithi109.stdout:[mgr.y] 2021-12-17T18:18:01.163 INFO:teuthology.orchestra.run.smithi109.stdout: key = AQA91LxhKdTGJRAArzUN3A1U5Efw0NG9Gw2Gcw== 2021-12-17T18:18:01.163 INFO:teuthology.orchestra.run.smithi109.stdout:[mds.a] 2021-12-17T18:18:01.163 INFO:teuthology.orchestra.run.smithi109.stdout: key = AQA91LxhxCS0LBAAtUlkgWYg4l3fQ2au7jMUDg== 2021-12-17T18:18:01.163 INFO:teuthology.orchestra.run.smithi109.stdout:[osd.0] 2021-12-17T18:18:01.164 INFO:teuthology.orchestra.run.smithi109.stdout: key = AQBA1LxhJXzhKhAAUnxP3G5VuATkQLoDALFjVg== 2021-12-17T18:18:01.164 INFO:teuthology.orchestra.run.smithi109.stdout:[osd.1] 2021-12-17T18:18:01.164 INFO:teuthology.orchestra.run.smithi109.stdout: key = AQBD1LxhregUDhAABrxQ2jQ4BwXvuWh/D9SkbQ== 2021-12-17T18:18:01.164 INFO:teuthology.orchestra.run.smithi109.stdout:[osd.2] 2021-12-17T18:18:01.165 INFO:teuthology.orchestra.run.smithi109.stdout: key = AQBF1LxhOo/SLhAAhQQLW/VKFx1sgm8chnD5tw== 2021-12-17T18:18:01.165 INFO:teuthology.orchestra.run.smithi109.stdout:[osd.3] 2021-12-17T18:18:01.165 INFO:teuthology.orchestra.run.smithi109.stdout: key = AQBI1LxhT2ZQExAA999j8V5bJAJ2PuaQqSkUOw== 2021-12-17T18:18:01.165 INFO:teuthology.orchestra.run.smithi109.stdout:[mgr.x] 2021-12-17T18:18:01.165 INFO:teuthology.orchestra.run.smithi109.stdout: key = AQA91LxhzvntKRAAFQlg69Z6d2nWX0GxSshsMw== 2021-12-17T18:18:01.166 INFO:teuthology.orchestra.run.smithi109.stdout:[mds.b] 2021-12-17T18:18:01.166 INFO:teuthology.orchestra.run.smithi109.stdout: key = AQA91LxhoRJAMxAAP/NmDQRwJjYip2rxJsQlYg== 2021-12-17T18:18:01.166 INFO:teuthology.orchestra.run.smithi109.stdout:[osd.4] 2021-12-17T18:18:01.166 INFO:teuthology.orchestra.run.smithi109.stdout: key = AQBN1LxhKBDzFhAAKmPF0FXnnfXtweo+6z9nxg== 2021-12-17T18:18:01.167 INFO:teuthology.orchestra.run.smithi109.stdout:[osd.5] 2021-12-17T18:18:01.167 INFO:teuthology.orchestra.run.smithi109.stdout: key = AQBP1LxhtqkAORAAVaFLVNIUMs4Sytk8WRaGNA== 2021-12-17T18:18:01.167 INFO:teuthology.orchestra.run.smithi109.stdout:[osd.6] 2021-12-17T18:18:01.167 INFO:teuthology.orchestra.run.smithi109.stdout: key = AQBS1LxhNtncGhAAgG64g1ie54CDp9Y7uldKQA== 2021-12-17T18:18:01.168 INFO:teuthology.orchestra.run.smithi109.stdout:[osd.7] 2021-12-17T18:18:01.168 INFO:teuthology.orchestra.run.smithi109.stdout: key = AQBV1Lxh3DcDABAAHVskSVtoEJ8BxCCAs3ZDVA== 2021-12-17T18:18:01.168 INFO:teuthology.orchestra.run.smithi109.stdout:[client.0] 2021-12-17T18:18:01.168 INFO:teuthology.orchestra.run.smithi109.stdout: key = AQA91Lxh9QhCNxAALkWTJorDpbt9yrikL7/NWg== 2021-12-17T18:18:01.168 INFO:teuthology.orchestra.run.smithi109.stdout:[client.1] 2021-12-17T18:18:01.169 INFO:teuthology.orchestra.run.smithi109.stdout: key = AQA91Lxhxm52OxAAbqXVaqRDmt4Ezj9xyCEODQ== 2021-12-17T18:18:01.169 INFO:teuthology.orchestra.run.smithi109.stdout:[client.2] 2021-12-17T18:18:01.169 INFO:teuthology.orchestra.run.smithi109.stdout: key = AQA+1LxhXu08BBAATRcUAZvMNg9ou4PLszDtmA== 2021-12-17T18:18:01.170 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-12-17T18:18:01.172 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-12-17T18:18:01.217 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-12-17T18:18:01.255 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-12-17T18:18:01.305 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-12-17T18:18:01.308 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-12-17T18:18:01.350 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-12-17T18:18:01.353 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-12-17T18:18:01.392 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-12-17T18:18:01.395 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-12-17T18:18:01.477 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-12-17T18:18:01.480 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-12-17T18:18:01.522 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-12-17T18:18:01.525 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-12-17T18:18:01.611 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-12-17T18:18:01.614 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-12-17T18:18:01.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-12-17T18:18:01.703 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-12-17T18:18:01.747 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-12-17T18:18:01.750 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-12-17T18:18:01.836 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-12-17T18:18:01.839 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-12-17T18:18:01.881 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-12-17T18:18:01.927 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-12-17T18:18:01.968 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-12-17T18:18:01.971 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-12-17T18:18:02.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-12-17T18:18:02.066 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-12-17T18:18:02.111 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-12-17T18:18:02.114 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-12-17T18:18:02.157 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-12-17T18:18:02.158 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-12-17T18:18:02.174 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-12-17T18:18:02.233 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-12-17T18:18:02.248 DEBUG:teuthology.orchestra.run.smithi109:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-12-17T18:18:02.263 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-12-17T18:18:02.320 DEBUG:teuthology.orchestra.run.smithi109:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-12-17T18:18:02.332 DEBUG:teuthology.orchestra.run.smithi109:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-12-17T18:18:02.346 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-12-17T18:18:02.404 DEBUG:teuthology.orchestra.run.smithi109:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-12-17T18:18:02.416 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-12-17T18:18:02.419 DEBUG:teuthology.orchestra.run.smithi109:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-12-17T18:18:02.424 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:18:02.425 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-12-17T18:18:02.426 INFO:tasks.ceph.mon.a:Restarting daemon 2021-12-17T18:18:02.427 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-12-17T18:18:02.429 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:18:02.431 INFO:tasks.ceph.mon.a:Started 2021-12-17T18:18:02.431 INFO:tasks.ceph.mon.b:Restarting daemon 2021-12-17T18:18:02.431 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-12-17T18:18:02.433 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:18:02.435 INFO:tasks.ceph.mon.b:Started 2021-12-17T18:18:02.435 INFO:tasks.ceph.mon.c:Restarting daemon 2021-12-17T18:18:02.435 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-12-17T18:18:02.437 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:18:02.440 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:18:02.480 INFO:tasks.ceph.mon.c:Started 2021-12-17T18:18:02.481 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-12-17T18:18:02.481 INFO:tasks.ceph.mgr.y:Restarting daemon 2021-12-17T18:18:02.482 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2021-12-17T18:18:02.484 INFO:tasks.ceph.mgr.y:Started 2021-12-17T18:18:02.485 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-12-17T18:18:02.485 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-12-17T18:18:02.488 INFO:tasks.ceph.mgr.x:Started 2021-12-17T18:18:02.489 INFO:tasks.ceph:Setting crush tunables to default 2021-12-17T18:18:02.489 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd crush tunables default 2021-12-17T18:18:02.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.614+0000 7f4efc09c700 1 Processor -- start 2021-12-17T18:18:02.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.614+0000 7f4efc09c700 1 -- start start 2021-12-17T18:18:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.618+0000 7f4efc09c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 0x7f4ef4060220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.618+0000 7f4efc09c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4ef41440a0 0x7f4ef4067830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.618+0000 7f4efc09c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef4067d20 con 0x7f4ef405fe40 2021-12-17T18:18:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.618+0000 7f4efc09c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef4144550 con 0x7f4ef41440a0 2021-12-17T18:18:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.618+0000 7f4efc09c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef40ae830 con 0x7f4ef40b1ad0 2021-12-17T18:18:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.618+0000 7f4ef9e38700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4ef405fe40 0x7f4ef4067120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59112/0 (socket says 172.21.15.62:59112) 2021-12-17T18:18:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.618+0000 7f4ef9e38700 1 -- 172.21.15.62:0/4120893961 learned_addr learned my addr 172.21.15.62:0/4120893961 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.618+0000 7f4ef9637700 1 --2- 172.21.15.62:0/4120893961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 0x7f4ef4060220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.618+0000 7f4efa639700 1 --2- 172.21.15.62:0/4120893961 >> v2:172.21.15.62:3300/0 conn(0x7f4ef41440a0 0x7f4ef4067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.618+0000 7f4efa639700 1 -- 172.21.15.62:0/4120893961 >> v2:172.21.15.62:3300/0 conn(0x7f4ef41440a0 msgr2=0x7f4ef4067830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-12-17T18:18:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.618+0000 7f4ef9637700 1 -- 172.21.15.62:0/4120893961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 msgr2=0x7f4ef4060220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-12-17T18:18:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.618+0000 7f4efa639700 1 -- 172.21.15.62:0/4120893961 >> v2:172.21.15.62:3300/0 conn(0x7f4ef41440a0 msgr2=0x7f4ef4067830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-12-17T18:18:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.618+0000 7f4ef9637700 1 -- 172.21.15.62:0/4120893961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 msgr2=0x7f4ef4060220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-12-17T18:18:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.618+0000 7f4efa639700 1 --2- 172.21.15.62:0/4120893961 >> v2:172.21.15.62:3300/0 conn(0x7f4ef41440a0 0x7f4ef4067830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-12-17T18:18:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.618+0000 7f4ef9637700 1 --2- 172.21.15.62:0/4120893961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 0x7f4ef4060220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-12-17T18:18:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.618+0000 7f4ef9637700 1 --2- 172.21.15.62:0/4120893961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 0x7f4ef4060220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-12-17T18:18:02.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.618+0000 7f4efa639700 1 --2- 172.21.15.62:0/4120893961 >> v2:172.21.15.62:3300/0 conn(0x7f4ef41440a0 0x7f4ef4067830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-12-17T18:18:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.782+0000 7f4ef8e36700 1 -- 172.21.15.62:0/4120893961 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447186403 0 0) 0x7f4ef4067d20 con 0x7f4ef405fe40 2021-12-17T18:18:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.782+0000 7f4ef8e36700 1 -- 172.21.15.62:0/4120893961 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4edc003260 con 0x7f4ef405fe40 2021-12-17T18:18:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef8e36700 1 -- 172.21.15.62:0/4120893961 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 80419638 0 0) 0x7f4edc003260 con 0x7f4ef405fe40 2021-12-17T18:18:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef8e36700 1 -- 172.21.15.62:0/4120893961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 msgr2=0x7f4ef4060220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-12-17T18:18:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef8e36700 1 --2- 172.21.15.62:0/4120893961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 0x7f4ef4060220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef8e36700 1 -- 172.21.15.62:0/4120893961 >> v2:172.21.15.62:3300/0 conn(0x7f4ef41440a0 msgr2=0x7f4ef4067830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-12-17T18:18:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef8e36700 1 --2- 172.21.15.62:0/4120893961 >> v2:172.21.15.62:3300/0 conn(0x7f4ef41440a0 0x7f4ef4067830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef8e36700 1 -- 172.21.15.62:0/4120893961 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef41436c0 con 0x7f4ef405fe40 2021-12-17T18:18:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef8e36700 1 -- 172.21.15.62:0/4120893961 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f4eec0019e0 con 0x7f4ef405fe40 2021-12-17T18:18:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef8e36700 1 -- 172.21.15.62:0/4120893961 >> v1:172.21.15.62:6789/0 conn(0x7f4ef405fe40 legacy=0x7f4ef4067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef8e36700 1 --2- 172.21.15.62:0/4120893961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4edc003750 0x7f4edc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef8e36700 1 --2- 172.21.15.62:0/4120893961 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4edc004500 0x7f4edc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef8e36700 1 --2- 172.21.15.62:0/4120893961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 0x7f4edc004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef8e36700 1 -- 172.21.15.62:0/4120893961 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4144550 con 0x7f4edc003750 2021-12-17T18:18:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef8e36700 1 -- 172.21.15.62:0/4120893961 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef40ae830 con 0x7f4edc004500 2021-12-17T18:18:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef8e36700 1 -- 172.21.15.62:0/4120893961 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc00d9b0 con 0x7f4ef40b1ad0 2021-12-17T18:18:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4efa639700 1 --2- 172.21.15.62:0/4120893961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 0x7f4edc004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef9637700 1 --2- 172.21.15.62:0/4120893961 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4edc004500 0x7f4edc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:02.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef9e38700 1 --2- 172.21.15.62:0/4120893961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4edc003750 0x7f4edc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:02.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4efa639700 1 -- 172.21.15.62:0/4120893961 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4edc004500 msgr2=0x7f4edc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:02.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4efa639700 1 --2- 172.21.15.62:0/4120893961 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4edc004500 0x7f4edc004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4efa639700 1 -- 172.21.15.62:0/4120893961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4edc003750 msgr2=0x7f4edc003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4efa639700 1 --2- 172.21.15.62:0/4120893961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4edc003750 0x7f4edc003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4efa639700 1 -- 172.21.15.62:0/4120893961 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc003260 con 0x7f4ef40b1ad0 2021-12-17T18:18:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef9e38700 1 --2- 172.21.15.62:0/4120893961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4edc003750 0x7f4edc003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4efa639700 1 --2- 172.21.15.62:0/4120893961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 0x7f4edc004e70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4ef0000e90 tx=0x7f4ef0008040).ready entity=mon.2 client_cookie=fd1861dfa325c080 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef8e36700 1 -- 172.21.15.62:0/4120893961 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ef0013620 con 0x7f4ef40b1ad0 2021-12-17T18:18:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef8e36700 1 -- 172.21.15.62:0/4120893961 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef0013780 con 0x7f4ef40b1ad0 2021-12-17T18:18:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4ef8e36700 1 -- 172.21.15.62:0/4120893961 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ef0013ae0 con 0x7f4ef40b1ad0 2021-12-17T18:18:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4efc09c700 1 -- 172.21.15.62:0/4120893961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 msgr2=0x7f4edc004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4efc09c700 1 --2- 172.21.15.62:0/4120893961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 0x7f4edc004e70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4ef0000e90 tx=0x7f4ef0008040).stop 2021-12-17T18:18:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4efa639700 1 -- 172.21.15.62:0/4120893961 reap_dead start 2021-12-17T18:18:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4efc09c700 1 -- 172.21.15.62:0/4120893961 shutdown_connections 2021-12-17T18:18:02.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.786+0000 7f4efc09c700 1 -- 172.21.15.62:0/4120893961 >> 172.21.15.62:0/4120893961 conn(0x7f4ef40626d0 msgr2=0x7f4ef405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:02.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.790+0000 7f4efc09c700 1 -- 172.21.15.62:0/4120893961 shutdown_connections 2021-12-17T18:18:02.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.790+0000 7f4efc09c700 1 -- 172.21.15.62:0/4120893961 wait complete. 2021-12-17T18:18:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.790+0000 7f4efc09c700 1 Processor -- start 2021-12-17T18:18:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.790+0000 7f4efc09c700 1 -- start start 2021-12-17T18:18:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4efc09c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 0x7f4ef4064620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4efc09c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ef4140c30 0x7f4ef40630e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4efc09c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4ef41406b0 0x7f4ef414eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4efc09c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef40a01a0 con 0x7f4ef4140c30 2021-12-17T18:18:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4efc09c700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef414e6a0 con 0x7f4ef41406b0 2021-12-17T18:18:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4efc09c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4064b10 con 0x7f4ef40b1ad0 2021-12-17T18:18:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4ef9637700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ef4140c30 0x7f4ef40630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4ef9637700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ef4140c30 0x7f4ef40630e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47330/0 (socket says 172.21.15.62:47330) 2021-12-17T18:18:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4ef9637700 1 -- 172.21.15.62:0/1443451964 learned_addr learned my addr 172.21.15.62:0/1443451964 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4ef9e38700 1 --2- 172.21.15.62:0/1443451964 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 0x7f4ef4064620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4efa639700 1 --2- 172.21.15.62:0/1443451964 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4ef41406b0 0x7f4ef414eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4ef9637700 1 -- 172.21.15.62:0/1443451964 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 msgr2=0x7f4ef4064620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4ef9637700 1 --2- 172.21.15.62:0/1443451964 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 0x7f4ef4064620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4ef9637700 1 -- 172.21.15.62:0/1443451964 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4ef41406b0 msgr2=0x7f4ef414eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4ef9637700 1 --2- 172.21.15.62:0/1443451964 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4ef41406b0 0x7f4ef414eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4ef9637700 1 -- 172.21.15.62:0/1443451964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef414e340 con 0x7f4ef4140c30 2021-12-17T18:18:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4ef9637700 1 --2- 172.21.15.62:0/1443451964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ef4140c30 0x7f4ef40630e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f4ee400c000 tx=0x7f4ee4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4ee2ffd700 1 -- 172.21.15.62:0/1443451964 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ee4014680 con 0x7f4ef4140c30 2021-12-17T18:18:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4ee2ffd700 1 -- 172.21.15.62:0/1443451964 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee40147e0 con 0x7f4ef4140c30 2021-12-17T18:18:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4efc09c700 1 -- 172.21.15.62:0/1443451964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef40635d0 con 0x7f4ef4140c30 2021-12-17T18:18:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4ee2ffd700 1 -- 172.21.15.62:0/1443451964 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ee4014b40 con 0x7f4ef4140c30 2021-12-17T18:18:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4efc09c700 1 -- 172.21.15.62:0/1443451964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef414f1d0 con 0x7f4ef4140c30 2021-12-17T18:18:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4ee2ffd700 1 -- 172.21.15.62:0/1443451964 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f4ee4006030 con 0x7f4ef4140c30 2021-12-17T18:18:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.794+0000 7f4ee2ffd700 1 -- 172.21.15.62:0/1443451964 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f4ee4005a60 con 0x7f4ef4140c30 2021-12-17T18:18:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.798+0000 7f4efc09c700 1 -- 172.21.15.62:0/1443451964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef4143960 con 0x7f4ef4140c30 2021-12-17T18:18:02.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.798+0000 7f4ee2ffd700 1 -- 172.21.15.62:0/1443451964 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f4ee4018020 con 0x7f4ef4140c30 2021-12-17T18:18:02.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.862+0000 7f4efc09c700 1 -- 172.21.15.62:0/1443451964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4ef40573d0 con 0x7f4ef4140c30 2021-12-17T18:18:02.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.866+0000 7f4ee2ffd700 1 -- 172.21.15.62:0/1443451964 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4ee402b090 con 0x7f4ef4140c30 2021-12-17T18:18:02.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.866+0000 7f4efc09c700 1 -- 172.21.15.62:0/1443451964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ef4140c30 msgr2=0x7f4ef40630e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:02.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.866+0000 7f4efc09c700 1 --2- 172.21.15.62:0/1443451964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ef4140c30 0x7f4ef40630e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f4ee400c000 tx=0x7f4ee4008040).stop 2021-12-17T18:18:02.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.870+0000 7f4efc09c700 1 -- 172.21.15.62:0/1443451964 shutdown_connections 2021-12-17T18:18:02.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.870+0000 7f4efc09c700 1 --2- 172.21.15.62:0/1443451964 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4ef41406b0 0x7f4ef414eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:02.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.870+0000 7f4efc09c700 1 --2- 172.21.15.62:0/1443451964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ef4140c30 0x7f4ef40630e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:02.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.870+0000 7f4efc09c700 1 --2- 172.21.15.62:0/1443451964 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ef40b1ad0 0x7f4ef4064620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.870+0000 7f4efc09c700 1 -- 172.21.15.62:0/1443451964 >> 172.21.15.62:0/1443451964 conn(0x7f4ef40626d0 msgr2=0x7f4ef40ad6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.870+0000 7f4efc09c700 1 -- 172.21.15.62:0/1443451964 shutdown_connections 2021-12-17T18:18:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:02.870+0000 7f4efc09c700 1 -- 172.21.15.62:0/1443451964 wait complete. 2021-12-17T18:18:02.878 INFO:teuthology.orchestra.run.smithi062.stderr:adjusted tunables profile to default 2021-12-17T18:18:02.884 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-12-17T18:18:02.885 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-12-17T18:18:02.891 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.6HPBIRATMT 2021-12-17T18:18:02.892 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.6HPBIRATMT 2021-12-17T18:18:02.910 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.6HPBIRATMT 2021-12-17T18:18:02.978 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.6HPBIRATMT is 37B 2021-12-17T18:18:02.993 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.6HPBIRATMT 2021-12-17T18:18:02.999 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-12-17T18:18:03.047 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.1o5okII10g 2021-12-17T18:18:03.047 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.1o5okII10g 2021-12-17T18:18:03.062 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.1o5okII10g 2021-12-17T18:18:03.082 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.1o5okII10g is 37B 2021-12-17T18:18:03.098 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.1o5okII10g 2021-12-17T18:18:03.105 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-12-17T18:18:03.151 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.Ojo0hB0J91 2021-12-17T18:18:03.152 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.Ojo0hB0J91 2021-12-17T18:18:03.165 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.Ojo0hB0J91 2021-12-17T18:18:03.231 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.Ojo0hB0J91 is 37B 2021-12-17T18:18:03.246 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.Ojo0hB0J91 2021-12-17T18:18:03.252 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-12-17T18:18:03.303 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.uxfvgZx3Ot 2021-12-17T18:18:03.303 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.uxfvgZx3Ot 2021-12-17T18:18:03.318 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.uxfvgZx3Ot 2021-12-17T18:18:03.336 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.uxfvgZx3Ot is 37B 2021-12-17T18:18:03.350 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.uxfvgZx3Ot 2021-12-17T18:18:03.356 DEBUG:teuthology.orchestra.run.smithi109:> mktemp 2021-12-17T18:18:03.363 INFO:teuthology.orchestra.run.smithi109.stdout:/tmp/tmp.c58VQQyruF 2021-12-17T18:18:03.364 DEBUG:teuthology.orchestra.run.smithi109:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.c58VQQyruF 2021-12-17T18:18:03.381 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod 0666 /tmp/tmp.c58VQQyruF 2021-12-17T18:18:03.449 DEBUG:teuthology.orchestra.remote:smithi109:/tmp/tmp.c58VQQyruF is 37B 2021-12-17T18:18:03.464 DEBUG:teuthology.orchestra.run.smithi109:> rm -fr /tmp/tmp.c58VQQyruF 2021-12-17T18:18:03.469 DEBUG:teuthology.orchestra.run.smithi109:> mktemp 2021-12-17T18:18:03.520 INFO:teuthology.orchestra.run.smithi109.stdout:/tmp/tmp.470VKNg6xA 2021-12-17T18:18:03.521 DEBUG:teuthology.orchestra.run.smithi109:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.470VKNg6xA 2021-12-17T18:18:03.536 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod 0666 /tmp/tmp.470VKNg6xA 2021-12-17T18:18:03.606 DEBUG:teuthology.orchestra.remote:smithi109:/tmp/tmp.470VKNg6xA is 37B 2021-12-17T18:18:03.621 DEBUG:teuthology.orchestra.run.smithi109:> rm -fr /tmp/tmp.470VKNg6xA 2021-12-17T18:18:03.627 DEBUG:teuthology.orchestra.run.smithi109:> mktemp 2021-12-17T18:18:03.632 INFO:teuthology.orchestra.run.smithi109.stdout:/tmp/tmp.87GLLGuAi5 2021-12-17T18:18:03.632 DEBUG:teuthology.orchestra.run.smithi109:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.87GLLGuAi5 2021-12-17T18:18:03.649 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod 0666 /tmp/tmp.87GLLGuAi5 2021-12-17T18:18:03.715 DEBUG:teuthology.orchestra.remote:smithi109:/tmp/tmp.87GLLGuAi5 is 37B 2021-12-17T18:18:03.728 DEBUG:teuthology.orchestra.run.smithi109:> rm -fr /tmp/tmp.87GLLGuAi5 2021-12-17T18:18:03.734 DEBUG:teuthology.orchestra.run.smithi109:> mktemp 2021-12-17T18:18:03.781 INFO:teuthology.orchestra.run.smithi109.stdout:/tmp/tmp.QgHyGvHDQ3 2021-12-17T18:18:03.781 DEBUG:teuthology.orchestra.run.smithi109:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.QgHyGvHDQ3 2021-12-17T18:18:03.798 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod 0666 /tmp/tmp.QgHyGvHDQ3 2021-12-17T18:18:03.861 DEBUG:teuthology.orchestra.remote:smithi109:/tmp/tmp.QgHyGvHDQ3 is 37B 2021-12-17T18:18:03.876 DEBUG:teuthology.orchestra.run.smithi109:> rm -fr /tmp/tmp.QgHyGvHDQ3 2021-12-17T18:18:03.882 DEBUG:teuthology.orchestra.run.smithi109:> sudo ceph --cluster ceph osd new c51e75ac-d8f3-4558-b672-587f12786690 0 2021-12-17T18:18:03.982 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.976+0000 7f49ba15b700 1 Processor -- start 2021-12-17T18:18:03.983 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.976+0000 7f49ba15b700 1 -- start start 2021-12-17T18:18:03.986 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49ba15b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49b40b6820 0x7f49b40b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:03.987 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49ba15b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f49b4063f40 0x7f49b4143b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:03.987 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49ba15b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f49b4144080 0x7f49b4128ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:03.987 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49ba15b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b41434c0 con 0x7f49b4063f40 2021-12-17T18:18:03.987 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49ba15b700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b40b6c00 con 0x7f49b4144080 2021-12-17T18:18:03.988 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49ba15b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b41436f0 con 0x7f49b40b6820 2021-12-17T18:18:03.988 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49b995a700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f49b4144080 0x7f49b4128ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:03.988 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49b995a700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f49b4144080 0x7f49b4128ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.109:56730/0 (socket says 172.21.15.109:56730) 2021-12-17T18:18:03.988 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49b995a700 1 -- 172.21.15.109:0/3018841635 learned_addr learned my addr 172.21.15.109:0/3018841635 (peer_addr_for_me v2:172.21.15.109:0/0) 2021-12-17T18:18:03.989 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49b9159700 1 --2- 172.21.15.109:0/3018841635 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49b40b6820 0x7f49b40b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:03.989 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49b8958700 1 --2- 172.21.15.109:0/3018841635 >> v2:172.21.15.62:3300/0 conn(0x7f49b4063f40 0x7f49b4143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:03.989 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49b995a700 1 -- 172.21.15.109:0/3018841635 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49b40b6820 msgr2=0x7f49b40b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:03.989 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49b995a700 1 --2- 172.21.15.109:0/3018841635 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49b40b6820 0x7f49b40b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:03.990 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49b995a700 1 -- 172.21.15.109:0/3018841635 >> v2:172.21.15.62:3300/0 conn(0x7f49b4063f40 msgr2=0x7f49b4143b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:03.990 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49b995a700 1 --2- 172.21.15.109:0/3018841635 >> v2:172.21.15.62:3300/0 conn(0x7f49b4063f40 0x7f49b4143b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:03.990 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49b995a700 1 -- 172.21.15.109:0/3018841635 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b4141010 con 0x7f49b4144080 2021-12-17T18:18:03.990 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49b995a700 1 --2- 172.21.15.109:0/3018841635 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f49b4144080 0x7f49b4128ba0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f49ac0032f0 tx=0x7f49ac009290).ready entity=mon.1 client_cookie=8e2b07fe9d89e870 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:03.991 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49a3fff700 1 -- 172.21.15.109:0/3018841635 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49ac00b870 con 0x7f49b4144080 2021-12-17T18:18:03.991 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49a3fff700 1 -- 172.21.15.109:0/3018841635 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac00b9d0 con 0x7f49b4144080 2021-12-17T18:18:03.991 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49a3fff700 1 -- 172.21.15.109:0/3018841635 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49ac00bb40 con 0x7f49b4144080 2021-12-17T18:18:03.991 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49ba15b700 1 -- 172.21.15.109:0/3018841635 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f49b4144080 msgr2=0x7f49b4128ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:03.992 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49ba15b700 1 --2- 172.21.15.109:0/3018841635 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f49b4144080 0x7f49b4128ba0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f49ac0032f0 tx=0x7f49ac009290).stop 2021-12-17T18:18:03.992 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49ba15b700 1 -- 172.21.15.109:0/3018841635 shutdown_connections 2021-12-17T18:18:03.992 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49ba15b700 1 --2- 172.21.15.109:0/3018841635 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f49b4144080 0x7f49b4128ba0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:03.992 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49ba15b700 1 --2- 172.21.15.109:0/3018841635 >> v2:172.21.15.62:3300/0 conn(0x7f49b4063f40 0x7f49b4143b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:03.993 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49ba15b700 1 --2- 172.21.15.109:0/3018841635 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49b40b6820 0x7f49b40b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:03.993 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49ba15b700 1 -- 172.21.15.109:0/3018841635 >> 172.21.15.109:0/3018841635 conn(0x7f49b40625b0 msgr2=0x7f49b4063620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:03.993 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49ba15b700 1 -- 172.21.15.109:0/3018841635 shutdown_connections 2021-12-17T18:18:03.993 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.980+0000 7f49ba15b700 1 -- 172.21.15.109:0/3018841635 wait complete. 2021-12-17T18:18:03.997 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49ba15b700 1 Processor -- start 2021-12-17T18:18:03.997 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49ba15b700 1 -- start start 2021-12-17T18:18:03.997 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49ba15b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49b4063f40 0x7f49b4141320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:03.997 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49ba15b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f49b40b6820 0x7f49b40af980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:03.998 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49ba15b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49b4144080 0x7f49b4153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:03.998 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49ba15b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b4153930 con 0x7f49b4063f40 2021-12-17T18:18:03.998 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49ba15b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b4129cc0 con 0x7f49b40b6820 2021-12-17T18:18:03.998 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49ba15b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b40afe70 con 0x7f49b4144080 2021-12-17T18:18:03.998 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49b8958700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f49b40b6820 0x7f49b40af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:03.999 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49b995a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49b4144080 0x7f49b4153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:03.999 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49b8958700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f49b40b6820 0x7f49b40af980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.109:56736/0 (socket says 172.21.15.109:56736) 2021-12-17T18:18:03.999 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49b8958700 1 -- 172.21.15.109:0/3776876676 learned_addr learned my addr 172.21.15.109:0/3776876676 (peer_addr_for_me v2:172.21.15.109:0/0) 2021-12-17T18:18:03.999 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49b9159700 1 --2- 172.21.15.109:0/3776876676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49b4063f40 0x7f49b4141320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.000 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49b8958700 1 -- 172.21.15.109:0/3776876676 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49b4144080 msgr2=0x7f49b4153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.000 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49b8958700 1 --2- 172.21.15.109:0/3776876676 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49b4144080 0x7f49b4153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.000 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49b8958700 1 -- 172.21.15.109:0/3776876676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49b4063f40 msgr2=0x7f49b4141320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.000 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49b8958700 1 --2- 172.21.15.109:0/3776876676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49b4063f40 0x7f49b4141320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.001 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49b8958700 1 -- 172.21.15.109:0/3776876676 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac009530 con 0x7f49b40b6820 2021-12-17T18:18:04.001 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49b995a700 1 --2- 172.21.15.109:0/3776876676 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49b4144080 0x7f49b4153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:04.001 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49b8958700 1 --2- 172.21.15.109:0/3776876676 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f49b40b6820 0x7f49b40af980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f49a40030b0 tx=0x7f49a4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:04.001 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49a27fc700 1 -- 172.21.15.109:0/3776876676 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49a4011780 con 0x7f49b40b6820 2021-12-17T18:18:04.001 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49ba15b700 1 -- 172.21.15.109:0/3776876676 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b4129f90 con 0x7f49b40b6820 2021-12-17T18:18:04.002 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49a27fc700 1 -- 172.21.15.109:0/3776876676 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a40118e0 con 0x7f49b40b6820 2021-12-17T18:18:04.002 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49ba15b700 1 -- 172.21.15.109:0/3776876676 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b4146470 con 0x7f49b40b6820 2021-12-17T18:18:04.002 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49a27fc700 1 -- 172.21.15.109:0/3776876676 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49a4011c40 con 0x7f49b40b6820 2021-12-17T18:18:04.002 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49a27fc700 1 -- 172.21.15.109:0/3776876676 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f49a40061f0 con 0x7f49b40b6820 2021-12-17T18:18:04.003 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.984+0000 7f49a27fc700 1 -- 172.21.15.109:0/3776876676 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f49a4005a60 con 0x7f49b40b6820 2021-12-17T18:18:04.003 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.988+0000 7f49ba15b700 1 -- 172.21.15.109:0/3776876676 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b4146780 con 0x7f49b40b6820 2021-12-17T18:18:04.003 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:03.992+0000 7f49a27fc700 1 -- 172.21.15.109:0/3776876676 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f49a4005cf0 con 0x7f49b40b6820 2021-12-17T18:18:04.062 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.056+0000 7f49ba15b700 1 -- 172.21.15.109:0/3776876676 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", "id": 0} v 0) v1 -- 0x7f49b40573d0 con 0x7f49b40b6820 2021-12-17T18:18:04.070 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.064+0000 7f49a27fc700 1 -- 172.21.15.109:0/3776876676 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f49a402a0b0 con 0x7f49b40b6820 2021-12-17T18:18:04.070 INFO:teuthology.orchestra.run.smithi109.stdout:0 2021-12-17T18:18:04.072 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.068+0000 7f49ba15b700 1 -- 172.21.15.109:0/3776876676 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f49b40b6820 msgr2=0x7f49b40af980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.073 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.068+0000 7f49ba15b700 1 --2- 172.21.15.109:0/3776876676 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f49b40b6820 0x7f49b40af980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f49a40030b0 tx=0x7f49a4008040).stop 2021-12-17T18:18:04.073 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.068+0000 7f49ba15b700 1 -- 172.21.15.109:0/3776876676 shutdown_connections 2021-12-17T18:18:04.073 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.068+0000 7f49ba15b700 1 --2- 172.21.15.109:0/3776876676 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49b4144080 0x7f49b4153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.073 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.068+0000 7f49ba15b700 1 --2- 172.21.15.109:0/3776876676 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f49b40b6820 0x7f49b40af980 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.074 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.068+0000 7f49ba15b700 1 --2- 172.21.15.109:0/3776876676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49b4063f40 0x7f49b4141320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.074 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.068+0000 7f49ba15b700 1 -- 172.21.15.109:0/3776876676 >> 172.21.15.109:0/3776876676 conn(0x7f49b40625b0 msgr2=0x7f49b4127f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:04.074 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.068+0000 7f49ba15b700 1 -- 172.21.15.109:0/3776876676 shutdown_connections 2021-12-17T18:18:04.075 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.068+0000 7f49ba15b700 1 -- 172.21.15.109:0/3776876676 wait complete. 2021-12-17T18:18:04.087 DEBUG:teuthology.orchestra.run.smithi109:> sudo ceph --cluster ceph osd new 886ecd5b-c84b-4b74-a0ac-52eb120d0da6 1 2021-12-17T18:18:04.188 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147ffff700 1 Processor -- start 2021-12-17T18:18:04.188 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147ffff700 1 -- start start 2021-12-17T18:18:04.192 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14800b6820 0x7f14800b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.192 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1480128ba0 0x7f1480128fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.192 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147ffff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14801434c0 con 0x7f1480063f40 2021-12-17T18:18:04.193 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147ffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14800b6c00 con 0x7f1480128ba0 2021-12-17T18:18:04.193 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147ffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14801436f0 con 0x7f14800b6820 2021-12-17T18:18:04.193 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147e7fc700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f1480063f40 0x7f1480143b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.109:38938/0 (socket says 172.21.15.109:38938) 2021-12-17T18:18:04.193 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147e7fc700 1 -- 172.21.15.109:0/2271936158 learned_addr learned my addr 172.21.15.109:0/2271936158 (peer_addr_for_me v1:172.21.15.109:0/0) 2021-12-17T18:18:04.194 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147effd700 1 --2- 172.21.15.109:0/2271936158 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14800b6820 0x7f14800b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.194 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147f7fe700 1 --2- 172.21.15.109:0/2271936158 >> v2:172.21.15.62:3300/0 conn(0x7f1480128ba0 0x7f1480128fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.194 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147dffb700 1 -- 172.21.15.109:0/2271936158 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865734942 0 0) 0x7f14801434c0 con 0x7f1480063f40 2021-12-17T18:18:04.194 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147dffb700 1 -- 172.21.15.109:0/2271936158 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1464003260 con 0x7f1480063f40 2021-12-17T18:18:04.195 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147effd700 1 -- 172.21.15.109:0/2271936158 >> v2:172.21.15.62:3300/0 conn(0x7f1480128ba0 msgr2=0x7f1480128fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:04.195 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147effd700 1 --2- 172.21.15.109:0/2271936158 >> v2:172.21.15.62:3300/0 conn(0x7f1480128ba0 0x7f1480128fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.195 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147effd700 1 -- 172.21.15.109:0/2271936158 >> v1:172.21.15.109:6789/0 conn(0x7f1480063f40 legacy=0x7f1480143b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.195 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147effd700 1 -- 172.21.15.109:0/2271936158 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1480141010 con 0x7f14800b6820 2021-12-17T18:18:04.196 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147effd700 1 --2- 172.21.15.109:0/2271936158 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14800b6820 0x7f14800b0ef0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f14780032f0 tx=0x7f14780091d0).ready entity=mon.2 client_cookie=16ca98df42cae823 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:04.196 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147dffb700 1 -- 172.21.15.109:0/2271936158 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f147800b600 con 0x7f14800b6820 2021-12-17T18:18:04.196 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147dffb700 1 -- 172.21.15.109:0/2271936158 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147800b760 con 0x7f14800b6820 2021-12-17T18:18:04.196 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147dffb700 1 -- 172.21.15.109:0/2271936158 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f147800b8d0 con 0x7f14800b6820 2021-12-17T18:18:04.196 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147ffff700 1 -- 172.21.15.109:0/2271936158 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14800b6820 msgr2=0x7f14800b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.197 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147ffff700 1 --2- 172.21.15.109:0/2271936158 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14800b6820 0x7f14800b0ef0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f14780032f0 tx=0x7f14780091d0).stop 2021-12-17T18:18:04.197 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147ffff700 1 -- 172.21.15.109:0/2271936158 shutdown_connections 2021-12-17T18:18:04.197 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147ffff700 1 --2- 172.21.15.109:0/2271936158 >> v2:172.21.15.62:3300/0 conn(0x7f1480128ba0 0x7f1480128fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.197 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147ffff700 1 --2- 172.21.15.109:0/2271936158 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14800b6820 0x7f14800b0ef0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.198 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147ffff700 1 -- 172.21.15.109:0/2271936158 >> 172.21.15.109:0/2271936158 conn(0x7f14800625b0 msgr2=0x7f1480063620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:04.198 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147ffff700 1 -- 172.21.15.109:0/2271936158 shutdown_connections 2021-12-17T18:18:04.198 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.184+0000 7f147ffff700 1 -- 172.21.15.109:0/2271936158 wait complete. 2021-12-17T18:18:04.198 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147ffff700 1 Processor -- start 2021-12-17T18:18:04.199 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147ffff700 1 -- start start 2021-12-17T18:18:04.202 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147ffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1480063f40 0x7f1480122e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.202 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14800b6820 0x7f1480125a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.202 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1480128ba0 0x7f1480125f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.203 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1480124ce0 con 0x7f1480128ba0 2021-12-17T18:18:04.203 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147ffff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14800af5c0 con 0x7f1480063f40 2021-12-17T18:18:04.203 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147ffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1480123520 con 0x7f14800b6820 2021-12-17T18:18:04.203 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147effd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1480063f40 0x7f1480122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.204 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147e7fc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14800b6820 0x7f1480125a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.204 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147effd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1480063f40 0x7f1480122e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.109:56746/0 (socket says 172.21.15.109:56746) 2021-12-17T18:18:04.204 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147effd700 1 -- 172.21.15.109:0/201136352 learned_addr learned my addr 172.21.15.109:0/201136352 (peer_addr_for_me v2:172.21.15.109:0/0) 2021-12-17T18:18:04.204 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147f7fe700 1 --2- 172.21.15.109:0/201136352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1480128ba0 0x7f1480125f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.205 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147e7fc700 1 -- 172.21.15.109:0/201136352 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1480063f40 msgr2=0x7f1480122e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.205 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147e7fc700 1 --2- 172.21.15.109:0/201136352 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1480063f40 0x7f1480122e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.205 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147e7fc700 1 -- 172.21.15.109:0/201136352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1480128ba0 msgr2=0x7f1480125f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.205 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147e7fc700 1 --2- 172.21.15.109:0/201136352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1480128ba0 0x7f1480125f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.206 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147e7fc700 1 -- 172.21.15.109:0/201136352 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1478009470 con 0x7f14800b6820 2021-12-17T18:18:04.206 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147e7fc700 1 --2- 172.21.15.109:0/201136352 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14800b6820 0x7f1480125a30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f14800af8d0 tx=0x7f1474007a20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:04.206 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f146ffff700 1 -- 172.21.15.109:0/201136352 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14740070d0 con 0x7f14800b6820 2021-12-17T18:18:04.206 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f146ffff700 1 -- 172.21.15.109:0/201136352 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1474007230 con 0x7f14800b6820 2021-12-17T18:18:04.206 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147ffff700 1 -- 172.21.15.109:0/201136352 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1480124300 con 0x7f14800b6820 2021-12-17T18:18:04.207 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f146ffff700 1 -- 172.21.15.109:0/201136352 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1474005610 con 0x7f14800b6820 2021-12-17T18:18:04.207 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f147ffff700 1 -- 172.21.15.109:0/201136352 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148013f600 con 0x7f14800b6820 2021-12-17T18:18:04.207 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f146ffff700 1 -- 172.21.15.109:0/201136352 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f147401a060 con 0x7f14800b6820 2021-12-17T18:18:04.207 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.188+0000 7f146ffff700 1 -- 172.21.15.109:0/201136352 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f1474013450 con 0x7f14800b6820 2021-12-17T18:18:04.208 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.192+0000 7f147ffff700 1 -- 172.21.15.109:0/201136352 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14800b0460 con 0x7f14800b6820 2021-12-17T18:18:04.208 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.196+0000 7f146ffff700 1 -- 172.21.15.109:0/201136352 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f14800b0460 con 0x7f14800b6820 2021-12-17T18:18:04.267 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.264+0000 7f147ffff700 1 -- 172.21.15.109:0/201136352 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd new", "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", "id": 1} v 0) v1 -- 0x7f1480123350 con 0x7f14800b6820 2021-12-17T18:18:04.278 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.272+0000 7f146ffff700 1 -- 172.21.15.109:0/201136352 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1474018070 con 0x7f14800b6820 2021-12-17T18:18:04.279 INFO:teuthology.orchestra.run.smithi109.stdout:1 2021-12-17T18:18:04.280 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.276+0000 7f147ffff700 1 -- 172.21.15.109:0/201136352 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14800b6820 msgr2=0x7f1480125a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.281 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.276+0000 7f147ffff700 1 --2- 172.21.15.109:0/201136352 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14800b6820 0x7f1480125a30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f14800af8d0 tx=0x7f1474007a20).stop 2021-12-17T18:18:04.281 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.276+0000 7f147ffff700 1 -- 172.21.15.109:0/201136352 shutdown_connections 2021-12-17T18:18:04.281 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.276+0000 7f147ffff700 1 --2- 172.21.15.109:0/201136352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1480128ba0 0x7f1480125f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.281 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.276+0000 7f147ffff700 1 --2- 172.21.15.109:0/201136352 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14800b6820 0x7f1480125a30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.281 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.276+0000 7f147ffff700 1 --2- 172.21.15.109:0/201136352 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1480063f40 0x7f1480122e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.282 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.276+0000 7f147ffff700 1 -- 172.21.15.109:0/201136352 >> 172.21.15.109:0/201136352 conn(0x7f14800625b0 msgr2=0x7f14801400e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:04.282 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.276+0000 7f147ffff700 1 -- 172.21.15.109:0/201136352 shutdown_connections 2021-12-17T18:18:04.282 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.276+0000 7f147ffff700 1 -- 172.21.15.109:0/201136352 wait complete. 2021-12-17T18:18:04.294 DEBUG:teuthology.orchestra.run.smithi109:> sudo ceph --cluster ceph osd new cdcbd8f0-be3e-4fff-8b63-62f30371135a 2 2021-12-17T18:18:04.391 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.384+0000 7f35f759e700 1 Processor -- start 2021-12-17T18:18:04.392 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.384+0000 7f35f759e700 1 -- start start 2021-12-17T18:18:04.401 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f35f80b6820 0x7f35f81430f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.402 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f8064050 con 0x7f35f8064940 2021-12-17T18:18:04.402 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f759e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f80b6c00 con 0x7f35f8140040 2021-12-17T18:18:04.402 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f80654e0 con 0x7f35f80b6820 2021-12-17T18:18:04.402 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f5d9b700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f35f8140040 0x7f35f81404f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.109:38950/0 (socket says 172.21.15.109:38950) 2021-12-17T18:18:04.403 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f5d9b700 1 -- 172.21.15.109:0/3221707919 learned_addr learned my addr 172.21.15.109:0/3221707919 (peer_addr_for_me v1:172.21.15.109:0/0) 2021-12-17T18:18:04.403 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f659c700 1 --2- 172.21.15.109:0/3221707919 >> v2:172.21.15.62:3300/0 conn(0x7f35f80b6820 0x7f35f81430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.403 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 -- 172.21.15.109:0/3221707919 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3644730902 0 0) 0x7f35f80b6c00 con 0x7f35f8140040 2021-12-17T18:18:04.403 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 -- 172.21.15.109:0/3221707919 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35dc003260 con 0x7f35f8140040 2021-12-17T18:18:04.404 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 -- 172.21.15.109:0/3221707919 <== mon.1 v1:172.21.15.109:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2399612208 0 0) 0x7f35dc003260 con 0x7f35f8140040 2021-12-17T18:18:04.404 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 -- 172.21.15.109:0/3221707919 >> v2:172.21.15.62:3300/0 conn(0x7f35f80b6820 msgr2=0x7f35f81430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:04.404 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 --2- 172.21.15.109:0/3221707919 >> v2:172.21.15.62:3300/0 conn(0x7f35f80b6820 0x7f35f81430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.405 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 -- 172.21.15.109:0/3221707919 >> v1:172.21.15.62:6789/0 conn(0x7f35f8064940 legacy=0x7f35f8064dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.405 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 -- 172.21.15.109:0/3221707919 --> v1:172.21.15.109:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f805f9d0 con 0x7f35f8140040 2021-12-17T18:18:04.405 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 -- 172.21.15.109:0/3221707919 <== mon.1 v1:172.21.15.109:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f35ec001660 con 0x7f35f8140040 2021-12-17T18:18:04.405 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 -- 172.21.15.109:0/3221707919 >> v1:172.21.15.109:6789/0 conn(0x7f35f8140040 legacy=0x7f35f81404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.406 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 --2- 172.21.15.109:0/3221707919 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35dc003750 0x7f35dc003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.406 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 --2- 172.21.15.109:0/3221707919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35dc004500 0x7f35dc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.406 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 --2- 172.21.15.109:0/3221707919 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35dc004e70 0x7f35dc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.406 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 -- 172.21.15.109:0/3221707919 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f80654e0 con 0x7f35dc004500 2021-12-17T18:18:04.407 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 -- 172.21.15.109:0/3221707919 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc00bc70 con 0x7f35dc004e70 2021-12-17T18:18:04.407 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 -- 172.21.15.109:0/3221707919 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc00be30 con 0x7f35dc003750 2021-12-17T18:18:04.407 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f659c700 1 --2- 172.21.15.109:0/3221707919 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35dc003750 0x7f35dc003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.407 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f6d9d700 1 --2- 172.21.15.109:0/3221707919 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35dc004e70 0x7f35dc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.408 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f5d9b700 1 --2- 172.21.15.109:0/3221707919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35dc004500 0x7f35dc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.408 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f6d9d700 1 -- 172.21.15.109:0/3221707919 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35dc003750 msgr2=0x7f35dc003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:04.408 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f6d9d700 1 --2- 172.21.15.109:0/3221707919 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35dc003750 0x7f35dc003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.408 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f6d9d700 1 -- 172.21.15.109:0/3221707919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35dc004500 msgr2=0x7f35dc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:04.409 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f6d9d700 1 --2- 172.21.15.109:0/3221707919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35dc004500 0x7f35dc004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.409 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f6d9d700 1 -- 172.21.15.109:0/3221707919 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc003260 con 0x7f35dc004e70 2021-12-17T18:18:04.409 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f659c700 1 --2- 172.21.15.109:0/3221707919 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35dc003750 0x7f35dc003b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:04.409 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f6d9d700 1 -- 172.21.15.109:0/3221707919 reap_dead start 2021-12-17T18:18:04.410 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f6d9d700 1 --2- 172.21.15.109:0/3221707919 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35dc004e70 0x7f35dc00b750 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f35f00013a0 tx=0x7f35f0007d60).ready entity=mon.1 client_cookie=85b2f899baf4bd8e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:04.410 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 -- 172.21.15.109:0/3221707919 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35f00016c0 con 0x7f35dc004e70 2021-12-17T18:18:04.410 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 -- 172.21.15.109:0/3221707919 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f0006890 con 0x7f35dc004e70 2021-12-17T18:18:04.410 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f559a700 1 -- 172.21.15.109:0/3221707919 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35f0006bf0 con 0x7f35dc004e70 2021-12-17T18:18:04.411 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f759e700 1 -- 172.21.15.109:0/3221707919 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35dc004e70 msgr2=0x7f35dc00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.411 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f759e700 1 --2- 172.21.15.109:0/3221707919 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35dc004e70 0x7f35dc00b750 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f35f00013a0 tx=0x7f35f0007d60).stop 2021-12-17T18:18:04.411 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f759e700 1 -- 172.21.15.109:0/3221707919 shutdown_connections 2021-12-17T18:18:04.411 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f759e700 1 --2- 172.21.15.109:0/3221707919 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35dc004e70 0x7f35dc00b750 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.412 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f759e700 1 -- 172.21.15.109:0/3221707919 >> 172.21.15.109:0/3221707919 conn(0x7f35f80625b0 msgr2=0x7f35f8063620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:04.412 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f759e700 1 -- 172.21.15.109:0/3221707919 shutdown_connections 2021-12-17T18:18:04.412 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.388+0000 7f35f759e700 1 -- 172.21.15.109:0/3221707919 wait complete. 2021-12-17T18:18:04.412 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f759e700 1 Processor -- start 2021-12-17T18:18:04.413 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f759e700 1 -- start start 2021-12-17T18:18:04.413 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35dc004e70 0x7f35f81491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.413 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35f80aee90 0x7f35f8141370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.413 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35f80b0060 0x7f35f80b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.414 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f80b09d0 con 0x7f35f80b0060 2021-12-17T18:18:04.414 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f80ad950 con 0x7f35dc004e70 2021-12-17T18:18:04.414 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f80adbf0 con 0x7f35f80aee90 2021-12-17T18:18:04.414 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f5d9b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35f80aee90 0x7f35f8141370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.414 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f659c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35dc004e70 0x7f35f81491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.415 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f5d9b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35f80aee90 0x7f35f8141370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.109:43174/0 (socket says 172.21.15.109:43174) 2021-12-17T18:18:04.415 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f5d9b700 1 -- 172.21.15.109:0/1857675919 learned_addr learned my addr 172.21.15.109:0/1857675919 (peer_addr_for_me v2:172.21.15.109:0/0) 2021-12-17T18:18:04.415 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f659c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35dc004e70 0x7f35f81491f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.109:56764/0 (socket says 172.21.15.109:56764) 2021-12-17T18:18:04.416 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f6d9d700 1 --2- 172.21.15.109:0/1857675919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35f80b0060 0x7f35f80b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.416 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f5d9b700 1 -- 172.21.15.109:0/1857675919 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35dc004e70 msgr2=0x7f35f81491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.416 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f5d9b700 1 --2- 172.21.15.109:0/1857675919 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35dc004e70 0x7f35f81491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.416 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f5d9b700 1 -- 172.21.15.109:0/1857675919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35f80b0060 msgr2=0x7f35f80b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.417 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f5d9b700 1 --2- 172.21.15.109:0/1857675919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35f80b0060 0x7f35f80b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.417 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f5d9b700 1 -- 172.21.15.109:0/1857675919 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f80ade90 con 0x7f35f80aee90 2021-12-17T18:18:04.417 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f5d9b700 1 --2- 172.21.15.109:0/1857675919 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35f80aee90 0x7f35f8141370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f35f80b0b10 tx=0x7f35f81435e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:04.417 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35e77fe700 1 -- 172.21.15.109:0/1857675919 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35ec0116b0 con 0x7f35f80aee90 2021-12-17T18:18:04.418 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35e77fe700 1 -- 172.21.15.109:0/1857675919 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec011810 con 0x7f35f80aee90 2021-12-17T18:18:04.418 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35f759e700 1 -- 172.21.15.109:0/1857675919 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f80af2f0 con 0x7f35f80aee90 2021-12-17T18:18:04.418 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.392+0000 7f35e77fe700 1 -- 172.21.15.109:0/1857675919 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35ec011b70 con 0x7f35f80aee90 2021-12-17T18:18:04.418 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.396+0000 7f35f759e700 1 -- 172.21.15.109:0/1857675919 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f8141860 con 0x7f35f80aee90 2021-12-17T18:18:04.419 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.396+0000 7f35e77fe700 1 -- 172.21.15.109:0/1857675919 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f35ec01b030 con 0x7f35f80aee90 2021-12-17T18:18:04.419 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.396+0000 7f35e77fe700 1 -- 172.21.15.109:0/1857675919 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f35ec01d800 con 0x7f35f80aee90 2021-12-17T18:18:04.419 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.396+0000 7f35f759e700 1 -- 172.21.15.109:0/1857675919 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f80ae020 con 0x7f35f80aee90 2021-12-17T18:18:04.420 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.400+0000 7f35e77fe700 1 -- 172.21.15.109:0/1857675919 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f35ec019070 con 0x7f35f80aee90 2021-12-17T18:18:04.468 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.464+0000 7f35f759e700 1 -- 172.21.15.109:0/1857675919 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", "id": 2} v 0) v1 -- 0x7f35f80573d0 con 0x7f35f80aee90 2021-12-17T18:18:04.477 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.472+0000 7f35e77fe700 1 -- 172.21.15.109:0/1857675919 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f35ec01d3b0 con 0x7f35f80aee90 2021-12-17T18:18:04.478 INFO:teuthology.orchestra.run.smithi109.stdout:2 2021-12-17T18:18:04.479 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.472+0000 7f35f759e700 1 -- 172.21.15.109:0/1857675919 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35f80aee90 msgr2=0x7f35f8141370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.479 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.472+0000 7f35f759e700 1 --2- 172.21.15.109:0/1857675919 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35f80aee90 0x7f35f8141370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f35f80b0b10 tx=0x7f35f81435e0).stop 2021-12-17T18:18:04.480 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.472+0000 7f35f759e700 1 -- 172.21.15.109:0/1857675919 shutdown_connections 2021-12-17T18:18:04.480 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.472+0000 7f35f759e700 1 --2- 172.21.15.109:0/1857675919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35f80b0060 0x7f35f80b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.480 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.472+0000 7f35f759e700 1 --2- 172.21.15.109:0/1857675919 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35f80aee90 0x7f35f8141370 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.480 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.472+0000 7f35f759e700 1 --2- 172.21.15.109:0/1857675919 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35dc004e70 0x7f35f81491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.481 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.472+0000 7f35f759e700 1 -- 172.21.15.109:0/1857675919 >> 172.21.15.109:0/1857675919 conn(0x7f35f80625b0 msgr2=0x7f35f8065620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:04.481 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.472+0000 7f35f759e700 1 -- 172.21.15.109:0/1857675919 shutdown_connections 2021-12-17T18:18:04.481 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.472+0000 7f35f759e700 1 -- 172.21.15.109:0/1857675919 wait complete. 2021-12-17T18:18:04.489 DEBUG:teuthology.orchestra.run.smithi109:> sudo ceph --cluster ceph osd new 80f42567-d96d-4bb0-81d4-4030752e3935 3 2021-12-17T18:18:04.588 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70fa9b4700 1 Processor -- start 2021-12-17T18:18:04.589 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70fa9b4700 1 -- start start 2021-12-17T18:18:04.592 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70fa9b4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70f4067830 0x7f70f40b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.592 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70fa9b4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f70f40b0140 0x7f70f4142500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.593 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70fa9b4700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f4067c10 con 0x7f70f40b06a0 2021-12-17T18:18:04.593 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70fa9b4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f40af760 con 0x7f70f40b0140 2021-12-17T18:18:04.593 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70fa9b4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f40afa00 con 0x7f70f4067830 2021-12-17T18:18:04.593 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70f99b2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70f4067830 0x7f70f40b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.594 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70f99b2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70f4067830 0x7f70f40b2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.109:43178/0 (socket says 172.21.15.109:43178) 2021-12-17T18:18:04.594 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70fa1b3700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f70f40b06a0 0x7f70f41429f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.109:38968/0 (socket says 172.21.15.109:38968) 2021-12-17T18:18:04.594 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70f99b2700 1 -- 172.21.15.109:0/3149739583 learned_addr learned my addr 172.21.15.109:0/3149739583 (peer_addr_for_me v2:172.21.15.109:0/0) 2021-12-17T18:18:04.594 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70f91b1700 1 --2- 172.21.15.109:0/3149739583 >> v2:172.21.15.62:3300/0 conn(0x7f70f40b0140 0x7f70f4142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.595 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70f89b0700 1 -- 172.21.15.109:0/3149739583 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158661386 0 0) 0x7f70f4067c10 con 0x7f70f40b06a0 2021-12-17T18:18:04.595 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70f89b0700 1 -- 172.21.15.109:0/3149739583 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70dc003260 con 0x7f70f40b06a0 2021-12-17T18:18:04.595 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70f99b2700 1 -- 172.21.15.109:0/3149739583 >> v2:172.21.15.62:3300/0 conn(0x7f70f40b0140 msgr2=0x7f70f4142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:04.595 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70f99b2700 1 --2- 172.21.15.109:0/3149739583 >> v2:172.21.15.62:3300/0 conn(0x7f70f40b0140 0x7f70f4142500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.595 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70f99b2700 1 -- 172.21.15.109:0/3149739583 >> v1:172.21.15.109:6789/0 conn(0x7f70f40b06a0 legacy=0x7f70f41429f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.596 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70f99b2700 1 -- 172.21.15.109:0/3149739583 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f40afca0 con 0x7f70f4067830 2021-12-17T18:18:04.596 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70f99b2700 1 --2- 172.21.15.109:0/3149739583 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70f4067830 0x7f70f40b2120 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f70f0002f70 tx=0x7f70f0006eb0).ready entity=mon.2 client_cookie=15787bf5dc430ec9 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:04.596 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70f89b0700 1 -- 172.21.15.109:0/3149739583 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f000d5c0 con 0x7f70f4067830 2021-12-17T18:18:04.596 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70f89b0700 1 -- 172.21.15.109:0/3149739583 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f0000e90 con 0x7f70f4067830 2021-12-17T18:18:04.598 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.584+0000 7f70f89b0700 1 -- 172.21.15.109:0/3149739583 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f000d950 con 0x7f70f4067830 2021-12-17T18:18:04.598 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.588+0000 7f70fa9b4700 1 -- 172.21.15.109:0/3149739583 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70f4067830 msgr2=0x7f70f40b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.598 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.588+0000 7f70fa9b4700 1 --2- 172.21.15.109:0/3149739583 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70f4067830 0x7f70f40b2120 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f70f0002f70 tx=0x7f70f0006eb0).stop 2021-12-17T18:18:04.598 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.588+0000 7f70fa9b4700 1 -- 172.21.15.109:0/3149739583 shutdown_connections 2021-12-17T18:18:04.599 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.588+0000 7f70fa9b4700 1 --2- 172.21.15.109:0/3149739583 >> v2:172.21.15.62:3300/0 conn(0x7f70f40b0140 0x7f70f4142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.599 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.588+0000 7f70fa9b4700 1 --2- 172.21.15.109:0/3149739583 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70f4067830 0x7f70f40b2120 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.599 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.588+0000 7f70fa9b4700 1 -- 172.21.15.109:0/3149739583 >> 172.21.15.109:0/3149739583 conn(0x7f70f405caf0 msgr2=0x7f70f405cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:04.599 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.588+0000 7f70fa9b4700 1 -- 172.21.15.109:0/3149739583 shutdown_connections 2021-12-17T18:18:04.600 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.588+0000 7f70fa9b4700 1 -- 172.21.15.109:0/3149739583 wait complete. 2021-12-17T18:18:04.603 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.588+0000 7f70fa9b4700 1 Processor -- start 2021-12-17T18:18:04.603 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.588+0000 7f70fa9b4700 1 -- start start 2021-12-17T18:18:04.604 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.588+0000 7f70fa9b4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70f4067830 0x7f70f4155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.604 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.588+0000 7f70fa9b4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70f40b0140 0x7f70f4148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.604 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.588+0000 7f70fa9b4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f70f40b06a0 0x7f70f409eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.604 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.588+0000 7f70fa9b4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f413fde0 con 0x7f70f40b0140 2021-12-17T18:18:04.605 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.588+0000 7f70fa9b4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f4140550 con 0x7f70f40b06a0 2021-12-17T18:18:04.605 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.588+0000 7f70fa9b4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f4140010 con 0x7f70f4067830 2021-12-17T18:18:04.605 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70fa1b3700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f70f40b06a0 0x7f70f409eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.606 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70f99b2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70f4067830 0x7f70f4155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.606 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70fa1b3700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f70f40b06a0 0x7f70f409eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.109:56780/0 (socket says 172.21.15.109:56780) 2021-12-17T18:18:04.606 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70f99b2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70f4067830 0x7f70f4155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.109:43184/0 (socket says 172.21.15.109:43184) 2021-12-17T18:18:04.606 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70fa1b3700 1 -- 172.21.15.109:0/330556460 learned_addr learned my addr 172.21.15.109:0/330556460 (peer_addr_for_me v2:172.21.15.109:0/0) 2021-12-17T18:18:04.607 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70f91b1700 1 --2- 172.21.15.109:0/330556460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70f40b0140 0x7f70f4148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.607 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70f99b2700 1 -- 172.21.15.109:0/330556460 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f70f40b06a0 msgr2=0x7f70f409eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.607 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70f99b2700 1 --2- 172.21.15.109:0/330556460 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f70f40b06a0 0x7f70f409eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.607 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70f99b2700 1 -- 172.21.15.109:0/330556460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70f40b0140 msgr2=0x7f70f4148150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.608 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70f99b2700 1 --2- 172.21.15.109:0/330556460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70f40b0140 0x7f70f4148150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.608 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70f99b2700 1 -- 172.21.15.109:0/330556460 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f000b1e0 con 0x7f70f4067830 2021-12-17T18:18:04.608 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70fa1b3700 1 --2- 172.21.15.109:0/330556460 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f70f40b06a0 0x7f70f409eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:04.608 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70f99b2700 1 --2- 172.21.15.109:0/330556460 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70f4067830 0x7f70f4155810 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f70f414a280 tx=0x7f70f0015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:04.609 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70e2ffd700 1 -- 172.21.15.109:0/330556460 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f0011760 con 0x7f70f4067830 2021-12-17T18:18:04.609 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70e2ffd700 1 -- 172.21.15.109:0/330556460 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f00118c0 con 0x7f70f4067830 2021-12-17T18:18:04.609 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70fa9b4700 1 -- 172.21.15.109:0/330556460 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f41402b0 con 0x7f70f4067830 2021-12-17T18:18:04.609 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70e2ffd700 1 -- 172.21.15.109:0/330556460 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f0011c20 con 0x7f70f4067830 2021-12-17T18:18:04.610 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70fa9b4700 1 -- 172.21.15.109:0/330556460 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f413e950 con 0x7f70f4067830 2021-12-17T18:18:04.610 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70e2ffd700 1 -- 172.21.15.109:0/330556460 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f70f001a040 con 0x7f70f4067830 2021-12-17T18:18:04.610 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70e2ffd700 1 -- 172.21.15.109:0/330556460 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f70f00268b0 con 0x7f70f4067830 2021-12-17T18:18:04.610 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.592+0000 7f70fa9b4700 1 -- 172.21.15.109:0/330556460 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f413e3a0 con 0x7f70f4067830 2021-12-17T18:18:04.610 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.596+0000 7f70e2ffd700 1 -- 172.21.15.109:0/330556460 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f70f413e3a0 con 0x7f70f4067830 2021-12-17T18:18:04.663 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.660+0000 7f70fa9b4700 1 -- 172.21.15.109:0/330556460 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd new", "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", "id": 3} v 0) v1 -- 0x7f70f40573d0 con 0x7f70f4067830 2021-12-17T18:18:04.674 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.668+0000 7f70e2ffd700 1 -- 172.21.15.109:0/330556460 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f70f0026b90 con 0x7f70f4067830 2021-12-17T18:18:04.675 INFO:teuthology.orchestra.run.smithi109.stdout:3 2021-12-17T18:18:04.676 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.672+0000 7f70fa9b4700 1 -- 172.21.15.109:0/330556460 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70f4067830 msgr2=0x7f70f4155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.676 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.672+0000 7f70fa9b4700 1 --2- 172.21.15.109:0/330556460 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70f4067830 0x7f70f4155810 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f70f414a280 tx=0x7f70f0015000).stop 2021-12-17T18:18:04.677 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.672+0000 7f70fa9b4700 1 -- 172.21.15.109:0/330556460 shutdown_connections 2021-12-17T18:18:04.677 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.672+0000 7f70fa9b4700 1 --2- 172.21.15.109:0/330556460 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f70f40b06a0 0x7f70f409eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.677 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.672+0000 7f70fa9b4700 1 --2- 172.21.15.109:0/330556460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70f40b0140 0x7f70f4148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.677 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.672+0000 7f70fa9b4700 1 --2- 172.21.15.109:0/330556460 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70f4067830 0x7f70f4155810 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.678 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.672+0000 7f70fa9b4700 1 -- 172.21.15.109:0/330556460 >> 172.21.15.109:0/330556460 conn(0x7f70f405caf0 msgr2=0x7f70f41424d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:04.678 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.672+0000 7f70fa9b4700 1 -- 172.21.15.109:0/330556460 shutdown_connections 2021-12-17T18:18:04.678 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.672+0000 7f70fa9b4700 1 -- 172.21.15.109:0/330556460 wait complete. 2021-12-17T18:18:04.691 DEBUG:teuthology.orchestra.run.smithi109:> sudo ceph --cluster ceph osd new 02486a2c-1a65-460b-9d75-ed180962ba0a 4 2021-12-17T18:18:04.793 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.788+0000 7f660272b700 1 Processor -- start 2021-12-17T18:18:04.794 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.788+0000 7f660272b700 1 -- start start 2021-12-17T18:18:04.797 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.788+0000 7f660272b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f65fc05ffe0 0x7f65fc1404a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.797 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.788+0000 7f660272b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65fc144a70 0x7f65fc144f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.797 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.788+0000 7f660272b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65fc0ab0c0 con 0x7f65fc0b2be0 2021-12-17T18:18:04.797 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.788+0000 7f660272b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65fc0a97e0 con 0x7f65fc05ffe0 2021-12-17T18:18:04.798 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.788+0000 7f660272b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc1410a0 con 0x7f65fc144a70 2021-12-17T18:18:04.798 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f6600cc8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65fc144a70 0x7f65fc144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.798 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f6600cc8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65fc144a70 0x7f65fc144f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.109:43194/0 (socket says 172.21.15.109:43194) 2021-12-17T18:18:04.798 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f65fb7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f65fc0b2be0 0x7f65fc140990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.109:54772/0 (socket says 172.21.15.109:54772) 2021-12-17T18:18:04.799 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f65fbfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f65fc05ffe0 0x7f65fc1404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.799 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f6600cc8700 1 -- 172.21.15.109:0/2039301581 learned_addr learned my addr 172.21.15.109:0/2039301581 (peer_addr_for_me v2:172.21.15.109:0/0) 2021-12-17T18:18:04.799 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f6600cc8700 1 -- 172.21.15.109:0/2039301581 >> v2:172.21.15.62:3300/0 conn(0x7f65fc05ffe0 msgr2=0x7f65fc1404a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:04.799 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f6600cc8700 1 --2- 172.21.15.109:0/2039301581 >> v2:172.21.15.62:3300/0 conn(0x7f65fc05ffe0 0x7f65fc1404a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.800 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f6600cc8700 1 -- 172.21.15.109:0/2039301581 >> v1:172.21.15.62:6789/0 conn(0x7f65fc0b2be0 legacy=0x7f65fc140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.800 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f6600cc8700 1 -- 172.21.15.109:0/2039301581 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65fc0aae20 con 0x7f65fc144a70 2021-12-17T18:18:04.800 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f6600cc8700 1 --2- 172.21.15.109:0/2039301581 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65fc144a70 0x7f65fc144f20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f65f40032f0 tx=0x7f65f4009290).ready entity=mon.2 client_cookie=9b29b4ecb1a5fe36 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:04.800 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f65faffd700 1 -- 172.21.15.109:0/2039301581 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65f400b8a0 con 0x7f65fc144a70 2021-12-17T18:18:04.801 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f65faffd700 1 -- 172.21.15.109:0/2039301581 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f400ba00 con 0x7f65fc144a70 2021-12-17T18:18:04.801 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f65faffd700 1 -- 172.21.15.109:0/2039301581 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65f400bb70 con 0x7f65fc144a70 2021-12-17T18:18:04.801 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f660272b700 1 -- 172.21.15.109:0/2039301581 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65fc144a70 msgr2=0x7f65fc144f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.801 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f660272b700 1 --2- 172.21.15.109:0/2039301581 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65fc144a70 0x7f65fc144f20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f65f40032f0 tx=0x7f65f4009290).stop 2021-12-17T18:18:04.802 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f660272b700 1 -- 172.21.15.109:0/2039301581 shutdown_connections 2021-12-17T18:18:04.802 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f660272b700 1 --2- 172.21.15.109:0/2039301581 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65fc144a70 0x7f65fc144f20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.802 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f660272b700 1 --2- 172.21.15.109:0/2039301581 >> v2:172.21.15.62:3300/0 conn(0x7f65fc05ffe0 0x7f65fc1404a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.802 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f660272b700 1 -- 172.21.15.109:0/2039301581 >> 172.21.15.109:0/2039301581 conn(0x7f65fc0626d0 msgr2=0x7f65fc05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:04.802 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f660272b700 1 -- 172.21.15.109:0/2039301581 shutdown_connections 2021-12-17T18:18:04.803 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f660272b700 1 -- 172.21.15.109:0/2039301581 wait complete. 2021-12-17T18:18:04.805 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f660272b700 1 Processor -- start 2021-12-17T18:18:04.806 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f660272b700 1 -- start start 2021-12-17T18:18:04.806 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f660272b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f65fc05ffe0 0x7f65fc1417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.806 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f660272b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65fc0b2be0 0x7f65fc0b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.806 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f660272b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65fc144a70 0x7f65fc0b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.807 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f660272b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc0b4110 con 0x7f65fc144a70 2021-12-17T18:18:04.807 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f660272b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc064f50 con 0x7f65fc05ffe0 2021-12-17T18:18:04.807 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f660272b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc0adcd0 con 0x7f65fc0b2be0 2021-12-17T18:18:04.807 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f65fb7fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65fc0b2be0 0x7f65fc0b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.808 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f65fbfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f65fc05ffe0 0x7f65fc1417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.808 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f65fb7fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65fc0b2be0 0x7f65fc0b4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.109:43198/0 (socket says 172.21.15.109:43198) 2021-12-17T18:18:04.808 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f65fb7fe700 1 -- 172.21.15.109:0/1306298054 learned_addr learned my addr 172.21.15.109:0/1306298054 (peer_addr_for_me v2:172.21.15.109:0/0) 2021-12-17T18:18:04.808 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.792+0000 7f6600cc8700 1 --2- 172.21.15.109:0/1306298054 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65fc144a70 0x7f65fc0b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.808 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.796+0000 7f65fbfff700 1 -- 172.21.15.109:0/1306298054 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65fc0b2be0 msgr2=0x7f65fc0b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.809 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.796+0000 7f65fbfff700 1 --2- 172.21.15.109:0/1306298054 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65fc0b2be0 0x7f65fc0b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.809 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.796+0000 7f65fbfff700 1 -- 172.21.15.109:0/1306298054 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65fc144a70 msgr2=0x7f65fc0b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.809 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.796+0000 7f65fbfff700 1 --2- 172.21.15.109:0/1306298054 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65fc144a70 0x7f65fc0b4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.809 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.796+0000 7f65fbfff700 1 -- 172.21.15.109:0/1306298054 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f4009530 con 0x7f65fc05ffe0 2021-12-17T18:18:04.810 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.796+0000 7f65fbfff700 1 --2- 172.21.15.109:0/1306298054 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f65fc05ffe0 0x7f65fc1417e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f65ec00c000 tx=0x7f65ec006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:04.810 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.796+0000 7f65f97fa700 1 -- 172.21.15.109:0/1306298054 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65ec010780 con 0x7f65fc05ffe0 2021-12-17T18:18:04.810 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.796+0000 7f65f97fa700 1 -- 172.21.15.109:0/1306298054 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ec0108e0 con 0x7f65fc05ffe0 2021-12-17T18:18:04.810 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.796+0000 7f660272b700 1 -- 172.21.15.109:0/1306298054 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65fc0ae7b0 con 0x7f65fc05ffe0 2021-12-17T18:18:04.811 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.796+0000 7f65f97fa700 1 -- 172.21.15.109:0/1306298054 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65ec010c40 con 0x7f65fc05ffe0 2021-12-17T18:18:04.811 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.796+0000 7f660272b700 1 -- 172.21.15.109:0/1306298054 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65fc0b3210 con 0x7f65fc05ffe0 2021-12-17T18:18:04.811 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.796+0000 7f65f97fa700 1 -- 172.21.15.109:0/1306298054 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f65ec01c460 con 0x7f65fc05ffe0 2021-12-17T18:18:04.811 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.796+0000 7f65f97fa700 1 -- 172.21.15.109:0/1306298054 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f65ec01c6f0 con 0x7f65fc05ffe0 2021-12-17T18:18:04.812 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.796+0000 7f660272b700 1 -- 172.21.15.109:0/1306298054 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65fc0aea00 con 0x7f65fc05ffe0 2021-12-17T18:18:04.812 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.800+0000 7f65f97fa700 1 -- 172.21.15.109:0/1306298054 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f65fc0aea00 con 0x7f65fc05ffe0 2021-12-17T18:18:04.868 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.864+0000 7f660272b700 1 -- 172.21.15.109:0/1306298054 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd new", "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", "id": 4} v 0) v1 -- 0x7f65fc0573d0 con 0x7f65fc05ffe0 2021-12-17T18:18:04.877 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.872+0000 7f65f97fa700 1 -- 172.21.15.109:0/1306298054 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f65ec022060 con 0x7f65fc05ffe0 2021-12-17T18:18:04.877 INFO:teuthology.orchestra.run.smithi109.stdout:4 2021-12-17T18:18:04.879 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.872+0000 7f660272b700 1 -- 172.21.15.109:0/1306298054 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f65fc05ffe0 msgr2=0x7f65fc1417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.879 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.872+0000 7f660272b700 1 --2- 172.21.15.109:0/1306298054 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f65fc05ffe0 0x7f65fc1417e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f65ec00c000 tx=0x7f65ec006df0).stop 2021-12-17T18:18:04.879 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.872+0000 7f660272b700 1 -- 172.21.15.109:0/1306298054 shutdown_connections 2021-12-17T18:18:04.880 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.872+0000 7f660272b700 1 --2- 172.21.15.109:0/1306298054 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65fc144a70 0x7f65fc0b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.880 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.872+0000 7f660272b700 1 --2- 172.21.15.109:0/1306298054 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65fc0b2be0 0x7f65fc0b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.880 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.872+0000 7f660272b700 1 --2- 172.21.15.109:0/1306298054 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f65fc05ffe0 0x7f65fc1417e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.880 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.872+0000 7f660272b700 1 -- 172.21.15.109:0/1306298054 >> 172.21.15.109:0/1306298054 conn(0x7f65fc0626d0 msgr2=0x7f65fc0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:04.881 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.872+0000 7f660272b700 1 -- 172.21.15.109:0/1306298054 shutdown_connections 2021-12-17T18:18:04.881 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.872+0000 7f660272b700 1 -- 172.21.15.109:0/1306298054 wait complete. 2021-12-17T18:18:04.889 DEBUG:teuthology.orchestra.run.smithi109:> sudo ceph --cluster ceph osd new 410bbb54-127f-4e2e-bc1c-373ce84935c0 5 2021-12-17T18:18:04.992 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.984+0000 7f35f0a43700 1 Processor -- start 2021-12-17T18:18:04.992 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.984+0000 7f35f0a43700 1 -- start start 2021-12-17T18:18:04.993 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.984+0000 7f35f0a43700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35ec1430f0 0x7f35ec140750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.993 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.984+0000 7f35f0a43700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f35ec064940 0x7f35ec064dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:04.993 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.984+0000 7f35f0a43700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ec064050 con 0x7f35ec0b6820 2021-12-17T18:18:04.993 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.984+0000 7f35f0a43700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ec0b6c00 con 0x7f35ec064940 2021-12-17T18:18:04.994 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.984+0000 7f35f0a43700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec05f9d0 con 0x7f35ec1430f0 2021-12-17T18:18:04.994 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.984+0000 7f35ebfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f35ec064940 0x7f35ec064dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.994 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.984+0000 7f35ebfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f35ec064940 0x7f35ec064dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.109:56798/0 (socket says 172.21.15.109:56798) 2021-12-17T18:18:04.994 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.984+0000 7f35ebfff700 1 -- 172.21.15.109:0/2564500423 learned_addr learned my addr 172.21.15.109:0/2564500423 (peer_addr_for_me v2:172.21.15.109:0/0) 2021-12-17T18:18:04.995 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.984+0000 7f35eaffd700 1 --2- 172.21.15.109:0/2564500423 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35ec1430f0 0x7f35ec140750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:04.995 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35ebfff700 1 -- 172.21.15.109:0/2564500423 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35ec1430f0 msgr2=0x7f35ec140750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:04.995 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35ebfff700 1 --2- 172.21.15.109:0/2564500423 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35ec1430f0 0x7f35ec140750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:04.995 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35ebfff700 1 -- 172.21.15.109:0/2564500423 >> v1:172.21.15.62:6789/0 conn(0x7f35ec0b6820 legacy=0x7f35ec140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:04.996 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35ebfff700 1 -- 172.21.15.109:0/2564500423 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec05f730 con 0x7f35ec064940 2021-12-17T18:18:04.996 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35eaffd700 1 --2- 172.21.15.109:0/2564500423 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35ec1430f0 0x7f35ec140750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:04.996 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35ebfff700 1 --2- 172.21.15.109:0/2564500423 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35ec064940 0x7f35ec064dd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f35e40032f0 tx=0x7f35e4009290).ready entity=mon.1 client_cookie=1b10f65980fa73a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:04.996 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35ea7fc700 1 -- 172.21.15.109:0/2564500423 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35e400b8a0 con 0x7f35ec064940 2021-12-17T18:18:04.997 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35ea7fc700 1 -- 172.21.15.109:0/2564500423 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e400ba00 con 0x7f35ec064940 2021-12-17T18:18:04.997 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35ea7fc700 1 -- 172.21.15.109:0/2564500423 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35e400bb70 con 0x7f35ec064940 2021-12-17T18:18:05.001 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35f0a43700 1 -- 172.21.15.109:0/2564500423 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35ec064940 msgr2=0x7f35ec064dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:05.001 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35f0a43700 1 --2- 172.21.15.109:0/2564500423 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35ec064940 0x7f35ec064dd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f35e40032f0 tx=0x7f35e4009290).stop 2021-12-17T18:18:05.001 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35f0a43700 1 -- 172.21.15.109:0/2564500423 shutdown_connections 2021-12-17T18:18:05.001 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35f0a43700 1 --2- 172.21.15.109:0/2564500423 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35ec064940 0x7f35ec064dd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.002 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35f0a43700 1 --2- 172.21.15.109:0/2564500423 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35ec1430f0 0x7f35ec140750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.002 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35f0a43700 1 -- 172.21.15.109:0/2564500423 >> 172.21.15.109:0/2564500423 conn(0x7f35ec0625b0 msgr2=0x7f35ec063620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:05.002 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35f0a43700 1 -- 172.21.15.109:0/2564500423 shutdown_connections 2021-12-17T18:18:05.002 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35f0a43700 1 -- 172.21.15.109:0/2564500423 wait complete. 2021-12-17T18:18:05.003 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35f0a43700 1 Processor -- start 2021-12-17T18:18:05.003 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35f0a43700 1 -- start start 2021-12-17T18:18:05.003 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35f0a43700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35ec064940 0x7f35ec144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:05.003 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35f0a43700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35ec0b6820 0x7f35ec152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:05.004 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35f0a43700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35ec1430f0 0x7f35ec146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:05.004 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35f0a43700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec114290 con 0x7f35ec064940 2021-12-17T18:18:05.004 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35f0a43700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec0b05d0 con 0x7f35ec1430f0 2021-12-17T18:18:05.004 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35f0a43700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec113b50 con 0x7f35ec0b6820 2021-12-17T18:18:05.004 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35ebfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35ec1430f0 0x7f35ec146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:05.005 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35eaffd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35ec0b6820 0x7f35ec152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:05.005 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35eaffd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35ec0b6820 0x7f35ec152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.109:43210/0 (socket says 172.21.15.109:43210) 2021-12-17T18:18:05.005 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35ebfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35ec1430f0 0x7f35ec146810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.109:56804/0 (socket says 172.21.15.109:56804) 2021-12-17T18:18:05.005 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35eaffd700 1 -- 172.21.15.109:0/1743197293 learned_addr learned my addr 172.21.15.109:0/1743197293 (peer_addr_for_me v2:172.21.15.109:0/0) 2021-12-17T18:18:05.006 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.988+0000 7f35eb7fe700 1 --2- 172.21.15.109:0/1743197293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35ec064940 0x7f35ec144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:05.006 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.992+0000 7f35ebfff700 1 -- 172.21.15.109:0/1743197293 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35ec0b6820 msgr2=0x7f35ec152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:05.006 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.992+0000 7f35ebfff700 1 --2- 172.21.15.109:0/1743197293 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35ec0b6820 0x7f35ec152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.006 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.992+0000 7f35ebfff700 1 -- 172.21.15.109:0/1743197293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35ec064940 msgr2=0x7f35ec144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:05.007 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.992+0000 7f35ebfff700 1 --2- 172.21.15.109:0/1743197293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35ec064940 0x7f35ec144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.007 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.992+0000 7f35ebfff700 1 -- 172.21.15.109:0/1743197293 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e000b180 con 0x7f35ec1430f0 2021-12-17T18:18:05.007 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.992+0000 7f35eaffd700 1 --2- 172.21.15.109:0/1743197293 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35ec0b6820 0x7f35ec152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:05.007 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.992+0000 7f35ebfff700 1 --2- 172.21.15.109:0/1743197293 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35ec1430f0 0x7f35ec146810 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f35e40032f0 tx=0x7f35e4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:05.008 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.992+0000 7f35e8ff9700 1 -- 172.21.15.109:0/1743197293 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35e400b8a0 con 0x7f35ec1430f0 2021-12-17T18:18:05.008 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.992+0000 7f35e8ff9700 1 -- 172.21.15.109:0/1743197293 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e4021440 con 0x7f35ec1430f0 2021-12-17T18:18:05.008 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.992+0000 7f35e8ff9700 1 -- 172.21.15.109:0/1743197293 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35e40217a0 con 0x7f35ec1430f0 2021-12-17T18:18:05.008 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.992+0000 7f35f0a43700 1 -- 172.21.15.109:0/1743197293 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e4009530 con 0x7f35ec1430f0 2021-12-17T18:18:05.008 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.992+0000 7f35f0a43700 1 -- 172.21.15.109:0/1743197293 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ec153790 con 0x7f35ec1430f0 2021-12-17T18:18:05.009 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.992+0000 7f35e8ff9700 1 -- 172.21.15.109:0/1743197293 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f35e4029070 con 0x7f35ec1430f0 2021-12-17T18:18:05.009 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.992+0000 7f35e8ff9700 1 -- 172.21.15.109:0/1743197293 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f35e4020990 con 0x7f35ec1430f0 2021-12-17T18:18:05.009 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.992+0000 7f35f0a43700 1 -- 172.21.15.109:0/1743197293 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ec113ff0 con 0x7f35ec1430f0 2021-12-17T18:18:05.009 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:04.996+0000 7f35e8ff9700 1 -- 172.21.15.109:0/1743197293 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f35ec113ff0 con 0x7f35ec1430f0 2021-12-17T18:18:05.069 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.064+0000 7f35f0a43700 1 -- 172.21.15.109:0/1743197293 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd new", "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", "id": 5} v 0) v1 -- 0x7f35ec0573d0 con 0x7f35ec1430f0 2021-12-17T18:18:05.078 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.072+0000 7f35e8ff9700 1 -- 172.21.15.109:0/1743197293 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f35e4027060 con 0x7f35ec1430f0 2021-12-17T18:18:05.078 INFO:teuthology.orchestra.run.smithi109.stdout:5 2021-12-17T18:18:05.080 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.076+0000 7f35f0a43700 1 -- 172.21.15.109:0/1743197293 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35ec1430f0 msgr2=0x7f35ec146810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:05.080 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.076+0000 7f35f0a43700 1 --2- 172.21.15.109:0/1743197293 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35ec1430f0 0x7f35ec146810 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f35e40032f0 tx=0x7f35e4016000).stop 2021-12-17T18:18:05.080 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.076+0000 7f35f0a43700 1 -- 172.21.15.109:0/1743197293 shutdown_connections 2021-12-17T18:18:05.081 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.076+0000 7f35f0a43700 1 --2- 172.21.15.109:0/1743197293 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35ec1430f0 0x7f35ec146810 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.081 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.076+0000 7f35f0a43700 1 --2- 172.21.15.109:0/1743197293 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35ec0b6820 0x7f35ec152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.081 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.076+0000 7f35f0a43700 1 --2- 172.21.15.109:0/1743197293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35ec064940 0x7f35ec144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.081 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.076+0000 7f35f0a43700 1 -- 172.21.15.109:0/1743197293 >> 172.21.15.109:0/1743197293 conn(0x7f35ec0625b0 msgr2=0x7f35ec142980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:05.082 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.076+0000 7f35f0a43700 1 -- 172.21.15.109:0/1743197293 shutdown_connections 2021-12-17T18:18:05.082 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.076+0000 7f35f0a43700 1 -- 172.21.15.109:0/1743197293 wait complete. 2021-12-17T18:18:05.096 DEBUG:teuthology.orchestra.run.smithi109:> sudo ceph --cluster ceph osd new fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29 6 2021-12-17T18:18:05.193 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.188+0000 7f57ce814700 1 Processor -- start 2021-12-17T18:18:05.194 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.188+0000 7f57ce814700 1 -- start start 2021-12-17T18:18:05.197 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.188+0000 7f57ce814700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57c8143250 0x7f57c81436c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:05.198 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.188+0000 7f57ce814700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c80b1500 con 0x7f57c80b6780 2021-12-17T18:18:05.198 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.188+0000 7f57ce814700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c80b6b60 con 0x7f57c80b31c0 2021-12-17T18:18:05.198 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.188+0000 7f57ce814700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80b0460 con 0x7f57c8143250 2021-12-17T18:18:05.198 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.188+0000 7f57ce013700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57c8143250 0x7f57c81436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:05.199 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.188+0000 7f57cd011700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f57c80b31c0 0x7f57c8142b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.109:39004/0 (socket says 172.21.15.109:39004) 2021-12-17T18:18:05.199 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.188+0000 7f57cd011700 1 -- 172.21.15.109:0/335040221 learned_addr learned my addr 172.21.15.109:0/335040221 (peer_addr_for_me v1:172.21.15.109:0/0) 2021-12-17T18:18:05.199 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.188+0000 7f57cc810700 1 -- 172.21.15.109:0/335040221 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007348727 0 0) 0x7f57c80b6b60 con 0x7f57c80b31c0 2021-12-17T18:18:05.199 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.188+0000 7f57ce013700 1 -- 172.21.15.109:0/335040221 >> v1:172.21.15.109:6789/0 conn(0x7f57c80b31c0 legacy=0x7f57c8142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:05.200 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.188+0000 7f57ce013700 1 -- 172.21.15.109:0/335040221 >> v1:172.21.15.62:6789/0 conn(0x7f57c80b6780 legacy=0x7f57c80b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:05.200 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.188+0000 7f57ce013700 1 -- 172.21.15.109:0/335040221 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c80b3630 con 0x7f57c8143250 2021-12-17T18:18:05.200 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.192+0000 7f57ce013700 1 --2- 172.21.15.109:0/335040221 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57c8143250 0x7f57c81436c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f57c00032f0 tx=0x7f57c00091d0).ready entity=mon.2 client_cookie=c42552fb4c43c73d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:05.200 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.192+0000 7f57cc810700 1 -- 172.21.15.109:0/335040221 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57c000b8a0 con 0x7f57c8143250 2021-12-17T18:18:05.200 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.192+0000 7f57cc810700 1 -- 172.21.15.109:0/335040221 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c000ba00 con 0x7f57c8143250 2021-12-17T18:18:05.201 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.192+0000 7f57cc810700 1 -- 172.21.15.109:0/335040221 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57c000bb70 con 0x7f57c8143250 2021-12-17T18:18:05.202 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.192+0000 7f57ce814700 1 -- 172.21.15.109:0/335040221 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57c8143250 msgr2=0x7f57c81436c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:05.203 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.192+0000 7f57ce814700 1 --2- 172.21.15.109:0/335040221 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57c8143250 0x7f57c81436c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f57c00032f0 tx=0x7f57c00091d0).stop 2021-12-17T18:18:05.203 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.192+0000 7f57ce814700 1 -- 172.21.15.109:0/335040221 shutdown_connections 2021-12-17T18:18:05.203 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.192+0000 7f57ce814700 1 --2- 172.21.15.109:0/335040221 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57c8143250 0x7f57c81436c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.203 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.192+0000 7f57ce814700 1 -- 172.21.15.109:0/335040221 >> 172.21.15.109:0/335040221 conn(0x7f57c805caf0 msgr2=0x7f57c805cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:05.204 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.192+0000 7f57ce814700 1 -- 172.21.15.109:0/335040221 shutdown_connections 2021-12-17T18:18:05.204 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.192+0000 7f57ce814700 1 -- 172.21.15.109:0/335040221 wait complete. 2021-12-17T18:18:05.204 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.192+0000 7f57ce814700 1 Processor -- start 2021-12-17T18:18:05.204 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.192+0000 7f57ce814700 1 -- start start 2021-12-17T18:18:05.207 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.192+0000 7f57ce814700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57c80b31c0 0x7f57c813b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:05.207 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.192+0000 7f57ce814700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f57c80b6780 0x7f57c813a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:05.208 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57ce814700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57c8143250 0x7f57c81375c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:05.208 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57ce814700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c813f400 con 0x7f57c80b31c0 2021-12-17T18:18:05.208 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57ce814700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c814e200 con 0x7f57c80b6780 2021-12-17T18:18:05.208 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57ce814700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80671b0 con 0x7f57c8143250 2021-12-17T18:18:05.209 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57cd011700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f57c80b6780 0x7f57c813a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:05.209 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57ce013700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57c8143250 0x7f57c81375c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:05.209 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57cd011700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f57c80b6780 0x7f57c813a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.109:56814/0 (socket says 172.21.15.109:56814) 2021-12-17T18:18:05.209 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57cd011700 1 -- 172.21.15.109:0/770889792 learned_addr learned my addr 172.21.15.109:0/770889792 (peer_addr_for_me v2:172.21.15.109:0/0) 2021-12-17T18:18:05.210 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57cd812700 1 --2- 172.21.15.109:0/770889792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57c80b31c0 0x7f57c813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:05.210 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57cd011700 1 -- 172.21.15.109:0/770889792 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57c8143250 msgr2=0x7f57c81375c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:05.210 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57cd011700 1 --2- 172.21.15.109:0/770889792 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57c8143250 0x7f57c81375c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.210 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57cd011700 1 -- 172.21.15.109:0/770889792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57c80b31c0 msgr2=0x7f57c813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:05.210 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57cd011700 1 --2- 172.21.15.109:0/770889792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57c80b31c0 0x7f57c813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.211 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57cd011700 1 -- 172.21.15.109:0/770889792 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c0009470 con 0x7f57c80b6780 2021-12-17T18:18:05.211 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57cd011700 1 --2- 172.21.15.109:0/770889792 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f57c80b6780 0x7f57c813a400 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f57b8000ed0 tx=0x7f57b8007ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:05.211 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57b6ffd700 1 -- 172.21.15.109:0/770889792 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57b80070d0 con 0x7f57c80b6780 2021-12-17T18:18:05.211 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57b6ffd700 1 -- 172.21.15.109:0/770889792 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b8007230 con 0x7f57c80b6780 2021-12-17T18:18:05.212 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57ce814700 1 -- 172.21.15.109:0/770889792 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c814e440 con 0x7f57c80b6780 2021-12-17T18:18:05.212 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57b6ffd700 1 -- 172.21.15.109:0/770889792 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57b8005610 con 0x7f57c80b6780 2021-12-17T18:18:05.212 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57ce814700 1 -- 172.21.15.109:0/770889792 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c813a8f0 con 0x7f57c80b6780 2021-12-17T18:18:05.212 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57b6ffd700 1 -- 172.21.15.109:0/770889792 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f57b801a060 con 0x7f57c80b6780 2021-12-17T18:18:05.213 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57b6ffd700 1 -- 172.21.15.109:0/770889792 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f57b801da60 con 0x7f57c80b6780 2021-12-17T18:18:05.213 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.196+0000 7f57ce814700 1 -- 172.21.15.109:0/770889792 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c814e5d0 con 0x7f57c80b6780 2021-12-17T18:18:05.213 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.200+0000 7f57b6ffd700 1 -- 172.21.15.109:0/770889792 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f57b8018070 con 0x7f57c80b6780 2021-12-17T18:18:05.272 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.268+0000 7f57ce814700 1 -- 172.21.15.109:0/770889792 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", "id": 6} v 0) v1 -- 0x7f57c8067370 con 0x7f57c80b6780 2021-12-17T18:18:05.281 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.276+0000 7f57b6ffd700 1 -- 172.21.15.109:0/770889792 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f57b8005df0 con 0x7f57c80b6780 2021-12-17T18:18:05.282 INFO:teuthology.orchestra.run.smithi109.stdout:6 2021-12-17T18:18:05.283 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.276+0000 7f57ce814700 1 -- 172.21.15.109:0/770889792 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f57c80b6780 msgr2=0x7f57c813a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:05.283 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.276+0000 7f57ce814700 1 --2- 172.21.15.109:0/770889792 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f57c80b6780 0x7f57c813a400 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f57b8000ed0 tx=0x7f57b8007ac0).stop 2021-12-17T18:18:05.284 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.276+0000 7f57ce814700 1 -- 172.21.15.109:0/770889792 shutdown_connections 2021-12-17T18:18:05.284 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.276+0000 7f57ce814700 1 --2- 172.21.15.109:0/770889792 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57c8143250 0x7f57c81375c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.284 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.276+0000 7f57ce814700 1 --2- 172.21.15.109:0/770889792 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f57c80b6780 0x7f57c813a400 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.284 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.276+0000 7f57ce814700 1 --2- 172.21.15.109:0/770889792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57c80b31c0 0x7f57c813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.285 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.276+0000 7f57ce814700 1 -- 172.21.15.109:0/770889792 >> 172.21.15.109:0/770889792 conn(0x7f57c805caf0 msgr2=0x7f57c80b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:05.285 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.280+0000 7f57ce814700 1 -- 172.21.15.109:0/770889792 shutdown_connections 2021-12-17T18:18:05.285 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.280+0000 7f57ce814700 1 -- 172.21.15.109:0/770889792 wait complete. 2021-12-17T18:18:05.294 DEBUG:teuthology.orchestra.run.smithi109:> sudo ceph --cluster ceph osd new f47c0a1f-4b7b-439a-8a64-4e8086324870 7 2021-12-17T18:18:05.396 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe12bfff700 1 Processor -- start 2021-12-17T18:18:05.396 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe12bfff700 1 -- start start 2021-12-17T18:18:05.400 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe12bfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe12c144e00 0x7fe12c1416c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:05.400 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe12bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe12c063f40 0x7fe12c13a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:05.400 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe12bfff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12c1452e0 con 0x7fe12c066b80 2021-12-17T18:18:05.400 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe12bfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12c141220 con 0x7fe12c063f40 2021-12-17T18:18:05.401 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe12bfff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12c140f50 con 0x7fe12c144e00 2021-12-17T18:18:05.401 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe12a7fc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe12c144e00 0x7fe12c1416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:05.401 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe12a7fc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe12c144e00 0x7fe12c1416c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.109:56820/0 (socket says 172.21.15.109:56820) 2021-12-17T18:18:05.401 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe12a7fc700 1 -- 172.21.15.109:0/87356858 learned_addr learned my addr 172.21.15.109:0/87356858 (peer_addr_for_me v2:172.21.15.109:0/0) 2021-12-17T18:18:05.402 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe12b7fe700 1 --2- 172.21.15.109:0/87356858 >> v2:172.21.15.62:3300/0 conn(0x7fe12c063f40 0x7fe12c13a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:05.402 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe12a7fc700 1 -- 172.21.15.109:0/87356858 >> v2:172.21.15.62:3300/0 conn(0x7fe12c063f40 msgr2=0x7fe12c13a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:05.402 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe12a7fc700 1 --2- 172.21.15.109:0/87356858 >> v2:172.21.15.62:3300/0 conn(0x7fe12c063f40 0x7fe12c13a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.402 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe12a7fc700 1 -- 172.21.15.109:0/87356858 >> v1:172.21.15.109:6789/0 conn(0x7fe12c066b80 legacy=0x7fe12c05f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:05.403 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe129ffb700 1 -- 172.21.15.109:0/87356858 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635025942 0 0) 0x7fe12c1452e0 con 0x7fe12c066b80 2021-12-17T18:18:05.403 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe12a7fc700 1 -- 172.21.15.109:0/87356858 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12c066f60 con 0x7fe12c144e00 2021-12-17T18:18:05.403 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe12a7fc700 1 --2- 172.21.15.109:0/87356858 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe12c144e00 0x7fe12c1416c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fe12c067610 tx=0x7fe114006eb0).ready entity=mon.1 client_cookie=fd1c92324915efdd server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:05.404 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe129ffb700 1 -- 172.21.15.109:0/87356858 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe11400d610 con 0x7fe12c144e00 2021-12-17T18:18:05.404 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe129ffb700 1 -- 172.21.15.109:0/87356858 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe114000e90 con 0x7fe12c144e00 2021-12-17T18:18:05.404 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.392+0000 7fe129ffb700 1 -- 172.21.15.109:0/87356858 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe11400d960 con 0x7fe12c144e00 2021-12-17T18:18:05.404 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12bfff700 1 -- 172.21.15.109:0/87356858 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe12c144e00 msgr2=0x7fe12c1416c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:05.405 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12bfff700 1 --2- 172.21.15.109:0/87356858 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe12c144e00 0x7fe12c1416c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fe12c067610 tx=0x7fe114006eb0).stop 2021-12-17T18:18:05.405 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12bfff700 1 -- 172.21.15.109:0/87356858 shutdown_connections 2021-12-17T18:18:05.405 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12bfff700 1 --2- 172.21.15.109:0/87356858 >> v2:172.21.15.62:3300/0 conn(0x7fe12c063f40 0x7fe12c13a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.405 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12bfff700 1 --2- 172.21.15.109:0/87356858 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe12c144e00 0x7fe12c1416c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.406 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12bfff700 1 -- 172.21.15.109:0/87356858 >> 172.21.15.109:0/87356858 conn(0x7fe12c0625b0 msgr2=0x7fe12c063620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:05.406 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12bfff700 1 -- 172.21.15.109:0/87356858 shutdown_connections 2021-12-17T18:18:05.406 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12bfff700 1 -- 172.21.15.109:0/87356858 wait complete. 2021-12-17T18:18:05.409 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12bfff700 1 Processor -- start 2021-12-17T18:18:05.409 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12bfff700 1 -- start start 2021-12-17T18:18:05.409 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe12c063f40 0x7fe12c0ae820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:05.410 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12bfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe12c066b80 0x7fe12c1426f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:05.410 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12bfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe12c144e00 0x7fe12c154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:05.411 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c1539f0 con 0x7fe12c063f40 2021-12-17T18:18:05.411 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12bfff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c0afdb0 con 0x7fe12c066b80 2021-12-17T18:18:05.412 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12bfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c0b0050 con 0x7fe12c144e00 2021-12-17T18:18:05.412 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12a7fc700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe12c066b80 0x7fe12c1426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:05.413 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12a7fc700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe12c066b80 0x7fe12c1426f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.109:56826/0 (socket says 172.21.15.109:56826) 2021-12-17T18:18:05.413 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12a7fc700 1 -- 172.21.15.109:0/2576311946 learned_addr learned my addr 172.21.15.109:0/2576311946 (peer_addr_for_me v2:172.21.15.109:0/0) 2021-12-17T18:18:05.413 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.396+0000 7fe12b7fe700 1 --2- 172.21.15.109:0/2576311946 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe12c144e00 0x7fe12c154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:05.414 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.400+0000 7fe12affd700 1 --2- 172.21.15.109:0/2576311946 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe12c063f40 0x7fe12c0ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:05.415 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.400+0000 7fe12b7fe700 1 -- 172.21.15.109:0/2576311946 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe12c066b80 msgr2=0x7fe12c1426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:05.415 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.400+0000 7fe12b7fe700 1 --2- 172.21.15.109:0/2576311946 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe12c066b80 0x7fe12c1426f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.416 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.400+0000 7fe12b7fe700 1 -- 172.21.15.109:0/2576311946 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe12c063f40 msgr2=0x7fe12c0ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:05.416 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.400+0000 7fe12b7fe700 1 --2- 172.21.15.109:0/2576311946 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe12c063f40 0x7fe12c0ae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.416 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.400+0000 7fe12b7fe700 1 -- 172.21.15.109:0/2576311946 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11400b1e0 con 0x7fe12c144e00 2021-12-17T18:18:05.417 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.400+0000 7fe12a7fc700 1 --2- 172.21.15.109:0/2576311946 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe12c066b80 0x7fe12c1426f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:05.417 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.400+0000 7fe12b7fe700 1 --2- 172.21.15.109:0/2576311946 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe12c144e00 0x7fe12c154090 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fe12400c000 tx=0x7fe124006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:05.418 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.400+0000 7fe123fff700 1 -- 172.21.15.109:0/2576311946 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe124011750 con 0x7fe12c144e00 2021-12-17T18:18:05.418 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.400+0000 7fe123fff700 1 -- 172.21.15.109:0/2576311946 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1240118b0 con 0x7fe12c144e00 2021-12-17T18:18:05.419 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.400+0000 7fe12bfff700 1 -- 172.21.15.109:0/2576311946 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12c0b02f0 con 0x7fe12c144e00 2021-12-17T18:18:05.419 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.400+0000 7fe123fff700 1 -- 172.21.15.109:0/2576311946 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe124011c10 con 0x7fe12c144e00 2021-12-17T18:18:05.419 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.400+0000 7fe12bfff700 1 -- 172.21.15.109:0/2576311946 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12c0af980 con 0x7fe12c144e00 2021-12-17T18:18:05.420 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.400+0000 7fe123fff700 1 -- 172.21.15.109:0/2576311946 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fe12401c460 con 0x7fe12c144e00 2021-12-17T18:18:05.421 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.400+0000 7fe123fff700 1 -- 172.21.15.109:0/2576311946 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7fe12401c6f0 con 0x7fe12c144e00 2021-12-17T18:18:05.421 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.400+0000 7fe12bfff700 1 -- 172.21.15.109:0/2576311946 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12c0b0480 con 0x7fe12c144e00 2021-12-17T18:18:05.422 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.400+0000 7fe123fff700 1 -- 172.21.15.109:0/2576311946 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fe12401cba0 con 0x7fe12c144e00 2021-12-17T18:18:05.474 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.468+0000 7fe12bfff700 1 -- 172.21.15.109:0/2576311946 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", "id": 7} v 0) v1 -- 0x7fe12c0573d0 con 0x7fe12c144e00 2021-12-17T18:18:05.483 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.480+0000 7fe123fff700 1 -- 172.21.15.109:0/2576311946 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe124026430 con 0x7fe12c144e00 2021-12-17T18:18:05.484 INFO:teuthology.orchestra.run.smithi109.stdout:7 2021-12-17T18:18:05.485 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.480+0000 7fe12bfff700 1 -- 172.21.15.109:0/2576311946 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe12c144e00 msgr2=0x7fe12c154090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:05.485 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.480+0000 7fe12bfff700 1 --2- 172.21.15.109:0/2576311946 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe12c144e00 0x7fe12c154090 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fe12400c000 tx=0x7fe124006df0).stop 2021-12-17T18:18:05.486 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.480+0000 7fe12bfff700 1 -- 172.21.15.109:0/2576311946 shutdown_connections 2021-12-17T18:18:05.486 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.480+0000 7fe12bfff700 1 --2- 172.21.15.109:0/2576311946 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe12c144e00 0x7fe12c154090 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.486 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.480+0000 7fe12bfff700 1 --2- 172.21.15.109:0/2576311946 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe12c066b80 0x7fe12c1426f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.486 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.480+0000 7fe12bfff700 1 --2- 172.21.15.109:0/2576311946 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe12c063f40 0x7fe12c0ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:05.487 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.480+0000 7fe12bfff700 1 -- 172.21.15.109:0/2576311946 >> 172.21.15.109:0/2576311946 conn(0x7fe12c0625b0 msgr2=0x7fe12c140390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:05.487 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.480+0000 7fe12bfff700 1 -- 172.21.15.109:0/2576311946 shutdown_connections 2021-12-17T18:18:05.487 INFO:teuthology.orchestra.run.smithi109.stderr:2021-12-17T18:18:05.480+0000 7fe12bfff700 1 -- 172.21.15.109:0/2576311946 wait complete. 2021-12-17T18:18:05.495 INFO:tasks.ceph.osd.0:Restarting daemon 2021-12-17T18:18:05.496 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-12-17T18:18:05.498 INFO:tasks.ceph.osd.0:Started 2021-12-17T18:18:05.498 INFO:tasks.ceph.osd.1:Restarting daemon 2021-12-17T18:18:05.499 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-12-17T18:18:05.501 INFO:tasks.ceph.osd.1:Started 2021-12-17T18:18:05.501 INFO:tasks.ceph.osd.2:Restarting daemon 2021-12-17T18:18:05.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-12-17T18:18:05.504 INFO:tasks.ceph.osd.2:Started 2021-12-17T18:18:05.504 INFO:tasks.ceph.osd.3:Restarting daemon 2021-12-17T18:18:05.505 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-12-17T18:18:05.507 INFO:tasks.ceph.osd.3:Started 2021-12-17T18:18:05.507 INFO:tasks.ceph.osd.4:Restarting daemon 2021-12-17T18:18:05.508 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-12-17T18:18:05.510 INFO:tasks.ceph.osd.4:Started 2021-12-17T18:18:05.510 INFO:tasks.ceph.osd.5:Restarting daemon 2021-12-17T18:18:05.511 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-12-17T18:18:05.514 INFO:tasks.ceph.osd.5:Started 2021-12-17T18:18:05.514 INFO:tasks.ceph.osd.6:Restarting daemon 2021-12-17T18:18:05.515 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2021-12-17T18:18:05.517 INFO:tasks.ceph.osd.6:Started 2021-12-17T18:18:05.517 INFO:tasks.ceph.osd.7:Restarting daemon 2021-12-17T18:18:05.517 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2021-12-17T18:18:05.520 INFO:tasks.ceph.osd.7:Started 2021-12-17T18:18:05.520 INFO:tasks.ceph:Waiting for OSDs to come up 2021-12-17T18:18:05.867 INFO:tasks.ceph.osd.0.smithi062.stderr:2021-12-17T18:18:05.862+0000 7fdf847a0d80 -1 Falling back to public interface 2021-12-17T18:18:05.889 INFO:tasks.ceph.osd.5.smithi109.stderr:2021-12-17T18:18:05.884+0000 7fd50d2edd80 -1 Falling back to public interface 2021-12-17T18:18:06.117 INFO:tasks.ceph.osd.4.smithi109.stderr:2021-12-17T18:18:06.112+0000 7ff7d6dcdd80 -1 Falling back to public interface 2021-12-17T18:18:06.119 INFO:tasks.ceph.osd.2.smithi062.stderr:2021-12-17T18:18:06.114+0000 7ff74a6efd80 -1 Falling back to public interface 2021-12-17T18:18:06.132 INFO:tasks.ceph.osd.7.smithi109.stderr:2021-12-17T18:18:06.128+0000 7f85fd023d80 -1 Falling back to public interface 2021-12-17T18:18:06.135 INFO:tasks.ceph.osd.3.smithi062.stderr:2021-12-17T18:18:06.130+0000 7f086fe5fd80 -1 Falling back to public interface 2021-12-17T18:18:06.141 INFO:tasks.ceph.osd.6.smithi109.stderr:2021-12-17T18:18:06.136+0000 7f94a7f31d80 -1 Falling back to public interface 2021-12-17T18:18:06.142 INFO:tasks.ceph.osd.1.smithi062.stderr:2021-12-17T18:18:06.138+0000 7fc62ef39d80 -1 Falling back to public interface 2021-12-17T18:18:06.326 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:06.420 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.414+0000 7fd7d5647700 1 Processor -- start 2021-12-17T18:18:06.421 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.414+0000 7fd7d5647700 1 -- start start 2021-12-17T18:18:06.423 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.414+0000 7fd7d5647700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7d01470f0 0x7fd7d00b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:06.423 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.414+0000 7fd7d5647700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd7d0063060 0x7fd7d0146060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:06.424 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.414+0000 7fd7d5647700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d00b1810 con 0x7fd7d00b1ef0 2021-12-17T18:18:06.424 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.414+0000 7fd7d5647700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d00b22d0 con 0x7fd7d0063060 2021-12-17T18:18:06.424 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.414+0000 7fd7d5647700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d00ada50 con 0x7fd7d01470f0 2021-12-17T18:18:06.424 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7d4e46700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd7d0063060 0x7fd7d0146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:06.425 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7d4e46700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd7d0063060 0x7fd7d0146060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47362/0 (socket says 172.21.15.62:47362) 2021-12-17T18:18:06.425 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7d4e46700 1 -- 172.21.15.62:0/2548514484 learned_addr learned my addr 172.21.15.62:0/2548514484 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:06.425 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7cf7fe700 1 --2- 172.21.15.62:0/2548514484 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7d01470f0 0x7fd7d00b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:06.425 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7d4e46700 1 -- 172.21.15.62:0/2548514484 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7d01470f0 msgr2=0x7fd7d00b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:06.426 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7d4e46700 1 --2- 172.21.15.62:0/2548514484 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7d01470f0 0x7fd7d00b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:06.426 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7d4e46700 1 -- 172.21.15.62:0/2548514484 >> v1:172.21.15.109:6789/0 conn(0x7fd7d00b1ef0 legacy=0x7fd7d0062950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:06.426 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7d4e46700 1 -- 172.21.15.62:0/2548514484 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d00634c0 con 0x7fd7d0063060 2021-12-17T18:18:06.426 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7d4e46700 1 --2- 172.21.15.62:0/2548514484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7d0063060 0x7fd7d0146060 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd7c8002f70 tx=0x7fd7c8006eb0).ready entity=mon.0 client_cookie=a6d1cbba93e80bb7 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:06.427 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7ceffd700 1 -- 172.21.15.62:0/2548514484 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7c800d570 con 0x7fd7d0063060 2021-12-17T18:18:06.427 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7ceffd700 1 -- 172.21.15.62:0/2548514484 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c8000e90 con 0x7fd7d0063060 2021-12-17T18:18:06.427 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7ceffd700 1 -- 172.21.15.62:0/2548514484 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7c800d900 con 0x7fd7d0063060 2021-12-17T18:18:06.427 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7d5647700 1 -- 172.21.15.62:0/2548514484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7d0063060 msgr2=0x7fd7d0146060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:06.427 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7d5647700 1 --2- 172.21.15.62:0/2548514484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7d0063060 0x7fd7d0146060 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd7c8002f70 tx=0x7fd7c8006eb0).stop 2021-12-17T18:18:06.428 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7d5647700 1 -- 172.21.15.62:0/2548514484 shutdown_connections 2021-12-17T18:18:06.428 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7d5647700 1 --2- 172.21.15.62:0/2548514484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7d0063060 0x7fd7d0146060 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:06.428 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7d5647700 1 --2- 172.21.15.62:0/2548514484 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7d01470f0 0x7fd7d00b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:06.428 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7d5647700 1 -- 172.21.15.62:0/2548514484 >> 172.21.15.62:0/2548514484 conn(0x7fd7d005c4a0 msgr2=0x7fd7d005c880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:06.429 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7d5647700 1 -- 172.21.15.62:0/2548514484 shutdown_connections 2021-12-17T18:18:06.429 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.418+0000 7fd7d5647700 1 -- 172.21.15.62:0/2548514484 wait complete. 2021-12-17T18:18:06.435 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7d5647700 1 Processor -- start 2021-12-17T18:18:06.435 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7d5647700 1 -- start start 2021-12-17T18:18:06.436 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7d5647700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd7d0063060 0x7fd7d01497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:06.436 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7d5647700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7d00b1ef0 0x7fd7d0063990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:06.437 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7d5647700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7d01470f0 0x7fd7d01428d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:06.437 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7d5647700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d00654f0 con 0x7fd7d00b1ef0 2021-12-17T18:18:06.438 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7d5647700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d0065790 con 0x7fd7d0063060 2021-12-17T18:18:06.438 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7d5647700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d0065a30 con 0x7fd7d01470f0 2021-12-17T18:18:06.438 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7cf7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7d00b1ef0 0x7fd7d0063990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:06.439 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7cf7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7d00b1ef0 0x7fd7d0063990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47366/0 (socket says 172.21.15.62:47366) 2021-12-17T18:18:06.439 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7cf7fe700 1 -- 172.21.15.62:0/3151322779 learned_addr learned my addr 172.21.15.62:0/3151322779 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:06.440 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7d4e46700 1 --2- 172.21.15.62:0/3151322779 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7d01470f0 0x7fd7d01428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:06.440 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7cffff700 1 --2- 172.21.15.62:0/3151322779 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd7d0063060 0x7fd7d01497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:06.440 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7cf7fe700 1 -- 172.21.15.62:0/3151322779 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7d01470f0 msgr2=0x7fd7d01428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:06.441 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7cf7fe700 1 --2- 172.21.15.62:0/3151322779 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7d01470f0 0x7fd7d01428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:06.441 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7cf7fe700 1 -- 172.21.15.62:0/3151322779 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd7d0063060 msgr2=0x7fd7d01497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:06.442 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7cf7fe700 1 --2- 172.21.15.62:0/3151322779 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd7d0063060 0x7fd7d01497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:06.442 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7cf7fe700 1 -- 172.21.15.62:0/3151322779 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c800b1e0 con 0x7fd7d00b1ef0 2021-12-17T18:18:06.443 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7cf7fe700 1 --2- 172.21.15.62:0/3151322779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7d00b1ef0 0x7fd7d0063990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd7b800c000 tx=0x7fd7b8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:06.443 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7cd7fa700 1 -- 172.21.15.62:0/3151322779 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7b8010780 con 0x7fd7d00b1ef0 2021-12-17T18:18:06.444 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7cd7fa700 1 -- 172.21.15.62:0/3151322779 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b80108e0 con 0x7fd7d00b1ef0 2021-12-17T18:18:06.444 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7d5647700 1 -- 172.21.15.62:0/3151322779 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d0065ed0 con 0x7fd7d00b1ef0 2021-12-17T18:18:06.444 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7cd7fa700 1 -- 172.21.15.62:0/3151322779 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7b8010c40 con 0x7fd7d00b1ef0 2021-12-17T18:18:06.445 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.422+0000 7fd7d5647700 1 -- 172.21.15.62:0/3151322779 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d014b0b0 con 0x7fd7d00b1ef0 2021-12-17T18:18:06.445 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.426+0000 7fd7cd7fa700 1 -- 172.21.15.62:0/3151322779 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 2) v1 ==== 32742+0+0 (secure 0 0 0) 0x7fd7b801c460 con 0x7fd7d00b1ef0 2021-12-17T18:18:06.446 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.426+0000 7fd7d5647700 1 -- 172.21.15.62:0/3151322779 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d00b12d0 con 0x7fd7d00b1ef0 2021-12-17T18:18:06.446 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.426+0000 7fd7cd7fa700 1 -- 172.21.15.62:0/3151322779 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7fd7b803a840 con 0x7fd7d00b1ef0 2021-12-17T18:18:06.447 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.430+0000 7fd7cd7fa700 1 -- 172.21.15.62:0/3151322779 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fd7b800f6b0 con 0x7fd7d00b1ef0 2021-12-17T18:18:06.498 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.494+0000 7fd7d5647700 1 -- 172.21.15.62:0/3151322779 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7d00573d0 con 0x7fd7d00b1ef0 2021-12-17T18:18:06.499 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.494+0000 7fd7cd7fa700 1 -- 172.21.15.62:0/3151322779 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6849 (secure 0 0 0) 0x7fd7b8019310 con 0x7fd7d00b1ef0 2021-12-17T18:18:06.499 INFO:teuthology.misc.health.smithi062.stdout: 2021-12-17T18:18:06.500 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":10,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:05.473048+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:06.505 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.502+0000 7fd7d5647700 1 -- 172.21.15.62:0/3151322779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7d00b1ef0 msgr2=0x7fd7d0063990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:06.506 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.502+0000 7fd7d5647700 1 --2- 172.21.15.62:0/3151322779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7d00b1ef0 0x7fd7d0063990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd7b800c000 tx=0x7fd7b8006df0).stop 2021-12-17T18:18:06.506 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.502+0000 7fd7d5647700 1 -- 172.21.15.62:0/3151322779 shutdown_connections 2021-12-17T18:18:06.506 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.502+0000 7fd7d5647700 1 --2- 172.21.15.62:0/3151322779 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7d01470f0 0x7fd7d01428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:06.507 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.502+0000 7fd7d5647700 1 --2- 172.21.15.62:0/3151322779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7d00b1ef0 0x7fd7d0063990 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:06.507 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.502+0000 7fd7d5647700 1 --2- 172.21.15.62:0/3151322779 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd7d0063060 0x7fd7d01497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:06.507 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.502+0000 7fd7d5647700 1 -- 172.21.15.62:0/3151322779 >> 172.21.15.62:0/3151322779 conn(0x7fd7d005c4a0 msgr2=0x7fd7d01453c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:06.507 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.502+0000 7fd7d5647700 1 -- 172.21.15.62:0/3151322779 shutdown_connections 2021-12-17T18:18:06.507 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:06.502+0000 7fd7d5647700 1 -- 172.21.15.62:0/3151322779 wait complete. 2021-12-17T18:18:06.515 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-12-17T18:18:07.030 INFO:tasks.ceph.osd.0.smithi062.stderr:2021-12-17T18:18:07.026+0000 7fdf847a0d80 -1 osd.0 0 log_to_monitors {default=true} 2021-12-17T18:18:07.042 INFO:tasks.ceph.osd.5.smithi109.stderr:2021-12-17T18:18:07.036+0000 7fd50d2edd80 -1 osd.5 0 log_to_monitors {default=true} 2021-12-17T18:18:07.272 INFO:tasks.ceph.osd.4.smithi109.stderr:2021-12-17T18:18:07.268+0000 7ff7d6dcdd80 -1 osd.4 0 log_to_monitors {default=true} 2021-12-17T18:18:07.291 INFO:tasks.ceph.osd.2.smithi062.stderr:2021-12-17T18:18:07.286+0000 7ff74a6efd80 -1 osd.2 0 log_to_monitors {default=true} 2021-12-17T18:18:07.323 INFO:tasks.ceph.osd.3.smithi062.stderr:2021-12-17T18:18:07.318+0000 7f086fe5fd80 -1 osd.3 0 log_to_monitors {default=true} 2021-12-17T18:18:07.327 INFO:tasks.ceph.osd.7.smithi109.stderr:2021-12-17T18:18:07.320+0000 7f85fd023d80 -1 osd.7 0 log_to_monitors {default=true} 2021-12-17T18:18:07.337 INFO:tasks.ceph.osd.6.smithi109.stderr:2021-12-17T18:18:07.332+0000 7f94a7f31d80 -1 osd.6 0 log_to_monitors {default=true} 2021-12-17T18:18:07.365 INFO:tasks.ceph.osd.1.smithi062.stderr:2021-12-17T18:18:07.358+0000 7fc62ef39d80 -1 osd.1 0 log_to_monitors {default=true} 2021-12-17T18:18:08.553 INFO:tasks.ceph.osd.5.smithi109.stderr:2021-12-17T18:18:08.548+0000 7fd4ff392700 -1 osd.5 0 waiting for initial osdmap 2021-12-17T18:18:08.554 INFO:tasks.ceph.osd.0.smithi062.stderr:2021-12-17T18:18:08.550+0000 7fdf76845700 -1 osd.0 0 waiting for initial osdmap 2021-12-17T18:18:08.555 INFO:tasks.ceph.osd.7.smithi109.stderr:2021-12-17T18:18:08.548+0000 7f85ef0c8700 -1 osd.7 0 waiting for initial osdmap 2021-12-17T18:18:08.555 INFO:tasks.ceph.osd.3.smithi062.stderr:2021-12-17T18:18:08.550+0000 7f0861f04700 -1 osd.3 0 waiting for initial osdmap 2021-12-17T18:18:08.556 INFO:tasks.ceph.osd.6.smithi109.stderr:2021-12-17T18:18:08.552+0000 7f9499fd6700 -1 osd.6 0 waiting for initial osdmap 2021-12-17T18:18:08.556 INFO:tasks.ceph.osd.1.smithi062.stderr:2021-12-17T18:18:08.550+0000 7fc620fde700 -1 osd.1 0 waiting for initial osdmap 2021-12-17T18:18:08.557 INFO:tasks.ceph.osd.2.smithi062.stderr:2021-12-17T18:18:08.550+0000 7ff73c794700 -1 osd.2 0 waiting for initial osdmap 2021-12-17T18:18:08.558 INFO:tasks.ceph.osd.4.smithi109.stderr:2021-12-17T18:18:08.552+0000 7ff7c8e72700 -1 osd.4 0 waiting for initial osdmap 2021-12-17T18:18:08.561 INFO:tasks.ceph.osd.0.smithi062.stderr:2021-12-17T18:18:08.558+0000 7fdf7dcc3700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-12-17T18:18:08.563 INFO:tasks.ceph.osd.7.smithi109.stderr:2021-12-17T18:18:08.560+0000 7f85f6546700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-12-17T18:18:08.564 INFO:tasks.ceph.osd.5.smithi109.stderr:2021-12-17T18:18:08.560+0000 7fd506810700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-12-17T18:18:08.566 INFO:tasks.ceph.osd.1.smithi062.stderr:2021-12-17T18:18:08.562+0000 7fc62845c700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-12-17T18:18:08.568 INFO:tasks.ceph.osd.4.smithi109.stderr:2021-12-17T18:18:08.564+0000 7ff7d02f0700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-12-17T18:18:08.569 INFO:tasks.ceph.osd.6.smithi109.stderr:2021-12-17T18:18:08.564+0000 7f94a1454700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-12-17T18:18:08.571 INFO:tasks.ceph.osd.3.smithi062.stderr:2021-12-17T18:18:08.566+0000 7f0869382700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-12-17T18:18:08.572 INFO:tasks.ceph.osd.2.smithi062.stderr:2021-12-17T18:18:08.566+0000 7ff743c12700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-12-17T18:18:13.321 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:13.423 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.418+0000 7f5fc957f700 1 Processor -- start 2021-12-17T18:18:13.424 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.418+0000 7f5fc957f700 1 -- start start 2021-12-17T18:18:13.426 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.418+0000 7f5fc957f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5fc40b4d90 0x7f5fc41404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:13.426 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.418+0000 7f5fc957f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc40b6800 con 0x7f5fc40b5c50 2021-12-17T18:18:13.426 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.418+0000 7f5fc957f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc40b4360 con 0x7f5fc40b6420 2021-12-17T18:18:13.427 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.418+0000 7f5fc957f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc40b1080 con 0x7f5fc40b4d90 2021-12-17T18:18:13.427 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.418+0000 7f5fbbfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5fc40b4d90 0x7f5fc41404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:13.427 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.418+0000 7f5fc8d7e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5fc40b5c50 0x7f5fc4143190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59404/0 (socket says 172.21.15.62:59404) 2021-12-17T18:18:13.427 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.418+0000 7f5fc8d7e700 1 -- 172.21.15.62:0/528159644 learned_addr learned my addr 172.21.15.62:0/528159644 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:13.428 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.418+0000 7f5fc37fe700 1 -- 172.21.15.62:0/528159644 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557050854 0 0) 0x7f5fc40b6800 con 0x7f5fc40b5c50 2021-12-17T18:18:13.428 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.418+0000 7f5fc37fe700 1 -- 172.21.15.62:0/528159644 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fa8003260 con 0x7f5fc40b5c50 2021-12-17T18:18:13.428 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.422+0000 7f5fc37fe700 1 -- 172.21.15.62:0/528159644 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 781190453 0 0) 0x7f5fa8003260 con 0x7f5fc40b5c50 2021-12-17T18:18:13.428 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.422+0000 7f5fbbfff700 1 -- 172.21.15.62:0/528159644 >> v1:172.21.15.109:6789/0 conn(0x7f5fc40b6420 legacy=0x7f5fc413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:13.428 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.422+0000 7f5fbbfff700 1 -- 172.21.15.62:0/528159644 >> v1:172.21.15.62:6789/0 conn(0x7f5fc40b5c50 legacy=0x7f5fc4143190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:13.429 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.422+0000 7f5fbbfff700 1 -- 172.21.15.62:0/528159644 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc40b6e00 con 0x7f5fc40b4d90 2021-12-17T18:18:13.429 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.422+0000 7f5fbbfff700 1 --2- 172.21.15.62:0/528159644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5fc40b4d90 0x7f5fc41404b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5fbc001b80 tx=0x7f5fac006df0).ready entity=mon.0 client_cookie=b44eca9270724bfd server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:13.429 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.422+0000 7f5fc37fe700 1 -- 172.21.15.62:0/528159644 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fbc0019e0 con 0x7f5fc40b4d90 2021-12-17T18:18:13.429 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.422+0000 7f5fc37fe700 1 -- 172.21.15.62:0/528159644 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fac000e90 con 0x7f5fc40b4d90 2021-12-17T18:18:13.430 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.422+0000 7f5fc37fe700 1 -- 172.21.15.62:0/528159644 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fac00d4f0 con 0x7f5fc40b4d90 2021-12-17T18:18:13.437 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.422+0000 7f5fc957f700 1 -- 172.21.15.62:0/528159644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5fc40b4d90 msgr2=0x7f5fc41404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:13.438 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.422+0000 7f5fc957f700 1 --2- 172.21.15.62:0/528159644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5fc40b4d90 0x7f5fc41404b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5fbc001b80 tx=0x7f5fac006df0).stop 2021-12-17T18:18:13.438 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.422+0000 7f5fc957f700 1 -- 172.21.15.62:0/528159644 shutdown_connections 2021-12-17T18:18:13.439 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.422+0000 7f5fc957f700 1 --2- 172.21.15.62:0/528159644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5fc40b4d90 0x7f5fc41404b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:13.439 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.422+0000 7f5fc957f700 1 -- 172.21.15.62:0/528159644 >> 172.21.15.62:0/528159644 conn(0x7f5fc4066da0 msgr2=0x7f5fc40671b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:13.440 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.422+0000 7f5fc957f700 1 -- 172.21.15.62:0/528159644 shutdown_connections 2021-12-17T18:18:13.440 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.422+0000 7f5fc957f700 1 -- 172.21.15.62:0/528159644 wait complete. 2021-12-17T18:18:13.440 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fc957f700 1 Processor -- start 2021-12-17T18:18:13.441 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fc957f700 1 -- start start 2021-12-17T18:18:13.441 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fc957f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5fc40b4d90 0x7f5fc4152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:13.442 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fc957f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5fc40b5c50 0x7f5fc4142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:13.442 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fc957f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5fc40b6420 0x7f5fc40aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:13.443 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fc957f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40af210 con 0x7f5fc40b5c50 2021-12-17T18:18:13.443 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fc957f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40af430 con 0x7f5fc40b6420 2021-12-17T18:18:13.444 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fc957f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40af6d0 con 0x7f5fc40b4d90 2021-12-17T18:18:13.444 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fbbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5fc40b5c50 0x7f5fc4142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:13.445 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fbbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5fc40b5c50 0x7f5fc4142010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47596/0 (socket says 172.21.15.62:47596) 2021-12-17T18:18:13.445 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fbbfff700 1 -- 172.21.15.62:0/947903828 learned_addr learned my addr 172.21.15.62:0/947903828 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:13.445 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fc3fff700 1 --2- 172.21.15.62:0/947903828 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5fc40b4d90 0x7f5fc4152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:13.446 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fc8d7e700 1 --2- 172.21.15.62:0/947903828 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5fc40b6420 0x7f5fc40aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:13.446 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fbbfff700 1 -- 172.21.15.62:0/947903828 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5fc40b4d90 msgr2=0x7f5fc4152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:13.447 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fbbfff700 1 --2- 172.21.15.62:0/947903828 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5fc40b4d90 0x7f5fc4152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:13.447 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fbbfff700 1 -- 172.21.15.62:0/947903828 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5fc40b6420 msgr2=0x7f5fc40aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:13.448 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fbbfff700 1 --2- 172.21.15.62:0/947903828 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5fc40b6420 0x7f5fc40aed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:13.448 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fbbfff700 1 -- 172.21.15.62:0/947903828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac00b180 con 0x7f5fc40b5c50 2021-12-17T18:18:13.449 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fbbfff700 1 --2- 172.21.15.62:0/947903828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5fc40b5c50 0x7f5fc4142010 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f5fbc001b80 tx=0x7f5fac014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:13.449 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fc1ffb700 1 -- 172.21.15.62:0/947903828 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fac016070 con 0x7f5fc40b5c50 2021-12-17T18:18:13.449 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fc1ffb700 1 -- 172.21.15.62:0/947903828 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fac002f50 con 0x7f5fc40b5c50 2021-12-17T18:18:13.450 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.426+0000 7f5fc957f700 1 -- 172.21.15.62:0/947903828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc4147070 con 0x7f5fc40b5c50 2021-12-17T18:18:13.450 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.430+0000 7f5fc1ffb700 1 -- 172.21.15.62:0/947903828 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fac00d4f0 con 0x7f5fc40b5c50 2021-12-17T18:18:13.451 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.430+0000 7f5fc957f700 1 -- 172.21.15.62:0/947903828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc4147350 con 0x7f5fc40b5c50 2021-12-17T18:18:13.451 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.430+0000 7f5fc957f700 1 -- 172.21.15.62:0/947903828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc40af890 con 0x7f5fc40b5c50 2021-12-17T18:18:13.452 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.430+0000 7f5fc1ffb700 1 -- 172.21.15.62:0/947903828 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5fac025030 con 0x7f5fc40b5c50 2021-12-17T18:18:13.452 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.430+0000 7f5fc1ffb700 1 --2- 172.21.15.62:0/947903828 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5f9c053610 0x7f5f9c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:13.453 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.430+0000 7f5fc1ffb700 1 -- 172.21.15.62:0/947903828 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f5fac06c4d0 con 0x7f5fc40b5c50 2021-12-17T18:18:13.453 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.430+0000 7f5fc3fff700 1 --2- 172.21.15.62:0/947903828 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5f9c053610 0x7f5f9c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:13.453 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.434+0000 7f5fc3fff700 1 --2- 172.21.15.62:0/947903828 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5f9c053610 0x7f5f9c055ad0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f5fb400b000 tx=0x7f5fb4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:13.454 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.438+0000 7f5fc1ffb700 1 -- 172.21.15.62:0/947903828 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5fac043ac0 con 0x7f5fc40b5c50 2021-12-17T18:18:13.570 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.566+0000 7f5fc957f700 1 -- 172.21.15.62:0/947903828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fc40b70a0 con 0x7f5fc40b5c50 2021-12-17T18:18:13.572 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.566+0000 7f5fc1ffb700 1 -- 172.21.15.62:0/947903828 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11853 (secure 0 0 0) 0x7f5fac023020 con 0x7f5fc40b5c50 2021-12-17T18:18:13.572 INFO:teuthology.misc.health.smithi062.stdout: 2021-12-17T18:18:13.572 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":16,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:11.565554+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:13.574 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.570+0000 7f5fc957f700 1 -- 172.21.15.62:0/947903828 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5f9c053610 msgr2=0x7f5f9c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:13.574 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.570+0000 7f5fc957f700 1 --2- 172.21.15.62:0/947903828 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5f9c053610 0x7f5f9c055ad0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f5fb400b000 tx=0x7f5fb4009040).stop 2021-12-17T18:18:13.574 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.570+0000 7f5fc957f700 1 -- 172.21.15.62:0/947903828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5fc40b5c50 msgr2=0x7f5fc4142010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:13.575 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.570+0000 7f5fc957f700 1 --2- 172.21.15.62:0/947903828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5fc40b5c50 0x7f5fc4142010 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f5fbc001b80 tx=0x7f5fac014000).stop 2021-12-17T18:18:13.575 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.570+0000 7f5fc957f700 1 -- 172.21.15.62:0/947903828 shutdown_connections 2021-12-17T18:18:13.575 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.570+0000 7f5fc957f700 1 --2- 172.21.15.62:0/947903828 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5f9c053610 0x7f5f9c055ad0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:13.576 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.570+0000 7f5fc957f700 1 --2- 172.21.15.62:0/947903828 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5fc40b6420 0x7f5fc40aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:13.576 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.570+0000 7f5fc957f700 1 --2- 172.21.15.62:0/947903828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5fc40b5c50 0x7f5fc4142010 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:13.576 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.570+0000 7f5fc957f700 1 --2- 172.21.15.62:0/947903828 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5fc40b4d90 0x7f5fc4152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:13.576 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.570+0000 7f5fc957f700 1 -- 172.21.15.62:0/947903828 >> 172.21.15.62:0/947903828 conn(0x7f5fc4066da0 msgr2=0x7f5fc40b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:13.577 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.570+0000 7f5fc957f700 1 -- 172.21.15.62:0/947903828 shutdown_connections 2021-12-17T18:18:13.577 INFO:teuthology.misc.health.smithi062.stderr:2021-12-17T18:18:13.570+0000 7f5fc957f700 1 -- 172.21.15.62:0/947903828 wait complete. 2021-12-17T18:18:13.584 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-12-17T18:18:13.585 INFO:tasks.ceph:Creating RBD pool 2021-12-17T18:18:13.585 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool create rbd 8 2021-12-17T18:18:13.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f9254d5a700 1 Processor -- start 2021-12-17T18:18:13.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f9254d5a700 1 -- start start 2021-12-17T18:18:13.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f9254d5a700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f92501466f0 0x7f9250143b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:13.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f9254d5a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92501433c0 con 0x7f925005ca90 2021-12-17T18:18:13.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f9254d5a700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9250143660 con 0x7f92500b17e0 2021-12-17T18:18:13.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f9254d5a700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925005ce70 con 0x7f92501466f0 2021-12-17T18:18:13.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f924f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f925005ca90 0x7f92500afe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59414/0 (socket says 172.21.15.62:59414) 2021-12-17T18:18:13.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f924f7fe700 1 -- 172.21.15.62:0/481440189 learned_addr learned my addr 172.21.15.62:0/481440189 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:13.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f9246ffd700 1 --2- 172.21.15.62:0/481440189 >> v2:172.21.15.109:3300/0 conn(0x7f92501466f0 0x7f9250143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:13.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f924effd700 1 -- 172.21.15.62:0/481440189 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820775444 0 0) 0x7f92501433c0 con 0x7f925005ca90 2021-12-17T18:18:13.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f924effd700 1 -- 172.21.15.62:0/481440189 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9230003260 con 0x7f925005ca90 2021-12-17T18:18:13.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f9246ffd700 1 -- 172.21.15.62:0/481440189 >> v1:172.21.15.109:6789/0 conn(0x7f92500b17e0 legacy=0x7f9250142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:13.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f9246ffd700 1 -- 172.21.15.62:0/481440189 >> v1:172.21.15.62:6789/0 conn(0x7f925005ca90 legacy=0x7f92500afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:13.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f924effd700 1 -- 172.21.15.62:0/481440189 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 491027424 0 0) 0x7f9230003260 con 0x7f925005ca90 2021-12-17T18:18:13.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f9246ffd700 1 -- 172.21.15.62:0/481440189 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9250060610 con 0x7f92501466f0 2021-12-17T18:18:13.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f9246ffd700 1 --2- 172.21.15.62:0/481440189 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f92501466f0 0x7f9250143b00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9240001800 tx=0x7f9238006df0).ready entity=mon.1 client_cookie=adf0d88f8672c797 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:13.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f924effd700 1 -- 172.21.15.62:0/481440189 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9240001660 con 0x7f92501466f0 2021-12-17T18:18:13.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f924effd700 1 -- 172.21.15.62:0/481440189 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9238000e90 con 0x7f92501466f0 2021-12-17T18:18:13.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.686+0000 7f924effd700 1 -- 172.21.15.62:0/481440189 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f923800d4f0 con 0x7f92501466f0 2021-12-17T18:18:13.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.690+0000 7f9254d5a700 1 -- 172.21.15.62:0/481440189 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f92501466f0 msgr2=0x7f9250143b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:13.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.690+0000 7f9254d5a700 1 --2- 172.21.15.62:0/481440189 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f92501466f0 0x7f9250143b00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9240001800 tx=0x7f9238006df0).stop 2021-12-17T18:18:13.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.690+0000 7f9254d5a700 1 -- 172.21.15.62:0/481440189 shutdown_connections 2021-12-17T18:18:13.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.690+0000 7f9254d5a700 1 --2- 172.21.15.62:0/481440189 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f92501466f0 0x7f9250143b00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:13.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.690+0000 7f9254d5a700 1 -- 172.21.15.62:0/481440189 >> 172.21.15.62:0/481440189 conn(0x7f925005be70 msgr2=0x7f9250062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:13.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.690+0000 7f9254d5a700 1 -- 172.21.15.62:0/481440189 shutdown_connections 2021-12-17T18:18:13.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.690+0000 7f9254d5a700 1 -- 172.21.15.62:0/481440189 wait complete. 2021-12-17T18:18:13.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.690+0000 7f9254d5a700 1 Processor -- start 2021-12-17T18:18:13.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.690+0000 7f9254d5a700 1 -- start start 2021-12-17T18:18:13.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f9254d5a700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f925005ca90 0x7f92500a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:13.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f9254d5a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92500b17e0 0x7f92500a3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:13.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f9254d5a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92501466f0 0x7f925014f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:13.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f9254d5a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9250064e40 con 0x7f92501466f0 2021-12-17T18:18:13.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f9254d5a700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92500a49b0 con 0x7f925005ca90 2021-12-17T18:18:13.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f9254d5a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92500a4be0 con 0x7f92500b17e0 2021-12-17T18:18:13.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f924ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92501466f0 0x7f925014f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:13.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f924ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92501466f0 0x7f925014f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47612/0 (socket says 172.21.15.62:47612) 2021-12-17T18:18:13.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f924ffff700 1 -- 172.21.15.62:0/797526838 learned_addr learned my addr 172.21.15.62:0/797526838 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:13.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f924f7fe700 1 --2- 172.21.15.62:0/797526838 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f925005ca90 0x7f92500a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:13.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f9246ffd700 1 --2- 172.21.15.62:0/797526838 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92500b17e0 0x7f92500a3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:13.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f924ffff700 1 -- 172.21.15.62:0/797526838 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92500b17e0 msgr2=0x7f92500a3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:13.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f924ffff700 1 --2- 172.21.15.62:0/797526838 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92500b17e0 0x7f92500a3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:13.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f924ffff700 1 -- 172.21.15.62:0/797526838 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f925005ca90 msgr2=0x7f92500a5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:13.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f924ffff700 1 --2- 172.21.15.62:0/797526838 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f925005ca90 0x7f92500a5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:13.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f924ffff700 1 -- 172.21.15.62:0/797526838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923800b180 con 0x7f92501466f0 2021-12-17T18:18:13.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f924ffff700 1 --2- 172.21.15.62:0/797526838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92501466f0 0x7f925014f8b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f92500b51c0 tx=0x7f9248007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:13.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f924d7fa700 1 -- 172.21.15.62:0/797526838 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f924800e4a0 con 0x7f92501466f0 2021-12-17T18:18:13.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f924d7fa700 1 -- 172.21.15.62:0/797526838 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924800e600 con 0x7f92501466f0 2021-12-17T18:18:13.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f9254d5a700 1 -- 172.21.15.62:0/797526838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92500a4e80 con 0x7f92501466f0 2021-12-17T18:18:13.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f924d7fa700 1 -- 172.21.15.62:0/797526838 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f924800e960 con 0x7f92501466f0 2021-12-17T18:18:13.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f9254d5a700 1 -- 172.21.15.62:0/797526838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9250067470 con 0x7f92501466f0 2021-12-17T18:18:13.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.694+0000 7f9254d5a700 1 -- 172.21.15.62:0/797526838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92500a5010 con 0x7f92501466f0 2021-12-17T18:18:13.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.698+0000 7f924d7fa700 1 -- 172.21.15.62:0/797526838 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9248019030 con 0x7f92501466f0 2021-12-17T18:18:13.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.698+0000 7f924d7fa700 1 --2- 172.21.15.62:0/797526838 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9234053580 0x7f9234055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:13.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.698+0000 7f924d7fa700 1 -- 172.21.15.62:0/797526838 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f924806ad10 con 0x7f92501466f0 2021-12-17T18:18:13.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.698+0000 7f924f7fe700 1 --2- 172.21.15.62:0/797526838 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9234053580 0x7f9234055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:13.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.698+0000 7f924f7fe700 1 --2- 172.21.15.62:0/797526838 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9234053580 0x7f9234055a40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f924000b000 tx=0x7f9240000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:13.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.702+0000 7f924d7fa700 1 -- 172.21.15.62:0/797526838 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9248070020 con 0x7f92501466f0 2021-12-17T18:18:13.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:13.822+0000 7f9254d5a700 1 -- 172.21.15.62:0/797526838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f92500573d0 con 0x7f92501466f0 2021-12-17T18:18:14.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.726+0000 7f924d7fa700 1 -- 172.21.15.62:0/797526838 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f92480421f0 con 0x7f92501466f0 2021-12-17T18:18:14.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.730+0000 7f9254d5a700 1 -- 172.21.15.62:0/797526838 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9234053580 msgr2=0x7f9234055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:14.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.730+0000 7f9254d5a700 1 --2- 172.21.15.62:0/797526838 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9234053580 0x7f9234055a40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f924000b000 tx=0x7f9240000bc0).stop 2021-12-17T18:18:14.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.730+0000 7f9254d5a700 1 -- 172.21.15.62:0/797526838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92501466f0 msgr2=0x7f925014f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:14.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.730+0000 7f9254d5a700 1 --2- 172.21.15.62:0/797526838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92501466f0 0x7f925014f8b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f92500b51c0 tx=0x7f9248007f40).stop 2021-12-17T18:18:14.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.730+0000 7f9254d5a700 1 -- 172.21.15.62:0/797526838 shutdown_connections 2021-12-17T18:18:14.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.730+0000 7f9254d5a700 1 --2- 172.21.15.62:0/797526838 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9234053580 0x7f9234055a40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:14.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.730+0000 7f9254d5a700 1 --2- 172.21.15.62:0/797526838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92501466f0 0x7f925014f8b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:14.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.730+0000 7f9254d5a700 1 --2- 172.21.15.62:0/797526838 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92500b17e0 0x7f92500a3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:14.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.730+0000 7f9254d5a700 1 --2- 172.21.15.62:0/797526838 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f925005ca90 0x7f92500a5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:14.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.730+0000 7f9254d5a700 1 -- 172.21.15.62:0/797526838 >> 172.21.15.62:0/797526838 conn(0x7f925005be70 msgr2=0x7f92500b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:14.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.730+0000 7f9254d5a700 1 -- 172.21.15.62:0/797526838 shutdown_connections 2021-12-17T18:18:14.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.730+0000 7f9254d5a700 1 -- 172.21.15.62:0/797526838 wait complete. 2021-12-17T18:18:14.741 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'rbd' created 2021-12-17T18:18:14.753 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-12-17T18:18:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.858+0000 7f517b59e700 1 Processor -- start 2021-12-17T18:18:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.858+0000 7f517b59e700 1 -- start start 2021-12-17T18:18:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f517b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f517c05fa70 0x7f517c0b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f517b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f517c05bcd0 0x7f517c1469c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f517b59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f517c146eb0 0x7f517c147340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f517b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517c0b6600 con 0x7f517c05fa70 2021-12-17T18:18:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f517b59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517c147830 con 0x7f517c146eb0 2021-12-17T18:18:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f517b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c0627d0 con 0x7f517c05bcd0 2021-12-17T18:18:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f517a59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f517c05fa70 0x7f517c0b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f517a59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f517c05fa70 0x7f517c0b0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47618/0 (socket says 172.21.15.62:47618) 2021-12-17T18:18:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f517a59c700 1 -- 172.21.15.62:0/1852427585 learned_addr learned my addr 172.21.15.62:0/1852427585 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f5173fff700 1 --2- 172.21.15.62:0/1852427585 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f517c05bcd0 0x7f517c1469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f517ad9d700 1 --2- 172.21.15.62:0/1852427585 >> v2:172.21.15.109:3300/0 conn(0x7f517c146eb0 0x7f517c147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f517a59c700 1 -- 172.21.15.62:0/1852427585 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f517c05bcd0 msgr2=0x7f517c1469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f517a59c700 1 --2- 172.21.15.62:0/1852427585 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f517c05bcd0 0x7f517c1469c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f517a59c700 1 -- 172.21.15.62:0/1852427585 >> v2:172.21.15.109:3300/0 conn(0x7f517c146eb0 msgr2=0x7f517c147340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f517a59c700 1 --2- 172.21.15.62:0/1852427585 >> v2:172.21.15.109:3300/0 conn(0x7f517c146eb0 0x7f517c147340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f517a59c700 1 -- 172.21.15.62:0/1852427585 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c0ac470 con 0x7f517c05fa70 2021-12-17T18:18:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f517a59c700 1 --2- 172.21.15.62:0/1852427585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f517c05fa70 0x7f517c0b0e90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f516c002f70 tx=0x7f516c006eb0).ready entity=mon.0 client_cookie=3577d434c63b3077 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f5179d9b700 1 -- 172.21.15.62:0/1852427585 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f516c00d570 con 0x7f517c05fa70 2021-12-17T18:18:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f5179d9b700 1 -- 172.21.15.62:0/1852427585 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c000e90 con 0x7f517c05fa70 2021-12-17T18:18:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.862+0000 7f5179d9b700 1 -- 172.21.15.62:0/1852427585 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f516c00d900 con 0x7f517c05fa70 2021-12-17T18:18:14.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.866+0000 7f517b59e700 1 -- 172.21.15.62:0/1852427585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f517c05fa70 msgr2=0x7f517c0b0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:14.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.866+0000 7f517b59e700 1 --2- 172.21.15.62:0/1852427585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f517c05fa70 0x7f517c0b0e90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f516c002f70 tx=0x7f516c006eb0).stop 2021-12-17T18:18:14.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.866+0000 7f517b59e700 1 -- 172.21.15.62:0/1852427585 shutdown_connections 2021-12-17T18:18:14.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.866+0000 7f517b59e700 1 --2- 172.21.15.62:0/1852427585 >> v2:172.21.15.109:3300/0 conn(0x7f517c146eb0 0x7f517c147340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:14.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.866+0000 7f517b59e700 1 --2- 172.21.15.62:0/1852427585 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f517c05bcd0 0x7f517c1469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:14.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.866+0000 7f517b59e700 1 --2- 172.21.15.62:0/1852427585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f517c05fa70 0x7f517c0b0e90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:14.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.866+0000 7f517b59e700 1 -- 172.21.15.62:0/1852427585 >> 172.21.15.62:0/1852427585 conn(0x7f517c0b5ae0 msgr2=0x7f517c0b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:14.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.866+0000 7f517b59e700 1 -- 172.21.15.62:0/1852427585 shutdown_connections 2021-12-17T18:18:14.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.866+0000 7f517b59e700 1 -- 172.21.15.62:0/1852427585 wait complete. 2021-12-17T18:18:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.866+0000 7f517b59e700 1 Processor -- start 2021-12-17T18:18:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.866+0000 7f517b59e700 1 -- start start 2021-12-17T18:18:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f517c05bcd0 0x7f517c152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f517c05fa70 0x7f517c14a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517b59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f517c146eb0 0x7f517c066d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c0a5fb0 con 0x7f517c05bcd0 2021-12-17T18:18:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517b59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c0a61e0 con 0x7f517c146eb0 2021-12-17T18:18:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c0671f0 con 0x7f517c05fa70 2021-12-17T18:18:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f517c05bcd0 0x7f517c152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:14.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f517c05bcd0 0x7f517c152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47622/0 (socket says 172.21.15.62:47622) 2021-12-17T18:18:14.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517a59c700 1 -- 172.21.15.62:0/969131419 learned_addr learned my addr 172.21.15.62:0/969131419 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:14.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f5173fff700 1 --2- 172.21.15.62:0/969131419 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f517c05fa70 0x7f517c14a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:14.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517ad9d700 1 --2- 172.21.15.62:0/969131419 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f517c146eb0 0x7f517c066d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:14.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517a59c700 1 -- 172.21.15.62:0/969131419 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f517c05fa70 msgr2=0x7f517c14a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:14.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517a59c700 1 --2- 172.21.15.62:0/969131419 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f517c05fa70 0x7f517c14a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:14.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517a59c700 1 -- 172.21.15.62:0/969131419 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f517c146eb0 msgr2=0x7f517c066d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:14.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517a59c700 1 --2- 172.21.15.62:0/969131419 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f517c146eb0 0x7f517c066d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517a59c700 1 -- 172.21.15.62:0/969131419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c00b1e0 con 0x7f517c05bcd0 2021-12-17T18:18:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517a59c700 1 --2- 172.21.15.62:0/969131419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f517c05bcd0 0x7f517c152300 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f516c002f70 tx=0x7f516c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f51737fe700 1 -- 172.21.15.62:0/969131419 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f516c0117e0 con 0x7f517c05bcd0 2021-12-17T18:18:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f51737fe700 1 -- 172.21.15.62:0/969131419 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c011940 con 0x7f517c05bcd0 2021-12-17T18:18:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517b59e700 1 -- 172.21.15.62:0/969131419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517c067810 con 0x7f517c05bcd0 2021-12-17T18:18:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f51737fe700 1 -- 172.21.15.62:0/969131419 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f516c011ca0 con 0x7f517c05bcd0 2021-12-17T18:18:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517b59e700 1 -- 172.21.15.62:0/969131419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517c155ea0 con 0x7f517c05bcd0 2021-12-17T18:18:14.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.870+0000 7f517b59e700 1 -- 172.21.15.62:0/969131419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517c0a63e0 con 0x7f517c05bcd0 2021-12-17T18:18:14.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.874+0000 7f51737fe700 1 -- 172.21.15.62:0/969131419 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f516c025030 con 0x7f517c05bcd0 2021-12-17T18:18:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.874+0000 7f51737fe700 1 --2- 172.21.15.62:0/969131419 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51600536d0 0x7f5160055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.874+0000 7f51737fe700 1 -- 172.21.15.62:0/969131419 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f516c06c5d0 con 0x7f517c05bcd0 2021-12-17T18:18:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.874+0000 7f5173fff700 1 --2- 172.21.15.62:0/969131419 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51600536d0 0x7f5160055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.874+0000 7f5173fff700 1 --2- 172.21.15.62:0/969131419 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51600536d0 0x7f5160055b90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f516400b000 tx=0x7f5164006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:14.878+0000 7f51737fe700 1 -- 172.21.15.62:0/969131419 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f516c043a70 con 0x7f517c05bcd0 2021-12-17T18:18:15.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.006+0000 7f517b59e700 1 -- 172.21.15.62:0/969131419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f517c0b6830 con 0x7f517c05bcd0 2021-12-17T18:18:15.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.730+0000 7f51737fe700 1 -- 172.21.15.62:0/969131419 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f516c023020 con 0x7f517c05bcd0 2021-12-17T18:18:15.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.734+0000 7f517b59e700 1 -- 172.21.15.62:0/969131419 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51600536d0 msgr2=0x7f5160055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:15.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.734+0000 7f517b59e700 1 --2- 172.21.15.62:0/969131419 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51600536d0 0x7f5160055b90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f516400b000 tx=0x7f5164006df0).stop 2021-12-17T18:18:15.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.734+0000 7f517b59e700 1 -- 172.21.15.62:0/969131419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f517c05bcd0 msgr2=0x7f517c152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:15.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.734+0000 7f517b59e700 1 --2- 172.21.15.62:0/969131419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f517c05bcd0 0x7f517c152300 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f516c002f70 tx=0x7f516c015000).stop 2021-12-17T18:18:15.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.734+0000 7f517b59e700 1 -- 172.21.15.62:0/969131419 shutdown_connections 2021-12-17T18:18:15.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.734+0000 7f517b59e700 1 --2- 172.21.15.62:0/969131419 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51600536d0 0x7f5160055b90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:15.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.734+0000 7f517b59e700 1 --2- 172.21.15.62:0/969131419 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f517c146eb0 0x7f517c066d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:15.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.734+0000 7f517b59e700 1 --2- 172.21.15.62:0/969131419 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f517c05fa70 0x7f517c14a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:15.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.734+0000 7f517b59e700 1 --2- 172.21.15.62:0/969131419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f517c05bcd0 0x7f517c152300 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:15.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.734+0000 7f517b59e700 1 -- 172.21.15.62:0/969131419 >> 172.21.15.62:0/969131419 conn(0x7f517c0b5ae0 msgr2=0x7f517c0aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:15.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.734+0000 7f517b59e700 1 -- 172.21.15.62:0/969131419 shutdown_connections 2021-12-17T18:18:15.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.734+0000 7f517b59e700 1 -- 172.21.15.62:0/969131419 wait complete. 2021-12-17T18:18:15.742 INFO:teuthology.orchestra.run.smithi062.stderr:enabled application 'rbd' on pool 'rbd' 2021-12-17T18:18:15.754 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-12-17T18:18:15.754 INFO:tasks.ceph.mds.a:Restarting daemon 2021-12-17T18:18:15.755 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-12-17T18:18:15.757 INFO:tasks.ceph.mds.a:Started 2021-12-17T18:18:15.757 INFO:tasks.ceph.mds.b:Restarting daemon 2021-12-17T18:18:15.758 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-12-17T18:18:15.760 INFO:tasks.ceph.mds.b:Started 2021-12-17T18:18:15.761 INFO:tasks.ceph:Setting up CephFS filesystem... 2021-12-17T18:18:15.761 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:15.824 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:18:15.831 INFO:tasks.ceph.mds.b.smithi109.stdout:starting mds.b at 2021-12-17T18:18:15.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.850+0000 7f0262dbe700 1 Processor -- start 2021-12-17T18:18:15.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.850+0000 7f0262dbe700 1 -- start start 2021-12-17T18:18:15.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0262dbe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f025c05ffe0 0x7f025c0679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:15.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0262dbe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f025c0b57e0 0x7f025c0b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:15.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0262dbe700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f025c0b2e90 con 0x7f025c0ad360 2021-12-17T18:18:15.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0262dbe700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c0b4b70 con 0x7f025c05ffe0 2021-12-17T18:18:15.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0262dbe700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c0b4e10 con 0x7f025c0b57e0 2021-12-17T18:18:15.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0260b5a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f025c05ffe0 0x7f025c0679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:15.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0260b5a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f025c05ffe0 0x7f025c0679c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47646/0 (socket says 172.21.15.62:47646) 2021-12-17T18:18:15.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0260b5a700 1 -- 172.21.15.62:0/980805719 learned_addr learned my addr 172.21.15.62:0/980805719 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:15.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f026135b700 1 --2- 172.21.15.62:0/980805719 >> v2:172.21.15.109:3300/0 conn(0x7f025c0b57e0 0x7f025c0b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:15.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0260b5a700 1 -- 172.21.15.62:0/980805719 >> v2:172.21.15.109:3300/0 conn(0x7f025c0b57e0 msgr2=0x7f025c0b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:15.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0260b5a700 1 --2- 172.21.15.62:0/980805719 >> v2:172.21.15.109:3300/0 conn(0x7f025c0b57e0 0x7f025c0b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:15.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0260b5a700 1 -- 172.21.15.62:0/980805719 >> v1:172.21.15.109:6789/0 conn(0x7f025c0ad360 legacy=0x7f025c0b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:15.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0260b5a700 1 -- 172.21.15.62:0/980805719 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c0b52b0 con 0x7f025c05ffe0 2021-12-17T18:18:15.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0260b5a700 1 --2- 172.21.15.62:0/980805719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f025c05ffe0 0x7f025c0679c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f02540032f0 tx=0x7f0254009290).ready entity=mon.0 client_cookie=61eab5a968cfaa88 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:15.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f025b7fe700 1 -- 172.21.15.62:0/980805719 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f025400b870 con 0x7f025c05ffe0 2021-12-17T18:18:15.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f025b7fe700 1 -- 172.21.15.62:0/980805719 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025400b9d0 con 0x7f025c05ffe0 2021-12-17T18:18:15.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f025b7fe700 1 -- 172.21.15.62:0/980805719 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f025400bb40 con 0x7f025c05ffe0 2021-12-17T18:18:15.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0262dbe700 1 -- 172.21.15.62:0/980805719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f025c05ffe0 msgr2=0x7f025c0679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:15.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0262dbe700 1 --2- 172.21.15.62:0/980805719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f025c05ffe0 0x7f025c0679c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f02540032f0 tx=0x7f0254009290).stop 2021-12-17T18:18:15.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0262dbe700 1 -- 172.21.15.62:0/980805719 shutdown_connections 2021-12-17T18:18:15.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0262dbe700 1 --2- 172.21.15.62:0/980805719 >> v2:172.21.15.109:3300/0 conn(0x7f025c0b57e0 0x7f025c0b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:15.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0262dbe700 1 --2- 172.21.15.62:0/980805719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f025c05ffe0 0x7f025c0679c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:15.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0262dbe700 1 -- 172.21.15.62:0/980805719 >> 172.21.15.62:0/980805719 conn(0x7f025c0626d0 msgr2=0x7f025c05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:15.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0262dbe700 1 -- 172.21.15.62:0/980805719 shutdown_connections 2021-12-17T18:18:15.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.854+0000 7f0262dbe700 1 -- 172.21.15.62:0/980805719 wait complete. 2021-12-17T18:18:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f0262dbe700 1 Processor -- start 2021-12-17T18:18:15.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f0262dbe700 1 -- start start 2021-12-17T18:18:15.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f0262dbe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f025c05ffe0 0x7f025c0b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:15.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f0262dbe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f025c0ad360 0x7f025c152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f0262dbe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f025c0b57e0 0x7f025c153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f0262dbe700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c064510 con 0x7f025c0b57e0 2021-12-17T18:18:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f0262dbe700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c1429c0 con 0x7f025c0ad360 2021-12-17T18:18:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f0262dbe700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c153960 con 0x7f025c05ffe0 2021-12-17T18:18:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f026135b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f025c0b57e0 0x7f025c153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:15.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f025bfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f025c0ad360 0x7f025c152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:15.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f026135b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f025c0b57e0 0x7f025c153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47656/0 (socket says 172.21.15.62:47656) 2021-12-17T18:18:15.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f025bfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f025c0ad360 0x7f025c152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:54204/0 (socket says 172.21.15.62:54204) 2021-12-17T18:18:15.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f026135b700 1 -- 172.21.15.62:0/3254035435 learned_addr learned my addr 172.21.15.62:0/3254035435 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:15.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f0260b5a700 1 --2- 172.21.15.62:0/3254035435 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f025c05ffe0 0x7f025c0b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:15.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f026135b700 1 -- 172.21.15.62:0/3254035435 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f025c05ffe0 msgr2=0x7f025c0b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:15.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f026135b700 1 --2- 172.21.15.62:0/3254035435 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f025c05ffe0 0x7f025c0b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:15.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f026135b700 1 -- 172.21.15.62:0/3254035435 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f025c0ad360 msgr2=0x7f025c152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:15.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f026135b700 1 --2- 172.21.15.62:0/3254035435 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f025c0ad360 0x7f025c152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:15.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f026135b700 1 -- 172.21.15.62:0/3254035435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0254009530 con 0x7f025c0b57e0 2021-12-17T18:18:15.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f025bfff700 1 --2- 172.21.15.62:0/3254035435 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f025c0ad360 0x7f025c152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:15.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f026135b700 1 --2- 172.21.15.62:0/3254035435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f025c0b57e0 0x7f025c153470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f025c153aa0 tx=0x7f024c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:15.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f0259ffb700 1 -- 172.21.15.62:0/3254035435 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f024c011780 con 0x7f025c0b57e0 2021-12-17T18:18:15.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f0259ffb700 1 -- 172.21.15.62:0/3254035435 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c0118e0 con 0x7f025c0b57e0 2021-12-17T18:18:15.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f0262dbe700 1 -- 172.21.15.62:0/3254035435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025c066eb0 con 0x7f025c0b57e0 2021-12-17T18:18:15.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f0259ffb700 1 -- 172.21.15.62:0/3254035435 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f024c011c40 con 0x7f025c0b57e0 2021-12-17T18:18:15.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.858+0000 7f0262dbe700 1 -- 172.21.15.62:0/3254035435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025c1529a0 con 0x7f025c0b57e0 2021-12-17T18:18:15.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.862+0000 7f0262dbe700 1 -- 172.21.15.62:0/3254035435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f025c067040 con 0x7f025c0b57e0 2021-12-17T18:18:15.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.862+0000 7f0259ffb700 1 -- 172.21.15.62:0/3254035435 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f024c012420 con 0x7f025c0b57e0 2021-12-17T18:18:15.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.862+0000 7f0259ffb700 1 --2- 172.21.15.62:0/3254035435 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f023c053640 0x7f023c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:15.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.862+0000 7f0259ffb700 1 -- 172.21.15.62:0/3254035435 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f024c06b3c0 con 0x7f025c0b57e0 2021-12-17T18:18:15.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.862+0000 7f0260b5a700 1 --2- 172.21.15.62:0/3254035435 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f023c053640 0x7f023c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:15.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.862+0000 7f0260b5a700 1 --2- 172.21.15.62:0/3254035435 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f023c053640 0x7f023c055b00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f025401b000 tx=0x7f0254016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:15.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.870+0000 7f0259ffb700 1 -- 172.21.15.62:0/3254035435 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f024c0426e0 con 0x7f025c0b57e0 2021-12-17T18:18:16.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:15.998+0000 7f0262dbe700 1 -- 172.21.15.62:0/3254035435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f025c0573d0 con 0x7f025c0b57e0 2021-12-17T18:18:16.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.002+0000 7f0259ffb700 1 -- 172.21.15.62:0/3254035435 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13239 (secure 0 0 0) 0x7f024c045d00 con 0x7f025c0b57e0 2021-12-17T18:18:16.006 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:16.006 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":18,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:15.722339+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:16.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.002+0000 7f0262dbe700 1 -- 172.21.15.62:0/3254035435 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f023c053640 msgr2=0x7f023c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.002+0000 7f0262dbe700 1 --2- 172.21.15.62:0/3254035435 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f023c053640 0x7f023c055b00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f025401b000 tx=0x7f0254016000).stop 2021-12-17T18:18:16.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.002+0000 7f0262dbe700 1 -- 172.21.15.62:0/3254035435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f025c0b57e0 msgr2=0x7f025c153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.002+0000 7f0262dbe700 1 --2- 172.21.15.62:0/3254035435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f025c0b57e0 0x7f025c153470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f025c153aa0 tx=0x7f024c008040).stop 2021-12-17T18:18:16.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.002+0000 7f0262dbe700 1 -- 172.21.15.62:0/3254035435 shutdown_connections 2021-12-17T18:18:16.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.002+0000 7f0262dbe700 1 --2- 172.21.15.62:0/3254035435 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f023c053640 0x7f023c055b00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.002+0000 7f0262dbe700 1 --2- 172.21.15.62:0/3254035435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f025c0b57e0 0x7f025c153470 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.002+0000 7f0262dbe700 1 --2- 172.21.15.62:0/3254035435 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f025c0ad360 0x7f025c152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.002+0000 7f0262dbe700 1 --2- 172.21.15.62:0/3254035435 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f025c05ffe0 0x7f025c0b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.002+0000 7f0262dbe700 1 -- 172.21.15.62:0/3254035435 >> 172.21.15.62:0/3254035435 conn(0x7f025c0626d0 msgr2=0x7f025c1433c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:16.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.002+0000 7f0262dbe700 1 -- 172.21.15.62:0/3254035435 shutdown_connections 2021-12-17T18:18:16.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.002+0000 7f0262dbe700 1 -- 172.21.15.62:0/3254035435 wait complete. 2021-12-17T18:18:16.020 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-12-17T18:18:16.020 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:18:16.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb0b59e700 1 Processor -- start 2021-12-17T18:18:16.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb0b59e700 1 -- start start 2021-12-17T18:18:16.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb0b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffb0c05f730 0x7ffb0c0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb0b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0c066170 con 0x7ffb0c0b2850 2021-12-17T18:18:16.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb0b59e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0c066410 con 0x7ffb0c05c8f0 2021-12-17T18:18:16.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb0b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0c147040 con 0x7ffb0c05f730 2021-12-17T18:18:16.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb09d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffb0c05f730 0x7ffb0c0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb0ad9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ffb0c0b2850 0x7ffb0c13cda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59476/0 (socket says 172.21.15.62:59476) 2021-12-17T18:18:16.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb0ad9d700 1 -- 172.21.15.62:0/2227793022 learned_addr learned my addr 172.21.15.62:0/2227793022 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:16.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb0959a700 1 -- 172.21.15.62:0/2227793022 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439633550 0 0) 0x7ffb0c066170 con 0x7ffb0c0b2850 2021-12-17T18:18:16.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb0959a700 1 -- 172.21.15.62:0/2227793022 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaf0003260 con 0x7ffb0c0b2850 2021-12-17T18:18:16.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb09d9b700 1 -- 172.21.15.62:0/2227793022 >> v1:172.21.15.109:6789/0 conn(0x7ffb0c05c8f0 legacy=0x7ffb0c146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb09d9b700 1 -- 172.21.15.62:0/2227793022 >> v1:172.21.15.62:6789/0 conn(0x7ffb0c0b2850 legacy=0x7ffb0c13cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb09d9b700 1 -- 172.21.15.62:0/2227793022 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c0b1ec0 con 0x7ffb0c05f730 2021-12-17T18:18:16.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb09d9b700 1 --2- 172.21.15.62:0/2227793022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb0c05f730 0x7ffb0c0b2360 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ffb00002f70 tx=0x7ffb00006df0).ready entity=mon.0 client_cookie=175c5fc605b65ad9 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:16.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb0959a700 1 -- 172.21.15.62:0/2227793022 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb0000d610 con 0x7ffb0c05f730 2021-12-17T18:18:16.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb0959a700 1 -- 172.21.15.62:0/2227793022 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb00000e90 con 0x7ffb0c05f730 2021-12-17T18:18:16.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.126+0000 7ffb0959a700 1 -- 172.21.15.62:0/2227793022 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb0000d960 con 0x7ffb0c05f730 2021-12-17T18:18:16.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.130+0000 7ffb0b59e700 1 -- 172.21.15.62:0/2227793022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb0c05f730 msgr2=0x7ffb0c0b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.130+0000 7ffb0b59e700 1 --2- 172.21.15.62:0/2227793022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb0c05f730 0x7ffb0c0b2360 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ffb00002f70 tx=0x7ffb00006df0).stop 2021-12-17T18:18:16.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.130+0000 7ffb0b59e700 1 -- 172.21.15.62:0/2227793022 shutdown_connections 2021-12-17T18:18:16.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.130+0000 7ffb0b59e700 1 --2- 172.21.15.62:0/2227793022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb0c05f730 0x7ffb0c0b2360 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.130+0000 7ffb0b59e700 1 -- 172.21.15.62:0/2227793022 >> 172.21.15.62:0/2227793022 conn(0x7ffb0c05bcd0 msgr2=0x7ffb0c062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:16.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.130+0000 7ffb0b59e700 1 -- 172.21.15.62:0/2227793022 shutdown_connections 2021-12-17T18:18:16.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.130+0000 7ffb0b59e700 1 -- 172.21.15.62:0/2227793022 wait complete. 2021-12-17T18:18:16.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.130+0000 7ffb0b59e700 1 Processor -- start 2021-12-17T18:18:16.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.130+0000 7ffb0b59e700 1 -- start start 2021-12-17T18:18:16.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb0c05c8f0 0x7ffb0c0b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb0c05f730 0x7ffb0c13f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0b59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb0c0b2850 0x7ffb0c13f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c1164f0 con 0x7ffb0c05c8f0 2021-12-17T18:18:16.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0b59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0af870 con 0x7ffb0c0b2850 2021-12-17T18:18:16.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c13fe30 con 0x7ffb0c05f730 2021-12-17T18:18:16.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb0c05c8f0 0x7ffb0c0b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb0c05c8f0 0x7ffb0c0b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47666/0 (socket says 172.21.15.62:47666) 2021-12-17T18:18:16.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0a59c700 1 -- 172.21.15.62:0/1274922907 learned_addr learned my addr 172.21.15.62:0/1274922907 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:16.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb09d9b700 1 --2- 172.21.15.62:0/1274922907 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb0c05f730 0x7ffb0c13f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0ad9d700 1 --2- 172.21.15.62:0/1274922907 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb0c0b2850 0x7ffb0c13f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0a59c700 1 -- 172.21.15.62:0/1274922907 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb0c05f730 msgr2=0x7ffb0c13f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0a59c700 1 --2- 172.21.15.62:0/1274922907 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb0c05f730 0x7ffb0c13f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0a59c700 1 -- 172.21.15.62:0/1274922907 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb0c0b2850 msgr2=0x7ffb0c13f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0a59c700 1 --2- 172.21.15.62:0/1274922907 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb0c0b2850 0x7ffb0c13f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0a59c700 1 -- 172.21.15.62:0/1274922907 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0000b180 con 0x7ffb0c05c8f0 2021-12-17T18:18:16.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0a59c700 1 --2- 172.21.15.62:0/1274922907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb0c05c8f0 0x7ffb0c0b0ad0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ffb0c13ffc0 tx=0x7ffafc007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:16.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffafb7fe700 1 -- 172.21.15.62:0/1274922907 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffafc00ce20 con 0x7ffb0c05c8f0 2021-12-17T18:18:16.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffafb7fe700 1 -- 172.21.15.62:0/1274922907 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc00f470 con 0x7ffb0c05c8f0 2021-12-17T18:18:16.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0b59e700 1 -- 172.21.15.62:0/1274922907 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c116720 con 0x7ffb0c05c8f0 2021-12-17T18:18:16.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffafb7fe700 1 -- 172.21.15.62:0/1274922907 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffafc00f7d0 con 0x7ffb0c05c8f0 2021-12-17T18:18:16.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.134+0000 7ffb0b59e700 1 -- 172.21.15.62:0/1274922907 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c0b0fc0 con 0x7ffb0c05c8f0 2021-12-17T18:18:16.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.138+0000 7ffb0b59e700 1 -- 172.21.15.62:0/1274922907 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c0af040 con 0x7ffb0c05c8f0 2021-12-17T18:18:16.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.138+0000 7ffafb7fe700 1 -- 172.21.15.62:0/1274922907 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffafc019030 con 0x7ffb0c05c8f0 2021-12-17T18:18:16.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.138+0000 7ffafb7fe700 1 --2- 172.21.15.62:0/1274922907 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffae8053580 0x7ffae8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.138+0000 7ffafb7fe700 1 -- 172.21.15.62:0/1274922907 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ffafc06ab70 con 0x7ffb0c05c8f0 2021-12-17T18:18:16.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.138+0000 7ffb09d9b700 1 --2- 172.21.15.62:0/1274922907 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffae8053580 0x7ffae8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.138+0000 7ffb09d9b700 1 --2- 172.21.15.62:0/1274922907 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffae8053580 0x7ffae8055a40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ffb00018000 tx=0x7ffb00014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:16.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.146+0000 7ffafb7fe700 1 -- 172.21.15.62:0/1274922907 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffafc041e90 con 0x7ffb0c05c8f0 2021-12-17T18:18:16.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.270+0000 7ffb0b59e700 1 -- 172.21.15.62:0/1274922907 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ffb0c05fd80 con 0x7ffb0c05c8f0 2021-12-17T18:18:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.274+0000 7ffafb7fe700 1 -- 172.21.15.62:0/1274922907 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7ffafc0454b0 con 0x7ffb0c05c8f0 2021-12-17T18:18:16.278 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:18:16.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.274+0000 7ffb0b59e700 1 -- 172.21.15.62:0/1274922907 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffae8053580 msgr2=0x7ffae8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.274+0000 7ffb0b59e700 1 --2- 172.21.15.62:0/1274922907 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffae8053580 0x7ffae8055a40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ffb00018000 tx=0x7ffb00014000).stop 2021-12-17T18:18:16.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.274+0000 7ffb0b59e700 1 -- 172.21.15.62:0/1274922907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb0c05c8f0 msgr2=0x7ffb0c0b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.274+0000 7ffb0b59e700 1 --2- 172.21.15.62:0/1274922907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb0c05c8f0 0x7ffb0c0b0ad0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ffb0c13ffc0 tx=0x7ffafc007c50).stop 2021-12-17T18:18:16.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.274+0000 7ffb0b59e700 1 -- 172.21.15.62:0/1274922907 shutdown_connections 2021-12-17T18:18:16.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.274+0000 7ffb0b59e700 1 --2- 172.21.15.62:0/1274922907 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffae8053580 0x7ffae8055a40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.274+0000 7ffb0b59e700 1 --2- 172.21.15.62:0/1274922907 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb0c0b2850 0x7ffb0c13f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.274+0000 7ffb0b59e700 1 --2- 172.21.15.62:0/1274922907 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb0c05f730 0x7ffb0c13f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.274+0000 7ffb0b59e700 1 --2- 172.21.15.62:0/1274922907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb0c05c8f0 0x7ffb0c0b0ad0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.274+0000 7ffb0b59e700 1 -- 172.21.15.62:0/1274922907 >> 172.21.15.62:0/1274922907 conn(0x7ffb0c05bcd0 msgr2=0x7ffb0c140950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.274+0000 7ffb0b59e700 1 -- 172.21.15.62:0/1274922907 shutdown_connections 2021-12-17T18:18:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.274+0000 7ffb0b59e700 1 -- 172.21.15.62:0/1274922907 wait complete. 2021-12-17T18:18:16.291 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:18:16.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc4ddb7700 1 Processor -- start 2021-12-17T18:18:16.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc4ddb7700 1 -- start start 2021-12-17T18:18:16.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc4ddb7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efc48060260 0x7efc4805cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc4ddb7700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7efc48146f70 0x7efc480b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc4ddb7700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc48142ff0 con 0x7efc4805c750 2021-12-17T18:18:16.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc4ddb7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc481473e0 con 0x7efc48060260 2021-12-17T18:18:16.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc4ddb7700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc48143290 con 0x7efc48146f70 2021-12-17T18:18:16.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc46ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efc48060260 0x7efc4805cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc477fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7efc4805c750 0x7efc481439d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59486/0 (socket says 172.21.15.62:59486) 2021-12-17T18:18:16.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc477fe700 1 -- 172.21.15.62:0/1742626294 learned_addr learned my addr 172.21.15.62:0/1742626294 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:16.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc47fff700 1 --2- 172.21.15.62:0/1742626294 >> v2:172.21.15.109:3300/0 conn(0x7efc48146f70 0x7efc480b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc46ffd700 1 -- 172.21.15.62:0/1742626294 >> v2:172.21.15.109:3300/0 conn(0x7efc48146f70 msgr2=0x7efc480b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:16.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc46ffd700 1 --2- 172.21.15.62:0/1742626294 >> v2:172.21.15.109:3300/0 conn(0x7efc48146f70 0x7efc480b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc467fc700 1 -- 172.21.15.62:0/1742626294 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141214061 0 0) 0x7efc48142ff0 con 0x7efc4805c750 2021-12-17T18:18:16.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc46ffd700 1 -- 172.21.15.62:0/1742626294 >> v1:172.21.15.62:6789/0 conn(0x7efc4805c750 legacy=0x7efc481439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc46ffd700 1 -- 172.21.15.62:0/1742626294 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc48143530 con 0x7efc48060260 2021-12-17T18:18:16.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc46ffd700 1 --2- 172.21.15.62:0/1742626294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc48060260 0x7efc4805cb30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7efc30002f70 tx=0x7efc30006df0).ready entity=mon.0 client_cookie=ecb1c77ce47c660f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:16.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc467fc700 1 -- 172.21.15.62:0/1742626294 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc3000d5c0 con 0x7efc48060260 2021-12-17T18:18:16.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc467fc700 1 -- 172.21.15.62:0/1742626294 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc30000e90 con 0x7efc48060260 2021-12-17T18:18:16.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.398+0000 7efc467fc700 1 -- 172.21.15.62:0/1742626294 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc3000d910 con 0x7efc48060260 2021-12-17T18:18:16.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.402+0000 7efc4ddb7700 1 -- 172.21.15.62:0/1742626294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc48060260 msgr2=0x7efc4805cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.402+0000 7efc4ddb7700 1 --2- 172.21.15.62:0/1742626294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc48060260 0x7efc4805cb30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7efc30002f70 tx=0x7efc30006df0).stop 2021-12-17T18:18:16.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.402+0000 7efc4ddb7700 1 -- 172.21.15.62:0/1742626294 shutdown_connections 2021-12-17T18:18:16.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.402+0000 7efc4ddb7700 1 --2- 172.21.15.62:0/1742626294 >> v2:172.21.15.109:3300/0 conn(0x7efc48146f70 0x7efc480b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.402+0000 7efc4ddb7700 1 --2- 172.21.15.62:0/1742626294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc48060260 0x7efc4805cb30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.402+0000 7efc4ddb7700 1 -- 172.21.15.62:0/1742626294 >> 172.21.15.62:0/1742626294 conn(0x7efc48062430 msgr2=0x7efc48062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:16.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.402+0000 7efc4ddb7700 1 -- 172.21.15.62:0/1742626294 shutdown_connections 2021-12-17T18:18:16.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.402+0000 7efc4ddb7700 1 -- 172.21.15.62:0/1742626294 wait complete. 2021-12-17T18:18:16.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.402+0000 7efc4ddb7700 1 Processor -- start 2021-12-17T18:18:16.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.402+0000 7efc4ddb7700 1 -- start start 2021-12-17T18:18:16.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.402+0000 7efc4ddb7700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efc4805c750 0x7efc4813e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.402+0000 7efc4ddb7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efc48060260 0x7efc48064550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.402+0000 7efc4ddb7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc48146f70 0x7efc48152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.402+0000 7efc4ddb7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc48153170 con 0x7efc48146f70 2021-12-17T18:18:16.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.402+0000 7efc4ddb7700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc48064f00 con 0x7efc4805c750 2021-12-17T18:18:16.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.402+0000 7efc4ddb7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc4813de90 con 0x7efc48060260 2021-12-17T18:18:16.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc47fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc48146f70 0x7efc48152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc47fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc48146f70 0x7efc48152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47682/0 (socket says 172.21.15.62:47682) 2021-12-17T18:18:16.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc47fff700 1 -- 172.21.15.62:0/2227896771 learned_addr learned my addr 172.21.15.62:0/2227896771 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:16.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc477fe700 1 --2- 172.21.15.62:0/2227896771 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efc4805c750 0x7efc4813e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc46ffd700 1 --2- 172.21.15.62:0/2227896771 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efc48060260 0x7efc48064550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc47fff700 1 -- 172.21.15.62:0/2227896771 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efc48060260 msgr2=0x7efc48064550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc47fff700 1 --2- 172.21.15.62:0/2227896771 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efc48060260 0x7efc48064550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc47fff700 1 -- 172.21.15.62:0/2227896771 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efc4805c750 msgr2=0x7efc4813e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc47fff700 1 --2- 172.21.15.62:0/2227896771 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efc4805c750 0x7efc4813e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc47fff700 1 -- 172.21.15.62:0/2227896771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3000b180 con 0x7efc48146f70 2021-12-17T18:18:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc477fe700 1 --2- 172.21.15.62:0/2227896771 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efc4805c750 0x7efc4813e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc47fff700 1 --2- 172.21.15.62:0/2227896771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc48146f70 0x7efc48152450 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7efc4000a000 tx=0x7efc40008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc44ff9700 1 -- 172.21.15.62:0/2227896771 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc400127e0 con 0x7efc48146f70 2021-12-17T18:18:16.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc44ff9700 1 -- 172.21.15.62:0/2227896771 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc40012940 con 0x7efc48146f70 2021-12-17T18:18:16.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc4ddb7700 1 -- 172.21.15.62:0/2227896771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc48064a40 con 0x7efc48146f70 2021-12-17T18:18:16.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc44ff9700 1 -- 172.21.15.62:0/2227896771 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc40012ca0 con 0x7efc48146f70 2021-12-17T18:18:16.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc4ddb7700 1 -- 172.21.15.62:0/2227896771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc48152b60 con 0x7efc48146f70 2021-12-17T18:18:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc4ddb7700 1 -- 172.21.15.62:0/2227896771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc480650c0 con 0x7efc48146f70 2021-12-17T18:18:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc44ff9700 1 -- 172.21.15.62:0/2227896771 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efc40013480 con 0x7efc48146f70 2021-12-17T18:18:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc44ff9700 1 --2- 172.21.15.62:0/2227896771 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efc2c053610 0x7efc2c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.406+0000 7efc44ff9700 1 -- 172.21.15.62:0/2227896771 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7efc4006bb40 con 0x7efc48146f70 2021-12-17T18:18:16.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.410+0000 7efc477fe700 1 --2- 172.21.15.62:0/2227896771 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efc2c053610 0x7efc2c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.410+0000 7efc477fe700 1 --2- 172.21.15.62:0/2227896771 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efc2c053610 0x7efc2c055ad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7efc3800b000 tx=0x7efc38009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:16.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.414+0000 7efc44ff9700 1 -- 172.21.15.62:0/2227896771 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efc40042ed0 con 0x7efc48146f70 2021-12-17T18:18:16.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.542+0000 7efc4ddb7700 1 -- 172.21.15.62:0/2227896771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efc481532b0 con 0x7efc48146f70 2021-12-17T18:18:16.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.542+0000 7efc44ff9700 1 -- 172.21.15.62:0/2227896771 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7efc40012e00 con 0x7efc48146f70 2021-12-17T18:18:16.549 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:16.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.546+0000 7efc4ddb7700 1 -- 172.21.15.62:0/2227896771 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efc2c053610 msgr2=0x7efc2c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.546+0000 7efc4ddb7700 1 --2- 172.21.15.62:0/2227896771 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efc2c053610 0x7efc2c055ad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7efc3800b000 tx=0x7efc38009040).stop 2021-12-17T18:18:16.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.546+0000 7efc4ddb7700 1 -- 172.21.15.62:0/2227896771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc48146f70 msgr2=0x7efc48152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.546+0000 7efc4ddb7700 1 --2- 172.21.15.62:0/2227896771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc48146f70 0x7efc48152450 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7efc4000a000 tx=0x7efc40008040).stop 2021-12-17T18:18:16.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.546+0000 7efc4ddb7700 1 -- 172.21.15.62:0/2227896771 shutdown_connections 2021-12-17T18:18:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.546+0000 7efc4ddb7700 1 --2- 172.21.15.62:0/2227896771 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efc2c053610 0x7efc2c055ad0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.546+0000 7efc4ddb7700 1 --2- 172.21.15.62:0/2227896771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc48146f70 0x7efc48152450 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.546+0000 7efc4ddb7700 1 --2- 172.21.15.62:0/2227896771 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efc48060260 0x7efc48064550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.546+0000 7efc4ddb7700 1 --2- 172.21.15.62:0/2227896771 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efc4805c750 0x7efc4813e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.546+0000 7efc4ddb7700 1 -- 172.21.15.62:0/2227896771 >> 172.21.15.62:0/2227896771 conn(0x7efc48062430 msgr2=0x7efc4813ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:16.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.546+0000 7efc4ddb7700 1 -- 172.21.15.62:0/2227896771 shutdown_connections 2021-12-17T18:18:16.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.546+0000 7efc4ddb7700 1 -- 172.21.15.62:0/2227896771 wait complete. 2021-12-17T18:18:16.561 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-12-17T18:18:16.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a9314700 1 Processor -- start 2021-12-17T18:18:16.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a9314700 1 -- start start 2021-12-17T18:18:16.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a9314700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb1a40b5b20 0x7fb1a40b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a9314700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a40b5f00 con 0x7fb1a40b3760 2021-12-17T18:18:16.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a9314700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a40b3020 con 0x7fb1a41458d0 2021-12-17T18:18:16.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a9314700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a40b32c0 con 0x7fb1a40b5b20 2021-12-17T18:18:16.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb1a40b5b20 0x7fb1a40b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb1a40b5b20 0x7fb1a40b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47688/0 (socket says 172.21.15.62:47688) 2021-12-17T18:18:16.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a3fff700 1 -- 172.21.15.62:0/2536729279 learned_addr learned my addr 172.21.15.62:0/2536729279 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:16.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a3fff700 1 -- 172.21.15.62:0/2536729279 >> v1:172.21.15.109:6789/0 conn(0x7fb1a41458d0 legacy=0x7fb1a4145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:16.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a3fff700 1 -- 172.21.15.62:0/2536729279 >> v1:172.21.15.62:6789/0 conn(0x7fb1a40b3760 legacy=0x7fb1a40b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:16.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a3fff700 1 -- 172.21.15.62:0/2536729279 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a40b6e90 con 0x7fb1a40b5b20 2021-12-17T18:18:16.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a3fff700 1 --2- 172.21.15.62:0/2536729279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1a40b5b20 0x7fb1a40b6290 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb1a406a750 tx=0x7fb19c009290).ready entity=mon.0 client_cookie=b5792d0477131823 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:16.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a2ffd700 1 -- 172.21.15.62:0/2536729279 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb19c00b860 con 0x7fb1a40b5b20 2021-12-17T18:18:16.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a2ffd700 1 -- 172.21.15.62:0/2536729279 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c00b9c0 con 0x7fb1a40b5b20 2021-12-17T18:18:16.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a2ffd700 1 -- 172.21.15.62:0/2536729279 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb19c00bb30 con 0x7fb1a40b5b20 2021-12-17T18:18:16.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a9314700 1 -- 172.21.15.62:0/2536729279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1a40b5b20 msgr2=0x7fb1a40b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a9314700 1 --2- 172.21.15.62:0/2536729279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1a40b5b20 0x7fb1a40b6290 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb1a406a750 tx=0x7fb19c009290).stop 2021-12-17T18:18:16.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a9314700 1 -- 172.21.15.62:0/2536729279 shutdown_connections 2021-12-17T18:18:16.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a9314700 1 --2- 172.21.15.62:0/2536729279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1a40b5b20 0x7fb1a40b6290 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a9314700 1 -- 172.21.15.62:0/2536729279 >> 172.21.15.62:0/2536729279 conn(0x7fb1a405c750 msgr2=0x7fb1a405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:16.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a9314700 1 -- 172.21.15.62:0/2536729279 shutdown_connections 2021-12-17T18:18:16.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.662+0000 7fb1a9314700 1 -- 172.21.15.62:0/2536729279 wait complete. 2021-12-17T18:18:16.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a9314700 1 Processor -- start 2021-12-17T18:18:16.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a9314700 1 -- start start 2021-12-17T18:18:16.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a9314700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb1a40b5b20 0x7fb1a4143720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a9314700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1a41458d0 0x7fb1a41484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a9314700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb1a4146fb0 0x7fb1a41489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a9314700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a4149650 con 0x7fb1a41458d0 2021-12-17T18:18:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a9314700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a4146840 con 0x7fb1a40b5b20 2021-12-17T18:18:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a9314700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a4148e90 con 0x7fb1a4146fb0 2021-12-17T18:18:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1a41458d0 0x7fb1a41484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a3fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb1a40b5b20 0x7fb1a4143720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1a41458d0 0x7fb1a41484b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47698/0 (socket says 172.21.15.62:47698) 2021-12-17T18:18:16.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a37fe700 1 -- 172.21.15.62:0/3964876519 learned_addr learned my addr 172.21.15.62:0/3964876519 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:16.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a8b13700 1 --2- 172.21.15.62:0/3964876519 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb1a4146fb0 0x7fb1a41489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a37fe700 1 -- 172.21.15.62:0/3964876519 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb1a4146fb0 msgr2=0x7fb1a41489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a37fe700 1 --2- 172.21.15.62:0/3964876519 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb1a4146fb0 0x7fb1a41489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a37fe700 1 -- 172.21.15.62:0/3964876519 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb1a40b5b20 msgr2=0x7fb1a4143720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a37fe700 1 --2- 172.21.15.62:0/3964876519 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb1a40b5b20 0x7fb1a4143720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a37fe700 1 -- 172.21.15.62:0/3964876519 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c009530 con 0x7fb1a41458d0 2021-12-17T18:18:16.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a8b13700 1 --2- 172.21.15.62:0/3964876519 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb1a4146fb0 0x7fb1a41489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:16.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a3fff700 1 --2- 172.21.15.62:0/3964876519 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb1a40b5b20 0x7fb1a4143720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:16.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a37fe700 1 --2- 172.21.15.62:0/3964876519 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1a41458d0 0x7fb1a41484b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb1a40b97b0 tx=0x7fb18c007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:16.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a17fa700 1 -- 172.21.15.62:0/3964876519 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb18c007030 con 0x7fb1a41458d0 2021-12-17T18:18:16.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a17fa700 1 -- 172.21.15.62:0/3964876519 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c007190 con 0x7fb1a41458d0 2021-12-17T18:18:16.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a9314700 1 -- 172.21.15.62:0/3964876519 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a41474f0 con 0x7fb1a41458d0 2021-12-17T18:18:16.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a17fa700 1 -- 172.21.15.62:0/3964876519 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb18c006510 con 0x7fb1a41458d0 2021-12-17T18:18:16.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.666+0000 7fb1a9314700 1 -- 172.21.15.62:0/3964876519 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a4155e10 con 0x7fb1a41458d0 2021-12-17T18:18:16.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.670+0000 7fb1a9314700 1 -- 172.21.15.62:0/3964876519 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a4146680 con 0x7fb1a41458d0 2021-12-17T18:18:16.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.670+0000 7fb1a17fa700 1 -- 172.21.15.62:0/3964876519 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb18c010030 con 0x7fb1a41458d0 2021-12-17T18:18:16.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.670+0000 7fb1a17fa700 1 --2- 172.21.15.62:0/3964876519 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb17c0536d0 0x7fb17c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.670+0000 7fb1a17fa700 1 -- 172.21.15.62:0/3964876519 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb18c06b190 con 0x7fb1a41458d0 2021-12-17T18:18:16.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.670+0000 7fb1a3fff700 1 --2- 172.21.15.62:0/3964876519 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb17c0536d0 0x7fb17c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.670+0000 7fb1a3fff700 1 --2- 172.21.15.62:0/3964876519 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb17c0536d0 0x7fb17c055b90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb19c01b000 tx=0x7fb19c016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:16.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.674+0000 7fb1a17fa700 1 -- 172.21.15.62:0/3964876519 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb18c042580 con 0x7fb1a41458d0 2021-12-17T18:18:16.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.806+0000 7fb1a9314700 1 -- 172.21.15.62:0/3964876519 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb1a41450d0 con 0x7fb1a41458d0 2021-12-17T18:18:16.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.806+0000 7fb1a17fa700 1 -- 172.21.15.62:0/3964876519 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb18c045ba0 con 0x7fb1a41458d0 2021-12-17T18:18:16.813 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:16.813 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2021-12-17T18:18:16.814 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:16.814 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2021-12-17T18:18:16.814 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "device_health_metrics" 2021-12-17T18:18:16.815 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:16.815 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:16.815 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2021-12-17T18:18:16.815 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2021-12-17T18:18:16.815 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:16.816 INFO:teuthology.orchestra.run.smithi062.stdout:] 2021-12-17T18:18:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.810+0000 7fb1a9314700 1 -- 172.21.15.62:0/3964876519 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb17c0536d0 msgr2=0x7fb17c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.810+0000 7fb1a9314700 1 --2- 172.21.15.62:0/3964876519 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb17c0536d0 0x7fb17c055b90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb19c01b000 tx=0x7fb19c016000).stop 2021-12-17T18:18:16.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.810+0000 7fb1a9314700 1 -- 172.21.15.62:0/3964876519 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1a41458d0 msgr2=0x7fb1a41484b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.810+0000 7fb1a9314700 1 --2- 172.21.15.62:0/3964876519 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1a41458d0 0x7fb1a41484b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb1a40b97b0 tx=0x7fb18c007be0).stop 2021-12-17T18:18:16.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.810+0000 7fb1a9314700 1 -- 172.21.15.62:0/3964876519 shutdown_connections 2021-12-17T18:18:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.810+0000 7fb1a9314700 1 --2- 172.21.15.62:0/3964876519 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb17c0536d0 0x7fb17c055b90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.810+0000 7fb1a9314700 1 --2- 172.21.15.62:0/3964876519 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb1a4146fb0 0x7fb1a41489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.810+0000 7fb1a9314700 1 --2- 172.21.15.62:0/3964876519 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1a41458d0 0x7fb1a41484b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.810+0000 7fb1a9314700 1 --2- 172.21.15.62:0/3964876519 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb1a40b5b20 0x7fb1a4143720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.810+0000 7fb1a9314700 1 -- 172.21.15.62:0/3964876519 >> 172.21.15.62:0/3964876519 conn(0x7fb1a405c750 msgr2=0x7fb1a40aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.810+0000 7fb1a9314700 1 -- 172.21.15.62:0/3964876519 shutdown_connections 2021-12-17T18:18:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.810+0000 7fb1a9314700 1 -- 172.21.15.62:0/3964876519 wait complete. 2021-12-17T18:18:16.825 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-12-17T18:18:16.826 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-12-17T18:18:16.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.926+0000 7efdeb59e700 1 Processor -- start 2021-12-17T18:18:16.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.926+0000 7efdeb59e700 1 -- start start 2021-12-17T18:18:16.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.926+0000 7efdeb59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efdec0b2d00 0x7efdec0b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.926+0000 7efdeb59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7efdec0625b0 0x7efdec13fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.926+0000 7efdeb59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdec140140 con 0x7efdec062b60 2021-12-17T18:18:16.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.926+0000 7efdeb59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdec140e60 con 0x7efdec0b2d00 2021-12-17T18:18:16.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.926+0000 7efdeb59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdec0aecb0 con 0x7efdec0625b0 2021-12-17T18:18:16.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.926+0000 7efdea59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efdec0b2d00 0x7efdec0b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.926+0000 7efde9d9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7efdec062b60 0x7efdec139870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59516/0 (socket says 172.21.15.62:59516) 2021-12-17T18:18:16.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.926+0000 7efde9d9b700 1 -- 172.21.15.62:0/2686290882 learned_addr learned my addr 172.21.15.62:0/2686290882 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:16.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.926+0000 7efdead9d700 1 --2- 172.21.15.62:0/2686290882 >> v2:172.21.15.109:3300/0 conn(0x7efdec0625b0 0x7efdec13fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.930+0000 7efdea59c700 1 -- 172.21.15.62:0/2686290882 >> v2:172.21.15.109:3300/0 conn(0x7efdec0625b0 msgr2=0x7efdec13fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:16.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.930+0000 7efdea59c700 1 --2- 172.21.15.62:0/2686290882 >> v2:172.21.15.109:3300/0 conn(0x7efdec0625b0 0x7efdec13fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.930+0000 7efdea59c700 1 -- 172.21.15.62:0/2686290882 >> v1:172.21.15.62:6789/0 conn(0x7efdec062b60 legacy=0x7efdec139870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.930+0000 7efdea59c700 1 -- 172.21.15.62:0/2686290882 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec0aef50 con 0x7efdec0b2d00 2021-12-17T18:18:16.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.930+0000 7efdea59c700 1 --2- 172.21.15.62:0/2686290882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0b2d00 0x7efdec0b30e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7efddc0012a0 tx=0x7efdd4006df0).ready entity=mon.0 client_cookie=44da138eff0d218f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:16.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.930+0000 7efde959a700 1 -- 172.21.15.62:0/2686290882 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd400d4a0 con 0x7efdec0b2d00 2021-12-17T18:18:16.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.930+0000 7efde959a700 1 -- 172.21.15.62:0/2686290882 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd4000e90 con 0x7efdec0b2d00 2021-12-17T18:18:16.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.930+0000 7efde959a700 1 -- 172.21.15.62:0/2686290882 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd400d7f0 con 0x7efdec0b2d00 2021-12-17T18:18:16.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.930+0000 7efdeb59e700 1 -- 172.21.15.62:0/2686290882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0b2d00 msgr2=0x7efdec0b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.930+0000 7efdeb59e700 1 --2- 172.21.15.62:0/2686290882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0b2d00 0x7efdec0b30e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7efddc0012a0 tx=0x7efdd4006df0).stop 2021-12-17T18:18:16.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.930+0000 7efdeb59e700 1 -- 172.21.15.62:0/2686290882 shutdown_connections 2021-12-17T18:18:16.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.930+0000 7efdeb59e700 1 --2- 172.21.15.62:0/2686290882 >> v2:172.21.15.109:3300/0 conn(0x7efdec0625b0 0x7efdec13fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.930+0000 7efdeb59e700 1 --2- 172.21.15.62:0/2686290882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0b2d00 0x7efdec0b30e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.930+0000 7efdeb59e700 1 -- 172.21.15.62:0/2686290882 >> 172.21.15.62:0/2686290882 conn(0x7efdec060a50 msgr2=0x7efdec05bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:16.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.930+0000 7efdeb59e700 1 -- 172.21.15.62:0/2686290882 shutdown_connections 2021-12-17T18:18:16.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.930+0000 7efdeb59e700 1 -- 172.21.15.62:0/2686290882 wait complete. 2021-12-17T18:18:16.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdeb59e700 1 Processor -- start 2021-12-17T18:18:16.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdeb59e700 1 -- start start 2021-12-17T18:18:16.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdeb59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0625b0 0x7efdec13c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdeb59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efdec062b60 0x7efdec14ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdeb59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efdec0b2d00 0x7efdec0642f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdeb59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec066a50 con 0x7efdec0625b0 2021-12-17T18:18:16.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdeb59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec066e10 con 0x7efdec0b2d00 2021-12-17T18:18:16.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdeb59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdec13bf70 con 0x7efdec062b60 2021-12-17T18:18:16.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdea59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0625b0 0x7efdec13c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdea59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0625b0 0x7efdec13c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47708/0 (socket says 172.21.15.62:47708) 2021-12-17T18:18:16.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdea59c700 1 -- 172.21.15.62:0/292860979 learned_addr learned my addr 172.21.15.62:0/292860979 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:16.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efde9d9b700 1 --2- 172.21.15.62:0/292860979 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efdec062b60 0x7efdec14ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdead9d700 1 --2- 172.21.15.62:0/292860979 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efdec0b2d00 0x7efdec0642f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdea59c700 1 -- 172.21.15.62:0/292860979 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efdec062b60 msgr2=0x7efdec14ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdea59c700 1 --2- 172.21.15.62:0/292860979 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efdec062b60 0x7efdec14ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdea59c700 1 -- 172.21.15.62:0/292860979 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efdec0b2d00 msgr2=0x7efdec0642f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:16.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdea59c700 1 --2- 172.21.15.62:0/292860979 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efdec0b2d00 0x7efdec0642f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:16.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdea59c700 1 -- 172.21.15.62:0/292860979 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd400b180 con 0x7efdec0625b0 2021-12-17T18:18:16.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdead9d700 1 --2- 172.21.15.62:0/292860979 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efdec0b2d00 0x7efdec0642f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:18:16.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdea59c700 1 --2- 172.21.15.62:0/292860979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0625b0 0x7efdec13c700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7efddc0012a0 tx=0x7efdd4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:16.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efde37fe700 1 -- 172.21.15.62:0/292860979 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd4013a40 con 0x7efdec0625b0 2021-12-17T18:18:16.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efde37fe700 1 -- 172.21.15.62:0/292860979 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd4013ba0 con 0x7efdec0625b0 2021-12-17T18:18:16.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdeb59e700 1 -- 172.21.15.62:0/292860979 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdec067070 con 0x7efdec0625b0 2021-12-17T18:18:16.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efde37fe700 1 -- 172.21.15.62:0/292860979 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd401e400 con 0x7efdec0625b0 2021-12-17T18:18:16.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.934+0000 7efdeb59e700 1 -- 172.21.15.62:0/292860979 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdec0647e0 con 0x7efdec0625b0 2021-12-17T18:18:16.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.938+0000 7efdeb59e700 1 -- 172.21.15.62:0/292860979 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdec066370 con 0x7efdec0625b0 2021-12-17T18:18:16.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.938+0000 7efde37fe700 1 -- 172.21.15.62:0/292860979 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efdd4025030 con 0x7efdec0625b0 2021-12-17T18:18:16.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.938+0000 7efde37fe700 1 --2- 172.21.15.62:0/292860979 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efdd0053610 0x7efdd0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:16.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.938+0000 7efde37fe700 1 -- 172.21.15.62:0/292860979 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5253+0+0 (secure 0 0 0) 0x7efdd406c440 con 0x7efdec0625b0 2021-12-17T18:18:16.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.938+0000 7efde9d9b700 1 --2- 172.21.15.62:0/292860979 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efdd0053610 0x7efdd0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:16.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.938+0000 7efde9d9b700 1 --2- 172.21.15.62:0/292860979 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efdd0053610 0x7efdd0055ad0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7efddc00b000 tx=0x7efddc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:16.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:16.942+0000 7efde37fe700 1 -- 172.21.15.62:0/292860979 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efdd40438d0 con 0x7efdec0625b0 2021-12-17T18:18:17.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.070+0000 7efdeb59e700 1 -- 172.21.15.62:0/292860979 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7efdec0af1f0 con 0x7efdec0625b0 2021-12-17T18:18:17.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.850+0000 7efde37fe700 1 -- 172.21.15.62:0/292860979 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v20) v1 ==== 133+0+0 (secure 0 0 0) 0x7efdd4023020 con 0x7efdec0625b0 2021-12-17T18:18:17.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.858+0000 7efdeb59e700 1 -- 172.21.15.62:0/292860979 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efdd0053610 msgr2=0x7efdd0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:17.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.858+0000 7efdeb59e700 1 --2- 172.21.15.62:0/292860979 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efdd0053610 0x7efdd0055ad0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7efddc00b000 tx=0x7efddc009040).stop 2021-12-17T18:18:17.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.858+0000 7efdeb59e700 1 -- 172.21.15.62:0/292860979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0625b0 msgr2=0x7efdec13c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:17.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.858+0000 7efdeb59e700 1 --2- 172.21.15.62:0/292860979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0625b0 0x7efdec13c700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7efddc0012a0 tx=0x7efdd4014000).stop 2021-12-17T18:18:17.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.858+0000 7efdeb59e700 1 -- 172.21.15.62:0/292860979 shutdown_connections 2021-12-17T18:18:17.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.858+0000 7efdeb59e700 1 --2- 172.21.15.62:0/292860979 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efdd0053610 0x7efdd0055ad0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0x7efddc00b000 tx=0x7efddc009040).stop 2021-12-17T18:18:17.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.858+0000 7efdeb59e700 1 --2- 172.21.15.62:0/292860979 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efdec0b2d00 0x7efdec0642f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:17.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.858+0000 7efdeb59e700 1 --2- 172.21.15.62:0/292860979 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efdec062b60 0x7efdec14ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:17.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.858+0000 7efdeb59e700 1 --2- 172.21.15.62:0/292860979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0625b0 0x7efdec13c700 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:17.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.858+0000 7efdeb59e700 1 -- 172.21.15.62:0/292860979 >> 172.21.15.62:0/292860979 conn(0x7efdec060a50 msgr2=0x7efdec139160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:17.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.858+0000 7efdeb59e700 1 -- 172.21.15.62:0/292860979 shutdown_connections 2021-12-17T18:18:17.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.862+0000 7efdeb59e700 1 -- 172.21.15.62:0/292860979 wait complete. 2021-12-17T18:18:17.866 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2021-12-17T18:18:17.878 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-12-17T18:18:17.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.986+0000 7fac4ddc3700 1 Processor -- start 2021-12-17T18:18:17.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.986+0000 7fac4ddc3700 1 -- start start 2021-12-17T18:18:17.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.986+0000 7fac4ddc3700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fac480b2540 0x7fac480b2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:17.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.986+0000 7fac4ddc3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fac480b04b0 0x7fac48146d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:17.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.986+0000 7fac4ddc3700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac480b2320 con 0x7fac4805bcd0 2021-12-17T18:18:17.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.986+0000 7fac4ddc3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac480ad410 con 0x7fac480b04b0 2021-12-17T18:18:17.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.986+0000 7fac4ddc3700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac481437f0 con 0x7fac480b2540 2021-12-17T18:18:17.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.986+0000 7fac4d5c2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fac480b04b0 0x7fac48146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:17.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.986+0000 7fac4d5c2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fac480b04b0 0x7fac48146d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47720/0 (socket says 172.21.15.62:47720) 2021-12-17T18:18:17.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.986+0000 7fac4d5c2700 1 -- 172.21.15.62:0/4253790241 learned_addr learned my addr 172.21.15.62:0/4253790241 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:17.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.986+0000 7fac4cdc1700 1 --2- 172.21.15.62:0/4253790241 >> v2:172.21.15.109:3300/0 conn(0x7fac480b2540 0x7fac480b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:17.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.986+0000 7fac4d5c2700 1 -- 172.21.15.62:0/4253790241 >> v2:172.21.15.109:3300/0 conn(0x7fac480b2540 msgr2=0x7fac480b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:17.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.986+0000 7fac4d5c2700 1 --2- 172.21.15.62:0/4253790241 >> v2:172.21.15.109:3300/0 conn(0x7fac480b2540 0x7fac480b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:17.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.986+0000 7fac4d5c2700 1 -- 172.21.15.62:0/4253790241 >> v1:172.21.15.109:6789/0 conn(0x7fac4805bcd0 legacy=0x7fac481430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:17.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.986+0000 7fac4d5c2700 1 -- 172.21.15.62:0/4253790241 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac480b11a0 con 0x7fac480b04b0 2021-12-17T18:18:17.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4d5c2700 1 --2- 172.21.15.62:0/4253790241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac480b04b0 0x7fac48146d20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fac400032f0 tx=0x7fac40009290).ready entity=mon.0 client_cookie=cc00c9945f64a42c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:18.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac477fe700 1 -- 172.21.15.62:0/4253790241 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac4000b870 con 0x7fac480b04b0 2021-12-17T18:18:18.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac477fe700 1 -- 172.21.15.62:0/4253790241 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4000b9d0 con 0x7fac480b04b0 2021-12-17T18:18:18.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac477fe700 1 -- 172.21.15.62:0/4253790241 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac4000bb40 con 0x7fac480b04b0 2021-12-17T18:18:18.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4ddc3700 1 -- 172.21.15.62:0/4253790241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac480b04b0 msgr2=0x7fac48146d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:18.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4ddc3700 1 --2- 172.21.15.62:0/4253790241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac480b04b0 0x7fac48146d20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fac400032f0 tx=0x7fac40009290).stop 2021-12-17T18:18:18.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4ddc3700 1 -- 172.21.15.62:0/4253790241 shutdown_connections 2021-12-17T18:18:18.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4ddc3700 1 --2- 172.21.15.62:0/4253790241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac480b04b0 0x7fac48146d20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:18.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4ddc3700 1 --2- 172.21.15.62:0/4253790241 >> v2:172.21.15.109:3300/0 conn(0x7fac480b2540 0x7fac480b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:18.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4ddc3700 1 -- 172.21.15.62:0/4253790241 >> 172.21.15.62:0/4253790241 conn(0x7fac4805c750 msgr2=0x7fac4805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:18.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4ddc3700 1 -- 172.21.15.62:0/4253790241 shutdown_connections 2021-12-17T18:18:18.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4ddc3700 1 -- 172.21.15.62:0/4253790241 wait complete. 2021-12-17T18:18:18.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4ddc3700 1 Processor -- start 2021-12-17T18:18:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4ddc3700 1 -- start start 2021-12-17T18:18:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4ddc3700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fac4805bcd0 0x7fac48065f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4ddc3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac480b04b0 0x7fac480b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4ddc3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fac480b2540 0x7fac48152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4ddc3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac480ac420 con 0x7fac480b04b0 2021-12-17T18:18:18.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4ddc3700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac481524a0 con 0x7fac4805bcd0 2021-12-17T18:18:18.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4ddc3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac48155920 con 0x7fac480b2540 2021-12-17T18:18:18.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac47fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac480b04b0 0x7fac480b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:18.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac47fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac480b04b0 0x7fac480b4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47724/0 (socket says 172.21.15.62:47724) 2021-12-17T18:18:18.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac47fff700 1 -- 172.21.15.62:0/572977013 learned_addr learned my addr 172.21.15.62:0/572977013 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:18.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4cdc1700 1 --2- 172.21.15.62:0/572977013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fac4805bcd0 0x7fac48065f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:18.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac4d5c2700 1 --2- 172.21.15.62:0/572977013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fac480b2540 0x7fac48152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:18.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac47fff700 1 -- 172.21.15.62:0/572977013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fac480b2540 msgr2=0x7fac48152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:18.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac47fff700 1 --2- 172.21.15.62:0/572977013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fac480b2540 0x7fac48152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:18.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac47fff700 1 -- 172.21.15.62:0/572977013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fac4805bcd0 msgr2=0x7fac48065f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:18.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac47fff700 1 --2- 172.21.15.62:0/572977013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fac4805bcd0 0x7fac48065f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:18.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.990+0000 7fac47fff700 1 -- 172.21.15.62:0/572977013 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac40009530 con 0x7fac480b04b0 2021-12-17T18:18:18.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.994+0000 7fac47fff700 1 --2- 172.21.15.62:0/572977013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac480b04b0 0x7fac480b4c10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fac4805d240 tx=0x7fac34007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:18.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.994+0000 7fac45ffb700 1 -- 172.21.15.62:0/572977013 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac34012400 con 0x7fac480b04b0 2021-12-17T18:18:18.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.994+0000 7fac45ffb700 1 -- 172.21.15.62:0/572977013 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac34012560 con 0x7fac480b04b0 2021-12-17T18:18:18.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.994+0000 7fac4ddc3700 1 -- 172.21.15.62:0/572977013 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac481526d0 con 0x7fac480b04b0 2021-12-17T18:18:18.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.994+0000 7fac45ffb700 1 -- 172.21.15.62:0/572977013 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac340128c0 con 0x7fac480b04b0 2021-12-17T18:18:18.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.994+0000 7fac4ddc3700 1 -- 172.21.15.62:0/572977013 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac48155bc0 con 0x7fac480b04b0 2021-12-17T18:18:18.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.994+0000 7fac45ffb700 1 -- 172.21.15.62:0/572977013 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fac34019030 con 0x7fac480b04b0 2021-12-17T18:18:18.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.994+0000 7fac4ddc3700 1 -- 172.21.15.62:0/572977013 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac48152860 con 0x7fac480b04b0 2021-12-17T18:18:18.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.998+0000 7fac45ffb700 1 --2- 172.21.15.62:0/572977013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fac28053610 0x7fac28055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:18.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.998+0000 7fac45ffb700 1 -- 172.21.15.62:0/572977013 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fac3406abc0 con 0x7fac480b04b0 2021-12-17T18:18:18.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.998+0000 7fac4cdc1700 1 --2- 172.21.15.62:0/572977013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fac28053610 0x7fac28055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:18.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:17.998+0000 7fac4cdc1700 1 --2- 172.21.15.62:0/572977013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fac28053610 0x7fac28055ad0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fac3c00b000 tx=0x7fac3c006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:18.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.002+0000 7fac45ffb700 1 -- 172.21.15.62:0/572977013 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fac34041d80 con 0x7fac480b04b0 2021-12-17T18:18:18.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.126+0000 7fac4ddc3700 1 -- 172.21.15.62:0/572977013 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fac48146880 con 0x7fac480b04b0 2021-12-17T18:18:18.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.854+0000 7fac45ffb700 1 -- 172.21.15.62:0/572977013 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v21) v1 ==== 125+0+0 (secure 0 0 0) 0x7fac340453a0 con 0x7fac480b04b0 2021-12-17T18:18:18.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.866+0000 7fac4ddc3700 1 -- 172.21.15.62:0/572977013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fac28053610 msgr2=0x7fac28055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.866+0000 7fac4ddc3700 1 --2- 172.21.15.62:0/572977013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fac28053610 0x7fac28055ad0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fac3c00b000 tx=0x7fac3c006df0).stop 2021-12-17T18:18:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.866+0000 7fac4ddc3700 1 -- 172.21.15.62:0/572977013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac480b04b0 msgr2=0x7fac480b4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:18.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.866+0000 7fac4ddc3700 1 --2- 172.21.15.62:0/572977013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac480b04b0 0x7fac480b4c10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fac4805d240 tx=0x7fac34007c50).stop 2021-12-17T18:18:18.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.866+0000 7fac4ddc3700 1 -- 172.21.15.62:0/572977013 shutdown_connections 2021-12-17T18:18:18.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.866+0000 7fac4ddc3700 1 --2- 172.21.15.62:0/572977013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fac28053610 0x7fac28055ad0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:18.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.866+0000 7fac4ddc3700 1 --2- 172.21.15.62:0/572977013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fac480b2540 0x7fac48152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:18.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.866+0000 7fac4ddc3700 1 --2- 172.21.15.62:0/572977013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac480b04b0 0x7fac480b4c10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.866+0000 7fac4ddc3700 1 --2- 172.21.15.62:0/572977013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fac4805bcd0 0x7fac48065f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.866+0000 7fac4ddc3700 1 -- 172.21.15.62:0/572977013 >> 172.21.15.62:0/572977013 conn(0x7fac4805c750 msgr2=0x7fac481430e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.866+0000 7fac4ddc3700 1 -- 172.21.15.62:0/572977013 shutdown_connections 2021-12-17T18:18:18.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.866+0000 7fac4ddc3700 1 -- 172.21.15.62:0/572977013 wait complete. 2021-12-17T18:18:18.875 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2021-12-17T18:18:18.884 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-12-17T18:18:18.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.986+0000 7fe415b16700 1 Processor -- start 2021-12-17T18:18:18.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.986+0000 7fe415b16700 1 -- start start 2021-12-17T18:18:18.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe415b16700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4100b4340 0x7fe4101471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:18.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe415b16700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe410142d70 0x7fe4100b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:18.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe415b16700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4100b09e0 con 0x7fe4100b51a0 2021-12-17T18:18:18.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe415b16700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4101467d0 con 0x7fe410142d70 2021-12-17T18:18:18.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe415b16700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe410146a70 con 0x7fe4100b4340 2021-12-17T18:18:18.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40effd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe4100b51a0 0x7fe410142660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59542/0 (socket says 172.21.15.62:59542) 2021-12-17T18:18:18.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40effd700 1 -- 172.21.15.62:0/192512458 learned_addr learned my addr 172.21.15.62:0/192512458 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:18.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40ffff700 1 --2- 172.21.15.62:0/192512458 >> v2:172.21.15.109:3300/0 conn(0x7fe410142d70 0x7fe4100b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:18.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40f7fe700 1 --2- 172.21.15.62:0/192512458 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4100b4340 0x7fe4101471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40e7fc700 1 -- 172.21.15.62:0/192512458 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959372655 0 0) 0x7fe4100b09e0 con 0x7fe4100b51a0 2021-12-17T18:18:19.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40e7fc700 1 -- 172.21.15.62:0/192512458 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3f0003260 con 0x7fe4100b51a0 2021-12-17T18:18:19.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40e7fc700 1 -- 172.21.15.62:0/192512458 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1294585004 0 0) 0x7fe3f0003260 con 0x7fe4100b51a0 2021-12-17T18:18:19.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40e7fc700 1 -- 172.21.15.62:0/192512458 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4100b4340 msgr2=0x7fe4101471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:19.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40e7fc700 1 --2- 172.21.15.62:0/192512458 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4100b4340 0x7fe4101471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40e7fc700 1 -- 172.21.15.62:0/192512458 >> v2:172.21.15.109:3300/0 conn(0x7fe410142d70 msgr2=0x7fe4100b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:19.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40e7fc700 1 --2- 172.21.15.62:0/192512458 >> v2:172.21.15.109:3300/0 conn(0x7fe410142d70 0x7fe4100b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40e7fc700 1 -- 172.21.15.62:0/192512458 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe410146d10 con 0x7fe4100b51a0 2021-12-17T18:18:19.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40e7fc700 1 -- 172.21.15.62:0/192512458 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fe400001660 con 0x7fe4100b51a0 2021-12-17T18:18:19.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40e7fc700 1 -- 172.21.15.62:0/192512458 >> v1:172.21.15.62:6789/0 conn(0x7fe4100b51a0 legacy=0x7fe410142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40e7fc700 1 --2- 172.21.15.62:0/192512458 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4100b4340 0x7fe3f0003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40e7fc700 1 --2- 172.21.15.62:0/192512458 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe3f0003c80 0x7fe3f0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40e7fc700 1 --2- 172.21.15.62:0/192512458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3f00049f0 0x7fe3f0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40e7fc700 1 -- 172.21.15.62:0/192512458 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4101467d0 con 0x7fe3f00049f0 2021-12-17T18:18:19.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40e7fc700 1 -- 172.21.15.62:0/192512458 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe410146a70 con 0x7fe3f0003c80 2021-12-17T18:18:19.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40e7fc700 1 -- 172.21.15.62:0/192512458 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f000b750 con 0x7fe4100b4340 2021-12-17T18:18:19.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40ffff700 1 --2- 172.21.15.62:0/192512458 >> v2:172.21.15.109:3300/0 conn(0x7fe410142d70 0x7fe4100b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:19.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40f7fe700 1 --2- 172.21.15.62:0/192512458 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4100b4340 0x7fe3f0003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40ffff700 1 --2- 172.21.15.62:0/192512458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3f00049f0 0x7fe3f0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40effd700 1 --2- 172.21.15.62:0/192512458 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe3f0003c80 0x7fe3f0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40ffff700 1 -- 172.21.15.62:0/192512458 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4100b4340 msgr2=0x7fe3f0003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:19.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40ffff700 1 --2- 172.21.15.62:0/192512458 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4100b4340 0x7fe3f0003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40ffff700 1 -- 172.21.15.62:0/192512458 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe3f0003c80 msgr2=0x7fe3f0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:19.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40ffff700 1 --2- 172.21.15.62:0/192512458 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe3f0003c80 0x7fe3f0004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40ffff700 1 -- 172.21.15.62:0/192512458 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f0003260 con 0x7fe3f00049f0 2021-12-17T18:18:19.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40f7fe700 1 --2- 172.21.15.62:0/192512458 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4100b4340 0x7fe3f0003750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:19.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.990+0000 7fe40ffff700 1 --2- 172.21.15.62:0/192512458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3f00049f0 0x7fe3f0004e70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe3f00054d0 tx=0x7fe4080091d0).ready entity=mon.0 client_cookie=9d17d69e1bb99200 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:19.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.994+0000 7fe40e7fc700 1 -- 172.21.15.62:0/192512458 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe40800eb10 con 0x7fe3f00049f0 2021-12-17T18:18:19.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.994+0000 7fe40e7fc700 1 -- 172.21.15.62:0/192512458 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40800ec70 con 0x7fe3f00049f0 2021-12-17T18:18:19.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.994+0000 7fe40e7fc700 1 -- 172.21.15.62:0/192512458 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4080123f0 con 0x7fe3f00049f0 2021-12-17T18:18:19.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.994+0000 7fe415b16700 1 -- 172.21.15.62:0/192512458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3f00049f0 msgr2=0x7fe3f0004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.994+0000 7fe415b16700 1 --2- 172.21.15.62:0/192512458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3f00049f0 0x7fe3f0004e70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe3f00054d0 tx=0x7fe4080091d0).stop 2021-12-17T18:18:19.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.994+0000 7fe40ffff700 1 -- 172.21.15.62:0/192512458 reap_dead start 2021-12-17T18:18:19.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.994+0000 7fe415b16700 1 -- 172.21.15.62:0/192512458 shutdown_connections 2021-12-17T18:18:19.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.994+0000 7fe415b16700 1 -- 172.21.15.62:0/192512458 >> 172.21.15.62:0/192512458 conn(0x7fe41005c750 msgr2=0x7fe41005cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:19.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.994+0000 7fe415b16700 1 -- 172.21.15.62:0/192512458 shutdown_connections 2021-12-17T18:18:19.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.994+0000 7fe415b16700 1 -- 172.21.15.62:0/192512458 wait complete. 2021-12-17T18:18:19.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.994+0000 7fe415b16700 1 Processor -- start 2021-12-17T18:18:19.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.994+0000 7fe415b16700 1 -- start start 2021-12-17T18:18:19.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe415b16700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4100b8af0 0x7fe4100a4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe415b16700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe410065500 0x7fe410156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe415b16700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe410156530 0x7fe410066480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe415b16700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe410155b50 con 0x7fe410156530 2021-12-17T18:18:19.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe415b16700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4100b8ed0 con 0x7fe410065500 2021-12-17T18:18:19.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe415b16700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4100a4ef0 con 0x7fe4100b8af0 2021-12-17T18:18:19.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe40ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe410156530 0x7fe410066480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe40ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe410156530 0x7fe410066480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47746/0 (socket says 172.21.15.62:47746) 2021-12-17T18:18:19.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe40ffff700 1 -- 172.21.15.62:0/2261729581 learned_addr learned my addr 172.21.15.62:0/2261729581 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:19.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe40effd700 1 --2- 172.21.15.62:0/2261729581 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe410065500 0x7fe410156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe40f7fe700 1 --2- 172.21.15.62:0/2261729581 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4100b8af0 0x7fe4100a4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe40ffff700 1 -- 172.21.15.62:0/2261729581 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4100b8af0 msgr2=0x7fe4100a4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe40ffff700 1 --2- 172.21.15.62:0/2261729581 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4100b8af0 0x7fe4100a4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe40ffff700 1 -- 172.21.15.62:0/2261729581 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe410065500 msgr2=0x7fe410156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe40ffff700 1 --2- 172.21.15.62:0/2261729581 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe410065500 0x7fe410156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe40ffff700 1 -- 172.21.15.62:0/2261729581 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4100a5190 con 0x7fe410156530 2021-12-17T18:18:19.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe40ffff700 1 --2- 172.21.15.62:0/2261729581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe410156530 0x7fe410066480 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe410060cc0 tx=0x7fe408019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:19.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe40cff9700 1 -- 172.21.15.62:0/2261729581 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe40800eb10 con 0x7fe410156530 2021-12-17T18:18:19.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe40cff9700 1 -- 172.21.15.62:0/2261729581 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe408022070 con 0x7fe410156530 2021-12-17T18:18:19.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe415b16700 1 -- 172.21.15.62:0/2261729581 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4100a5430 con 0x7fe410156530 2021-12-17T18:18:19.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe40cff9700 1 -- 172.21.15.62:0/2261729581 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe40801b640 con 0x7fe410156530 2021-12-17T18:18:19.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:18.998+0000 7fe415b16700 1 -- 172.21.15.62:0/2261729581 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe410066970 con 0x7fe410156530 2021-12-17T18:18:19.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.002+0000 7fe415b16700 1 -- 172.21.15.62:0/2261729581 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4100a4d40 con 0x7fe410156530 2021-12-17T18:18:19.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.002+0000 7fe40cff9700 1 -- 172.21.15.62:0/2261729581 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe40802e070 con 0x7fe410156530 2021-12-17T18:18:19.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.002+0000 7fe40cff9700 1 --2- 172.21.15.62:0/2261729581 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe3f40536d0 0x7fe3f4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.002+0000 7fe40cff9700 1 -- 172.21.15.62:0/2261729581 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fe40806da90 con 0x7fe410156530 2021-12-17T18:18:19.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.002+0000 7fe40f7fe700 1 --2- 172.21.15.62:0/2261729581 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe3f40536d0 0x7fe3f4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.002+0000 7fe40f7fe700 1 --2- 172.21.15.62:0/2261729581 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe3f40536d0 0x7fe3f4055b90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe3f800b000 tx=0x7fe3f8006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:19.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.006+0000 7fe40cff9700 1 -- 172.21.15.62:0/2261729581 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe4080485f0 con 0x7fe410156530 2021-12-17T18:18:19.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.170+0000 7fe415b16700 1 -- 172.21.15.62:0/2261729581 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fe4100a55c0 con 0x7fe410156530 2021-12-17T18:18:19.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.182+0000 7fe40cff9700 1 -- 172.21.15.62:0/2261729581 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 187+0+0 (secure 0 0 0) 0x7fe4080481e0 con 0x7fe410156530 2021-12-17T18:18:19.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.190+0000 7fe415b16700 1 -- 172.21.15.62:0/2261729581 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe3f40536d0 msgr2=0x7fe3f4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.190+0000 7fe415b16700 1 --2- 172.21.15.62:0/2261729581 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe3f40536d0 0x7fe3f4055b90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe3f800b000 tx=0x7fe3f8006df0).stop 2021-12-17T18:18:19.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.190+0000 7fe415b16700 1 -- 172.21.15.62:0/2261729581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe410156530 msgr2=0x7fe410066480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.190+0000 7fe415b16700 1 --2- 172.21.15.62:0/2261729581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe410156530 0x7fe410066480 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe410060cc0 tx=0x7fe408019000).stop 2021-12-17T18:18:19.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.190+0000 7fe415b16700 1 -- 172.21.15.62:0/2261729581 shutdown_connections 2021-12-17T18:18:19.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.190+0000 7fe415b16700 1 --2- 172.21.15.62:0/2261729581 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe3f40536d0 0x7fe3f4055b90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.190+0000 7fe415b16700 1 --2- 172.21.15.62:0/2261729581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe410156530 0x7fe410066480 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.190+0000 7fe415b16700 1 --2- 172.21.15.62:0/2261729581 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe410065500 0x7fe410156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.190+0000 7fe415b16700 1 --2- 172.21.15.62:0/2261729581 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4100b8af0 0x7fe4100a4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.190+0000 7fe415b16700 1 -- 172.21.15.62:0/2261729581 >> 172.21.15.62:0/2261729581 conn(0x7fe41005c750 msgr2=0x7fe4100b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:19.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.194+0000 7fe415b16700 1 -- 172.21.15.62:0/2261729581 shutdown_connections 2021-12-17T18:18:19.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.194+0000 7fe415b16700 1 -- 172.21.15.62:0/2261729581 wait complete. 2021-12-17T18:18:19.200 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 3 and data pool 4 2021-12-17T18:18:19.211 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:19.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.298+0000 7f4e511ad700 1 Processor -- start 2021-12-17T18:18:19.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.298+0000 7f4e511ad700 1 -- start start 2021-12-17T18:18:19.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e511ad700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e4c0b21f0 0x7f4e4c14aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e511ad700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4c0b2ce0 con 0x7f4e4c0b1730 2021-12-17T18:18:19.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e511ad700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4c0aca60 con 0x7f4e4c0a7bb0 2021-12-17T18:18:19.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e511ad700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c147870 con 0x7f4e4c0b21f0 2021-12-17T18:18:19.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e4a59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4e4c0b1730 0x7f4e4c0ace90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59574/0 (socket says 172.21.15.62:59574) 2021-12-17T18:18:19.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e4a59c700 1 -- 172.21.15.62:0/484398896 learned_addr learned my addr 172.21.15.62:0/484398896 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:19.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e4ad9d700 1 --2- 172.21.15.62:0/484398896 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e4c0b21f0 0x7f4e4c14aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 -- 172.21.15.62:0/484398896 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2089232968 0 0) 0x7f4e4c0b2ce0 con 0x7f4e4c0b1730 2021-12-17T18:18:19.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 -- 172.21.15.62:0/484398896 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e30003260 con 0x7f4e4c0b1730 2021-12-17T18:18:19.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 -- 172.21.15.62:0/484398896 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191739288 0 0) 0x7f4e4c0aca60 con 0x7f4e4c0a7bb0 2021-12-17T18:18:19.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 -- 172.21.15.62:0/484398896 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e4c0b2ce0 con 0x7f4e4c0a7bb0 2021-12-17T18:18:19.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 -- 172.21.15.62:0/484398896 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3698077705 0 0) 0x7f4e30003260 con 0x7f4e4c0b1730 2021-12-17T18:18:19.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 -- 172.21.15.62:0/484398896 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e4c0b21f0 msgr2=0x7f4e4c14aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:19.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 --2- 172.21.15.62:0/484398896 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e4c0b21f0 0x7f4e4c14aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 -- 172.21.15.62:0/484398896 >> v1:172.21.15.109:6789/0 conn(0x7f4e4c0a7bb0 legacy=0x7f4e4c067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 -- 172.21.15.62:0/484398896 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c0b2f10 con 0x7f4e4c0b1730 2021-12-17T18:18:19.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 -- 172.21.15.62:0/484398896 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f4e40001660 con 0x7f4e4c0b1730 2021-12-17T18:18:19.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 -- 172.21.15.62:0/484398896 >> v1:172.21.15.62:6789/0 conn(0x7f4e4c0b1730 legacy=0x7f4e4c0ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 --2- 172.21.15.62:0/484398896 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e30004970 0x7f4e30004d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 --2- 172.21.15.62:0/484398896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e300034a0 0x7f4e30003920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 --2- 172.21.15.62:0/484398896 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e4c0b21f0 0x7f4e30003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 -- 172.21.15.62:0/484398896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3000b750 con 0x7f4e300034a0 2021-12-17T18:18:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 -- 172.21.15.62:0/484398896 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3000b8c0 con 0x7f4e30004970 2021-12-17T18:18:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 -- 172.21.15.62:0/484398896 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3000ba80 con 0x7f4e4c0b21f0 2021-12-17T18:18:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e4a59c700 1 --2- 172.21.15.62:0/484398896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e300034a0 0x7f4e30003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e4ad9d700 1 --2- 172.21.15.62:0/484398896 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e30004970 0x7f4e30004d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e4b59e700 1 --2- 172.21.15.62:0/484398896 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e4c0b21f0 0x7f4e30003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e4a59c700 1 -- 172.21.15.62:0/484398896 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e4c0b21f0 msgr2=0x7f4e30003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:19.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e4a59c700 1 --2- 172.21.15.62:0/484398896 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e4c0b21f0 0x7f4e30003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e4a59c700 1 -- 172.21.15.62:0/484398896 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e30004970 msgr2=0x7f4e30004d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:19.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e4a59c700 1 --2- 172.21.15.62:0/484398896 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e30004970 0x7f4e30004d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e4a59c700 1 -- 172.21.15.62:0/484398896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e30003260 con 0x7f4e300034a0 2021-12-17T18:18:19.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e4a59c700 1 --2- 172.21.15.62:0/484398896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e300034a0 0x7f4e30003920 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4e40001430 tx=0x7f4e4c0b31b0).ready entity=mon.0 client_cookie=59e8be6c96b9f3af server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:19.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 -- 172.21.15.62:0/484398896 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e400071a0 con 0x7f4e300034a0 2021-12-17T18:18:19.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 -- 172.21.15.62:0/484398896 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e40007300 con 0x7f4e300034a0 2021-12-17T18:18:19.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e49d9b700 1 -- 172.21.15.62:0/484398896 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e4000c8f0 con 0x7f4e300034a0 2021-12-17T18:18:19.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e511ad700 1 -- 172.21.15.62:0/484398896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e300034a0 msgr2=0x7f4e30003920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e511ad700 1 --2- 172.21.15.62:0/484398896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e300034a0 0x7f4e30003920 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4e40001430 tx=0x7f4e4c0b31b0).stop 2021-12-17T18:18:19.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.302+0000 7f4e4b59e700 1 -- 172.21.15.62:0/484398896 reap_dead start 2021-12-17T18:18:19.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.306+0000 7f4e511ad700 1 -- 172.21.15.62:0/484398896 shutdown_connections 2021-12-17T18:18:19.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.306+0000 7f4e511ad700 1 -- 172.21.15.62:0/484398896 >> 172.21.15.62:0/484398896 conn(0x7f4e4c05f730 msgr2=0x7f4e4c05fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:19.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.306+0000 7f4e511ad700 1 -- 172.21.15.62:0/484398896 shutdown_connections 2021-12-17T18:18:19.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.306+0000 7f4e511ad700 1 -- 172.21.15.62:0/484398896 wait complete. 2021-12-17T18:18:19.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.306+0000 7f4e511ad700 1 Processor -- start 2021-12-17T18:18:19.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.306+0000 7f4e511ad700 1 -- start start 2021-12-17T18:18:19.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.306+0000 7f4e511ad700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e300034a0 0x7f4e4c149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.306+0000 7f4e511ad700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e4c0a9a50 0x7f4e4c1468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e511ad700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e4c146de0 0x7f4e4c14a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e511ad700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c156ae0 con 0x7f4e300034a0 2021-12-17T18:18:19.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e511ad700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c0a95a0 con 0x7f4e4c0a9a50 2021-12-17T18:18:19.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e511ad700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c0a9800 con 0x7f4e4c146de0 2021-12-17T18:18:19.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e4ad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e300034a0 0x7f4e4c149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e4ad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e300034a0 0x7f4e4c149590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47772/0 (socket says 172.21.15.62:47772) 2021-12-17T18:18:19.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e4ad9d700 1 -- 172.21.15.62:0/1206650005 learned_addr learned my addr 172.21.15.62:0/1206650005 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:19.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e4b59e700 1 --2- 172.21.15.62:0/1206650005 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e4c146de0 0x7f4e4c14a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e4a59c700 1 --2- 172.21.15.62:0/1206650005 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e4c0a9a50 0x7f4e4c1468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e4ad9d700 1 -- 172.21.15.62:0/1206650005 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e4c146de0 msgr2=0x7f4e4c14a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e4ad9d700 1 --2- 172.21.15.62:0/1206650005 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e4c146de0 0x7f4e4c14a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e4ad9d700 1 -- 172.21.15.62:0/1206650005 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e4c0a9a50 msgr2=0x7f4e4c1468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e4ad9d700 1 --2- 172.21.15.62:0/1206650005 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e4c0a9a50 0x7f4e4c1468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e4ad9d700 1 -- 172.21.15.62:0/1206650005 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c14a080 con 0x7f4e300034a0 2021-12-17T18:18:19.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e4a59c700 1 --2- 172.21.15.62:0/1206650005 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e4c0a9a50 0x7f4e4c1468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:19.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e4ad9d700 1 --2- 172.21.15.62:0/1206650005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e300034a0 0x7f4e4c149590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4e4400b000 tx=0x7f4e440091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:19.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e3bfff700 1 -- 172.21.15.62:0/1206650005 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e4400fac0 con 0x7f4e300034a0 2021-12-17T18:18:19.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e3bfff700 1 -- 172.21.15.62:0/1206650005 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4400fc20 con 0x7f4e300034a0 2021-12-17T18:18:19.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e511ad700 1 -- 172.21.15.62:0/1206650005 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4c147290 con 0x7f4e300034a0 2021-12-17T18:18:19.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e3bfff700 1 -- 172.21.15.62:0/1206650005 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e4400fdd0 con 0x7f4e300034a0 2021-12-17T18:18:19.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e511ad700 1 -- 172.21.15.62:0/1206650005 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4c14be30 con 0x7f4e300034a0 2021-12-17T18:18:19.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e511ad700 1 -- 172.21.15.62:0/1206650005 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4c147480 con 0x7f4e300034a0 2021-12-17T18:18:19.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e3bfff700 1 -- 172.21.15.62:0/1206650005 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4e44024070 con 0x7f4e300034a0 2021-12-17T18:18:19.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e3bfff700 1 --2- 172.21.15.62:0/1206650005 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4e280536d0 0x7f4e28055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e3bfff700 1 -- 172.21.15.62:0/1206650005 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4e4406c620 con 0x7f4e300034a0 2021-12-17T18:18:19.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.310+0000 7f4e4a59c700 1 --2- 172.21.15.62:0/1206650005 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4e280536d0 0x7f4e28055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.314+0000 7f4e4a59c700 1 --2- 172.21.15.62:0/1206650005 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4e280536d0 0x7f4e28055b90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4e40019000 tx=0x7f4e40013000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:19.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.314+0000 7f4e3bfff700 1 -- 172.21.15.62:0/1206650005 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4e4c147480 con 0x7f4e300034a0 2021-12-17T18:18:19.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.442+0000 7f4e511ad700 1 -- 172.21.15.62:0/1206650005 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e4c147480 con 0x7f4e300034a0 2021-12-17T18:18:19.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.446+0000 7f4e3bfff700 1 -- 172.21.15.62:0/1206650005 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16099 (secure 0 0 0) 0x7f4e4c147480 con 0x7f4e300034a0 2021-12-17T18:18:19.450 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:19.451 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":22,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:19.175364+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:17.128555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:18.180577+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:19.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.446+0000 7f4e511ad700 1 -- 172.21.15.62:0/1206650005 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4e280536d0 msgr2=0x7f4e28055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.446+0000 7f4e511ad700 1 --2- 172.21.15.62:0/1206650005 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4e280536d0 0x7f4e28055b90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4e40019000 tx=0x7f4e40013000).stop 2021-12-17T18:18:19.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.446+0000 7f4e511ad700 1 -- 172.21.15.62:0/1206650005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e300034a0 msgr2=0x7f4e4c149590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.446+0000 7f4e511ad700 1 --2- 172.21.15.62:0/1206650005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e300034a0 0x7f4e4c149590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4e4400b000 tx=0x7f4e440091d0).stop 2021-12-17T18:18:19.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.446+0000 7f4e511ad700 1 -- 172.21.15.62:0/1206650005 shutdown_connections 2021-12-17T18:18:19.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.446+0000 7f4e511ad700 1 --2- 172.21.15.62:0/1206650005 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4e280536d0 0x7f4e28055b90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.446+0000 7f4e511ad700 1 --2- 172.21.15.62:0/1206650005 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e4c146de0 0x7f4e4c14a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.446+0000 7f4e511ad700 1 --2- 172.21.15.62:0/1206650005 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e4c0a9a50 0x7f4e4c1468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.446+0000 7f4e511ad700 1 --2- 172.21.15.62:0/1206650005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e300034a0 0x7f4e4c149590 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.446+0000 7f4e511ad700 1 -- 172.21.15.62:0/1206650005 >> 172.21.15.62:0/1206650005 conn(0x7f4e4c05f730 msgr2=0x7f4e4c147c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:19.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.446+0000 7f4e511ad700 1 -- 172.21.15.62:0/1206650005 shutdown_connections 2021-12-17T18:18:19.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.446+0000 7f4e511ad700 1 -- 172.21.15.62:0/1206650005 wait complete. 2021-12-17T18:18:19.464 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:19.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.558+0000 7fdeb1898700 1 Processor -- start 2021-12-17T18:18:19.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.558+0000 7fdeb1898700 1 -- start start 2021-12-17T18:18:19.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeb1898700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdeac0a7bb0 0x7fdeac067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeb1898700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac0b2ce0 con 0x7fdeac0b1730 2021-12-17T18:18:19.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeb1898700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac0aca60 con 0x7fdeac0b21f0 2021-12-17T18:18:19.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeb1898700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac14b5b0 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeab7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdeac0a7bb0 0x7fdeac067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeab7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdeac0a7bb0 0x7fdeac067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47784/0 (socket says 172.21.15.62:47784) 2021-12-17T18:18:19.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeaa7fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdeac0b1730 0x7fdeac0ace90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59592/0 (socket says 172.21.15.62:59592) 2021-12-17T18:18:19.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeab7fe700 1 -- 172.21.15.62:0/2897865426 learned_addr learned my addr 172.21.15.62:0/2897865426 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:19.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeab7fe700 1 -- 172.21.15.62:0/2897865426 >> v1:172.21.15.109:6789/0 conn(0x7fdeac0b21f0 legacy=0x7fdeac14aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:19.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeab7fe700 1 -- 172.21.15.62:0/2897865426 >> v1:172.21.15.62:6789/0 conn(0x7fdeac0b1730 legacy=0x7fdeac0ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeab7fe700 1 -- 172.21.15.62:0/2897865426 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac0b2f10 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeab7fe700 1 --2- 172.21.15.62:0/2897865426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdeac0a7bb0 0x7fdeac067120 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fdeac061080 tx=0x7fdea4006eb0).ready entity=mon.0 client_cookie=61ebea400714f56 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:19.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdea9ffb700 1 -- 172.21.15.62:0/2897865426 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdea400d5c0 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdea9ffb700 1 -- 172.21.15.62:0/2897865426 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea4000e90 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdea9ffb700 1 -- 172.21.15.62:0/2897865426 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdea400d950 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeb1898700 1 -- 172.21.15.62:0/2897865426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdeac0a7bb0 msgr2=0x7fdeac067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeb1898700 1 --2- 172.21.15.62:0/2897865426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdeac0a7bb0 0x7fdeac067120 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fdeac061080 tx=0x7fdea4006eb0).stop 2021-12-17T18:18:19.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeb1898700 1 -- 172.21.15.62:0/2897865426 shutdown_connections 2021-12-17T18:18:19.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeb1898700 1 --2- 172.21.15.62:0/2897865426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdeac0a7bb0 0x7fdeac067120 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeb1898700 1 -- 172.21.15.62:0/2897865426 >> 172.21.15.62:0/2897865426 conn(0x7fdeac05f730 msgr2=0x7fdeac05fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:19.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeb1898700 1 -- 172.21.15.62:0/2897865426 shutdown_connections 2021-12-17T18:18:19.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.562+0000 7fdeb1898700 1 -- 172.21.15.62:0/2897865426 wait complete. 2021-12-17T18:18:19.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.566+0000 7fdeb1898700 1 Processor -- start 2021-12-17T18:18:19.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.566+0000 7fdeb1898700 1 -- start start 2021-12-17T18:18:19.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.566+0000 7fdeb1898700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdeac0a7bb0 0x7fdeac0a9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.566+0000 7fdeb1898700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdeac0b1730 0x7fdeac157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.566+0000 7fdeb1898700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdeac0b21f0 0x7fdeac157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.566+0000 7fdeb1898700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac14da80 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.566+0000 7fdeb1898700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac063a30 con 0x7fdeac0b21f0 2021-12-17T18:18:19.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.566+0000 7fdeb1898700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac063cd0 con 0x7fdeac0b1730 2021-12-17T18:18:19.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.566+0000 7fdeaaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdeac0a7bb0 0x7fdeac0a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.566+0000 7fdeaaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdeac0a7bb0 0x7fdeac0a9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47786/0 (socket says 172.21.15.62:47786) 2021-12-17T18:18:19.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.566+0000 7fdeaaffd700 1 -- 172.21.15.62:0/3487000741 learned_addr learned my addr 172.21.15.62:0/3487000741 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:19.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.566+0000 7fdeab7fe700 1 --2- 172.21.15.62:0/3487000741 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdeac0b21f0 0x7fdeac157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.566+0000 7fdeaa7fc700 1 --2- 172.21.15.62:0/3487000741 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdeac0b1730 0x7fdeac157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.570+0000 7fdeaaffd700 1 -- 172.21.15.62:0/3487000741 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdeac0b1730 msgr2=0x7fdeac157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.570+0000 7fdeaaffd700 1 --2- 172.21.15.62:0/3487000741 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdeac0b1730 0x7fdeac157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.570+0000 7fdeaaffd700 1 -- 172.21.15.62:0/3487000741 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdeac0b21f0 msgr2=0x7fdeac157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.570+0000 7fdeaaffd700 1 --2- 172.21.15.62:0/3487000741 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdeac0b21f0 0x7fdeac157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.570+0000 7fdeaaffd700 1 -- 172.21.15.62:0/3487000741 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea400b1e0 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.570+0000 7fdeaa7fc700 1 --2- 172.21.15.62:0/3487000741 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdeac0b1730 0x7fdeac157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:19.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.570+0000 7fdeaaffd700 1 --2- 172.21.15.62:0/3487000741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdeac0a7bb0 0x7fdeac0a9770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fdea0002f30 tx=0x7fdea0006d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:19.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.570+0000 7fde9bfff700 1 -- 172.21.15.62:0/3487000741 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdea0012410 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.570+0000 7fde9bfff700 1 -- 172.21.15.62:0/3487000741 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea0012570 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.570+0000 7fdeb1898700 1 -- 172.21.15.62:0/3487000741 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeac063f70 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.570+0000 7fde9bfff700 1 -- 172.21.15.62:0/3487000741 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdea00128d0 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.570+0000 7fdeb1898700 1 -- 172.21.15.62:0/3487000741 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac0ab170 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.570+0000 7fdeb1898700 1 -- 172.21.15.62:0/3487000741 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeac064100 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.570+0000 7fde9bfff700 1 -- 172.21.15.62:0/3487000741 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdea000f030 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.570+0000 7fde9bfff700 1 --2- 172.21.15.62:0/3487000741 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde88053610 0x7fde88055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.570+0000 7fde9bfff700 1 -- 172.21.15.62:0/3487000741 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdea006b340 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.574+0000 7fdeaa7fc700 1 --2- 172.21.15.62:0/3487000741 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde88053610 0x7fde88055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.574+0000 7fdeaa7fc700 1 --2- 172.21.15.62:0/3487000741 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde88053610 0x7fde88055ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fde9c00d000 tx=0x7fde9c007ec0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:19.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.578+0000 7fde9bfff700 1 -- 172.21.15.62:0/3487000741 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdea0042440 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.698+0000 7fdeb1898700 1 -- 172.21.15.62:0/3487000741 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdeac0ab170 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.702+0000 7fde9bfff700 1 -- 172.21.15.62:0/3487000741 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16099 (secure 0 0 0) 0x7fdeac0ab170 con 0x7fdeac0a7bb0 2021-12-17T18:18:19.706 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:19.706 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":22,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:19.175364+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:17.128555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:18.180577+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:19.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.702+0000 7fdeb1898700 1 -- 172.21.15.62:0/3487000741 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde88053610 msgr2=0x7fde88055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.702+0000 7fdeb1898700 1 --2- 172.21.15.62:0/3487000741 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde88053610 0x7fde88055ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fde9c00d000 tx=0x7fde9c007ec0).stop 2021-12-17T18:18:19.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.702+0000 7fdeb1898700 1 -- 172.21.15.62:0/3487000741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdeac0a7bb0 msgr2=0x7fdeac0a9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.702+0000 7fdeb1898700 1 --2- 172.21.15.62:0/3487000741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdeac0a7bb0 0x7fdeac0a9770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fdea0002f30 tx=0x7fdea0006d70).stop 2021-12-17T18:18:19.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.702+0000 7fdeb1898700 1 -- 172.21.15.62:0/3487000741 shutdown_connections 2021-12-17T18:18:19.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.702+0000 7fdeb1898700 1 --2- 172.21.15.62:0/3487000741 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde88053610 0x7fde88055ad0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.702+0000 7fdeb1898700 1 --2- 172.21.15.62:0/3487000741 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdeac0b21f0 0x7fdeac157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.702+0000 7fdeb1898700 1 --2- 172.21.15.62:0/3487000741 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdeac0b1730 0x7fdeac157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.702+0000 7fdeb1898700 1 --2- 172.21.15.62:0/3487000741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdeac0a7bb0 0x7fdeac0a9770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.702+0000 7fdeb1898700 1 -- 172.21.15.62:0/3487000741 >> 172.21.15.62:0/3487000741 conn(0x7fdeac05f730 msgr2=0x7fdeac14adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:19.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.702+0000 7fdeb1898700 1 -- 172.21.15.62:0/3487000741 shutdown_connections 2021-12-17T18:18:19.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.702+0000 7fdeb1898700 1 -- 172.21.15.62:0/3487000741 wait complete. 2021-12-17T18:18:19.719 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-12-17T18:18:19.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f8259ed0700 1 Processor -- start 2021-12-17T18:18:19.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f8259ed0700 1 -- start start 2021-12-17T18:18:19.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f8259ed0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82540b47c0 0x7f82540b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f8259ed0700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f82540b5be0 0x7f8254143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f8259ed0700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82540b0870 con 0x7f825405ca90 2021-12-17T18:18:19.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f8259ed0700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825405ce70 con 0x7f82540b5be0 2021-12-17T18:18:19.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f8259ed0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82540b05d0 con 0x7f82540b47c0 2021-12-17T18:18:19.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f8258ece700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f825405ca90 0x7f82540b1d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:47694/0 (socket says 172.21.15.62:47694) 2021-12-17T18:18:19.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f8258ece700 1 -- 172.21.15.62:0/390705384 learned_addr learned my addr 172.21.15.62:0/390705384 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:19.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f8253fff700 1 --2- 172.21.15.62:0/390705384 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82540b47c0 0x7f82540b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f82596cf700 1 --2- 172.21.15.62:0/390705384 >> v2:172.21.15.109:3300/0 conn(0x7f82540b5be0 0x7f8254143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f82537fe700 1 -- 172.21.15.62:0/390705384 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1385159012 0 0) 0x7f82540b0870 con 0x7f825405ca90 2021-12-17T18:18:19.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f82537fe700 1 -- 172.21.15.62:0/390705384 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8238003260 con 0x7f825405ca90 2021-12-17T18:18:19.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f82596cf700 1 -- 172.21.15.62:0/390705384 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82540b47c0 msgr2=0x7f82540b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:19.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f82596cf700 1 --2- 172.21.15.62:0/390705384 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82540b47c0 0x7f82540b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f82596cf700 1 -- 172.21.15.62:0/390705384 >> v1:172.21.15.109:6789/0 conn(0x7f825405ca90 legacy=0x7f82540b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f82596cf700 1 -- 172.21.15.62:0/390705384 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82540b5250 con 0x7f82540b5be0 2021-12-17T18:18:19.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f8253fff700 1 --2- 172.21.15.62:0/390705384 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82540b47c0 0x7f82540b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:19.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f82596cf700 1 --2- 172.21.15.62:0/390705384 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f82540b5be0 0x7f8254143ba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f824c0032f0 tx=0x7f824c0091d0).ready entity=mon.1 client_cookie=6a1d0b740943609f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:19.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f82537fe700 1 -- 172.21.15.62:0/390705384 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f824c00b600 con 0x7f82540b5be0 2021-12-17T18:18:19.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f82537fe700 1 -- 172.21.15.62:0/390705384 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824c00b760 con 0x7f82540b5be0 2021-12-17T18:18:19.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.826+0000 7f82537fe700 1 -- 172.21.15.62:0/390705384 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f824c00b8d0 con 0x7f82540b5be0 2021-12-17T18:18:19.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8259ed0700 1 -- 172.21.15.62:0/390705384 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f82540b5be0 msgr2=0x7f8254143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8259ed0700 1 --2- 172.21.15.62:0/390705384 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f82540b5be0 0x7f8254143ba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f824c0032f0 tx=0x7f824c0091d0).stop 2021-12-17T18:18:19.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8259ed0700 1 -- 172.21.15.62:0/390705384 shutdown_connections 2021-12-17T18:18:19.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8259ed0700 1 --2- 172.21.15.62:0/390705384 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f82540b5be0 0x7f8254143ba0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8259ed0700 1 --2- 172.21.15.62:0/390705384 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82540b47c0 0x7f82540b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8259ed0700 1 -- 172.21.15.62:0/390705384 >> 172.21.15.62:0/390705384 conn(0x7f825405bcd0 msgr2=0x7f8254062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:19.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8259ed0700 1 -- 172.21.15.62:0/390705384 shutdown_connections 2021-12-17T18:18:19.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8259ed0700 1 -- 172.21.15.62:0/390705384 wait complete. 2021-12-17T18:18:19.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8259ed0700 1 Processor -- start 2021-12-17T18:18:19.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8259ed0700 1 -- start start 2021-12-17T18:18:19.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8259ed0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f825405ca90 0x7f8254142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8259ed0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82540b47c0 0x7f82541448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8259ed0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82540b5be0 0x7f82540655a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8259ed0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82541458a0 con 0x7f82540b47c0 2021-12-17T18:18:19.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8259ed0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8254063940 con 0x7f825405ca90 2021-12-17T18:18:19.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8259ed0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8254063be0 con 0x7f82540b5be0 2021-12-17T18:18:19.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8253fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82540b47c0 0x7f82541448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8253fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82540b47c0 0x7f82541448f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47802/0 (socket says 172.21.15.62:47802) 2021-12-17T18:18:19.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8253fff700 1 -- 172.21.15.62:0/1584381211 learned_addr learned my addr 172.21.15.62:0/1584381211 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:19.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8258ece700 1 --2- 172.21.15.62:0/1584381211 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f825405ca90 0x7f8254142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f82596cf700 1 --2- 172.21.15.62:0/1584381211 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82540b5be0 0x7f82540655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8253fff700 1 -- 172.21.15.62:0/1584381211 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82540b5be0 msgr2=0x7f82540655a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8253fff700 1 --2- 172.21.15.62:0/1584381211 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82540b5be0 0x7f82540655a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8253fff700 1 -- 172.21.15.62:0/1584381211 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f825405ca90 msgr2=0x7f8254142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:19.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8253fff700 1 --2- 172.21.15.62:0/1584381211 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f825405ca90 0x7f8254142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:19.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8253fff700 1 -- 172.21.15.62:0/1584381211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824000b180 con 0x7f82540b47c0 2021-12-17T18:18:19.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.830+0000 7f8253fff700 1 --2- 172.21.15.62:0/1584381211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82540b47c0 0x7f82541448f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f824000c000 tx=0x7f8240006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:19.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.834+0000 7f8251ffb700 1 -- 172.21.15.62:0/1584381211 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f824000c7e0 con 0x7f82540b47c0 2021-12-17T18:18:19.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.834+0000 7f8251ffb700 1 -- 172.21.15.62:0/1584381211 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824000c940 con 0x7f82540b47c0 2021-12-17T18:18:19.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.834+0000 7f8259ed0700 1 -- 172.21.15.62:0/1584381211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824c009470 con 0x7f82540b47c0 2021-12-17T18:18:19.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.834+0000 7f8251ffb700 1 -- 172.21.15.62:0/1584381211 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f824000cca0 con 0x7f82540b47c0 2021-12-17T18:18:19.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.834+0000 7f8259ed0700 1 -- 172.21.15.62:0/1584381211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8254146c10 con 0x7f82540b47c0 2021-12-17T18:18:19.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.834+0000 7f8259ed0700 1 -- 172.21.15.62:0/1584381211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8254063760 con 0x7f82540b47c0 2021-12-17T18:18:19.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.834+0000 7f8251ffb700 1 -- 172.21.15.62:0/1584381211 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f824001c460 con 0x7f82540b47c0 2021-12-17T18:18:19.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.834+0000 7f8251ffb700 1 --2- 172.21.15.62:0/1584381211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8234053640 0x7f8234055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:19.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.834+0000 7f8251ffb700 1 -- 172.21.15.62:0/1584381211 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f824006be90 con 0x7f82540b47c0 2021-12-17T18:18:19.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.834+0000 7f8258ece700 1 --2- 172.21.15.62:0/1584381211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8234053640 0x7f8234055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:19.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.838+0000 7f8258ece700 1 --2- 172.21.15.62:0/1584381211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8234053640 0x7f8234055b00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f824800d000 tx=0x7f8248009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:19.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:19.846+0000 7f8251ffb700 1 -- 172.21.15.62:0/1584381211 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8240042f90 con 0x7f82540b47c0 2021-12-17T18:18:20.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.010+0000 7f8259ed0700 1 -- 172.21.15.62:0/1584381211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f82540b3980 con 0x7f82540b47c0 2021-12-17T18:18:20.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.194+0000 7f8251ffb700 1 -- 172.21.15.62:0/1584381211 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f82400465b0 con 0x7f82540b47c0 2021-12-17T18:18:20.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.198+0000 7f8259ed0700 1 -- 172.21.15.62:0/1584381211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8234053640 msgr2=0x7f8234055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.198+0000 7f8259ed0700 1 --2- 172.21.15.62:0/1584381211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8234053640 0x7f8234055b00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f824800d000 tx=0x7f8248009040).stop 2021-12-17T18:18:20.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.198+0000 7f8259ed0700 1 -- 172.21.15.62:0/1584381211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82540b47c0 msgr2=0x7f82541448f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.198+0000 7f8259ed0700 1 --2- 172.21.15.62:0/1584381211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82540b47c0 0x7f82541448f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f824000c000 tx=0x7f8240006df0).stop 2021-12-17T18:18:20.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.198+0000 7f8259ed0700 1 -- 172.21.15.62:0/1584381211 shutdown_connections 2021-12-17T18:18:20.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.198+0000 7f8259ed0700 1 --2- 172.21.15.62:0/1584381211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8234053640 0x7f8234055b00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.198+0000 7f8259ed0700 1 --2- 172.21.15.62:0/1584381211 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82540b5be0 0x7f82540655a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.198+0000 7f8259ed0700 1 --2- 172.21.15.62:0/1584381211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82540b47c0 0x7f82541448f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.198+0000 7f8259ed0700 1 --2- 172.21.15.62:0/1584381211 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f825405ca90 0x7f8254142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.198+0000 7f8259ed0700 1 -- 172.21.15.62:0/1584381211 >> 172.21.15.62:0/1584381211 conn(0x7f825405bcd0 msgr2=0x7f82540b8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:20.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.198+0000 7f8259ed0700 1 -- 172.21.15.62:0/1584381211 shutdown_connections 2021-12-17T18:18:20.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.198+0000 7f8259ed0700 1 -- 172.21.15.62:0/1584381211 wait complete. 2021-12-17T18:18:20.218 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:18:20.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef3d3da700 1 Processor -- start 2021-12-17T18:18:20.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef3d3da700 1 -- start start 2021-12-17T18:18:20.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef3d3da700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fef380b42c0 0x7fef381449e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef3d3da700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef380ae2a0 0x7fef38141090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef3d3da700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef38060370 con 0x7fef380ad550 2021-12-17T18:18:20.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef3d3da700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef380b3ae0 con 0x7fef380b42c0 2021-12-17T18:18:20.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef3d3da700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef380adb40 con 0x7fef380ae2a0 2021-12-17T18:18:20.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef36ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fef380b42c0 0x7fef381449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef36ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fef380b42c0 0x7fef381449e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47808/0 (socket says 172.21.15.62:47808) 2021-12-17T18:18:20.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef36ffd700 1 -- 172.21.15.62:0/2368438296 learned_addr learned my addr 172.21.15.62:0/2368438296 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:20.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef367fc700 1 --1- 172.21.15.62:0/2368438296 >> v1:172.21.15.109:6789/0 conn(0x7fef380ad550 0x7fef38144ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:47708/0 (socket says 172.21.15.62:47708) 2021-12-17T18:18:20.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef377fe700 1 --2- 172.21.15.62:0/2368438296 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef380ae2a0 0x7fef38141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef36ffd700 1 -- 172.21.15.62:0/2368438296 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef380ae2a0 msgr2=0x7fef38141090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:20.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef35ffb700 1 -- 172.21.15.62:0/2368438296 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679196815 0 0) 0x7fef38060370 con 0x7fef380ad550 2021-12-17T18:18:20.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef36ffd700 1 --2- 172.21.15.62:0/2368438296 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef380ae2a0 0x7fef38141090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef36ffd700 1 -- 172.21.15.62:0/2368438296 >> v1:172.21.15.109:6789/0 conn(0x7fef380ad550 legacy=0x7fef38144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef36ffd700 1 -- 172.21.15.62:0/2368438296 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef38060050 con 0x7fef380b42c0 2021-12-17T18:18:20.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.322+0000 7fef36ffd700 1 --2- 172.21.15.62:0/2368438296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef380b42c0 0x7fef381449e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fef28002f70 tx=0x7fef28006eb0).ready entity=mon.0 client_cookie=73e087e4e473364d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:20.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef35ffb700 1 -- 172.21.15.62:0/2368438296 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef2800d570 con 0x7fef380b42c0 2021-12-17T18:18:20.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef35ffb700 1 -- 172.21.15.62:0/2368438296 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef28000e90 con 0x7fef380b42c0 2021-12-17T18:18:20.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef35ffb700 1 -- 172.21.15.62:0/2368438296 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef2800d8c0 con 0x7fef380b42c0 2021-12-17T18:18:20.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef3d3da700 1 -- 172.21.15.62:0/2368438296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef380b42c0 msgr2=0x7fef381449e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef3d3da700 1 --2- 172.21.15.62:0/2368438296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef380b42c0 0x7fef381449e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fef28002f70 tx=0x7fef28006eb0).stop 2021-12-17T18:18:20.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef3d3da700 1 -- 172.21.15.62:0/2368438296 shutdown_connections 2021-12-17T18:18:20.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef3d3da700 1 --2- 172.21.15.62:0/2368438296 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef380ae2a0 0x7fef38141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef3d3da700 1 --2- 172.21.15.62:0/2368438296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef380b42c0 0x7fef381449e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef3d3da700 1 -- 172.21.15.62:0/2368438296 >> 172.21.15.62:0/2368438296 conn(0x7fef3805ca90 msgr2=0x7fef3805ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:20.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef3d3da700 1 -- 172.21.15.62:0/2368438296 shutdown_connections 2021-12-17T18:18:20.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef3d3da700 1 -- 172.21.15.62:0/2368438296 wait complete. 2021-12-17T18:18:20.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef3d3da700 1 Processor -- start 2021-12-17T18:18:20.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef3d3da700 1 -- start start 2021-12-17T18:18:20.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef3d3da700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fef380ad550 0x7fef38066de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef3d3da700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef380ae2a0 0x7fef3813ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef3d3da700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef380b42c0 0x7fef38141670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef3d3da700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef38151550 con 0x7fef380b42c0 2021-12-17T18:18:20.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef3d3da700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3813e150 con 0x7fef380ad550 2021-12-17T18:18:20.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef3d3da700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3813e3f0 con 0x7fef380ae2a0 2021-12-17T18:18:20.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.326+0000 7fef377fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef380b42c0 0x7fef38141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.330+0000 7fef36ffd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fef380ad550 0x7fef38066de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.330+0000 7fef367fc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef380ae2a0 0x7fef3813ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.330+0000 7fef377fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef380b42c0 0x7fef38141670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47818/0 (socket says 172.21.15.62:47818) 2021-12-17T18:18:20.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.330+0000 7fef377fe700 1 -- 172.21.15.62:0/1510310005 learned_addr learned my addr 172.21.15.62:0/1510310005 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:20.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.330+0000 7fef377fe700 1 -- 172.21.15.62:0/1510310005 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef380ae2a0 msgr2=0x7fef3813ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.330+0000 7fef377fe700 1 --2- 172.21.15.62:0/1510310005 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef380ae2a0 0x7fef3813ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.330+0000 7fef377fe700 1 -- 172.21.15.62:0/1510310005 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fef380ad550 msgr2=0x7fef38066de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.330+0000 7fef377fe700 1 --2- 172.21.15.62:0/1510310005 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fef380ad550 0x7fef38066de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.330+0000 7fef377fe700 1 -- 172.21.15.62:0/1510310005 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2800b1e0 con 0x7fef380b42c0 2021-12-17T18:18:20.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.330+0000 7fef377fe700 1 --2- 172.21.15.62:0/1510310005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef380b42c0 0x7fef38141670 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fef30006e00 tx=0x7fef300091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:20.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.330+0000 7fef2ffff700 1 -- 172.21.15.62:0/1510310005 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef3000c640 con 0x7fef380b42c0 2021-12-17T18:18:20.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.330+0000 7fef2ffff700 1 -- 172.21.15.62:0/1510310005 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3000c7a0 con 0x7fef380b42c0 2021-12-17T18:18:20.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.330+0000 7fef3d3da700 1 -- 172.21.15.62:0/1510310005 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef380b0100 con 0x7fef380b42c0 2021-12-17T18:18:20.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.330+0000 7fef2ffff700 1 -- 172.21.15.62:0/1510310005 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef3000cb00 con 0x7fef380b42c0 2021-12-17T18:18:20.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.330+0000 7fef3d3da700 1 -- 172.21.15.62:0/1510310005 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef38154850 con 0x7fef380b42c0 2021-12-17T18:18:20.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.330+0000 7fef3d3da700 1 -- 172.21.15.62:0/1510310005 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef380adc80 con 0x7fef380b42c0 2021-12-17T18:18:20.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.330+0000 7fef2ffff700 1 -- 172.21.15.62:0/1510310005 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fef3000cc60 con 0x7fef380b42c0 2021-12-17T18:18:20.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.334+0000 7fef2ffff700 1 --2- 172.21.15.62:0/1510310005 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fef1c0536a0 0x7fef1c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.334+0000 7fef2ffff700 1 -- 172.21.15.62:0/1510310005 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fef3006bb40 con 0x7fef380b42c0 2021-12-17T18:18:20.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.334+0000 7fef36ffd700 1 --2- 172.21.15.62:0/1510310005 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fef1c0536a0 0x7fef1c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.334+0000 7fef36ffd700 1 --2- 172.21.15.62:0/1510310005 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fef1c0536a0 0x7fef1c055b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fef2801c000 tx=0x7fef28015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:20.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.338+0000 7fef2ffff700 1 -- 172.21.15.62:0/1510310005 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fef380adc80 con 0x7fef380b42c0 2021-12-17T18:18:20.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.506+0000 7fef3d3da700 1 -- 172.21.15.62:0/1510310005 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef380adc80 con 0x7fef380b42c0 2021-12-17T18:18:20.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.506+0000 7fef2ffff700 1 -- 172.21.15.62:0/1510310005 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2137 (secure 0 0 0) 0x7fef380adc80 con 0x7fef380b42c0 2021-12-17T18:18:20.513 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:20.514 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/1930484969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1930484969},{"type":"v1","addr":"172.21.15.109:6835","nonce":1930484969}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:18:19.175750+0000","modified":"2021-12-17T18:18:20.179555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.62:6833/3194210554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3194210554},{"type":"v1","addr":"172.21.15.62:6833","nonce":3194210554}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-12-17T18:18:20.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.510+0000 7fef3d3da700 1 -- 172.21.15.62:0/1510310005 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fef1c0536a0 msgr2=0x7fef1c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.510+0000 7fef3d3da700 1 --2- 172.21.15.62:0/1510310005 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fef1c0536a0 0x7fef1c055b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fef2801c000 tx=0x7fef28015000).stop 2021-12-17T18:18:20.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.510+0000 7fef3d3da700 1 -- 172.21.15.62:0/1510310005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef380b42c0 msgr2=0x7fef38141670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.510+0000 7fef3d3da700 1 --2- 172.21.15.62:0/1510310005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef380b42c0 0x7fef38141670 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fef30006e00 tx=0x7fef300091d0).stop 2021-12-17T18:18:20.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.510+0000 7fef3d3da700 1 -- 172.21.15.62:0/1510310005 shutdown_connections 2021-12-17T18:18:20.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.510+0000 7fef3d3da700 1 --2- 172.21.15.62:0/1510310005 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fef1c0536a0 0x7fef1c055b60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.510+0000 7fef3d3da700 1 --2- 172.21.15.62:0/1510310005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef380b42c0 0x7fef38141670 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.510+0000 7fef3d3da700 1 --2- 172.21.15.62:0/1510310005 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef380ae2a0 0x7fef3813ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.510+0000 7fef3d3da700 1 --2- 172.21.15.62:0/1510310005 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fef380ad550 0x7fef38066de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.510+0000 7fef3d3da700 1 -- 172.21.15.62:0/1510310005 >> 172.21.15.62:0/1510310005 conn(0x7fef3805ca90 msgr2=0x7fef380b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:20.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.510+0000 7fef3d3da700 1 -- 172.21.15.62:0/1510310005 shutdown_connections 2021-12-17T18:18:20.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.510+0000 7fef3d3da700 1 -- 172.21.15.62:0/1510310005 wait complete. 2021-12-17T18:18:20.523 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 5 2021-12-17T18:18:20.531 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:20.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.626+0000 7fcce6033700 1 Processor -- start 2021-12-17T18:18:20.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.626+0000 7fcce6033700 1 -- start start 2021-12-17T18:18:20.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.626+0000 7fcce6033700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fcce00b21f0 0x7fcce014aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.626+0000 7fcce6033700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcce00a7bb0 0x7fcce0067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.626+0000 7fcce6033700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce00b2ce0 con 0x7fcce00b1730 2021-12-17T18:18:20.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.626+0000 7fcce6033700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce0147870 con 0x7fcce00a7bb0 2021-12-17T18:18:20.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.626+0000 7fcce6033700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce00b2f10 con 0x7fcce00b21f0 2021-12-17T18:18:20.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fccdffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcce00a7bb0 0x7fcce0067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fccdffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcce00a7bb0 0x7fcce0067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47826/0 (socket says 172.21.15.62:47826) 2021-12-17T18:18:20.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fccdffff700 1 -- 172.21.15.62:0/1434151042 learned_addr learned my addr 172.21.15.62:0/1434151042 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:20.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fccdf7fe700 1 --2- 172.21.15.62:0/1434151042 >> v2:172.21.15.109:3300/0 conn(0x7fcce00b21f0 0x7fcce014aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fccdffff700 1 -- 172.21.15.62:0/1434151042 >> v2:172.21.15.109:3300/0 conn(0x7fcce00b21f0 msgr2=0x7fcce014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:20.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fccdffff700 1 --2- 172.21.15.62:0/1434151042 >> v2:172.21.15.109:3300/0 conn(0x7fcce00b21f0 0x7fcce014aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fccdffff700 1 -- 172.21.15.62:0/1434151042 >> v1:172.21.15.109:6789/0 conn(0x7fcce00b1730 legacy=0x7fcce00ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fccdffff700 1 -- 172.21.15.62:0/1434151042 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce00aca60 con 0x7fcce00a7bb0 2021-12-17T18:18:20.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fccdffff700 1 --2- 172.21.15.62:0/1434151042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce00a7bb0 0x7fcce0067120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fcce00b1c00 tx=0x7fccd8006eb0).ready entity=mon.0 client_cookie=c5789475c8d66582 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:20.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fccde7fc700 1 -- 172.21.15.62:0/1434151042 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccd800d610 con 0x7fcce00a7bb0 2021-12-17T18:18:20.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fccde7fc700 1 -- 172.21.15.62:0/1434151042 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd8000e90 con 0x7fcce00a7bb0 2021-12-17T18:18:20.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fccde7fc700 1 -- 172.21.15.62:0/1434151042 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccd800d960 con 0x7fcce00a7bb0 2021-12-17T18:18:20.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fcce6033700 1 -- 172.21.15.62:0/1434151042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce00a7bb0 msgr2=0x7fcce0067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fcce6033700 1 --2- 172.21.15.62:0/1434151042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce00a7bb0 0x7fcce0067120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fcce00b1c00 tx=0x7fccd8006eb0).stop 2021-12-17T18:18:20.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fcce6033700 1 -- 172.21.15.62:0/1434151042 shutdown_connections 2021-12-17T18:18:20.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fcce6033700 1 --2- 172.21.15.62:0/1434151042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce00a7bb0 0x7fcce0067120 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fcce6033700 1 --2- 172.21.15.62:0/1434151042 >> v2:172.21.15.109:3300/0 conn(0x7fcce00b21f0 0x7fcce014aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fcce6033700 1 -- 172.21.15.62:0/1434151042 >> 172.21.15.62:0/1434151042 conn(0x7fcce005f730 msgr2=0x7fcce005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:20.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fcce6033700 1 -- 172.21.15.62:0/1434151042 shutdown_connections 2021-12-17T18:18:20.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.630+0000 7fcce6033700 1 -- 172.21.15.62:0/1434151042 wait complete. 2021-12-17T18:18:20.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fcce6033700 1 Processor -- start 2021-12-17T18:18:20.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fcce6033700 1 -- start start 2021-12-17T18:18:20.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fcce6033700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcce00a7bb0 0x7fcce0063810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fcce6033700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce00b1730 0x7fcce01578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fcce6033700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcce00b21f0 0x7fcce00a99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fcce6033700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce0156ca0 con 0x7fcce00b1730 2021-12-17T18:18:20.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fcce6033700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00ac850 con 0x7fcce00b21f0 2021-12-17T18:18:20.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fcce6033700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce0156ee0 con 0x7fcce00a7bb0 2021-12-17T18:18:20.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fccdeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce00b1730 0x7fcce01578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fccdeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce00b1730 0x7fcce01578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47830/0 (socket says 172.21.15.62:47830) 2021-12-17T18:18:20.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fccdeffd700 1 -- 172.21.15.62:0/1407765707 learned_addr learned my addr 172.21.15.62:0/1407765707 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:20.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fccdffff700 1 --2- 172.21.15.62:0/1407765707 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcce00b21f0 0x7fcce00a99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fccdf7fe700 1 --2- 172.21.15.62:0/1407765707 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcce00a7bb0 0x7fcce0063810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fccdeffd700 1 -- 172.21.15.62:0/1407765707 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcce00a7bb0 msgr2=0x7fcce0063810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fccdeffd700 1 --2- 172.21.15.62:0/1407765707 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcce00a7bb0 0x7fcce0063810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fccdeffd700 1 -- 172.21.15.62:0/1407765707 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcce00b21f0 msgr2=0x7fcce00a99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fccdeffd700 1 --2- 172.21.15.62:0/1407765707 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcce00b21f0 0x7fcce00a99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fccdeffd700 1 -- 172.21.15.62:0/1407765707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd800b1e0 con 0x7fcce00b1730 2021-12-17T18:18:20.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fccdeffd700 1 --2- 172.21.15.62:0/1407765707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce00b1730 0x7fcce01578c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fcce00a88d0 tx=0x7fccd00014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:20.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fccdcff9700 1 -- 172.21.15.62:0/1407765707 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccd000e4a0 con 0x7fcce00b1730 2021-12-17T18:18:20.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fccdcff9700 1 -- 172.21.15.62:0/1407765707 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd000e600 con 0x7fcce00b1730 2021-12-17T18:18:20.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fcce6033700 1 -- 172.21.15.62:0/1407765707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce0157180 con 0x7fcce00b1730 2021-12-17T18:18:20.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fccdcff9700 1 -- 172.21.15.62:0/1407765707 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccd000e960 con 0x7fcce00b1730 2021-12-17T18:18:20.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.634+0000 7fcce6033700 1 -- 172.21.15.62:0/1407765707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce00abac0 con 0x7fcce00b1730 2021-12-17T18:18:20.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.638+0000 7fcce6033700 1 -- 172.21.15.62:0/1407765707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce00573d0 con 0x7fcce00b1730 2021-12-17T18:18:20.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.638+0000 7fccdcff9700 1 -- 172.21.15.62:0/1407765707 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fccd0019030 con 0x7fcce00b1730 2021-12-17T18:18:20.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.638+0000 7fccdcff9700 1 --2- 172.21.15.62:0/1407765707 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fccc40536a0 0x7fccc4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.638+0000 7fccdcff9700 1 -- 172.21.15.62:0/1407765707 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fccd006b1a0 con 0x7fcce00b1730 2021-12-17T18:18:20.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.638+0000 7fccdf7fe700 1 --2- 172.21.15.62:0/1407765707 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fccc40536a0 0x7fccc4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.638+0000 7fccdf7fe700 1 --2- 172.21.15.62:0/1407765707 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fccc40536a0 0x7fccc4055b60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fccc800c000 tx=0x7fccc8008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:20.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.646+0000 7fccdcff9700 1 -- 172.21.15.62:0/1407765707 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fccd0042260 con 0x7fcce00b1730 2021-12-17T18:18:20.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.774+0000 7fcce6033700 1 -- 172.21.15.62:0/1407765707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcce00af860 con 0x7fcce00b1730 2021-12-17T18:18:20.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.774+0000 7fccdcff9700 1 -- 172.21.15.62:0/1407765707 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7fccd0017020 con 0x7fcce00b1730 2021-12-17T18:18:20.779 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:20.780 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:20.178383+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:17.128555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:18.180577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:20.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.774+0000 7fcce6033700 1 -- 172.21.15.62:0/1407765707 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fccc40536a0 msgr2=0x7fccc4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.774+0000 7fcce6033700 1 --2- 172.21.15.62:0/1407765707 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fccc40536a0 0x7fccc4055b60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fccc800c000 tx=0x7fccc8008040).stop 2021-12-17T18:18:20.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.774+0000 7fcce6033700 1 -- 172.21.15.62:0/1407765707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce00b1730 msgr2=0x7fcce01578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.774+0000 7fcce6033700 1 --2- 172.21.15.62:0/1407765707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce00b1730 0x7fcce01578c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fcce00a88d0 tx=0x7fccd00014a0).stop 2021-12-17T18:18:20.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.778+0000 7fcce6033700 1 -- 172.21.15.62:0/1407765707 shutdown_connections 2021-12-17T18:18:20.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.778+0000 7fcce6033700 1 --2- 172.21.15.62:0/1407765707 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fccc40536a0 0x7fccc4055b60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.778+0000 7fcce6033700 1 --2- 172.21.15.62:0/1407765707 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcce00b21f0 0x7fcce00a99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.778+0000 7fcce6033700 1 --2- 172.21.15.62:0/1407765707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce00b1730 0x7fcce01578c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.778+0000 7fcce6033700 1 --2- 172.21.15.62:0/1407765707 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcce00a7bb0 0x7fcce0063810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.778+0000 7fcce6033700 1 -- 172.21.15.62:0/1407765707 >> 172.21.15.62:0/1407765707 conn(0x7fcce005f730 msgr2=0x7fcce01479c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:20.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.778+0000 7fcce6033700 1 -- 172.21.15.62:0/1407765707 shutdown_connections 2021-12-17T18:18:20.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.778+0000 7fcce6033700 1 -- 172.21.15.62:0/1407765707 wait complete. 2021-12-17T18:18:20.794 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:20.794 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-12-17T18:18:20.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff147a31700 1 Processor -- start 2021-12-17T18:18:20.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff147a31700 1 -- start start 2021-12-17T18:18:20.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff147a31700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff1400ad610 0x7ff1400b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff147a31700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff14013f470 0x7ff140143000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff147a31700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1400ad9f0 con 0x7ff1400b0e00 2021-12-17T18:18:20.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff147a31700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1400ad010 con 0x7ff14013f470 2021-12-17T18:18:20.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff147a31700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400b19e0 con 0x7ff1400ad610 2021-12-17T18:18:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff145fce700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff14013f470 0x7ff140143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff1457cd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff1400ad610 0x7ff1400b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff145fce700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff14013f470 0x7ff140143000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47840/0 (socket says 172.21.15.62:47840) 2021-12-17T18:18:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff1457cd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff1400ad610 0x7ff1400b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:41538/0 (socket says 172.21.15.62:41538) 2021-12-17T18:18:20.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff145fce700 1 -- 172.21.15.62:0/1082821210 learned_addr learned my addr 172.21.15.62:0/1082821210 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:20.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff1457cd700 1 -- 172.21.15.62:0/1082821210 >> v2:172.21.15.62:3300/0 conn(0x7ff14013f470 msgr2=0x7ff140143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:20.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff12ffff700 1 -- 172.21.15.62:0/1082821210 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491810465 0 0) 0x7ff1400ad9f0 con 0x7ff1400b0e00 2021-12-17T18:18:20.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff1457cd700 1 --2- 172.21.15.62:0/1082821210 >> v2:172.21.15.62:3300/0 conn(0x7ff14013f470 0x7ff140143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff1457cd700 1 -- 172.21.15.62:0/1082821210 >> v1:172.21.15.109:6789/0 conn(0x7ff1400b0e00 legacy=0x7ff14013ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff1457cd700 1 -- 172.21.15.62:0/1082821210 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1400b1c80 con 0x7ff1400ad610 2021-12-17T18:18:20.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.898+0000 7ff1457cd700 1 --2- 172.21.15.62:0/1082821210 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff1400ad610 0x7ff1400b2370 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff13c002f70 tx=0x7ff13c006df0).ready entity=mon.2 client_cookie=8af50e6e113acfe0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:20.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff12ffff700 1 -- 172.21.15.62:0/1082821210 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff13c014070 con 0x7ff1400ad610 2021-12-17T18:18:20.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff12ffff700 1 -- 172.21.15.62:0/1082821210 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c000e90 con 0x7ff1400ad610 2021-12-17T18:18:20.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff12ffff700 1 -- 172.21.15.62:0/1082821210 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff13c00fb60 con 0x7ff1400ad610 2021-12-17T18:18:20.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff147a31700 1 -- 172.21.15.62:0/1082821210 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff1400ad610 msgr2=0x7ff1400b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff147a31700 1 --2- 172.21.15.62:0/1082821210 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff1400ad610 0x7ff1400b2370 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff13c002f70 tx=0x7ff13c006df0).stop 2021-12-17T18:18:20.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff147a31700 1 -- 172.21.15.62:0/1082821210 shutdown_connections 2021-12-17T18:18:20.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff147a31700 1 --2- 172.21.15.62:0/1082821210 >> v2:172.21.15.62:3300/0 conn(0x7ff14013f470 0x7ff140143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff147a31700 1 --2- 172.21.15.62:0/1082821210 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff1400ad610 0x7ff1400b2370 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff147a31700 1 -- 172.21.15.62:0/1082821210 >> 172.21.15.62:0/1082821210 conn(0x7ff14005c750 msgr2=0x7ff1400630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:20.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff147a31700 1 -- 172.21.15.62:0/1082821210 shutdown_connections 2021-12-17T18:18:20.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff147a31700 1 -- 172.21.15.62:0/1082821210 wait complete. 2021-12-17T18:18:20.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff147a31700 1 Processor -- start 2021-12-17T18:18:20.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff147a31700 1 -- start start 2021-12-17T18:18:20.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff147a31700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1400ad610 0x7ff140066d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff147a31700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff1400b0e00 0x7ff14013c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff147a31700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff14013f470 0x7ff14014ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff147a31700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff140066620 con 0x7ff1400ad610 2021-12-17T18:18:20.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff147a31700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff140064fb0 con 0x7ff14013f470 2021-12-17T18:18:20.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff147a31700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff140065450 con 0x7ff1400b0e00 2021-12-17T18:18:20.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff1457cd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1400ad610 0x7ff140066d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff1457cd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1400ad610 0x7ff140066d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47842/0 (socket says 172.21.15.62:47842) 2021-12-17T18:18:20.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff144fcc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff1400b0e00 0x7ff14013c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff1457cd700 1 -- 172.21.15.62:0/3149067715 learned_addr learned my addr 172.21.15.62:0/3149067715 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:20.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.902+0000 7ff145fce700 1 --2- 172.21.15.62:0/3149067715 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff14013f470 0x7ff14014ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.906+0000 7ff1457cd700 1 -- 172.21.15.62:0/3149067715 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff1400b0e00 msgr2=0x7ff14013c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.906+0000 7ff1457cd700 1 --2- 172.21.15.62:0/3149067715 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff1400b0e00 0x7ff14013c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.906+0000 7ff1457cd700 1 -- 172.21.15.62:0/3149067715 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff14013f470 msgr2=0x7ff14014ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:20.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.906+0000 7ff1457cd700 1 --2- 172.21.15.62:0/3149067715 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff14013f470 0x7ff14014ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:20.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.906+0000 7ff1457cd700 1 -- 172.21.15.62:0/3149067715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c00b180 con 0x7ff1400ad610 2021-12-17T18:18:20.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.906+0000 7ff1457cd700 1 --2- 172.21.15.62:0/3149067715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1400ad610 0x7ff140066d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff13c002f70 tx=0x7ff13c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:20.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.906+0000 7ff12e7fc700 1 -- 172.21.15.62:0/3149067715 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff13c010da0 con 0x7ff1400ad610 2021-12-17T18:18:20.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.906+0000 7ff12e7fc700 1 -- 172.21.15.62:0/3149067715 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c01d450 con 0x7ff1400ad610 2021-12-17T18:18:20.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.906+0000 7ff147a31700 1 -- 172.21.15.62:0/3149067715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1400657b0 con 0x7ff1400ad610 2021-12-17T18:18:20.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.906+0000 7ff12e7fc700 1 -- 172.21.15.62:0/3149067715 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff13c01d7b0 con 0x7ff1400ad610 2021-12-17T18:18:20.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.906+0000 7ff147a31700 1 -- 172.21.15.62:0/3149067715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14014f4f0 con 0x7ff1400ad610 2021-12-17T18:18:20.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.906+0000 7ff147a31700 1 -- 172.21.15.62:0/3149067715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1400b1f20 con 0x7ff1400ad610 2021-12-17T18:18:20.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.906+0000 7ff12e7fc700 1 -- 172.21.15.62:0/3149067715 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff13c01d910 con 0x7ff1400ad610 2021-12-17T18:18:20.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.906+0000 7ff12e7fc700 1 --2- 172.21.15.62:0/3149067715 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff120053580 0x7ff120055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:20.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.906+0000 7ff12e7fc700 1 -- 172.21.15.62:0/3149067715 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff13c06f8c0 con 0x7ff1400ad610 2021-12-17T18:18:20.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.910+0000 7ff144fcc700 1 --2- 172.21.15.62:0/3149067715 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff120053580 0x7ff120055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:20.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.910+0000 7ff144fcc700 1 --2- 172.21.15.62:0/3149067715 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff120053580 0x7ff120055a40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff13000d000 tx=0x7ff130007a20).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:20.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:20.914+0000 7ff12e7fc700 1 -- 172.21.15.62:0/3149067715 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff13c046a20 con 0x7ff1400ad610 2021-12-17T18:18:21.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.034+0000 7ff147a31700 1 -- 172.21.15.62:0/3149067715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1400573d0 con 0x7ff1400ad610 2021-12-17T18:18:21.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.038+0000 7ff12e7fc700 1 -- 172.21.15.62:0/3149067715 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7ff13c04a040 con 0x7ff1400ad610 2021-12-17T18:18:21.042 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:21.043 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:20.178383+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:17.128555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:18.180577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:21.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.038+0000 7ff147a31700 1 -- 172.21.15.62:0/3149067715 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff120053580 msgr2=0x7ff120055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.038+0000 7ff147a31700 1 --2- 172.21.15.62:0/3149067715 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff120053580 0x7ff120055a40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff13000d000 tx=0x7ff130007a20).stop 2021-12-17T18:18:21.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.038+0000 7ff147a31700 1 -- 172.21.15.62:0/3149067715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1400ad610 msgr2=0x7ff140066d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.038+0000 7ff147a31700 1 --2- 172.21.15.62:0/3149067715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1400ad610 0x7ff140066d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff13c002f70 tx=0x7ff13c016000).stop 2021-12-17T18:18:21.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.038+0000 7ff147a31700 1 -- 172.21.15.62:0/3149067715 shutdown_connections 2021-12-17T18:18:21.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.038+0000 7ff147a31700 1 --2- 172.21.15.62:0/3149067715 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff120053580 0x7ff120055a40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.038+0000 7ff147a31700 1 --2- 172.21.15.62:0/3149067715 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff14013f470 0x7ff14014ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.038+0000 7ff147a31700 1 --2- 172.21.15.62:0/3149067715 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff1400b0e00 0x7ff14013c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.038+0000 7ff147a31700 1 --2- 172.21.15.62:0/3149067715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1400ad610 0x7ff140066d40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.038+0000 7ff147a31700 1 -- 172.21.15.62:0/3149067715 >> 172.21.15.62:0/3149067715 conn(0x7ff14005c750 msgr2=0x7ff14013eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:21.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.038+0000 7ff147a31700 1 -- 172.21.15.62:0/3149067715 shutdown_connections 2021-12-17T18:18:21.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.038+0000 7ff147a31700 1 -- 172.21.15.62:0/3149067715 wait complete. 2021-12-17T18:18:21.056 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:18:17.128555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:18:18.180577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:18:21.057 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:18:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.162+0000 7fcf1b350700 1 Processor -- start 2021-12-17T18:18:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.162+0000 7fcf1b350700 1 -- start start 2021-12-17T18:18:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf1b350700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fcf140b5dd0 0x7fcf14146da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf1b350700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf140b2010 con 0x7fcf140b05b0 2021-12-17T18:18:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf1b350700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf140b0990 con 0x7fcf140b41f0 2021-12-17T18:18:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf1b350700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf14147290 con 0x7fcf140b5dd0 2021-12-17T18:18:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf190ec700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcf140b05b0 0x7fcf14146690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59662/0 (socket says 172.21.15.62:59662) 2021-12-17T18:18:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf190ec700 1 -- 172.21.15.62:0/345378450 learned_addr learned my addr 172.21.15.62:0/345378450 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf188eb700 1 --2- 172.21.15.62:0/345378450 >> v2:172.21.15.109:3300/0 conn(0x7fcf140b5dd0 0x7fcf14146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcefffff700 1 -- 172.21.15.62:0/345378450 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464865412 0 0) 0x7fcf140b2010 con 0x7fcf140b05b0 2021-12-17T18:18:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcefffff700 1 -- 172.21.15.62:0/345378450 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcef8003260 con 0x7fcf140b05b0 2021-12-17T18:18:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf188eb700 1 -- 172.21.15.62:0/345378450 >> v1:172.21.15.109:6789/0 conn(0x7fcf140b41f0 legacy=0x7fcf14141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf188eb700 1 -- 172.21.15.62:0/345378450 >> v1:172.21.15.62:6789/0 conn(0x7fcf140b05b0 legacy=0x7fcf14146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf188eb700 1 -- 172.21.15.62:0/345378450 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf140b2240 con 0x7fcf140b5dd0 2021-12-17T18:18:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf188eb700 1 --2- 172.21.15.62:0/345378450 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf140b5dd0 0x7fcf14146da0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fcf140b15f0 tx=0x7fcf08006df0).ready entity=mon.1 client_cookie=7c95c8c9a90d306e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcefffff700 1 -- 172.21.15.62:0/345378450 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf0800d610 con 0x7fcf140b5dd0 2021-12-17T18:18:21.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcefffff700 1 -- 172.21.15.62:0/345378450 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf08000e90 con 0x7fcf140b5dd0 2021-12-17T18:18:21.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcefffff700 1 -- 172.21.15.62:0/345378450 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf0800d960 con 0x7fcf140b5dd0 2021-12-17T18:18:21.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf1b350700 1 -- 172.21.15.62:0/345378450 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf140b5dd0 msgr2=0x7fcf14146da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf1b350700 1 --2- 172.21.15.62:0/345378450 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf140b5dd0 0x7fcf14146da0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fcf140b15f0 tx=0x7fcf08006df0).stop 2021-12-17T18:18:21.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf1b350700 1 -- 172.21.15.62:0/345378450 shutdown_connections 2021-12-17T18:18:21.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf1b350700 1 --2- 172.21.15.62:0/345378450 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf140b5dd0 0x7fcf14146da0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf1b350700 1 -- 172.21.15.62:0/345378450 >> 172.21.15.62:0/345378450 conn(0x7fcf14062510 msgr2=0x7fcf140628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:21.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf1b350700 1 -- 172.21.15.62:0/345378450 shutdown_connections 2021-12-17T18:18:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.166+0000 7fcf1b350700 1 -- 172.21.15.62:0/345378450 wait complete. 2021-12-17T18:18:21.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf1b350700 1 Processor -- start 2021-12-17T18:18:21.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf1b350700 1 -- start start 2021-12-17T18:18:21.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf1b350700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf140b05b0 0x7fcf140b8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf1b350700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf140b41f0 0x7fcf140643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf1b350700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf140b5dd0 0x7fcf14065d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf1b350700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf141462a0 con 0x7fcf140b5dd0 2021-12-17T18:18:21.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf1b350700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf140648b0 con 0x7fcf140b05b0 2021-12-17T18:18:21.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf1b350700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf14063c80 con 0x7fcf140b41f0 2021-12-17T18:18:21.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf190ec700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf140b05b0 0x7fcf140b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf188eb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf140b41f0 0x7fcf140643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf198ed700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf140b5dd0 0x7fcf14065d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf188eb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf140b41f0 0x7fcf140643c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:41560/0 (socket says 172.21.15.62:41560) 2021-12-17T18:18:21.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf188eb700 1 -- 172.21.15.62:0/3034387243 learned_addr learned my addr 172.21.15.62:0/3034387243 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:21.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf190ec700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf140b05b0 0x7fcf140b8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:54406/0 (socket says 172.21.15.62:54406) 2021-12-17T18:18:21.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf188eb700 1 -- 172.21.15.62:0/3034387243 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf140b05b0 msgr2=0x7fcf140b8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf188eb700 1 --2- 172.21.15.62:0/3034387243 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf140b05b0 0x7fcf140b8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf188eb700 1 -- 172.21.15.62:0/3034387243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf140b5dd0 msgr2=0x7fcf14065d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf188eb700 1 --2- 172.21.15.62:0/3034387243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf140b5dd0 0x7fcf14065d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf188eb700 1 -- 172.21.15.62:0/3034387243 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0800b180 con 0x7fcf140b41f0 2021-12-17T18:18:21.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.170+0000 7fcf188eb700 1 --2- 172.21.15.62:0/3034387243 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf140b41f0 0x7fcf140643c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fcf14064a40 tx=0x7fcf08014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:21.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.174+0000 7fcf06ffd700 1 -- 172.21.15.62:0/3034387243 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf08013d20 con 0x7fcf140b41f0 2021-12-17T18:18:21.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.174+0000 7fcf06ffd700 1 -- 172.21.15.62:0/3034387243 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0800d290 con 0x7fcf140b41f0 2021-12-17T18:18:21.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.174+0000 7fcf1b350700 1 -- 172.21.15.62:0/3034387243 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf14063f20 con 0x7fcf140b41f0 2021-12-17T18:18:21.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.174+0000 7fcf06ffd700 1 -- 172.21.15.62:0/3034387243 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf0801e5f0 con 0x7fcf140b41f0 2021-12-17T18:18:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.174+0000 7fcf1b350700 1 -- 172.21.15.62:0/3034387243 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf14145e70 con 0x7fcf140b41f0 2021-12-17T18:18:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.174+0000 7fcf1b350700 1 -- 172.21.15.62:0/3034387243 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf140638b0 con 0x7fcf140b41f0 2021-12-17T18:18:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.174+0000 7fcf06ffd700 1 -- 172.21.15.62:0/3034387243 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcf0801c070 con 0x7fcf140b41f0 2021-12-17T18:18:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.174+0000 7fcf06ffd700 1 --2- 172.21.15.62:0/3034387243 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcef0053610 0x7fcef0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.174+0000 7fcf06ffd700 1 -- 172.21.15.62:0/3034387243 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcf0806c2d0 con 0x7fcf140b41f0 2021-12-17T18:18:21.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.174+0000 7fcf190ec700 1 --2- 172.21.15.62:0/3034387243 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcef0053610 0x7fcef0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.174+0000 7fcf190ec700 1 --2- 172.21.15.62:0/3034387243 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcef0053610 0x7fcef0055ad0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fcf1000d000 tx=0x7fcf10009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:21.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.182+0000 7fcf06ffd700 1 -- 172.21.15.62:0/3034387243 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf140638b0 con 0x7fcf140b41f0 2021-12-17T18:18:21.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.314+0000 7fcf1b350700 1 -- 172.21.15.62:0/3034387243 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcf140638b0 con 0x7fcf140b41f0 2021-12-17T18:18:21.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.314+0000 7fcf06ffd700 1 -- 172.21.15.62:0/3034387243 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcf140638b0 con 0x7fcf140b41f0 2021-12-17T18:18:21.319 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:18:21.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.318+0000 7fcf1b350700 1 -- 172.21.15.62:0/3034387243 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcef0053610 msgr2=0x7fcef0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.318+0000 7fcf1b350700 1 --2- 172.21.15.62:0/3034387243 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcef0053610 0x7fcef0055ad0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fcf1000d000 tx=0x7fcf10009040).stop 2021-12-17T18:18:21.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.318+0000 7fcf1b350700 1 -- 172.21.15.62:0/3034387243 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf140b41f0 msgr2=0x7fcf140643c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.318+0000 7fcf1b350700 1 --2- 172.21.15.62:0/3034387243 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf140b41f0 0x7fcf140643c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fcf14064a40 tx=0x7fcf08014000).stop 2021-12-17T18:18:21.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.318+0000 7fcf1b350700 1 -- 172.21.15.62:0/3034387243 shutdown_connections 2021-12-17T18:18:21.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.318+0000 7fcf1b350700 1 --2- 172.21.15.62:0/3034387243 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcef0053610 0x7fcef0055ad0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.318+0000 7fcf1b350700 1 --2- 172.21.15.62:0/3034387243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf140b5dd0 0x7fcf14065d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.318+0000 7fcf1b350700 1 --2- 172.21.15.62:0/3034387243 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf140b41f0 0x7fcf140643c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.318+0000 7fcf1b350700 1 --2- 172.21.15.62:0/3034387243 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf140b05b0 0x7fcf140b8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.318+0000 7fcf1b350700 1 -- 172.21.15.62:0/3034387243 >> 172.21.15.62:0/3034387243 conn(0x7fcf14062510 msgr2=0x7fcf14060220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:21.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.318+0000 7fcf1b350700 1 -- 172.21.15.62:0/3034387243 shutdown_connections 2021-12-17T18:18:21.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.318+0000 7fcf1b350700 1 -- 172.21.15.62:0/3034387243 wait complete. 2021-12-17T18:18:21.337 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:18:21.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.446+0000 7f27d8b2a700 1 Processor -- start 2021-12-17T18:18:21.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.446+0000 7f27d8b2a700 1 -- start start 2021-12-17T18:18:21.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d8b2a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27d405cb30 0x7f27d4146f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d8b2a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d4142ff0 con 0x7f27d4060260 2021-12-17T18:18:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d8b2a700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d4143290 con 0x7f27d405c750 2021-12-17T18:18:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d8b2a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4143530 con 0x7f27d405cb30 2021-12-17T18:18:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d1d9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f27d4060260 0x7f27d40b4c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59678/0 (socket says 172.21.15.62:59678) 2021-12-17T18:18:21.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d1d9b700 1 -- 172.21.15.62:0/1426642422 learned_addr learned my addr 172.21.15.62:0/1426642422 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:21.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d2d9d700 1 --2- 172.21.15.62:0/1426642422 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27d405cb30 0x7f27d4146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 -- 172.21.15.62:0/1426642422 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176447289 0 0) 0x7f27d4142ff0 con 0x7f27d4060260 2021-12-17T18:18:21.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 -- 172.21.15.62:0/1426642422 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b4003260 con 0x7f27d4060260 2021-12-17T18:18:21.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 -- 172.21.15.62:0/1426642422 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268221383 0 0) 0x7f27d4143290 con 0x7f27d405c750 2021-12-17T18:18:21.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 -- 172.21.15.62:0/1426642422 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d4142ff0 con 0x7f27d405c750 2021-12-17T18:18:21.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 -- 172.21.15.62:0/1426642422 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2646784268 0 0) 0x7f27b4003260 con 0x7f27d4060260 2021-12-17T18:18:21.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 -- 172.21.15.62:0/1426642422 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27d405cb30 msgr2=0x7f27d4146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:21.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 --2- 172.21.15.62:0/1426642422 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27d405cb30 0x7f27d4146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 -- 172.21.15.62:0/1426642422 >> v1:172.21.15.109:6789/0 conn(0x7f27d405c750 legacy=0x7f27d41439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 -- 172.21.15.62:0/1426642422 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d40b5390 con 0x7f27d4060260 2021-12-17T18:18:21.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 -- 172.21.15.62:0/1426642422 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f27c4001660 con 0x7f27d4060260 2021-12-17T18:18:21.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 -- 172.21.15.62:0/1426642422 >> v1:172.21.15.62:6789/0 conn(0x7f27d4060260 legacy=0x7f27d40b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 --2- 172.21.15.62:0/1426642422 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27d405cb30 0x7f27b4003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 --2- 172.21.15.62:0/1426642422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27b4003e70 0x7f27b4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 --2- 172.21.15.62:0/1426642422 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27b40049f0 0x7f27b4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 -- 172.21.15.62:0/1426642422 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4143530 con 0x7f27b4003e70 2021-12-17T18:18:21.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 -- 172.21.15.62:0/1426642422 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b400b830 con 0x7f27b40049f0 2021-12-17T18:18:21.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 -- 172.21.15.62:0/1426642422 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b400b9f0 con 0x7f27d405cb30 2021-12-17T18:18:21.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d1d9b700 1 --2- 172.21.15.62:0/1426642422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27b4003e70 0x7f27b4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d259c700 1 --2- 172.21.15.62:0/1426642422 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27d405cb30 0x7f27b4003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d2d9d700 1 --2- 172.21.15.62:0/1426642422 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27b40049f0 0x7f27b4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d1d9b700 1 -- 172.21.15.62:0/1426642422 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27d405cb30 msgr2=0x7f27b4003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d1d9b700 1 --2- 172.21.15.62:0/1426642422 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27d405cb30 0x7f27b4003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d1d9b700 1 -- 172.21.15.62:0/1426642422 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27b40049f0 msgr2=0x7f27b4004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d1d9b700 1 --2- 172.21.15.62:0/1426642422 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27b40049f0 0x7f27b4004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d1d9b700 1 -- 172.21.15.62:0/1426642422 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b4003260 con 0x7f27b4003e70 2021-12-17T18:18:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d1d9b700 1 --2- 172.21.15.62:0/1426642422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27b4003e70 0x7f27b4004500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f27c4001430 tx=0x7f27c4001d00).ready entity=mon.0 client_cookie=45d05d20cde3db1a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 -- 172.21.15.62:0/1426642422 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c4001d70 con 0x7f27b4003e70 2021-12-17T18:18:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 -- 172.21.15.62:0/1426642422 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c40070d0 con 0x7f27b4003e70 2021-12-17T18:18:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.450+0000 7f27d159a700 1 -- 172.21.15.62:0/1426642422 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c4007430 con 0x7f27b4003e70 2021-12-17T18:18:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d8b2a700 1 -- 172.21.15.62:0/1426642422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27b4003e70 msgr2=0x7f27b4004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d8b2a700 1 --2- 172.21.15.62:0/1426642422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27b4003e70 0x7f27b4004500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f27c4001430 tx=0x7f27c4001d00).stop 2021-12-17T18:18:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d2d9d700 1 -- 172.21.15.62:0/1426642422 reap_dead start 2021-12-17T18:18:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d8b2a700 1 -- 172.21.15.62:0/1426642422 shutdown_connections 2021-12-17T18:18:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d8b2a700 1 -- 172.21.15.62:0/1426642422 >> 172.21.15.62:0/1426642422 conn(0x7f27d4062430 msgr2=0x7f27d4062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d8b2a700 1 -- 172.21.15.62:0/1426642422 shutdown_connections 2021-12-17T18:18:21.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d8b2a700 1 -- 172.21.15.62:0/1426642422 wait complete. 2021-12-17T18:18:21.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d8b2a700 1 Processor -- start 2021-12-17T18:18:21.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d8b2a700 1 -- start start 2021-12-17T18:18:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d8b2a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27b4003e70 0x7f27d4147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d8b2a700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27d414a2f0 0x7f27d41521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d8b2a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27d4063490 0x7f27d4066c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d8b2a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4063af0 con 0x7f27d4063490 2021-12-17T18:18:21.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d8b2a700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4065aa0 con 0x7f27d414a2f0 2021-12-17T18:18:21.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d8b2a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4066810 con 0x7f27b4003e70 2021-12-17T18:18:21.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d2d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27d4063490 0x7f27d4066c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d2d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27d4063490 0x7f27d4066c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47880/0 (socket says 172.21.15.62:47880) 2021-12-17T18:18:21.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d2d9d700 1 -- 172.21.15.62:0/4157586890 learned_addr learned my addr 172.21.15.62:0/4157586890 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:21.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d259c700 1 --2- 172.21.15.62:0/4157586890 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27b4003e70 0x7f27d4147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d1d9b700 1 --2- 172.21.15.62:0/4157586890 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27d414a2f0 0x7f27d41521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d2d9d700 1 -- 172.21.15.62:0/4157586890 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27b4003e70 msgr2=0x7f27d4147ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d2d9d700 1 --2- 172.21.15.62:0/4157586890 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27b4003e70 0x7f27d4147ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d2d9d700 1 -- 172.21.15.62:0/4157586890 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27d414a2f0 msgr2=0x7f27d41521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d2d9d700 1 --2- 172.21.15.62:0/4157586890 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27d414a2f0 0x7f27d41521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d2d9d700 1 -- 172.21.15.62:0/4157586890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d4156330 con 0x7f27d4063490 2021-12-17T18:18:21.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.454+0000 7f27d2d9d700 1 --2- 172.21.15.62:0/4157586890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27d4063490 0x7f27d4066c40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f27cc00b000 tx=0x7f27cc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:21.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.458+0000 7f27cb7fe700 1 -- 172.21.15.62:0/4157586890 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27cc0146c0 con 0x7f27d4063490 2021-12-17T18:18:21.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.458+0000 7f27cb7fe700 1 -- 172.21.15.62:0/4157586890 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc014820 con 0x7f27d4063490 2021-12-17T18:18:21.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.458+0000 7f27d8b2a700 1 -- 172.21.15.62:0/4157586890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d41565d0 con 0x7f27d4063490 2021-12-17T18:18:21.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.458+0000 7f27cb7fe700 1 -- 172.21.15.62:0/4157586890 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27cc014b80 con 0x7f27d4063490 2021-12-17T18:18:21.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.458+0000 7f27d8b2a700 1 -- 172.21.15.62:0/4157586890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d4067130 con 0x7f27d4063490 2021-12-17T18:18:21.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.458+0000 7f27d8b2a700 1 -- 172.21.15.62:0/4157586890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d4156160 con 0x7f27d4063490 2021-12-17T18:18:21.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.458+0000 7f27cb7fe700 1 -- 172.21.15.62:0/4157586890 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f27cc012040 con 0x7f27d4063490 2021-12-17T18:18:21.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.458+0000 7f27cb7fe700 1 --2- 172.21.15.62:0/4157586890 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f27b8053610 0x7f27b8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.458+0000 7f27cb7fe700 1 -- 172.21.15.62:0/4157586890 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f27cc06bed0 con 0x7f27d4063490 2021-12-17T18:18:21.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.458+0000 7f27d259c700 1 --2- 172.21.15.62:0/4157586890 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f27b8053610 0x7f27b8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.458+0000 7f27d259c700 1 --2- 172.21.15.62:0/4157586890 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f27b8053610 0x7f27b8055ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f27bc00d000 tx=0x7f27bc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:21.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.466+0000 7f27cb7fe700 1 -- 172.21.15.62:0/4157586890 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f27cc043030 con 0x7f27d4063490 2021-12-17T18:18:21.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.590+0000 7f27d8b2a700 1 -- 172.21.15.62:0/4157586890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f27d40573d0 con 0x7f27d4063490 2021-12-17T18:18:21.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.594+0000 7f27cb7fe700 1 -- 172.21.15.62:0/4157586890 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f27cc046650 con 0x7f27d4063490 2021-12-17T18:18:21.597 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:21.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.594+0000 7f27d8b2a700 1 -- 172.21.15.62:0/4157586890 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f27b8053610 msgr2=0x7f27b8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.594+0000 7f27d8b2a700 1 --2- 172.21.15.62:0/4157586890 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f27b8053610 0x7f27b8055ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f27bc00d000 tx=0x7f27bc009040).stop 2021-12-17T18:18:21.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.594+0000 7f27d8b2a700 1 -- 172.21.15.62:0/4157586890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27d4063490 msgr2=0x7f27d4066c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.594+0000 7f27d8b2a700 1 --2- 172.21.15.62:0/4157586890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27d4063490 0x7f27d4066c40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f27cc00b000 tx=0x7f27cc008040).stop 2021-12-17T18:18:21.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.594+0000 7f27d8b2a700 1 -- 172.21.15.62:0/4157586890 shutdown_connections 2021-12-17T18:18:21.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.594+0000 7f27d8b2a700 1 --2- 172.21.15.62:0/4157586890 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f27b8053610 0x7f27b8055ad0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.594+0000 7f27d8b2a700 1 --2- 172.21.15.62:0/4157586890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27d4063490 0x7f27d4066c40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.594+0000 7f27d8b2a700 1 --2- 172.21.15.62:0/4157586890 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27d414a2f0 0x7f27d41521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.594+0000 7f27d8b2a700 1 --2- 172.21.15.62:0/4157586890 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27b4003e70 0x7f27d4147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.594+0000 7f27d8b2a700 1 -- 172.21.15.62:0/4157586890 >> 172.21.15.62:0/4157586890 conn(0x7f27d4062430 msgr2=0x7f27d41400e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:21.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.594+0000 7f27d8b2a700 1 -- 172.21.15.62:0/4157586890 shutdown_connections 2021-12-17T18:18:21.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.594+0000 7f27d8b2a700 1 -- 172.21.15.62:0/4157586890 wait complete. 2021-12-17T18:18:21.611 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:18:21.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.714+0000 7ff0ce37f700 1 Processor -- start 2021-12-17T18:18:21.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.714+0000 7ff0ce37f700 1 -- start start 2021-12-17T18:18:21.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.714+0000 7ff0ce37f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0c805ca90 0x7ff0c80b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.714+0000 7ff0ce37f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff0c80b40b0 0x7ff0c8143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.714+0000 7ff0ce37f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c80b0870 con 0x7ff0c80b47c0 2021-12-17T18:18:21.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.714+0000 7ff0ce37f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c805ce70 con 0x7ff0c80b40b0 2021-12-17T18:18:21.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.714+0000 7ff0ce37f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c80b05d0 con 0x7ff0c805ca90 2021-12-17T18:18:21.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.714+0000 7ff0cdb7e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff0c80b40b0 0x7ff0c8143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.714+0000 7ff0ccb7c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff0c80b47c0 0x7ff0c80b56f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59698/0 (socket says 172.21.15.62:59698) 2021-12-17T18:18:21.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0ccb7c700 1 -- 172.21.15.62:0/3504619615 learned_addr learned my addr 172.21.15.62:0/3504619615 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:21.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0cdb7e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff0c80b40b0 0x7ff0c8143ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47886/0 (socket says 172.21.15.62:47886) 2021-12-17T18:18:21.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0cd37d700 1 --2- 172.21.15.62:0/3504619615 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0c805ca90 0x7ff0c80b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0cdb7e700 1 -- 172.21.15.62:0/3504619615 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0c805ca90 msgr2=0x7ff0c80b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:21.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0cdb7e700 1 --2- 172.21.15.62:0/3504619615 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0c805ca90 0x7ff0c80b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0cdb7e700 1 -- 172.21.15.62:0/3504619615 >> v1:172.21.15.62:6789/0 conn(0x7ff0c80b47c0 legacy=0x7ff0c80b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0cdb7e700 1 -- 172.21.15.62:0/3504619615 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c80b5250 con 0x7ff0c80b40b0 2021-12-17T18:18:21.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0cd37d700 1 --2- 172.21.15.62:0/3504619615 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0c805ca90 0x7ff0c80b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:21.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0cdb7e700 1 --2- 172.21.15.62:0/3504619615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c80b40b0 0x7ff0c8143ba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ff0c00032f0 tx=0x7ff0c00091d0).ready entity=mon.0 client_cookie=82d341bf6bb80ff2 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:21.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0b3fff700 1 -- 172.21.15.62:0/3504619615 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0c0009ea0 con 0x7ff0c80b40b0 2021-12-17T18:18:21.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0b3fff700 1 -- 172.21.15.62:0/3504619615 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c000b8a0 con 0x7ff0c80b40b0 2021-12-17T18:18:21.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0b3fff700 1 -- 172.21.15.62:0/3504619615 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0c000ba10 con 0x7ff0c80b40b0 2021-12-17T18:18:21.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0ce37f700 1 -- 172.21.15.62:0/3504619615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c80b40b0 msgr2=0x7ff0c8143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0ce37f700 1 --2- 172.21.15.62:0/3504619615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c80b40b0 0x7ff0c8143ba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ff0c00032f0 tx=0x7ff0c00091d0).stop 2021-12-17T18:18:21.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0ce37f700 1 -- 172.21.15.62:0/3504619615 shutdown_connections 2021-12-17T18:18:21.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0ce37f700 1 --2- 172.21.15.62:0/3504619615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c80b40b0 0x7ff0c8143ba0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0ce37f700 1 --2- 172.21.15.62:0/3504619615 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0c805ca90 0x7ff0c80b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0ce37f700 1 -- 172.21.15.62:0/3504619615 >> 172.21.15.62:0/3504619615 conn(0x7ff0c805bcd0 msgr2=0x7ff0c8062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:21.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0ce37f700 1 -- 172.21.15.62:0/3504619615 shutdown_connections 2021-12-17T18:18:21.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.718+0000 7ff0ce37f700 1 -- 172.21.15.62:0/3504619615 wait complete. 2021-12-17T18:18:21.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0ce37f700 1 Processor -- start 2021-12-17T18:18:21.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0ce37f700 1 -- start start 2021-12-17T18:18:21.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0ce37f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c805ca90 0x7ff0c8148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0ce37f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0c80b40b0 0x7ff0c80a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0ce37f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0c80b47c0 0x7ff0c80a4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0ce37f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c80b00d0 con 0x7ff0c805ca90 2021-12-17T18:18:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0ce37f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c8067050 con 0x7ff0c80b47c0 2021-12-17T18:18:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0ce37f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c8066b10 con 0x7ff0c80b40b0 2021-12-17T18:18:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0cd37d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c805ca90 0x7ff0c8148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0cd37d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c805ca90 0x7ff0c8148e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47890/0 (socket says 172.21.15.62:47890) 2021-12-17T18:18:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0cd37d700 1 -- 172.21.15.62:0/3928770599 learned_addr learned my addr 172.21.15.62:0/3928770599 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0cdb7e700 1 --2- 172.21.15.62:0/3928770599 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0c80b47c0 0x7ff0c80a4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0ccb7c700 1 --2- 172.21.15.62:0/3928770599 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0c80b40b0 0x7ff0c80a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0cd37d700 1 -- 172.21.15.62:0/3928770599 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0c80b40b0 msgr2=0x7ff0c80a4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0cd37d700 1 --2- 172.21.15.62:0/3928770599 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0c80b40b0 0x7ff0c80a4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0cd37d700 1 -- 172.21.15.62:0/3928770599 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0c80b47c0 msgr2=0x7ff0c80a4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0cd37d700 1 --2- 172.21.15.62:0/3928770599 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0c80b47c0 0x7ff0c80a4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0cd37d700 1 -- 172.21.15.62:0/3928770599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c0009470 con 0x7ff0c805ca90 2021-12-17T18:18:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0cd37d700 1 --2- 172.21.15.62:0/3928770599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c805ca90 0x7ff0c8148e70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7ff0c8064cc0 tx=0x7ff0bc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0baffd700 1 -- 172.21.15.62:0/3928770599 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0bc011780 con 0x7ff0c805ca90 2021-12-17T18:18:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0baffd700 1 -- 172.21.15.62:0/3928770599 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc0118e0 con 0x7ff0c805ca90 2021-12-17T18:18:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0ce37f700 1 -- 172.21.15.62:0/3928770599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c8066db0 con 0x7ff0c805ca90 2021-12-17T18:18:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.722+0000 7ff0baffd700 1 -- 172.21.15.62:0/3928770599 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0bc011c40 con 0x7ff0c805ca90 2021-12-17T18:18:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.726+0000 7ff0ce37f700 1 -- 172.21.15.62:0/3928770599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c80a52e0 con 0x7ff0c805ca90 2021-12-17T18:18:21.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.726+0000 7ff0ce37f700 1 -- 172.21.15.62:0/3928770599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c80b3980 con 0x7ff0c805ca90 2021-12-17T18:18:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.726+0000 7ff0baffd700 1 -- 172.21.15.62:0/3928770599 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff0bc012420 con 0x7ff0c805ca90 2021-12-17T18:18:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.726+0000 7ff0baffd700 1 --2- 172.21.15.62:0/3928770599 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff0a40535b0 0x7ff0a4055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.726+0000 7ff0baffd700 1 -- 172.21.15.62:0/3928770599 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff0bc06b840 con 0x7ff0c805ca90 2021-12-17T18:18:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.726+0000 7ff0ccb7c700 1 --2- 172.21.15.62:0/3928770599 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff0a40535b0 0x7ff0a4055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.730+0000 7ff0ccb7c700 1 --2- 172.21.15.62:0/3928770599 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff0a40535b0 0x7ff0a4055a70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff0c400d000 tx=0x7ff0c4000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.734+0000 7ff0baffd700 1 -- 172.21.15.62:0/3928770599 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff0bc0427b0 con 0x7ff0c805ca90 2021-12-17T18:18:21.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.854+0000 7ff0ce37f700 1 -- 172.21.15.62:0/3928770599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff0c80573d0 con 0x7ff0c805ca90 2021-12-17T18:18:21.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.854+0000 7ff0baffd700 1 -- 172.21.15.62:0/3928770599 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff0bc045dd0 con 0x7ff0c805ca90 2021-12-17T18:18:21.861 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:21.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.858+0000 7ff0ce37f700 1 -- 172.21.15.62:0/3928770599 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff0a40535b0 msgr2=0x7ff0a4055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.858+0000 7ff0ce37f700 1 --2- 172.21.15.62:0/3928770599 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff0a40535b0 0x7ff0a4055a70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff0c400d000 tx=0x7ff0c4000bc0).stop 2021-12-17T18:18:21.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.858+0000 7ff0ce37f700 1 -- 172.21.15.62:0/3928770599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c805ca90 msgr2=0x7ff0c8148e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.858+0000 7ff0ce37f700 1 --2- 172.21.15.62:0/3928770599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c805ca90 0x7ff0c8148e70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7ff0c8064cc0 tx=0x7ff0bc008040).stop 2021-12-17T18:18:21.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.858+0000 7ff0ce37f700 1 -- 172.21.15.62:0/3928770599 shutdown_connections 2021-12-17T18:18:21.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.858+0000 7ff0ce37f700 1 --2- 172.21.15.62:0/3928770599 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff0a40535b0 0x7ff0a4055a70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.858+0000 7ff0ce37f700 1 --2- 172.21.15.62:0/3928770599 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0c80b47c0 0x7ff0c80a4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.858+0000 7ff0ce37f700 1 --2- 172.21.15.62:0/3928770599 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0c80b40b0 0x7ff0c80a4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.858+0000 7ff0ce37f700 1 --2- 172.21.15.62:0/3928770599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c805ca90 0x7ff0c8148e70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.858+0000 7ff0ce37f700 1 -- 172.21.15.62:0/3928770599 >> 172.21.15.62:0/3928770599 conn(0x7ff0c805bcd0 msgr2=0x7ff0c80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:21.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.858+0000 7ff0ce37f700 1 -- 172.21.15.62:0/3928770599 shutdown_connections 2021-12-17T18:18:21.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.858+0000 7ff0ce37f700 1 -- 172.21.15.62:0/3928770599 wait complete. 2021-12-17T18:18:21.880 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:18:21.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa919ab8700 1 Processor -- start 2021-12-17T18:18:21.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa919ab8700 1 -- start start 2021-12-17T18:18:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa919ab8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa91405ca90 0x7fa91414b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa919ab8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa9140ac040 0x7fa9141475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa919ab8700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa914147ab0 0x7fa9140b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa919ab8700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa914060750 con 0x7fa91405ca90 2021-12-17T18:18:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa919ab8700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91414ac00 con 0x7fa914147ab0 2021-12-17T18:18:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa919ab8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91414aea0 con 0x7fa9140ac040 2021-12-17T18:18:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa918ab6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa91405ca90 0x7fa91414b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa918ab6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa91405ca90 0x7fa91414b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47898/0 (socket says 172.21.15.62:47898) 2021-12-17T18:18:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa918ab6700 1 -- 172.21.15.62:0/520301087 learned_addr learned my addr 172.21.15.62:0/520301087 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa9192b7700 1 --2- 172.21.15.62:0/520301087 >> v2:172.21.15.109:3300/0 conn(0x7fa914147ab0 0x7fa9140b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa913fff700 1 --2- 172.21.15.62:0/520301087 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa9140ac040 0x7fa9141475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa918ab6700 1 -- 172.21.15.62:0/520301087 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa9140ac040 msgr2=0x7fa9141475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa918ab6700 1 --2- 172.21.15.62:0/520301087 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa9140ac040 0x7fa9141475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa918ab6700 1 -- 172.21.15.62:0/520301087 >> v2:172.21.15.109:3300/0 conn(0x7fa914147ab0 msgr2=0x7fa9140b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa918ab6700 1 --2- 172.21.15.62:0/520301087 >> v2:172.21.15.109:3300/0 conn(0x7fa914147ab0 0x7fa9140b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa918ab6700 1 -- 172.21.15.62:0/520301087 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91405ce70 con 0x7fa91405ca90 2021-12-17T18:18:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa9192b7700 1 --2- 172.21.15.62:0/520301087 >> v2:172.21.15.109:3300/0 conn(0x7fa914147ab0 0x7fa9140b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa918ab6700 1 --2- 172.21.15.62:0/520301087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa91405ca90 0x7fa91414b340 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa904002f70 tx=0x7fa904006eb0).ready entity=mon.0 client_cookie=545012c058bf4a3a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa9137fe700 1 -- 172.21.15.62:0/520301087 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa90400d570 con 0x7fa91405ca90 2021-12-17T18:18:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa9137fe700 1 -- 172.21.15.62:0/520301087 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa904000e90 con 0x7fa91405ca90 2021-12-17T18:18:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.982+0000 7fa9137fe700 1 -- 172.21.15.62:0/520301087 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa90400d900 con 0x7fa91405ca90 2021-12-17T18:18:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa919ab8700 1 -- 172.21.15.62:0/520301087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa91405ca90 msgr2=0x7fa91414b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa919ab8700 1 --2- 172.21.15.62:0/520301087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa91405ca90 0x7fa91414b340 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa904002f70 tx=0x7fa904006eb0).stop 2021-12-17T18:18:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa919ab8700 1 -- 172.21.15.62:0/520301087 shutdown_connections 2021-12-17T18:18:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa919ab8700 1 --2- 172.21.15.62:0/520301087 >> v2:172.21.15.109:3300/0 conn(0x7fa914147ab0 0x7fa9140b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa919ab8700 1 --2- 172.21.15.62:0/520301087 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa9140ac040 0x7fa9141475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa919ab8700 1 --2- 172.21.15.62:0/520301087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa91405ca90 0x7fa91414b340 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa919ab8700 1 -- 172.21.15.62:0/520301087 >> 172.21.15.62:0/520301087 conn(0x7fa91405be70 msgr2=0x7fa914062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:21.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa919ab8700 1 -- 172.21.15.62:0/520301087 shutdown_connections 2021-12-17T18:18:21.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa919ab8700 1 -- 172.21.15.62:0/520301087 wait complete. 2021-12-17T18:18:22.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa919ab8700 1 Processor -- start 2021-12-17T18:18:22.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa919ab8700 1 -- start start 2021-12-17T18:18:22.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa919ab8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa91405ca90 0x7fa91409feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa919ab8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9140ac040 0x7fa9140adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa919ab8700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa914147ab0 0x7fa91409f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa919ab8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9140ae4e0 con 0x7fa9140ac040 2021-12-17T18:18:22.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa919ab8700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9140ae700 con 0x7fa914147ab0 2021-12-17T18:18:22.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa919ab8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91409eae0 con 0x7fa91405ca90 2021-12-17T18:18:22.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa913fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9140ac040 0x7fa9140adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa913fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9140ac040 0x7fa9140adff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47904/0 (socket says 172.21.15.62:47904) 2021-12-17T18:18:22.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa913fff700 1 -- 172.21.15.62:0/315639689 learned_addr learned my addr 172.21.15.62:0/315639689 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:22.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa9192b7700 1 --2- 172.21.15.62:0/315639689 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa914147ab0 0x7fa91409f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.986+0000 7fa918ab6700 1 --2- 172.21.15.62:0/315639689 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa91405ca90 0x7fa91409feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.990+0000 7fa913fff700 1 -- 172.21.15.62:0/315639689 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa91405ca90 msgr2=0x7fa91409feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.990+0000 7fa913fff700 1 --2- 172.21.15.62:0/315639689 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa91405ca90 0x7fa91409feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.990+0000 7fa913fff700 1 -- 172.21.15.62:0/315639689 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa914147ab0 msgr2=0x7fa91409f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.990+0000 7fa913fff700 1 --2- 172.21.15.62:0/315639689 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa914147ab0 0x7fa91409f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.990+0000 7fa913fff700 1 -- 172.21.15.62:0/315639689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90400b1e0 con 0x7fa9140ac040 2021-12-17T18:18:22.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.990+0000 7fa913fff700 1 --2- 172.21.15.62:0/315639689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9140ac040 0x7fa9140adff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa9080030b0 tx=0x7fa908008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:22.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.990+0000 7fa911ffb700 1 -- 172.21.15.62:0/315639689 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa908011780 con 0x7fa9140ac040 2021-12-17T18:18:22.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.990+0000 7fa911ffb700 1 -- 172.21.15.62:0/315639689 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9080118e0 con 0x7fa9140ac040 2021-12-17T18:18:22.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.990+0000 7fa919ab8700 1 -- 172.21.15.62:0/315639689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91409ed80 con 0x7fa9140ac040 2021-12-17T18:18:22.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.990+0000 7fa911ffb700 1 -- 172.21.15.62:0/315639689 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa908011c40 con 0x7fa9140ac040 2021-12-17T18:18:22.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.990+0000 7fa919ab8700 1 -- 172.21.15.62:0/315639689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91409f930 con 0x7fa9140ac040 2021-12-17T18:18:22.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.990+0000 7fa919ab8700 1 -- 172.21.15.62:0/315639689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9140573d0 con 0x7fa9140ac040 2021-12-17T18:18:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.990+0000 7fa911ffb700 1 -- 172.21.15.62:0/315639689 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa908012420 con 0x7fa9140ac040 2021-12-17T18:18:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.990+0000 7fa911ffb700 1 --2- 172.21.15.62:0/315639689 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8f4053640 0x7fa8f4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.990+0000 7fa911ffb700 1 -- 172.21.15.62:0/315639689 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa90806b650 con 0x7fa9140ac040 2021-12-17T18:18:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.990+0000 7fa918ab6700 1 --2- 172.21.15.62:0/315639689 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8f4053640 0x7fa8f4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.994+0000 7fa918ab6700 1 --2- 172.21.15.62:0/315639689 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8f4053640 0x7fa8f4055b00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa90401c000 tx=0x7fa904015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:22.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:21.998+0000 7fa911ffb700 1 -- 172.21.15.62:0/315639689 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa908042750 con 0x7fa9140ac040 2021-12-17T18:18:22.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.122+0000 7fa919ab8700 1 -- 172.21.15.62:0/315639689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9140a1fc0 con 0x7fa9140ac040 2021-12-17T18:18:22.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.126+0000 7fa911ffb700 1 -- 172.21.15.62:0/315639689 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa908045d70 con 0x7fa9140ac040 2021-12-17T18:18:22.130 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:22.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.126+0000 7fa919ab8700 1 -- 172.21.15.62:0/315639689 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8f4053640 msgr2=0x7fa8f4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.126+0000 7fa919ab8700 1 --2- 172.21.15.62:0/315639689 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8f4053640 0x7fa8f4055b00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa90401c000 tx=0x7fa904015000).stop 2021-12-17T18:18:22.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.126+0000 7fa919ab8700 1 -- 172.21.15.62:0/315639689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9140ac040 msgr2=0x7fa9140adff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.126+0000 7fa919ab8700 1 --2- 172.21.15.62:0/315639689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9140ac040 0x7fa9140adff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa9080030b0 tx=0x7fa908008040).stop 2021-12-17T18:18:22.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.126+0000 7fa919ab8700 1 -- 172.21.15.62:0/315639689 shutdown_connections 2021-12-17T18:18:22.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.126+0000 7fa919ab8700 1 --2- 172.21.15.62:0/315639689 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8f4053640 0x7fa8f4055b00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.126+0000 7fa919ab8700 1 --2- 172.21.15.62:0/315639689 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa914147ab0 0x7fa91409f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.126+0000 7fa919ab8700 1 --2- 172.21.15.62:0/315639689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9140ac040 0x7fa9140adff0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.126+0000 7fa919ab8700 1 --2- 172.21.15.62:0/315639689 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa91405ca90 0x7fa91409feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.126+0000 7fa919ab8700 1 -- 172.21.15.62:0/315639689 >> 172.21.15.62:0/315639689 conn(0x7fa91405be70 msgr2=0x7fa914144830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:22.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.130+0000 7fa919ab8700 1 -- 172.21.15.62:0/315639689 shutdown_connections 2021-12-17T18:18:22.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.130+0000 7fa919ab8700 1 -- 172.21.15.62:0/315639689 wait complete. 2021-12-17T18:18:22.147 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-12-17T18:18:22.148 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-12-17T18:18:22.148 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2021-12-17T18:18:22.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.246+0000 7f263b9e1700 1 Processor -- start 2021-12-17T18:18:22.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.246+0000 7f263b9e1700 1 -- start start 2021-12-17T18:18:22.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f263b9e1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26340b21f0 0x7f263414aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f263b9e1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f26340a7bb0 0x7f2634067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f263b9e1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26340b2ce0 con 0x7f26340b1730 2021-12-17T18:18:22.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f263b9e1700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2634147870 con 0x7f26340a7bb0 2021-12-17T18:18:22.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f263b9e1700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26340b2f10 con 0x7f26340b21f0 2021-12-17T18:18:22.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f2639f7e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f26340a7bb0 0x7f2634067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f2638f7c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f26340b1730 0x7f26340ace90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59722/0 (socket says 172.21.15.62:59722) 2021-12-17T18:18:22.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f2638f7c700 1 -- 172.21.15.62:0/945123211 learned_addr learned my addr 172.21.15.62:0/945123211 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:22.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f263977d700 1 --2- 172.21.15.62:0/945123211 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26340b21f0 0x7f263414aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f2639f7e700 1 -- 172.21.15.62:0/945123211 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26340b21f0 msgr2=0x7f263414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:22.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f2639f7e700 1 --2- 172.21.15.62:0/945123211 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26340b21f0 0x7f263414aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f2639f7e700 1 -- 172.21.15.62:0/945123211 >> v1:172.21.15.62:6789/0 conn(0x7f26340b1730 legacy=0x7f26340ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f2639f7e700 1 -- 172.21.15.62:0/945123211 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26340aca60 con 0x7f26340a7bb0 2021-12-17T18:18:22.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f2639f7e700 1 --2- 172.21.15.62:0/945123211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340a7bb0 0x7f2634067120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f262c002f70 tx=0x7f262c006df0).ready entity=mon.0 client_cookie=fa9262e456ef56b6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:22.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f262bfff700 1 -- 172.21.15.62:0/945123211 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262c00d570 con 0x7f26340a7bb0 2021-12-17T18:18:22.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f262bfff700 1 -- 172.21.15.62:0/945123211 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c000e90 con 0x7f26340a7bb0 2021-12-17T18:18:22.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f262bfff700 1 -- 172.21.15.62:0/945123211 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262c00d8c0 con 0x7f26340a7bb0 2021-12-17T18:18:22.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f263b9e1700 1 -- 172.21.15.62:0/945123211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340a7bb0 msgr2=0x7f2634067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f263b9e1700 1 --2- 172.21.15.62:0/945123211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340a7bb0 0x7f2634067120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f262c002f70 tx=0x7f262c006df0).stop 2021-12-17T18:18:22.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f263b9e1700 1 -- 172.21.15.62:0/945123211 shutdown_connections 2021-12-17T18:18:22.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f263b9e1700 1 --2- 172.21.15.62:0/945123211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340a7bb0 0x7f2634067120 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f263b9e1700 1 --2- 172.21.15.62:0/945123211 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26340b21f0 0x7f263414aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f263b9e1700 1 -- 172.21.15.62:0/945123211 >> 172.21.15.62:0/945123211 conn(0x7f263405f730 msgr2=0x7f263405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:22.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f263b9e1700 1 -- 172.21.15.62:0/945123211 shutdown_connections 2021-12-17T18:18:22.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.250+0000 7f263b9e1700 1 -- 172.21.15.62:0/945123211 wait complete. 2021-12-17T18:18:22.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f263b9e1700 1 Processor -- start 2021-12-17T18:18:22.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f263b9e1700 1 -- start start 2021-12-17T18:18:22.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f263b9e1700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26340a7bb0 0x7f263414bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f263b9e1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340b1730 0x7f263415a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f263b9e1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26340b21f0 0x7f2634063d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f263b9e1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26340ab7a0 con 0x7f26340b1730 2021-12-17T18:18:22.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f263b9e1700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26340aba10 con 0x7f26340a7bb0 2021-12-17T18:18:22.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f263b9e1700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26340638b0 con 0x7f26340b21f0 2021-12-17T18:18:22.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f2638f7c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340b1730 0x7f263415a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f2638f7c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340b1730 0x7f263415a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47918/0 (socket says 172.21.15.62:47918) 2021-12-17T18:18:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f2638f7c700 1 -- 172.21.15.62:0/3400825472 learned_addr learned my addr 172.21.15.62:0/3400825472 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f263977d700 1 --2- 172.21.15.62:0/3400825472 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26340a7bb0 0x7f263414bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f2639f7e700 1 --2- 172.21.15.62:0/3400825472 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26340b21f0 0x7f2634063d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f2638f7c700 1 -- 172.21.15.62:0/3400825472 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26340b21f0 msgr2=0x7f2634063d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f2638f7c700 1 --2- 172.21.15.62:0/3400825472 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26340b21f0 0x7f2634063d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f2638f7c700 1 -- 172.21.15.62:0/3400825472 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26340a7bb0 msgr2=0x7f263414bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f2638f7c700 1 --2- 172.21.15.62:0/3400825472 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26340a7bb0 0x7f263414bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f2638f7c700 1 -- 172.21.15.62:0/3400825472 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c00b180 con 0x7f26340b1730 2021-12-17T18:18:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.254+0000 7f2638f7c700 1 --2- 172.21.15.62:0/3400825472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340b1730 0x7f263415a5c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f2634061080 tx=0x7f26300014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:22.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.258+0000 7f262a7fc700 1 -- 172.21.15.62:0/3400825472 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2630005ba0 con 0x7f26340b1730 2021-12-17T18:18:22.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.258+0000 7f262a7fc700 1 -- 172.21.15.62:0/3400825472 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2630005d00 con 0x7f26340b1730 2021-12-17T18:18:22.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.258+0000 7f263b9e1700 1 -- 172.21.15.62:0/3400825472 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26340a9b60 con 0x7f26340b1730 2021-12-17T18:18:22.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.258+0000 7f262a7fc700 1 -- 172.21.15.62:0/3400825472 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26300072c0 con 0x7f26340b1730 2021-12-17T18:18:22.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.258+0000 7f263b9e1700 1 -- 172.21.15.62:0/3400825472 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26340a9720 con 0x7f26340b1730 2021-12-17T18:18:22.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.258+0000 7f263b9e1700 1 -- 172.21.15.62:0/3400825472 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26340abc10 con 0x7f26340b1730 2021-12-17T18:18:22.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.258+0000 7f262a7fc700 1 -- 172.21.15.62:0/3400825472 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f263001a060 con 0x7f26340b1730 2021-12-17T18:18:22.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.258+0000 7f262a7fc700 1 --2- 172.21.15.62:0/3400825472 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f261c0536d0 0x7f261c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.258+0000 7f262a7fc700 1 -- 172.21.15.62:0/3400825472 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f263006b3d0 con 0x7f26340b1730 2021-12-17T18:18:22.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.258+0000 7f263977d700 1 --2- 172.21.15.62:0/3400825472 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f261c0536d0 0x7f261c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.262+0000 7f263977d700 1 --2- 172.21.15.62:0/3400825472 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f261c0536d0 0x7f261c055b90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f262400c000 tx=0x7f2624008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:22.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.266+0000 7f262a7fc700 1 -- 172.21.15.62:0/3400825472 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f26300423e0 con 0x7f26340b1730 2021-12-17T18:18:22.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.418+0000 7f263b9e1700 1 -- 172.21.15.62:0/3400825472 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f26340aabf0 con 0x7f26340b1730 2021-12-17T18:18:22.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.422+0000 7f262a7fc700 1 -- 172.21.15.62:0/3400825472 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+131259 (secure 0 0 0) 0x7f26340aabf0 con 0x7f26340b1730 2021-12-17T18:18:22.430 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:22.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.426+0000 7f263b9e1700 1 -- 172.21.15.62:0/3400825472 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f261c0536d0 msgr2=0x7f261c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.426+0000 7f263b9e1700 1 --2- 172.21.15.62:0/3400825472 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f261c0536d0 0x7f261c055b90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f262400c000 tx=0x7f2624008040).stop 2021-12-17T18:18:22.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.426+0000 7f263b9e1700 1 -- 172.21.15.62:0/3400825472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340b1730 msgr2=0x7f263415a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.426+0000 7f263b9e1700 1 --2- 172.21.15.62:0/3400825472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340b1730 0x7f263415a5c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f2634061080 tx=0x7f26300014a0).stop 2021-12-17T18:18:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.426+0000 7f263b9e1700 1 -- 172.21.15.62:0/3400825472 shutdown_connections 2021-12-17T18:18:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.426+0000 7f263b9e1700 1 --2- 172.21.15.62:0/3400825472 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f261c0536d0 0x7f261c055b90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.426+0000 7f263b9e1700 1 --2- 172.21.15.62:0/3400825472 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26340b21f0 0x7f2634063d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.426+0000 7f263b9e1700 1 --2- 172.21.15.62:0/3400825472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340b1730 0x7f263415a5c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.426+0000 7f263b9e1700 1 --2- 172.21.15.62:0/3400825472 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26340a7bb0 0x7f263414bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.426+0000 7f263b9e1700 1 -- 172.21.15.62:0/3400825472 >> 172.21.15.62:0/3400825472 conn(0x7f263405f730 msgr2=0x7f26340adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.426+0000 7f263b9e1700 1 -- 172.21.15.62:0/3400825472 shutdown_connections 2021-12-17T18:18:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.426+0000 7f263b9e1700 1 -- 172.21.15.62:0/3400825472 wait complete. 2021-12-17T18:18:22.443 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6800","nonce":14658},{"type":"v1","addr":"172.21.15.109:6801","nonce":14658}]},"active_addr":"172.21.15.109:6801/14658","active_change":"2021-12-17T18:18:05.518731+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.109:0","nonce":1023689790}]},{"addrvec":[{"type":"v2","addr":"172.21.15.109:0","nonce":165545704}]},{"addrvec":[{"type":"v2","addr":"172.21.15.109:0","nonce":1473344228}]}]}} 2021-12-17T18:18:22.452 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-12-17T18:18:22.452 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2021-12-17T18:18:22.453 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:22.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.554+0000 7f688b259700 1 Processor -- start 2021-12-17T18:18:22.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.554+0000 7f688b259700 1 -- start start 2021-12-17T18:18:22.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f688b259700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f68840a9500 0x7f68840acf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f688b259700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68840ad670 0x7f68840b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f688b259700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68840ad480 con 0x7f68840b2c90 2021-12-17T18:18:22.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f688b259700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68840a8fc0 con 0x7f68840a9500 2021-12-17T18:18:22.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f688b259700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68840b3070 con 0x7f68840ad670 2021-12-17T18:18:22.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f6888ff5700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f68840b2c90 0x7f68840affc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:47824/0 (socket says 172.21.15.62:47824) 2021-12-17T18:18:22.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f68897f6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68840ad670 0x7f68840b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f6888ff5700 1 -- 172.21.15.62:0/577001528 learned_addr learned my addr 172.21.15.62:0/577001528 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:22.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f6883fff700 1 --2- 172.21.15.62:0/577001528 >> v2:172.21.15.109:3300/0 conn(0x7f68840a9500 0x7f68840acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f68837fe700 1 -- 172.21.15.62:0/577001528 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173292409 0 0) 0x7f6878001110 con 0x7f68840b2c90 2021-12-17T18:18:22.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f68837fe700 1 -- 172.21.15.62:0/577001528 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6868003260 con 0x7f68840b2c90 2021-12-17T18:18:22.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f68897f6700 1 -- 172.21.15.62:0/577001528 >> v2:172.21.15.109:3300/0 conn(0x7f68840a9500 msgr2=0x7f68840acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f68897f6700 1 --2- 172.21.15.62:0/577001528 >> v2:172.21.15.109:3300/0 conn(0x7f68840a9500 0x7f68840acf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f68897f6700 1 -- 172.21.15.62:0/577001528 >> v1:172.21.15.109:6789/0 conn(0x7f68840b2c90 legacy=0x7f68840affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f68897f6700 1 -- 172.21.15.62:0/577001528 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68840aca60 con 0x7f68840ad670 2021-12-17T18:18:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f68897f6700 1 --2- 172.21.15.62:0/577001528 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68840ad670 0x7f68840b06d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f687c0032f0 tx=0x7f687c00a2b0).ready entity=mon.2 client_cookie=8a841ae623f5d21c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f68837fe700 1 -- 172.21.15.62:0/577001528 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f687c00b760 con 0x7f68840ad670 2021-12-17T18:18:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f68837fe700 1 -- 172.21.15.62:0/577001528 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c00b8c0 con 0x7f68840ad670 2021-12-17T18:18:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f68837fe700 1 -- 172.21.15.62:0/577001528 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f687c00bc20 con 0x7f68840ad670 2021-12-17T18:18:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f688b259700 1 -- 172.21.15.62:0/577001528 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68840ad670 msgr2=0x7f68840b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f688b259700 1 --2- 172.21.15.62:0/577001528 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68840ad670 0x7f68840b06d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f687c0032f0 tx=0x7f687c00a2b0).stop 2021-12-17T18:18:22.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f688b259700 1 -- 172.21.15.62:0/577001528 shutdown_connections 2021-12-17T18:18:22.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f688b259700 1 --2- 172.21.15.62:0/577001528 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68840ad670 0x7f68840b06d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f688b259700 1 --2- 172.21.15.62:0/577001528 >> v2:172.21.15.109:3300/0 conn(0x7f68840a9500 0x7f68840acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f688b259700 1 -- 172.21.15.62:0/577001528 >> 172.21.15.62:0/577001528 conn(0x7f688405f730 msgr2=0x7f688405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:22.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f688b259700 1 -- 172.21.15.62:0/577001528 shutdown_connections 2021-12-17T18:18:22.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.558+0000 7f688b259700 1 -- 172.21.15.62:0/577001528 wait complete. 2021-12-17T18:18:22.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f688b259700 1 Processor -- start 2021-12-17T18:18:22.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f688b259700 1 -- start start 2021-12-17T18:18:22.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f688b259700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f68840a9500 0x7f6884066790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f688b259700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68840ad670 0x7f688414f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f688b259700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68840b2c90 0x7f6884151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f688b259700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6884063170 con 0x7f68840b2c90 2021-12-17T18:18:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f688b259700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68840636f0 con 0x7f68840a9500 2021-12-17T18:18:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f688b259700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688414f7b0 con 0x7f68840ad670 2021-12-17T18:18:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f68897f6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68840b2c90 0x7f6884151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f68897f6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68840b2c90 0x7f6884151cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47934/0 (socket says 172.21.15.62:47934) 2021-12-17T18:18:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f68897f6700 1 -- 172.21.15.62:0/1677844967 learned_addr learned my addr 172.21.15.62:0/1677844967 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f6888ff5700 1 --2- 172.21.15.62:0/1677844967 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f68840a9500 0x7f6884066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f6883fff700 1 --2- 172.21.15.62:0/1677844967 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68840ad670 0x7f688414f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f68897f6700 1 -- 172.21.15.62:0/1677844967 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68840ad670 msgr2=0x7f688414f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f68897f6700 1 --2- 172.21.15.62:0/1677844967 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68840ad670 0x7f688414f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f68897f6700 1 -- 172.21.15.62:0/1677844967 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f68840a9500 msgr2=0x7f6884066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f68897f6700 1 --2- 172.21.15.62:0/1677844967 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f68840a9500 0x7f6884066790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f68897f6700 1 -- 172.21.15.62:0/1677844967 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c00a510 con 0x7f68840b2c90 2021-12-17T18:18:22.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f68897f6700 1 --2- 172.21.15.62:0/1677844967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68840b2c90 0x7f6884151cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f687c0032f0 tx=0x7f68840af140).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:22.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f6881ffb700 1 -- 172.21.15.62:0/1677844967 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f687c01e070 con 0x7f68840b2c90 2021-12-17T18:18:22.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f6881ffb700 1 -- 172.21.15.62:0/1677844967 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c00fc30 con 0x7f68840b2c90 2021-12-17T18:18:22.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f688b259700 1 -- 172.21.15.62:0/1677844967 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688409e9d0 con 0x7f68840b2c90 2021-12-17T18:18:22.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f6881ffb700 1 -- 172.21.15.62:0/1677844967 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f687c018470 con 0x7f68840b2c90 2021-12-17T18:18:22.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.562+0000 7f688b259700 1 -- 172.21.15.62:0/1677844967 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68840b61a0 con 0x7f68840b2c90 2021-12-17T18:18:22.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.566+0000 7f688b259700 1 -- 172.21.15.62:0/1677844967 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68840638b0 con 0x7f68840b2c90 2021-12-17T18:18:22.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.566+0000 7f6881ffb700 1 -- 172.21.15.62:0/1677844967 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f687c0185d0 con 0x7f68840b2c90 2021-12-17T18:18:22.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.566+0000 7f6881ffb700 1 --2- 172.21.15.62:0/1677844967 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6864053610 0x7f6864055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.566+0000 7f6881ffb700 1 -- 172.21.15.62:0/1677844967 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f687c06ce30 con 0x7f68840b2c90 2021-12-17T18:18:22.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.566+0000 7f6888ff5700 1 --2- 172.21.15.62:0/1677844967 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6864053610 0x7f6864055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.566+0000 7f6888ff5700 1 --2- 172.21.15.62:0/1677844967 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6864053610 0x7f6864055ad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f687800d000 tx=0x7f68780078a0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:22.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.574+0000 7f6881ffb700 1 -- 172.21.15.62:0/1677844967 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f687c043f40 con 0x7f68840b2c90 2021-12-17T18:18:22.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.698+0000 7f688b259700 1 -- 172.21.15.62:0/1677844967 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68840a8d20 con 0x7f68840b2c90 2021-12-17T18:18:22.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.702+0000 7f6881ffb700 1 -- 172.21.15.62:0/1677844967 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f687c00b040 con 0x7f68840b2c90 2021-12-17T18:18:22.705 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:22.706 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:20.178383+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:17.128555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:18.180577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:22.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.702+0000 7f688b259700 1 -- 172.21.15.62:0/1677844967 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6864053610 msgr2=0x7f6864055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.702+0000 7f688b259700 1 --2- 172.21.15.62:0/1677844967 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6864053610 0x7f6864055ad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f687800d000 tx=0x7f68780078a0).stop 2021-12-17T18:18:22.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.702+0000 7f688b259700 1 -- 172.21.15.62:0/1677844967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68840b2c90 msgr2=0x7f6884151cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.702+0000 7f688b259700 1 --2- 172.21.15.62:0/1677844967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68840b2c90 0x7f6884151cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f687c0032f0 tx=0x7f68840af140).stop 2021-12-17T18:18:22.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.702+0000 7f688b259700 1 -- 172.21.15.62:0/1677844967 shutdown_connections 2021-12-17T18:18:22.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.702+0000 7f688b259700 1 --2- 172.21.15.62:0/1677844967 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6864053610 0x7f6864055ad0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.702+0000 7f688b259700 1 --2- 172.21.15.62:0/1677844967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68840b2c90 0x7f6884151cb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.702+0000 7f688b259700 1 --2- 172.21.15.62:0/1677844967 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68840ad670 0x7f688414f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.702+0000 7f688b259700 1 --2- 172.21.15.62:0/1677844967 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f68840a9500 0x7f6884066790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.702+0000 7f688b259700 1 -- 172.21.15.62:0/1677844967 >> 172.21.15.62:0/1677844967 conn(0x7f688405f730 msgr2=0x7f6884145ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:22.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.702+0000 7f688b259700 1 -- 172.21.15.62:0/1677844967 shutdown_connections 2021-12-17T18:18:22.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.702+0000 7f688b259700 1 -- 172.21.15.62:0/1677844967 wait complete. 2021-12-17T18:18:22.724 INFO:tasks.ceph.ceph_manager.ceph:all up! 2021-12-17T18:18:22.724 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:22.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14fa605700 1 Processor -- start 2021-12-17T18:18:22.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14fa605700 1 -- start start 2021-12-17T18:18:22.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14fa605700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f14f40b0250 0x7f14f414ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14fa605700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f40b2e50 con 0x7f14f40b2620 2021-12-17T18:18:22.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14fa605700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f40afc50 con 0x7f14f40b07f0 2021-12-17T18:18:22.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14fa605700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f40b1440 con 0x7f14f40b0250 2021-12-17T18:18:22.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14f9e04700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f14f40b0250 0x7f14f414ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14f9e04700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f14f40b0250 0x7f14f414ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47942/0 (socket says 172.21.15.62:47942) 2021-12-17T18:18:22.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14f9e04700 1 -- 172.21.15.62:0/1039686124 learned_addr learned my addr 172.21.15.62:0/1039686124 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:22.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14f9603700 1 --1- 172.21.15.62:0/1039686124 >> v1:172.21.15.62:6789/0 conn(0x7f14f40b2620 0x7f14f40b1b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59750/0 (socket says 172.21.15.62:59750) 2021-12-17T18:18:22.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14f9e04700 1 -- 172.21.15.62:0/1039686124 >> v1:172.21.15.109:6789/0 conn(0x7f14f40b07f0 legacy=0x7f14f40adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14e7fff700 1 -- 172.21.15.62:0/1039686124 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419559464 0 0) 0x7f14f40b2e50 con 0x7f14f40b2620 2021-12-17T18:18:22.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14f9e04700 1 -- 172.21.15.62:0/1039686124 >> v1:172.21.15.62:6789/0 conn(0x7f14f40b2620 legacy=0x7f14f40b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14f9e04700 1 -- 172.21.15.62:0/1039686124 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f40b2a00 con 0x7f14f40b0250 2021-12-17T18:18:22.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14f9e04700 1 --2- 172.21.15.62:0/1039686124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14f40b0250 0x7f14f414ddc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f14e8001110 tx=0x7f14ec009290).ready entity=mon.0 client_cookie=f5aef1458a0c1cbc server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:22.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14e7fff700 1 -- 172.21.15.62:0/1039686124 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14ec00b7e0 con 0x7f14f40b0250 2021-12-17T18:18:22.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14e7fff700 1 -- 172.21.15.62:0/1039686124 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec00b940 con 0x7f14f40b0250 2021-12-17T18:18:22.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14e7fff700 1 -- 172.21.15.62:0/1039686124 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14ec00bab0 con 0x7f14f40b0250 2021-12-17T18:18:22.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14fa605700 1 -- 172.21.15.62:0/1039686124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14f40b0250 msgr2=0x7f14f414ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.822+0000 7f14fa605700 1 --2- 172.21.15.62:0/1039686124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14f40b0250 0x7f14f414ddc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f14e8001110 tx=0x7f14ec009290).stop 2021-12-17T18:18:22.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14fa605700 1 -- 172.21.15.62:0/1039686124 shutdown_connections 2021-12-17T18:18:22.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14fa605700 1 --2- 172.21.15.62:0/1039686124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14f40b0250 0x7f14f414ddc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14fa605700 1 -- 172.21.15.62:0/1039686124 >> 172.21.15.62:0/1039686124 conn(0x7f14f405bcd0 msgr2=0x7f14f40630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:22.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14fa605700 1 -- 172.21.15.62:0/1039686124 shutdown_connections 2021-12-17T18:18:22.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14fa605700 1 -- 172.21.15.62:0/1039686124 wait complete. 2021-12-17T18:18:22.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14fa605700 1 Processor -- start 2021-12-17T18:18:22.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14fa605700 1 -- start start 2021-12-17T18:18:22.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14fa605700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14f40b0250 0x7f14f40a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14fa605700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f14f40b07f0 0x7f14f40a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14fa605700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14f40b2620 0x7f14f4144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14fa605700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f40a46a0 con 0x7f14f40b2620 2021-12-17T18:18:22.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14fa605700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f40a7760 con 0x7f14f40b07f0 2021-12-17T18:18:22.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14fa605700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f40a5120 con 0x7f14f40b0250 2021-12-17T18:18:22.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14f9e04700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14f40b2620 0x7f14f4144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14f9e04700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14f40b2620 0x7f14f4144770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47948/0 (socket says 172.21.15.62:47948) 2021-12-17T18:18:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14f9e04700 1 -- 172.21.15.62:0/944698044 learned_addr learned my addr 172.21.15.62:0/944698044 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14f8e02700 1 --2- 172.21.15.62:0/944698044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f14f40b07f0 0x7f14f40a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14f9603700 1 --2- 172.21.15.62:0/944698044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14f40b0250 0x7f14f40a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14f9e04700 1 -- 172.21.15.62:0/944698044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14f40b0250 msgr2=0x7f14f40a41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14f9e04700 1 --2- 172.21.15.62:0/944698044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14f40b0250 0x7f14f40a41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14f9e04700 1 -- 172.21.15.62:0/944698044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f14f40b07f0 msgr2=0x7f14f40a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14f9e04700 1 --2- 172.21.15.62:0/944698044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f14f40b07f0 0x7f14f40a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14f9e04700 1 -- 172.21.15.62:0/944698044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec009530 con 0x7f14f40b2620 2021-12-17T18:18:22.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14f9e04700 1 --2- 172.21.15.62:0/944698044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14f40b2620 0x7f14f4144770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f14e8001110 tx=0x7f14ec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:22.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14e67fc700 1 -- 172.21.15.62:0/944698044 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14ec00b7e0 con 0x7f14f40b2620 2021-12-17T18:18:22.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14e67fc700 1 -- 172.21.15.62:0/944698044 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec0032d0 con 0x7f14f40b2620 2021-12-17T18:18:22.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14fa605700 1 -- 172.21.15.62:0/944698044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f40a73a0 con 0x7f14f40b2620 2021-12-17T18:18:22.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14e67fc700 1 -- 172.21.15.62:0/944698044 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14ec011ea0 con 0x7f14f40b2620 2021-12-17T18:18:22.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.826+0000 7f14fa605700 1 -- 172.21.15.62:0/944698044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f40a31c0 con 0x7f14f40b2620 2021-12-17T18:18:22.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.830+0000 7f14fa605700 1 -- 172.21.15.62:0/944698044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f40a3740 con 0x7f14f40b2620 2021-12-17T18:18:22.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.830+0000 7f14e67fc700 1 -- 172.21.15.62:0/944698044 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f14ec026030 con 0x7f14f40b2620 2021-12-17T18:18:22.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.830+0000 7f14e67fc700 1 --2- 172.21.15.62:0/944698044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f14d4053610 0x7f14d4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:22.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.830+0000 7f14e67fc700 1 -- 172.21.15.62:0/944698044 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f14ec06c680 con 0x7f14f40b2620 2021-12-17T18:18:22.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.830+0000 7f14f9603700 1 --2- 172.21.15.62:0/944698044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f14d4053610 0x7f14d4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:22.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.830+0000 7f14f9603700 1 --2- 172.21.15.62:0/944698044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f14d4053610 0x7f14d4055ad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f14f000d000 tx=0x7f14f0007bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:22.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.838+0000 7f14e67fc700 1 -- 172.21.15.62:0/944698044 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f14f40a3740 con 0x7f14f40b2620 2021-12-17T18:18:22.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.966+0000 7f14fa605700 1 -- 172.21.15.62:0/944698044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14f40a52e0 con 0x7f14f40b2620 2021-12-17T18:18:22.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.966+0000 7f14e67fc700 1 -- 172.21.15.62:0/944698044 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f14f40a52e0 con 0x7f14f40b2620 2021-12-17T18:18:22.972 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:22.972 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:20.178383+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:17.128555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:18.180577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:22.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.966+0000 7f14fa605700 1 -- 172.21.15.62:0/944698044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f14d4053610 msgr2=0x7f14d4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.966+0000 7f14fa605700 1 --2- 172.21.15.62:0/944698044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f14d4053610 0x7f14d4055ad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f14f000d000 tx=0x7f14f0007bc0).stop 2021-12-17T18:18:22.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.966+0000 7f14fa605700 1 -- 172.21.15.62:0/944698044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14f40b2620 msgr2=0x7f14f4144770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:22.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.966+0000 7f14fa605700 1 --2- 172.21.15.62:0/944698044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14f40b2620 0x7f14f4144770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f14e8001110 tx=0x7f14ec016000).stop 2021-12-17T18:18:22.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.966+0000 7f14fa605700 1 -- 172.21.15.62:0/944698044 shutdown_connections 2021-12-17T18:18:22.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.966+0000 7f14fa605700 1 --2- 172.21.15.62:0/944698044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f14d4053610 0x7f14d4055ad0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.966+0000 7f14fa605700 1 --2- 172.21.15.62:0/944698044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14f40b2620 0x7f14f4144770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.966+0000 7f14fa605700 1 --2- 172.21.15.62:0/944698044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f14f40b07f0 0x7f14f40a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.966+0000 7f14fa605700 1 --2- 172.21.15.62:0/944698044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14f40b0250 0x7f14f40a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:22.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.966+0000 7f14fa605700 1 -- 172.21.15.62:0/944698044 >> 172.21.15.62:0/944698044 conn(0x7f14f405bcd0 msgr2=0x7f14f4147970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:22.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.970+0000 7f14fa605700 1 -- 172.21.15.62:0/944698044 shutdown_connections 2021-12-17T18:18:22.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:22.970+0000 7f14fa605700 1 -- 172.21.15.62:0/944698044 wait complete. 2021-12-17T18:18:22.985 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-12-17T18:18:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.086+0000 7f2a6ffff700 1 Processor -- start 2021-12-17T18:18:23.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.086+0000 7f2a6ffff700 1 -- start start 2021-12-17T18:18:23.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.086+0000 7f2a6ffff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f2a700b1d10 0x7f2a70147b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.086+0000 7f2a6ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a700b20f0 0x7f2a70144580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.086+0000 7f2a6ffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a700ad7a0 con 0x7f2a700afba0 2021-12-17T18:18:23.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.086+0000 7f2a6ffff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a700ac420 con 0x7f2a700b1d10 2021-12-17T18:18:23.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.086+0000 7f2a6ffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a70148430 con 0x7f2a700b20f0 2021-12-17T18:18:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.086+0000 7f2a6e7fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2a700afba0 0x7f2a7014a7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59764/0 (socket says 172.21.15.62:59764) 2021-12-17T18:18:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.086+0000 7f2a6e7fc700 1 -- 172.21.15.62:0/2056142155 learned_addr learned my addr 172.21.15.62:0/2056142155 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.086+0000 7f2a6effd700 1 --2- 172.21.15.62:0/2056142155 >> v2:172.21.15.109:3300/0 conn(0x7f2a700b1d10 0x7f2a70147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.086+0000 7f2a6f7fe700 1 --2- 172.21.15.62:0/2056142155 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a700b20f0 0x7f2a70144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.086+0000 7f2a6dffb700 1 -- 172.21.15.62:0/2056142155 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556885148 0 0) 0x7f2a700ad7a0 con 0x7f2a700afba0 2021-12-17T18:18:23.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.086+0000 7f2a6dffb700 1 -- 172.21.15.62:0/2056142155 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a54003260 con 0x7f2a700afba0 2021-12-17T18:18:23.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.086+0000 7f2a6f7fe700 1 -- 172.21.15.62:0/2056142155 >> v2:172.21.15.109:3300/0 conn(0x7f2a700b1d10 msgr2=0x7f2a70147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:23.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.086+0000 7f2a6f7fe700 1 --2- 172.21.15.62:0/2056142155 >> v2:172.21.15.109:3300/0 conn(0x7f2a700b1d10 0x7f2a70147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.086+0000 7f2a6f7fe700 1 -- 172.21.15.62:0/2056142155 >> v1:172.21.15.62:6789/0 conn(0x7f2a700afba0 legacy=0x7f2a7014a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.086+0000 7f2a6f7fe700 1 -- 172.21.15.62:0/2056142155 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a701473c0 con 0x7f2a700b20f0 2021-12-17T18:18:23.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6f7fe700 1 --2- 172.21.15.62:0/2056142155 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a700b20f0 0x7f2a70144580 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2a68002f70 tx=0x7f2a68006df0).ready entity=mon.2 client_cookie=8035c309125a4aa8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6dffb700 1 -- 172.21.15.62:0/2056142155 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a6800d4a0 con 0x7f2a700b20f0 2021-12-17T18:18:23.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6dffb700 1 -- 172.21.15.62:0/2056142155 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a68000e90 con 0x7f2a700b20f0 2021-12-17T18:18:23.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6dffb700 1 -- 172.21.15.62:0/2056142155 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a6800d7f0 con 0x7f2a700b20f0 2021-12-17T18:18:23.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6ffff700 1 -- 172.21.15.62:0/2056142155 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a700b20f0 msgr2=0x7f2a70144580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6ffff700 1 --2- 172.21.15.62:0/2056142155 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a700b20f0 0x7f2a70144580 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2a68002f70 tx=0x7f2a68006df0).stop 2021-12-17T18:18:23.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6ffff700 1 -- 172.21.15.62:0/2056142155 shutdown_connections 2021-12-17T18:18:23.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6ffff700 1 --2- 172.21.15.62:0/2056142155 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a700b20f0 0x7f2a70144580 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6ffff700 1 --2- 172.21.15.62:0/2056142155 >> v2:172.21.15.109:3300/0 conn(0x7f2a700b1d10 0x7f2a70147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6ffff700 1 -- 172.21.15.62:0/2056142155 >> 172.21.15.62:0/2056142155 conn(0x7f2a700623c0 msgr2=0x7f2a700627d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:23.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6ffff700 1 -- 172.21.15.62:0/2056142155 shutdown_connections 2021-12-17T18:18:23.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6ffff700 1 -- 172.21.15.62:0/2056142155 wait complete. 2021-12-17T18:18:23.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6ffff700 1 Processor -- start 2021-12-17T18:18:23.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6ffff700 1 -- start start 2021-12-17T18:18:23.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a700afba0 0x7f2a70141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a700b1d10 0x7f2a70141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6ffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2a700b20f0 0x7f2a700643a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a70063750 con 0x7f2a700afba0 2021-12-17T18:18:23.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6ffff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a70149030 con 0x7f2a700b20f0 2021-12-17T18:18:23.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.090+0000 7f2a6ffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a70157200 con 0x7f2a700b1d10 2021-12-17T18:18:23.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a6effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a700afba0 0x7f2a70141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a6effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a700afba0 0x7f2a70141090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47958/0 (socket says 172.21.15.62:47958) 2021-12-17T18:18:23.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a6effd700 1 -- 172.21.15.62:0/2250031436 learned_addr learned my addr 172.21.15.62:0/2250031436 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a6f7fe700 1 --2- 172.21.15.62:0/2250031436 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2a700b20f0 0x7f2a700643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a6e7fc700 1 --2- 172.21.15.62:0/2250031436 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a700b1d10 0x7f2a70141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a6effd700 1 -- 172.21.15.62:0/2250031436 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a700b1d10 msgr2=0x7f2a70141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a6effd700 1 --2- 172.21.15.62:0/2250031436 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a700b1d10 0x7f2a70141580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a6effd700 1 -- 172.21.15.62:0/2250031436 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2a700b20f0 msgr2=0x7f2a700643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a6effd700 1 --2- 172.21.15.62:0/2250031436 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2a700b20f0 0x7f2a700643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a6effd700 1 -- 172.21.15.62:0/2250031436 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6800b180 con 0x7f2a700afba0 2021-12-17T18:18:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a6e7fc700 1 --2- 172.21.15.62:0/2250031436 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a700b1d10 0x7f2a70141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a6effd700 1 --2- 172.21.15.62:0/2250031436 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a700afba0 0x7f2a70141090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f2a6400c000 tx=0x7f2a64006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a5ffff700 1 -- 172.21.15.62:0/2250031436 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a64010780 con 0x7f2a700afba0 2021-12-17T18:18:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a5ffff700 1 -- 172.21.15.62:0/2250031436 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a640108e0 con 0x7f2a700afba0 2021-12-17T18:18:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a5ffff700 1 -- 172.21.15.62:0/2250031436 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a64010c40 con 0x7f2a700afba0 2021-12-17T18:18:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a6ffff700 1 -- 172.21.15.62:0/2250031436 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a70148790 con 0x7f2a700afba0 2021-12-17T18:18:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a6ffff700 1 -- 172.21.15.62:0/2250031436 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a70156cf0 con 0x7f2a700afba0 2021-12-17T18:18:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a6ffff700 1 -- 172.21.15.62:0/2250031436 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2a70148c30 con 0x7f2a700afba0 2021-12-17T18:18:23.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a5ffff700 1 -- 172.21.15.62:0/2250031436 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2a6401c460 con 0x7f2a700afba0 2021-12-17T18:18:23.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a5ffff700 1 --2- 172.21.15.62:0/2250031436 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2a4c053610 0x7f2a4c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a5ffff700 1 -- 172.21.15.62:0/2250031436 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2a6406be00 con 0x7f2a700afba0 2021-12-17T18:18:23.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a5ffff700 1 --2- 172.21.15.62:0/2250031436 >> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] conn(0x7f2a4c05aa00 0x7f2a4c05ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a5ffff700 1 -- 172.21.15.62:0/2250031436 --> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a4c05d3e0 con 0x7f2a4c05aa00 2021-12-17T18:18:23.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a5ffff700 1 -- 172.21.15.62:0/2250031436 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a6406e470 con 0x7f2a700afba0 2021-12-17T18:18:23.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.094+0000 7f2a6e7fc700 1 --2- 172.21.15.62:0/2250031436 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2a4c053610 0x7f2a4c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.098+0000 7f2a6f7fe700 1 --2- 172.21.15.62:0/2250031436 >> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] conn(0x7f2a4c05aa00 0x7f2a4c05ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.098+0000 7f2a6f7fe700 1 --2- 172.21.15.62:0/2250031436 >> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] conn(0x7f2a4c05aa00 0x7f2a4c05ce20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.098+0000 7f2a6e7fc700 1 --2- 172.21.15.62:0/2250031436 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2a4c053610 0x7f2a4c055ad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2a6000b000 tx=0x7f2a60009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.098+0000 7f2a5ffff700 1 -- 172.21.15.62:0/2250031436 <== osd.0 v2:172.21.15.62:6800/14759 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f2a4c05d3e0 con 0x7f2a4c05aa00 2021-12-17T18:18:23.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.114+0000 7f2a6ffff700 1 -- 172.21.15.62:0/2250031436 --> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2a70064cf0 con 0x7f2a4c05aa00 2021-12-17T18:18:23.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.114+0000 7f2a5ffff700 1 -- 172.21.15.62:0/2250031436 <== osd.0 v2:172.21.15.62:6800/14759 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2a68017020 con 0x7f2a4c05aa00 2021-12-17T18:18:23.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.114+0000 7f2a6ffff700 1 -- 172.21.15.62:0/2250031436 >> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] conn(0x7f2a4c05aa00 msgr2=0x7f2a4c05ce20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.114+0000 7f2a6ffff700 1 --2- 172.21.15.62:0/2250031436 >> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] conn(0x7f2a4c05aa00 0x7f2a4c05ce20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.114+0000 7f2a6ffff700 1 -- 172.21.15.62:0/2250031436 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2a4c053610 msgr2=0x7f2a4c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.114+0000 7f2a6ffff700 1 --2- 172.21.15.62:0/2250031436 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2a4c053610 0x7f2a4c055ad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2a6000b000 tx=0x7f2a60009040).stop 2021-12-17T18:18:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.114+0000 7f2a6ffff700 1 -- 172.21.15.62:0/2250031436 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a700afba0 msgr2=0x7f2a70141090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.114+0000 7f2a6ffff700 1 --2- 172.21.15.62:0/2250031436 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a700afba0 0x7f2a70141090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f2a6400c000 tx=0x7f2a64006df0).stop 2021-12-17T18:18:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.114+0000 7f2a6f7fe700 1 -- 172.21.15.62:0/2250031436 reap_dead start 2021-12-17T18:18:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.114+0000 7f2a6ffff700 1 -- 172.21.15.62:0/2250031436 shutdown_connections 2021-12-17T18:18:23.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.114+0000 7f2a6ffff700 1 -- 172.21.15.62:0/2250031436 >> 172.21.15.62:0/2250031436 conn(0x7f2a700623c0 msgr2=0x7f2a7005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.114+0000 7f2a6ffff700 1 -- 172.21.15.62:0/2250031436 shutdown_connections 2021-12-17T18:18:23.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.114+0000 7f2a6ffff700 1 -- 172.21.15.62:0/2250031436 wait complete. 2021-12-17T18:18:23.132 INFO:teuthology.orchestra.run.smithi062.stdout:60129542149 2021-12-17T18:18:23.132 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-12-17T18:18:23.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.242+0000 7f306759e700 1 Processor -- start 2021-12-17T18:18:23.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.242+0000 7f306759e700 1 -- start start 2021-12-17T18:18:23.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.242+0000 7f306759e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f30680630e0 0x7f30680b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.242+0000 7f306759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30680b0e90 0x7f306813ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.242+0000 7f306759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30680b69f0 con 0x7f30680b6610 2021-12-17T18:18:23.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.242+0000 7f306759e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3068143800 con 0x7f30680630e0 2021-12-17T18:18:23.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.242+0000 7f306759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30680b1c40 con 0x7f30680b0e90 2021-12-17T18:18:23.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.242+0000 7f306659c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f30680b6610 0x7f30681430f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59780/0 (socket says 172.21.15.62:59780) 2021-12-17T18:18:23.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.242+0000 7f306659c700 1 -- 172.21.15.62:0/4072210446 learned_addr learned my addr 172.21.15.62:0/4072210446 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:23.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.242+0000 7f3066d9d700 1 --2- 172.21.15.62:0/4072210446 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30680b0e90 0x7f306813ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.242+0000 7f305dd9b700 1 --2- 172.21.15.62:0/4072210446 >> v2:172.21.15.109:3300/0 conn(0x7f30680630e0 0x7f30680b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.242+0000 7f3065d9b700 1 -- 172.21.15.62:0/4072210446 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759367117 0 0) 0x7f30680b69f0 con 0x7f30680b6610 2021-12-17T18:18:23.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.242+0000 7f3065d9b700 1 -- 172.21.15.62:0/4072210446 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3048003260 con 0x7f30680b6610 2021-12-17T18:18:23.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f3066d9d700 1 -- 172.21.15.62:0/4072210446 >> v2:172.21.15.109:3300/0 conn(0x7f30680630e0 msgr2=0x7f30680b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:23.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f3066d9d700 1 --2- 172.21.15.62:0/4072210446 >> v2:172.21.15.109:3300/0 conn(0x7f30680630e0 0x7f30680b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f3066d9d700 1 -- 172.21.15.62:0/4072210446 >> v1:172.21.15.62:6789/0 conn(0x7f30680b6610 legacy=0x7f30681430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f3066d9d700 1 -- 172.21.15.62:0/4072210446 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30680b0260 con 0x7f30680b0e90 2021-12-17T18:18:23.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f3066d9d700 1 --2- 172.21.15.62:0/4072210446 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30680b0e90 0x7f306813ef50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f30600032f0 tx=0x7f30600091d0).ready entity=mon.2 client_cookie=10e97ee45f6dee8d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f3065d9b700 1 -- 172.21.15.62:0/4072210446 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f306000b600 con 0x7f30680b0e90 2021-12-17T18:18:23.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f3065d9b700 1 -- 172.21.15.62:0/4072210446 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306000b760 con 0x7f30680b0e90 2021-12-17T18:18:23.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f3065d9b700 1 -- 172.21.15.62:0/4072210446 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f306000b8d0 con 0x7f30680b0e90 2021-12-17T18:18:23.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f306759e700 1 -- 172.21.15.62:0/4072210446 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30680b0e90 msgr2=0x7f306813ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f306759e700 1 --2- 172.21.15.62:0/4072210446 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30680b0e90 0x7f306813ef50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f30600032f0 tx=0x7f30600091d0).stop 2021-12-17T18:18:23.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f306759e700 1 -- 172.21.15.62:0/4072210446 shutdown_connections 2021-12-17T18:18:23.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f306759e700 1 --2- 172.21.15.62:0/4072210446 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30680b0e90 0x7f306813ef50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f306759e700 1 --2- 172.21.15.62:0/4072210446 >> v2:172.21.15.109:3300/0 conn(0x7f30680630e0 0x7f30680b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f306759e700 1 -- 172.21.15.62:0/4072210446 >> 172.21.15.62:0/4072210446 conn(0x7f306805d1c0 msgr2=0x7f30680b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:23.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f306759e700 1 -- 172.21.15.62:0/4072210446 shutdown_connections 2021-12-17T18:18:23.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f306759e700 1 -- 172.21.15.62:0/4072210446 wait complete. 2021-12-17T18:18:23.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f306759e700 1 Processor -- start 2021-12-17T18:18:23.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.246+0000 7f306759e700 1 -- start start 2021-12-17T18:18:23.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f306759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30680630e0 0x7f30680b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f306759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30680b0e90 0x7f30681522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f306759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30680b6610 0x7f30681527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f306759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3068066e60 con 0x7f30680b0e90 2021-12-17T18:18:23.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f306759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306809f7e0 con 0x7f30680630e0 2021-12-17T18:18:23.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f306759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306809ee00 con 0x7f30680b6610 2021-12-17T18:18:23.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f305dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30680b0e90 0x7f30681522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f305dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30680b0e90 0x7f30681522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47976/0 (socket says 172.21.15.62:47976) 2021-12-17T18:18:23.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f305dd9b700 1 -- 172.21.15.62:0/1041291090 learned_addr learned my addr 172.21.15.62:0/1041291090 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:23.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f3066d9d700 1 --2- 172.21.15.62:0/1041291090 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30680b6610 0x7f30681527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f306659c700 1 --2- 172.21.15.62:0/1041291090 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30680630e0 0x7f30680b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f305dd9b700 1 -- 172.21.15.62:0/1041291090 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30680b6610 msgr2=0x7f30681527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f305dd9b700 1 --2- 172.21.15.62:0/1041291090 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30680b6610 0x7f30681527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f305dd9b700 1 -- 172.21.15.62:0/1041291090 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30680630e0 msgr2=0x7f30680b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f305dd9b700 1 --2- 172.21.15.62:0/1041291090 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30680630e0 0x7f30680b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f305dd9b700 1 -- 172.21.15.62:0/1041291090 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3060009470 con 0x7f30680b0e90 2021-12-17T18:18:23.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f305dd9b700 1 --2- 172.21.15.62:0/1041291090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30680b0e90 0x7f30681522d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f305000c000 tx=0x7f3050006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f305ffff700 1 -- 172.21.15.62:0/1041291090 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3050011920 con 0x7f30680b0e90 2021-12-17T18:18:23.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f305ffff700 1 -- 172.21.15.62:0/1041291090 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3050011a80 con 0x7f30680b0e90 2021-12-17T18:18:23.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f306759e700 1 -- 172.21.15.62:0/1041291090 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306809f100 con 0x7f30680b0e90 2021-12-17T18:18:23.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f305ffff700 1 -- 172.21.15.62:0/1041291090 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3050011de0 con 0x7f30680b0e90 2021-12-17T18:18:23.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.250+0000 7f306759e700 1 -- 172.21.15.62:0/1041291090 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306809e9d0 con 0x7f30680b0e90 2021-12-17T18:18:23.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.254+0000 7f306759e700 1 -- 172.21.15.62:0/1041291090 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f306809ec80 con 0x7f30680b0e90 2021-12-17T18:18:23.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.254+0000 7f305ffff700 1 -- 172.21.15.62:0/1041291090 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3050021070 con 0x7f30680b0e90 2021-12-17T18:18:23.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.254+0000 7f305ffff700 1 --2- 172.21.15.62:0/1041291090 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f304c0536a0 0x7f304c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.254+0000 7f305ffff700 1 -- 172.21.15.62:0/1041291090 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f305006d590 con 0x7f30680b0e90 2021-12-17T18:18:23.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.254+0000 7f305ffff700 1 --2- 172.21.15.62:0/1041291090 >> [v2:172.21.15.62:6824/14763,v1:172.21.15.62:6825/14763] conn(0x7f304c05aa90 0x7f304c05ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.254+0000 7f305ffff700 1 -- 172.21.15.62:0/1041291090 --> [v2:172.21.15.62:6824/14763,v1:172.21.15.62:6825/14763] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f304c05d470 con 0x7f304c05aa90 2021-12-17T18:18:23.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.254+0000 7f305ffff700 1 -- 172.21.15.62:0/1041291090 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f305006fb10 con 0x7f30680b0e90 2021-12-17T18:18:23.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.254+0000 7f306659c700 1 --2- 172.21.15.62:0/1041291090 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f304c0536a0 0x7f304c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.254+0000 7f3066d9d700 1 --2- 172.21.15.62:0/1041291090 >> [v2:172.21.15.62:6824/14763,v1:172.21.15.62:6825/14763] conn(0x7f304c05aa90 0x7f304c05ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.254+0000 7f3066d9d700 1 --2- 172.21.15.62:0/1041291090 >> [v2:172.21.15.62:6824/14763,v1:172.21.15.62:6825/14763] conn(0x7f304c05aa90 0x7f304c05ceb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.254+0000 7f306659c700 1 --2- 172.21.15.62:0/1041291090 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f304c0536a0 0x7f304c055b60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f305800d000 tx=0x7f3058009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.254+0000 7f305ffff700 1 -- 172.21.15.62:0/1041291090 <== osd.1 v2:172.21.15.62:6824/14763 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f304c05d470 con 0x7f304c05aa90 2021-12-17T18:18:23.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.274+0000 7f306759e700 1 -- 172.21.15.62:0/1041291090 --> [v2:172.21.15.62:6824/14763,v1:172.21.15.62:6825/14763] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3068065c10 con 0x7f304c05aa90 2021-12-17T18:18:23.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.274+0000 7f305ffff700 1 -- 172.21.15.62:0/1041291090 <== osd.1 v2:172.21.15.62:6824/14763 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3068065c10 con 0x7f304c05aa90 2021-12-17T18:18:23.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.274+0000 7f306759e700 1 -- 172.21.15.62:0/1041291090 >> [v2:172.21.15.62:6824/14763,v1:172.21.15.62:6825/14763] conn(0x7f304c05aa90 msgr2=0x7f304c05ceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.274+0000 7f306759e700 1 --2- 172.21.15.62:0/1041291090 >> [v2:172.21.15.62:6824/14763,v1:172.21.15.62:6825/14763] conn(0x7f304c05aa90 0x7f304c05ceb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.274+0000 7f306759e700 1 -- 172.21.15.62:0/1041291090 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f304c0536a0 msgr2=0x7f304c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.274+0000 7f306759e700 1 --2- 172.21.15.62:0/1041291090 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f304c0536a0 0x7f304c055b60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f305800d000 tx=0x7f3058009040).stop 2021-12-17T18:18:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.274+0000 7f306759e700 1 -- 172.21.15.62:0/1041291090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30680b0e90 msgr2=0x7f30681522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.274+0000 7f306759e700 1 --2- 172.21.15.62:0/1041291090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30680b0e90 0x7f30681522d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f305000c000 tx=0x7f3050006df0).stop 2021-12-17T18:18:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.274+0000 7f3066d9d700 1 -- 172.21.15.62:0/1041291090 reap_dead start 2021-12-17T18:18:23.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.274+0000 7f306759e700 1 -- 172.21.15.62:0/1041291090 shutdown_connections 2021-12-17T18:18:23.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.274+0000 7f306759e700 1 -- 172.21.15.62:0/1041291090 >> 172.21.15.62:0/1041291090 conn(0x7f306805d1c0 msgr2=0x7f3068143000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.274+0000 7f306759e700 1 -- 172.21.15.62:0/1041291090 shutdown_connections 2021-12-17T18:18:23.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.274+0000 7f306759e700 1 -- 172.21.15.62:0/1041291090 wait complete. 2021-12-17T18:18:23.291 INFO:teuthology.orchestra.run.smithi062.stdout:60129542148 2021-12-17T18:18:23.292 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-12-17T18:18:23.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.406+0000 7f944d292700 1 Processor -- start 2021-12-17T18:18:23.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.406+0000 7f944d292700 1 -- start start 2021-12-17T18:18:23.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.406+0000 7f944d292700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f9448062620 0x7f944813c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.406+0000 7f944d292700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9448143610 0x7f944814d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.406+0000 7f944d292700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9448146e30 con 0x7f944813cc60 2021-12-17T18:18:23.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.406+0000 7f944d292700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9448062a00 con 0x7f9448143610 2021-12-17T18:18:23.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.406+0000 7f944d292700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94480b59e0 con 0x7f9448062620 2021-12-17T18:18:23.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f944ca91700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9448143610 0x7f944814d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f944ca91700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9448143610 0x7f944814d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47986/0 (socket says 172.21.15.62:47986) 2021-12-17T18:18:23.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f94477fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f944813cc60 0x7f9448142f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59800/0 (socket says 172.21.15.62:59800) 2021-12-17T18:18:23.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f944ca91700 1 -- 172.21.15.62:0/3310419405 learned_addr learned my addr 172.21.15.62:0/3310419405 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:23.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f9447fff700 1 --2- 172.21.15.62:0/3310419405 >> v2:172.21.15.109:3300/0 conn(0x7f9448062620 0x7f944813c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f944ca91700 1 -- 172.21.15.62:0/3310419405 >> v2:172.21.15.109:3300/0 conn(0x7f9448062620 msgr2=0x7f944813c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:23.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f944ca91700 1 --2- 172.21.15.62:0/3310419405 >> v2:172.21.15.109:3300/0 conn(0x7f9448062620 0x7f944813c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f944ca91700 1 -- 172.21.15.62:0/3310419405 >> v1:172.21.15.62:6789/0 conn(0x7f944813cc60 legacy=0x7f9448142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f944ca91700 1 -- 172.21.15.62:0/3310419405 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9448147060 con 0x7f9448143610 2021-12-17T18:18:23.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f9446ffd700 1 -- 172.21.15.62:0/3310419405 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932503332 0 0) 0x7f9448146e30 con 0x7f944813cc60 2021-12-17T18:18:23.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f944ca91700 1 --2- 172.21.15.62:0/3310419405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9448143610 0x7f944814d720 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f94400032f0 tx=0x7f9440009290).ready entity=mon.0 client_cookie=79bea1e63df58541 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f9446ffd700 1 -- 172.21.15.62:0/3310419405 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f944000b870 con 0x7f9448143610 2021-12-17T18:18:23.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f9446ffd700 1 -- 172.21.15.62:0/3310419405 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944000b9d0 con 0x7f9448143610 2021-12-17T18:18:23.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f9446ffd700 1 -- 172.21.15.62:0/3310419405 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f944000bb40 con 0x7f9448143610 2021-12-17T18:18:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f944d292700 1 -- 172.21.15.62:0/3310419405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9448143610 msgr2=0x7f944814d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f944d292700 1 --2- 172.21.15.62:0/3310419405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9448143610 0x7f944814d720 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f94400032f0 tx=0x7f9440009290).stop 2021-12-17T18:18:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f944d292700 1 -- 172.21.15.62:0/3310419405 shutdown_connections 2021-12-17T18:18:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f944d292700 1 --2- 172.21.15.62:0/3310419405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9448143610 0x7f944814d720 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f944d292700 1 --2- 172.21.15.62:0/3310419405 >> v2:172.21.15.109:3300/0 conn(0x7f9448062620 0x7f944813c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f944d292700 1 -- 172.21.15.62:0/3310419405 >> 172.21.15.62:0/3310419405 conn(0x7f944805c750 msgr2=0x7f944805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f944d292700 1 -- 172.21.15.62:0/3310419405 shutdown_connections 2021-12-17T18:18:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.410+0000 7f944d292700 1 -- 172.21.15.62:0/3310419405 wait complete. 2021-12-17T18:18:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.414+0000 7f944d292700 1 Processor -- start 2021-12-17T18:18:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.414+0000 7f944d292700 1 -- start start 2021-12-17T18:18:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.414+0000 7f944d292700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9448062620 0x7f944813dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.414+0000 7f944d292700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f944813cc60 0x7f9448149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.414+0000 7f944d292700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9448143610 0x7f94481556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.414+0000 7f944d292700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9448155300 con 0x7f944813cc60 2021-12-17T18:18:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.414+0000 7f944d292700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94480b9cd0 con 0x7f9448062620 2021-12-17T18:18:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.414+0000 7f944d292700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94480b9f30 con 0x7f9448143610 2021-12-17T18:18:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.414+0000 7f94477fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f944813cc60 0x7f9448149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.414+0000 7f94477fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f944813cc60 0x7f9448149890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47992/0 (socket says 172.21.15.62:47992) 2021-12-17T18:18:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.414+0000 7f94477fe700 1 -- 172.21.15.62:0/3970480858 learned_addr learned my addr 172.21.15.62:0/3970480858 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.414+0000 7f9447fff700 1 --2- 172.21.15.62:0/3970480858 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9448062620 0x7f944813dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.414+0000 7f944ca91700 1 --2- 172.21.15.62:0/3970480858 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9448143610 0x7f94481556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f94477fe700 1 -- 172.21.15.62:0/3970480858 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9448143610 msgr2=0x7f94481556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f94477fe700 1 --2- 172.21.15.62:0/3970480858 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9448143610 0x7f94481556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f94477fe700 1 -- 172.21.15.62:0/3970480858 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9448062620 msgr2=0x7f944813dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f94477fe700 1 --2- 172.21.15.62:0/3970480858 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9448062620 0x7f944813dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f94477fe700 1 -- 172.21.15.62:0/3970480858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9440009530 con 0x7f944813cc60 2021-12-17T18:18:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f94477fe700 1 --2- 172.21.15.62:0/3970480858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f944813cc60 0x7f9448149890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f943c000ed0 tx=0x7f943c007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f94457fa700 1 -- 172.21.15.62:0/3970480858 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f943c00ce40 con 0x7f944813cc60 2021-12-17T18:18:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f94457fa700 1 -- 172.21.15.62:0/3970480858 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c0072e0 con 0x7f944813cc60 2021-12-17T18:18:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f944d292700 1 -- 172.21.15.62:0/3970480858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94480b9150 con 0x7f944813cc60 2021-12-17T18:18:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f94457fa700 1 -- 172.21.15.62:0/3970480858 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f943c005740 con 0x7f944813cc60 2021-12-17T18:18:23.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f944d292700 1 -- 172.21.15.62:0/3970480858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94480b9580 con 0x7f944813cc60 2021-12-17T18:18:23.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f944d292700 1 -- 172.21.15.62:0/3970480858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f94480b42c0 con 0x7f944813cc60 2021-12-17T18:18:23.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f94457fa700 1 -- 172.21.15.62:0/3970480858 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f943c01a060 con 0x7f944813cc60 2021-12-17T18:18:23.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f94457fa700 1 --2- 172.21.15.62:0/3970480858 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f94280534f0 0x7f94280559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f94457fa700 1 -- 172.21.15.62:0/3970480858 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f943c06b130 con 0x7f944813cc60 2021-12-17T18:18:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f94457fa700 1 --2- 172.21.15.62:0/3970480858 >> [v2:172.21.15.62:6808/14760,v1:172.21.15.62:6809/14760] conn(0x7f942805a980 0x7f942805cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f94457fa700 1 -- 172.21.15.62:0/3970480858 --> [v2:172.21.15.62:6808/14760,v1:172.21.15.62:6809/14760] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f942805d400 con 0x7f942805a980 2021-12-17T18:18:23.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f9447fff700 1 --2- 172.21.15.62:0/3970480858 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f94280534f0 0x7f94280559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f94457fa700 1 -- 172.21.15.62:0/3970480858 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f943c06d7c0 con 0x7f944813cc60 2021-12-17T18:18:23.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.418+0000 7f944ca91700 1 --2- 172.21.15.62:0/3970480858 >> [v2:172.21.15.62:6808/14760,v1:172.21.15.62:6809/14760] conn(0x7f942805a980 0x7f942805cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.422+0000 7f944ca91700 1 --2- 172.21.15.62:0/3970480858 >> [v2:172.21.15.62:6808/14760,v1:172.21.15.62:6809/14760] conn(0x7f942805a980 0x7f942805cda0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.422+0000 7f9447fff700 1 --2- 172.21.15.62:0/3970480858 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f94280534f0 0x7f94280559b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f943800b000 tx=0x7f9438006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.422+0000 7f94457fa700 1 -- 172.21.15.62:0/3970480858 <== osd.2 v2:172.21.15.62:6808/14760 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f942805d400 con 0x7f942805a980 2021-12-17T18:18:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.438+0000 7f944d292700 1 -- 172.21.15.62:0/3970480858 --> [v2:172.21.15.62:6808/14760,v1:172.21.15.62:6809/14760] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f94480573d0 con 0x7f942805a980 2021-12-17T18:18:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.438+0000 7f94457fa700 1 -- 172.21.15.62:0/3970480858 <== osd.2 v2:172.21.15.62:6808/14760 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f94480573d0 con 0x7f942805a980 2021-12-17T18:18:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.438+0000 7f944d292700 1 -- 172.21.15.62:0/3970480858 >> [v2:172.21.15.62:6808/14760,v1:172.21.15.62:6809/14760] conn(0x7f942805a980 msgr2=0x7f942805cda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.438+0000 7f944d292700 1 --2- 172.21.15.62:0/3970480858 >> [v2:172.21.15.62:6808/14760,v1:172.21.15.62:6809/14760] conn(0x7f942805a980 0x7f942805cda0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.442+0000 7f944d292700 1 -- 172.21.15.62:0/3970480858 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f94280534f0 msgr2=0x7f94280559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.442+0000 7f944d292700 1 --2- 172.21.15.62:0/3970480858 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f94280534f0 0x7f94280559b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f943800b000 tx=0x7f9438006df0).stop 2021-12-17T18:18:23.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.442+0000 7f944d292700 1 -- 172.21.15.62:0/3970480858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f944813cc60 msgr2=0x7f9448149890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.442+0000 7f944d292700 1 --2- 172.21.15.62:0/3970480858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f944813cc60 0x7f9448149890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f943c000ed0 tx=0x7f943c007ac0).stop 2021-12-17T18:18:23.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.442+0000 7f944ca91700 1 -- 172.21.15.62:0/3970480858 reap_dead start 2021-12-17T18:18:23.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.442+0000 7f944d292700 1 -- 172.21.15.62:0/3970480858 shutdown_connections 2021-12-17T18:18:23.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.442+0000 7f944d292700 1 -- 172.21.15.62:0/3970480858 >> 172.21.15.62:0/3970480858 conn(0x7f944805c750 msgr2=0x7f94480b5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:23.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.442+0000 7f944d292700 1 -- 172.21.15.62:0/3970480858 shutdown_connections 2021-12-17T18:18:23.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.442+0000 7f944d292700 1 -- 172.21.15.62:0/3970480858 wait complete. 2021-12-17T18:18:23.457 INFO:teuthology.orchestra.run.smithi062.stdout:60129542149 2021-12-17T18:18:23.457 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2021-12-17T18:18:23.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0436fb7700 1 Processor -- start 2021-12-17T18:18:23.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0436fb7700 1 -- start start 2021-12-17T18:18:23.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0436fb7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f04300adaa0 0x7f04300b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0436fb7700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f04300b1760 0x7f0430143a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0436fb7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f04300b1bc0 0x7f043013f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0436fb7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04300ae550 con 0x7f04300adaa0 2021-12-17T18:18:23.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0436fb7700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04300b0100 con 0x7f04300b1760 2021-12-17T18:18:23.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0436fb7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04300ade80 con 0x7f04300b1bc0 2021-12-17T18:18:23.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0435fb5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f04300adaa0 0x7f04300b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0435fb5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f04300adaa0 0x7f04300b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48000/0 (socket says 172.21.15.62:48000) 2021-12-17T18:18:23.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0435fb5700 1 -- 172.21.15.62:0/599531935 learned_addr learned my addr 172.21.15.62:0/599531935 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f04357b4700 1 --2- 172.21.15.62:0/599531935 >> v2:172.21.15.109:3300/0 conn(0x7f04300b1760 0x7f0430143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f04367b6700 1 --2- 172.21.15.62:0/599531935 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f04300b1bc0 0x7f043013f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0435fb5700 1 -- 172.21.15.62:0/599531935 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f04300b1bc0 msgr2=0x7f043013f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0435fb5700 1 --2- 172.21.15.62:0/599531935 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f04300b1bc0 0x7f043013f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0435fb5700 1 -- 172.21.15.62:0/599531935 >> v2:172.21.15.109:3300/0 conn(0x7f04300b1760 msgr2=0x7f0430143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0435fb5700 1 --2- 172.21.15.62:0/599531935 >> v2:172.21.15.109:3300/0 conn(0x7f04300b1760 0x7f0430143a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0435fb5700 1 -- 172.21.15.62:0/599531935 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04301432c0 con 0x7f04300adaa0 2021-12-17T18:18:23.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f04357b4700 1 --2- 172.21.15.62:0/599531935 >> v2:172.21.15.109:3300/0 conn(0x7f04300b1760 0x7f0430143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:23.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f04367b6700 1 --2- 172.21.15.62:0/599531935 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f04300b1bc0 0x7f043013f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:18:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0435fb5700 1 --2- 172.21.15.62:0/599531935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04300adaa0 0x7f04300b02b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f042c002f70 tx=0x7f042c006eb0).ready entity=mon.0 client_cookie=d05f74401417c0ba server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0434fb3700 1 -- 172.21.15.62:0/599531935 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f042c00d570 con 0x7f04300adaa0 2021-12-17T18:18:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0434fb3700 1 -- 172.21.15.62:0/599531935 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c000e90 con 0x7f04300adaa0 2021-12-17T18:18:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0434fb3700 1 -- 172.21.15.62:0/599531935 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f042c00d900 con 0x7f04300adaa0 2021-12-17T18:18:23.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0436fb7700 1 -- 172.21.15.62:0/599531935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04300adaa0 msgr2=0x7f04300b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0436fb7700 1 --2- 172.21.15.62:0/599531935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04300adaa0 0x7f04300b02b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f042c002f70 tx=0x7f042c006eb0).stop 2021-12-17T18:18:23.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0436fb7700 1 -- 172.21.15.62:0/599531935 shutdown_connections 2021-12-17T18:18:23.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0436fb7700 1 --2- 172.21.15.62:0/599531935 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f04300b1bc0 0x7f043013f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0436fb7700 1 --2- 172.21.15.62:0/599531935 >> v2:172.21.15.109:3300/0 conn(0x7f04300b1760 0x7f0430143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0436fb7700 1 --2- 172.21.15.62:0/599531935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04300adaa0 0x7f04300b02b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0436fb7700 1 -- 172.21.15.62:0/599531935 >> 172.21.15.62:0/599531935 conn(0x7f04300b6320 msgr2=0x7f04300b6700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:23.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0436fb7700 1 -- 172.21.15.62:0/599531935 shutdown_connections 2021-12-17T18:18:23.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.570+0000 7f0436fb7700 1 -- 172.21.15.62:0/599531935 wait complete. 2021-12-17T18:18:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f0436fb7700 1 Processor -- start 2021-12-17T18:18:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f0436fb7700 1 -- start start 2021-12-17T18:18:23.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f0436fb7700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f04300adaa0 0x7f0430062320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f0436fb7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04300b1760 0x7f043013f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f0436fb7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f04300b1bc0 0x7f0430063740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f0436fb7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0430156a00 con 0x7f04300b1760 2021-12-17T18:18:23.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f0436fb7700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04300a4890 con 0x7f04300adaa0 2021-12-17T18:18:23.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f0436fb7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0430065440 con 0x7f04300b1bc0 2021-12-17T18:18:23.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f04357b4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04300b1760 0x7f043013f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f04357b4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04300b1760 0x7f043013f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48006/0 (socket says 172.21.15.62:48006) 2021-12-17T18:18:23.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f04357b4700 1 -- 172.21.15.62:0/3532762552 learned_addr learned my addr 172.21.15.62:0/3532762552 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:23.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f04367b6700 1 --2- 172.21.15.62:0/3532762552 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f04300b1bc0 0x7f0430063740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f0435fb5700 1 --2- 172.21.15.62:0/3532762552 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f04300adaa0 0x7f0430062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f04357b4700 1 -- 172.21.15.62:0/3532762552 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f04300b1bc0 msgr2=0x7f0430063740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f04357b4700 1 --2- 172.21.15.62:0/3532762552 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f04300b1bc0 0x7f0430063740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f04357b4700 1 -- 172.21.15.62:0/3532762552 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f04300adaa0 msgr2=0x7f0430062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f04357b4700 1 --2- 172.21.15.62:0/3532762552 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f04300adaa0 0x7f0430062320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f04357b4700 1 -- 172.21.15.62:0/3532762552 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c00b1e0 con 0x7f04300b1760 2021-12-17T18:18:23.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f04357b4700 1 --2- 172.21.15.62:0/3532762552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04300b1760 0x7f043013f180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f04300b5380 tx=0x7f0420008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f0426ffd700 1 -- 172.21.15.62:0/3532762552 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0420011780 con 0x7f04300b1760 2021-12-17T18:18:23.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f0426ffd700 1 -- 172.21.15.62:0/3532762552 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04200118e0 con 0x7f04300b1760 2021-12-17T18:18:23.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f0436fb7700 1 -- 172.21.15.62:0/3532762552 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04300a45f0 con 0x7f04300b1760 2021-12-17T18:18:23.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f0426ffd700 1 -- 172.21.15.62:0/3532762552 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0420011c40 con 0x7f04300b1760 2021-12-17T18:18:23.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.574+0000 7f0436fb7700 1 -- 172.21.15.62:0/3532762552 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04300b4f20 con 0x7f04300b1760 2021-12-17T18:18:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.578+0000 7f0436fb7700 1 -- 172.21.15.62:0/3532762552 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f04300634a0 con 0x7f04300b1760 2021-12-17T18:18:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.578+0000 7f0426ffd700 1 -- 172.21.15.62:0/3532762552 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f042001c460 con 0x7f04300b1760 2021-12-17T18:18:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.578+0000 7f0426ffd700 1 --2- 172.21.15.62:0/3532762552 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f04180535b0 0x7f0418055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.578+0000 7f0426ffd700 1 -- 172.21.15.62:0/3532762552 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f042006bb80 con 0x7f04300b1760 2021-12-17T18:18:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.578+0000 7f0426ffd700 1 --2- 172.21.15.62:0/3532762552 >> [v2:172.21.15.62:6816/14762,v1:172.21.15.62:6817/14762] conn(0x7f041805a9a0 0x7f041805cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.578+0000 7f0426ffd700 1 -- 172.21.15.62:0/3532762552 --> [v2:172.21.15.62:6816/14762,v1:172.21.15.62:6817/14762] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f041805d420 con 0x7f041805a9a0 2021-12-17T18:18:23.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.578+0000 7f0426ffd700 1 -- 172.21.15.62:0/3532762552 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0420070240 con 0x7f04300b1760 2021-12-17T18:18:23.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.578+0000 7f0435fb5700 1 --2- 172.21.15.62:0/3532762552 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f04180535b0 0x7f0418055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.578+0000 7f04367b6700 1 --2- 172.21.15.62:0/3532762552 >> [v2:172.21.15.62:6816/14762,v1:172.21.15.62:6817/14762] conn(0x7f041805a9a0 0x7f041805cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.578+0000 7f04367b6700 1 --2- 172.21.15.62:0/3532762552 >> [v2:172.21.15.62:6816/14762,v1:172.21.15.62:6817/14762] conn(0x7f041805a9a0 0x7f041805cdc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.578+0000 7f0435fb5700 1 --2- 172.21.15.62:0/3532762552 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f04180535b0 0x7f0418055a70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f042c01c000 tx=0x7f042c015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.582+0000 7f0426ffd700 1 -- 172.21.15.62:0/3532762552 <== osd.3 v2:172.21.15.62:6816/14762 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f041805d420 con 0x7f041805a9a0 2021-12-17T18:18:23.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.598+0000 7f0436fb7700 1 -- 172.21.15.62:0/3532762552 --> [v2:172.21.15.62:6816/14762,v1:172.21.15.62:6817/14762] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0430065190 con 0x7f041805a9a0 2021-12-17T18:18:23.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.602+0000 7f0426ffd700 1 -- 172.21.15.62:0/3532762552 <== osd.3 v2:172.21.15.62:6816/14762 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0430065190 con 0x7f041805a9a0 2021-12-17T18:18:23.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.602+0000 7f0436fb7700 1 -- 172.21.15.62:0/3532762552 >> [v2:172.21.15.62:6816/14762,v1:172.21.15.62:6817/14762] conn(0x7f041805a9a0 msgr2=0x7f041805cdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.602+0000 7f0436fb7700 1 --2- 172.21.15.62:0/3532762552 >> [v2:172.21.15.62:6816/14762,v1:172.21.15.62:6817/14762] conn(0x7f041805a9a0 0x7f041805cdc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.602+0000 7f0436fb7700 1 -- 172.21.15.62:0/3532762552 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f04180535b0 msgr2=0x7f0418055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.602+0000 7f0436fb7700 1 --2- 172.21.15.62:0/3532762552 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f04180535b0 0x7f0418055a70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f042c01c000 tx=0x7f042c015000).stop 2021-12-17T18:18:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.602+0000 7f0436fb7700 1 -- 172.21.15.62:0/3532762552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04300b1760 msgr2=0x7f043013f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.602+0000 7f0436fb7700 1 --2- 172.21.15.62:0/3532762552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04300b1760 0x7f043013f180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f04300b5380 tx=0x7f0420008040).stop 2021-12-17T18:18:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.602+0000 7f04367b6700 1 -- 172.21.15.62:0/3532762552 reap_dead start 2021-12-17T18:18:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.602+0000 7f0436fb7700 1 -- 172.21.15.62:0/3532762552 shutdown_connections 2021-12-17T18:18:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.602+0000 7f0436fb7700 1 -- 172.21.15.62:0/3532762552 >> 172.21.15.62:0/3532762552 conn(0x7f04300b6320 msgr2=0x7f0430066620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.602+0000 7f0436fb7700 1 -- 172.21.15.62:0/3532762552 shutdown_connections 2021-12-17T18:18:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.602+0000 7f0436fb7700 1 -- 172.21.15.62:0/3532762552 wait complete. 2021-12-17T18:18:23.619 INFO:teuthology.orchestra.run.smithi062.stdout:60129542148 2021-12-17T18:18:23.619 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2021-12-17T18:18:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.730+0000 7f545b59e700 1 Processor -- start 2021-12-17T18:18:23.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.730+0000 7f545b59e700 1 -- start start 2021-12-17T18:18:23.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f545c13cf50 0x7f545c060100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545c1439a0 con 0x7f545c0abd50 2021-12-17T18:18:23.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545b59e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545c05fe50 con 0x7f545c05fa70 2021-12-17T18:18:23.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f545c0605f0 con 0x7f545c13cf50 2021-12-17T18:18:23.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545ad9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f545c13cf50 0x7f545c060100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545ad9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f545c13cf50 0x7f545c060100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48020/0 (socket says 172.21.15.62:48020) 2021-12-17T18:18:23.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545ad9d700 1 -- 172.21.15.62:0/2571230830 learned_addr learned my addr 172.21.15.62:0/2571230830 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:23.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f5453fff700 1 --1- 172.21.15.62:0/2571230830 >> v1:172.21.15.62:6789/0 conn(0x7f545c0abd50 0x7f545c0b19f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59830/0 (socket says 172.21.15.62:59830) 2021-12-17T18:18:23.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545ad9d700 1 -- 172.21.15.62:0/2571230830 >> v1:172.21.15.109:6789/0 conn(0x7f545c05fa70 legacy=0x7f545c13c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545ad9d700 1 -- 172.21.15.62:0/2571230830 >> v1:172.21.15.62:6789/0 conn(0x7f545c0abd50 legacy=0x7f545c0b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f5459d9b700 1 -- 172.21.15.62:0/2571230830 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692121591 0 0) 0x7f545c1439a0 con 0x7f545c0abd50 2021-12-17T18:18:23.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545ad9d700 1 -- 172.21.15.62:0/2571230830 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c143c00 con 0x7f545c13cf50 2021-12-17T18:18:23.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545ad9d700 1 --2- 172.21.15.62:0/2571230830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545c13cf50 0x7f545c060100 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f54540032f0 tx=0x7f5454009290).ready entity=mon.0 client_cookie=f039fd581d6b0bfc server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f5459d9b700 1 -- 172.21.15.62:0/2571230830 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f545400b8a0 con 0x7f545c13cf50 2021-12-17T18:18:23.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f5459d9b700 1 -- 172.21.15.62:0/2571230830 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545400ba00 con 0x7f545c13cf50 2021-12-17T18:18:23.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f5459d9b700 1 -- 172.21.15.62:0/2571230830 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f545400bb70 con 0x7f545c13cf50 2021-12-17T18:18:23.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545b59e700 1 -- 172.21.15.62:0/2571230830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545c13cf50 msgr2=0x7f545c060100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545b59e700 1 --2- 172.21.15.62:0/2571230830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545c13cf50 0x7f545c060100 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f54540032f0 tx=0x7f5454009290).stop 2021-12-17T18:18:23.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545b59e700 1 -- 172.21.15.62:0/2571230830 shutdown_connections 2021-12-17T18:18:23.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545b59e700 1 --2- 172.21.15.62:0/2571230830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545c13cf50 0x7f545c060100 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545b59e700 1 -- 172.21.15.62:0/2571230830 >> 172.21.15.62:0/2571230830 conn(0x7f545c0623c0 msgr2=0x7f545c0627d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:23.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545b59e700 1 -- 172.21.15.62:0/2571230830 shutdown_connections 2021-12-17T18:18:23.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.734+0000 7f545b59e700 1 -- 172.21.15.62:0/2571230830 wait complete. 2021-12-17T18:18:23.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.738+0000 7f545b59e700 1 Processor -- start 2021-12-17T18:18:23.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.738+0000 7f545b59e700 1 -- start start 2021-12-17T18:18:23.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.738+0000 7f545b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f545c05fa70 0x7f545c146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.738+0000 7f545b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545c0abd50 0x7f545c1429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.738+0000 7f545b59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f545c13cf50 0x7f545c142e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.738+0000 7f545b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c156550 con 0x7f545c0abd50 2021-12-17T18:18:23.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.738+0000 7f545b59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c1407a0 con 0x7f545c13cf50 2021-12-17T18:18:23.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.738+0000 7f545b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545c140500 con 0x7f545c05fa70 2021-12-17T18:18:23.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.738+0000 7f5453fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545c0abd50 0x7f545c1429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f5453fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545c0abd50 0x7f545c1429a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48024/0 (socket says 172.21.15.62:48024) 2021-12-17T18:18:23.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f5453fff700 1 -- 172.21.15.62:0/3019089009 learned_addr learned my addr 172.21.15.62:0/3019089009 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:23.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f545ad9d700 1 --2- 172.21.15.62:0/3019089009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f545c13cf50 0x7f545c142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f545a59c700 1 --2- 172.21.15.62:0/3019089009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f545c05fa70 0x7f545c146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f5453fff700 1 -- 172.21.15.62:0/3019089009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f545c05fa70 msgr2=0x7f545c146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f5453fff700 1 --2- 172.21.15.62:0/3019089009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f545c05fa70 0x7f545c146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f5453fff700 1 -- 172.21.15.62:0/3019089009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f545c13cf50 msgr2=0x7f545c142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f5453fff700 1 --2- 172.21.15.62:0/3019089009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f545c13cf50 0x7f545c142e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f5453fff700 1 -- 172.21.15.62:0/3019089009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5454009530 con 0x7f545c0abd50 2021-12-17T18:18:23.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f5453fff700 1 --2- 172.21.15.62:0/3019089009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545c0abd50 0x7f545c1429a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f544c000ed0 tx=0x7f544c007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f54537fe700 1 -- 172.21.15.62:0/3019089009 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f544c0070d0 con 0x7f545c0abd50 2021-12-17T18:18:23.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f54537fe700 1 -- 172.21.15.62:0/3019089009 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544c007230 con 0x7f545c0abd50 2021-12-17T18:18:23.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f545b59e700 1 -- 172.21.15.62:0/3019089009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545c0b0df0 con 0x7f545c0abd50 2021-12-17T18:18:23.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f54537fe700 1 -- 172.21.15.62:0/3019089009 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f544c005740 con 0x7f545c0abd50 2021-12-17T18:18:23.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f545b59e700 1 -- 172.21.15.62:0/3019089009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545c0ad8b0 con 0x7f545c0abd50 2021-12-17T18:18:23.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f545b59e700 1 -- 172.21.15.62:0/3019089009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f545c140380 con 0x7f545c0abd50 2021-12-17T18:18:23.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f54537fe700 1 -- 172.21.15.62:0/3019089009 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f544c010070 con 0x7f545c0abd50 2021-12-17T18:18:23.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f54537fe700 1 --2- 172.21.15.62:0/3019089009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5440053640 0x7f5440055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f54537fe700 1 -- 172.21.15.62:0/3019089009 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f544c06afe0 con 0x7f545c0abd50 2021-12-17T18:18:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f54537fe700 1 --2- 172.21.15.62:0/3019089009 >> [v2:172.21.15.109:6810/15017,v1:172.21.15.109:6811/15017] conn(0x7f544005aa30 0x7f544005ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f54537fe700 1 -- 172.21.15.62:0/3019089009 --> [v2:172.21.15.109:6810/15017,v1:172.21.15.109:6811/15017] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f544005d410 con 0x7f544005aa30 2021-12-17T18:18:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.742+0000 7f54537fe700 1 -- 172.21.15.62:0/3019089009 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f544c06d670 con 0x7f545c0abd50 2021-12-17T18:18:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.746+0000 7f545a59c700 1 --2- 172.21.15.62:0/3019089009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5440053640 0x7f5440055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.746+0000 7f545ad9d700 1 --2- 172.21.15.62:0/3019089009 >> [v2:172.21.15.109:6810/15017,v1:172.21.15.109:6811/15017] conn(0x7f544005aa30 0x7f544005ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.746+0000 7f545ad9d700 1 --2- 172.21.15.62:0/3019089009 >> [v2:172.21.15.109:6810/15017,v1:172.21.15.109:6811/15017] conn(0x7f544005aa30 0x7f544005ce50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.746+0000 7f545a59c700 1 --2- 172.21.15.62:0/3019089009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5440053640 0x7f5440055b00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f544400d000 tx=0x7f5444007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.746+0000 7f54537fe700 1 -- 172.21.15.62:0/3019089009 <== osd.4 v2:172.21.15.109:6810/15017 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f544005d410 con 0x7f544005aa30 2021-12-17T18:18:23.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.762+0000 7f545b59e700 1 -- 172.21.15.62:0/3019089009 --> [v2:172.21.15.109:6810/15017,v1:172.21.15.109:6811/15017] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f545c0573d0 con 0x7f544005aa30 2021-12-17T18:18:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.766+0000 7f54537fe700 1 -- 172.21.15.62:0/3019089009 <== osd.4 v2:172.21.15.109:6810/15017 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f545c0573d0 con 0x7f544005aa30 2021-12-17T18:18:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.766+0000 7f545b59e700 1 -- 172.21.15.62:0/3019089009 >> [v2:172.21.15.109:6810/15017,v1:172.21.15.109:6811/15017] conn(0x7f544005aa30 msgr2=0x7f544005ce50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.766+0000 7f545b59e700 1 --2- 172.21.15.62:0/3019089009 >> [v2:172.21.15.109:6810/15017,v1:172.21.15.109:6811/15017] conn(0x7f544005aa30 0x7f544005ce50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.766+0000 7f545b59e700 1 -- 172.21.15.62:0/3019089009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5440053640 msgr2=0x7f5440055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.766+0000 7f545b59e700 1 --2- 172.21.15.62:0/3019089009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5440053640 0x7f5440055b00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f544400d000 tx=0x7f5444007b90).stop 2021-12-17T18:18:23.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.766+0000 7f545b59e700 1 -- 172.21.15.62:0/3019089009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545c0abd50 msgr2=0x7f545c1429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.766+0000 7f545b59e700 1 --2- 172.21.15.62:0/3019089009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545c0abd50 0x7f545c1429a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f544c000ed0 tx=0x7f544c007ac0).stop 2021-12-17T18:18:23.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.766+0000 7f545ad9d700 1 -- 172.21.15.62:0/3019089009 reap_dead start 2021-12-17T18:18:23.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.766+0000 7f545b59e700 1 -- 172.21.15.62:0/3019089009 shutdown_connections 2021-12-17T18:18:23.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.766+0000 7f545b59e700 1 -- 172.21.15.62:0/3019089009 >> 172.21.15.62:0/3019089009 conn(0x7f545c0623c0 msgr2=0x7f545c0b46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.766+0000 7f545b59e700 1 -- 172.21.15.62:0/3019089009 shutdown_connections 2021-12-17T18:18:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.766+0000 7f545b59e700 1 -- 172.21.15.62:0/3019089009 wait complete. 2021-12-17T18:18:23.782 INFO:teuthology.orchestra.run.smithi062.stdout:60129542148 2021-12-17T18:18:23.782 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2021-12-17T18:18:23.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.882+0000 7f70ef5df700 1 Processor -- start 2021-12-17T18:18:23.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.882+0000 7f70ef5df700 1 -- start start 2021-12-17T18:18:23.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.882+0000 7f70ef5df700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f70e80aca60 0x7f70e8147050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.882+0000 7f70ef5df700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f70e8147540 0x7f70e80b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.882+0000 7f70ef5df700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e8067c10 con 0x7f70e8067830 2021-12-17T18:18:23.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.882+0000 7f70ef5df700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e8060520 con 0x7f70e8147540 2021-12-17T18:18:23.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.882+0000 7f70ef5df700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e80acf00 con 0x7f70e80aca60 2021-12-17T18:18:23.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.882+0000 7f70edb7c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f70e8147540 0x7f70e80b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.882+0000 7f70edb7c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f70e8147540 0x7f70e80b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48036/0 (socket says 172.21.15.62:48036) 2021-12-17T18:18:23.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.882+0000 7f70ed37b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f70e8067830 0x7f70e8146940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59844/0 (socket says 172.21.15.62:59844) 2021-12-17T18:18:23.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.882+0000 7f70edb7c700 1 -- 172.21.15.62:0/3224715956 learned_addr learned my addr 172.21.15.62:0/3224715956 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:23.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.882+0000 7f70ecb7a700 1 --2- 172.21.15.62:0/3224715956 >> v2:172.21.15.109:3300/0 conn(0x7f70e80aca60 0x7f70e8147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70edb7c700 1 -- 172.21.15.62:0/3224715956 >> v2:172.21.15.109:3300/0 conn(0x7f70e80aca60 msgr2=0x7f70e8147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:23.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70edb7c700 1 --2- 172.21.15.62:0/3224715956 >> v2:172.21.15.109:3300/0 conn(0x7f70e80aca60 0x7f70e8147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70edb7c700 1 -- 172.21.15.62:0/3224715956 >> v1:172.21.15.62:6789/0 conn(0x7f70e8067830 legacy=0x7f70e8146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70edb7c700 1 -- 172.21.15.62:0/3224715956 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e80b12a0 con 0x7f70e8147540 2021-12-17T18:18:23.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70d7fff700 1 -- 172.21.15.62:0/3224715956 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775479971 0 0) 0x7f70e8067c10 con 0x7f70e8067830 2021-12-17T18:18:23.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70ecb7a700 1 --2- 172.21.15.62:0/3224715956 >> v2:172.21.15.109:3300/0 conn(0x7f70e80aca60 0x7f70e8147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:23.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70edb7c700 1 --2- 172.21.15.62:0/3224715956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70e8147540 0x7f70e80b1d30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f70e80b1af0 tx=0x7f70e0009290).ready entity=mon.0 client_cookie=9ec437dfcd523526 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70d7fff700 1 -- 172.21.15.62:0/3224715956 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70e000b860 con 0x7f70e8147540 2021-12-17T18:18:23.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70d7fff700 1 -- 172.21.15.62:0/3224715956 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e000b9c0 con 0x7f70e8147540 2021-12-17T18:18:23.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70d7fff700 1 -- 172.21.15.62:0/3224715956 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70e000bb30 con 0x7f70e8147540 2021-12-17T18:18:23.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70ef5df700 1 -- 172.21.15.62:0/3224715956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70e8147540 msgr2=0x7f70e80b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70ef5df700 1 --2- 172.21.15.62:0/3224715956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70e8147540 0x7f70e80b1d30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f70e80b1af0 tx=0x7f70e0009290).stop 2021-12-17T18:18:23.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70ef5df700 1 -- 172.21.15.62:0/3224715956 shutdown_connections 2021-12-17T18:18:23.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70ef5df700 1 --2- 172.21.15.62:0/3224715956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70e8147540 0x7f70e80b1d30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70ef5df700 1 --2- 172.21.15.62:0/3224715956 >> v2:172.21.15.109:3300/0 conn(0x7f70e80aca60 0x7f70e8147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70ef5df700 1 -- 172.21.15.62:0/3224715956 >> 172.21.15.62:0/3224715956 conn(0x7f70e805f730 msgr2=0x7f70e805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:23.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70ef5df700 1 -- 172.21.15.62:0/3224715956 shutdown_connections 2021-12-17T18:18:23.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70ef5df700 1 -- 172.21.15.62:0/3224715956 wait complete. 2021-12-17T18:18:23.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70ef5df700 1 Processor -- start 2021-12-17T18:18:23.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.886+0000 7f70ef5df700 1 -- start start 2021-12-17T18:18:23.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ef5df700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f70e8067830 0x7f70e80a9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ef5df700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70e80aca60 0x7f70e809ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ef5df700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70e8147540 0x7f70e809f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ef5df700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e80ac2f0 con 0x7f70e80aca60 2021-12-17T18:18:23.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ef5df700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e80a22b0 con 0x7f70e8067830 2021-12-17T18:18:23.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ef5df700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e80a2550 con 0x7f70e8147540 2021-12-17T18:18:23.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ecb7a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70e80aca60 0x7f70e809ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ecb7a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70e80aca60 0x7f70e809ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48040/0 (socket says 172.21.15.62:48040) 2021-12-17T18:18:23.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70edb7c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70e8147540 0x7f70e809f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ecb7a700 1 -- 172.21.15.62:0/2930867151 learned_addr learned my addr 172.21.15.62:0/2930867151 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:23.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ed37b700 1 --2- 172.21.15.62:0/2930867151 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f70e8067830 0x7f70e80a9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ecb7a700 1 -- 172.21.15.62:0/2930867151 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70e8147540 msgr2=0x7f70e809f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ecb7a700 1 --2- 172.21.15.62:0/2930867151 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70e8147540 0x7f70e809f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ecb7a700 1 -- 172.21.15.62:0/2930867151 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f70e8067830 msgr2=0x7f70e80a9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ecb7a700 1 --2- 172.21.15.62:0/2930867151 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f70e8067830 0x7f70e80a9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ecb7a700 1 -- 172.21.15.62:0/2930867151 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e0009530 con 0x7f70e80aca60 2021-12-17T18:18:23.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70edb7c700 1 --2- 172.21.15.62:0/2930867151 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70e8147540 0x7f70e809f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:23.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ecb7a700 1 --2- 172.21.15.62:0/2930867151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70e80aca60 0x7f70e809ed10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f70d8006940 tx=0x7f70d8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70d67fc700 1 -- 172.21.15.62:0/2930867151 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70d8011780 con 0x7f70e80aca60 2021-12-17T18:18:23.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70d67fc700 1 -- 172.21.15.62:0/2930867151 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d80118e0 con 0x7f70e80aca60 2021-12-17T18:18:23.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ef5df700 1 -- 172.21.15.62:0/2930867151 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e80ab140 con 0x7f70e80aca60 2021-12-17T18:18:23.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70d67fc700 1 -- 172.21.15.62:0/2930867151 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70d8011c40 con 0x7f70e80aca60 2021-12-17T18:18:23.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ef5df700 1 -- 172.21.15.62:0/2930867151 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e80a99f0 con 0x7f70e80aca60 2021-12-17T18:18:23.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.890+0000 7f70ef5df700 1 -- 172.21.15.62:0/2930867151 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70e809f740 con 0x7f70e80aca60 2021-12-17T18:18:23.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.894+0000 7f70d67fc700 1 -- 172.21.15.62:0/2930867151 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f70d8012420 con 0x7f70e80aca60 2021-12-17T18:18:23.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.894+0000 7f70d67fc700 1 --2- 172.21.15.62:0/2930867151 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f70c80536a0 0x7f70c8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.894+0000 7f70d67fc700 1 -- 172.21.15.62:0/2930867151 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f70d806b760 con 0x7f70e80aca60 2021-12-17T18:18:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.894+0000 7f70d67fc700 1 --2- 172.21.15.62:0/2930867151 >> [v2:172.21.15.109:6802/15019,v1:172.21.15.109:6803/15019] conn(0x7f70c805aa90 0x7f70c805ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.894+0000 7f70d67fc700 1 -- 172.21.15.62:0/2930867151 --> [v2:172.21.15.109:6802/15019,v1:172.21.15.109:6803/15019] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70c805d470 con 0x7f70c805aa90 2021-12-17T18:18:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.894+0000 7f70d67fc700 1 -- 172.21.15.62:0/2930867151 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70d806ddf0 con 0x7f70e80aca60 2021-12-17T18:18:23.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.894+0000 7f70ed37b700 1 --2- 172.21.15.62:0/2930867151 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f70c80536a0 0x7f70c8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.894+0000 7f70edb7c700 1 --2- 172.21.15.62:0/2930867151 >> [v2:172.21.15.109:6802/15019,v1:172.21.15.109:6803/15019] conn(0x7f70c805aa90 0x7f70c805ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:23.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.894+0000 7f70ed37b700 1 --2- 172.21.15.62:0/2930867151 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f70c80536a0 0x7f70c8055b60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f70e400d000 tx=0x7f70e40079e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.894+0000 7f70edb7c700 1 --2- 172.21.15.62:0/2930867151 >> [v2:172.21.15.109:6802/15019,v1:172.21.15.109:6803/15019] conn(0x7f70c805aa90 0x7f70c805ceb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:23.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.894+0000 7f70d67fc700 1 -- 172.21.15.62:0/2930867151 <== osd.5 v2:172.21.15.109:6802/15019 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f70c805d470 con 0x7f70c805aa90 2021-12-17T18:18:23.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.914+0000 7f70ef5df700 1 -- 172.21.15.62:0/2930867151 --> [v2:172.21.15.109:6802/15019,v1:172.21.15.109:6803/15019] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f70e80b0fb0 con 0x7f70c805aa90 2021-12-17T18:18:23.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.914+0000 7f70d67fc700 1 -- 172.21.15.62:0/2930867151 <== osd.5 v2:172.21.15.109:6802/15019 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f70e80b0fb0 con 0x7f70c805aa90 2021-12-17T18:18:23.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.914+0000 7f70ef5df700 1 -- 172.21.15.62:0/2930867151 >> [v2:172.21.15.109:6802/15019,v1:172.21.15.109:6803/15019] conn(0x7f70c805aa90 msgr2=0x7f70c805ceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.914+0000 7f70ef5df700 1 --2- 172.21.15.62:0/2930867151 >> [v2:172.21.15.109:6802/15019,v1:172.21.15.109:6803/15019] conn(0x7f70c805aa90 0x7f70c805ceb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:23.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.914+0000 7f70ef5df700 1 -- 172.21.15.62:0/2930867151 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f70c80536a0 msgr2=0x7f70c8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.914+0000 7f70ef5df700 1 --2- 172.21.15.62:0/2930867151 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f70c80536a0 0x7f70c8055b60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f70e400d000 tx=0x7f70e40079e0).stop 2021-12-17T18:18:23.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.914+0000 7f70ef5df700 1 -- 172.21.15.62:0/2930867151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70e80aca60 msgr2=0x7f70e809ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:23.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.914+0000 7f70ef5df700 1 --2- 172.21.15.62:0/2930867151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70e80aca60 0x7f70e809ed10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f70d8006940 tx=0x7f70d8008040).stop 2021-12-17T18:18:23.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.914+0000 7f70edb7c700 1 -- 172.21.15.62:0/2930867151 reap_dead start 2021-12-17T18:18:23.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.914+0000 7f70ef5df700 1 -- 172.21.15.62:0/2930867151 shutdown_connections 2021-12-17T18:18:23.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.914+0000 7f70ef5df700 1 -- 172.21.15.62:0/2930867151 >> 172.21.15.62:0/2930867151 conn(0x7f70e805f730 msgr2=0x7f70e8140d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:23.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.914+0000 7f70ef5df700 1 -- 172.21.15.62:0/2930867151 shutdown_connections 2021-12-17T18:18:23.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:23.914+0000 7f70ef5df700 1 -- 172.21.15.62:0/2930867151 wait complete. 2021-12-17T18:18:23.938 INFO:teuthology.orchestra.run.smithi062.stdout:60129542149 2021-12-17T18:18:23.938 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2021-12-17T18:18:24.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33f64de700 1 Processor -- start 2021-12-17T18:18:24.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33f64de700 1 -- start start 2021-12-17T18:18:24.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33f64de700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f33f00b1730 0x7f33f00ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33f64de700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f00b2ce0 con 0x7f33f00b21f0 2021-12-17T18:18:24.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33f64de700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f00aca60 con 0x7f33f00a7bb0 2021-12-17T18:18:24.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33f64de700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f014b5b0 con 0x7f33f00b1730 2021-12-17T18:18:24.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33effff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f33f00b21f0 0x7f33f014aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59860/0 (socket says 172.21.15.62:59860) 2021-12-17T18:18:24.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33effff700 1 -- 172.21.15.62:0/3974841897 learned_addr learned my addr 172.21.15.62:0/3974841897 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:24.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33ef7fe700 1 --2- 172.21.15.62:0/3974841897 >> v2:172.21.15.109:3300/0 conn(0x7f33f00b1730 0x7f33f00ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33eeffd700 1 -- 172.21.15.62:0/3974841897 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557505192 0 0) 0x7f33f00b2ce0 con 0x7f33f00b21f0 2021-12-17T18:18:24.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33eeffd700 1 -- 172.21.15.62:0/3974841897 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33d0003260 con 0x7f33f00b21f0 2021-12-17T18:18:24.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33ef7fe700 1 -- 172.21.15.62:0/3974841897 >> v1:172.21.15.109:6789/0 conn(0x7f33f00a7bb0 legacy=0x7f33f0067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33ef7fe700 1 -- 172.21.15.62:0/3974841897 >> v1:172.21.15.62:6789/0 conn(0x7f33f00b21f0 legacy=0x7f33f014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33ef7fe700 1 -- 172.21.15.62:0/3974841897 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f00b2f10 con 0x7f33f00b1730 2021-12-17T18:18:24.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33ef7fe700 1 --2- 172.21.15.62:0/3974841897 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33f00b1730 0x7f33f00ace90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f33f00b1c00 tx=0x7f33e00091d0).ready entity=mon.1 client_cookie=5792254699533a4d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:24.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33eeffd700 1 -- 172.21.15.62:0/3974841897 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33e000b6d0 con 0x7f33f00b1730 2021-12-17T18:18:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33eeffd700 1 -- 172.21.15.62:0/3974841897 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e000b830 con 0x7f33f00b1730 2021-12-17T18:18:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.046+0000 7f33eeffd700 1 -- 172.21.15.62:0/3974841897 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33e000b9a0 con 0x7f33f00b1730 2021-12-17T18:18:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33f64de700 1 -- 172.21.15.62:0/3974841897 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33f00b1730 msgr2=0x7f33f00ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33f64de700 1 --2- 172.21.15.62:0/3974841897 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33f00b1730 0x7f33f00ace90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f33f00b1c00 tx=0x7f33e00091d0).stop 2021-12-17T18:18:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33f64de700 1 -- 172.21.15.62:0/3974841897 shutdown_connections 2021-12-17T18:18:24.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33f64de700 1 --2- 172.21.15.62:0/3974841897 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33f00b1730 0x7f33f00ace90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33f64de700 1 -- 172.21.15.62:0/3974841897 >> 172.21.15.62:0/3974841897 conn(0x7f33f005f730 msgr2=0x7f33f005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:24.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33f64de700 1 -- 172.21.15.62:0/3974841897 shutdown_connections 2021-12-17T18:18:24.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33f64de700 1 -- 172.21.15.62:0/3974841897 wait complete. 2021-12-17T18:18:24.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33f64de700 1 Processor -- start 2021-12-17T18:18:24.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33f64de700 1 -- start start 2021-12-17T18:18:24.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33f64de700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f00a7bb0 0x7f33f014ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33f64de700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f33f00b1730 0x7f33f0146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33f64de700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33f00b21f0 0x7f33f0146e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33f64de700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f00abf00 con 0x7f33f00a7bb0 2021-12-17T18:18:24.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33f64de700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0066860 con 0x7f33f00b21f0 2021-12-17T18:18:24.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33f64de700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f00ab600 con 0x7f33f00b1730 2021-12-17T18:18:24.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33effff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f00a7bb0 0x7f33f014ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33effff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f00a7bb0 0x7f33f014ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48056/0 (socket says 172.21.15.62:48056) 2021-12-17T18:18:24.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33effff700 1 -- 172.21.15.62:0/1601574914 learned_addr learned my addr 172.21.15.62:0/1601574914 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:24.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33ef7fe700 1 --2- 172.21.15.62:0/1601574914 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f33f00b1730 0x7f33f0146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33f4a7b700 1 --2- 172.21.15.62:0/1601574914 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33f00b21f0 0x7f33f0146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33effff700 1 -- 172.21.15.62:0/1601574914 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f33f00b1730 msgr2=0x7f33f0146960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33effff700 1 --2- 172.21.15.62:0/1601574914 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f33f00b1730 0x7f33f0146960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33effff700 1 -- 172.21.15.62:0/1601574914 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33f00b21f0 msgr2=0x7f33f0146e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33effff700 1 --2- 172.21.15.62:0/1601574914 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33f00b21f0 0x7f33f0146e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.050+0000 7f33effff700 1 -- 172.21.15.62:0/1601574914 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e0009470 con 0x7f33f00a7bb0 2021-12-17T18:18:24.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.054+0000 7f33effff700 1 --2- 172.21.15.62:0/1601574914 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f00a7bb0 0x7f33f014ba30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f33d8001110 tx=0x7f33d8007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:24.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.054+0000 7f33ed7fa700 1 -- 172.21.15.62:0/1601574914 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d80070d0 con 0x7f33f00a7bb0 2021-12-17T18:18:24.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.054+0000 7f33ed7fa700 1 -- 172.21.15.62:0/1601574914 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d8007230 con 0x7f33f00a7bb0 2021-12-17T18:18:24.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.054+0000 7f33f64de700 1 -- 172.21.15.62:0/1601574914 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f0063f10 con 0x7f33f00a7bb0 2021-12-17T18:18:24.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.054+0000 7f33ed7fa700 1 -- 172.21.15.62:0/1601574914 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d8005610 con 0x7f33f00a7bb0 2021-12-17T18:18:24.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.054+0000 7f33f64de700 1 -- 172.21.15.62:0/1601574914 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f0066f30 con 0x7f33f00a7bb0 2021-12-17T18:18:24.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.054+0000 7f33f64de700 1 -- 172.21.15.62:0/1601574914 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33f00640a0 con 0x7f33f00a7bb0 2021-12-17T18:18:24.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.054+0000 7f33ed7fa700 1 -- 172.21.15.62:0/1601574914 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f33d8010070 con 0x7f33f00a7bb0 2021-12-17T18:18:24.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.054+0000 7f33ed7fa700 1 --2- 172.21.15.62:0/1601574914 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f33d40534f0 0x7f33d40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.054+0000 7f33ed7fa700 1 -- 172.21.15.62:0/1601574914 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f33d806af50 con 0x7f33f00a7bb0 2021-12-17T18:18:24.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.054+0000 7f33ed7fa700 1 --2- 172.21.15.62:0/1601574914 >> [v2:172.21.15.109:6826/15028,v1:172.21.15.109:6827/15028] conn(0x7f33d405a900 0x7f33d405cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.054+0000 7f33ed7fa700 1 -- 172.21.15.62:0/1601574914 --> [v2:172.21.15.109:6826/15028,v1:172.21.15.109:6827/15028] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33d405d380 con 0x7f33d405a900 2021-12-17T18:18:24.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.054+0000 7f33ed7fa700 1 -- 172.21.15.62:0/1601574914 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33d806d560 con 0x7f33f00a7bb0 2021-12-17T18:18:24.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.054+0000 7f33ef7fe700 1 --2- 172.21.15.62:0/1601574914 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f33d40534f0 0x7f33d40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.054+0000 7f33f4a7b700 1 --2- 172.21.15.62:0/1601574914 >> [v2:172.21.15.109:6826/15028,v1:172.21.15.109:6827/15028] conn(0x7f33d405a900 0x7f33d405cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.058+0000 7f33ef7fe700 1 --2- 172.21.15.62:0/1601574914 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f33d40534f0 0x7f33d40559b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f33e001b000 tx=0x7f33e0016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:24.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.058+0000 7f33f4a7b700 1 --2- 172.21.15.62:0/1601574914 >> [v2:172.21.15.109:6826/15028,v1:172.21.15.109:6827/15028] conn(0x7f33d405a900 0x7f33d405cd20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:24.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.058+0000 7f33ed7fa700 1 -- 172.21.15.62:0/1601574914 <== osd.6 v2:172.21.15.109:6826/15028 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f33d405d380 con 0x7f33d405a900 2021-12-17T18:18:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.078+0000 7f33f64de700 1 -- 172.21.15.62:0/1601574914 --> [v2:172.21.15.109:6826/15028,v1:172.21.15.109:6827/15028] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f33f0066c30 con 0x7f33d405a900 2021-12-17T18:18:24.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.078+0000 7f33ed7fa700 1 -- 172.21.15.62:0/1601574914 <== osd.6 v2:172.21.15.109:6826/15028 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f33f0066c30 con 0x7f33d405a900 2021-12-17T18:18:24.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.078+0000 7f33f64de700 1 -- 172.21.15.62:0/1601574914 >> [v2:172.21.15.109:6826/15028,v1:172.21.15.109:6827/15028] conn(0x7f33d405a900 msgr2=0x7f33d405cd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.078+0000 7f33f64de700 1 --2- 172.21.15.62:0/1601574914 >> [v2:172.21.15.109:6826/15028,v1:172.21.15.109:6827/15028] conn(0x7f33d405a900 0x7f33d405cd20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.078+0000 7f33f64de700 1 -- 172.21.15.62:0/1601574914 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f33d40534f0 msgr2=0x7f33d40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.078+0000 7f33f64de700 1 --2- 172.21.15.62:0/1601574914 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f33d40534f0 0x7f33d40559b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f33e001b000 tx=0x7f33e0016000).stop 2021-12-17T18:18:24.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.078+0000 7f33f64de700 1 -- 172.21.15.62:0/1601574914 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f00a7bb0 msgr2=0x7f33f014ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.078+0000 7f33f64de700 1 --2- 172.21.15.62:0/1601574914 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f00a7bb0 0x7f33f014ba30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f33d8001110 tx=0x7f33d8007ad0).stop 2021-12-17T18:18:24.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.078+0000 7f33f4a7b700 1 -- 172.21.15.62:0/1601574914 reap_dead start 2021-12-17T18:18:24.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.078+0000 7f33f64de700 1 -- 172.21.15.62:0/1601574914 shutdown_connections 2021-12-17T18:18:24.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.078+0000 7f33f64de700 1 -- 172.21.15.62:0/1601574914 >> 172.21.15.62:0/1601574914 conn(0x7f33f005f730 msgr2=0x7f33f014adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:24.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.078+0000 7f33f64de700 1 -- 172.21.15.62:0/1601574914 shutdown_connections 2021-12-17T18:18:24.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.078+0000 7f33f64de700 1 -- 172.21.15.62:0/1601574914 wait complete. 2021-12-17T18:18:24.096 INFO:teuthology.orchestra.run.smithi062.stdout:60129542149 2021-12-17T18:18:24.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2021-12-17T18:18:24.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.194+0000 7fe2e88be700 1 Processor -- start 2021-12-17T18:18:24.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.194+0000 7fe2e88be700 1 -- start start 2021-12-17T18:18:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.194+0000 7fe2e88be700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe2e40adaa0 0x7fe2e40b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.194+0000 7fe2e88be700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2e40b1bc0 0x7fe2e4140190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.194+0000 7fe2e88be700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e40b0100 con 0x7fe2e40b1760 2021-12-17T18:18:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.194+0000 7fe2e88be700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e40ae550 con 0x7fe2e40adaa0 2021-12-17T18:18:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.194+0000 7fe2e88be700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e4144110 con 0x7fe2e40b1bc0 2021-12-17T18:18:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.194+0000 7fe2e2ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe2e40b1760 0x7fe2e4143a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59878/0 (socket says 172.21.15.62:59878) 2021-12-17T18:18:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.194+0000 7fe2e2ffd700 1 -- 172.21.15.62:0/4231660970 learned_addr learned my addr 172.21.15.62:0/4231660970 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:24.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.194+0000 7fe2e37fe700 1 --2- 172.21.15.62:0/4231660970 >> v2:172.21.15.109:3300/0 conn(0x7fe2e40adaa0 0x7fe2e40b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.194+0000 7fe2e3fff700 1 --2- 172.21.15.62:0/4231660970 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2e40b1bc0 0x7fe2e4140190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.194+0000 7fe2e27fc700 1 -- 172.21.15.62:0/4231660970 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204152344 0 0) 0x7fe2e40b0100 con 0x7fe2e40b1760 2021-12-17T18:18:24.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.194+0000 7fe2e27fc700 1 -- 172.21.15.62:0/4231660970 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2c4003260 con 0x7fe2e40b1760 2021-12-17T18:18:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.194+0000 7fe2e3fff700 1 -- 172.21.15.62:0/4231660970 >> v2:172.21.15.109:3300/0 conn(0x7fe2e40adaa0 msgr2=0x7fe2e40b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.194+0000 7fe2e3fff700 1 --2- 172.21.15.62:0/4231660970 >> v2:172.21.15.109:3300/0 conn(0x7fe2e40adaa0 0x7fe2e40b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.194+0000 7fe2e3fff700 1 -- 172.21.15.62:0/4231660970 >> v1:172.21.15.62:6789/0 conn(0x7fe2e40b1760 legacy=0x7fe2e4143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.194+0000 7fe2e3fff700 1 -- 172.21.15.62:0/4231660970 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e40ade80 con 0x7fe2e40b1bc0 2021-12-17T18:18:24.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.198+0000 7fe2e3fff700 1 --2- 172.21.15.62:0/4231660970 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2e40b1bc0 0x7fe2e4140190 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fe2dc0032f0 tx=0x7fe2dc0091d0).ready entity=mon.2 client_cookie=5dbfd27a4228edac server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.198+0000 7fe2e27fc700 1 -- 172.21.15.62:0/4231660970 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2dc00b600 con 0x7fe2e40b1bc0 2021-12-17T18:18:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.198+0000 7fe2e27fc700 1 -- 172.21.15.62:0/4231660970 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc00b760 con 0x7fe2e40b1bc0 2021-12-17T18:18:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.198+0000 7fe2e27fc700 1 -- 172.21.15.62:0/4231660970 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2dc00b8d0 con 0x7fe2e40b1bc0 2021-12-17T18:18:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.198+0000 7fe2e88be700 1 -- 172.21.15.62:0/4231660970 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2e40b1bc0 msgr2=0x7fe2e4140190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.198+0000 7fe2e88be700 1 --2- 172.21.15.62:0/4231660970 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2e40b1bc0 0x7fe2e4140190 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fe2dc0032f0 tx=0x7fe2dc0091d0).stop 2021-12-17T18:18:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.198+0000 7fe2e88be700 1 -- 172.21.15.62:0/4231660970 shutdown_connections 2021-12-17T18:18:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.198+0000 7fe2e88be700 1 --2- 172.21.15.62:0/4231660970 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2e40b1bc0 0x7fe2e4140190 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.198+0000 7fe2e88be700 1 --2- 172.21.15.62:0/4231660970 >> v2:172.21.15.109:3300/0 conn(0x7fe2e40adaa0 0x7fe2e40b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.198+0000 7fe2e88be700 1 -- 172.21.15.62:0/4231660970 >> 172.21.15.62:0/4231660970 conn(0x7fe2e40b6320 msgr2=0x7fe2e40b6700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:24.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.198+0000 7fe2e88be700 1 -- 172.21.15.62:0/4231660970 shutdown_connections 2021-12-17T18:18:24.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.198+0000 7fe2e88be700 1 -- 172.21.15.62:0/4231660970 wait complete. 2021-12-17T18:18:24.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.198+0000 7fe2e88be700 1 Processor -- start 2021-12-17T18:18:24.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.198+0000 7fe2e88be700 1 -- start start 2021-12-17T18:18:24.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e88be700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe2e40adaa0 0x7fe2e4066180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e88be700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2e40b1760 0x7fe2e41413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e88be700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2e40b1bc0 0x7fe2e413b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e88be700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e4064cc0 con 0x7fe2e40b1760 2021-12-17T18:18:24.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e88be700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e4064ef0 con 0x7fe2e40adaa0 2021-12-17T18:18:24.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e88be700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e4065190 con 0x7fe2e40b1bc0 2021-12-17T18:18:24.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2e40b1760 0x7fe2e41413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2e40b1760 0x7fe2e41413f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48070/0 (socket says 172.21.15.62:48070) 2021-12-17T18:18:24.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e2ffd700 1 -- 172.21.15.62:0/789757686 learned_addr learned my addr 172.21.15.62:0/789757686 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:24.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e37fe700 1 --2- 172.21.15.62:0/789757686 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe2e40adaa0 0x7fe2e4066180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e3fff700 1 --2- 172.21.15.62:0/789757686 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2e40b1bc0 0x7fe2e413b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e2ffd700 1 -- 172.21.15.62:0/789757686 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2e40b1bc0 msgr2=0x7fe2e413b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e2ffd700 1 --2- 172.21.15.62:0/789757686 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2e40b1bc0 0x7fe2e413b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e2ffd700 1 -- 172.21.15.62:0/789757686 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe2e40adaa0 msgr2=0x7fe2e4066180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e2ffd700 1 --2- 172.21.15.62:0/789757686 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe2e40adaa0 0x7fe2e4066180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e2ffd700 1 -- 172.21.15.62:0/789757686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc009470 con 0x7fe2e40b1760 2021-12-17T18:18:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e2ffd700 1 --2- 172.21.15.62:0/789757686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2e40b1760 0x7fe2e41413f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fe2cc001110 tx=0x7fe2cc007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e0ff9700 1 -- 172.21.15.62:0/789757686 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2cc0070d0 con 0x7fe2e40b1760 2021-12-17T18:18:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e0ff9700 1 -- 172.21.15.62:0/789757686 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc007230 con 0x7fe2e40b1760 2021-12-17T18:18:24.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e0ff9700 1 -- 172.21.15.62:0/789757686 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2cc005610 con 0x7fe2e40b1760 2021-12-17T18:18:24.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e88be700 1 -- 172.21.15.62:0/789757686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e413bb00 con 0x7fe2e40b1760 2021-12-17T18:18:24.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e88be700 1 -- 172.21.15.62:0/789757686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e413c030 con 0x7fe2e40b1760 2021-12-17T18:18:24.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.202+0000 7fe2e88be700 1 -- 172.21.15.62:0/789757686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2e4065350 con 0x7fe2e40b1760 2021-12-17T18:18:24.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.206+0000 7fe2e0ff9700 1 -- 172.21.15.62:0/789757686 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe2cc010070 con 0x7fe2e40b1760 2021-12-17T18:18:24.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.206+0000 7fe2e0ff9700 1 --2- 172.21.15.62:0/789757686 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe2c80536a0 0x7fe2c8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.206+0000 7fe2e0ff9700 1 -- 172.21.15.62:0/789757686 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe2cc06afe0 con 0x7fe2e40b1760 2021-12-17T18:18:24.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.206+0000 7fe2e0ff9700 1 --2- 172.21.15.62:0/789757686 >> [v2:172.21.15.109:6818/15018,v1:172.21.15.109:6819/15018] conn(0x7fe2c805aa10 0x7fe2c805ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.206+0000 7fe2e0ff9700 1 -- 172.21.15.62:0/789757686 --> [v2:172.21.15.109:6818/15018,v1:172.21.15.109:6819/15018] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2c805d3f0 con 0x7fe2c805aa10 2021-12-17T18:18:24.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.206+0000 7fe2e0ff9700 1 -- 172.21.15.62:0/789757686 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2cc06d650 con 0x7fe2e40b1760 2021-12-17T18:18:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.206+0000 7fe2e37fe700 1 --2- 172.21.15.62:0/789757686 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe2c80536a0 0x7fe2c8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.206+0000 7fe2e3fff700 1 --2- 172.21.15.62:0/789757686 >> [v2:172.21.15.109:6818/15018,v1:172.21.15.109:6819/15018] conn(0x7fe2c805aa10 0x7fe2c805ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.206+0000 7fe2e37fe700 1 --2- 172.21.15.62:0/789757686 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe2c80536a0 0x7fe2c8055b60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fe2d400b000 tx=0x7fe2d4006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.206+0000 7fe2e3fff700 1 --2- 172.21.15.62:0/789757686 >> [v2:172.21.15.109:6818/15018,v1:172.21.15.109:6819/15018] conn(0x7fe2c805aa10 0x7fe2c805ce30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.206+0000 7fe2e0ff9700 1 -- 172.21.15.62:0/789757686 <== osd.7 v2:172.21.15.109:6818/15018 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fe2c805d3f0 con 0x7fe2c805aa10 2021-12-17T18:18:24.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.230+0000 7fe2e88be700 1 -- 172.21.15.62:0/789757686 --> [v2:172.21.15.109:6818/15018,v1:172.21.15.109:6819/15018] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe2e413a180 con 0x7fe2c805aa10 2021-12-17T18:18:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.230+0000 7fe2e0ff9700 1 -- 172.21.15.62:0/789757686 <== osd.7 v2:172.21.15.109:6818/15018 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe2e413a180 con 0x7fe2c805aa10 2021-12-17T18:18:24.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.230+0000 7fe2e88be700 1 -- 172.21.15.62:0/789757686 >> [v2:172.21.15.109:6818/15018,v1:172.21.15.109:6819/15018] conn(0x7fe2c805aa10 msgr2=0x7fe2c805ce30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.230+0000 7fe2e88be700 1 --2- 172.21.15.62:0/789757686 >> [v2:172.21.15.109:6818/15018,v1:172.21.15.109:6819/15018] conn(0x7fe2c805aa10 0x7fe2c805ce30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.230+0000 7fe2e88be700 1 -- 172.21.15.62:0/789757686 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe2c80536a0 msgr2=0x7fe2c8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.230+0000 7fe2e88be700 1 --2- 172.21.15.62:0/789757686 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe2c80536a0 0x7fe2c8055b60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fe2d400b000 tx=0x7fe2d4006df0).stop 2021-12-17T18:18:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.230+0000 7fe2e88be700 1 -- 172.21.15.62:0/789757686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2e40b1760 msgr2=0x7fe2e41413f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.230+0000 7fe2e88be700 1 --2- 172.21.15.62:0/789757686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2e40b1760 0x7fe2e41413f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fe2cc001110 tx=0x7fe2cc007aa0).stop 2021-12-17T18:18:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.230+0000 7fe2e3fff700 1 -- 172.21.15.62:0/789757686 reap_dead start 2021-12-17T18:18:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.230+0000 7fe2e88be700 1 -- 172.21.15.62:0/789757686 shutdown_connections 2021-12-17T18:18:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.230+0000 7fe2e88be700 1 -- 172.21.15.62:0/789757686 >> 172.21.15.62:0/789757686 conn(0x7fe2e40b6320 msgr2=0x7fe2e40b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:24.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.230+0000 7fe2e88be700 1 -- 172.21.15.62:0/789757686 shutdown_connections 2021-12-17T18:18:24.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.230+0000 7fe2e88be700 1 -- 172.21.15.62:0/789757686 wait complete. 2021-12-17T18:18:24.247 INFO:teuthology.orchestra.run.smithi062.stdout:60129542149 2021-12-17T18:18:24.247 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-12-17T18:18:24.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f8311082700 1 Processor -- start 2021-12-17T18:18:24.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f8311082700 1 -- start start 2021-12-17T18:18:24.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f8311082700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f830c0b1d10 0x7f830c147b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f8311082700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f830c0afba0 0x7f830c14a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f8311082700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f830c14ace0 0x7f830c144580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f8311082700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830c0ac420 con 0x7f830c14ace0 2021-12-17T18:18:24.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f8311082700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830c0ad7a0 con 0x7f830c0afba0 2021-12-17T18:18:24.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f8311082700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830c148430 con 0x7f830c0b1d10 2021-12-17T18:18:24.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f8310881700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f830c14ace0 0x7f830c144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f8310881700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f830c14ace0 0x7f830c144580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48084/0 (socket says 172.21.15.62:48084) 2021-12-17T18:18:24.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f8310881700 1 -- 172.21.15.62:0/3786473941 learned_addr learned my addr 172.21.15.62:0/3786473941 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:24.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f830b7fe700 1 --2- 172.21.15.62:0/3786473941 >> v2:172.21.15.109:3300/0 conn(0x7f830c0afba0 0x7f830c14a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f830bfff700 1 --2- 172.21.15.62:0/3786473941 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f830c0b1d10 0x7f830c147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f830b7fe700 1 -- 172.21.15.62:0/3786473941 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f830c0b1d10 msgr2=0x7f830c147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:24.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f830b7fe700 1 --2- 172.21.15.62:0/3786473941 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f830c0b1d10 0x7f830c147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f830b7fe700 1 -- 172.21.15.62:0/3786473941 >> v2:172.21.15.62:3300/0 conn(0x7f830c14ace0 msgr2=0x7f830c144580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:24.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f830b7fe700 1 --2- 172.21.15.62:0/3786473941 >> v2:172.21.15.62:3300/0 conn(0x7f830c14ace0 0x7f830c144580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f830b7fe700 1 -- 172.21.15.62:0/3786473941 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c1473c0 con 0x7f830c0afba0 2021-12-17T18:18:24.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f8310881700 1 --2- 172.21.15.62:0/3786473941 >> v2:172.21.15.62:3300/0 conn(0x7f830c14ace0 0x7f830c144580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:24.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f830b7fe700 1 --2- 172.21.15.62:0/3786473941 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f830c0afba0 0x7f830c14a7f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f82fc0032f0 tx=0x7f82fc0091d0).ready entity=mon.1 client_cookie=16b3d3ab954c4b03 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:24.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f830affd700 1 -- 172.21.15.62:0/3786473941 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82fc00b600 con 0x7f830c0afba0 2021-12-17T18:18:24.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f830affd700 1 -- 172.21.15.62:0/3786473941 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82fc00b760 con 0x7f830c0afba0 2021-12-17T18:18:24.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.354+0000 7f830affd700 1 -- 172.21.15.62:0/3786473941 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82fc00b8d0 con 0x7f830c0afba0 2021-12-17T18:18:24.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.358+0000 7f8311082700 1 -- 172.21.15.62:0/3786473941 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f830c0afba0 msgr2=0x7f830c14a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.358+0000 7f8311082700 1 --2- 172.21.15.62:0/3786473941 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f830c0afba0 0x7f830c14a7f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f82fc0032f0 tx=0x7f82fc0091d0).stop 2021-12-17T18:18:24.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.358+0000 7f8311082700 1 -- 172.21.15.62:0/3786473941 shutdown_connections 2021-12-17T18:18:24.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.358+0000 7f8311082700 1 --2- 172.21.15.62:0/3786473941 >> v2:172.21.15.62:3300/0 conn(0x7f830c14ace0 0x7f830c144580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.358+0000 7f8311082700 1 --2- 172.21.15.62:0/3786473941 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f830c0afba0 0x7f830c14a7f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.358+0000 7f8311082700 1 --2- 172.21.15.62:0/3786473941 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f830c0b1d10 0x7f830c147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.358+0000 7f8311082700 1 -- 172.21.15.62:0/3786473941 >> 172.21.15.62:0/3786473941 conn(0x7f830c0623c0 msgr2=0x7f830c0627d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:24.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.358+0000 7f8311082700 1 -- 172.21.15.62:0/3786473941 shutdown_connections 2021-12-17T18:18:24.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.358+0000 7f8311082700 1 -- 172.21.15.62:0/3786473941 wait complete. 2021-12-17T18:18:24.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.358+0000 7f8311082700 1 Processor -- start 2021-12-17T18:18:24.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.358+0000 7f8311082700 1 -- start start 2021-12-17T18:18:24.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.358+0000 7f8311082700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f830c0afba0 0x7f830c14c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.358+0000 7f8311082700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f830c0b1d10 0x7f830c15a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.358+0000 7f8311082700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f830c14ace0 0x7f830c15a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.358+0000 7f8311082700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c149e20 con 0x7f830c0afba0 2021-12-17T18:18:24.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.358+0000 7f8311082700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c146970 con 0x7f830c14ace0 2021-12-17T18:18:24.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.358+0000 7f8311082700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830c15ab10 con 0x7f830c0b1d10 2021-12-17T18:18:24.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f830bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f830c0afba0 0x7f830c14c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f830bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f830c0afba0 0x7f830c14c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48086/0 (socket says 172.21.15.62:48086) 2021-12-17T18:18:24.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f830bfff700 1 -- 172.21.15.62:0/3995916658 learned_addr learned my addr 172.21.15.62:0/3995916658 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:24.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f830b7fe700 1 --2- 172.21.15.62:0/3995916658 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f830c0b1d10 0x7f830c15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f8310881700 1 --2- 172.21.15.62:0/3995916658 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f830c14ace0 0x7f830c15a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f830bfff700 1 -- 172.21.15.62:0/3995916658 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f830c0b1d10 msgr2=0x7f830c15a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f830bfff700 1 --2- 172.21.15.62:0/3995916658 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f830c0b1d10 0x7f830c15a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f830bfff700 1 -- 172.21.15.62:0/3995916658 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f830c14ace0 msgr2=0x7f830c15a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f830bfff700 1 --2- 172.21.15.62:0/3995916658 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f830c14ace0 0x7f830c15a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f830bfff700 1 -- 172.21.15.62:0/3995916658 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830400b1e0 con 0x7f830c0afba0 2021-12-17T18:18:24.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f830bfff700 1 --2- 172.21.15.62:0/3995916658 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f830c0afba0 0x7f830c14c8b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f82f400c000 tx=0x7f82f4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:24.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f83097fa700 1 -- 172.21.15.62:0/3995916658 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82f4010780 con 0x7f830c0afba0 2021-12-17T18:18:24.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f83097fa700 1 -- 172.21.15.62:0/3995916658 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f40108e0 con 0x7f830c0afba0 2021-12-17T18:18:24.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f8311082700 1 -- 172.21.15.62:0/3995916658 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82fc009470 con 0x7f830c0afba0 2021-12-17T18:18:24.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f83097fa700 1 -- 172.21.15.62:0/3995916658 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82f4010c40 con 0x7f830c0afba0 2021-12-17T18:18:24.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f8311082700 1 -- 172.21.15.62:0/3995916658 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830c148f70 con 0x7f830c0afba0 2021-12-17T18:18:24.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f8311082700 1 -- 172.21.15.62:0/3995916658 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f830c147660 con 0x7f830c0afba0 2021-12-17T18:18:24.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f83097fa700 1 -- 172.21.15.62:0/3995916658 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f82f401c460 con 0x7f830c0afba0 2021-12-17T18:18:24.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.362+0000 7f83097fa700 1 --2- 172.21.15.62:0/3995916658 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f82f0053520 0x7f82f00559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.366+0000 7f83097fa700 1 -- 172.21.15.62:0/3995916658 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f82f406bd20 con 0x7f830c0afba0 2021-12-17T18:18:24.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.366+0000 7f830b7fe700 1 --2- 172.21.15.62:0/3995916658 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f82f0053520 0x7f82f00559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.366+0000 7f830b7fe700 1 --2- 172.21.15.62:0/3995916658 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f82f0053520 0x7f82f00559e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f82fc01b000 tx=0x7f82fc016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:24.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.370+0000 7f83097fa700 1 -- 172.21.15.62:0/3995916658 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f82f4042d80 con 0x7f830c0afba0 2021-12-17T18:18:24.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.498+0000 7f8311082700 1 -- 172.21.15.62:0/3995916658 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f830c0573d0 con 0x7f830c0afba0 2021-12-17T18:18:24.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.498+0000 7f83097fa700 1 -- 172.21.15.62:0/3995916658 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f82f40463a0 con 0x7f830c0afba0 2021-12-17T18:18:24.503 INFO:teuthology.orchestra.run.smithi062.stdout:60129542149 2021-12-17T18:18:24.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.498+0000 7f8311082700 1 -- 172.21.15.62:0/3995916658 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f82f0053520 msgr2=0x7f82f00559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.498+0000 7f8311082700 1 --2- 172.21.15.62:0/3995916658 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f82f0053520 0x7f82f00559e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f82fc01b000 tx=0x7f82fc016000).stop 2021-12-17T18:18:24.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.498+0000 7f8311082700 1 -- 172.21.15.62:0/3995916658 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f830c0afba0 msgr2=0x7f830c14c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.498+0000 7f8311082700 1 --2- 172.21.15.62:0/3995916658 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f830c0afba0 0x7f830c14c8b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f82f400c000 tx=0x7f82f4006df0).stop 2021-12-17T18:18:24.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.498+0000 7f8311082700 1 -- 172.21.15.62:0/3995916658 shutdown_connections 2021-12-17T18:18:24.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.498+0000 7f8311082700 1 --2- 172.21.15.62:0/3995916658 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f82f0053520 0x7f82f00559e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.498+0000 7f8311082700 1 --2- 172.21.15.62:0/3995916658 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f830c14ace0 0x7f830c15a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.498+0000 7f8311082700 1 --2- 172.21.15.62:0/3995916658 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f830c0b1d10 0x7f830c15a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.498+0000 7f8311082700 1 --2- 172.21.15.62:0/3995916658 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f830c0afba0 0x7f830c14c8b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.498+0000 7f8311082700 1 -- 172.21.15.62:0/3995916658 >> 172.21.15.62:0/3995916658 conn(0x7f830c0623c0 msgr2=0x7f830c144350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:24.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.498+0000 7f8311082700 1 -- 172.21.15.62:0/3995916658 shutdown_connections 2021-12-17T18:18:24.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.498+0000 7f8311082700 1 -- 172.21.15.62:0/3995916658 wait complete. 2021-12-17T18:18:24.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2021-12-17T18:18:24.516 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-12-17T18:18:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.614+0000 7f792e42e700 1 Processor -- start 2021-12-17T18:18:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.614+0000 7f792e42e700 1 -- start start 2021-12-17T18:18:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f792e42e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79280b21f0 0x7f792814aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f792e42e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f79280b1730 0x7f79280ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f792e42e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79280b2ce0 con 0x7f79280a7bb0 2021-12-17T18:18:24.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f792e42e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7928147870 con 0x7f79280b1730 2021-12-17T18:18:24.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f792e42e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79280b2f10 con 0x7f79280b21f0 2021-12-17T18:18:24.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f79277fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f79280b1730 0x7f79280ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f79277fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f79280b1730 0x7f79280ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48094/0 (socket says 172.21.15.62:48094) 2021-12-17T18:18:24.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f79277fe700 1 -- 172.21.15.62:0/1976939461 learned_addr learned my addr 172.21.15.62:0/1976939461 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:24.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f792c9cb700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f79280a7bb0 0x7f7928067120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59910/0 (socket says 172.21.15.62:59910) 2021-12-17T18:18:24.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f7927fff700 1 --2- 172.21.15.62:0/1976939461 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79280b21f0 0x7f792814aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f79277fe700 1 -- 172.21.15.62:0/1976939461 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79280b21f0 msgr2=0x7f792814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f79277fe700 1 --2- 172.21.15.62:0/1976939461 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79280b21f0 0x7f792814aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f79277fe700 1 -- 172.21.15.62:0/1976939461 >> v1:172.21.15.62:6789/0 conn(0x7f79280a7bb0 legacy=0x7f7928067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f7926ffd700 1 -- 172.21.15.62:0/1976939461 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421994492 0 0) 0x7f79280b2ce0 con 0x7f79280a7bb0 2021-12-17T18:18:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f79277fe700 1 -- 172.21.15.62:0/1976939461 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79280aca60 con 0x7f79280b1730 2021-12-17T18:18:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f7927fff700 1 --2- 172.21.15.62:0/1976939461 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79280b21f0 0x7f792814aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f79277fe700 1 --2- 172.21.15.62:0/1976939461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79280b1730 0x7f79280ace90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f79180032f0 tx=0x7f7918009290).ready entity=mon.0 client_cookie=c514fd44b5ae9df2 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f7926ffd700 1 -- 172.21.15.62:0/1976939461 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f791800b8a0 con 0x7f79280b1730 2021-12-17T18:18:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f7926ffd700 1 -- 172.21.15.62:0/1976939461 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791800ba00 con 0x7f79280b1730 2021-12-17T18:18:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f7926ffd700 1 -- 172.21.15.62:0/1976939461 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f791800bb70 con 0x7f79280b1730 2021-12-17T18:18:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f792e42e700 1 -- 172.21.15.62:0/1976939461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79280b1730 msgr2=0x7f79280ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f792e42e700 1 --2- 172.21.15.62:0/1976939461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79280b1730 0x7f79280ace90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f79180032f0 tx=0x7f7918009290).stop 2021-12-17T18:18:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f792e42e700 1 -- 172.21.15.62:0/1976939461 shutdown_connections 2021-12-17T18:18:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f792e42e700 1 --2- 172.21.15.62:0/1976939461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79280b1730 0x7f79280ace90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f792e42e700 1 --2- 172.21.15.62:0/1976939461 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79280b21f0 0x7f792814aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f792e42e700 1 -- 172.21.15.62:0/1976939461 >> 172.21.15.62:0/1976939461 conn(0x7f792805f730 msgr2=0x7f792805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f792e42e700 1 -- 172.21.15.62:0/1976939461 shutdown_connections 2021-12-17T18:18:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.618+0000 7f792e42e700 1 -- 172.21.15.62:0/1976939461 wait complete. 2021-12-17T18:18:24.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f792e42e700 1 Processor -- start 2021-12-17T18:18:24.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f792e42e700 1 -- start start 2021-12-17T18:18:24.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f792e42e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79280a7bb0 0x7f79280aaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f792e42e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79280b1730 0x7f7928157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f792e42e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79280b21f0 0x7f7928066870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f792e42e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7928158110 con 0x7f79280b1730 2021-12-17T18:18:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f792e42e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7928157510 con 0x7f79280b21f0 2021-12-17T18:18:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f792e42e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7928157730 con 0x7f79280a7bb0 2021-12-17T18:18:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f79277fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79280b1730 0x7f7928157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f79277fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79280b1730 0x7f7928157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48104/0 (socket says 172.21.15.62:48104) 2021-12-17T18:18:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f79277fe700 1 -- 172.21.15.62:0/4032479693 learned_addr learned my addr 172.21.15.62:0/4032479693 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f792c9cb700 1 --2- 172.21.15.62:0/4032479693 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79280b21f0 0x7f7928066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f7927fff700 1 --2- 172.21.15.62:0/4032479693 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79280a7bb0 0x7f79280aaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f79277fe700 1 -- 172.21.15.62:0/4032479693 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79280a7bb0 msgr2=0x7f79280aaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f79277fe700 1 --2- 172.21.15.62:0/4032479693 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79280a7bb0 0x7f79280aaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f79277fe700 1 -- 172.21.15.62:0/4032479693 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79280b21f0 msgr2=0x7f7928066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f79277fe700 1 --2- 172.21.15.62:0/4032479693 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79280b21f0 0x7f7928066870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f79277fe700 1 -- 172.21.15.62:0/4032479693 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7918009530 con 0x7f79280b1730 2021-12-17T18:18:24.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f7927fff700 1 --2- 172.21.15.62:0/4032479693 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79280a7bb0 0x7f79280aaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:24.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f792c9cb700 1 --2- 172.21.15.62:0/4032479693 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79280b21f0 0x7f7928066870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:24.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f79277fe700 1 --2- 172.21.15.62:0/4032479693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79280b1730 0x7f7928157020 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f79180032f0 tx=0x7f7918016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:24.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f79257fa700 1 -- 172.21.15.62:0/4032479693 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f791800bb70 con 0x7f79280b1730 2021-12-17T18:18:24.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f79257fa700 1 -- 172.21.15.62:0/4032479693 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7918020420 con 0x7f79280b1730 2021-12-17T18:18:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f79257fa700 1 -- 172.21.15.62:0/4032479693 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7918020780 con 0x7f79280b1730 2021-12-17T18:18:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f792e42e700 1 -- 172.21.15.62:0/4032479693 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79281579d0 con 0x7f79280b1730 2021-12-17T18:18:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f792e42e700 1 -- 172.21.15.62:0/4032479693 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7928063840 con 0x7f79280b1730 2021-12-17T18:18:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.622+0000 7f792e42e700 1 -- 172.21.15.62:0/4032479693 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79280573d0 con 0x7f79280b1730 2021-12-17T18:18:24.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.626+0000 7f79257fa700 1 -- 172.21.15.62:0/4032479693 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7918027070 con 0x7f79280b1730 2021-12-17T18:18:24.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.626+0000 7f79257fa700 1 --2- 172.21.15.62:0/4032479693 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79080536d0 0x7f7908055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.626+0000 7f79257fa700 1 -- 172.21.15.62:0/4032479693 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f791806c440 con 0x7f79280b1730 2021-12-17T18:18:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.626+0000 7f7927fff700 1 --2- 172.21.15.62:0/4032479693 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79080536d0 0x7f7908055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.626+0000 7f7927fff700 1 --2- 172.21.15.62:0/4032479693 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79080536d0 0x7f7908055b90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f791c00c000 tx=0x7f791c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.634+0000 7f79257fa700 1 -- 172.21.15.62:0/4032479693 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7918043490 con 0x7f79280b1730 2021-12-17T18:18:24.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.762+0000 7f792e42e700 1 -- 172.21.15.62:0/4032479693 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f79280af860 con 0x7f79280b1730 2021-12-17T18:18:24.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.762+0000 7f79257fa700 1 -- 172.21.15.62:0/4032479693 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7918015090 con 0x7f79280b1730 2021-12-17T18:18:24.769 INFO:teuthology.orchestra.run.smithi062.stdout:60129542148 2021-12-17T18:18:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.766+0000 7f792e42e700 1 -- 172.21.15.62:0/4032479693 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79080536d0 msgr2=0x7f7908055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.766+0000 7f792e42e700 1 --2- 172.21.15.62:0/4032479693 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79080536d0 0x7f7908055b90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f791c00c000 tx=0x7f791c008040).stop 2021-12-17T18:18:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.766+0000 7f792e42e700 1 -- 172.21.15.62:0/4032479693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79280b1730 msgr2=0x7f7928157020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.766+0000 7f792e42e700 1 --2- 172.21.15.62:0/4032479693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79280b1730 0x7f7928157020 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f79180032f0 tx=0x7f7918016000).stop 2021-12-17T18:18:24.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.766+0000 7f792e42e700 1 -- 172.21.15.62:0/4032479693 shutdown_connections 2021-12-17T18:18:24.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.766+0000 7f792e42e700 1 --2- 172.21.15.62:0/4032479693 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79080536d0 0x7f7908055b90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.766+0000 7f792e42e700 1 --2- 172.21.15.62:0/4032479693 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79280b21f0 0x7f7928066870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.766+0000 7f792e42e700 1 --2- 172.21.15.62:0/4032479693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79280b1730 0x7f7928157020 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.766+0000 7f792e42e700 1 --2- 172.21.15.62:0/4032479693 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79280a7bb0 0x7f79280aaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.766+0000 7f792e42e700 1 -- 172.21.15.62:0/4032479693 >> 172.21.15.62:0/4032479693 conn(0x7f792805f730 msgr2=0x7f792805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:24.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.766+0000 7f792e42e700 1 -- 172.21.15.62:0/4032479693 shutdown_connections 2021-12-17T18:18:24.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.766+0000 7f792e42e700 1 -- 172.21.15.62:0/4032479693 wait complete. 2021-12-17T18:18:24.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2021-12-17T18:18:24.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-12-17T18:18:24.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.890+0000 7f2bd20e4700 1 Processor -- start 2021-12-17T18:18:24.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.890+0000 7f2bd20e4700 1 -- start start 2021-12-17T18:18:24.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.890+0000 7f2bd20e4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2bcc0b0ed0 0x7f2bcc0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.890+0000 7f2bd20e4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bcc0b18c0 con 0x7f2bcc0b2230 2021-12-17T18:18:24.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.890+0000 7f2bd20e4700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bcc05fe50 con 0x7f2bcc05fa70 2021-12-17T18:18:24.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.890+0000 7f2bd20e4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bcc147400 con 0x7f2bcc0b0ed0 2021-12-17T18:18:24.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bd18e3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2bcc0b0ed0 0x7f2bcc0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bd08e1700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2bcc0b2230 0x7f2bcc146cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59922/0 (socket says 172.21.15.62:59922) 2021-12-17T18:18:24.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bd08e1700 1 -- 172.21.15.62:0/1483228838 learned_addr learned my addr 172.21.15.62:0/1483228838 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:24.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bbbfff700 1 -- 172.21.15.62:0/1483228838 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192005128 0 0) 0x7f2bcc0b18c0 con 0x7f2bcc0b2230 2021-12-17T18:18:24.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bbbfff700 1 -- 172.21.15.62:0/1483228838 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bb4003260 con 0x7f2bcc0b2230 2021-12-17T18:18:24.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bd18e3700 1 -- 172.21.15.62:0/1483228838 >> v1:172.21.15.109:6789/0 conn(0x7f2bcc05fa70 legacy=0x7f2bcc1465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bd18e3700 1 -- 172.21.15.62:0/1483228838 >> v1:172.21.15.62:6789/0 conn(0x7f2bcc0b2230 legacy=0x7f2bcc146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bd18e3700 1 -- 172.21.15.62:0/1483228838 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bcc0b1af0 con 0x7f2bcc0b0ed0 2021-12-17T18:18:24.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bd18e3700 1 --2- 172.21.15.62:0/1483228838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bcc0b0ed0 0x7f2bcc0aec60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f2bc40032f0 tx=0x7f2bc40091d0).ready entity=mon.0 client_cookie=16e536b4e940c875 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:24.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bbbfff700 1 -- 172.21.15.62:0/1483228838 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bc400b710 con 0x7f2bcc0b0ed0 2021-12-17T18:18:24.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bbbfff700 1 -- 172.21.15.62:0/1483228838 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc400b870 con 0x7f2bcc0b0ed0 2021-12-17T18:18:24.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bbbfff700 1 -- 172.21.15.62:0/1483228838 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bc400b9e0 con 0x7f2bcc0b0ed0 2021-12-17T18:18:24.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bd20e4700 1 -- 172.21.15.62:0/1483228838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bcc0b0ed0 msgr2=0x7f2bcc0aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bd20e4700 1 --2- 172.21.15.62:0/1483228838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bcc0b0ed0 0x7f2bcc0aec60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f2bc40032f0 tx=0x7f2bc40091d0).stop 2021-12-17T18:18:24.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bd20e4700 1 -- 172.21.15.62:0/1483228838 shutdown_connections 2021-12-17T18:18:24.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bd20e4700 1 --2- 172.21.15.62:0/1483228838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bcc0b0ed0 0x7f2bcc0aec60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bd20e4700 1 -- 172.21.15.62:0/1483228838 >> 172.21.15.62:0/1483228838 conn(0x7f2bcc0b6320 msgr2=0x7f2bcc0b6700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:24.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bd20e4700 1 -- 172.21.15.62:0/1483228838 shutdown_connections 2021-12-17T18:18:24.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bd20e4700 1 -- 172.21.15.62:0/1483228838 wait complete. 2021-12-17T18:18:24.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bd20e4700 1 Processor -- start 2021-12-17T18:18:24.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.894+0000 7f2bd20e4700 1 -- start start 2021-12-17T18:18:24.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd20e4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2bcc05fa70 0x7f2bcc152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd20e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bcc0b0ed0 0x7f2bcc065480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd20e4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2bcc0b2230 0x7f2bcc1444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd20e4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc0664d0 con 0x7f2bcc0b0ed0 2021-12-17T18:18:24.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd20e4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc063e60 con 0x7f2bcc0b2230 2021-12-17T18:18:24.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd20e4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc063bc0 con 0x7f2bcc05fa70 2021-12-17T18:18:24.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd08e1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bcc0b0ed0 0x7f2bcc065480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd08e1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bcc0b0ed0 0x7f2bcc065480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48116/0 (socket says 172.21.15.62:48116) 2021-12-17T18:18:24.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd08e1700 1 -- 172.21.15.62:0/1009105846 learned_addr learned my addr 172.21.15.62:0/1009105846 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:24.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd10e2700 1 --2- 172.21.15.62:0/1009105846 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2bcc05fa70 0x7f2bcc152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd18e3700 1 --2- 172.21.15.62:0/1009105846 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2bcc0b2230 0x7f2bcc1444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd08e1700 1 -- 172.21.15.62:0/1009105846 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2bcc05fa70 msgr2=0x7f2bcc152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd08e1700 1 --2- 172.21.15.62:0/1009105846 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2bcc05fa70 0x7f2bcc152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd08e1700 1 -- 172.21.15.62:0/1009105846 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2bcc0b2230 msgr2=0x7f2bcc1444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:24.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd08e1700 1 --2- 172.21.15.62:0/1009105846 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2bcc0b2230 0x7f2bcc1444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:24.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd08e1700 1 -- 172.21.15.62:0/1009105846 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc4009470 con 0x7f2bcc0b0ed0 2021-12-17T18:18:24.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd08e1700 1 --2- 172.21.15.62:0/1009105846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bcc0b0ed0 0x7f2bcc065480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f2bbc001110 tx=0x7f2bbc007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:24.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bba7fc700 1 -- 172.21.15.62:0/1009105846 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bbc00ce20 con 0x7f2bcc0b0ed0 2021-12-17T18:18:24.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bba7fc700 1 -- 172.21.15.62:0/1009105846 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc0072e0 con 0x7f2bcc0b0ed0 2021-12-17T18:18:24.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bba7fc700 1 -- 172.21.15.62:0/1009105846 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bbc005800 con 0x7f2bcc0b0ed0 2021-12-17T18:18:24.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd20e4700 1 -- 172.21.15.62:0/1009105846 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bcc064b10 con 0x7f2bcc0b0ed0 2021-12-17T18:18:24.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.898+0000 7f2bd20e4700 1 -- 172.21.15.62:0/1009105846 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bcc145f10 con 0x7f2bcc0b0ed0 2021-12-17T18:18:24.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.902+0000 7f2bd20e4700 1 -- 172.21.15.62:0/1009105846 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bcc153210 con 0x7f2bcc0b0ed0 2021-12-17T18:18:24.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.902+0000 7f2bba7fc700 1 -- 172.21.15.62:0/1009105846 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2bbc010070 con 0x7f2bcc0b0ed0 2021-12-17T18:18:24.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.902+0000 7f2bba7fc700 1 --2- 172.21.15.62:0/1009105846 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2bac053610 0x7f2bac055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:24.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.902+0000 7f2bba7fc700 1 -- 172.21.15.62:0/1009105846 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2bbc06b180 con 0x7f2bcc0b0ed0 2021-12-17T18:18:24.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.902+0000 7f2bd10e2700 1 --2- 172.21.15.62:0/1009105846 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2bac053610 0x7f2bac055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:24.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.902+0000 7f2bd10e2700 1 --2- 172.21.15.62:0/1009105846 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2bac053610 0x7f2bac055ad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2bc800d000 tx=0x7f2bc8007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:24.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:24.910+0000 7f2bba7fc700 1 -- 172.21.15.62:0/1009105846 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2bbc0421d0 con 0x7f2bcc0b0ed0 2021-12-17T18:18:25.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.030+0000 7f2bd20e4700 1 -- 172.21.15.62:0/1009105846 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2bcc064ca0 con 0x7f2bcc0b0ed0 2021-12-17T18:18:25.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.030+0000 7f2bba7fc700 1 -- 172.21.15.62:0/1009105846 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2bbc0457f0 con 0x7f2bcc0b0ed0 2021-12-17T18:18:25.035 INFO:teuthology.orchestra.run.smithi062.stdout:60129542149 2021-12-17T18:18:25.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.030+0000 7f2bd20e4700 1 -- 172.21.15.62:0/1009105846 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2bac053610 msgr2=0x7f2bac055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:25.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.030+0000 7f2bd20e4700 1 --2- 172.21.15.62:0/1009105846 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2bac053610 0x7f2bac055ad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2bc800d000 tx=0x7f2bc8007b90).stop 2021-12-17T18:18:25.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.030+0000 7f2bd20e4700 1 -- 172.21.15.62:0/1009105846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bcc0b0ed0 msgr2=0x7f2bcc065480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:25.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.030+0000 7f2bd20e4700 1 --2- 172.21.15.62:0/1009105846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bcc0b0ed0 0x7f2bcc065480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f2bbc001110 tx=0x7f2bbc007ad0).stop 2021-12-17T18:18:25.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.030+0000 7f2bd20e4700 1 -- 172.21.15.62:0/1009105846 shutdown_connections 2021-12-17T18:18:25.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.030+0000 7f2bd20e4700 1 --2- 172.21.15.62:0/1009105846 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2bac053610 0x7f2bac055ad0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:25.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.030+0000 7f2bd20e4700 1 --2- 172.21.15.62:0/1009105846 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2bcc0b2230 0x7f2bcc1444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:25.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.030+0000 7f2bd20e4700 1 --2- 172.21.15.62:0/1009105846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bcc0b0ed0 0x7f2bcc065480 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:25.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.030+0000 7f2bd20e4700 1 --2- 172.21.15.62:0/1009105846 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2bcc05fa70 0x7f2bcc152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:25.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.030+0000 7f2bd20e4700 1 -- 172.21.15.62:0/1009105846 >> 172.21.15.62:0/1009105846 conn(0x7f2bcc0b6320 msgr2=0x7f2bcc0af170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:25.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.030+0000 7f2bd20e4700 1 -- 172.21.15.62:0/1009105846 shutdown_connections 2021-12-17T18:18:25.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.030+0000 7f2bd20e4700 1 -- 172.21.15.62:0/1009105846 wait complete. 2021-12-17T18:18:25.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2021-12-17T18:18:25.048 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2021-12-17T18:18:25.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.150+0000 7f17f551d700 1 Processor -- start 2021-12-17T18:18:25.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.150+0000 7f17f551d700 1 -- start start 2021-12-17T18:18:25.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.150+0000 7f17f551d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f17f00b3eb0 0x7f17f0145110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:25.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.150+0000 7f17f551d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17f0067770 0x7f17f00b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:25.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.150+0000 7f17f551d700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f00b27c0 con 0x7f17f00b4780 2021-12-17T18:18:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.150+0000 7f17f551d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f0144730 con 0x7f17f00b3eb0 2021-12-17T18:18:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.150+0000 7f17f551d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f01449d0 con 0x7f17f0067770 2021-12-17T18:18:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.150+0000 7f17eeffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f17f00b3eb0 0x7f17f0145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.150+0000 7f17eeffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f17f00b3eb0 0x7f17f0145110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48122/0 (socket says 172.21.15.62:48122) 2021-12-17T18:18:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.150+0000 7f17eeffd700 1 -- 172.21.15.62:0/2449467811 learned_addr learned my addr 172.21.15.62:0/2449467811 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.150+0000 7f17ee7fc700 1 --2- 172.21.15.62:0/2449467811 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17f0067770 0x7f17f00b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.150+0000 7f17eeffd700 1 -- 172.21.15.62:0/2449467811 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17f0067770 msgr2=0x7f17f00b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:25.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.150+0000 7f17eeffd700 1 --2- 172.21.15.62:0/2449467811 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17f0067770 0x7f17f00b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:25.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.150+0000 7f17eeffd700 1 -- 172.21.15.62:0/2449467811 >> v1:172.21.15.109:6789/0 conn(0x7f17f00b4780 legacy=0x7f17f005f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:25.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.150+0000 7f17eeffd700 1 -- 172.21.15.62:0/2449467811 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f0144c70 con 0x7f17f00b3eb0 2021-12-17T18:18:25.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.150+0000 7f17eeffd700 1 --2- 172.21.15.62:0/2449467811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f00b3eb0 0x7f17f0145110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f17f00b4dc0 tx=0x7f17e0006eb0).ready entity=mon.0 client_cookie=be752a8482a2e85a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:25.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.154+0000 7f17edffb700 1 -- 172.21.15.62:0/2449467811 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17e000d5c0 con 0x7f17f00b3eb0 2021-12-17T18:18:25.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.154+0000 7f17edffb700 1 -- 172.21.15.62:0/2449467811 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e0000e90 con 0x7f17f00b3eb0 2021-12-17T18:18:25.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.154+0000 7f17edffb700 1 -- 172.21.15.62:0/2449467811 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17e000d950 con 0x7f17f00b3eb0 2021-12-17T18:18:25.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.154+0000 7f17f551d700 1 -- 172.21.15.62:0/2449467811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f00b3eb0 msgr2=0x7f17f0145110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:25.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.154+0000 7f17f551d700 1 --2- 172.21.15.62:0/2449467811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f00b3eb0 0x7f17f0145110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f17f00b4dc0 tx=0x7f17e0006eb0).stop 2021-12-17T18:18:25.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.154+0000 7f17f551d700 1 -- 172.21.15.62:0/2449467811 shutdown_connections 2021-12-17T18:18:25.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.154+0000 7f17f551d700 1 --2- 172.21.15.62:0/2449467811 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17f0067770 0x7f17f00b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:25.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.154+0000 7f17f551d700 1 --2- 172.21.15.62:0/2449467811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f00b3eb0 0x7f17f0145110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:25.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.154+0000 7f17f551d700 1 -- 172.21.15.62:0/2449467811 >> 172.21.15.62:0/2449467811 conn(0x7f17f005cb40 msgr2=0x7f17f005cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:25.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.154+0000 7f17f551d700 1 -- 172.21.15.62:0/2449467811 shutdown_connections 2021-12-17T18:18:25.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.154+0000 7f17f551d700 1 -- 172.21.15.62:0/2449467811 wait complete. 2021-12-17T18:18:25.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.154+0000 7f17f551d700 1 Processor -- start 2021-12-17T18:18:25.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.154+0000 7f17f551d700 1 -- start start 2021-12-17T18:18:25.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17f551d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f0067770 0x7f17f0148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:25.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17f551d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17f00b3eb0 0x7f17f00ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:25.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17f551d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17f00b4780 0x7f17f00af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:25.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17f551d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0065140 con 0x7f17f0067770 2021-12-17T18:18:25.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17f551d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00abaa0 con 0x7f17f00b3eb0 2021-12-17T18:18:25.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17f551d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00ace10 con 0x7f17f00b4780 2021-12-17T18:18:25.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17eeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f0067770 0x7f17f0148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:25.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17eeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f0067770 0x7f17f0148560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48128/0 (socket says 172.21.15.62:48128) 2021-12-17T18:18:25.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17eeffd700 1 -- 172.21.15.62:0/4205939590 learned_addr learned my addr 172.21.15.62:0/4205939590 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:25.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17ee7fc700 1 --2- 172.21.15.62:0/4205939590 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17f00b3eb0 0x7f17f00ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:25.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17ef7fe700 1 --2- 172.21.15.62:0/4205939590 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17f00b4780 0x7f17f00af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:25.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17eeffd700 1 -- 172.21.15.62:0/4205939590 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17f00b4780 msgr2=0x7f17f00af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:25.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17eeffd700 1 --2- 172.21.15.62:0/4205939590 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17f00b4780 0x7f17f00af430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:25.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17eeffd700 1 -- 172.21.15.62:0/4205939590 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17f00b3eb0 msgr2=0x7f17f00ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:25.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17eeffd700 1 --2- 172.21.15.62:0/4205939590 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17f00b3eb0 0x7f17f00ad550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:25.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17eeffd700 1 -- 172.21.15.62:0/4205939590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e000b1e0 con 0x7f17f0067770 2021-12-17T18:18:25.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17eeffd700 1 --2- 172.21.15.62:0/4205939590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f0067770 0x7f17f0148560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f17f00b4dc0 tx=0x7f17e0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:25.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17e7fff700 1 -- 172.21.15.62:0/4205939590 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17e0011860 con 0x7f17f0067770 2021-12-17T18:18:25.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17e7fff700 1 -- 172.21.15.62:0/4205939590 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e00119c0 con 0x7f17f0067770 2021-12-17T18:18:25.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17e7fff700 1 -- 172.21.15.62:0/4205939590 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17e0011d20 con 0x7f17f0067770 2021-12-17T18:18:25.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17f551d700 1 -- 172.21.15.62:0/4205939590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f00ad0b0 con 0x7f17f0067770 2021-12-17T18:18:25.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17f551d700 1 -- 172.21.15.62:0/4205939590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f00ab720 con 0x7f17f0067770 2021-12-17T18:18:25.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.158+0000 7f17e7fff700 1 -- 172.21.15.62:0/4205939590 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f17e0025030 con 0x7f17f0067770 2021-12-17T18:18:25.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.162+0000 7f17e7fff700 1 --2- 172.21.15.62:0/4205939590 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f17d40536d0 0x7f17d4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:25.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.162+0000 7f17e7fff700 1 -- 172.21.15.62:0/4205939590 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f17e006cb60 con 0x7f17f0067770 2021-12-17T18:18:25.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.162+0000 7f17f551d700 1 -- 172.21.15.62:0/4205939590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f00573d0 con 0x7f17f0067770 2021-12-17T18:18:25.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.162+0000 7f17ee7fc700 1 --2- 172.21.15.62:0/4205939590 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f17d40536d0 0x7f17d4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:25.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.162+0000 7f17ee7fc700 1 --2- 172.21.15.62:0/4205939590 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f17d40536d0 0x7f17d4055b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f17d800c000 tx=0x7f17d8008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:25.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.166+0000 7f17e7fff700 1 -- 172.21.15.62:0/4205939590 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f17e0023020 con 0x7f17f0067770 2021-12-17T18:18:25.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.290+0000 7f17f551d700 1 -- 172.21.15.62:0/4205939590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f17f00aac70 con 0x7f17f0067770 2021-12-17T18:18:25.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.290+0000 7f17e7fff700 1 -- 172.21.15.62:0/4205939590 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17e0043c20 con 0x7f17f0067770 2021-12-17T18:18:25.296 INFO:teuthology.orchestra.run.smithi062.stdout:60129542147 2021-12-17T18:18:25.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.294+0000 7f17f551d700 1 -- 172.21.15.62:0/4205939590 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f17d40536d0 msgr2=0x7f17d4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:25.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.294+0000 7f17f551d700 1 --2- 172.21.15.62:0/4205939590 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f17d40536d0 0x7f17d4055b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f17d800c000 tx=0x7f17d8008040).stop 2021-12-17T18:18:25.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.294+0000 7f17f551d700 1 -- 172.21.15.62:0/4205939590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f0067770 msgr2=0x7f17f0148560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:25.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.294+0000 7f17f551d700 1 --2- 172.21.15.62:0/4205939590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f0067770 0x7f17f0148560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f17f00b4dc0 tx=0x7f17e0015000).stop 2021-12-17T18:18:25.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.294+0000 7f17f551d700 1 -- 172.21.15.62:0/4205939590 shutdown_connections 2021-12-17T18:18:25.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.294+0000 7f17f551d700 1 --2- 172.21.15.62:0/4205939590 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f17d40536d0 0x7f17d4055b90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:25.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.294+0000 7f17f551d700 1 --2- 172.21.15.62:0/4205939590 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17f00b4780 0x7f17f00af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:25.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.294+0000 7f17f551d700 1 --2- 172.21.15.62:0/4205939590 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17f00b3eb0 0x7f17f00ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:25.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.294+0000 7f17f551d700 1 --2- 172.21.15.62:0/4205939590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f0067770 0x7f17f0148560 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:25.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.294+0000 7f17f551d700 1 -- 172.21.15.62:0/4205939590 >> 172.21.15.62:0/4205939590 conn(0x7f17f005cb40 msgr2=0x7f17f00b2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:25.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.294+0000 7f17f551d700 1 -- 172.21.15.62:0/4205939590 shutdown_connections 2021-12-17T18:18:25.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:25.294+0000 7f17f551d700 1 -- 172.21.15.62:0/4205939590 wait complete. 2021-12-17T18:18:25.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.3 2021-12-17T18:18:26.315 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2021-12-17T18:18:26.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.421+0000 7f3a1b81b700 1 Processor -- start 2021-12-17T18:18:26.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.421+0000 7f3a1b81b700 1 -- start start 2021-12-17T18:18:26.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a1b81b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3a1405ffe0 0x7f3a140679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a1b81b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a140b2e90 con 0x7f3a140ad360 2021-12-17T18:18:26.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a1b81b700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a140b4b70 con 0x7f3a140b57e0 2021-12-17T18:18:26.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a1b81b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140b4e10 con 0x7f3a1405ffe0 2021-12-17T18:18:26.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a18db6700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3a140ad360 0x7f3a140b32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59948/0 (socket says 172.21.15.62:59948) 2021-12-17T18:18:26.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a18db6700 1 -- 172.21.15.62:0/2532589701 learned_addr learned my addr 172.21.15.62:0/2532589701 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:26.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a195b7700 1 --2- 172.21.15.62:0/2532589701 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3a1405ffe0 0x7f3a140679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a07fff700 1 -- 172.21.15.62:0/2532589701 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727374672 0 0) 0x7f3a140b2e90 con 0x7f3a140ad360 2021-12-17T18:18:26.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a07fff700 1 -- 172.21.15.62:0/2532589701 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39f8003260 con 0x7f3a140ad360 2021-12-17T18:18:26.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a07fff700 1 -- 172.21.15.62:0/2532589701 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761422112 0 0) 0x7f3a140b4b70 con 0x7f3a140b57e0 2021-12-17T18:18:26.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a07fff700 1 -- 172.21.15.62:0/2532589701 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a140b2e90 con 0x7f3a140b57e0 2021-12-17T18:18:26.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a195b7700 1 -- 172.21.15.62:0/2532589701 >> v1:172.21.15.109:6789/0 conn(0x7f3a140b57e0 legacy=0x7f3a141438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a195b7700 1 -- 172.21.15.62:0/2532589701 >> v1:172.21.15.62:6789/0 conn(0x7f3a140ad360 legacy=0x7f3a140b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a195b7700 1 -- 172.21.15.62:0/2532589701 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a140b52b0 con 0x7f3a1405ffe0 2021-12-17T18:18:26.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a195b7700 1 --2- 172.21.15.62:0/2532589701 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3a1405ffe0 0x7f3a140679c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f3a10002f70 tx=0x7f3a10006df0).ready entity=mon.2 client_cookie=9e9d06ba33d7cfa7 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:26.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a07fff700 1 -- 172.21.15.62:0/2532589701 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1000d5c0 con 0x7f3a1405ffe0 2021-12-17T18:18:26.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a07fff700 1 -- 172.21.15.62:0/2532589701 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a10000e90 con 0x7f3a1405ffe0 2021-12-17T18:18:26.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a07fff700 1 -- 172.21.15.62:0/2532589701 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1000d910 con 0x7f3a1405ffe0 2021-12-17T18:18:26.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a1b81b700 1 -- 172.21.15.62:0/2532589701 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3a1405ffe0 msgr2=0x7f3a140679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.425+0000 7f3a1b81b700 1 --2- 172.21.15.62:0/2532589701 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3a1405ffe0 0x7f3a140679c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f3a10002f70 tx=0x7f3a10006df0).stop 2021-12-17T18:18:26.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.429+0000 7f3a1b81b700 1 -- 172.21.15.62:0/2532589701 shutdown_connections 2021-12-17T18:18:26.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.429+0000 7f3a1b81b700 1 --2- 172.21.15.62:0/2532589701 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3a1405ffe0 0x7f3a140679c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.429+0000 7f3a1b81b700 1 -- 172.21.15.62:0/2532589701 >> 172.21.15.62:0/2532589701 conn(0x7f3a140626d0 msgr2=0x7f3a1405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:26.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.429+0000 7f3a1b81b700 1 -- 172.21.15.62:0/2532589701 shutdown_connections 2021-12-17T18:18:26.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.429+0000 7f3a1b81b700 1 -- 172.21.15.62:0/2532589701 wait complete. 2021-12-17T18:18:26.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.429+0000 7f3a1b81b700 1 Processor -- start 2021-12-17T18:18:26.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.429+0000 7f3a1b81b700 1 -- start start 2021-12-17T18:18:26.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a1b81b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a1405ffe0 0x7f3a14064a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a1b81b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3a140ad360 0x7f3a14065150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a1b81b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3a140b57e0 0x7f3a140ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a1b81b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14063210 con 0x7f3a1405ffe0 2021-12-17T18:18:26.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a1b81b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140634b0 con 0x7f3a140b57e0 2021-12-17T18:18:26.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a1b81b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14063750 con 0x7f3a140ad360 2021-12-17T18:18:26.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a195b7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a1405ffe0 0x7f3a14064a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a195b7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a1405ffe0 0x7f3a14064a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48142/0 (socket says 172.21.15.62:48142) 2021-12-17T18:18:26.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a195b7700 1 -- 172.21.15.62:0/1833265015 learned_addr learned my addr 172.21.15.62:0/1833265015 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:26.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a18db6700 1 --2- 172.21.15.62:0/1833265015 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3a140ad360 0x7f3a14065150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a19db8700 1 --2- 172.21.15.62:0/1833265015 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3a140b57e0 0x7f3a140ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a195b7700 1 -- 172.21.15.62:0/1833265015 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3a140ad360 msgr2=0x7f3a14065150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a195b7700 1 --2- 172.21.15.62:0/1833265015 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3a140ad360 0x7f3a14065150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a195b7700 1 -- 172.21.15.62:0/1833265015 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3a140b57e0 msgr2=0x7f3a140ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a195b7700 1 --2- 172.21.15.62:0/1833265015 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3a140b57e0 0x7f3a140ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a195b7700 1 -- 172.21.15.62:0/1833265015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1000b180 con 0x7f3a1405ffe0 2021-12-17T18:18:26.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a195b7700 1 --2- 172.21.15.62:0/1833265015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a1405ffe0 0x7f3a14064a30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f3a10002f70 tx=0x7f3a10014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:26.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a067fc700 1 -- 172.21.15.62:0/1833265015 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a10013de0 con 0x7f3a1405ffe0 2021-12-17T18:18:26.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a067fc700 1 -- 172.21.15.62:0/1833265015 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1001e400 con 0x7f3a1405ffe0 2021-12-17T18:18:26.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a1b81b700 1 -- 172.21.15.62:0/1833265015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a14063bf0 con 0x7f3a1405ffe0 2021-12-17T18:18:26.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a067fc700 1 -- 172.21.15.62:0/1833265015 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1001e760 con 0x7f3a1405ffe0 2021-12-17T18:18:26.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a1b81b700 1 -- 172.21.15.62:0/1833265015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a140a2de0 con 0x7f3a1405ffe0 2021-12-17T18:18:26.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.433+0000 7f3a1b81b700 1 -- 172.21.15.62:0/1833265015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a14065860 con 0x7f3a1405ffe0 2021-12-17T18:18:26.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.437+0000 7f3a067fc700 1 -- 172.21.15.62:0/1833265015 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3a10025030 con 0x7f3a1405ffe0 2021-12-17T18:18:26.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.437+0000 7f3a067fc700 1 --2- 172.21.15.62:0/1833265015 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f39fc053610 0x7f39fc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.437+0000 7f3a067fc700 1 -- 172.21.15.62:0/1833265015 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3a1006c570 con 0x7f3a1405ffe0 2021-12-17T18:18:26.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.437+0000 7f3a18db6700 1 --2- 172.21.15.62:0/1833265015 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f39fc053610 0x7f39fc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.437+0000 7f3a18db6700 1 --2- 172.21.15.62:0/1833265015 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f39fc053610 0x7f39fc055ad0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3a0800d000 tx=0x7f3a08009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:26.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.441+0000 7f3a067fc700 1 -- 172.21.15.62:0/1833265015 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3a100436d0 con 0x7f3a1405ffe0 2021-12-17T18:18:26.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.569+0000 7f3a1b81b700 1 -- 172.21.15.62:0/1833265015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3a140573d0 con 0x7f3a1405ffe0 2021-12-17T18:18:26.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.569+0000 7f3a067fc700 1 -- 172.21.15.62:0/1833265015 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a10023020 con 0x7f3a1405ffe0 2021-12-17T18:18:26.575 INFO:teuthology.orchestra.run.smithi062.stdout:60129542148 2021-12-17T18:18:26.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.569+0000 7f3a1b81b700 1 -- 172.21.15.62:0/1833265015 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f39fc053610 msgr2=0x7f39fc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.569+0000 7f3a1b81b700 1 --2- 172.21.15.62:0/1833265015 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f39fc053610 0x7f39fc055ad0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3a0800d000 tx=0x7f3a08009040).stop 2021-12-17T18:18:26.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.569+0000 7f3a1b81b700 1 -- 172.21.15.62:0/1833265015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a1405ffe0 msgr2=0x7f3a14064a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.569+0000 7f3a1b81b700 1 --2- 172.21.15.62:0/1833265015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a1405ffe0 0x7f3a14064a30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f3a10002f70 tx=0x7f3a10014000).stop 2021-12-17T18:18:26.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.569+0000 7f3a1b81b700 1 -- 172.21.15.62:0/1833265015 shutdown_connections 2021-12-17T18:18:26.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.569+0000 7f3a1b81b700 1 --2- 172.21.15.62:0/1833265015 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f39fc053610 0x7f39fc055ad0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.569+0000 7f3a1b81b700 1 --2- 172.21.15.62:0/1833265015 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3a140b57e0 0x7f3a140ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.569+0000 7f3a1b81b700 1 --2- 172.21.15.62:0/1833265015 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3a140ad360 0x7f3a14065150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.569+0000 7f3a1b81b700 1 --2- 172.21.15.62:0/1833265015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a1405ffe0 0x7f3a14064a30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.569+0000 7f3a1b81b700 1 -- 172.21.15.62:0/1833265015 >> 172.21.15.62:0/1833265015 conn(0x7f3a140626d0 msgr2=0x7f3a140b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:26.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.569+0000 7f3a1b81b700 1 -- 172.21.15.62:0/1833265015 shutdown_connections 2021-12-17T18:18:26.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.569+0000 7f3a1b81b700 1 -- 172.21.15.62:0/1833265015 wait complete. 2021-12-17T18:18:26.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.3 2021-12-17T18:18:26.588 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2021-12-17T18:18:26.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f31018e2700 1 Processor -- start 2021-12-17T18:18:26.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f31018e2700 1 -- start start 2021-12-17T18:18:26.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f31018e2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30fc0b20f0 0x7f30fc144580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f31018e2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30fc0ad7a0 con 0x7f30fc0afba0 2021-12-17T18:18:26.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f31018e2700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30fc148430 con 0x7f30fc0b1d10 2021-12-17T18:18:26.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f31018e2700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc0ac420 con 0x7f30fc0b20f0 2021-12-17T18:18:26.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f3fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f30fc0afba0 0x7f30fc14a7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59964/0 (socket says 172.21.15.62:59964) 2021-12-17T18:18:26.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f3fff700 1 -- 172.21.15.62:0/952904955 learned_addr learned my addr 172.21.15.62:0/952904955 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:26.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f31010e1700 1 --2- 172.21.15.62:0/952904955 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30fc0b20f0 0x7f30fc144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 -- 172.21.15.62:0/952904955 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750513307 0 0) 0x7f30fc0ad7a0 con 0x7f30fc0afba0 2021-12-17T18:18:26.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 -- 172.21.15.62:0/952904955 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30e8003260 con 0x7f30fc0afba0 2021-12-17T18:18:26.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 -- 172.21.15.62:0/952904955 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744734686 0 0) 0x7f30fc148430 con 0x7f30fc0b1d10 2021-12-17T18:18:26.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 -- 172.21.15.62:0/952904955 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30fc0ad7a0 con 0x7f30fc0b1d10 2021-12-17T18:18:26.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 -- 172.21.15.62:0/952904955 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1045503720 0 0) 0x7f30e8003260 con 0x7f30fc0afba0 2021-12-17T18:18:26.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 -- 172.21.15.62:0/952904955 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30fc0b20f0 msgr2=0x7f30fc144580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:26.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 --2- 172.21.15.62:0/952904955 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30fc0b20f0 0x7f30fc144580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 -- 172.21.15.62:0/952904955 >> v1:172.21.15.109:6789/0 conn(0x7f30fc0b1d10 legacy=0x7f30fc147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 -- 172.21.15.62:0/952904955 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc1473c0 con 0x7f30fc0afba0 2021-12-17T18:18:26.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 -- 172.21.15.62:0/952904955 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f30ec001660 con 0x7f30fc0afba0 2021-12-17T18:18:26.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 -- 172.21.15.62:0/952904955 >> v1:172.21.15.62:6789/0 conn(0x7f30fc0afba0 legacy=0x7f30fc14a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 --2- 172.21.15.62:0/952904955 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30fc0b20f0 0x7f30e8003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 --2- 172.21.15.62:0/952904955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30e8003e20 0x7f30e8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 --2- 172.21.15.62:0/952904955 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30e80049f0 0x7f30e8004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 -- 172.21.15.62:0/952904955 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e800b800 con 0x7f30e8003e20 2021-12-17T18:18:26.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 -- 172.21.15.62:0/952904955 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e800b940 con 0x7f30e80049f0 2021-12-17T18:18:26.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 -- 172.21.15.62:0/952904955 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e800bb00 con 0x7f30fc0b20f0 2021-12-17T18:18:26.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f3fff700 1 --2- 172.21.15.62:0/952904955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30e8003e20 0x7f30e8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f31008e0700 1 --2- 172.21.15.62:0/952904955 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30fc0b20f0 0x7f30e8003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f31010e1700 1 --2- 172.21.15.62:0/952904955 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30e80049f0 0x7f30e8004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f3fff700 1 -- 172.21.15.62:0/952904955 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30fc0b20f0 msgr2=0x7f30e8003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:26.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f3fff700 1 --2- 172.21.15.62:0/952904955 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30fc0b20f0 0x7f30e8003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f3fff700 1 -- 172.21.15.62:0/952904955 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30e80049f0 msgr2=0x7f30e8004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:26.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f3fff700 1 --2- 172.21.15.62:0/952904955 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30e80049f0 0x7f30e8004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f3fff700 1 -- 172.21.15.62:0/952904955 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e8003260 con 0x7f30e8003e20 2021-12-17T18:18:26.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f3fff700 1 --2- 172.21.15.62:0/952904955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30e8003e20 0x7f30e8004500 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f30ec001430 tx=0x7f30ec001dd0).ready entity=mon.0 client_cookie=cea5e0221da79449 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:26.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 -- 172.21.15.62:0/952904955 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30ec0070d0 con 0x7f30e8003e20 2021-12-17T18:18:26.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 -- 172.21.15.62:0/952904955 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ec007230 con 0x7f30e8003e20 2021-12-17T18:18:26.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.689+0000 7f30f37fe700 1 -- 172.21.15.62:0/952904955 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30ec00c8f0 con 0x7f30e8003e20 2021-12-17T18:18:26.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31018e2700 1 -- 172.21.15.62:0/952904955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30e8003e20 msgr2=0x7f30e8004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31018e2700 1 --2- 172.21.15.62:0/952904955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30e8003e20 0x7f30e8004500 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f30ec001430 tx=0x7f30ec001dd0).stop 2021-12-17T18:18:26.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31010e1700 1 -- 172.21.15.62:0/952904955 reap_dead start 2021-12-17T18:18:26.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31018e2700 1 -- 172.21.15.62:0/952904955 shutdown_connections 2021-12-17T18:18:26.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31018e2700 1 -- 172.21.15.62:0/952904955 >> 172.21.15.62:0/952904955 conn(0x7f30fc0623c0 msgr2=0x7f30fc0627d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:26.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31018e2700 1 -- 172.21.15.62:0/952904955 shutdown_connections 2021-12-17T18:18:26.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31018e2700 1 -- 172.21.15.62:0/952904955 wait complete. 2021-12-17T18:18:26.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31018e2700 1 Processor -- start 2021-12-17T18:18:26.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31018e2700 1 -- start start 2021-12-17T18:18:26.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31018e2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30fc1457a0 0x7f30fc0652a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31018e2700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30fc14a660 0x7f30fc156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31018e2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30fc156930 0x7f30fc066840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31018e2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc14ac50 con 0x7f30fc1457a0 2021-12-17T18:18:26.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31018e2700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc0648c0 con 0x7f30fc14a660 2021-12-17T18:18:26.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31018e2700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc064b60 con 0x7f30fc156930 2021-12-17T18:18:26.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31008e0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30fc1457a0 0x7f30fc0652a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31008e0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30fc1457a0 0x7f30fc0652a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48162/0 (socket says 172.21.15.62:48162) 2021-12-17T18:18:26.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31008e0700 1 -- 172.21.15.62:0/3792439016 learned_addr learned my addr 172.21.15.62:0/3792439016 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:26.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f30f3fff700 1 --2- 172.21.15.62:0/3792439016 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30fc14a660 0x7f30fc156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31010e1700 1 --2- 172.21.15.62:0/3792439016 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30fc156930 0x7f30fc066840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31008e0700 1 -- 172.21.15.62:0/3792439016 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30fc156930 msgr2=0x7f30fc066840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31008e0700 1 --2- 172.21.15.62:0/3792439016 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30fc156930 0x7f30fc066840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31008e0700 1 -- 172.21.15.62:0/3792439016 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30fc14a660 msgr2=0x7f30fc156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31008e0700 1 --2- 172.21.15.62:0/3792439016 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30fc14a660 0x7f30fc156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31008e0700 1 -- 172.21.15.62:0/3792439016 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc064e00 con 0x7f30fc1457a0 2021-12-17T18:18:26.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31008e0700 1 --2- 172.21.15.62:0/3792439016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30fc1457a0 0x7f30fc0652a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f30f800d000 tx=0x7f30f80079e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:26.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f30f1ffb700 1 -- 172.21.15.62:0/3792439016 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f8012750 con 0x7f30fc1457a0 2021-12-17T18:18:26.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f30f1ffb700 1 -- 172.21.15.62:0/3792439016 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f80128b0 con 0x7f30fc1457a0 2021-12-17T18:18:26.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31018e2700 1 -- 172.21.15.62:0/3792439016 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30fc146540 con 0x7f30fc1457a0 2021-12-17T18:18:26.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f30f1ffb700 1 -- 172.21.15.62:0/3792439016 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f8012c10 con 0x7f30fc1457a0 2021-12-17T18:18:26.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.693+0000 7f31018e2700 1 -- 172.21.15.62:0/3792439016 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30fc156de0 con 0x7f30fc1457a0 2021-12-17T18:18:26.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.697+0000 7f31018e2700 1 -- 172.21.15.62:0/3792439016 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30fc064f90 con 0x7f30fc1457a0 2021-12-17T18:18:26.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.697+0000 7f30f1ffb700 1 -- 172.21.15.62:0/3792439016 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f30f8012d70 con 0x7f30fc1457a0 2021-12-17T18:18:26.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.697+0000 7f30f1ffb700 1 --2- 172.21.15.62:0/3792439016 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f30dc0534f0 0x7f30dc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.697+0000 7f30f1ffb700 1 -- 172.21.15.62:0/3792439016 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f30f806bd70 con 0x7f30fc1457a0 2021-12-17T18:18:26.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.697+0000 7f30f3fff700 1 --2- 172.21.15.62:0/3792439016 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f30dc0534f0 0x7f30dc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.697+0000 7f30f3fff700 1 --2- 172.21.15.62:0/3792439016 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f30dc0534f0 0x7f30dc0559b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f30ec019000 tx=0x7f30ec015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:26.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.701+0000 7f30f1ffb700 1 -- 172.21.15.62:0/3792439016 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f30f8042dc0 con 0x7f30fc1457a0 2021-12-17T18:18:26.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.825+0000 7f31018e2700 1 -- 172.21.15.62:0/3792439016 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f30fc147660 con 0x7f30fc1457a0 2021-12-17T18:18:26.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.829+0000 7f30f1ffb700 1 -- 172.21.15.62:0/3792439016 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f30f80463e0 con 0x7f30fc1457a0 2021-12-17T18:18:26.834 INFO:teuthology.orchestra.run.smithi062.stdout:60129542148 2021-12-17T18:18:26.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.829+0000 7f31018e2700 1 -- 172.21.15.62:0/3792439016 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f30dc0534f0 msgr2=0x7f30dc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.829+0000 7f31018e2700 1 --2- 172.21.15.62:0/3792439016 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f30dc0534f0 0x7f30dc0559b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f30ec019000 tx=0x7f30ec015000).stop 2021-12-17T18:18:26.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.829+0000 7f31018e2700 1 -- 172.21.15.62:0/3792439016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30fc1457a0 msgr2=0x7f30fc0652a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.829+0000 7f31018e2700 1 --2- 172.21.15.62:0/3792439016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30fc1457a0 0x7f30fc0652a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f30f800d000 tx=0x7f30f80079e0).stop 2021-12-17T18:18:26.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.829+0000 7f31018e2700 1 -- 172.21.15.62:0/3792439016 shutdown_connections 2021-12-17T18:18:26.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.829+0000 7f31018e2700 1 --2- 172.21.15.62:0/3792439016 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f30dc0534f0 0x7f30dc0559b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.829+0000 7f31018e2700 1 --2- 172.21.15.62:0/3792439016 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30fc156930 0x7f30fc066840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.829+0000 7f31018e2700 1 --2- 172.21.15.62:0/3792439016 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30fc14a660 0x7f30fc156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.833+0000 7f31018e2700 1 --2- 172.21.15.62:0/3792439016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30fc1457a0 0x7f30fc0652a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.833+0000 7f31018e2700 1 -- 172.21.15.62:0/3792439016 >> 172.21.15.62:0/3792439016 conn(0x7f30fc0623c0 msgr2=0x7f30fc14c000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:26.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.833+0000 7f31018e2700 1 -- 172.21.15.62:0/3792439016 shutdown_connections 2021-12-17T18:18:26.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.833+0000 7f31018e2700 1 -- 172.21.15.62:0/3792439016 wait complete. 2021-12-17T18:18:26.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.4 2021-12-17T18:18:26.853 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2021-12-17T18:18:26.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.953+0000 7f33fba75700 1 Processor -- start 2021-12-17T18:18:26.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.953+0000 7f33fba75700 1 -- start start 2021-12-17T18:18:26.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33fba75700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f33f405ffe0 0x7f33f40679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33fba75700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f33f40ad360 0x7f33f40b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33fba75700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f40b2e90 con 0x7f33f40b57e0 2021-12-17T18:18:26.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33fba75700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f40b4b70 con 0x7f33f405ffe0 2021-12-17T18:18:26.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33fba75700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40b4e10 con 0x7f33f40ad360 2021-12-17T18:18:26.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33f9811700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f33f405ffe0 0x7f33f40679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33f9811700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f33f405ffe0 0x7f33f40679c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48170/0 (socket says 172.21.15.62:48170) 2021-12-17T18:18:26.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33f9811700 1 -- 172.21.15.62:0/2493999751 learned_addr learned my addr 172.21.15.62:0/2493999751 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:26.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33f9010700 1 --2- 172.21.15.62:0/2493999751 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f33f40ad360 0x7f33f40b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33f9811700 1 -- 172.21.15.62:0/2493999751 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f33f40ad360 msgr2=0x7f33f40b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:26.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33f9811700 1 --2- 172.21.15.62:0/2493999751 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f33f40ad360 0x7f33f40b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33f9811700 1 -- 172.21.15.62:0/2493999751 >> v1:172.21.15.109:6789/0 conn(0x7f33f40b57e0 legacy=0x7f33f40b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33f880f700 1 -- 172.21.15.62:0/2493999751 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895851737 0 0) 0x7f33f40b2e90 con 0x7f33f40b57e0 2021-12-17T18:18:26.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33f9811700 1 -- 172.21.15.62:0/2493999751 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f40b52b0 con 0x7f33f405ffe0 2021-12-17T18:18:26.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33f9811700 1 --2- 172.21.15.62:0/2493999751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f405ffe0 0x7f33f40679c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f33f0002f70 tx=0x7f33f0006eb0).ready entity=mon.0 client_cookie=14be3ee7d92f3dfe server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:26.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33f880f700 1 -- 172.21.15.62:0/2493999751 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33f000d570 con 0x7f33f405ffe0 2021-12-17T18:18:26.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33f880f700 1 -- 172.21.15.62:0/2493999751 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f0000e90 con 0x7f33f405ffe0 2021-12-17T18:18:26.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33f880f700 1 -- 172.21.15.62:0/2493999751 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33f000d8c0 con 0x7f33f405ffe0 2021-12-17T18:18:26.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33fba75700 1 -- 172.21.15.62:0/2493999751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f405ffe0 msgr2=0x7f33f40679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33fba75700 1 --2- 172.21.15.62:0/2493999751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f405ffe0 0x7f33f40679c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f33f0002f70 tx=0x7f33f0006eb0).stop 2021-12-17T18:18:26.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33fba75700 1 -- 172.21.15.62:0/2493999751 shutdown_connections 2021-12-17T18:18:26.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33fba75700 1 --2- 172.21.15.62:0/2493999751 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f33f40ad360 0x7f33f40b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33fba75700 1 --2- 172.21.15.62:0/2493999751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f405ffe0 0x7f33f40679c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33fba75700 1 -- 172.21.15.62:0/2493999751 >> 172.21.15.62:0/2493999751 conn(0x7f33f40626d0 msgr2=0x7f33f405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:26.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33fba75700 1 -- 172.21.15.62:0/2493999751 shutdown_connections 2021-12-17T18:18:26.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.957+0000 7f33fba75700 1 -- 172.21.15.62:0/2493999751 wait complete. 2021-12-17T18:18:26.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.961+0000 7f33fba75700 1 Processor -- start 2021-12-17T18:18:26.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.961+0000 7f33fba75700 1 -- start start 2021-12-17T18:18:26.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.961+0000 7f33fba75700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f405ffe0 0x7f33f40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.961+0000 7f33fba75700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f33f40ad360 0x7f33f40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.961+0000 7f33fba75700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33f40b57e0 0x7f33f4066f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.961+0000 7f33fba75700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f4063050 con 0x7f33f405ffe0 2021-12-17T18:18:26.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.961+0000 7f33fba75700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40632f0 con 0x7f33f40b57e0 2021-12-17T18:18:26.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.961+0000 7f33fba75700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f4063590 con 0x7f33f40ad360 2021-12-17T18:18:26.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.961+0000 7f33f9811700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f405ffe0 0x7f33f40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.965+0000 7f33f9811700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f405ffe0 0x7f33f40b78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48176/0 (socket says 172.21.15.62:48176) 2021-12-17T18:18:26.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.965+0000 7f33f9811700 1 -- 172.21.15.62:0/4074800829 learned_addr learned my addr 172.21.15.62:0/4074800829 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:26.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.965+0000 7f33f9010700 1 --2- 172.21.15.62:0/4074800829 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f33f40ad360 0x7f33f40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.965+0000 7f33fa012700 1 --2- 172.21.15.62:0/4074800829 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33f40b57e0 0x7f33f4066f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.965+0000 7f33f9811700 1 -- 172.21.15.62:0/4074800829 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f33f40ad360 msgr2=0x7f33f40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.965+0000 7f33f9811700 1 --2- 172.21.15.62:0/4074800829 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f33f40ad360 0x7f33f40aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.965+0000 7f33f9811700 1 -- 172.21.15.62:0/4074800829 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33f40b57e0 msgr2=0x7f33f4066f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:26.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.965+0000 7f33f9811700 1 --2- 172.21.15.62:0/4074800829 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33f40b57e0 0x7f33f4066f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:26.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.965+0000 7f33f9811700 1 -- 172.21.15.62:0/4074800829 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f000b1e0 con 0x7f33f405ffe0 2021-12-17T18:18:26.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.965+0000 7f33f9811700 1 --2- 172.21.15.62:0/4074800829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f405ffe0 0x7f33f40b78b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f33f0002f70 tx=0x7f33f0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:26.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.965+0000 7f33e6ffd700 1 -- 172.21.15.62:0/4074800829 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33f0011760 con 0x7f33f405ffe0 2021-12-17T18:18:26.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.965+0000 7f33e6ffd700 1 -- 172.21.15.62:0/4074800829 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f00118c0 con 0x7f33f405ffe0 2021-12-17T18:18:26.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.965+0000 7f33fba75700 1 -- 172.21.15.62:0/4074800829 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f4153940 con 0x7f33f405ffe0 2021-12-17T18:18:26.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.965+0000 7f33e6ffd700 1 -- 172.21.15.62:0/4074800829 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33f0011c20 con 0x7f33f405ffe0 2021-12-17T18:18:26.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.965+0000 7f33fba75700 1 -- 172.21.15.62:0/4074800829 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f40af250 con 0x7f33f405ffe0 2021-12-17T18:18:26.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.965+0000 7f33fba75700 1 -- 172.21.15.62:0/4074800829 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f4063750 con 0x7f33f405ffe0 2021-12-17T18:18:26.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.965+0000 7f33e6ffd700 1 -- 172.21.15.62:0/4074800829 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f33f0025030 con 0x7f33f405ffe0 2021-12-17T18:18:26.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.969+0000 7f33e6ffd700 1 --2- 172.21.15.62:0/4074800829 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f33d40536a0 0x7f33d4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:26.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.969+0000 7f33e6ffd700 1 -- 172.21.15.62:0/4074800829 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f33f006c920 con 0x7f33f405ffe0 2021-12-17T18:18:26.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.969+0000 7f33f9010700 1 --2- 172.21.15.62:0/4074800829 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f33d40536a0 0x7f33d4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:26.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.969+0000 7f33f9010700 1 --2- 172.21.15.62:0/4074800829 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f33d40536a0 0x7f33d4055b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f33e800b000 tx=0x7f33e80091d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:26.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:26.973+0000 7f33e6ffd700 1 -- 172.21.15.62:0/4074800829 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f33f0043a80 con 0x7f33f405ffe0 2021-12-17T18:18:27.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.101+0000 7f33fba75700 1 -- 172.21.15.62:0/4074800829 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f33f40573d0 con 0x7f33f405ffe0 2021-12-17T18:18:27.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.101+0000 7f33e6ffd700 1 -- 172.21.15.62:0/4074800829 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f33f0023090 con 0x7f33f405ffe0 2021-12-17T18:18:27.107 INFO:teuthology.orchestra.run.smithi062.stdout:60129542149 2021-12-17T18:18:27.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.101+0000 7f33fba75700 1 -- 172.21.15.62:0/4074800829 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f33d40536a0 msgr2=0x7f33d4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.101+0000 7f33fba75700 1 --2- 172.21.15.62:0/4074800829 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f33d40536a0 0x7f33d4055b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f33e800b000 tx=0x7f33e80091d0).stop 2021-12-17T18:18:27.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.101+0000 7f33fba75700 1 -- 172.21.15.62:0/4074800829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f405ffe0 msgr2=0x7f33f40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.101+0000 7f33fba75700 1 --2- 172.21.15.62:0/4074800829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f405ffe0 0x7f33f40b78b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f33f0002f70 tx=0x7f33f0015000).stop 2021-12-17T18:18:27.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.101+0000 7f33fba75700 1 -- 172.21.15.62:0/4074800829 shutdown_connections 2021-12-17T18:18:27.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.101+0000 7f33fba75700 1 --2- 172.21.15.62:0/4074800829 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f33d40536a0 0x7f33d4055b60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.101+0000 7f33fba75700 1 --2- 172.21.15.62:0/4074800829 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33f40b57e0 0x7f33f4066f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.101+0000 7f33fba75700 1 --2- 172.21.15.62:0/4074800829 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f33f40ad360 0x7f33f40aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.101+0000 7f33fba75700 1 --2- 172.21.15.62:0/4074800829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f405ffe0 0x7f33f40b78b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.101+0000 7f33fba75700 1 -- 172.21.15.62:0/4074800829 >> 172.21.15.62:0/4074800829 conn(0x7f33f40626d0 msgr2=0x7f33f4143ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:27.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.105+0000 7f33fba75700 1 -- 172.21.15.62:0/4074800829 shutdown_connections 2021-12-17T18:18:27.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.105+0000 7f33fba75700 1 -- 172.21.15.62:0/4074800829 wait complete. 2021-12-17T18:18:27.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2021-12-17T18:18:27.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2021-12-17T18:18:27.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.217+0000 7f5f792dd700 1 Processor -- start 2021-12-17T18:18:27.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.217+0000 7f5f792dd700 1 -- start start 2021-12-17T18:18:27.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.221+0000 7f5f792dd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5f74064500 0x7f5f740648e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:27.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.221+0000 7f5f792dd700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5f7412bdb0 0x7f5f7412c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:27.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.221+0000 7f5f792dd700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f74064dd0 con 0x7f5f740b1db0 2021-12-17T18:18:27.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.221+0000 7f5f792dd700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f741470c0 con 0x7f5f7412bdb0 2021-12-17T18:18:27.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.221+0000 7f5f792dd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f74142d60 con 0x7f5f74064500 2021-12-17T18:18:27.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.221+0000 7f5f78adc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5f7412bdb0 0x7f5f7412c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:27.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.221+0000 7f5f73fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5f74064500 0x7f5f740648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:27.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.221+0000 7f5f78adc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5f7412bdb0 0x7f5f7412c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:54738/0 (socket says 172.21.15.62:54738) 2021-12-17T18:18:27.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.221+0000 7f5f78adc700 1 -- 172.21.15.62:0/3423217525 learned_addr learned my addr 172.21.15.62:0/3423217525 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:27.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.221+0000 7f5f78adc700 1 -- 172.21.15.62:0/3423217525 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5f74064500 msgr2=0x7f5f740648e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:27.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.221+0000 7f5f78adc700 1 --2- 172.21.15.62:0/3423217525 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5f74064500 0x7f5f740648e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.221+0000 7f5f78adc700 1 -- 172.21.15.62:0/3423217525 >> v1:172.21.15.109:6789/0 conn(0x7f5f740b1db0 legacy=0x7f5f74144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.221+0000 7f5f78adc700 1 -- 172.21.15.62:0/3423217525 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f74143000 con 0x7f5f7412bdb0 2021-12-17T18:18:27.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.221+0000 7f5f78adc700 1 --2- 172.21.15.62:0/3423217525 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5f7412bdb0 0x7f5f7412c260 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f5f740b4d10 tx=0x7f5f6c009290).ready entity=mon.1 client_cookie=dda3110082d99f7a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:27.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.221+0000 7f5f72ffd700 1 -- 172.21.15.62:0/3423217525 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f6c00b860 con 0x7f5f7412bdb0 2021-12-17T18:18:27.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.221+0000 7f5f72ffd700 1 -- 172.21.15.62:0/3423217525 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c00b9c0 con 0x7f5f7412bdb0 2021-12-17T18:18:27.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.221+0000 7f5f72ffd700 1 -- 172.21.15.62:0/3423217525 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f6c00bb30 con 0x7f5f7412bdb0 2021-12-17T18:18:27.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f792dd700 1 -- 172.21.15.62:0/3423217525 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5f7412bdb0 msgr2=0x7f5f7412c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f792dd700 1 --2- 172.21.15.62:0/3423217525 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5f7412bdb0 0x7f5f7412c260 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f5f740b4d10 tx=0x7f5f6c009290).stop 2021-12-17T18:18:27.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f792dd700 1 -- 172.21.15.62:0/3423217525 shutdown_connections 2021-12-17T18:18:27.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f792dd700 1 --2- 172.21.15.62:0/3423217525 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5f7412bdb0 0x7f5f7412c260 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f792dd700 1 --2- 172.21.15.62:0/3423217525 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5f74064500 0x7f5f740648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f792dd700 1 -- 172.21.15.62:0/3423217525 >> 172.21.15.62:0/3423217525 conn(0x7f5f740623c0 msgr2=0x7f5f740627d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:27.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f792dd700 1 -- 172.21.15.62:0/3423217525 shutdown_connections 2021-12-17T18:18:27.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f792dd700 1 -- 172.21.15.62:0/3423217525 wait complete. 2021-12-17T18:18:27.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f792dd700 1 Processor -- start 2021-12-17T18:18:27.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f792dd700 1 -- start start 2021-12-17T18:18:27.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f792dd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5f74064500 0x7f5f7412e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:27.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f792dd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5f740b1db0 0x7f5f74066b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:27.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f792dd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f7412bdb0 0x7f5f74151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:27.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f792dd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f74128940 con 0x7f5f7412bdb0 2021-12-17T18:18:27.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f792dd700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7412d7a0 con 0x7f5f740b1db0 2021-12-17T18:18:27.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f792dd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7412ed20 con 0x7f5f74064500 2021-12-17T18:18:27.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f78adc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f7412bdb0 0x7f5f74151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:27.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f78adc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f7412bdb0 0x7f5f74151660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48194/0 (socket says 172.21.15.62:48194) 2021-12-17T18:18:27.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f78adc700 1 -- 172.21.15.62:0/3981532062 learned_addr learned my addr 172.21.15.62:0/3981532062 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:27.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f737fe700 1 --2- 172.21.15.62:0/3981532062 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5f740b1db0 0x7f5f74066b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:27.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.225+0000 7f5f73fff700 1 --2- 172.21.15.62:0/3981532062 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5f74064500 0x7f5f7412e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:27.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.229+0000 7f5f78adc700 1 -- 172.21.15.62:0/3981532062 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5f74064500 msgr2=0x7f5f7412e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.229+0000 7f5f78adc700 1 --2- 172.21.15.62:0/3981532062 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5f74064500 0x7f5f7412e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.229+0000 7f5f78adc700 1 -- 172.21.15.62:0/3981532062 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5f740b1db0 msgr2=0x7f5f74066b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.229+0000 7f5f78adc700 1 --2- 172.21.15.62:0/3981532062 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5f740b1db0 0x7f5f74066b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.229+0000 7f5f78adc700 1 -- 172.21.15.62:0/3981532062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c009530 con 0x7f5f7412bdb0 2021-12-17T18:18:27.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.229+0000 7f5f78adc700 1 --2- 172.21.15.62:0/3981532062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f7412bdb0 0x7f5f74151660 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f5f740b4d10 tx=0x7f5f6c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:27.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.229+0000 7f5f717fa700 1 -- 172.21.15.62:0/3981532062 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f6c0032f0 con 0x7f5f7412bdb0 2021-12-17T18:18:27.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.229+0000 7f5f717fa700 1 -- 172.21.15.62:0/3981532062 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c021440 con 0x7f5f7412bdb0 2021-12-17T18:18:27.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.229+0000 7f5f792dd700 1 -- 172.21.15.62:0/3981532062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7412efc0 con 0x7f5f7412bdb0 2021-12-17T18:18:27.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.229+0000 7f5f717fa700 1 -- 172.21.15.62:0/3981532062 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f6c0217a0 con 0x7f5f7412bdb0 2021-12-17T18:18:27.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.229+0000 7f5f792dd700 1 -- 172.21.15.62:0/3981532062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f741557e0 con 0x7f5f7412bdb0 2021-12-17T18:18:27.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.229+0000 7f5f792dd700 1 -- 172.21.15.62:0/3981532062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f74146d40 con 0x7f5f7412bdb0 2021-12-17T18:18:27.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.229+0000 7f5f717fa700 1 -- 172.21.15.62:0/3981532062 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5f6c027020 con 0x7f5f7412bdb0 2021-12-17T18:18:27.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.229+0000 7f5f717fa700 1 --2- 172.21.15.62:0/3981532062 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5f54053640 0x7f5f54055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:27.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.229+0000 7f5f717fa700 1 -- 172.21.15.62:0/3981532062 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5f6c06cbb0 con 0x7f5f7412bdb0 2021-12-17T18:18:27.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.233+0000 7f5f73fff700 1 --2- 172.21.15.62:0/3981532062 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5f54053640 0x7f5f54055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:27.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.233+0000 7f5f73fff700 1 --2- 172.21.15.62:0/3981532062 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5f54053640 0x7f5f54055b00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5f6400b000 tx=0x7f5f64006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:27.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.237+0000 7f5f717fa700 1 -- 172.21.15.62:0/3981532062 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5f6c043dc0 con 0x7f5f7412bdb0 2021-12-17T18:18:27.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.361+0000 7f5f792dd700 1 -- 172.21.15.62:0/3981532062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5f740573d0 con 0x7f5f7412bdb0 2021-12-17T18:18:27.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.361+0000 7f5f717fa700 1 -- 172.21.15.62:0/3981532062 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f6c015070 con 0x7f5f7412bdb0 2021-12-17T18:18:27.369 INFO:teuthology.orchestra.run.smithi062.stdout:60129542149 2021-12-17T18:18:27.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.365+0000 7f5f792dd700 1 -- 172.21.15.62:0/3981532062 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5f54053640 msgr2=0x7f5f54055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.365+0000 7f5f792dd700 1 --2- 172.21.15.62:0/3981532062 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5f54053640 0x7f5f54055b00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5f6400b000 tx=0x7f5f64006df0).stop 2021-12-17T18:18:27.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.365+0000 7f5f792dd700 1 -- 172.21.15.62:0/3981532062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f7412bdb0 msgr2=0x7f5f74151660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.365+0000 7f5f792dd700 1 --2- 172.21.15.62:0/3981532062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f7412bdb0 0x7f5f74151660 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f5f740b4d10 tx=0x7f5f6c016000).stop 2021-12-17T18:18:27.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.365+0000 7f5f792dd700 1 -- 172.21.15.62:0/3981532062 shutdown_connections 2021-12-17T18:18:27.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.365+0000 7f5f792dd700 1 --2- 172.21.15.62:0/3981532062 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5f54053640 0x7f5f54055b00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.365+0000 7f5f792dd700 1 --2- 172.21.15.62:0/3981532062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f7412bdb0 0x7f5f74151660 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.365+0000 7f5f792dd700 1 --2- 172.21.15.62:0/3981532062 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5f740b1db0 0x7f5f74066b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.365+0000 7f5f792dd700 1 --2- 172.21.15.62:0/3981532062 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5f74064500 0x7f5f7412e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.365+0000 7f5f792dd700 1 -- 172.21.15.62:0/3981532062 >> 172.21.15.62:0/3981532062 conn(0x7f5f740623c0 msgr2=0x7f5f74146060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:27.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.365+0000 7f5f792dd700 1 -- 172.21.15.62:0/3981532062 shutdown_connections 2021-12-17T18:18:27.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.365+0000 7f5f792dd700 1 -- 172.21.15.62:0/3981532062 wait complete. 2021-12-17T18:18:27.387 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2021-12-17T18:18:27.387 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2021-12-17T18:18:27.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.477+0000 7f5828b5f700 1 Processor -- start 2021-12-17T18:18:27.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.477+0000 7f5828b5f700 1 -- start start 2021-12-17T18:18:27.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5828b5f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f58240b2770 0x7f5824067140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:27.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5828b5f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58240b3c30 con 0x7f58240b22c0 2021-12-17T18:18:27.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5828b5f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58240b4560 con 0x7f58240b4180 2021-12-17T18:18:27.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5828b5f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5824067630 con 0x7f58240b2770 2021-12-17T18:18:27.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5823fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f58240b2770 0x7f5824067140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:27.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5823fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f58240b2770 0x7f5824067140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48202/0 (socket says 172.21.15.62:48202) 2021-12-17T18:18:27.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5823fff700 1 -- 172.21.15.62:0/2810668461 learned_addr learned my addr 172.21.15.62:0/2810668461 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:27.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5822ffd700 1 --1- 172.21.15.62:0/2810668461 >> v1:172.21.15.62:6789/0 conn(0x7f58240b22c0 0x7f5824129790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60012/0 (socket says 172.21.15.62:60012) 2021-12-17T18:18:27.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5823fff700 1 -- 172.21.15.62:0/2810668461 >> v1:172.21.15.109:6789/0 conn(0x7f58240b4180 legacy=0x7f5824066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5823fff700 1 -- 172.21.15.62:0/2810668461 >> v1:172.21.15.62:6789/0 conn(0x7f58240b22c0 legacy=0x7f5824129790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5823fff700 1 -- 172.21.15.62:0/2810668461 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5824144d10 con 0x7f58240b2770 2021-12-17T18:18:27.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5823fff700 1 --2- 172.21.15.62:0/2810668461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58240b2770 0x7f5824067140 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f581c0032f0 tx=0x7f581c009290).ready entity=mon.0 client_cookie=d3c560fe37b3aec8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:27.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f58227fc700 1 -- 172.21.15.62:0/2810668461 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f581c00b8a0 con 0x7f58240b2770 2021-12-17T18:18:27.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f58227fc700 1 -- 172.21.15.62:0/2810668461 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c00ba00 con 0x7f58240b2770 2021-12-17T18:18:27.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f58227fc700 1 -- 172.21.15.62:0/2810668461 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f581c00bb70 con 0x7f58240b2770 2021-12-17T18:18:27.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5828b5f700 1 -- 172.21.15.62:0/2810668461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58240b2770 msgr2=0x7f5824067140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5828b5f700 1 --2- 172.21.15.62:0/2810668461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58240b2770 0x7f5824067140 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f581c0032f0 tx=0x7f581c009290).stop 2021-12-17T18:18:27.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5828b5f700 1 -- 172.21.15.62:0/2810668461 shutdown_connections 2021-12-17T18:18:27.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5828b5f700 1 --2- 172.21.15.62:0/2810668461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58240b2770 0x7f5824067140 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5828b5f700 1 -- 172.21.15.62:0/2810668461 >> 172.21.15.62:0/2810668461 conn(0x7f58240623c0 msgr2=0x7f58240627d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:27.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5828b5f700 1 -- 172.21.15.62:0/2810668461 shutdown_connections 2021-12-17T18:18:27.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.481+0000 7f5828b5f700 1 -- 172.21.15.62:0/2810668461 wait complete. 2021-12-17T18:18:27.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f5828b5f700 1 Processor -- start 2021-12-17T18:18:27.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f5828b5f700 1 -- start start 2021-12-17T18:18:27.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f5828b5f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58240b22c0 0x7f5824064fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:27.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f5828b5f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f58240b2770 0x7f5824155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:27.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f5828b5f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f58240b4180 0x7f5824146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:27.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f5828b5f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582412a9b0 con 0x7f58240b22c0 2021-12-17T18:18:27.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f5828b5f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5824064010 con 0x7f58240b2770 2021-12-17T18:18:27.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f5828b5f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58240642b0 con 0x7f58240b4180 2021-12-17T18:18:27.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f58237fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58240b22c0 0x7f5824064fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:27.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f5822ffd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f58240b2770 0x7f5824155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:27.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f58237fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58240b22c0 0x7f5824064fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48204/0 (socket says 172.21.15.62:48204) 2021-12-17T18:18:27.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f5823fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f58240b4180 0x7f5824146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:27.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f58237fe700 1 -- 172.21.15.62:0/1172767752 learned_addr learned my addr 172.21.15.62:0/1172767752 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:27.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f5822ffd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f58240b2770 0x7f5824155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:54756/0 (socket says 172.21.15.62:54756) 2021-12-17T18:18:27.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f58237fe700 1 -- 172.21.15.62:0/1172767752 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f58240b4180 msgr2=0x7f5824146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f58237fe700 1 --2- 172.21.15.62:0/1172767752 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f58240b4180 0x7f5824146d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f58237fe700 1 -- 172.21.15.62:0/1172767752 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f58240b2770 msgr2=0x7f5824155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f58237fe700 1 --2- 172.21.15.62:0/1172767752 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f58240b2770 0x7f5824155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f58237fe700 1 -- 172.21.15.62:0/1172767752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c009530 con 0x7f58240b22c0 2021-12-17T18:18:27.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f5822ffd700 1 --2- 172.21.15.62:0/1172767752 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f58240b2770 0x7f5824155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:27.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f58237fe700 1 --2- 172.21.15.62:0/1172767752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58240b22c0 0x7f5824064fe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f58240b7320 tx=0x7f580c007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:27.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f5820ff9700 1 -- 172.21.15.62:0/1172767752 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f580c007e70 con 0x7f58240b22c0 2021-12-17T18:18:27.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f5820ff9700 1 -- 172.21.15.62:0/1172767752 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580c007030 con 0x7f58240b22c0 2021-12-17T18:18:27.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f5828b5f700 1 -- 172.21.15.62:0/1172767752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5824063d00 con 0x7f58240b22c0 2021-12-17T18:18:27.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f5820ff9700 1 -- 172.21.15.62:0/1172767752 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f580c007390 con 0x7f58240b22c0 2021-12-17T18:18:27.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.485+0000 7f5828b5f700 1 -- 172.21.15.62:0/1172767752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582412d940 con 0x7f58240b22c0 2021-12-17T18:18:27.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.489+0000 7f5828b5f700 1 -- 172.21.15.62:0/1172767752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5824144fb0 con 0x7f58240b22c0 2021-12-17T18:18:27.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.489+0000 7f5820ff9700 1 -- 172.21.15.62:0/1172767752 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f580c010030 con 0x7f58240b22c0 2021-12-17T18:18:27.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.489+0000 7f5820ff9700 1 --2- 172.21.15.62:0/1172767752 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5808053610 0x7f5808055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:27.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.489+0000 7f5820ff9700 1 -- 172.21.15.62:0/1172767752 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f580c06b490 con 0x7f58240b22c0 2021-12-17T18:18:27.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.489+0000 7f5822ffd700 1 --2- 172.21.15.62:0/1172767752 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5808053610 0x7f5808055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:27.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.489+0000 7f5822ffd700 1 --2- 172.21.15.62:0/1172767752 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5808053610 0x7f5808055ad0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f581400d000 tx=0x7f5814009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:27.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.497+0000 7f5820ff9700 1 -- 172.21.15.62:0/1172767752 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f580c042550 con 0x7f58240b22c0 2021-12-17T18:18:27.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.621+0000 7f5828b5f700 1 -- 172.21.15.62:0/1172767752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f58240573d0 con 0x7f58240b22c0 2021-12-17T18:18:27.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.621+0000 7f5820ff9700 1 -- 172.21.15.62:0/1172767752 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f580c045b70 con 0x7f58240b22c0 2021-12-17T18:18:27.629 INFO:teuthology.orchestra.run.smithi062.stdout:60129542149 2021-12-17T18:18:27.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.625+0000 7f5828b5f700 1 -- 172.21.15.62:0/1172767752 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5808053610 msgr2=0x7f5808055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.625+0000 7f5828b5f700 1 --2- 172.21.15.62:0/1172767752 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5808053610 0x7f5808055ad0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f581400d000 tx=0x7f5814009040).stop 2021-12-17T18:18:27.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.625+0000 7f5828b5f700 1 -- 172.21.15.62:0/1172767752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58240b22c0 msgr2=0x7f5824064fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.625+0000 7f5828b5f700 1 --2- 172.21.15.62:0/1172767752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58240b22c0 0x7f5824064fe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f58240b7320 tx=0x7f580c007c00).stop 2021-12-17T18:18:27.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.625+0000 7f5828b5f700 1 -- 172.21.15.62:0/1172767752 shutdown_connections 2021-12-17T18:18:27.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.625+0000 7f5828b5f700 1 --2- 172.21.15.62:0/1172767752 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5808053610 0x7f5808055ad0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.625+0000 7f5828b5f700 1 --2- 172.21.15.62:0/1172767752 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f58240b4180 0x7f5824146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.625+0000 7f5828b5f700 1 --2- 172.21.15.62:0/1172767752 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f58240b2770 0x7f5824155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.625+0000 7f5828b5f700 1 --2- 172.21.15.62:0/1172767752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58240b22c0 0x7f5824064fe0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.625+0000 7f5828b5f700 1 -- 172.21.15.62:0/1172767752 >> 172.21.15.62:0/1172767752 conn(0x7f58240623c0 msgr2=0x7f582405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:27.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.625+0000 7f5828b5f700 1 -- 172.21.15.62:0/1172767752 shutdown_connections 2021-12-17T18:18:27.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.625+0000 7f5828b5f700 1 -- 172.21.15.62:0/1172767752 wait complete. 2021-12-17T18:18:27.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2021-12-17T18:18:27.642 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-12-17T18:18:27.643 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-12-17T18:18:27.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286ffff700 1 Processor -- start 2021-12-17T18:18:27.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286ffff700 1 -- start start 2021-12-17T18:18:27.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286ffff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f28700b1ff0 0x7f2870066bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:27.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286ffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2870065a10 con 0x7f2870144fa0 2021-12-17T18:18:27.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286ffff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28700670c0 con 0x7f2870065630 2021-12-17T18:18:27.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286ffff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2870067330 con 0x7f28700b1ff0 2021-12-17T18:18:27.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2870144fa0 0x7f28701404b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60028/0 (socket says 172.21.15.62:60028) 2021-12-17T18:18:27.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286f7fe700 1 -- 172.21.15.62:0/1300066399 learned_addr learned my addr 172.21.15.62:0/1300066399 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:27.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286e7fc700 1 --2- 172.21.15.62:0/1300066399 >> v2:172.21.15.109:3300/0 conn(0x7f28700b1ff0 0x7f2870066bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:27.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286dffb700 1 -- 172.21.15.62:0/1300066399 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016727436 0 0) 0x7f2870065a10 con 0x7f2870144fa0 2021-12-17T18:18:27.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286dffb700 1 -- 172.21.15.62:0/1300066399 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2850003260 con 0x7f2870144fa0 2021-12-17T18:18:27.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286dffb700 1 -- 172.21.15.62:0/1300066399 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404516184 0 0) 0x7f28700670c0 con 0x7f2870065630 2021-12-17T18:18:27.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286dffb700 1 -- 172.21.15.62:0/1300066399 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2870065a10 con 0x7f2870065630 2021-12-17T18:18:27.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286e7fc700 1 -- 172.21.15.62:0/1300066399 >> v1:172.21.15.109:6789/0 conn(0x7f2870065630 legacy=0x7f2870144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286e7fc700 1 -- 172.21.15.62:0/1300066399 >> v1:172.21.15.62:6789/0 conn(0x7f2870144fa0 legacy=0x7f28701404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286dffb700 1 -- 172.21.15.62:0/1300066399 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3674576837 0 0) 0x7f2850003260 con 0x7f2870144fa0 2021-12-17T18:18:27.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286e7fc700 1 -- 172.21.15.62:0/1300066399 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28700675d0 con 0x7f28700b1ff0 2021-12-17T18:18:27.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286e7fc700 1 --2- 172.21.15.62:0/1300066399 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28700b1ff0 0x7f2870066bd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f2860001110 tx=0x7f28680091d0).ready entity=mon.1 client_cookie=53ad3f58d7803728 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:27.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286dffb700 1 -- 172.21.15.62:0/1300066399 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2860001660 con 0x7f28700b1ff0 2021-12-17T18:18:27.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286dffb700 1 -- 172.21.15.62:0/1300066399 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286800f510 con 0x7f28700b1ff0 2021-12-17T18:18:27.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.741+0000 7f286dffb700 1 -- 172.21.15.62:0/1300066399 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286800f680 con 0x7f28700b1ff0 2021-12-17T18:18:27.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.745+0000 7f286ffff700 1 -- 172.21.15.62:0/1300066399 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28700b1ff0 msgr2=0x7f2870066bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.745+0000 7f286ffff700 1 --2- 172.21.15.62:0/1300066399 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28700b1ff0 0x7f2870066bd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f2860001110 tx=0x7f28680091d0).stop 2021-12-17T18:18:27.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.745+0000 7f286ffff700 1 -- 172.21.15.62:0/1300066399 shutdown_connections 2021-12-17T18:18:27.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.745+0000 7f286ffff700 1 --2- 172.21.15.62:0/1300066399 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28700b1ff0 0x7f2870066bd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.745+0000 7f286ffff700 1 -- 172.21.15.62:0/1300066399 >> 172.21.15.62:0/1300066399 conn(0x7f287005c750 msgr2=0x7f287005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:27.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.745+0000 7f286ffff700 1 -- 172.21.15.62:0/1300066399 shutdown_connections 2021-12-17T18:18:27.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.745+0000 7f286ffff700 1 -- 172.21.15.62:0/1300066399 wait complete. 2021-12-17T18:18:27.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.745+0000 7f286ffff700 1 Processor -- start 2021-12-17T18:18:27.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.745+0000 7f286ffff700 1 -- start start 2021-12-17T18:18:27.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286ffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2870065630 0x7f28701529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:27.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28700b1ff0 0x7f28700b3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:27.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2870144fa0 0x7f28700aa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:27.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28700b1100 con 0x7f28700b1ff0 2021-12-17T18:18:27.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286ffff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287013f660 con 0x7f2870065630 2021-12-17T18:18:27.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286ffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28700ae9c0 con 0x7f2870144fa0 2021-12-17T18:18:27.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28700b1ff0 0x7f28700b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:27.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28700b1ff0 0x7f28700b3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48220/0 (socket says 172.21.15.62:48220) 2021-12-17T18:18:27.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286e7fc700 1 -- 172.21.15.62:0/998562027 learned_addr learned my addr 172.21.15.62:0/998562027 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:27.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286effd700 1 --2- 172.21.15.62:0/998562027 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2870065630 0x7f28701529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:27.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286f7fe700 1 --2- 172.21.15.62:0/998562027 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2870144fa0 0x7f28700aa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:27.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286e7fc700 1 -- 172.21.15.62:0/998562027 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2870144fa0 msgr2=0x7f28700aa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286e7fc700 1 --2- 172.21.15.62:0/998562027 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2870144fa0 0x7f28700aa4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286e7fc700 1 -- 172.21.15.62:0/998562027 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2870065630 msgr2=0x7f28701529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286e7fc700 1 --2- 172.21.15.62:0/998562027 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2870065630 0x7f28701529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286e7fc700 1 -- 172.21.15.62:0/998562027 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2868009470 con 0x7f28700b1ff0 2021-12-17T18:18:27.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286e7fc700 1 --2- 172.21.15.62:0/998562027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28700b1ff0 0x7f28700b3130 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f28700afef0 tx=0x7f2868016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:27.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f2867fff700 1 -- 172.21.15.62:0/998562027 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28680032d0 con 0x7f28700b1ff0 2021-12-17T18:18:27.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f2867fff700 1 -- 172.21.15.62:0/998562027 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286800fe60 con 0x7f28700b1ff0 2021-12-17T18:18:27.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286ffff700 1 -- 172.21.15.62:0/998562027 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28700aec60 con 0x7f28700b1ff0 2021-12-17T18:18:27.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f2867fff700 1 -- 172.21.15.62:0/998562027 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28680205e0 con 0x7f28700b1ff0 2021-12-17T18:18:27.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286ffff700 1 -- 172.21.15.62:0/998562027 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28700b09b0 con 0x7f28700b1ff0 2021-12-17T18:18:27.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.749+0000 7f286ffff700 1 -- 172.21.15.62:0/998562027 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28700573d0 con 0x7f28700b1ff0 2021-12-17T18:18:27.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.753+0000 7f2867fff700 1 -- 172.21.15.62:0/998562027 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f286801e070 con 0x7f28700b1ff0 2021-12-17T18:18:27.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.753+0000 7f2867fff700 1 --2- 172.21.15.62:0/998562027 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2854053610 0x7f2854055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:27.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.753+0000 7f2867fff700 1 -- 172.21.15.62:0/998562027 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f286806c5f0 con 0x7f28700b1ff0 2021-12-17T18:18:27.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.753+0000 7f286effd700 1 --2- 172.21.15.62:0/998562027 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2854053610 0x7f2854055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:27.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.753+0000 7f286effd700 1 --2- 172.21.15.62:0/998562027 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2854053610 0x7f2854055ad0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f285800d000 tx=0x7f2858007a20).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:27.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.757+0000 7f2867fff700 1 -- 172.21.15.62:0/998562027 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f28680436f0 con 0x7f28700b1ff0 2021-12-17T18:18:27.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.881+0000 7f286ffff700 1 -- 172.21.15.62:0/998562027 --> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28700ac6c0 con 0x7f2854053610 2021-12-17T18:18:27.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.889+0000 7f2867fff700 1 -- 172.21.15.62:0/998562027 <== mgr.4103 v2:172.21.15.109:6800/14658 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82308 (secure 0 0 0) 0x7f28580023a0 con 0x7f2854053610 2021-12-17T18:18:27.897 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:27.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.889+0000 7f286ffff700 1 -- 172.21.15.62:0/998562027 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2854053610 msgr2=0x7f2854055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.889+0000 7f286ffff700 1 --2- 172.21.15.62:0/998562027 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2854053610 0x7f2854055ad0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f285800d000 tx=0x7f2858007a20).stop 2021-12-17T18:18:27.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.889+0000 7f286ffff700 1 -- 172.21.15.62:0/998562027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28700b1ff0 msgr2=0x7f28700b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:27.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.889+0000 7f286ffff700 1 --2- 172.21.15.62:0/998562027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28700b1ff0 0x7f28700b3130 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f28700afef0 tx=0x7f2868016000).stop 2021-12-17T18:18:27.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.889+0000 7f286ffff700 1 -- 172.21.15.62:0/998562027 shutdown_connections 2021-12-17T18:18:27.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.889+0000 7f286ffff700 1 --2- 172.21.15.62:0/998562027 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2854053610 0x7f2854055ad0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.889+0000 7f286ffff700 1 --2- 172.21.15.62:0/998562027 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2870144fa0 0x7f28700aa4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.889+0000 7f286ffff700 1 --2- 172.21.15.62:0/998562027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28700b1ff0 0x7f28700b3130 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.889+0000 7f286ffff700 1 --2- 172.21.15.62:0/998562027 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2870065630 0x7f28701529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:27.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.889+0000 7f286ffff700 1 -- 172.21.15.62:0/998562027 >> 172.21.15.62:0/998562027 conn(0x7f287005c750 msgr2=0x7f2870142480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:27.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.893+0000 7f286ffff700 1 -- 172.21.15.62:0/998562027 shutdown_connections 2021-12-17T18:18:27.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:27.893+0000 7f286ffff700 1 -- 172.21.15.62:0/998562027 wait complete. 2021-12-17T18:18:27.905 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2021-12-17T18:18:27.911 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2021-12-17T18:18:27.533972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390588,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584132,"statfs":{"total":773094113280,"available":764502151168,"internally_reserved":8589934592,"allocated":1961984,"data_stored":710102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.349900"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.200692+0000","last_change":"2021-12-17T18:18:19.199544+0000","last_active":"2021-12-17T18:18:19.200692+0000","last_peered":"2021-12-17T18:18:19.200692+0000","last_clean":"2021-12-17T18:18:19.200692+0000","last_became_active":"2021-12-17T18:18:19.199142+0000","last_became_peered":"2021-12-17T18:18:19.199142+0000","last_unstale":"2021-12-17T18:18:19.200692+0000","last_undegraded":"2021-12-17T18:18:19.200692+0000","last_fullsized":"2021-12-17T18:18:19.200692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_clean_scrub_stamp":"2021-12-17T18:18:18.848432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.198047+0000","last_change":"2021-12-17T18:18:11.029535+0000","last_active":"2021-12-17T18:18:19.198047+0000","last_peered":"2021-12-17T18:18:19.198047+0000","last_clean":"2021-12-17T18:18:19.198047+0000","last_became_active":"2021-12-17T18:18:11.028573+0000","last_became_peered":"2021-12-17T18:18:11.028573+0000","last_unstale":"2021-12-17T18:18:19.198047+0000","last_undegraded":"2021-12-17T18:18:19.198047+0000","last_fullsized":"2021-12-17T18:18:19.198047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:06.521383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:06.521383+0000","last_clean_scrub_stamp":"2021-12-17T18:18:06.521383+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.192548+0000","last_change":"2021-12-17T18:18:15.745704+0000","last_active":"2021-12-17T18:18:19.192548+0000","last_peered":"2021-12-17T18:18:19.192548+0000","last_clean":"2021-12-17T18:18:19.192548+0000","last_became_active":"2021-12-17T18:18:15.744953+0000","last_became_peered":"2021-12-17T18:18:15.744953+0000","last_unstale":"2021-12-17T18:18:19.192548+0000","last_undegraded":"2021-12-17T18:18:19.192548+0000","last_fullsized":"2021-12-17T18:18:19.192548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.195969+0000","last_change":"2021-12-17T18:18:18.872111+0000","last_active":"2021-12-17T18:18:19.195969+0000","last_peered":"2021-12-17T18:18:19.195969+0000","last_clean":"2021-12-17T18:18:19.195969+0000","last_became_active":"2021-12-17T18:18:18.871711+0000","last_became_peered":"2021-12-17T18:18:18.871711+0000","last_unstale":"2021-12-17T18:18:19.195969+0000","last_undegraded":"2021-12-17T18:18:19.195969+0000","last_fullsized":"2021-12-17T18:18:19.195969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_clean_scrub_stamp":"2021-12-17T18:18:17.839888+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.203172+0000","last_change":"2021-12-17T18:18:19.202540+0000","last_active":"2021-12-17T18:18:19.203172+0000","last_peered":"2021-12-17T18:18:19.203172+0000","last_clean":"2021-12-17T18:18:19.203172+0000","last_became_active":"2021-12-17T18:18:19.202192+0000","last_became_peered":"2021-12-17T18:18:19.202192+0000","last_unstale":"2021-12-17T18:18:19.203172+0000","last_undegraded":"2021-12-17T18:18:19.203172+0000","last_fullsized":"2021-12-17T18:18:19.203172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_clean_scrub_stamp":"2021-12-17T18:18:18.848432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.197846+0000","last_change":"2021-12-17T18:18:15.740336+0000","last_active":"2021-12-17T18:18:19.197846+0000","last_peered":"2021-12-17T18:18:19.197846+0000","last_clean":"2021-12-17T18:18:19.197846+0000","last_became_active":"2021-12-17T18:18:15.739646+0000","last_became_peered":"2021-12-17T18:18:15.739646+0000","last_unstale":"2021-12-17T18:18:19.197846+0000","last_undegraded":"2021-12-17T18:18:19.197846+0000","last_fullsized":"2021-12-17T18:18:19.197846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.191254+0000","last_change":"2021-12-17T18:18:18.869339+0000","last_active":"2021-12-17T18:18:19.191254+0000","last_peered":"2021-12-17T18:18:19.191254+0000","last_clean":"2021-12-17T18:18:19.191254+0000","last_became_active":"2021-12-17T18:18:18.868944+0000","last_became_peered":"2021-12-17T18:18:18.868944+0000","last_unstale":"2021-12-17T18:18:19.191254+0000","last_undegraded":"2021-12-17T18:18:19.191254+0000","last_fullsized":"2021-12-17T18:18:19.191254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_clean_scrub_stamp":"2021-12-17T18:18:17.839888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.201965+0000","last_change":"2021-12-17T18:18:19.196826+0000","last_active":"2021-12-17T18:18:19.201965+0000","last_peered":"2021-12-17T18:18:19.201965+0000","last_clean":"2021-12-17T18:18:19.201965+0000","last_became_active":"2021-12-17T18:18:19.196225+0000","last_became_peered":"2021-12-17T18:18:19.196225+0000","last_unstale":"2021-12-17T18:18:19.201965+0000","last_undegraded":"2021-12-17T18:18:19.201965+0000","last_fullsized":"2021-12-17T18:18:19.201965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_clean_scrub_stamp":"2021-12-17T18:18:18.848432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.191656+0000","last_change":"2021-12-17T18:18:16.000008+0000","last_active":"2021-12-17T18:18:19.191656+0000","last_peered":"2021-12-17T18:18:19.191656+0000","last_clean":"2021-12-17T18:18:19.191656+0000","last_became_active":"2021-12-17T18:18:15.998977+0000","last_became_peered":"2021-12-17T18:18:15.998977+0000","last_unstale":"2021-12-17T18:18:19.191656+0000","last_undegraded":"2021-12-17T18:18:19.191656+0000","last_fullsized":"2021-12-17T18:18:19.191656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.202605+0000","last_change":"2021-12-17T18:18:18.866606+0000","last_active":"2021-12-17T18:18:19.202605+0000","last_peered":"2021-12-17T18:18:19.202605+0000","last_clean":"2021-12-17T18:18:19.202605+0000","last_became_active":"2021-12-17T18:18:18.866134+0000","last_became_peered":"2021-12-17T18:18:18.866134+0000","last_unstale":"2021-12-17T18:18:19.202605+0000","last_undegraded":"2021-12-17T18:18:19.202605+0000","last_fullsized":"2021-12-17T18:18:19.202605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_clean_scrub_stamp":"2021-12-17T18:18:17.839888+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.202380+0000","last_change":"2021-12-17T18:18:19.198049+0000","last_active":"2021-12-17T18:18:19.202380+0000","last_peered":"2021-12-17T18:18:19.202380+0000","last_clean":"2021-12-17T18:18:19.202380+0000","last_became_active":"2021-12-17T18:18:19.197423+0000","last_became_peered":"2021-12-17T18:18:19.197423+0000","last_unstale":"2021-12-17T18:18:19.202380+0000","last_undegraded":"2021-12-17T18:18:19.202380+0000","last_fullsized":"2021-12-17T18:18:19.202380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_clean_scrub_stamp":"2021-12-17T18:18:18.848432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.192731+0000","last_change":"2021-12-17T18:18:15.744111+0000","last_active":"2021-12-17T18:18:19.192731+0000","last_peered":"2021-12-17T18:18:19.192731+0000","last_clean":"2021-12-17T18:18:19.192731+0000","last_became_active":"2021-12-17T18:18:15.743756+0000","last_became_peered":"2021-12-17T18:18:15.743756+0000","last_unstale":"2021-12-17T18:18:19.192731+0000","last_undegraded":"2021-12-17T18:18:19.192731+0000","last_fullsized":"2021-12-17T18:18:19.192731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'5","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.203664+0000","last_change":"2021-12-17T18:18:18.869311+0000","last_active":"2021-12-17T18:18:19.203664+0000","last_peered":"2021-12-17T18:18:19.203664+0000","last_clean":"2021-12-17T18:18:19.203664+0000","last_became_active":"2021-12-17T18:18:18.868832+0000","last_became_peered":"2021-12-17T18:18:18.868832+0000","last_unstale":"2021-12-17T18:18:19.203664+0000","last_undegraded":"2021-12-17T18:18:19.203664+0000","last_fullsized":"2021-12-17T18:18:19.203664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_clean_scrub_stamp":"2021-12-17T18:18:17.839888+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.202261+0000","last_change":"2021-12-17T18:18:19.199611+0000","last_active":"2021-12-17T18:18:19.202261+0000","last_peered":"2021-12-17T18:18:19.202261+0000","last_clean":"2021-12-17T18:18:19.202261+0000","last_became_active":"2021-12-17T18:18:19.199251+0000","last_became_peered":"2021-12-17T18:18:19.199251+0000","last_unstale":"2021-12-17T18:18:19.202261+0000","last_undegraded":"2021-12-17T18:18:19.202261+0000","last_fullsized":"2021-12-17T18:18:19.202261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_clean_scrub_stamp":"2021-12-17T18:18:18.848432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.203119+0000","last_change":"2021-12-17T18:18:18.870268+0000","last_active":"2021-12-17T18:18:19.203119+0000","last_peered":"2021-12-17T18:18:19.203119+0000","last_clean":"2021-12-17T18:18:19.203119+0000","last_became_active":"2021-12-17T18:18:18.869868+0000","last_became_peered":"2021-12-17T18:18:18.869868+0000","last_unstale":"2021-12-17T18:18:19.203119+0000","last_undegraded":"2021-12-17T18:18:19.203119+0000","last_fullsized":"2021-12-17T18:18:19.203119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_clean_scrub_stamp":"2021-12-17T18:18:17.839888+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.183226+0000","last_change":"2021-12-17T18:18:16.004167+0000","last_active":"2021-12-17T18:18:19.183226+0000","last_peered":"2021-12-17T18:18:19.183226+0000","last_clean":"2021-12-17T18:18:19.183226+0000","last_became_active":"2021-12-17T18:18:16.003760+0000","last_became_peered":"2021-12-17T18:18:16.003760+0000","last_unstale":"2021-12-17T18:18:19.183226+0000","last_undegraded":"2021-12-17T18:18:19.183226+0000","last_fullsized":"2021-12-17T18:18:19.183226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.200741+0000","last_change":"2021-12-17T18:18:19.197446+0000","last_active":"2021-12-17T18:18:19.200741+0000","last_peered":"2021-12-17T18:18:19.200741+0000","last_clean":"2021-12-17T18:18:19.200741+0000","last_became_active":"2021-12-17T18:18:19.196389+0000","last_became_peered":"2021-12-17T18:18:19.196389+0000","last_unstale":"2021-12-17T18:18:19.200741+0000","last_undegraded":"2021-12-17T18:18:19.200741+0000","last_fullsized":"2021-12-17T18:18:19.200741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_clean_scrub_stamp":"2021-12-17T18:18:18.848432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.204468+0000","last_change":"2021-12-17T18:18:18.866826+0000","last_active":"2021-12-17T18:18:19.204468+0000","last_peered":"2021-12-17T18:18:19.204468+0000","last_clean":"2021-12-17T18:18:19.204468+0000","last_became_active":"2021-12-17T18:18:18.865791+0000","last_became_peered":"2021-12-17T18:18:18.865791+0000","last_unstale":"2021-12-17T18:18:19.204468+0000","last_undegraded":"2021-12-17T18:18:19.204468+0000","last_fullsized":"2021-12-17T18:18:19.204468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_clean_scrub_stamp":"2021-12-17T18:18:17.839888+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.196785+0000","last_change":"2021-12-17T18:18:16.007390+0000","last_active":"2021-12-17T18:18:19.196785+0000","last_peered":"2021-12-17T18:18:19.196785+0000","last_clean":"2021-12-17T18:18:19.196785+0000","last_became_active":"2021-12-17T18:18:16.006472+0000","last_became_peered":"2021-12-17T18:18:16.006472+0000","last_unstale":"2021-12-17T18:18:19.196785+0000","last_undegraded":"2021-12-17T18:18:19.196785+0000","last_fullsized":"2021-12-17T18:18:19.196785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.201516+0000","last_change":"2021-12-17T18:18:19.199241+0000","last_active":"2021-12-17T18:18:19.201516+0000","last_peered":"2021-12-17T18:18:19.201516+0000","last_clean":"2021-12-17T18:18:19.201516+0000","last_became_active":"2021-12-17T18:18:19.198884+0000","last_became_peered":"2021-12-17T18:18:19.198884+0000","last_unstale":"2021-12-17T18:18:19.201516+0000","last_undegraded":"2021-12-17T18:18:19.201516+0000","last_fullsized":"2021-12-17T18:18:19.201516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_clean_scrub_stamp":"2021-12-17T18:18:18.848432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"22'7","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.199276+0000","last_change":"2021-12-17T18:18:18.878116+0000","last_active":"2021-12-17T18:18:19.199276+0000","last_peered":"2021-12-17T18:18:19.199276+0000","last_clean":"2021-12-17T18:18:19.199276+0000","last_became_active":"2021-12-17T18:18:18.877649+0000","last_became_peered":"2021-12-17T18:18:18.877649+0000","last_unstale":"2021-12-17T18:18:19.199276+0000","last_undegraded":"2021-12-17T18:18:19.199276+0000","last_fullsized":"2021-12-17T18:18:19.199276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_clean_scrub_stamp":"2021-12-17T18:18:17.839888+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.182103+0000","last_change":"2021-12-17T18:18:15.740372+0000","last_active":"2021-12-17T18:18:19.182103+0000","last_peered":"2021-12-17T18:18:19.182103+0000","last_clean":"2021-12-17T18:18:19.182103+0000","last_became_active":"2021-12-17T18:18:15.739493+0000","last_became_peered":"2021-12-17T18:18:15.739493+0000","last_unstale":"2021-12-17T18:18:19.182103+0000","last_undegraded":"2021-12-17T18:18:19.182103+0000","last_fullsized":"2021-12-17T18:18:19.182103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.200829+0000","last_change":"2021-12-17T18:18:19.199463+0000","last_active":"2021-12-17T18:18:19.200829+0000","last_peered":"2021-12-17T18:18:19.200829+0000","last_clean":"2021-12-17T18:18:19.200829+0000","last_became_active":"2021-12-17T18:18:19.198875+0000","last_became_peered":"2021-12-17T18:18:19.198875+0000","last_unstale":"2021-12-17T18:18:19.200829+0000","last_undegraded":"2021-12-17T18:18:19.200829+0000","last_fullsized":"2021-12-17T18:18:19.200829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_clean_scrub_stamp":"2021-12-17T18:18:18.848432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2021-12-17T18:18:20.832147+0000","last_change":"2021-12-17T18:18:18.867085+0000","last_active":"2021-12-17T18:18:20.832147+0000","last_peered":"2021-12-17T18:18:20.832147+0000","last_clean":"2021-12-17T18:18:20.832147+0000","last_became_active":"2021-12-17T18:18:18.866585+0000","last_became_peered":"2021-12-17T18:18:18.866585+0000","last_unstale":"2021-12-17T18:18:20.832147+0000","last_undegraded":"2021-12-17T18:18:20.832147+0000","last_fullsized":"2021-12-17T18:18:20.832147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_clean_scrub_stamp":"2021-12-17T18:18:17.839888+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.194871+0000","last_change":"2021-12-17T18:18:15.743498+0000","last_active":"2021-12-17T18:18:19.194871+0000","last_peered":"2021-12-17T18:18:19.194871+0000","last_clean":"2021-12-17T18:18:19.194871+0000","last_became_active":"2021-12-17T18:18:15.742720+0000","last_became_peered":"2021-12-17T18:18:15.742720+0000","last_unstale":"2021-12-17T18:18:19.194871+0000","last_undegraded":"2021-12-17T18:18:19.194871+0000","last_fullsized":"2021-12-17T18:18:19.194871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":88834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048816,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323024,"statfs":{"total":96636764160,"available":95562776576,"internally_reserved":1073741824,"allocated":237568,"data_stored":88259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":88419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":88293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":88994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":89794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":89794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048816,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323024,"statfs":{"total":96636764160,"available":95562776576,"internally_reserved":1073741824,"allocated":237568,"data_stored":87715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]}]}]}} 2021-12-17T18:18:27.913 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-12-17T18:18:28.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f8aa3b700 1 Processor -- start 2021-12-17T18:18:28.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f8aa3b700 1 -- start start 2021-12-17T18:18:28.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f8aa3b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f4f840b1730 0x7f4f840ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f8aa3b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f840a7bb0 0x7f4f84067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f8aa3b700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f840b2ce0 con 0x7f4f840b21f0 2021-12-17T18:18:28.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f8aa3b700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8414b5b0 con 0x7f4f840b1730 2021-12-17T18:18:28.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f8aa3b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f84147870 con 0x7f4f840a7bb0 2021-12-17T18:18:28.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f7b7fe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f4f840b1730 0x7f4f840ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f88fd8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f840a7bb0 0x7f4f84067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f7b7fe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f4f840b1730 0x7f4f840ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:54778/0 (socket says 172.21.15.62:54778) 2021-12-17T18:18:28.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f88fd8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f840a7bb0 0x7f4f84067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:41932/0 (socket says 172.21.15.62:41932) 2021-12-17T18:18:28.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f7b7fe700 1 -- 172.21.15.62:0/457813575 learned_addr learned my addr 172.21.15.62:0/457813575 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:28.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f83fff700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f4f840b21f0 0x7f4f8414aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:48126/0 (socket says 172.21.15.62:48126) 2021-12-17T18:18:28.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f7b7fe700 1 -- 172.21.15.62:0/457813575 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f840a7bb0 msgr2=0x7f4f84067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:28.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f7b7fe700 1 --2- 172.21.15.62:0/457813575 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f840a7bb0 0x7f4f84067120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f7b7fe700 1 -- 172.21.15.62:0/457813575 >> v1:172.21.15.109:6789/0 conn(0x7f4f840b21f0 legacy=0x7f4f8414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f7b7fe700 1 -- 172.21.15.62:0/457813575 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f840aca60 con 0x7f4f840b1730 2021-12-17T18:18:28.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f88fd8700 1 --2- 172.21.15.62:0/457813575 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f840a7bb0 0x7f4f84067120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:28.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f7b7fe700 1 --2- 172.21.15.62:0/457813575 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f840b1730 0x7f4f840ace90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f4f6c002f70 tx=0x7f4f6c006eb0).ready entity=mon.1 client_cookie=27cb8241a47bd78d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:28.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f837fe700 1 -- 172.21.15.62:0/457813575 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f6c00d570 con 0x7f4f840b1730 2021-12-17T18:18:28.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f837fe700 1 -- 172.21.15.62:0/457813575 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6c000e90 con 0x7f4f840b1730 2021-12-17T18:18:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f837fe700 1 -- 172.21.15.62:0/457813575 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f6c00d900 con 0x7f4f840b1730 2021-12-17T18:18:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f8aa3b700 1 -- 172.21.15.62:0/457813575 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f840b1730 msgr2=0x7f4f840ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f8aa3b700 1 --2- 172.21.15.62:0/457813575 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f840b1730 0x7f4f840ace90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f4f6c002f70 tx=0x7f4f6c006eb0).stop 2021-12-17T18:18:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f8aa3b700 1 -- 172.21.15.62:0/457813575 shutdown_connections 2021-12-17T18:18:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f8aa3b700 1 --2- 172.21.15.62:0/457813575 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f840a7bb0 0x7f4f84067120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f8aa3b700 1 --2- 172.21.15.62:0/457813575 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f840b1730 0x7f4f840ace90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f8aa3b700 1 -- 172.21.15.62:0/457813575 >> 172.21.15.62:0/457813575 conn(0x7f4f8405f730 msgr2=0x7f4f8405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:28.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f8aa3b700 1 -- 172.21.15.62:0/457813575 shutdown_connections 2021-12-17T18:18:28.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.013+0000 7f4f8aa3b700 1 -- 172.21.15.62:0/457813575 wait complete. 2021-12-17T18:18:28.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f8aa3b700 1 Processor -- start 2021-12-17T18:18:28.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f8aa3b700 1 -- start start 2021-12-17T18:18:28.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f8aa3b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f840a7bb0 0x7f4f840abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f8aa3b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f840b1730 0x7f4f840ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f8aa3b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f840b21f0 0x7f4f84065e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f8aa3b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f840633f0 con 0x7f4f840a7bb0 2021-12-17T18:18:28.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f8aa3b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f84063650 con 0x7f4f840b1730 2021-12-17T18:18:28.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f8aa3b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f840638f0 con 0x7f4f840b21f0 2021-12-17T18:18:28.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f83fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f840a7bb0 0x7f4f840abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f83fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f840a7bb0 0x7f4f840abdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48232/0 (socket says 172.21.15.62:48232) 2021-12-17T18:18:28.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f83fff700 1 -- 172.21.15.62:0/3300691965 learned_addr learned my addr 172.21.15.62:0/3300691965 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:28.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f88fd8700 1 --2- 172.21.15.62:0/3300691965 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f840b21f0 0x7f4f84065e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f7b7fe700 1 --2- 172.21.15.62:0/3300691965 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f840b1730 0x7f4f840ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f88fd8700 1 -- 172.21.15.62:0/3300691965 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f840b1730 msgr2=0x7f4f840ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f88fd8700 1 --2- 172.21.15.62:0/3300691965 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f840b1730 0x7f4f840ac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f88fd8700 1 -- 172.21.15.62:0/3300691965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f840a7bb0 msgr2=0x7f4f840abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f88fd8700 1 --2- 172.21.15.62:0/3300691965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f840a7bb0 0x7f4f840abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f88fd8700 1 -- 172.21.15.62:0/3300691965 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c009470 con 0x7f4f840b21f0 2021-12-17T18:18:28.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f83fff700 1 --2- 172.21.15.62:0/3300691965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f840a7bb0 0x7f4f840abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:28.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f88fd8700 1 --2- 172.21.15.62:0/3300691965 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f840b21f0 0x7f4f84065e30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4f7c00c000 tx=0x7f4f7c0091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:28.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f81ffb700 1 -- 172.21.15.62:0/3300691965 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f7c00c850 con 0x7f4f840b21f0 2021-12-17T18:18:28.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f81ffb700 1 -- 172.21.15.62:0/3300691965 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7c00c9b0 con 0x7f4f840b21f0 2021-12-17T18:18:28.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f8aa3b700 1 -- 172.21.15.62:0/3300691965 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6c00b1e0 con 0x7f4f840b21f0 2021-12-17T18:18:28.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f81ffb700 1 -- 172.21.15.62:0/3300691965 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f7c00cd10 con 0x7f4f840b21f0 2021-12-17T18:18:28.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.017+0000 7f4f8aa3b700 1 -- 172.21.15.62:0/3300691965 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f840645b0 con 0x7f4f840b21f0 2021-12-17T18:18:28.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.021+0000 7f4f8aa3b700 1 -- 172.21.15.62:0/3300691965 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f840b2f10 con 0x7f4f840b21f0 2021-12-17T18:18:28.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.021+0000 7f4f81ffb700 1 -- 172.21.15.62:0/3300691965 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4f7c022070 con 0x7f4f840b21f0 2021-12-17T18:18:28.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.021+0000 7f4f81ffb700 1 --2- 172.21.15.62:0/3300691965 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f680536a0 0x7f4f68055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.021+0000 7f4f81ffb700 1 -- 172.21.15.62:0/3300691965 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4f7c06c3b0 con 0x7f4f840b21f0 2021-12-17T18:18:28.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.021+0000 7f4f83fff700 1 --2- 172.21.15.62:0/3300691965 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f680536a0 0x7f4f68055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.025+0000 7f4f83fff700 1 --2- 172.21.15.62:0/3300691965 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f680536a0 0x7f4f68055b60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f4f7400d000 tx=0x7f4f74007c40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:28.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.033+0000 7f4f81ffb700 1 -- 172.21.15.62:0/3300691965 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4f7c043400 con 0x7f4f840b21f0 2021-12-17T18:18:28.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.157+0000 7f4f8aa3b700 1 -- 172.21.15.62:0/3300691965 --> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f84064830 con 0x7f4f680536a0 2021-12-17T18:18:28.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.165+0000 7f4f81ffb700 1 -- 172.21.15.62:0/3300691965 <== mgr.4103 v2:172.21.15.109:6800/14658 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82308 (secure 0 0 0) 0x7f4f74004520 con 0x7f4f680536a0 2021-12-17T18:18:28.171 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:28.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.165+0000 7f4f8aa3b700 1 -- 172.21.15.62:0/3300691965 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f680536a0 msgr2=0x7f4f68055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.165+0000 7f4f8aa3b700 1 --2- 172.21.15.62:0/3300691965 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f680536a0 0x7f4f68055b60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f4f7400d000 tx=0x7f4f74007c40).stop 2021-12-17T18:18:28.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.165+0000 7f4f8aa3b700 1 -- 172.21.15.62:0/3300691965 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f840b21f0 msgr2=0x7f4f84065e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.165+0000 7f4f8aa3b700 1 --2- 172.21.15.62:0/3300691965 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f840b21f0 0x7f4f84065e30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4f7c00c000 tx=0x7f4f7c0091d0).stop 2021-12-17T18:18:28.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.165+0000 7f4f8aa3b700 1 -- 172.21.15.62:0/3300691965 shutdown_connections 2021-12-17T18:18:28.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.165+0000 7f4f8aa3b700 1 --2- 172.21.15.62:0/3300691965 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f680536a0 0x7f4f68055b60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.165+0000 7f4f8aa3b700 1 --2- 172.21.15.62:0/3300691965 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f840b21f0 0x7f4f84065e30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.165+0000 7f4f8aa3b700 1 --2- 172.21.15.62:0/3300691965 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f840b1730 0x7f4f840ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.165+0000 7f4f8aa3b700 1 --2- 172.21.15.62:0/3300691965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f840a7bb0 0x7f4f840abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.165+0000 7f4f8aa3b700 1 -- 172.21.15.62:0/3300691965 >> 172.21.15.62:0/3300691965 conn(0x7f4f8405f730 msgr2=0x7f4f84146e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:28.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.165+0000 7f4f8aa3b700 1 -- 172.21.15.62:0/3300691965 shutdown_connections 2021-12-17T18:18:28.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.165+0000 7f4f8aa3b700 1 -- 172.21.15.62:0/3300691965 wait complete. 2021-12-17T18:18:28.176 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2021-12-17T18:18:28.185 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2021-12-17T18:18:27.533972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390588,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584132,"statfs":{"total":773094113280,"available":764502151168,"internally_reserved":8589934592,"allocated":1961984,"data_stored":710102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.349900"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.200692+0000","last_change":"2021-12-17T18:18:19.199544+0000","last_active":"2021-12-17T18:18:19.200692+0000","last_peered":"2021-12-17T18:18:19.200692+0000","last_clean":"2021-12-17T18:18:19.200692+0000","last_became_active":"2021-12-17T18:18:19.199142+0000","last_became_peered":"2021-12-17T18:18:19.199142+0000","last_unstale":"2021-12-17T18:18:19.200692+0000","last_undegraded":"2021-12-17T18:18:19.200692+0000","last_fullsized":"2021-12-17T18:18:19.200692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_clean_scrub_stamp":"2021-12-17T18:18:18.848432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.198047+0000","last_change":"2021-12-17T18:18:11.029535+0000","last_active":"2021-12-17T18:18:19.198047+0000","last_peered":"2021-12-17T18:18:19.198047+0000","last_clean":"2021-12-17T18:18:19.198047+0000","last_became_active":"2021-12-17T18:18:11.028573+0000","last_became_peered":"2021-12-17T18:18:11.028573+0000","last_unstale":"2021-12-17T18:18:19.198047+0000","last_undegraded":"2021-12-17T18:18:19.198047+0000","last_fullsized":"2021-12-17T18:18:19.198047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:06.521383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:06.521383+0000","last_clean_scrub_stamp":"2021-12-17T18:18:06.521383+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.192548+0000","last_change":"2021-12-17T18:18:15.745704+0000","last_active":"2021-12-17T18:18:19.192548+0000","last_peered":"2021-12-17T18:18:19.192548+0000","last_clean":"2021-12-17T18:18:19.192548+0000","last_became_active":"2021-12-17T18:18:15.744953+0000","last_became_peered":"2021-12-17T18:18:15.744953+0000","last_unstale":"2021-12-17T18:18:19.192548+0000","last_undegraded":"2021-12-17T18:18:19.192548+0000","last_fullsized":"2021-12-17T18:18:19.192548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.195969+0000","last_change":"2021-12-17T18:18:18.872111+0000","last_active":"2021-12-17T18:18:19.195969+0000","last_peered":"2021-12-17T18:18:19.195969+0000","last_clean":"2021-12-17T18:18:19.195969+0000","last_became_active":"2021-12-17T18:18:18.871711+0000","last_became_peered":"2021-12-17T18:18:18.871711+0000","last_unstale":"2021-12-17T18:18:19.195969+0000","last_undegraded":"2021-12-17T18:18:19.195969+0000","last_fullsized":"2021-12-17T18:18:19.195969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_clean_scrub_stamp":"2021-12-17T18:18:17.839888+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.203172+0000","last_change":"2021-12-17T18:18:19.202540+0000","last_active":"2021-12-17T18:18:19.203172+0000","last_peered":"2021-12-17T18:18:19.203172+0000","last_clean":"2021-12-17T18:18:19.203172+0000","last_became_active":"2021-12-17T18:18:19.202192+0000","last_became_peered":"2021-12-17T18:18:19.202192+0000","last_unstale":"2021-12-17T18:18:19.203172+0000","last_undegraded":"2021-12-17T18:18:19.203172+0000","last_fullsized":"2021-12-17T18:18:19.203172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_clean_scrub_stamp":"2021-12-17T18:18:18.848432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.197846+0000","last_change":"2021-12-17T18:18:15.740336+0000","last_active":"2021-12-17T18:18:19.197846+0000","last_peered":"2021-12-17T18:18:19.197846+0000","last_clean":"2021-12-17T18:18:19.197846+0000","last_became_active":"2021-12-17T18:18:15.739646+0000","last_became_peered":"2021-12-17T18:18:15.739646+0000","last_unstale":"2021-12-17T18:18:19.197846+0000","last_undegraded":"2021-12-17T18:18:19.197846+0000","last_fullsized":"2021-12-17T18:18:19.197846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.191254+0000","last_change":"2021-12-17T18:18:18.869339+0000","last_active":"2021-12-17T18:18:19.191254+0000","last_peered":"2021-12-17T18:18:19.191254+0000","last_clean":"2021-12-17T18:18:19.191254+0000","last_became_active":"2021-12-17T18:18:18.868944+0000","last_became_peered":"2021-12-17T18:18:18.868944+0000","last_unstale":"2021-12-17T18:18:19.191254+0000","last_undegraded":"2021-12-17T18:18:19.191254+0000","last_fullsized":"2021-12-17T18:18:19.191254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_clean_scrub_stamp":"2021-12-17T18:18:17.839888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.201965+0000","last_change":"2021-12-17T18:18:19.196826+0000","last_active":"2021-12-17T18:18:19.201965+0000","last_peered":"2021-12-17T18:18:19.201965+0000","last_clean":"2021-12-17T18:18:19.201965+0000","last_became_active":"2021-12-17T18:18:19.196225+0000","last_became_peered":"2021-12-17T18:18:19.196225+0000","last_unstale":"2021-12-17T18:18:19.201965+0000","last_undegraded":"2021-12-17T18:18:19.201965+0000","last_fullsized":"2021-12-17T18:18:19.201965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_clean_scrub_stamp":"2021-12-17T18:18:18.848432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.191656+0000","last_change":"2021-12-17T18:18:16.000008+0000","last_active":"2021-12-17T18:18:19.191656+0000","last_peered":"2021-12-17T18:18:19.191656+0000","last_clean":"2021-12-17T18:18:19.191656+0000","last_became_active":"2021-12-17T18:18:15.998977+0000","last_became_peered":"2021-12-17T18:18:15.998977+0000","last_unstale":"2021-12-17T18:18:19.191656+0000","last_undegraded":"2021-12-17T18:18:19.191656+0000","last_fullsized":"2021-12-17T18:18:19.191656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.202605+0000","last_change":"2021-12-17T18:18:18.866606+0000","last_active":"2021-12-17T18:18:19.202605+0000","last_peered":"2021-12-17T18:18:19.202605+0000","last_clean":"2021-12-17T18:18:19.202605+0000","last_became_active":"2021-12-17T18:18:18.866134+0000","last_became_peered":"2021-12-17T18:18:18.866134+0000","last_unstale":"2021-12-17T18:18:19.202605+0000","last_undegraded":"2021-12-17T18:18:19.202605+0000","last_fullsized":"2021-12-17T18:18:19.202605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_clean_scrub_stamp":"2021-12-17T18:18:17.839888+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.202380+0000","last_change":"2021-12-17T18:18:19.198049+0000","last_active":"2021-12-17T18:18:19.202380+0000","last_peered":"2021-12-17T18:18:19.202380+0000","last_clean":"2021-12-17T18:18:19.202380+0000","last_became_active":"2021-12-17T18:18:19.197423+0000","last_became_peered":"2021-12-17T18:18:19.197423+0000","last_unstale":"2021-12-17T18:18:19.202380+0000","last_undegraded":"2021-12-17T18:18:19.202380+0000","last_fullsized":"2021-12-17T18:18:19.202380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_clean_scrub_stamp":"2021-12-17T18:18:18.848432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.192731+0000","last_change":"2021-12-17T18:18:15.744111+0000","last_active":"2021-12-17T18:18:19.192731+0000","last_peered":"2021-12-17T18:18:19.192731+0000","last_clean":"2021-12-17T18:18:19.192731+0000","last_became_active":"2021-12-17T18:18:15.743756+0000","last_became_peered":"2021-12-17T18:18:15.743756+0000","last_unstale":"2021-12-17T18:18:19.192731+0000","last_undegraded":"2021-12-17T18:18:19.192731+0000","last_fullsized":"2021-12-17T18:18:19.192731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'5","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.203664+0000","last_change":"2021-12-17T18:18:18.869311+0000","last_active":"2021-12-17T18:18:19.203664+0000","last_peered":"2021-12-17T18:18:19.203664+0000","last_clean":"2021-12-17T18:18:19.203664+0000","last_became_active":"2021-12-17T18:18:18.868832+0000","last_became_peered":"2021-12-17T18:18:18.868832+0000","last_unstale":"2021-12-17T18:18:19.203664+0000","last_undegraded":"2021-12-17T18:18:19.203664+0000","last_fullsized":"2021-12-17T18:18:19.203664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_clean_scrub_stamp":"2021-12-17T18:18:17.839888+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.202261+0000","last_change":"2021-12-17T18:18:19.199611+0000","last_active":"2021-12-17T18:18:19.202261+0000","last_peered":"2021-12-17T18:18:19.202261+0000","last_clean":"2021-12-17T18:18:19.202261+0000","last_became_active":"2021-12-17T18:18:19.199251+0000","last_became_peered":"2021-12-17T18:18:19.199251+0000","last_unstale":"2021-12-17T18:18:19.202261+0000","last_undegraded":"2021-12-17T18:18:19.202261+0000","last_fullsized":"2021-12-17T18:18:19.202261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_clean_scrub_stamp":"2021-12-17T18:18:18.848432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.203119+0000","last_change":"2021-12-17T18:18:18.870268+0000","last_active":"2021-12-17T18:18:19.203119+0000","last_peered":"2021-12-17T18:18:19.203119+0000","last_clean":"2021-12-17T18:18:19.203119+0000","last_became_active":"2021-12-17T18:18:18.869868+0000","last_became_peered":"2021-12-17T18:18:18.869868+0000","last_unstale":"2021-12-17T18:18:19.203119+0000","last_undegraded":"2021-12-17T18:18:19.203119+0000","last_fullsized":"2021-12-17T18:18:19.203119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_clean_scrub_stamp":"2021-12-17T18:18:17.839888+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.183226+0000","last_change":"2021-12-17T18:18:16.004167+0000","last_active":"2021-12-17T18:18:19.183226+0000","last_peered":"2021-12-17T18:18:19.183226+0000","last_clean":"2021-12-17T18:18:19.183226+0000","last_became_active":"2021-12-17T18:18:16.003760+0000","last_became_peered":"2021-12-17T18:18:16.003760+0000","last_unstale":"2021-12-17T18:18:19.183226+0000","last_undegraded":"2021-12-17T18:18:19.183226+0000","last_fullsized":"2021-12-17T18:18:19.183226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.200741+0000","last_change":"2021-12-17T18:18:19.197446+0000","last_active":"2021-12-17T18:18:19.200741+0000","last_peered":"2021-12-17T18:18:19.200741+0000","last_clean":"2021-12-17T18:18:19.200741+0000","last_became_active":"2021-12-17T18:18:19.196389+0000","last_became_peered":"2021-12-17T18:18:19.196389+0000","last_unstale":"2021-12-17T18:18:19.200741+0000","last_undegraded":"2021-12-17T18:18:19.200741+0000","last_fullsized":"2021-12-17T18:18:19.200741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_clean_scrub_stamp":"2021-12-17T18:18:18.848432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.204468+0000","last_change":"2021-12-17T18:18:18.866826+0000","last_active":"2021-12-17T18:18:19.204468+0000","last_peered":"2021-12-17T18:18:19.204468+0000","last_clean":"2021-12-17T18:18:19.204468+0000","last_became_active":"2021-12-17T18:18:18.865791+0000","last_became_peered":"2021-12-17T18:18:18.865791+0000","last_unstale":"2021-12-17T18:18:19.204468+0000","last_undegraded":"2021-12-17T18:18:19.204468+0000","last_fullsized":"2021-12-17T18:18:19.204468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_clean_scrub_stamp":"2021-12-17T18:18:17.839888+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.196785+0000","last_change":"2021-12-17T18:18:16.007390+0000","last_active":"2021-12-17T18:18:19.196785+0000","last_peered":"2021-12-17T18:18:19.196785+0000","last_clean":"2021-12-17T18:18:19.196785+0000","last_became_active":"2021-12-17T18:18:16.006472+0000","last_became_peered":"2021-12-17T18:18:16.006472+0000","last_unstale":"2021-12-17T18:18:19.196785+0000","last_undegraded":"2021-12-17T18:18:19.196785+0000","last_fullsized":"2021-12-17T18:18:19.196785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.201516+0000","last_change":"2021-12-17T18:18:19.199241+0000","last_active":"2021-12-17T18:18:19.201516+0000","last_peered":"2021-12-17T18:18:19.201516+0000","last_clean":"2021-12-17T18:18:19.201516+0000","last_became_active":"2021-12-17T18:18:19.198884+0000","last_became_peered":"2021-12-17T18:18:19.198884+0000","last_unstale":"2021-12-17T18:18:19.201516+0000","last_undegraded":"2021-12-17T18:18:19.201516+0000","last_fullsized":"2021-12-17T18:18:19.201516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_clean_scrub_stamp":"2021-12-17T18:18:18.848432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"22'7","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.199276+0000","last_change":"2021-12-17T18:18:18.878116+0000","last_active":"2021-12-17T18:18:19.199276+0000","last_peered":"2021-12-17T18:18:19.199276+0000","last_clean":"2021-12-17T18:18:19.199276+0000","last_became_active":"2021-12-17T18:18:18.877649+0000","last_became_peered":"2021-12-17T18:18:18.877649+0000","last_unstale":"2021-12-17T18:18:19.199276+0000","last_undegraded":"2021-12-17T18:18:19.199276+0000","last_fullsized":"2021-12-17T18:18:19.199276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_clean_scrub_stamp":"2021-12-17T18:18:17.839888+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.182103+0000","last_change":"2021-12-17T18:18:15.740372+0000","last_active":"2021-12-17T18:18:19.182103+0000","last_peered":"2021-12-17T18:18:19.182103+0000","last_clean":"2021-12-17T18:18:19.182103+0000","last_became_active":"2021-12-17T18:18:15.739493+0000","last_became_peered":"2021-12-17T18:18:15.739493+0000","last_unstale":"2021-12-17T18:18:19.182103+0000","last_undegraded":"2021-12-17T18:18:19.182103+0000","last_fullsized":"2021-12-17T18:18:19.182103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.200829+0000","last_change":"2021-12-17T18:18:19.199463+0000","last_active":"2021-12-17T18:18:19.200829+0000","last_peered":"2021-12-17T18:18:19.200829+0000","last_clean":"2021-12-17T18:18:19.200829+0000","last_became_active":"2021-12-17T18:18:19.198875+0000","last_became_peered":"2021-12-17T18:18:19.198875+0000","last_unstale":"2021-12-17T18:18:19.200829+0000","last_undegraded":"2021-12-17T18:18:19.200829+0000","last_fullsized":"2021-12-17T18:18:19.200829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:18.848432+0000","last_clean_scrub_stamp":"2021-12-17T18:18:18.848432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2021-12-17T18:18:20.832147+0000","last_change":"2021-12-17T18:18:18.867085+0000","last_active":"2021-12-17T18:18:20.832147+0000","last_peered":"2021-12-17T18:18:20.832147+0000","last_clean":"2021-12-17T18:18:20.832147+0000","last_became_active":"2021-12-17T18:18:18.866585+0000","last_became_peered":"2021-12-17T18:18:18.866585+0000","last_unstale":"2021-12-17T18:18:20.832147+0000","last_undegraded":"2021-12-17T18:18:20.832147+0000","last_fullsized":"2021-12-17T18:18:20.832147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:17.839888+0000","last_clean_scrub_stamp":"2021-12-17T18:18:17.839888+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-12-17T18:18:19.194871+0000","last_change":"2021-12-17T18:18:15.743498+0000","last_active":"2021-12-17T18:18:19.194871+0000","last_peered":"2021-12-17T18:18:19.194871+0000","last_clean":"2021-12-17T18:18:19.194871+0000","last_became_active":"2021-12-17T18:18:15.742720+0000","last_became_peered":"2021-12-17T18:18:15.742720+0000","last_unstale":"2021-12-17T18:18:19.194871+0000","last_undegraded":"2021-12-17T18:18:19.194871+0000","last_fullsized":"2021-12-17T18:18:19.194871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":88834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048816,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323024,"statfs":{"total":96636764160,"available":95562776576,"internally_reserved":1073741824,"allocated":237568,"data_stored":88259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":88419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":88293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":88994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":89794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":89794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048816,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323024,"statfs":{"total":96636764160,"available":95562776576,"internally_reserved":1073741824,"allocated":237568,"data_stored":87715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]}]}]}} 2021-12-17T18:18:28.187 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-12-17T18:18:28.187 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-12-17T18:18:28.188 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2021-12-17T18:18:28.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-12-17T18:18:28.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.285+0000 7ff4909c1700 1 Processor -- start 2021-12-17T18:18:28.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.285+0000 7ff4909c1700 1 -- start start 2021-12-17T18:18:28.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.285+0000 7ff4909c1700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff48c05ffe0 0x7ff48c0679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.285+0000 7ff4909c1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48c0b2e90 con 0x7ff48c0ad360 2021-12-17T18:18:28.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.285+0000 7ff4909c1700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48c0b4b70 con 0x7ff48c0b57e0 2021-12-17T18:18:28.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.285+0000 7ff4909c1700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48c0b4e10 con 0x7ff48c05ffe0 2021-12-17T18:18:28.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.285+0000 7ff489d9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff48c0ad360 0x7ff48c0b32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60056/0 (socket says 172.21.15.62:60056) 2021-12-17T18:18:28.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.285+0000 7ff489d9b700 1 -- 172.21.15.62:0/3515486127 learned_addr learned my addr 172.21.15.62:0/3515486127 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:28.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.285+0000 7ff48a59c700 1 --2- 172.21.15.62:0/3515486127 >> v2:172.21.15.109:3300/0 conn(0x7ff48c05ffe0 0x7ff48c0679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.285+0000 7ff48959a700 1 -- 172.21.15.62:0/3515486127 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103709601 0 0) 0x7ff48c0b2e90 con 0x7ff48c0ad360 2021-12-17T18:18:28.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.285+0000 7ff48959a700 1 -- 172.21.15.62:0/3515486127 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff46c003260 con 0x7ff48c0ad360 2021-12-17T18:18:28.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff48959a700 1 -- 172.21.15.62:0/3515486127 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2418233215 0 0) 0x7ff46c003260 con 0x7ff48c0ad360 2021-12-17T18:18:28.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff48a59c700 1 -- 172.21.15.62:0/3515486127 >> v1:172.21.15.109:6789/0 conn(0x7ff48c0b57e0 legacy=0x7ff48c1438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff48a59c700 1 -- 172.21.15.62:0/3515486127 >> v1:172.21.15.62:6789/0 conn(0x7ff48c0ad360 legacy=0x7ff48c0b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff48a59c700 1 -- 172.21.15.62:0/3515486127 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c0b52b0 con 0x7ff48c05ffe0 2021-12-17T18:18:28.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff48a59c700 1 --2- 172.21.15.62:0/3515486127 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff48c05ffe0 0x7ff48c0679c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7ff474001800 tx=0x7ff47c0091d0).ready entity=mon.1 client_cookie=1f1ddfdf483276ad server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:28.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff48959a700 1 -- 172.21.15.62:0/3515486127 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff474001660 con 0x7ff48c05ffe0 2021-12-17T18:18:28.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff48959a700 1 -- 172.21.15.62:0/3515486127 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c00b580 con 0x7ff48c05ffe0 2021-12-17T18:18:28.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff48959a700 1 -- 172.21.15.62:0/3515486127 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff47c00b6f0 con 0x7ff48c05ffe0 2021-12-17T18:18:28.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff4909c1700 1 -- 172.21.15.62:0/3515486127 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff48c05ffe0 msgr2=0x7ff48c0679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff4909c1700 1 --2- 172.21.15.62:0/3515486127 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff48c05ffe0 0x7ff48c0679c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7ff474001800 tx=0x7ff47c0091d0).stop 2021-12-17T18:18:28.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff4909c1700 1 -- 172.21.15.62:0/3515486127 shutdown_connections 2021-12-17T18:18:28.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff4909c1700 1 --2- 172.21.15.62:0/3515486127 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff48c05ffe0 0x7ff48c0679c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff4909c1700 1 -- 172.21.15.62:0/3515486127 >> 172.21.15.62:0/3515486127 conn(0x7ff48c0626d0 msgr2=0x7ff48c05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:28.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff4909c1700 1 -- 172.21.15.62:0/3515486127 shutdown_connections 2021-12-17T18:18:28.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff4909c1700 1 -- 172.21.15.62:0/3515486127 wait complete. 2021-12-17T18:18:28.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff4909c1700 1 Processor -- start 2021-12-17T18:18:28.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff4909c1700 1 -- start start 2021-12-17T18:18:28.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff4909c1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff48c05ffe0 0x7ff48c0a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff4909c1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff48c0ad360 0x7ff48c0a3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff4909c1700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff48c0b57e0 0x7ff48c152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff4909c1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c065be0 con 0x7ff48c05ffe0 2021-12-17T18:18:28.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff4909c1700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0656f0 con 0x7ff48c0b57e0 2021-12-17T18:18:28.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff4909c1700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0658b0 con 0x7ff48c0ad360 2021-12-17T18:18:28.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff48a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff48c05ffe0 0x7ff48c0a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff48a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff48c05ffe0 0x7ff48c0a5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48246/0 (socket says 172.21.15.62:48246) 2021-12-17T18:18:28.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff48a59c700 1 -- 172.21.15.62:0/3428974400 learned_addr learned my addr 172.21.15.62:0/3428974400 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:28.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff489d9b700 1 --2- 172.21.15.62:0/3428974400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff48c0ad360 0x7ff48c0a3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff48ad9d700 1 --2- 172.21.15.62:0/3428974400 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff48c0b57e0 0x7ff48c152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff48a59c700 1 -- 172.21.15.62:0/3428974400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff48c0ad360 msgr2=0x7ff48c0a3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff48a59c700 1 --2- 172.21.15.62:0/3428974400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff48c0ad360 0x7ff48c0a3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff48a59c700 1 -- 172.21.15.62:0/3428974400 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff48c0b57e0 msgr2=0x7ff48c152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff48a59c700 1 --2- 172.21.15.62:0/3428974400 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff48c0b57e0 0x7ff48c152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.289+0000 7ff48a59c700 1 -- 172.21.15.62:0/3428974400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c009470 con 0x7ff48c05ffe0 2021-12-17T18:18:28.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.293+0000 7ff48a59c700 1 --2- 172.21.15.62:0/3428974400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff48c05ffe0 0x7ff48c0a5740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7ff474001800 tx=0x7ff47c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:28.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.293+0000 7ff4837fe700 1 -- 172.21.15.62:0/3428974400 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff47c00beb0 con 0x7ff48c05ffe0 2021-12-17T18:18:28.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.293+0000 7ff4837fe700 1 -- 172.21.15.62:0/3428974400 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c00b6f0 con 0x7ff48c05ffe0 2021-12-17T18:18:28.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.293+0000 7ff4909c1700 1 -- 172.21.15.62:0/3428974400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff48c066f90 con 0x7ff48c05ffe0 2021-12-17T18:18:28.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.293+0000 7ff4837fe700 1 -- 172.21.15.62:0/3428974400 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff47c01f5e0 con 0x7ff48c05ffe0 2021-12-17T18:18:28.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.293+0000 7ff4909c1700 1 -- 172.21.15.62:0/3428974400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48c0a37b0 con 0x7ff48c05ffe0 2021-12-17T18:18:28.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.293+0000 7ff4909c1700 1 -- 172.21.15.62:0/3428974400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48c066810 con 0x7ff48c05ffe0 2021-12-17T18:18:28.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.293+0000 7ff4837fe700 1 -- 172.21.15.62:0/3428974400 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff47c026030 con 0x7ff48c05ffe0 2021-12-17T18:18:28.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.293+0000 7ff4837fe700 1 --2- 172.21.15.62:0/3428974400 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff470053640 0x7ff470055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.293+0000 7ff4837fe700 1 -- 172.21.15.62:0/3428974400 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff47c06c380 con 0x7ff48c05ffe0 2021-12-17T18:18:28.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.297+0000 7ff489d9b700 1 --2- 172.21.15.62:0/3428974400 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff470053640 0x7ff470055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.297+0000 7ff489d9b700 1 --2- 172.21.15.62:0/3428974400 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff470053640 0x7ff470055b00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7ff47400b000 tx=0x7ff474000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:28.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.301+0000 7ff4837fe700 1 -- 172.21.15.62:0/3428974400 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff47c0433d0 con 0x7ff48c05ffe0 2021-12-17T18:18:28.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.465+0000 7ff4909c1700 1 -- 172.21.15.62:0/3428974400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff48c0573d0 con 0x7ff48c05ffe0 2021-12-17T18:18:28.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.465+0000 7ff4837fe700 1 -- 172.21.15.62:0/3428974400 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7ff47c0469f0 con 0x7ff48c05ffe0 2021-12-17T18:18:28.473 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:28.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.469+0000 7ff4909c1700 1 -- 172.21.15.62:0/3428974400 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff470053640 msgr2=0x7ff470055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.469+0000 7ff4909c1700 1 --2- 172.21.15.62:0/3428974400 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff470053640 0x7ff470055b00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7ff47400b000 tx=0x7ff474000bc0).stop 2021-12-17T18:18:28.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.469+0000 7ff4909c1700 1 -- 172.21.15.62:0/3428974400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff48c05ffe0 msgr2=0x7ff48c0a5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.469+0000 7ff4909c1700 1 --2- 172.21.15.62:0/3428974400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff48c05ffe0 0x7ff48c0a5740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7ff474001800 tx=0x7ff47c016000).stop 2021-12-17T18:18:28.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.469+0000 7ff4909c1700 1 -- 172.21.15.62:0/3428974400 shutdown_connections 2021-12-17T18:18:28.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.469+0000 7ff4909c1700 1 --2- 172.21.15.62:0/3428974400 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff470053640 0x7ff470055b00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.469+0000 7ff4909c1700 1 --2- 172.21.15.62:0/3428974400 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff48c0b57e0 0x7ff48c152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.469+0000 7ff4909c1700 1 --2- 172.21.15.62:0/3428974400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff48c0ad360 0x7ff48c0a3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.469+0000 7ff4909c1700 1 --2- 172.21.15.62:0/3428974400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff48c05ffe0 0x7ff48c0a5740 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.469+0000 7ff4909c1700 1 -- 172.21.15.62:0/3428974400 >> 172.21.15.62:0/3428974400 conn(0x7ff48c0626d0 msgr2=0x7ff48c0676f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:28.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.469+0000 7ff4909c1700 1 -- 172.21.15.62:0/3428974400 shutdown_connections 2021-12-17T18:18:28.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.469+0000 7ff4909c1700 1 -- 172.21.15.62:0/3428974400 wait complete. 2021-12-17T18:18:28.486 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-12-17T18:18:28.486 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2021-12-17T18:18:28.487 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:28.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4c50bd700 1 Processor -- start 2021-12-17T18:18:28.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4c50bd700 1 -- start start 2021-12-17T18:18:28.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4c50bd700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa4c00b0970 0x7fa4c00b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4c50bd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4c00ac5c0 0x7fa4c0146680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4c50bd700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c00b0d50 con 0x7fa4c00b5730 2021-12-17T18:18:28.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4c50bd700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c00afec0 con 0x7fa4c00b0970 2021-12-17T18:18:28.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4c50bd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c00b5cb0 con 0x7fa4c00ac5c0 2021-12-17T18:18:28.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4be59c700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7fa4c00b5730 0x7fa4c00ae8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:48154/0 (socket says 172.21.15.62:48154) 2021-12-17T18:18:28.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4bf59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4c00ac5c0 0x7fa4c0146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4be59c700 1 -- 172.21.15.62:0/2462456655 learned_addr learned my addr 172.21.15.62:0/2462456655 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:28.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4bed9d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa4c00b0970 0x7fa4c00b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4bed9d700 1 -- 172.21.15.62:0/2462456655 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4c00ac5c0 msgr2=0x7fa4c0146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:28.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4bdd9b700 1 -- 172.21.15.62:0/2462456655 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831229491 0 0) 0x7fa4c00b0d50 con 0x7fa4c00b5730 2021-12-17T18:18:28.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4bed9d700 1 --2- 172.21.15.62:0/2462456655 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4c00ac5c0 0x7fa4c0146680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4bed9d700 1 -- 172.21.15.62:0/2462456655 >> v1:172.21.15.109:6789/0 conn(0x7fa4c00b5730 legacy=0x7fa4c00ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4bed9d700 1 -- 172.21.15.62:0/2462456655 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c00b13e0 con 0x7fa4c00b0970 2021-12-17T18:18:28.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4bf59e700 1 --2- 172.21.15.62:0/2462456655 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4c00ac5c0 0x7fa4c0146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:28.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4bed9d700 1 --2- 172.21.15.62:0/2462456655 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa4c00b0970 0x7fa4c00b1880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa4a8002f70 tx=0x7fa4a8006df0).ready entity=mon.1 client_cookie=e86455e684f988a4 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:28.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4bdd9b700 1 -- 172.21.15.62:0/2462456655 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4a800d570 con 0x7fa4c00b0970 2021-12-17T18:18:28.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4bdd9b700 1 -- 172.21.15.62:0/2462456655 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a8000e90 con 0x7fa4c00b0970 2021-12-17T18:18:28.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4bdd9b700 1 -- 172.21.15.62:0/2462456655 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4a800d8c0 con 0x7fa4c00b0970 2021-12-17T18:18:28.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4c50bd700 1 -- 172.21.15.62:0/2462456655 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa4c00b0970 msgr2=0x7fa4c00b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.585+0000 7fa4c50bd700 1 --2- 172.21.15.62:0/2462456655 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa4c00b0970 0x7fa4c00b1880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa4a8002f70 tx=0x7fa4a8006df0).stop 2021-12-17T18:18:28.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4c50bd700 1 -- 172.21.15.62:0/2462456655 shutdown_connections 2021-12-17T18:18:28.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4c50bd700 1 --2- 172.21.15.62:0/2462456655 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4c00ac5c0 0x7fa4c0146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4c50bd700 1 --2- 172.21.15.62:0/2462456655 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa4c00b0970 0x7fa4c00b1880 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4c50bd700 1 -- 172.21.15.62:0/2462456655 >> 172.21.15.62:0/2462456655 conn(0x7fa4c005cb40 msgr2=0x7fa4c005cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:28.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4c50bd700 1 -- 172.21.15.62:0/2462456655 shutdown_connections 2021-12-17T18:18:28.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4c50bd700 1 -- 172.21.15.62:0/2462456655 wait complete. 2021-12-17T18:18:28.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4c50bd700 1 Processor -- start 2021-12-17T18:18:28.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4c50bd700 1 -- start start 2021-12-17T18:18:28.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4c50bd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa4c00ac5c0 0x7fa4c0067000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4c50bd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4c00b0970 0x7fa4c0157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4c50bd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4c00b5730 0x7fa4c00a7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4c50bd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0145830 con 0x7fa4c00b0970 2021-12-17T18:18:28.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4c50bd700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0157d30 con 0x7fa4c00ac5c0 2021-12-17T18:18:28.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4c50bd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0156e60 con 0x7fa4c00b5730 2021-12-17T18:18:28.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4be59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4c00b0970 0x7fa4c0157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4be59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4c00b0970 0x7fa4c0157840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48262/0 (socket says 172.21.15.62:48262) 2021-12-17T18:18:28.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4be59c700 1 -- 172.21.15.62:0/1843612449 learned_addr learned my addr 172.21.15.62:0/1843612449 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:28.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4bed9d700 1 --2- 172.21.15.62:0/1843612449 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa4c00ac5c0 0x7fa4c0067000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4bf59e700 1 --2- 172.21.15.62:0/1843612449 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4c00b5730 0x7fa4c00a7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4be59c700 1 -- 172.21.15.62:0/1843612449 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4c00b5730 msgr2=0x7fa4c00a7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4be59c700 1 --2- 172.21.15.62:0/1843612449 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4c00b5730 0x7fa4c00a7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4be59c700 1 -- 172.21.15.62:0/1843612449 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa4c00ac5c0 msgr2=0x7fa4c0067000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4be59c700 1 --2- 172.21.15.62:0/1843612449 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa4c00ac5c0 0x7fa4c0067000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4be59c700 1 -- 172.21.15.62:0/1843612449 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b000b180 con 0x7fa4c00b0970 2021-12-17T18:18:28.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4bed9d700 1 --2- 172.21.15.62:0/1843612449 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa4c00ac5c0 0x7fa4c0067000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:28.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.589+0000 7fa4be59c700 1 --2- 172.21.15.62:0/1843612449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4c00b0970 0x7fa4c0157840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fa4b8001250 tx=0x7fa4b80013f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:28.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.593+0000 7fa4b7fff700 1 -- 172.21.15.62:0/1843612449 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4b8005ba0 con 0x7fa4c00b0970 2021-12-17T18:18:28.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.593+0000 7fa4b7fff700 1 -- 172.21.15.62:0/1843612449 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b8005d00 con 0x7fa4c00b0970 2021-12-17T18:18:28.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.593+0000 7fa4c50bd700 1 -- 172.21.15.62:0/1843612449 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a800b180 con 0x7fa4c00b0970 2021-12-17T18:18:28.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.593+0000 7fa4b7fff700 1 -- 172.21.15.62:0/1843612449 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4b80072c0 con 0x7fa4c00b0970 2021-12-17T18:18:28.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.593+0000 7fa4c50bd700 1 -- 172.21.15.62:0/1843612449 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c01573a0 con 0x7fa4c00b0970 2021-12-17T18:18:28.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.593+0000 7fa4c50bd700 1 -- 172.21.15.62:0/1843612449 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c00a7380 con 0x7fa4c00b0970 2021-12-17T18:18:28.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.593+0000 7fa4b7fff700 1 -- 172.21.15.62:0/1843612449 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa4b801a060 con 0x7fa4c00b0970 2021-12-17T18:18:28.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.593+0000 7fa4b7fff700 1 --2- 172.21.15.62:0/1843612449 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa4a40536a0 0x7fa4a4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.593+0000 7fa4b7fff700 1 -- 172.21.15.62:0/1843612449 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa4b806b400 con 0x7fa4c00b0970 2021-12-17T18:18:28.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.593+0000 7fa4bed9d700 1 --2- 172.21.15.62:0/1843612449 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa4a40536a0 0x7fa4a4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.597+0000 7fa4bed9d700 1 --2- 172.21.15.62:0/1843612449 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa4a40536a0 0x7fa4a4055b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fa4a8018000 tx=0x7fa4a8014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:28.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.601+0000 7fa4b7fff700 1 -- 172.21.15.62:0/1843612449 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa4b8042560 con 0x7fa4c00b0970 2021-12-17T18:18:28.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.725+0000 7fa4c50bd700 1 -- 172.21.15.62:0/1843612449 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4c00573d0 con 0x7fa4c00b0970 2021-12-17T18:18:28.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.729+0000 7fa4b7fff700 1 -- 172.21.15.62:0/1843612449 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7fa4b8018070 con 0x7fa4c00b0970 2021-12-17T18:18:28.735 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:28.735 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:20.178383+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:17.128555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:18.180577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:28.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.729+0000 7fa4c50bd700 1 -- 172.21.15.62:0/1843612449 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa4a40536a0 msgr2=0x7fa4a4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.729+0000 7fa4c50bd700 1 --2- 172.21.15.62:0/1843612449 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa4a40536a0 0x7fa4a4055b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fa4a8018000 tx=0x7fa4a8014000).stop 2021-12-17T18:18:28.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.729+0000 7fa4c50bd700 1 -- 172.21.15.62:0/1843612449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4c00b0970 msgr2=0x7fa4c0157840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.729+0000 7fa4c50bd700 1 --2- 172.21.15.62:0/1843612449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4c00b0970 0x7fa4c0157840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fa4b8001250 tx=0x7fa4b80013f0).stop 2021-12-17T18:18:28.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.729+0000 7fa4c50bd700 1 -- 172.21.15.62:0/1843612449 shutdown_connections 2021-12-17T18:18:28.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.729+0000 7fa4c50bd700 1 --2- 172.21.15.62:0/1843612449 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa4a40536a0 0x7fa4a4055b60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.729+0000 7fa4c50bd700 1 --2- 172.21.15.62:0/1843612449 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4c00b5730 0x7fa4c00a7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.729+0000 7fa4c50bd700 1 --2- 172.21.15.62:0/1843612449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4c00b0970 0x7fa4c0157840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.729+0000 7fa4c50bd700 1 --2- 172.21.15.62:0/1843612449 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa4c00ac5c0 0x7fa4c0067000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.729+0000 7fa4c50bd700 1 -- 172.21.15.62:0/1843612449 >> 172.21.15.62:0/1843612449 conn(0x7fa4c005cb40 msgr2=0x7fa4c0148130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:28.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.729+0000 7fa4c50bd700 1 -- 172.21.15.62:0/1843612449 shutdown_connections 2021-12-17T18:18:28.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.729+0000 7fa4c50bd700 1 -- 172.21.15.62:0/1843612449 wait complete. 2021-12-17T18:18:28.748 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:18:17.128555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:18:18.180577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:18:28.748 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:18:28.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.849+0000 7f7b5d251700 1 Processor -- start 2021-12-17T18:18:28.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.849+0000 7f7b5d251700 1 -- start start 2021-12-17T18:18:28.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.849+0000 7f7b5d251700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7b580b5dd0 0x7f7b58146da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b5d251700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7b580b41f0 0x7f7b58141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b5d251700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b580b2010 con 0x7f7b580b05b0 2021-12-17T18:18:28.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b5d251700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b580b0990 con 0x7f7b580b5dd0 2021-12-17T18:18:28.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b5d251700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b58147290 con 0x7f7b580b41f0 2021-12-17T18:18:28.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b4e59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7b580b5dd0 0x7f7b58146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b4e59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7b580b5dd0 0x7f7b58146da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48268/0 (socket says 172.21.15.62:48268) 2021-12-17T18:18:28.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b4e59c700 1 -- 172.21.15.62:0/294232230 learned_addr learned my addr 172.21.15.62:0/294232230 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:28.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b5759e700 1 --2- 172.21.15.62:0/294232230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7b580b41f0 0x7f7b58141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b4e59c700 1 -- 172.21.15.62:0/294232230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7b580b41f0 msgr2=0x7f7b58141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:28.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b4e59c700 1 --2- 172.21.15.62:0/294232230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7b580b41f0 0x7f7b58141fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b4e59c700 1 -- 172.21.15.62:0/294232230 >> v1:172.21.15.109:6789/0 conn(0x7f7b580b05b0 legacy=0x7f7b58146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b4e59c700 1 -- 172.21.15.62:0/294232230 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b580b2240 con 0x7f7b580b5dd0 2021-12-17T18:18:28.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b4e59c700 1 --2- 172.21.15.62:0/294232230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b580b5dd0 0x7f7b58146da0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f7b40002f70 tx=0x7f7b40006eb0).ready entity=mon.0 client_cookie=ebc0b1eec0c43e66 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:28.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b5659c700 1 -- 172.21.15.62:0/294232230 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b4000d5c0 con 0x7f7b580b5dd0 2021-12-17T18:18:28.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b5659c700 1 -- 172.21.15.62:0/294232230 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b40000e90 con 0x7f7b580b5dd0 2021-12-17T18:18:28.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b5659c700 1 -- 172.21.15.62:0/294232230 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b4000d950 con 0x7f7b580b5dd0 2021-12-17T18:18:28.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b5d251700 1 -- 172.21.15.62:0/294232230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b580b5dd0 msgr2=0x7f7b58146da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b5d251700 1 --2- 172.21.15.62:0/294232230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b580b5dd0 0x7f7b58146da0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f7b40002f70 tx=0x7f7b40006eb0).stop 2021-12-17T18:18:28.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b5d251700 1 -- 172.21.15.62:0/294232230 shutdown_connections 2021-12-17T18:18:28.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b5d251700 1 --2- 172.21.15.62:0/294232230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7b580b41f0 0x7f7b58141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b5d251700 1 --2- 172.21.15.62:0/294232230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b580b5dd0 0x7f7b58146da0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b5d251700 1 -- 172.21.15.62:0/294232230 >> 172.21.15.62:0/294232230 conn(0x7f7b58062510 msgr2=0x7f7b580628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:28.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b5d251700 1 -- 172.21.15.62:0/294232230 shutdown_connections 2021-12-17T18:18:28.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.853+0000 7f7b5d251700 1 -- 172.21.15.62:0/294232230 wait complete. 2021-12-17T18:18:28.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b5d251700 1 Processor -- start 2021-12-17T18:18:28.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b5d251700 1 -- start start 2021-12-17T18:18:28.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b5d251700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7b580b05b0 0x7f7b58066fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b5d251700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b580b41f0 0x7f7b580a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b5d251700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7b580b5dd0 0x7f7b58064580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b5d251700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580a38b0 con 0x7f7b580b41f0 2021-12-17T18:18:28.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b5d251700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580a4d60 con 0x7f7b580b5dd0 2021-12-17T18:18:28.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b5d251700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580a5000 con 0x7f7b580b05b0 2021-12-17T18:18:28.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b4e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b580b41f0 0x7f7b580a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b4e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b580b41f0 0x7f7b580a33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48276/0 (socket says 172.21.15.62:48276) 2021-12-17T18:18:28.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b4e59c700 1 -- 172.21.15.62:0/2162622572 learned_addr learned my addr 172.21.15.62:0/2162622572 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:28.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b5759e700 1 --2- 172.21.15.62:0/2162622572 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7b580b5dd0 0x7f7b58064580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b56d9d700 1 --2- 172.21.15.62:0/2162622572 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7b580b05b0 0x7f7b58066fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b4e59c700 1 -- 172.21.15.62:0/2162622572 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7b580b05b0 msgr2=0x7f7b58066fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b4e59c700 1 --2- 172.21.15.62:0/2162622572 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7b580b05b0 0x7f7b58066fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b4e59c700 1 -- 172.21.15.62:0/2162622572 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7b580b5dd0 msgr2=0x7f7b58064580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:28.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b4e59c700 1 --2- 172.21.15.62:0/2162622572 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7b580b5dd0 0x7f7b58064580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:28.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b4e59c700 1 -- 172.21.15.62:0/2162622572 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4000b1e0 con 0x7f7b580b41f0 2021-12-17T18:18:28.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b4e59c700 1 --2- 172.21.15.62:0/2162622572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b580b41f0 0x7f7b580a33c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f7b40002f70 tx=0x7f7b40015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:28.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b54d99700 1 -- 172.21.15.62:0/2162622572 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b40011860 con 0x7f7b580b41f0 2021-12-17T18:18:28.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b54d99700 1 -- 172.21.15.62:0/2162622572 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b400119c0 con 0x7f7b580b41f0 2021-12-17T18:18:28.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b5d251700 1 -- 172.21.15.62:0/2162622572 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b580a52a0 con 0x7f7b580b41f0 2021-12-17T18:18:28.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b54d99700 1 -- 172.21.15.62:0/2162622572 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b40011d20 con 0x7f7b580b41f0 2021-12-17T18:18:28.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b5d251700 1 -- 172.21.15.62:0/2162622572 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b58065a80 con 0x7f7b580b41f0 2021-12-17T18:18:28.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.857+0000 7f7b5d251700 1 -- 172.21.15.62:0/2162622572 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b580a4b90 con 0x7f7b580b41f0 2021-12-17T18:18:28.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.861+0000 7f7b54d99700 1 -- 172.21.15.62:0/2162622572 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7b40025030 con 0x7f7b580b41f0 2021-12-17T18:18:28.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.861+0000 7f7b54d99700 1 --2- 172.21.15.62:0/2162622572 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b300534f0 0x7f7b300559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:28.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.861+0000 7f7b54d99700 1 -- 172.21.15.62:0/2162622572 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7b4006cbb0 con 0x7f7b580b41f0 2021-12-17T18:18:28.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.861+0000 7f7b56d9d700 1 --2- 172.21.15.62:0/2162622572 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b300534f0 0x7f7b300559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:28.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.861+0000 7f7b56d9d700 1 --2- 172.21.15.62:0/2162622572 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b300534f0 0x7f7b300559b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f7b4800b000 tx=0x7f7b48009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:28.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.865+0000 7f7b54d99700 1 -- 172.21.15.62:0/2162622572 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7b40073080 con 0x7f7b580b41f0 2021-12-17T18:18:28.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.993+0000 7f7b5d251700 1 -- 172.21.15.62:0/2162622572 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7b580a5430 con 0x7f7b580b41f0 2021-12-17T18:18:28.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.993+0000 7f7b54d99700 1 -- 172.21.15.62:0/2162622572 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7b40043d50 con 0x7f7b580b41f0 2021-12-17T18:18:29.000 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:18:29.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.997+0000 7f7b5d251700 1 -- 172.21.15.62:0/2162622572 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b300534f0 msgr2=0x7f7b300559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.997+0000 7f7b5d251700 1 --2- 172.21.15.62:0/2162622572 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b300534f0 0x7f7b300559b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f7b4800b000 tx=0x7f7b48009040).stop 2021-12-17T18:18:29.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.997+0000 7f7b5d251700 1 -- 172.21.15.62:0/2162622572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b580b41f0 msgr2=0x7f7b580a33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.997+0000 7f7b5d251700 1 --2- 172.21.15.62:0/2162622572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b580b41f0 0x7f7b580a33c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f7b40002f70 tx=0x7f7b40015000).stop 2021-12-17T18:18:29.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.997+0000 7f7b5d251700 1 -- 172.21.15.62:0/2162622572 shutdown_connections 2021-12-17T18:18:29.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.997+0000 7f7b5d251700 1 --2- 172.21.15.62:0/2162622572 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b300534f0 0x7f7b300559b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.997+0000 7f7b5d251700 1 --2- 172.21.15.62:0/2162622572 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7b580b5dd0 0x7f7b58064580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.997+0000 7f7b5d251700 1 --2- 172.21.15.62:0/2162622572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b580b41f0 0x7f7b580a33c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.997+0000 7f7b5d251700 1 --2- 172.21.15.62:0/2162622572 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7b580b05b0 0x7f7b58066fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.997+0000 7f7b5d251700 1 -- 172.21.15.62:0/2162622572 >> 172.21.15.62:0/2162622572 conn(0x7f7b58062510 msgr2=0x7f7b580b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:29.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.997+0000 7f7b5d251700 1 -- 172.21.15.62:0/2162622572 shutdown_connections 2021-12-17T18:18:29.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:28.997+0000 7f7b5d251700 1 -- 172.21.15.62:0/2162622572 wait complete. 2021-12-17T18:18:29.017 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:18:29.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd2331a700 1 Processor -- start 2021-12-17T18:18:29.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd2331a700 1 -- start start 2021-12-17T18:18:29.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd2331a700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fcd1c05c750 0x7fcd1c05cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd2331a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcd1c060260 0x7fcd1c146f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd2331a700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1c142ff0 con 0x7fcd1c1439d0 2021-12-17T18:18:29.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd2331a700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1c143290 con 0x7fcd1c05c750 2021-12-17T18:18:29.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd2331a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c143530 con 0x7fcd1c060260 2021-12-17T18:18:29.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd208b5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcd1c060260 0x7fcd1c146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd208b5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcd1c060260 0x7fcd1c146f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:41988/0 (socket says 172.21.15.62:41988) 2021-12-17T18:18:29.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd208b5700 1 -- 172.21.15.62:0/683505621 learned_addr learned my addr 172.21.15.62:0/683505621 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:29.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd210b6700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fcd1c05c750 0x7fcd1c05cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd208b5700 1 -- 172.21.15.62:0/683505621 >> v2:172.21.15.109:3300/0 conn(0x7fcd1c05c750 msgr2=0x7fcd1c05cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:29.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd208b5700 1 --2- 172.21.15.62:0/683505621 >> v2:172.21.15.109:3300/0 conn(0x7fcd1c05c750 0x7fcd1c05cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd208b5700 1 -- 172.21.15.62:0/683505621 >> v1:172.21.15.109:6789/0 conn(0x7fcd1c1439d0 legacy=0x7fcd1c0b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd208b5700 1 -- 172.21.15.62:0/683505621 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c0b5390 con 0x7fcd1c060260 2021-12-17T18:18:29.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd208b5700 1 --2- 172.21.15.62:0/683505621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcd1c060260 0x7fcd1c146f70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fcd0c002f70 tx=0x7fcd0c006eb0).ready entity=mon.2 client_cookie=280c817079daa866 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:29.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd13fff700 1 -- 172.21.15.62:0/683505621 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd0c00d570 con 0x7fcd1c060260 2021-12-17T18:18:29.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd13fff700 1 -- 172.21.15.62:0/683505621 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c000e90 con 0x7fcd1c060260 2021-12-17T18:18:29.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.125+0000 7fcd13fff700 1 -- 172.21.15.62:0/683505621 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd0c00d900 con 0x7fcd1c060260 2021-12-17T18:18:29.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.129+0000 7fcd2331a700 1 -- 172.21.15.62:0/683505621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcd1c060260 msgr2=0x7fcd1c146f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.129+0000 7fcd2331a700 1 --2- 172.21.15.62:0/683505621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcd1c060260 0x7fcd1c146f70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fcd0c002f70 tx=0x7fcd0c006eb0).stop 2021-12-17T18:18:29.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.129+0000 7fcd2331a700 1 -- 172.21.15.62:0/683505621 shutdown_connections 2021-12-17T18:18:29.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.129+0000 7fcd2331a700 1 --2- 172.21.15.62:0/683505621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcd1c060260 0x7fcd1c146f70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.129+0000 7fcd2331a700 1 --2- 172.21.15.62:0/683505621 >> v2:172.21.15.109:3300/0 conn(0x7fcd1c05c750 0x7fcd1c05cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.129+0000 7fcd2331a700 1 -- 172.21.15.62:0/683505621 >> 172.21.15.62:0/683505621 conn(0x7fcd1c062430 msgr2=0x7fcd1c062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:29.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.129+0000 7fcd2331a700 1 -- 172.21.15.62:0/683505621 shutdown_connections 2021-12-17T18:18:29.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.129+0000 7fcd2331a700 1 -- 172.21.15.62:0/683505621 wait complete. 2021-12-17T18:18:29.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.129+0000 7fcd2331a700 1 Processor -- start 2021-12-17T18:18:29.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.129+0000 7fcd2331a700 1 -- start start 2021-12-17T18:18:29.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.129+0000 7fcd2331a700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcd1c05c750 0x7fcd1c0670c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.129+0000 7fcd2331a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcd1c060260 0x7fcd1c0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.129+0000 7fcd2331a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd1c1439d0 0x7fcd1c13b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.129+0000 7fcd2331a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c0656c0 con 0x7fcd1c1439d0 2021-12-17T18:18:29.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.129+0000 7fcd2331a700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c152590 con 0x7fcd1c05c750 2021-12-17T18:18:29.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.129+0000 7fcd2331a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c13fc70 con 0x7fcd1c060260 2021-12-17T18:18:29.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd218b7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd1c1439d0 0x7fcd1c13b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd208b5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcd1c060260 0x7fcd1c0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd210b6700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcd1c05c750 0x7fcd1c0670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd218b7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd1c1439d0 0x7fcd1c13b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48292/0 (socket says 172.21.15.62:48292) 2021-12-17T18:18:29.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd218b7700 1 -- 172.21.15.62:0/332757065 learned_addr learned my addr 172.21.15.62:0/332757065 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:29.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd210b6700 1 -- 172.21.15.62:0/332757065 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcd1c060260 msgr2=0x7fcd1c0b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd210b6700 1 --2- 172.21.15.62:0/332757065 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcd1c060260 0x7fcd1c0b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd210b6700 1 -- 172.21.15.62:0/332757065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd1c1439d0 msgr2=0x7fcd1c13b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd210b6700 1 --2- 172.21.15.62:0/332757065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd1c1439d0 0x7fcd1c13b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd210b6700 1 -- 172.21.15.62:0/332757065 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c00b1e0 con 0x7fcd1c05c750 2021-12-17T18:18:29.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd210b6700 1 --2- 172.21.15.62:0/332757065 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcd1c05c750 0x7fcd1c0670c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fcd1c1526d0 tx=0x7fcd18006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:29.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd127fc700 1 -- 172.21.15.62:0/332757065 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd18016070 con 0x7fcd1c05c750 2021-12-17T18:18:29.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd127fc700 1 -- 172.21.15.62:0/332757065 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd18011750 con 0x7fcd1c05c750 2021-12-17T18:18:29.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd127fc700 1 -- 172.21.15.62:0/332757065 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd18011ab0 con 0x7fcd1c05c750 2021-12-17T18:18:29.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd2331a700 1 -- 172.21.15.62:0/332757065 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1c13fea0 con 0x7fcd1c05c750 2021-12-17T18:18:29.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd2331a700 1 -- 172.21.15.62:0/332757065 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1c064a90 con 0x7fcd1c05c750 2021-12-17T18:18:29.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd2331a700 1 -- 172.21.15.62:0/332757065 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1c066ef0 con 0x7fcd1c05c750 2021-12-17T18:18:29.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd127fc700 1 -- 172.21.15.62:0/332757065 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcd18011c10 con 0x7fcd1c05c750 2021-12-17T18:18:29.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd127fc700 1 --2- 172.21.15.62:0/332757065 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcd040534f0 0x7fcd040559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.133+0000 7fcd127fc700 1 -- 172.21.15.62:0/332757065 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcd1806bf30 con 0x7fcd1c05c750 2021-12-17T18:18:29.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.137+0000 7fcd208b5700 1 --2- 172.21.15.62:0/332757065 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcd040534f0 0x7fcd040559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.137+0000 7fcd208b5700 1 --2- 172.21.15.62:0/332757065 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcd040534f0 0x7fcd040559b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fcd0c01c000 tx=0x7fcd0c015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:29.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.145+0000 7fcd127fc700 1 -- 172.21.15.62:0/332757065 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcd18042f80 con 0x7fcd1c05c750 2021-12-17T18:18:29.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.273+0000 7fcd2331a700 1 -- 172.21.15.62:0/332757065 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcd1c0573d0 con 0x7fcd1c05c750 2021-12-17T18:18:29.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.273+0000 7fcd127fc700 1 -- 172.21.15.62:0/332757065 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcd180370a0 con 0x7fcd1c05c750 2021-12-17T18:18:29.279 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:29.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.273+0000 7fcd2331a700 1 -- 172.21.15.62:0/332757065 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcd040534f0 msgr2=0x7fcd040559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.273+0000 7fcd2331a700 1 --2- 172.21.15.62:0/332757065 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcd040534f0 0x7fcd040559b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fcd0c01c000 tx=0x7fcd0c015000).stop 2021-12-17T18:18:29.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.273+0000 7fcd2331a700 1 -- 172.21.15.62:0/332757065 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcd1c05c750 msgr2=0x7fcd1c0670c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.273+0000 7fcd2331a700 1 --2- 172.21.15.62:0/332757065 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcd1c05c750 0x7fcd1c0670c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fcd1c1526d0 tx=0x7fcd18006df0).stop 2021-12-17T18:18:29.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.273+0000 7fcd2331a700 1 -- 172.21.15.62:0/332757065 shutdown_connections 2021-12-17T18:18:29.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.273+0000 7fcd2331a700 1 --2- 172.21.15.62:0/332757065 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcd040534f0 0x7fcd040559b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.273+0000 7fcd2331a700 1 --2- 172.21.15.62:0/332757065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd1c1439d0 0x7fcd1c13b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.273+0000 7fcd2331a700 1 --2- 172.21.15.62:0/332757065 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcd1c060260 0x7fcd1c0b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.273+0000 7fcd2331a700 1 --2- 172.21.15.62:0/332757065 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcd1c05c750 0x7fcd1c0670c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.273+0000 7fcd2331a700 1 -- 172.21.15.62:0/332757065 >> 172.21.15.62:0/332757065 conn(0x7fcd1c062430 msgr2=0x7fcd1c0b8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:29.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.273+0000 7fcd2331a700 1 -- 172.21.15.62:0/332757065 shutdown_connections 2021-12-17T18:18:29.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.273+0000 7fcd2331a700 1 -- 172.21.15.62:0/332757065 wait complete. 2021-12-17T18:18:29.292 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:18:29.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bf59e700 1 Processor -- start 2021-12-17T18:18:29.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bf59e700 1 -- start start 2021-12-17T18:18:29.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bf59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd8c005ca90 0x7fd8c00b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bf59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd8c00b4a40 0x7fd8c014ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bf59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8c00b23d0 0x7fd8c00b2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bf59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c00b0ff0 con 0x7fd8c005ca90 2021-12-17T18:18:29.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bf59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c00b46a0 con 0x7fd8c00b4a40 2021-12-17T18:18:29.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bf59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c005ce70 con 0x7fd8c00b23d0 2021-12-17T18:18:29.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8be59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd8c005ca90 0x7fd8c00b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8be59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd8c005ca90 0x7fd8c00b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48296/0 (socket says 172.21.15.62:48296) 2021-12-17T18:18:29.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8be59c700 1 -- 172.21.15.62:0/2045306826 learned_addr learned my addr 172.21.15.62:0/2045306826 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:29.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bdd9b700 1 --2- 172.21.15.62:0/2045306826 >> v2:172.21.15.109:3300/0 conn(0x7fd8c00b4a40 0x7fd8c014ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bed9d700 1 --2- 172.21.15.62:0/2045306826 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8c00b23d0 0x7fd8c00b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bdd9b700 1 -- 172.21.15.62:0/2045306826 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8c00b23d0 msgr2=0x7fd8c00b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:29.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bdd9b700 1 --2- 172.21.15.62:0/2045306826 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8c00b23d0 0x7fd8c00b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bdd9b700 1 -- 172.21.15.62:0/2045306826 >> v2:172.21.15.62:3300/0 conn(0x7fd8c005ca90 msgr2=0x7fd8c00b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:29.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bdd9b700 1 --2- 172.21.15.62:0/2045306826 >> v2:172.21.15.62:3300/0 conn(0x7fd8c005ca90 0x7fd8c00b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bdd9b700 1 -- 172.21.15.62:0/2045306826 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c00b4230 con 0x7fd8c00b4a40 2021-12-17T18:18:29.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8be59c700 1 --2- 172.21.15.62:0/2045306826 >> v2:172.21.15.62:3300/0 conn(0x7fd8c005ca90 0x7fd8c00b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:29.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bdd9b700 1 --2- 172.21.15.62:0/2045306826 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8c00b4a40 0x7fd8c014ad40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fd8c00b4500 tx=0x7fd8a8006df0).ready entity=mon.1 client_cookie=438537e8301f2ceb server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:29.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bd59a700 1 -- 172.21.15.62:0/2045306826 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a800d4a0 con 0x7fd8c00b4a40 2021-12-17T18:18:29.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bd59a700 1 -- 172.21.15.62:0/2045306826 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a8000e90 con 0x7fd8c00b4a40 2021-12-17T18:18:29.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.401+0000 7fd8bd59a700 1 -- 172.21.15.62:0/2045306826 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a800d7f0 con 0x7fd8c00b4a40 2021-12-17T18:18:29.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.405+0000 7fd8bf59e700 1 -- 172.21.15.62:0/2045306826 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8c00b4a40 msgr2=0x7fd8c014ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.405+0000 7fd8bf59e700 1 --2- 172.21.15.62:0/2045306826 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8c00b4a40 0x7fd8c014ad40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fd8c00b4500 tx=0x7fd8a8006df0).stop 2021-12-17T18:18:29.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.405+0000 7fd8bf59e700 1 -- 172.21.15.62:0/2045306826 shutdown_connections 2021-12-17T18:18:29.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.405+0000 7fd8bf59e700 1 --2- 172.21.15.62:0/2045306826 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8c00b23d0 0x7fd8c00b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.405+0000 7fd8bf59e700 1 --2- 172.21.15.62:0/2045306826 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8c00b4a40 0x7fd8c014ad40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.405+0000 7fd8bf59e700 1 --2- 172.21.15.62:0/2045306826 >> v2:172.21.15.62:3300/0 conn(0x7fd8c005ca90 0x7fd8c00b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.405+0000 7fd8bf59e700 1 -- 172.21.15.62:0/2045306826 >> 172.21.15.62:0/2045306826 conn(0x7fd8c005bcd0 msgr2=0x7fd8c0062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:29.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.405+0000 7fd8bf59e700 1 -- 172.21.15.62:0/2045306826 shutdown_connections 2021-12-17T18:18:29.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.405+0000 7fd8bf59e700 1 -- 172.21.15.62:0/2045306826 wait complete. 2021-12-17T18:18:29.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.405+0000 7fd8bf59e700 1 Processor -- start 2021-12-17T18:18:29.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.405+0000 7fd8bf59e700 1 -- start start 2021-12-17T18:18:29.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8bf59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8c005ca90 0x7fd8c014aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8bf59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8c00b23d0 0x7fd8c015a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8bf59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8c00b4a40 0x7fd8c015a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8bf59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c0159e40 con 0x7fd8c005ca90 2021-12-17T18:18:29.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8bf59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c015ac50 con 0x7fd8c00b4a40 2021-12-17T18:18:29.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8bf59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c0144580 con 0x7fd8c00b23d0 2021-12-17T18:18:29.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8be59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8c005ca90 0x7fd8c014aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8be59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8c005ca90 0x7fd8c014aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48302/0 (socket says 172.21.15.62:48302) 2021-12-17T18:18:29.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8be59c700 1 -- 172.21.15.62:0/3632205621 learned_addr learned my addr 172.21.15.62:0/3632205621 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:29.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8bdd9b700 1 --2- 172.21.15.62:0/3632205621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8c00b23d0 0x7fd8c015a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8bed9d700 1 --2- 172.21.15.62:0/3632205621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8c00b4a40 0x7fd8c015a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8be59c700 1 -- 172.21.15.62:0/3632205621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8c00b23d0 msgr2=0x7fd8c015a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8be59c700 1 --2- 172.21.15.62:0/3632205621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8c00b23d0 0x7fd8c015a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8be59c700 1 -- 172.21.15.62:0/3632205621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8c00b4a40 msgr2=0x7fd8c015a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8be59c700 1 --2- 172.21.15.62:0/3632205621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8c00b4a40 0x7fd8c015a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8be59c700 1 -- 172.21.15.62:0/3632205621 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b000b1e0 con 0x7fd8c005ca90 2021-12-17T18:18:29.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8bdd9b700 1 --2- 172.21.15.62:0/3632205621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8c00b23d0 0x7fd8c015a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:29.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8be59c700 1 --2- 172.21.15.62:0/3632205621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8c005ca90 0x7fd8c014aaa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fd8b000c000 tx=0x7fd8b0006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:29.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8b77fe700 1 -- 172.21.15.62:0/3632205621 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8b0012600 con 0x7fd8c005ca90 2021-12-17T18:18:29.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8b77fe700 1 -- 172.21.15.62:0/3632205621 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b0012760 con 0x7fd8c005ca90 2021-12-17T18:18:29.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8bf59e700 1 -- 172.21.15.62:0/3632205621 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a800b180 con 0x7fd8c005ca90 2021-12-17T18:18:29.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8b77fe700 1 -- 172.21.15.62:0/3632205621 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8b0012ac0 con 0x7fd8c005ca90 2021-12-17T18:18:29.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8bf59e700 1 -- 172.21.15.62:0/3632205621 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c0144200 con 0x7fd8c005ca90 2021-12-17T18:18:29.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8bf59e700 1 -- 172.21.15.62:0/3632205621 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c0159fb0 con 0x7fd8c005ca90 2021-12-17T18:18:29.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.409+0000 7fd8b77fe700 1 -- 172.21.15.62:0/3632205621 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd8b0022070 con 0x7fd8c005ca90 2021-12-17T18:18:29.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.413+0000 7fd8b77fe700 1 --2- 172.21.15.62:0/3632205621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd8a40536a0 0x7fd8a4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.413+0000 7fd8b77fe700 1 -- 172.21.15.62:0/3632205621 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd8b006bf70 con 0x7fd8c005ca90 2021-12-17T18:18:29.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.413+0000 7fd8bdd9b700 1 --2- 172.21.15.62:0/3632205621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd8a40536a0 0x7fd8a4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.413+0000 7fd8bdd9b700 1 --2- 172.21.15.62:0/3632205621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd8a40536a0 0x7fd8a4055b60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fd8a801a000 tx=0x7fd8a8014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:29.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.417+0000 7fd8b77fe700 1 -- 172.21.15.62:0/3632205621 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd8b0042fc0 con 0x7fd8c005ca90 2021-12-17T18:18:29.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.541+0000 7fd8bf59e700 1 -- 172.21.15.62:0/3632205621 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8c00b1f30 con 0x7fd8c005ca90 2021-12-17T18:18:29.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.545+0000 7fd8b77fe700 1 -- 172.21.15.62:0/3632205621 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd8b00465e0 con 0x7fd8c005ca90 2021-12-17T18:18:29.550 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:29.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.545+0000 7fd8bf59e700 1 -- 172.21.15.62:0/3632205621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd8a40536a0 msgr2=0x7fd8a4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.545+0000 7fd8bf59e700 1 --2- 172.21.15.62:0/3632205621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd8a40536a0 0x7fd8a4055b60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fd8a801a000 tx=0x7fd8a8014000).stop 2021-12-17T18:18:29.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.545+0000 7fd8bf59e700 1 -- 172.21.15.62:0/3632205621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8c005ca90 msgr2=0x7fd8c014aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.545+0000 7fd8bf59e700 1 --2- 172.21.15.62:0/3632205621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8c005ca90 0x7fd8c014aaa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fd8b000c000 tx=0x7fd8b0006eb0).stop 2021-12-17T18:18:29.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.545+0000 7fd8bf59e700 1 -- 172.21.15.62:0/3632205621 shutdown_connections 2021-12-17T18:18:29.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.545+0000 7fd8bf59e700 1 --2- 172.21.15.62:0/3632205621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd8a40536a0 0x7fd8a4055b60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.545+0000 7fd8bf59e700 1 --2- 172.21.15.62:0/3632205621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8c00b4a40 0x7fd8c015a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.545+0000 7fd8bf59e700 1 --2- 172.21.15.62:0/3632205621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8c00b23d0 0x7fd8c015a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.545+0000 7fd8bf59e700 1 --2- 172.21.15.62:0/3632205621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8c005ca90 0x7fd8c014aaa0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.545+0000 7fd8bf59e700 1 -- 172.21.15.62:0/3632205621 >> 172.21.15.62:0/3632205621 conn(0x7fd8c005bcd0 msgr2=0x7fd8c014c780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:29.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.545+0000 7fd8bf59e700 1 -- 172.21.15.62:0/3632205621 shutdown_connections 2021-12-17T18:18:29.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.545+0000 7fd8bf59e700 1 -- 172.21.15.62:0/3632205621 wait complete. 2021-12-17T18:18:29.563 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:18:29.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f6091ab0700 1 Processor -- start 2021-12-17T18:18:29.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f6091ab0700 1 -- start start 2021-12-17T18:18:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f6091ab0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f608c067830 0x7f608c0b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f6091ab0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f608c0b0c90 0x7f608c0b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f6091ab0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608c143940 con 0x7f608c0b2d00 2021-12-17T18:18:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f6091ab0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608c0ad6a0 con 0x7f608c0b0c90 2021-12-17T18:18:29.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f6091ab0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c067c10 con 0x7f608c067830 2021-12-17T18:18:29.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f608affd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f608c0b0c90 0x7f608c0b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f608bfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f608c0b2d00 0x7f608c142220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60124/0 (socket says 172.21.15.62:60124) 2021-12-17T18:18:29.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f608bfff700 1 -- 172.21.15.62:0/873221923 learned_addr learned my addr 172.21.15.62:0/873221923 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:29.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f608b7fe700 1 --2- 172.21.15.62:0/873221923 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f608c067830 0x7f608c0b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f608a7fc700 1 -- 172.21.15.62:0/873221923 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491096562 0 0) 0x7f608c143940 con 0x7f608c0b2d00 2021-12-17T18:18:29.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f608a7fc700 1 -- 172.21.15.62:0/873221923 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6078003260 con 0x7f608c0b2d00 2021-12-17T18:18:29.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f608affd700 1 -- 172.21.15.62:0/873221923 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f608c067830 msgr2=0x7f608c0b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:29.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f608affd700 1 --2- 172.21.15.62:0/873221923 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f608c067830 0x7f608c0b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f608affd700 1 -- 172.21.15.62:0/873221923 >> v1:172.21.15.62:6789/0 conn(0x7f608c0b2d00 legacy=0x7f608c142220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f608affd700 1 -- 172.21.15.62:0/873221923 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c0b2240 con 0x7f608c0b0c90 2021-12-17T18:18:29.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f608b7fe700 1 --2- 172.21.15.62:0/873221923 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f608c067830 0x7f608c0b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:29.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f608affd700 1 --2- 172.21.15.62:0/873221923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f608c0b0c90 0x7f608c0b2810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f6080002f70 tx=0x7f6080006df0).ready entity=mon.0 client_cookie=cc37710ee6e4bd4d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:29.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f608a7fc700 1 -- 172.21.15.62:0/873221923 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f608000d570 con 0x7f608c0b0c90 2021-12-17T18:18:29.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f608a7fc700 1 -- 172.21.15.62:0/873221923 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6080000e90 con 0x7f608c0b0c90 2021-12-17T18:18:29.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.669+0000 7f608a7fc700 1 -- 172.21.15.62:0/873221923 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f608000d900 con 0x7f608c0b0c90 2021-12-17T18:18:29.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f6091ab0700 1 -- 172.21.15.62:0/873221923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f608c0b0c90 msgr2=0x7f608c0b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f6091ab0700 1 --2- 172.21.15.62:0/873221923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f608c0b0c90 0x7f608c0b2810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f6080002f70 tx=0x7f6080006df0).stop 2021-12-17T18:18:29.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f6091ab0700 1 -- 172.21.15.62:0/873221923 shutdown_connections 2021-12-17T18:18:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f6091ab0700 1 --2- 172.21.15.62:0/873221923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f608c0b0c90 0x7f608c0b2810 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f6091ab0700 1 --2- 172.21.15.62:0/873221923 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f608c067830 0x7f608c0b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f6091ab0700 1 -- 172.21.15.62:0/873221923 >> 172.21.15.62:0/873221923 conn(0x7f608c05cac0 msgr2=0x7f608c05ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f6091ab0700 1 -- 172.21.15.62:0/873221923 shutdown_connections 2021-12-17T18:18:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f6091ab0700 1 -- 172.21.15.62:0/873221923 wait complete. 2021-12-17T18:18:29.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f6091ab0700 1 Processor -- start 2021-12-17T18:18:29.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f6091ab0700 1 -- start start 2021-12-17T18:18:29.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f6091ab0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f608c067830 0x7f608c144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f6091ab0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f608c0b0c90 0x7f608c152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f6091ab0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f608c0b2d00 0x7f608c155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f6091ab0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c152640 con 0x7f608c0b2d00 2021-12-17T18:18:29.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f6091ab0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c155800 con 0x7f608c0b0c90 2021-12-17T18:18:29.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f6091ab0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c113200 con 0x7f608c067830 2021-12-17T18:18:29.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f608bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f608c0b2d00 0x7f608c155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f608bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f608c0b2d00 0x7f608c155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48320/0 (socket says 172.21.15.62:48320) 2021-12-17T18:18:29.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f608bfff700 1 -- 172.21.15.62:0/2548943352 learned_addr learned my addr 172.21.15.62:0/2548943352 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:29.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f608b7fe700 1 --2- 172.21.15.62:0/2548943352 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f608c067830 0x7f608c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.673+0000 7f608affd700 1 --2- 172.21.15.62:0/2548943352 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f608c0b0c90 0x7f608c152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.677+0000 7f608bfff700 1 -- 172.21.15.62:0/2548943352 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f608c067830 msgr2=0x7f608c144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.677+0000 7f608bfff700 1 --2- 172.21.15.62:0/2548943352 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f608c067830 0x7f608c144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.677+0000 7f608bfff700 1 -- 172.21.15.62:0/2548943352 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f608c0b0c90 msgr2=0x7f608c152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.677+0000 7f608bfff700 1 --2- 172.21.15.62:0/2548943352 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f608c0b0c90 0x7f608c152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.677+0000 7f608bfff700 1 -- 172.21.15.62:0/2548943352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608000b180 con 0x7f608c0b2d00 2021-12-17T18:18:29.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.677+0000 7f608affd700 1 --2- 172.21.15.62:0/2548943352 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f608c0b0c90 0x7f608c152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:29.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.677+0000 7f608bfff700 1 --2- 172.21.15.62:0/2548943352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f608c0b2d00 0x7f608c155c30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f6084001490 tx=0x7f6084007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:29.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.677+0000 7f6088ff9700 1 -- 172.21.15.62:0/2548943352 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6084005ba0 con 0x7f608c0b2d00 2021-12-17T18:18:29.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.677+0000 7f6088ff9700 1 -- 172.21.15.62:0/2548943352 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6084005d00 con 0x7f608c0b2d00 2021-12-17T18:18:29.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.677+0000 7f6091ab0700 1 -- 172.21.15.62:0/2548943352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608c1134a0 con 0x7f608c0b2d00 2021-12-17T18:18:29.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.677+0000 7f6088ff9700 1 -- 172.21.15.62:0/2548943352 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60840072c0 con 0x7f608c0b2d00 2021-12-17T18:18:29.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.677+0000 7f6091ab0700 1 -- 172.21.15.62:0/2548943352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608c10f7a0 con 0x7f608c0b2d00 2021-12-17T18:18:29.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.677+0000 7f6091ab0700 1 -- 172.21.15.62:0/2548943352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608c0b4740 con 0x7f608c0b2d00 2021-12-17T18:18:29.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.677+0000 7f6088ff9700 1 -- 172.21.15.62:0/2548943352 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6084010070 con 0x7f608c0b2d00 2021-12-17T18:18:29.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.677+0000 7f6088ff9700 1 --2- 172.21.15.62:0/2548943352 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f606c053640 0x7f606c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.681+0000 7f6088ff9700 1 -- 172.21.15.62:0/2548943352 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f608406b2b0 con 0x7f608c0b2d00 2021-12-17T18:18:29.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.681+0000 7f608b7fe700 1 --2- 172.21.15.62:0/2548943352 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f606c053640 0x7f606c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.681+0000 7f608b7fe700 1 --2- 172.21.15.62:0/2548943352 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f606c053640 0x7f606c055b00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f607c00c000 tx=0x7f607c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:29.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.685+0000 7f6088ff9700 1 -- 172.21.15.62:0/2548943352 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f608c0b4740 con 0x7f608c0b2d00 2021-12-17T18:18:29.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.813+0000 7f6091ab0700 1 -- 172.21.15.62:0/2548943352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f608c0b4740 con 0x7f608c0b2d00 2021-12-17T18:18:29.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.813+0000 7f6088ff9700 1 -- 172.21.15.62:0/2548943352 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f608c0b4740 con 0x7f608c0b2d00 2021-12-17T18:18:29.820 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:29.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.817+0000 7f6091ab0700 1 -- 172.21.15.62:0/2548943352 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f606c053640 msgr2=0x7f606c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.817+0000 7f6091ab0700 1 --2- 172.21.15.62:0/2548943352 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f606c053640 0x7f606c055b00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f607c00c000 tx=0x7f607c008040).stop 2021-12-17T18:18:29.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.817+0000 7f6091ab0700 1 -- 172.21.15.62:0/2548943352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f608c0b2d00 msgr2=0x7f608c155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.817+0000 7f6091ab0700 1 --2- 172.21.15.62:0/2548943352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f608c0b2d00 0x7f608c155c30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f6084001490 tx=0x7f6084007e00).stop 2021-12-17T18:18:29.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.817+0000 7f6091ab0700 1 -- 172.21.15.62:0/2548943352 shutdown_connections 2021-12-17T18:18:29.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.817+0000 7f6091ab0700 1 --2- 172.21.15.62:0/2548943352 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f606c053640 0x7f606c055b00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.817+0000 7f6091ab0700 1 --2- 172.21.15.62:0/2548943352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f608c0b2d00 0x7f608c155c30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.817+0000 7f6091ab0700 1 --2- 172.21.15.62:0/2548943352 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f608c0b0c90 0x7f608c152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.817+0000 7f6091ab0700 1 --2- 172.21.15.62:0/2548943352 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f608c067830 0x7f608c144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.817+0000 7f6091ab0700 1 -- 172.21.15.62:0/2548943352 >> 172.21.15.62:0/2548943352 conn(0x7f608c05cac0 msgr2=0x7f608c0b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:29.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.817+0000 7f6091ab0700 1 -- 172.21.15.62:0/2548943352 shutdown_connections 2021-12-17T18:18:29.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.817+0000 7f6091ab0700 1 -- 172.21.15.62:0/2548943352 wait complete. 2021-12-17T18:18:29.833 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:18:29.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.929+0000 7f8621f59700 1 Processor -- start 2021-12-17T18:18:29.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.929+0000 7f8621f59700 1 -- start start 2021-12-17T18:18:29.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8621f59700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f861c0acbd0 0x7f861c05fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8621f59700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861c067530 con 0x7f861c0b19c0 2021-12-17T18:18:29.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8621f59700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861c0acfb0 con 0x7f861c060530 2021-12-17T18:18:29.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8621f59700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f861c140290 con 0x7f861c0acbd0 2021-12-17T18:18:29.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8613fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f861c0b19c0 0x7f861c0b1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60138/0 (socket says 172.21.15.62:60138) 2021-12-17T18:18:29.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8613fff700 1 -- 172.21.15.62:0/583352648 learned_addr learned my addr 172.21.15.62:0/583352648 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:29.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8620f57700 1 --2- 172.21.15.62:0/583352648 >> v2:172.21.15.109:3300/0 conn(0x7f861c0acbd0 0x7f861c05fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 -- 172.21.15.62:0/583352648 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115170767 0 0) 0x7f861c067530 con 0x7f861c0b19c0 2021-12-17T18:18:29.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 -- 172.21.15.62:0/583352648 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8608003260 con 0x7f861c0b19c0 2021-12-17T18:18:29.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 -- 172.21.15.62:0/583352648 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3649398342 0 0) 0x7f8608003260 con 0x7f861c0b19c0 2021-12-17T18:18:29.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 -- 172.21.15.62:0/583352648 >> v2:172.21.15.109:3300/0 conn(0x7f861c0acbd0 msgr2=0x7f861c05fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:29.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 --2- 172.21.15.62:0/583352648 >> v2:172.21.15.109:3300/0 conn(0x7f861c0acbd0 0x7f861c05fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 -- 172.21.15.62:0/583352648 >> v1:172.21.15.109:6789/0 conn(0x7f861c060530 legacy=0x7f861c0ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 -- 172.21.15.62:0/583352648 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c140530 con 0x7f861c0b19c0 2021-12-17T18:18:29.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 -- 172.21.15.62:0/583352648 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f860c001660 con 0x7f861c0b19c0 2021-12-17T18:18:29.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 -- 172.21.15.62:0/583352648 >> v1:172.21.15.62:6789/0 conn(0x7f861c0b19c0 legacy=0x7f861c0b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 --2- 172.21.15.62:0/583352648 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8608003750 0x7f8608003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 --2- 172.21.15.62:0/583352648 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8608004500 0x7f8608004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 --2- 172.21.15.62:0/583352648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8608004e70 0x7f860800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 -- 172.21.15.62:0/583352648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c140290 con 0x7f8608004e70 2021-12-17T18:18:29.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 -- 172.21.15.62:0/583352648 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860800bd20 con 0x7f8608004500 2021-12-17T18:18:29.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 -- 172.21.15.62:0/583352648 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860800bee0 con 0x7f8608003750 2021-12-17T18:18:29.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8621758700 1 --2- 172.21.15.62:0/583352648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8608004e70 0x7f860800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8613fff700 1 --2- 172.21.15.62:0/583352648 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8608004500 0x7f8608004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8620f57700 1 --2- 172.21.15.62:0/583352648 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8608003750 0x7f8608003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8621758700 1 -- 172.21.15.62:0/583352648 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8608003750 msgr2=0x7f8608003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:29.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8621758700 1 --2- 172.21.15.62:0/583352648 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8608003750 0x7f8608003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8621758700 1 -- 172.21.15.62:0/583352648 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8608004500 msgr2=0x7f8608004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:29.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8621758700 1 --2- 172.21.15.62:0/583352648 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8608004500 0x7f8608004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8621758700 1 -- 172.21.15.62:0/583352648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8608003260 con 0x7f8608004e70 2021-12-17T18:18:29.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8613fff700 1 --2- 172.21.15.62:0/583352648 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8608004500 0x7f8608004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:29.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8621758700 1 -- 172.21.15.62:0/583352648 reap_dead start 2021-12-17T18:18:29.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8621758700 1 --2- 172.21.15.62:0/583352648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8608004e70 0x7f860800b750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f861c0614e0 tx=0x7f8614007d80).ready entity=mon.0 client_cookie=71161b8000782f3e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:29.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 -- 172.21.15.62:0/583352648 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8614001620 con 0x7f8608004e70 2021-12-17T18:18:29.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 -- 172.21.15.62:0/583352648 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8614006890 con 0x7f8608004e70 2021-12-17T18:18:29.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f86137fe700 1 -- 172.21.15.62:0/583352648 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8614006bf0 con 0x7f8608004e70 2021-12-17T18:18:29.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8621f59700 1 -- 172.21.15.62:0/583352648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8608004e70 msgr2=0x7f860800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.933+0000 7f8621f59700 1 --2- 172.21.15.62:0/583352648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8608004e70 0x7f860800b750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f861c0614e0 tx=0x7f8614007d80).stop 2021-12-17T18:18:29.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621f59700 1 -- 172.21.15.62:0/583352648 shutdown_connections 2021-12-17T18:18:29.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621f59700 1 --2- 172.21.15.62:0/583352648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8608004e70 0x7f860800b750 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621f59700 1 -- 172.21.15.62:0/583352648 >> 172.21.15.62:0/583352648 conn(0x7f861c05d220 msgr2=0x7f861c0b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:29.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621f59700 1 -- 172.21.15.62:0/583352648 shutdown_connections 2021-12-17T18:18:29.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621f59700 1 -- 172.21.15.62:0/583352648 wait complete. 2021-12-17T18:18:29.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621f59700 1 Processor -- start 2021-12-17T18:18:29.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621f59700 1 -- start start 2021-12-17T18:18:29.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621f59700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8608004e70 0x7f861c13eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621f59700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f861c064ec0 0x7f861c153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621f59700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f861c153610 0x7f861c153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621f59700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c1431d0 con 0x7f861c153610 2021-12-17T18:18:29.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621f59700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c0666e0 con 0x7f861c064ec0 2021-12-17T18:18:29.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621f59700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861c153f90 con 0x7f8608004e70 2021-12-17T18:18:29.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621758700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f861c153610 0x7f861c153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8620f57700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8608004e70 0x7f861c13eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621758700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f861c153610 0x7f861c153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48340/0 (socket says 172.21.15.62:48340) 2021-12-17T18:18:29.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621758700 1 -- 172.21.15.62:0/1647848382 learned_addr learned my addr 172.21.15.62:0/1647848382 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:29.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8613fff700 1 --2- 172.21.15.62:0/1647848382 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f861c064ec0 0x7f861c153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621758700 1 -- 172.21.15.62:0/1647848382 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8608004e70 msgr2=0x7f861c13eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621758700 1 --2- 172.21.15.62:0/1647848382 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8608004e70 0x7f861c13eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621758700 1 -- 172.21.15.62:0/1647848382 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f861c064ec0 msgr2=0x7f861c153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:29.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621758700 1 --2- 172.21.15.62:0/1647848382 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f861c064ec0 0x7f861c153120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:29.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621758700 1 -- 172.21.15.62:0/1647848382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c139960 con 0x7f861c153610 2021-12-17T18:18:29.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.937+0000 7f8621758700 1 --2- 172.21.15.62:0/1647848382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f861c153610 0x7f861c153aa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f861c0614e0 tx=0x7f8614016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:29.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.941+0000 7f8611ffb700 1 -- 172.21.15.62:0/1647848382 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8614001620 con 0x7f861c153610 2021-12-17T18:18:29.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.941+0000 7f8611ffb700 1 -- 172.21.15.62:0/1647848382 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861400c860 con 0x7f861c153610 2021-12-17T18:18:29.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.941+0000 7f8611ffb700 1 -- 172.21.15.62:0/1647848382 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f861400cbc0 con 0x7f861c153610 2021-12-17T18:18:29.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.941+0000 7f8621f59700 1 -- 172.21.15.62:0/1647848382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861c139c00 con 0x7f861c153610 2021-12-17T18:18:29.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.941+0000 7f8621f59700 1 -- 172.21.15.62:0/1647848382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861c137ad0 con 0x7f861c153610 2021-12-17T18:18:29.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.941+0000 7f8621f59700 1 -- 172.21.15.62:0/1647848382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f861c05f730 con 0x7f861c153610 2021-12-17T18:18:29.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.941+0000 7f8611ffb700 1 -- 172.21.15.62:0/1647848382 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8614027070 con 0x7f861c153610 2021-12-17T18:18:29.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.941+0000 7f8611ffb700 1 --2- 172.21.15.62:0/1647848382 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85fc053580 0x7f85fc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:29.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.941+0000 7f8611ffb700 1 -- 172.21.15.62:0/1647848382 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f861406c930 con 0x7f861c153610 2021-12-17T18:18:29.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.941+0000 7f8620f57700 1 --2- 172.21.15.62:0/1647848382 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85fc053580 0x7f85fc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:29.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.941+0000 7f8620f57700 1 --2- 172.21.15.62:0/1647848382 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85fc053580 0x7f85fc055a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f861800b000 tx=0x7f8618008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:29.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:29.945+0000 7f8611ffb700 1 -- 172.21.15.62:0/1647848382 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8614043920 con 0x7f861c153610 2021-12-17T18:18:30.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.113+0000 7f8621f59700 1 -- 172.21.15.62:0/1647848382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f861c137ad0 con 0x7f861c153610 2021-12-17T18:18:30.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.117+0000 7f8611ffb700 1 -- 172.21.15.62:0/1647848382 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f861c137ad0 con 0x7f861c153610 2021-12-17T18:18:30.122 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:30.122 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/1930484969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1930484969},{"type":"v1","addr":"172.21.15.109:6835","nonce":1930484969}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:18:19.175750+0000","modified":"2021-12-17T18:18:20.179555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.62:6833/3194210554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3194210554},{"type":"v1","addr":"172.21.15.62:6833","nonce":3194210554}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-12-17T18:18:30.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.117+0000 7f8621f59700 1 -- 172.21.15.62:0/1647848382 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85fc053580 msgr2=0x7f85fc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:30.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.117+0000 7f8621f59700 1 --2- 172.21.15.62:0/1647848382 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85fc053580 0x7f85fc055a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f861800b000 tx=0x7f8618008040).stop 2021-12-17T18:18:30.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.117+0000 7f8621f59700 1 -- 172.21.15.62:0/1647848382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f861c153610 msgr2=0x7f861c153aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:30.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.117+0000 7f8621f59700 1 --2- 172.21.15.62:0/1647848382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f861c153610 0x7f861c153aa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f861c0614e0 tx=0x7f8614016000).stop 2021-12-17T18:18:30.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.117+0000 7f8621f59700 1 -- 172.21.15.62:0/1647848382 shutdown_connections 2021-12-17T18:18:30.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.117+0000 7f8621f59700 1 --2- 172.21.15.62:0/1647848382 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85fc053580 0x7f85fc055a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.117+0000 7f8621f59700 1 --2- 172.21.15.62:0/1647848382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f861c153610 0x7f861c153aa0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.117+0000 7f8621f59700 1 --2- 172.21.15.62:0/1647848382 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f861c064ec0 0x7f861c153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.117+0000 7f8621f59700 1 --2- 172.21.15.62:0/1647848382 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8608004e70 0x7f861c13eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.117+0000 7f8621f59700 1 -- 172.21.15.62:0/1647848382 >> 172.21.15.62:0/1647848382 conn(0x7f861c05d220 msgr2=0x7f861c0b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:30.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.117+0000 7f8621f59700 1 -- 172.21.15.62:0/1647848382 shutdown_connections 2021-12-17T18:18:30.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.117+0000 7f8621f59700 1 -- 172.21.15.62:0/1647848382 wait complete. 2021-12-17T18:18:30.127 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 5 2021-12-17T18:18:30.337 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:18:19.175750+0000', 'modified': '2021-12-17T18:18:20.179555+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4264}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4264': {'gid': 4264, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.62:6833/3194210554', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 3194210554}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 3194210554}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:18:30.337 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:18:30.338 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:18:30.457 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":4264,"want_state":"up:active","state":"up:active","rank_uptime":11.264046824999999,"mdsmap_epoch":5,"osdmap_epoch":23,"osdmap_epoch_barrier":23,"uptime":14.619617737} 2021-12-17T18:18:30.458 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 4264, "mdsmap_epoch": 5, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "rank_uptime": 11.264046825, "state": "up:active", "uptime": 14.619617737, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:18:30.458 INFO:teuthology.run_tasks:Running task ceph-fuse... 2021-12-17T18:18:30.476 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2021-12-17T18:18:30.477 INFO:tasks.ceph_fuse:config is None 2021-12-17T18:18:30.477 INFO:tasks.ceph_fuse:new config is {'client.0': None, 'client.1': None, 'client.2': None} 2021-12-17T18:18:30.478 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2021-12-17T18:18:30.478 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:30.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.577+0000 7f14c6cb8700 1 Processor -- start 2021-12-17T18:18:30.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.577+0000 7f14c6cb8700 1 -- start start 2021-12-17T18:18:30.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.577+0000 7f14c6cb8700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f14c0067830 0x7f14c0146940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.577+0000 7f14c6cb8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14c00aca60 0x7f14c0146e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.577+0000 7f14c6cb8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c0067c10 con 0x7f14c00affc0 2021-12-17T18:18:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.577+0000 7f14c6cb8700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c00b2d40 con 0x7f14c0067830 2021-12-17T18:18:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.577+0000 7f14c6cb8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c0060520 con 0x7f14c00aca60 2021-12-17T18:18:30.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c5255700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f14c00affc0 0x7f14c01436c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60160/0 (socket says 172.21.15.62:60160) 2021-12-17T18:18:30.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c5255700 1 -- 172.21.15.62:0/2673871619 learned_addr learned my addr 172.21.15.62:0/2673871619 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:30.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c4a54700 1 --2- 172.21.15.62:0/2673871619 >> v2:172.21.15.109:3300/0 conn(0x7f14c0067830 0x7f14c0146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:30.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14bffff700 1 --2- 172.21.15.62:0/2673871619 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14c00aca60 0x7f14c0146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:30.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14bf7fe700 1 -- 172.21.15.62:0/2673871619 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408383951 0 0) 0x7f14c0067c10 con 0x7f14c00affc0 2021-12-17T18:18:30.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14bf7fe700 1 -- 172.21.15.62:0/2673871619 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14a4003260 con 0x7f14c00affc0 2021-12-17T18:18:30.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c4a54700 1 -- 172.21.15.62:0/2673871619 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14c00aca60 msgr2=0x7f14c0146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:30.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c4a54700 1 --2- 172.21.15.62:0/2673871619 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14c00aca60 0x7f14c0146e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c4a54700 1 -- 172.21.15.62:0/2673871619 >> v1:172.21.15.62:6789/0 conn(0x7f14c00affc0 legacy=0x7f14c01436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:30.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c4a54700 1 -- 172.21.15.62:0/2673871619 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c00acf00 con 0x7f14c0067830 2021-12-17T18:18:30.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c4a54700 1 --2- 172.21.15.62:0/2673871619 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f14c0067830 0x7f14c0146940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f14b4002f70 tx=0x7f14b4006df0).ready entity=mon.1 client_cookie=f8070fac4f139dea server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:30.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14bf7fe700 1 -- 172.21.15.62:0/2673871619 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14b400d4a0 con 0x7f14c0067830 2021-12-17T18:18:30.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14bf7fe700 1 -- 172.21.15.62:0/2673871619 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b4000e90 con 0x7f14c0067830 2021-12-17T18:18:30.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14bf7fe700 1 -- 172.21.15.62:0/2673871619 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14b400d7f0 con 0x7f14c0067830 2021-12-17T18:18:30.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c6cb8700 1 -- 172.21.15.62:0/2673871619 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f14c0067830 msgr2=0x7f14c0146940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:30.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c6cb8700 1 --2- 172.21.15.62:0/2673871619 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f14c0067830 0x7f14c0146940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f14b4002f70 tx=0x7f14b4006df0).stop 2021-12-17T18:18:30.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c6cb8700 1 -- 172.21.15.62:0/2673871619 shutdown_connections 2021-12-17T18:18:30.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c6cb8700 1 --2- 172.21.15.62:0/2673871619 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14c00aca60 0x7f14c0146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c6cb8700 1 --2- 172.21.15.62:0/2673871619 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f14c0067830 0x7f14c0146940 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c6cb8700 1 -- 172.21.15.62:0/2673871619 >> 172.21.15.62:0/2673871619 conn(0x7f14c005f730 msgr2=0x7f14c005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:30.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c6cb8700 1 -- 172.21.15.62:0/2673871619 shutdown_connections 2021-12-17T18:18:30.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c6cb8700 1 -- 172.21.15.62:0/2673871619 wait complete. 2021-12-17T18:18:30.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c6cb8700 1 Processor -- start 2021-12-17T18:18:30.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.581+0000 7f14c6cb8700 1 -- start start 2021-12-17T18:18:30.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c6cb8700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f14c0067830 0x7f14c00b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:30.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c6cb8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14c00aca60 0x7f14c0156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c6cb8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14c00affc0 0x7f14c0156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c6cb8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c009f2e0 con 0x7f14c00affc0 2021-12-17T18:18:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c6cb8700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c009e9d0 con 0x7f14c0067830 2021-12-17T18:18:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c6cb8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c009ec70 con 0x7f14c00aca60 2021-12-17T18:18:30.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c5255700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14c00affc0 0x7f14c0156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:30.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c5255700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14c00affc0 0x7f14c0156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48352/0 (socket says 172.21.15.62:48352) 2021-12-17T18:18:30.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c5255700 1 -- 172.21.15.62:0/1870440192 learned_addr learned my addr 172.21.15.62:0/1870440192 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:30.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c4a54700 1 --2- 172.21.15.62:0/1870440192 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f14c0067830 0x7f14c00b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:30.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14bffff700 1 --2- 172.21.15.62:0/1870440192 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14c00aca60 0x7f14c0156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:30.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c5255700 1 -- 172.21.15.62:0/1870440192 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14c00aca60 msgr2=0x7f14c0156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:30.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c5255700 1 --2- 172.21.15.62:0/1870440192 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14c00aca60 0x7f14c0156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c5255700 1 -- 172.21.15.62:0/1870440192 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f14c0067830 msgr2=0x7f14c00b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:30.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c5255700 1 --2- 172.21.15.62:0/1870440192 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f14c0067830 0x7f14c00b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c5255700 1 -- 172.21.15.62:0/1870440192 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b400b180 con 0x7f14c00affc0 2021-12-17T18:18:30.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14bffff700 1 --2- 172.21.15.62:0/1870440192 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14c00aca60 0x7f14c0156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:18:30.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c5255700 1 --2- 172.21.15.62:0/1870440192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14c00affc0 0x7f14c0156500 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f14b8001490 tx=0x7f14b8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:30.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14bdffb700 1 -- 172.21.15.62:0/1870440192 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14b8005ba0 con 0x7f14c00affc0 2021-12-17T18:18:30.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14bdffb700 1 -- 172.21.15.62:0/1870440192 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b8005d00 con 0x7f14c00affc0 2021-12-17T18:18:30.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c6cb8700 1 -- 172.21.15.62:0/1870440192 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c009ef10 con 0x7f14c00affc0 2021-12-17T18:18:30.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14bdffb700 1 -- 172.21.15.62:0/1870440192 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14b80072c0 con 0x7f14c00affc0 2021-12-17T18:18:30.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c6cb8700 1 -- 172.21.15.62:0/1870440192 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c01569f0 con 0x7f14c00affc0 2021-12-17T18:18:30.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14c6cb8700 1 -- 172.21.15.62:0/1870440192 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c0155de0 con 0x7f14c00affc0 2021-12-17T18:18:30.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.585+0000 7f14bdffb700 1 -- 172.21.15.62:0/1870440192 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f14b801a060 con 0x7f14c00affc0 2021-12-17T18:18:30.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.589+0000 7f14bdffb700 1 --2- 172.21.15.62:0/1870440192 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f14a00536a0 0x7f14a0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:30.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.589+0000 7f14bdffb700 1 -- 172.21.15.62:0/1870440192 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f14b806b490 con 0x7f14c00affc0 2021-12-17T18:18:30.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.589+0000 7f14c4a54700 1 --2- 172.21.15.62:0/1870440192 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f14a00536a0 0x7f14a0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:30.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.589+0000 7f14c4a54700 1 --2- 172.21.15.62:0/1870440192 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f14a00536a0 0x7f14a0055b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f14b4018000 tx=0x7f14b4014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:30.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.593+0000 7f14bdffb700 1 -- 172.21.15.62:0/1870440192 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f14b80425f0 con 0x7f14c00affc0 2021-12-17T18:18:30.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.721+0000 7f14c6cb8700 1 -- 172.21.15.62:0/1870440192 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14c00b12a0 con 0x7f14c00affc0 2021-12-17T18:18:30.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.725+0000 7f14bdffb700 1 -- 172.21.15.62:0/1870440192 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f14b8018070 con 0x7f14c00affc0 2021-12-17T18:18:30.729 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:30.730 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:20.178383+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:17.128555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:18.180577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:30.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.729+0000 7f14c6cb8700 1 -- 172.21.15.62:0/1870440192 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f14a00536a0 msgr2=0x7f14a0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:30.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.729+0000 7f14c6cb8700 1 --2- 172.21.15.62:0/1870440192 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f14a00536a0 0x7f14a0055b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f14b4018000 tx=0x7f14b4014000).stop 2021-12-17T18:18:30.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.729+0000 7f14c6cb8700 1 -- 172.21.15.62:0/1870440192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14c00affc0 msgr2=0x7f14c0156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:30.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.729+0000 7f14c6cb8700 1 --2- 172.21.15.62:0/1870440192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14c00affc0 0x7f14c0156500 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f14b8001490 tx=0x7f14b8007e00).stop 2021-12-17T18:18:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.729+0000 7f14c6cb8700 1 -- 172.21.15.62:0/1870440192 shutdown_connections 2021-12-17T18:18:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.729+0000 7f14c6cb8700 1 --2- 172.21.15.62:0/1870440192 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f14a00536a0 0x7f14a0055b60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.729+0000 7f14c6cb8700 1 --2- 172.21.15.62:0/1870440192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14c00affc0 0x7f14c0156500 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.729+0000 7f14c6cb8700 1 --2- 172.21.15.62:0/1870440192 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f14c00aca60 0x7f14c0156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.729+0000 7f14c6cb8700 1 --2- 172.21.15.62:0/1870440192 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f14c0067830 0x7f14c00b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.729+0000 7f14c6cb8700 1 -- 172.21.15.62:0/1870440192 >> 172.21.15.62:0/1870440192 conn(0x7f14c005f730 msgr2=0x7f14c00aead0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:30.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.729+0000 7f14c6cb8700 1 -- 172.21.15.62:0/1870440192 shutdown_connections 2021-12-17T18:18:30.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.729+0000 7f14c6cb8700 1 -- 172.21.15.62:0/1870440192 wait complete. 2021-12-17T18:18:30.748 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:18:17.128555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:18:18.180577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:18:30.749 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:18:30.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f68778da700 1 Processor -- start 2021-12-17T18:18:30.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f68778da700 1 -- start start 2021-12-17T18:18:30.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f68778da700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68700b0f20 0x7f68700b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:30.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f68778da700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6870143610 0x7f6870143a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:30.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f68778da700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6870063c60 con 0x7f6870063880 2021-12-17T18:18:30.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f68778da700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68700b3e90 con 0x7f6870143610 2021-12-17T18:18:30.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f68778da700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68700b1430 con 0x7f68700b0f20 2021-12-17T18:18:30.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f6875676700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6870063880 0x7f68700aba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60170/0 (socket says 172.21.15.62:60170) 2021-12-17T18:18:30.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f6875676700 1 -- 172.21.15.62:0/3801307189 learned_addr learned my addr 172.21.15.62:0/3801307189 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:30.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f6874e75700 1 --2- 172.21.15.62:0/3801307189 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68700b0f20 0x7f68700b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f6875e77700 1 --2- 172.21.15.62:0/3801307189 >> v2:172.21.15.109:3300/0 conn(0x7f6870143610 0x7f6870143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f685ffff700 1 -- 172.21.15.62:0/3801307189 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803101003 0 0) 0x7f6870063c60 con 0x7f6870063880 2021-12-17T18:18:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f685ffff700 1 -- 172.21.15.62:0/3801307189 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6858003260 con 0x7f6870063880 2021-12-17T18:18:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f6874e75700 1 -- 172.21.15.62:0/3801307189 >> v2:172.21.15.109:3300/0 conn(0x7f6870143610 msgr2=0x7f6870143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f6874e75700 1 --2- 172.21.15.62:0/3801307189 >> v2:172.21.15.109:3300/0 conn(0x7f6870143610 0x7f6870143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f6874e75700 1 -- 172.21.15.62:0/3801307189 >> v1:172.21.15.62:6789/0 conn(0x7f6870063880 legacy=0x7f68700aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f6874e75700 1 -- 172.21.15.62:0/3801307189 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68700ab5a0 con 0x7f68700b0f20 2021-12-17T18:18:30.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.849+0000 7f6874e75700 1 --2- 172.21.15.62:0/3801307189 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68700b0f20 0x7f68700b1ab0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f6860002f70 tx=0x7f6860006df0).ready entity=mon.2 client_cookie=305b89a651e6b288 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:30.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f685ffff700 1 -- 172.21.15.62:0/3801307189 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f686000d4a0 con 0x7f68700b0f20 2021-12-17T18:18:30.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f685ffff700 1 -- 172.21.15.62:0/3801307189 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6860000e90 con 0x7f68700b0f20 2021-12-17T18:18:30.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f685ffff700 1 -- 172.21.15.62:0/3801307189 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f686000d7f0 con 0x7f68700b0f20 2021-12-17T18:18:30.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f68778da700 1 -- 172.21.15.62:0/3801307189 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68700b0f20 msgr2=0x7f68700b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:30.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f68778da700 1 --2- 172.21.15.62:0/3801307189 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68700b0f20 0x7f68700b1ab0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f6860002f70 tx=0x7f6860006df0).stop 2021-12-17T18:18:30.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f68778da700 1 -- 172.21.15.62:0/3801307189 shutdown_connections 2021-12-17T18:18:30.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f68778da700 1 --2- 172.21.15.62:0/3801307189 >> v2:172.21.15.109:3300/0 conn(0x7f6870143610 0x7f6870143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f68778da700 1 --2- 172.21.15.62:0/3801307189 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68700b0f20 0x7f68700b1ab0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f68778da700 1 -- 172.21.15.62:0/3801307189 >> 172.21.15.62:0/3801307189 conn(0x7f68700625b0 msgr2=0x7f6870062990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:30.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f68778da700 1 -- 172.21.15.62:0/3801307189 shutdown_connections 2021-12-17T18:18:30.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f68778da700 1 -- 172.21.15.62:0/3801307189 wait complete. 2021-12-17T18:18:30.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f68778da700 1 Processor -- start 2021-12-17T18:18:30.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f68778da700 1 -- start start 2021-12-17T18:18:30.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f68778da700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6870063880 0x7f6870142830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:30.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f68778da700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68700b0f20 0x7f6870066f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:30.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f68778da700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6870143610 0x7f68700b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:30.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f68778da700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6870065c00 con 0x7f68700b0f20 2021-12-17T18:18:30.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f68778da700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6870067480 con 0x7f6870063880 2021-12-17T18:18:30.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.853+0000 7f68778da700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687009eb90 con 0x7f6870143610 2021-12-17T18:18:30.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f6874e75700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68700b0f20 0x7f6870066f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:30.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f6874e75700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68700b0f20 0x7f6870066f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48366/0 (socket says 172.21.15.62:48366) 2021-12-17T18:18:30.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f6874e75700 1 -- 172.21.15.62:0/37374402 learned_addr learned my addr 172.21.15.62:0/37374402 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:30.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f6875e77700 1 --2- 172.21.15.62:0/37374402 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6870143610 0x7f68700b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:30.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f6875676700 1 --2- 172.21.15.62:0/37374402 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6870063880 0x7f6870142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:30.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f6874e75700 1 -- 172.21.15.62:0/37374402 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6870143610 msgr2=0x7f68700b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:30.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f6874e75700 1 --2- 172.21.15.62:0/37374402 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6870143610 0x7f68700b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f6874e75700 1 -- 172.21.15.62:0/37374402 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6870063880 msgr2=0x7f6870142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:30.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f6874e75700 1 --2- 172.21.15.62:0/37374402 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6870063880 0x7f6870142830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f6874e75700 1 -- 172.21.15.62:0/37374402 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686000b180 con 0x7f68700b0f20 2021-12-17T18:18:30.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f6874e75700 1 --2- 172.21.15.62:0/37374402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68700b0f20 0x7f6870066f90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f6860002f70 tx=0x7f6860014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:30.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f685e7fc700 1 -- 172.21.15.62:0/37374402 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6860016070 con 0x7f68700b0f20 2021-12-17T18:18:30.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f685e7fc700 1 -- 172.21.15.62:0/37374402 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68600137d0 con 0x7f68700b0f20 2021-12-17T18:18:30.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f68778da700 1 -- 172.21.15.62:0/37374402 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687009ee30 con 0x7f68700b0f20 2021-12-17T18:18:30.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f685e7fc700 1 -- 172.21.15.62:0/37374402 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6860013b30 con 0x7f68700b0f20 2021-12-17T18:18:30.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f68778da700 1 -- 172.21.15.62:0/37374402 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6870142290 con 0x7f68700b0f20 2021-12-17T18:18:30.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f68778da700 1 -- 172.21.15.62:0/37374402 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687009e9d0 con 0x7f68700b0f20 2021-12-17T18:18:30.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.857+0000 7f685e7fc700 1 -- 172.21.15.62:0/37374402 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6860025030 con 0x7f68700b0f20 2021-12-17T18:18:30.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.861+0000 7f685e7fc700 1 --2- 172.21.15.62:0/37374402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6850053640 0x7f6850055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:30.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.861+0000 7f685e7fc700 1 -- 172.21.15.62:0/37374402 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f686006c740 con 0x7f68700b0f20 2021-12-17T18:18:30.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.861+0000 7f6875676700 1 --2- 172.21.15.62:0/37374402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6850053640 0x7f6850055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:30.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.861+0000 7f6875676700 1 --2- 172.21.15.62:0/37374402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6850053640 0x7f6850055b00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f686c00d000 tx=0x7f686c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:30.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.865+0000 7f685e7fc700 1 -- 172.21.15.62:0/37374402 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6860043820 con 0x7f68700b0f20 2021-12-17T18:18:30.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.989+0000 7f68778da700 1 -- 172.21.15.62:0/37374402 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f68700573d0 con 0x7f68700b0f20 2021-12-17T18:18:30.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.989+0000 7f685e7fc700 1 -- 172.21.15.62:0/37374402 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f68600230b0 con 0x7f68700b0f20 2021-12-17T18:18:30.996 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:18:30.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.993+0000 7f68778da700 1 -- 172.21.15.62:0/37374402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6850053640 msgr2=0x7f6850055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:30.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.993+0000 7f68778da700 1 --2- 172.21.15.62:0/37374402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6850053640 0x7f6850055b00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f686c00d000 tx=0x7f686c009040).stop 2021-12-17T18:18:30.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.993+0000 7f68778da700 1 -- 172.21.15.62:0/37374402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68700b0f20 msgr2=0x7f6870066f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:30.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.993+0000 7f68778da700 1 --2- 172.21.15.62:0/37374402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68700b0f20 0x7f6870066f90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f6860002f70 tx=0x7f6860014000).stop 2021-12-17T18:18:30.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.993+0000 7f68778da700 1 -- 172.21.15.62:0/37374402 shutdown_connections 2021-12-17T18:18:30.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.993+0000 7f68778da700 1 --2- 172.21.15.62:0/37374402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6850053640 0x7f6850055b00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:30.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.993+0000 7f68778da700 1 --2- 172.21.15.62:0/37374402 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6870143610 0x7f68700b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.993+0000 7f68778da700 1 --2- 172.21.15.62:0/37374402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68700b0f20 0x7f6870066f90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.993+0000 7f68778da700 1 --2- 172.21.15.62:0/37374402 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6870063880 0x7f6870142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.993+0000 7f68778da700 1 -- 172.21.15.62:0/37374402 >> 172.21.15.62:0/37374402 conn(0x7f68700625b0 msgr2=0x7f68700aeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:31.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.993+0000 7f68778da700 1 -- 172.21.15.62:0/37374402 shutdown_connections 2021-12-17T18:18:31.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:30.993+0000 7f68778da700 1 -- 172.21.15.62:0/37374402 wait complete. 2021-12-17T18:18:31.009 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:18:31.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f3939c66700 1 Processor -- start 2021-12-17T18:18:31.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f3939c66700 1 -- start start 2021-12-17T18:18:31.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f3939c66700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f39341471c0 0x7f3934152d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f3939c66700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393405ce70 con 0x7f39340b4980 2021-12-17T18:18:31.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f3939c66700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393414b5a0 con 0x7f393405ca90 2021-12-17T18:18:31.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f3939c66700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393414b840 con 0x7f39341471c0 2021-12-17T18:18:31.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f3933fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f39341471c0 0x7f3934152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f392affd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f39340b4980 0x7f3934146ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60186/0 (socket says 172.21.15.62:60186) 2021-12-17T18:18:31.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f392affd700 1 -- 172.21.15.62:0/1429464057 learned_addr learned my addr 172.21.15.62:0/1429464057 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:31.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f3932ffd700 1 -- 172.21.15.62:0/1429464057 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452313977 0 0) 0x7f393405ce70 con 0x7f39340b4980 2021-12-17T18:18:31.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f3932ffd700 1 -- 172.21.15.62:0/1429464057 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3914003260 con 0x7f39340b4980 2021-12-17T18:18:31.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f3933fff700 1 -- 172.21.15.62:0/1429464057 >> v1:172.21.15.109:6789/0 conn(0x7f393405ca90 legacy=0x7f39340b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f3933fff700 1 -- 172.21.15.62:0/1429464057 >> v1:172.21.15.62:6789/0 conn(0x7f39340b4980 legacy=0x7f3934146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f3933fff700 1 -- 172.21.15.62:0/1429464057 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39340604d0 con 0x7f39341471c0 2021-12-17T18:18:31.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f3933fff700 1 --2- 172.21.15.62:0/1429464057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39341471c0 0x7f3934152d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f392c0032f0 tx=0x7f392c0091d0).ready entity=mon.0 client_cookie=862e9bbe232d941a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:31.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f3932ffd700 1 -- 172.21.15.62:0/1429464057 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f392c00b6c0 con 0x7f39341471c0 2021-12-17T18:18:31.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f3932ffd700 1 -- 172.21.15.62:0/1429464057 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c00b820 con 0x7f39341471c0 2021-12-17T18:18:31.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.113+0000 7f3932ffd700 1 -- 172.21.15.62:0/1429464057 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f392c00b990 con 0x7f39341471c0 2021-12-17T18:18:31.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.117+0000 7f3939c66700 1 -- 172.21.15.62:0/1429464057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39341471c0 msgr2=0x7f3934152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.117+0000 7f3939c66700 1 --2- 172.21.15.62:0/1429464057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39341471c0 0x7f3934152d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f392c0032f0 tx=0x7f392c0091d0).stop 2021-12-17T18:18:31.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.117+0000 7f3939c66700 1 -- 172.21.15.62:0/1429464057 shutdown_connections 2021-12-17T18:18:31.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.117+0000 7f3939c66700 1 --2- 172.21.15.62:0/1429464057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39341471c0 0x7f3934152d80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.117+0000 7f3939c66700 1 -- 172.21.15.62:0/1429464057 >> 172.21.15.62:0/1429464057 conn(0x7f3934062430 msgr2=0x7f3934062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:31.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.117+0000 7f3939c66700 1 -- 172.21.15.62:0/1429464057 shutdown_connections 2021-12-17T18:18:31.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.117+0000 7f3939c66700 1 -- 172.21.15.62:0/1429464057 wait complete. 2021-12-17T18:18:31.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.117+0000 7f3939c66700 1 Processor -- start 2021-12-17T18:18:31.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.117+0000 7f3939c66700 1 -- start start 2021-12-17T18:18:31.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f3939c66700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f393405ca90 0x7f3934083af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f3939c66700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39340b4980 0x7f3934084c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f3939c66700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39341471c0 0x7f3934159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f3939c66700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3934064620 con 0x7f39340b4980 2021-12-17T18:18:31.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f3939c66700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39340661b0 con 0x7f393405ca90 2021-12-17T18:18:31.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f3939c66700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3934157b10 con 0x7f39341471c0 2021-12-17T18:18:31.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f392affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39340b4980 0x7f3934084c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f392affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39340b4980 0x7f3934084c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48380/0 (socket says 172.21.15.62:48380) 2021-12-17T18:18:31.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f392affd700 1 -- 172.21.15.62:0/204256538 learned_addr learned my addr 172.21.15.62:0/204256538 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:31.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f39337fe700 1 --2- 172.21.15.62:0/204256538 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f393405ca90 0x7f3934083af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f3933fff700 1 --2- 172.21.15.62:0/204256538 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39341471c0 0x7f3934159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f392affd700 1 -- 172.21.15.62:0/204256538 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39341471c0 msgr2=0x7f3934159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f392affd700 1 --2- 172.21.15.62:0/204256538 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39341471c0 0x7f3934159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f392affd700 1 -- 172.21.15.62:0/204256538 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f393405ca90 msgr2=0x7f3934083af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f392affd700 1 --2- 172.21.15.62:0/204256538 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f393405ca90 0x7f3934083af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f392affd700 1 -- 172.21.15.62:0/204256538 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c009470 con 0x7f39340b4980 2021-12-17T18:18:31.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f39337fe700 1 --2- 172.21.15.62:0/204256538 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f393405ca90 0x7f3934083af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:31.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f3933fff700 1 --2- 172.21.15.62:0/204256538 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39341471c0 0x7f3934159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:31.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f392affd700 1 --2- 172.21.15.62:0/204256538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39340b4980 0x7f3934084c90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f391c001110 tx=0x7f391c007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:31.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f39317fa700 1 -- 172.21.15.62:0/204256538 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f391c0070d0 con 0x7f39340b4980 2021-12-17T18:18:31.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f39317fa700 1 -- 172.21.15.62:0/204256538 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c007230 con 0x7f39340b4980 2021-12-17T18:18:31.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f3939c66700 1 -- 172.21.15.62:0/204256538 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39340639e0 con 0x7f39340b4980 2021-12-17T18:18:31.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f39317fa700 1 -- 172.21.15.62:0/204256538 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f391c005610 con 0x7f39340b4980 2021-12-17T18:18:31.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.121+0000 7f3939c66700 1 -- 172.21.15.62:0/204256538 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3934082f30 con 0x7f39340b4980 2021-12-17T18:18:31.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.125+0000 7f39317fa700 1 -- 172.21.15.62:0/204256538 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f391c01a060 con 0x7f39340b4980 2021-12-17T18:18:31.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.125+0000 7f3939c66700 1 -- 172.21.15.62:0/204256538 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3934060970 con 0x7f39340b4980 2021-12-17T18:18:31.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.125+0000 7f39317fa700 1 --2- 172.21.15.62:0/204256538 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3918053610 0x7f3918055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.125+0000 7f39317fa700 1 -- 172.21.15.62:0/204256538 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f391c06ac40 con 0x7f39340b4980 2021-12-17T18:18:31.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.125+0000 7f39337fe700 1 --2- 172.21.15.62:0/204256538 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3918053610 0x7f3918055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.125+0000 7f39337fe700 1 --2- 172.21.15.62:0/204256538 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3918053610 0x7f3918055ad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f392400d000 tx=0x7f3924009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:31.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.133+0000 7f39317fa700 1 -- 172.21.15.62:0/204256538 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f391c041da0 con 0x7f39340b4980 2021-12-17T18:18:31.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.262+0000 7f3939c66700 1 -- 172.21.15.62:0/204256538 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f39340573d0 con 0x7f39340b4980 2021-12-17T18:18:31.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.262+0000 7f39317fa700 1 -- 172.21.15.62:0/204256538 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f391c018070 con 0x7f39340b4980 2021-12-17T18:18:31.267 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:31.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.266+0000 7f3939c66700 1 -- 172.21.15.62:0/204256538 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3918053610 msgr2=0x7f3918055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.266+0000 7f3939c66700 1 --2- 172.21.15.62:0/204256538 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3918053610 0x7f3918055ad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f392400d000 tx=0x7f3924009040).stop 2021-12-17T18:18:31.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.266+0000 7f3939c66700 1 -- 172.21.15.62:0/204256538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39340b4980 msgr2=0x7f3934084c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.266+0000 7f3939c66700 1 --2- 172.21.15.62:0/204256538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39340b4980 0x7f3934084c90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f391c001110 tx=0x7f391c007aa0).stop 2021-12-17T18:18:31.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.266+0000 7f3939c66700 1 -- 172.21.15.62:0/204256538 shutdown_connections 2021-12-17T18:18:31.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.266+0000 7f3939c66700 1 --2- 172.21.15.62:0/204256538 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3918053610 0x7f3918055ad0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.266+0000 7f3939c66700 1 --2- 172.21.15.62:0/204256538 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39341471c0 0x7f3934159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.266+0000 7f3939c66700 1 --2- 172.21.15.62:0/204256538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39340b4980 0x7f3934084c90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.266+0000 7f3939c66700 1 --2- 172.21.15.62:0/204256538 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f393405ca90 0x7f3934083af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.266+0000 7f3939c66700 1 -- 172.21.15.62:0/204256538 >> 172.21.15.62:0/204256538 conn(0x7f3934062430 msgr2=0x7f3934145c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:31.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.266+0000 7f3939c66700 1 -- 172.21.15.62:0/204256538 shutdown_connections 2021-12-17T18:18:31.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.266+0000 7f3939c66700 1 -- 172.21.15.62:0/204256538 wait complete. 2021-12-17T18:18:31.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:18:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.386+0000 7f8ecca5d700 1 Processor -- start 2021-12-17T18:18:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.386+0000 7f8ecca5d700 1 -- start start 2021-12-17T18:18:31.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.386+0000 7f8ecca5d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8ec80b47c0 0x7f8ec80b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.386+0000 7f8ecca5d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec80b0870 con 0x7f8ec805ca90 2021-12-17T18:18:31.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.386+0000 7f8ecca5d700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec805ce70 con 0x7f8ec80b5be0 2021-12-17T18:18:31.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.386+0000 7f8ecca5d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec80b05d0 con 0x7f8ec80b47c0 2021-12-17T18:18:31.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.386+0000 7f8ec659c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8ec80b47c0 0x7f8ec80b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.386+0000 7f8ec659c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8ec80b47c0 0x7f8ec80b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48388/0 (socket says 172.21.15.62:48388) 2021-12-17T18:18:31.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.386+0000 7f8ec659c700 1 -- 172.21.15.62:0/2992144297 learned_addr learned my addr 172.21.15.62:0/2992144297 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:31.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.386+0000 7f8ec6d9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8ec805ca90 0x7f8ec80b1d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60198/0 (socket says 172.21.15.62:60198) 2021-12-17T18:18:31.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.386+0000 7f8ec659c700 1 -- 172.21.15.62:0/2992144297 >> v1:172.21.15.109:6789/0 conn(0x7f8ec80b5be0 legacy=0x7f8ec8143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.386+0000 7f8ec659c700 1 -- 172.21.15.62:0/2992144297 >> v1:172.21.15.62:6789/0 conn(0x7f8ec805ca90 legacy=0x7f8ec80b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.386+0000 7f8ec659c700 1 -- 172.21.15.62:0/2992144297 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec80b5250 con 0x7f8ec80b47c0 2021-12-17T18:18:31.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.390+0000 7f8ec659c700 1 --2- 172.21.15.62:0/2992144297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ec80b47c0 0x7f8ec80b56f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f8eb8002f70 tx=0x7f8eb8006eb0).ready entity=mon.0 client_cookie=baecdde8be092d48 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:31.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.390+0000 7f8ec5d9b700 1 -- 172.21.15.62:0/2992144297 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eb800d660 con 0x7f8ec80b47c0 2021-12-17T18:18:31.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.390+0000 7f8ec5d9b700 1 -- 172.21.15.62:0/2992144297 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb8000e90 con 0x7f8ec80b47c0 2021-12-17T18:18:31.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.390+0000 7f8ec5d9b700 1 -- 172.21.15.62:0/2992144297 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eb800d9f0 con 0x7f8ec80b47c0 2021-12-17T18:18:31.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.390+0000 7f8ecca5d700 1 -- 172.21.15.62:0/2992144297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ec80b47c0 msgr2=0x7f8ec80b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.390+0000 7f8ecca5d700 1 --2- 172.21.15.62:0/2992144297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ec80b47c0 0x7f8ec80b56f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f8eb8002f70 tx=0x7f8eb8006eb0).stop 2021-12-17T18:18:31.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.390+0000 7f8ecca5d700 1 -- 172.21.15.62:0/2992144297 shutdown_connections 2021-12-17T18:18:31.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.390+0000 7f8ecca5d700 1 --2- 172.21.15.62:0/2992144297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ec80b47c0 0x7f8ec80b56f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.390+0000 7f8ecca5d700 1 -- 172.21.15.62:0/2992144297 >> 172.21.15.62:0/2992144297 conn(0x7f8ec805bcd0 msgr2=0x7f8ec8062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:31.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.390+0000 7f8ecca5d700 1 -- 172.21.15.62:0/2992144297 shutdown_connections 2021-12-17T18:18:31.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.390+0000 7f8ecca5d700 1 -- 172.21.15.62:0/2992144297 wait complete. 2021-12-17T18:18:31.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.390+0000 7f8ecca5d700 1 Processor -- start 2021-12-17T18:18:31.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.390+0000 7f8ecca5d700 1 -- start start 2021-12-17T18:18:31.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ecca5d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ec805ca90 0x7f8ec8147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ecca5d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8ec80b47c0 0x7f8ec80af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ecca5d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8ec80b5be0 0x7f8ec80afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ecca5d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec80a2f60 con 0x7f8ec805ca90 2021-12-17T18:18:31.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ecca5d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec80a3200 con 0x7f8ec80b47c0 2021-12-17T18:18:31.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ecca5d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec80a34a0 con 0x7f8ec80b5be0 2021-12-17T18:18:31.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ec6d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ec805ca90 0x7f8ec8147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ec6d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ec805ca90 0x7f8ec8147ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48392/0 (socket says 172.21.15.62:48392) 2021-12-17T18:18:31.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ec6d9d700 1 -- 172.21.15.62:0/546827423 learned_addr learned my addr 172.21.15.62:0/546827423 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:31.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ec659c700 1 --2- 172.21.15.62:0/546827423 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8ec80b47c0 0x7f8ec80af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ec759e700 1 --2- 172.21.15.62:0/546827423 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8ec80b5be0 0x7f8ec80afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ec6d9d700 1 -- 172.21.15.62:0/546827423 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8ec80b5be0 msgr2=0x7f8ec80afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ec6d9d700 1 --2- 172.21.15.62:0/546827423 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8ec80b5be0 0x7f8ec80afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ec6d9d700 1 -- 172.21.15.62:0/546827423 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8ec80b47c0 msgr2=0x7f8ec80af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ec6d9d700 1 --2- 172.21.15.62:0/546827423 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8ec80b47c0 0x7f8ec80af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ec6d9d700 1 -- 172.21.15.62:0/546827423 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb800b1e0 con 0x7f8ec805ca90 2021-12-17T18:18:31.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ec759e700 1 --2- 172.21.15.62:0/546827423 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8ec80b5be0 0x7f8ec80afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:18:31.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ec659c700 1 --2- 172.21.15.62:0/546827423 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8ec80b47c0 0x7f8ec80af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:18:31.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ec6d9d700 1 --2- 172.21.15.62:0/546827423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ec805ca90 0x7f8ec8147ec0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f8ec8062e10 tx=0x7f8eb0007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:31.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ebffff700 1 -- 172.21.15.62:0/546827423 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eb000ce30 con 0x7f8ec805ca90 2021-12-17T18:18:31.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ebffff700 1 -- 172.21.15.62:0/546827423 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb00072e0 con 0x7f8ec805ca90 2021-12-17T18:18:31.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ecca5d700 1 -- 172.21.15.62:0/546827423 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec8155cc0 con 0x7f8ec805ca90 2021-12-17T18:18:31.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ebffff700 1 -- 172.21.15.62:0/546827423 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eb0007450 con 0x7f8ec805ca90 2021-12-17T18:18:31.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ecca5d700 1 -- 172.21.15.62:0/546827423 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec8064770 con 0x7f8ec805ca90 2021-12-17T18:18:31.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ecca5d700 1 -- 172.21.15.62:0/546827423 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec80b3980 con 0x7f8ec805ca90 2021-12-17T18:18:31.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ebffff700 1 -- 172.21.15.62:0/546827423 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8eb0010070 con 0x7f8ec805ca90 2021-12-17T18:18:31.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ebffff700 1 --2- 172.21.15.62:0/546827423 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8eac053580 0x7f8eac055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ebffff700 1 -- 172.21.15.62:0/546827423 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8eb006b070 con 0x7f8ec805ca90 2021-12-17T18:18:31.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.394+0000 7f8ec659c700 1 --2- 172.21.15.62:0/546827423 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8eac053580 0x7f8eac055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.398+0000 7f8ec659c700 1 --2- 172.21.15.62:0/546827423 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8eac053580 0x7f8eac055a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f8eb8017000 tx=0x7f8eb8015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:31.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.402+0000 7f8ebffff700 1 -- 172.21.15.62:0/546827423 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8eb00420c0 con 0x7f8ec805ca90 2021-12-17T18:18:31.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.530+0000 7f8ecca5d700 1 -- 172.21.15.62:0/546827423 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ec80573d0 con 0x7f8ec805ca90 2021-12-17T18:18:31.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.534+0000 7f8ebffff700 1 -- 172.21.15.62:0/546827423 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8eb00456e0 con 0x7f8ec805ca90 2021-12-17T18:18:31.538 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:31.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.534+0000 7f8ecca5d700 1 -- 172.21.15.62:0/546827423 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8eac053580 msgr2=0x7f8eac055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.534+0000 7f8ecca5d700 1 --2- 172.21.15.62:0/546827423 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8eac053580 0x7f8eac055a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f8eb8017000 tx=0x7f8eb8015000).stop 2021-12-17T18:18:31.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.534+0000 7f8ecca5d700 1 -- 172.21.15.62:0/546827423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ec805ca90 msgr2=0x7f8ec8147ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.534+0000 7f8ecca5d700 1 --2- 172.21.15.62:0/546827423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ec805ca90 0x7f8ec8147ec0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f8ec8062e10 tx=0x7f8eb0007c40).stop 2021-12-17T18:18:31.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.534+0000 7f8ecca5d700 1 -- 172.21.15.62:0/546827423 shutdown_connections 2021-12-17T18:18:31.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.534+0000 7f8ecca5d700 1 --2- 172.21.15.62:0/546827423 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8eac053580 0x7f8eac055a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.534+0000 7f8ecca5d700 1 --2- 172.21.15.62:0/546827423 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8ec80b5be0 0x7f8ec80afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.534+0000 7f8ecca5d700 1 --2- 172.21.15.62:0/546827423 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8ec80b47c0 0x7f8ec80af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.534+0000 7f8ecca5d700 1 --2- 172.21.15.62:0/546827423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ec805ca90 0x7f8ec8147ec0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.534+0000 7f8ecca5d700 1 -- 172.21.15.62:0/546827423 >> 172.21.15.62:0/546827423 conn(0x7f8ec805bcd0 msgr2=0x7f8ec8149070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:31.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.534+0000 7f8ecca5d700 1 -- 172.21.15.62:0/546827423 shutdown_connections 2021-12-17T18:18:31.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.534+0000 7f8ecca5d700 1 -- 172.21.15.62:0/546827423 wait complete. 2021-12-17T18:18:31.551 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:18:31.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.654+0000 7f0634a0e700 1 Processor -- start 2021-12-17T18:18:31.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.654+0000 7f0634a0e700 1 -- start start 2021-12-17T18:18:31.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.654+0000 7f0634a0e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f063005ca90 0x7f0630144520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.654+0000 7f0634a0e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f063013a910 0x7f063013ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.654+0000 7f0634a0e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063005ce70 con 0x7f0630065a40 2021-12-17T18:18:31.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.654+0000 7f0634a0e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06300604c0 con 0x7f063005ca90 2021-12-17T18:18:31.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.654+0000 7f0634a0e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0630142080 con 0x7f063013a910 2021-12-17T18:18:31.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f062ed9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f063005ca90 0x7f0630144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f062ed9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f063005ca90 0x7f0630144520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48400/0 (socket says 172.21.15.62:48400) 2021-12-17T18:18:31.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f062ed9d700 1 -- 172.21.15.62:0/2664830471 learned_addr learned my addr 172.21.15.62:0/2664830471 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:31.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f062f59e700 1 --2- 172.21.15.62:0/2664830471 >> v2:172.21.15.109:3300/0 conn(0x7f063013a910 0x7f063013ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f062ed9d700 1 -- 172.21.15.62:0/2664830471 >> v2:172.21.15.109:3300/0 conn(0x7f063013a910 msgr2=0x7f063013ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:31.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f062ed9d700 1 --2- 172.21.15.62:0/2664830471 >> v2:172.21.15.109:3300/0 conn(0x7f063013a910 0x7f063013ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f062ed9d700 1 -- 172.21.15.62:0/2664830471 >> v1:172.21.15.109:6789/0 conn(0x7f0630065a40 legacy=0x7f0630065ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f062ed9d700 1 -- 172.21.15.62:0/2664830471 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06300adb50 con 0x7f063005ca90 2021-12-17T18:18:31.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f062ed9d700 1 --2- 172.21.15.62:0/2664830471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f063005ca90 0x7f0630144520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f0630065920 tx=0x7f0620006e50).ready entity=mon.0 client_cookie=a62f8926dcef1048 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:31.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f062e59c700 1 -- 172.21.15.62:0/2664830471 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f062000d610 con 0x7f063005ca90 2021-12-17T18:18:31.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f062e59c700 1 -- 172.21.15.62:0/2664830471 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0620000e90 con 0x7f063005ca90 2021-12-17T18:18:31.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f062e59c700 1 -- 172.21.15.62:0/2664830471 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f062000d960 con 0x7f063005ca90 2021-12-17T18:18:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f0634a0e700 1 -- 172.21.15.62:0/2664830471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f063005ca90 msgr2=0x7f0630144520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f0634a0e700 1 --2- 172.21.15.62:0/2664830471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f063005ca90 0x7f0630144520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f0630065920 tx=0x7f0620006e50).stop 2021-12-17T18:18:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f0634a0e700 1 -- 172.21.15.62:0/2664830471 shutdown_connections 2021-12-17T18:18:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f0634a0e700 1 --2- 172.21.15.62:0/2664830471 >> v2:172.21.15.109:3300/0 conn(0x7f063013a910 0x7f063013ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f0634a0e700 1 --2- 172.21.15.62:0/2664830471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f063005ca90 0x7f0630144520 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f0634a0e700 1 -- 172.21.15.62:0/2664830471 >> 172.21.15.62:0/2664830471 conn(0x7f063005be70 msgr2=0x7f0630062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:31.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f0634a0e700 1 -- 172.21.15.62:0/2664830471 shutdown_connections 2021-12-17T18:18:31.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f0634a0e700 1 -- 172.21.15.62:0/2664830471 wait complete. 2021-12-17T18:18:31.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f0634a0e700 1 Processor -- start 2021-12-17T18:18:31.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f0634a0e700 1 -- start start 2021-12-17T18:18:31.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f0634a0e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f063005ca90 0x7f06300aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f0634a0e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0630065a40 0x7f0630063af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f0634a0e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f063013a910 0x7f0630063fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f0634a0e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0630142f60 con 0x7f063013a910 2021-12-17T18:18:31.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f0634a0e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06301383c0 con 0x7f0630065a40 2021-12-17T18:18:31.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.658+0000 7f0634a0e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06301431c0 con 0x7f063005ca90 2021-12-17T18:18:31.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f062f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f063013a910 0x7f0630063fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f062f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f063013a910 0x7f0630063fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48408/0 (socket says 172.21.15.62:48408) 2021-12-17T18:18:31.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f062659c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0630065a40 0x7f0630063af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f062f59e700 1 -- 172.21.15.62:0/2413527900 learned_addr learned my addr 172.21.15.62:0/2413527900 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:31.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f062ed9d700 1 --2- 172.21.15.62:0/2413527900 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f063005ca90 0x7f06300aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f062f59e700 1 -- 172.21.15.62:0/2413527900 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f063005ca90 msgr2=0x7f06300aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f062f59e700 1 --2- 172.21.15.62:0/2413527900 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f063005ca90 0x7f06300aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f062f59e700 1 -- 172.21.15.62:0/2413527900 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0630065a40 msgr2=0x7f0630063af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f062f59e700 1 --2- 172.21.15.62:0/2413527900 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0630065a40 0x7f0630063af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f062f59e700 1 -- 172.21.15.62:0/2413527900 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062000b1e0 con 0x7f063013a910 2021-12-17T18:18:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f062f59e700 1 --2- 172.21.15.62:0/2413527900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f063013a910 0x7f0630063fe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f0628006e00 tx=0x7f06280091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f062cd99700 1 -- 172.21.15.62:0/2413527900 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f062800c670 con 0x7f063013a910 2021-12-17T18:18:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f062cd99700 1 -- 172.21.15.62:0/2413527900 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062800c7d0 con 0x7f063013a910 2021-12-17T18:18:31.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f0634a0e700 1 -- 172.21.15.62:0/2413527900 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0630144700 con 0x7f063013a910 2021-12-17T18:18:31.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f062cd99700 1 -- 172.21.15.62:0/2413527900 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f062800cb30 con 0x7f063013a910 2021-12-17T18:18:31.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f0634a0e700 1 -- 172.21.15.62:0/2413527900 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06301441f0 con 0x7f063013a910 2021-12-17T18:18:31.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f0634a0e700 1 -- 172.21.15.62:0/2413527900 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06300573d0 con 0x7f063013a910 2021-12-17T18:18:31.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f062cd99700 1 -- 172.21.15.62:0/2413527900 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f062800cc90 con 0x7f063013a910 2021-12-17T18:18:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f062cd99700 1 --2- 172.21.15.62:0/2413527900 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f06140536a0 0x7f0614055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.662+0000 7f062cd99700 1 -- 172.21.15.62:0/2413527900 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f062806bb60 con 0x7f063013a910 2021-12-17T18:18:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.666+0000 7f062ed9d700 1 --2- 172.21.15.62:0/2413527900 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f06140536a0 0x7f0614055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.666+0000 7f062ed9d700 1 --2- 172.21.15.62:0/2413527900 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f06140536a0 0x7f0614055b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f0620018000 tx=0x7f0620014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:31.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.670+0000 7f062cd99700 1 -- 172.21.15.62:0/2413527900 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0628042cc0 con 0x7f063013a910 2021-12-17T18:18:31.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.798+0000 7f0634a0e700 1 -- 172.21.15.62:0/2413527900 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0630143e80 con 0x7f063013a910 2021-12-17T18:18:31.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.798+0000 7f062cd99700 1 -- 172.21.15.62:0/2413527900 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f06280462e0 con 0x7f063013a910 2021-12-17T18:18:31.805 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:31.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.802+0000 7f0634a0e700 1 -- 172.21.15.62:0/2413527900 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f06140536a0 msgr2=0x7f0614055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.802+0000 7f0634a0e700 1 --2- 172.21.15.62:0/2413527900 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f06140536a0 0x7f0614055b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f0620018000 tx=0x7f0620014000).stop 2021-12-17T18:18:31.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.802+0000 7f0634a0e700 1 -- 172.21.15.62:0/2413527900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f063013a910 msgr2=0x7f0630063fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.802+0000 7f0634a0e700 1 --2- 172.21.15.62:0/2413527900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f063013a910 0x7f0630063fe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f0628006e00 tx=0x7f06280091d0).stop 2021-12-17T18:18:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.802+0000 7f0634a0e700 1 -- 172.21.15.62:0/2413527900 shutdown_connections 2021-12-17T18:18:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.802+0000 7f0634a0e700 1 --2- 172.21.15.62:0/2413527900 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f06140536a0 0x7f0614055b60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.802+0000 7f0634a0e700 1 --2- 172.21.15.62:0/2413527900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f063013a910 0x7f0630063fe0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.802+0000 7f0634a0e700 1 --2- 172.21.15.62:0/2413527900 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0630065a40 0x7f0630063af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.802+0000 7f0634a0e700 1 --2- 172.21.15.62:0/2413527900 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f063005ca90 0x7f06300aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.802+0000 7f0634a0e700 1 -- 172.21.15.62:0/2413527900 >> 172.21.15.62:0/2413527900 conn(0x7f063005be70 msgr2=0x7f0630139f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:31.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.802+0000 7f0634a0e700 1 -- 172.21.15.62:0/2413527900 shutdown_connections 2021-12-17T18:18:31.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.802+0000 7f0634a0e700 1 -- 172.21.15.62:0/2413527900 wait complete. 2021-12-17T18:18:31.824 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:18:31.824 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:18:31.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.922+0000 7fc6c60ee700 1 Processor -- start 2021-12-17T18:18:31.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.922+0000 7fc6c60ee700 1 -- start start 2021-12-17T18:18:31.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.922+0000 7fc6c60ee700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6c00b1730 0x7fc6c00ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.922+0000 7fc6c60ee700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6c00a7bb0 0x7fc6c0067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.922+0000 7fc6c60ee700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c00b2ce0 con 0x7fc6c00b21f0 2021-12-17T18:18:31.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.922+0000 7fc6c60ee700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c014b5b0 con 0x7fc6c00b1730 2021-12-17T18:18:31.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.922+0000 7fc6c60ee700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0147870 con 0x7fc6c00a7bb0 2021-12-17T18:18:31.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.922+0000 7fc6bf7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc6c00b21f0 0x7fc6c014aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60226/0 (socket says 172.21.15.62:60226) 2021-12-17T18:18:31.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.922+0000 7fc6bf7fe700 1 -- 172.21.15.62:0/1860056264 learned_addr learned my addr 172.21.15.62:0/1860056264 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:31.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.922+0000 7fc6bffff700 1 --2- 172.21.15.62:0/1860056264 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6c00a7bb0 0x7fc6c0067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.922+0000 7fc6beffd700 1 --2- 172.21.15.62:0/1860056264 >> v2:172.21.15.62:3300/0 conn(0x7fc6c00b1730 0x7fc6c00ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.922+0000 7fc6be7fc700 1 -- 172.21.15.62:0/1860056264 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670085618 0 0) 0x7fc6c00b2ce0 con 0x7fc6c00b21f0 2021-12-17T18:18:31.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.922+0000 7fc6be7fc700 1 -- 172.21.15.62:0/1860056264 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6ac003260 con 0x7fc6c00b21f0 2021-12-17T18:18:31.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.926+0000 7fc6bffff700 1 -- 172.21.15.62:0/1860056264 >> v2:172.21.15.62:3300/0 conn(0x7fc6c00b1730 msgr2=0x7fc6c00ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:31.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.926+0000 7fc6bffff700 1 --2- 172.21.15.62:0/1860056264 >> v2:172.21.15.62:3300/0 conn(0x7fc6c00b1730 0x7fc6c00ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.926+0000 7fc6bffff700 1 -- 172.21.15.62:0/1860056264 >> v1:172.21.15.62:6789/0 conn(0x7fc6c00b21f0 legacy=0x7fc6c014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.926+0000 7fc6bffff700 1 -- 172.21.15.62:0/1860056264 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c00aca60 con 0x7fc6c00a7bb0 2021-12-17T18:18:31.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.926+0000 7fc6bffff700 1 --2- 172.21.15.62:0/1860056264 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6c00a7bb0 0x7fc6c0067120 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc6b80032f0 tx=0x7fc6b80091d0).ready entity=mon.2 client_cookie=9b23e2e9357f7ead server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:31.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.926+0000 7fc6be7fc700 1 -- 172.21.15.62:0/1860056264 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6b800b600 con 0x7fc6c00a7bb0 2021-12-17T18:18:31.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.926+0000 7fc6be7fc700 1 -- 172.21.15.62:0/1860056264 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b800b760 con 0x7fc6c00a7bb0 2021-12-17T18:18:31.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.926+0000 7fc6be7fc700 1 -- 172.21.15.62:0/1860056264 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6b800b8d0 con 0x7fc6c00a7bb0 2021-12-17T18:18:31.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.926+0000 7fc6c60ee700 1 -- 172.21.15.62:0/1860056264 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6c00a7bb0 msgr2=0x7fc6c0067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.926+0000 7fc6c60ee700 1 --2- 172.21.15.62:0/1860056264 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6c00a7bb0 0x7fc6c0067120 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc6b80032f0 tx=0x7fc6b80091d0).stop 2021-12-17T18:18:31.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.926+0000 7fc6c60ee700 1 -- 172.21.15.62:0/1860056264 shutdown_connections 2021-12-17T18:18:31.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.926+0000 7fc6c60ee700 1 --2- 172.21.15.62:0/1860056264 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6c00a7bb0 0x7fc6c0067120 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.926+0000 7fc6c60ee700 1 --2- 172.21.15.62:0/1860056264 >> v2:172.21.15.62:3300/0 conn(0x7fc6c00b1730 0x7fc6c00ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.926+0000 7fc6c60ee700 1 -- 172.21.15.62:0/1860056264 >> 172.21.15.62:0/1860056264 conn(0x7fc6c005f730 msgr2=0x7fc6c005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:31.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.926+0000 7fc6c60ee700 1 -- 172.21.15.62:0/1860056264 shutdown_connections 2021-12-17T18:18:31.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.926+0000 7fc6c60ee700 1 -- 172.21.15.62:0/1860056264 wait complete. 2021-12-17T18:18:31.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6c60ee700 1 Processor -- start 2021-12-17T18:18:31.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6c60ee700 1 -- start start 2021-12-17T18:18:31.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6c60ee700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc6c00a7bb0 0x7fc6c01576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6c60ee700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6c00b1730 0x7fc6c0063450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6c60ee700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c00b21f0 0x7fc6c0149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6c60ee700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00a9740 con 0x7fc6c00b21f0 2021-12-17T18:18:31.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6c60ee700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0063c90 con 0x7fc6c00a7bb0 2021-12-17T18:18:31.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6c60ee700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0063f30 con 0x7fc6c00b1730 2021-12-17T18:18:31.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6bffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c00b21f0 0x7fc6c0149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6bffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c00b21f0 0x7fc6c0149db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48424/0 (socket says 172.21.15.62:48424) 2021-12-17T18:18:31.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6bffff700 1 -- 172.21.15.62:0/3753626565 learned_addr learned my addr 172.21.15.62:0/3753626565 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:31.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6bf7fe700 1 --2- 172.21.15.62:0/3753626565 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc6c00a7bb0 0x7fc6c01576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6beffd700 1 --2- 172.21.15.62:0/3753626565 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6c00b1730 0x7fc6c0063450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6bffff700 1 -- 172.21.15.62:0/3753626565 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6c00b1730 msgr2=0x7fc6c0063450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6bffff700 1 --2- 172.21.15.62:0/3753626565 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6c00b1730 0x7fc6c0063450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6bffff700 1 -- 172.21.15.62:0/3753626565 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc6c00a7bb0 msgr2=0x7fc6c01576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:31.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6bffff700 1 --2- 172.21.15.62:0/3753626565 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc6c00a7bb0 0x7fc6c01576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:31.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6bffff700 1 -- 172.21.15.62:0/3753626565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b8009470 con 0x7fc6c00b21f0 2021-12-17T18:18:31.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6bffff700 1 --2- 172.21.15.62:0/3753626565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c00b21f0 0x7fc6c0149db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fc6b80032f0 tx=0x7fc6b8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:31.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6bcff9700 1 -- 172.21.15.62:0/3753626565 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6b800b8d0 con 0x7fc6c00b21f0 2021-12-17T18:18:31.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6bcff9700 1 -- 172.21.15.62:0/3753626565 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b801f3f0 con 0x7fc6c00b21f0 2021-12-17T18:18:31.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6c60ee700 1 -- 172.21.15.62:0/3753626565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c00a9430 con 0x7fc6c00b21f0 2021-12-17T18:18:31.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6bcff9700 1 -- 172.21.15.62:0/3753626565 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6b800b600 con 0x7fc6c00b21f0 2021-12-17T18:18:31.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.930+0000 7fc6c60ee700 1 -- 172.21.15.62:0/3753626565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c0066d50 con 0x7fc6c00b21f0 2021-12-17T18:18:31.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.934+0000 7fc6c60ee700 1 -- 172.21.15.62:0/3753626565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c00640f0 con 0x7fc6c00b21f0 2021-12-17T18:18:31.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.934+0000 7fc6bcff9700 1 -- 172.21.15.62:0/3753626565 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc6b8026030 con 0x7fc6c00b21f0 2021-12-17T18:18:31.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.934+0000 7fc6bcff9700 1 --2- 172.21.15.62:0/3753626565 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc6a00536a0 0x7fc6a0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:31.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.934+0000 7fc6bcff9700 1 -- 172.21.15.62:0/3753626565 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc6b806c3a0 con 0x7fc6c00b21f0 2021-12-17T18:18:31.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.934+0000 7fc6bf7fe700 1 --2- 172.21.15.62:0/3753626565 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc6a00536a0 0x7fc6a0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:31.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.934+0000 7fc6bf7fe700 1 --2- 172.21.15.62:0/3753626565 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc6a00536a0 0x7fc6a0055b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc6b000d000 tx=0x7fc6b0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:31.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:31.942+0000 7fc6bcff9700 1 -- 172.21.15.62:0/3753626565 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc6b8043500 con 0x7fc6c00b21f0 2021-12-17T18:18:32.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:32.102+0000 7fc6c60ee700 1 -- 172.21.15.62:0/3753626565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6c00b2f10 con 0x7fc6c00b21f0 2021-12-17T18:18:32.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:32.106+0000 7fc6bcff9700 1 -- 172.21.15.62:0/3753626565 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2137 (secure 0 0 0) 0x7fc6b8015090 con 0x7fc6c00b21f0 2021-12-17T18:18:32.110 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:32.110 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/1930484969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1930484969},{"type":"v1","addr":"172.21.15.109:6835","nonce":1930484969}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:18:19.175750+0000","modified":"2021-12-17T18:18:20.179555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.62:6833/3194210554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3194210554},{"type":"v1","addr":"172.21.15.62:6833","nonce":3194210554}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-12-17T18:18:32.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:32.106+0000 7fc6c60ee700 1 -- 172.21.15.62:0/3753626565 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc6a00536a0 msgr2=0x7fc6a0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:32.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:32.106+0000 7fc6c60ee700 1 --2- 172.21.15.62:0/3753626565 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc6a00536a0 0x7fc6a0055b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc6b000d000 tx=0x7fc6b0009040).stop 2021-12-17T18:18:32.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:32.106+0000 7fc6c60ee700 1 -- 172.21.15.62:0/3753626565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c00b21f0 msgr2=0x7fc6c0149db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:32.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:32.106+0000 7fc6c60ee700 1 --2- 172.21.15.62:0/3753626565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c00b21f0 0x7fc6c0149db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fc6b80032f0 tx=0x7fc6b8016000).stop 2021-12-17T18:18:32.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:32.106+0000 7fc6c60ee700 1 -- 172.21.15.62:0/3753626565 shutdown_connections 2021-12-17T18:18:32.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:32.106+0000 7fc6c60ee700 1 --2- 172.21.15.62:0/3753626565 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc6a00536a0 0x7fc6a0055b60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:32.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:32.106+0000 7fc6c60ee700 1 --2- 172.21.15.62:0/3753626565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c00b21f0 0x7fc6c0149db0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:32.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:32.106+0000 7fc6c60ee700 1 --2- 172.21.15.62:0/3753626565 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6c00b1730 0x7fc6c0063450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:32.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:32.106+0000 7fc6c60ee700 1 --2- 172.21.15.62:0/3753626565 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc6c00a7bb0 0x7fc6c01576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:32.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:32.110+0000 7fc6c60ee700 1 -- 172.21.15.62:0/3753626565 >> 172.21.15.62:0/3753626565 conn(0x7fc6c005f730 msgr2=0x7fc6c00ad560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:32.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:32.110+0000 7fc6c60ee700 1 -- 172.21.15.62:0/3753626565 shutdown_connections 2021-12-17T18:18:32.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:32.110+0000 7fc6c60ee700 1 -- 172.21.15.62:0/3753626565 wait complete. 2021-12-17T18:18:32.117 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 5 2021-12-17T18:18:32.332 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:18:19.175750+0000', 'modified': '2021-12-17T18:18:20.179555+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4264}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4264': {'gid': 4264, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.62:6833/3194210554', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 3194210554}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 3194210554}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:18:32.332 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:18:32.333 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:18:32.453 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":4264,"want_state":"up:active","state":"up:active","rank_uptime":13.261562803,"mdsmap_epoch":5,"osdmap_epoch":23,"osdmap_epoch_barrier":23,"uptime":16.617132218999998} 2021-12-17T18:18:32.454 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 4264, "mdsmap_epoch": 5, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "rank_uptime": 13.261562803, "state": "up:active", "uptime": 16.617132219, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:18:32.454 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:18:32.455 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-12-17T18:18:32.455 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-12-17T18:18:32.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:32.456 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:18:32.464 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:18:32.523 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:18:32.523 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:18:32.537 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:18:32.539 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:18:32.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:32.540 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:18:32.547 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:18:32.548 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:18:32.550 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:18:32.565 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:18:32.566 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:18:32.579 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:18:32.580 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:18:32.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:32.581 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:18:32.645 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2021-12-17T18:18:32.642+0000 7efed4bac080 -1 init, newargv = 0x559eaa8b2fa0 newargc=9ceph-fuse[13867]: starting ceph client 2021-12-17T18:18:32.646 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr: 2021-12-17T18:18:32.655 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[13867]: starting fuse 2021-12-17T18:18:32.735 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:18:32.738 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:18:32.741 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:18:32.743 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:18:32.746 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:18:33.687 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:18:33.705 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:18:33.706 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:18:33.721 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:18:33.723 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:18:33.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:33.724 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:18:33.780 INFO:teuthology.orchestra.run.smithi125.stdout:52 2021-12-17T18:18:33.780 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:18:33.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:33.781 DEBUG:teuthology.orchestra.run.smithi125:> sudo python3 -c ' 2021-12-17T18:18:33.782 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2021-12-17T18:18:33.782 DEBUG:teuthology.orchestra.run.smithi125:> import re 2021-12-17T18:18:33.783 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:18:33.783 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2021-12-17T18:18:33.783 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:18:33.784 DEBUG:teuthology.orchestra.run.smithi125:> def find_socket(client_name): 2021-12-17T18:18:33.784 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-12-17T18:18:33.785 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2021-12-17T18:18:33.785 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:18:33.785 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2021-12-17T18:18:33.786 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2021-12-17T18:18:33.786 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2021-12-17T18:18:33.786 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2021-12-17T18:18:33.787 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:18:33.787 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2021-12-17T18:18:33.788 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:18:33.788 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:18:33.788 DEBUG:teuthology.orchestra.run.smithi125:> return f 2021-12-17T18:18:33.789 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:18:33.789 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:18:33.789 DEBUG:teuthology.orchestra.run.smithi125:> print(find_socket("client.0")) 2021-12-17T18:18:33.790 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:18:33.833 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.13867.asok 2021-12-17T18:18:33.838 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13867.asok 2021-12-17T18:18:33.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:33.839 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13867.asok status 2021-12-17T18:18:33.930 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2021-12-17T18:18:33.930 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2021-12-17T18:18:33.930 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:18:33.930 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:18:33.931 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2021-12-17T18:18:33.931 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2021-12-17T18:18:33.931 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-12-17T18:18:33.932 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "13867", 2021-12-17T18:18:33.932 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2021-12-17T18:18:33.932 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:18:33.932 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2021-12-17T18:18:33.933 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2021-12-17T18:18:33.933 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 4594, 2021-12-17T18:18:33.933 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2021-12-17T18:18:33.933 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2021-12-17T18:18:33.934 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2021-12-17T18:18:33.934 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 4594 2021-12-17T18:18:33.934 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:18:33.934 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:18:33.934 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:18:33.935 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:18:33.935 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 3953150487 2021-12-17T18:18:33.935 INFO:teuthology.orchestra.run.smithi125.stdout: } 2021-12-17T18:18:33.935 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:18:33.936 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:18:33.936 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:18:33.936 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:18:33.936 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 3953150487 2021-12-17T18:18:33.937 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:18:33.937 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.4594 172.21.15.125:0/3953150487", 2021-12-17T18:18:33.937 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "172.21.15.125:0/3953150487", 2021-12-17T18:18:33.937 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2021-12-17T18:18:33.937 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 5, 2021-12-17T18:18:33.938 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 23, 2021-12-17T18:18:33.938 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:18:33.938 INFO:teuthology.orchestra.run.smithi125.stdout: "blacklisted": false, 2021-12-17T18:18:33.938 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2021-12-17T18:18:33.939 INFO:teuthology.orchestra.run.smithi125.stdout:} 2021-12-17T18:18:33.940 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.046+0000 7f797e853700 1 Processor -- start 2021-12-17T18:18:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.046+0000 7f797e853700 1 -- start start 2021-12-17T18:18:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797e853700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f797813d450 0x7f7978140510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797e853700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797813d8a0 con 0x7f79780b2a40 2021-12-17T18:18:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797e853700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79780b2e20 con 0x7f79780afcf0 2021-12-17T18:18:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797e853700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79780ae860 con 0x7f797813d450 2021-12-17T18:18:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797e052700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f797813d450 0x7f7978140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797d851700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f79780b2a40 0x7f797813cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60240/0 (socket says 172.21.15.62:60240) 2021-12-17T18:18:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797d851700 1 -- 172.21.15.62:0/3427360065 learned_addr learned my addr 172.21.15.62:0/3427360065 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797e052700 1 -- 172.21.15.62:0/3427360065 >> v1:172.21.15.109:6789/0 conn(0x7f79780afcf0 legacy=0x7f797813fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797e052700 1 -- 172.21.15.62:0/3427360065 >> v1:172.21.15.62:6789/0 conn(0x7f79780b2a40 legacy=0x7f797813cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797e052700 1 -- 172.21.15.62:0/3427360065 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7978143800 con 0x7f797813d450 2021-12-17T18:18:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797e052700 1 --2- 172.21.15.62:0/3427360065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f797813d450 0x7f7978140510 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f79700032f0 tx=0x7f797000b470).ready entity=mon.0 client_cookie=64ea432b0c181b30 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797c84f700 1 -- 172.21.15.62:0/3427360065 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f797000de20 con 0x7f797813d450 2021-12-17T18:18:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797c84f700 1 -- 172.21.15.62:0/3427360065 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7970010470 con 0x7f797813d450 2021-12-17T18:18:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797c84f700 1 -- 172.21.15.62:0/3427360065 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79700107d0 con 0x7f797813d450 2021-12-17T18:18:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797e853700 1 -- 172.21.15.62:0/3427360065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f797813d450 msgr2=0x7f7978140510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797e853700 1 --2- 172.21.15.62:0/3427360065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f797813d450 0x7f7978140510 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f79700032f0 tx=0x7f797000b470).stop 2021-12-17T18:18:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797e853700 1 -- 172.21.15.62:0/3427360065 shutdown_connections 2021-12-17T18:18:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797e853700 1 --2- 172.21.15.62:0/3427360065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f797813d450 0x7f7978140510 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797e853700 1 -- 172.21.15.62:0/3427360065 >> 172.21.15.62:0/3427360065 conn(0x7f797805c750 msgr2=0x7f797805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797e853700 1 -- 172.21.15.62:0/3427360065 shutdown_connections 2021-12-17T18:18:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.050+0000 7f797e853700 1 -- 172.21.15.62:0/3427360065 wait complete. 2021-12-17T18:18:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.054+0000 7f797e853700 1 Processor -- start 2021-12-17T18:18:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.054+0000 7f797e853700 1 -- start start 2021-12-17T18:18:34.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.054+0000 7f797e853700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79780afcf0 0x7f7978065490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.054+0000 7f797e853700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b2a40 0x7f79781406d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f797e853700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f797813d450 0x7f7978151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f797e853700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797811f630 con 0x7f79780b2a40 2021-12-17T18:18:34.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f797e853700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79781517d0 con 0x7f79780afcf0 2021-12-17T18:18:34.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f797e853700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7978151a70 con 0x7f797813d450 2021-12-17T18:18:34.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f797d050700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b2a40 0x7f79781406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f797d050700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b2a40 0x7f79781406d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48436/0 (socket says 172.21.15.62:48436) 2021-12-17T18:18:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f797d050700 1 -- 172.21.15.62:0/2465037323 learned_addr learned my addr 172.21.15.62:0/2465037323 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f797d851700 1 --2- 172.21.15.62:0/2465037323 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79780afcf0 0x7f7978065490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f797e052700 1 --2- 172.21.15.62:0/2465037323 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f797813d450 0x7f7978151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f797d050700 1 -- 172.21.15.62:0/2465037323 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f797813d450 msgr2=0x7f7978151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f797d050700 1 --2- 172.21.15.62:0/2465037323 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f797813d450 0x7f7978151f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f797d050700 1 -- 172.21.15.62:0/2465037323 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79780afcf0 msgr2=0x7f7978065490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f797d050700 1 --2- 172.21.15.62:0/2465037323 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79780afcf0 0x7f7978065490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f797d050700 1 -- 172.21.15.62:0/2465037323 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797000b710 con 0x7f79780b2a40 2021-12-17T18:18:34.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f797d050700 1 --2- 172.21.15.62:0/2465037323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b2a40 0x7f79781406d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f79780b3430 tx=0x7f7968007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:34.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f7966ffd700 1 -- 172.21.15.62:0/2465037323 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7968012400 con 0x7f79780b2a40 2021-12-17T18:18:34.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f7966ffd700 1 -- 172.21.15.62:0/2465037323 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7968012560 con 0x7f79780b2a40 2021-12-17T18:18:34.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f797e853700 1 -- 172.21.15.62:0/2465037323 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7978065100 con 0x7f79780b2a40 2021-12-17T18:18:34.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f7966ffd700 1 -- 172.21.15.62:0/2465037323 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79680128c0 con 0x7f79780b2a40 2021-12-17T18:18:34.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.058+0000 7f797e853700 1 -- 172.21.15.62:0/2465037323 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797811f170 con 0x7f79780b2a40 2021-12-17T18:18:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.062+0000 7f7966ffd700 1 -- 172.21.15.62:0/2465037323 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7968019030 con 0x7f79780b2a40 2021-12-17T18:18:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.062+0000 7f797e853700 1 -- 172.21.15.62:0/2465037323 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797811f450 con 0x7f79780b2a40 2021-12-17T18:18:34.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.062+0000 7f7966ffd700 1 --2- 172.21.15.62:0/2465037323 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7958053610 0x7f7958055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.062+0000 7f7966ffd700 1 -- 172.21.15.62:0/2465037323 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f796806ad50 con 0x7f79780b2a40 2021-12-17T18:18:34.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.062+0000 7f797d851700 1 --2- 172.21.15.62:0/2465037323 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7958053610 0x7f7958055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.062+0000 7f797d851700 1 --2- 172.21.15.62:0/2465037323 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7958053610 0x7f7958055ad0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f797400d000 tx=0x7f7974009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.070+0000 7f7966ffd700 1 -- 172.21.15.62:0/2465037323 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7968041d40 con 0x7f79780b2a40 2021-12-17T18:18:34.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.202+0000 7f797e853700 1 -- 172.21.15.62:0/2465037323 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7978143aa0 con 0x7f79780b2a40 2021-12-17T18:18:34.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.202+0000 7f7966ffd700 1 -- 172.21.15.62:0/2465037323 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f7968045360 con 0x7f79780b2a40 2021-12-17T18:18:34.208 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:34.208 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:20.178383+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:17.128555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:18.180577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:34.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.206+0000 7f797e853700 1 -- 172.21.15.62:0/2465037323 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7958053610 msgr2=0x7f7958055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.206+0000 7f797e853700 1 --2- 172.21.15.62:0/2465037323 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7958053610 0x7f7958055ad0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f797400d000 tx=0x7f7974009040).stop 2021-12-17T18:18:34.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.206+0000 7f797e853700 1 -- 172.21.15.62:0/2465037323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b2a40 msgr2=0x7f79781406d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.206+0000 7f797e853700 1 --2- 172.21.15.62:0/2465037323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b2a40 0x7f79781406d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f79780b3430 tx=0x7f7968007c50).stop 2021-12-17T18:18:34.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.206+0000 7f797e853700 1 -- 172.21.15.62:0/2465037323 shutdown_connections 2021-12-17T18:18:34.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.206+0000 7f797e853700 1 --2- 172.21.15.62:0/2465037323 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7958053610 0x7f7958055ad0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.206+0000 7f797e853700 1 --2- 172.21.15.62:0/2465037323 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f797813d450 0x7f7978151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.206+0000 7f797e853700 1 --2- 172.21.15.62:0/2465037323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b2a40 0x7f79781406d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.206+0000 7f797e853700 1 --2- 172.21.15.62:0/2465037323 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79780afcf0 0x7f7978065490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.206+0000 7f797e853700 1 -- 172.21.15.62:0/2465037323 >> 172.21.15.62:0/2465037323 conn(0x7f797805c750 msgr2=0x7f79781290f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:34.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.206+0000 7f797e853700 1 -- 172.21.15.62:0/2465037323 shutdown_connections 2021-12-17T18:18:34.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.206+0000 7f797e853700 1 -- 172.21.15.62:0/2465037323 wait complete. 2021-12-17T18:18:34.222 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:18:17.128555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:18:18.180577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:18:34.222 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:18:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b74fdf700 1 Processor -- start 2021-12-17T18:18:34.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b74fdf700 1 -- start start 2021-12-17T18:18:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b74fdf700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b700b05b0 0x7f1b70146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b74fdf700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1b700b5dd0 0x7f1b70146b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b74fdf700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b700b2010 con 0x7f1b70147070 2021-12-17T18:18:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b74fdf700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b700b0990 con 0x7f1b700b5dd0 2021-12-17T18:18:34.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b74fdf700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b700b2240 con 0x7f1b700b05b0 2021-12-17T18:18:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b6dd9b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1b700b5dd0 0x7f1b70146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b6e59c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b700b05b0 0x7f1b70146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b6e59c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b700b05b0 0x7f1b70146690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:42144/0 (socket says 172.21.15.62:42144) 2021-12-17T18:18:34.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b6e59c700 1 -- 172.21.15.62:0/2906383263 learned_addr learned my addr 172.21.15.62:0/2906383263 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b6d59a700 1 -- 172.21.15.62:0/2906383263 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873868305 0 0) 0x7f1b700b2010 con 0x7f1b70147070 2021-12-17T18:18:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b6d59a700 1 -- 172.21.15.62:0/2906383263 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b54003260 con 0x7f1b70147070 2021-12-17T18:18:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b6e59c700 1 -- 172.21.15.62:0/2906383263 >> v2:172.21.15.109:3300/0 conn(0x7f1b700b5dd0 msgr2=0x7f1b70146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b6e59c700 1 --2- 172.21.15.62:0/2906383263 >> v2:172.21.15.109:3300/0 conn(0x7f1b700b5dd0 0x7f1b70146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b6e59c700 1 -- 172.21.15.62:0/2906383263 >> v1:172.21.15.109:6789/0 conn(0x7f1b70147070 legacy=0x7f1b7005f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b6e59c700 1 -- 172.21.15.62:0/2906383263 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b700b24e0 con 0x7f1b700b05b0 2021-12-17T18:18:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b6e59c700 1 --2- 172.21.15.62:0/2906383263 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b700b05b0 0x7f1b70146690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1b64002f70 tx=0x7f1b64006eb0).ready entity=mon.2 client_cookie=aededd8697cd6f2 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b6d59a700 1 -- 172.21.15.62:0/2906383263 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b6400d5c0 con 0x7f1b700b05b0 2021-12-17T18:18:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b6d59a700 1 -- 172.21.15.62:0/2906383263 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b64000e90 con 0x7f1b700b05b0 2021-12-17T18:18:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.326+0000 7f1b6d59a700 1 -- 172.21.15.62:0/2906383263 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b6400d950 con 0x7f1b700b05b0 2021-12-17T18:18:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b74fdf700 1 -- 172.21.15.62:0/2906383263 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b700b05b0 msgr2=0x7f1b70146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b74fdf700 1 --2- 172.21.15.62:0/2906383263 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b700b05b0 0x7f1b70146690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1b64002f70 tx=0x7f1b64006eb0).stop 2021-12-17T18:18:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b74fdf700 1 -- 172.21.15.62:0/2906383263 shutdown_connections 2021-12-17T18:18:34.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b74fdf700 1 --2- 172.21.15.62:0/2906383263 >> v2:172.21.15.109:3300/0 conn(0x7f1b700b5dd0 0x7f1b70146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b74fdf700 1 --2- 172.21.15.62:0/2906383263 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b700b05b0 0x7f1b70146690 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b74fdf700 1 -- 172.21.15.62:0/2906383263 >> 172.21.15.62:0/2906383263 conn(0x7f1b70062510 msgr2=0x7f1b700628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:34.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b74fdf700 1 -- 172.21.15.62:0/2906383263 shutdown_connections 2021-12-17T18:18:34.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b74fdf700 1 -- 172.21.15.62:0/2906383263 wait complete. 2021-12-17T18:18:34.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b74fdf700 1 Processor -- start 2021-12-17T18:18:34.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b74fdf700 1 -- start start 2021-12-17T18:18:34.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b74fdf700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b700b05b0 0x7f1b701438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b74fdf700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1b700b5dd0 0x7f1b70152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b74fdf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b70067160 0x7f1b70152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b74fdf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b701523d0 con 0x7f1b70067160 2021-12-17T18:18:34.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b74fdf700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b700a6470 con 0x7f1b700b5dd0 2021-12-17T18:18:34.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b74fdf700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b70066440 con 0x7f1b700b05b0 2021-12-17T18:18:34.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b6ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b70067160 0x7f1b70152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b6ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b70067160 0x7f1b70152c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48450/0 (socket says 172.21.15.62:48450) 2021-12-17T18:18:34.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b6ed9d700 1 -- 172.21.15.62:0/1276788617 learned_addr learned my addr 172.21.15.62:0/1276788617 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:34.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b6dd9b700 1 --2- 172.21.15.62:0/1276788617 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1b700b5dd0 0x7f1b70152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b6e59c700 1 --2- 172.21.15.62:0/1276788617 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b700b05b0 0x7f1b701438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b6ed9d700 1 -- 172.21.15.62:0/1276788617 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b700b05b0 msgr2=0x7f1b701438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b6ed9d700 1 --2- 172.21.15.62:0/1276788617 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b700b05b0 0x7f1b701438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b6ed9d700 1 -- 172.21.15.62:0/1276788617 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1b700b5dd0 msgr2=0x7f1b70152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b6ed9d700 1 --2- 172.21.15.62:0/1276788617 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1b700b5dd0 0x7f1b70152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b6ed9d700 1 -- 172.21.15.62:0/1276788617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6400b1e0 con 0x7f1b70067160 2021-12-17T18:18:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.330+0000 7f1b6ed9d700 1 --2- 172.21.15.62:0/1276788617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b70067160 0x7f1b70152c40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f1b68001490 tx=0x7f1b68007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.334+0000 7f1b5f7fe700 1 -- 172.21.15.62:0/1276788617 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b68002310 con 0x7f1b70067160 2021-12-17T18:18:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.334+0000 7f1b5f7fe700 1 -- 172.21.15.62:0/1276788617 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b68002470 con 0x7f1b70067160 2021-12-17T18:18:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.334+0000 7f1b74fdf700 1 -- 172.21.15.62:0/1276788617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b700666e0 con 0x7f1b70067160 2021-12-17T18:18:34.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.334+0000 7f1b5f7fe700 1 -- 172.21.15.62:0/1276788617 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b680017a0 con 0x7f1b70067160 2021-12-17T18:18:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.334+0000 7f1b74fdf700 1 -- 172.21.15.62:0/1276788617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b70153130 con 0x7f1b70067160 2021-12-17T18:18:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.334+0000 7f1b74fdf700 1 -- 172.21.15.62:0/1276788617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b700a62e0 con 0x7f1b70067160 2021-12-17T18:18:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.334+0000 7f1b5f7fe700 1 -- 172.21.15.62:0/1276788617 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1b68010030 con 0x7f1b70067160 2021-12-17T18:18:34.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.334+0000 7f1b5f7fe700 1 --2- 172.21.15.62:0/1276788617 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1b4c053610 0x7f1b4c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.334+0000 7f1b5f7fe700 1 -- 172.21.15.62:0/1276788617 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1b6806b810 con 0x7f1b70067160 2021-12-17T18:18:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.334+0000 7f1b6e59c700 1 --2- 172.21.15.62:0/1276788617 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1b4c053610 0x7f1b4c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.338+0000 7f1b6e59c700 1 --2- 172.21.15.62:0/1276788617 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1b4c053610 0x7f1b4c055ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f1b6401c000 tx=0x7f1b64015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:34.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.342+0000 7f1b5f7fe700 1 -- 172.21.15.62:0/1276788617 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1b68042970 con 0x7f1b70067160 2021-12-17T18:18:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.466+0000 7f1b74fdf700 1 -- 172.21.15.62:0/1276788617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1b70066870 con 0x7f1b70067160 2021-12-17T18:18:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.466+0000 7f1b5f7fe700 1 -- 172.21.15.62:0/1276788617 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1b68045f90 con 0x7f1b70067160 2021-12-17T18:18:34.472 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:18:34.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.470+0000 7f1b74fdf700 1 -- 172.21.15.62:0/1276788617 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1b4c053610 msgr2=0x7f1b4c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.470+0000 7f1b74fdf700 1 --2- 172.21.15.62:0/1276788617 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1b4c053610 0x7f1b4c055ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f1b6401c000 tx=0x7f1b64015000).stop 2021-12-17T18:18:34.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.470+0000 7f1b74fdf700 1 -- 172.21.15.62:0/1276788617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b70067160 msgr2=0x7f1b70152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.470+0000 7f1b74fdf700 1 --2- 172.21.15.62:0/1276788617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b70067160 0x7f1b70152c40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f1b68001490 tx=0x7f1b68007da0).stop 2021-12-17T18:18:34.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.470+0000 7f1b74fdf700 1 -- 172.21.15.62:0/1276788617 shutdown_connections 2021-12-17T18:18:34.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.470+0000 7f1b74fdf700 1 --2- 172.21.15.62:0/1276788617 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1b4c053610 0x7f1b4c055ad0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.470+0000 7f1b74fdf700 1 --2- 172.21.15.62:0/1276788617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b70067160 0x7f1b70152c40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.470+0000 7f1b74fdf700 1 --2- 172.21.15.62:0/1276788617 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1b700b5dd0 0x7f1b70152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.470+0000 7f1b74fdf700 1 --2- 172.21.15.62:0/1276788617 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b700b05b0 0x7f1b701438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.470+0000 7f1b74fdf700 1 -- 172.21.15.62:0/1276788617 >> 172.21.15.62:0/1276788617 conn(0x7f1b70062510 msgr2=0x7f1b700b8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:34.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.470+0000 7f1b74fdf700 1 -- 172.21.15.62:0/1276788617 shutdown_connections 2021-12-17T18:18:34.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.470+0000 7f1b74fdf700 1 -- 172.21.15.62:0/1276788617 wait complete. 2021-12-17T18:18:34.491 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:18:34.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.598+0000 7f5af759e700 1 Processor -- start 2021-12-17T18:18:34.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.598+0000 7f5af759e700 1 -- start start 2021-12-17T18:18:34.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.598+0000 7f5af759e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5af805c8f0 0x7f5af80b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.598+0000 7f5af759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af805f9d0 con 0x7f5af8141890 2021-12-17T18:18:34.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.598+0000 7f5af759e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af80abe60 con 0x7f5af80af3a0 2021-12-17T18:18:34.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.598+0000 7f5af759e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af805ff60 con 0x7f5af805c8f0 2021-12-17T18:18:34.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.598+0000 7f5af6d9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5af8141890 0x7f5af81445e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60272/0 (socket says 172.21.15.62:60272) 2021-12-17T18:18:34.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.598+0000 7f5af6d9d700 1 -- 172.21.15.62:0/2604053876 learned_addr learned my addr 172.21.15.62:0/2604053876 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:34.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.598+0000 7f5af659c700 1 --2- 172.21.15.62:0/2604053876 >> v2:172.21.15.109:3300/0 conn(0x7f5af805c8f0 0x7f5af80b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.598+0000 7f5af559a700 1 -- 172.21.15.62:0/2604053876 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286341497 0 0) 0x7f5af805f9d0 con 0x7f5af8141890 2021-12-17T18:18:34.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.598+0000 7f5af559a700 1 -- 172.21.15.62:0/2604053876 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5adc003260 con 0x7f5af8141890 2021-12-17T18:18:34.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.598+0000 7f5af659c700 1 -- 172.21.15.62:0/2604053876 >> v1:172.21.15.109:6789/0 conn(0x7f5af80af3a0 legacy=0x7f5af8141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.598+0000 7f5af659c700 1 -- 172.21.15.62:0/2604053876 >> v1:172.21.15.62:6789/0 conn(0x7f5af8141890 legacy=0x7f5af81445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.598+0000 7f5af659c700 1 -- 172.21.15.62:0/2604053876 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af805ccd0 con 0x7f5af805c8f0 2021-12-17T18:18:34.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.598+0000 7f5af659c700 1 --2- 172.21.15.62:0/2604053876 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5af805c8f0 0x7f5af80b0620 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5aec002f70 tx=0x7f5aec006df0).ready entity=mon.1 client_cookie=8c9acb985af03f5a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:34.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af559a700 1 -- 172.21.15.62:0/2604053876 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aec00d610 con 0x7f5af805c8f0 2021-12-17T18:18:34.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af559a700 1 -- 172.21.15.62:0/2604053876 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec000e90 con 0x7f5af805c8f0 2021-12-17T18:18:34.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af559a700 1 -- 172.21.15.62:0/2604053876 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aec00d960 con 0x7f5af805c8f0 2021-12-17T18:18:34.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af759e700 1 -- 172.21.15.62:0/2604053876 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5af805c8f0 msgr2=0x7f5af80b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af759e700 1 --2- 172.21.15.62:0/2604053876 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5af805c8f0 0x7f5af80b0620 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5aec002f70 tx=0x7f5aec006df0).stop 2021-12-17T18:18:34.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af759e700 1 -- 172.21.15.62:0/2604053876 shutdown_connections 2021-12-17T18:18:34.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af759e700 1 --2- 172.21.15.62:0/2604053876 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5af805c8f0 0x7f5af80b0620 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af759e700 1 -- 172.21.15.62:0/2604053876 >> 172.21.15.62:0/2604053876 conn(0x7f5af805be70 msgr2=0x7f5af8062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:34.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af759e700 1 -- 172.21.15.62:0/2604053876 shutdown_connections 2021-12-17T18:18:34.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af759e700 1 -- 172.21.15.62:0/2604053876 wait complete. 2021-12-17T18:18:34.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af759e700 1 Processor -- start 2021-12-17T18:18:34.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af759e700 1 -- start start 2021-12-17T18:18:34.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af805c8f0 0x7f5af8143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af80af3a0 0x7f5af80669b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5af8141890 0x7f5af80ad730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8140370 con 0x7f5af805c8f0 2021-12-17T18:18:34.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af81405a0 con 0x7f5af8141890 2021-12-17T18:18:34.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8140840 con 0x7f5af80af3a0 2021-12-17T18:18:34.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af805c8f0 0x7f5af8143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af805c8f0 0x7f5af8143c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48462/0 (socket says 172.21.15.62:48462) 2021-12-17T18:18:34.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af659c700 1 -- 172.21.15.62:0/3696655033 learned_addr learned my addr 172.21.15.62:0/3696655033 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:34.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af6d9d700 1 --2- 172.21.15.62:0/3696655033 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5af8141890 0x7f5af80ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af659c700 1 -- 172.21.15.62:0/3696655033 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af80af3a0 msgr2=0x7f5af80669b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af5d9b700 1 --2- 172.21.15.62:0/3696655033 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af80af3a0 0x7f5af80669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af659c700 1 --2- 172.21.15.62:0/3696655033 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af80af3a0 0x7f5af80669b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af659c700 1 -- 172.21.15.62:0/3696655033 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5af8141890 msgr2=0x7f5af80ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af659c700 1 --2- 172.21.15.62:0/3696655033 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5af8141890 0x7f5af80ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af659c700 1 -- 172.21.15.62:0/3696655033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec00b180 con 0x7f5af805c8f0 2021-12-17T18:18:34.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af6d9d700 1 --2- 172.21.15.62:0/3696655033 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5af8141890 0x7f5af80ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:18:34.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.602+0000 7f5af5d9b700 1 --2- 172.21.15.62:0/3696655033 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af80af3a0 0x7f5af80669b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:18:34.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.606+0000 7f5af659c700 1 --2- 172.21.15.62:0/3696655033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af805c8f0 0x7f5af8143c60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f5aec002f70 tx=0x7f5aec014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:34.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.606+0000 7f5ae77fe700 1 -- 172.21.15.62:0/3696655033 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aec00d290 con 0x7f5af805c8f0 2021-12-17T18:18:34.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.606+0000 7f5ae77fe700 1 -- 172.21.15.62:0/3696655033 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec01e400 con 0x7f5af805c8f0 2021-12-17T18:18:34.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.606+0000 7f5af759e700 1 -- 172.21.15.62:0/3696655033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af8066ea0 con 0x7f5af805c8f0 2021-12-17T18:18:34.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.606+0000 7f5ae77fe700 1 -- 172.21.15.62:0/3696655033 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aec01e760 con 0x7f5af805c8f0 2021-12-17T18:18:34.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.606+0000 7f5af759e700 1 -- 172.21.15.62:0/3696655033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af8140f00 con 0x7f5af805c8f0 2021-12-17T18:18:34.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.606+0000 7f5af759e700 1 -- 172.21.15.62:0/3696655033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af8141d00 con 0x7f5af805c8f0 2021-12-17T18:18:34.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.606+0000 7f5ae77fe700 1 -- 172.21.15.62:0/3696655033 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5aec025030 con 0x7f5af805c8f0 2021-12-17T18:18:34.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.606+0000 7f5ae77fe700 1 --2- 172.21.15.62:0/3696655033 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5ad4053580 0x7f5ad4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.606+0000 7f5ae77fe700 1 -- 172.21.15.62:0/3696655033 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5aec06c810 con 0x7f5af805c8f0 2021-12-17T18:18:34.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.606+0000 7f5af5d9b700 1 --2- 172.21.15.62:0/3696655033 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5ad4053580 0x7f5ad4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.606+0000 7f5af5d9b700 1 --2- 172.21.15.62:0/3696655033 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5ad4053580 0x7f5ad4055a40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f5ae8008000 tx=0x7f5ae8009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:34.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.610+0000 7f5ae77fe700 1 -- 172.21.15.62:0/3696655033 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5aec043970 con 0x7f5af805c8f0 2021-12-17T18:18:34.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.738+0000 7f5af759e700 1 -- 172.21.15.62:0/3696655033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5af8140a00 con 0x7f5af805c8f0 2021-12-17T18:18:34.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.738+0000 7f5ae77fe700 1 -- 172.21.15.62:0/3696655033 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5aec023020 con 0x7f5af805c8f0 2021-12-17T18:18:34.743 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:34.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.742+0000 7f5af759e700 1 -- 172.21.15.62:0/3696655033 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5ad4053580 msgr2=0x7f5ad4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.742+0000 7f5af759e700 1 --2- 172.21.15.62:0/3696655033 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5ad4053580 0x7f5ad4055a40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f5ae8008000 tx=0x7f5ae8009040).stop 2021-12-17T18:18:34.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.742+0000 7f5af759e700 1 -- 172.21.15.62:0/3696655033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af805c8f0 msgr2=0x7f5af8143c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.742+0000 7f5af759e700 1 --2- 172.21.15.62:0/3696655033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af805c8f0 0x7f5af8143c60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f5aec002f70 tx=0x7f5aec014000).stop 2021-12-17T18:18:34.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.742+0000 7f5af759e700 1 -- 172.21.15.62:0/3696655033 shutdown_connections 2021-12-17T18:18:34.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.742+0000 7f5af759e700 1 --2- 172.21.15.62:0/3696655033 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5ad4053580 0x7f5ad4055a40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.742+0000 7f5af759e700 1 --2- 172.21.15.62:0/3696655033 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5af8141890 0x7f5af80ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.742+0000 7f5af759e700 1 --2- 172.21.15.62:0/3696655033 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af80af3a0 0x7f5af80669b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.742+0000 7f5af759e700 1 --2- 172.21.15.62:0/3696655033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af805c8f0 0x7f5af8143c60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.742+0000 7f5af759e700 1 -- 172.21.15.62:0/3696655033 >> 172.21.15.62:0/3696655033 conn(0x7f5af805be70 msgr2=0x7f5af80b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:34.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.742+0000 7f5af759e700 1 -- 172.21.15.62:0/3696655033 shutdown_connections 2021-12-17T18:18:34.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.742+0000 7f5af759e700 1 -- 172.21.15.62:0/3696655033 wait complete. 2021-12-17T18:18:34.762 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:18:34.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f8015b51700 1 Processor -- start 2021-12-17T18:18:34.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f8015b51700 1 -- start start 2021-12-17T18:18:34.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f8015b51700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f80100b46d0 0x7f8010140550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f8015b51700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801005ce70 con 0x7f80100b4b40 2021-12-17T18:18:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f8015b51700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801005ffd0 con 0x7f801005ca90 2021-12-17T18:18:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f8015b51700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80100b31e0 con 0x7f80100b46d0 2021-12-17T18:18:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f8007fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f80100b46d0 0x7f8010140550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f8015350700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f80100b4b40 0x7f8010140a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60286/0 (socket says 172.21.15.62:60286) 2021-12-17T18:18:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f8015350700 1 -- 172.21.15.62:0/2400693475 learned_addr learned my addr 172.21.15.62:0/2400693475 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f80077fe700 1 -- 172.21.15.62:0/2400693475 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791652437 0 0) 0x7f801005ce70 con 0x7f80100b4b40 2021-12-17T18:18:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f8007fff700 1 -- 172.21.15.62:0/2400693475 >> v1:172.21.15.109:6789/0 conn(0x7f801005ca90 legacy=0x7f801005f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f8007fff700 1 -- 172.21.15.62:0/2400693475 >> v1:172.21.15.62:6789/0 conn(0x7f80100b4b40 legacy=0x7f8010140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f8007fff700 1 -- 172.21.15.62:0/2400693475 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80100b3f90 con 0x7f80100b46d0 2021-12-17T18:18:34.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f8007fff700 1 --2- 172.21.15.62:0/2400693475 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f80100b46d0 0x7f8010140550 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f8000002f70 tx=0x7f8000006df0).ready entity=mon.1 client_cookie=64dba69b0dc12981 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:34.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f80077fe700 1 -- 172.21.15.62:0/2400693475 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f800000d610 con 0x7f80100b46d0 2021-12-17T18:18:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f80077fe700 1 -- 172.21.15.62:0/2400693475 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8000000e90 con 0x7f80100b46d0 2021-12-17T18:18:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f80077fe700 1 -- 172.21.15.62:0/2400693475 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f800000d960 con 0x7f80100b46d0 2021-12-17T18:18:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f8015b51700 1 -- 172.21.15.62:0/2400693475 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f80100b46d0 msgr2=0x7f8010140550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.870+0000 7f8015b51700 1 --2- 172.21.15.62:0/2400693475 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f80100b46d0 0x7f8010140550 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f8000002f70 tx=0x7f8000006df0).stop 2021-12-17T18:18:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8015b51700 1 -- 172.21.15.62:0/2400693475 shutdown_connections 2021-12-17T18:18:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8015b51700 1 --2- 172.21.15.62:0/2400693475 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f80100b46d0 0x7f8010140550 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8015b51700 1 -- 172.21.15.62:0/2400693475 >> 172.21.15.62:0/2400693475 conn(0x7f801005bcd0 msgr2=0x7f8010062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8015b51700 1 -- 172.21.15.62:0/2400693475 shutdown_connections 2021-12-17T18:18:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8015b51700 1 -- 172.21.15.62:0/2400693475 wait complete. 2021-12-17T18:18:34.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8015b51700 1 Processor -- start 2021-12-17T18:18:34.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8015b51700 1 -- start start 2021-12-17T18:18:34.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8015b51700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f801005ca90 0x7f801013f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8015b51700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80100b46d0 0x7f80100b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8015b51700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f80100b4b40 0x7f8010130dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8015b51700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801013cf10 con 0x7f80100b46d0 2021-12-17T18:18:34.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8015b51700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801013cc70 con 0x7f801005ca90 2021-12-17T18:18:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8015b51700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80100b1300 con 0x7f80100b4b40 2021-12-17T18:18:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8007fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80100b46d0 0x7f80100b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8007fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80100b46d0 0x7f80100b67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48478/0 (socket says 172.21.15.62:48478) 2021-12-17T18:18:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8007fff700 1 -- 172.21.15.62:0/2389796522 learned_addr learned my addr 172.21.15.62:0/2389796522 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8014b4f700 1 --2- 172.21.15.62:0/2389796522 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f801005ca90 0x7f801013f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8015350700 1 --2- 172.21.15.62:0/2389796522 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f80100b4b40 0x7f8010130dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8007fff700 1 -- 172.21.15.62:0/2389796522 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f80100b4b40 msgr2=0x7f8010130dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8007fff700 1 --2- 172.21.15.62:0/2389796522 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f80100b4b40 0x7f8010130dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8007fff700 1 -- 172.21.15.62:0/2389796522 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f801005ca90 msgr2=0x7f801013f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:34.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8007fff700 1 --2- 172.21.15.62:0/2389796522 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f801005ca90 0x7f801013f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:34.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8007fff700 1 -- 172.21.15.62:0/2389796522 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800000b180 con 0x7f80100b46d0 2021-12-17T18:18:34.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8015350700 1 --2- 172.21.15.62:0/2389796522 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f80100b4b40 0x7f8010130dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:34.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8007fff700 1 --2- 172.21.15.62:0/2389796522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80100b46d0 0x7f80100b67f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f8000002f70 tx=0x7f8000015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:34.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8005ffb700 1 -- 172.21.15.62:0/2389796522 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f800000de70 con 0x7f80100b46d0 2021-12-17T18:18:34.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8005ffb700 1 -- 172.21.15.62:0/2389796522 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8000011bb0 con 0x7f80100b46d0 2021-12-17T18:18:34.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8015b51700 1 -- 172.21.15.62:0/2389796522 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80100b0450 con 0x7f80100b46d0 2021-12-17T18:18:34.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8005ffb700 1 -- 172.21.15.62:0/2389796522 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f800001e460 con 0x7f80100b46d0 2021-12-17T18:18:34.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.874+0000 7f8015b51700 1 -- 172.21.15.62:0/2389796522 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80100b0770 con 0x7f80100b46d0 2021-12-17T18:18:34.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.878+0000 7f8015b51700 1 -- 172.21.15.62:0/2389796522 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80100b14c0 con 0x7f80100b46d0 2021-12-17T18:18:34.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.878+0000 7f8005ffb700 1 -- 172.21.15.62:0/2389796522 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8000025030 con 0x7f80100b46d0 2021-12-17T18:18:34.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.878+0000 7f8005ffb700 1 --2- 172.21.15.62:0/2389796522 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7ff0053580 0x7f7ff0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:34.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.878+0000 7f8005ffb700 1 -- 172.21.15.62:0/2389796522 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f800006cd50 con 0x7f80100b46d0 2021-12-17T18:18:34.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.878+0000 7f8014b4f700 1 --2- 172.21.15.62:0/2389796522 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7ff0053580 0x7f7ff0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:34.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.882+0000 7f8014b4f700 1 --2- 172.21.15.62:0/2389796522 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7ff0053580 0x7f7ff0055a40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f800c00d000 tx=0x7f800c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:34.882+0000 7f8005ffb700 1 -- 172.21.15.62:0/2389796522 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8000043ef0 con 0x7f80100b46d0 2021-12-17T18:18:35.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.006+0000 7f8015b51700 1 -- 172.21.15.62:0/2389796522 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80100b4230 con 0x7f80100b46d0 2021-12-17T18:18:35.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.010+0000 7f8005ffb700 1 -- 172.21.15.62:0/2389796522 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f80000230a0 con 0x7f80100b46d0 2021-12-17T18:18:35.013 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:35.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.010+0000 7f8015b51700 1 -- 172.21.15.62:0/2389796522 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7ff0053580 msgr2=0x7f7ff0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:35.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.010+0000 7f8015b51700 1 --2- 172.21.15.62:0/2389796522 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7ff0053580 0x7f7ff0055a40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f800c00d000 tx=0x7f800c009040).stop 2021-12-17T18:18:35.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.010+0000 7f8015b51700 1 -- 172.21.15.62:0/2389796522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80100b46d0 msgr2=0x7f80100b67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:35.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.010+0000 7f8015b51700 1 --2- 172.21.15.62:0/2389796522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80100b46d0 0x7f80100b67f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f8000002f70 tx=0x7f8000015000).stop 2021-12-17T18:18:35.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.010+0000 7f8015b51700 1 -- 172.21.15.62:0/2389796522 shutdown_connections 2021-12-17T18:18:35.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.010+0000 7f8015b51700 1 --2- 172.21.15.62:0/2389796522 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7ff0053580 0x7f7ff0055a40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.010+0000 7f8015b51700 1 --2- 172.21.15.62:0/2389796522 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f80100b4b40 0x7f8010130dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.010+0000 7f8015b51700 1 --2- 172.21.15.62:0/2389796522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80100b46d0 0x7f80100b67f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.010+0000 7f8015b51700 1 --2- 172.21.15.62:0/2389796522 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f801005ca90 0x7f801013f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.010+0000 7f8015b51700 1 -- 172.21.15.62:0/2389796522 >> 172.21.15.62:0/2389796522 conn(0x7f801005bcd0 msgr2=0x7f801013a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:35.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.010+0000 7f8015b51700 1 -- 172.21.15.62:0/2389796522 shutdown_connections 2021-12-17T18:18:35.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.010+0000 7f8015b51700 1 -- 172.21.15.62:0/2389796522 wait complete. 2021-12-17T18:18:35.026 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:18:35.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.126+0000 7f454759e700 1 Processor -- start 2021-12-17T18:18:35.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.126+0000 7f454759e700 1 -- start start 2021-12-17T18:18:35.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f454759e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f45480b2fb0 0x7f4548061390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:35.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f454759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4548062910 0x7f4548140430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:35.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f454759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454813fd30 con 0x7f4548140920 2021-12-17T18:18:35.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f454759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454813ff90 con 0x7f4548062910 2021-12-17T18:18:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f454759e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45480653d0 con 0x7f45480b2fb0 2021-12-17T18:18:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f453dd9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4548062910 0x7f4548140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f4546d9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4548140920 0x7f45481431f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60298/0 (socket says 172.21.15.62:60298) 2021-12-17T18:18:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f4546d9d700 1 -- 172.21.15.62:0/3907754904 learned_addr learned my addr 172.21.15.62:0/3907754904 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:35.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f454659c700 1 --2- 172.21.15.62:0/3907754904 >> v2:172.21.15.109:3300/0 conn(0x7f45480b2fb0 0x7f4548061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:35.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f453dd9b700 1 -- 172.21.15.62:0/3907754904 >> v2:172.21.15.109:3300/0 conn(0x7f45480b2fb0 msgr2=0x7f4548061390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:35.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f453dd9b700 1 --2- 172.21.15.62:0/3907754904 >> v2:172.21.15.109:3300/0 conn(0x7f45480b2fb0 0x7f4548061390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f453dd9b700 1 -- 172.21.15.62:0/3907754904 >> v1:172.21.15.62:6789/0 conn(0x7f4548140920 legacy=0x7f45481431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:35.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f4545d9b700 1 -- 172.21.15.62:0/3907754904 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471666011 0 0) 0x7f454813fd30 con 0x7f4548140920 2021-12-17T18:18:35.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f453dd9b700 1 -- 172.21.15.62:0/3907754904 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45480656a0 con 0x7f4548062910 2021-12-17T18:18:35.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f453dd9b700 1 --2- 172.21.15.62:0/3907754904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4548062910 0x7f4548140430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f4530002f70 tx=0x7f4530006df0).ready entity=mon.0 client_cookie=4e7ec26f0e245833 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:35.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f4545d9b700 1 -- 172.21.15.62:0/3907754904 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f453000d570 con 0x7f4548062910 2021-12-17T18:18:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f4545d9b700 1 -- 172.21.15.62:0/3907754904 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4530000e90 con 0x7f4548062910 2021-12-17T18:18:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f4545d9b700 1 -- 172.21.15.62:0/3907754904 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f453000d8c0 con 0x7f4548062910 2021-12-17T18:18:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f454759e700 1 -- 172.21.15.62:0/3907754904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4548062910 msgr2=0x7f4548140430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f454759e700 1 --2- 172.21.15.62:0/3907754904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4548062910 0x7f4548140430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f4530002f70 tx=0x7f4530006df0).stop 2021-12-17T18:18:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f454759e700 1 -- 172.21.15.62:0/3907754904 shutdown_connections 2021-12-17T18:18:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f454759e700 1 --2- 172.21.15.62:0/3907754904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4548062910 0x7f4548140430 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f454759e700 1 --2- 172.21.15.62:0/3907754904 >> v2:172.21.15.109:3300/0 conn(0x7f45480b2fb0 0x7f4548061390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f454759e700 1 -- 172.21.15.62:0/3907754904 >> 172.21.15.62:0/3907754904 conn(0x7f4548063510 msgr2=0x7f45480638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f454759e700 1 -- 172.21.15.62:0/3907754904 shutdown_connections 2021-12-17T18:18:35.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.130+0000 7f454759e700 1 -- 172.21.15.62:0/3907754904 wait complete. 2021-12-17T18:18:35.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f454759e700 1 Processor -- start 2021-12-17T18:18:35.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f454759e700 1 -- start start 2021-12-17T18:18:35.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f454759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4548062910 0x7f45480afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:35.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f454759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45480b2fb0 0x7f4548150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:35.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f454759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4548140920 0x7f4548129b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:35.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f454759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45481513c0 con 0x7f4548140920 2021-12-17T18:18:35.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f454759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4548060380 con 0x7f4548062910 2021-12-17T18:18:35.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f454759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4548150660 con 0x7f45480b2fb0 2021-12-17T18:18:35.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f4546d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4548140920 0x7f4548129b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:35.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f4546d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4548140920 0x7f4548129b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48494/0 (socket says 172.21.15.62:48494) 2021-12-17T18:18:35.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f4546d9d700 1 -- 172.21.15.62:0/2114160286 learned_addr learned my addr 172.21.15.62:0/2114160286 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:35.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f453dd9b700 1 --2- 172.21.15.62:0/2114160286 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45480b2fb0 0x7f4548150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:35.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f454659c700 1 --2- 172.21.15.62:0/2114160286 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4548062910 0x7f45480afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:35.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f4546d9d700 1 -- 172.21.15.62:0/2114160286 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45480b2fb0 msgr2=0x7f4548150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:35.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f4546d9d700 1 --2- 172.21.15.62:0/2114160286 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45480b2fb0 0x7f4548150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f4546d9d700 1 -- 172.21.15.62:0/2114160286 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4548062910 msgr2=0x7f45480afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:35.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f4546d9d700 1 --2- 172.21.15.62:0/2114160286 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4548062910 0x7f45480afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f4546d9d700 1 -- 172.21.15.62:0/2114160286 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453000b180 con 0x7f4548140920 2021-12-17T18:18:35.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f4546d9d700 1 --2- 172.21.15.62:0/2114160286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4548140920 0x7f4548129b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f4548143ec0 tx=0x7f4540001380).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:35.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f453ffff700 1 -- 172.21.15.62:0/2114160286 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4540005b60 con 0x7f4548140920 2021-12-17T18:18:35.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f453ffff700 1 -- 172.21.15.62:0/2114160286 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4540005cc0 con 0x7f4548140920 2021-12-17T18:18:35.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f454759e700 1 -- 172.21.15.62:0/2114160286 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4548144090 con 0x7f4548140920 2021-12-17T18:18:35.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f453ffff700 1 -- 172.21.15.62:0/2114160286 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4540004a90 con 0x7f4548140920 2021-12-17T18:18:35.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.134+0000 7f454759e700 1 -- 172.21.15.62:0/2114160286 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45480b03f0 con 0x7f4548140920 2021-12-17T18:18:35.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.138+0000 7f453ffff700 1 -- 172.21.15.62:0/2114160286 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4540004bf0 con 0x7f4548140920 2021-12-17T18:18:35.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.138+0000 7f453ffff700 1 --2- 172.21.15.62:0/2114160286 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f452c053610 0x7f452c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:35.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.138+0000 7f454759e700 1 -- 172.21.15.62:0/2114160286 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45480601a0 con 0x7f4548140920 2021-12-17T18:18:35.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.138+0000 7f453ffff700 1 -- 172.21.15.62:0/2114160286 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f454006b460 con 0x7f4548140920 2021-12-17T18:18:35.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.138+0000 7f454659c700 1 --2- 172.21.15.62:0/2114160286 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f452c053610 0x7f452c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:35.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.138+0000 7f454659c700 1 --2- 172.21.15.62:0/2114160286 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f452c053610 0x7f452c055ad0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f453800b000 tx=0x7f4538006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:35.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.146+0000 7f453ffff700 1 -- 172.21.15.62:0/2114160286 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f45400425c0 con 0x7f4548140920 2021-12-17T18:18:35.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.274+0000 7f454759e700 1 -- 172.21.15.62:0/2114160286 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45480617a0 con 0x7f4548140920 2021-12-17T18:18:35.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.274+0000 7f453ffff700 1 -- 172.21.15.62:0/2114160286 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f4540045be0 con 0x7f4548140920 2021-12-17T18:18:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:35.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.274+0000 7f454759e700 1 -- 172.21.15.62:0/2114160286 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f452c053610 msgr2=0x7f452c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:35.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.274+0000 7f454759e700 1 --2- 172.21.15.62:0/2114160286 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f452c053610 0x7f452c055ad0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f453800b000 tx=0x7f4538006df0).stop 2021-12-17T18:18:35.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.274+0000 7f454759e700 1 -- 172.21.15.62:0/2114160286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4548140920 msgr2=0x7f4548129b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:35.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.274+0000 7f454759e700 1 --2- 172.21.15.62:0/2114160286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4548140920 0x7f4548129b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f4548143ec0 tx=0x7f4540001380).stop 2021-12-17T18:18:35.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.274+0000 7f454759e700 1 -- 172.21.15.62:0/2114160286 shutdown_connections 2021-12-17T18:18:35.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.274+0000 7f454759e700 1 --2- 172.21.15.62:0/2114160286 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f452c053610 0x7f452c055ad0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.274+0000 7f454759e700 1 --2- 172.21.15.62:0/2114160286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4548140920 0x7f4548129b20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.278+0000 7f454759e700 1 --2- 172.21.15.62:0/2114160286 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45480b2fb0 0x7f4548150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.278+0000 7f454759e700 1 --2- 172.21.15.62:0/2114160286 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4548062910 0x7f45480afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.278+0000 7f454759e700 1 -- 172.21.15.62:0/2114160286 >> 172.21.15.62:0/2114160286 conn(0x7f4548063510 msgr2=0x7f4548128c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:35.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.278+0000 7f454759e700 1 -- 172.21.15.62:0/2114160286 shutdown_connections 2021-12-17T18:18:35.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.278+0000 7f454759e700 1 -- 172.21.15.62:0/2114160286 wait complete. 2021-12-17T18:18:35.292 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:18:35.293 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:18:35.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.390+0000 7fe6eafc3700 1 Processor -- start 2021-12-17T18:18:35.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.390+0000 7fe6eafc3700 1 -- start start 2021-12-17T18:18:35.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6eafc3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6e4067870 0x7fe6e413ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:35.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6eafc3700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe6e40628c0 0x7fe6e413f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:35.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6eafc3700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e40b3e20 con 0x7fe6e40b3a40 2021-12-17T18:18:35.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6eafc3700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e40b09f0 con 0x7fe6e40628c0 2021-12-17T18:18:35.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6eafc3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40af900 con 0x7fe6e4067870 2021-12-17T18:18:35.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6e97c0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6e4067870 0x7fe6e413ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:35.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6ea7c2700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe6e40628c0 0x7fe6e413f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:35.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6ea7c2700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe6e40628c0 0x7fe6e413f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:55052/0 (socket says 172.21.15.62:55052) 2021-12-17T18:18:35.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6ea7c2700 1 -- 172.21.15.62:0/4135928740 learned_addr learned my addr 172.21.15.62:0/4135928740 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:35.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6e97c0700 1 -- 172.21.15.62:0/4135928740 >> v2:172.21.15.109:3300/0 conn(0x7fe6e40628c0 msgr2=0x7fe6e413f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:35.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6e97c0700 1 --2- 172.21.15.62:0/4135928740 >> v2:172.21.15.109:3300/0 conn(0x7fe6e40628c0 0x7fe6e413f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6e97c0700 1 -- 172.21.15.62:0/4135928740 >> v1:172.21.15.109:6789/0 conn(0x7fe6e40b3a40 legacy=0x7fe6e40b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:35.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6e97c0700 1 -- 172.21.15.62:0/4135928740 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e40afba0 con 0x7fe6e4067870 2021-12-17T18:18:35.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6e97c0700 1 --2- 172.21.15.62:0/4135928740 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6e4067870 0x7fe6e413ec90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fe6d4002f70 tx=0x7fe6d4006df0).ready entity=mon.2 client_cookie=b7518dfdb93ecea7 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:35.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6e8fbf700 1 -- 172.21.15.62:0/4135928740 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6d400d570 con 0x7fe6e4067870 2021-12-17T18:18:35.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6e8fbf700 1 -- 172.21.15.62:0/4135928740 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d4000e90 con 0x7fe6e4067870 2021-12-17T18:18:35.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6e8fbf700 1 -- 172.21.15.62:0/4135928740 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6d400d8c0 con 0x7fe6e4067870 2021-12-17T18:18:35.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6eafc3700 1 -- 172.21.15.62:0/4135928740 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6e4067870 msgr2=0x7fe6e413ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:35.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6eafc3700 1 --2- 172.21.15.62:0/4135928740 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6e4067870 0x7fe6e413ec90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fe6d4002f70 tx=0x7fe6d4006df0).stop 2021-12-17T18:18:35.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6eafc3700 1 -- 172.21.15.62:0/4135928740 shutdown_connections 2021-12-17T18:18:35.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6eafc3700 1 --2- 172.21.15.62:0/4135928740 >> v2:172.21.15.109:3300/0 conn(0x7fe6e40628c0 0x7fe6e413f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6eafc3700 1 --2- 172.21.15.62:0/4135928740 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6e4067870 0x7fe6e413ec90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6eafc3700 1 -- 172.21.15.62:0/4135928740 >> 172.21.15.62:0/4135928740 conn(0x7fe6e40b7020 msgr2=0x7fe6e40b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:35.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6eafc3700 1 -- 172.21.15.62:0/4135928740 shutdown_connections 2021-12-17T18:18:35.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.394+0000 7fe6eafc3700 1 -- 172.21.15.62:0/4135928740 wait complete. 2021-12-17T18:18:35.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6eafc3700 1 Processor -- start 2021-12-17T18:18:35.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6eafc3700 1 -- start start 2021-12-17T18:18:35.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6eafc3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6e40628c0 0x7fe6e4155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:35.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6eafc3700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6e4067870 0x7fe6e413dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:35.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6eafc3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e40b3a40 0x7fe6e413bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:35.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6eafc3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e4063b30 con 0x7fe6e40b3a40 2021-12-17T18:18:35.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6eafc3700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e4064e20 con 0x7fe6e4067870 2021-12-17T18:18:35.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6eafc3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40653a0 con 0x7fe6e40628c0 2021-12-17T18:18:35.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6ea7c2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e40b3a40 0x7fe6e413bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:35.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6ea7c2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e40b3a40 0x7fe6e413bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48506/0 (socket says 172.21.15.62:48506) 2021-12-17T18:18:35.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6ea7c2700 1 -- 172.21.15.62:0/1925394856 learned_addr learned my addr 172.21.15.62:0/1925394856 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:35.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6e97c0700 1 --2- 172.21.15.62:0/1925394856 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6e4067870 0x7fe6e413dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:35.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6e9fc1700 1 --2- 172.21.15.62:0/1925394856 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6e40628c0 0x7fe6e4155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:35.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6ea7c2700 1 -- 172.21.15.62:0/1925394856 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6e40628c0 msgr2=0x7fe6e4155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:35.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6ea7c2700 1 --2- 172.21.15.62:0/1925394856 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6e40628c0 0x7fe6e4155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6ea7c2700 1 -- 172.21.15.62:0/1925394856 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6e4067870 msgr2=0x7fe6e413dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:35.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6ea7c2700 1 --2- 172.21.15.62:0/1925394856 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6e4067870 0x7fe6e413dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6ea7c2700 1 -- 172.21.15.62:0/1925394856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d400b180 con 0x7fe6e40b3a40 2021-12-17T18:18:35.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6ea7c2700 1 --2- 172.21.15.62:0/1925394856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e40b3a40 0x7fe6e413bdd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fe6dc00c000 tx=0x7fe6dc009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:35.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6d2ffd700 1 -- 172.21.15.62:0/1925394856 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6dc012600 con 0x7fe6e40b3a40 2021-12-17T18:18:35.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6d2ffd700 1 -- 172.21.15.62:0/1925394856 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc012760 con 0x7fe6e40b3a40 2021-12-17T18:18:35.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6eafc3700 1 -- 172.21.15.62:0/1925394856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e4063d60 con 0x7fe6e40b3a40 2021-12-17T18:18:35.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6d2ffd700 1 -- 172.21.15.62:0/1925394856 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6dc012ac0 con 0x7fe6e40b3a40 2021-12-17T18:18:35.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.398+0000 7fe6eafc3700 1 -- 172.21.15.62:0/1925394856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e41408b0 con 0x7fe6e40b3a40 2021-12-17T18:18:35.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.402+0000 7fe6eafc3700 1 -- 172.21.15.62:0/1925394856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e40669a0 con 0x7fe6e40b3a40 2021-12-17T18:18:35.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.402+0000 7fe6d2ffd700 1 -- 172.21.15.62:0/1925394856 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe6dc022070 con 0x7fe6e40b3a40 2021-12-17T18:18:35.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.402+0000 7fe6d2ffd700 1 --2- 172.21.15.62:0/1925394856 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe6c40536a0 0x7fe6c4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:35.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.402+0000 7fe6d2ffd700 1 -- 172.21.15.62:0/1925394856 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe6dc06be40 con 0x7fe6e40b3a40 2021-12-17T18:18:35.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.402+0000 7fe6e9fc1700 1 --2- 172.21.15.62:0/1925394856 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe6c40536a0 0x7fe6c4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:35.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.402+0000 7fe6e9fc1700 1 --2- 172.21.15.62:0/1925394856 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe6c40536a0 0x7fe6c4055b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fe6e000d000 tx=0x7fe6e0000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:35.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.406+0000 7fe6d2ffd700 1 -- 172.21.15.62:0/1925394856 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe6dc042fa0 con 0x7fe6e40b3a40 2021-12-17T18:18:35.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.570+0000 7fe6eafc3700 1 -- 172.21.15.62:0/1925394856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6e40afe40 con 0x7fe6e40b3a40 2021-12-17T18:18:35.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.574+0000 7fe6d2ffd700 1 -- 172.21.15.62:0/1925394856 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2137 (secure 0 0 0) 0x7fe6dc016020 con 0x7fe6e40b3a40 2021-12-17T18:18:35.578 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:35.578 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/1930484969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1930484969},{"type":"v1","addr":"172.21.15.109:6835","nonce":1930484969}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:18:19.175750+0000","modified":"2021-12-17T18:18:20.179555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.62:6833/3194210554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3194210554},{"type":"v1","addr":"172.21.15.62:6833","nonce":3194210554}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-12-17T18:18:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.574+0000 7fe6eafc3700 1 -- 172.21.15.62:0/1925394856 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe6c40536a0 msgr2=0x7fe6c4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.574+0000 7fe6eafc3700 1 --2- 172.21.15.62:0/1925394856 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe6c40536a0 0x7fe6c4055b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fe6e000d000 tx=0x7fe6e0000bc0).stop 2021-12-17T18:18:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.574+0000 7fe6eafc3700 1 -- 172.21.15.62:0/1925394856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e40b3a40 msgr2=0x7fe6e413bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.574+0000 7fe6eafc3700 1 --2- 172.21.15.62:0/1925394856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e40b3a40 0x7fe6e413bdd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fe6dc00c000 tx=0x7fe6dc009290).stop 2021-12-17T18:18:35.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.574+0000 7fe6eafc3700 1 -- 172.21.15.62:0/1925394856 shutdown_connections 2021-12-17T18:18:35.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.574+0000 7fe6eafc3700 1 --2- 172.21.15.62:0/1925394856 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe6c40536a0 0x7fe6c4055b60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.574+0000 7fe6eafc3700 1 --2- 172.21.15.62:0/1925394856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e40b3a40 0x7fe6e413bdd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.574+0000 7fe6eafc3700 1 --2- 172.21.15.62:0/1925394856 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6e4067870 0x7fe6e413dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.574+0000 7fe6eafc3700 1 --2- 172.21.15.62:0/1925394856 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6e40628c0 0x7fe6e4155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:35.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.574+0000 7fe6eafc3700 1 -- 172.21.15.62:0/1925394856 >> 172.21.15.62:0/1925394856 conn(0x7fe6e40b7020 msgr2=0x7fe6e4148b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:35.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.574+0000 7fe6eafc3700 1 -- 172.21.15.62:0/1925394856 shutdown_connections 2021-12-17T18:18:35.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:35.574+0000 7fe6eafc3700 1 -- 172.21.15.62:0/1925394856 wait complete. 2021-12-17T18:18:35.583 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 5 2021-12-17T18:18:35.793 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:18:19.175750+0000', 'modified': '2021-12-17T18:18:20.179555+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4264}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4264': {'gid': 4264, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.62:6833/3194210554', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 3194210554}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 3194210554}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:18:35.794 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:18:35.794 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:18:35.914 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":4264,"want_state":"up:active","state":"up:active","rank_uptime":16.722425689000001,"mdsmap_epoch":5,"osdmap_epoch":23,"osdmap_epoch_barrier":23,"uptime":20.077996398} 2021-12-17T18:18:35.914 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 4264, "mdsmap_epoch": 5, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "rank_uptime": 16.722425689, "state": "up:active", "uptime": 20.077996398, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:18:35.915 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:18:35.915 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-12-17T18:18:35.915 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi158.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-12-17T18:18:35.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:35.916 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:18:35.925 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:18:35.984 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:18:35.985 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:18:35.999 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:18:36.000 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:18:36.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:36.001 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:18:36.008 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:18:36.009 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:18:36.011 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:18:36.026 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:18:36.027 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:18:36.081 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:18:36.082 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:18:36.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:36.083 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:18:36.099 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:2021-12-17T18:18:36.094+0000 7fd23f321080 -1 init, newargv = 0x560bd70b9d50 newargc=9ceph-fuse[13844]: starting ceph client 2021-12-17T18:18:36.100 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr: 2021-12-17T18:18:36.110 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[13844]: starting fuse 2021-12-17T18:18:37.189 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:18:37.208 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:18:37.209 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:18:37.267 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:18:37.268 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:18:37.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:37.270 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:18:37.276 INFO:teuthology.orchestra.run.smithi158.stdout:52 2021-12-17T18:18:37.277 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:18:37.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:37.278 DEBUG:teuthology.orchestra.run.smithi158:> sudo python3 -c ' 2021-12-17T18:18:37.279 DEBUG:teuthology.orchestra.run.smithi158:> import glob 2021-12-17T18:18:37.280 DEBUG:teuthology.orchestra.run.smithi158:> import re 2021-12-17T18:18:37.280 DEBUG:teuthology.orchestra.run.smithi158:> import os 2021-12-17T18:18:37.281 DEBUG:teuthology.orchestra.run.smithi158:> import subprocess 2021-12-17T18:18:37.282 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:18:37.282 DEBUG:teuthology.orchestra.run.smithi158:> def find_socket(client_name): 2021-12-17T18:18:37.283 DEBUG:teuthology.orchestra.run.smithi158:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-12-17T18:18:37.283 DEBUG:teuthology.orchestra.run.smithi158:> files = glob.glob(asok_path) 2021-12-17T18:18:37.284 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:18:37.285 DEBUG:teuthology.orchestra.run.smithi158:> # Given a non-glob path, it better be there 2021-12-17T18:18:37.285 DEBUG:teuthology.orchestra.run.smithi158:> if "*" not in asok_path: 2021-12-17T18:18:37.286 DEBUG:teuthology.orchestra.run.smithi158:> assert(len(files) == 1) 2021-12-17T18:18:37.287 DEBUG:teuthology.orchestra.run.smithi158:> return files[0] 2021-12-17T18:18:37.287 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:18:37.288 DEBUG:teuthology.orchestra.run.smithi158:> for f in files: 2021-12-17T18:18:37.288 DEBUG:teuthology.orchestra.run.smithi158:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:18:37.289 DEBUG:teuthology.orchestra.run.smithi158:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:18:37.290 DEBUG:teuthology.orchestra.run.smithi158:> return f 2021-12-17T18:18:37.290 DEBUG:teuthology.orchestra.run.smithi158:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:18:37.290 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:18:37.291 DEBUG:teuthology.orchestra.run.smithi158:> print(find_socket("client.1")) 2021-12-17T18:18:37.291 DEBUG:teuthology.orchestra.run.smithi158:> ' 2021-12-17T18:18:37.334 INFO:teuthology.orchestra.run.smithi158.stdout:/var/run/ceph/ceph-client.1.13844.asok 2021-12-17T18:18:37.339 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13844.asok 2021-12-17T18:18:37.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:37.340 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13844.asok status 2021-12-17T18:18:37.478 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2021-12-17T18:18:37.478 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": { 2021-12-17T18:18:37.478 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:18:37.478 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:18:37.479 INFO:teuthology.orchestra.run.smithi158.stdout: "entity_id": "1", 2021-12-17T18:18:37.479 INFO:teuthology.orchestra.run.smithi158.stdout: "hostname": "smithi158", 2021-12-17T18:18:37.479 INFO:teuthology.orchestra.run.smithi158.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-12-17T18:18:37.479 INFO:teuthology.orchestra.run.smithi158.stdout: "pid": "13844", 2021-12-17T18:18:37.480 INFO:teuthology.orchestra.run.smithi158.stdout: "root": "/" 2021-12-17T18:18:37.480 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:18:37.480 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_count": 0, 2021-12-17T18:18:37.480 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_pinned_count": 0, 2021-12-17T18:18:37.481 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 4499, 2021-12-17T18:18:37.481 INFO:teuthology.orchestra.run.smithi158.stdout: "inst": { 2021-12-17T18:18:37.481 INFO:teuthology.orchestra.run.smithi158.stdout: "name": { 2021-12-17T18:18:37.481 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "client", 2021-12-17T18:18:37.482 INFO:teuthology.orchestra.run.smithi158.stdout: "num": 4499 2021-12-17T18:18:37.482 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:18:37.482 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:18:37.483 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:18:37.483 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:18:37.483 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 1264804019 2021-12-17T18:18:37.483 INFO:teuthology.orchestra.run.smithi158.stdout: } 2021-12-17T18:18:37.484 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:18:37.484 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:18:37.484 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:18:37.484 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:18:37.484 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 1264804019 2021-12-17T18:18:37.485 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:18:37.485 INFO:teuthology.orchestra.run.smithi158.stdout: "inst_str": "client.4499 172.21.15.158:0/1264804019", 2021-12-17T18:18:37.485 INFO:teuthology.orchestra.run.smithi158.stdout: "addr_str": "172.21.15.158:0/1264804019", 2021-12-17T18:18:37.485 INFO:teuthology.orchestra.run.smithi158.stdout: "inode_count": 1, 2021-12-17T18:18:37.486 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_epoch": 5, 2021-12-17T18:18:37.486 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch": 23, 2021-12-17T18:18:37.486 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:18:37.486 INFO:teuthology.orchestra.run.smithi158.stdout: "blacklisted": false, 2021-12-17T18:18:37.486 INFO:teuthology.orchestra.run.smithi158.stdout: "fs_name": "cephfs" 2021-12-17T18:18:37.487 INFO:teuthology.orchestra.run.smithi158.stdout:} 2021-12-17T18:18:37.488 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:37.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916ed77700 1 Processor -- start 2021-12-17T18:18:37.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916ed77700 1 -- start start 2021-12-17T18:18:37.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916ed77700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f91680b3a40 0x7f91680b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:37.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916ed77700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f91680b07d0 0x7f91681432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:37.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916ed77700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91680b3e20 con 0x7f9168067870 2021-12-17T18:18:37.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916ed77700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91680af900 con 0x7f91680b07d0 2021-12-17T18:18:37.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916ed77700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91680afba0 con 0x7f91680b3a40 2021-12-17T18:18:37.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916dd75700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f91680b3a40 0x7f91680b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:37.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916dd75700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f91680b3a40 0x7f91680b02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:42214/0 (socket says 172.21.15.62:42214) 2021-12-17T18:18:37.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916d574700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f91680b07d0 0x7f91681432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:37.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916dd75700 1 -- 172.21.15.62:0/762203958 learned_addr learned my addr 172.21.15.62:0/762203958 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:37.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916d574700 1 -- 172.21.15.62:0/762203958 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f91680b3a40 msgr2=0x7f91680b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:37.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916d574700 1 --2- 172.21.15.62:0/762203958 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f91680b3a40 0x7f91680b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:37.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916d574700 1 -- 172.21.15.62:0/762203958 >> v1:172.21.15.109:6789/0 conn(0x7f9168067870 legacy=0x7f91681437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:37.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916d574700 1 -- 172.21.15.62:0/762203958 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91680afe40 con 0x7f91680b07d0 2021-12-17T18:18:37.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916d574700 1 --2- 172.21.15.62:0/762203958 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f91680b07d0 0x7f91681432c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f91500032f0 tx=0x7f91500091d0).ready entity=mon.1 client_cookie=7938924a7d382d9f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:37.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916cd73700 1 -- 172.21.15.62:0/762203958 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f915000b6c0 con 0x7f91680b07d0 2021-12-17T18:18:37.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916cd73700 1 -- 172.21.15.62:0/762203958 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915000b820 con 0x7f91680b07d0 2021-12-17T18:18:37.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916cd73700 1 -- 172.21.15.62:0/762203958 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f915000b990 con 0x7f91680b07d0 2021-12-17T18:18:37.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916ed77700 1 -- 172.21.15.62:0/762203958 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f91680b07d0 msgr2=0x7f91681432c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:37.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916ed77700 1 --2- 172.21.15.62:0/762203958 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f91680b07d0 0x7f91681432c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f91500032f0 tx=0x7f91500091d0).stop 2021-12-17T18:18:37.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916ed77700 1 -- 172.21.15.62:0/762203958 shutdown_connections 2021-12-17T18:18:37.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916ed77700 1 --2- 172.21.15.62:0/762203958 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f91680b07d0 0x7f91681432c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:37.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916ed77700 1 --2- 172.21.15.62:0/762203958 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f91680b3a40 0x7f91680b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:37.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.602+0000 7f916ed77700 1 -- 172.21.15.62:0/762203958 >> 172.21.15.62:0/762203958 conn(0x7f91680b7020 msgr2=0x7f91680b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:37.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916ed77700 1 -- 172.21.15.62:0/762203958 shutdown_connections 2021-12-17T18:18:37.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916ed77700 1 -- 172.21.15.62:0/762203958 wait complete. 2021-12-17T18:18:37.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916ed77700 1 Processor -- start 2021-12-17T18:18:37.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916ed77700 1 -- start start 2021-12-17T18:18:37.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916ed77700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9168067870 0x7f91681403e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:37.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916ed77700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91680b07d0 0x7f9168063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:37.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916ed77700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f91680b3a40 0x7f9168115050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:37.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916ed77700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9168063b10 con 0x7f91680b07d0 2021-12-17T18:18:37.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916ed77700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9168065f70 con 0x7f91680b3a40 2021-12-17T18:18:37.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916ed77700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9168066210 con 0x7f9168067870 2021-12-17T18:18:37.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916d574700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91680b07d0 0x7f9168063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:37.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916d574700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91680b07d0 0x7f9168063620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48520/0 (socket says 172.21.15.62:48520) 2021-12-17T18:18:37.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916d574700 1 -- 172.21.15.62:0/3140634015 learned_addr learned my addr 172.21.15.62:0/3140634015 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:37.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916dd75700 1 --2- 172.21.15.62:0/3140634015 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9168067870 0x7f91681403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:37.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916e576700 1 --2- 172.21.15.62:0/3140634015 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f91680b3a40 0x7f9168115050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:37.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916d574700 1 -- 172.21.15.62:0/3140634015 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9168067870 msgr2=0x7f91681403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:37.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916d574700 1 --2- 172.21.15.62:0/3140634015 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9168067870 0x7f91681403e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:37.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916d574700 1 -- 172.21.15.62:0/3140634015 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f91680b3a40 msgr2=0x7f9168115050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:37.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916d574700 1 --2- 172.21.15.62:0/3140634015 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f91680b3a40 0x7f9168115050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:37.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916d574700 1 -- 172.21.15.62:0/3140634015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9150009470 con 0x7f91680b07d0 2021-12-17T18:18:37.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916d574700 1 --2- 172.21.15.62:0/3140634015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91680b07d0 0x7f9168063620 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f91500032f0 tx=0x7f9150016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:37.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f9166ffd700 1 -- 172.21.15.62:0/3140634015 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9150011e20 con 0x7f91680b07d0 2021-12-17T18:18:37.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f9166ffd700 1 -- 172.21.15.62:0/3140634015 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9150021440 con 0x7f91680b07d0 2021-12-17T18:18:37.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916ed77700 1 -- 172.21.15.62:0/3140634015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91680664b0 con 0x7f91680b07d0 2021-12-17T18:18:37.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f9166ffd700 1 -- 172.21.15.62:0/3140634015 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91500217a0 con 0x7f91680b07d0 2021-12-17T18:18:37.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.606+0000 7f916ed77700 1 -- 172.21.15.62:0/3140634015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91680671e0 con 0x7f91680b07d0 2021-12-17T18:18:37.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.610+0000 7f916ed77700 1 -- 172.21.15.62:0/3140634015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91680ad740 con 0x7f91680b07d0 2021-12-17T18:18:37.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.610+0000 7f9166ffd700 1 -- 172.21.15.62:0/3140634015 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9150027020 con 0x7f91680b07d0 2021-12-17T18:18:37.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.610+0000 7f9166ffd700 1 --2- 172.21.15.62:0/3140634015 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f914c053580 0x7f914c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:37.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.610+0000 7f9166ffd700 1 -- 172.21.15.62:0/3140634015 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f915006cda0 con 0x7f91680b07d0 2021-12-17T18:18:37.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.610+0000 7f916dd75700 1 --2- 172.21.15.62:0/3140634015 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f914c053580 0x7f914c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:37.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.610+0000 7f916dd75700 1 --2- 172.21.15.62:0/3140634015 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f914c053580 0x7f914c055a40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f9160008000 tx=0x7f9160008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:37.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.614+0000 7f9166ffd700 1 -- 172.21.15.62:0/3140634015 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9150043f00 con 0x7f91680b07d0 2021-12-17T18:18:37.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.742+0000 7f916ed77700 1 -- 172.21.15.62:0/3140634015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91680573d0 con 0x7f91680b07d0 2021-12-17T18:18:37.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.742+0000 7f9166ffd700 1 -- 172.21.15.62:0/3140634015 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f9150015020 con 0x7f91680b07d0 2021-12-17T18:18:37.746 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:37.747 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:20.178383+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:17.128555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:18.180577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:37.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.742+0000 7f916ed77700 1 -- 172.21.15.62:0/3140634015 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f914c053580 msgr2=0x7f914c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:37.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.742+0000 7f916ed77700 1 --2- 172.21.15.62:0/3140634015 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f914c053580 0x7f914c055a40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f9160008000 tx=0x7f9160008040).stop 2021-12-17T18:18:37.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.742+0000 7f916ed77700 1 -- 172.21.15.62:0/3140634015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91680b07d0 msgr2=0x7f9168063620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:37.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.742+0000 7f916ed77700 1 --2- 172.21.15.62:0/3140634015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91680b07d0 0x7f9168063620 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f91500032f0 tx=0x7f9150016000).stop 2021-12-17T18:18:37.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.742+0000 7f916ed77700 1 -- 172.21.15.62:0/3140634015 shutdown_connections 2021-12-17T18:18:37.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.742+0000 7f916ed77700 1 --2- 172.21.15.62:0/3140634015 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f914c053580 0x7f914c055a40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:37.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.742+0000 7f916ed77700 1 --2- 172.21.15.62:0/3140634015 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f91680b3a40 0x7f9168115050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:37.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.742+0000 7f916ed77700 1 --2- 172.21.15.62:0/3140634015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91680b07d0 0x7f9168063620 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:37.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.742+0000 7f916ed77700 1 --2- 172.21.15.62:0/3140634015 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9168067870 0x7f91681403e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:37.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.742+0000 7f916ed77700 1 -- 172.21.15.62:0/3140634015 >> 172.21.15.62:0/3140634015 conn(0x7f91680b7020 msgr2=0x7f91680b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:37.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.742+0000 7f916ed77700 1 -- 172.21.15.62:0/3140634015 shutdown_connections 2021-12-17T18:18:37.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.746+0000 7f916ed77700 1 -- 172.21.15.62:0/3140634015 wait complete. 2021-12-17T18:18:37.760 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:18:17.128555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:18:18.180577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:18:37.761 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:18:37.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.866+0000 7fc6fb2f3700 1 Processor -- start 2021-12-17T18:18:37.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.866+0000 7fc6fb2f3700 1 -- start start 2021-12-17T18:18:37.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.866+0000 7fc6fb2f3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6f40b2d00 0x7fc6f40b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:37.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.866+0000 7fc6fb2f3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6f40625b0 0x7fc6f413fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:37.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.866+0000 7fc6fb2f3700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f4140140 con 0x7fc6f4062b60 2021-12-17T18:18:37.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.866+0000 7fc6fb2f3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f4140e60 con 0x7fc6f40b2d00 2021-12-17T18:18:37.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.866+0000 7fc6fb2f3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f40aecb0 con 0x7fc6f40625b0 2021-12-17T18:18:37.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.866+0000 7fc6fa2f1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6f40b2d00 0x7fc6f40b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:37.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.866+0000 7fc6fa2f1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6f40b2d00 0x7fc6f40b30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48528/0 (socket says 172.21.15.62:48528) 2021-12-17T18:18:37.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.866+0000 7fc6faaf2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6f40625b0 0x7fc6f413fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:37.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.866+0000 7fc6fa2f1700 1 -- 172.21.15.62:0/1141029366 learned_addr learned my addr 172.21.15.62:0/1141029366 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:37.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.866+0000 7fc6fa2f1700 1 -- 172.21.15.62:0/1141029366 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6f40625b0 msgr2=0x7fc6f413fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:37.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.866+0000 7fc6fa2f1700 1 --2- 172.21.15.62:0/1141029366 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6f40625b0 0x7fc6f413fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:37.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.866+0000 7fc6fa2f1700 1 -- 172.21.15.62:0/1141029366 >> v1:172.21.15.109:6789/0 conn(0x7fc6f4062b60 legacy=0x7fc6f4139870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:37.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.866+0000 7fc6f92ef700 1 -- 172.21.15.62:0/1141029366 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794709889 0 0) 0x7fc6e8001110 con 0x7fc6f4062b60 2021-12-17T18:18:37.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.866+0000 7fc6fa2f1700 1 -- 172.21.15.62:0/1141029366 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f40aef50 con 0x7fc6f40b2d00 2021-12-17T18:18:37.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.870+0000 7fc6fa2f1700 1 --2- 172.21.15.62:0/1141029366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f40b2d00 0x7fc6f40b30e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fc6f0002f70 tx=0x7fc6f0006eb0).ready entity=mon.0 client_cookie=8edc5aa08e14b1fa server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:37.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.870+0000 7fc6f92ef700 1 -- 172.21.15.62:0/1141029366 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6f000d570 con 0x7fc6f40b2d00 2021-12-17T18:18:37.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.870+0000 7fc6f92ef700 1 -- 172.21.15.62:0/1141029366 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f0000e90 con 0x7fc6f40b2d00 2021-12-17T18:18:37.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.870+0000 7fc6f92ef700 1 -- 172.21.15.62:0/1141029366 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6f000d8c0 con 0x7fc6f40b2d00 2021-12-17T18:18:37.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.870+0000 7fc6fb2f3700 1 -- 172.21.15.62:0/1141029366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f40b2d00 msgr2=0x7fc6f40b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:37.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.870+0000 7fc6fb2f3700 1 --2- 172.21.15.62:0/1141029366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f40b2d00 0x7fc6f40b30e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fc6f0002f70 tx=0x7fc6f0006eb0).stop 2021-12-17T18:18:37.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.870+0000 7fc6fb2f3700 1 -- 172.21.15.62:0/1141029366 shutdown_connections 2021-12-17T18:18:37.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.870+0000 7fc6fb2f3700 1 --2- 172.21.15.62:0/1141029366 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6f40625b0 0x7fc6f413fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:37.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.870+0000 7fc6fb2f3700 1 --2- 172.21.15.62:0/1141029366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f40b2d00 0x7fc6f40b30e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:37.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.870+0000 7fc6fb2f3700 1 -- 172.21.15.62:0/1141029366 >> 172.21.15.62:0/1141029366 conn(0x7fc6f4060a50 msgr2=0x7fc6f405bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:37.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.870+0000 7fc6fb2f3700 1 -- 172.21.15.62:0/1141029366 shutdown_connections 2021-12-17T18:18:37.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.870+0000 7fc6fb2f3700 1 -- 172.21.15.62:0/1141029366 wait complete. 2021-12-17T18:18:37.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.870+0000 7fc6fb2f3700 1 Processor -- start 2021-12-17T18:18:37.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.870+0000 7fc6fb2f3700 1 -- start start 2021-12-17T18:18:37.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6fb2f3700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc6f40625b0 0x7fc6f414dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:37.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6fb2f3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f4062b60 0x7fc6f4064670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:37.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6fb2f3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6f40b2d00 0x7fc6f405ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:37.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6fb2f3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f4064b60 con 0x7fc6f4062b60 2021-12-17T18:18:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6fb2f3700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f4064df0 con 0x7fc6f40625b0 2021-12-17T18:18:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6fb2f3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f4065090 con 0x7fc6f40b2d00 2021-12-17T18:18:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6f9af0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f4062b60 0x7fc6f4064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6f9af0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f4062b60 0x7fc6f4064670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48534/0 (socket says 172.21.15.62:48534) 2021-12-17T18:18:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6f9af0700 1 -- 172.21.15.62:0/3046776675 learned_addr learned my addr 172.21.15.62:0/3046776675 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:37.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6fa2f1700 1 --2- 172.21.15.62:0/3046776675 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc6f40625b0 0x7fc6f414dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:37.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6faaf2700 1 --2- 172.21.15.62:0/3046776675 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6f40b2d00 0x7fc6f405ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:37.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6f9af0700 1 -- 172.21.15.62:0/3046776675 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6f40b2d00 msgr2=0x7fc6f405ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:37.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6f9af0700 1 --2- 172.21.15.62:0/3046776675 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6f40b2d00 0x7fc6f405ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:37.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6f9af0700 1 -- 172.21.15.62:0/3046776675 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc6f40625b0 msgr2=0x7fc6f414dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:37.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6f9af0700 1 --2- 172.21.15.62:0/3046776675 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc6f40625b0 0x7fc6f414dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:37.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6f9af0700 1 -- 172.21.15.62:0/3046776675 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f000b1e0 con 0x7fc6f4062b60 2021-12-17T18:18:37.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6faaf2700 1 --2- 172.21.15.62:0/3046776675 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6f40b2d00 0x7fc6f405ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:37.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6f9af0700 1 --2- 172.21.15.62:0/3046776675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f4062b60 0x7fc6f4064670 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc6e8000ed0 tx=0x7fc6e8001850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:37.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6e77fe700 1 -- 172.21.15.62:0/3046776675 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6e800ce50 con 0x7fc6f4062b60 2021-12-17T18:18:37.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6e77fe700 1 -- 172.21.15.62:0/3046776675 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e800f470 con 0x7fc6f4062b60 2021-12-17T18:18:37.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6fb2f3700 1 -- 172.21.15.62:0/3046776675 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f4151220 con 0x7fc6f4062b60 2021-12-17T18:18:37.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6e77fe700 1 -- 172.21.15.62:0/3046776675 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6e800f7d0 con 0x7fc6f4062b60 2021-12-17T18:18:37.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6fb2f3700 1 -- 172.21.15.62:0/3046776675 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f41516c0 con 0x7fc6f4062b60 2021-12-17T18:18:37.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6fb2f3700 1 -- 172.21.15.62:0/3046776675 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f41513b0 con 0x7fc6f4062b60 2021-12-17T18:18:37.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.874+0000 7fc6e77fe700 1 -- 172.21.15.62:0/3046776675 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc6e8019030 con 0x7fc6f4062b60 2021-12-17T18:18:37.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.878+0000 7fc6e77fe700 1 --2- 172.21.15.62:0/3046776675 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc6d40536a0 0x7fc6d4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:37.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.878+0000 7fc6e77fe700 1 -- 172.21.15.62:0/3046776675 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc6e806ad20 con 0x7fc6f4062b60 2021-12-17T18:18:37.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.878+0000 7fc6fa2f1700 1 --2- 172.21.15.62:0/3046776675 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc6d40536a0 0x7fc6d4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:37.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.878+0000 7fc6fa2f1700 1 --2- 172.21.15.62:0/3046776675 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc6d40536a0 0x7fc6d4055b60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc6f001a000 tx=0x7fc6f0015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:37.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:37.882+0000 7fc6e77fe700 1 -- 172.21.15.62:0/3046776675 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc6e806f070 con 0x7fc6f4062b60 2021-12-17T18:18:38.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.010+0000 7fc6fb2f3700 1 -- 172.21.15.62:0/3046776675 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc6f4140140 con 0x7fc6f4062b60 2021-12-17T18:18:38.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.010+0000 7fc6e77fe700 1 -- 172.21.15.62:0/3046776675 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc6f4140140 con 0x7fc6f4062b60 2021-12-17T18:18:38.014 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:18:38.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.010+0000 7fc6fb2f3700 1 -- 172.21.15.62:0/3046776675 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc6d40536a0 msgr2=0x7fc6d4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.010+0000 7fc6fb2f3700 1 --2- 172.21.15.62:0/3046776675 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc6d40536a0 0x7fc6d4055b60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc6f001a000 tx=0x7fc6f0015000).stop 2021-12-17T18:18:38.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.010+0000 7fc6fb2f3700 1 -- 172.21.15.62:0/3046776675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f4062b60 msgr2=0x7fc6f4064670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.010+0000 7fc6fb2f3700 1 --2- 172.21.15.62:0/3046776675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f4062b60 0x7fc6f4064670 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc6e8000ed0 tx=0x7fc6e8001850).stop 2021-12-17T18:18:38.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.010+0000 7fc6fb2f3700 1 -- 172.21.15.62:0/3046776675 shutdown_connections 2021-12-17T18:18:38.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.010+0000 7fc6fb2f3700 1 --2- 172.21.15.62:0/3046776675 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc6d40536a0 0x7fc6d4055b60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.010+0000 7fc6fb2f3700 1 --2- 172.21.15.62:0/3046776675 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6f40b2d00 0x7fc6f405ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.010+0000 7fc6fb2f3700 1 --2- 172.21.15.62:0/3046776675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f4062b60 0x7fc6f4064670 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.010+0000 7fc6fb2f3700 1 --2- 172.21.15.62:0/3046776675 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc6f40625b0 0x7fc6f414dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.010+0000 7fc6fb2f3700 1 -- 172.21.15.62:0/3046776675 >> 172.21.15.62:0/3046776675 conn(0x7fc6f4060a50 msgr2=0x7fc6f41402e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:38.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.010+0000 7fc6fb2f3700 1 -- 172.21.15.62:0/3046776675 shutdown_connections 2021-12-17T18:18:38.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.010+0000 7fc6fb2f3700 1 -- 172.21.15.62:0/3046776675 wait complete. 2021-12-17T18:18:38.027 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:18:38.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.130+0000 7f69f4f96700 1 Processor -- start 2021-12-17T18:18:38.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.130+0000 7f69f4f96700 1 -- start start 2021-12-17T18:18:38.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69f4f96700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f69f00abff0 0x7f69f00b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69f4f96700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69f005c9b0 0x7f69f013f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69f4f96700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f69f013f6b0 0x7f69f01433c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69f4f96700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f00b13e0 con 0x7f69f00abff0 2021-12-17T18:18:38.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69f4f96700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f00ac3d0 con 0x7f69f013f6b0 2021-12-17T18:18:38.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69f4f96700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f005cea0 con 0x7f69f005c9b0 2021-12-17T18:18:38.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69ef7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f69f00abff0 0x7f69f00b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69ef7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f69f00abff0 0x7f69f00b05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48540/0 (socket says 172.21.15.62:48540) 2021-12-17T18:18:38.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69ef7fe700 1 -- 172.21.15.62:0/3108500797 learned_addr learned my addr 172.21.15.62:0/3108500797 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:38.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69eeffd700 1 --2- 172.21.15.62:0/3108500797 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69f005c9b0 0x7f69f013f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69effff700 1 --2- 172.21.15.62:0/3108500797 >> v2:172.21.15.109:3300/0 conn(0x7f69f013f6b0 0x7f69f01433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69ef7fe700 1 -- 172.21.15.62:0/3108500797 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69f005c9b0 msgr2=0x7f69f013f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:38.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69ef7fe700 1 --2- 172.21.15.62:0/3108500797 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69f005c9b0 0x7f69f013f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69ef7fe700 1 -- 172.21.15.62:0/3108500797 >> v2:172.21.15.109:3300/0 conn(0x7f69f013f6b0 msgr2=0x7f69f01433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:38.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69ef7fe700 1 --2- 172.21.15.62:0/3108500797 >> v2:172.21.15.109:3300/0 conn(0x7f69f013f6b0 0x7f69f01433c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69ef7fe700 1 -- 172.21.15.62:0/3108500797 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f00b0ca0 con 0x7f69f00abff0 2021-12-17T18:18:38.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69ef7fe700 1 --2- 172.21.15.62:0/3108500797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69f00abff0 0x7f69f00b05d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f69f00adc10 tx=0x7f69e0006eb0).ready entity=mon.0 client_cookie=3c0aa9a14fe36e12 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:38.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69ee7fc700 1 -- 172.21.15.62:0/3108500797 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69e000e540 con 0x7f69f00abff0 2021-12-17T18:18:38.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69ee7fc700 1 -- 172.21.15.62:0/3108500797 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e0000e90 con 0x7f69f00abff0 2021-12-17T18:18:38.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69ee7fc700 1 -- 172.21.15.62:0/3108500797 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69e000e8d0 con 0x7f69f00abff0 2021-12-17T18:18:38.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69f4f96700 1 -- 172.21.15.62:0/3108500797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69f00abff0 msgr2=0x7f69f00b05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69f4f96700 1 --2- 172.21.15.62:0/3108500797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69f00abff0 0x7f69f00b05d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f69f00adc10 tx=0x7f69e0006eb0).stop 2021-12-17T18:18:38.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69f4f96700 1 -- 172.21.15.62:0/3108500797 shutdown_connections 2021-12-17T18:18:38.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69f4f96700 1 --2- 172.21.15.62:0/3108500797 >> v2:172.21.15.109:3300/0 conn(0x7f69f013f6b0 0x7f69f01433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69f4f96700 1 --2- 172.21.15.62:0/3108500797 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69f005c9b0 0x7f69f013f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69f4f96700 1 --2- 172.21.15.62:0/3108500797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69f00abff0 0x7f69f00b05d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69f4f96700 1 -- 172.21.15.62:0/3108500797 >> 172.21.15.62:0/3108500797 conn(0x7f69f005be70 msgr2=0x7f69f0062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:38.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69f4f96700 1 -- 172.21.15.62:0/3108500797 shutdown_connections 2021-12-17T18:18:38.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.134+0000 7f69f4f96700 1 -- 172.21.15.62:0/3108500797 wait complete. 2021-12-17T18:18:38.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.138+0000 7f69f4f96700 1 Processor -- start 2021-12-17T18:18:38.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.138+0000 7f69f4f96700 1 -- start start 2021-12-17T18:18:38.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.138+0000 7f69f4f96700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69f005c9b0 0x7f69f012d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.138+0000 7f69f4f96700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f69f00abff0 0x7f69f012a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.138+0000 7f69f4f96700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69f013f6b0 0x7f69f012a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.138+0000 7f69f4f96700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f0143150 con 0x7f69f013f6b0 2021-12-17T18:18:38.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.138+0000 7f69f4f96700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f012aba0 con 0x7f69f00abff0 2021-12-17T18:18:38.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.138+0000 7f69f4f96700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f0132080 con 0x7f69f005c9b0 2021-12-17T18:18:38.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.138+0000 7f69effff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69f013f6b0 0x7f69f012a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.138+0000 7f69ef7fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69f005c9b0 0x7f69f012d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.138+0000 7f69eeffd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f69f00abff0 0x7f69f012a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.138+0000 7f69effff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69f013f6b0 0x7f69f012a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48550/0 (socket says 172.21.15.62:48550) 2021-12-17T18:18:38.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.138+0000 7f69effff700 1 -- 172.21.15.62:0/1609521673 learned_addr learned my addr 172.21.15.62:0/1609521673 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:38.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.142+0000 7f69effff700 1 -- 172.21.15.62:0/1609521673 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69f005c9b0 msgr2=0x7f69f012d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.142+0000 7f69effff700 1 --2- 172.21.15.62:0/1609521673 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69f005c9b0 0x7f69f012d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.142+0000 7f69effff700 1 -- 172.21.15.62:0/1609521673 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f69f00abff0 msgr2=0x7f69f012a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.142+0000 7f69effff700 1 --2- 172.21.15.62:0/1609521673 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f69f00abff0 0x7f69f012a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.142+0000 7f69effff700 1 -- 172.21.15.62:0/1609521673 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e000b1e0 con 0x7f69f013f6b0 2021-12-17T18:18:38.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.142+0000 7f69eeffd700 1 --2- 172.21.15.62:0/1609521673 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f69f00abff0 0x7f69f012a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:38.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.142+0000 7f69effff700 1 --2- 172.21.15.62:0/1609521673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69f013f6b0 0x7f69f012a6b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f69f01321c0 tx=0x7f69e80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:38.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.142+0000 7f69ecff9700 1 -- 172.21.15.62:0/1609521673 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69e800c640 con 0x7f69f013f6b0 2021-12-17T18:18:38.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.142+0000 7f69ecff9700 1 -- 172.21.15.62:0/1609521673 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e800c7a0 con 0x7f69f013f6b0 2021-12-17T18:18:38.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.142+0000 7f69f4f96700 1 -- 172.21.15.62:0/1609521673 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f012bd20 con 0x7f69f013f6b0 2021-12-17T18:18:38.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.142+0000 7f69ecff9700 1 -- 172.21.15.62:0/1609521673 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69e800cb00 con 0x7f69f013f6b0 2021-12-17T18:18:38.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.142+0000 7f69f4f96700 1 -- 172.21.15.62:0/1609521673 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f012db20 con 0x7f69f013f6b0 2021-12-17T18:18:38.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.142+0000 7f69f4f96700 1 -- 172.21.15.62:0/1609521673 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f00b0f40 con 0x7f69f013f6b0 2021-12-17T18:18:38.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.142+0000 7f69ecff9700 1 -- 172.21.15.62:0/1609521673 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f69e8022070 con 0x7f69f013f6b0 2021-12-17T18:18:38.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.146+0000 7f69ecff9700 1 --2- 172.21.15.62:0/1609521673 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f69d00536a0 0x7f69d0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.146+0000 7f69ecff9700 1 -- 172.21.15.62:0/1609521673 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f69e806be50 con 0x7f69f013f6b0 2021-12-17T18:18:38.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.146+0000 7f69ef7fe700 1 --2- 172.21.15.62:0/1609521673 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f69d00536a0 0x7f69d0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.146+0000 7f69ef7fe700 1 --2- 172.21.15.62:0/1609521673 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f69d00536a0 0x7f69d0055b60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f69e001b000 tx=0x7f69e0015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:38.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.150+0000 7f69ecff9700 1 -- 172.21.15.62:0/1609521673 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f69e8042fb0 con 0x7f69f013f6b0 2021-12-17T18:18:38.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.278+0000 7f69f4f96700 1 -- 172.21.15.62:0/1609521673 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f69f00573d0 con 0x7f69f013f6b0 2021-12-17T18:18:38.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.282+0000 7f69ecff9700 1 -- 172.21.15.62:0/1609521673 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f69e80465d0 con 0x7f69f013f6b0 2021-12-17T18:18:38.286 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.282+0000 7f69f4f96700 1 -- 172.21.15.62:0/1609521673 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f69d00536a0 msgr2=0x7f69d0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.282+0000 7f69f4f96700 1 --2- 172.21.15.62:0/1609521673 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f69d00536a0 0x7f69d0055b60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f69e001b000 tx=0x7f69e0015000).stop 2021-12-17T18:18:38.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.282+0000 7f69f4f96700 1 -- 172.21.15.62:0/1609521673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69f013f6b0 msgr2=0x7f69f012a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.282+0000 7f69f4f96700 1 --2- 172.21.15.62:0/1609521673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69f013f6b0 0x7f69f012a6b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f69f01321c0 tx=0x7f69e80091d0).stop 2021-12-17T18:18:38.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.282+0000 7f69f4f96700 1 -- 172.21.15.62:0/1609521673 shutdown_connections 2021-12-17T18:18:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.282+0000 7f69f4f96700 1 --2- 172.21.15.62:0/1609521673 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f69d00536a0 0x7f69d0055b60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.282+0000 7f69f4f96700 1 --2- 172.21.15.62:0/1609521673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69f013f6b0 0x7f69f012a6b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.282+0000 7f69f4f96700 1 --2- 172.21.15.62:0/1609521673 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f69f00abff0 0x7f69f012a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.282+0000 7f69f4f96700 1 --2- 172.21.15.62:0/1609521673 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69f005c9b0 0x7f69f012d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.282+0000 7f69f4f96700 1 -- 172.21.15.62:0/1609521673 >> 172.21.15.62:0/1609521673 conn(0x7f69f005be70 msgr2=0x7f69f00b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.282+0000 7f69f4f96700 1 -- 172.21.15.62:0/1609521673 shutdown_connections 2021-12-17T18:18:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.282+0000 7f69f4f96700 1 -- 172.21.15.62:0/1609521673 wait complete. 2021-12-17T18:18:38.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:18:38.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.402+0000 7fc857fff700 1 Processor -- start 2021-12-17T18:18:38.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.402+0000 7fc857fff700 1 -- start start 2021-12-17T18:18:38.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.402+0000 7fc857fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8580b6700 0x7fc8580630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.402+0000 7fc857fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc8580679e0 0x7fc8580660e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.402+0000 7fc857fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8580b6ae0 con 0x7fc8580b1ec0 2021-12-17T18:18:38.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.402+0000 7fc857fff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8580635d0 con 0x7fc8580679e0 2021-12-17T18:18:38.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.402+0000 7fc857fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580672a0 con 0x7fc8580b6700 2021-12-17T18:18:38.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.402+0000 7fc8577fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc8580b1ec0 0x7fc8580665d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60368/0 (socket says 172.21.15.62:60368) 2021-12-17T18:18:38.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.402+0000 7fc8577fe700 1 -- 172.21.15.62:0/3147080870 learned_addr learned my addr 172.21.15.62:0/3147080870 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:38.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.402+0000 7fc856ffd700 1 --2- 172.21.15.62:0/3147080870 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8580b6700 0x7fc8580630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.402+0000 7fc8567fc700 1 --2- 172.21.15.62:0/3147080870 >> v2:172.21.15.109:3300/0 conn(0x7fc8580679e0 0x7fc8580660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.402+0000 7fc855ffb700 1 -- 172.21.15.62:0/3147080870 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203045811 0 0) 0x7fc8580b6ae0 con 0x7fc8580b1ec0 2021-12-17T18:18:38.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.402+0000 7fc855ffb700 1 -- 172.21.15.62:0/3147080870 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc838003260 con 0x7fc8580b1ec0 2021-12-17T18:18:38.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc855ffb700 1 -- 172.21.15.62:0/3147080870 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2773156012 0 0) 0x7fc838003260 con 0x7fc8580b1ec0 2021-12-17T18:18:38.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc855ffb700 1 -- 172.21.15.62:0/3147080870 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8580b6700 msgr2=0x7fc8580630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:38.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc855ffb700 1 --2- 172.21.15.62:0/3147080870 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8580b6700 0x7fc8580630e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc855ffb700 1 -- 172.21.15.62:0/3147080870 >> v2:172.21.15.109:3300/0 conn(0x7fc8580679e0 msgr2=0x7fc8580660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:38.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc855ffb700 1 --2- 172.21.15.62:0/3147080870 >> v2:172.21.15.109:3300/0 conn(0x7fc8580679e0 0x7fc8580660e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc855ffb700 1 -- 172.21.15.62:0/3147080870 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc858067540 con 0x7fc8580b1ec0 2021-12-17T18:18:38.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc855ffb700 1 -- 172.21.15.62:0/3147080870 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fc848001660 con 0x7fc8580b1ec0 2021-12-17T18:18:38.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc855ffb700 1 -- 172.21.15.62:0/3147080870 >> v1:172.21.15.62:6789/0 conn(0x7fc8580b1ec0 legacy=0x7fc8580665d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc855ffb700 1 --2- 172.21.15.62:0/3147080870 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8580b6700 0x7fc838003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc855ffb700 1 --2- 172.21.15.62:0/3147080870 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc838003c80 0x7fc838004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc855ffb700 1 --2- 172.21.15.62:0/3147080870 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8380049f0 0x7fc838004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc855ffb700 1 -- 172.21.15.62:0/3147080870 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580635d0 con 0x7fc838003c80 2021-12-17T18:18:38.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc855ffb700 1 -- 172.21.15.62:0/3147080870 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580672a0 con 0x7fc8380049f0 2021-12-17T18:18:38.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc855ffb700 1 -- 172.21.15.62:0/3147080870 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83800b750 con 0x7fc8580b6700 2021-12-17T18:18:38.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc8567fc700 1 --2- 172.21.15.62:0/3147080870 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc838003c80 0x7fc838004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc856ffd700 1 --2- 172.21.15.62:0/3147080870 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8580b6700 0x7fc838003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc8577fe700 1 --2- 172.21.15.62:0/3147080870 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8380049f0 0x7fc838004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc8567fc700 1 -- 172.21.15.62:0/3147080870 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8580b6700 msgr2=0x7fc838003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:38.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc8567fc700 1 --2- 172.21.15.62:0/3147080870 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8580b6700 0x7fc838003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc8567fc700 1 -- 172.21.15.62:0/3147080870 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8380049f0 msgr2=0x7fc838004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:38.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc8567fc700 1 --2- 172.21.15.62:0/3147080870 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8380049f0 0x7fc838004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc8567fc700 1 -- 172.21.15.62:0/3147080870 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc838003260 con 0x7fc838003c80 2021-12-17T18:18:38.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc8567fc700 1 --2- 172.21.15.62:0/3147080870 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc838003c80 0x7fc838004500 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fc8380054d0 tx=0x7fc840006df0).ready entity=mon.0 client_cookie=8c70baef4840b1af server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:38.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc855ffb700 1 -- 172.21.15.62:0/3147080870 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc84000e830 con 0x7fc838003c80 2021-12-17T18:18:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc855ffb700 1 -- 172.21.15.62:0/3147080870 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84000e990 con 0x7fc838003c80 2021-12-17T18:18:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc855ffb700 1 -- 172.21.15.62:0/3147080870 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc84000ecf0 con 0x7fc838003c80 2021-12-17T18:18:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc857fff700 1 -- 172.21.15.62:0/3147080870 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc838003c80 msgr2=0x7fc838004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc857fff700 1 --2- 172.21.15.62:0/3147080870 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc838003c80 0x7fc838004500 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fc8380054d0 tx=0x7fc840006df0).stop 2021-12-17T18:18:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc8577fe700 1 -- 172.21.15.62:0/3147080870 reap_dead start 2021-12-17T18:18:38.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc857fff700 1 -- 172.21.15.62:0/3147080870 shutdown_connections 2021-12-17T18:18:38.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc857fff700 1 -- 172.21.15.62:0/3147080870 >> 172.21.15.62:0/3147080870 conn(0x7fc85805c750 msgr2=0x7fc8580b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:38.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc857fff700 1 -- 172.21.15.62:0/3147080870 shutdown_connections 2021-12-17T18:18:38.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc857fff700 1 -- 172.21.15.62:0/3147080870 wait complete. 2021-12-17T18:18:38.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc857fff700 1 Processor -- start 2021-12-17T18:18:38.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.406+0000 7fc857fff700 1 -- start start 2021-12-17T18:18:38.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc857fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc838003c80 0x7fc858148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc857fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc858141cd0 0x7fc85813c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc857fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8581423f0 0x7fc858155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc857fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc858155730 con 0x7fc838003c80 2021-12-17T18:18:38.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc857fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85813e900 con 0x7fc8581423f0 2021-12-17T18:18:38.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc857fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc858155960 con 0x7fc858141cd0 2021-12-17T18:18:38.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc856ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc838003c80 0x7fc858148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc856ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc838003c80 0x7fc858148eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48566/0 (socket says 172.21.15.62:48566) 2021-12-17T18:18:38.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc856ffd700 1 -- 172.21.15.62:0/989857297 learned_addr learned my addr 172.21.15.62:0/989857297 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:38.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc8577fe700 1 --2- 172.21.15.62:0/989857297 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8581423f0 0x7fc858155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc8567fc700 1 --2- 172.21.15.62:0/989857297 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc858141cd0 0x7fc85813c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc856ffd700 1 -- 172.21.15.62:0/989857297 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc858141cd0 msgr2=0x7fc85813c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc856ffd700 1 --2- 172.21.15.62:0/989857297 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc858141cd0 0x7fc85813c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc856ffd700 1 -- 172.21.15.62:0/989857297 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8581423f0 msgr2=0x7fc858155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc856ffd700 1 --2- 172.21.15.62:0/989857297 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8581423f0 0x7fc858155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc856ffd700 1 -- 172.21.15.62:0/989857297 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85813eba0 con 0x7fc838003c80 2021-12-17T18:18:38.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc8577fe700 1 --2- 172.21.15.62:0/989857297 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8581423f0 0x7fc858155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:38.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc856ffd700 1 --2- 172.21.15.62:0/989857297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc838003c80 0x7fc858148eb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fc850003430 tx=0x7fc850008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:38.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc84ffff700 1 -- 172.21.15.62:0/989857297 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc850011e70 con 0x7fc838003c80 2021-12-17T18:18:38.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc84ffff700 1 -- 172.21.15.62:0/989857297 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85000f8e0 con 0x7fc838003c80 2021-12-17T18:18:38.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc857fff700 1 -- 172.21.15.62:0/989857297 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85813c910 con 0x7fc838003c80 2021-12-17T18:18:38.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc84ffff700 1 -- 172.21.15.62:0/989857297 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc85000fa50 con 0x7fc838003c80 2021-12-17T18:18:38.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.410+0000 7fc857fff700 1 -- 172.21.15.62:0/989857297 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc858156510 con 0x7fc838003c80 2021-12-17T18:18:38.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.414+0000 7fc857fff700 1 -- 172.21.15.62:0/989857297 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc858155b60 con 0x7fc838003c80 2021-12-17T18:18:38.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.414+0000 7fc84ffff700 1 -- 172.21.15.62:0/989857297 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc850025070 con 0x7fc838003c80 2021-12-17T18:18:38.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.414+0000 7fc84ffff700 1 --2- 172.21.15.62:0/989857297 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc83c0534f0 0x7fc83c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.414+0000 7fc84ffff700 1 -- 172.21.15.62:0/989857297 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc85006c1b0 con 0x7fc838003c80 2021-12-17T18:18:38.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.414+0000 7fc8567fc700 1 --2- 172.21.15.62:0/989857297 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc83c0534f0 0x7fc83c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.414+0000 7fc8567fc700 1 --2- 172.21.15.62:0/989857297 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc83c0534f0 0x7fc83c0559b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fc84001c000 tx=0x7fc840019000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:38.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.418+0000 7fc84ffff700 1 -- 172.21.15.62:0/989857297 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc858155b60 con 0x7fc838003c80 2021-12-17T18:18:38.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.550+0000 7fc857fff700 1 -- 172.21.15.62:0/989857297 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc858155b60 con 0x7fc838003c80 2021-12-17T18:18:38.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.550+0000 7fc84ffff700 1 -- 172.21.15.62:0/989857297 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc858155b60 con 0x7fc838003c80 2021-12-17T18:18:38.554 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:38.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.550+0000 7fc857fff700 1 -- 172.21.15.62:0/989857297 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc83c0534f0 msgr2=0x7fc83c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.550+0000 7fc857fff700 1 --2- 172.21.15.62:0/989857297 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc83c0534f0 0x7fc83c0559b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fc84001c000 tx=0x7fc840019000).stop 2021-12-17T18:18:38.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.550+0000 7fc857fff700 1 -- 172.21.15.62:0/989857297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc838003c80 msgr2=0x7fc858148eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.550+0000 7fc857fff700 1 --2- 172.21.15.62:0/989857297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc838003c80 0x7fc858148eb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fc850003430 tx=0x7fc850008040).stop 2021-12-17T18:18:38.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.550+0000 7fc857fff700 1 -- 172.21.15.62:0/989857297 shutdown_connections 2021-12-17T18:18:38.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.550+0000 7fc857fff700 1 --2- 172.21.15.62:0/989857297 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc83c0534f0 0x7fc83c0559b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.550+0000 7fc857fff700 1 --2- 172.21.15.62:0/989857297 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8581423f0 0x7fc858155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.550+0000 7fc857fff700 1 --2- 172.21.15.62:0/989857297 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc858141cd0 0x7fc85813c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.550+0000 7fc857fff700 1 --2- 172.21.15.62:0/989857297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc838003c80 0x7fc858148eb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.550+0000 7fc857fff700 1 -- 172.21.15.62:0/989857297 >> 172.21.15.62:0/989857297 conn(0x7fc85805c750 msgr2=0x7fc858064360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:38.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.550+0000 7fc857fff700 1 -- 172.21.15.62:0/989857297 shutdown_connections 2021-12-17T18:18:38.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.550+0000 7fc857fff700 1 -- 172.21.15.62:0/989857297 wait complete. 2021-12-17T18:18:38.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:18:38.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f582759e700 1 Processor -- start 2021-12-17T18:18:38.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f582759e700 1 -- start start 2021-12-17T18:18:38.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f582759e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5828060440 0x7f5828147820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f582759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58280b4b60 con 0x7f582805c8f0 2021-12-17T18:18:38.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f582759e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58280b25d0 con 0x7f5828147d10 2021-12-17T18:18:38.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f582759e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58280b2870 con 0x7f5828060440 2021-12-17T18:18:38.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f582659c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f582805c8f0 0x7f5828144730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60386/0 (socket says 172.21.15.62:60386) 2021-12-17T18:18:38.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f582659c700 1 -- 172.21.15.62:0/1149126261 learned_addr learned my addr 172.21.15.62:0/1149126261 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:38.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f581ffff700 1 --2- 172.21.15.62:0/1149126261 >> v2:172.21.15.109:3300/0 conn(0x7f5828060440 0x7f5828147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5825d9b700 1 -- 172.21.15.62:0/1149126261 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954522826 0 0) 0x7f58280b4b60 con 0x7f582805c8f0 2021-12-17T18:18:38.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5825d9b700 1 -- 172.21.15.62:0/1149126261 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5808003260 con 0x7f582805c8f0 2021-12-17T18:18:38.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5825d9b700 1 -- 172.21.15.62:0/1149126261 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1402659922 0 0) 0x7f5808003260 con 0x7f582805c8f0 2021-12-17T18:18:38.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5825d9b700 1 -- 172.21.15.62:0/1149126261 >> v2:172.21.15.109:3300/0 conn(0x7f5828060440 msgr2=0x7f5828147820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:38.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5825d9b700 1 --2- 172.21.15.62:0/1149126261 >> v2:172.21.15.109:3300/0 conn(0x7f5828060440 0x7f5828147820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5825d9b700 1 -- 172.21.15.62:0/1149126261 >> v1:172.21.15.109:6789/0 conn(0x7f5828147d10 legacy=0x7f5828151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5825d9b700 1 -- 172.21.15.62:0/1149126261 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58280b47e0 con 0x7f582805c8f0 2021-12-17T18:18:38.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5825d9b700 1 -- 172.21.15.62:0/1149126261 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f5818001660 con 0x7f582805c8f0 2021-12-17T18:18:38.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5825d9b700 1 -- 172.21.15.62:0/1149126261 >> v1:172.21.15.62:6789/0 conn(0x7f582805c8f0 legacy=0x7f5828144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5825d9b700 1 --2- 172.21.15.62:0/1149126261 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5808003750 0x7f5808003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5825d9b700 1 --2- 172.21.15.62:0/1149126261 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5808004500 0x7f5808004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5825d9b700 1 --2- 172.21.15.62:0/1149126261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5808004e70 0x7f580800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5825d9b700 1 -- 172.21.15.62:0/1149126261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58280b2870 con 0x7f5808004e70 2021-12-17T18:18:38.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5825d9b700 1 -- 172.21.15.62:0/1149126261 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580800bd20 con 0x7f5808003750 2021-12-17T18:18:38.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5825d9b700 1 -- 172.21.15.62:0/1149126261 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580800bee0 con 0x7f5808004500 2021-12-17T18:18:38.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5826d9d700 1 --2- 172.21.15.62:0/1149126261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5808004e70 0x7f580800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f582659c700 1 --2- 172.21.15.62:0/1149126261 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5808003750 0x7f5808003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f581ffff700 1 --2- 172.21.15.62:0/1149126261 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5808004500 0x7f5808004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5826d9d700 1 -- 172.21.15.62:0/1149126261 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5808004500 msgr2=0x7f5808004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:38.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5826d9d700 1 --2- 172.21.15.62:0/1149126261 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5808004500 0x7f5808004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5826d9d700 1 -- 172.21.15.62:0/1149126261 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5808003750 msgr2=0x7f5808003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:38.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5826d9d700 1 --2- 172.21.15.62:0/1149126261 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5808003750 0x7f5808003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5826d9d700 1 -- 172.21.15.62:0/1149126261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5808003260 con 0x7f5808004e70 2021-12-17T18:18:38.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f582659c700 1 --2- 172.21.15.62:0/1149126261 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5808003750 0x7f5808003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:38.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5826d9d700 1 -- 172.21.15.62:0/1149126261 reap_dead start 2021-12-17T18:18:38.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5826d9d700 1 --2- 172.21.15.62:0/1149126261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5808004e70 0x7f580800b750 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f582805d2e0 tx=0x7f5820007d80).ready entity=mon.0 client_cookie=be132660be2f8b33 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:38.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.674+0000 7f5825d9b700 1 -- 172.21.15.62:0/1149126261 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5820001620 con 0x7f5808004e70 2021-12-17T18:18:38.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.678+0000 7f5825d9b700 1 -- 172.21.15.62:0/1149126261 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5820006890 con 0x7f5808004e70 2021-12-17T18:18:38.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.678+0000 7f5825d9b700 1 -- 172.21.15.62:0/1149126261 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5820006bf0 con 0x7f5808004e70 2021-12-17T18:18:38.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.678+0000 7f582759e700 1 -- 172.21.15.62:0/1149126261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5808004e70 msgr2=0x7f580800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.678+0000 7f582759e700 1 --2- 172.21.15.62:0/1149126261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5808004e70 0x7f580800b750 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f582805d2e0 tx=0x7f5820007d80).stop 2021-12-17T18:18:38.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.678+0000 7f582759e700 1 -- 172.21.15.62:0/1149126261 shutdown_connections 2021-12-17T18:18:38.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.678+0000 7f582759e700 1 --2- 172.21.15.62:0/1149126261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5808004e70 0x7f580800b750 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.678+0000 7f582759e700 1 -- 172.21.15.62:0/1149126261 >> 172.21.15.62:0/1149126261 conn(0x7f582805bcd0 msgr2=0x7f5828062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:38.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.678+0000 7f582759e700 1 -- 172.21.15.62:0/1149126261 shutdown_connections 2021-12-17T18:18:38.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.678+0000 7f582759e700 1 -- 172.21.15.62:0/1149126261 wait complete. 2021-12-17T18:18:38.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.678+0000 7f582759e700 1 Processor -- start 2021-12-17T18:18:38.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.678+0000 7f582759e700 1 -- start start 2021-12-17T18:18:38.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f582759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5808004e70 0x7f5828063b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f582759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5828083a80 0x7f5828084600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f582759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5828084af0 0x7f58281434f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f582759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5828063490 con 0x7f5828084af0 2021-12-17T18:18:38.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f582759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58280852c0 con 0x7f5808004e70 2021-12-17T18:18:38.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f582759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5828082ed0 con 0x7f5828083a80 2021-12-17T18:18:38.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f5826d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5828084af0 0x7f58281434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f5826d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5828084af0 0x7f58281434f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48588/0 (socket says 172.21.15.62:48588) 2021-12-17T18:18:38.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f5826d9d700 1 -- 172.21.15.62:0/1852869639 learned_addr learned my addr 172.21.15.62:0/1852869639 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:38.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f581ffff700 1 --2- 172.21.15.62:0/1852869639 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5828083a80 0x7f5828084600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f582659c700 1 --2- 172.21.15.62:0/1852869639 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5808004e70 0x7f5828063b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f5826d9d700 1 -- 172.21.15.62:0/1852869639 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5828083a80 msgr2=0x7f5828084600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f5826d9d700 1 --2- 172.21.15.62:0/1852869639 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5828083a80 0x7f5828084600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f5826d9d700 1 -- 172.21.15.62:0/1852869639 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5808004e70 msgr2=0x7f5828063b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f5826d9d700 1 --2- 172.21.15.62:0/1852869639 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5808004e70 0x7f5828063b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f5826d9d700 1 -- 172.21.15.62:0/1852869639 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5828065e50 con 0x7f5828084af0 2021-12-17T18:18:38.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f582659c700 1 --2- 172.21.15.62:0/1852869639 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5808004e70 0x7f5828063b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:38.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f5826d9d700 1 --2- 172.21.15.62:0/1852869639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5828084af0 0x7f58281434f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f582805d2e0 tx=0x7f5820016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:38.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f581f7fe700 1 -- 172.21.15.62:0/1852869639 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5820007b60 con 0x7f5828084af0 2021-12-17T18:18:38.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f581f7fe700 1 -- 172.21.15.62:0/1852869639 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582000c860 con 0x7f5828084af0 2021-12-17T18:18:38.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f581f7fe700 1 -- 172.21.15.62:0/1852869639 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f582000cbc0 con 0x7f5828084af0 2021-12-17T18:18:38.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f582759e700 1 -- 172.21.15.62:0/1852869639 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58280638c0 con 0x7f5828084af0 2021-12-17T18:18:38.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f582759e700 1 -- 172.21.15.62:0/1852869639 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58281439e0 con 0x7f5828084af0 2021-12-17T18:18:38.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.682+0000 7f582759e700 1 -- 172.21.15.62:0/1852869639 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58280b2aa0 con 0x7f5828084af0 2021-12-17T18:18:38.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.686+0000 7f581f7fe700 1 -- 172.21.15.62:0/1852869639 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5820027070 con 0x7f5828084af0 2021-12-17T18:18:38.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.686+0000 7f581f7fe700 1 --2- 172.21.15.62:0/1852869639 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f580c0534f0 0x7f580c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.686+0000 7f581f7fe700 1 -- 172.21.15.62:0/1852869639 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f582006cba0 con 0x7f5828084af0 2021-12-17T18:18:38.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.686+0000 7f582659c700 1 --2- 172.21.15.62:0/1852869639 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f580c0534f0 0x7f580c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.686+0000 7f582659c700 1 --2- 172.21.15.62:0/1852869639 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f580c0534f0 0x7f580c0559b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f581800d000 tx=0x7f5818009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:38.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.690+0000 7f581f7fe700 1 -- 172.21.15.62:0/1852869639 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5820043b90 con 0x7f5828084af0 2021-12-17T18:18:38.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.818+0000 7f582759e700 1 -- 172.21.15.62:0/1852869639 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58280573d0 con 0x7f5828084af0 2021-12-17T18:18:38.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.818+0000 7f581f7fe700 1 -- 172.21.15.62:0/1852869639 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f58200471b0 con 0x7f5828084af0 2021-12-17T18:18:38.822 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:38.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.822+0000 7f582759e700 1 -- 172.21.15.62:0/1852869639 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f580c0534f0 msgr2=0x7f580c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.822+0000 7f582759e700 1 --2- 172.21.15.62:0/1852869639 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f580c0534f0 0x7f580c0559b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f581800d000 tx=0x7f5818009040).stop 2021-12-17T18:18:38.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.822+0000 7f582759e700 1 -- 172.21.15.62:0/1852869639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5828084af0 msgr2=0x7f58281434f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.822+0000 7f582759e700 1 --2- 172.21.15.62:0/1852869639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5828084af0 0x7f58281434f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f582805d2e0 tx=0x7f5820016000).stop 2021-12-17T18:18:38.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.822+0000 7f582759e700 1 -- 172.21.15.62:0/1852869639 shutdown_connections 2021-12-17T18:18:38.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.822+0000 7f582759e700 1 --2- 172.21.15.62:0/1852869639 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f580c0534f0 0x7f580c0559b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.822+0000 7f582759e700 1 --2- 172.21.15.62:0/1852869639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5828084af0 0x7f58281434f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.822+0000 7f582759e700 1 --2- 172.21.15.62:0/1852869639 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5828083a80 0x7f5828084600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.822+0000 7f582759e700 1 --2- 172.21.15.62:0/1852869639 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5808004e70 0x7f5828063b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.822+0000 7f582759e700 1 -- 172.21.15.62:0/1852869639 >> 172.21.15.62:0/1852869639 conn(0x7f582805bcd0 msgr2=0x7f58280b6490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:38.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.822+0000 7f582759e700 1 -- 172.21.15.62:0/1852869639 shutdown_connections 2021-12-17T18:18:38.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.822+0000 7f582759e700 1 -- 172.21.15.62:0/1852869639 wait complete. 2021-12-17T18:18:38.839 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:18:38.840 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:18:38.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.930+0000 7f8c415e0700 1 Processor -- start 2021-12-17T18:18:38.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.930+0000 7f8c415e0700 1 -- start start 2021-12-17T18:18:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.930+0000 7f8c415e0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c3c0b3760 0x7f8c3c0b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.930+0000 7f8c415e0700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f8c3c1458d0 0x7f8c3c145d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.930+0000 7f8c415e0700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3c0b5f00 con 0x7f8c3c0b5b20 2021-12-17T18:18:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.930+0000 7f8c415e0700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3c0b3020 con 0x7f8c3c1458d0 2021-12-17T18:18:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.930+0000 7f8c415e0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0b32c0 con 0x7f8c3c0b3760 2021-12-17T18:18:38.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c40ddf700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f8c3c1458d0 0x7f8c3c145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c3b7fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c3c0b3760 0x7f8c3c0b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c40ddf700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f8c3c1458d0 0x7f8c3c145d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:55148/0 (socket says 172.21.15.62:55148) 2021-12-17T18:18:38.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c40ddf700 1 -- 172.21.15.62:0/3973534890 learned_addr learned my addr 172.21.15.62:0/3973534890 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:38.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c3bfff700 1 --1- 172.21.15.62:0/3973534890 >> v1:172.21.15.109:6789/0 conn(0x7f8c3c0b5b20 0x7f8c3c0b6290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:48494/0 (socket says 172.21.15.62:48494) 2021-12-17T18:18:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c40ddf700 1 -- 172.21.15.62:0/3973534890 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c3c0b3760 msgr2=0x7f8c3c0b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c40ddf700 1 --2- 172.21.15.62:0/3973534890 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c3c0b3760 0x7f8c3c0b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c40ddf700 1 -- 172.21.15.62:0/3973534890 >> v1:172.21.15.109:6789/0 conn(0x7f8c3c0b5b20 legacy=0x7f8c3c0b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c40ddf700 1 -- 172.21.15.62:0/3973534890 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c0b6e90 con 0x7f8c3c1458d0 2021-12-17T18:18:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c40ddf700 1 --2- 172.21.15.62:0/3973534890 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c3c1458d0 0x7f8c3c145d20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f8c340032f0 tx=0x7f8c34009290).ready entity=mon.1 client_cookie=857229857e41a584 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c3affd700 1 -- 172.21.15.62:0/3973534890 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c3400b8a0 con 0x7f8c3c1458d0 2021-12-17T18:18:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c3affd700 1 -- 172.21.15.62:0/3973534890 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3400ba00 con 0x7f8c3c1458d0 2021-12-17T18:18:38.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c3affd700 1 -- 172.21.15.62:0/3973534890 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c3400bb70 con 0x7f8c3c1458d0 2021-12-17T18:18:38.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c415e0700 1 -- 172.21.15.62:0/3973534890 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c3c1458d0 msgr2=0x7f8c3c145d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c415e0700 1 --2- 172.21.15.62:0/3973534890 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c3c1458d0 0x7f8c3c145d20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f8c340032f0 tx=0x7f8c34009290).stop 2021-12-17T18:18:38.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c415e0700 1 -- 172.21.15.62:0/3973534890 shutdown_connections 2021-12-17T18:18:38.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c415e0700 1 --2- 172.21.15.62:0/3973534890 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c3c1458d0 0x7f8c3c145d20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c415e0700 1 --2- 172.21.15.62:0/3973534890 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c3c0b3760 0x7f8c3c0b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c415e0700 1 -- 172.21.15.62:0/3973534890 >> 172.21.15.62:0/3973534890 conn(0x7f8c3c05c750 msgr2=0x7f8c3c05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:38.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c415e0700 1 -- 172.21.15.62:0/3973534890 shutdown_connections 2021-12-17T18:18:38.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.934+0000 7f8c415e0700 1 -- 172.21.15.62:0/3973534890 wait complete. 2021-12-17T18:18:38.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c415e0700 1 Processor -- start 2021-12-17T18:18:38.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c415e0700 1 -- start start 2021-12-17T18:18:38.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c415e0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c3c0b5b20 0x7f8c3c066c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c415e0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c3c1458d0 0x7f8c3c066390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c415e0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c3c0657c0 0x7f8c3c147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c415e0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c141870 con 0x7f8c3c1458d0 2021-12-17T18:18:38.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c415e0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c147480 con 0x7f8c3c0b5b20 2021-12-17T18:18:38.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c415e0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c1466b0 con 0x7f8c3c0657c0 2021-12-17T18:18:38.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c3b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c3c1458d0 0x7f8c3c066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c3b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c3c1458d0 0x7f8c3c066390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48602/0 (socket says 172.21.15.62:48602) 2021-12-17T18:18:38.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c40ddf700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c3c0657c0 0x7f8c3c147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c3b7fe700 1 -- 172.21.15.62:0/1121885535 learned_addr learned my addr 172.21.15.62:0/1121885535 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:38.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c3bfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c3c0b5b20 0x7f8c3c066c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c40ddf700 1 -- 172.21.15.62:0/1121885535 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c3c0b5b20 msgr2=0x7f8c3c066c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c40ddf700 1 --2- 172.21.15.62:0/1121885535 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c3c0b5b20 0x7f8c3c066c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c40ddf700 1 -- 172.21.15.62:0/1121885535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c3c1458d0 msgr2=0x7f8c3c066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:38.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c40ddf700 1 --2- 172.21.15.62:0/1121885535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c3c1458d0 0x7f8c3c066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:38.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c40ddf700 1 -- 172.21.15.62:0/1121885535 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c34009530 con 0x7f8c3c0657c0 2021-12-17T18:18:38.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c3b7fe700 1 --2- 172.21.15.62:0/1121885535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c3c1458d0 0x7f8c3c066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:38.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c40ddf700 1 --2- 172.21.15.62:0/1121885535 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c3c0657c0 0x7f8c3c147b50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f8c3c064c20 tx=0x7f8c34016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:38.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c397fa700 1 -- 172.21.15.62:0/1121885535 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c3400b8a0 con 0x7f8c3c0657c0 2021-12-17T18:18:38.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c397fa700 1 -- 172.21.15.62:0/1121885535 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c34021440 con 0x7f8c3c0657c0 2021-12-17T18:18:38.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c415e0700 1 -- 172.21.15.62:0/1121885535 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3c14a850 con 0x7f8c3c0657c0 2021-12-17T18:18:38.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c397fa700 1 -- 172.21.15.62:0/1121885535 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c340217a0 con 0x7f8c3c0657c0 2021-12-17T18:18:38.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.938+0000 7f8c415e0700 1 -- 172.21.15.62:0/1121885535 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3c066880 con 0x7f8c3c0657c0 2021-12-17T18:18:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.942+0000 7f8c415e0700 1 -- 172.21.15.62:0/1121885535 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3c1478b0 con 0x7f8c3c0657c0 2021-12-17T18:18:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.942+0000 7f8c397fa700 1 -- 172.21.15.62:0/1121885535 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8c34027020 con 0x7f8c3c0657c0 2021-12-17T18:18:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.942+0000 7f8c397fa700 1 --2- 172.21.15.62:0/1121885535 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c1c0535b0 0x7f8c1c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:38.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.942+0000 7f8c397fa700 1 -- 172.21.15.62:0/1121885535 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8c3406cd40 con 0x7f8c3c0657c0 2021-12-17T18:18:38.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.942+0000 7f8c3bfff700 1 --2- 172.21.15.62:0/1121885535 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c1c0535b0 0x7f8c1c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:38.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.942+0000 7f8c3bfff700 1 --2- 172.21.15.62:0/1121885535 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c1c0535b0 0x7f8c1c055a70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f8c2c00d000 tx=0x7f8c2c007b80).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:38.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:38.954+0000 7f8c397fa700 1 -- 172.21.15.62:0/1121885535 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8c3c1478b0 con 0x7f8c3c0657c0 2021-12-17T18:18:39.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:39.114+0000 7f8c415e0700 1 -- 172.21.15.62:0/1121885535 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c3c1478b0 con 0x7f8c3c0657c0 2021-12-17T18:18:39.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:39.114+0000 7f8c397fa700 1 -- 172.21.15.62:0/1121885535 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f8c3c1478b0 con 0x7f8c3c0657c0 2021-12-17T18:18:39.119 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:39.119 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/1930484969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1930484969},{"type":"v1","addr":"172.21.15.109:6835","nonce":1930484969}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:18:19.175750+0000","modified":"2021-12-17T18:18:20.179555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.62:6833/3194210554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3194210554},{"type":"v1","addr":"172.21.15.62:6833","nonce":3194210554}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-12-17T18:18:39.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:39.118+0000 7f8c415e0700 1 -- 172.21.15.62:0/1121885535 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c1c0535b0 msgr2=0x7f8c1c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:39.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:39.118+0000 7f8c415e0700 1 --2- 172.21.15.62:0/1121885535 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c1c0535b0 0x7f8c1c055a70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f8c2c00d000 tx=0x7f8c2c007b80).stop 2021-12-17T18:18:39.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:39.118+0000 7f8c415e0700 1 -- 172.21.15.62:0/1121885535 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c3c0657c0 msgr2=0x7f8c3c147b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:39.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:39.118+0000 7f8c415e0700 1 --2- 172.21.15.62:0/1121885535 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c3c0657c0 0x7f8c3c147b50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f8c3c064c20 tx=0x7f8c34016000).stop 2021-12-17T18:18:39.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:39.118+0000 7f8c415e0700 1 -- 172.21.15.62:0/1121885535 shutdown_connections 2021-12-17T18:18:39.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:39.118+0000 7f8c415e0700 1 --2- 172.21.15.62:0/1121885535 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c1c0535b0 0x7f8c1c055a70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:39.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:39.118+0000 7f8c415e0700 1 --2- 172.21.15.62:0/1121885535 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c3c0657c0 0x7f8c3c147b50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:39.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:39.118+0000 7f8c415e0700 1 --2- 172.21.15.62:0/1121885535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c3c1458d0 0x7f8c3c066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:39.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:39.118+0000 7f8c415e0700 1 --2- 172.21.15.62:0/1121885535 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c3c0b5b20 0x7f8c3c066c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:39.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:39.118+0000 7f8c415e0700 1 -- 172.21.15.62:0/1121885535 >> 172.21.15.62:0/1121885535 conn(0x7f8c3c05c750 msgr2=0x7f8c3c0b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:39.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:39.118+0000 7f8c415e0700 1 -- 172.21.15.62:0/1121885535 shutdown_connections 2021-12-17T18:18:39.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:39.118+0000 7f8c415e0700 1 -- 172.21.15.62:0/1121885535 wait complete. 2021-12-17T18:18:39.126 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 5 2021-12-17T18:18:39.340 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:18:19.175750+0000', 'modified': '2021-12-17T18:18:20.179555+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4264}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4264': {'gid': 4264, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.62:6833/3194210554', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 3194210554}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 3194210554}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:18:39.341 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:18:39.342 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:18:39.459 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":4264,"want_state":"up:active","state":"up:active","rank_uptime":20.267993159,"mdsmap_epoch":5,"osdmap_epoch":23,"osdmap_epoch_barrier":23,"uptime":23.623561955} 2021-12-17T18:18:39.460 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 4264, "mdsmap_epoch": 5, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "rank_uptime": 20.267993159, "state": "up:active", "uptime": 23.623561955, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:18:39.460 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:18:39.461 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2021-12-17T18:18:39.461 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.2 at ubuntu@smithi192.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2... 2021-12-17T18:18:39.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:39.462 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:18:39.470 DEBUG:teuthology.orchestra.run.smithi192:> sudo modprobe fuse 2021-12-17T18:18:39.484 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:18:39.484 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:18:39.540 INFO:teuthology.orchestra.run.smithi192.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:18:39.541 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:18:39.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:39.542 DEBUG:teuthology.orchestra.run.smithi192:> ls /sys/fs/fuse/connections 2021-12-17T18:18:39.549 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:18:39.549 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.2 /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:18:39.551 DEBUG:teuthology.orchestra.run.smithi192:> sudo modprobe fuse 2021-12-17T18:18:39.568 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:18:39.568 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:18:39.628 INFO:teuthology.orchestra.run.smithi192.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:18:39.629 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:18:39.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:39.630 DEBUG:teuthology.orchestra.run.smithi192:> ls /sys/fs/fuse/connections 2021-12-17T18:18:39.642 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi192.stderr:2021-12-17T18:18:39.637+0000 7faf78887080 -1 init, newargv = 0x55edc197dd50 newargc=9ceph-fuse[ 2021-12-17T18:18:39.642 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi192.stderr:13900]: starting ceph client 2021-12-17T18:18:39.652 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi192.stderr:ceph-fuse[13900]: starting fuse 2021-12-17T18:18:40.736 DEBUG:teuthology.orchestra.run.smithi192:> sudo modprobe fuse 2021-12-17T18:18:40.754 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:18:40.754 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:18:40.809 INFO:teuthology.orchestra.run.smithi192.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:18:40.810 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:18:40.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:40.811 DEBUG:teuthology.orchestra.run.smithi192:> ls /sys/fs/fuse/connections 2021-12-17T18:18:40.816 INFO:teuthology.orchestra.run.smithi192.stdout:52 2021-12-17T18:18:40.817 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:18:40.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:40.817 DEBUG:teuthology.orchestra.run.smithi192:> sudo python3 -c ' 2021-12-17T18:18:40.818 DEBUG:teuthology.orchestra.run.smithi192:> import glob 2021-12-17T18:18:40.818 DEBUG:teuthology.orchestra.run.smithi192:> import re 2021-12-17T18:18:40.819 DEBUG:teuthology.orchestra.run.smithi192:> import os 2021-12-17T18:18:40.819 DEBUG:teuthology.orchestra.run.smithi192:> import subprocess 2021-12-17T18:18:40.819 DEBUG:teuthology.orchestra.run.smithi192:> 2021-12-17T18:18:40.820 DEBUG:teuthology.orchestra.run.smithi192:> def find_socket(client_name): 2021-12-17T18:18:40.820 DEBUG:teuthology.orchestra.run.smithi192:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2021-12-17T18:18:40.820 DEBUG:teuthology.orchestra.run.smithi192:> files = glob.glob(asok_path) 2021-12-17T18:18:40.821 DEBUG:teuthology.orchestra.run.smithi192:> 2021-12-17T18:18:40.821 DEBUG:teuthology.orchestra.run.smithi192:> # Given a non-glob path, it better be there 2021-12-17T18:18:40.821 DEBUG:teuthology.orchestra.run.smithi192:> if "*" not in asok_path: 2021-12-17T18:18:40.822 DEBUG:teuthology.orchestra.run.smithi192:> assert(len(files) == 1) 2021-12-17T18:18:40.822 DEBUG:teuthology.orchestra.run.smithi192:> return files[0] 2021-12-17T18:18:40.823 DEBUG:teuthology.orchestra.run.smithi192:> 2021-12-17T18:18:40.823 DEBUG:teuthology.orchestra.run.smithi192:> for f in files: 2021-12-17T18:18:40.823 DEBUG:teuthology.orchestra.run.smithi192:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:18:40.824 DEBUG:teuthology.orchestra.run.smithi192:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:18:40.824 DEBUG:teuthology.orchestra.run.smithi192:> return f 2021-12-17T18:18:40.824 DEBUG:teuthology.orchestra.run.smithi192:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:18:40.825 DEBUG:teuthology.orchestra.run.smithi192:> 2021-12-17T18:18:40.825 DEBUG:teuthology.orchestra.run.smithi192:> print(find_socket("client.2")) 2021-12-17T18:18:40.825 DEBUG:teuthology.orchestra.run.smithi192:> ' 2021-12-17T18:18:40.905 INFO:teuthology.orchestra.run.smithi192.stdout:/var/run/ceph/ceph-client.2.13900.asok 2021-12-17T18:18:40.909 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.13900.asok 2021-12-17T18:18:40.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:40.910 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.13900.asok status 2021-12-17T18:18:41.000 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2021-12-17T18:18:41.000 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": { 2021-12-17T18:18:41.000 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:18:41.001 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:18:41.001 INFO:teuthology.orchestra.run.smithi192.stdout: "entity_id": "2", 2021-12-17T18:18:41.001 INFO:teuthology.orchestra.run.smithi192.stdout: "hostname": "smithi192", 2021-12-17T18:18:41.001 INFO:teuthology.orchestra.run.smithi192.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2021-12-17T18:18:41.002 INFO:teuthology.orchestra.run.smithi192.stdout: "pid": "13900", 2021-12-17T18:18:41.002 INFO:teuthology.orchestra.run.smithi192.stdout: "root": "/" 2021-12-17T18:18:41.002 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2021-12-17T18:18:41.002 INFO:teuthology.orchestra.run.smithi192.stdout: "dentry_count": 0, 2021-12-17T18:18:41.003 INFO:teuthology.orchestra.run.smithi192.stdout: "dentry_pinned_count": 0, 2021-12-17T18:18:41.003 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 4704, 2021-12-17T18:18:41.003 INFO:teuthology.orchestra.run.smithi192.stdout: "inst": { 2021-12-17T18:18:41.003 INFO:teuthology.orchestra.run.smithi192.stdout: "name": { 2021-12-17T18:18:41.004 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "client", 2021-12-17T18:18:41.004 INFO:teuthology.orchestra.run.smithi192.stdout: "num": 4704 2021-12-17T18:18:41.004 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2021-12-17T18:18:41.004 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": { 2021-12-17T18:18:41.004 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2021-12-17T18:18:41.005 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:0", 2021-12-17T18:18:41.005 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1631648661 2021-12-17T18:18:41.005 INFO:teuthology.orchestra.run.smithi192.stdout: } 2021-12-17T18:18:41.005 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2021-12-17T18:18:41.006 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": { 2021-12-17T18:18:41.006 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2021-12-17T18:18:41.006 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:0", 2021-12-17T18:18:41.006 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1631648661 2021-12-17T18:18:41.007 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2021-12-17T18:18:41.007 INFO:teuthology.orchestra.run.smithi192.stdout: "inst_str": "client.4704 172.21.15.192:0/1631648661", 2021-12-17T18:18:41.007 INFO:teuthology.orchestra.run.smithi192.stdout: "addr_str": "172.21.15.192:0/1631648661", 2021-12-17T18:18:41.007 INFO:teuthology.orchestra.run.smithi192.stdout: "inode_count": 1, 2021-12-17T18:18:41.008 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_epoch": 5, 2021-12-17T18:18:41.008 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_epoch": 23, 2021-12-17T18:18:41.008 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:18:41.008 INFO:teuthology.orchestra.run.smithi192.stdout: "blacklisted": false, 2021-12-17T18:18:41.009 INFO:teuthology.orchestra.run.smithi192.stdout: "fs_name": "cephfs" 2021-12-17T18:18:41.009 INFO:teuthology.orchestra.run.smithi192.stdout:} 2021-12-17T18:18:41.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:41.011 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:18:41.011 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:18:41.020 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:18:41.021 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:18:41.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:41.022 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:18:41.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:41.084 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:18:41.085 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:18:41.093 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:18:41.094 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:18:41.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:41.095 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:18:41.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:41.121 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:18:41.121 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:18:41.130 INFO:teuthology.orchestra.run.smithi192.stdout:fuseblk 2021-12-17T18:18:41.131 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2021-12-17T18:18:41.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:41.132 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:18:41.198 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2021-12-17T18:18:41.218 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:41.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.326+0000 7f73448ba700 1 Processor -- start 2021-12-17T18:18:41.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.326+0000 7f73448ba700 1 -- start start 2021-12-17T18:18:41.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f73448ba700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f73400b1730 0x7f73400ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:41.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f73448ba700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73400b2ce0 con 0x7f73400a7bb0 2021-12-17T18:18:41.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f73448ba700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73400aca60 con 0x7f73400b21f0 2021-12-17T18:18:41.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f73448ba700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734014b5b0 con 0x7f73400b1730 2021-12-17T18:18:41.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f733ed9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f73400a7bb0 0x7f7340067120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60424/0 (socket says 172.21.15.62:60424) 2021-12-17T18:18:41.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f733ed9d700 1 -- 172.21.15.62:0/786532272 learned_addr learned my addr 172.21.15.62:0/786532272 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:41.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f733dd9b700 1 --2- 172.21.15.62:0/786532272 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f73400b1730 0x7f73400ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:41.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f733d59a700 1 -- 172.21.15.62:0/786532272 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071043450 0 0) 0x7f73400b2ce0 con 0x7f73400a7bb0 2021-12-17T18:18:41.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f733d59a700 1 -- 172.21.15.62:0/786532272 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7324003260 con 0x7f73400a7bb0 2021-12-17T18:18:41.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f733d59a700 1 -- 172.21.15.62:0/786532272 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491687724 0 0) 0x7f73400aca60 con 0x7f73400b21f0 2021-12-17T18:18:41.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f733d59a700 1 -- 172.21.15.62:0/786532272 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73400b2ce0 con 0x7f73400b21f0 2021-12-17T18:18:41.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f733dd9b700 1 -- 172.21.15.62:0/786532272 >> v1:172.21.15.109:6789/0 conn(0x7f73400b21f0 legacy=0x7f734014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f733dd9b700 1 -- 172.21.15.62:0/786532272 >> v1:172.21.15.62:6789/0 conn(0x7f73400a7bb0 legacy=0x7f7340067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f733dd9b700 1 -- 172.21.15.62:0/786532272 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73400b2f10 con 0x7f73400b1730 2021-12-17T18:18:41.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f733dd9b700 1 --2- 172.21.15.62:0/786532272 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f73400b1730 0x7f73400ace90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7330002f70 tx=0x7f7330006df0).ready entity=mon.2 client_cookie=ad32547451c6c606 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:41.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f733d59a700 1 -- 172.21.15.62:0/786532272 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f733000d5c0 con 0x7f73400b1730 2021-12-17T18:18:41.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f733d59a700 1 -- 172.21.15.62:0/786532272 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7330000e90 con 0x7f73400b1730 2021-12-17T18:18:41.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f733d59a700 1 -- 172.21.15.62:0/786532272 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f733000d910 con 0x7f73400b1730 2021-12-17T18:18:41.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f73448ba700 1 -- 172.21.15.62:0/786532272 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f73400b1730 msgr2=0x7f73400ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f73448ba700 1 --2- 172.21.15.62:0/786532272 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f73400b1730 0x7f73400ace90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7330002f70 tx=0x7f7330006df0).stop 2021-12-17T18:18:41.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f73448ba700 1 -- 172.21.15.62:0/786532272 shutdown_connections 2021-12-17T18:18:41.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f73448ba700 1 --2- 172.21.15.62:0/786532272 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f73400b1730 0x7f73400ace90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f73448ba700 1 -- 172.21.15.62:0/786532272 >> 172.21.15.62:0/786532272 conn(0x7f734005f730 msgr2=0x7f734005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:41.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f73448ba700 1 -- 172.21.15.62:0/786532272 shutdown_connections 2021-12-17T18:18:41.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.330+0000 7f73448ba700 1 -- 172.21.15.62:0/786532272 wait complete. 2021-12-17T18:18:41.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.334+0000 7f73448ba700 1 Processor -- start 2021-12-17T18:18:41.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.334+0000 7f73448ba700 1 -- start start 2021-12-17T18:18:41.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.334+0000 7f73448ba700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f73400a7bb0 0x7f7340157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:41.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.334+0000 7f73448ba700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f73400b1730 0x7f734014e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:41.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.334+0000 7f73448ba700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73400b21f0 0x7f734014e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:41.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.334+0000 7f73448ba700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734014c8e0 con 0x7f73400b21f0 2021-12-17T18:18:41.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.334+0000 7f73448ba700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734014cb30 con 0x7f73400a7bb0 2021-12-17T18:18:41.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.334+0000 7f73448ba700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734014cdd0 con 0x7f73400b1730 2021-12-17T18:18:41.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.334+0000 7f733ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73400b21f0 0x7f734014e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:41.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f733ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73400b21f0 0x7f734014e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48618/0 (socket says 172.21.15.62:48618) 2021-12-17T18:18:41.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f733ed9d700 1 -- 172.21.15.62:0/2641867747 learned_addr learned my addr 172.21.15.62:0/2641867747 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:41.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f733dd9b700 1 --2- 172.21.15.62:0/2641867747 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f73400b1730 0x7f734014e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:41.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f733e59c700 1 --2- 172.21.15.62:0/2641867747 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f73400a7bb0 0x7f7340157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:41.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f733ed9d700 1 -- 172.21.15.62:0/2641867747 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f73400b1730 msgr2=0x7f734014e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f733ed9d700 1 --2- 172.21.15.62:0/2641867747 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f73400b1730 0x7f734014e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f733ed9d700 1 -- 172.21.15.62:0/2641867747 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f73400a7bb0 msgr2=0x7f7340157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f733ed9d700 1 --2- 172.21.15.62:0/2641867747 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f73400a7bb0 0x7f7340157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f733ed9d700 1 -- 172.21.15.62:0/2641867747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733000b180 con 0x7f73400b21f0 2021-12-17T18:18:41.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f733ed9d700 1 --2- 172.21.15.62:0/2641867747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73400b21f0 0x7f734014e620 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f7338001490 tx=0x7f7338007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:41.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f732f7fe700 1 -- 172.21.15.62:0/2641867747 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7338005ba0 con 0x7f73400b21f0 2021-12-17T18:18:41.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f732f7fe700 1 -- 172.21.15.62:0/2641867747 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7338005d00 con 0x7f73400b21f0 2021-12-17T18:18:41.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f732f7fe700 1 -- 172.21.15.62:0/2641867747 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73380072c0 con 0x7f73400b21f0 2021-12-17T18:18:41.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f73448ba700 1 -- 172.21.15.62:0/2641867747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734014d960 con 0x7f73400b21f0 2021-12-17T18:18:41.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f73448ba700 1 -- 172.21.15.62:0/2641867747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7340066aa0 con 0x7f73400b21f0 2021-12-17T18:18:41.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f73448ba700 1 -- 172.21.15.62:0/2641867747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734014cf90 con 0x7f73400b21f0 2021-12-17T18:18:41.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f732f7fe700 1 -- 172.21.15.62:0/2641867747 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7338010070 con 0x7f73400b21f0 2021-12-17T18:18:41.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.338+0000 7f732f7fe700 1 --2- 172.21.15.62:0/2641867747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f731c0536a0 0x7f731c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:41.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.342+0000 7f732f7fe700 1 -- 172.21.15.62:0/2641867747 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f733806b180 con 0x7f73400b21f0 2021-12-17T18:18:41.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.342+0000 7f733e59c700 1 --2- 172.21.15.62:0/2641867747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f731c0536a0 0x7f731c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:41.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.342+0000 7f733e59c700 1 --2- 172.21.15.62:0/2641867747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f731c0536a0 0x7f731c055b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f733400d000 tx=0x7f7334007a00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:41.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.346+0000 7f732f7fe700 1 -- 172.21.15.62:0/2641867747 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f73380422e0 con 0x7f73400b21f0 2021-12-17T18:18:41.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.470+0000 7f73448ba700 1 -- 172.21.15.62:0/2641867747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73400ad380 con 0x7f73400b21f0 2021-12-17T18:18:41.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.474+0000 7f732f7fe700 1 -- 172.21.15.62:0/2641867747 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f7338018070 con 0x7f73400b21f0 2021-12-17T18:18:41.477 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:41.477 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:20.178383+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:17.128555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:18.180577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:41.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.474+0000 7f73448ba700 1 -- 172.21.15.62:0/2641867747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f731c0536a0 msgr2=0x7f731c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.474+0000 7f73448ba700 1 --2- 172.21.15.62:0/2641867747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f731c0536a0 0x7f731c055b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f733400d000 tx=0x7f7334007a00).stop 2021-12-17T18:18:41.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.474+0000 7f73448ba700 1 -- 172.21.15.62:0/2641867747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73400b21f0 msgr2=0x7f734014e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.474+0000 7f73448ba700 1 --2- 172.21.15.62:0/2641867747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73400b21f0 0x7f734014e620 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f7338001490 tx=0x7f7338007de0).stop 2021-12-17T18:18:41.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.474+0000 7f73448ba700 1 -- 172.21.15.62:0/2641867747 shutdown_connections 2021-12-17T18:18:41.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.474+0000 7f73448ba700 1 --2- 172.21.15.62:0/2641867747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f731c0536a0 0x7f731c055b60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.474+0000 7f73448ba700 1 --2- 172.21.15.62:0/2641867747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73400b21f0 0x7f734014e620 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.474+0000 7f73448ba700 1 --2- 172.21.15.62:0/2641867747 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f73400b1730 0x7f734014e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.474+0000 7f73448ba700 1 --2- 172.21.15.62:0/2641867747 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f73400a7bb0 0x7f7340157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.474+0000 7f73448ba700 1 -- 172.21.15.62:0/2641867747 >> 172.21.15.62:0/2641867747 conn(0x7f734005f730 msgr2=0x7f734014ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:41.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.474+0000 7f73448ba700 1 -- 172.21.15.62:0/2641867747 shutdown_connections 2021-12-17T18:18:41.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.474+0000 7f73448ba700 1 -- 172.21.15.62:0/2641867747 wait complete. 2021-12-17T18:18:41.490 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:18:17.128555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:18:18.180577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:18:41.491 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:18:41.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.598+0000 7fd4deb64700 1 Processor -- start 2021-12-17T18:18:41.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.598+0000 7fd4deb64700 1 -- start start 2021-12-17T18:18:41.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4deb64700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4d80b6700 0x7fd4d8143200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:41.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4deb64700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd4d8064110 0x7fd4d80ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:41.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4deb64700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d8067840 con 0x7fd4d805f730 2021-12-17T18:18:41.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4deb64700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d8066840 con 0x7fd4d8064110 2021-12-17T18:18:41.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4deb64700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d8064b70 con 0x7fd4d80b6700 2021-12-17T18:18:41.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4dd361700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd4d8064110 0x7fd4d80ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:41.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4de363700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd4d805f730 0x7fd4d805fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60438/0 (socket says 172.21.15.62:60438) 2021-12-17T18:18:41.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4de363700 1 -- 172.21.15.62:0/4211002411 learned_addr learned my addr 172.21.15.62:0/4211002411 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:41.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4ddb62700 1 --2- 172.21.15.62:0/4211002411 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4d80b6700 0x7fd4d8143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:41.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4dd361700 1 -- 172.21.15.62:0/4211002411 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4d80b6700 msgr2=0x7fd4d8143200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:41.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4dd361700 1 --2- 172.21.15.62:0/4211002411 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4d80b6700 0x7fd4d8143200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4dd361700 1 -- 172.21.15.62:0/4211002411 >> v1:172.21.15.62:6789/0 conn(0x7fd4d805f730 legacy=0x7fd4d805fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4dd361700 1 -- 172.21.15.62:0/4211002411 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d80b6ae0 con 0x7fd4d8064110 2021-12-17T18:18:41.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4dd361700 1 --2- 172.21.15.62:0/4211002411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d8064110 0x7fd4d80ad630 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fd4c8002f70 tx=0x7fd4c8006df0).ready entity=mon.0 client_cookie=910724c013e13fce server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:41.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4dcb60700 1 -- 172.21.15.62:0/4211002411 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4c800d570 con 0x7fd4d8064110 2021-12-17T18:18:41.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4dcb60700 1 -- 172.21.15.62:0/4211002411 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c8000e90 con 0x7fd4d8064110 2021-12-17T18:18:41.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4dcb60700 1 -- 172.21.15.62:0/4211002411 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4c800d8c0 con 0x7fd4d8064110 2021-12-17T18:18:41.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4deb64700 1 -- 172.21.15.62:0/4211002411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d8064110 msgr2=0x7fd4d80ad630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4deb64700 1 --2- 172.21.15.62:0/4211002411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d8064110 0x7fd4d80ad630 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fd4c8002f70 tx=0x7fd4c8006df0).stop 2021-12-17T18:18:41.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4deb64700 1 -- 172.21.15.62:0/4211002411 shutdown_connections 2021-12-17T18:18:41.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4deb64700 1 --2- 172.21.15.62:0/4211002411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d8064110 0x7fd4d80ad630 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4deb64700 1 --2- 172.21.15.62:0/4211002411 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4d80b6700 0x7fd4d8143200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4deb64700 1 -- 172.21.15.62:0/4211002411 >> 172.21.15.62:0/4211002411 conn(0x7fd4d805c750 msgr2=0x7fd4d80b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:41.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4deb64700 1 -- 172.21.15.62:0/4211002411 shutdown_connections 2021-12-17T18:18:41.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.602+0000 7fd4deb64700 1 -- 172.21.15.62:0/4211002411 wait complete. 2021-12-17T18:18:41.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4deb64700 1 Processor -- start 2021-12-17T18:18:41.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4deb64700 1 -- start start 2021-12-17T18:18:41.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4deb64700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4d805f730 0x7fd4d8142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:41.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4deb64700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d8064110 0x7fd4d813e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:41.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4deb64700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4d80b6700 0x7fd4d8146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:41.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4deb64700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d8145d70 con 0x7fd4d8064110 2021-12-17T18:18:41.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4deb64700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d813e840 con 0x7fd4d80b6700 2021-12-17T18:18:41.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4deb64700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d813f320 con 0x7fd4d805f730 2021-12-17T18:18:41.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4dd361700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d8064110 0x7fd4d813e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:41.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4ddb62700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4d805f730 0x7fd4d8142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:41.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4dd361700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d8064110 0x7fd4d813e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48630/0 (socket says 172.21.15.62:48630) 2021-12-17T18:18:41.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4dd361700 1 -- 172.21.15.62:0/988815014 learned_addr learned my addr 172.21.15.62:0/988815014 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:41.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4de363700 1 --2- 172.21.15.62:0/988815014 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4d80b6700 0x7fd4d8146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:41.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4dd361700 1 -- 172.21.15.62:0/988815014 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4d805f730 msgr2=0x7fd4d8142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4dd361700 1 --2- 172.21.15.62:0/988815014 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4d805f730 0x7fd4d8142670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4dd361700 1 -- 172.21.15.62:0/988815014 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4d80b6700 msgr2=0x7fd4d8146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4dd361700 1 --2- 172.21.15.62:0/988815014 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4d80b6700 0x7fd4d8146d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4dd361700 1 -- 172.21.15.62:0/988815014 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c800b180 con 0x7fd4d8064110 2021-12-17T18:18:41.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.606+0000 7fd4de363700 1 --2- 172.21.15.62:0/988815014 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4d80b6700 0x7fd4d8146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:41.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.610+0000 7fd4dd361700 1 --2- 172.21.15.62:0/988815014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d8064110 0x7fd4d813e350 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fd4c8002f70 tx=0x7fd4c8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:41.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.610+0000 7fd4c6ffd700 1 -- 172.21.15.62:0/988815014 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4c800bed0 con 0x7fd4d8064110 2021-12-17T18:18:41.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.610+0000 7fd4c6ffd700 1 -- 172.21.15.62:0/988815014 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c800de50 con 0x7fd4d8064110 2021-12-17T18:18:41.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.610+0000 7fd4deb64700 1 -- 172.21.15.62:0/988815014 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d81440c0 con 0x7fd4d8064110 2021-12-17T18:18:41.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.610+0000 7fd4c6ffd700 1 -- 172.21.15.62:0/988815014 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4c8011d70 con 0x7fd4d8064110 2021-12-17T18:18:41.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.610+0000 7fd4deb64700 1 -- 172.21.15.62:0/988815014 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d813fd20 con 0x7fd4d8064110 2021-12-17T18:18:41.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.610+0000 7fd4deb64700 1 -- 172.21.15.62:0/988815014 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d8067a70 con 0x7fd4d8064110 2021-12-17T18:18:41.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.614+0000 7fd4c6ffd700 1 -- 172.21.15.62:0/988815014 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd4c8025030 con 0x7fd4d8064110 2021-12-17T18:18:41.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.614+0000 7fd4c6ffd700 1 --2- 172.21.15.62:0/988815014 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4b8053610 0x7fd4b8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:41.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.614+0000 7fd4c6ffd700 1 -- 172.21.15.62:0/988815014 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd4c806c9d0 con 0x7fd4d8064110 2021-12-17T18:18:41.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.614+0000 7fd4ddb62700 1 --2- 172.21.15.62:0/988815014 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4b8053610 0x7fd4b8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:41.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.614+0000 7fd4ddb62700 1 --2- 172.21.15.62:0/988815014 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4b8053610 0x7fd4b8055ad0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd4d400c000 tx=0x7fd4d4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:41.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.622+0000 7fd4c6ffd700 1 -- 172.21.15.62:0/988815014 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd4c8043b30 con 0x7fd4d8064110 2021-12-17T18:18:41.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.746+0000 7fd4deb64700 1 -- 172.21.15.62:0/988815014 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd4d80573d0 con 0x7fd4d8064110 2021-12-17T18:18:41.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.746+0000 7fd4c6ffd700 1 -- 172.21.15.62:0/988815014 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd4c8023020 con 0x7fd4d8064110 2021-12-17T18:18:41.752 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:18:41.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.750+0000 7fd4deb64700 1 -- 172.21.15.62:0/988815014 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4b8053610 msgr2=0x7fd4b8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.750+0000 7fd4deb64700 1 --2- 172.21.15.62:0/988815014 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4b8053610 0x7fd4b8055ad0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd4d400c000 tx=0x7fd4d4008040).stop 2021-12-17T18:18:41.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.750+0000 7fd4deb64700 1 -- 172.21.15.62:0/988815014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d8064110 msgr2=0x7fd4d813e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.750+0000 7fd4deb64700 1 --2- 172.21.15.62:0/988815014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d8064110 0x7fd4d813e350 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fd4c8002f70 tx=0x7fd4c8015000).stop 2021-12-17T18:18:41.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.750+0000 7fd4deb64700 1 -- 172.21.15.62:0/988815014 shutdown_connections 2021-12-17T18:18:41.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.750+0000 7fd4deb64700 1 --2- 172.21.15.62:0/988815014 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4b8053610 0x7fd4b8055ad0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.750+0000 7fd4deb64700 1 --2- 172.21.15.62:0/988815014 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4d80b6700 0x7fd4d8146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.750+0000 7fd4deb64700 1 --2- 172.21.15.62:0/988815014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d8064110 0x7fd4d813e350 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.750+0000 7fd4deb64700 1 --2- 172.21.15.62:0/988815014 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4d805f730 0x7fd4d8142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.750+0000 7fd4deb64700 1 -- 172.21.15.62:0/988815014 >> 172.21.15.62:0/988815014 conn(0x7fd4d805c750 msgr2=0x7fd4d80b4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:41.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.750+0000 7fd4deb64700 1 -- 172.21.15.62:0/988815014 shutdown_connections 2021-12-17T18:18:41.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.750+0000 7fd4deb64700 1 -- 172.21.15.62:0/988815014 wait complete. 2021-12-17T18:18:41.765 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:18:41.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.866+0000 7f4d2759e700 1 Processor -- start 2021-12-17T18:18:41.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.866+0000 7f4d2759e700 1 -- start start 2021-12-17T18:18:41.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.866+0000 7f4d2759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4d280b17e0 0x7f4d2814dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:41.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.866+0000 7f4d2759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d281433c0 con 0x7f4d2805ca90 2021-12-17T18:18:41.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.866+0000 7f4d2759e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d28143660 con 0x7f4d281466f0 2021-12-17T18:18:41.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.866+0000 7f4d2759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d28143120 con 0x7f4d280b17e0 2021-12-17T18:18:41.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.866+0000 7f4d2659c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4d2805ca90 0x7f4d280afe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60448/0 (socket says 172.21.15.62:60448) 2021-12-17T18:18:41.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.866+0000 7f4d2659c700 1 -- 172.21.15.62:0/1289263164 learned_addr learned my addr 172.21.15.62:0/1289263164 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:41.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.866+0000 7f4d26d9d700 1 --2- 172.21.15.62:0/1289263164 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4d280b17e0 0x7f4d2814dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:41.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d2559a700 1 -- 172.21.15.62:0/1289263164 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547872176 0 0) 0x7f4d281433c0 con 0x7f4d2805ca90 2021-12-17T18:18:41.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d2559a700 1 -- 172.21.15.62:0/1289263164 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d0c003260 con 0x7f4d2805ca90 2021-12-17T18:18:41.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d2559a700 1 -- 172.21.15.62:0/1289263164 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498488240 0 0) 0x7f4d28143660 con 0x7f4d281466f0 2021-12-17T18:18:41.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d2559a700 1 -- 172.21.15.62:0/1289263164 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d281433c0 con 0x7f4d281466f0 2021-12-17T18:18:41.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d26d9d700 1 -- 172.21.15.62:0/1289263164 >> v1:172.21.15.109:6789/0 conn(0x7f4d281466f0 legacy=0x7f4d28143b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d2559a700 1 -- 172.21.15.62:0/1289263164 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1383251048 0 0) 0x7f4d0c003260 con 0x7f4d2805ca90 2021-12-17T18:18:41.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d26d9d700 1 -- 172.21.15.62:0/1289263164 >> v1:172.21.15.62:6789/0 conn(0x7f4d2805ca90 legacy=0x7f4d280afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d26d9d700 1 -- 172.21.15.62:0/1289263164 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2805ce70 con 0x7f4d280b17e0 2021-12-17T18:18:41.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d26d9d700 1 --2- 172.21.15.62:0/1289263164 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4d280b17e0 0x7f4d2814dd20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f4d1c001110 tx=0x7f4d200091d0).ready entity=mon.2 client_cookie=e2be675f79f37ad3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:41.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d2559a700 1 -- 172.21.15.62:0/1289263164 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d1c001660 con 0x7f4d280b17e0 2021-12-17T18:18:41.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d2559a700 1 -- 172.21.15.62:0/1289263164 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2000f510 con 0x7f4d280b17e0 2021-12-17T18:18:41.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d2559a700 1 -- 172.21.15.62:0/1289263164 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d2000f680 con 0x7f4d280b17e0 2021-12-17T18:18:41.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d2759e700 1 -- 172.21.15.62:0/1289263164 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4d280b17e0 msgr2=0x7f4d2814dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d2759e700 1 --2- 172.21.15.62:0/1289263164 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4d280b17e0 0x7f4d2814dd20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f4d1c001110 tx=0x7f4d200091d0).stop 2021-12-17T18:18:41.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d2759e700 1 -- 172.21.15.62:0/1289263164 shutdown_connections 2021-12-17T18:18:41.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d2759e700 1 --2- 172.21.15.62:0/1289263164 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4d280b17e0 0x7f4d2814dd20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d2759e700 1 -- 172.21.15.62:0/1289263164 >> 172.21.15.62:0/1289263164 conn(0x7f4d2805be70 msgr2=0x7f4d28062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:41.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d2759e700 1 -- 172.21.15.62:0/1289263164 shutdown_connections 2021-12-17T18:18:41.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.870+0000 7f4d2759e700 1 -- 172.21.15.62:0/1289263164 wait complete. 2021-12-17T18:18:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d2759e700 1 Processor -- start 2021-12-17T18:18:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d2759e700 1 -- start start 2021-12-17T18:18:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d2759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4d2805ca90 0x7f4d280b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d2759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4d280b17e0 0x7f4d2813f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d2759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d281466f0 0x7f4d28066760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:41.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d2759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d281490f0 con 0x7f4d281466f0 2021-12-17T18:18:41.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d2759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d28064180 con 0x7f4d2805ca90 2021-12-17T18:18:41.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d2759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d28149320 con 0x7f4d280b17e0 2021-12-17T18:18:41.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d26d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d281466f0 0x7f4d28066760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:41.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d26d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d281466f0 0x7f4d28066760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48644/0 (socket says 172.21.15.62:48644) 2021-12-17T18:18:41.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d2659c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4d2805ca90 0x7f4d280b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:41.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d26d9d700 1 -- 172.21.15.62:0/250717484 learned_addr learned my addr 172.21.15.62:0/250717484 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:41.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d25d9b700 1 --2- 172.21.15.62:0/250717484 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4d280b17e0 0x7f4d2813f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:41.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d26d9d700 1 -- 172.21.15.62:0/250717484 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4d280b17e0 msgr2=0x7f4d2813f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d26d9d700 1 --2- 172.21.15.62:0/250717484 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4d280b17e0 0x7f4d2813f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d26d9d700 1 -- 172.21.15.62:0/250717484 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4d2805ca90 msgr2=0x7f4d280b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:41.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d26d9d700 1 --2- 172.21.15.62:0/250717484 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4d2805ca90 0x7f4d280b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:41.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d26d9d700 1 -- 172.21.15.62:0/250717484 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d20009470 con 0x7f4d281466f0 2021-12-17T18:18:41.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d25d9b700 1 --2- 172.21.15.62:0/250717484 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4d280b17e0 0x7f4d2813f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:41.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d26d9d700 1 --2- 172.21.15.62:0/250717484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d281466f0 0x7f4d28066760 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f4d1c001110 tx=0x7f4d20016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:41.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d177fe700 1 -- 172.21.15.62:0/250717484 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d200032f0 con 0x7f4d281466f0 2021-12-17T18:18:41.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d177fe700 1 -- 172.21.15.62:0/250717484 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d20011c30 con 0x7f4d281466f0 2021-12-17T18:18:41.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d2759e700 1 -- 172.21.15.62:0/250717484 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2813f930 con 0x7f4d281466f0 2021-12-17T18:18:41.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d177fe700 1 -- 172.21.15.62:0/250717484 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d20021480 con 0x7f4d281466f0 2021-12-17T18:18:41.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.874+0000 7f4d2759e700 1 -- 172.21.15.62:0/250717484 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d280645e0 con 0x7f4d281466f0 2021-12-17T18:18:41.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.878+0000 7f4d177fe700 1 -- 172.21.15.62:0/250717484 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4d2000f070 con 0x7f4d281466f0 2021-12-17T18:18:41.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.878+0000 7f4d2759e700 1 -- 172.21.15.62:0/250717484 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d28144210 con 0x7f4d281466f0 2021-12-17T18:18:41.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.878+0000 7f4d177fe700 1 --2- 172.21.15.62:0/250717484 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4d04053520 0x7f4d040559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:41.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.878+0000 7f4d177fe700 1 -- 172.21.15.62:0/250717484 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4d2006c6a0 con 0x7f4d281466f0 2021-12-17T18:18:41.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.878+0000 7f4d2659c700 1 --2- 172.21.15.62:0/250717484 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4d04053520 0x7f4d040559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:41.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.878+0000 7f4d2659c700 1 --2- 172.21.15.62:0/250717484 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4d04053520 0x7f4d040559e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f4d1c00d000 tx=0x7f4d1c001ab0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:41.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:41.882+0000 7f4d177fe700 1 -- 172.21.15.62:0/250717484 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4d20043670 con 0x7f4d281466f0 2021-12-17T18:18:42.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.010+0000 7f4d2759e700 1 -- 172.21.15.62:0/250717484 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4d280573d0 con 0x7f4d281466f0 2021-12-17T18:18:42.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.010+0000 7f4d177fe700 1 -- 172.21.15.62:0/250717484 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4d20015020 con 0x7f4d281466f0 2021-12-17T18:18:42.014 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:42.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.010+0000 7f4d2759e700 1 -- 172.21.15.62:0/250717484 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4d04053520 msgr2=0x7f4d040559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.010+0000 7f4d2759e700 1 --2- 172.21.15.62:0/250717484 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4d04053520 0x7f4d040559e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f4d1c00d000 tx=0x7f4d1c001ab0).stop 2021-12-17T18:18:42.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.010+0000 7f4d2759e700 1 -- 172.21.15.62:0/250717484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d281466f0 msgr2=0x7f4d28066760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.010+0000 7f4d2759e700 1 --2- 172.21.15.62:0/250717484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d281466f0 0x7f4d28066760 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f4d1c001110 tx=0x7f4d20016000).stop 2021-12-17T18:18:42.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.010+0000 7f4d2759e700 1 -- 172.21.15.62:0/250717484 shutdown_connections 2021-12-17T18:18:42.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.010+0000 7f4d2759e700 1 --2- 172.21.15.62:0/250717484 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4d04053520 0x7f4d040559e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.010+0000 7f4d2759e700 1 --2- 172.21.15.62:0/250717484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d281466f0 0x7f4d28066760 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.010+0000 7f4d2759e700 1 --2- 172.21.15.62:0/250717484 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4d280b17e0 0x7f4d2813f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.010+0000 7f4d2759e700 1 --2- 172.21.15.62:0/250717484 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4d2805ca90 0x7f4d280b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.010+0000 7f4d2759e700 1 -- 172.21.15.62:0/250717484 >> 172.21.15.62:0/250717484 conn(0x7f4d2805be70 msgr2=0x7f4d280b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:42.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.010+0000 7f4d2759e700 1 -- 172.21.15.62:0/250717484 shutdown_connections 2021-12-17T18:18:42.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.010+0000 7f4d2759e700 1 -- 172.21.15.62:0/250717484 wait complete. 2021-12-17T18:18:42.027 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:18:42.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.130+0000 7f3876ff0700 1 Processor -- start 2021-12-17T18:18:42.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.130+0000 7f3876ff0700 1 -- start start 2021-12-17T18:18:42.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.130+0000 7f3876ff0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f38700b5dd0 0x7f3870146da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.130+0000 7f3876ff0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38700b2010 con 0x7f38700b05b0 2021-12-17T18:18:42.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.130+0000 7f3876ff0700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38700b0990 con 0x7f38700b41f0 2021-12-17T18:18:42.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.130+0000 7f3876ff0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3870147290 con 0x7f38700b5dd0 2021-12-17T18:18:42.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.130+0000 7f386ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f38700b5dd0 0x7f3870146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.130+0000 7f386ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f38700b5dd0 0x7f3870146da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48652/0 (socket says 172.21.15.62:48652) 2021-12-17T18:18:42.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.130+0000 7f386ffff700 1 -- 172.21.15.62:0/3688033873 learned_addr learned my addr 172.21.15.62:0/3688033873 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:42.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.130+0000 7f3874d8c700 1 --1- 172.21.15.62:0/3688033873 >> v1:172.21.15.62:6789/0 conn(0x7f38700b05b0 0x7f3870146690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60462/0 (socket says 172.21.15.62:60462) 2021-12-17T18:18:42.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.134+0000 7f386ffff700 1 -- 172.21.15.62:0/3688033873 >> v1:172.21.15.109:6789/0 conn(0x7f38700b41f0 legacy=0x7f3870141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.134+0000 7f386ffff700 1 -- 172.21.15.62:0/3688033873 >> v1:172.21.15.62:6789/0 conn(0x7f38700b05b0 legacy=0x7f3870146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.134+0000 7f386ffff700 1 -- 172.21.15.62:0/3688033873 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38700b2240 con 0x7f38700b5dd0 2021-12-17T18:18:42.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.134+0000 7f386ffff700 1 --2- 172.21.15.62:0/3688033873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38700b5dd0 0x7f3870146da0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f38700b15f0 tx=0x7f3864006eb0).ready entity=mon.0 client_cookie=ddedc8e8548e80d7 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:42.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.134+0000 7f386f7fe700 1 -- 172.21.15.62:0/3688033873 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f386400d660 con 0x7f38700b5dd0 2021-12-17T18:18:42.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.134+0000 7f386f7fe700 1 -- 172.21.15.62:0/3688033873 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3864000e90 con 0x7f38700b5dd0 2021-12-17T18:18:42.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.134+0000 7f386f7fe700 1 -- 172.21.15.62:0/3688033873 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f386400d9f0 con 0x7f38700b5dd0 2021-12-17T18:18:42.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.134+0000 7f3876ff0700 1 -- 172.21.15.62:0/3688033873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38700b5dd0 msgr2=0x7f3870146da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.134+0000 7f3876ff0700 1 --2- 172.21.15.62:0/3688033873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38700b5dd0 0x7f3870146da0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f38700b15f0 tx=0x7f3864006eb0).stop 2021-12-17T18:18:42.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.134+0000 7f3876ff0700 1 -- 172.21.15.62:0/3688033873 shutdown_connections 2021-12-17T18:18:42.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.134+0000 7f3876ff0700 1 --2- 172.21.15.62:0/3688033873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38700b5dd0 0x7f3870146da0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.134+0000 7f3876ff0700 1 -- 172.21.15.62:0/3688033873 >> 172.21.15.62:0/3688033873 conn(0x7f3870062510 msgr2=0x7f38700628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:42.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.134+0000 7f3876ff0700 1 -- 172.21.15.62:0/3688033873 shutdown_connections 2021-12-17T18:18:42.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.134+0000 7f3876ff0700 1 -- 172.21.15.62:0/3688033873 wait complete. 2021-12-17T18:18:42.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.134+0000 7f3876ff0700 1 Processor -- start 2021-12-17T18:18:42.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.134+0000 7f3876ff0700 1 -- start start 2021-12-17T18:18:42.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f3876ff0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38700b05b0 0x7f38700a3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f3876ff0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38700b41f0 0x7f3870155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f3876ff0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38700b5dd0 0x7f3870156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f3876ff0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3870067480 con 0x7f38700b05b0 2021-12-17T18:18:42.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f3876ff0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38700a4f90 con 0x7f38700b41f0 2021-12-17T18:18:42.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f3876ff0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38700a5230 con 0x7f38700b5dd0 2021-12-17T18:18:42.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f3874d8c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38700b05b0 0x7f38700a3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f3874d8c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38700b05b0 0x7f38700a3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48656/0 (socket says 172.21.15.62:48656) 2021-12-17T18:18:42.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f3874d8c700 1 -- 172.21.15.62:0/779860007 learned_addr learned my addr 172.21.15.62:0/779860007 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:42.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f386ffff700 1 --2- 172.21.15.62:0/779860007 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38700b41f0 0x7f3870155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f387558d700 1 --2- 172.21.15.62:0/779860007 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38700b5dd0 0x7f3870156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f3874d8c700 1 -- 172.21.15.62:0/779860007 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38700b5dd0 msgr2=0x7f3870156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f3874d8c700 1 --2- 172.21.15.62:0/779860007 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38700b5dd0 0x7f3870156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f3874d8c700 1 -- 172.21.15.62:0/779860007 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38700b41f0 msgr2=0x7f3870155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f3874d8c700 1 --2- 172.21.15.62:0/779860007 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38700b41f0 0x7f3870155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f3874d8c700 1 -- 172.21.15.62:0/779860007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386400b1e0 con 0x7f38700b05b0 2021-12-17T18:18:42.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f386ffff700 1 --2- 172.21.15.62:0/779860007 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38700b41f0 0x7f3870155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:42.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f3874d8c700 1 --2- 172.21.15.62:0/779860007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38700b05b0 0x7f38700a3120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f38700ba230 tx=0x7f3860007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:42.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f386dffb700 1 -- 172.21.15.62:0/779860007 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f386000ce30 con 0x7f38700b05b0 2021-12-17T18:18:42.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f386dffb700 1 -- 172.21.15.62:0/779860007 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38600072e0 con 0x7f38700b05b0 2021-12-17T18:18:42.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f3876ff0700 1 -- 172.21.15.62:0/779860007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38700a54d0 con 0x7f38700b05b0 2021-12-17T18:18:42.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f386dffb700 1 -- 172.21.15.62:0/779860007 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3860007450 con 0x7f38700b05b0 2021-12-17T18:18:42.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.138+0000 7f3876ff0700 1 -- 172.21.15.62:0/779860007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38700a4d10 con 0x7f38700b05b0 2021-12-17T18:18:42.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.142+0000 7f386dffb700 1 -- 172.21.15.62:0/779860007 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f386001a070 con 0x7f38700b05b0 2021-12-17T18:18:42.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.142+0000 7f3876ff0700 1 -- 172.21.15.62:0/779860007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3870066070 con 0x7f38700b05b0 2021-12-17T18:18:42.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.142+0000 7f386dffb700 1 --2- 172.21.15.62:0/779860007 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38500534f0 0x7f38500559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.142+0000 7f386dffb700 1 -- 172.21.15.62:0/779860007 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f386006acb0 con 0x7f38700b05b0 2021-12-17T18:18:42.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.142+0000 7f386ffff700 1 --2- 172.21.15.62:0/779860007 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38500534f0 0x7f38500559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.142+0000 7f386ffff700 1 --2- 172.21.15.62:0/779860007 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38500534f0 0x7f38500559b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f3864019000 tx=0x7f3864015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:42.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.150+0000 7f386dffb700 1 -- 172.21.15.62:0/779860007 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3870066070 con 0x7f38700b05b0 2021-12-17T18:18:42.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.274+0000 7f3876ff0700 1 -- 172.21.15.62:0/779860007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3870066070 con 0x7f38700b05b0 2021-12-17T18:18:42.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.274+0000 7f386dffb700 1 -- 172.21.15.62:0/779860007 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3870066070 con 0x7f38700b05b0 2021-12-17T18:18:42.280 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:42.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.278+0000 7f3876ff0700 1 -- 172.21.15.62:0/779860007 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38500534f0 msgr2=0x7f38500559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.278+0000 7f3876ff0700 1 --2- 172.21.15.62:0/779860007 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38500534f0 0x7f38500559b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f3864019000 tx=0x7f3864015000).stop 2021-12-17T18:18:42.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.278+0000 7f3876ff0700 1 -- 172.21.15.62:0/779860007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38700b05b0 msgr2=0x7f38700a3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.278+0000 7f3876ff0700 1 --2- 172.21.15.62:0/779860007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38700b05b0 0x7f38700a3120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f38700ba230 tx=0x7f3860007c40).stop 2021-12-17T18:18:42.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.278+0000 7f3876ff0700 1 -- 172.21.15.62:0/779860007 shutdown_connections 2021-12-17T18:18:42.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.278+0000 7f3876ff0700 1 --2- 172.21.15.62:0/779860007 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38500534f0 0x7f38500559b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.278+0000 7f3876ff0700 1 --2- 172.21.15.62:0/779860007 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38700b5dd0 0x7f3870156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.278+0000 7f3876ff0700 1 --2- 172.21.15.62:0/779860007 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38700b41f0 0x7f3870155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.278+0000 7f3876ff0700 1 --2- 172.21.15.62:0/779860007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38700b05b0 0x7f38700a3120 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.278+0000 7f3876ff0700 1 -- 172.21.15.62:0/779860007 >> 172.21.15.62:0/779860007 conn(0x7f3870062510 msgr2=0x7f38700b99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:42.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.278+0000 7f3876ff0700 1 -- 172.21.15.62:0/779860007 shutdown_connections 2021-12-17T18:18:42.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.278+0000 7f3876ff0700 1 -- 172.21.15.62:0/779860007 wait complete. 2021-12-17T18:18:42.293 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:18:42.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.398+0000 7f0ad237e700 1 Processor -- start 2021-12-17T18:18:42.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0ad237e700 1 -- start start 2021-12-17T18:18:42.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0ad237e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f0acc05c750 0x7f0acc05cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0ad237e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0acc146f70 0x7f0acc0b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0ad237e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc142ff0 con 0x7f0acc060260 2021-12-17T18:18:42.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0ad237e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0acc1473e0 con 0x7f0acc05c750 2021-12-17T18:18:42.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0ad237e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc143290 con 0x7f0acc146f70 2021-12-17T18:18:42.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0ad091b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0acc146f70 0x7f0acc0b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0acbfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f0acc05c750 0x7f0acc05cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0ad091b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0acc146f70 0x7f0acc0b4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:42366/0 (socket says 172.21.15.62:42366) 2021-12-17T18:18:42.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0ad091b700 1 -- 172.21.15.62:0/2954143534 learned_addr learned my addr 172.21.15.62:0/2954143534 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:42.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0acbfff700 1 -- 172.21.15.62:0/2954143534 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0acc146f70 msgr2=0x7f0acc0b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:42.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0acbfff700 1 --2- 172.21.15.62:0/2954143534 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0acc146f70 0x7f0acc0b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0acbfff700 1 -- 172.21.15.62:0/2954143534 >> v1:172.21.15.109:6789/0 conn(0x7f0acc060260 legacy=0x7f0acc1439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0acbfff700 1 -- 172.21.15.62:0/2954143534 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc143530 con 0x7f0acc05c750 2021-12-17T18:18:42.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0acbfff700 1 --2- 172.21.15.62:0/2954143534 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0acc05c750 0x7f0acc05cb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f0abc002f70 tx=0x7f0abc006df0).ready entity=mon.1 client_cookie=4290500116a8ee2a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:42.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0acaffd700 1 -- 172.21.15.62:0/2954143534 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0abc00d570 con 0x7f0acc05c750 2021-12-17T18:18:42.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0acaffd700 1 -- 172.21.15.62:0/2954143534 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc000e90 con 0x7f0acc05c750 2021-12-17T18:18:42.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.402+0000 7f0acaffd700 1 -- 172.21.15.62:0/2954143534 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0abc00d8c0 con 0x7f0acc05c750 2021-12-17T18:18:42.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad237e700 1 -- 172.21.15.62:0/2954143534 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0acc05c750 msgr2=0x7f0acc05cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad237e700 1 --2- 172.21.15.62:0/2954143534 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0acc05c750 0x7f0acc05cb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f0abc002f70 tx=0x7f0abc006df0).stop 2021-12-17T18:18:42.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad237e700 1 -- 172.21.15.62:0/2954143534 shutdown_connections 2021-12-17T18:18:42.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad237e700 1 --2- 172.21.15.62:0/2954143534 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0acc146f70 0x7f0acc0b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad237e700 1 --2- 172.21.15.62:0/2954143534 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0acc05c750 0x7f0acc05cb30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad237e700 1 -- 172.21.15.62:0/2954143534 >> 172.21.15.62:0/2954143534 conn(0x7f0acc062430 msgr2=0x7f0acc062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:42.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad237e700 1 -- 172.21.15.62:0/2954143534 shutdown_connections 2021-12-17T18:18:42.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad237e700 1 -- 172.21.15.62:0/2954143534 wait complete. 2021-12-17T18:18:42.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad237e700 1 Processor -- start 2021-12-17T18:18:42.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad237e700 1 -- start start 2021-12-17T18:18:42.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad237e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0acc05c750 0x7f0acc065f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad237e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0acc060260 0x7f0acc0663f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad237e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0acc146f70 0x7f0acc0636a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad237e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0668e0 con 0x7f0acc146f70 2021-12-17T18:18:42.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad237e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc140120 con 0x7f0acc05c750 2021-12-17T18:18:42.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad237e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc066b70 con 0x7f0acc060260 2021-12-17T18:18:42.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad091b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0acc146f70 0x7f0acc0636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad091b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0acc146f70 0x7f0acc0636a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48674/0 (socket says 172.21.15.62:48674) 2021-12-17T18:18:42.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad091b700 1 -- 172.21.15.62:0/515330760 learned_addr learned my addr 172.21.15.62:0/515330760 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:42.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0acb7fe700 1 --2- 172.21.15.62:0/515330760 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0acc060260 0x7f0acc0663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0acbfff700 1 --2- 172.21.15.62:0/515330760 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0acc05c750 0x7f0acc065f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad091b700 1 -- 172.21.15.62:0/515330760 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0acc060260 msgr2=0x7f0acc0663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad091b700 1 --2- 172.21.15.62:0/515330760 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0acc060260 0x7f0acc0663f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad091b700 1 -- 172.21.15.62:0/515330760 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0acc05c750 msgr2=0x7f0acc065f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad091b700 1 --2- 172.21.15.62:0/515330760 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0acc05c750 0x7f0acc065f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0ad091b700 1 -- 172.21.15.62:0/515330760 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc00b180 con 0x7f0acc146f70 2021-12-17T18:18:42.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.406+0000 7f0acbfff700 1 --2- 172.21.15.62:0/515330760 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0acc05c750 0x7f0acc065f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:42.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.410+0000 7f0ad091b700 1 --2- 172.21.15.62:0/515330760 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0acc146f70 0x7f0acc0636a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f0ac400c000 tx=0x7f0ac4009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:42.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.410+0000 7f0ac97fa700 1 -- 172.21.15.62:0/515330760 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ac4012600 con 0x7f0acc146f70 2021-12-17T18:18:42.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.410+0000 7f0ac97fa700 1 -- 172.21.15.62:0/515330760 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac4012760 con 0x7f0acc146f70 2021-12-17T18:18:42.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.410+0000 7f0ad237e700 1 -- 172.21.15.62:0/515330760 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0acc13f1a0 con 0x7f0acc146f70 2021-12-17T18:18:42.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.410+0000 7f0ac97fa700 1 -- 172.21.15.62:0/515330760 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ac4012ac0 con 0x7f0acc146f70 2021-12-17T18:18:42.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.410+0000 7f0ad237e700 1 -- 172.21.15.62:0/515330760 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0acc13fea0 con 0x7f0acc146f70 2021-12-17T18:18:42.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.410+0000 7f0ac97fa700 1 -- 172.21.15.62:0/515330760 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0ac4022070 con 0x7f0acc146f70 2021-12-17T18:18:42.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.410+0000 7f0ad237e700 1 -- 172.21.15.62:0/515330760 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0acc066d30 con 0x7f0acc146f70 2021-12-17T18:18:42.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.410+0000 7f0ac97fa700 1 --2- 172.21.15.62:0/515330760 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0aac0536a0 0x7f0aac055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.410+0000 7f0ac97fa700 1 -- 172.21.15.62:0/515330760 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0ac406bf00 con 0x7f0acc146f70 2021-12-17T18:18:42.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.410+0000 7f0acbfff700 1 --2- 172.21.15.62:0/515330760 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0aac0536a0 0x7f0aac055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.410+0000 7f0acbfff700 1 --2- 172.21.15.62:0/515330760 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0aac0536a0 0x7f0aac055b60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f0abc018000 tx=0x7f0abc014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:42.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.418+0000 7f0ac97fa700 1 -- 172.21.15.62:0/515330760 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0ac4043060 con 0x7f0acc146f70 2021-12-17T18:18:42.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.546+0000 7f0ad237e700 1 -- 172.21.15.62:0/515330760 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0acc0b7040 con 0x7f0acc146f70 2021-12-17T18:18:42.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.550+0000 7f0ac97fa700 1 -- 172.21.15.62:0/515330760 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0ac40160a0 con 0x7f0acc146f70 2021-12-17T18:18:42.553 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:42.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.550+0000 7f0ad237e700 1 -- 172.21.15.62:0/515330760 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0aac0536a0 msgr2=0x7f0aac055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.550+0000 7f0ad237e700 1 --2- 172.21.15.62:0/515330760 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0aac0536a0 0x7f0aac055b60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f0abc018000 tx=0x7f0abc014000).stop 2021-12-17T18:18:42.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.550+0000 7f0ad237e700 1 -- 172.21.15.62:0/515330760 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0acc146f70 msgr2=0x7f0acc0636a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.550+0000 7f0ad237e700 1 --2- 172.21.15.62:0/515330760 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0acc146f70 0x7f0acc0636a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f0ac400c000 tx=0x7f0ac4009290).stop 2021-12-17T18:18:42.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.550+0000 7f0ad237e700 1 -- 172.21.15.62:0/515330760 shutdown_connections 2021-12-17T18:18:42.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.550+0000 7f0ad237e700 1 --2- 172.21.15.62:0/515330760 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0aac0536a0 0x7f0aac055b60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.550+0000 7f0ad237e700 1 --2- 172.21.15.62:0/515330760 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0acc146f70 0x7f0acc0636a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.550+0000 7f0ad237e700 1 --2- 172.21.15.62:0/515330760 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0acc060260 0x7f0acc0663f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.550+0000 7f0ad237e700 1 --2- 172.21.15.62:0/515330760 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0acc05c750 0x7f0acc065f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.550+0000 7f0ad237e700 1 -- 172.21.15.62:0/515330760 >> 172.21.15.62:0/515330760 conn(0x7f0acc062430 msgr2=0x7f0acc0b53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:42.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.550+0000 7f0ad237e700 1 -- 172.21.15.62:0/515330760 shutdown_connections 2021-12-17T18:18:42.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.550+0000 7f0ad237e700 1 -- 172.21.15.62:0/515330760 wait complete. 2021-12-17T18:18:42.566 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:42.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0342c32700 1 Processor -- start 2021-12-17T18:18:42.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0342c32700 1 -- start start 2021-12-17T18:18:42.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0342c32700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f033c0b5c80 0x7f033c0b6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0342c32700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f033c13fb60 0x7f033c143280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0342c32700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033c0b1540 con 0x7f033c0afcf0 2021-12-17T18:18:42.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0342c32700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033c13ffd0 con 0x7f033c13fb60 2021-12-17T18:18:42.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0342c32700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033c0b0140 con 0x7f033c0b5c80 2021-12-17T18:18:42.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0342431700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f033c13fb60 0x7f033c143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0341c30700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f033c0b5c80 0x7f033c0b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0342431700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f033c13fb60 0x7f033c143280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48682/0 (socket says 172.21.15.62:48682) 2021-12-17T18:18:42.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0342431700 1 -- 172.21.15.62:0/4235810830 learned_addr learned my addr 172.21.15.62:0/4235810830 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:42.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0342431700 1 -- 172.21.15.62:0/4235810830 >> v2:172.21.15.109:3300/0 conn(0x7f033c0b5c80 msgr2=0x7f033c0b6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:42.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0342431700 1 --2- 172.21.15.62:0/4235810830 >> v2:172.21.15.109:3300/0 conn(0x7f033c0b5c80 0x7f033c0b6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0342431700 1 -- 172.21.15.62:0/4235810830 >> v1:172.21.15.109:6789/0 conn(0x7f033c0afcf0 legacy=0x7f033c142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0342431700 1 -- 172.21.15.62:0/4235810830 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c0af5b0 con 0x7f033c13fb60 2021-12-17T18:18:42.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0341c30700 1 --2- 172.21.15.62:0/4235810830 >> v2:172.21.15.109:3300/0 conn(0x7f033c0b5c80 0x7f033c0b6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:42.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0342431700 1 --2- 172.21.15.62:0/4235810830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f033c13fb60 0x7f033c143280 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f0338002f70 tx=0x7f0338006eb0).ready entity=mon.0 client_cookie=47696124912d11e6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:42.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0340c2e700 1 -- 172.21.15.62:0/4235810830 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033800d5c0 con 0x7f033c13fb60 2021-12-17T18:18:42.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0340c2e700 1 -- 172.21.15.62:0/4235810830 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0338000e90 con 0x7f033c13fb60 2021-12-17T18:18:42.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.670+0000 7f0340c2e700 1 -- 172.21.15.62:0/4235810830 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033800d950 con 0x7f033c13fb60 2021-12-17T18:18:42.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.674+0000 7f0342c32700 1 -- 172.21.15.62:0/4235810830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f033c13fb60 msgr2=0x7f033c143280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.674+0000 7f0342c32700 1 --2- 172.21.15.62:0/4235810830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f033c13fb60 0x7f033c143280 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f0338002f70 tx=0x7f0338006eb0).stop 2021-12-17T18:18:42.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.674+0000 7f0342c32700 1 -- 172.21.15.62:0/4235810830 shutdown_connections 2021-12-17T18:18:42.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.674+0000 7f0342c32700 1 --2- 172.21.15.62:0/4235810830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f033c13fb60 0x7f033c143280 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.674+0000 7f0342c32700 1 --2- 172.21.15.62:0/4235810830 >> v2:172.21.15.109:3300/0 conn(0x7f033c0b5c80 0x7f033c0b6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.674+0000 7f0342c32700 1 -- 172.21.15.62:0/4235810830 >> 172.21.15.62:0/4235810830 conn(0x7f033c05c750 msgr2=0x7f033c05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:42.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.674+0000 7f0342c32700 1 -- 172.21.15.62:0/4235810830 shutdown_connections 2021-12-17T18:18:42.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.674+0000 7f0342c32700 1 -- 172.21.15.62:0/4235810830 wait complete. 2021-12-17T18:18:42.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.674+0000 7f0342c32700 1 Processor -- start 2021-12-17T18:18:42.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.674+0000 7f0342c32700 1 -- start start 2021-12-17T18:18:42.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342c32700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f033c0afcf0 0x7f033c139a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342c32700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f033c0b5c80 0x7f033c0659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342c32700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f033c13fb60 0x7f033c150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342c32700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c153c00 con 0x7f033c13fb60 2021-12-17T18:18:42.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342c32700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c153ea0 con 0x7f033c0b5c80 2021-12-17T18:18:42.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342c32700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c154140 con 0x7f033c0afcf0 2021-12-17T18:18:42.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342431700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f033c13fb60 0x7f033c150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342431700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f033c13fb60 0x7f033c150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48688/0 (socket says 172.21.15.62:48688) 2021-12-17T18:18:42.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342431700 1 -- 172.21.15.62:0/4063247917 learned_addr learned my addr 172.21.15.62:0/4063247917 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:42.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0341c30700 1 --2- 172.21.15.62:0/4063247917 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f033c0afcf0 0x7f033c139a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f034142f700 1 --2- 172.21.15.62:0/4063247917 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f033c0b5c80 0x7f033c0659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342431700 1 -- 172.21.15.62:0/4063247917 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f033c0afcf0 msgr2=0x7f033c139a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342431700 1 --2- 172.21.15.62:0/4063247917 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f033c0afcf0 0x7f033c139a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342431700 1 -- 172.21.15.62:0/4063247917 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f033c0b5c80 msgr2=0x7f033c0659a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342431700 1 --2- 172.21.15.62:0/4063247917 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f033c0b5c80 0x7f033c0659a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342431700 1 -- 172.21.15.62:0/4063247917 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033000b180 con 0x7f033c13fb60 2021-12-17T18:18:42.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342431700 1 --2- 172.21.15.62:0/4063247917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f033c13fb60 0x7f033c150330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f0338002f70 tx=0x7f0338015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:42.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f032effd700 1 -- 172.21.15.62:0/4063247917 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0338011760 con 0x7f033c13fb60 2021-12-17T18:18:42.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f032effd700 1 -- 172.21.15.62:0/4063247917 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03380118c0 con 0x7f033c13fb60 2021-12-17T18:18:42.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342c32700 1 -- 172.21.15.62:0/4063247917 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033800b1e0 con 0x7f033c13fb60 2021-12-17T18:18:42.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f032effd700 1 -- 172.21.15.62:0/4063247917 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0338011c20 con 0x7f033c13fb60 2021-12-17T18:18:42.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342c32700 1 -- 172.21.15.62:0/4063247917 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033c153880 con 0x7f033c13fb60 2021-12-17T18:18:42.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f0342c32700 1 -- 172.21.15.62:0/4063247917 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033c153a70 con 0x7f033c13fb60 2021-12-17T18:18:42.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.678+0000 7f032effd700 1 -- 172.21.15.62:0/4063247917 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0338025030 con 0x7f033c13fb60 2021-12-17T18:18:42.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.682+0000 7f032effd700 1 --2- 172.21.15.62:0/4063247917 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f031c053580 0x7f031c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.682+0000 7f032effd700 1 -- 172.21.15.62:0/4063247917 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f033806cad0 con 0x7f033c13fb60 2021-12-17T18:18:42.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.682+0000 7f0341c30700 1 --2- 172.21.15.62:0/4063247917 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f031c053580 0x7f031c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.682+0000 7f0341c30700 1 --2- 172.21.15.62:0/4063247917 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f031c053580 0x7f031c055a40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f033000b000 tx=0x7f0330008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:42.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.690+0000 7f032effd700 1 -- 172.21.15.62:0/4063247917 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0338043c30 con 0x7f033c13fb60 2021-12-17T18:18:42.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.818+0000 7f0342c32700 1 -- 172.21.15.62:0/4063247917 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f033c154300 con 0x7f033c13fb60 2021-12-17T18:18:42.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.822+0000 7f032effd700 1 -- 172.21.15.62:0/4063247917 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f0338023020 con 0x7f033c13fb60 2021-12-17T18:18:42.825 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:42.825 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:20.178383+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:17.128555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:18.180577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:42.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.822+0000 7f0342c32700 1 -- 172.21.15.62:0/4063247917 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f031c053580 msgr2=0x7f031c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.822+0000 7f0342c32700 1 --2- 172.21.15.62:0/4063247917 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f031c053580 0x7f031c055a40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f033000b000 tx=0x7f0330008040).stop 2021-12-17T18:18:42.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.822+0000 7f0342c32700 1 -- 172.21.15.62:0/4063247917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f033c13fb60 msgr2=0x7f033c150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.822+0000 7f0342c32700 1 --2- 172.21.15.62:0/4063247917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f033c13fb60 0x7f033c150330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f0338002f70 tx=0x7f0338015000).stop 2021-12-17T18:18:42.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.822+0000 7f0342c32700 1 -- 172.21.15.62:0/4063247917 shutdown_connections 2021-12-17T18:18:42.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.822+0000 7f0342c32700 1 --2- 172.21.15.62:0/4063247917 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f031c053580 0x7f031c055a40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.822+0000 7f0342c32700 1 --2- 172.21.15.62:0/4063247917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f033c13fb60 0x7f033c150330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.822+0000 7f0342c32700 1 --2- 172.21.15.62:0/4063247917 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f033c0b5c80 0x7f033c0659a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.822+0000 7f0342c32700 1 --2- 172.21.15.62:0/4063247917 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f033c0afcf0 0x7f033c139a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.822+0000 7f0342c32700 1 -- 172.21.15.62:0/4063247917 >> 172.21.15.62:0/4063247917 conn(0x7f033c05c750 msgr2=0x7f033c0b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:42.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.822+0000 7f0342c32700 1 -- 172.21.15.62:0/4063247917 shutdown_connections 2021-12-17T18:18:42.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.822+0000 7f0342c32700 1 -- 172.21.15.62:0/4063247917 wait complete. 2021-12-17T18:18:42.838 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:18:17.128555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:18:18.180577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:18:42.839 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:18:42.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e33323700 1 Processor -- start 2021-12-17T18:18:42.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e33323700 1 -- start start 2021-12-17T18:18:42.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e33323700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f8e2c0b05b0 0x7f8e2c146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e33323700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8e2c0b41f0 0x7f8e2c141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e33323700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2c0b2010 con 0x7f8e2c0b5dd0 2021-12-17T18:18:42.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e33323700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2c0b0990 con 0x7f8e2c0b05b0 2021-12-17T18:18:42.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e33323700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c147290 con 0x7f8e2c0b41f0 2021-12-17T18:18:42.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e308be700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8e2c0b5dd0 0x7f8e2c146b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60504/0 (socket says 172.21.15.62:60504) 2021-12-17T18:18:42.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e308be700 1 -- 172.21.15.62:0/503026584 learned_addr learned my addr 172.21.15.62:0/503026584 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:42.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e318c0700 1 --2- 172.21.15.62:0/503026584 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8e2c0b41f0 0x7f8e2c141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e310bf700 1 --2- 172.21.15.62:0/503026584 >> v2:172.21.15.109:3300/0 conn(0x7f8e2c0b05b0 0x7f8e2c146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e1bfff700 1 -- 172.21.15.62:0/503026584 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037980835 0 0) 0x7f8e2c0b2010 con 0x7f8e2c0b5dd0 2021-12-17T18:18:42.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e1bfff700 1 -- 172.21.15.62:0/503026584 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e14003260 con 0x7f8e2c0b5dd0 2021-12-17T18:18:42.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e318c0700 1 -- 172.21.15.62:0/503026584 >> v2:172.21.15.109:3300/0 conn(0x7f8e2c0b05b0 msgr2=0x7f8e2c146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:42.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e318c0700 1 --2- 172.21.15.62:0/503026584 >> v2:172.21.15.109:3300/0 conn(0x7f8e2c0b05b0 0x7f8e2c146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e318c0700 1 -- 172.21.15.62:0/503026584 >> v1:172.21.15.62:6789/0 conn(0x7f8e2c0b5dd0 legacy=0x7f8e2c146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e318c0700 1 -- 172.21.15.62:0/503026584 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c0b2240 con 0x7f8e2c0b41f0 2021-12-17T18:18:42.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e310bf700 1 --2- 172.21.15.62:0/503026584 >> v2:172.21.15.109:3300/0 conn(0x7f8e2c0b05b0 0x7f8e2c146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:42.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e318c0700 1 --2- 172.21.15.62:0/503026584 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8e2c0b41f0 0x7f8e2c141fd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f8e240032f0 tx=0x7f8e240091d0).ready entity=mon.2 client_cookie=84bd3794b2256220 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:42.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e1bfff700 1 -- 172.21.15.62:0/503026584 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e2400b600 con 0x7f8e2c0b41f0 2021-12-17T18:18:42.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e1bfff700 1 -- 172.21.15.62:0/503026584 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2400b760 con 0x7f8e2c0b41f0 2021-12-17T18:18:42.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e1bfff700 1 -- 172.21.15.62:0/503026584 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e2400b8d0 con 0x7f8e2c0b41f0 2021-12-17T18:18:42.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e33323700 1 -- 172.21.15.62:0/503026584 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8e2c0b41f0 msgr2=0x7f8e2c141fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e33323700 1 --2- 172.21.15.62:0/503026584 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8e2c0b41f0 0x7f8e2c141fd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f8e240032f0 tx=0x7f8e240091d0).stop 2021-12-17T18:18:42.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e33323700 1 -- 172.21.15.62:0/503026584 shutdown_connections 2021-12-17T18:18:42.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e33323700 1 --2- 172.21.15.62:0/503026584 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8e2c0b41f0 0x7f8e2c141fd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e33323700 1 --2- 172.21.15.62:0/503026584 >> v2:172.21.15.109:3300/0 conn(0x7f8e2c0b05b0 0x7f8e2c146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.950+0000 7f8e33323700 1 -- 172.21.15.62:0/503026584 >> 172.21.15.62:0/503026584 conn(0x7f8e2c062510 msgr2=0x7f8e2c0628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:42.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e33323700 1 -- 172.21.15.62:0/503026584 shutdown_connections 2021-12-17T18:18:42.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e33323700 1 -- 172.21.15.62:0/503026584 wait complete. 2021-12-17T18:18:42.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e33323700 1 Processor -- start 2021-12-17T18:18:42.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e33323700 1 -- start start 2021-12-17T18:18:42.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e33323700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e2c0b05b0 0x7f8e2c1438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e33323700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8e2c0b41f0 0x7f8e2c1558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e33323700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8e2c0b5dd0 0x7f8e2c152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e33323700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c064760 con 0x7f8e2c0b05b0 2021-12-17T18:18:42.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e33323700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c155d90 con 0x7f8e2c0b5dd0 2021-12-17T18:18:42.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e33323700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c0644c0 con 0x7f8e2c0b41f0 2021-12-17T18:18:42.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e310bf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e2c0b05b0 0x7f8e2c1438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e310bf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e2c0b05b0 0x7f8e2c1438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48696/0 (socket says 172.21.15.62:48696) 2021-12-17T18:18:42.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e310bf700 1 -- 172.21.15.62:0/2787348601 learned_addr learned my addr 172.21.15.62:0/2787348601 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:42.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e318c0700 1 --2- 172.21.15.62:0/2787348601 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8e2c0b5dd0 0x7f8e2c152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e308be700 1 --2- 172.21.15.62:0/2787348601 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8e2c0b41f0 0x7f8e2c1558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e310bf700 1 -- 172.21.15.62:0/2787348601 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8e2c0b41f0 msgr2=0x7f8e2c1558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e310bf700 1 --2- 172.21.15.62:0/2787348601 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8e2c0b41f0 0x7f8e2c1558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e310bf700 1 -- 172.21.15.62:0/2787348601 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8e2c0b5dd0 msgr2=0x7f8e2c152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:42.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e310bf700 1 --2- 172.21.15.62:0/2787348601 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8e2c0b5dd0 0x7f8e2c152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:42.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e310bf700 1 -- 172.21.15.62:0/2787348601 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2800b180 con 0x7f8e2c0b05b0 2021-12-17T18:18:42.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e318c0700 1 --2- 172.21.15.62:0/2787348601 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8e2c0b5dd0 0x7f8e2c152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:42.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.954+0000 7f8e310bf700 1 --2- 172.21.15.62:0/2787348601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e2c0b05b0 0x7f8e2c1438c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f8e2800c000 tx=0x7f8e28006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:42.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.958+0000 7f8e1a7fc700 1 -- 172.21.15.62:0/2787348601 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e28010780 con 0x7f8e2c0b05b0 2021-12-17T18:18:42.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.958+0000 7f8e1a7fc700 1 -- 172.21.15.62:0/2787348601 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e280108e0 con 0x7f8e2c0b05b0 2021-12-17T18:18:42.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.958+0000 7f8e33323700 1 -- 172.21.15.62:0/2787348601 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e24009470 con 0x7f8e2c0b05b0 2021-12-17T18:18:42.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.958+0000 7f8e1a7fc700 1 -- 172.21.15.62:0/2787348601 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e28010c40 con 0x7f8e2c0b05b0 2021-12-17T18:18:42.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.958+0000 7f8e33323700 1 -- 172.21.15.62:0/2787348601 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2c145780 con 0x7f8e2c0b05b0 2021-12-17T18:18:42.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.958+0000 7f8e1a7fc700 1 -- 172.21.15.62:0/2787348601 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8e2801c460 con 0x7f8e2c0b05b0 2021-12-17T18:18:42.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.958+0000 7f8e33323700 1 -- 172.21.15.62:0/2787348601 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2c13ea50 con 0x7f8e2c0b05b0 2021-12-17T18:18:42.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.958+0000 7f8e1a7fc700 1 --2- 172.21.15.62:0/2787348601 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8e0c053580 0x7f8e0c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:42.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.958+0000 7f8e1a7fc700 1 -- 172.21.15.62:0/2787348601 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8e2806bdf0 con 0x7f8e2c0b05b0 2021-12-17T18:18:42.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.958+0000 7f8e308be700 1 --2- 172.21.15.62:0/2787348601 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8e0c053580 0x7f8e0c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:42.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.958+0000 7f8e308be700 1 --2- 172.21.15.62:0/2787348601 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8e0c053580 0x7f8e0c055a40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f8e1c00d000 tx=0x7f8e1c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:42.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:42.966+0000 7f8e1a7fc700 1 -- 172.21.15.62:0/2787348601 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8e2c13ea50 con 0x7f8e2c0b05b0 2021-12-17T18:18:43.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.094+0000 7f8e33323700 1 -- 172.21.15.62:0/2787348601 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8e2c13ea50 con 0x7f8e2c0b05b0 2021-12-17T18:18:43.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.094+0000 7f8e1a7fc700 1 -- 172.21.15.62:0/2787348601 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8e2c13ea50 con 0x7f8e2c0b05b0 2021-12-17T18:18:43.099 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:18:43.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.098+0000 7f8e33323700 1 -- 172.21.15.62:0/2787348601 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8e0c053580 msgr2=0x7f8e0c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.098+0000 7f8e33323700 1 --2- 172.21.15.62:0/2787348601 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8e0c053580 0x7f8e0c055a40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f8e1c00d000 tx=0x7f8e1c009040).stop 2021-12-17T18:18:43.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.098+0000 7f8e33323700 1 -- 172.21.15.62:0/2787348601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e2c0b05b0 msgr2=0x7f8e2c1438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.098+0000 7f8e33323700 1 --2- 172.21.15.62:0/2787348601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e2c0b05b0 0x7f8e2c1438c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f8e2800c000 tx=0x7f8e28006df0).stop 2021-12-17T18:18:43.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.098+0000 7f8e33323700 1 -- 172.21.15.62:0/2787348601 shutdown_connections 2021-12-17T18:18:43.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.098+0000 7f8e33323700 1 --2- 172.21.15.62:0/2787348601 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8e0c053580 0x7f8e0c055a40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.098+0000 7f8e33323700 1 --2- 172.21.15.62:0/2787348601 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8e2c0b5dd0 0x7f8e2c152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.098+0000 7f8e33323700 1 --2- 172.21.15.62:0/2787348601 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8e2c0b41f0 0x7f8e2c1558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.098+0000 7f8e33323700 1 --2- 172.21.15.62:0/2787348601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e2c0b05b0 0x7f8e2c1438c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.098+0000 7f8e33323700 1 -- 172.21.15.62:0/2787348601 >> 172.21.15.62:0/2787348601 conn(0x7f8e2c062510 msgr2=0x7f8e2c0b97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:43.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.098+0000 7f8e33323700 1 -- 172.21.15.62:0/2787348601 shutdown_connections 2021-12-17T18:18:43.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.098+0000 7f8e33323700 1 -- 172.21.15.62:0/2787348601 wait complete. 2021-12-17T18:18:43.117 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:18:43.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.218+0000 7f640b59e700 1 Processor -- start 2021-12-17T18:18:43.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.218+0000 7f640b59e700 1 -- start start 2021-12-17T18:18:43.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f640c0af5f0 0x7f640c14c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:43.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c05bff0 con 0x7f640c0af160 2021-12-17T18:18:43.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640b59e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c063bb0 con 0x7f640c13e420 2021-12-17T18:18:43.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640c144a30 con 0x7f640c0af5f0 2021-12-17T18:18:43.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640ad9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f640c0af5f0 0x7f640c14c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:43.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640ad9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f640c0af5f0 0x7f640c14c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48708/0 (socket says 172.21.15.62:48708) 2021-12-17T18:18:43.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640ad9d700 1 -- 172.21.15.62:0/2398107434 learned_addr learned my addr 172.21.15.62:0/2398107434 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:43.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640ad9d700 1 -- 172.21.15.62:0/2398107434 >> v1:172.21.15.109:6789/0 conn(0x7f640c13e420 legacy=0x7f640c144320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640ad9d700 1 -- 172.21.15.62:0/2398107434 >> v1:172.21.15.62:6789/0 conn(0x7f640c0af160 legacy=0x7f640c063fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640ad9d700 1 -- 172.21.15.62:0/2398107434 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c13e800 con 0x7f640c0af5f0 2021-12-17T18:18:43.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640ad9d700 1 --2- 172.21.15.62:0/2398107434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f640c0af5f0 0x7f640c14c6d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f64040032f0 tx=0x7f6404009290).ready entity=mon.0 client_cookie=74b95e3718cd20df server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:43.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640959a700 1 -- 172.21.15.62:0/2398107434 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f640400b8a0 con 0x7f640c0af5f0 2021-12-17T18:18:43.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640959a700 1 -- 172.21.15.62:0/2398107434 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640400ba00 con 0x7f640c0af5f0 2021-12-17T18:18:43.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640959a700 1 -- 172.21.15.62:0/2398107434 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f640400bb70 con 0x7f640c0af5f0 2021-12-17T18:18:43.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640b59e700 1 -- 172.21.15.62:0/2398107434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f640c0af5f0 msgr2=0x7f640c14c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640b59e700 1 --2- 172.21.15.62:0/2398107434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f640c0af5f0 0x7f640c14c6d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f64040032f0 tx=0x7f6404009290).stop 2021-12-17T18:18:43.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640b59e700 1 -- 172.21.15.62:0/2398107434 shutdown_connections 2021-12-17T18:18:43.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640b59e700 1 --2- 172.21.15.62:0/2398107434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f640c0af5f0 0x7f640c14c6d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640b59e700 1 -- 172.21.15.62:0/2398107434 >> 172.21.15.62:0/2398107434 conn(0x7f640c05c750 msgr2=0x7f640c05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:43.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640b59e700 1 -- 172.21.15.62:0/2398107434 shutdown_connections 2021-12-17T18:18:43.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.222+0000 7f640b59e700 1 -- 172.21.15.62:0/2398107434 wait complete. 2021-12-17T18:18:43.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640b59e700 1 Processor -- start 2021-12-17T18:18:43.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640b59e700 1 -- start start 2021-12-17T18:18:43.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640b59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f640c0af160 0x7f640c154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:43.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f640c0af5f0 0x7f640c142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:43.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f640c13e420 0x7f640c1430e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:43.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c0642b0 con 0x7f640c0af5f0 2021-12-17T18:18:43.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640b59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c064eb0 con 0x7f640c0af160 2021-12-17T18:18:43.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640c154730 con 0x7f640c13e420 2021-12-17T18:18:43.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f6409d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f640c0af5f0 0x7f640c142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:43.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640a59c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f640c0af160 0x7f640c154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:43.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640a59c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f640c0af160 0x7f640c154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:55260/0 (socket says 172.21.15.62:55260) 2021-12-17T18:18:43.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640a59c700 1 -- 172.21.15.62:0/3848811353 learned_addr learned my addr 172.21.15.62:0/3848811353 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:43.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640ad9d700 1 --2- 172.21.15.62:0/3848811353 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f640c13e420 0x7f640c1430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:43.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640a59c700 1 -- 172.21.15.62:0/3848811353 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f640c13e420 msgr2=0x7f640c1430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640a59c700 1 --2- 172.21.15.62:0/3848811353 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f640c13e420 0x7f640c1430e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640a59c700 1 -- 172.21.15.62:0/3848811353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f640c0af5f0 msgr2=0x7f640c142bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640a59c700 1 --2- 172.21.15.62:0/3848811353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f640c0af5f0 0x7f640c142bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640a59c700 1 -- 172.21.15.62:0/3848811353 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6404009530 con 0x7f640c0af160 2021-12-17T18:18:43.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640a59c700 1 --2- 172.21.15.62:0/3848811353 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f640c0af160 0x7f640c154240 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f640c063f30 tx=0x7f63fc007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:43.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f63fb7fe700 1 -- 172.21.15.62:0/3848811353 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63fc00ce70 con 0x7f640c0af160 2021-12-17T18:18:43.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f63fb7fe700 1 -- 172.21.15.62:0/3848811353 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63fc012400 con 0x7f640c0af160 2021-12-17T18:18:43.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640b59e700 1 -- 172.21.15.62:0/3848811353 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640c064c10 con 0x7f640c0af160 2021-12-17T18:18:43.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f63fb7fe700 1 -- 172.21.15.62:0/3848811353 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63fc012760 con 0x7f640c0af160 2021-12-17T18:18:43.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.226+0000 7f640b59e700 1 -- 172.21.15.62:0/3848811353 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640c1435d0 con 0x7f640c0af160 2021-12-17T18:18:43.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.230+0000 7f640b59e700 1 -- 172.21.15.62:0/3848811353 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640c064100 con 0x7f640c0af160 2021-12-17T18:18:43.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.230+0000 7f63fb7fe700 1 -- 172.21.15.62:0/3848811353 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f63fc019030 con 0x7f640c0af160 2021-12-17T18:18:43.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.230+0000 7f63fb7fe700 1 --2- 172.21.15.62:0/3848811353 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f63e8053610 0x7f63e8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:43.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.230+0000 7f63fb7fe700 1 -- 172.21.15.62:0/3848811353 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f63fc06ac70 con 0x7f640c0af160 2021-12-17T18:18:43.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.230+0000 7f6409d9b700 1 --2- 172.21.15.62:0/3848811353 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f63e8053610 0x7f63e8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:43.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.230+0000 7f6409d9b700 1 --2- 172.21.15.62:0/3848811353 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f63e8053610 0x7f63e8055ad0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f640000d000 tx=0x7f6400007b50).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:43.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.238+0000 7f63fb7fe700 1 -- 172.21.15.62:0/3848811353 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f63fc041cc0 con 0x7f640c0af160 2021-12-17T18:18:43.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.366+0000 7f640b59e700 1 -- 172.21.15.62:0/3848811353 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f640c1548d0 con 0x7f640c0af160 2021-12-17T18:18:43.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.366+0000 7f63fb7fe700 1 -- 172.21.15.62:0/3848811353 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f63fc0452e0 con 0x7f640c0af160 2021-12-17T18:18:43.372 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:43.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.370+0000 7f640b59e700 1 -- 172.21.15.62:0/3848811353 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f63e8053610 msgr2=0x7f63e8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.370+0000 7f640b59e700 1 --2- 172.21.15.62:0/3848811353 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f63e8053610 0x7f63e8055ad0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f640000d000 tx=0x7f6400007b50).stop 2021-12-17T18:18:43.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.370+0000 7f640b59e700 1 -- 172.21.15.62:0/3848811353 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f640c0af160 msgr2=0x7f640c154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.370+0000 7f640b59e700 1 --2- 172.21.15.62:0/3848811353 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f640c0af160 0x7f640c154240 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f640c063f30 tx=0x7f63fc007c50).stop 2021-12-17T18:18:43.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.370+0000 7f640b59e700 1 -- 172.21.15.62:0/3848811353 shutdown_connections 2021-12-17T18:18:43.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.370+0000 7f640b59e700 1 --2- 172.21.15.62:0/3848811353 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f63e8053610 0x7f63e8055ad0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.370+0000 7f640b59e700 1 --2- 172.21.15.62:0/3848811353 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f640c13e420 0x7f640c1430e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.370+0000 7f640b59e700 1 --2- 172.21.15.62:0/3848811353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f640c0af5f0 0x7f640c142bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.370+0000 7f640b59e700 1 --2- 172.21.15.62:0/3848811353 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f640c0af160 0x7f640c154240 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.370+0000 7f640b59e700 1 -- 172.21.15.62:0/3848811353 >> 172.21.15.62:0/3848811353 conn(0x7f640c05c750 msgr2=0x7f640c140da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:43.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.370+0000 7f640b59e700 1 -- 172.21.15.62:0/3848811353 shutdown_connections 2021-12-17T18:18:43.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.370+0000 7f640b59e700 1 -- 172.21.15.62:0/3848811353 wait complete. 2021-12-17T18:18:43.386 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:18:43.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.494+0000 7f66948d9700 1 Processor -- start 2021-12-17T18:18:43.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.494+0000 7f66948d9700 1 -- start start 2021-12-17T18:18:43.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.494+0000 7f66948d9700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f669005ca90 0x7f66900b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:43.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.494+0000 7f66948d9700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66900b47c0 0x7f66900b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:43.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.494+0000 7f66948d9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66900b5be0 0x7f6690143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:43.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.494+0000 7f66948d9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66900b0870 con 0x7f66900b5be0 2021-12-17T18:18:43.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.494+0000 7f66948d9700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669005ce70 con 0x7f669005ca90 2021-12-17T18:18:43.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.494+0000 7f66948d9700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66900b05d0 con 0x7f66900b47c0 2021-12-17T18:18:43.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.494+0000 7f668f59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66900b5be0 0x7f6690143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:43.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.494+0000 7f668f59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66900b5be0 0x7f6690143ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48720/0 (socket says 172.21.15.62:48720) 2021-12-17T18:18:43.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.494+0000 7f668f59e700 1 -- 172.21.15.62:0/2243348846 learned_addr learned my addr 172.21.15.62:0/2243348846 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:43.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.494+0000 7f668ed9d700 1 --2- 172.21.15.62:0/2243348846 >> v2:172.21.15.109:3300/0 conn(0x7f669005ca90 0x7f66900b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:43.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.494+0000 7f668659c700 1 --2- 172.21.15.62:0/2243348846 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66900b47c0 0x7f66900b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:43.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f668f59e700 1 -- 172.21.15.62:0/2243348846 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66900b47c0 msgr2=0x7f66900b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:43.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f668f59e700 1 --2- 172.21.15.62:0/2243348846 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66900b47c0 0x7f66900b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f668f59e700 1 -- 172.21.15.62:0/2243348846 >> v2:172.21.15.109:3300/0 conn(0x7f669005ca90 msgr2=0x7f66900b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:43.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f668f59e700 1 --2- 172.21.15.62:0/2243348846 >> v2:172.21.15.109:3300/0 conn(0x7f669005ca90 0x7f66900b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f668f59e700 1 -- 172.21.15.62:0/2243348846 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66900b5250 con 0x7f66900b5be0 2021-12-17T18:18:43.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f668ed9d700 1 --2- 172.21.15.62:0/2243348846 >> v2:172.21.15.109:3300/0 conn(0x7f669005ca90 0x7f66900b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:43.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f668f59e700 1 --2- 172.21.15.62:0/2243348846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66900b5be0 0x7f6690143ba0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f66880032f0 tx=0x7f6688009290).ready entity=mon.0 client_cookie=57b279f5ae0183aa server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:43.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f668e59c700 1 -- 172.21.15.62:0/2243348846 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f668800b870 con 0x7f66900b5be0 2021-12-17T18:18:43.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f668e59c700 1 -- 172.21.15.62:0/2243348846 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668800b9d0 con 0x7f66900b5be0 2021-12-17T18:18:43.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f668e59c700 1 -- 172.21.15.62:0/2243348846 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f668800bb40 con 0x7f66900b5be0 2021-12-17T18:18:43.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f66948d9700 1 -- 172.21.15.62:0/2243348846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66900b5be0 msgr2=0x7f6690143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f66948d9700 1 --2- 172.21.15.62:0/2243348846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66900b5be0 0x7f6690143ba0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f66880032f0 tx=0x7f6688009290).stop 2021-12-17T18:18:43.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f66948d9700 1 -- 172.21.15.62:0/2243348846 shutdown_connections 2021-12-17T18:18:43.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f66948d9700 1 --2- 172.21.15.62:0/2243348846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66900b5be0 0x7f6690143ba0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f66948d9700 1 --2- 172.21.15.62:0/2243348846 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66900b47c0 0x7f66900b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f66948d9700 1 --2- 172.21.15.62:0/2243348846 >> v2:172.21.15.109:3300/0 conn(0x7f669005ca90 0x7f66900b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f66948d9700 1 -- 172.21.15.62:0/2243348846 >> 172.21.15.62:0/2243348846 conn(0x7f669005bcd0 msgr2=0x7f6690062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:43.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f66948d9700 1 -- 172.21.15.62:0/2243348846 shutdown_connections 2021-12-17T18:18:43.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f66948d9700 1 -- 172.21.15.62:0/2243348846 wait complete. 2021-12-17T18:18:43.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f66948d9700 1 Processor -- start 2021-12-17T18:18:43.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.498+0000 7f66948d9700 1 -- start start 2021-12-17T18:18:43.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f66948d9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f669005ca90 0x7f6690065d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:43.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f66948d9700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66900b47c0 0x7f66900af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:43.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f66948d9700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66900b5be0 0x7f66900afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:43.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f66948d9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66900a3cb0 con 0x7f669005ca90 2021-12-17T18:18:43.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f66948d9700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6690064bd0 con 0x7f66900b5be0 2021-12-17T18:18:43.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f66948d9700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6690066600 con 0x7f66900b47c0 2021-12-17T18:18:43.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f668ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f669005ca90 0x7f6690065d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:43.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f668ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f669005ca90 0x7f6690065d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48728/0 (socket says 172.21.15.62:48728) 2021-12-17T18:18:43.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f668ed9d700 1 -- 172.21.15.62:0/94605348 learned_addr learned my addr 172.21.15.62:0/94605348 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:43.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f668f59e700 1 --2- 172.21.15.62:0/94605348 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66900b5be0 0x7f66900afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:43.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f668659c700 1 --2- 172.21.15.62:0/94605348 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66900b47c0 0x7f66900af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:43.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f668f59e700 1 -- 172.21.15.62:0/94605348 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66900b47c0 msgr2=0x7f66900af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f668f59e700 1 --2- 172.21.15.62:0/94605348 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66900b47c0 0x7f66900af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f668f59e700 1 -- 172.21.15.62:0/94605348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f669005ca90 msgr2=0x7f6690065d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f668f59e700 1 --2- 172.21.15.62:0/94605348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f669005ca90 0x7f6690065d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f668f59e700 1 -- 172.21.15.62:0/94605348 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6688009530 con 0x7f66900b5be0 2021-12-17T18:18:43.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f668f59e700 1 --2- 172.21.15.62:0/94605348 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66900b5be0 0x7f66900afbe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f66900662c0 tx=0x7f6688016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:43.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f668cd99700 1 -- 172.21.15.62:0/94605348 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f668800b870 con 0x7f66900b5be0 2021-12-17T18:18:43.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f668cd99700 1 -- 172.21.15.62:0/94605348 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6688020430 con 0x7f66900b5be0 2021-12-17T18:18:43.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f66948d9700 1 -- 172.21.15.62:0/94605348 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66900663a0 con 0x7f66900b5be0 2021-12-17T18:18:43.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f668cd99700 1 -- 172.21.15.62:0/94605348 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6688011ea0 con 0x7f66900b5be0 2021-12-17T18:18:43.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.502+0000 7f66948d9700 1 -- 172.21.15.62:0/94605348 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66900657b0 con 0x7f66900b5be0 2021-12-17T18:18:43.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.506+0000 7f66948d9700 1 -- 172.21.15.62:0/94605348 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66900a3df0 con 0x7f66900b5be0 2021-12-17T18:18:43.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.506+0000 7f668cd99700 1 -- 172.21.15.62:0/94605348 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6688026020 con 0x7f66900b5be0 2021-12-17T18:18:43.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.506+0000 7f668cd99700 1 --2- 172.21.15.62:0/94605348 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f66680536a0 0x7f6668055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:43.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.506+0000 7f668cd99700 1 -- 172.21.15.62:0/94605348 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f668806c6b0 con 0x7f66900b5be0 2021-12-17T18:18:43.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.506+0000 7f668ed9d700 1 --2- 172.21.15.62:0/94605348 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f66680536a0 0x7f6668055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:43.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.506+0000 7f668ed9d700 1 --2- 172.21.15.62:0/94605348 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f66680536a0 0x7f6668055b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f6680008000 tx=0x7f6680008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:43.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.514+0000 7f668cd99700 1 -- 172.21.15.62:0/94605348 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6688043700 con 0x7f66900b5be0 2021-12-17T18:18:43.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.638+0000 7f66948d9700 1 -- 172.21.15.62:0/94605348 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6690064290 con 0x7f66900b5be0 2021-12-17T18:18:43.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.638+0000 7f668cd99700 1 -- 172.21.15.62:0/94605348 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6688046d20 con 0x7f66900b5be0 2021-12-17T18:18:43.647 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:43.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.642+0000 7f66948d9700 1 -- 172.21.15.62:0/94605348 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f66680536a0 msgr2=0x7f6668055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.642+0000 7f66948d9700 1 --2- 172.21.15.62:0/94605348 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f66680536a0 0x7f6668055b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f6680008000 tx=0x7f6680008040).stop 2021-12-17T18:18:43.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.642+0000 7f66948d9700 1 -- 172.21.15.62:0/94605348 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66900b5be0 msgr2=0x7f66900afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.642+0000 7f66948d9700 1 --2- 172.21.15.62:0/94605348 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66900b5be0 0x7f66900afbe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f66900662c0 tx=0x7f6688016000).stop 2021-12-17T18:18:43.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.642+0000 7f66948d9700 1 -- 172.21.15.62:0/94605348 shutdown_connections 2021-12-17T18:18:43.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.642+0000 7f66948d9700 1 --2- 172.21.15.62:0/94605348 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f66680536a0 0x7f6668055b60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.642+0000 7f66948d9700 1 --2- 172.21.15.62:0/94605348 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66900b5be0 0x7f66900afbe0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.642+0000 7f66948d9700 1 --2- 172.21.15.62:0/94605348 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66900b47c0 0x7f66900af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.642+0000 7f66948d9700 1 --2- 172.21.15.62:0/94605348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f669005ca90 0x7f6690065d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.642+0000 7f66948d9700 1 -- 172.21.15.62:0/94605348 >> 172.21.15.62:0/94605348 conn(0x7f669005bcd0 msgr2=0x7f669005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.642+0000 7f66948d9700 1 -- 172.21.15.62:0/94605348 shutdown_connections 2021-12-17T18:18:43.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.642+0000 7f66948d9700 1 -- 172.21.15.62:0/94605348 wait complete. 2021-12-17T18:18:43.663 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:18:43.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff2a7b3700 1 Processor -- start 2021-12-17T18:18:43.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff2a7b3700 1 -- start start 2021-12-17T18:18:43.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff2a7b3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7eff24060260 0x7eff2405cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:43.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff2a7b3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff24142ff0 con 0x7eff2405c750 2021-12-17T18:18:43.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff2a7b3700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff24143290 con 0x7eff24146f70 2021-12-17T18:18:43.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff2a7b3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff241473e0 con 0x7eff24060260 2021-12-17T18:18:43.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff237fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7eff24060260 0x7eff2405cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:43.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff23fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7eff2405c750 0x7eff241439d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60544/0 (socket says 172.21.15.62:60544) 2021-12-17T18:18:43.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff23fff700 1 -- 172.21.15.62:0/3150424757 learned_addr learned my addr 172.21.15.62:0/3150424757 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:43.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff237fe700 1 -- 172.21.15.62:0/3150424757 >> v1:172.21.15.109:6789/0 conn(0x7eff24146f70 legacy=0x7eff240b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff237fe700 1 -- 172.21.15.62:0/3150424757 >> v1:172.21.15.62:6789/0 conn(0x7eff2405c750 legacy=0x7eff241439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff237fe700 1 -- 172.21.15.62:0/3150424757 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff24143530 con 0x7eff24060260 2021-12-17T18:18:43.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff237fe700 1 --2- 172.21.15.62:0/3150424757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff24060260 0x7eff2405cb30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7eff14002f70 tx=0x7eff14006df0).ready entity=mon.0 client_cookie=701e0a73c80a1cc8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:43.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff22ffd700 1 -- 172.21.15.62:0/3150424757 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff1400d610 con 0x7eff24060260 2021-12-17T18:18:43.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff22ffd700 1 -- 172.21.15.62:0/3150424757 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14000e90 con 0x7eff24060260 2021-12-17T18:18:43.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff22ffd700 1 -- 172.21.15.62:0/3150424757 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff1400d960 con 0x7eff24060260 2021-12-17T18:18:43.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff2a7b3700 1 -- 172.21.15.62:0/3150424757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff24060260 msgr2=0x7eff2405cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff2a7b3700 1 --2- 172.21.15.62:0/3150424757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff24060260 0x7eff2405cb30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7eff14002f70 tx=0x7eff14006df0).stop 2021-12-17T18:18:43.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff2a7b3700 1 -- 172.21.15.62:0/3150424757 shutdown_connections 2021-12-17T18:18:43.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff2a7b3700 1 --2- 172.21.15.62:0/3150424757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff24060260 0x7eff2405cb30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff2a7b3700 1 -- 172.21.15.62:0/3150424757 >> 172.21.15.62:0/3150424757 conn(0x7eff24062430 msgr2=0x7eff24062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:43.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff2a7b3700 1 -- 172.21.15.62:0/3150424757 shutdown_connections 2021-12-17T18:18:43.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.766+0000 7eff2a7b3700 1 -- 172.21.15.62:0/3150424757 wait complete. 2021-12-17T18:18:43.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff2a7b3700 1 Processor -- start 2021-12-17T18:18:43.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff2a7b3700 1 -- start start 2021-12-17T18:18:43.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff2a7b3700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7eff2405c750 0x7eff240666c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:43.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff2a7b3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff24060260 0x7eff24066bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:43.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff2a7b3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff24146f70 0x7eff2414f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:43.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff2a7b3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff241531c0 con 0x7eff24146f70 2021-12-17T18:18:43.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff2a7b3700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff24153460 con 0x7eff2405c750 2021-12-17T18:18:43.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff2a7b3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff240b9150 con 0x7eff24060260 2021-12-17T18:18:43.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff28d50700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff24146f70 0x7eff2414f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:43.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff28d50700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff24146f70 0x7eff2414f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48736/0 (socket says 172.21.15.62:48736) 2021-12-17T18:18:43.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff28d50700 1 -- 172.21.15.62:0/2294774571 learned_addr learned my addr 172.21.15.62:0/2294774571 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:43.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff23fff700 1 --2- 172.21.15.62:0/2294774571 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7eff2405c750 0x7eff240666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:43.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff237fe700 1 --2- 172.21.15.62:0/2294774571 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff24060260 0x7eff24066bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:43.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff28d50700 1 -- 172.21.15.62:0/2294774571 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff24060260 msgr2=0x7eff24066bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff28d50700 1 --2- 172.21.15.62:0/2294774571 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff24060260 0x7eff24066bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff28d50700 1 -- 172.21.15.62:0/2294774571 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7eff2405c750 msgr2=0x7eff240666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff28d50700 1 --2- 172.21.15.62:0/2294774571 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7eff2405c750 0x7eff240666c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff28d50700 1 -- 172.21.15.62:0/2294774571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1400b180 con 0x7eff24146f70 2021-12-17T18:18:43.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff28d50700 1 --2- 172.21.15.62:0/2294774571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff24146f70 0x7eff2414f780 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7eff2405d110 tx=0x7eff1c0013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:43.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff217fa700 1 -- 172.21.15.62:0/2294774571 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff1c006aa0 con 0x7eff24146f70 2021-12-17T18:18:43.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff217fa700 1 -- 172.21.15.62:0/2294774571 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c006c00 con 0x7eff24146f70 2021-12-17T18:18:43.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff2a7b3700 1 -- 172.21.15.62:0/2294774571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff24063490 con 0x7eff24146f70 2021-12-17T18:18:43.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff217fa700 1 -- 172.21.15.62:0/2294774571 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff1c007030 con 0x7eff24146f70 2021-12-17T18:18:43.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.770+0000 7eff2a7b3700 1 -- 172.21.15.62:0/2294774571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff240ba570 con 0x7eff24146f70 2021-12-17T18:18:43.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.774+0000 7eff217fa700 1 -- 172.21.15.62:0/2294774571 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7eff1c010030 con 0x7eff24146f70 2021-12-17T18:18:43.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.774+0000 7eff2a7b3700 1 -- 172.21.15.62:0/2294774571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff24063680 con 0x7eff24146f70 2021-12-17T18:18:43.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.774+0000 7eff217fa700 1 --2- 172.21.15.62:0/2294774571 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7eff080536a0 0x7eff08055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:43.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.774+0000 7eff217fa700 1 -- 172.21.15.62:0/2294774571 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7eff1c06b6d0 con 0x7eff24146f70 2021-12-17T18:18:43.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.774+0000 7eff23fff700 1 --2- 172.21.15.62:0/2294774571 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7eff080536a0 0x7eff08055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:43.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.774+0000 7eff23fff700 1 --2- 172.21.15.62:0/2294774571 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7eff080536a0 0x7eff08055b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7eff0c00d000 tx=0x7eff0c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:43.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.782+0000 7eff217fa700 1 -- 172.21.15.62:0/2294774571 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7eff24063680 con 0x7eff24146f70 2021-12-17T18:18:43.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.906+0000 7eff2a7b3700 1 -- 172.21.15.62:0/2294774571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff24063680 con 0x7eff24146f70 2021-12-17T18:18:43.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.906+0000 7eff217fa700 1 -- 172.21.15.62:0/2294774571 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7eff24063680 con 0x7eff24146f70 2021-12-17T18:18:43.916 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:43.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.910+0000 7eff2a7b3700 1 -- 172.21.15.62:0/2294774571 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7eff080536a0 msgr2=0x7eff08055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.910+0000 7eff2a7b3700 1 --2- 172.21.15.62:0/2294774571 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7eff080536a0 0x7eff08055b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7eff0c00d000 tx=0x7eff0c009040).stop 2021-12-17T18:18:43.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.910+0000 7eff2a7b3700 1 -- 172.21.15.62:0/2294774571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff24146f70 msgr2=0x7eff2414f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:43.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.910+0000 7eff2a7b3700 1 --2- 172.21.15.62:0/2294774571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff24146f70 0x7eff2414f780 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7eff2405d110 tx=0x7eff1c0013a0).stop 2021-12-17T18:18:43.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.910+0000 7eff2a7b3700 1 -- 172.21.15.62:0/2294774571 shutdown_connections 2021-12-17T18:18:43.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.910+0000 7eff2a7b3700 1 --2- 172.21.15.62:0/2294774571 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7eff080536a0 0x7eff08055b60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.910+0000 7eff2a7b3700 1 --2- 172.21.15.62:0/2294774571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff24146f70 0x7eff2414f780 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.910+0000 7eff2a7b3700 1 --2- 172.21.15.62:0/2294774571 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff24060260 0x7eff24066bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.910+0000 7eff2a7b3700 1 --2- 172.21.15.62:0/2294774571 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7eff2405c750 0x7eff240666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.910+0000 7eff2a7b3700 1 -- 172.21.15.62:0/2294774571 >> 172.21.15.62:0/2294774571 conn(0x7eff24062430 msgr2=0x7eff2406ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.910+0000 7eff2a7b3700 1 -- 172.21.15.62:0/2294774571 shutdown_connections 2021-12-17T18:18:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:43.910+0000 7eff2a7b3700 1 -- 172.21.15.62:0/2294774571 wait complete. 2021-12-17T18:18:43.929 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:44.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f6006097700 1 Processor -- start 2021-12-17T18:18:44.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f6006097700 1 -- start start 2021-12-17T18:18:44.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f6006097700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60000b6160 0x7f600005c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f6006097700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f600013efb0 0x7f600013f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f6006097700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60000b6540 con 0x7f60000ad2d0 2021-12-17T18:18:44.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f6006097700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60000b2420 con 0x7f600013efb0 2021-12-17T18:18:44.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f6006097700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60001402e0 con 0x7f60000b6160 2021-12-17T18:18:44.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f5ffeffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f60000ad2d0 0x7f6000140780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60560/0 (socket says 172.21.15.62:60560) 2021-12-17T18:18:44.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f5ffeffd700 1 -- 172.21.15.62:0/3375389507 learned_addr learned my addr 172.21.15.62:0/3375389507 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:44.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f5fff7fe700 1 --2- 172.21.15.62:0/3375389507 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60000b6160 0x7f600005c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f5ffffff700 1 --2- 172.21.15.62:0/3375389507 >> v2:172.21.15.109:3300/0 conn(0x7f600013efb0 0x7f600013f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f5ffe7fc700 1 -- 172.21.15.62:0/3375389507 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539736164 0 0) 0x7f60000b6540 con 0x7f60000ad2d0 2021-12-17T18:18:44.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f5ffe7fc700 1 -- 172.21.15.62:0/3375389507 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fec003260 con 0x7f60000ad2d0 2021-12-17T18:18:44.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f5fff7fe700 1 -- 172.21.15.62:0/3375389507 >> v2:172.21.15.109:3300/0 conn(0x7f600013efb0 msgr2=0x7f600013f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:44.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f5fff7fe700 1 --2- 172.21.15.62:0/3375389507 >> v2:172.21.15.109:3300/0 conn(0x7f600013efb0 0x7f600013f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f5fff7fe700 1 -- 172.21.15.62:0/3375389507 >> v1:172.21.15.62:6789/0 conn(0x7f60000ad2d0 legacy=0x7f6000140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f5fff7fe700 1 -- 172.21.15.62:0/3375389507 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60000b2110 con 0x7f60000b6160 2021-12-17T18:18:44.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f5fff7fe700 1 --2- 172.21.15.62:0/3375389507 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60000b6160 0x7f600005c020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5ff0002f70 tx=0x7f5ff0006df0).ready entity=mon.2 client_cookie=45e5d00fcde76146 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:44.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f5ffe7fc700 1 -- 172.21.15.62:0/3375389507 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff000d4a0 con 0x7f60000b6160 2021-12-17T18:18:44.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f5ffe7fc700 1 -- 172.21.15.62:0/3375389507 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff0000e90 con 0x7f60000b6160 2021-12-17T18:18:44.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f5ffe7fc700 1 -- 172.21.15.62:0/3375389507 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff000d7f0 con 0x7f60000b6160 2021-12-17T18:18:44.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f6006097700 1 -- 172.21.15.62:0/3375389507 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60000b6160 msgr2=0x7f600005c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f6006097700 1 --2- 172.21.15.62:0/3375389507 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60000b6160 0x7f600005c020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5ff0002f70 tx=0x7f5ff0006df0).stop 2021-12-17T18:18:44.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f6006097700 1 -- 172.21.15.62:0/3375389507 shutdown_connections 2021-12-17T18:18:44.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f6006097700 1 --2- 172.21.15.62:0/3375389507 >> v2:172.21.15.109:3300/0 conn(0x7f600013efb0 0x7f600013f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f6006097700 1 --2- 172.21.15.62:0/3375389507 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60000b6160 0x7f600005c020 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f6006097700 1 -- 172.21.15.62:0/3375389507 >> 172.21.15.62:0/3375389507 conn(0x7f600005c750 msgr2=0x7f60000630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:44.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f6006097700 1 -- 172.21.15.62:0/3375389507 shutdown_connections 2021-12-17T18:18:44.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f6006097700 1 -- 172.21.15.62:0/3375389507 wait complete. 2021-12-17T18:18:44.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f6006097700 1 Processor -- start 2021-12-17T18:18:44.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.026+0000 7f6006097700 1 -- start start 2021-12-17T18:18:44.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f6006097700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f60000ad2d0 0x7f60000b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f6006097700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60000b6160 0x7f60001537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f6006097700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f600013efb0 0x7f60000a0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f6006097700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600009eb30 con 0x7f60000b6160 2021-12-17T18:18:44.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f6006097700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6000153cd0 con 0x7f60000ad2d0 2021-12-17T18:18:44.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f6006097700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6000067d50 con 0x7f600013efb0 2021-12-17T18:18:44.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60000b6160 0x7f60001537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60000b6160 0x7f60001537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48752/0 (socket says 172.21.15.62:48752) 2021-12-17T18:18:44.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f5ffeffd700 1 -- 172.21.15.62:0/4135252046 learned_addr learned my addr 172.21.15.62:0/4135252046 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:44.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f5fff7fe700 1 --2- 172.21.15.62:0/4135252046 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f60000ad2d0 0x7f60000b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f5ffffff700 1 --2- 172.21.15.62:0/4135252046 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f600013efb0 0x7f60000a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f5ffeffd700 1 -- 172.21.15.62:0/4135252046 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f600013efb0 msgr2=0x7f60000a0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f5ffeffd700 1 --2- 172.21.15.62:0/4135252046 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f600013efb0 0x7f60000a0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f5ffeffd700 1 -- 172.21.15.62:0/4135252046 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f60000ad2d0 msgr2=0x7f60000b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f5ffeffd700 1 --2- 172.21.15.62:0/4135252046 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f60000ad2d0 0x7f60000b2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f5ffeffd700 1 -- 172.21.15.62:0/4135252046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff000b180 con 0x7f60000b6160 2021-12-17T18:18:44.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f5ffeffd700 1 --2- 172.21.15.62:0/4135252046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60000b6160 0x7f60001537e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f6000066fe0 tx=0x7f5ff4007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:44.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f5ffcff9700 1 -- 172.21.15.62:0/4135252046 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff400ce70 con 0x7f60000b6160 2021-12-17T18:18:44.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f5ffcff9700 1 -- 172.21.15.62:0/4135252046 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff40070d0 con 0x7f60000b6160 2021-12-17T18:18:44.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f6006097700 1 -- 172.21.15.62:0/4135252046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6000143cc0 con 0x7f60000b6160 2021-12-17T18:18:44.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f5ffcff9700 1 -- 172.21.15.62:0/4135252046 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff4007430 con 0x7f60000b6160 2021-12-17T18:18:44.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f6006097700 1 -- 172.21.15.62:0/4135252046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600009fbf0 con 0x7f60000b6160 2021-12-17T18:18:44.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f6006097700 1 -- 172.21.15.62:0/4135252046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6000140e90 con 0x7f60000b6160 2021-12-17T18:18:44.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.030+0000 7f5ffcff9700 1 -- 172.21.15.62:0/4135252046 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5ff4010070 con 0x7f60000b6160 2021-12-17T18:18:44.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.034+0000 7f5ffcff9700 1 --2- 172.21.15.62:0/4135252046 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fe00536a0 0x7f5fe0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.034+0000 7f5ffcff9700 1 -- 172.21.15.62:0/4135252046 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5ff406ae90 con 0x7f60000b6160 2021-12-17T18:18:44.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.034+0000 7f5fff7fe700 1 --2- 172.21.15.62:0/4135252046 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fe00536a0 0x7f5fe0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.034+0000 7f5fff7fe700 1 --2- 172.21.15.62:0/4135252046 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fe00536a0 0x7f5fe0055b60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f5ff001a000 tx=0x7f5ff0014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:44.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.038+0000 7f5ffcff9700 1 -- 172.21.15.62:0/4135252046 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ff4041ff0 con 0x7f60000b6160 2021-12-17T18:18:44.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.166+0000 7f6006097700 1 -- 172.21.15.62:0/4135252046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60000573d0 con 0x7f60000b6160 2021-12-17T18:18:44.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.166+0000 7f5ffcff9700 1 -- 172.21.15.62:0/4135252046 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f5ff4045610 con 0x7f60000b6160 2021-12-17T18:18:44.176 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:44.176 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:20.178383+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:17.128555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:18.180577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:44.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.170+0000 7f6006097700 1 -- 172.21.15.62:0/4135252046 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fe00536a0 msgr2=0x7f5fe0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.170+0000 7f6006097700 1 --2- 172.21.15.62:0/4135252046 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fe00536a0 0x7f5fe0055b60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f5ff001a000 tx=0x7f5ff0014000).stop 2021-12-17T18:18:44.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.170+0000 7f6006097700 1 -- 172.21.15.62:0/4135252046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60000b6160 msgr2=0x7f60001537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.170+0000 7f6006097700 1 --2- 172.21.15.62:0/4135252046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60000b6160 0x7f60001537e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f6000066fe0 tx=0x7f5ff4007aa0).stop 2021-12-17T18:18:44.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.170+0000 7f6006097700 1 -- 172.21.15.62:0/4135252046 shutdown_connections 2021-12-17T18:18:44.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.170+0000 7f6006097700 1 --2- 172.21.15.62:0/4135252046 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fe00536a0 0x7f5fe0055b60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.170+0000 7f6006097700 1 --2- 172.21.15.62:0/4135252046 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f600013efb0 0x7f60000a0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.170+0000 7f6006097700 1 --2- 172.21.15.62:0/4135252046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60000b6160 0x7f60001537e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.170+0000 7f6006097700 1 --2- 172.21.15.62:0/4135252046 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f60000ad2d0 0x7f60000b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.170+0000 7f6006097700 1 -- 172.21.15.62:0/4135252046 >> 172.21.15.62:0/4135252046 conn(0x7f600005c750 msgr2=0x7f60000ada00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:44.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.170+0000 7f6006097700 1 -- 172.21.15.62:0/4135252046 shutdown_connections 2021-12-17T18:18:44.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.170+0000 7f6006097700 1 -- 172.21.15.62:0/4135252046 wait complete. 2021-12-17T18:18:44.188 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:18:17.128555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:18:18.180577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:18:44.189 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:18:44.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.286+0000 7f0e11989700 1 Processor -- start 2021-12-17T18:18:44.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.286+0000 7f0e11989700 1 -- start start 2021-12-17T18:18:44.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.286+0000 7f0e11989700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f0e0c05ca90 0x7f0e0c0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.286+0000 7f0e11989700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e0c0b47c0 0x7f0e0c0b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.286+0000 7f0e11989700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0c0b0870 con 0x7f0e0c0b5be0 2021-12-17T18:18:44.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.286+0000 7f0e11989700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0c05ce70 con 0x7f0e0c0b47c0 2021-12-17T18:18:44.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.286+0000 7f0e11989700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0c0b05d0 con 0x7f0e0c05ca90 2021-12-17T18:18:44.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.286+0000 7f0e0bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e0c0b47c0 0x7f0e0c0b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.286+0000 7f0e0bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e0c0b47c0 0x7f0e0c0b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48760/0 (socket says 172.21.15.62:48760) 2021-12-17T18:18:44.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.286+0000 7f0e0bfff700 1 -- 172.21.15.62:0/2116754456 learned_addr learned my addr 172.21.15.62:0/2116754456 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:44.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.286+0000 7f0e10987700 1 --2- 172.21.15.62:0/2116754456 >> v2:172.21.15.109:3300/0 conn(0x7f0e0c05ca90 0x7f0e0c0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.286+0000 7f0e0bfff700 1 -- 172.21.15.62:0/2116754456 >> v2:172.21.15.109:3300/0 conn(0x7f0e0c05ca90 msgr2=0x7f0e0c0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:44.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.286+0000 7f0e0bfff700 1 --2- 172.21.15.62:0/2116754456 >> v2:172.21.15.109:3300/0 conn(0x7f0e0c05ca90 0x7f0e0c0b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.286+0000 7f0e0bfff700 1 -- 172.21.15.62:0/2116754456 >> v1:172.21.15.109:6789/0 conn(0x7f0e0c0b5be0 legacy=0x7f0e0c143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.286+0000 7f0e0bfff700 1 -- 172.21.15.62:0/2116754456 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c0b5250 con 0x7f0e0c0b47c0 2021-12-17T18:18:44.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.286+0000 7f0e0bfff700 1 --2- 172.21.15.62:0/2116754456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e0c0b47c0 0x7f0e0c0b56f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f0dfc002f70 tx=0x7f0dfc006eb0).ready entity=mon.0 client_cookie=3348273dbef0c9d3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:44.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.290+0000 7f0e0b7fe700 1 -- 172.21.15.62:0/2116754456 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dfc00d5c0 con 0x7f0e0c0b47c0 2021-12-17T18:18:44.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.290+0000 7f0e0b7fe700 1 -- 172.21.15.62:0/2116754456 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc000e90 con 0x7f0e0c0b47c0 2021-12-17T18:18:44.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.290+0000 7f0e0b7fe700 1 -- 172.21.15.62:0/2116754456 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dfc00d950 con 0x7f0e0c0b47c0 2021-12-17T18:18:44.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.290+0000 7f0e11989700 1 -- 172.21.15.62:0/2116754456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e0c0b47c0 msgr2=0x7f0e0c0b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.290+0000 7f0e11989700 1 --2- 172.21.15.62:0/2116754456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e0c0b47c0 0x7f0e0c0b56f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f0dfc002f70 tx=0x7f0dfc006eb0).stop 2021-12-17T18:18:44.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.290+0000 7f0e11989700 1 -- 172.21.15.62:0/2116754456 shutdown_connections 2021-12-17T18:18:44.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.290+0000 7f0e11989700 1 --2- 172.21.15.62:0/2116754456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e0c0b47c0 0x7f0e0c0b56f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.290+0000 7f0e11989700 1 --2- 172.21.15.62:0/2116754456 >> v2:172.21.15.109:3300/0 conn(0x7f0e0c05ca90 0x7f0e0c0b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.290+0000 7f0e11989700 1 -- 172.21.15.62:0/2116754456 >> 172.21.15.62:0/2116754456 conn(0x7f0e0c05bcd0 msgr2=0x7f0e0c062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:44.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.290+0000 7f0e11989700 1 -- 172.21.15.62:0/2116754456 shutdown_connections 2021-12-17T18:18:44.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.290+0000 7f0e11989700 1 -- 172.21.15.62:0/2116754456 wait complete. 2021-12-17T18:18:44.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.290+0000 7f0e11989700 1 Processor -- start 2021-12-17T18:18:44.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.290+0000 7f0e11989700 1 -- start start 2021-12-17T18:18:44.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11989700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0e0c05ca90 0x7f0e0c066e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11989700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0e0c0b47c0 0x7f0e0c155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11989700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e0c0b5be0 0x7f0e0c1563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11989700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c0a4be0 con 0x7f0e0c0b5be0 2021-12-17T18:18:44.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11989700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c0a4e10 con 0x7f0e0c0b47c0 2021-12-17T18:18:44.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11989700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c0a50b0 con 0x7f0e0c05ca90 2021-12-17T18:18:44.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11188700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e0c0b5be0 0x7f0e0c1563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11188700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e0c0b5be0 0x7f0e0c1563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48768/0 (socket says 172.21.15.62:48768) 2021-12-17T18:18:44.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11188700 1 -- 172.21.15.62:0/3053708311 learned_addr learned my addr 172.21.15.62:0/3053708311 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:44.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e0bfff700 1 --2- 172.21.15.62:0/3053708311 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0e0c0b47c0 0x7f0e0c155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e10987700 1 --2- 172.21.15.62:0/3053708311 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0e0c05ca90 0x7f0e0c066e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11188700 1 -- 172.21.15.62:0/3053708311 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0e0c05ca90 msgr2=0x7f0e0c066e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11188700 1 --2- 172.21.15.62:0/3053708311 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0e0c05ca90 0x7f0e0c066e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11188700 1 -- 172.21.15.62:0/3053708311 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0e0c0b47c0 msgr2=0x7f0e0c155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11188700 1 --2- 172.21.15.62:0/3053708311 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0e0c0b47c0 0x7f0e0c155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11188700 1 -- 172.21.15.62:0/3053708311 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc00b1e0 con 0x7f0e0c0b5be0 2021-12-17T18:18:44.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11188700 1 --2- 172.21.15.62:0/3053708311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e0c0b5be0 0x7f0e0c1563a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f0e0c0b55d0 tx=0x7f0e040013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:44.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e09ffb700 1 -- 172.21.15.62:0/3053708311 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e04006aa0 con 0x7f0e0c0b5be0 2021-12-17T18:18:44.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e09ffb700 1 -- 172.21.15.62:0/3053708311 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e04006c00 con 0x7f0e0c0b5be0 2021-12-17T18:18:44.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11989700 1 -- 172.21.15.62:0/3053708311 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0c0a5350 con 0x7f0e0c0b5be0 2021-12-17T18:18:44.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e09ffb700 1 -- 172.21.15.62:0/3053708311 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e04007030 con 0x7f0e0c0b5be0 2021-12-17T18:18:44.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11989700 1 -- 172.21.15.62:0/3053708311 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0c0a5a10 con 0x7f0e0c0b5be0 2021-12-17T18:18:44.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e09ffb700 1 -- 172.21.15.62:0/3053708311 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0e04010030 con 0x7f0e0c0b5be0 2021-12-17T18:18:44.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e11989700 1 -- 172.21.15.62:0/3053708311 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e0c066860 con 0x7f0e0c0b5be0 2021-12-17T18:18:44.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e09ffb700 1 --2- 172.21.15.62:0/3053708311 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0dec053610 0x7f0dec055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e09ffb700 1 -- 172.21.15.62:0/3053708311 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0e0406b810 con 0x7f0e0c0b5be0 2021-12-17T18:18:44.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.294+0000 7f0e10987700 1 --2- 172.21.15.62:0/3053708311 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0dec053610 0x7f0dec055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.298+0000 7f0e10987700 1 --2- 172.21.15.62:0/3053708311 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0dec053610 0x7f0dec055ad0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f0e0000b000 tx=0x7f0e00006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:44.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.302+0000 7f0e09ffb700 1 -- 172.21.15.62:0/3053708311 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0e0c066860 con 0x7f0e0c0b5be0 2021-12-17T18:18:44.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.430+0000 7f0e11989700 1 -- 172.21.15.62:0/3053708311 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0e0c066860 con 0x7f0e0c0b5be0 2021-12-17T18:18:44.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.430+0000 7f0e09ffb700 1 -- 172.21.15.62:0/3053708311 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0e0c066860 con 0x7f0e0c0b5be0 2021-12-17T18:18:44.440 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:18:44.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.434+0000 7f0e11989700 1 -- 172.21.15.62:0/3053708311 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0dec053610 msgr2=0x7f0dec055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.434+0000 7f0e11989700 1 --2- 172.21.15.62:0/3053708311 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0dec053610 0x7f0dec055ad0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f0e0000b000 tx=0x7f0e00006df0).stop 2021-12-17T18:18:44.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.434+0000 7f0e11989700 1 -- 172.21.15.62:0/3053708311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e0c0b5be0 msgr2=0x7f0e0c1563a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.434+0000 7f0e11989700 1 --2- 172.21.15.62:0/3053708311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e0c0b5be0 0x7f0e0c1563a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f0e0c0b55d0 tx=0x7f0e040013a0).stop 2021-12-17T18:18:44.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.434+0000 7f0e11989700 1 -- 172.21.15.62:0/3053708311 shutdown_connections 2021-12-17T18:18:44.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.434+0000 7f0e11989700 1 --2- 172.21.15.62:0/3053708311 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0dec053610 0x7f0dec055ad0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.434+0000 7f0e11989700 1 --2- 172.21.15.62:0/3053708311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e0c0b5be0 0x7f0e0c1563a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.434+0000 7f0e11989700 1 --2- 172.21.15.62:0/3053708311 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0e0c0b47c0 0x7f0e0c155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.434+0000 7f0e11989700 1 --2- 172.21.15.62:0/3053708311 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0e0c05ca90 0x7f0e0c066e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.434+0000 7f0e11989700 1 -- 172.21.15.62:0/3053708311 >> 172.21.15.62:0/3053708311 conn(0x7f0e0c05bcd0 msgr2=0x7f0e0c0b7970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:44.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.434+0000 7f0e11989700 1 -- 172.21.15.62:0/3053708311 shutdown_connections 2021-12-17T18:18:44.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.434+0000 7f0e11989700 1 -- 172.21.15.62:0/3053708311 wait complete. 2021-12-17T18:18:44.453 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:18:44.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.554+0000 7ff421d0c700 1 Processor -- start 2021-12-17T18:18:44.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.554+0000 7ff421d0c700 1 -- start start 2021-12-17T18:18:44.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff421d0c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff41c05c750 0x7ff41c05cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff421d0c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff41c146f70 0x7ff41c0b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff421d0c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41c142ff0 con 0x7ff41c060260 2021-12-17T18:18:44.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff421d0c700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c1473e0 con 0x7ff41c146f70 2021-12-17T18:18:44.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff421d0c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c143290 con 0x7ff41c05c750 2021-12-17T18:18:44.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff41affd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff41c060260 0x7ff41c1439d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60584/0 (socket says 172.21.15.62:60584) 2021-12-17T18:18:44.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff41affd700 1 -- 172.21.15.62:0/1763828057 learned_addr learned my addr 172.21.15.62:0/1763828057 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:44.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff41b7fe700 1 --2- 172.21.15.62:0/1763828057 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff41c05c750 0x7ff41c05cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff41bfff700 1 --2- 172.21.15.62:0/1763828057 >> v2:172.21.15.109:3300/0 conn(0x7ff41c146f70 0x7ff41c0b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff41a7fc700 1 -- 172.21.15.62:0/1763828057 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606991729 0 0) 0x7ff41c142ff0 con 0x7ff41c060260 2021-12-17T18:18:44.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff41a7fc700 1 -- 172.21.15.62:0/1763828057 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3fc003260 con 0x7ff41c060260 2021-12-17T18:18:44.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff41b7fe700 1 -- 172.21.15.62:0/1763828057 >> v2:172.21.15.109:3300/0 conn(0x7ff41c146f70 msgr2=0x7ff41c0b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:44.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff41b7fe700 1 --2- 172.21.15.62:0/1763828057 >> v2:172.21.15.109:3300/0 conn(0x7ff41c146f70 0x7ff41c0b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff41b7fe700 1 -- 172.21.15.62:0/1763828057 >> v1:172.21.15.62:6789/0 conn(0x7ff41c060260 legacy=0x7ff41c1439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff41b7fe700 1 -- 172.21.15.62:0/1763828057 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c143530 con 0x7ff41c05c750 2021-12-17T18:18:44.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff41b7fe700 1 --2- 172.21.15.62:0/1763828057 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff41c05c750 0x7ff41c05cb30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff40c002f70 tx=0x7ff40c006df0).ready entity=mon.2 client_cookie=21de714b1e46c6b8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:44.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff41a7fc700 1 -- 172.21.15.62:0/1763828057 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff40c00d4a0 con 0x7ff41c05c750 2021-12-17T18:18:44.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff41a7fc700 1 -- 172.21.15.62:0/1763828057 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c000e90 con 0x7ff41c05c750 2021-12-17T18:18:44.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff41a7fc700 1 -- 172.21.15.62:0/1763828057 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff40c00d7f0 con 0x7ff41c05c750 2021-12-17T18:18:44.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff421d0c700 1 -- 172.21.15.62:0/1763828057 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff41c05c750 msgr2=0x7ff41c05cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff421d0c700 1 --2- 172.21.15.62:0/1763828057 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff41c05c750 0x7ff41c05cb30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff40c002f70 tx=0x7ff40c006df0).stop 2021-12-17T18:18:44.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff421d0c700 1 -- 172.21.15.62:0/1763828057 shutdown_connections 2021-12-17T18:18:44.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff421d0c700 1 --2- 172.21.15.62:0/1763828057 >> v2:172.21.15.109:3300/0 conn(0x7ff41c146f70 0x7ff41c0b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff421d0c700 1 --2- 172.21.15.62:0/1763828057 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff41c05c750 0x7ff41c05cb30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff421d0c700 1 -- 172.21.15.62:0/1763828057 >> 172.21.15.62:0/1763828057 conn(0x7ff41c062430 msgr2=0x7ff41c062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:44.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff421d0c700 1 -- 172.21.15.62:0/1763828057 shutdown_connections 2021-12-17T18:18:44.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.558+0000 7ff421d0c700 1 -- 172.21.15.62:0/1763828057 wait complete. 2021-12-17T18:18:44.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff421d0c700 1 Processor -- start 2021-12-17T18:18:44.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff421d0c700 1 -- start start 2021-12-17T18:18:44.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff421d0c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff41c05c750 0x7ff41c13da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff421d0c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff41c060260 0x7ff41c13fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff421d0c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff41c146f70 0x7ff41c1522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff421d0c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c13e820 con 0x7ff41c146f70 2021-12-17T18:18:44.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff421d0c700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c064e00 con 0x7ff41c060260 2021-12-17T18:18:44.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff421d0c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c065f10 con 0x7ff41c05c750 2021-12-17T18:18:44.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff41bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff41c146f70 0x7ff41c1522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff41bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff41c146f70 0x7ff41c1522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48782/0 (socket says 172.21.15.62:48782) 2021-12-17T18:18:44.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff41bfff700 1 -- 172.21.15.62:0/4234933544 learned_addr learned my addr 172.21.15.62:0/4234933544 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:44.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff41b7fe700 1 --2- 172.21.15.62:0/4234933544 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff41c05c750 0x7ff41c13da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff41affd700 1 --2- 172.21.15.62:0/4234933544 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff41c060260 0x7ff41c13fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff41b7fe700 1 -- 172.21.15.62:0/4234933544 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff41c060260 msgr2=0x7ff41c13fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff41b7fe700 1 --2- 172.21.15.62:0/4234933544 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff41c060260 0x7ff41c13fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff41b7fe700 1 -- 172.21.15.62:0/4234933544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff41c146f70 msgr2=0x7ff41c1522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff41b7fe700 1 --2- 172.21.15.62:0/4234933544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff41c146f70 0x7ff41c1522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff41b7fe700 1 -- 172.21.15.62:0/4234933544 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c00b180 con 0x7ff41c05c750 2021-12-17T18:18:44.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff41b7fe700 1 --2- 172.21.15.62:0/4234933544 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff41c05c750 0x7ff41c13da40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff40c002f70 tx=0x7ff40c014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:44.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff418ff9700 1 -- 172.21.15.62:0/4234933544 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff40c016070 con 0x7ff41c05c750 2021-12-17T18:18:44.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff421d0c700 1 -- 172.21.15.62:0/4234933544 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41c0664e0 con 0x7ff41c05c750 2021-12-17T18:18:44.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff421d0c700 1 -- 172.21.15.62:0/4234933544 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c140040 con 0x7ff41c05c750 2021-12-17T18:18:44.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff418ff9700 1 -- 172.21.15.62:0/4234933544 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c0137d0 con 0x7ff41c05c750 2021-12-17T18:18:44.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff418ff9700 1 -- 172.21.15.62:0/4234933544 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff40c013b30 con 0x7ff41c05c750 2021-12-17T18:18:44.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.562+0000 7ff421d0c700 1 -- 172.21.15.62:0/4234933544 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41c065d30 con 0x7ff41c05c750 2021-12-17T18:18:44.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.566+0000 7ff418ff9700 1 -- 172.21.15.62:0/4234933544 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff40c00f030 con 0x7ff41c05c750 2021-12-17T18:18:44.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.566+0000 7ff418ff9700 1 --2- 172.21.15.62:0/4234933544 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4000536d0 0x7ff400055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.566+0000 7ff418ff9700 1 -- 172.21.15.62:0/4234933544 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff40c06c880 con 0x7ff41c05c750 2021-12-17T18:18:44.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.566+0000 7ff41affd700 1 --2- 172.21.15.62:0/4234933544 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4000536d0 0x7ff400055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.566+0000 7ff41affd700 1 --2- 172.21.15.62:0/4234933544 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4000536d0 0x7ff400055b90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7ff40400d000 tx=0x7ff404009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:44.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.578+0000 7ff418ff9700 1 -- 172.21.15.62:0/4234933544 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff40c0439e0 con 0x7ff41c05c750 2021-12-17T18:18:44.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.698+0000 7ff421d0c700 1 -- 172.21.15.62:0/4234933544 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff41c0573d0 con 0x7ff41c05c750 2021-12-17T18:18:44.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.698+0000 7ff418ff9700 1 -- 172.21.15.62:0/4234933544 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff40c023020 con 0x7ff41c05c750 2021-12-17T18:18:44.708 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:44.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.702+0000 7ff421d0c700 1 -- 172.21.15.62:0/4234933544 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4000536d0 msgr2=0x7ff400055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.702+0000 7ff421d0c700 1 --2- 172.21.15.62:0/4234933544 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4000536d0 0x7ff400055b90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7ff40400d000 tx=0x7ff404009040).stop 2021-12-17T18:18:44.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.702+0000 7ff421d0c700 1 -- 172.21.15.62:0/4234933544 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff41c05c750 msgr2=0x7ff41c13da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.702+0000 7ff421d0c700 1 --2- 172.21.15.62:0/4234933544 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff41c05c750 0x7ff41c13da40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff40c002f70 tx=0x7ff40c014000).stop 2021-12-17T18:18:44.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.702+0000 7ff421d0c700 1 -- 172.21.15.62:0/4234933544 shutdown_connections 2021-12-17T18:18:44.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.702+0000 7ff421d0c700 1 --2- 172.21.15.62:0/4234933544 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4000536d0 0x7ff400055b90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.702+0000 7ff421d0c700 1 --2- 172.21.15.62:0/4234933544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff41c146f70 0x7ff41c1522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.702+0000 7ff421d0c700 1 --2- 172.21.15.62:0/4234933544 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff41c060260 0x7ff41c13fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.702+0000 7ff421d0c700 1 --2- 172.21.15.62:0/4234933544 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff41c05c750 0x7ff41c13da40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.702+0000 7ff421d0c700 1 -- 172.21.15.62:0/4234933544 >> 172.21.15.62:0/4234933544 conn(0x7ff41c062430 msgr2=0x7ff41c0b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:44.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.702+0000 7ff421d0c700 1 -- 172.21.15.62:0/4234933544 shutdown_connections 2021-12-17T18:18:44.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.702+0000 7ff421d0c700 1 -- 172.21.15.62:0/4234933544 wait complete. 2021-12-17T18:18:44.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:18:44.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.826+0000 7fceb4e2c700 1 Processor -- start 2021-12-17T18:18:44.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.826+0000 7fceb4e2c700 1 -- start start 2021-12-17T18:18:44.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fceb4e2c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fceb005ca90 0x7fceb005f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fceb4e2c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fceb00b46d0 0x7fceb0144730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fceb4e2c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fceb00b4b40 0x7fceb0144c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fceb4e2c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb00b31e0 con 0x7fceb00b46d0 2021-12-17T18:18:44.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fceb4e2c700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb005ce70 con 0x7fceb005ca90 2021-12-17T18:18:44.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fceb4e2c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb005ffd0 con 0x7fceb00b4b40 2021-12-17T18:18:44.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fcea7fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fceb00b46d0 0x7fceb0144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fcea7fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fceb00b46d0 0x7fceb0144730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48786/0 (socket says 172.21.15.62:48786) 2021-12-17T18:18:44.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fcea7fff700 1 -- 172.21.15.62:0/804888636 learned_addr learned my addr 172.21.15.62:0/804888636 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:44.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fceaf7fe700 1 --2- 172.21.15.62:0/804888636 >> v2:172.21.15.109:3300/0 conn(0x7fceb005ca90 0x7fceb005f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fceaffff700 1 --2- 172.21.15.62:0/804888636 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fceb00b4b40 0x7fceb0144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fcea7fff700 1 -- 172.21.15.62:0/804888636 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fceb00b4b40 msgr2=0x7fceb0144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:44.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fcea7fff700 1 --2- 172.21.15.62:0/804888636 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fceb00b4b40 0x7fceb0144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fcea7fff700 1 -- 172.21.15.62:0/804888636 >> v2:172.21.15.109:3300/0 conn(0x7fceb005ca90 msgr2=0x7fceb005f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:44.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fcea7fff700 1 --2- 172.21.15.62:0/804888636 >> v2:172.21.15.109:3300/0 conn(0x7fceb005ca90 0x7fceb005f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fcea7fff700 1 -- 172.21.15.62:0/804888636 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb00b3f90 con 0x7fceb00b46d0 2021-12-17T18:18:44.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fcea7fff700 1 --2- 172.21.15.62:0/804888636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fceb00b46d0 0x7fceb0144730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fce98002f70 tx=0x7fce98006eb0).ready entity=mon.0 client_cookie=53076114c6d1ae3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:44.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fceaeffd700 1 -- 172.21.15.62:0/804888636 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce9800d570 con 0x7fceb00b46d0 2021-12-17T18:18:44.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fceaeffd700 1 -- 172.21.15.62:0/804888636 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce98000e90 con 0x7fceb00b46d0 2021-12-17T18:18:44.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.830+0000 7fceaeffd700 1 -- 172.21.15.62:0/804888636 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce9800d900 con 0x7fceb00b46d0 2021-12-17T18:18:44.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceb4e2c700 1 -- 172.21.15.62:0/804888636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fceb00b46d0 msgr2=0x7fceb0144730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceb4e2c700 1 --2- 172.21.15.62:0/804888636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fceb00b46d0 0x7fceb0144730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fce98002f70 tx=0x7fce98006eb0).stop 2021-12-17T18:18:44.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceb4e2c700 1 -- 172.21.15.62:0/804888636 shutdown_connections 2021-12-17T18:18:44.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceb4e2c700 1 --2- 172.21.15.62:0/804888636 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fceb00b4b40 0x7fceb0144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceb4e2c700 1 --2- 172.21.15.62:0/804888636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fceb00b46d0 0x7fceb0144730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceb4e2c700 1 --2- 172.21.15.62:0/804888636 >> v2:172.21.15.109:3300/0 conn(0x7fceb005ca90 0x7fceb005f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceb4e2c700 1 -- 172.21.15.62:0/804888636 >> 172.21.15.62:0/804888636 conn(0x7fceb005bcd0 msgr2=0x7fceb0062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:44.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceb4e2c700 1 -- 172.21.15.62:0/804888636 shutdown_connections 2021-12-17T18:18:44.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceb4e2c700 1 -- 172.21.15.62:0/804888636 wait complete. 2021-12-17T18:18:44.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceb4e2c700 1 Processor -- start 2021-12-17T18:18:44.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceb4e2c700 1 -- start start 2021-12-17T18:18:44.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceb4e2c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fceb005ca90 0x7fceb0140b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceb4e2c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fceb00b46d0 0x7fceb013d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceb4e2c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fceb00b4b40 0x7fceb013d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceb4e2c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00afc70 con 0x7fceb00b4b40 2021-12-17T18:18:44.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceb4e2c700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00aeae0 con 0x7fceb005ca90 2021-12-17T18:18:44.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceb4e2c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00aed80 con 0x7fceb00b46d0 2021-12-17T18:18:44.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceaffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fceb00b4b40 0x7fceb013d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceaffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fceb00b4b40 0x7fceb013d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48796/0 (socket says 172.21.15.62:48796) 2021-12-17T18:18:44.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fceaffff700 1 -- 172.21.15.62:0/2964162016 learned_addr learned my addr 172.21.15.62:0/2964162016 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:44.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.834+0000 7fcea7fff700 1 --2- 172.21.15.62:0/2964162016 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fceb00b46d0 0x7fceb013d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fceaf7fe700 1 --2- 172.21.15.62:0/2964162016 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fceb005ca90 0x7fceb0140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fcea7fff700 1 -- 172.21.15.62:0/2964162016 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fceb005ca90 msgr2=0x7fceb0140b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fcea7fff700 1 --2- 172.21.15.62:0/2964162016 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fceb005ca90 0x7fceb0140b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fcea7fff700 1 -- 172.21.15.62:0/2964162016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fceb00b4b40 msgr2=0x7fceb013d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fcea7fff700 1 --2- 172.21.15.62:0/2964162016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fceb00b4b40 0x7fceb013d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fcea7fff700 1 -- 172.21.15.62:0/2964162016 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9800b1e0 con 0x7fceb00b46d0 2021-12-17T18:18:44.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fceaffff700 1 --2- 172.21.15.62:0/2964162016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fceb00b4b40 0x7fceb013d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:44.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fcea7fff700 1 --2- 172.21.15.62:0/2964162016 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fceb00b46d0 0x7fceb013d140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fce98002f70 tx=0x7fce98015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:44.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fcead7fa700 1 -- 172.21.15.62:0/2964162016 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce980117e0 con 0x7fceb00b46d0 2021-12-17T18:18:44.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fcead7fa700 1 -- 172.21.15.62:0/2964162016 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce98011940 con 0x7fceb00b46d0 2021-12-17T18:18:44.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fceb4e2c700 1 -- 172.21.15.62:0/2964162016 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb00af8f0 con 0x7fceb00b46d0 2021-12-17T18:18:44.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fcead7fa700 1 -- 172.21.15.62:0/2964162016 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce98011ca0 con 0x7fceb00b46d0 2021-12-17T18:18:44.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fceb4e2c700 1 -- 172.21.15.62:0/2964162016 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb00b0b30 con 0x7fceb00b46d0 2021-12-17T18:18:44.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fcead7fa700 1 -- 172.21.15.62:0/2964162016 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fce9801a040 con 0x7fceb00b46d0 2021-12-17T18:18:44.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fceb4e2c700 1 -- 172.21.15.62:0/2964162016 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb00b4230 con 0x7fceb00b46d0 2021-12-17T18:18:44.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fcead7fa700 1 --2- 172.21.15.62:0/2964162016 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fce940536a0 0x7fce94055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:44.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fcead7fa700 1 -- 172.21.15.62:0/2964162016 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fce9806c6d0 con 0x7fceb00b46d0 2021-12-17T18:18:44.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.838+0000 7fceaf7fe700 1 --2- 172.21.15.62:0/2964162016 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fce940536a0 0x7fce94055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:44.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.842+0000 7fceaf7fe700 1 --2- 172.21.15.62:0/2964162016 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fce940536a0 0x7fce94055b60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fcea000b000 tx=0x7fcea0006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:44.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.850+0000 7fcead7fa700 1 -- 172.21.15.62:0/2964162016 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fce98043790 con 0x7fceb00b46d0 2021-12-17T18:18:44.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.978+0000 7fceb4e2c700 1 -- 172.21.15.62:0/2964162016 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fceb00b6da0 con 0x7fceb00b46d0 2021-12-17T18:18:44.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.978+0000 7fcead7fa700 1 -- 172.21.15.62:0/2964162016 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fce98046db0 con 0x7fceb00b46d0 2021-12-17T18:18:44.986 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:44.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.978+0000 7fceb4e2c700 1 -- 172.21.15.62:0/2964162016 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fce940536a0 msgr2=0x7fce94055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.978+0000 7fceb4e2c700 1 --2- 172.21.15.62:0/2964162016 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fce940536a0 0x7fce94055b60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fcea000b000 tx=0x7fcea0006df0).stop 2021-12-17T18:18:44.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.978+0000 7fceb4e2c700 1 -- 172.21.15.62:0/2964162016 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fceb00b46d0 msgr2=0x7fceb013d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:44.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.978+0000 7fceb4e2c700 1 --2- 172.21.15.62:0/2964162016 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fceb00b46d0 0x7fceb013d140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fce98002f70 tx=0x7fce98015000).stop 2021-12-17T18:18:44.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.982+0000 7fceb4e2c700 1 -- 172.21.15.62:0/2964162016 shutdown_connections 2021-12-17T18:18:44.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.982+0000 7fceb4e2c700 1 --2- 172.21.15.62:0/2964162016 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fce940536a0 0x7fce94055b60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.982+0000 7fceb4e2c700 1 --2- 172.21.15.62:0/2964162016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fceb00b4b40 0x7fceb013d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.982+0000 7fceb4e2c700 1 --2- 172.21.15.62:0/2964162016 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fceb00b46d0 0x7fceb013d140 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.982+0000 7fceb4e2c700 1 --2- 172.21.15.62:0/2964162016 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fceb005ca90 0x7fceb0140b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:44.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.982+0000 7fceb4e2c700 1 -- 172.21.15.62:0/2964162016 >> 172.21.15.62:0/2964162016 conn(0x7fceb005bcd0 msgr2=0x7fceb0141710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:44.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.982+0000 7fceb4e2c700 1 -- 172.21.15.62:0/2964162016 shutdown_connections 2021-12-17T18:18:44.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:44.982+0000 7fceb4e2c700 1 -- 172.21.15.62:0/2964162016 wait complete. 2021-12-17T18:18:45.000 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:18:45.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.102+0000 7f67be890700 1 Processor -- start 2021-12-17T18:18:45.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.102+0000 7f67be890700 1 -- start start 2021-12-17T18:18:45.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.102+0000 7f67be890700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f67b805ca90 0x7f67b81430f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.102+0000 7f67be890700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b8140190 0x7f67b8140600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.102+0000 7f67be890700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b80657d0 con 0x7f67b80ad430 2021-12-17T18:18:45.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.102+0000 7f67be890700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b805ce70 con 0x7f67b805ca90 2021-12-17T18:18:45.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.102+0000 7f67be890700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b8060680 con 0x7f67b8140190 2021-12-17T18:18:45.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67bd08d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f67b80ad430 0x7f67b8065c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60612/0 (socket says 172.21.15.62:60612) 2021-12-17T18:18:45.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67bd08d700 1 -- 172.21.15.62:0/2074505925 learned_addr learned my addr 172.21.15.62:0/2074505925 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:45.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67be08f700 1 --2- 172.21.15.62:0/2074505925 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b8140190 0x7f67b8140600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67bd88e700 1 --2- 172.21.15.62:0/2074505925 >> v2:172.21.15.109:3300/0 conn(0x7f67b805ca90 0x7f67b81430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67bc88c700 1 -- 172.21.15.62:0/2074505925 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317697510 0 0) 0x7f67b80657d0 con 0x7f67b80ad430 2021-12-17T18:18:45.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67bc88c700 1 -- 172.21.15.62:0/2074505925 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67a0003260 con 0x7f67b80ad430 2021-12-17T18:18:45.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67be08f700 1 -- 172.21.15.62:0/2074505925 >> v2:172.21.15.109:3300/0 conn(0x7f67b805ca90 msgr2=0x7f67b81430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:45.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67be08f700 1 --2- 172.21.15.62:0/2074505925 >> v2:172.21.15.109:3300/0 conn(0x7f67b805ca90 0x7f67b81430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67bc88c700 1 -- 172.21.15.62:0/2074505925 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4147404417 0 0) 0x7f67a0003260 con 0x7f67b80ad430 2021-12-17T18:18:45.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67be08f700 1 -- 172.21.15.62:0/2074505925 >> v1:172.21.15.62:6789/0 conn(0x7f67b80ad430 legacy=0x7f67b8065c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67be08f700 1 -- 172.21.15.62:0/2074505925 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b80603e0 con 0x7f67b8140190 2021-12-17T18:18:45.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67be08f700 1 --2- 172.21.15.62:0/2074505925 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b8140190 0x7f67b8140600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f67a8001800 tx=0x7f67b00091d0).ready entity=mon.2 client_cookie=c97a9d7afc0ad5b6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:45.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67bc88c700 1 -- 172.21.15.62:0/2074505925 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67a8001660 con 0x7f67b8140190 2021-12-17T18:18:45.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67bc88c700 1 -- 172.21.15.62:0/2074505925 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b000f510 con 0x7f67b8140190 2021-12-17T18:18:45.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67bc88c700 1 -- 172.21.15.62:0/2074505925 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67b000f680 con 0x7f67b8140190 2021-12-17T18:18:45.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67be890700 1 -- 172.21.15.62:0/2074505925 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b8140190 msgr2=0x7f67b8140600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67be890700 1 --2- 172.21.15.62:0/2074505925 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b8140190 0x7f67b8140600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f67a8001800 tx=0x7f67b00091d0).stop 2021-12-17T18:18:45.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67be890700 1 -- 172.21.15.62:0/2074505925 shutdown_connections 2021-12-17T18:18:45.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67be890700 1 --2- 172.21.15.62:0/2074505925 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b8140190 0x7f67b8140600 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67be890700 1 --2- 172.21.15.62:0/2074505925 >> v2:172.21.15.109:3300/0 conn(0x7f67b805ca90 0x7f67b81430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67be890700 1 -- 172.21.15.62:0/2074505925 >> 172.21.15.62:0/2074505925 conn(0x7f67b805be70 msgr2=0x7f67b8062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:45.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67be890700 1 -- 172.21.15.62:0/2074505925 shutdown_connections 2021-12-17T18:18:45.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.106+0000 7f67be890700 1 -- 172.21.15.62:0/2074505925 wait complete. 2021-12-17T18:18:45.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.110+0000 7f67be890700 1 Processor -- start 2021-12-17T18:18:45.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.110+0000 7f67be890700 1 -- start start 2021-12-17T18:18:45.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.110+0000 7f67be890700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f67b805ca90 0x7f67b8146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.110+0000 7f67be890700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b80ad430 0x7f67b8146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.110+0000 7f67be890700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b8140190 0x7f67b813dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.110+0000 7f67be890700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b8146e20 con 0x7f67b8140190 2021-12-17T18:18:45.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.110+0000 7f67be890700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b80b12b0 con 0x7f67b805ca90 2021-12-17T18:18:45.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.110+0000 7f67be890700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b80b1550 con 0x7f67b80ad430 2021-12-17T18:18:45.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.110+0000 7f67be08f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b8140190 0x7f67b813dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.110+0000 7f67be08f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b8140190 0x7f67b813dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48810/0 (socket says 172.21.15.62:48810) 2021-12-17T18:18:45.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.110+0000 7f67be08f700 1 -- 172.21.15.62:0/2886045780 learned_addr learned my addr 172.21.15.62:0/2886045780 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:45.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.110+0000 7f67bd08d700 1 --2- 172.21.15.62:0/2886045780 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b80ad430 0x7f67b8146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.110+0000 7f67bd88e700 1 --2- 172.21.15.62:0/2886045780 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f67b805ca90 0x7f67b8146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.114+0000 7f67be08f700 1 -- 172.21.15.62:0/2886045780 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b80ad430 msgr2=0x7f67b8146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.114+0000 7f67be08f700 1 --2- 172.21.15.62:0/2886045780 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b80ad430 0x7f67b8146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.114+0000 7f67be08f700 1 -- 172.21.15.62:0/2886045780 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f67b805ca90 msgr2=0x7f67b8146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.114+0000 7f67be08f700 1 --2- 172.21.15.62:0/2886045780 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f67b805ca90 0x7f67b8146440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.114+0000 7f67be08f700 1 -- 172.21.15.62:0/2886045780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b0009470 con 0x7f67b8140190 2021-12-17T18:18:45.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.114+0000 7f67bd08d700 1 --2- 172.21.15.62:0/2886045780 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b80ad430 0x7f67b8146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:45.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.114+0000 7f67be08f700 1 --2- 172.21.15.62:0/2886045780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b8140190 0x7f67b813dd10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f67a8001800 tx=0x7f67b0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:45.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.114+0000 7f67a6ffd700 1 -- 172.21.15.62:0/2886045780 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67b00032f0 con 0x7f67b8140190 2021-12-17T18:18:45.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.114+0000 7f67a6ffd700 1 -- 172.21.15.62:0/2886045780 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b0011b80 con 0x7f67b8140190 2021-12-17T18:18:45.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.114+0000 7f67be890700 1 -- 172.21.15.62:0/2886045780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b80b0e80 con 0x7f67b8140190 2021-12-17T18:18:45.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.114+0000 7f67a6ffd700 1 -- 172.21.15.62:0/2886045780 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67b0021480 con 0x7f67b8140190 2021-12-17T18:18:45.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.114+0000 7f67be890700 1 -- 172.21.15.62:0/2886045780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b8144830 con 0x7f67b8140190 2021-12-17T18:18:45.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.114+0000 7f67be890700 1 -- 172.21.15.62:0/2886045780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b80b1100 con 0x7f67b8140190 2021-12-17T18:18:45.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.114+0000 7f67a6ffd700 1 -- 172.21.15.62:0/2886045780 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f67b000f070 con 0x7f67b8140190 2021-12-17T18:18:45.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.118+0000 7f67a6ffd700 1 --2- 172.21.15.62:0/2886045780 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6798053640 0x7f6798055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.118+0000 7f67a6ffd700 1 -- 172.21.15.62:0/2886045780 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f67b006cab0 con 0x7f67b8140190 2021-12-17T18:18:45.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.118+0000 7f67bd88e700 1 --2- 172.21.15.62:0/2886045780 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6798053640 0x7f6798055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.118+0000 7f67bd88e700 1 --2- 172.21.15.62:0/2886045780 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6798053640 0x7f6798055b00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f67b4006000 tx=0x7f67b4006d90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:45.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.122+0000 7f67a6ffd700 1 -- 172.21.15.62:0/2886045780 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f67b0043c50 con 0x7f67b8140190 2021-12-17T18:18:45.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.250+0000 7f67be890700 1 -- 172.21.15.62:0/2886045780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67b80b1710 con 0x7f67b8140190 2021-12-17T18:18:45.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.250+0000 7f67a6ffd700 1 -- 172.21.15.62:0/2886045780 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f67b0015070 con 0x7f67b8140190 2021-12-17T18:18:45.259 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:45.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.254+0000 7f67be890700 1 -- 172.21.15.62:0/2886045780 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6798053640 msgr2=0x7f6798055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.254+0000 7f67be890700 1 --2- 172.21.15.62:0/2886045780 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6798053640 0x7f6798055b00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f67b4006000 tx=0x7f67b4006d90).stop 2021-12-17T18:18:45.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.254+0000 7f67be890700 1 -- 172.21.15.62:0/2886045780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b8140190 msgr2=0x7f67b813dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.254+0000 7f67be890700 1 --2- 172.21.15.62:0/2886045780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b8140190 0x7f67b813dd10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f67a8001800 tx=0x7f67b0016000).stop 2021-12-17T18:18:45.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.254+0000 7f67be890700 1 -- 172.21.15.62:0/2886045780 shutdown_connections 2021-12-17T18:18:45.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.254+0000 7f67be890700 1 --2- 172.21.15.62:0/2886045780 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6798053640 0x7f6798055b00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.254+0000 7f67be890700 1 --2- 172.21.15.62:0/2886045780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b8140190 0x7f67b813dd10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.254+0000 7f67be890700 1 --2- 172.21.15.62:0/2886045780 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b80ad430 0x7f67b8146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.254+0000 7f67be890700 1 --2- 172.21.15.62:0/2886045780 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f67b805ca90 0x7f67b8146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.254+0000 7f67be890700 1 -- 172.21.15.62:0/2886045780 >> 172.21.15.62:0/2886045780 conn(0x7f67b805be70 msgr2=0x7f67b8063c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:45.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.254+0000 7f67be890700 1 -- 172.21.15.62:0/2886045780 shutdown_connections 2021-12-17T18:18:45.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.254+0000 7f67be890700 1 -- 172.21.15.62:0/2886045780 wait complete. 2021-12-17T18:18:45.273 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:45.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.370+0000 7f6d4a8fb700 1 Processor -- start 2021-12-17T18:18:45.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.370+0000 7f6d4a8fb700 1 -- start start 2021-12-17T18:18:45.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.370+0000 7f6d4a8fb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6d440aedd0 0x7f6d440b2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.370+0000 7f6d4a8fb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d44148720 0x7f6d440b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.370+0000 7f6d4a8fb700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d440af1b0 con 0x7f6d440b1ff0 2021-12-17T18:18:45.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.370+0000 7f6d4a8fb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d44148b70 con 0x7f6d440aedd0 2021-12-17T18:18:45.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.370+0000 7f6d4a8fb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d440b0170 con 0x7f6d44148720 2021-12-17T18:18:45.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.370+0000 7f6d498f9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6d440aedd0 0x7f6d440b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.370+0000 7f6d498f9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6d440aedd0 0x7f6d440b2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48816/0 (socket says 172.21.15.62:48816) 2021-12-17T18:18:45.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.370+0000 7f6d4a0fa700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d44148720 0x7f6d440b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.370+0000 7f6d498f9700 1 -- 172.21.15.62:0/2737463632 learned_addr learned my addr 172.21.15.62:0/2737463632 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:45.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.370+0000 7f6d488f7700 1 -- 172.21.15.62:0/2737463632 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283397364 0 0) 0x7f6d440af1b0 con 0x7f6d440b1ff0 2021-12-17T18:18:45.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d488f7700 1 -- 172.21.15.62:0/2737463632 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d2c003260 con 0x7f6d440b1ff0 2021-12-17T18:18:45.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d4a0fa700 1 -- 172.21.15.62:0/2737463632 >> v2:172.21.15.62:3300/0 conn(0x7f6d440aedd0 msgr2=0x7f6d440b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:45.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d4a0fa700 1 --2- 172.21.15.62:0/2737463632 >> v2:172.21.15.62:3300/0 conn(0x7f6d440aedd0 0x7f6d440b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d4a0fa700 1 -- 172.21.15.62:0/2737463632 >> v1:172.21.15.109:6789/0 conn(0x7f6d440b1ff0 legacy=0x7f6d44148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d4a0fa700 1 -- 172.21.15.62:0/2737463632 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d440aaca0 con 0x7f6d44148720 2021-12-17T18:18:45.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d4a0fa700 1 --2- 172.21.15.62:0/2737463632 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d44148720 0x7f6d440b05f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f6d3c0032f0 tx=0x7f6d3c0091d0).ready entity=mon.2 client_cookie=7359983030c84c70 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:45.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d488f7700 1 -- 172.21.15.62:0/2737463632 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d3c00b600 con 0x7f6d44148720 2021-12-17T18:18:45.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d488f7700 1 -- 172.21.15.62:0/2737463632 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c00b760 con 0x7f6d44148720 2021-12-17T18:18:45.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d488f7700 1 -- 172.21.15.62:0/2737463632 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d3c00b8d0 con 0x7f6d44148720 2021-12-17T18:18:45.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d4a8fb700 1 -- 172.21.15.62:0/2737463632 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d44148720 msgr2=0x7f6d440b05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d4a8fb700 1 --2- 172.21.15.62:0/2737463632 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d44148720 0x7f6d440b05f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f6d3c0032f0 tx=0x7f6d3c0091d0).stop 2021-12-17T18:18:45.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d4a8fb700 1 -- 172.21.15.62:0/2737463632 shutdown_connections 2021-12-17T18:18:45.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d4a8fb700 1 --2- 172.21.15.62:0/2737463632 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d44148720 0x7f6d440b05f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d4a8fb700 1 --2- 172.21.15.62:0/2737463632 >> v2:172.21.15.62:3300/0 conn(0x7f6d440aedd0 0x7f6d440b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d4a8fb700 1 -- 172.21.15.62:0/2737463632 >> 172.21.15.62:0/2737463632 conn(0x7f6d4405c750 msgr2=0x7f6d4405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:45.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d4a8fb700 1 -- 172.21.15.62:0/2737463632 shutdown_connections 2021-12-17T18:18:45.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d4a8fb700 1 -- 172.21.15.62:0/2737463632 wait complete. 2021-12-17T18:18:45.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d4a8fb700 1 Processor -- start 2021-12-17T18:18:45.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.374+0000 7f6d4a8fb700 1 -- start start 2021-12-17T18:18:45.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a8fb700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6d440aedd0 0x7f6d44156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a8fb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d440b1ff0 0x7f6d440b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a8fb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d44148720 0x7f6d44159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a8fb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d44144b10 con 0x7f6d44148720 2021-12-17T18:18:45.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a8fb700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d441568b0 con 0x7f6d440aedd0 2021-12-17T18:18:45.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a8fb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d44156b50 con 0x7f6d440b1ff0 2021-12-17T18:18:45.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a0fa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d44148720 0x7f6d44159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a0fa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d44148720 0x7f6d44159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48824/0 (socket says 172.21.15.62:48824) 2021-12-17T18:18:45.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a0fa700 1 -- 172.21.15.62:0/1261178510 learned_addr learned my addr 172.21.15.62:0/1261178510 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:45.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d490f8700 1 --2- 172.21.15.62:0/1261178510 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d440b1ff0 0x7f6d440b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d498f9700 1 --2- 172.21.15.62:0/1261178510 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6d440aedd0 0x7f6d44156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a0fa700 1 -- 172.21.15.62:0/1261178510 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d440b1ff0 msgr2=0x7f6d440b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a0fa700 1 --2- 172.21.15.62:0/1261178510 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d440b1ff0 0x7f6d440b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a0fa700 1 -- 172.21.15.62:0/1261178510 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6d440aedd0 msgr2=0x7f6d44156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a0fa700 1 --2- 172.21.15.62:0/1261178510 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6d440aedd0 0x7f6d44156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a0fa700 1 -- 172.21.15.62:0/1261178510 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c009470 con 0x7f6d44148720 2021-12-17T18:18:45.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a0fa700 1 --2- 172.21.15.62:0/1261178510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d44148720 0x7f6d44159cc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f6d3c0032f0 tx=0x7f6d3c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:45.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d36ffd700 1 -- 172.21.15.62:0/1261178510 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d3c00b8d0 con 0x7f6d44148720 2021-12-17T18:18:45.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d36ffd700 1 -- 172.21.15.62:0/1261178510 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c01f3f0 con 0x7f6d44148720 2021-12-17T18:18:45.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a8fb700 1 -- 172.21.15.62:0/1261178510 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d440b5e20 con 0x7f6d44148720 2021-12-17T18:18:45.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d36ffd700 1 -- 172.21.15.62:0/1261178510 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d3c00b600 con 0x7f6d44148720 2021-12-17T18:18:45.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a8fb700 1 -- 172.21.15.62:0/1261178510 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d441574e0 con 0x7f6d44148720 2021-12-17T18:18:45.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d4a8fb700 1 -- 172.21.15.62:0/1261178510 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d44156d10 con 0x7f6d44148720 2021-12-17T18:18:45.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d36ffd700 1 -- 172.21.15.62:0/1261178510 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6d3c026030 con 0x7f6d44148720 2021-12-17T18:18:45.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d36ffd700 1 --2- 172.21.15.62:0/1261178510 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d24053580 0x7f6d24055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.378+0000 7f6d36ffd700 1 -- 172.21.15.62:0/1261178510 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6d3c06c3c0 con 0x7f6d44148720 2021-12-17T18:18:45.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.382+0000 7f6d498f9700 1 --2- 172.21.15.62:0/1261178510 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d24053580 0x7f6d24055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.382+0000 7f6d498f9700 1 --2- 172.21.15.62:0/1261178510 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d24053580 0x7f6d24055a40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f6d38008000 tx=0x7f6d38008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:45.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.386+0000 7f6d36ffd700 1 -- 172.21.15.62:0/1261178510 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6d3c043520 con 0x7f6d44148720 2021-12-17T18:18:45.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.510+0000 7f6d4a8fb700 1 -- 172.21.15.62:0/1261178510 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d440573d0 con 0x7f6d44148720 2021-12-17T18:18:45.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.510+0000 7f6d36ffd700 1 -- 172.21.15.62:0/1261178510 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f6d3c015090 con 0x7f6d44148720 2021-12-17T18:18:45.520 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:45.520 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:20.178383+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:17.128555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:18.180577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:45.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.514+0000 7f6d4a8fb700 1 -- 172.21.15.62:0/1261178510 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d24053580 msgr2=0x7f6d24055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.514+0000 7f6d4a8fb700 1 --2- 172.21.15.62:0/1261178510 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d24053580 0x7f6d24055a40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f6d38008000 tx=0x7f6d38008040).stop 2021-12-17T18:18:45.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.514+0000 7f6d4a8fb700 1 -- 172.21.15.62:0/1261178510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d44148720 msgr2=0x7f6d44159cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.514+0000 7f6d4a8fb700 1 --2- 172.21.15.62:0/1261178510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d44148720 0x7f6d44159cc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f6d3c0032f0 tx=0x7f6d3c016000).stop 2021-12-17T18:18:45.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.514+0000 7f6d4a8fb700 1 -- 172.21.15.62:0/1261178510 shutdown_connections 2021-12-17T18:18:45.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.514+0000 7f6d4a8fb700 1 --2- 172.21.15.62:0/1261178510 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d24053580 0x7f6d24055a40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.514+0000 7f6d4a8fb700 1 --2- 172.21.15.62:0/1261178510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d44148720 0x7f6d44159cc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.514+0000 7f6d4a8fb700 1 --2- 172.21.15.62:0/1261178510 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d440b1ff0 0x7f6d440b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.514+0000 7f6d4a8fb700 1 --2- 172.21.15.62:0/1261178510 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6d440aedd0 0x7f6d44156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.514+0000 7f6d4a8fb700 1 -- 172.21.15.62:0/1261178510 >> 172.21.15.62:0/1261178510 conn(0x7f6d4405c750 msgr2=0x7f6d440b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:45.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.514+0000 7f6d4a8fb700 1 -- 172.21.15.62:0/1261178510 shutdown_connections 2021-12-17T18:18:45.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.514+0000 7f6d4a8fb700 1 -- 172.21.15.62:0/1261178510 wait complete. 2021-12-17T18:18:45.533 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:18:17.128555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:18:18.180577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:18:45.534 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:18:45.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.630+0000 7f716d764700 1 Processor -- start 2021-12-17T18:18:45.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.630+0000 7f716d764700 1 -- start start 2021-12-17T18:18:45.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.630+0000 7f716d764700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f71680b05b0 0x7f7168146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.630+0000 7f716d764700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71680b41f0 0x7f7168141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.630+0000 7f716d764700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71680b2010 con 0x7f71680b5dd0 2021-12-17T18:18:45.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.630+0000 7f716d764700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71680b0990 con 0x7f71680b05b0 2021-12-17T18:18:45.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.630+0000 7f716d764700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7168147290 con 0x7f71680b41f0 2021-12-17T18:18:45.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.630+0000 7f71667fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f71680b5dd0 0x7f7168146b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60640/0 (socket says 172.21.15.62:60640) 2021-12-17T18:18:45.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.630+0000 7f71667fc700 1 -- 172.21.15.62:0/3906325301 learned_addr learned my addr 172.21.15.62:0/3906325301 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:45.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.630+0000 7f71677fe700 1 --2- 172.21.15.62:0/3906325301 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71680b41f0 0x7f7168141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.630+0000 7f7166ffd700 1 --2- 172.21.15.62:0/3906325301 >> v2:172.21.15.109:3300/0 conn(0x7f71680b05b0 0x7f7168146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.630+0000 7f7165ffb700 1 -- 172.21.15.62:0/3906325301 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748660467 0 0) 0x7f71680b2010 con 0x7f71680b5dd0 2021-12-17T18:18:45.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.630+0000 7f7165ffb700 1 -- 172.21.15.62:0/3906325301 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7148003260 con 0x7f71680b5dd0 2021-12-17T18:18:45.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f71677fe700 1 -- 172.21.15.62:0/3906325301 >> v2:172.21.15.109:3300/0 conn(0x7f71680b05b0 msgr2=0x7f7168146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:45.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f71677fe700 1 --2- 172.21.15.62:0/3906325301 >> v2:172.21.15.109:3300/0 conn(0x7f71680b05b0 0x7f7168146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f71677fe700 1 -- 172.21.15.62:0/3906325301 >> v1:172.21.15.62:6789/0 conn(0x7f71680b5dd0 legacy=0x7f7168146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f71677fe700 1 -- 172.21.15.62:0/3906325301 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71680b2240 con 0x7f71680b41f0 2021-12-17T18:18:45.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f71677fe700 1 --2- 172.21.15.62:0/3906325301 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71680b41f0 0x7f7168141fd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f71600032f0 tx=0x7f71600091d0).ready entity=mon.2 client_cookie=cd6c5a6f539c95ef server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:45.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f7165ffb700 1 -- 172.21.15.62:0/3906325301 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f716000b600 con 0x7f71680b41f0 2021-12-17T18:18:45.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f7165ffb700 1 -- 172.21.15.62:0/3906325301 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716000b760 con 0x7f71680b41f0 2021-12-17T18:18:45.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f7165ffb700 1 -- 172.21.15.62:0/3906325301 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f716000b8d0 con 0x7f71680b41f0 2021-12-17T18:18:45.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f716d764700 1 -- 172.21.15.62:0/3906325301 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71680b41f0 msgr2=0x7f7168141fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f716d764700 1 --2- 172.21.15.62:0/3906325301 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71680b41f0 0x7f7168141fd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f71600032f0 tx=0x7f71600091d0).stop 2021-12-17T18:18:45.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f716d764700 1 -- 172.21.15.62:0/3906325301 shutdown_connections 2021-12-17T18:18:45.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f716d764700 1 --2- 172.21.15.62:0/3906325301 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71680b41f0 0x7f7168141fd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f716d764700 1 --2- 172.21.15.62:0/3906325301 >> v2:172.21.15.109:3300/0 conn(0x7f71680b05b0 0x7f7168146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f716d764700 1 -- 172.21.15.62:0/3906325301 >> 172.21.15.62:0/3906325301 conn(0x7f7168062510 msgr2=0x7f71680628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:45.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f716d764700 1 -- 172.21.15.62:0/3906325301 shutdown_connections 2021-12-17T18:18:45.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f716d764700 1 -- 172.21.15.62:0/3906325301 wait complete. 2021-12-17T18:18:45.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f716d764700 1 Processor -- start 2021-12-17T18:18:45.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.634+0000 7f716d764700 1 -- start start 2021-12-17T18:18:45.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f716d764700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71680b05b0 0x7f71680b8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f716d764700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71680b41f0 0x7f7168065a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f716d764700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f71680b5dd0 0x7f7168063a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f716d764700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7168063610 con 0x7f71680b41f0 2021-12-17T18:18:45.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f716d764700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7168065f60 con 0x7f71680b5dd0 2021-12-17T18:18:45.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f716d764700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71681487b0 con 0x7f71680b05b0 2021-12-17T18:18:45.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f71667fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71680b41f0 0x7f7168065a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f71667fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71680b41f0 0x7f7168065a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48836/0 (socket says 172.21.15.62:48836) 2021-12-17T18:18:45.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f71667fc700 1 -- 172.21.15.62:0/749593362 learned_addr learned my addr 172.21.15.62:0/749593362 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:45.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f7166ffd700 1 --2- 172.21.15.62:0/749593362 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71680b05b0 0x7f71680b8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f71677fe700 1 --2- 172.21.15.62:0/749593362 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f71680b5dd0 0x7f7168063a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f71667fc700 1 -- 172.21.15.62:0/749593362 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71680b05b0 msgr2=0x7f71680b8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f71667fc700 1 --2- 172.21.15.62:0/749593362 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71680b05b0 0x7f71680b8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f71667fc700 1 -- 172.21.15.62:0/749593362 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f71680b5dd0 msgr2=0x7f7168063a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f71667fc700 1 --2- 172.21.15.62:0/749593362 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f71680b5dd0 0x7f7168063a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f71667fc700 1 -- 172.21.15.62:0/749593362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7160009470 con 0x7f71680b41f0 2021-12-17T18:18:45.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f71677fe700 1 --2- 172.21.15.62:0/749593362 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f71680b5dd0 0x7f7168063a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:45.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f71667fc700 1 --2- 172.21.15.62:0/749593362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71680b41f0 0x7f7168065a70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f7158001110 tx=0x7f7158007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:45.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f715ffff700 1 -- 172.21.15.62:0/749593362 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71580070d0 con 0x7f71680b41f0 2021-12-17T18:18:45.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f715ffff700 1 -- 172.21.15.62:0/749593362 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7158007230 con 0x7f71680b41f0 2021-12-17T18:18:45.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f716d764700 1 -- 172.21.15.62:0/749593362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7168148a50 con 0x7f71680b41f0 2021-12-17T18:18:45.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f715ffff700 1 -- 172.21.15.62:0/749593362 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7158005610 con 0x7f71680b41f0 2021-12-17T18:18:45.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.638+0000 7f716d764700 1 -- 172.21.15.62:0/749593362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7168149040 con 0x7f71680b41f0 2021-12-17T18:18:45.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.642+0000 7f716d764700 1 -- 172.21.15.62:0/749593362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71680b24e0 con 0x7f71680b41f0 2021-12-17T18:18:45.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.642+0000 7f715ffff700 1 -- 172.21.15.62:0/749593362 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f715801a070 con 0x7f71680b41f0 2021-12-17T18:18:45.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.642+0000 7f715ffff700 1 --2- 172.21.15.62:0/749593362 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f714c053640 0x7f714c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.642+0000 7f715ffff700 1 -- 172.21.15.62:0/749593362 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f715806ac30 con 0x7f71680b41f0 2021-12-17T18:18:45.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.642+0000 7f7166ffd700 1 --2- 172.21.15.62:0/749593362 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f714c053640 0x7f714c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.642+0000 7f7166ffd700 1 --2- 172.21.15.62:0/749593362 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f714c053640 0x7f714c055b00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f715000b000 tx=0x7f7150006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:45.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.650+0000 7f715ffff700 1 -- 172.21.15.62:0/749593362 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7158041cf0 con 0x7f71680b41f0 2021-12-17T18:18:45.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.774+0000 7f716d764700 1 -- 172.21.15.62:0/749593362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f71680573d0 con 0x7f71680b41f0 2021-12-17T18:18:45.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.774+0000 7f715ffff700 1 -- 172.21.15.62:0/749593362 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7158045310 con 0x7f71680b41f0 2021-12-17T18:18:45.783 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:18:45.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.774+0000 7f716d764700 1 -- 172.21.15.62:0/749593362 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f714c053640 msgr2=0x7f714c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.774+0000 7f716d764700 1 --2- 172.21.15.62:0/749593362 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f714c053640 0x7f714c055b00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f715000b000 tx=0x7f7150006df0).stop 2021-12-17T18:18:45.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.774+0000 7f716d764700 1 -- 172.21.15.62:0/749593362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71680b41f0 msgr2=0x7f7168065a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.774+0000 7f716d764700 1 --2- 172.21.15.62:0/749593362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71680b41f0 0x7f7168065a70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f7158001110 tx=0x7f7158007a60).stop 2021-12-17T18:18:45.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.774+0000 7f716d764700 1 -- 172.21.15.62:0/749593362 shutdown_connections 2021-12-17T18:18:45.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.774+0000 7f716d764700 1 --2- 172.21.15.62:0/749593362 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f714c053640 0x7f714c055b00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.774+0000 7f716d764700 1 --2- 172.21.15.62:0/749593362 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f71680b5dd0 0x7f7168063a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.774+0000 7f716d764700 1 --2- 172.21.15.62:0/749593362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71680b41f0 0x7f7168065a70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.774+0000 7f716d764700 1 --2- 172.21.15.62:0/749593362 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71680b05b0 0x7f71680b8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.774+0000 7f716d764700 1 -- 172.21.15.62:0/749593362 >> 172.21.15.62:0/749593362 conn(0x7f7168062510 msgr2=0x7f71681467c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:45.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.778+0000 7f716d764700 1 -- 172.21.15.62:0/749593362 shutdown_connections 2021-12-17T18:18:45.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.778+0000 7f716d764700 1 -- 172.21.15.62:0/749593362 wait complete. 2021-12-17T18:18:45.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:18:45.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.894+0000 7f8c9359e700 1 Processor -- start 2021-12-17T18:18:45.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.894+0000 7f8c9359e700 1 -- start start 2021-12-17T18:18:45.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.894+0000 7f8c9359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8c940b4230 0x7f8c940b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.894+0000 7f8c9359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9405ce70 con 0x7f8c940b3540 2021-12-17T18:18:45.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.894+0000 7f8c9359e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c940b1bc0 con 0x7f8c9405ca90 2021-12-17T18:18:45.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.894+0000 7f8c9359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c940b1e60 con 0x7f8c940b4230 2021-12-17T18:18:45.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.894+0000 7f8c92d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8c940b4230 0x7f8c940b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.894+0000 7f8c8bfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8c940b3540 0x7f8c94145a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60654/0 (socket says 172.21.15.62:60654) 2021-12-17T18:18:45.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.894+0000 7f8c8bfff700 1 -- 172.21.15.62:0/1865395252 learned_addr learned my addr 172.21.15.62:0/1865395252 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:45.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.894+0000 7f8c92d9d700 1 -- 172.21.15.62:0/1865395252 >> v1:172.21.15.109:6789/0 conn(0x7f8c9405ca90 legacy=0x7f8c940b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.894+0000 7f8c92d9d700 1 -- 172.21.15.62:0/1865395252 >> v1:172.21.15.62:6789/0 conn(0x7f8c940b3540 legacy=0x7f8c94145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.894+0000 7f8c92d9d700 1 -- 172.21.15.62:0/1865395252 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c940b2100 con 0x7f8c940b4230 2021-12-17T18:18:45.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.894+0000 7f8c92d9d700 1 --2- 172.21.15.62:0/1865395252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c940b4230 0x7f8c940b25a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f8c8c0032f0 tx=0x7f8c8c0091d0).ready entity=mon.0 client_cookie=8f7bff85ed9bcd75 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:45.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.894+0000 7f8c91d9b700 1 -- 172.21.15.62:0/1865395252 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c8c009ea0 con 0x7f8c940b4230 2021-12-17T18:18:45.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.898+0000 7f8c91d9b700 1 -- 172.21.15.62:0/1865395252 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c00b8a0 con 0x7f8c940b4230 2021-12-17T18:18:45.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.898+0000 7f8c91d9b700 1 -- 172.21.15.62:0/1865395252 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c8c00ba10 con 0x7f8c940b4230 2021-12-17T18:18:45.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.898+0000 7f8c9359e700 1 -- 172.21.15.62:0/1865395252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c940b4230 msgr2=0x7f8c940b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.898+0000 7f8c9359e700 1 --2- 172.21.15.62:0/1865395252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c940b4230 0x7f8c940b25a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f8c8c0032f0 tx=0x7f8c8c0091d0).stop 2021-12-17T18:18:45.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.898+0000 7f8c9359e700 1 -- 172.21.15.62:0/1865395252 shutdown_connections 2021-12-17T18:18:45.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.898+0000 7f8c9359e700 1 --2- 172.21.15.62:0/1865395252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c940b4230 0x7f8c940b25a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.898+0000 7f8c9359e700 1 -- 172.21.15.62:0/1865395252 >> 172.21.15.62:0/1865395252 conn(0x7f8c9405bcd0 msgr2=0x7f8c94062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:45.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.898+0000 7f8c9359e700 1 -- 172.21.15.62:0/1865395252 shutdown_connections 2021-12-17T18:18:45.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.898+0000 7f8c9359e700 1 -- 172.21.15.62:0/1865395252 wait complete. 2021-12-17T18:18:45.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.898+0000 7f8c9359e700 1 Processor -- start 2021-12-17T18:18:45.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.898+0000 7f8c9359e700 1 -- start start 2021-12-17T18:18:45.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c9359e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c9405ca90 0x7f8c940a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c9359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c940b3540 0x7f8c940a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c9359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c940b4230 0x7f8c940a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c9359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c94152f80 con 0x7f8c940b4230 2021-12-17T18:18:45.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c9359e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c940aff70 con 0x7f8c9405ca90 2021-12-17T18:18:45.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c9359e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c940afcd0 con 0x7f8c940b3540 2021-12-17T18:18:45.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c92d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c940b4230 0x7f8c940a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c92d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c940b4230 0x7f8c940a6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48852/0 (socket says 172.21.15.62:48852) 2021-12-17T18:18:45.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c92d9d700 1 -- 172.21.15.62:0/208062510 learned_addr learned my addr 172.21.15.62:0/208062510 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:45.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c9259c700 1 --2- 172.21.15.62:0/208062510 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c9405ca90 0x7f8c940a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c8bfff700 1 --2- 172.21.15.62:0/208062510 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c940b3540 0x7f8c940a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c92d9d700 1 -- 172.21.15.62:0/208062510 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c940b3540 msgr2=0x7f8c940a67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c92d9d700 1 --2- 172.21.15.62:0/208062510 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c940b3540 0x7f8c940a67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c92d9d700 1 -- 172.21.15.62:0/208062510 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c9405ca90 msgr2=0x7f8c940a38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:45.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c92d9d700 1 --2- 172.21.15.62:0/208062510 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c9405ca90 0x7f8c940a38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:45.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c92d9d700 1 -- 172.21.15.62:0/208062510 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c009470 con 0x7f8c940b4230 2021-12-17T18:18:45.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c92d9d700 1 --2- 172.21.15.62:0/208062510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c940b4230 0x7f8c940a6cc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f8c8c0032f0 tx=0x7f8c8c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:45.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c8b7fe700 1 -- 172.21.15.62:0/208062510 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c8c009ea0 con 0x7f8c940b4230 2021-12-17T18:18:45.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c8b7fe700 1 -- 172.21.15.62:0/208062510 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c01f3f0 con 0x7f8c940b4230 2021-12-17T18:18:45.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c9359e700 1 -- 172.21.15.62:0/208062510 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c940a34f0 con 0x7f8c940b4230 2021-12-17T18:18:45.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c8b7fe700 1 -- 172.21.15.62:0/208062510 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c8c01f750 con 0x7f8c940b4230 2021-12-17T18:18:45.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.902+0000 7f8c9359e700 1 -- 172.21.15.62:0/208062510 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c940a3de0 con 0x7f8c940b4230 2021-12-17T18:18:45.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.906+0000 7f8c9359e700 1 -- 172.21.15.62:0/208062510 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c940603f0 con 0x7f8c940b4230 2021-12-17T18:18:45.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.906+0000 7f8c8b7fe700 1 -- 172.21.15.62:0/208062510 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8c8c026030 con 0x7f8c940b4230 2021-12-17T18:18:45.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.906+0000 7f8c8b7fe700 1 --2- 172.21.15.62:0/208062510 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c6c053580 0x7f8c6c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:45.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.906+0000 7f8c8b7fe700 1 -- 172.21.15.62:0/208062510 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8c8c06c680 con 0x7f8c940b4230 2021-12-17T18:18:45.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.906+0000 7f8c9259c700 1 --2- 172.21.15.62:0/208062510 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c6c053580 0x7f8c6c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:45.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.906+0000 7f8c9259c700 1 --2- 172.21.15.62:0/208062510 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c6c053580 0x7f8c6c055a40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f8c8400d000 tx=0x7f8c84000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:45.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:45.914+0000 7f8c8b7fe700 1 -- 172.21.15.62:0/208062510 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8c8c047210 con 0x7f8c940b4230 2021-12-17T18:18:46.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.042+0000 7f8c9359e700 1 -- 172.21.15.62:0/208062510 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8c940573d0 con 0x7f8c940b4230 2021-12-17T18:18:46.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.042+0000 7f8c8b7fe700 1 -- 172.21.15.62:0/208062510 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8c8c0150a0 con 0x7f8c940b4230 2021-12-17T18:18:46.050 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:46.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.042+0000 7f8c9359e700 1 -- 172.21.15.62:0/208062510 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c6c053580 msgr2=0x7f8c6c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:46.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.042+0000 7f8c9359e700 1 --2- 172.21.15.62:0/208062510 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c6c053580 0x7f8c6c055a40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f8c8400d000 tx=0x7f8c84000bc0).stop 2021-12-17T18:18:46.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.042+0000 7f8c9359e700 1 -- 172.21.15.62:0/208062510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c940b4230 msgr2=0x7f8c940a6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:46.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.042+0000 7f8c9359e700 1 --2- 172.21.15.62:0/208062510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c940b4230 0x7f8c940a6cc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f8c8c0032f0 tx=0x7f8c8c016000).stop 2021-12-17T18:18:46.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.042+0000 7f8c9359e700 1 -- 172.21.15.62:0/208062510 shutdown_connections 2021-12-17T18:18:46.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.042+0000 7f8c9359e700 1 --2- 172.21.15.62:0/208062510 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c6c053580 0x7f8c6c055a40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.042+0000 7f8c9359e700 1 --2- 172.21.15.62:0/208062510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c940b4230 0x7f8c940a6cc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.042+0000 7f8c9359e700 1 --2- 172.21.15.62:0/208062510 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c940b3540 0x7f8c940a67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.042+0000 7f8c9359e700 1 --2- 172.21.15.62:0/208062510 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c9405ca90 0x7f8c940a38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.042+0000 7f8c9359e700 1 -- 172.21.15.62:0/208062510 >> 172.21.15.62:0/208062510 conn(0x7f8c9405bcd0 msgr2=0x7f8c94148920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:46.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.046+0000 7f8c9359e700 1 -- 172.21.15.62:0/208062510 shutdown_connections 2021-12-17T18:18:46.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.046+0000 7f8c9359e700 1 -- 172.21.15.62:0/208062510 wait complete. 2021-12-17T18:18:46.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:18:46.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f9411ff1700 1 Processor -- start 2021-12-17T18:18:46.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f9411ff1700 1 -- start start 2021-12-17T18:18:46.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f9411ff1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f940c062b60 0x7f940c0b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f9411ff1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940c140e60 con 0x7f940c0625b0 2021-12-17T18:18:46.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f9411ff1700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940c0aecb0 con 0x7f940c0b2d00 2021-12-17T18:18:46.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f9411ff1700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940c0aef50 con 0x7f940c062b60 2021-12-17T18:18:46.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f94117f0700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f940c0625b0 0x7f940c143760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60670/0 (socket says 172.21.15.62:60670) 2021-12-17T18:18:46.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f94117f0700 1 -- 172.21.15.62:0/2775514870 learned_addr learned my addr 172.21.15.62:0/2775514870 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:46.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f940bfff700 1 --2- 172.21.15.62:0/2775514870 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f940c062b60 0x7f940c0b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f940b7fe700 1 -- 172.21.15.62:0/2775514870 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645076083 0 0) 0x7f940c140e60 con 0x7f940c0625b0 2021-12-17T18:18:46.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f940b7fe700 1 -- 172.21.15.62:0/2775514870 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93f0003260 con 0x7f940c0625b0 2021-12-17T18:18:46.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f940b7fe700 1 -- 172.21.15.62:0/2775514870 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155478340 0 0) 0x7f940c0aecb0 con 0x7f940c0b2d00 2021-12-17T18:18:46.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f940b7fe700 1 -- 172.21.15.62:0/2775514870 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f940c140e60 con 0x7f940c0b2d00 2021-12-17T18:18:46.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f940bfff700 1 -- 172.21.15.62:0/2775514870 >> v1:172.21.15.109:6789/0 conn(0x7f940c0b2d00 legacy=0x7f940c139870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:46.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f940bfff700 1 -- 172.21.15.62:0/2775514870 >> v1:172.21.15.62:6789/0 conn(0x7f940c0625b0 legacy=0x7f940c143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:46.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f940b7fe700 1 -- 172.21.15.62:0/2775514870 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1033245804 0 0) 0x7f93f0003260 con 0x7f940c0625b0 2021-12-17T18:18:46.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f940bfff700 1 -- 172.21.15.62:0/2775514870 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c0af1f0 con 0x7f940c062b60 2021-12-17T18:18:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.170+0000 7f940bfff700 1 --2- 172.21.15.62:0/2775514870 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f940c062b60 0x7f940c0b30e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f9400002f70 tx=0x7f9400006df0).ready entity=mon.2 client_cookie=daa97788ed2b1962 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.174+0000 7f940b7fe700 1 -- 172.21.15.62:0/2775514870 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f940000d5c0 con 0x7f940c062b60 2021-12-17T18:18:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.174+0000 7f940b7fe700 1 -- 172.21.15.62:0/2775514870 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9400000e90 con 0x7f940c062b60 2021-12-17T18:18:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.174+0000 7f940b7fe700 1 -- 172.21.15.62:0/2775514870 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f940000d910 con 0x7f940c062b60 2021-12-17T18:18:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.174+0000 7f9411ff1700 1 -- 172.21.15.62:0/2775514870 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f940c062b60 msgr2=0x7f940c0b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:46.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.174+0000 7f9411ff1700 1 --2- 172.21.15.62:0/2775514870 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f940c062b60 0x7f940c0b30e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f9400002f70 tx=0x7f9400006df0).stop 2021-12-17T18:18:46.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.174+0000 7f9411ff1700 1 -- 172.21.15.62:0/2775514870 shutdown_connections 2021-12-17T18:18:46.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.174+0000 7f9411ff1700 1 --2- 172.21.15.62:0/2775514870 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f940c062b60 0x7f940c0b30e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.174+0000 7f9411ff1700 1 -- 172.21.15.62:0/2775514870 >> 172.21.15.62:0/2775514870 conn(0x7f940c060a50 msgr2=0x7f940c05bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:46.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.174+0000 7f9411ff1700 1 -- 172.21.15.62:0/2775514870 shutdown_connections 2021-12-17T18:18:46.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.174+0000 7f9411ff1700 1 -- 172.21.15.62:0/2775514870 wait complete. 2021-12-17T18:18:46.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.174+0000 7f9411ff1700 1 Processor -- start 2021-12-17T18:18:46.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.174+0000 7f9411ff1700 1 -- start start 2021-12-17T18:18:46.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f9411ff1700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f940c0625b0 0x7f940c140340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f9411ff1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f940c062b60 0x7f940c064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f9411ff1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f940c0b2d00 0x7f940c138d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f9411ff1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940c13a8e0 con 0x7f940c062b60 2021-12-17T18:18:46.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f9411ff1700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940c13a640 con 0x7f940c0625b0 2021-12-17T18:18:46.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f9411ff1700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940c13cee0 con 0x7f940c0b2d00 2021-12-17T18:18:46.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f940bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f940c062b60 0x7f940c064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f94117f0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f940c0b2d00 0x7f940c138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f940bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f940c062b60 0x7f940c064490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48864/0 (socket says 172.21.15.62:48864) 2021-12-17T18:18:46.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f940bfff700 1 -- 172.21.15.62:0/2725964052 learned_addr learned my addr 172.21.15.62:0/2725964052 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:46.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f9410fef700 1 --2- 172.21.15.62:0/2725964052 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f940c0625b0 0x7f940c140340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f940bfff700 1 -- 172.21.15.62:0/2725964052 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f940c0b2d00 msgr2=0x7f940c138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:46.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f940bfff700 1 --2- 172.21.15.62:0/2725964052 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f940c0b2d00 0x7f940c138d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f940bfff700 1 -- 172.21.15.62:0/2725964052 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f940c0625b0 msgr2=0x7f940c140340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:46.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f940bfff700 1 --2- 172.21.15.62:0/2725964052 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f940c0625b0 0x7f940c140340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f940bfff700 1 -- 172.21.15.62:0/2725964052 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940000b180 con 0x7f940c062b60 2021-12-17T18:18:46.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f940bfff700 1 --2- 172.21.15.62:0/2725964052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f940c062b60 0x7f940c064490 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f9400002f70 tx=0x7f9400014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f9409ffb700 1 -- 172.21.15.62:0/2725964052 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9400016070 con 0x7f940c062b60 2021-12-17T18:18:46.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f9409ffb700 1 -- 172.21.15.62:0/2725964052 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94000137d0 con 0x7f940c062b60 2021-12-17T18:18:46.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f9411ff1700 1 -- 172.21.15.62:0/2725964052 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f940c13eea0 con 0x7f940c062b60 2021-12-17T18:18:46.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f9409ffb700 1 -- 172.21.15.62:0/2725964052 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9400013b30 con 0x7f940c062b60 2021-12-17T18:18:46.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.178+0000 7f9411ff1700 1 -- 172.21.15.62:0/2725964052 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f940c13a3c0 con 0x7f940c062b60 2021-12-17T18:18:46.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.182+0000 7f9411ff1700 1 -- 172.21.15.62:0/2725964052 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f940c0573d0 con 0x7f940c062b60 2021-12-17T18:18:46.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.182+0000 7f9409ffb700 1 -- 172.21.15.62:0/2725964052 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9400025030 con 0x7f940c062b60 2021-12-17T18:18:46.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.182+0000 7f9409ffb700 1 --2- 172.21.15.62:0/2725964052 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f93ec053610 0x7f93ec055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.182+0000 7f9409ffb700 1 -- 172.21.15.62:0/2725964052 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f940006c6b0 con 0x7f940c062b60 2021-12-17T18:18:46.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.182+0000 7f9410fef700 1 --2- 172.21.15.62:0/2725964052 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f93ec053610 0x7f93ec055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.182+0000 7f9410fef700 1 --2- 172.21.15.62:0/2725964052 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f93ec053610 0x7f93ec055ad0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f93f800d000 tx=0x7f93f8007a20).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:46.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.186+0000 7f9409ffb700 1 -- 172.21.15.62:0/2725964052 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9400043810 con 0x7f940c062b60 2021-12-17T18:18:46.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.306+0000 7f9411ff1700 1 -- 172.21.15.62:0/2725964052 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f940c13d0a0 con 0x7f940c062b60 2021-12-17T18:18:46.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.306+0000 7f9409ffb700 1 -- 172.21.15.62:0/2725964052 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f9400046e30 con 0x7f940c062b60 2021-12-17T18:18:46.316 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:46.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.310+0000 7f9411ff1700 1 -- 172.21.15.62:0/2725964052 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f93ec053610 msgr2=0x7f93ec055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:46.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.310+0000 7f9411ff1700 1 --2- 172.21.15.62:0/2725964052 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f93ec053610 0x7f93ec055ad0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f93f800d000 tx=0x7f93f8007a20).stop 2021-12-17T18:18:46.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.310+0000 7f9411ff1700 1 -- 172.21.15.62:0/2725964052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f940c062b60 msgr2=0x7f940c064490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:46.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.310+0000 7f9411ff1700 1 --2- 172.21.15.62:0/2725964052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f940c062b60 0x7f940c064490 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f9400002f70 tx=0x7f9400014000).stop 2021-12-17T18:18:46.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.310+0000 7f9411ff1700 1 -- 172.21.15.62:0/2725964052 shutdown_connections 2021-12-17T18:18:46.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.310+0000 7f9411ff1700 1 --2- 172.21.15.62:0/2725964052 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f93ec053610 0x7f93ec055ad0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.310+0000 7f9411ff1700 1 --2- 172.21.15.62:0/2725964052 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f940c0b2d00 0x7f940c138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.310+0000 7f9411ff1700 1 --2- 172.21.15.62:0/2725964052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f940c062b60 0x7f940c064490 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.310+0000 7f9411ff1700 1 --2- 172.21.15.62:0/2725964052 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f940c0625b0 0x7f940c140340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.310+0000 7f9411ff1700 1 -- 172.21.15.62:0/2725964052 >> 172.21.15.62:0/2725964052 conn(0x7f940c060a50 msgr2=0x7f940c0b1400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:46.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.310+0000 7f9411ff1700 1 -- 172.21.15.62:0/2725964052 shutdown_connections 2021-12-17T18:18:46.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.310+0000 7f9411ff1700 1 -- 172.21.15.62:0/2725964052 wait complete. 2021-12-17T18:18:46.328 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:18:46.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.422+0000 7f897ee4f700 1 Processor -- start 2021-12-17T18:18:46.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.422+0000 7f897ee4f700 1 -- start start 2021-12-17T18:18:46.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ee4f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f89780b2fb0 0x7f8978061390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ee4f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8978062910 0x7f8978140430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ee4f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8978140920 0x7f89781431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ee4f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897813fd30 con 0x7f8978140920 2021-12-17T18:18:46.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ee4f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897813ff90 con 0x7f89780b2fb0 2021-12-17T18:18:46.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ee4f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89780653d0 con 0x7f8978062910 2021-12-17T18:18:46.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897e64e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8978140920 0x7f89781431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897e64e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8978140920 0x7f89781431f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48874/0 (socket says 172.21.15.62:48874) 2021-12-17T18:18:46.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897e64e700 1 -- 172.21.15.62:0/1500655998 learned_addr learned my addr 172.21.15.62:0/1500655998 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:46.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897de4d700 1 --2- 172.21.15.62:0/1500655998 >> v2:172.21.15.109:3300/0 conn(0x7f89780b2fb0 0x7f8978061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897d64c700 1 --2- 172.21.15.62:0/1500655998 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8978062910 0x7f8978140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897e64e700 1 -- 172.21.15.62:0/1500655998 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8978062910 msgr2=0x7f8978140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:46.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897e64e700 1 --2- 172.21.15.62:0/1500655998 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8978062910 0x7f8978140430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897e64e700 1 -- 172.21.15.62:0/1500655998 >> v2:172.21.15.109:3300/0 conn(0x7f89780b2fb0 msgr2=0x7f8978061390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:46.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897e64e700 1 --2- 172.21.15.62:0/1500655998 >> v2:172.21.15.109:3300/0 conn(0x7f89780b2fb0 0x7f8978061390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897e64e700 1 -- 172.21.15.62:0/1500655998 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89780656a0 con 0x7f8978140920 2021-12-17T18:18:46.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897e64e700 1 --2- 172.21.15.62:0/1500655998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8978140920 0x7f89781431f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f89700032f0 tx=0x7f8970009290).ready entity=mon.0 client_cookie=d3d57530f6af5cf1 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:46.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ce4b700 1 -- 172.21.15.62:0/1500655998 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f897000b870 con 0x7f8978140920 2021-12-17T18:18:46.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ce4b700 1 -- 172.21.15.62:0/1500655998 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897000b9d0 con 0x7f8978140920 2021-12-17T18:18:46.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ce4b700 1 -- 172.21.15.62:0/1500655998 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f897000bb40 con 0x7f8978140920 2021-12-17T18:18:46.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ee4f700 1 -- 172.21.15.62:0/1500655998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8978140920 msgr2=0x7f89781431f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:46.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ee4f700 1 --2- 172.21.15.62:0/1500655998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8978140920 0x7f89781431f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f89700032f0 tx=0x7f8970009290).stop 2021-12-17T18:18:46.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ee4f700 1 -- 172.21.15.62:0/1500655998 shutdown_connections 2021-12-17T18:18:46.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ee4f700 1 --2- 172.21.15.62:0/1500655998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8978140920 0x7f89781431f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ee4f700 1 --2- 172.21.15.62:0/1500655998 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8978062910 0x7f8978140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ee4f700 1 --2- 172.21.15.62:0/1500655998 >> v2:172.21.15.109:3300/0 conn(0x7f89780b2fb0 0x7f8978061390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ee4f700 1 -- 172.21.15.62:0/1500655998 >> 172.21.15.62:0/1500655998 conn(0x7f8978063510 msgr2=0x7f89780638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:46.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ee4f700 1 -- 172.21.15.62:0/1500655998 shutdown_connections 2021-12-17T18:18:46.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.426+0000 7f897ee4f700 1 -- 172.21.15.62:0/1500655998 wait complete. 2021-12-17T18:18:46.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.430+0000 7f897ee4f700 1 Processor -- start 2021-12-17T18:18:46.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.430+0000 7f897ee4f700 1 -- start start 2021-12-17T18:18:46.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.430+0000 7f897ee4f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8978062910 0x7f89780afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.430+0000 7f897ee4f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f89780b2fb0 0x7f89781503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.430+0000 7f897ee4f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8978140920 0x7f89781508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897ee4f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8978145cf0 con 0x7f8978140920 2021-12-17T18:18:46.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897ee4f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8978145f90 con 0x7f8978062910 2021-12-17T18:18:46.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897ee4f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8978146230 con 0x7f89780b2fb0 2021-12-17T18:18:46.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897e64e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8978140920 0x7f89781508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897de4d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8978062910 0x7f89780afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897d64c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f89780b2fb0 0x7f89781503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897e64e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8978140920 0x7f89781508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48880/0 (socket says 172.21.15.62:48880) 2021-12-17T18:18:46.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897e64e700 1 -- 172.21.15.62:0/1301124210 learned_addr learned my addr 172.21.15.62:0/1301124210 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:46.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897e64e700 1 -- 172.21.15.62:0/1301124210 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f89780b2fb0 msgr2=0x7f89781503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:46.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897e64e700 1 --2- 172.21.15.62:0/1301124210 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f89780b2fb0 0x7f89781503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897e64e700 1 -- 172.21.15.62:0/1301124210 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8978062910 msgr2=0x7f89780afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:46.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897e64e700 1 --2- 172.21.15.62:0/1301124210 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8978062910 0x7f89780afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897e64e700 1 -- 172.21.15.62:0/1301124210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8970009530 con 0x7f8978140920 2021-12-17T18:18:46.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897de4d700 1 --2- 172.21.15.62:0/1301124210 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8978062910 0x7f89780afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:46.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897e64e700 1 --2- 172.21.15.62:0/1301124210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8978140920 0x7f89781508b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f89700032f0 tx=0x7f8970016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:46.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f8966ffd700 1 -- 172.21.15.62:0/1301124210 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f897000b870 con 0x7f8978140920 2021-12-17T18:18:46.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897ee4f700 1 -- 172.21.15.62:0/1301124210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89781458c0 con 0x7f8978140920 2021-12-17T18:18:46.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f8966ffd700 1 -- 172.21.15.62:0/1301124210 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8970021630 con 0x7f8978140920 2021-12-17T18:18:46.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f8966ffd700 1 -- 172.21.15.62:0/1301124210 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8970011ea0 con 0x7f8978140920 2021-12-17T18:18:46.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897ee4f700 1 -- 172.21.15.62:0/1301124210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8978150f40 con 0x7f8978140920 2021-12-17T18:18:46.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f897ee4f700 1 -- 172.21.15.62:0/1301124210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8978145c50 con 0x7f8978140920 2021-12-17T18:18:46.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f8966ffd700 1 -- 172.21.15.62:0/1301124210 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f897000f070 con 0x7f8978140920 2021-12-17T18:18:46.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.434+0000 7f8966ffd700 1 --2- 172.21.15.62:0/1301124210 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f89580536a0 0x7f8958055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.438+0000 7f8966ffd700 1 -- 172.21.15.62:0/1301124210 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f897006cb30 con 0x7f8978140920 2021-12-17T18:18:46.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.438+0000 7f897de4d700 1 --2- 172.21.15.62:0/1301124210 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f89580536a0 0x7f8958055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.438+0000 7f897de4d700 1 --2- 172.21.15.62:0/1301124210 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f89580536a0 0x7f8958055b60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f897400c000 tx=0x7f8974008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:46.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.446+0000 7f8966ffd700 1 -- 172.21.15.62:0/1301124210 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8970043c70 con 0x7f8978140920 2021-12-17T18:18:46.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.570+0000 7f897ee4f700 1 -- 172.21.15.62:0/1301124210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89780b3390 con 0x7f8978140920 2021-12-17T18:18:46.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.574+0000 7f8966ffd700 1 -- 172.21.15.62:0/1301124210 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8970015070 con 0x7f8978140920 2021-12-17T18:18:46.580 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:46.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.574+0000 7f897ee4f700 1 -- 172.21.15.62:0/1301124210 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f89580536a0 msgr2=0x7f8958055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:46.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.574+0000 7f897ee4f700 1 --2- 172.21.15.62:0/1301124210 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f89580536a0 0x7f8958055b60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f897400c000 tx=0x7f8974008040).stop 2021-12-17T18:18:46.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.574+0000 7f897ee4f700 1 -- 172.21.15.62:0/1301124210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8978140920 msgr2=0x7f89781508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:46.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.574+0000 7f897ee4f700 1 --2- 172.21.15.62:0/1301124210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8978140920 0x7f89781508b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f89700032f0 tx=0x7f8970016000).stop 2021-12-17T18:18:46.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.574+0000 7f897ee4f700 1 -- 172.21.15.62:0/1301124210 shutdown_connections 2021-12-17T18:18:46.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.574+0000 7f897ee4f700 1 --2- 172.21.15.62:0/1301124210 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f89580536a0 0x7f8958055b60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.574+0000 7f897ee4f700 1 --2- 172.21.15.62:0/1301124210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8978140920 0x7f89781508b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.574+0000 7f897ee4f700 1 --2- 172.21.15.62:0/1301124210 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f89780b2fb0 0x7f89781503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.574+0000 7f897ee4f700 1 --2- 172.21.15.62:0/1301124210 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8978062910 0x7f89780afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.574+0000 7f897ee4f700 1 -- 172.21.15.62:0/1301124210 >> 172.21.15.62:0/1301124210 conn(0x7f8978063510 msgr2=0x7f89780b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:46.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.574+0000 7f897ee4f700 1 -- 172.21.15.62:0/1301124210 shutdown_connections 2021-12-17T18:18:46.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.574+0000 7f897ee4f700 1 -- 172.21.15.62:0/1301124210 wait complete. 2021-12-17T18:18:46.603 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) 2021-12-17T18:18:46.605 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-12-17T18:18:46.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.710+0000 7fdba6817700 1 Processor -- start 2021-12-17T18:18:46.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.710+0000 7fdba6817700 1 -- start start 2021-12-17T18:18:46.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6817700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fdba00b5c80 0x7fdba00b6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6817700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdba00afcf0 0x7fdba0142b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6817700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdba0143060 0x7fdba0143490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6817700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba00b1540 con 0x7fdba0143060 2021-12-17T18:18:46.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6817700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba00b0140 con 0x7fdba00b5c80 2021-12-17T18:18:46.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6817700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba00af5b0 con 0x7fdba00afcf0 2021-12-17T18:18:46.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6016700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdba0143060 0x7fdba0143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6016700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdba0143060 0x7fdba0143490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48886/0 (socket says 172.21.15.62:48886) 2021-12-17T18:18:46.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6016700 1 -- 172.21.15.62:0/2571868951 learned_addr learned my addr 172.21.15.62:0/2571868951 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:46.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba5815700 1 --2- 172.21.15.62:0/2571868951 >> v2:172.21.15.109:3300/0 conn(0x7fdba00b5c80 0x7fdba00b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba5014700 1 --2- 172.21.15.62:0/2571868951 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdba00afcf0 0x7fdba0142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6016700 1 -- 172.21.15.62:0/2571868951 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdba00afcf0 msgr2=0x7fdba0142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:46.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6016700 1 --2- 172.21.15.62:0/2571868951 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdba00afcf0 0x7fdba0142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6016700 1 -- 172.21.15.62:0/2571868951 >> v2:172.21.15.109:3300/0 conn(0x7fdba00b5c80 msgr2=0x7fdba00b6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:46.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6016700 1 --2- 172.21.15.62:0/2571868951 >> v2:172.21.15.109:3300/0 conn(0x7fdba00b5c80 0x7fdba00b6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6016700 1 -- 172.21.15.62:0/2571868951 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba00af850 con 0x7fdba0143060 2021-12-17T18:18:46.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba5014700 1 --2- 172.21.15.62:0/2571868951 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdba00afcf0 0x7fdba0142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:46.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6016700 1 --2- 172.21.15.62:0/2571868951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdba0143060 0x7fdba0143490 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fdb980032f0 tx=0x7fdb98009290).ready entity=mon.0 client_cookie=f08966c8d75459f8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:46.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba4813700 1 -- 172.21.15.62:0/2571868951 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb9800b870 con 0x7fdba0143060 2021-12-17T18:18:46.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba4813700 1 -- 172.21.15.62:0/2571868951 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9800b9d0 con 0x7fdba0143060 2021-12-17T18:18:46.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba4813700 1 -- 172.21.15.62:0/2571868951 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb9800bb40 con 0x7fdba0143060 2021-12-17T18:18:46.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6817700 1 -- 172.21.15.62:0/2571868951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdba0143060 msgr2=0x7fdba0143490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:46.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6817700 1 --2- 172.21.15.62:0/2571868951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdba0143060 0x7fdba0143490 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fdb980032f0 tx=0x7fdb98009290).stop 2021-12-17T18:18:46.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6817700 1 -- 172.21.15.62:0/2571868951 shutdown_connections 2021-12-17T18:18:46.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6817700 1 --2- 172.21.15.62:0/2571868951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdba0143060 0x7fdba0143490 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6817700 1 --2- 172.21.15.62:0/2571868951 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdba00afcf0 0x7fdba0142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6817700 1 --2- 172.21.15.62:0/2571868951 >> v2:172.21.15.109:3300/0 conn(0x7fdba00b5c80 0x7fdba00b6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6817700 1 -- 172.21.15.62:0/2571868951 >> 172.21.15.62:0/2571868951 conn(0x7fdba005c750 msgr2=0x7fdba005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:46.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6817700 1 -- 172.21.15.62:0/2571868951 shutdown_connections 2021-12-17T18:18:46.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.714+0000 7fdba6817700 1 -- 172.21.15.62:0/2571868951 wait complete. 2021-12-17T18:18:46.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba6817700 1 Processor -- start 2021-12-17T18:18:46.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba6817700 1 -- start start 2021-12-17T18:18:46.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba6817700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdba00afcf0 0x7fdba013f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba6817700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdba00b5c80 0x7fdba013c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba6817700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdba0143060 0x7fdba013c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba6817700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba00a46d0 con 0x7fdba00afcf0 2021-12-17T18:18:46.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba6817700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba0065d70 con 0x7fdba0143060 2021-12-17T18:18:46.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba6817700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba0066fe0 con 0x7fdba00b5c80 2021-12-17T18:18:46.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba5815700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdba00afcf0 0x7fdba013f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba5815700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdba00afcf0 0x7fdba013f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48890/0 (socket says 172.21.15.62:48890) 2021-12-17T18:18:46.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba6016700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdba0143060 0x7fdba013c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba5815700 1 -- 172.21.15.62:0/733013133 learned_addr learned my addr 172.21.15.62:0/733013133 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:46.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba5014700 1 --2- 172.21.15.62:0/733013133 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdba00b5c80 0x7fdba013c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba5815700 1 -- 172.21.15.62:0/733013133 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdba00b5c80 msgr2=0x7fdba013c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:46.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba5815700 1 --2- 172.21.15.62:0/733013133 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdba00b5c80 0x7fdba013c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba5815700 1 -- 172.21.15.62:0/733013133 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdba0143060 msgr2=0x7fdba013c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:46.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba5815700 1 --2- 172.21.15.62:0/733013133 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdba0143060 0x7fdba013c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:46.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba5815700 1 -- 172.21.15.62:0/733013133 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb98009530 con 0x7fdba00afcf0 2021-12-17T18:18:46.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba6016700 1 --2- 172.21.15.62:0/733013133 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdba0143060 0x7fdba013c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:46.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba5815700 1 --2- 172.21.15.62:0/733013133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdba00afcf0 0x7fdba013f6a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fdb9c00c000 tx=0x7fdb9c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:46.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdb92ffd700 1 -- 172.21.15.62:0/733013133 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb9c010780 con 0x7fdba00afcf0 2021-12-17T18:18:46.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdb92ffd700 1 -- 172.21.15.62:0/733013133 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c0108e0 con 0x7fdba00afcf0 2021-12-17T18:18:46.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba6817700 1 -- 172.21.15.62:0/733013133 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba00a5ca0 con 0x7fdba00afcf0 2021-12-17T18:18:46.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdb92ffd700 1 -- 172.21.15.62:0/733013133 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb9c010c40 con 0x7fdba00afcf0 2021-12-17T18:18:46.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.718+0000 7fdba6817700 1 -- 172.21.15.62:0/733013133 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba0066b40 con 0x7fdba00afcf0 2021-12-17T18:18:46.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.722+0000 7fdba6817700 1 -- 172.21.15.62:0/733013133 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba0066d00 con 0x7fdba00afcf0 2021-12-17T18:18:46.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.722+0000 7fdb92ffd700 1 -- 172.21.15.62:0/733013133 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdb9c01c460 con 0x7fdba00afcf0 2021-12-17T18:18:46.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.722+0000 7fdb92ffd700 1 --2- 172.21.15.62:0/733013133 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdb800535b0 0x7fdb80055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:46.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.722+0000 7fdb92ffd700 1 -- 172.21.15.62:0/733013133 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdb9c06bd40 con 0x7fdba00afcf0 2021-12-17T18:18:46.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.722+0000 7fdba5014700 1 --2- 172.21.15.62:0/733013133 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdb800535b0 0x7fdb80055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:46.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.722+0000 7fdba5014700 1 --2- 172.21.15.62:0/733013133 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdb800535b0 0x7fdb80055a70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fdb9400c000 tx=0x7fdb94008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:46.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.726+0000 7fdb92ffd700 1 -- 172.21.15.62:0/733013133 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdb9c042da0 con 0x7fdba00afcf0 2021-12-17T18:18:46.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:46.890+0000 7fdba6817700 1 -- 172.21.15.62:0/733013133 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7fdba0143980 con 0x7fdba00afcf0 2021-12-17T18:18:47.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.654+0000 7fdb92ffd700 1 -- 172.21.15.62:0/733013133 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v44) v1 ==== 142+0+0 (secure 0 0 0) 0x7fdb9c0463c0 con 0x7fdba00afcf0 2021-12-17T18:18:47.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.658+0000 7fdba6817700 1 -- 172.21.15.62:0/733013133 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdb800535b0 msgr2=0x7fdb80055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:47.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.658+0000 7fdba6817700 1 --2- 172.21.15.62:0/733013133 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdb800535b0 0x7fdb80055a70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fdb9400c000 tx=0x7fdb94008040).stop 2021-12-17T18:18:47.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.658+0000 7fdba6817700 1 -- 172.21.15.62:0/733013133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdba00afcf0 msgr2=0x7fdba013f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:47.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.658+0000 7fdba6817700 1 --2- 172.21.15.62:0/733013133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdba00afcf0 0x7fdba013f6a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fdb9c00c000 tx=0x7fdb9c006df0).stop 2021-12-17T18:18:47.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.658+0000 7fdba6817700 1 -- 172.21.15.62:0/733013133 shutdown_connections 2021-12-17T18:18:47.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.658+0000 7fdba6817700 1 --2- 172.21.15.62:0/733013133 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdb800535b0 0x7fdb80055a70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:47.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.658+0000 7fdba6817700 1 --2- 172.21.15.62:0/733013133 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdba0143060 0x7fdba013c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:47.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.658+0000 7fdba6817700 1 --2- 172.21.15.62:0/733013133 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdba00b5c80 0x7fdba013c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:47.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.658+0000 7fdba6817700 1 --2- 172.21.15.62:0/733013133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdba00afcf0 0x7fdba013f6a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:47.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.658+0000 7fdba6817700 1 -- 172.21.15.62:0/733013133 >> 172.21.15.62:0/733013133 conn(0x7fdba005c750 msgr2=0x7fdba00b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:47.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.662+0000 7fdba6817700 1 -- 172.21.15.62:0/733013133 shutdown_connections 2021-12-17T18:18:47.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.662+0000 7fdba6817700 1 -- 172.21.15.62:0/733013133 wait complete. 2021-12-17T18:18:47.684 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-12-17T18:18:47.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa17d74700 1 Processor -- start 2021-12-17T18:18:47.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa17d74700 1 -- start start 2021-12-17T18:18:47.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa17d74700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7faa100b07c0 0x7faa100b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:47.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa17d74700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa100606e0 con 0x7faa100b5330 2021-12-17T18:18:47.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa17d74700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa10060980 con 0x7faa10147440 2021-12-17T18:18:47.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa17d74700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa10141950 con 0x7faa100b07c0 2021-12-17T18:18:47.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa15b10700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7faa100b5330 0x7faa10147b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60710/0 (socket says 172.21.15.62:60710) 2021-12-17T18:18:47.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa15b10700 1 -- 172.21.15.62:0/3181396139 learned_addr learned my addr 172.21.15.62:0/3181396139 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:47.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa1530f700 1 --2- 172.21.15.62:0/3181396139 >> v2:172.21.15.109:3300/0 conn(0x7faa100b07c0 0x7faa100b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:47.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa14b0e700 1 -- 172.21.15.62:0/3181396139 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924684032 0 0) 0x7faa100606e0 con 0x7faa100b5330 2021-12-17T18:18:47.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa14b0e700 1 -- 172.21.15.62:0/3181396139 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f8003260 con 0x7faa100b5330 2021-12-17T18:18:47.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa14b0e700 1 -- 172.21.15.62:0/3181396139 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1297077844 0 0) 0x7fa9f8003260 con 0x7faa100b5330 2021-12-17T18:18:47.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa14b0e700 1 -- 172.21.15.62:0/3181396139 >> v2:172.21.15.109:3300/0 conn(0x7faa100b07c0 msgr2=0x7faa100b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:47.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa14b0e700 1 --2- 172.21.15.62:0/3181396139 >> v2:172.21.15.109:3300/0 conn(0x7faa100b07c0 0x7faa100b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:47.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa14b0e700 1 -- 172.21.15.62:0/3181396139 >> v1:172.21.15.109:6789/0 conn(0x7faa10147440 legacy=0x7faa1014ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:47.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa14b0e700 1 -- 172.21.15.62:0/3181396139 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa10148250 con 0x7faa100b5330 2021-12-17T18:18:47.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa14b0e700 1 -- 172.21.15.62:0/3181396139 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7faa0c001660 con 0x7faa100b5330 2021-12-17T18:18:47.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa14b0e700 1 -- 172.21.15.62:0/3181396139 >> v1:172.21.15.62:6789/0 conn(0x7faa100b5330 legacy=0x7faa10147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:47.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa14b0e700 1 --2- 172.21.15.62:0/3181396139 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa9f8003750 0x7fa9f8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:47.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa14b0e700 1 --2- 172.21.15.62:0/3181396139 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa9f8004500 0x7fa9f8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:47.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa14b0e700 1 --2- 172.21.15.62:0/3181396139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8004e70 0x7fa9f800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:47.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa14b0e700 1 -- 172.21.15.62:0/3181396139 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa10141950 con 0x7fa9f8004e70 2021-12-17T18:18:47.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa14b0e700 1 -- 172.21.15.62:0/3181396139 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f800bd20 con 0x7fa9f8004500 2021-12-17T18:18:47.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa14b0e700 1 -- 172.21.15.62:0/3181396139 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f800bee0 con 0x7fa9f8003750 2021-12-17T18:18:47.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa16311700 1 --2- 172.21.15.62:0/3181396139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8004e70 0x7fa9f800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:47.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa15b10700 1 --2- 172.21.15.62:0/3181396139 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa9f8003750 0x7fa9f8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:47.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa1530f700 1 --2- 172.21.15.62:0/3181396139 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa9f8004500 0x7fa9f8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:47.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.790+0000 7faa16311700 1 -- 172.21.15.62:0/3181396139 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa9f8003750 msgr2=0x7fa9f8003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:47.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.794+0000 7faa16311700 1 --2- 172.21.15.62:0/3181396139 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa9f8003750 0x7fa9f8003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:47.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.794+0000 7faa16311700 1 -- 172.21.15.62:0/3181396139 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa9f8004500 msgr2=0x7fa9f8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:47.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.794+0000 7faa16311700 1 --2- 172.21.15.62:0/3181396139 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa9f8004500 0x7fa9f8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:47.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.794+0000 7faa16311700 1 -- 172.21.15.62:0/3181396139 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f8003260 con 0x7fa9f8004e70 2021-12-17T18:18:47.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.794+0000 7faa16311700 1 -- 172.21.15.62:0/3181396139 reap_dead start 2021-12-17T18:18:47.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.794+0000 7faa16311700 1 --2- 172.21.15.62:0/3181396139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8004e70 0x7fa9f800b750 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7faa10063080 tx=0x7faa08007d80).ready entity=mon.0 client_cookie=4e20a363490c7c00 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:47.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.794+0000 7faa14b0e700 1 -- 172.21.15.62:0/3181396139 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa08001620 con 0x7fa9f8004e70 2021-12-17T18:18:47.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.794+0000 7faa14b0e700 1 -- 172.21.15.62:0/3181396139 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa08006890 con 0x7fa9f8004e70 2021-12-17T18:18:47.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.794+0000 7faa14b0e700 1 -- 172.21.15.62:0/3181396139 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa08006bf0 con 0x7fa9f8004e70 2021-12-17T18:18:47.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.794+0000 7faa17d74700 1 -- 172.21.15.62:0/3181396139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8004e70 msgr2=0x7fa9f800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:47.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.794+0000 7faa17d74700 1 --2- 172.21.15.62:0/3181396139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8004e70 0x7fa9f800b750 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7faa10063080 tx=0x7faa08007d80).stop 2021-12-17T18:18:47.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.794+0000 7faa17d74700 1 -- 172.21.15.62:0/3181396139 shutdown_connections 2021-12-17T18:18:47.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.794+0000 7faa17d74700 1 --2- 172.21.15.62:0/3181396139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8004e70 0x7fa9f800b750 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:47.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.794+0000 7faa17d74700 1 -- 172.21.15.62:0/3181396139 >> 172.21.15.62:0/3181396139 conn(0x7faa1005c750 msgr2=0x7faa1005cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:47.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.794+0000 7faa17d74700 1 -- 172.21.15.62:0/3181396139 shutdown_connections 2021-12-17T18:18:47.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.794+0000 7faa17d74700 1 -- 172.21.15.62:0/3181396139 wait complete. 2021-12-17T18:18:47.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa17d74700 1 Processor -- start 2021-12-17T18:18:47.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa17d74700 1 -- start start 2021-12-17T18:18:47.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa17d74700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8004e70 0x7faa1014ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:47.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa17d74700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faa10063570 0x7faa100639d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:47.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa17d74700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faa100ad890 0x7faa100add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:47.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa17d74700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa101424d0 con 0x7fa9f8004e70 2021-12-17T18:18:47.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa17d74700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa10141c10 con 0x7faa100ad890 2021-12-17T18:18:47.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa17d74700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa10144d40 con 0x7faa10063570 2021-12-17T18:18:47.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa15b10700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8004e70 0x7faa1014ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:47.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa15b10700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8004e70 0x7faa1014ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48910/0 (socket says 172.21.15.62:48910) 2021-12-17T18:18:47.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa15b10700 1 -- 172.21.15.62:0/208870598 learned_addr learned my addr 172.21.15.62:0/208870598 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:47.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa1530f700 1 --2- 172.21.15.62:0/208870598 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faa10063570 0x7faa100639d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:47.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa16311700 1 --2- 172.21.15.62:0/208870598 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faa100ad890 0x7faa100add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:47.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa15b10700 1 -- 172.21.15.62:0/208870598 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faa10063570 msgr2=0x7faa100639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:47.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa15b10700 1 --2- 172.21.15.62:0/208870598 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faa10063570 0x7faa100639d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:47.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa15b10700 1 -- 172.21.15.62:0/208870598 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faa100ad890 msgr2=0x7faa100add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:47.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa15b10700 1 --2- 172.21.15.62:0/208870598 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faa100ad890 0x7faa100add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:47.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa15b10700 1 -- 172.21.15.62:0/208870598 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa100ae930 con 0x7fa9f8004e70 2021-12-17T18:18:47.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa16311700 1 --2- 172.21.15.62:0/208870598 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faa100ad890 0x7faa100add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:47.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa15b10700 1 --2- 172.21.15.62:0/208870598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8004e70 0x7faa1014ad60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7faa0c00d000 tx=0x7faa0c001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:47.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7fa9feffd700 1 -- 172.21.15.62:0/208870598 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa0c0116b0 con 0x7fa9f8004e70 2021-12-17T18:18:47.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7fa9feffd700 1 -- 172.21.15.62:0/208870598 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c011810 con 0x7fa9f8004e70 2021-12-17T18:18:47.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7fa9feffd700 1 -- 172.21.15.62:0/208870598 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa0c011b70 con 0x7fa9f8004e70 2021-12-17T18:18:47.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa17d74700 1 -- 172.21.15.62:0/208870598 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa100af480 con 0x7fa9f8004e70 2021-12-17T18:18:47.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.798+0000 7faa17d74700 1 -- 172.21.15.62:0/208870598 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa10063ec0 con 0x7fa9f8004e70 2021-12-17T18:18:47.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.802+0000 7faa17d74700 1 -- 172.21.15.62:0/208870598 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa10141d80 con 0x7fa9f8004e70 2021-12-17T18:18:47.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.802+0000 7fa9feffd700 1 -- 172.21.15.62:0/208870598 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faa0c01b030 con 0x7fa9f8004e70 2021-12-17T18:18:47.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.802+0000 7fa9feffd700 1 --2- 172.21.15.62:0/208870598 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa9f00534f0 0x7fa9f00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:47.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.802+0000 7fa9feffd700 1 -- 172.21.15.62:0/208870598 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faa0c06b5a0 con 0x7fa9f8004e70 2021-12-17T18:18:47.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.802+0000 7faa1530f700 1 --2- 172.21.15.62:0/208870598 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa9f00534f0 0x7fa9f00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:47.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.802+0000 7faa1530f700 1 --2- 172.21.15.62:0/208870598 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa9f00534f0 0x7fa9f00559b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7faa0000b000 tx=0x7faa00006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:47.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.810+0000 7fa9feffd700 1 -- 172.21.15.62:0/208870598 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faa10141d80 con 0x7fa9f8004e70 2021-12-17T18:18:47.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.938+0000 7faa17d74700 1 -- 172.21.15.62:0/208870598 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7faa10141d80 con 0x7fa9f8004e70 2021-12-17T18:18:47.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.946+0000 7fa9feffd700 1 -- 172.21.15.62:0/208870598 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7faa10141d80 con 0x7fa9f8004e70 2021-12-17T18:18:47.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.950+0000 7faa17d74700 1 -- 172.21.15.62:0/208870598 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa9f00534f0 msgr2=0x7fa9f00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:47.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.950+0000 7faa17d74700 1 --2- 172.21.15.62:0/208870598 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa9f00534f0 0x7fa9f00559b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7faa0000b000 tx=0x7faa00006df0).stop 2021-12-17T18:18:47.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.950+0000 7faa17d74700 1 -- 172.21.15.62:0/208870598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8004e70 msgr2=0x7faa1014ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:47.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.950+0000 7faa17d74700 1 --2- 172.21.15.62:0/208870598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8004e70 0x7faa1014ad60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7faa0c00d000 tx=0x7faa0c001e10).stop 2021-12-17T18:18:47.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.950+0000 7faa17d74700 1 -- 172.21.15.62:0/208870598 shutdown_connections 2021-12-17T18:18:47.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.950+0000 7faa17d74700 1 --2- 172.21.15.62:0/208870598 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa9f00534f0 0x7fa9f00559b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:47.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.950+0000 7faa17d74700 1 --2- 172.21.15.62:0/208870598 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faa100ad890 0x7faa100add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:47.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.950+0000 7faa17d74700 1 --2- 172.21.15.62:0/208870598 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faa10063570 0x7faa100639d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:47.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.950+0000 7faa17d74700 1 --2- 172.21.15.62:0/208870598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8004e70 0x7faa1014ad60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:47.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.950+0000 7faa17d74700 1 -- 172.21.15.62:0/208870598 >> 172.21.15.62:0/208870598 conn(0x7faa1005c750 msgr2=0x7faa1013fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:47.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.950+0000 7faa17d74700 1 -- 172.21.15.62:0/208870598 shutdown_connections 2021-12-17T18:18:47.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:47.950+0000 7faa17d74700 1 -- 172.21.15.62:0/208870598 wait complete. 2021-12-17T18:18:47.969 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:18:47.970 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:18:47.991 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:18:48.012 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:18:48.034 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:18:48.055 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:18:48.077 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:18:48.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:48.078 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:18:48.078 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:18:48.086 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:18:48.087 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:18:48.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:48.088 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:18:48.089 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:18:48.135 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:18:48.137 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:18:48.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:48.138 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:18:48.139 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:18:48.146 INFO:teuthology.orchestra.run.smithi125.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-12-17T18:18:48.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:18:48.147 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-12-17T18:18:48.148 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:18:48.148 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:18:48.149 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:18:48.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:48.222 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:18:48.222 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:18:48.229 INFO:teuthology.orchestra.run.smithi125.stdout:ext2/ext3 2021-12-17T18:18:48.230 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:18:48.230 INFO:teuthology.orchestra.run:waiting for 900 2021-12-17T18:18:48.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:18:48.231 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:18:48.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:48.245 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:18:48.245 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:18:48.254 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:18:48.255 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:18:48.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:48.256 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:18:48.256 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:18:48.264 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:18:48.265 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:18:48.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:48.266 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:18:48.267 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:18:48.313 INFO:teuthology.orchestra.run.smithi158.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': Transport endpoint is not connected 2021-12-17T18:18:48.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:18:48.314 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.1 2021-12-17T18:18:48.315 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi158.front.sepia.ceph.com... 2021-12-17T18:18:48.315 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:18:48.316 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:18:48.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:48.343 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:18:48.343 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:18:48.389 INFO:teuthology.orchestra.run.smithi158.stdout:ext2/ext3 2021-12-17T18:18:48.390 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:18:48.391 INFO:teuthology.orchestra.run:waiting for 900 2021-12-17T18:18:48.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:18:48.392 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:18:48.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:48.423 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:18:48.423 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:18:48.432 INFO:teuthology.orchestra.run.smithi192.stdout:fuseblk 2021-12-17T18:18:48.433 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2021-12-17T18:18:48.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:48.434 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:18:48.435 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:18:48.443 INFO:teuthology.orchestra.run.smithi192.stdout:fuseblk 2021-12-17T18:18:48.444 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2021-12-17T18:18:48.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:48.445 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:18:48.445 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:18:48.494 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': Transport endpoint is not connected 2021-12-17T18:18:48.495 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:18:48.496 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.2 2021-12-17T18:18:48.496 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi192.front.sepia.ceph.com... 2021-12-17T18:18:48.496 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:18:48.497 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:18:48.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:18:48.526 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:18:48.526 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:18:48.533 INFO:teuthology.orchestra.run.smithi192.stdout:ext2/ext3 2021-12-17T18:18:48.534 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:18:48.535 INFO:teuthology.orchestra.run:waiting for 900 2021-12-17T18:18:48.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:18:48.537 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:18:48.593 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:18:48.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.694+0000 7fd404ec2700 1 Processor -- start 2021-12-17T18:18:48.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.694+0000 7fd404ec2700 1 -- start start 2021-12-17T18:18:48.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd404ec2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd4000b5b20 0x7fd4000b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:48.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd404ec2700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd4000b3760 0x7fd4000b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:48.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd404ec2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4000b6c70 0x7fd400146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:48.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd404ec2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4000b5f00 con 0x7fd4000b5b20 2021-12-17T18:18:48.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd404ec2700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4000b3020 con 0x7fd4000b3760 2021-12-17T18:18:48.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd404ec2700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000b32c0 con 0x7fd4000b6c70 2021-12-17T18:18:48.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd3ff7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd4000b5b20 0x7fd4000b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:48.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd3ff7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd4000b5b20 0x7fd4000b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48920/0 (socket says 172.21.15.62:48920) 2021-12-17T18:18:48.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd3ff7fe700 1 -- 172.21.15.62:0/4075934252 learned_addr learned my addr 172.21.15.62:0/4075934252 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:48.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd3f7fff700 1 --2- 172.21.15.62:0/4075934252 >> v2:172.21.15.109:3300/0 conn(0x7fd4000b3760 0x7fd4000b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:48.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd3fffff700 1 --2- 172.21.15.62:0/4075934252 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4000b6c70 0x7fd400146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:48.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd3f7fff700 1 -- 172.21.15.62:0/4075934252 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4000b6c70 msgr2=0x7fd400146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:48.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd3f7fff700 1 --2- 172.21.15.62:0/4075934252 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4000b6c70 0x7fd400146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:48.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd3f7fff700 1 -- 172.21.15.62:0/4075934252 >> v2:172.21.15.62:3300/0 conn(0x7fd4000b5b20 msgr2=0x7fd4000b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:48.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd3f7fff700 1 --2- 172.21.15.62:0/4075934252 >> v2:172.21.15.62:3300/0 conn(0x7fd4000b5b20 0x7fd4000b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:48.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd3f7fff700 1 -- 172.21.15.62:0/4075934252 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4000b5440 con 0x7fd4000b3760 2021-12-17T18:18:48.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd3fffff700 1 --2- 172.21.15.62:0/4075934252 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4000b6c70 0x7fd400146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:48.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd3ff7fe700 1 --2- 172.21.15.62:0/4075934252 >> v2:172.21.15.62:3300/0 conn(0x7fd4000b5b20 0x7fd4000b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:48.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd3f7fff700 1 --2- 172.21.15.62:0/4075934252 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4000b3760 0x7fd4000b6780 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fd3e8002f70 tx=0x7fd3e8006df0).ready entity=mon.1 client_cookie=9a38fadfbcdddd6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:48.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd3feffd700 1 -- 172.21.15.62:0/4075934252 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3e800d4a0 con 0x7fd4000b3760 2021-12-17T18:18:48.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd3feffd700 1 -- 172.21.15.62:0/4075934252 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e8000e90 con 0x7fd4000b3760 2021-12-17T18:18:48.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.698+0000 7fd3feffd700 1 -- 172.21.15.62:0/4075934252 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3e800d7f0 con 0x7fd4000b3760 2021-12-17T18:18:48.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.702+0000 7fd404ec2700 1 -- 172.21.15.62:0/4075934252 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4000b3760 msgr2=0x7fd4000b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:48.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.702+0000 7fd404ec2700 1 --2- 172.21.15.62:0/4075934252 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4000b3760 0x7fd4000b6780 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fd3e8002f70 tx=0x7fd3e8006df0).stop 2021-12-17T18:18:48.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.702+0000 7fd404ec2700 1 -- 172.21.15.62:0/4075934252 shutdown_connections 2021-12-17T18:18:48.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.702+0000 7fd404ec2700 1 --2- 172.21.15.62:0/4075934252 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4000b6c70 0x7fd400146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:48.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.702+0000 7fd404ec2700 1 --2- 172.21.15.62:0/4075934252 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4000b3760 0x7fd4000b6780 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:48.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.702+0000 7fd404ec2700 1 --2- 172.21.15.62:0/4075934252 >> v2:172.21.15.62:3300/0 conn(0x7fd4000b5b20 0x7fd4000b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:48.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.702+0000 7fd404ec2700 1 -- 172.21.15.62:0/4075934252 >> 172.21.15.62:0/4075934252 conn(0x7fd40005c750 msgr2=0x7fd40005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:48.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.702+0000 7fd404ec2700 1 -- 172.21.15.62:0/4075934252 shutdown_connections 2021-12-17T18:18:48.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.702+0000 7fd404ec2700 1 -- 172.21.15.62:0/4075934252 wait complete. 2021-12-17T18:18:48.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.702+0000 7fd404ec2700 1 Processor -- start 2021-12-17T18:18:48.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.702+0000 7fd404ec2700 1 -- start start 2021-12-17T18:18:48.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd404ec2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4000b5b20 0x7fd4000b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:48.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd404ec2700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4000b6c70 0x7fd40013f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:48.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd404ec2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4001416c0 0x7fd400152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:48.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd404ec2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000b02a0 con 0x7fd4001416c0 2021-12-17T18:18:48.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd404ec2700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000ae8e0 con 0x7fd4000b6c70 2021-12-17T18:18:48.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd404ec2700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000aeb50 con 0x7fd4000b5b20 2021-12-17T18:18:48.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd3fffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4001416c0 0x7fd400152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:48.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd3ff7fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4000b5b20 0x7fd4000b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:48.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd3fffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4001416c0 0x7fd400152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48928/0 (socket says 172.21.15.62:48928) 2021-12-17T18:18:48.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd3fffff700 1 -- 172.21.15.62:0/1515716437 learned_addr learned my addr 172.21.15.62:0/1515716437 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:48.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd3f7fff700 1 --2- 172.21.15.62:0/1515716437 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4000b6c70 0x7fd40013f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:48.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd3fffff700 1 -- 172.21.15.62:0/1515716437 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4000b5b20 msgr2=0x7fd4000b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:48.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd3fffff700 1 --2- 172.21.15.62:0/1515716437 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4000b5b20 0x7fd4000b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:48.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd3fffff700 1 -- 172.21.15.62:0/1515716437 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4000b6c70 msgr2=0x7fd40013f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:48.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd3fffff700 1 --2- 172.21.15.62:0/1515716437 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4000b6c70 0x7fd40013f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:48.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd3fffff700 1 -- 172.21.15.62:0/1515716437 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f000b1e0 con 0x7fd4001416c0 2021-12-17T18:18:48.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd3fffff700 1 --2- 172.21.15.62:0/1515716437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4001416c0 0x7fd400152480 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fd4000aea70 tx=0x7fd3f80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:48.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd3fd7fa700 1 -- 172.21.15.62:0/1515716437 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3f800c850 con 0x7fd4001416c0 2021-12-17T18:18:48.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd404ec2700 1 -- 172.21.15.62:0/1515716437 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f8009470 con 0x7fd4001416c0 2021-12-17T18:18:48.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd3fd7fa700 1 -- 172.21.15.62:0/1515716437 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f800c9b0 con 0x7fd4001416c0 2021-12-17T18:18:48.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd3fd7fa700 1 -- 172.21.15.62:0/1515716437 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3f800cd10 con 0x7fd4001416c0 2021-12-17T18:18:48.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd404ec2700 1 -- 172.21.15.62:0/1515716437 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e800b180 con 0x7fd4001416c0 2021-12-17T18:18:48.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd404ec2700 1 -- 172.21.15.62:0/1515716437 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4000b0410 con 0x7fd4001416c0 2021-12-17T18:18:48.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.706+0000 7fd3fd7fa700 1 -- 172.21.15.62:0/1515716437 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd3f80123f0 con 0x7fd4001416c0 2021-12-17T18:18:48.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.710+0000 7fd3fd7fa700 1 --2- 172.21.15.62:0/1515716437 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd3e4053640 0x7fd3e4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:48.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.710+0000 7fd3fd7fa700 1 -- 172.21.15.62:0/1515716437 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd3f806be70 con 0x7fd4001416c0 2021-12-17T18:18:48.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.710+0000 7fd3ff7fe700 1 --2- 172.21.15.62:0/1515716437 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd3e4053640 0x7fd3e4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:48.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.710+0000 7fd3ff7fe700 1 --2- 172.21.15.62:0/1515716437 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd3e4053640 0x7fd3e4055b00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd3f000b000 tx=0x7fd3f0006eb0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:48.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.718+0000 7fd3fd7fa700 1 -- 172.21.15.62:0/1515716437 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd4000b0410 con 0x7fd4001416c0 2021-12-17T18:18:48.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.846+0000 7fd404ec2700 1 -- 172.21.15.62:0/1515716437 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd4000573d0 con 0x7fd4001416c0 2021-12-17T18:18:48.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.850+0000 7fd3fd7fa700 1 -- 172.21.15.62:0/1515716437 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v23) v1 ==== 81+0+33693 (secure 0 0 0) 0x7fd3f8016070 con 0x7fd4001416c0 2021-12-17T18:18:48.859 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:48.859 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:18:48.859 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 23, 2021-12-17T18:18:48.859 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:18:48.860 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:18:48.860 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:18:20.178383+0000", 2021-12-17T18:18:48.860 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:18:48.860 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:18:48.861 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:18:48.861 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:18:48.861 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:18:48.861 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:18:48.862 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:18:48.862 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:18:48.862 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:18:48.862 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:18:48.863 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:18:48.863 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:18:48.863 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:18:48.863 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:18:48.864 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:18:48.864 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 4, 2021-12-17T18:18:48.864 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:18:48.864 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:18:48.865 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:18:48.865 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:18:48.865 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:18:48.865 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.865 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:18:48.866 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:18:48.866 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:18:48.866 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:18:48.866 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:18:48.867 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:18:48.867 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:18:48.867 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:18:48.867 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:18:48.868 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:18:48.868 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:18:48.868 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:18:48.868 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:18:48.869 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:18:48.869 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:18:48.869 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:18:48.869 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:18:48.869 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:18:48.870 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:18:48.870 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:18:48.870 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:18:48.870 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:18:48.871 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:18:48.871 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.871 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:18:48.871 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:18:48.871 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:18:48.872 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:18:48.872 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:18:48.872 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:18:48.872 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:18:48.873 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:18:48.873 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:18:48.873 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:18:48.873 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:18:48.874 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:18:48.874 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:18:48.874 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:18:48.874 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:18:48.875 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:18:48.875 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:18:48.875 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:18:48.875 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:18:48.875 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:18:48.876 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:18:48.876 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:18:48.876 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:18:48.876 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:18:48.877 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:18:48.877 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:18:48.877 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:18:48.877 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.878 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:18:48.878 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:18:48.878 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:18:48.878 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:18:48.879 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:18:48.879 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:18:48.879 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:18:48.879 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:18:48.880 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:18:48.880 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:18:48.880 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:18:48.880 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:18:48.881 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:18:48.881 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.881 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:18:48.881 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:18:48.881 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.882 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.882 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.882 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:18:48.883 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:18:48.883 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:18:48.883 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:18:48.883 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:18:48.883 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:18:48.884 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:18:48.884 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:18:48.884 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:18:48.884 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:18:48.885 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:18:48.885 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:18:48.885 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:18:48.885 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:18:48.886 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:18:48.886 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:18:48.886 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:18:48.886 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:18:48.886 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:18:48.887 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:18:48.887 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:18:48.887 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:18:48.887 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:18:48.888 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.888 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:18:48.888 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:18:48.888 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:18:48.888 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:18:48.889 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:18:48.889 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:18:48.889 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:18:48.889 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:18:48.890 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:18:48.890 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:18:48.890 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:18:48.890 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:18:48.890 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:18:48.891 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:18:48.891 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:18:48.891 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:18:48.891 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:18:48.892 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:18:48.892 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:18:48.892 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:18:48.892 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:18:48.893 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:18:48.893 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:18:48.893 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:18:48.893 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:18:48.893 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:18:48.894 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:18:48.894 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.894 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:18:48.894 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:18:48.895 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:18:48.895 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:18:48.895 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:18:48.895 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:18:48.896 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:18:48.896 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:18:48.896 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:18:48.896 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:18:48.897 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:18:48.897 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:18:48.897 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:18:48.897 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:18:48.897 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.898 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.898 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.898 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 3, 2021-12-17T18:18:48.898 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2021-12-17T18:18:48.899 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:17.128555+0000", 2021-12-17T18:18:48.899 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:18:48.899 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:18:48.899 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:18:48.900 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:18:48.900 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:18:48.900 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:18:48.900 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:18:48.901 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:18:48.901 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:18:48.901 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:18:48.901 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:18:48.901 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:18:48.902 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:18:48.902 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:18:48.902 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:18:48.902 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:18:48.903 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:18:48.903 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:18:48.903 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:18:48.903 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:18:48.904 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.904 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "22", 2021-12-17T18:18:48.904 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:18:48.904 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:18:48.904 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:18:48.905 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:18:48.905 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:18:48.905 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:18:48.905 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:18:48.906 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:18:48.906 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:18:48.906 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:18:48.906 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:18:48.907 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:18:48.907 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:18:48.907 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:18:48.907 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:18:48.907 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:18:48.908 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:18:48.908 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:18:48.908 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:18:48.908 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:18:48.909 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:18:48.909 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:18:48.909 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:18:48.909 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:18:48.909 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:18:48.910 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:18:48.910 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.910 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:18:48.910 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:18:48.911 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:18:48.911 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:18:48.911 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:18:48.911 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:18:48.911 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:18:48.912 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:18:48.912 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:18:48.912 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:18:48.912 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:18:48.913 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:18:48.913 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2021-12-17T18:18:48.913 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2021-12-17T18:18:48.913 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2021-12-17T18:18:48.913 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.914 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:18:48.914 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:18:48.914 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2021-12-17T18:18:48.914 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.915 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.915 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.915 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.915 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 4, 2021-12-17T18:18:48.916 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2021-12-17T18:18:48.916 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:18.180577+0000", 2021-12-17T18:18:48.916 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:18:48.916 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:18:48.917 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:18:48.917 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:18:48.917 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:18:48.917 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:18:48.917 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:18:48.918 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:18:48.918 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:18:48.918 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:18:48.918 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:18:48.919 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:18:48.919 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:18:48.919 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:18:48.919 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:18:48.920 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:18:48.920 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:18:48.920 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:18:48.920 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:18:48.921 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:18:48.921 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.921 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "23", 2021-12-17T18:18:48.921 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:18:48.921 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:18:48.922 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:18:48.922 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:18:48.922 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:18:48.922 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:18:48.923 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:18:48.923 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:18:48.923 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:18:48.923 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:18:48.924 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:18:48.924 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:18:48.924 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:18:48.924 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:18:48.924 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:18:48.925 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:18:48.925 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:18:48.925 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:18:48.925 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:18:48.926 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:18:48.926 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:18:48.926 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:18:48.926 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:18:48.926 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:18:48.927 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:18:48.927 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:18:48.927 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.927 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:18:48.928 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:18:48.928 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:18:48.928 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:18:48.928 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:18:48.929 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:18:48.929 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:18:48.929 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:18:48.929 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:18:48.929 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:18:48.930 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:18:48.930 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:18:48.930 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:18:48.930 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:18:48.931 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2021-12-17T18:18:48.931 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.931 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.931 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.932 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:18:48.932 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:18:48.932 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.932 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:18:48.932 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:18:48.933 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:18:48.933 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:18:48.933 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:18:48.933 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:18:48.934 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:18:48.934 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:18:48.934 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:18:48.934 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 21, 2021-12-17T18:18:48.935 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:18:48.935 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:18:48.935 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:18:48.935 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:48.935 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.936 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:48.936 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:18:48.936 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:18:48.936 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.937 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.937 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:48.937 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:18:48.937 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:18:48.937 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.938 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.938 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.938 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:18:48.938 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:48.939 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.939 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:48.939 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:18:48.939 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:18:48.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.940 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.940 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:48.940 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:18:48.940 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:18:48.941 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.941 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.941 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.941 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:18:48.942 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:48.942 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.942 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:48.942 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:18:48.942 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:18:48.943 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.943 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.943 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:48.943 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:18:48.944 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:18:48.944 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.944 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.944 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.945 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:18:48.945 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:48.945 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.945 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:48.946 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:18:48.946 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:18:48.946 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.946 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.946 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:48.947 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:18:48.947 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:18:48.947 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.947 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.948 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.948 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:18:48.948 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:18:48.948 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:18:48.949 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:18:48.949 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:18:48.949 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:18:48.949 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:18:48.949 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.950 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.950 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.950 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:18:48.950 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:18:48.951 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:18:48.951 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:18:48.951 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:18:48.951 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:18:48.952 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:18:48.952 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:18:48.952 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:18:48.952 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 21, 2021-12-17T18:18:48.952 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:18:48.953 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:18:48.953 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:18:48.953 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:48.953 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.954 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:48.954 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:18:48.954 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:18:48.954 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.955 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.955 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:48.955 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:18:48.955 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:18:48.955 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.956 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.956 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.956 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:18:48.956 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:48.957 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.957 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:48.957 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:18:48.957 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:18:48.958 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.958 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.958 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:48.958 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:18:48.958 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:18:48.959 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.959 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.959 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.959 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:18:48.960 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:48.960 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.960 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:48.960 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:18:48.961 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:18:48.961 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.961 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.961 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:48.961 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:18:48.962 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:18:48.962 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.962 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.962 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.962 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:18:48.963 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:48.963 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.963 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:48.963 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:18:48.964 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:18:48.964 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.964 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.964 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:48.965 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:18:48.965 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:18:48.965 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.965 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.965 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.966 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:18:48.966 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:18:48.966 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:18:48.966 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:18:48.967 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:18:48.967 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:18:48.967 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:18:48.967 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.967 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.968 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.968 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:18:48.968 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:18:48.968 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:18:48.969 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:18:48.969 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:18:48.969 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:18:48.969 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:18:48.969 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:18:48.970 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:18:48.970 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 17, 2021-12-17T18:18:48.970 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:18:48.970 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:18:48.971 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:18:48.971 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:48.971 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.971 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:48.971 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:18:48.972 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:18:48.972 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.972 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.972 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:48.973 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:18:48.973 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:18:48.973 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.973 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.974 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.974 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:18:48.974 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:48.974 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.974 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:48.975 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:18:48.975 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:18:48.975 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.975 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.976 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:48.976 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:18:48.976 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:18:48.976 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.977 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.977 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.977 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:18:48.977 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:48.977 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.978 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:48.978 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:18:48.978 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:18:48.978 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.979 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.979 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:48.979 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:18:48.979 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:18:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:18:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:18:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:18:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:18:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:18:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:18:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:18:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:18:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:18:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:18:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:18:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:18:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:18:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:18:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:18:48.987 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:18:48.987 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:18:48.987 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:18:48.987 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:18:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:18:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:18:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 21, 2021-12-17T18:18:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:18:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:18:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:18:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:18:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:18:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:48.991 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:18:48.991 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:18:48.991 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.991 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:18:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:18:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:18:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:18:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:18:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:18:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:18:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:18:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:18:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:18:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:18:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:18:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:18:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:18:49.001 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:18:49.001 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.001 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.001 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.002 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:18:49.002 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:18:49.002 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:18:49.002 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:18:49.002 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:18:49.003 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:18:49.003 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:18:49.003 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.003 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.004 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.004 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:18:49.004 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:18:49.004 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:18:49.005 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:18:49.005 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:18:49.005 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:18:49.005 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:18:49.005 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:18:49.006 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:18:49.006 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 21, 2021-12-17T18:18:49.006 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:18:49.006 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:18:49.007 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:18:49.007 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:49.007 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.007 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:49.008 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:18:49.008 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:18:49.008 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.008 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.008 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:49.009 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:18:49.009 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:18:49.009 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.009 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.010 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.010 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:18:49.010 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:49.010 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.010 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:49.011 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:18:49.011 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:18:49.011 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.011 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.012 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:49.012 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:18:49.012 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:18:49.012 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.013 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.013 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.013 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:18:49.013 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:49.013 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.014 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:49.014 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:18:49.014 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:18:49.014 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.015 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.015 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:49.015 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:18:49.015 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:18:49.015 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.016 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.016 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.016 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:18:49.016 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:49.017 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.017 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:49.017 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:18:49.017 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:18:49.018 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.018 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.018 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:49.018 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:18:49.018 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:18:49.019 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.019 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.019 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.019 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:18:49.020 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:18:49.020 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:18:49.020 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:18:49.020 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:18:49.021 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:18:49.021 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:18:49.021 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.021 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.021 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.022 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:18:49.022 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:18:49.022 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:18:49.022 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:18:49.023 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:18:49.023 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:18:49.023 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:18:49.023 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:18:49.024 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:18:49.024 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 20, 2021-12-17T18:18:49.024 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:18:49.024 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:18:49.024 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:18:49.025 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:49.025 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.025 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:49.025 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:18:49.026 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:18:49.026 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.026 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.026 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:49.026 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:18:49.027 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:18:49.027 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.027 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.027 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.028 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:18:49.028 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:49.028 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.028 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:49.029 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:18:49.029 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:18:49.029 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.029 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.029 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:49.030 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:18:49.030 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:18:49.030 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.030 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.031 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.031 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:18:49.031 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:49.031 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.032 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:49.032 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:18:49.032 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:18:49.032 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.032 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.033 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:49.033 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:18:49.033 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:18:49.033 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.034 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.034 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.034 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:18:49.034 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:49.035 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.035 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:49.035 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:18:49.035 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:18:49.036 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.036 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.036 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:49.036 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:18:49.036 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:18:49.037 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.037 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.037 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.037 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:18:49.038 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:18:49.038 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:18:49.038 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:18:49.038 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:18:49.039 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:18:49.039 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:18:49.039 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.039 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.039 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.040 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:18:49.040 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:18:49.040 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:18:49.040 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:18:49.041 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:18:49.041 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:18:49.041 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:18:49.041 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:18:49.042 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:18:49.042 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 21, 2021-12-17T18:18:49.042 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:18:49.042 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:18:49.042 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:18:49.043 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:49.043 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.043 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:49.043 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:18:49.044 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:18:49.044 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.044 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.044 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:49.044 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:18:49.045 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:18:49.045 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.045 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.045 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.046 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:18:49.046 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:49.046 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.046 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:49.047 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:18:49.047 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:18:49.047 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.047 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:18:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:18:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:18:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:18:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:18:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.051 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:49.051 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:18:49.051 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:18:49.051 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.052 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.052 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.052 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:18:49.052 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:49.053 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.053 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:49.053 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:18:49.053 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:18:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:18:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:18:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:18:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:18:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:18:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:18:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:18:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:18:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:18:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:18:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:18:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:18:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:18:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:18:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:18:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:18:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:18:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:18:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 17, 2021-12-17T18:18:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:18:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:18:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:18:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:18:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:18:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:18:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:18:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:18:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:18:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:18:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:18:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:18:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:18:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:18:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:18:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:18:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:18:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:18:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:18:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:18:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:18:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:18:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:18:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:18:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:18:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:18:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:18:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:18:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:18:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:18:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:18:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:18:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:18:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:18:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:18:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:18:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:18:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:18:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:18:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:18:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:18:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:18:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:18:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:18:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:18:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:18:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:18:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:18:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:18:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:18:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:18:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:18:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:18:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:18:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:18:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:18:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:18:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:18:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:18:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:18:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:18:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:18:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:18:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:18:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:18:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:18:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:18:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:18:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:18:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:18:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:18:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:18:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:18:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:18:49.088 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.088 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.088 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:18:49.088 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:18:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:18:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:18:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:18:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:18:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:18:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:18:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:18:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:18:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:18:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:18:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:18:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:18:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:18:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:18:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:18:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:18:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:18:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:18:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:18:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:18:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:18:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:18:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:18:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:18:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:18:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:18:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:18:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": {}, 2021-12-17T18:18:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:18:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:18:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:18:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:18:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:18:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:18:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:18:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:18:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:18:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:18:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:18:49.100 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:18:49.100 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:18:49.100 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:18:49.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.850+0000 7fd404ec2700 1 -- 172.21.15.62:0/1515716437 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd3e4053640 msgr2=0x7fd3e4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:49.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.850+0000 7fd404ec2700 1 --2- 172.21.15.62:0/1515716437 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd3e4053640 0x7fd3e4055b00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd3f000b000 tx=0x7fd3f0006eb0).stop 2021-12-17T18:18:49.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.850+0000 7fd404ec2700 1 -- 172.21.15.62:0/1515716437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4001416c0 msgr2=0x7fd400152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:49.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.850+0000 7fd404ec2700 1 --2- 172.21.15.62:0/1515716437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4001416c0 0x7fd400152480 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fd4000aea70 tx=0x7fd3f80091d0).stop 2021-12-17T18:18:49.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.854+0000 7fd404ec2700 1 -- 172.21.15.62:0/1515716437 shutdown_connections 2021-12-17T18:18:49.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.854+0000 7fd404ec2700 1 --2- 172.21.15.62:0/1515716437 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd3e4053640 0x7fd3e4055b00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:49.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.854+0000 7fd404ec2700 1 --2- 172.21.15.62:0/1515716437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4001416c0 0x7fd400152480 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:49.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.854+0000 7fd404ec2700 1 --2- 172.21.15.62:0/1515716437 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4000b6c70 0x7fd40013f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:49.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.854+0000 7fd404ec2700 1 --2- 172.21.15.62:0/1515716437 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4000b5b20 0x7fd4000b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:49.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.854+0000 7fd404ec2700 1 -- 172.21.15.62:0/1515716437 >> 172.21.15.62:0/1515716437 conn(0x7fd40005c750 msgr2=0x7fd4000b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:49.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.854+0000 7fd404ec2700 1 -- 172.21.15.62:0/1515716437 shutdown_connections 2021-12-17T18:18:49.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:48.854+0000 7fd404ec2700 1 -- 172.21.15.62:0/1515716437 wait complete. 2021-12-17T18:18:49.106 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:18:49.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.210+0000 7f28dd18d700 1 Processor -- start 2021-12-17T18:18:49.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.210+0000 7f28dd18d700 1 -- start start 2021-12-17T18:18:49.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.210+0000 7f28dd18d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28d8065630 0x7f28d8066bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:49.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28dd18d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f28d80b1ff0 0x7f28d8144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:49.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28dd18d700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d8065a10 con 0x7f28d8144d80 2021-12-17T18:18:49.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28dd18d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d80670c0 con 0x7f28d80b1ff0 2021-12-17T18:18:49.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28dd18d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d8067330 con 0x7f28d8065630 2021-12-17T18:18:49.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28d77fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f28d80b1ff0 0x7f28d8144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:49.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28d7fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28d8065630 0x7f28d8066bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:49.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28d77fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f28d80b1ff0 0x7f28d8144890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48934/0 (socket says 172.21.15.62:48934) 2021-12-17T18:18:49.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28d77fe700 1 -- 172.21.15.62:0/1887844442 learned_addr learned my addr 172.21.15.62:0/1887844442 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:49.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28dc98c700 1 --1- 172.21.15.62:0/1887844442 >> v1:172.21.15.109:6789/0 conn(0x7f28d8144d80 0x7f28d81404b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:48834/0 (socket says 172.21.15.62:48834) 2021-12-17T18:18:49.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28d77fe700 1 -- 172.21.15.62:0/1887844442 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28d8065630 msgr2=0x7f28d8066bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:49.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28d77fe700 1 --2- 172.21.15.62:0/1887844442 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28d8065630 0x7f28d8066bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:49.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28d77fe700 1 -- 172.21.15.62:0/1887844442 >> v1:172.21.15.109:6789/0 conn(0x7f28d8144d80 legacy=0x7f28d81404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:49.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28d77fe700 1 -- 172.21.15.62:0/1887844442 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d80675d0 con 0x7f28d80b1ff0 2021-12-17T18:18:49.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28d77fe700 1 --2- 172.21.15.62:0/1887844442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d80b1ff0 0x7f28d8144890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f28cc002f70 tx=0x7f28cc006eb0).ready entity=mon.0 client_cookie=a5e06e314b45a480 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:49.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28d6ffd700 1 -- 172.21.15.62:0/1887844442 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28cc00d570 con 0x7f28d80b1ff0 2021-12-17T18:18:49.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28d6ffd700 1 -- 172.21.15.62:0/1887844442 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc000e90 con 0x7f28d80b1ff0 2021-12-17T18:18:49.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28d6ffd700 1 -- 172.21.15.62:0/1887844442 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28cc00d900 con 0x7f28d80b1ff0 2021-12-17T18:18:49.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28dd18d700 1 -- 172.21.15.62:0/1887844442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d80b1ff0 msgr2=0x7f28d8144890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:49.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28dd18d700 1 --2- 172.21.15.62:0/1887844442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d80b1ff0 0x7f28d8144890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f28cc002f70 tx=0x7f28cc006eb0).stop 2021-12-17T18:18:49.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28dd18d700 1 -- 172.21.15.62:0/1887844442 shutdown_connections 2021-12-17T18:18:49.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28dd18d700 1 --2- 172.21.15.62:0/1887844442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d80b1ff0 0x7f28d8144890 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:49.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28dd18d700 1 --2- 172.21.15.62:0/1887844442 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28d8065630 0x7f28d8066bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:49.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28dd18d700 1 -- 172.21.15.62:0/1887844442 >> 172.21.15.62:0/1887844442 conn(0x7f28d805c750 msgr2=0x7f28d805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:49.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28dd18d700 1 -- 172.21.15.62:0/1887844442 shutdown_connections 2021-12-17T18:18:49.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.214+0000 7f28dd18d700 1 -- 172.21.15.62:0/1887844442 wait complete. 2021-12-17T18:18:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28dd18d700 1 Processor -- start 2021-12-17T18:18:49.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28dd18d700 1 -- start start 2021-12-17T18:18:49.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28dd18d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d8065630 0x7f28d80aca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:49.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28dd18d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28d80b1ff0 0x7f28d80b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:49.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28dd18d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28d8144d80 0x7f28d8152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:49.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28dd18d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d80650b0 con 0x7f28d8065630 2021-12-17T18:18:49.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28dd18d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d80aeb40 con 0x7f28d80b1ff0 2021-12-17T18:18:49.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28dd18d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d80b1060 con 0x7f28d8144d80 2021-12-17T18:18:49.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28d7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d8065630 0x7f28d80aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:49.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28d7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d8065630 0x7f28d80aca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48938/0 (socket says 172.21.15.62:48938) 2021-12-17T18:18:49.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28d7fff700 1 -- 172.21.15.62:0/3403110366 learned_addr learned my addr 172.21.15.62:0/3403110366 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:49.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28d77fe700 1 --2- 172.21.15.62:0/3403110366 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28d80b1ff0 0x7f28d80b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:49.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28dc98c700 1 --2- 172.21.15.62:0/3403110366 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28d8144d80 0x7f28d8152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:49.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28d7fff700 1 -- 172.21.15.62:0/3403110366 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28d8144d80 msgr2=0x7f28d8152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:49.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28d7fff700 1 --2- 172.21.15.62:0/3403110366 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28d8144d80 0x7f28d8152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:49.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28d7fff700 1 -- 172.21.15.62:0/3403110366 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28d80b1ff0 msgr2=0x7f28d80b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:49.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28d7fff700 1 --2- 172.21.15.62:0/3403110366 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28d80b1ff0 0x7f28d80b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:49.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28d7fff700 1 -- 172.21.15.62:0/3403110366 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc00b1e0 con 0x7f28d8065630 2021-12-17T18:18:49.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28d77fe700 1 --2- 172.21.15.62:0/3403110366 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28d80b1ff0 0x7f28d80b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:49.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28d7fff700 1 --2- 172.21.15.62:0/3403110366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d8065630 0x7f28d80aca30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f28c800c000 tx=0x7f28c80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:49.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28d57fa700 1 -- 172.21.15.62:0/3403110366 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28c800c850 con 0x7f28d8065630 2021-12-17T18:18:49.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28d57fa700 1 -- 172.21.15.62:0/3403110366 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c800c9b0 con 0x7f28d8065630 2021-12-17T18:18:49.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28dd18d700 1 -- 172.21.15.62:0/3403110366 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d8064960 con 0x7f28d8065630 2021-12-17T18:18:49.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28d57fa700 1 -- 172.21.15.62:0/3403110366 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28c800cd10 con 0x7f28d8065630 2021-12-17T18:18:49.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.218+0000 7f28dd18d700 1 -- 172.21.15.62:0/3403110366 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d80a2de0 con 0x7f28d8065630 2021-12-17T18:18:49.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.222+0000 7f28dd18d700 1 -- 172.21.15.62:0/3403110366 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d8064b50 con 0x7f28d8065630 2021-12-17T18:18:49.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.222+0000 7f28d57fa700 1 -- 172.21.15.62:0/3403110366 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f28c8022070 con 0x7f28d8065630 2021-12-17T18:18:49.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.222+0000 7f28d57fa700 1 --2- 172.21.15.62:0/3403110366 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f28b8053610 0x7f28b8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:49.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.222+0000 7f28d57fa700 1 -- 172.21.15.62:0/3403110366 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f28c806c120 con 0x7f28d8065630 2021-12-17T18:18:49.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.222+0000 7f28d77fe700 1 --2- 172.21.15.62:0/3403110366 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f28b8053610 0x7f28b8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:49.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.222+0000 7f28d77fe700 1 --2- 172.21.15.62:0/3403110366 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f28b8053610 0x7f28b8055ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f28cc01a000 tx=0x7f28cc015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:49.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.226+0000 7f28d57fa700 1 -- 172.21.15.62:0/3403110366 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f28c8043170 con 0x7f28d8065630 2021-12-17T18:18:49.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.390+0000 7f28dd18d700 1 -- 172.21.15.62:0/3403110366 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28d80b1230 con 0x7f28d8065630 2021-12-17T18:18:49.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.394+0000 7f28d57fa700 1 -- 172.21.15.62:0/3403110366 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f28c8046790 con 0x7f28d8065630 2021-12-17T18:18:49.401 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:49.401 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/1930484969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1930484969},{"type":"v1","addr":"172.21.15.109:6835","nonce":1930484969}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:18:19.175750+0000","modified":"2021-12-17T18:18:20.179555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.62:6833/3194210554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3194210554},{"type":"v1","addr":"172.21.15.62:6833","nonce":3194210554}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-12-17T18:18:49.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.394+0000 7f28dd18d700 1 -- 172.21.15.62:0/3403110366 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f28b8053610 msgr2=0x7f28b8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:49.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.394+0000 7f28dd18d700 1 --2- 172.21.15.62:0/3403110366 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f28b8053610 0x7f28b8055ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f28cc01a000 tx=0x7f28cc015000).stop 2021-12-17T18:18:49.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.394+0000 7f28dd18d700 1 -- 172.21.15.62:0/3403110366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d8065630 msgr2=0x7f28d80aca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:49.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.394+0000 7f28dd18d700 1 --2- 172.21.15.62:0/3403110366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d8065630 0x7f28d80aca30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f28c800c000 tx=0x7f28c80091d0).stop 2021-12-17T18:18:49.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.394+0000 7f28dd18d700 1 -- 172.21.15.62:0/3403110366 shutdown_connections 2021-12-17T18:18:49.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.394+0000 7f28dd18d700 1 --2- 172.21.15.62:0/3403110366 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f28b8053610 0x7f28b8055ad0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:49.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.394+0000 7f28dd18d700 1 --2- 172.21.15.62:0/3403110366 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28d8144d80 0x7f28d8152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:49.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.394+0000 7f28dd18d700 1 --2- 172.21.15.62:0/3403110366 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28d80b1ff0 0x7f28d80b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:49.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.394+0000 7f28dd18d700 1 --2- 172.21.15.62:0/3403110366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d8065630 0x7f28d80aca30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:49.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.394+0000 7f28dd18d700 1 -- 172.21.15.62:0/3403110366 >> 172.21.15.62:0/3403110366 conn(0x7f28d805c750 msgr2=0x7f28d8140e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:49.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.394+0000 7f28dd18d700 1 -- 172.21.15.62:0/3403110366 shutdown_connections 2021-12-17T18:18:49.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.394+0000 7f28dd18d700 1 -- 172.21.15.62:0/3403110366 wait complete. 2021-12-17T18:18:49.406 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 5 2021-12-17T18:18:49.413 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-12-17T18:18:49.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.514+0000 7fe4fbfff700 1 Processor -- start 2021-12-17T18:18:49.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.514+0000 7fe4fbfff700 1 -- start start 2021-12-17T18:18:49.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.514+0000 7fe4fbfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4fc0b20f0 0x7fe4fc144580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:49.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.514+0000 7fe4fbfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4fc0ad7a0 con 0x7fe4fc0afba0 2021-12-17T18:18:49.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.514+0000 7fe4fbfff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4fc148430 con 0x7fe4fc0b1d10 2021-12-17T18:18:49.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.514+0000 7fe4fbfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4fc0ac420 con 0x7fe4fc0b20f0 2021-12-17T18:18:49.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.514+0000 7fe4fb7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4fc0b20f0 0x7fe4fc144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:49.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.518+0000 7fe4fb7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4fc0b20f0 0x7fe4fc144580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48950/0 (socket says 172.21.15.62:48950) 2021-12-17T18:18:49.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.518+0000 7fe4fb7fe700 1 -- 172.21.15.62:0/1059084966 learned_addr learned my addr 172.21.15.62:0/1059084966 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:49.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.518+0000 7fe4fb7fe700 1 -- 172.21.15.62:0/1059084966 >> v1:172.21.15.109:6789/0 conn(0x7fe4fc0b1d10 legacy=0x7fe4fc147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:49.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.518+0000 7fe4fb7fe700 1 -- 172.21.15.62:0/1059084966 >> v1:172.21.15.62:6789/0 conn(0x7fe4fc0afba0 legacy=0x7fe4fc14a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:49.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.518+0000 7fe4fb7fe700 1 -- 172.21.15.62:0/1059084966 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc1473c0 con 0x7fe4fc0b20f0 2021-12-17T18:18:49.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.518+0000 7fe4fb7fe700 1 --2- 172.21.15.62:0/1059084966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4fc0b20f0 0x7fe4fc144580 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fe4ec002f70 tx=0x7fe4ec006eb0).ready entity=mon.0 client_cookie=d96fa2f6faacefec server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:49.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.518+0000 7fe4f9ffb700 1 -- 172.21.15.62:0/1059084966 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4ec00d660 con 0x7fe4fc0b20f0 2021-12-17T18:18:49.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.518+0000 7fe4f9ffb700 1 -- 172.21.15.62:0/1059084966 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec000e90 con 0x7fe4fc0b20f0 2021-12-17T18:18:49.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.518+0000 7fe4f9ffb700 1 -- 172.21.15.62:0/1059084966 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4ec00d9f0 con 0x7fe4fc0b20f0 2021-12-17T18:18:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.518+0000 7fe4fbfff700 1 -- 172.21.15.62:0/1059084966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4fc0b20f0 msgr2=0x7fe4fc144580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.518+0000 7fe4fbfff700 1 --2- 172.21.15.62:0/1059084966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4fc0b20f0 0x7fe4fc144580 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fe4ec002f70 tx=0x7fe4ec006eb0).stop 2021-12-17T18:18:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.518+0000 7fe4fbfff700 1 -- 172.21.15.62:0/1059084966 shutdown_connections 2021-12-17T18:18:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.518+0000 7fe4fbfff700 1 --2- 172.21.15.62:0/1059084966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4fc0b20f0 0x7fe4fc144580 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:49.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.518+0000 7fe4fbfff700 1 -- 172.21.15.62:0/1059084966 >> 172.21.15.62:0/1059084966 conn(0x7fe4fc0623c0 msgr2=0x7fe4fc0627d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:49.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.518+0000 7fe4fbfff700 1 -- 172.21.15.62:0/1059084966 shutdown_connections 2021-12-17T18:18:49.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.518+0000 7fe4fbfff700 1 -- 172.21.15.62:0/1059084966 wait complete. 2021-12-17T18:18:49.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fbfff700 1 Processor -- start 2021-12-17T18:18:49.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fbfff700 1 -- start start 2021-12-17T18:18:49.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fbfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe4fc0afba0 0x7fe4fc142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:49.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4fc0b1d10 0x7fe4fc066710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:49.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fbfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4fc0b20f0 0x7fe4fc149c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:49.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fbfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc156450 con 0x7fe4fc0b1d10 2021-12-17T18:18:49.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fbfff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc0b47e0 con 0x7fe4fc0afba0 2021-12-17T18:18:49.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fbfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc0b4a80 con 0x7fe4fc0b20f0 2021-12-17T18:18:49.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fa7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4fc0b1d10 0x7fe4fc066710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:49.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fa7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4fc0b1d10 0x7fe4fc066710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48954/0 (socket says 172.21.15.62:48954) 2021-12-17T18:18:49.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fa7fc700 1 -- 172.21.15.62:0/3649712559 learned_addr learned my addr 172.21.15.62:0/3649712559 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:49.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4faffd700 1 --2- 172.21.15.62:0/3649712559 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe4fc0afba0 0x7fe4fc142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:49.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fb7fe700 1 --2- 172.21.15.62:0/3649712559 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4fc0b20f0 0x7fe4fc149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:49.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fa7fc700 1 -- 172.21.15.62:0/3649712559 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4fc0b20f0 msgr2=0x7fe4fc149c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:49.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fa7fc700 1 --2- 172.21.15.62:0/3649712559 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4fc0b20f0 0x7fe4fc149c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:49.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fa7fc700 1 -- 172.21.15.62:0/3649712559 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe4fc0afba0 msgr2=0x7fe4fc142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:49.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fa7fc700 1 --2- 172.21.15.62:0/3649712559 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe4fc0afba0 0x7fe4fc142140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:49.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fa7fc700 1 -- 172.21.15.62:0/3649712559 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec00b1e0 con 0x7fe4fc0b1d10 2021-12-17T18:18:49.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fa7fc700 1 --2- 172.21.15.62:0/3649712559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4fc0b1d10 0x7fe4fc066710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe4fc1479e0 tx=0x7fe4e4007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:49.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4f3fff700 1 -- 172.21.15.62:0/3649712559 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4e4006aa0 con 0x7fe4fc0b1d10 2021-12-17T18:18:49.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4f3fff700 1 -- 172.21.15.62:0/3649712559 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e4006c00 con 0x7fe4fc0b1d10 2021-12-17T18:18:49.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4f3fff700 1 -- 172.21.15.62:0/3649712559 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4e4007030 con 0x7fe4fc0b1d10 2021-12-17T18:18:49.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fbfff700 1 -- 172.21.15.62:0/3649712559 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4fc0b4d20 con 0x7fe4fc0b1d10 2021-12-17T18:18:49.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.522+0000 7fe4fbfff700 1 -- 172.21.15.62:0/3649712559 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4fc0b4260 con 0x7fe4fc0b1d10 2021-12-17T18:18:49.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.526+0000 7fe4fbfff700 1 -- 172.21.15.62:0/3649712559 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4fc156590 con 0x7fe4fc0b1d10 2021-12-17T18:18:49.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.526+0000 7fe4f3fff700 1 -- 172.21.15.62:0/3649712559 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe4e4010070 con 0x7fe4fc0b1d10 2021-12-17T18:18:49.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.526+0000 7fe4f3fff700 1 --2- 172.21.15.62:0/3649712559 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe4e00536a0 0x7fe4e0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:49.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.526+0000 7fe4f3fff700 1 -- 172.21.15.62:0/3649712559 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe4e406b540 con 0x7fe4fc0b1d10 2021-12-17T18:18:49.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.526+0000 7fe4faffd700 1 --2- 172.21.15.62:0/3649712559 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe4e00536a0 0x7fe4e0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:49.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.526+0000 7fe4faffd700 1 --2- 172.21.15.62:0/3649712559 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe4e00536a0 0x7fe4e0055b60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fe4f400d000 tx=0x7fe4f4007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:49.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.534+0000 7fe4f3fff700 1 -- 172.21.15.62:0/3649712559 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe4fc156590 con 0x7fe4fc0b1d10 2021-12-17T18:18:49.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:49.698+0000 7fe4fbfff700 1 -- 172.21.15.62:0/3649712559 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe4fc156590 con 0x7fe4fc0b1d10 2021-12-17T18:18:50.674 INFO:tasks.ceph.mon.a.smithi062.stderr:2021-12-17T18:18:50.666+0000 7f8d3b366700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-12-17T18:18:50.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.678+0000 7fe4f3fff700 1 -- 172.21.15.62:0/3649712559 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v6) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe4fc156590 con 0x7fe4fc0b1d10 2021-12-17T18:18:50.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.682+0000 7fe4fbfff700 1 -- 172.21.15.62:0/3649712559 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe4e00536a0 msgr2=0x7fe4e0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:50.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.682+0000 7fe4fbfff700 1 --2- 172.21.15.62:0/3649712559 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe4e00536a0 0x7fe4e0055b60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fe4f400d000 tx=0x7fe4f4007b90).stop 2021-12-17T18:18:50.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.682+0000 7fe4fbfff700 1 -- 172.21.15.62:0/3649712559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4fc0b1d10 msgr2=0x7fe4fc066710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:50.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.682+0000 7fe4fbfff700 1 --2- 172.21.15.62:0/3649712559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4fc0b1d10 0x7fe4fc066710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe4fc1479e0 tx=0x7fe4e4007f60).stop 2021-12-17T18:18:50.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.682+0000 7fe4fbfff700 1 -- 172.21.15.62:0/3649712559 shutdown_connections 2021-12-17T18:18:50.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.682+0000 7fe4fbfff700 1 --2- 172.21.15.62:0/3649712559 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe4e00536a0 0x7fe4e0055b60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:50.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.682+0000 7fe4fbfff700 1 --2- 172.21.15.62:0/3649712559 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4fc0b20f0 0x7fe4fc149c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:50.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.682+0000 7fe4fbfff700 1 --2- 172.21.15.62:0/3649712559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4fc0b1d10 0x7fe4fc066710 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:50.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.682+0000 7fe4fbfff700 1 --2- 172.21.15.62:0/3649712559 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe4fc0afba0 0x7fe4fc142140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:50.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.682+0000 7fe4fbfff700 1 -- 172.21.15.62:0/3649712559 >> 172.21.15.62:0/3649712559 conn(0x7fe4fc0623c0 msgr2=0x7fe4fc06ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:50.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.682+0000 7fe4fbfff700 1 -- 172.21.15.62:0/3649712559 shutdown_connections 2021-12-17T18:18:50.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.682+0000 7fe4fbfff700 1 -- 172.21.15.62:0/3649712559 wait complete. 2021-12-17T18:18:50.695 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-12-17T18:18:50.706 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:18:50.716 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:18:50.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.802+0000 7f57953c3700 1 Processor -- start 2021-12-17T18:18:50.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.802+0000 7f57953c3700 1 -- start start 2021-12-17T18:18:50.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.802+0000 7f57953c3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57900b5c80 0x7f57900b6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:50.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f57953c3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57900b1540 con 0x7f579013fb60 2021-12-17T18:18:50.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f57953c3700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5790143990 con 0x7f57900afcf0 2021-12-17T18:18:50.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f57953c3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57900af5b0 con 0x7f57900b5c80 2021-12-17T18:18:50.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f5794bc2700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f579013fb60 0x7f5790143280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60788/0 (socket says 172.21.15.62:60788) 2021-12-17T18:18:50.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f5794bc2700 1 -- 172.21.15.62:0/3939338560 learned_addr learned my addr 172.21.15.62:0/3939338560 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:50.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f578ffff700 1 --2- 172.21.15.62:0/3939338560 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57900b5c80 0x7f57900b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:50.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f578f7fe700 1 -- 172.21.15.62:0/3939338560 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236784066 0 0) 0x7f57900b1540 con 0x7f579013fb60 2021-12-17T18:18:50.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f578ffff700 1 -- 172.21.15.62:0/3939338560 >> v1:172.21.15.109:6789/0 conn(0x7f57900afcf0 legacy=0x7f5790142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:50.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f578ffff700 1 -- 172.21.15.62:0/3939338560 >> v1:172.21.15.62:6789/0 conn(0x7f579013fb60 legacy=0x7f5790143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:50.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f578ffff700 1 -- 172.21.15.62:0/3939338560 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57900af850 con 0x7f57900b5c80 2021-12-17T18:18:50.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f578ffff700 1 --2- 172.21.15.62:0/3939338560 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57900b5c80 0x7f57900b6060 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f5780002f70 tx=0x7f5780006e80).ready entity=mon.2 client_cookie=23edb7558788675e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:50.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f578f7fe700 1 -- 172.21.15.62:0/3939338560 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5780014070 con 0x7f57900b5c80 2021-12-17T18:18:50.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f578f7fe700 1 -- 172.21.15.62:0/3939338560 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5780000e90 con 0x7f57900b5c80 2021-12-17T18:18:50.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f578f7fe700 1 -- 172.21.15.62:0/3939338560 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f578000a8a0 con 0x7f57900b5c80 2021-12-17T18:18:50.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f57953c3700 1 -- 172.21.15.62:0/3939338560 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57900b5c80 msgr2=0x7f57900b6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:50.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f57953c3700 1 --2- 172.21.15.62:0/3939338560 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57900b5c80 0x7f57900b6060 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f5780002f70 tx=0x7f5780006e80).stop 2021-12-17T18:18:50.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f57953c3700 1 -- 172.21.15.62:0/3939338560 shutdown_connections 2021-12-17T18:18:50.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f57953c3700 1 --2- 172.21.15.62:0/3939338560 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57900b5c80 0x7f57900b6060 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:50.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f57953c3700 1 -- 172.21.15.62:0/3939338560 >> 172.21.15.62:0/3939338560 conn(0x7f579005c750 msgr2=0x7f579005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:50.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f57953c3700 1 -- 172.21.15.62:0/3939338560 shutdown_connections 2021-12-17T18:18:50.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.806+0000 7f57953c3700 1 -- 172.21.15.62:0/3939338560 wait complete. 2021-12-17T18:18:50.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f57953c3700 1 Processor -- start 2021-12-17T18:18:50.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f57953c3700 1 -- start start 2021-12-17T18:18:50.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f57953c3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57900afcf0 0x7f579009f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:50.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f57953c3700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f57900b5c80 0x7f57900b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:50.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f57953c3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f579013fb60 0x7f57900abea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:50.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f57953c3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5790065fe0 con 0x7f579013fb60 2021-12-17T18:18:50.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f57953c3700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5790066280 con 0x7f57900b5c80 2021-12-17T18:18:50.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f57953c3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5790066520 con 0x7f57900afcf0 2021-12-17T18:18:50.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f578ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57900afcf0 0x7f579009f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:50.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f5794bc2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f579013fb60 0x7f57900abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:50.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f578ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57900afcf0 0x7f579009f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:42680/0 (socket says 172.21.15.62:42680) 2021-12-17T18:18:50.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f578ffff700 1 -- 172.21.15.62:0/1759381080 learned_addr learned my addr 172.21.15.62:0/1759381080 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:50.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f5787fff700 1 --2- 172.21.15.62:0/1759381080 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f57900b5c80 0x7f57900b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:50.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f578ffff700 1 -- 172.21.15.62:0/1759381080 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f57900b5c80 msgr2=0x7f57900b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:50.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f578ffff700 1 --2- 172.21.15.62:0/1759381080 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f57900b5c80 0x7f57900b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:50.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f578ffff700 1 -- 172.21.15.62:0/1759381080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f579013fb60 msgr2=0x7f57900abea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:50.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f578ffff700 1 --2- 172.21.15.62:0/1759381080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f579013fb60 0x7f57900abea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:50.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f578ffff700 1 -- 172.21.15.62:0/1759381080 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578000c310 con 0x7f57900afcf0 2021-12-17T18:18:50.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.810+0000 7f5794bc2700 1 --2- 172.21.15.62:0/1759381080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f579013fb60 0x7f57900abea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:50.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.814+0000 7f578ffff700 1 --2- 172.21.15.62:0/1759381080 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57900afcf0 0x7f579009f3e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f5780002f70 tx=0x7f57900af9e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:50.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.814+0000 7f578dffb700 1 -- 172.21.15.62:0/1759381080 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5780010d40 con 0x7f57900afcf0 2021-12-17T18:18:50.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.814+0000 7f578dffb700 1 -- 172.21.15.62:0/1759381080 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578001d450 con 0x7f57900afcf0 2021-12-17T18:18:50.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.814+0000 7f57953c3700 1 -- 172.21.15.62:0/1759381080 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5790151770 con 0x7f57900afcf0 2021-12-17T18:18:50.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.814+0000 7f578dffb700 1 -- 172.21.15.62:0/1759381080 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5780010ea0 con 0x7f57900afcf0 2021-12-17T18:18:50.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.814+0000 7f57953c3700 1 -- 172.21.15.62:0/1759381080 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5790067160 con 0x7f57900afcf0 2021-12-17T18:18:50.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.814+0000 7f57953c3700 1 -- 172.21.15.62:0/1759381080 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57900a0bc0 con 0x7f57900afcf0 2021-12-17T18:18:50.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.814+0000 7f578dffb700 1 -- 172.21.15.62:0/1759381080 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f578000e040 con 0x7f57900afcf0 2021-12-17T18:18:50.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.814+0000 7f578dffb700 1 --2- 172.21.15.62:0/1759381080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5774053580 0x7f5774055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:50.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.814+0000 7f578dffb700 1 -- 172.21.15.62:0/1759381080 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f578006eae0 con 0x7f57900afcf0 2021-12-17T18:18:50.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.814+0000 7f5787fff700 1 --2- 172.21.15.62:0/1759381080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5774053580 0x7f5774055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:50.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.818+0000 7f5787fff700 1 --2- 172.21.15.62:0/1759381080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5774053580 0x7f5774055a40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f577800d000 tx=0x7f5778007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:50.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.822+0000 7f578dffb700 1 -- 172.21.15.62:0/1759381080 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5780045b70 con 0x7f57900afcf0 2021-12-17T18:18:50.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.986+0000 7f57953c3700 1 -- 172.21.15.62:0/1759381080 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57900b0110 con 0x7f57900afcf0 2021-12-17T18:18:50.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.990+0000 7f578dffb700 1 -- 172.21.15.62:0/1759381080 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+1777 (secure 0 0 0) 0x7f5780049190 con 0x7f57900afcf0 2021-12-17T18:18:50.997 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:50.997 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/1930484969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1930484969},{"type":"v1","addr":"172.21.15.109:6835","nonce":1930484969}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:18:19.175750+0000","modified":"2021-12-17T18:18:50.672759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-12-17T18:18:50.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.990+0000 7f57953c3700 1 -- 172.21.15.62:0/1759381080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5774053580 msgr2=0x7f5774055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:50.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.990+0000 7f57953c3700 1 --2- 172.21.15.62:0/1759381080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5774053580 0x7f5774055a40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f577800d000 tx=0x7f5778007b90).stop 2021-12-17T18:18:50.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.990+0000 7f57953c3700 1 -- 172.21.15.62:0/1759381080 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57900afcf0 msgr2=0x7f579009f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:51.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.990+0000 7f57953c3700 1 --2- 172.21.15.62:0/1759381080 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57900afcf0 0x7f579009f3e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f5780002f70 tx=0x7f57900af9e0).stop 2021-12-17T18:18:51.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.990+0000 7f57953c3700 1 -- 172.21.15.62:0/1759381080 shutdown_connections 2021-12-17T18:18:51.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.990+0000 7f57953c3700 1 --2- 172.21.15.62:0/1759381080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5774053580 0x7f5774055a40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.990+0000 7f57953c3700 1 --2- 172.21.15.62:0/1759381080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f579013fb60 0x7f57900abea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.990+0000 7f57953c3700 1 --2- 172.21.15.62:0/1759381080 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f57900b5c80 0x7f57900b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.990+0000 7f57953c3700 1 --2- 172.21.15.62:0/1759381080 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f57900afcf0 0x7f579009f3e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.990+0000 7f57953c3700 1 -- 172.21.15.62:0/1759381080 >> 172.21.15.62:0/1759381080 conn(0x7f579005c750 msgr2=0x7f57900b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:51.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.990+0000 7f57953c3700 1 -- 172.21.15.62:0/1759381080 shutdown_connections 2021-12-17T18:18:51.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:50.990+0000 7f57953c3700 1 -- 172.21.15.62:0/1759381080 wait complete. 2021-12-17T18:18:51.002 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 6 2021-12-17T18:18:51.011 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-12-17T18:18:51.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.114+0000 7fd46c12b700 1 Processor -- start 2021-12-17T18:18:51.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.114+0000 7fd46c12b700 1 -- start start 2021-12-17T18:18:51.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.114+0000 7fd46c12b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd4640b3eb0 0x7fd464145110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:51.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.114+0000 7fd46c12b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd4641406a0 0x7fd464140b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:51.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.114+0000 7fd46c12b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4640b27c0 con 0x7fd464067770 2021-12-17T18:18:51.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.114+0000 7fd46c12b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd464144730 con 0x7fd4640b3eb0 2021-12-17T18:18:51.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.114+0000 7fd46c12b700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4641449d0 con 0x7fd4641406a0 2021-12-17T18:18:51.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.114+0000 7fd469ec7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd4640b3eb0 0x7fd464145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:51.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.114+0000 7fd4696c6700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd464067770 0x7fd4640b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60798/0 (socket says 172.21.15.62:60798) 2021-12-17T18:18:51.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.114+0000 7fd4696c6700 1 -- 172.21.15.62:0/3787364794 learned_addr learned my addr 172.21.15.62:0/3787364794 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:51.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.114+0000 7fd46a6c8700 1 --2- 172.21.15.62:0/3787364794 >> v2:172.21.15.109:3300/0 conn(0x7fd4641406a0 0x7fd464140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:51.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.114+0000 7fd469ec7700 1 -- 172.21.15.62:0/3787364794 >> v2:172.21.15.109:3300/0 conn(0x7fd4641406a0 msgr2=0x7fd464140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:51.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.114+0000 7fd469ec7700 1 --2- 172.21.15.62:0/3787364794 >> v2:172.21.15.109:3300/0 conn(0x7fd4641406a0 0x7fd464140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.114+0000 7fd469ec7700 1 -- 172.21.15.62:0/3787364794 >> v1:172.21.15.62:6789/0 conn(0x7fd464067770 legacy=0x7fd4640b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:51.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.114+0000 7fd469ec7700 1 -- 172.21.15.62:0/3787364794 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd464144c70 con 0x7fd4640b3eb0 2021-12-17T18:18:51.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.114+0000 7fd469ec7700 1 --2- 172.21.15.62:0/3787364794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4640b3eb0 0x7fd464145110 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fd458002f70 tx=0x7fd458006df0).ready entity=mon.0 client_cookie=2ad303605bba0a9f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:51.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd468ec5700 1 -- 172.21.15.62:0/3787364794 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd45800d570 con 0x7fd4640b3eb0 2021-12-17T18:18:51.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd468ec5700 1 -- 172.21.15.62:0/3787364794 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd458000e90 con 0x7fd4640b3eb0 2021-12-17T18:18:51.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd468ec5700 1 -- 172.21.15.62:0/3787364794 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd45800d8c0 con 0x7fd4640b3eb0 2021-12-17T18:18:51.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd46c12b700 1 -- 172.21.15.62:0/3787364794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4640b3eb0 msgr2=0x7fd464145110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:51.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd46c12b700 1 --2- 172.21.15.62:0/3787364794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4640b3eb0 0x7fd464145110 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fd458002f70 tx=0x7fd458006df0).stop 2021-12-17T18:18:51.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd46c12b700 1 -- 172.21.15.62:0/3787364794 shutdown_connections 2021-12-17T18:18:51.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd46c12b700 1 --2- 172.21.15.62:0/3787364794 >> v2:172.21.15.109:3300/0 conn(0x7fd4641406a0 0x7fd464140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd46c12b700 1 --2- 172.21.15.62:0/3787364794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4640b3eb0 0x7fd464145110 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd46c12b700 1 -- 172.21.15.62:0/3787364794 >> 172.21.15.62:0/3787364794 conn(0x7fd46405cb40 msgr2=0x7fd46405cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:51.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd46c12b700 1 -- 172.21.15.62:0/3787364794 shutdown_connections 2021-12-17T18:18:51.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd46c12b700 1 -- 172.21.15.62:0/3787364794 wait complete. 2021-12-17T18:18:51.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd46c12b700 1 Processor -- start 2021-12-17T18:18:51.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd46c12b700 1 -- start start 2021-12-17T18:18:51.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd46c12b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd464067770 0x7fd4640b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:51.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd46c12b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4640b3eb0 0x7fd4640b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:51.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd46c12b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4641406a0 0x7fd4640b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:51.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd46c12b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640ade70 con 0x7fd4640b3eb0 2021-12-17T18:18:51.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd46c12b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640af240 con 0x7fd464067770 2021-12-17T18:18:51.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.118+0000 7fd46c12b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640af4e0 con 0x7fd4641406a0 2021-12-17T18:18:51.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.122+0000 7fd4696c6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4640b3eb0 0x7fd4640b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:51.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.122+0000 7fd4696c6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4640b3eb0 0x7fd4640b0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48992/0 (socket says 172.21.15.62:48992) 2021-12-17T18:18:51.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.122+0000 7fd4696c6700 1 -- 172.21.15.62:0/2900843442 learned_addr learned my addr 172.21.15.62:0/2900843442 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:51.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.122+0000 7fd469ec7700 1 --2- 172.21.15.62:0/2900843442 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd464067770 0x7fd4640b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:51.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.122+0000 7fd46a6c8700 1 --2- 172.21.15.62:0/2900843442 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4641406a0 0x7fd4640b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:51.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.122+0000 7fd4696c6700 1 -- 172.21.15.62:0/2900843442 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4641406a0 msgr2=0x7fd4640b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:51.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.122+0000 7fd4696c6700 1 --2- 172.21.15.62:0/2900843442 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4641406a0 0x7fd4640b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.122+0000 7fd4696c6700 1 -- 172.21.15.62:0/2900843442 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd464067770 msgr2=0x7fd4640b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:51.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.122+0000 7fd4696c6700 1 --2- 172.21.15.62:0/2900843442 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd464067770 0x7fd4640b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.122+0000 7fd4696c6700 1 -- 172.21.15.62:0/2900843442 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45800b180 con 0x7fd4640b3eb0 2021-12-17T18:18:51.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.122+0000 7fd4696c6700 1 --2- 172.21.15.62:0/2900843442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4640b3eb0 0x7fd4640b0e60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fd464066c00 tx=0x7fd460007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:51.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.122+0000 7fd456ffd700 1 -- 172.21.15.62:0/2900843442 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4600070d0 con 0x7fd4640b3eb0 2021-12-17T18:18:51.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.122+0000 7fd456ffd700 1 -- 172.21.15.62:0/2900843442 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd460007230 con 0x7fd4640b3eb0 2021-12-17T18:18:51.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.122+0000 7fd46c12b700 1 -- 172.21.15.62:0/2900843442 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4641505a0 con 0x7fd4640b3eb0 2021-12-17T18:18:51.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.122+0000 7fd456ffd700 1 -- 172.21.15.62:0/2900843442 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd460005610 con 0x7fd4640b3eb0 2021-12-17T18:18:51.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.122+0000 7fd46c12b700 1 -- 172.21.15.62:0/2900843442 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd464150b20 con 0x7fd4640b3eb0 2021-12-17T18:18:51.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.122+0000 7fd46c12b700 1 -- 172.21.15.62:0/2900843442 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4640af6a0 con 0x7fd4640b3eb0 2021-12-17T18:18:51.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.126+0000 7fd456ffd700 1 -- 172.21.15.62:0/2900843442 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd460010070 con 0x7fd4640b3eb0 2021-12-17T18:18:51.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.126+0000 7fd456ffd700 1 --2- 172.21.15.62:0/2900843442 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd444053610 0x7fd444055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:51.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.126+0000 7fd456ffd700 1 -- 172.21.15.62:0/2900843442 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd46006ae60 con 0x7fd4640b3eb0 2021-12-17T18:18:51.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.126+0000 7fd469ec7700 1 --2- 172.21.15.62:0/2900843442 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd444053610 0x7fd444055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:51.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.126+0000 7fd469ec7700 1 --2- 172.21.15.62:0/2900843442 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd444053610 0x7fd444055ad0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fd45801a000 tx=0x7fd458014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:51.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.134+0000 7fd456ffd700 1 -- 172.21.15.62:0/2900843442 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd460045e60 con 0x7fd4640b3eb0 2021-12-17T18:18:51.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.298+0000 7fd46c12b700 1 -- 172.21.15.62:0/2900843442 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd4640573d0 con 0x7fd4640b3eb0 2021-12-17T18:18:51.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.682+0000 7fd456ffd700 1 -- 172.21.15.62:0/2900843442 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd460018070 con 0x7fd4640b3eb0 2021-12-17T18:18:51.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.686+0000 7fd46c12b700 1 -- 172.21.15.62:0/2900843442 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd444053610 msgr2=0x7fd444055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:51.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.686+0000 7fd46c12b700 1 --2- 172.21.15.62:0/2900843442 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd444053610 0x7fd444055ad0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fd45801a000 tx=0x7fd458014000).stop 2021-12-17T18:18:51.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.686+0000 7fd46c12b700 1 -- 172.21.15.62:0/2900843442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4640b3eb0 msgr2=0x7fd4640b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:51.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.686+0000 7fd46c12b700 1 --2- 172.21.15.62:0/2900843442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4640b3eb0 0x7fd4640b0e60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fd464066c00 tx=0x7fd460007c00).stop 2021-12-17T18:18:51.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.686+0000 7fd46c12b700 1 -- 172.21.15.62:0/2900843442 shutdown_connections 2021-12-17T18:18:51.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.686+0000 7fd46c12b700 1 --2- 172.21.15.62:0/2900843442 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd444053610 0x7fd444055ad0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.686+0000 7fd46c12b700 1 --2- 172.21.15.62:0/2900843442 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4641406a0 0x7fd4640b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.686+0000 7fd46c12b700 1 --2- 172.21.15.62:0/2900843442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4640b3eb0 0x7fd4640b0e60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.686+0000 7fd46c12b700 1 --2- 172.21.15.62:0/2900843442 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd464067770 0x7fd4640b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.686+0000 7fd46c12b700 1 -- 172.21.15.62:0/2900843442 >> 172.21.15.62:0/2900843442 conn(0x7fd46405cb40 msgr2=0x7fd46413f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:51.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.686+0000 7fd46c12b700 1 -- 172.21.15.62:0/2900843442 shutdown_connections 2021-12-17T18:18:51.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.686+0000 7fd46c12b700 1 -- 172.21.15.62:0/2900843442 wait complete. 2021-12-17T18:18:51.712 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-12-17T18:18:51.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.826+0000 7f1e89e36700 1 Processor -- start 2021-12-17T18:18:51.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.826+0000 7f1e89e36700 1 -- start start 2021-12-17T18:18:51.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e89e36700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1e840b31c0 0x7f1e84065d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:51.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e89e36700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e840626a0 0x7f1e84143170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:51.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e89e36700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1e84143660 0x7f1e84061390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:51.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e89e36700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e84143af0 con 0x7f1e840b31c0 2021-12-17T18:18:51.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e89e36700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e840653d0 con 0x7f1e84143660 2021-12-17T18:18:51.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e89e36700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840b35a0 con 0x7f1e840626a0 2021-12-17T18:18:51.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e88e34700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1e840b31c0 0x7f1e84065d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:51.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e88e34700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1e840b31c0 0x7f1e84065d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49000/0 (socket says 172.21.15.62:49000) 2021-12-17T18:18:51.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e88e34700 1 -- 172.21.15.62:0/2094220343 learned_addr learned my addr 172.21.15.62:0/2094220343 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:51.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e83fff700 1 --2- 172.21.15.62:0/2094220343 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e840626a0 0x7f1e84143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e89635700 1 --2- 172.21.15.62:0/2094220343 >> v2:172.21.15.109:3300/0 conn(0x7f1e84143660 0x7f1e84061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e88e34700 1 -- 172.21.15.62:0/2094220343 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e840626a0 msgr2=0x7f1e84143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e88e34700 1 --2- 172.21.15.62:0/2094220343 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e840626a0 0x7f1e84143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e88e34700 1 -- 172.21.15.62:0/2094220343 >> v2:172.21.15.109:3300/0 conn(0x7f1e84143660 msgr2=0x7f1e84061390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e88e34700 1 --2- 172.21.15.62:0/2094220343 >> v2:172.21.15.109:3300/0 conn(0x7f1e84143660 0x7f1e84061390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e88e34700 1 -- 172.21.15.62:0/2094220343 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e840661f0 con 0x7f1e840b31c0 2021-12-17T18:18:51.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e83fff700 1 --2- 172.21.15.62:0/2094220343 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e840626a0 0x7f1e84143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:51.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e88e34700 1 --2- 172.21.15.62:0/2094220343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e840b31c0 0x7f1e84065d00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f1e78002f70 tx=0x7f1e78006eb0).ready entity=mon.0 client_cookie=3c2e47cf9420f328 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:51.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e837fe700 1 -- 172.21.15.62:0/2094220343 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e7800d570 con 0x7f1e840b31c0 2021-12-17T18:18:51.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e837fe700 1 -- 172.21.15.62:0/2094220343 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e78000e90 con 0x7f1e840b31c0 2021-12-17T18:18:51.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e837fe700 1 -- 172.21.15.62:0/2094220343 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e7800d900 con 0x7f1e840b31c0 2021-12-17T18:18:51.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e89e36700 1 -- 172.21.15.62:0/2094220343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e840b31c0 msgr2=0x7f1e84065d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:51.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e89e36700 1 --2- 172.21.15.62:0/2094220343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e840b31c0 0x7f1e84065d00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f1e78002f70 tx=0x7f1e78006eb0).stop 2021-12-17T18:18:51.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e89e36700 1 -- 172.21.15.62:0/2094220343 shutdown_connections 2021-12-17T18:18:51.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e89e36700 1 --2- 172.21.15.62:0/2094220343 >> v2:172.21.15.109:3300/0 conn(0x7f1e84143660 0x7f1e84061390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e89e36700 1 --2- 172.21.15.62:0/2094220343 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e840626a0 0x7f1e84143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e89e36700 1 --2- 172.21.15.62:0/2094220343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e840b31c0 0x7f1e84065d00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e89e36700 1 -- 172.21.15.62:0/2094220343 >> 172.21.15.62:0/2094220343 conn(0x7f1e8405bcd0 msgr2=0x7f1e84063510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:51.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e89e36700 1 -- 172.21.15.62:0/2094220343 shutdown_connections 2021-12-17T18:18:51.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.830+0000 7f1e89e36700 1 -- 172.21.15.62:0/2094220343 wait complete. 2021-12-17T18:18:51.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e89e36700 1 Processor -- start 2021-12-17T18:18:51.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e89e36700 1 -- start start 2021-12-17T18:18:51.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e89e36700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e840626a0 0x7f1e8412de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:51.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e89e36700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e840b31c0 0x7f1e840b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:51.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e89e36700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1e84143660 0x7f1e840b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:51.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e89e36700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840b44a0 con 0x7f1e840b31c0 2021-12-17T18:18:51.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e89e36700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840b4200 con 0x7f1e84143660 2021-12-17T18:18:51.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e89e36700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840b4820 con 0x7f1e840626a0 2021-12-17T18:18:51.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e83fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e840b31c0 0x7f1e840b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:51.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e83fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e840b31c0 0x7f1e840b4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49008/0 (socket says 172.21.15.62:49008) 2021-12-17T18:18:51.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e83fff700 1 -- 172.21.15.62:0/3143604209 learned_addr learned my addr 172.21.15.62:0/3143604209 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:51.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e88e34700 1 --2- 172.21.15.62:0/3143604209 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e840626a0 0x7f1e8412de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:51.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e89635700 1 --2- 172.21.15.62:0/3143604209 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1e84143660 0x7f1e840b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:51.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e83fff700 1 -- 172.21.15.62:0/3143604209 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e840626a0 msgr2=0x7f1e8412de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:51.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e83fff700 1 --2- 172.21.15.62:0/3143604209 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e840626a0 0x7f1e8412de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e83fff700 1 -- 172.21.15.62:0/3143604209 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1e84143660 msgr2=0x7f1e840b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:51.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e83fff700 1 --2- 172.21.15.62:0/3143604209 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1e84143660 0x7f1e840b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:51.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e83fff700 1 -- 172.21.15.62:0/3143604209 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7800b1e0 con 0x7f1e840b31c0 2021-12-17T18:18:51.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e83fff700 1 --2- 172.21.15.62:0/3143604209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e840b31c0 0x7f1e840b4d60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f1e7000a000 tx=0x7f1e70008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:51.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e81ffb700 1 -- 172.21.15.62:0/3143604209 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e70011780 con 0x7f1e840b31c0 2021-12-17T18:18:51.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e81ffb700 1 -- 172.21.15.62:0/3143604209 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e700118e0 con 0x7f1e840b31c0 2021-12-17T18:18:51.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e89e36700 1 -- 172.21.15.62:0/3143604209 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e840b5740 con 0x7f1e840b31c0 2021-12-17T18:18:51.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e81ffb700 1 -- 172.21.15.62:0/3143604209 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e70011c40 con 0x7f1e840b31c0 2021-12-17T18:18:51.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.834+0000 7f1e89e36700 1 -- 172.21.15.62:0/3143604209 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8414a430 con 0x7f1e840b31c0 2021-12-17T18:18:51.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.838+0000 7f1e89e36700 1 -- 172.21.15.62:0/3143604209 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e840655c0 con 0x7f1e840b31c0 2021-12-17T18:18:51.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.838+0000 7f1e81ffb700 1 -- 172.21.15.62:0/3143604209 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1e7001c460 con 0x7f1e840b31c0 2021-12-17T18:18:51.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.838+0000 7f1e81ffb700 1 --2- 172.21.15.62:0/3143604209 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e64053610 0x7f1e64055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:51.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.838+0000 7f1e81ffb700 1 -- 172.21.15.62:0/3143604209 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1e7006bc20 con 0x7f1e840b31c0 2021-12-17T18:18:51.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.838+0000 7f1e88e34700 1 --2- 172.21.15.62:0/3143604209 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e64053610 0x7f1e64055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:51.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.838+0000 7f1e88e34700 1 --2- 172.21.15.62:0/3143604209 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e64053610 0x7f1e64055ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1e7801c000 tx=0x7f1e78015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:51.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.846+0000 7f1e81ffb700 1 -- 172.21.15.62:0/3143604209 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1e70042bc0 con 0x7f1e840b31c0 2021-12-17T18:18:51.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:51.978+0000 7f1e89e36700 1 -- 172.21.15.62:0/3143604209 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1e840b5930 con 0x7f1e840b31c0 2021-12-17T18:18:52.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.726+0000 7f1e81ffb700 1 -- 172.21.15.62:0/3143604209 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 185+0+0 (secure 0 0 0) 0x7f1e700461e0 con 0x7f1e840b31c0 2021-12-17T18:18:52.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.734+0000 7f1e89e36700 1 -- 172.21.15.62:0/3143604209 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e64053610 msgr2=0x7f1e64055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:52.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.734+0000 7f1e89e36700 1 --2- 172.21.15.62:0/3143604209 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e64053610 0x7f1e64055ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1e7801c000 tx=0x7f1e78015000).stop 2021-12-17T18:18:52.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.734+0000 7f1e89e36700 1 -- 172.21.15.62:0/3143604209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e840b31c0 msgr2=0x7f1e840b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:52.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.734+0000 7f1e89e36700 1 --2- 172.21.15.62:0/3143604209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e840b31c0 0x7f1e840b4d60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f1e7000a000 tx=0x7f1e70008040).stop 2021-12-17T18:18:52.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.734+0000 7f1e89e36700 1 -- 172.21.15.62:0/3143604209 shutdown_connections 2021-12-17T18:18:52.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.734+0000 7f1e89e36700 1 --2- 172.21.15.62:0/3143604209 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e64053610 0x7f1e64055ad0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:52.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.734+0000 7f1e89e36700 1 --2- 172.21.15.62:0/3143604209 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1e84143660 0x7f1e840b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:52.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.734+0000 7f1e89e36700 1 --2- 172.21.15.62:0/3143604209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e840b31c0 0x7f1e840b4d60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:52.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.734+0000 7f1e89e36700 1 --2- 172.21.15.62:0/3143604209 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e840626a0 0x7f1e8412de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:52.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.734+0000 7f1e89e36700 1 -- 172.21.15.62:0/3143604209 >> 172.21.15.62:0/3143604209 conn(0x7f1e8405bcd0 msgr2=0x7f1e84061b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:52.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.734+0000 7f1e89e36700 1 -- 172.21.15.62:0/3143604209 shutdown_connections 2021-12-17T18:18:52.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.734+0000 7f1e89e36700 1 -- 172.21.15.62:0/3143604209 wait complete. 2021-12-17T18:18:52.744 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2021-12-17T18:18:52.754 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-12-17T18:18:52.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.858+0000 7f8a7d337700 1 Processor -- start 2021-12-17T18:18:52.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.858+0000 7f8a7d337700 1 -- start start 2021-12-17T18:18:52.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.858+0000 7f8a7d337700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f8a78142d70 0x7f8a781471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:52.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.858+0000 7f8a7d337700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a780b09e0 con 0x7f8a780b51a0 2021-12-17T18:18:52.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.858+0000 7f8a7d337700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a781467d0 con 0x7f8a780b4340 2021-12-17T18:18:52.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.858+0000 7f8a7d337700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a78146a70 con 0x7f8a78142d70 2021-12-17T18:18:52.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.858+0000 7f8a777fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8a780b51a0 0x7f8a780b5a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60830/0 (socket says 172.21.15.62:60830) 2021-12-17T18:18:52.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.858+0000 7f8a777fe700 1 -- 172.21.15.62:0/808295507 learned_addr learned my addr 172.21.15.62:0/808295507 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:52.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.858+0000 7f8a767fc700 1 --2- 172.21.15.62:0/808295507 >> v2:172.21.15.109:3300/0 conn(0x7f8a78142d70 0x7f8a781471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:52.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.858+0000 7f8a75ffb700 1 -- 172.21.15.62:0/808295507 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447848327 0 0) 0x7f8a780b09e0 con 0x7f8a780b51a0 2021-12-17T18:18:52.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.858+0000 7f8a75ffb700 1 -- 172.21.15.62:0/808295507 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a5c003260 con 0x7f8a780b51a0 2021-12-17T18:18:52.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.858+0000 7f8a767fc700 1 -- 172.21.15.62:0/808295507 >> v1:172.21.15.109:6789/0 conn(0x7f8a780b4340 legacy=0x7f8a78142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:52.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.858+0000 7f8a767fc700 1 -- 172.21.15.62:0/808295507 >> v1:172.21.15.62:6789/0 conn(0x7f8a780b51a0 legacy=0x7f8a780b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:52.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.858+0000 7f8a767fc700 1 -- 172.21.15.62:0/808295507 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a78146d10 con 0x7f8a78142d70 2021-12-17T18:18:52.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.858+0000 7f8a767fc700 1 --2- 172.21.15.62:0/808295507 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a78142d70 0x7f8a781471b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f8a6c002f70 tx=0x7f8a6c006df0).ready entity=mon.1 client_cookie=d8aa93ae6ae46aad server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:52.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.858+0000 7f8a75ffb700 1 -- 172.21.15.62:0/808295507 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a6c00d610 con 0x7f8a78142d70 2021-12-17T18:18:52.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.858+0000 7f8a75ffb700 1 -- 172.21.15.62:0/808295507 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6c000e90 con 0x7f8a78142d70 2021-12-17T18:18:52.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a75ffb700 1 -- 172.21.15.62:0/808295507 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a6c00d960 con 0x7f8a78142d70 2021-12-17T18:18:52.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a7d337700 1 -- 172.21.15.62:0/808295507 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a78142d70 msgr2=0x7f8a781471b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:52.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a7d337700 1 --2- 172.21.15.62:0/808295507 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a78142d70 0x7f8a781471b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f8a6c002f70 tx=0x7f8a6c006df0).stop 2021-12-17T18:18:52.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a7d337700 1 -- 172.21.15.62:0/808295507 shutdown_connections 2021-12-17T18:18:52.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a7d337700 1 --2- 172.21.15.62:0/808295507 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a78142d70 0x7f8a781471b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:52.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a7d337700 1 -- 172.21.15.62:0/808295507 >> 172.21.15.62:0/808295507 conn(0x7f8a7805c750 msgr2=0x7f8a7805cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:52.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a7d337700 1 -- 172.21.15.62:0/808295507 shutdown_connections 2021-12-17T18:18:52.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a7d337700 1 -- 172.21.15.62:0/808295507 wait complete. 2021-12-17T18:18:52.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a7d337700 1 Processor -- start 2021-12-17T18:18:52.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a7d337700 1 -- start start 2021-12-17T18:18:52.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a7d337700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a780b4340 0x7f8a7805fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:52.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a7d337700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a780b51a0 0x7f8a7813faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:52.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a7d337700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a78142d70 0x7f8a7813ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:52.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a7d337700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a78060b90 con 0x7f8a780b4340 2021-12-17T18:18:52.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a7d337700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a781404d0 con 0x7f8a780b51a0 2021-12-17T18:18:52.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a7d337700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a78067150 con 0x7f8a78142d70 2021-12-17T18:18:52.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a76ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a780b4340 0x7f8a7805fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:52.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a76ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a780b4340 0x7f8a7805fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49020/0 (socket says 172.21.15.62:49020) 2021-12-17T18:18:52.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a76ffd700 1 -- 172.21.15.62:0/1598353734 learned_addr learned my addr 172.21.15.62:0/1598353734 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:52.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a767fc700 1 --2- 172.21.15.62:0/1598353734 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a780b51a0 0x7f8a7813faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:52.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a777fe700 1 --2- 172.21.15.62:0/1598353734 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a78142d70 0x7f8a7813ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:52.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a76ffd700 1 -- 172.21.15.62:0/1598353734 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a78142d70 msgr2=0x7f8a7813ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:52.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a76ffd700 1 --2- 172.21.15.62:0/1598353734 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a78142d70 0x7f8a7813ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:52.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a76ffd700 1 -- 172.21.15.62:0/1598353734 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a780b51a0 msgr2=0x7f8a7813faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:52.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a76ffd700 1 --2- 172.21.15.62:0/1598353734 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a780b51a0 0x7f8a7813faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:52.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a76ffd700 1 -- 172.21.15.62:0/1598353734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c00b180 con 0x7f8a780b4340 2021-12-17T18:18:52.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a767fc700 1 --2- 172.21.15.62:0/1598353734 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a780b51a0 0x7f8a7813faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:52.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a76ffd700 1 --2- 172.21.15.62:0/1598353734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a780b4340 0x7f8a7805fda0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f8a78061b00 tx=0x7f8a68007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:52.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a67fff700 1 -- 172.21.15.62:0/1598353734 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a6800ce30 con 0x7f8a780b4340 2021-12-17T18:18:52.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a67fff700 1 -- 172.21.15.62:0/1598353734 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6800f470 con 0x7f8a780b4340 2021-12-17T18:18:52.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a7d337700 1 -- 172.21.15.62:0/1598353734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a78153210 con 0x7f8a780b4340 2021-12-17T18:18:52.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a67fff700 1 -- 172.21.15.62:0/1598353734 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a6800f7d0 con 0x7f8a780b4340 2021-12-17T18:18:52.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.862+0000 7f8a7d337700 1 -- 172.21.15.62:0/1598353734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a780655d0 con 0x7f8a780b4340 2021-12-17T18:18:52.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.866+0000 7f8a67fff700 1 -- 172.21.15.62:0/1598353734 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8a68010070 con 0x7f8a780b4340 2021-12-17T18:18:52.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.866+0000 7f8a7d337700 1 -- 172.21.15.62:0/1598353734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a78067310 con 0x7f8a780b4340 2021-12-17T18:18:52.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.866+0000 7f8a67fff700 1 --2- 172.21.15.62:0/1598353734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8a54053580 0x7f8a54055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:52.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.866+0000 7f8a67fff700 1 -- 172.21.15.62:0/1598353734 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f8a6806a960 con 0x7f8a780b4340 2021-12-17T18:18:52.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.866+0000 7f8a767fc700 1 --2- 172.21.15.62:0/1598353734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8a54053580 0x7f8a54055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:52.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.866+0000 7f8a767fc700 1 --2- 172.21.15.62:0/1598353734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8a54053580 0x7f8a54055a40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f8a6c018000 tx=0x7f8a6c014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:52.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.874+0000 7f8a67fff700 1 -- 172.21.15.62:0/1598353734 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8a68041ba0 con 0x7f8a780b4340 2021-12-17T18:18:53.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:52.998+0000 7f8a7d337700 1 -- 172.21.15.62:0/1598353734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8a780ba130 con 0x7f8a780b4340 2021-12-17T18:18:53.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.738+0000 7f8a67fff700 1 -- 172.21.15.62:0/1598353734 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 173+0+0 (secure 0 0 0) 0x7f8a680451c0 con 0x7f8a780b4340 2021-12-17T18:18:53.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.746+0000 7f8a7d337700 1 -- 172.21.15.62:0/1598353734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8a54053580 msgr2=0x7f8a54055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:53.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.746+0000 7f8a7d337700 1 --2- 172.21.15.62:0/1598353734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8a54053580 0x7f8a54055a40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f8a6c018000 tx=0x7f8a6c014000).stop 2021-12-17T18:18:53.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.746+0000 7f8a7d337700 1 -- 172.21.15.62:0/1598353734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a780b4340 msgr2=0x7f8a7805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:53.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.746+0000 7f8a7d337700 1 --2- 172.21.15.62:0/1598353734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a780b4340 0x7f8a7805fda0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f8a78061b00 tx=0x7f8a68007c50).stop 2021-12-17T18:18:53.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.746+0000 7f8a7d337700 1 -- 172.21.15.62:0/1598353734 shutdown_connections 2021-12-17T18:18:53.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.746+0000 7f8a7d337700 1 --2- 172.21.15.62:0/1598353734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8a54053580 0x7f8a54055a40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:53.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.746+0000 7f8a7d337700 1 --2- 172.21.15.62:0/1598353734 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a78142d70 0x7f8a7813ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:53.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.746+0000 7f8a7d337700 1 --2- 172.21.15.62:0/1598353734 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a780b51a0 0x7f8a7813faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:53.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.746+0000 7f8a7d337700 1 --2- 172.21.15.62:0/1598353734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a780b4340 0x7f8a7805fda0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:53.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.746+0000 7f8a7d337700 1 -- 172.21.15.62:0/1598353734 >> 172.21.15.62:0/1598353734 conn(0x7f8a7805c750 msgr2=0x7f8a78140770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:53.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.746+0000 7f8a7d337700 1 -- 172.21.15.62:0/1598353734 shutdown_connections 2021-12-17T18:18:53.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.746+0000 7f8a7d337700 1 -- 172.21.15.62:0/1598353734 wait complete. 2021-12-17T18:18:53.756 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2021-12-17T18:18:53.766 INFO:tasks.ceph.mds.a:Restarting daemon 2021-12-17T18:18:53.766 INFO:tasks.ceph.mds.a:Stopping old one... 2021-12-17T18:18:53.767 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-12-17T18:18:53.767 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:18:53.767 INFO:tasks.ceph.mds.b:Restarting daemon 2021-12-17T18:18:53.768 INFO:tasks.ceph.mds.b:Stopping old one... 2021-12-17T18:18:53.768 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-12-17T18:18:53.768 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:18:53.778 INFO:tasks.ceph.mds.a:Stopped 2021-12-17T18:18:53.778 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-12-17T18:18:53.781 INFO:tasks.ceph.mds.a:Started 2021-12-17T18:18:53.781 DEBUG:teuthology.parallel:result is None 2021-12-17T18:18:53.783 INFO:tasks.ceph.mds.b:Stopped 2021-12-17T18:18:53.783 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-12-17T18:18:53.826 INFO:tasks.ceph.mds.b:Started 2021-12-17T18:18:53.827 DEBUG:teuthology.parallel:result is None 2021-12-17T18:18:53.827 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-12-17T18:18:53.855 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:18:53.904 INFO:tasks.ceph.mds.b.smithi109.stdout:starting mds.b at 2021-12-17T18:18:53.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.930+0000 7f85cf1ce700 1 Processor -- start 2021-12-17T18:18:53.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.930+0000 7f85cf1ce700 1 -- start start 2021-12-17T18:18:53.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.930+0000 7f85cf1ce700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85c813ef50 0x7f85c813f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:53.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.930+0000 7f85cf1ce700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c80b69f0 con 0x7f85c80b6610 2021-12-17T18:18:53.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.930+0000 7f85cf1ce700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c80b1c40 con 0x7f85c80630e0 2021-12-17T18:18:53.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.930+0000 7f85cf1ce700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c8143800 con 0x7f85c813ef50 2021-12-17T18:18:53.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.930+0000 7f85ce1cc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f85c80b6610 0x7f85c81430f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60852/0 (socket says 172.21.15.62:60852) 2021-12-17T18:18:53.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.930+0000 7f85ce1cc700 1 -- 172.21.15.62:0/2924722490 learned_addr learned my addr 172.21.15.62:0/2924722490 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:53.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.930+0000 7f85ce9cd700 1 --2- 172.21.15.62:0/2924722490 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85c813ef50 0x7f85c813f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:53.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.930+0000 7f85cd1ca700 1 -- 172.21.15.62:0/2924722490 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845118706 0 0) 0x7f85c80b69f0 con 0x7f85c80b6610 2021-12-17T18:18:53.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.930+0000 7f85cd1ca700 1 -- 172.21.15.62:0/2924722490 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85b4003260 con 0x7f85c80b6610 2021-12-17T18:18:53.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.934+0000 7f85ce9cd700 1 -- 172.21.15.62:0/2924722490 >> v1:172.21.15.109:6789/0 conn(0x7f85c80630e0 legacy=0x7f85c80b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:53.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.934+0000 7f85ce9cd700 1 -- 172.21.15.62:0/2924722490 >> v1:172.21.15.62:6789/0 conn(0x7f85c80b6610 legacy=0x7f85c81430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:53.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.934+0000 7f85ce9cd700 1 -- 172.21.15.62:0/2924722490 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c80b0260 con 0x7f85c813ef50 2021-12-17T18:18:53.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.934+0000 7f85ce9cd700 1 --2- 172.21.15.62:0/2924722490 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85c813ef50 0x7f85c813f3e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f85c0002f70 tx=0x7f85c0006df0).ready entity=mon.2 client_cookie=ee1da94e0239a0ee server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:53.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.934+0000 7f85cd1ca700 1 -- 172.21.15.62:0/2924722490 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c000d570 con 0x7f85c813ef50 2021-12-17T18:18:53.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.934+0000 7f85cd1ca700 1 -- 172.21.15.62:0/2924722490 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c0000e90 con 0x7f85c813ef50 2021-12-17T18:18:53.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.934+0000 7f85cd1ca700 1 -- 172.21.15.62:0/2924722490 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c000d8c0 con 0x7f85c813ef50 2021-12-17T18:18:53.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.934+0000 7f85cf1ce700 1 -- 172.21.15.62:0/2924722490 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85c813ef50 msgr2=0x7f85c813f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:53.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.934+0000 7f85cf1ce700 1 --2- 172.21.15.62:0/2924722490 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85c813ef50 0x7f85c813f3e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f85c0002f70 tx=0x7f85c0006df0).stop 2021-12-17T18:18:53.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.934+0000 7f85cf1ce700 1 -- 172.21.15.62:0/2924722490 shutdown_connections 2021-12-17T18:18:53.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.934+0000 7f85cf1ce700 1 --2- 172.21.15.62:0/2924722490 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85c813ef50 0x7f85c813f3e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:53.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.934+0000 7f85cf1ce700 1 -- 172.21.15.62:0/2924722490 >> 172.21.15.62:0/2924722490 conn(0x7f85c805d1c0 msgr2=0x7f85c80b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:53.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.934+0000 7f85cf1ce700 1 -- 172.21.15.62:0/2924722490 shutdown_connections 2021-12-17T18:18:53.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.934+0000 7f85cf1ce700 1 -- 172.21.15.62:0/2924722490 wait complete. 2021-12-17T18:18:53.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cf1ce700 1 Processor -- start 2021-12-17T18:18:53.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cf1ce700 1 -- start start 2021-12-17T18:18:53.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cf1ce700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85c80630e0 0x7f85c814c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:53.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cf1ce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85c80b6610 0x7f85c815a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:53.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cf1ce700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f85c813ef50 0x7f85c81564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:53.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cf1ce700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c8159be0 con 0x7f85c80b6610 2021-12-17T18:18:53.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cf1ce700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c8159e80 con 0x7f85c813ef50 2021-12-17T18:18:53.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cf1ce700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80b5710 con 0x7f85c80630e0 2021-12-17T18:18:53.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cd9cb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85c80b6610 0x7f85c815a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:53.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cd9cb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85c80b6610 0x7f85c815a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49046/0 (socket says 172.21.15.62:49046) 2021-12-17T18:18:53.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cd9cb700 1 -- 172.21.15.62:0/4290537671 learned_addr learned my addr 172.21.15.62:0/4290537671 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:53.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85ce9cd700 1 --2- 172.21.15.62:0/4290537671 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f85c813ef50 0x7f85c81564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:53.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85ce1cc700 1 --2- 172.21.15.62:0/4290537671 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85c80630e0 0x7f85c814c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:53.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cd9cb700 1 -- 172.21.15.62:0/4290537671 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85c80630e0 msgr2=0x7f85c814c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:53.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cd9cb700 1 --2- 172.21.15.62:0/4290537671 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85c80630e0 0x7f85c814c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:53.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cd9cb700 1 -- 172.21.15.62:0/4290537671 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f85c813ef50 msgr2=0x7f85c81564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:53.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cd9cb700 1 --2- 172.21.15.62:0/4290537671 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f85c813ef50 0x7f85c81564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:53.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cd9cb700 1 -- 172.21.15.62:0/4290537671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c000b180 con 0x7f85c80b6610 2021-12-17T18:18:53.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85ce9cd700 1 --2- 172.21.15.62:0/4290537671 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f85c813ef50 0x7f85c81564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:53.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85ce1cc700 1 --2- 172.21.15.62:0/4290537671 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85c80630e0 0x7f85c814c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:53.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cd9cb700 1 --2- 172.21.15.62:0/4290537671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85c80b6610 0x7f85c815a320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f85c80608e0 tx=0x7f85bc007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:53.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85c77fe700 1 -- 172.21.15.62:0/4290537671 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85bc007030 con 0x7f85c80b6610 2021-12-17T18:18:53.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85c77fe700 1 -- 172.21.15.62:0/4290537671 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc007190 con 0x7f85c80b6610 2021-12-17T18:18:53.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cf1ce700 1 -- 172.21.15.62:0/4290537671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c814c8b0 con 0x7f85c80b6610 2021-12-17T18:18:53.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85c77fe700 1 -- 172.21.15.62:0/4290537671 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85bc006510 con 0x7f85c80b6610 2021-12-17T18:18:53.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.938+0000 7f85cf1ce700 1 -- 172.21.15.62:0/4290537671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c80b4d20 con 0x7f85c80b6610 2021-12-17T18:18:53.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.942+0000 7f85cf1ce700 1 -- 172.21.15.62:0/4290537671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c815a040 con 0x7f85c80b6610 2021-12-17T18:18:53.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.942+0000 7f85c77fe700 1 -- 172.21.15.62:0/4290537671 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f85bc010030 con 0x7f85c80b6610 2021-12-17T18:18:53.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.942+0000 7f85c77fe700 1 --2- 172.21.15.62:0/4290537671 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85a8053640 0x7f85a8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:53.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.942+0000 7f85c77fe700 1 -- 172.21.15.62:0/4290537671 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f85bc06b230 con 0x7f85c80b6610 2021-12-17T18:18:53.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.942+0000 7f85ce1cc700 1 --2- 172.21.15.62:0/4290537671 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85a8053640 0x7f85a8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:53.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.942+0000 7f85ce1cc700 1 --2- 172.21.15.62:0/4290537671 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85a8053640 0x7f85a8055b00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f85b800d000 tx=0x7f85b8009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:53.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:53.946+0000 7f85c77fe700 1 -- 172.21.15.62:0/4290537671 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f85bc042670 con 0x7f85c80b6610 2021-12-17T18:18:54.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:54.078+0000 7f85cf1ce700 1 -- 172.21.15.62:0/4290537671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f85c80b0500 con 0x7f85c80b6610 2021-12-17T18:18:54.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:54.942+0000 7f85c77fe700 1 -- 172.21.15.62:0/4290537671 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f85bc045c90 con 0x7f85c80b6610 2021-12-17T18:18:54.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:54.946+0000 7f85cf1ce700 1 -- 172.21.15.62:0/4290537671 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85a8053640 msgr2=0x7f85a8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:54.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:54.946+0000 7f85cf1ce700 1 --2- 172.21.15.62:0/4290537671 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85a8053640 0x7f85a8055b00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f85b800d000 tx=0x7f85b8009040).stop 2021-12-17T18:18:54.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:54.946+0000 7f85cf1ce700 1 -- 172.21.15.62:0/4290537671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85c80b6610 msgr2=0x7f85c815a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:54.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:54.946+0000 7f85cf1ce700 1 --2- 172.21.15.62:0/4290537671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85c80b6610 0x7f85c815a320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f85c80608e0 tx=0x7f85bc007c10).stop 2021-12-17T18:18:54.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:54.946+0000 7f85cf1ce700 1 -- 172.21.15.62:0/4290537671 shutdown_connections 2021-12-17T18:18:54.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:54.946+0000 7f85cf1ce700 1 --2- 172.21.15.62:0/4290537671 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85a8053640 0x7f85a8055b00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:54.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:54.946+0000 7f85cf1ce700 1 --2- 172.21.15.62:0/4290537671 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f85c813ef50 0x7f85c81564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:54.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:54.946+0000 7f85cf1ce700 1 --2- 172.21.15.62:0/4290537671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85c80b6610 0x7f85c815a320 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:54.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:54.946+0000 7f85cf1ce700 1 --2- 172.21.15.62:0/4290537671 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85c80630e0 0x7f85c814c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:54.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:54.946+0000 7f85cf1ce700 1 -- 172.21.15.62:0/4290537671 >> 172.21.15.62:0/4290537671 conn(0x7f85c805d1c0 msgr2=0x7f85c80b08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:54.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:54.946+0000 7f85cf1ce700 1 -- 172.21.15.62:0/4290537671 shutdown_connections 2021-12-17T18:18:54.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:54.946+0000 7f85cf1ce700 1 -- 172.21.15.62:0/4290537671 wait complete. 2021-12-17T18:18:54.956 INFO:teuthology.orchestra.run.smithi062.stderr: removed all blacklist entries 2021-12-17T18:18:54.968 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-12-17T18:18:54.969 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-12-17T18:18:55.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.070+0000 7f492e252700 1 Processor -- start 2021-12-17T18:18:55.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.070+0000 7f492e252700 1 -- start start 2021-12-17T18:18:55.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.070+0000 7f492e252700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f4928067870 0x7f4928147e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.070+0000 7f492e252700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49280b3e20 con 0x7f49280b3a40 2021-12-17T18:18:55.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.070+0000 7f492e252700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49281476c0 con 0x7f49281482f0 2021-12-17T18:18:55.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.070+0000 7f492e252700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49280b1b10 con 0x7f4928067870 2021-12-17T18:18:55.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.070+0000 7f492d250700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f49280b3a40 0x7f49280b1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60868/0 (socket says 172.21.15.62:60868) 2021-12-17T18:18:55.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.070+0000 7f492d250700 1 -- 172.21.15.62:0/1508145092 learned_addr learned my addr 172.21.15.62:0/1508145092 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:55.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.070+0000 7f492ca4f700 1 --2- 172.21.15.62:0/1508145092 >> v2:172.21.15.109:3300/0 conn(0x7f4928067870 0x7f4928147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.070+0000 7f491bfff700 1 -- 172.21.15.62:0/1508145092 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145585580 0 0) 0x7f49280b3e20 con 0x7f49280b3a40 2021-12-17T18:18:55.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.070+0000 7f491bfff700 1 -- 172.21.15.62:0/1508145092 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f490c003260 con 0x7f49280b3a40 2021-12-17T18:18:55.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.070+0000 7f492ca4f700 1 -- 172.21.15.62:0/1508145092 >> v1:172.21.15.109:6789/0 conn(0x7f49281482f0 legacy=0x7f4928146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.070+0000 7f491bfff700 1 -- 172.21.15.62:0/1508145092 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1631024585 0 0) 0x7f490c003260 con 0x7f49280b3a40 2021-12-17T18:18:55.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.070+0000 7f492ca4f700 1 -- 172.21.15.62:0/1508145092 >> v1:172.21.15.62:6789/0 conn(0x7f49280b3a40 legacy=0x7f49280b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.070+0000 7f492ca4f700 1 -- 172.21.15.62:0/1508145092 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4928147960 con 0x7f4928067870 2021-12-17T18:18:55.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.074+0000 7f492ca4f700 1 --2- 172.21.15.62:0/1508145092 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4928067870 0x7f4928147e00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f4924001800 tx=0x7f491c006df0).ready entity=mon.1 client_cookie=3d542a744c0ea562 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:55.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.074+0000 7f491bfff700 1 -- 172.21.15.62:0/1508145092 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4924001660 con 0x7f4928067870 2021-12-17T18:18:55.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.074+0000 7f491bfff700 1 -- 172.21.15.62:0/1508145092 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c000e90 con 0x7f4928067870 2021-12-17T18:18:55.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.074+0000 7f491bfff700 1 -- 172.21.15.62:0/1508145092 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f491c00d4f0 con 0x7f4928067870 2021-12-17T18:18:55.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.074+0000 7f492e252700 1 -- 172.21.15.62:0/1508145092 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4928067870 msgr2=0x7f4928147e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.074+0000 7f492e252700 1 --2- 172.21.15.62:0/1508145092 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4928067870 0x7f4928147e00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f4924001800 tx=0x7f491c006df0).stop 2021-12-17T18:18:55.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.074+0000 7f492e252700 1 -- 172.21.15.62:0/1508145092 shutdown_connections 2021-12-17T18:18:55.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.074+0000 7f492e252700 1 --2- 172.21.15.62:0/1508145092 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4928067870 0x7f4928147e00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.074+0000 7f492e252700 1 -- 172.21.15.62:0/1508145092 >> 172.21.15.62:0/1508145092 conn(0x7f49280b7020 msgr2=0x7f49280b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:55.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.074+0000 7f492e252700 1 -- 172.21.15.62:0/1508145092 shutdown_connections 2021-12-17T18:18:55.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.074+0000 7f492e252700 1 -- 172.21.15.62:0/1508145092 wait complete. 2021-12-17T18:18:55.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492e252700 1 Processor -- start 2021-12-17T18:18:55.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492e252700 1 -- start start 2021-12-17T18:18:55.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492e252700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4928067870 0x7f4928117f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492e252700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49280b3a40 0x7f4928066eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492e252700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49281482f0 0x7f49281449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492e252700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4928063620 con 0x7f49281482f0 2021-12-17T18:18:55.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492e252700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4928157410 con 0x7f4928067870 2021-12-17T18:18:55.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492e252700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4928063850 con 0x7f49280b3a40 2021-12-17T18:18:55.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492da51700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49281482f0 0x7f49281449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492da51700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49281482f0 0x7f49281449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49064/0 (socket says 172.21.15.62:49064) 2021-12-17T18:18:55.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492da51700 1 -- 172.21.15.62:0/1387934548 learned_addr learned my addr 172.21.15.62:0/1387934548 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:55.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492d250700 1 --2- 172.21.15.62:0/1387934548 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4928067870 0x7f4928117f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492ca4f700 1 --2- 172.21.15.62:0/1387934548 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49280b3a40 0x7f4928066eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492da51700 1 -- 172.21.15.62:0/1387934548 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49280b3a40 msgr2=0x7f4928066eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492da51700 1 --2- 172.21.15.62:0/1387934548 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49280b3a40 0x7f4928066eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492da51700 1 -- 172.21.15.62:0/1387934548 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4928067870 msgr2=0x7f4928117f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492da51700 1 --2- 172.21.15.62:0/1387934548 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4928067870 0x7f4928117f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492da51700 1 -- 172.21.15.62:0/1387934548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c00b180 con 0x7f49281482f0 2021-12-17T18:18:55.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492da51700 1 --2- 172.21.15.62:0/1387934548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49281482f0 0x7f49281449a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f49280b6460 tx=0x7f4920007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:55.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f491affd700 1 -- 172.21.15.62:0/1387934548 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4920006aa0 con 0x7f49281482f0 2021-12-17T18:18:55.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f491affd700 1 -- 172.21.15.62:0/1387934548 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4920006c00 con 0x7f49281482f0 2021-12-17T18:18:55.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492e252700 1 -- 172.21.15.62:0/1387934548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49280673a0 con 0x7f49281482f0 2021-12-17T18:18:55.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f491affd700 1 -- 172.21.15.62:0/1387934548 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4920007030 con 0x7f49281482f0 2021-12-17T18:18:55.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.078+0000 7f492e252700 1 -- 172.21.15.62:0/1387934548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4928157050 con 0x7f49281482f0 2021-12-17T18:18:55.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.082+0000 7f492e252700 1 -- 172.21.15.62:0/1387934548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49280573d0 con 0x7f49281482f0 2021-12-17T18:18:55.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.082+0000 7f491affd700 1 -- 172.21.15.62:0/1387934548 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4920010030 con 0x7f49281482f0 2021-12-17T18:18:55.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.082+0000 7f491affd700 1 --2- 172.21.15.62:0/1387934548 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4904053580 0x7f4904055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.082+0000 7f491affd700 1 -- 172.21.15.62:0/1387934548 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f492006b3a0 con 0x7f49281482f0 2021-12-17T18:18:55.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.082+0000 7f492d250700 1 --2- 172.21.15.62:0/1387934548 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4904053580 0x7f4904055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.082+0000 7f492d250700 1 --2- 172.21.15.62:0/1387934548 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4904053580 0x7f4904055a40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f492400d000 tx=0x7f4924000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:55.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.090+0000 7f491affd700 1 -- 172.21.15.62:0/1387934548 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4920042830 con 0x7f49281482f0 2021-12-17T18:18:55.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.254+0000 7f492e252700 1 -- 172.21.15.62:0/1387934548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4928068f30 con 0x7f49281482f0 2021-12-17T18:18:55.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.258+0000 7f491affd700 1 -- 172.21.15.62:0/1387934548 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+5627 (secure 0 0 0) 0x7f4920045e50 con 0x7f49281482f0 2021-12-17T18:18:55.265 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:55.265 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:18:55.265 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_dump": [ 2021-12-17T18:18:55.266 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.266 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.a", 2021-12-17T18:18:55.266 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhxCS0LBAAtUlkgWYg4l3fQ2au7jMUDg==", 2021-12-17T18:18:55.266 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.267 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:18:55.267 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:18:55.267 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:18:55.267 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:18:55.267 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.268 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.268 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.268 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.b", 2021-12-17T18:18:55.268 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhoRJAMxAAP/NmDQRwJjYip2rxJsQlYg==", 2021-12-17T18:18:55.269 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.269 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:18:55.269 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:18:55.269 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:18:55.269 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:18:55.270 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.270 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.270 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.270 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.0", 2021-12-17T18:18:55.271 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBA1LxhJXzhKhAAUnxP3G5VuATkQLoDALFjVg==", 2021-12-17T18:18:55.271 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.271 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:18:55.271 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:18:55.271 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:18:55.272 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.272 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.272 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.272 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.1", 2021-12-17T18:18:55.272 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBD1LxhregUDhAABrxQ2jQ4BwXvuWh/D9SkbQ==", 2021-12-17T18:18:55.273 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.273 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:18:55.273 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:18:55.273 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:18:55.274 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.274 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.274 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.274 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.2", 2021-12-17T18:18:55.274 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBF1LxhOo/SLhAAhQQLW/VKFx1sgm8chnD5tw==", 2021-12-17T18:18:55.275 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.275 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:18:55.275 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:18:55.275 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:18:55.276 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.276 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.276 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.276 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.3", 2021-12-17T18:18:55.276 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBI1LxhT2ZQExAA999j8V5bJAJ2PuaQqSkUOw==", 2021-12-17T18:18:55.277 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.277 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:18:55.277 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:18:55.277 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:18:55.278 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.278 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.278 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.278 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.4", 2021-12-17T18:18:55.279 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBN1LxhKBDzFhAAKmPF0FXnnfXtweo+6z9nxg==", 2021-12-17T18:18:55.279 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.279 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:18:55.279 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:18:55.279 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:18:55.280 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.280 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.280 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.280 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.5", 2021-12-17T18:18:55.280 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBP1LxhtqkAORAAVaFLVNIUMs4Sytk8WRaGNA==", 2021-12-17T18:18:55.281 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.281 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:18:55.281 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:18:55.281 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:18:55.282 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.282 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.282 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.282 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.6", 2021-12-17T18:18:55.283 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBS1LxhNtncGhAAgG64g1ie54CDp9Y7uldKQA==", 2021-12-17T18:18:55.283 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.283 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:18:55.283 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:18:55.283 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:18:55.284 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.284 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.284 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.284 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.7", 2021-12-17T18:18:55.285 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBV1Lxh3DcDABAAHVskSVtoEJ8BxCCAs3ZDVA==", 2021-12-17T18:18:55.285 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.285 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:18:55.285 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:18:55.285 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:18:55.286 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.286 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.286 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.286 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.0", 2021-12-17T18:18:55.287 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxh9QhCNxAALkWTJorDpbt9yrikL7/NWg==", 2021-12-17T18:18:55.287 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.287 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:18:55.287 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow r", 2021-12-17T18:18:55.287 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow rw", 2021-12-17T18:18:55.288 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rwx" 2021-12-17T18:18:55.288 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.288 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.288 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.289 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.1", 2021-12-17T18:18:55.289 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxhxm52OxAAbqXVaqRDmt4Ezj9xyCEODQ==", 2021-12-17T18:18:55.289 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.289 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:18:55.289 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow r", 2021-12-17T18:18:55.290 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow rw", 2021-12-17T18:18:55.290 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rwx" 2021-12-17T18:18:55.290 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.290 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.291 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.291 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.2", 2021-12-17T18:18:55.291 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+1LxhXu08BBAATRcUAZvMNg9ou4PLszDtmA==", 2021-12-17T18:18:55.291 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.291 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:18:55.292 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow r", 2021-12-17T18:18:55.292 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow rw", 2021-12-17T18:18:55.292 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rwx" 2021-12-17T18:18:55.292 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.292 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.293 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.293 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.admin", 2021-12-17T18:18:55.293 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhyAGlDRAA2ggSG5yBBFbMgK2fCBk2mQ==", 2021-12-17T18:18:55.293 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.294 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:18:55.294 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:18:55.294 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:18:55.294 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:18:55.294 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.295 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.295 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.295 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-mds", 2021-12-17T18:18:55.295 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBa1LxhTdqLLRAAiHqLOpAOwCgf7uFTiL0DDA==", 2021-12-17T18:18:55.296 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.296 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-mds" 2021-12-17T18:18:55.296 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.296 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.296 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.297 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-mgr", 2021-12-17T18:18:55.297 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBa1LxhCPSLLRAAJL+ZrihFkGHr4JdVv506nQ==", 2021-12-17T18:18:55.297 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.297 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-mgr" 2021-12-17T18:18:55.298 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.298 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.298 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.298 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-osd", 2021-12-17T18:18:55.298 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBa1Lxh/AqMLRAAW+JK0/hcOYsCZwrwSXe/sw==", 2021-12-17T18:18:55.299 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.299 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-osd" 2021-12-17T18:18:55.299 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.299 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.300 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.300 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-rbd", 2021-12-17T18:18:55.300 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBa1LxhuyGMLRAA4ea6q1qgXqj9KCNaJl7nkw==", 2021-12-17T18:18:55.300 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.300 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-rbd" 2021-12-17T18:18:55.301 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.301 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.301 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.301 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-rbd-mirror", 2021-12-17T18:18:55.301 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBa1Lxh+jqMLRAAqfiJ3gFyygmWYDp8FTPuKA==", 2021-12-17T18:18:55.302 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.302 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2021-12-17T18:18:55.302 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.302 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.303 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.303 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-rgw", 2021-12-17T18:18:55.303 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBa1Lxhc1WMLRAAS9y28X+luPHajyFZW6JtFA==", 2021-12-17T18:18:55.303 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.303 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-rgw" 2021-12-17T18:18:55.304 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.304 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.304 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.304 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.x", 2021-12-17T18:18:55.305 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhzvntKRAAFQlg69Z6d2nWX0GxSshsMw==", 2021-12-17T18:18:55.305 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.305 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:18:55.305 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:18:55.305 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:18:55.306 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.306 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:55.306 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:55.306 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.y", 2021-12-17T18:18:55.306 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhKdTGJRAArzUN3A1U5Efw0NG9Gw2Gcw==", 2021-12-17T18:18:55.307 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:18:55.307 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:18:55.307 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:18:55.307 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:18:55.308 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.308 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:55.308 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:18:55.308 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:18:55.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.258+0000 7f492e252700 1 -- 172.21.15.62:0/1387934548 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4904053580 msgr2=0x7f4904055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.258+0000 7f492e252700 1 --2- 172.21.15.62:0/1387934548 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4904053580 0x7f4904055a40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f492400d000 tx=0x7f4924000bc0).stop 2021-12-17T18:18:55.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.258+0000 7f492e252700 1 -- 172.21.15.62:0/1387934548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49281482f0 msgr2=0x7f49281449a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.258+0000 7f492e252700 1 --2- 172.21.15.62:0/1387934548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49281482f0 0x7f49281449a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f49280b6460 tx=0x7f4920007f40).stop 2021-12-17T18:18:55.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.258+0000 7f492e252700 1 -- 172.21.15.62:0/1387934548 shutdown_connections 2021-12-17T18:18:55.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.258+0000 7f492e252700 1 --2- 172.21.15.62:0/1387934548 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4904053580 0x7f4904055a40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.258+0000 7f492e252700 1 --2- 172.21.15.62:0/1387934548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49281482f0 0x7f49281449a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.258+0000 7f492e252700 1 --2- 172.21.15.62:0/1387934548 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49280b3a40 0x7f4928066eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.258+0000 7f492e252700 1 --2- 172.21.15.62:0/1387934548 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4928067870 0x7f4928117f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.258+0000 7f492e252700 1 -- 172.21.15.62:0/1387934548 >> 172.21.15.62:0/1387934548 conn(0x7f49280b7020 msgr2=0x7f4928148960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:55.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.258+0000 7f492e252700 1 -- 172.21.15.62:0/1387934548 shutdown_connections 2021-12-17T18:18:55.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.258+0000 7f492e252700 1 -- 172.21.15.62:0/1387934548 wait complete. 2021-12-17T18:18:55.313 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2021-12-17T18:18:55.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.414+0000 7f1c3770e700 1 Processor -- start 2021-12-17T18:18:55.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.414+0000 7f1c3770e700 1 -- start start 2021-12-17T18:18:55.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.414+0000 7f1c3770e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1c300b2c90 0x7f1c300acf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.414+0000 7f1c3770e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1c300a9500 0x7f1c300ad670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.414+0000 7f1c3770e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c300ad480 con 0x7f1c300affc0 2021-12-17T18:18:55.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.414+0000 7f1c3770e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c300a8fc0 con 0x7f1c300b2c90 2021-12-17T18:18:55.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.414+0000 7f1c3770e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c300b3070 con 0x7f1c300a9500 2021-12-17T18:18:55.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c354aa700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1c300b2c90 0x7f1c300acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c354aa700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1c300b2c90 0x7f1c300acf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49074/0 (socket says 172.21.15.62:49074) 2021-12-17T18:18:55.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c354aa700 1 -- 172.21.15.62:0/3453190942 learned_addr learned my addr 172.21.15.62:0/3453190942 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:55.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c34ca9700 1 --2- 172.21.15.62:0/3453190942 >> v2:172.21.15.109:3300/0 conn(0x7f1c300a9500 0x7f1c300ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c354aa700 1 -- 172.21.15.62:0/3453190942 >> v2:172.21.15.109:3300/0 conn(0x7f1c300a9500 msgr2=0x7f1c300ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:55.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c354aa700 1 --2- 172.21.15.62:0/3453190942 >> v2:172.21.15.109:3300/0 conn(0x7f1c300a9500 0x7f1c300ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c354aa700 1 -- 172.21.15.62:0/3453190942 >> v1:172.21.15.109:6789/0 conn(0x7f1c300affc0 legacy=0x7f1c300b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c354aa700 1 -- 172.21.15.62:0/3453190942 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c300adb60 con 0x7f1c300b2c90 2021-12-17T18:18:55.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c354aa700 1 --2- 172.21.15.62:0/3453190942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300b2c90 0x7f1c300acf90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f1c2c002f70 tx=0x7f1c2c006eb0).ready entity=mon.0 client_cookie=ba4adbd0a82249b2 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:55.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c1ffff700 1 -- 172.21.15.62:0/3453190942 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c2c00d5c0 con 0x7f1c300b2c90 2021-12-17T18:18:55.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c1ffff700 1 -- 172.21.15.62:0/3453190942 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2c000e90 con 0x7f1c300b2c90 2021-12-17T18:18:55.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c1ffff700 1 -- 172.21.15.62:0/3453190942 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c2c00d950 con 0x7f1c300b2c90 2021-12-17T18:18:55.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c3770e700 1 -- 172.21.15.62:0/3453190942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300b2c90 msgr2=0x7f1c300acf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c3770e700 1 --2- 172.21.15.62:0/3453190942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300b2c90 0x7f1c300acf90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f1c2c002f70 tx=0x7f1c2c006eb0).stop 2021-12-17T18:18:55.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c3770e700 1 -- 172.21.15.62:0/3453190942 shutdown_connections 2021-12-17T18:18:55.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c3770e700 1 --2- 172.21.15.62:0/3453190942 >> v2:172.21.15.109:3300/0 conn(0x7f1c300a9500 0x7f1c300ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c3770e700 1 --2- 172.21.15.62:0/3453190942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300b2c90 0x7f1c300acf90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c3770e700 1 -- 172.21.15.62:0/3453190942 >> 172.21.15.62:0/3453190942 conn(0x7f1c3005f730 msgr2=0x7f1c3005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:55.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c3770e700 1 -- 172.21.15.62:0/3453190942 shutdown_connections 2021-12-17T18:18:55.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.418+0000 7f1c3770e700 1 -- 172.21.15.62:0/3453190942 wait complete. 2021-12-17T18:18:55.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c3770e700 1 Processor -- start 2021-12-17T18:18:55.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c3770e700 1 -- start start 2021-12-17T18:18:55.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c3770e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c300a9500 0x7f1c30066ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c3770e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300affc0 0x7f1c30140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c3770e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c300b2c90 0x7f1c30140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c3770e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c30066560 con 0x7f1c300affc0 2021-12-17T18:18:55.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c3770e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c30065240 con 0x7f1c300a9500 2021-12-17T18:18:55.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c3770e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c30066790 con 0x7f1c300b2c90 2021-12-17T18:18:55.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c34ca9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300affc0 0x7f1c30140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c34ca9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300affc0 0x7f1c30140960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49078/0 (socket says 172.21.15.62:49078) 2021-12-17T18:18:55.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c34ca9700 1 -- 172.21.15.62:0/3859561488 learned_addr learned my addr 172.21.15.62:0/3859561488 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:55.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c354aa700 1 --2- 172.21.15.62:0/3859561488 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c300a9500 0x7f1c30066ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c35cab700 1 --2- 172.21.15.62:0/3859561488 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c300b2c90 0x7f1c30140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c34ca9700 1 -- 172.21.15.62:0/3859561488 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c300b2c90 msgr2=0x7f1c30140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c34ca9700 1 --2- 172.21.15.62:0/3859561488 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c300b2c90 0x7f1c30140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c34ca9700 1 -- 172.21.15.62:0/3859561488 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c300a9500 msgr2=0x7f1c30066ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c34ca9700 1 --2- 172.21.15.62:0/3859561488 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c300a9500 0x7f1c30066ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c34ca9700 1 -- 172.21.15.62:0/3859561488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c00b1e0 con 0x7f1c300affc0 2021-12-17T18:18:55.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c34ca9700 1 --2- 172.21.15.62:0/3859561488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300affc0 0x7f1c30140960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f1c2000c000 tx=0x7f1c20006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:55.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c1e7fc700 1 -- 172.21.15.62:0/3859561488 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c20010780 con 0x7f1c300affc0 2021-12-17T18:18:55.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c1e7fc700 1 -- 172.21.15.62:0/3859561488 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c200108e0 con 0x7f1c300affc0 2021-12-17T18:18:55.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c3770e700 1 -- 172.21.15.62:0/3859561488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c30067730 con 0x7f1c300affc0 2021-12-17T18:18:55.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c1e7fc700 1 -- 172.21.15.62:0/3859561488 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c20010c40 con 0x7f1c300affc0 2021-12-17T18:18:55.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.422+0000 7f1c3770e700 1 -- 172.21.15.62:0/3859561488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c30141340 con 0x7f1c300affc0 2021-12-17T18:18:55.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.426+0000 7f1c3770e700 1 -- 172.21.15.62:0/3859561488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c30147b60 con 0x7f1c300affc0 2021-12-17T18:18:55.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.426+0000 7f1c1e7fc700 1 -- 172.21.15.62:0/3859561488 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1c2001c460 con 0x7f1c300affc0 2021-12-17T18:18:55.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.426+0000 7f1c1e7fc700 1 --2- 172.21.15.62:0/3859561488 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c100536a0 0x7f1c10055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.426+0000 7f1c1e7fc700 1 -- 172.21.15.62:0/3859561488 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1c2006bb00 con 0x7f1c300affc0 2021-12-17T18:18:55.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.426+0000 7f1c354aa700 1 --2- 172.21.15.62:0/3859561488 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c100536a0 0x7f1c10055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.426+0000 7f1c354aa700 1 --2- 172.21.15.62:0/3859561488 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c100536a0 0x7f1c10055b60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f1c2c01c000 tx=0x7f1c2c015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:55.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.434+0000 7f1c1e7fc700 1 -- 172.21.15.62:0/3859561488 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1c20042e90 con 0x7f1c300affc0 2021-12-17T18:18:55.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.602+0000 7f1c3770e700 1 -- 172.21.15.62:0/3859561488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f1c300aca60 con 0x7f1c300affc0 2021-12-17T18:18:55.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.610+0000 7f1c1e7fc700 1 -- 172.21.15.62:0/3859561488 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v5) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1c200464b0 con 0x7f1c300affc0 2021-12-17T18:18:55.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.610+0000 7f1c3770e700 1 -- 172.21.15.62:0/3859561488 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c100536a0 msgr2=0x7f1c10055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.610+0000 7f1c3770e700 1 --2- 172.21.15.62:0/3859561488 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c100536a0 0x7f1c10055b60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f1c2c01c000 tx=0x7f1c2c015000).stop 2021-12-17T18:18:55.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.610+0000 7f1c3770e700 1 -- 172.21.15.62:0/3859561488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300affc0 msgr2=0x7f1c30140960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.610+0000 7f1c3770e700 1 --2- 172.21.15.62:0/3859561488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300affc0 0x7f1c30140960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f1c2000c000 tx=0x7f1c20006df0).stop 2021-12-17T18:18:55.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.614+0000 7f1c3770e700 1 -- 172.21.15.62:0/3859561488 shutdown_connections 2021-12-17T18:18:55.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.614+0000 7f1c3770e700 1 --2- 172.21.15.62:0/3859561488 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c100536a0 0x7f1c10055b60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.614+0000 7f1c3770e700 1 --2- 172.21.15.62:0/3859561488 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c300b2c90 0x7f1c30140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.614+0000 7f1c3770e700 1 --2- 172.21.15.62:0/3859561488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300affc0 0x7f1c30140960 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.614+0000 7f1c3770e700 1 --2- 172.21.15.62:0/3859561488 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c300a9500 0x7f1c30066ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.614+0000 7f1c3770e700 1 -- 172.21.15.62:0/3859561488 >> 172.21.15.62:0/3859561488 conn(0x7f1c3005f730 msgr2=0x7f1c301417c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:55.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.614+0000 7f1c3770e700 1 -- 172.21.15.62:0/3859561488 shutdown_connections 2021-12-17T18:18:55.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.614+0000 7f1c3770e700 1 -- 172.21.15.62:0/3859561488 wait complete. 2021-12-17T18:18:55.624 INFO:teuthology.orchestra.run.smithi062.stderr:updated 2021-12-17T18:18:55.634 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2021-12-17T18:18:55.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.726+0000 7f644a053700 1 Processor -- start 2021-12-17T18:18:55.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.726+0000 7f644a053700 1 -- start start 2021-12-17T18:18:55.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.726+0000 7f644a053700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f64440b1730 0x7f64440ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.726+0000 7f644a053700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64440b2ce0 con 0x7f64440a7bb0 2021-12-17T18:18:55.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.726+0000 7f644a053700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64440aca60 con 0x7f64440b21f0 2021-12-17T18:18:55.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f644a053700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644414b5b0 con 0x7f64440b1730 2021-12-17T18:18:55.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6443fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f64440a7bb0 0x7f6444067120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60898/0 (socket says 172.21.15.62:60898) 2021-12-17T18:18:55.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6443fff700 1 -- 172.21.15.62:0/1205901323 learned_addr learned my addr 172.21.15.62:0/1205901323 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:55.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f643bfff700 1 --2- 172.21.15.62:0/1205901323 >> v2:172.21.15.109:3300/0 conn(0x7f64440b1730 0x7f64440ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 -- 172.21.15.62:0/1205901323 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337481982 0 0) 0x7f64440b2ce0 con 0x7f64440a7bb0 2021-12-17T18:18:55.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 -- 172.21.15.62:0/1205901323 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6424003260 con 0x7f64440a7bb0 2021-12-17T18:18:55.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 -- 172.21.15.62:0/1205901323 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136341467 0 0) 0x7f64440aca60 con 0x7f64440b21f0 2021-12-17T18:18:55.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 -- 172.21.15.62:0/1205901323 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64440b2ce0 con 0x7f64440b21f0 2021-12-17T18:18:55.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 -- 172.21.15.62:0/1205901323 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2603772920 0 0) 0x7f6424003260 con 0x7f64440a7bb0 2021-12-17T18:18:55.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 -- 172.21.15.62:0/1205901323 >> v2:172.21.15.109:3300/0 conn(0x7f64440b1730 msgr2=0x7f64440ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:55.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 --2- 172.21.15.62:0/1205901323 >> v2:172.21.15.109:3300/0 conn(0x7f64440b1730 0x7f64440ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 -- 172.21.15.62:0/1205901323 >> v1:172.21.15.109:6789/0 conn(0x7f64440b21f0 legacy=0x7f644414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 -- 172.21.15.62:0/1205901323 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64440b2f10 con 0x7f64440a7bb0 2021-12-17T18:18:55.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 -- 172.21.15.62:0/1205901323 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f643c0019e0 con 0x7f64440a7bb0 2021-12-17T18:18:55.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f643bfff700 1 --2- 172.21.15.62:0/1205901323 >> v2:172.21.15.109:3300/0 conn(0x7f64440b1730 0x7f64440ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:55.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 -- 172.21.15.62:0/1205901323 >> v1:172.21.15.62:6789/0 conn(0x7f64440a7bb0 legacy=0x7f6444067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 --2- 172.21.15.62:0/1205901323 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f64240038e0 0x7f6424003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 --2- 172.21.15.62:0/1205901323 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6424004500 0x7f6424004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 --2- 172.21.15.62:0/1205901323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6424004e70 0x7f642400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 -- 172.21.15.62:0/1205901323 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644414b5b0 con 0x7f6424004e70 2021-12-17T18:18:55.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 -- 172.21.15.62:0/1205901323 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642400bcf0 con 0x7f64240038e0 2021-12-17T18:18:55.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 -- 172.21.15.62:0/1205901323 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642400beb0 con 0x7f6424004500 2021-12-17T18:18:55.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f64437fe700 1 --2- 172.21.15.62:0/1205901323 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f64240038e0 0x7f6424003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6443fff700 1 --2- 172.21.15.62:0/1205901323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6424004e70 0x7f642400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f643bfff700 1 --2- 172.21.15.62:0/1205901323 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6424004500 0x7f6424004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f64437fe700 1 -- 172.21.15.62:0/1205901323 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6424004500 msgr2=0x7f6424004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f64437fe700 1 --2- 172.21.15.62:0/1205901323 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6424004500 0x7f6424004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f64437fe700 1 -- 172.21.15.62:0/1205901323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6424004e70 msgr2=0x7f642400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f64437fe700 1 --2- 172.21.15.62:0/1205901323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6424004e70 0x7f642400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f64437fe700 1 -- 172.21.15.62:0/1205901323 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6424003260 con 0x7f64240038e0 2021-12-17T18:18:55.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6443fff700 1 --2- 172.21.15.62:0/1205901323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6424004e70 0x7f642400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:55.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6443fff700 1 -- 172.21.15.62:0/1205901323 reap_dead start 2021-12-17T18:18:55.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f64437fe700 1 --2- 172.21.15.62:0/1205901323 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f64240038e0 0x7f6424003ce0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f64240054d0 tx=0x7f6434007a00).ready entity=mon.1 client_cookie=6e33af344d9abf5 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:55.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 -- 172.21.15.62:0/1205901323 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6434007d10 con 0x7f64240038e0 2021-12-17T18:18:55.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 -- 172.21.15.62:0/1205901323 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6434007030 con 0x7f64240038e0 2021-12-17T18:18:55.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f6442ffd700 1 -- 172.21.15.62:0/1205901323 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6434007390 con 0x7f64240038e0 2021-12-17T18:18:55.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.730+0000 7f644a053700 1 -- 172.21.15.62:0/1205901323 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f64240038e0 msgr2=0x7f6424003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f644a053700 1 --2- 172.21.15.62:0/1205901323 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f64240038e0 0x7f6424003ce0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f64240054d0 tx=0x7f6434007a00).stop 2021-12-17T18:18:55.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f644a053700 1 -- 172.21.15.62:0/1205901323 shutdown_connections 2021-12-17T18:18:55.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f644a053700 1 --2- 172.21.15.62:0/1205901323 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f64240038e0 0x7f6424003ce0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f644a053700 1 -- 172.21.15.62:0/1205901323 >> 172.21.15.62:0/1205901323 conn(0x7f644405f730 msgr2=0x7f644405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:55.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f644a053700 1 -- 172.21.15.62:0/1205901323 shutdown_connections 2021-12-17T18:18:55.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f644a053700 1 -- 172.21.15.62:0/1205901323 wait complete. 2021-12-17T18:18:55.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f644a053700 1 Processor -- start 2021-12-17T18:18:55.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f644a053700 1 -- start start 2021-12-17T18:18:55.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f644a053700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f64240038e0 0x7f64440aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f644a053700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f644414d6b0 0x7f6444063e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f644a053700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6444156ee0 0x7f6444157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f644a053700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6444063720 con 0x7f6444156ee0 2021-12-17T18:18:55.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f644a053700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64440639c0 con 0x7f64240038e0 2021-12-17T18:18:55.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f644a053700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6444064350 con 0x7f644414d6b0 2021-12-17T18:18:55.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f6443fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6444156ee0 0x7f6444157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f6443fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6444156ee0 0x7f6444157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49100/0 (socket says 172.21.15.62:49100) 2021-12-17T18:18:55.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f6443fff700 1 -- 172.21.15.62:0/4268442949 learned_addr learned my addr 172.21.15.62:0/4268442949 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:55.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f643bfff700 1 --2- 172.21.15.62:0/4268442949 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f644414d6b0 0x7f6444063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f64437fe700 1 --2- 172.21.15.62:0/4268442949 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f64240038e0 0x7f64440aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f6443fff700 1 -- 172.21.15.62:0/4268442949 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f644414d6b0 msgr2=0x7f6444063e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f6443fff700 1 --2- 172.21.15.62:0/4268442949 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f644414d6b0 0x7f6444063e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f6443fff700 1 -- 172.21.15.62:0/4268442949 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f64240038e0 msgr2=0x7f64440aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f6443fff700 1 --2- 172.21.15.62:0/4268442949 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f64240038e0 0x7f64440aa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f6443fff700 1 -- 172.21.15.62:0/4268442949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644414dbd0 con 0x7f6444156ee0 2021-12-17T18:18:55.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f643bfff700 1 --2- 172.21.15.62:0/4268442949 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f644414d6b0 0x7f6444063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:55.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f64437fe700 1 --2- 172.21.15.62:0/4268442949 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f64240038e0 0x7f64440aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:55.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.734+0000 7f6443fff700 1 --2- 172.21.15.62:0/4268442949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6444156ee0 0x7f6444157390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f6444061080 tx=0x7f64440b30a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:55.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.738+0000 7f64417fa700 1 -- 172.21.15.62:0/4268442949 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f643c00f8a0 con 0x7f6444156ee0 2021-12-17T18:18:55.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.738+0000 7f64417fa700 1 -- 172.21.15.62:0/4268442949 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c00fa00 con 0x7f6444156ee0 2021-12-17T18:18:55.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.738+0000 7f644a053700 1 -- 172.21.15.62:0/4268442949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644414ddc0 con 0x7f6444156ee0 2021-12-17T18:18:55.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.738+0000 7f64417fa700 1 -- 172.21.15.62:0/4268442949 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f643c00fd60 con 0x7f6444156ee0 2021-12-17T18:18:55.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.738+0000 7f644a053700 1 -- 172.21.15.62:0/4268442949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6444146860 con 0x7f6444156ee0 2021-12-17T18:18:55.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.738+0000 7f644a053700 1 -- 172.21.15.62:0/4268442949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64440573d0 con 0x7f6444156ee0 2021-12-17T18:18:55.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.738+0000 7f64417fa700 1 -- 172.21.15.62:0/4268442949 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f643c01b030 con 0x7f6444156ee0 2021-12-17T18:18:55.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.738+0000 7f64417fa700 1 --2- 172.21.15.62:0/4268442949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f64280536a0 0x7f6428055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:55.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.738+0000 7f64417fa700 1 -- 172.21.15.62:0/4268442949 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f643c06b0b0 con 0x7f6444156ee0 2021-12-17T18:18:55.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.738+0000 7f64437fe700 1 --2- 172.21.15.62:0/4268442949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f64280536a0 0x7f6428055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:55.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.742+0000 7f64437fe700 1 --2- 172.21.15.62:0/4268442949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f64280536a0 0x7f6428055b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f6434018000 tx=0x7f6434015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:55.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.746+0000 7f64417fa700 1 -- 172.21.15.62:0/4268442949 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f643c042550 con 0x7f6444156ee0 2021-12-17T18:18:55.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.910+0000 7f644a053700 1 -- 172.21.15.62:0/4268442949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f644414ddc0 con 0x7f6444156ee0 2021-12-17T18:18:55.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.914+0000 7f64417fa700 1 -- 172.21.15.62:0/4268442949 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7f644414ddc0 con 0x7f6444156ee0 2021-12-17T18:18:55.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.914+0000 7f644a053700 1 -- 172.21.15.62:0/4268442949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f64280536a0 msgr2=0x7f6428055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.914+0000 7f644a053700 1 --2- 172.21.15.62:0/4268442949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f64280536a0 0x7f6428055b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f6434018000 tx=0x7f6434015000).stop 2021-12-17T18:18:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.914+0000 7f644a053700 1 -- 172.21.15.62:0/4268442949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6444156ee0 msgr2=0x7f6444157390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.914+0000 7f644a053700 1 --2- 172.21.15.62:0/4268442949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6444156ee0 0x7f6444157390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f6444061080 tx=0x7f64440b30a0).stop 2021-12-17T18:18:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.918+0000 7f644a053700 1 -- 172.21.15.62:0/4268442949 shutdown_connections 2021-12-17T18:18:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.918+0000 7f644a053700 1 --2- 172.21.15.62:0/4268442949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f64280536a0 0x7f6428055b60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.918+0000 7f644a053700 1 --2- 172.21.15.62:0/4268442949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6444156ee0 0x7f6444157390 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.918+0000 7f644a053700 1 --2- 172.21.15.62:0/4268442949 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f644414d6b0 0x7f6444063e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.918+0000 7f644a053700 1 --2- 172.21.15.62:0/4268442949 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f64240038e0 0x7f64440aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.918+0000 7f644a053700 1 -- 172.21.15.62:0/4268442949 >> 172.21.15.62:0/4268442949 conn(0x7f644405f730 msgr2=0x7f64440b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:55.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.918+0000 7f644a053700 1 -- 172.21.15.62:0/4268442949 shutdown_connections 2021-12-17T18:18:55.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:55.918+0000 7f644a053700 1 -- 172.21.15.62:0/4268442949 wait complete. 2021-12-17T18:18:55.927 INFO:teuthology.orchestra.run.smithi062.stderr:updated 2021-12-17T18:18:55.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2021-12-17T18:18:56.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.034+0000 7fa5ab485700 1 Processor -- start 2021-12-17T18:18:56.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.034+0000 7fa5ab485700 1 -- start start 2021-12-17T18:18:56.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5ab485700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa5a405fa70 0x7fa5a40a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5ab485700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa5a40afeb0 0x7fa5a41447b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5ab485700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5a40b6da0 0x7fa5a41405b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5ab485700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a40b66d0 con 0x7fa5a405fa70 2021-12-17T18:18:56.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5ab485700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a40b1310 con 0x7fa5a40afeb0 2021-12-17T18:18:56.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5ab485700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a405fe50 con 0x7fa5a40b6da0 2021-12-17T18:18:56.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5a9221700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa5a405fa70 0x7fa5a40a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5a9221700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa5a405fa70 0x7fa5a40a9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49104/0 (socket says 172.21.15.62:49104) 2021-12-17T18:18:56.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5a9221700 1 -- 172.21.15.62:0/4091122664 learned_addr learned my addr 172.21.15.62:0/4091122664 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:56.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5a8a20700 1 --2- 172.21.15.62:0/4091122664 >> v2:172.21.15.109:3300/0 conn(0x7fa5a40afeb0 0x7fa5a41447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5a9a22700 1 --2- 172.21.15.62:0/4091122664 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5a40b6da0 0x7fa5a41405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5a9221700 1 -- 172.21.15.62:0/4091122664 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5a40b6da0 msgr2=0x7fa5a41405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:56.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5a9221700 1 --2- 172.21.15.62:0/4091122664 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5a40b6da0 0x7fa5a41405b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5a9221700 1 -- 172.21.15.62:0/4091122664 >> v2:172.21.15.109:3300/0 conn(0x7fa5a40afeb0 msgr2=0x7fa5a41447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:56.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5a9221700 1 --2- 172.21.15.62:0/4091122664 >> v2:172.21.15.109:3300/0 conn(0x7fa5a40afeb0 0x7fa5a41447b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5a9221700 1 -- 172.21.15.62:0/4091122664 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a40b0430 con 0x7fa5a405fa70 2021-12-17T18:18:56.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5a9221700 1 --2- 172.21.15.62:0/4091122664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5a405fa70 0x7fa5a40a9c90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fa5a0002f70 tx=0x7fa5a0006eb0).ready entity=mon.0 client_cookie=3c722f33e72a0255 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:56.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa593fff700 1 -- 172.21.15.62:0/4091122664 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5a000d570 con 0x7fa5a405fa70 2021-12-17T18:18:56.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa593fff700 1 -- 172.21.15.62:0/4091122664 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a0000e90 con 0x7fa5a405fa70 2021-12-17T18:18:56.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa593fff700 1 -- 172.21.15.62:0/4091122664 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5a000d900 con 0x7fa5a405fa70 2021-12-17T18:18:56.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5ab485700 1 -- 172.21.15.62:0/4091122664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5a405fa70 msgr2=0x7fa5a40a9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5ab485700 1 --2- 172.21.15.62:0/4091122664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5a405fa70 0x7fa5a40a9c90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fa5a0002f70 tx=0x7fa5a0006eb0).stop 2021-12-17T18:18:56.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5ab485700 1 -- 172.21.15.62:0/4091122664 shutdown_connections 2021-12-17T18:18:56.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5ab485700 1 --2- 172.21.15.62:0/4091122664 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5a40b6da0 0x7fa5a41405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5ab485700 1 --2- 172.21.15.62:0/4091122664 >> v2:172.21.15.109:3300/0 conn(0x7fa5a40afeb0 0x7fa5a41447b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5ab485700 1 --2- 172.21.15.62:0/4091122664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5a405fa70 0x7fa5a40a9c90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5ab485700 1 -- 172.21.15.62:0/4091122664 >> 172.21.15.62:0/4091122664 conn(0x7fa5a405bcd0 msgr2=0x7fa5a40638c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:56.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5ab485700 1 -- 172.21.15.62:0/4091122664 shutdown_connections 2021-12-17T18:18:56.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.038+0000 7fa5ab485700 1 -- 172.21.15.62:0/4091122664 wait complete. 2021-12-17T18:18:56.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5ab485700 1 Processor -- start 2021-12-17T18:18:56.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5ab485700 1 -- start start 2021-12-17T18:18:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5ab485700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5a405fa70 0x7fa5a4066300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5ab485700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa5a40afeb0 0x7fa5a40ac730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5ab485700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5a40b6da0 0x7fa5a4154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5ab485700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a409fc20 con 0x7fa5a40b6da0 2021-12-17T18:18:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5ab485700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a413f740 con 0x7fa5a40afeb0 2021-12-17T18:18:56.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5ab485700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4067260 con 0x7fa5a405fa70 2021-12-17T18:18:56.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5a9a22700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5a40b6da0 0x7fa5a4154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5a8a20700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa5a40afeb0 0x7fa5a40ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5a8a20700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa5a40afeb0 0x7fa5a40ac730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:55660/0 (socket says 172.21.15.62:55660) 2021-12-17T18:18:56.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5a9221700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5a405fa70 0x7fa5a4066300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5a8a20700 1 -- 172.21.15.62:0/1344926251 learned_addr learned my addr 172.21.15.62:0/1344926251 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:56.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5a9a22700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5a40b6da0 0x7fa5a4154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49114/0 (socket says 172.21.15.62:49114) 2021-12-17T18:18:56.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5a9a22700 1 -- 172.21.15.62:0/1344926251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5a405fa70 msgr2=0x7fa5a4066300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5a9a22700 1 --2- 172.21.15.62:0/1344926251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5a405fa70 0x7fa5a4066300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5a9a22700 1 -- 172.21.15.62:0/1344926251 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa5a40afeb0 msgr2=0x7fa5a40ac730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5a9a22700 1 --2- 172.21.15.62:0/1344926251 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa5a40afeb0 0x7fa5a40ac730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5a9a22700 1 -- 172.21.15.62:0/1344926251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a000b1e0 con 0x7fa5a40b6da0 2021-12-17T18:18:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5a8a20700 1 --2- 172.21.15.62:0/1344926251 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa5a40afeb0 0x7fa5a40ac730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:56.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5a9221700 1 --2- 172.21.15.62:0/1344926251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5a405fa70 0x7fa5a4066300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:56.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5a9a22700 1 --2- 172.21.15.62:0/1344926251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5a40b6da0 0x7fa5a4154110 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fa59c00c000 tx=0x7fa59c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:56.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5927fc700 1 -- 172.21.15.62:0/1344926251 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa59c012600 con 0x7fa5a40b6da0 2021-12-17T18:18:56.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5927fc700 1 -- 172.21.15.62:0/1344926251 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c012760 con 0x7fa5a40b6da0 2021-12-17T18:18:56.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5927fc700 1 -- 172.21.15.62:0/1344926251 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa59c012ac0 con 0x7fa5a40b6da0 2021-12-17T18:18:56.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5ab485700 1 -- 172.21.15.62:0/1344926251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a4067500 con 0x7fa5a40b6da0 2021-12-17T18:18:56.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.042+0000 7fa5ab485700 1 -- 172.21.15.62:0/1344926251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a40acc20 con 0x7fa5a40b6da0 2021-12-17T18:18:56.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.046+0000 7fa5ab485700 1 -- 172.21.15.62:0/1344926251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a40b6900 con 0x7fa5a40b6da0 2021-12-17T18:18:56.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.046+0000 7fa5927fc700 1 -- 172.21.15.62:0/1344926251 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa59c022070 con 0x7fa5a40b6da0 2021-12-17T18:18:56.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.046+0000 7fa5927fc700 1 --2- 172.21.15.62:0/1344926251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa584053610 0x7fa584055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.046+0000 7fa5927fc700 1 -- 172.21.15.62:0/1344926251 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa59c06bb70 con 0x7fa5a40b6da0 2021-12-17T18:18:56.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.046+0000 7fa5a9221700 1 --2- 172.21.15.62:0/1344926251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa584053610 0x7fa584055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.046+0000 7fa5a9221700 1 --2- 172.21.15.62:0/1344926251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa584053610 0x7fa584055ad0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fa5a001c000 tx=0x7fa5a0015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:56.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.054+0000 7fa5927fc700 1 -- 172.21.15.62:0/1344926251 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa59c042f00 con 0x7fa5a40b6da0 2021-12-17T18:18:56.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.218+0000 7fa5ab485700 1 -- 172.21.15.62:0/1344926251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fa5a40573d0 con 0x7fa5a40b6da0 2021-12-17T18:18:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.226+0000 7fa5927fc700 1 -- 172.21.15.62:0/1344926251 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa59c016020 con 0x7fa5a40b6da0 2021-12-17T18:18:56.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.230+0000 7fa5ab485700 1 -- 172.21.15.62:0/1344926251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa584053610 msgr2=0x7fa584055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.230+0000 7fa5ab485700 1 --2- 172.21.15.62:0/1344926251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa584053610 0x7fa584055ad0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fa5a001c000 tx=0x7fa5a0015000).stop 2021-12-17T18:18:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.230+0000 7fa5ab485700 1 -- 172.21.15.62:0/1344926251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5a40b6da0 msgr2=0x7fa5a4154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.230+0000 7fa5ab485700 1 --2- 172.21.15.62:0/1344926251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5a40b6da0 0x7fa5a4154110 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fa59c00c000 tx=0x7fa59c0091d0).stop 2021-12-17T18:18:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.230+0000 7fa5ab485700 1 -- 172.21.15.62:0/1344926251 shutdown_connections 2021-12-17T18:18:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.230+0000 7fa5ab485700 1 --2- 172.21.15.62:0/1344926251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa584053610 0x7fa584055ad0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.230+0000 7fa5ab485700 1 --2- 172.21.15.62:0/1344926251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5a40b6da0 0x7fa5a4154110 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.230+0000 7fa5ab485700 1 --2- 172.21.15.62:0/1344926251 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa5a40afeb0 0x7fa5a40ac730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.230+0000 7fa5ab485700 1 --2- 172.21.15.62:0/1344926251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5a405fa70 0x7fa5a4066300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.230+0000 7fa5ab485700 1 -- 172.21.15.62:0/1344926251 >> 172.21.15.62:0/1344926251 conn(0x7fa5a405bcd0 msgr2=0x7fa5a4141010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:56.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.230+0000 7fa5ab485700 1 -- 172.21.15.62:0/1344926251 shutdown_connections 2021-12-17T18:18:56.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.230+0000 7fa5ab485700 1 -- 172.21.15.62:0/1344926251 wait complete. 2021-12-17T18:18:56.240 INFO:teuthology.orchestra.run.smithi062.stderr:updated 2021-12-17T18:18:56.251 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2021-12-17T18:18:56.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.350+0000 7f8946104700 1 Processor -- start 2021-12-17T18:18:56.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.350+0000 7f8946104700 1 -- start start 2021-12-17T18:18:56.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f8946104700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f89400b0830 0x7f8940142da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f8946104700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f89400af220 0x7f89400b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f8946104700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89400b6540 con 0x7f89400b6160 2021-12-17T18:18:56.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f8946104700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89400ae840 con 0x7f89400af220 2021-12-17T18:18:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f8946104700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89400aeae0 con 0x7f89400b0830 2021-12-17T18:18:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f893ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f89400af220 0x7f89400b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f893ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f89400af220 0x7f89400b2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49122/0 (socket says 172.21.15.62:49122) 2021-12-17T18:18:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f893ffff700 1 -- 172.21.15.62:0/627199311 learned_addr learned my addr 172.21.15.62:0/627199311 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:56.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f893f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f89400b6160 0x7f8940142690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60932/0 (socket says 172.21.15.62:60932) 2021-12-17T18:18:56.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f8936ffd700 1 --2- 172.21.15.62:0/627199311 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f89400b0830 0x7f8940142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f893ffff700 1 -- 172.21.15.62:0/627199311 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f89400b0830 msgr2=0x7f8940142da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:56.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f893ffff700 1 --2- 172.21.15.62:0/627199311 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f89400b0830 0x7f8940142da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f893ffff700 1 -- 172.21.15.62:0/627199311 >> v1:172.21.15.62:6789/0 conn(0x7f89400b6160 legacy=0x7f8940142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f893ffff700 1 -- 172.21.15.62:0/627199311 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89400aed80 con 0x7f89400af220 2021-12-17T18:18:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f893effd700 1 -- 172.21.15.62:0/627199311 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171910272 0 0) 0x7f89400b6540 con 0x7f89400b6160 2021-12-17T18:18:56.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f893ffff700 1 --2- 172.21.15.62:0/627199311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89400af220 0x7f89400b2820 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f8940062ce0 tx=0x7f8938009290).ready entity=mon.0 client_cookie=c4cb166f4f32a36f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f893effd700 1 -- 172.21.15.62:0/627199311 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f893800b860 con 0x7f89400af220 2021-12-17T18:18:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f893effd700 1 -- 172.21.15.62:0/627199311 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893800b9c0 con 0x7f89400af220 2021-12-17T18:18:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f893effd700 1 -- 172.21.15.62:0/627199311 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f893800bb30 con 0x7f89400af220 2021-12-17T18:18:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f8946104700 1 -- 172.21.15.62:0/627199311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89400af220 msgr2=0x7f89400b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f8946104700 1 --2- 172.21.15.62:0/627199311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89400af220 0x7f89400b2820 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f8940062ce0 tx=0x7f8938009290).stop 2021-12-17T18:18:56.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f8946104700 1 -- 172.21.15.62:0/627199311 shutdown_connections 2021-12-17T18:18:56.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f8946104700 1 --2- 172.21.15.62:0/627199311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89400af220 0x7f89400b2820 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f8946104700 1 --2- 172.21.15.62:0/627199311 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f89400b0830 0x7f8940142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f8946104700 1 -- 172.21.15.62:0/627199311 >> 172.21.15.62:0/627199311 conn(0x7f894005c750 msgr2=0x7f89400630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:56.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f8946104700 1 -- 172.21.15.62:0/627199311 shutdown_connections 2021-12-17T18:18:56.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.354+0000 7f8946104700 1 -- 172.21.15.62:0/627199311 wait complete. 2021-12-17T18:18:56.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.358+0000 7f8946104700 1 Processor -- start 2021-12-17T18:18:56.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.358+0000 7f8946104700 1 -- start start 2021-12-17T18:18:56.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.358+0000 7f8946104700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f89400af220 0x7f8940064200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.358+0000 7f8946104700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89400b0830 0x7f8940155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.358+0000 7f8946104700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f89400b6160 0x7f8940156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.358+0000 7f8946104700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8940147490 con 0x7f89400b0830 2021-12-17T18:18:56.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.358+0000 7f8946104700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8940140530 con 0x7f89400af220 2021-12-17T18:18:56.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.358+0000 7f8946104700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8940140300 con 0x7f89400b6160 2021-12-17T18:18:56.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.358+0000 7f8936ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89400b0830 0x7f8940155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.358+0000 7f893f7fe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f89400af220 0x7f8940064200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.358+0000 7f8936ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89400b0830 0x7f8940155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49126/0 (socket says 172.21.15.62:49126) 2021-12-17T18:18:56.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.358+0000 7f8936ffd700 1 -- 172.21.15.62:0/2496989808 learned_addr learned my addr 172.21.15.62:0/2496989808 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:56.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.358+0000 7f893ffff700 1 --2- 172.21.15.62:0/2496989808 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f89400b6160 0x7f8940156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.362+0000 7f8936ffd700 1 -- 172.21.15.62:0/2496989808 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f89400b6160 msgr2=0x7f8940156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.362+0000 7f8936ffd700 1 --2- 172.21.15.62:0/2496989808 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f89400b6160 0x7f8940156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.362+0000 7f8936ffd700 1 -- 172.21.15.62:0/2496989808 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f89400af220 msgr2=0x7f8940064200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.362+0000 7f8936ffd700 1 --2- 172.21.15.62:0/2496989808 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f89400af220 0x7f8940064200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.362+0000 7f8936ffd700 1 -- 172.21.15.62:0/2496989808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8938009530 con 0x7f89400b0830 2021-12-17T18:18:56.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.362+0000 7f8936ffd700 1 --2- 172.21.15.62:0/2496989808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89400b0830 0x7f8940155d50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f89401475d0 tx=0x7f8928006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:56.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.362+0000 7f893d7fa700 1 -- 172.21.15.62:0/2496989808 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8928010780 con 0x7f89400b0830 2021-12-17T18:18:56.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.362+0000 7f893d7fa700 1 -- 172.21.15.62:0/2496989808 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89280108e0 con 0x7f89400b0830 2021-12-17T18:18:56.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.362+0000 7f8946104700 1 -- 172.21.15.62:0/2496989808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8940146d50 con 0x7f89400b0830 2021-12-17T18:18:56.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.362+0000 7f893d7fa700 1 -- 172.21.15.62:0/2496989808 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8928010c40 con 0x7f89400b0830 2021-12-17T18:18:56.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.362+0000 7f8946104700 1 -- 172.21.15.62:0/2496989808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8940140760 con 0x7f89400b0830 2021-12-17T18:18:56.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.362+0000 7f8946104700 1 -- 172.21.15.62:0/2496989808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89400b0560 con 0x7f89400b0830 2021-12-17T18:18:56.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.362+0000 7f893d7fa700 1 -- 172.21.15.62:0/2496989808 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f892801c460 con 0x7f89400b0830 2021-12-17T18:18:56.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.362+0000 7f893d7fa700 1 --2- 172.21.15.62:0/2496989808 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8924053610 0x7f8924055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.362+0000 7f893d7fa700 1 -- 172.21.15.62:0/2496989808 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f892806bad0 con 0x7f89400b0830 2021-12-17T18:18:56.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.362+0000 7f893f7fe700 1 --2- 172.21.15.62:0/2496989808 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8924053610 0x7f8924055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.366+0000 7f893f7fe700 1 --2- 172.21.15.62:0/2496989808 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8924053610 0x7f8924055ad0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f893000d000 tx=0x7f8930007bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:56.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.370+0000 7f893d7fa700 1 -- 172.21.15.62:0/2496989808 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8928042df0 con 0x7f89400b0830 2021-12-17T18:18:56.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.534+0000 7f8946104700 1 -- 172.21.15.62:0/2496989808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f894005bed0 con 0x7f89400b0830 2021-12-17T18:18:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.542+0000 7f893d7fa700 1 -- 172.21.15.62:0/2496989808 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8928046410 con 0x7f89400b0830 2021-12-17T18:18:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.542+0000 7f8946104700 1 -- 172.21.15.62:0/2496989808 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8924053610 msgr2=0x7f8924055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.542+0000 7f8946104700 1 --2- 172.21.15.62:0/2496989808 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8924053610 0x7f8924055ad0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f893000d000 tx=0x7f8930007bc0).stop 2021-12-17T18:18:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.542+0000 7f8946104700 1 -- 172.21.15.62:0/2496989808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89400b0830 msgr2=0x7f8940155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.542+0000 7f8946104700 1 --2- 172.21.15.62:0/2496989808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89400b0830 0x7f8940155d50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f89401475d0 tx=0x7f8928006df0).stop 2021-12-17T18:18:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.542+0000 7f8946104700 1 -- 172.21.15.62:0/2496989808 shutdown_connections 2021-12-17T18:18:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.542+0000 7f8946104700 1 --2- 172.21.15.62:0/2496989808 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8924053610 0x7f8924055ad0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.542+0000 7f8946104700 1 --2- 172.21.15.62:0/2496989808 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f89400b6160 0x7f8940156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.542+0000 7f8946104700 1 --2- 172.21.15.62:0/2496989808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89400b0830 0x7f8940155d50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.542+0000 7f8946104700 1 --2- 172.21.15.62:0/2496989808 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f89400af220 0x7f8940064200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.542+0000 7f8946104700 1 -- 172.21.15.62:0/2496989808 >> 172.21.15.62:0/2496989808 conn(0x7f894005c750 msgr2=0x7f89400b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:56.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.542+0000 7f8946104700 1 -- 172.21.15.62:0/2496989808 shutdown_connections 2021-12-17T18:18:56.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.542+0000 7f8946104700 1 -- 172.21.15.62:0/2496989808 wait complete. 2021-12-17T18:18:56.558 INFO:teuthology.orchestra.run.smithi062.stderr:updated 2021-12-17T18:18:56.563 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2021-12-17T18:18:56.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.666+0000 7f7629940700 1 Processor -- start 2021-12-17T18:18:56.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.666+0000 7f7629940700 1 -- start start 2021-12-17T18:18:56.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.666+0000 7f7629940700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f76240b20f0 0x7f7624144580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.666+0000 7f7629940700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76240ad7a0 con 0x7f76240b1d10 2021-12-17T18:18:56.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.666+0000 7f7629940700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7624148430 con 0x7f76240afba0 2021-12-17T18:18:56.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.666+0000 7f7629940700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76240ac420 con 0x7f76240b20f0 2021-12-17T18:18:56.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.666+0000 7f762913f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f76240b20f0 0x7f7624144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.666+0000 7f762893e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f76240b1d10 0x7f7624147b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60944/0 (socket says 172.21.15.62:60944) 2021-12-17T18:18:56.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.666+0000 7f762913f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f76240b20f0 0x7f7624144580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49136/0 (socket says 172.21.15.62:49136) 2021-12-17T18:18:56.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.666+0000 7f762893e700 1 -- 172.21.15.62:0/3544756033 learned_addr learned my addr 172.21.15.62:0/3544756033 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:56.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.666+0000 7f762913f700 1 -- 172.21.15.62:0/3544756033 >> v1:172.21.15.109:6789/0 conn(0x7f76240afba0 legacy=0x7f762414a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.666+0000 7f762913f700 1 -- 172.21.15.62:0/3544756033 >> v1:172.21.15.62:6789/0 conn(0x7f76240b1d10 legacy=0x7f7624147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.666+0000 7f762913f700 1 -- 172.21.15.62:0/3544756033 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76241473c0 con 0x7f76240b20f0 2021-12-17T18:18:56.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.666+0000 7f76237fe700 1 -- 172.21.15.62:0/3544756033 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789948444 0 0) 0x7f76240ad7a0 con 0x7f76240b1d10 2021-12-17T18:18:56.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.670+0000 7f762913f700 1 --2- 172.21.15.62:0/3544756033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76240b20f0 0x7f7624144580 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f761c002f70 tx=0x7f761c006df0).ready entity=mon.0 client_cookie=815ac681d7d3f629 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.670+0000 7f76237fe700 1 -- 172.21.15.62:0/3544756033 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f761c00d610 con 0x7f76240b20f0 2021-12-17T18:18:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.670+0000 7f76237fe700 1 -- 172.21.15.62:0/3544756033 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761c000e90 con 0x7f76240b20f0 2021-12-17T18:18:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.670+0000 7f76237fe700 1 -- 172.21.15.62:0/3544756033 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f761c00d960 con 0x7f76240b20f0 2021-12-17T18:18:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.670+0000 7f7629940700 1 -- 172.21.15.62:0/3544756033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76240b20f0 msgr2=0x7f7624144580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.670+0000 7f7629940700 1 --2- 172.21.15.62:0/3544756033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76240b20f0 0x7f7624144580 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f761c002f70 tx=0x7f761c006df0).stop 2021-12-17T18:18:56.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.670+0000 7f7629940700 1 -- 172.21.15.62:0/3544756033 shutdown_connections 2021-12-17T18:18:56.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.670+0000 7f7629940700 1 --2- 172.21.15.62:0/3544756033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76240b20f0 0x7f7624144580 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.670+0000 7f7629940700 1 -- 172.21.15.62:0/3544756033 >> 172.21.15.62:0/3544756033 conn(0x7f76240623c0 msgr2=0x7f76240627d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:56.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.670+0000 7f7629940700 1 -- 172.21.15.62:0/3544756033 shutdown_connections 2021-12-17T18:18:56.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.670+0000 7f7629940700 1 -- 172.21.15.62:0/3544756033 wait complete. 2021-12-17T18:18:56.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f7629940700 1 Processor -- start 2021-12-17T18:18:56.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f7629940700 1 -- start start 2021-12-17T18:18:56.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f7629940700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f76240afba0 0x7f7624063ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f7629940700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f76240b1d10 0x7f7624066970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f7629940700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76240b20f0 0x7f7624066e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f7629940700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7624067350 con 0x7f76240b20f0 2021-12-17T18:18:56.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f7629940700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7624146290 con 0x7f76240afba0 2021-12-17T18:18:56.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f7629940700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76241570a0 con 0x7f76240b1d10 2021-12-17T18:18:56.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f762913f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76240b20f0 0x7f7624066e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f762913f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76240b20f0 0x7f7624066e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49142/0 (socket says 172.21.15.62:49142) 2021-12-17T18:18:56.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f762913f700 1 -- 172.21.15.62:0/324134466 learned_addr learned my addr 172.21.15.62:0/324134466 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f762893e700 1 --2- 172.21.15.62:0/324134466 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f76240afba0 0x7f7624063ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f7623fff700 1 --2- 172.21.15.62:0/324134466 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f76240b1d10 0x7f7624066970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f762913f700 1 -- 172.21.15.62:0/324134466 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f76240b1d10 msgr2=0x7f7624066970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f762913f700 1 --2- 172.21.15.62:0/324134466 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f76240b1d10 0x7f7624066970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f762913f700 1 -- 172.21.15.62:0/324134466 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f76240afba0 msgr2=0x7f7624063ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f762913f700 1 --2- 172.21.15.62:0/324134466 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f76240afba0 0x7f7624063ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f762913f700 1 -- 172.21.15.62:0/324134466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f761c00b180 con 0x7f76240b20f0 2021-12-17T18:18:56.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f7623fff700 1 --2- 172.21.15.62:0/324134466 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f76240b1d10 0x7f7624066970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:56.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f762913f700 1 --2- 172.21.15.62:0/324134466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76240b20f0 0x7f7624066e60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f761c002f70 tx=0x7f761c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:56.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f7621ffb700 1 -- 172.21.15.62:0/324134466 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f761c00bed0 con 0x7f76240b20f0 2021-12-17T18:18:56.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f7629940700 1 -- 172.21.15.62:0/324134466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7624156d00 con 0x7f76240b20f0 2021-12-17T18:18:56.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f7621ffb700 1 -- 172.21.15.62:0/324134466 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761c011bf0 con 0x7f76240b20f0 2021-12-17T18:18:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f7621ffb700 1 -- 172.21.15.62:0/324134466 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f761c01e460 con 0x7f76240b20f0 2021-12-17T18:18:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.674+0000 7f7629940700 1 -- 172.21.15.62:0/324134466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7624064170 con 0x7f76240b20f0 2021-12-17T18:18:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.678+0000 7f7629940700 1 -- 172.21.15.62:0/324134466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7624064310 con 0x7f76240b20f0 2021-12-17T18:18:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.678+0000 7f7621ffb700 1 -- 172.21.15.62:0/324134466 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f761c01a040 con 0x7f76240b20f0 2021-12-17T18:18:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.678+0000 7f7621ffb700 1 --2- 172.21.15.62:0/324134466 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7604053610 0x7f7604055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.678+0000 7f7621ffb700 1 -- 172.21.15.62:0/324134466 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f761c06c4c0 con 0x7f76240b20f0 2021-12-17T18:18:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.678+0000 7f762893e700 1 --2- 172.21.15.62:0/324134466 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7604053610 0x7f7604055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.678+0000 7f762893e700 1 --2- 172.21.15.62:0/324134466 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7604053610 0x7f7604055ad0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f761800d000 tx=0x7f7618007a00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:56.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.686+0000 7f7621ffb700 1 -- 172.21.15.62:0/324134466 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7624064310 con 0x7f76240b20f0 2021-12-17T18:18:56.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.854+0000 7f7629940700 1 -- 172.21.15.62:0/324134466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f7624157260 con 0x7f76240b20f0 2021-12-17T18:18:56.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.858+0000 7f7621ffb700 1 -- 172.21.15.62:0/324134466 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f761c023020 con 0x7f76240b20f0 2021-12-17T18:18:56.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.862+0000 7f7629940700 1 -- 172.21.15.62:0/324134466 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7604053610 msgr2=0x7f7604055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.862+0000 7f7629940700 1 --2- 172.21.15.62:0/324134466 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7604053610 0x7f7604055ad0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f761800d000 tx=0x7f7618007a00).stop 2021-12-17T18:18:56.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.862+0000 7f7629940700 1 -- 172.21.15.62:0/324134466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76240b20f0 msgr2=0x7f7624066e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.862+0000 7f7629940700 1 --2- 172.21.15.62:0/324134466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76240b20f0 0x7f7624066e60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f761c002f70 tx=0x7f761c015000).stop 2021-12-17T18:18:56.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.862+0000 7f7629940700 1 -- 172.21.15.62:0/324134466 shutdown_connections 2021-12-17T18:18:56.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.862+0000 7f7629940700 1 --2- 172.21.15.62:0/324134466 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7604053610 0x7f7604055ad0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.862+0000 7f7629940700 1 --2- 172.21.15.62:0/324134466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76240b20f0 0x7f7624066e60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.862+0000 7f7629940700 1 --2- 172.21.15.62:0/324134466 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f76240b1d10 0x7f7624066970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.862+0000 7f7629940700 1 --2- 172.21.15.62:0/324134466 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f76240afba0 0x7f7624063ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.862+0000 7f7629940700 1 -- 172.21.15.62:0/324134466 >> 172.21.15.62:0/324134466 conn(0x7f76240623c0 msgr2=0x7f762414a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:56.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.862+0000 7f7629940700 1 -- 172.21.15.62:0/324134466 shutdown_connections 2021-12-17T18:18:56.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.862+0000 7f7629940700 1 -- 172.21.15.62:0/324134466 wait complete. 2021-12-17T18:18:56.874 INFO:teuthology.orchestra.run.smithi062.stderr:updated 2021-12-17T18:18:56.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2021-12-17T18:18:56.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde34696700 1 Processor -- start 2021-12-17T18:18:56.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde34696700 1 -- start start 2021-12-17T18:18:56.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde34696700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde2c143780 0x7fde2c143b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde34696700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde2c0ad7f0 con 0x7fde2c067120 2021-12-17T18:18:56.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde34696700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde2c0ada90 con 0x7fde2c0b1260 2021-12-17T18:18:56.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde34696700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c0add30 con 0x7fde2c143780 2021-12-17T18:18:56.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde31c31700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fde2c067120 0x7fde2c0675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60958/0 (socket says 172.21.15.62:60958) 2021-12-17T18:18:56.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde31c31700 1 -- 172.21.15.62:0/3009016562 learned_addr learned my addr 172.21.15.62:0/3009016562 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:56.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde32432700 1 --2- 172.21.15.62:0/3009016562 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde2c143780 0x7fde2c143b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde31430700 1 -- 172.21.15.62:0/3009016562 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828470490 0 0) 0x7fde2c0ad7f0 con 0x7fde2c067120 2021-12-17T18:18:56.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde31430700 1 -- 172.21.15.62:0/3009016562 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde14005470 con 0x7fde2c067120 2021-12-17T18:18:56.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde31430700 1 -- 172.21.15.62:0/3009016562 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 375793485 0 0) 0x7fde14005470 con 0x7fde2c067120 2021-12-17T18:18:56.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde31430700 1 -- 172.21.15.62:0/3009016562 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde2c143780 msgr2=0x7fde2c143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:56.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde31430700 1 --2- 172.21.15.62:0/3009016562 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde2c143780 0x7fde2c143b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde31430700 1 -- 172.21.15.62:0/3009016562 >> v1:172.21.15.109:6789/0 conn(0x7fde2c0b1260 legacy=0x7fde2c0b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde31430700 1 -- 172.21.15.62:0/3009016562 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2c067cb0 con 0x7fde2c067120 2021-12-17T18:18:56.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde31430700 1 -- 172.21.15.62:0/3009016562 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fde1c001660 con 0x7fde2c067120 2021-12-17T18:18:56.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.978+0000 7fde31430700 1 -- 172.21.15.62:0/3009016562 >> v1:172.21.15.62:6789/0 conn(0x7fde2c067120 legacy=0x7fde2c0675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde31430700 1 --2- 172.21.15.62:0/3009016562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde14005990 0x7fde14005d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde31430700 1 --2- 172.21.15.62:0/3009016562 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde14006710 0x7fde14006b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde31430700 1 --2- 172.21.15.62:0/3009016562 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde2c143780 0x7fde14007080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:56.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde31430700 1 -- 172.21.15.62:0/3009016562 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c0add30 con 0x7fde14005990 2021-12-17T18:18:56.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde31430700 1 -- 172.21.15.62:0/3009016562 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1400d960 con 0x7fde14006710 2021-12-17T18:18:56.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde31430700 1 -- 172.21.15.62:0/3009016562 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1400dad0 con 0x7fde2c143780 2021-12-17T18:18:56.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde32432700 1 --2- 172.21.15.62:0/3009016562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde14005990 0x7fde14005d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde31c31700 1 --2- 172.21.15.62:0/3009016562 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde14006710 0x7fde14006b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde32c33700 1 --2- 172.21.15.62:0/3009016562 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde2c143780 0x7fde14007080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:56.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde32432700 1 -- 172.21.15.62:0/3009016562 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde2c143780 msgr2=0x7fde14007080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:56.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde32432700 1 --2- 172.21.15.62:0/3009016562 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde2c143780 0x7fde14007080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde32432700 1 -- 172.21.15.62:0/3009016562 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde14006710 msgr2=0x7fde14006b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:56.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde32432700 1 --2- 172.21.15.62:0/3009016562 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde14006710 0x7fde14006b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:56.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde32432700 1 -- 172.21.15.62:0/3009016562 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde14005470 con 0x7fde14005990 2021-12-17T18:18:56.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde31c31700 1 --2- 172.21.15.62:0/3009016562 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde14006710 0x7fde14006b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:18:56.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde32432700 1 --2- 172.21.15.62:0/3009016562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde14005990 0x7fde14005d70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fde2800c000 tx=0x7fde28006df0).ready entity=mon.0 client_cookie=f41fc86e54c447fd server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:56.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde31430700 1 -- 172.21.15.62:0/3009016562 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde2800e7d0 con 0x7fde14005990 2021-12-17T18:18:56.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde31430700 1 -- 172.21.15.62:0/3009016562 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2800e930 con 0x7fde14005990 2021-12-17T18:18:56.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde31430700 1 -- 172.21.15.62:0/3009016562 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde2800ec90 con 0x7fde14005990 2021-12-17T18:18:56.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde34696700 1 -- 172.21.15.62:0/3009016562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde14005990 msgr2=0x7fde14005d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:56.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde34696700 1 --2- 172.21.15.62:0/3009016562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde14005990 0x7fde14005d70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fde2800c000 tx=0x7fde28006df0).stop 2021-12-17T18:18:56.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde32c33700 1 -- 172.21.15.62:0/3009016562 reap_dead start 2021-12-17T18:18:56.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde34696700 1 -- 172.21.15.62:0/3009016562 shutdown_connections 2021-12-17T18:18:56.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde34696700 1 -- 172.21.15.62:0/3009016562 >> 172.21.15.62:0/3009016562 conn(0x7fde2c05f730 msgr2=0x7fde2c05fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:56.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde34696700 1 -- 172.21.15.62:0/3009016562 shutdown_connections 2021-12-17T18:18:57.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde34696700 1 -- 172.21.15.62:0/3009016562 wait complete. 2021-12-17T18:18:57.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.982+0000 7fde34696700 1 Processor -- start 2021-12-17T18:18:57.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde34696700 1 -- start start 2021-12-17T18:18:57.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde34696700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde2c151f20 0x7fde2c14f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde34696700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde2c13c510 0x7fde2c0aaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde34696700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde2c0aaf40 0x7fde2c0ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde34696700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c152700 con 0x7fde2c13c510 2021-12-17T18:18:57.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde34696700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c1529a0 con 0x7fde2c0aaf40 2021-12-17T18:18:57.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde34696700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c13a8a0 con 0x7fde2c151f20 2021-12-17T18:18:57.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde31c31700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde2c13c510 0x7fde2c0aaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde31c31700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde2c13c510 0x7fde2c0aaa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49160/0 (socket says 172.21.15.62:49160) 2021-12-17T18:18:57.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde31c31700 1 -- 172.21.15.62:0/2003890564 learned_addr learned my addr 172.21.15.62:0/2003890564 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:57.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde32432700 1 --2- 172.21.15.62:0/2003890564 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde2c151f20 0x7fde2c14f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde32c33700 1 --2- 172.21.15.62:0/2003890564 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde2c0aaf40 0x7fde2c0ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde31c31700 1 -- 172.21.15.62:0/2003890564 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde2c151f20 msgr2=0x7fde2c14f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde31c31700 1 --2- 172.21.15.62:0/2003890564 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde2c151f20 0x7fde2c14f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde31c31700 1 -- 172.21.15.62:0/2003890564 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde2c0aaf40 msgr2=0x7fde2c0ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde31c31700 1 --2- 172.21.15.62:0/2003890564 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde2c0aaf40 0x7fde2c0ab5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde31c31700 1 -- 172.21.15.62:0/2003890564 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2c152300 con 0x7fde2c13c510 2021-12-17T18:18:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde31c31700 1 --2- 172.21.15.62:0/2003890564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde2c13c510 0x7fde2c0aaa50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fde1c00d000 tx=0x7fde2c0af930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde1b7fe700 1 -- 172.21.15.62:0/2003890564 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde1c00fa90 con 0x7fde2c13c510 2021-12-17T18:18:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde1b7fe700 1 -- 172.21.15.62:0/2003890564 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c00fbf0 con 0x7fde2c13c510 2021-12-17T18:18:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde34696700 1 -- 172.21.15.62:0/2003890564 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde2c14f660 con 0x7fde2c13c510 2021-12-17T18:18:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde1b7fe700 1 -- 172.21.15.62:0/2003890564 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde1c012350 con 0x7fde2c13c510 2021-12-17T18:18:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde34696700 1 -- 172.21.15.62:0/2003890564 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2c13b920 con 0x7fde2c13c510 2021-12-17T18:18:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.986+0000 7fde34696700 1 -- 172.21.15.62:0/2003890564 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde2c152b60 con 0x7fde2c13c510 2021-12-17T18:18:57.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.990+0000 7fde1b7fe700 1 -- 172.21.15.62:0/2003890564 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fde1c01b030 con 0x7fde2c13c510 2021-12-17T18:18:57.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.990+0000 7fde1b7fe700 1 --2- 172.21.15.62:0/2003890564 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde0c053610 0x7fde0c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.990+0000 7fde1b7fe700 1 -- 172.21.15.62:0/2003890564 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fde1c06b470 con 0x7fde2c13c510 2021-12-17T18:18:57.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.990+0000 7fde32432700 1 --2- 172.21.15.62:0/2003890564 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde0c053610 0x7fde0c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.990+0000 7fde32432700 1 --2- 172.21.15.62:0/2003890564 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde0c053610 0x7fde0c055ad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fde2801b000 tx=0x7fde28019000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:57.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:56.998+0000 7fde1b7fe700 1 -- 172.21.15.62:0/2003890564 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fde1c042900 con 0x7fde2c13c510 2021-12-17T18:18:57.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.158+0000 7fde34696700 1 -- 172.21.15.62:0/2003890564 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fde2c0b2e10 con 0x7fde2c13c510 2021-12-17T18:18:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.166+0000 7fde1b7fe700 1 -- 172.21.15.62:0/2003890564 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7fde1c019030 con 0x7fde2c13c510 2021-12-17T18:18:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.166+0000 7fde34696700 1 -- 172.21.15.62:0/2003890564 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde0c053610 msgr2=0x7fde0c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.166+0000 7fde34696700 1 --2- 172.21.15.62:0/2003890564 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde0c053610 0x7fde0c055ad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fde2801b000 tx=0x7fde28019000).stop 2021-12-17T18:18:57.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.166+0000 7fde34696700 1 -- 172.21.15.62:0/2003890564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde2c13c510 msgr2=0x7fde2c0aaa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.166+0000 7fde34696700 1 --2- 172.21.15.62:0/2003890564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde2c13c510 0x7fde2c0aaa50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fde1c00d000 tx=0x7fde2c0af930).stop 2021-12-17T18:18:57.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.166+0000 7fde34696700 1 -- 172.21.15.62:0/2003890564 shutdown_connections 2021-12-17T18:18:57.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.166+0000 7fde34696700 1 --2- 172.21.15.62:0/2003890564 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde0c053610 0x7fde0c055ad0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.166+0000 7fde34696700 1 --2- 172.21.15.62:0/2003890564 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde2c0aaf40 0x7fde2c0ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.166+0000 7fde34696700 1 --2- 172.21.15.62:0/2003890564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde2c13c510 0x7fde2c0aaa50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.166+0000 7fde34696700 1 --2- 172.21.15.62:0/2003890564 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde2c151f20 0x7fde2c14f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.166+0000 7fde34696700 1 -- 172.21.15.62:0/2003890564 >> 172.21.15.62:0/2003890564 conn(0x7fde2c05f730 msgr2=0x7fde2c1416f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:57.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.166+0000 7fde34696700 1 -- 172.21.15.62:0/2003890564 shutdown_connections 2021-12-17T18:18:57.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.166+0000 7fde34696700 1 -- 172.21.15.62:0/2003890564 wait complete. 2021-12-17T18:18:57.180 INFO:teuthology.orchestra.run.smithi062.stderr:updated 2021-12-17T18:18:57.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:18:57.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.286+0000 7fa60bfff700 1 Processor -- start 2021-12-17T18:18:57.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.286+0000 7fa60bfff700 1 -- start start 2021-12-17T18:18:57.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.286+0000 7fa60bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa60c0a8e10 0x7fa60c147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.286+0000 7fa60bfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa60c0a71e0 0x7fa60c0a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.286+0000 7fa60bfff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60c0b6270 con 0x7fa60c141480 2021-12-17T18:18:57.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.286+0000 7fa60bfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c147610 con 0x7fa60c0a8e10 2021-12-17T18:18:57.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.286+0000 7fa60bfff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c1478b0 con 0x7fa60c0a71e0 2021-12-17T18:18:57.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.286+0000 7fa60a7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa60c0a8e10 0x7fa60c147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.286+0000 7fa60a7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa60c0a8e10 0x7fa60c147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49166/0 (socket says 172.21.15.62:49166) 2021-12-17T18:18:57.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.286+0000 7fa60a7fc700 1 -- 172.21.15.62:0/1827048317 learned_addr learned my addr 172.21.15.62:0/1827048317 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:57.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.286+0000 7fa60b7fe700 1 --2- 172.21.15.62:0/1827048317 >> v2:172.21.15.109:3300/0 conn(0x7fa60c0a71e0 0x7fa60c0a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.286+0000 7fa60a7fc700 1 -- 172.21.15.62:0/1827048317 >> v2:172.21.15.109:3300/0 conn(0x7fa60c0a71e0 msgr2=0x7fa60c0a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.286+0000 7fa60a7fc700 1 --2- 172.21.15.62:0/1827048317 >> v2:172.21.15.109:3300/0 conn(0x7fa60c0a71e0 0x7fa60c0a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.286+0000 7fa60a7fc700 1 -- 172.21.15.62:0/1827048317 >> v1:172.21.15.109:6789/0 conn(0x7fa60c141480 legacy=0x7fa60c0b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.286+0000 7fa60a7fc700 1 -- 172.21.15.62:0/1827048317 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c147b50 con 0x7fa60c0a8e10 2021-12-17T18:18:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.286+0000 7fa609ffb700 1 -- 172.21.15.62:0/1827048317 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855003016 0 0) 0x7fa60c0b6270 con 0x7fa60c141480 2021-12-17T18:18:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.286+0000 7fa60a7fc700 1 --2- 172.21.15.62:0/1827048317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa60c0a8e10 0x7fa60c147ff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fa5fc0032f0 tx=0x7fa5fc009290).ready entity=mon.0 client_cookie=832ca1cf41b604ee server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa609ffb700 1 -- 172.21.15.62:0/1827048317 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5fc00b870 con 0x7fa60c0a8e10 2021-12-17T18:18:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa609ffb700 1 -- 172.21.15.62:0/1827048317 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc00b9d0 con 0x7fa60c0a8e10 2021-12-17T18:18:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa609ffb700 1 -- 172.21.15.62:0/1827048317 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5fc00bb40 con 0x7fa60c0a8e10 2021-12-17T18:18:57.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60bfff700 1 -- 172.21.15.62:0/1827048317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa60c0a8e10 msgr2=0x7fa60c147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60bfff700 1 --2- 172.21.15.62:0/1827048317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa60c0a8e10 0x7fa60c147ff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fa5fc0032f0 tx=0x7fa5fc009290).stop 2021-12-17T18:18:57.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60bfff700 1 -- 172.21.15.62:0/1827048317 shutdown_connections 2021-12-17T18:18:57.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60bfff700 1 --2- 172.21.15.62:0/1827048317 >> v2:172.21.15.109:3300/0 conn(0x7fa60c0a71e0 0x7fa60c0a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60bfff700 1 --2- 172.21.15.62:0/1827048317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa60c0a8e10 0x7fa60c147ff0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60bfff700 1 -- 172.21.15.62:0/1827048317 >> 172.21.15.62:0/1827048317 conn(0x7fa60c05d220 msgr2=0x7fa60c0b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:57.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60bfff700 1 -- 172.21.15.62:0/1827048317 shutdown_connections 2021-12-17T18:18:57.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60bfff700 1 -- 172.21.15.62:0/1827048317 wait complete. 2021-12-17T18:18:57.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60bfff700 1 Processor -- start 2021-12-17T18:18:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60bfff700 1 -- start start 2021-12-17T18:18:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60bfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa60c0a71e0 0x7fa60c14b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60bfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa60c0a8e10 0x7fa60c14af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa60c141480 0x7fa60c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c144f50 con 0x7fa60c141480 2021-12-17T18:18:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60bfff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0aaab0 con 0x7fa60c0a71e0 2021-12-17T18:18:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60bfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c144a80 con 0x7fa60c0a8e10 2021-12-17T18:18:57.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa60c141480 0x7fa60c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa60c141480 0x7fa60c0b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49174/0 (socket says 172.21.15.62:49174) 2021-12-17T18:18:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60b7fe700 1 -- 172.21.15.62:0/3449295968 learned_addr learned my addr 172.21.15.62:0/3449295968 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60a7fc700 1 --2- 172.21.15.62:0/3449295968 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa60c0a8e10 0x7fa60c14af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.290+0000 7fa60affd700 1 --2- 172.21.15.62:0/3449295968 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa60c0a71e0 0x7fa60c14b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.294+0000 7fa60b7fe700 1 -- 172.21.15.62:0/3449295968 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa60c0a8e10 msgr2=0x7fa60c14af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.294+0000 7fa60b7fe700 1 --2- 172.21.15.62:0/3449295968 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa60c0a8e10 0x7fa60c14af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.294+0000 7fa60b7fe700 1 -- 172.21.15.62:0/3449295968 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa60c0a71e0 msgr2=0x7fa60c14b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.294+0000 7fa60b7fe700 1 --2- 172.21.15.62:0/3449295968 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa60c0a71e0 0x7fa60c14b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.294+0000 7fa60b7fe700 1 -- 172.21.15.62:0/3449295968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc009530 con 0x7fa60c141480 2021-12-17T18:18:57.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.294+0000 7fa60b7fe700 1 --2- 172.21.15.62:0/3449295968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa60c141480 0x7fa60c0b4d20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fa60c0aabf0 tx=0x7fa604006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:57.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.294+0000 7fa5fbfff700 1 -- 172.21.15.62:0/3449295968 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa604010780 con 0x7fa60c141480 2021-12-17T18:18:57.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.294+0000 7fa5fbfff700 1 -- 172.21.15.62:0/3449295968 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6040108e0 con 0x7fa60c141480 2021-12-17T18:18:57.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.294+0000 7fa60bfff700 1 -- 172.21.15.62:0/3449295968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c0aa650 con 0x7fa60c141480 2021-12-17T18:18:57.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.294+0000 7fa5fbfff700 1 -- 172.21.15.62:0/3449295968 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa604010c40 con 0x7fa60c141480 2021-12-17T18:18:57.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.294+0000 7fa60bfff700 1 -- 172.21.15.62:0/3449295968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c0ab2f0 con 0x7fa60c141480 2021-12-17T18:18:57.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.294+0000 7fa60bfff700 1 -- 172.21.15.62:0/3449295968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c0b1b90 con 0x7fa60c141480 2021-12-17T18:18:57.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.294+0000 7fa5fbfff700 1 -- 172.21.15.62:0/3449295968 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa60401c460 con 0x7fa60c141480 2021-12-17T18:18:57.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.294+0000 7fa5fbfff700 1 --2- 172.21.15.62:0/3449295968 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa5e8053610 0x7fa5e8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.294+0000 7fa5fbfff700 1 -- 172.21.15.62:0/3449295968 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa60406b920 con 0x7fa60c141480 2021-12-17T18:18:57.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.294+0000 7fa60affd700 1 --2- 172.21.15.62:0/3449295968 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa5e8053610 0x7fa5e8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.298+0000 7fa60affd700 1 --2- 172.21.15.62:0/3449295968 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa5e8053610 0x7fa5e8055ad0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fa60000b000 tx=0x7fa600009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:57.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.302+0000 7fa5fbfff700 1 -- 172.21.15.62:0/3449295968 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa604042d50 con 0x7fa60c141480 2021-12-17T18:18:57.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.426+0000 7fa60bfff700 1 -- 172.21.15.62:0/3449295968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa60c0573d0 con 0x7fa60c141480 2021-12-17T18:18:57.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.426+0000 7fa5fbfff700 1 -- 172.21.15.62:0/3449295968 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+13229 (secure 0 0 0) 0x7fa604046370 con 0x7fa60c141480 2021-12-17T18:18:57.436 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:57.436 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":29,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:18:54.939649+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:18:57.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.430+0000 7fa60bfff700 1 -- 172.21.15.62:0/3449295968 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa5e8053610 msgr2=0x7fa5e8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.430+0000 7fa60bfff700 1 --2- 172.21.15.62:0/3449295968 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa5e8053610 0x7fa5e8055ad0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fa60000b000 tx=0x7fa600009040).stop 2021-12-17T18:18:57.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.430+0000 7fa60bfff700 1 -- 172.21.15.62:0/3449295968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa60c141480 msgr2=0x7fa60c0b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.430+0000 7fa60bfff700 1 --2- 172.21.15.62:0/3449295968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa60c141480 0x7fa60c0b4d20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fa60c0aabf0 tx=0x7fa604006df0).stop 2021-12-17T18:18:57.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.430+0000 7fa60bfff700 1 -- 172.21.15.62:0/3449295968 shutdown_connections 2021-12-17T18:18:57.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.430+0000 7fa60bfff700 1 --2- 172.21.15.62:0/3449295968 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa5e8053610 0x7fa5e8055ad0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.430+0000 7fa60bfff700 1 --2- 172.21.15.62:0/3449295968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa60c141480 0x7fa60c0b4d20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.430+0000 7fa60bfff700 1 --2- 172.21.15.62:0/3449295968 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa60c0a8e10 0x7fa60c14af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.430+0000 7fa60bfff700 1 --2- 172.21.15.62:0/3449295968 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa60c0a71e0 0x7fa60c14b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.430+0000 7fa60bfff700 1 -- 172.21.15.62:0/3449295968 >> 172.21.15.62:0/3449295968 conn(0x7fa60c05d220 msgr2=0x7fa60c1450d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:57.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.430+0000 7fa60bfff700 1 -- 172.21.15.62:0/3449295968 shutdown_connections 2021-12-17T18:18:57.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.430+0000 7fa60bfff700 1 -- 172.21.15.62:0/3449295968 wait complete. 2021-12-17T18:18:57.453 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-12-17T18:18:57.454 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:18:57.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.554+0000 7f5129cb0700 1 Processor -- start 2021-12-17T18:18:57.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.554+0000 7f5129cb0700 1 -- start start 2021-12-17T18:18:57.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.554+0000 7f5129cb0700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f51240b47c0 0x7f51240b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.554+0000 7f5129cb0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51240b0870 con 0x7f51240b5be0 2021-12-17T18:18:57.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.554+0000 7f5129cb0700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f512405ce70 con 0x7f512405ca90 2021-12-17T18:18:57.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.554+0000 7f5129cb0700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51240b05d0 con 0x7f51240b47c0 2021-12-17T18:18:57.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.554+0000 7f51294af700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f51240b5be0 0x7f5124143ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60996/0 (socket says 172.21.15.62:60996) 2021-12-17T18:18:57.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.554+0000 7f51294af700 1 -- 172.21.15.62:0/10359175 learned_addr learned my addr 172.21.15.62:0/10359175 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:57.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.554+0000 7f5123fff700 1 --2- 172.21.15.62:0/10359175 >> v2:172.21.15.109:3300/0 conn(0x7f51240b47c0 0x7f51240b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f51237fe700 1 -- 172.21.15.62:0/10359175 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156219805 0 0) 0x7f51240b0870 con 0x7f51240b5be0 2021-12-17T18:18:57.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f51237fe700 1 -- 172.21.15.62:0/10359175 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5104003260 con 0x7f51240b5be0 2021-12-17T18:18:57.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f51237fe700 1 -- 172.21.15.62:0/10359175 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159993889 0 0) 0x7f512405ce70 con 0x7f512405ca90 2021-12-17T18:18:57.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f51237fe700 1 -- 172.21.15.62:0/10359175 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51240b0870 con 0x7f512405ca90 2021-12-17T18:18:57.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f5123fff700 1 -- 172.21.15.62:0/10359175 >> v1:172.21.15.109:6789/0 conn(0x7f512405ca90 legacy=0x7f51240b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f5123fff700 1 -- 172.21.15.62:0/10359175 >> v1:172.21.15.62:6789/0 conn(0x7f51240b5be0 legacy=0x7f5124143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f5123fff700 1 -- 172.21.15.62:0/10359175 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51240b5250 con 0x7f51240b47c0 2021-12-17T18:18:57.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f5123fff700 1 --2- 172.21.15.62:0/10359175 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51240b47c0 0x7f51240b56f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f5114002f70 tx=0x7f5114006df0).ready entity=mon.1 client_cookie=452e4851ae63e99e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:57.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f51237fe700 1 -- 172.21.15.62:0/10359175 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f511400d540 con 0x7f51240b47c0 2021-12-17T18:18:57.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f51237fe700 1 -- 172.21.15.62:0/10359175 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5114000e90 con 0x7f51240b47c0 2021-12-17T18:18:57.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f51237fe700 1 -- 172.21.15.62:0/10359175 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f511400d890 con 0x7f51240b47c0 2021-12-17T18:18:57.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f5129cb0700 1 -- 172.21.15.62:0/10359175 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51240b47c0 msgr2=0x7f51240b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f5129cb0700 1 --2- 172.21.15.62:0/10359175 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51240b47c0 0x7f51240b56f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f5114002f70 tx=0x7f5114006df0).stop 2021-12-17T18:18:57.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f5129cb0700 1 -- 172.21.15.62:0/10359175 shutdown_connections 2021-12-17T18:18:57.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f5129cb0700 1 --2- 172.21.15.62:0/10359175 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51240b47c0 0x7f51240b56f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f5129cb0700 1 -- 172.21.15.62:0/10359175 >> 172.21.15.62:0/10359175 conn(0x7f512405bcd0 msgr2=0x7f5124062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:57.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f5129cb0700 1 -- 172.21.15.62:0/10359175 shutdown_connections 2021-12-17T18:18:57.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f5129cb0700 1 -- 172.21.15.62:0/10359175 wait complete. 2021-12-17T18:18:57.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f5129cb0700 1 Processor -- start 2021-12-17T18:18:57.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.558+0000 7f5129cb0700 1 -- start start 2021-12-17T18:18:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f5129cb0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f512405ca90 0x7f51240b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f5129cb0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51240b47c0 0x7f51240653c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f5129cb0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51240b5be0 0x7f51240af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f5129cb0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5124064a00 con 0x7f51240b5be0 2021-12-17T18:18:57.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f5129cb0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51240a2de0 con 0x7f512405ca90 2021-12-17T18:18:57.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f5129cb0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51240a3010 con 0x7f51240b47c0 2021-12-17T18:18:57.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f51294af700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51240b5be0 0x7f51240af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f51294af700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51240b5be0 0x7f51240af8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49190/0 (socket says 172.21.15.62:49190) 2021-12-17T18:18:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f51294af700 1 -- 172.21.15.62:0/2641228373 learned_addr learned my addr 172.21.15.62:0/2641228373 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f5123fff700 1 --2- 172.21.15.62:0/2641228373 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51240b47c0 0x7f51240653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f5128cae700 1 --2- 172.21.15.62:0/2641228373 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f512405ca90 0x7f51240b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f51294af700 1 -- 172.21.15.62:0/2641228373 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51240b47c0 msgr2=0x7f51240653c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f51294af700 1 --2- 172.21.15.62:0/2641228373 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51240b47c0 0x7f51240653c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f51294af700 1 -- 172.21.15.62:0/2641228373 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f512405ca90 msgr2=0x7f51240b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f51294af700 1 --2- 172.21.15.62:0/2641228373 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f512405ca90 0x7f51240b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f51294af700 1 -- 172.21.15.62:0/2641228373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511400b180 con 0x7f51240b5be0 2021-12-17T18:18:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f51294af700 1 --2- 172.21.15.62:0/2641228373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51240b5be0 0x7f51240af8d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f511c001490 tx=0x7f511c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f5121ffb700 1 -- 172.21.15.62:0/2641228373 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f511c005ba0 con 0x7f51240b5be0 2021-12-17T18:18:57.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f5129cb0700 1 -- 172.21.15.62:0/2641228373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51240a32b0 con 0x7f51240b5be0 2021-12-17T18:18:57.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f5121ffb700 1 -- 172.21.15.62:0/2641228373 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c005d00 con 0x7f51240b5be0 2021-12-17T18:18:57.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f5121ffb700 1 -- 172.21.15.62:0/2641228373 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f511c0072c0 con 0x7f51240b5be0 2021-12-17T18:18:57.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.562+0000 7f5129cb0700 1 -- 172.21.15.62:0/2641228373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5124155bc0 con 0x7f51240b5be0 2021-12-17T18:18:57.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.566+0000 7f5129cb0700 1 -- 172.21.15.62:0/2641228373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51240b3980 con 0x7f51240b5be0 2021-12-17T18:18:57.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.566+0000 7f5121ffb700 1 -- 172.21.15.62:0/2641228373 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f511c010070 con 0x7f51240b5be0 2021-12-17T18:18:57.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.566+0000 7f5121ffb700 1 --2- 172.21.15.62:0/2641228373 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51080535b0 0x7f5108055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.566+0000 7f5121ffb700 1 -- 172.21.15.62:0/2641228373 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f511c06b0c0 con 0x7f51240b5be0 2021-12-17T18:18:57.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.566+0000 7f5128cae700 1 --2- 172.21.15.62:0/2641228373 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51080535b0 0x7f5108055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.566+0000 7f5128cae700 1 --2- 172.21.15.62:0/2641228373 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51080535b0 0x7f5108055a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f510c00d000 tx=0x7f510c007a20).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:57.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.570+0000 7f5121ffb700 1 -- 172.21.15.62:0/2641228373 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f511c0423c0 con 0x7f51240b5be0 2021-12-17T18:18:57.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.698+0000 7f5129cb0700 1 -- 172.21.15.62:0/2641228373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f51240573d0 con 0x7f51240b5be0 2021-12-17T18:18:57.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.698+0000 7f5121ffb700 1 -- 172.21.15.62:0/2641228373 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v29) v1 ==== 110+0+10 (secure 0 0 0) 0x7f511c0459e0 con 0x7f51240b5be0 2021-12-17T18:18:57.706 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:18:57.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.702+0000 7f5129cb0700 1 -- 172.21.15.62:0/2641228373 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51080535b0 msgr2=0x7f5108055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.702+0000 7f5129cb0700 1 --2- 172.21.15.62:0/2641228373 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51080535b0 0x7f5108055a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f510c00d000 tx=0x7f510c007a20).stop 2021-12-17T18:18:57.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.702+0000 7f5129cb0700 1 -- 172.21.15.62:0/2641228373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51240b5be0 msgr2=0x7f51240af8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.702+0000 7f5129cb0700 1 --2- 172.21.15.62:0/2641228373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51240b5be0 0x7f51240af8d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f511c001490 tx=0x7f511c007e00).stop 2021-12-17T18:18:57.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.702+0000 7f5129cb0700 1 -- 172.21.15.62:0/2641228373 shutdown_connections 2021-12-17T18:18:57.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.702+0000 7f5129cb0700 1 --2- 172.21.15.62:0/2641228373 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51080535b0 0x7f5108055a70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.702+0000 7f5129cb0700 1 --2- 172.21.15.62:0/2641228373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51240b5be0 0x7f51240af8d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.702+0000 7f5129cb0700 1 --2- 172.21.15.62:0/2641228373 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51240b47c0 0x7f51240653c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.702+0000 7f5129cb0700 1 --2- 172.21.15.62:0/2641228373 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f512405ca90 0x7f51240b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.702+0000 7f5129cb0700 1 -- 172.21.15.62:0/2641228373 >> 172.21.15.62:0/2641228373 conn(0x7f512405bcd0 msgr2=0x7f512405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:57.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.702+0000 7f5129cb0700 1 -- 172.21.15.62:0/2641228373 shutdown_connections 2021-12-17T18:18:57.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.702+0000 7f5129cb0700 1 -- 172.21.15.62:0/2641228373 wait complete. 2021-12-17T18:18:57.722 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:18:57.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.822+0000 7f6d5ad2f700 1 Processor -- start 2021-12-17T18:18:57.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.822+0000 7f6d5ad2f700 1 -- start start 2021-12-17T18:18:57.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d5ad2f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6d5405c750 0x7f6d5405cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d5ad2f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6d54146f70 0x7f6d540b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d5ad2f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d541473c0 con 0x7f6d54060260 2021-12-17T18:18:57.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d5ad2f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d54142ff0 con 0x7f6d54146f70 2021-12-17T18:18:57.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d5ad2f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d54143290 con 0x7f6d5405c750 2021-12-17T18:18:57.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d592cc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6d54146f70 0x7f6d540b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d592cc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6d54146f70 0x7f6d540b4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49198/0 (socket says 172.21.15.62:49198) 2021-12-17T18:18:57.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d592cc700 1 -- 172.21.15.62:0/4033811706 learned_addr learned my addr 172.21.15.62:0/4033811706 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:57.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d58acb700 1 --2- 172.21.15.62:0/4033811706 >> v2:172.21.15.109:3300/0 conn(0x7f6d5405c750 0x7f6d5405cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d592cc700 1 -- 172.21.15.62:0/4033811706 >> v2:172.21.15.109:3300/0 conn(0x7f6d5405c750 msgr2=0x7f6d5405cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:18:57.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d592cc700 1 --2- 172.21.15.62:0/4033811706 >> v2:172.21.15.109:3300/0 conn(0x7f6d5405c750 0x7f6d5405cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d592cc700 1 -- 172.21.15.62:0/4033811706 >> v1:172.21.15.62:6789/0 conn(0x7f6d54060260 legacy=0x7f6d541439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d592cc700 1 -- 172.21.15.62:0/4033811706 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d54143530 con 0x7f6d54146f70 2021-12-17T18:18:57.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d592cc700 1 --2- 172.21.15.62:0/4033811706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d54146f70 0x7f6d540b4c80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f6d4c0032f0 tx=0x7f6d4c009290).ready entity=mon.0 client_cookie=8d3ee3e682cf308e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:57.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d537fe700 1 -- 172.21.15.62:0/4033811706 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d4c00b870 con 0x7f6d54146f70 2021-12-17T18:18:57.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d537fe700 1 -- 172.21.15.62:0/4033811706 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4c00b9d0 con 0x7f6d54146f70 2021-12-17T18:18:57.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d537fe700 1 -- 172.21.15.62:0/4033811706 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d4c00bb40 con 0x7f6d54146f70 2021-12-17T18:18:57.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d5ad2f700 1 -- 172.21.15.62:0/4033811706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d54146f70 msgr2=0x7f6d540b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d5ad2f700 1 --2- 172.21.15.62:0/4033811706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d54146f70 0x7f6d540b4c80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f6d4c0032f0 tx=0x7f6d4c009290).stop 2021-12-17T18:18:57.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d5ad2f700 1 -- 172.21.15.62:0/4033811706 shutdown_connections 2021-12-17T18:18:57.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d5ad2f700 1 --2- 172.21.15.62:0/4033811706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d54146f70 0x7f6d540b4c80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d5ad2f700 1 --2- 172.21.15.62:0/4033811706 >> v2:172.21.15.109:3300/0 conn(0x7f6d5405c750 0x7f6d5405cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d5ad2f700 1 -- 172.21.15.62:0/4033811706 >> 172.21.15.62:0/4033811706 conn(0x7f6d54062430 msgr2=0x7f6d54062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:57.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d5ad2f700 1 -- 172.21.15.62:0/4033811706 shutdown_connections 2021-12-17T18:18:57.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d5ad2f700 1 -- 172.21.15.62:0/4033811706 wait complete. 2021-12-17T18:18:57.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d5ad2f700 1 Processor -- start 2021-12-17T18:18:57.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.826+0000 7f6d5ad2f700 1 -- start start 2021-12-17T18:18:57.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d5ad2f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d5405c750 0x7f6d54112b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d5ad2f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6d54060260 0x7f6d54063490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d5ad2f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d54146f70 0x7f6d54063980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d5ad2f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d54152970 con 0x7f6d54146f70 2021-12-17T18:18:57.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d5ad2f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d54152c10 con 0x7f6d54060260 2021-12-17T18:18:57.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d5ad2f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d54152eb0 con 0x7f6d5405c750 2021-12-17T18:18:57.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d592cc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d54146f70 0x7f6d54063980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d592cc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d54146f70 0x7f6d54063980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49204/0 (socket says 172.21.15.62:49204) 2021-12-17T18:18:57.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d592cc700 1 -- 172.21.15.62:0/3787743166 learned_addr learned my addr 172.21.15.62:0/3787743166 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d53fff700 1 --2- 172.21.15.62:0/3787743166 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6d54060260 0x7f6d54063490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d58acb700 1 --2- 172.21.15.62:0/3787743166 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d5405c750 0x7f6d54112b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d592cc700 1 -- 172.21.15.62:0/3787743166 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d5405c750 msgr2=0x7f6d54112b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d592cc700 1 --2- 172.21.15.62:0/3787743166 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d5405c750 0x7f6d54112b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d592cc700 1 -- 172.21.15.62:0/3787743166 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6d54060260 msgr2=0x7f6d54063490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d592cc700 1 --2- 172.21.15.62:0/3787743166 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6d54060260 0x7f6d54063490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d592cc700 1 -- 172.21.15.62:0/3787743166 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c009530 con 0x7f6d54146f70 2021-12-17T18:18:57.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d592cc700 1 --2- 172.21.15.62:0/3787743166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d54146f70 0x7f6d54063980 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f6d4c0032f0 tx=0x7f6d4c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:57.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d51ffb700 1 -- 172.21.15.62:0/3787743166 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d4c00b870 con 0x7f6d54146f70 2021-12-17T18:18:57.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d51ffb700 1 -- 172.21.15.62:0/3787743166 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4c021670 con 0x7f6d54146f70 2021-12-17T18:18:57.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d5ad2f700 1 -- 172.21.15.62:0/3787743166 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d54113060 con 0x7f6d54146f70 2021-12-17T18:18:57.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d51ffb700 1 -- 172.21.15.62:0/3787743166 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d4c0219d0 con 0x7f6d54146f70 2021-12-17T18:18:57.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.830+0000 7f6d5ad2f700 1 -- 172.21.15.62:0/3787743166 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d54063e70 con 0x7f6d54146f70 2021-12-17T18:18:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.834+0000 7f6d51ffb700 1 -- 172.21.15.62:0/3787743166 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6d4c00f070 con 0x7f6d54146f70 2021-12-17T18:18:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.834+0000 7f6d5ad2f700 1 -- 172.21.15.62:0/3787743166 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d54153070 con 0x7f6d54146f70 2021-12-17T18:18:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.834+0000 7f6d51ffb700 1 --2- 172.21.15.62:0/3787743166 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d34053640 0x7f6d34055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.834+0000 7f6d51ffb700 1 -- 172.21.15.62:0/3787743166 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6d4c06c790 con 0x7f6d54146f70 2021-12-17T18:18:57.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.834+0000 7f6d58acb700 1 --2- 172.21.15.62:0/3787743166 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d34053640 0x7f6d34055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:57.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.834+0000 7f6d58acb700 1 --2- 172.21.15.62:0/3787743166 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d34053640 0x7f6d34055b00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f6d4400c000 tx=0x7f6d44008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:57.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.838+0000 7f6d51ffb700 1 -- 172.21.15.62:0/3787743166 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6d4c043b10 con 0x7f6d54146f70 2021-12-17T18:18:57.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.966+0000 7f6d5ad2f700 1 -- 172.21.15.62:0/3787743166 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6d540573d0 con 0x7f6d54146f70 2021-12-17T18:18:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.966+0000 7f6d51ffb700 1 -- 172.21.15.62:0/3787743166 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6d4c026020 con 0x7f6d54146f70 2021-12-17T18:18:57.976 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:18:57.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.966+0000 7f6d5ad2f700 1 -- 172.21.15.62:0/3787743166 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d34053640 msgr2=0x7f6d34055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.970+0000 7f6d5ad2f700 1 --2- 172.21.15.62:0/3787743166 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d34053640 0x7f6d34055b00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f6d4400c000 tx=0x7f6d44008040).stop 2021-12-17T18:18:57.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.970+0000 7f6d5ad2f700 1 -- 172.21.15.62:0/3787743166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d54146f70 msgr2=0x7f6d54063980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:57.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.970+0000 7f6d5ad2f700 1 --2- 172.21.15.62:0/3787743166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d54146f70 0x7f6d54063980 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f6d4c0032f0 tx=0x7f6d4c016000).stop 2021-12-17T18:18:57.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.970+0000 7f6d5ad2f700 1 -- 172.21.15.62:0/3787743166 shutdown_connections 2021-12-17T18:18:57.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.970+0000 7f6d5ad2f700 1 --2- 172.21.15.62:0/3787743166 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d34053640 0x7f6d34055b00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.970+0000 7f6d5ad2f700 1 --2- 172.21.15.62:0/3787743166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d54146f70 0x7f6d54063980 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.970+0000 7f6d5ad2f700 1 --2- 172.21.15.62:0/3787743166 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6d54060260 0x7f6d54063490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.970+0000 7f6d5ad2f700 1 --2- 172.21.15.62:0/3787743166 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d5405c750 0x7f6d54112b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:57.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.970+0000 7f6d5ad2f700 1 -- 172.21.15.62:0/3787743166 >> 172.21.15.62:0/3787743166 conn(0x7f6d54062430 msgr2=0x7f6d540b53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:57.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.970+0000 7f6d5ad2f700 1 -- 172.21.15.62:0/3787743166 shutdown_connections 2021-12-17T18:18:57.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:57.970+0000 7f6d5ad2f700 1 -- 172.21.15.62:0/3787743166 wait complete. 2021-12-17T18:18:57.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-12-17T18:18:58.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe8a051b700 1 Processor -- start 2021-12-17T18:18:58.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe8a051b700 1 -- start start 2021-12-17T18:18:58.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe8a051b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe8980a7bb0 0x7fe898067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:58.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe8a051b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8980b2ce0 con 0x7fe8980b21f0 2021-12-17T18:18:58.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe8a051b700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8980aca60 con 0x7fe8980b1730 2021-12-17T18:18:58.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe8a051b700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89814b5b0 con 0x7fe8980a7bb0 2021-12-17T18:18:58.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe89e2b7700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe8980b21f0 0x7fe89814aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32788/0 (socket says 172.21.15.62:32788) 2021-12-17T18:18:58.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe89e2b7700 1 -- 172.21.15.62:0/3816238218 learned_addr learned my addr 172.21.15.62:0/3816238218 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:58.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe89eab8700 1 --2- 172.21.15.62:0/3816238218 >> v2:172.21.15.109:3300/0 conn(0x7fe8980a7bb0 0x7fe898067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:58.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe89d2b5700 1 -- 172.21.15.62:0/3816238218 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974751342 0 0) 0x7fe8980b2ce0 con 0x7fe8980b21f0 2021-12-17T18:18:58.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe89d2b5700 1 -- 172.21.15.62:0/3816238218 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe884003260 con 0x7fe8980b21f0 2021-12-17T18:18:58.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe89d2b5700 1 -- 172.21.15.62:0/3816238218 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763093025 0 0) 0x7fe8980aca60 con 0x7fe8980b1730 2021-12-17T18:18:58.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe89d2b5700 1 -- 172.21.15.62:0/3816238218 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8980b2ce0 con 0x7fe8980b1730 2021-12-17T18:18:58.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe89eab8700 1 -- 172.21.15.62:0/3816238218 >> v1:172.21.15.109:6789/0 conn(0x7fe8980b1730 legacy=0x7fe8980ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:58.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe89d2b5700 1 -- 172.21.15.62:0/3816238218 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4281598413 0 0) 0x7fe884003260 con 0x7fe8980b21f0 2021-12-17T18:18:58.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe89eab8700 1 -- 172.21.15.62:0/3816238218 >> v1:172.21.15.62:6789/0 conn(0x7fe8980b21f0 legacy=0x7fe89814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:58.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe89eab8700 1 -- 172.21.15.62:0/3816238218 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8980b2f10 con 0x7fe8980a7bb0 2021-12-17T18:18:58.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe89eab8700 1 --2- 172.21.15.62:0/3816238218 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe8980a7bb0 0x7fe898067120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fe88c001110 tx=0x7fe888006df0).ready entity=mon.1 client_cookie=f840a7bcd88a046a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:58.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe89d2b5700 1 -- 172.21.15.62:0/3816238218 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe88c001660 con 0x7fe8980a7bb0 2021-12-17T18:18:58.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe89d2b5700 1 -- 172.21.15.62:0/3816238218 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe888000e90 con 0x7fe8980a7bb0 2021-12-17T18:18:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.087+0000 7fe89d2b5700 1 -- 172.21.15.62:0/3816238218 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe888012460 con 0x7fe8980a7bb0 2021-12-17T18:18:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8a051b700 1 -- 172.21.15.62:0/3816238218 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe8980a7bb0 msgr2=0x7fe898067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8a051b700 1 --2- 172.21.15.62:0/3816238218 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe8980a7bb0 0x7fe898067120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fe88c001110 tx=0x7fe888006df0).stop 2021-12-17T18:18:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8a051b700 1 -- 172.21.15.62:0/3816238218 shutdown_connections 2021-12-17T18:18:58.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8a051b700 1 --2- 172.21.15.62:0/3816238218 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe8980a7bb0 0x7fe898067120 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:58.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8a051b700 1 -- 172.21.15.62:0/3816238218 >> 172.21.15.62:0/3816238218 conn(0x7fe89805f730 msgr2=0x7fe89805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:58.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8a051b700 1 -- 172.21.15.62:0/3816238218 shutdown_connections 2021-12-17T18:18:58.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8a051b700 1 -- 172.21.15.62:0/3816238218 wait complete. 2021-12-17T18:18:58.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8a051b700 1 Processor -- start 2021-12-17T18:18:58.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8a051b700 1 -- start start 2021-12-17T18:18:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8a051b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe8980a7bb0 0x7fe898065b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8a051b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8980b1730 0x7fe898066080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8a051b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe8980b21f0 0x7fe898063060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8a051b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8981577f0 con 0x7fe8980b1730 2021-12-17T18:18:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8a051b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe898157a90 con 0x7fe8980b21f0 2021-12-17T18:18:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8a051b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe898066570 con 0x7fe8980a7bb0 2021-12-17T18:18:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe89dab6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8980b1730 0x7fe898066080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe89dab6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8980b1730 0x7fe898066080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49216/0 (socket says 172.21.15.62:49216) 2021-12-17T18:18:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe89dab6700 1 -- 172.21.15.62:0/241157875 learned_addr learned my addr 172.21.15.62:0/241157875 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe89e2b7700 1 --2- 172.21.15.62:0/241157875 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe8980a7bb0 0x7fe898065b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe89eab8700 1 --2- 172.21.15.62:0/241157875 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe8980b21f0 0x7fe898063060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe89dab6700 1 -- 172.21.15.62:0/241157875 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe8980a7bb0 msgr2=0x7fe898065b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:58.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe89dab6700 1 --2- 172.21.15.62:0/241157875 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe8980a7bb0 0x7fe898065b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:58.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe89dab6700 1 -- 172.21.15.62:0/241157875 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe8980b21f0 msgr2=0x7fe898063060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:58.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe89dab6700 1 --2- 172.21.15.62:0/241157875 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe8980b21f0 0x7fe898063060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:58.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe89dab6700 1 -- 172.21.15.62:0/241157875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88800b180 con 0x7fe8980b1730 2021-12-17T18:18:58.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe89e2b7700 1 --2- 172.21.15.62:0/241157875 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe8980a7bb0 0x7fe898065b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:18:58.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe89dab6700 1 --2- 172.21.15.62:0/241157875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8980b1730 0x7fe898066080 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fe890001490 tx=0x7fe890007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:58.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8977fe700 1 -- 172.21.15.62:0/241157875 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe890002310 con 0x7fe8980b1730 2021-12-17T18:18:58.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8977fe700 1 -- 172.21.15.62:0/241157875 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe890002470 con 0x7fe8980b1730 2021-12-17T18:18:58.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8a051b700 1 -- 172.21.15.62:0/241157875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe898066a70 con 0x7fe8980b1730 2021-12-17T18:18:58.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8977fe700 1 -- 172.21.15.62:0/241157875 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe890001840 con 0x7fe8980b1730 2021-12-17T18:18:58.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.091+0000 7fe8a051b700 1 -- 172.21.15.62:0/241157875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8980ac8b0 con 0x7fe8980b1730 2021-12-17T18:18:58.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.095+0000 7fe8977fe700 1 -- 172.21.15.62:0/241157875 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe890019030 con 0x7fe8980b1730 2021-12-17T18:18:58.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.095+0000 7fe8a051b700 1 -- 172.21.15.62:0/241157875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8980ad5a0 con 0x7fe8980b1730 2021-12-17T18:18:58.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.095+0000 7fe8977fe700 1 --2- 172.21.15.62:0/241157875 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe8780534f0 0x7fe8780559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:58.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.095+0000 7fe8977fe700 1 -- 172.21.15.62:0/241157875 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe89006aea0 con 0x7fe8980b1730 2021-12-17T18:18:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.095+0000 7fe89e2b7700 1 --2- 172.21.15.62:0/241157875 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe8780534f0 0x7fe8780559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.095+0000 7fe89e2b7700 1 --2- 172.21.15.62:0/241157875 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe8780534f0 0x7fe8780559b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fe88c00b000 tx=0x7fe88c000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.099+0000 7fe8977fe700 1 -- 172.21.15.62:0/241157875 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe890042330 con 0x7fe8980b1730 2021-12-17T18:18:58.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.227+0000 7fe8a051b700 1 -- 172.21.15.62:0/241157875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe8980573d0 con 0x7fe8980b1730 2021-12-17T18:18:58.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.227+0000 7fe8977fe700 1 -- 172.21.15.62:0/241157875 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+143 (secure 0 0 0) 0x7fe890045950 con 0x7fe8980b1730 2021-12-17T18:18:58.239 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:18:58.239 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2021-12-17T18:18:58.239 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:58.240 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2021-12-17T18:18:58.240 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "device_health_metrics" 2021-12-17T18:18:58.240 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:18:58.240 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:18:58.241 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2021-12-17T18:18:58.241 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2021-12-17T18:18:58.241 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:18:58.241 INFO:teuthology.orchestra.run.smithi062.stdout:] 2021-12-17T18:18:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.231+0000 7fe8a051b700 1 -- 172.21.15.62:0/241157875 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe8780534f0 msgr2=0x7fe8780559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.231+0000 7fe8a051b700 1 --2- 172.21.15.62:0/241157875 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe8780534f0 0x7fe8780559b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fe88c00b000 tx=0x7fe88c000bc0).stop 2021-12-17T18:18:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.231+0000 7fe8a051b700 1 -- 172.21.15.62:0/241157875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8980b1730 msgr2=0x7fe898066080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.231+0000 7fe8a051b700 1 --2- 172.21.15.62:0/241157875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8980b1730 0x7fe898066080 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fe890001490 tx=0x7fe890007e60).stop 2021-12-17T18:18:58.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.231+0000 7fe8a051b700 1 -- 172.21.15.62:0/241157875 shutdown_connections 2021-12-17T18:18:58.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.231+0000 7fe8a051b700 1 --2- 172.21.15.62:0/241157875 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe8780534f0 0x7fe8780559b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:58.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.231+0000 7fe8a051b700 1 --2- 172.21.15.62:0/241157875 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe8980b21f0 0x7fe898063060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:58.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.231+0000 7fe8a051b700 1 --2- 172.21.15.62:0/241157875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8980b1730 0x7fe898066080 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:58.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.231+0000 7fe8a051b700 1 --2- 172.21.15.62:0/241157875 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe8980a7bb0 0x7fe898065b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:58.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.231+0000 7fe8a051b700 1 -- 172.21.15.62:0/241157875 >> 172.21.15.62:0/241157875 conn(0x7fe89805f730 msgr2=0x7fe898147970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:58.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.231+0000 7fe8a051b700 1 -- 172.21.15.62:0/241157875 shutdown_connections 2021-12-17T18:18:58.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.231+0000 7fe8a051b700 1 -- 172.21.15.62:0/241157875 wait complete. 2021-12-17T18:18:58.248 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-12-17T18:18:58.248 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-12-17T18:18:58.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.351+0000 7f1fe1666700 1 Processor -- start 2021-12-17T18:18:58.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.351+0000 7f1fe1666700 1 -- start start 2021-12-17T18:18:58.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fe1666700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1fdc0b41f0 0x7f1fdc146da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:58.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fe1666700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc0b2010 con 0x7f1fdc0b05b0 2021-12-17T18:18:58.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fe1666700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc0b0990 con 0x7f1fdc0b5dd0 2021-12-17T18:18:58.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fe1666700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc147290 con 0x7f1fdc0b41f0 2021-12-17T18:18:58.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fdaffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1fdc0b05b0 0x7f1fdc146690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32802/0 (socket says 172.21.15.62:32802) 2021-12-17T18:18:58.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fdaffd700 1 -- 172.21.15.62:0/1629932986 learned_addr learned my addr 172.21.15.62:0/1629932986 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:58.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fdb7fe700 1 --2- 172.21.15.62:0/1629932986 >> v2:172.21.15.109:3300/0 conn(0x7f1fdc0b41f0 0x7f1fdc146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fda7fc700 1 -- 172.21.15.62:0/1629932986 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699101168 0 0) 0x7f1fdc0b2010 con 0x7f1fdc0b05b0 2021-12-17T18:18:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fda7fc700 1 -- 172.21.15.62:0/1629932986 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fbc003260 con 0x7f1fdc0b05b0 2021-12-17T18:18:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fda7fc700 1 -- 172.21.15.62:0/1629932986 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441578064 0 0) 0x7f1fdc0b0990 con 0x7f1fdc0b5dd0 2021-12-17T18:18:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fda7fc700 1 -- 172.21.15.62:0/1629932986 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fdc0b2010 con 0x7f1fdc0b5dd0 2021-12-17T18:18:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fdb7fe700 1 -- 172.21.15.62:0/1629932986 >> v1:172.21.15.109:6789/0 conn(0x7f1fdc0b5dd0 legacy=0x7f1fdc141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fdb7fe700 1 -- 172.21.15.62:0/1629932986 >> v1:172.21.15.62:6789/0 conn(0x7f1fdc0b05b0 legacy=0x7f1fdc146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fdb7fe700 1 -- 172.21.15.62:0/1629932986 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc0b2240 con 0x7f1fdc0b41f0 2021-12-17T18:18:58.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fdb7fe700 1 --2- 172.21.15.62:0/1629932986 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fdc0b41f0 0x7f1fdc146da0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f1fdc0b15f0 tx=0x7f1fd40091d0).ready entity=mon.1 client_cookie=342725411b61c095 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:58.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fda7fc700 1 -- 172.21.15.62:0/1629932986 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fd400b600 con 0x7f1fdc0b41f0 2021-12-17T18:18:58.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fda7fc700 1 -- 172.21.15.62:0/1629932986 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd400b760 con 0x7f1fdc0b41f0 2021-12-17T18:18:58.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fda7fc700 1 -- 172.21.15.62:0/1629932986 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fd400b8d0 con 0x7f1fdc0b41f0 2021-12-17T18:18:58.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fe1666700 1 -- 172.21.15.62:0/1629932986 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fdc0b41f0 msgr2=0x7f1fdc146da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fe1666700 1 --2- 172.21.15.62:0/1629932986 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fdc0b41f0 0x7f1fdc146da0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f1fdc0b15f0 tx=0x7f1fd40091d0).stop 2021-12-17T18:18:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fe1666700 1 -- 172.21.15.62:0/1629932986 shutdown_connections 2021-12-17T18:18:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fe1666700 1 --2- 172.21.15.62:0/1629932986 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fdc0b41f0 0x7f1fdc146da0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fe1666700 1 -- 172.21.15.62:0/1629932986 >> 172.21.15.62:0/1629932986 conn(0x7f1fdc062510 msgr2=0x7f1fdc0628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fe1666700 1 -- 172.21.15.62:0/1629932986 shutdown_connections 2021-12-17T18:18:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.355+0000 7f1fe1666700 1 -- 172.21.15.62:0/1629932986 wait complete. 2021-12-17T18:18:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fe1666700 1 Processor -- start 2021-12-17T18:18:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fe1666700 1 -- start start 2021-12-17T18:18:58.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fe1666700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fdc0b05b0 0x7f1fdc0b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:58.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fe1666700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fdc0b41f0 0x7f1fdc0643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:58.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fe1666700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fdc0b5dd0 0x7f1fdc0648b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:58.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fe1666700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc1407d0 con 0x7f1fdc0b5dd0 2021-12-17T18:18:58.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fe1666700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc13f9c0 con 0x7f1fdc0b41f0 2021-12-17T18:18:58.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fe1666700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc063f20 con 0x7f1fdc0b05b0 2021-12-17T18:18:58.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fdb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fdc0b5dd0 0x7f1fdc0648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:58.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fdb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fdc0b5dd0 0x7f1fdc0648b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49230/0 (socket says 172.21.15.62:49230) 2021-12-17T18:18:58.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fdb7fe700 1 -- 172.21.15.62:0/113072358 learned_addr learned my addr 172.21.15.62:0/113072358 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:58.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fdaffd700 1 --2- 172.21.15.62:0/113072358 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fdc0b05b0 0x7f1fdc0b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:58.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fd3fff700 1 --2- 172.21.15.62:0/113072358 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fdc0b41f0 0x7f1fdc0643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:58.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fdb7fe700 1 -- 172.21.15.62:0/113072358 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fdc0b05b0 msgr2=0x7f1fdc0b8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:58.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fdb7fe700 1 --2- 172.21.15.62:0/113072358 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fdc0b05b0 0x7f1fdc0b8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:58.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fdb7fe700 1 -- 172.21.15.62:0/113072358 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fdc0b41f0 msgr2=0x7f1fdc0643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:58.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fdb7fe700 1 --2- 172.21.15.62:0/113072358 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fdc0b41f0 0x7f1fdc0643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:58.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fdb7fe700 1 -- 172.21.15.62:0/113072358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd4009470 con 0x7f1fdc0b5dd0 2021-12-17T18:18:58.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fdb7fe700 1 --2- 172.21.15.62:0/113072358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fdc0b5dd0 0x7f1fdc0648b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f1fdc0b15f0 tx=0x7f1fd4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:58.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fd8ff9700 1 -- 172.21.15.62:0/113072358 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fd400b600 con 0x7f1fdc0b5dd0 2021-12-17T18:18:58.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fd8ff9700 1 -- 172.21.15.62:0/113072358 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd4011e60 con 0x7f1fdc0b5dd0 2021-12-17T18:18:58.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fd8ff9700 1 -- 172.21.15.62:0/113072358 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fd401f5e0 con 0x7f1fdc0b5dd0 2021-12-17T18:18:58.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fe1666700 1 -- 172.21.15.62:0/113072358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc064da0 con 0x7f1fdc0b5dd0 2021-12-17T18:18:58.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.359+0000 7f1fe1666700 1 -- 172.21.15.62:0/113072358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc063710 con 0x7f1fdc0b5dd0 2021-12-17T18:18:58.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.363+0000 7f1fe1666700 1 -- 172.21.15.62:0/113072358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fdc0b2780 con 0x7f1fdc0b5dd0 2021-12-17T18:18:58.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.363+0000 7f1fd8ff9700 1 -- 172.21.15.62:0/113072358 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1fd400f070 con 0x7f1fdc0b5dd0 2021-12-17T18:18:58.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.363+0000 7f1fd8ff9700 1 --2- 172.21.15.62:0/113072358 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fc00536a0 0x7f1fc0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:58.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.363+0000 7f1fd8ff9700 1 -- 172.21.15.62:0/113072358 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1fd406bd60 con 0x7f1fdc0b5dd0 2021-12-17T18:18:58.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.363+0000 7f1fdaffd700 1 --2- 172.21.15.62:0/113072358 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fc00536a0 0x7f1fc0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:58.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.363+0000 7f1fdaffd700 1 --2- 172.21.15.62:0/113072358 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fc00536a0 0x7f1fc0055b60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f1fcc00d000 tx=0x7f1fcc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:58.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.367+0000 7f1fd8ff9700 1 -- 172.21.15.62:0/113072358 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1fd4043150 con 0x7f1fdc0b5dd0 2021-12-17T18:18:58.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:58.495+0000 7f1fe1666700 1 -- 172.21.15.62:0/113072358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f1fdc0573d0 con 0x7f1fdc0b5dd0 2021-12-17T18:18:59.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.175+0000 7f1fd8ff9700 1 -- 172.21.15.62:0/113072358 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v30) v1 ==== 133+0+0 (secure 0 0 0) 0x7f1fd40240a0 con 0x7f1fdc0b5dd0 2021-12-17T18:18:59.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.179+0000 7f1fe1666700 1 -- 172.21.15.62:0/113072358 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fc00536a0 msgr2=0x7f1fc0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:59.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.179+0000 7f1fe1666700 1 --2- 172.21.15.62:0/113072358 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fc00536a0 0x7f1fc0055b60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f1fcc00d000 tx=0x7f1fcc009040).stop 2021-12-17T18:18:59.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.179+0000 7f1fe1666700 1 -- 172.21.15.62:0/113072358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fdc0b5dd0 msgr2=0x7f1fdc0648b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:59.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.179+0000 7f1fe1666700 1 --2- 172.21.15.62:0/113072358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fdc0b5dd0 0x7f1fdc0648b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f1fdc0b15f0 tx=0x7f1fd4016000).stop 2021-12-17T18:18:59.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.179+0000 7f1fe1666700 1 -- 172.21.15.62:0/113072358 shutdown_connections 2021-12-17T18:18:59.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.179+0000 7f1fe1666700 1 --2- 172.21.15.62:0/113072358 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fc00536a0 0x7f1fc0055b60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:59.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.179+0000 7f1fe1666700 1 --2- 172.21.15.62:0/113072358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fdc0b5dd0 0x7f1fdc0648b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:59.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.179+0000 7f1fe1666700 1 --2- 172.21.15.62:0/113072358 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fdc0b41f0 0x7f1fdc0643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:59.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.179+0000 7f1fe1666700 1 --2- 172.21.15.62:0/113072358 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fdc0b05b0 0x7f1fdc0b8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:59.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.179+0000 7f1fe1666700 1 -- 172.21.15.62:0/113072358 >> 172.21.15.62:0/113072358 conn(0x7f1fdc062510 msgr2=0x7f1fdc142780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:59.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.179+0000 7f1fe1666700 1 -- 172.21.15.62:0/113072358 shutdown_connections 2021-12-17T18:18:59.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.179+0000 7f1fe1666700 1 -- 172.21.15.62:0/113072358 wait complete. 2021-12-17T18:18:59.189 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2021-12-17T18:18:59.199 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-12-17T18:18:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.307+0000 7f8ef1954700 1 Processor -- start 2021-12-17T18:18:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.307+0000 7f8ef1954700 1 -- start start 2021-12-17T18:18:59.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef1954700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f8eec0b05d0 0x7f8eec13f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:59.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef1954700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eec0ac3d0 con 0x7f8eec0abff0 2021-12-17T18:18:59.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef1954700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eec05cea0 con 0x7f8eec05c9b0 2021-12-17T18:18:59.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef1954700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eec0b13e0 con 0x7f8eec0b05d0 2021-12-17T18:18:59.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef0952700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8eec0abff0 0x7f8eec13f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32816/0 (socket says 172.21.15.62:32816) 2021-12-17T18:18:59.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef0952700 1 -- 172.21.15.62:0/387496913 learned_addr learned my addr 172.21.15.62:0/387496913 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:18:59.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef1153700 1 --2- 172.21.15.62:0/387496913 >> v2:172.21.15.109:3300/0 conn(0x7f8eec0b05d0 0x7f8eec13f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:59.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8eeb7fe700 1 -- 172.21.15.62:0/387496913 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272668306 0 0) 0x7f8eec0ac3d0 con 0x7f8eec0abff0 2021-12-17T18:18:59.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8eeb7fe700 1 -- 172.21.15.62:0/387496913 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ed8003260 con 0x7f8eec0abff0 2021-12-17T18:18:59.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef1153700 1 -- 172.21.15.62:0/387496913 >> v1:172.21.15.109:6789/0 conn(0x7f8eec05c9b0 legacy=0x7f8eec0ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:59.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef1153700 1 -- 172.21.15.62:0/387496913 >> v1:172.21.15.62:6789/0 conn(0x7f8eec0abff0 legacy=0x7f8eec13f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:59.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef1153700 1 -- 172.21.15.62:0/387496913 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eec0b0ca0 con 0x7f8eec0b05d0 2021-12-17T18:18:59.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef1153700 1 --2- 172.21.15.62:0/387496913 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8eec0b05d0 0x7f8eec13f8d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f8ee40032f0 tx=0x7f8ee40091d0).ready entity=mon.1 client_cookie=af10d559380cf77d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:59.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8eeb7fe700 1 -- 172.21.15.62:0/387496913 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ee400b6c0 con 0x7f8eec0b05d0 2021-12-17T18:18:59.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8eeb7fe700 1 -- 172.21.15.62:0/387496913 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee400b820 con 0x7f8eec0b05d0 2021-12-17T18:18:59.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8eeb7fe700 1 -- 172.21.15.62:0/387496913 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ee400b990 con 0x7f8eec0b05d0 2021-12-17T18:18:59.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef1954700 1 -- 172.21.15.62:0/387496913 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8eec0b05d0 msgr2=0x7f8eec13f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:59.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef1954700 1 --2- 172.21.15.62:0/387496913 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8eec0b05d0 0x7f8eec13f8d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f8ee40032f0 tx=0x7f8ee40091d0).stop 2021-12-17T18:18:59.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef1954700 1 -- 172.21.15.62:0/387496913 shutdown_connections 2021-12-17T18:18:59.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef1954700 1 --2- 172.21.15.62:0/387496913 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8eec0b05d0 0x7f8eec13f8d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:59.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef1954700 1 -- 172.21.15.62:0/387496913 >> 172.21.15.62:0/387496913 conn(0x7f8eec05be70 msgr2=0x7f8eec062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:18:59.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef1954700 1 -- 172.21.15.62:0/387496913 shutdown_connections 2021-12-17T18:18:59.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.311+0000 7f8ef1954700 1 -- 172.21.15.62:0/387496913 wait complete. 2021-12-17T18:18:59.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1954700 1 Processor -- start 2021-12-17T18:18:59.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1954700 1 -- start start 2021-12-17T18:18:59.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1954700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8eec05c9b0 0x7f8eec063e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:59.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1954700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8eec0abff0 0x7f8eec142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:59.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1954700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8eec0b05d0 0x7f8eec153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:59.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1954700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec13e1b0 con 0x7f8eec0b05d0 2021-12-17T18:18:59.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1954700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec1434b0 con 0x7f8eec0abff0 2021-12-17T18:18:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1954700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec152670 con 0x7f8eec05c9b0 2021-12-17T18:18:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1153700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8eec0b05d0 0x7f8eec153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1153700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8eec0b05d0 0x7f8eec153050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49244/0 (socket says 172.21.15.62:49244) 2021-12-17T18:18:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1153700 1 -- 172.21.15.62:0/1391892085 learned_addr learned my addr 172.21.15.62:0/1391892085 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:18:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef0952700 1 --2- 172.21.15.62:0/1391892085 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8eec05c9b0 0x7f8eec063e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8eebfff700 1 --2- 172.21.15.62:0/1391892085 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8eec0abff0 0x7f8eec142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1153700 1 -- 172.21.15.62:0/1391892085 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8eec05c9b0 msgr2=0x7f8eec063e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1153700 1 --2- 172.21.15.62:0/1391892085 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8eec05c9b0 0x7f8eec063e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1153700 1 -- 172.21.15.62:0/1391892085 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8eec0abff0 msgr2=0x7f8eec142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:18:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1153700 1 --2- 172.21.15.62:0/1391892085 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8eec0abff0 0x7f8eec142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:18:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1153700 1 -- 172.21.15.62:0/1391892085 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee4009470 con 0x7f8eec0b05d0 2021-12-17T18:18:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1153700 1 --2- 172.21.15.62:0/1391892085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8eec0b05d0 0x7f8eec153050 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f8ee40032f0 tx=0x7f8ee4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ee9ffb700 1 -- 172.21.15.62:0/1391892085 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ee400b6c0 con 0x7f8eec0b05d0 2021-12-17T18:18:59.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ee9ffb700 1 -- 172.21.15.62:0/1391892085 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee4021670 con 0x7f8eec0b05d0 2021-12-17T18:18:59.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1954700 1 -- 172.21.15.62:0/1391892085 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eec152910 con 0x7f8eec0b05d0 2021-12-17T18:18:59.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ee9ffb700 1 -- 172.21.15.62:0/1391892085 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ee40219d0 con 0x7f8eec0b05d0 2021-12-17T18:18:59.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.315+0000 7f8ef1954700 1 -- 172.21.15.62:0/1391892085 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eec13c310 con 0x7f8eec0b05d0 2021-12-17T18:18:59.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.319+0000 7f8ee9ffb700 1 -- 172.21.15.62:0/1391892085 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8ee400f070 con 0x7f8eec0b05d0 2021-12-17T18:18:59.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.319+0000 7f8ef1954700 1 -- 172.21.15.62:0/1391892085 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eec0b0f40 con 0x7f8eec0b05d0 2021-12-17T18:18:59.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.319+0000 7f8ee9ffb700 1 --2- 172.21.15.62:0/1391892085 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ecc0536a0 0x7f8ecc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:18:59.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.319+0000 7f8ee9ffb700 1 -- 172.21.15.62:0/1391892085 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f8ee406cba0 con 0x7f8eec0b05d0 2021-12-17T18:18:59.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.319+0000 7f8ef0952700 1 --2- 172.21.15.62:0/1391892085 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ecc0536a0 0x7f8ecc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:18:59.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.319+0000 7f8ef0952700 1 --2- 172.21.15.62:0/1391892085 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ecc0536a0 0x7f8ecc055b60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f8edc00d000 tx=0x7f8edc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:18:59.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.327+0000 7f8ee9ffb700 1 -- 172.21.15.62:0/1391892085 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8ee4043ed0 con 0x7f8eec0b05d0 2021-12-17T18:18:59.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:18:59.451+0000 7f8ef1954700 1 -- 172.21.15.62:0/1391892085 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f8eec0573d0 con 0x7f8eec0b05d0 2021-12-17T18:19:00.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.187+0000 7f8ee9ffb700 1 -- 172.21.15.62:0/1391892085 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v31) v1 ==== 125+0+0 (secure 0 0 0) 0x7f8ee40474f0 con 0x7f8eec0b05d0 2021-12-17T18:19:00.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.195+0000 7f8ef1954700 1 -- 172.21.15.62:0/1391892085 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ecc0536a0 msgr2=0x7f8ecc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.195+0000 7f8ef1954700 1 --2- 172.21.15.62:0/1391892085 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ecc0536a0 0x7f8ecc055b60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f8edc00d000 tx=0x7f8edc009040).stop 2021-12-17T18:19:00.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.195+0000 7f8ef1954700 1 -- 172.21.15.62:0/1391892085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8eec0b05d0 msgr2=0x7f8eec153050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.195+0000 7f8ef1954700 1 --2- 172.21.15.62:0/1391892085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8eec0b05d0 0x7f8eec153050 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f8ee40032f0 tx=0x7f8ee4016000).stop 2021-12-17T18:19:00.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.195+0000 7f8ef1954700 1 -- 172.21.15.62:0/1391892085 shutdown_connections 2021-12-17T18:19:00.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.195+0000 7f8ef1954700 1 --2- 172.21.15.62:0/1391892085 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ecc0536a0 0x7f8ecc055b60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.195+0000 7f8ef1954700 1 --2- 172.21.15.62:0/1391892085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8eec0b05d0 0x7f8eec153050 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.195+0000 7f8ef1954700 1 --2- 172.21.15.62:0/1391892085 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8eec0abff0 0x7f8eec142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.195+0000 7f8ef1954700 1 --2- 172.21.15.62:0/1391892085 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8eec05c9b0 0x7f8eec063e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.195+0000 7f8ef1954700 1 -- 172.21.15.62:0/1391892085 >> 172.21.15.62:0/1391892085 conn(0x7f8eec05be70 msgr2=0x7f8eec138e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:00.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.195+0000 7f8ef1954700 1 -- 172.21.15.62:0/1391892085 shutdown_connections 2021-12-17T18:19:00.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.195+0000 7f8ef1954700 1 -- 172.21.15.62:0/1391892085 wait complete. 2021-12-17T18:19:00.206 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2021-12-17T18:19:00.217 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-12-17T18:19:00.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.319+0000 7f34b4a44700 1 Processor -- start 2021-12-17T18:19:00.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.319+0000 7f34b4a44700 1 -- start start 2021-12-17T18:19:00.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.319+0000 7f34b4a44700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f34b005ca90 0x7f34b00b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:00.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34b4a44700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b005ce70 con 0x7f34b00b34b0 2021-12-17T18:19:00.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34b4a44700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b00b2d70 con 0x7f34b00604b0 2021-12-17T18:19:00.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34b4a44700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b00b3010 con 0x7f34b005ca90 2021-12-17T18:19:00.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34aed9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f34b005ca90 0x7f34b00b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:00.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34ae59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f34b00b34b0 0x7f34b0145b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32828/0 (socket says 172.21.15.62:32828) 2021-12-17T18:19:00.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34ae59c700 1 -- 172.21.15.62:0/3778415527 learned_addr learned my addr 172.21.15.62:0/3778415527 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:19:00.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34add9b700 1 -- 172.21.15.62:0/3778415527 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883656026 0 0) 0x7f34b005ce70 con 0x7f34b00b34b0 2021-12-17T18:19:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34add9b700 1 -- 172.21.15.62:0/3778415527 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3490003260 con 0x7f34b00b34b0 2021-12-17T18:19:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34add9b700 1 -- 172.21.15.62:0/3778415527 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520192695 0 0) 0x7f34b00b2d70 con 0x7f34b00604b0 2021-12-17T18:19:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34add9b700 1 -- 172.21.15.62:0/3778415527 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34b005ce70 con 0x7f34b00604b0 2021-12-17T18:19:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34add9b700 1 -- 172.21.15.62:0/3778415527 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2198086547 0 0) 0x7f3490003260 con 0x7f34b00b34b0 2021-12-17T18:19:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34aed9d700 1 -- 172.21.15.62:0/3778415527 >> v1:172.21.15.109:6789/0 conn(0x7f34b00604b0 legacy=0x7f34b00b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34aed9d700 1 -- 172.21.15.62:0/3778415527 >> v1:172.21.15.62:6789/0 conn(0x7f34b00b34b0 legacy=0x7f34b0145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34aed9d700 1 -- 172.21.15.62:0/3778415527 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b00b2ab0 con 0x7f34b005ca90 2021-12-17T18:19:00.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34aed9d700 1 --2- 172.21.15.62:0/3778415527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b005ca90 0x7f34b00b2470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f34a0001110 tx=0x7f3498006df0).ready entity=mon.0 client_cookie=8722382b12a49396 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:00.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34add9b700 1 -- 172.21.15.62:0/3778415527 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34a0001660 con 0x7f34b005ca90 2021-12-17T18:19:00.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34add9b700 1 -- 172.21.15.62:0/3778415527 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3498000e90 con 0x7f34b005ca90 2021-12-17T18:19:00.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34add9b700 1 -- 172.21.15.62:0/3778415527 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3498012460 con 0x7f34b005ca90 2021-12-17T18:19:00.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34b4a44700 1 -- 172.21.15.62:0/3778415527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b005ca90 msgr2=0x7f34b00b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34b4a44700 1 --2- 172.21.15.62:0/3778415527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b005ca90 0x7f34b00b2470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f34a0001110 tx=0x7f3498006df0).stop 2021-12-17T18:19:00.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34b4a44700 1 -- 172.21.15.62:0/3778415527 shutdown_connections 2021-12-17T18:19:00.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34b4a44700 1 --2- 172.21.15.62:0/3778415527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b005ca90 0x7f34b00b2470 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34b4a44700 1 -- 172.21.15.62:0/3778415527 >> 172.21.15.62:0/3778415527 conn(0x7f34b005bcd0 msgr2=0x7f34b0062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:00.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34b4a44700 1 -- 172.21.15.62:0/3778415527 shutdown_connections 2021-12-17T18:19:00.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34b4a44700 1 -- 172.21.15.62:0/3778415527 wait complete. 2021-12-17T18:19:00.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34b4a44700 1 Processor -- start 2021-12-17T18:19:00.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.323+0000 7f34b4a44700 1 -- start start 2021-12-17T18:19:00.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34b4a44700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f34b005ca90 0x7f34b0066260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:00.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34b4a44700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f34b00604b0 0x7f34b0143b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:00.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34b4a44700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b00b34b0 0x7f34b00a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:00.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34b4a44700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b01557c0 con 0x7f34b00b34b0 2021-12-17T18:19:00.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34b4a44700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b0066890 con 0x7f34b00604b0 2021-12-17T18:19:00.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34b4a44700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b0155a20 con 0x7f34b005ca90 2021-12-17T18:19:00.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34af59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b00b34b0 0x7f34b00a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:00.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34af59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b00b34b0 0x7f34b00a5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49258/0 (socket says 172.21.15.62:49258) 2021-12-17T18:19:00.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34af59e700 1 -- 172.21.15.62:0/828208895 learned_addr learned my addr 172.21.15.62:0/828208895 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:00.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34ae59c700 1 --2- 172.21.15.62:0/828208895 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f34b00604b0 0x7f34b0143b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:00.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34aed9d700 1 --2- 172.21.15.62:0/828208895 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f34b005ca90 0x7f34b0066260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:00.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34af59e700 1 -- 172.21.15.62:0/828208895 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f34b005ca90 msgr2=0x7f34b0066260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34af59e700 1 --2- 172.21.15.62:0/828208895 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f34b005ca90 0x7f34b0066260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34af59e700 1 -- 172.21.15.62:0/828208895 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f34b00604b0 msgr2=0x7f34b0143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34af59e700 1 --2- 172.21.15.62:0/828208895 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f34b00604b0 0x7f34b0143b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34af59e700 1 -- 172.21.15.62:0/828208895 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349800b180 con 0x7f34b00b34b0 2021-12-17T18:19:00.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34ae59c700 1 --2- 172.21.15.62:0/828208895 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f34b00604b0 0x7f34b0143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:19:00.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34af59e700 1 --2- 172.21.15.62:0/828208895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b00b34b0 0x7f34b00a5e40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f34a8001490 tx=0x7f34a8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:00.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34a7fff700 1 -- 172.21.15.62:0/828208895 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34a8002310 con 0x7f34b00b34b0 2021-12-17T18:19:00.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34a7fff700 1 -- 172.21.15.62:0/828208895 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a8002470 con 0x7f34b00b34b0 2021-12-17T18:19:00.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34b4a44700 1 -- 172.21.15.62:0/828208895 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b01521f0 con 0x7f34b00b34b0 2021-12-17T18:19:00.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34a7fff700 1 -- 172.21.15.62:0/828208895 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34a8001840 con 0x7f34b00b34b0 2021-12-17T18:19:00.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34b4a44700 1 -- 172.21.15.62:0/828208895 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b01526c0 con 0x7f34b00b34b0 2021-12-17T18:19:00.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34b4a44700 1 -- 172.21.15.62:0/828208895 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b00b4500 con 0x7f34b00b34b0 2021-12-17T18:19:00.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.327+0000 7f34a7fff700 1 -- 172.21.15.62:0/828208895 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f34a8010030 con 0x7f34b00b34b0 2021-12-17T18:19:00.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.331+0000 7f34a7fff700 1 --2- 172.21.15.62:0/828208895 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3494053610 0x7f3494055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:00.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.331+0000 7f34a7fff700 1 -- 172.21.15.62:0/828208895 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f34a806b900 con 0x7f34b00b34b0 2021-12-17T18:19:00.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.331+0000 7f34aed9d700 1 --2- 172.21.15.62:0/828208895 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3494053610 0x7f3494055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:00.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.331+0000 7f34aed9d700 1 --2- 172.21.15.62:0/828208895 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3494053610 0x7f3494055ad0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f3498018000 tx=0x7f3498014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:00.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.335+0000 7f34a7fff700 1 -- 172.21.15.62:0/828208895 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f34a8042ad0 con 0x7f34b00b34b0 2021-12-17T18:19:00.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.495+0000 7f34b4a44700 1 -- 172.21.15.62:0/828208895 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f34b00573d0 con 0x7f34b00b34b0 2021-12-17T18:19:00.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.507+0000 7f34a7fff700 1 -- 172.21.15.62:0/828208895 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 5 and data pool 6 v9) v1 ==== 187+0+0 (secure 0 0 0) 0x7f34a80460f0 con 0x7f34b00b34b0 2021-12-17T18:19:00.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.511+0000 7f34b4a44700 1 -- 172.21.15.62:0/828208895 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3494053610 msgr2=0x7f3494055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.511+0000 7f34b4a44700 1 --2- 172.21.15.62:0/828208895 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3494053610 0x7f3494055ad0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f3498018000 tx=0x7f3498014000).stop 2021-12-17T18:19:00.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.511+0000 7f34b4a44700 1 -- 172.21.15.62:0/828208895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b00b34b0 msgr2=0x7f34b00a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.511+0000 7f34b4a44700 1 --2- 172.21.15.62:0/828208895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b00b34b0 0x7f34b00a5e40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f34a8001490 tx=0x7f34a8007dd0).stop 2021-12-17T18:19:00.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.511+0000 7f34b4a44700 1 -- 172.21.15.62:0/828208895 shutdown_connections 2021-12-17T18:19:00.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.511+0000 7f34b4a44700 1 --2- 172.21.15.62:0/828208895 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3494053610 0x7f3494055ad0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.511+0000 7f34b4a44700 1 --2- 172.21.15.62:0/828208895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b00b34b0 0x7f34b00a5e40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.511+0000 7f34b4a44700 1 --2- 172.21.15.62:0/828208895 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f34b00604b0 0x7f34b0143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.511+0000 7f34b4a44700 1 --2- 172.21.15.62:0/828208895 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f34b005ca90 0x7f34b0066260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.511+0000 7f34b4a44700 1 -- 172.21.15.62:0/828208895 >> 172.21.15.62:0/828208895 conn(0x7f34b005bcd0 msgr2=0x7f34b0144540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:00.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.511+0000 7f34b4a44700 1 -- 172.21.15.62:0/828208895 shutdown_connections 2021-12-17T18:19:00.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.511+0000 7f34b4a44700 1 -- 172.21.15.62:0/828208895 wait complete. 2021-12-17T18:19:00.520 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 5 and data pool 6 2021-12-17T18:19:00.533 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:19:00.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495ed5d700 1 Processor -- start 2021-12-17T18:19:00.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495ed5d700 1 -- start start 2021-12-17T18:19:00.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495ed5d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49580b3a40 0x7f49580b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:00.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495ed5d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f49580b07d0 0x7f49581432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:00.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495ed5d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f4958067870 0x7f49581437b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:00.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495ed5d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49580b3e20 con 0x7f49580b07d0 2021-12-17T18:19:00.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495ed5d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49580af900 con 0x7f4958067870 2021-12-17T18:19:00.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495ed5d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49580afba0 con 0x7f49580b3a40 2021-12-17T18:19:00.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495d55a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f49580b07d0 0x7f49581432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495d55a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f49580b07d0 0x7f49581432c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49264/0 (socket says 172.21.15.62:49264) 2021-12-17T18:19:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495d55a700 1 -- 172.21.15.62:0/2301612893 learned_addr learned my addr 172.21.15.62:0/2301612893 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495e55c700 1 --2- 172.21.15.62:0/2301612893 >> v2:172.21.15.109:3300/0 conn(0x7f4958067870 0x7f49581437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495dd5b700 1 --2- 172.21.15.62:0/2301612893 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49580b3a40 0x7f49580b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:00.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495d55a700 1 -- 172.21.15.62:0/2301612893 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49580b3a40 msgr2=0x7f49580b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:00.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495d55a700 1 --2- 172.21.15.62:0/2301612893 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49580b3a40 0x7f49580b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495d55a700 1 -- 172.21.15.62:0/2301612893 >> v2:172.21.15.109:3300/0 conn(0x7f4958067870 msgr2=0x7f49581437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:00.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495d55a700 1 --2- 172.21.15.62:0/2301612893 >> v2:172.21.15.109:3300/0 conn(0x7f4958067870 0x7f49581437b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495d55a700 1 -- 172.21.15.62:0/2301612893 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49580afe40 con 0x7f49580b07d0 2021-12-17T18:19:00.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495d55a700 1 --2- 172.21.15.62:0/2301612893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49580b07d0 0x7f49581432c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f494c0032f0 tx=0x7f494c009290).ready entity=mon.0 client_cookie=589bd5afdb66365d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:00.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495cd59700 1 -- 172.21.15.62:0/2301612893 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f494c00f8a0 con 0x7f49580b07d0 2021-12-17T18:19:00.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495cd59700 1 -- 172.21.15.62:0/2301612893 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494c00fa00 con 0x7f49580b07d0 2021-12-17T18:19:00.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.619+0000 7f495cd59700 1 -- 172.21.15.62:0/2301612893 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f494c00fd60 con 0x7f49580b07d0 2021-12-17T18:19:00.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495ed5d700 1 -- 172.21.15.62:0/2301612893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49580b07d0 msgr2=0x7f49581432c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495ed5d700 1 --2- 172.21.15.62:0/2301612893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49580b07d0 0x7f49581432c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f494c0032f0 tx=0x7f494c009290).stop 2021-12-17T18:19:00.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495ed5d700 1 -- 172.21.15.62:0/2301612893 shutdown_connections 2021-12-17T18:19:00.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495ed5d700 1 --2- 172.21.15.62:0/2301612893 >> v2:172.21.15.109:3300/0 conn(0x7f4958067870 0x7f49581437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495ed5d700 1 --2- 172.21.15.62:0/2301612893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49580b07d0 0x7f49581432c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495ed5d700 1 --2- 172.21.15.62:0/2301612893 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f49580b3a40 0x7f49580b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495ed5d700 1 -- 172.21.15.62:0/2301612893 >> 172.21.15.62:0/2301612893 conn(0x7f49580b7020 msgr2=0x7f49580b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:00.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495ed5d700 1 -- 172.21.15.62:0/2301612893 shutdown_connections 2021-12-17T18:19:00.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495ed5d700 1 -- 172.21.15.62:0/2301612893 wait complete. 2021-12-17T18:19:00.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495ed5d700 1 Processor -- start 2021-12-17T18:19:00.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495ed5d700 1 -- start start 2021-12-17T18:19:00.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495ed5d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4958067870 0x7f495810f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:00.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495ed5d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f49580b07d0 0x7f495813bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:00.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495ed5d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49580b3a40 0x7f495813c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:00.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495ed5d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49581104c0 con 0x7f49580b3a40 2021-12-17T18:19:00.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495ed5d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4958064480 con 0x7f49580b07d0 2021-12-17T18:19:00.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495ed5d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4958110220 con 0x7f4958067870 2021-12-17T18:19:00.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495e55c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49580b3a40 0x7f495813c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:00.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495e55c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49580b3a40 0x7f495813c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49272/0 (socket says 172.21.15.62:49272) 2021-12-17T18:19:00.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495e55c700 1 -- 172.21.15.62:0/2683125571 learned_addr learned my addr 172.21.15.62:0/2683125571 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:00.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495dd5b700 1 --2- 172.21.15.62:0/2683125571 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4958067870 0x7f495810f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:00.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.623+0000 7f495d55a700 1 --2- 172.21.15.62:0/2683125571 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f49580b07d0 0x7f495813bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:00.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.627+0000 7f495e55c700 1 -- 172.21.15.62:0/2683125571 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4958067870 msgr2=0x7f495810f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.627+0000 7f495e55c700 1 --2- 172.21.15.62:0/2683125571 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4958067870 0x7f495810f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.627+0000 7f495e55c700 1 -- 172.21.15.62:0/2683125571 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f49580b07d0 msgr2=0x7f495813bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.627+0000 7f495e55c700 1 --2- 172.21.15.62:0/2683125571 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f49580b07d0 0x7f495813bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.627+0000 7f495e55c700 1 -- 172.21.15.62:0/2683125571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c009530 con 0x7f49580b3a40 2021-12-17T18:19:00.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.627+0000 7f495e55c700 1 --2- 172.21.15.62:0/2683125571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49580b3a40 0x7f495813c200 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f495000c000 tx=0x7f4950006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:00.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.627+0000 7f494affd700 1 -- 172.21.15.62:0/2683125571 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4950010780 con 0x7f49580b3a40 2021-12-17T18:19:00.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.627+0000 7f494affd700 1 -- 172.21.15.62:0/2683125571 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49500108e0 con 0x7f49580b3a40 2021-12-17T18:19:00.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.627+0000 7f495ed5d700 1 -- 172.21.15.62:0/2683125571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f495813c6f0 con 0x7f49580b3a40 2021-12-17T18:19:00.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.627+0000 7f494affd700 1 -- 172.21.15.62:0/2683125571 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4950010c40 con 0x7f49580b3a40 2021-12-17T18:19:00.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.627+0000 7f495ed5d700 1 -- 172.21.15.62:0/2683125571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4958064170 con 0x7f49580b3a40 2021-12-17T18:19:00.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.627+0000 7f495ed5d700 1 -- 172.21.15.62:0/2683125571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4958110050 con 0x7f49580b3a40 2021-12-17T18:19:00.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.627+0000 7f494affd700 1 -- 172.21.15.62:0/2683125571 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f495001c460 con 0x7f49580b3a40 2021-12-17T18:19:00.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.627+0000 7f494affd700 1 --2- 172.21.15.62:0/2683125571 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4938053610 0x7f4938055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:00.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.627+0000 7f494affd700 1 -- 172.21.15.62:0/2683125571 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f495006bd90 con 0x7f49580b3a40 2021-12-17T18:19:00.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.631+0000 7f495dd5b700 1 --2- 172.21.15.62:0/2683125571 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4938053610 0x7f4938055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:00.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.631+0000 7f495dd5b700 1 --2- 172.21.15.62:0/2683125571 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4938053610 0x7f4938055ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f495400b000 tx=0x7f4954006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:00.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.635+0000 7f494affd700 1 -- 172.21.15.62:0/2683125571 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4950042e90 con 0x7f49580b3a40 2021-12-17T18:19:00.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.755+0000 7f495ed5d700 1 -- 172.21.15.62:0/2683125571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49580ad740 con 0x7f49580b3a40 2021-12-17T18:19:00.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.759+0000 7f494affd700 1 -- 172.21.15.62:0/2683125571 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16099 (secure 0 0 0) 0x7f49500464b0 con 0x7f49580b3a40 2021-12-17T18:19:00.765 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:19:00.765 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":32,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:19:00.503106+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:58.549405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:59.508046+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:19:00.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.759+0000 7f495ed5d700 1 -- 172.21.15.62:0/2683125571 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4938053610 msgr2=0x7f4938055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.759+0000 7f495ed5d700 1 --2- 172.21.15.62:0/2683125571 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4938053610 0x7f4938055ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f495400b000 tx=0x7f4954006df0).stop 2021-12-17T18:19:00.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.759+0000 7f495ed5d700 1 -- 172.21.15.62:0/2683125571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49580b3a40 msgr2=0x7f495813c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.759+0000 7f495ed5d700 1 --2- 172.21.15.62:0/2683125571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49580b3a40 0x7f495813c200 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f495000c000 tx=0x7f4950006df0).stop 2021-12-17T18:19:00.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.759+0000 7f495ed5d700 1 -- 172.21.15.62:0/2683125571 shutdown_connections 2021-12-17T18:19:00.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.759+0000 7f495ed5d700 1 --2- 172.21.15.62:0/2683125571 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4938053610 0x7f4938055ad0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.759+0000 7f495ed5d700 1 --2- 172.21.15.62:0/2683125571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49580b3a40 0x7f495813c200 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.759+0000 7f495ed5d700 1 --2- 172.21.15.62:0/2683125571 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f49580b07d0 0x7f495813bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.759+0000 7f495ed5d700 1 --2- 172.21.15.62:0/2683125571 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4958067870 0x7f495810f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.759+0000 7f495ed5d700 1 -- 172.21.15.62:0/2683125571 >> 172.21.15.62:0/2683125571 conn(0x7f49580b7020 msgr2=0x7f495813e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:00.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.759+0000 7f495ed5d700 1 -- 172.21.15.62:0/2683125571 shutdown_connections 2021-12-17T18:19:00.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.759+0000 7f495ed5d700 1 -- 172.21.15.62:0/2683125571 wait complete. 2021-12-17T18:19:00.778 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:19:00.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f9a216700 1 Processor -- start 2021-12-17T18:19:00.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f9a216700 1 -- start start 2021-12-17T18:19:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f9a216700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4f940b3760 0x7f4f940b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f9a216700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f940b5f00 con 0x7f4f940b5b20 2021-12-17T18:19:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f9a216700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f940b3020 con 0x7f4f941458d0 2021-12-17T18:19:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f9a216700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f940b32c0 con 0x7f4f940b3760 2021-12-17T18:19:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f99214700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4f940b5b20 0x7f4f940b6290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32856/0 (socket says 172.21.15.62:32856) 2021-12-17T18:19:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f99214700 1 -- 172.21.15.62:0/293872139 learned_addr learned my addr 172.21.15.62:0/293872139 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:19:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f98a13700 1 --2- 172.21.15.62:0/293872139 >> v2:172.21.15.62:3300/0 conn(0x7f4f940b3760 0x7f4f940b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f93fff700 1 -- 172.21.15.62:0/293872139 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424817615 0 0) 0x7f4f940b5f00 con 0x7f4f940b5b20 2021-12-17T18:19:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f93fff700 1 -- 172.21.15.62:0/293872139 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f74003260 con 0x7f4f940b5b20 2021-12-17T18:19:00.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f98a13700 1 -- 172.21.15.62:0/293872139 >> v1:172.21.15.109:6789/0 conn(0x7f4f941458d0 legacy=0x7f4f94145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f98a13700 1 -- 172.21.15.62:0/293872139 >> v1:172.21.15.62:6789/0 conn(0x7f4f940b5b20 legacy=0x7f4f940b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f98a13700 1 -- 172.21.15.62:0/293872139 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f940b6e90 con 0x7f4f940b3760 2021-12-17T18:19:00.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f98a13700 1 --2- 172.21.15.62:0/293872139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f940b3760 0x7f4f940b69a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f4f84002f70 tx=0x7f4f84006df0).ready entity=mon.0 client_cookie=b738c03f00cd28e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f93fff700 1 -- 172.21.15.62:0/293872139 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f8400d610 con 0x7f4f940b3760 2021-12-17T18:19:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f93fff700 1 -- 172.21.15.62:0/293872139 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f84000e90 con 0x7f4f940b3760 2021-12-17T18:19:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f93fff700 1 -- 172.21.15.62:0/293872139 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f8400d960 con 0x7f4f940b3760 2021-12-17T18:19:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f9a216700 1 -- 172.21.15.62:0/293872139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f940b3760 msgr2=0x7f4f940b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f9a216700 1 --2- 172.21.15.62:0/293872139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f940b3760 0x7f4f940b69a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f4f84002f70 tx=0x7f4f84006df0).stop 2021-12-17T18:19:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f9a216700 1 -- 172.21.15.62:0/293872139 shutdown_connections 2021-12-17T18:19:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f9a216700 1 --2- 172.21.15.62:0/293872139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f940b3760 0x7f4f940b69a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f9a216700 1 -- 172.21.15.62:0/293872139 >> 172.21.15.62:0/293872139 conn(0x7f4f9405c750 msgr2=0x7f4f9405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.879+0000 7f4f9a216700 1 -- 172.21.15.62:0/293872139 shutdown_connections 2021-12-17T18:19:00.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f9a216700 1 -- 172.21.15.62:0/293872139 wait complete. 2021-12-17T18:19:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f9a216700 1 Processor -- start 2021-12-17T18:19:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f9a216700 1 -- start start 2021-12-17T18:19:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f9a216700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f940b5b20 0x7f4f940b8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f9a216700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f941458d0 0x7f4f94063e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f9a216700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f94148a30 0x7f4f941526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f9a216700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f94149270 con 0x7f4f941458d0 2021-12-17T18:19:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f9a216700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f94147d40 con 0x7f4f94148a30 2021-12-17T18:19:00.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f9a216700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f94063740 con 0x7f4f940b5b20 2021-12-17T18:19:00.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f98a13700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f941458d0 0x7f4f94063e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:00.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f99214700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f940b5b20 0x7f4f940b8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:00.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f98a13700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f941458d0 0x7f4f94063e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49284/0 (socket says 172.21.15.62:49284) 2021-12-17T18:19:00.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f98a13700 1 -- 172.21.15.62:0/3735776863 learned_addr learned my addr 172.21.15.62:0/3735776863 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:00.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f99a15700 1 --2- 172.21.15.62:0/3735776863 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f94148a30 0x7f4f941526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:00.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f99214700 1 -- 172.21.15.62:0/3735776863 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f94148a30 msgr2=0x7f4f941526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f99214700 1 --2- 172.21.15.62:0/3735776863 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f94148a30 0x7f4f941526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f99214700 1 -- 172.21.15.62:0/3735776863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f941458d0 msgr2=0x7f4f94063e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:00.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f99214700 1 --2- 172.21.15.62:0/3735776863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f941458d0 0x7f4f94063e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:00.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f99214700 1 -- 172.21.15.62:0/3735776863 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8400b180 con 0x7f4f940b5b20 2021-12-17T18:19:00.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f98a13700 1 --2- 172.21.15.62:0/3735776863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f941458d0 0x7f4f94063e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:19:00.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f99214700 1 --2- 172.21.15.62:0/3735776863 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f940b5b20 0x7f4f940b8b50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f4f940b9d30 tx=0x7f4f7c007da0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:00.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.883+0000 7f4f927fc700 1 -- 172.21.15.62:0/3735776863 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f7c005c70 con 0x7f4f940b5b20 2021-12-17T18:19:00.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.887+0000 7f4f927fc700 1 -- 172.21.15.62:0/3735776863 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7c005dd0 con 0x7f4f940b5b20 2021-12-17T18:19:00.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.887+0000 7f4f9a216700 1 -- 172.21.15.62:0/3735776863 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f940639e0 con 0x7f4f940b5b20 2021-12-17T18:19:00.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.887+0000 7f4f927fc700 1 -- 172.21.15.62:0/3735776863 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f7c0072c0 con 0x7f4f940b5b20 2021-12-17T18:19:00.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.887+0000 7f4f9a216700 1 -- 172.21.15.62:0/3735776863 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f941479c0 con 0x7f4f940b5b20 2021-12-17T18:19:00.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.887+0000 7f4f9a216700 1 -- 172.21.15.62:0/3735776863 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f940573d0 con 0x7f4f940b5b20 2021-12-17T18:19:00.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.887+0000 7f4f927fc700 1 -- 172.21.15.62:0/3735776863 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4f7c01a060 con 0x7f4f940b5b20 2021-12-17T18:19:00.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.887+0000 7f4f927fc700 1 --2- 172.21.15.62:0/3735776863 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f78053640 0x7f4f78055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:00.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.887+0000 7f4f927fc700 1 -- 172.21.15.62:0/3735776863 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4f7c06b3b0 con 0x7f4f940b5b20 2021-12-17T18:19:00.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.887+0000 7f4f98a13700 1 --2- 172.21.15.62:0/3735776863 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f78053640 0x7f4f78055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:00.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.891+0000 7f4f98a13700 1 --2- 172.21.15.62:0/3735776863 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f78053640 0x7f4f78055b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f4f8401a000 tx=0x7f4f84014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:00.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:00.899+0000 7f4f927fc700 1 -- 172.21.15.62:0/3735776863 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4f7c042400 con 0x7f4f940b5b20 2021-12-17T18:19:01.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.027+0000 7f4f9a216700 1 -- 172.21.15.62:0/3735776863 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f94068f30 con 0x7f4f940b5b20 2021-12-17T18:19:01.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.027+0000 7f4f927fc700 1 -- 172.21.15.62:0/3735776863 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16099 (secure 0 0 0) 0x7f4f7c018070 con 0x7f4f940b5b20 2021-12-17T18:19:01.036 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:19:01.036 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":32,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:19:00.503106+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:58.549405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:59.508046+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:19:01.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.031+0000 7f4f9a216700 1 -- 172.21.15.62:0/3735776863 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f78053640 msgr2=0x7f4f78055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.031+0000 7f4f9a216700 1 --2- 172.21.15.62:0/3735776863 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f78053640 0x7f4f78055b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f4f8401a000 tx=0x7f4f84014000).stop 2021-12-17T18:19:01.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.031+0000 7f4f9a216700 1 -- 172.21.15.62:0/3735776863 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f940b5b20 msgr2=0x7f4f940b8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.031+0000 7f4f9a216700 1 --2- 172.21.15.62:0/3735776863 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f940b5b20 0x7f4f940b8b50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f4f940b9d30 tx=0x7f4f7c007da0).stop 2021-12-17T18:19:01.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.031+0000 7f4f9a216700 1 -- 172.21.15.62:0/3735776863 shutdown_connections 2021-12-17T18:19:01.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.031+0000 7f4f9a216700 1 --2- 172.21.15.62:0/3735776863 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f78053640 0x7f4f78055b00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.031+0000 7f4f9a216700 1 --2- 172.21.15.62:0/3735776863 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f94148a30 0x7f4f941526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.031+0000 7f4f9a216700 1 --2- 172.21.15.62:0/3735776863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f941458d0 0x7f4f94063e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.031+0000 7f4f9a216700 1 --2- 172.21.15.62:0/3735776863 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f940b5b20 0x7f4f940b8b50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.031+0000 7f4f9a216700 1 -- 172.21.15.62:0/3735776863 >> 172.21.15.62:0/3735776863 conn(0x7f4f9405c750 msgr2=0x7f4f9405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:01.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.031+0000 7f4f9a216700 1 -- 172.21.15.62:0/3735776863 shutdown_connections 2021-12-17T18:19:01.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.031+0000 7f4f9a216700 1 -- 172.21.15.62:0/3735776863 wait complete. 2021-12-17T18:19:01.048 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-12-17T18:19:01.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.155+0000 7ff05a07a700 1 Processor -- start 2021-12-17T18:19:01.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.155+0000 7ff05a07a700 1 -- start start 2021-12-17T18:19:01.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.155+0000 7ff05a07a700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff054143720 0x7ff054149e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:01.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.155+0000 7ff05a07a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0540b2110 con 0x7ff0540b6400 2021-12-17T18:19:01.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.155+0000 7ff05a07a700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0540b00f0 con 0x7ff0540b67e0 2021-12-17T18:19:01.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.155+0000 7ff05a07a700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0540ae980 con 0x7ff054143720 2021-12-17T18:19:01.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.155+0000 7ff0537fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff0540b6400 0x7ff0540af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32870/0 (socket says 172.21.15.62:32870) 2021-12-17T18:19:01.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.155+0000 7ff0537fe700 1 -- 172.21.15.62:0/681747382 learned_addr learned my addr 172.21.15.62:0/681747382 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:19:01.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.155+0000 7ff053fff700 1 --2- 172.21.15.62:0/681747382 >> v2:172.21.15.109:3300/0 conn(0x7ff054143720 0x7ff054149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:01.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff0527fc700 1 -- 172.21.15.62:0/681747382 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596217098 0 0) 0x7ff0540b2110 con 0x7ff0540b6400 2021-12-17T18:19:01.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff0527fc700 1 -- 172.21.15.62:0/681747382 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff040004370 con 0x7ff0540b6400 2021-12-17T18:19:01.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff053fff700 1 -- 172.21.15.62:0/681747382 >> v1:172.21.15.109:6789/0 conn(0x7ff0540b67e0 legacy=0x7ff054143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff053fff700 1 -- 172.21.15.62:0/681747382 >> v1:172.21.15.62:6789/0 conn(0x7ff0540b6400 legacy=0x7ff0540af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff053fff700 1 -- 172.21.15.62:0/681747382 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0540b0390 con 0x7ff054143720 2021-12-17T18:19:01.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff053fff700 1 --2- 172.21.15.62:0/681747382 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff054143720 0x7ff054149e70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ff04c0032f0 tx=0x7ff04c0091d0).ready entity=mon.1 client_cookie=72feac670fd848f9 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:01.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff0527fc700 1 -- 172.21.15.62:0/681747382 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff04c00b8b0 con 0x7ff054143720 2021-12-17T18:19:01.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff0527fc700 1 -- 172.21.15.62:0/681747382 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c00ba10 con 0x7ff054143720 2021-12-17T18:19:01.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff0527fc700 1 -- 172.21.15.62:0/681747382 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff04c00bd70 con 0x7ff054143720 2021-12-17T18:19:01.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff05a07a700 1 -- 172.21.15.62:0/681747382 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff054143720 msgr2=0x7ff054149e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff05a07a700 1 --2- 172.21.15.62:0/681747382 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff054143720 0x7ff054149e70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ff04c0032f0 tx=0x7ff04c0091d0).stop 2021-12-17T18:19:01.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff05a07a700 1 -- 172.21.15.62:0/681747382 shutdown_connections 2021-12-17T18:19:01.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff05a07a700 1 --2- 172.21.15.62:0/681747382 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff054143720 0x7ff054149e70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff05a07a700 1 -- 172.21.15.62:0/681747382 >> 172.21.15.62:0/681747382 conn(0x7ff05405c8f0 msgr2=0x7ff0540b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:01.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff05a07a700 1 -- 172.21.15.62:0/681747382 shutdown_connections 2021-12-17T18:19:01.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff05a07a700 1 -- 172.21.15.62:0/681747382 wait complete. 2021-12-17T18:19:01.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff05a07a700 1 Processor -- start 2021-12-17T18:19:01.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.159+0000 7ff05a07a700 1 -- start start 2021-12-17T18:19:01.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff05a07a700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0540b6400 0x7ff054065d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:01.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff05a07a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0540b67e0 0x7ff0540a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:01.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff05a07a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff054143720 0x7ff0540a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:01.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff05a07a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0540a4770 con 0x7ff054143720 2021-12-17T18:19:01.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff05a07a700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0540a49a0 con 0x7ff0540b6400 2021-12-17T18:19:01.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff05a07a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0540a4c40 con 0x7ff0540b67e0 2021-12-17T18:19:01.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff053fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff054143720 0x7ff0540a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:01.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff053fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff054143720 0x7ff0540a2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49298/0 (socket says 172.21.15.62:49298) 2021-12-17T18:19:01.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff053fff700 1 -- 172.21.15.62:0/3169954463 learned_addr learned my addr 172.21.15.62:0/3169954463 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:01.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff0537fe700 1 --2- 172.21.15.62:0/3169954463 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0540b6400 0x7ff054065d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:01.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff052ffd700 1 --2- 172.21.15.62:0/3169954463 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0540b67e0 0x7ff0540a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:01.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff053fff700 1 -- 172.21.15.62:0/3169954463 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0540b67e0 msgr2=0x7ff0540a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff053fff700 1 --2- 172.21.15.62:0/3169954463 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0540b67e0 0x7ff0540a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff053fff700 1 -- 172.21.15.62:0/3169954463 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0540b6400 msgr2=0x7ff054065d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff053fff700 1 --2- 172.21.15.62:0/3169954463 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0540b6400 0x7ff054065d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff053fff700 1 -- 172.21.15.62:0/3169954463 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c009470 con 0x7ff054143720 2021-12-17T18:19:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff052ffd700 1 --2- 172.21.15.62:0/3169954463 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0540b67e0 0x7ff0540a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:19:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff053fff700 1 --2- 172.21.15.62:0/3169954463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff054143720 0x7ff0540a2de0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7ff04c0032f0 tx=0x7ff04c018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff050ff9700 1 -- 172.21.15.62:0/3169954463 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff04c01d070 con 0x7ff054143720 2021-12-17T18:19:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff050ff9700 1 -- 172.21.15.62:0/3169954463 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c022420 con 0x7ff054143720 2021-12-17T18:19:01.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff05a07a700 1 -- 172.21.15.62:0/3169954463 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0540657b0 con 0x7ff054143720 2021-12-17T18:19:01.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff050ff9700 1 -- 172.21.15.62:0/3169954463 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff04c022780 con 0x7ff054143720 2021-12-17T18:19:01.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.163+0000 7ff05a07a700 1 -- 172.21.15.62:0/3169954463 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0540a34f0 con 0x7ff054143720 2021-12-17T18:19:01.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.167+0000 7ff050ff9700 1 -- 172.21.15.62:0/3169954463 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff04c0228e0 con 0x7ff054143720 2021-12-17T18:19:01.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.167+0000 7ff05a07a700 1 -- 172.21.15.62:0/3169954463 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0540573d0 con 0x7ff054143720 2021-12-17T18:19:01.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.167+0000 7ff050ff9700 1 --2- 172.21.15.62:0/3169954463 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff034053640 0x7ff034055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:01.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.167+0000 7ff050ff9700 1 -- 172.21.15.62:0/3169954463 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff04c06d480 con 0x7ff054143720 2021-12-17T18:19:01.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.167+0000 7ff0537fe700 1 --2- 172.21.15.62:0/3169954463 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff034053640 0x7ff034055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:01.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.167+0000 7ff0537fe700 1 --2- 172.21.15.62:0/3169954463 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff034053640 0x7ff034055b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7ff04400d000 tx=0x7ff044009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:01.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.171+0000 7ff050ff9700 1 -- 172.21.15.62:0/3169954463 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff04c0444d0 con 0x7ff054143720 2021-12-17T18:19:01.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.335+0000 7ff05a07a700 1 -- 172.21.15.62:0/3169954463 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff0540630c0 con 0x7ff054143720 2021-12-17T18:19:01.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.507+0000 7ff050ff9700 1 -- 172.21.15.62:0/3169954463 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v10) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff04c027020 con 0x7ff054143720 2021-12-17T18:19:01.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.511+0000 7ff05a07a700 1 -- 172.21.15.62:0/3169954463 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff034053640 msgr2=0x7ff034055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.511+0000 7ff05a07a700 1 --2- 172.21.15.62:0/3169954463 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff034053640 0x7ff034055b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7ff04400d000 tx=0x7ff044009040).stop 2021-12-17T18:19:01.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.511+0000 7ff05a07a700 1 -- 172.21.15.62:0/3169954463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff054143720 msgr2=0x7ff0540a2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.511+0000 7ff05a07a700 1 --2- 172.21.15.62:0/3169954463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff054143720 0x7ff0540a2de0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7ff04c0032f0 tx=0x7ff04c018000).stop 2021-12-17T18:19:01.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.511+0000 7ff05a07a700 1 -- 172.21.15.62:0/3169954463 shutdown_connections 2021-12-17T18:19:01.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.511+0000 7ff05a07a700 1 --2- 172.21.15.62:0/3169954463 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff034053640 0x7ff034055b00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.511+0000 7ff05a07a700 1 --2- 172.21.15.62:0/3169954463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff054143720 0x7ff0540a2de0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.511+0000 7ff05a07a700 1 --2- 172.21.15.62:0/3169954463 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0540b67e0 0x7ff0540a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.511+0000 7ff05a07a700 1 --2- 172.21.15.62:0/3169954463 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0540b6400 0x7ff054065d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.511+0000 7ff05a07a700 1 -- 172.21.15.62:0/3169954463 >> 172.21.15.62:0/3169954463 conn(0x7ff05405c8f0 msgr2=0x7ff05405bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:01.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.511+0000 7ff05a07a700 1 -- 172.21.15.62:0/3169954463 shutdown_connections 2021-12-17T18:19:01.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.511+0000 7ff05a07a700 1 -- 172.21.15.62:0/3169954463 wait complete. 2021-12-17T18:19:01.534 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:19:01.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.635+0000 7f7c7a003700 1 Processor -- start 2021-12-17T18:19:01.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.635+0000 7f7c7a003700 1 -- start start 2021-12-17T18:19:01.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.635+0000 7f7c7a003700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c7413fb60 0x7f7c740afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:01.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.635+0000 7f7c7a003700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c740b1540 con 0x7f7c740b6060 2021-12-17T18:19:01.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.635+0000 7f7c7a003700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7413ffd0 con 0x7f7c740b5c80 2021-12-17T18:19:01.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.635+0000 7f7c7a003700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74143990 con 0x7f7c7413fb60 2021-12-17T18:19:01.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.635+0000 7f7c78800700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7c740b6060 0x7f7c74143280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32884/0 (socket says 172.21.15.62:32884) 2021-12-17T18:19:01.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.635+0000 7f7c78800700 1 -- 172.21.15.62:0/2758391356 learned_addr learned my addr 172.21.15.62:0/2758391356 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:19:01.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.635+0000 7f7c79802700 1 --2- 172.21.15.62:0/2758391356 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c7413fb60 0x7f7c740afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:01.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.635+0000 7f7c6bfff700 1 -- 172.21.15.62:0/2758391356 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206127160 0 0) 0x7f7c740b1540 con 0x7f7c740b6060 2021-12-17T18:19:01.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.635+0000 7f7c6bfff700 1 -- 172.21.15.62:0/2758391356 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c58003260 con 0x7f7c740b6060 2021-12-17T18:19:01.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.635+0000 7f7c6bfff700 1 -- 172.21.15.62:0/2758391356 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888932065 0 0) 0x7f7c64001110 con 0x7f7c740b5c80 2021-12-17T18:19:01.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.635+0000 7f7c6bfff700 1 -- 172.21.15.62:0/2758391356 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c740b1540 con 0x7f7c740b5c80 2021-12-17T18:19:01.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.635+0000 7f7c79802700 1 -- 172.21.15.62:0/2758391356 >> v1:172.21.15.109:6789/0 conn(0x7f7c740b5c80 legacy=0x7f7c74142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.635+0000 7f7c6bfff700 1 -- 172.21.15.62:0/2758391356 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2126191343 0 0) 0x7f7c58003260 con 0x7f7c740b6060 2021-12-17T18:19:01.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.635+0000 7f7c79802700 1 -- 172.21.15.62:0/2758391356 >> v1:172.21.15.62:6789/0 conn(0x7f7c740b6060 legacy=0x7f7c74143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.635+0000 7f7c79802700 1 -- 172.21.15.62:0/2758391356 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c740af5b0 con 0x7f7c7413fb60 2021-12-17T18:19:01.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c79802700 1 --2- 172.21.15.62:0/2758391356 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c7413fb60 0x7f7c740afcf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7c70001110 tx=0x7f7c6c00a370).ready entity=mon.2 client_cookie=2f76265e2dc9e527 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:01.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c6bfff700 1 -- 172.21.15.62:0/2758391356 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c70001660 con 0x7f7c7413fb60 2021-12-17T18:19:01.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c6bfff700 1 -- 172.21.15.62:0/2758391356 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c00c870 con 0x7f7c7413fb60 2021-12-17T18:19:01.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c6bfff700 1 -- 172.21.15.62:0/2758391356 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c6c00cbd0 con 0x7f7c7413fb60 2021-12-17T18:19:01.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c7a003700 1 -- 172.21.15.62:0/2758391356 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c7413fb60 msgr2=0x7f7c740afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c7a003700 1 --2- 172.21.15.62:0/2758391356 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c7413fb60 0x7f7c740afcf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7c70001110 tx=0x7f7c6c00a370).stop 2021-12-17T18:19:01.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c7a003700 1 -- 172.21.15.62:0/2758391356 shutdown_connections 2021-12-17T18:19:01.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c7a003700 1 --2- 172.21.15.62:0/2758391356 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c7413fb60 0x7f7c740afcf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c7a003700 1 -- 172.21.15.62:0/2758391356 >> 172.21.15.62:0/2758391356 conn(0x7f7c7405c750 msgr2=0x7f7c7405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:01.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c7a003700 1 -- 172.21.15.62:0/2758391356 shutdown_connections 2021-12-17T18:19:01.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c7a003700 1 -- 172.21.15.62:0/2758391356 wait complete. 2021-12-17T18:19:01.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c7a003700 1 Processor -- start 2021-12-17T18:19:01.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c7a003700 1 -- start start 2021-12-17T18:19:01.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c7a003700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c740b5c80 0x7f7c7413d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:01.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c7a003700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7c740b6060 0x7f7c74144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:01.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c7a003700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c7413fb60 0x7f7c740a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:01.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c7a003700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74067520 con 0x7f7c740b5c80 2021-12-17T18:19:01.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c7a003700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74065610 con 0x7f7c740b6060 2021-12-17T18:19:01.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c7a003700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7409fe50 con 0x7f7c7413fb60 2021-12-17T18:19:01.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c79001700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c740b5c80 0x7f7c7413d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:01.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.639+0000 7f7c79001700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c740b5c80 0x7f7c7413d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49310/0 (socket says 172.21.15.62:49310) 2021-12-17T18:19:01.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.643+0000 7f7c78800700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7c740b6060 0x7f7c74144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:01.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.643+0000 7f7c79001700 1 -- 172.21.15.62:0/50591789 learned_addr learned my addr 172.21.15.62:0/50591789 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:01.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.643+0000 7f7c79802700 1 --2- 172.21.15.62:0/50591789 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c7413fb60 0x7f7c740a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:01.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.643+0000 7f7c79001700 1 -- 172.21.15.62:0/50591789 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c7413fb60 msgr2=0x7f7c740a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.643+0000 7f7c79001700 1 --2- 172.21.15.62:0/50591789 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c7413fb60 0x7f7c740a02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.643+0000 7f7c79001700 1 -- 172.21.15.62:0/50591789 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7c740b6060 msgr2=0x7f7c74144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.643+0000 7f7c79001700 1 --2- 172.21.15.62:0/50591789 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7c740b6060 0x7f7c74144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.643+0000 7f7c79001700 1 -- 172.21.15.62:0/50591789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c00a610 con 0x7f7c740b5c80 2021-12-17T18:19:01.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.643+0000 7f7c79001700 1 --2- 172.21.15.62:0/50591789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c740b5c80 0x7f7c7413d890 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f7c640012a0 tx=0x7f7c640028a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:01.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.643+0000 7f7c6a7fc700 1 -- 172.21.15.62:0/50591789 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c64012400 con 0x7f7c740b5c80 2021-12-17T18:19:01.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.643+0000 7f7c6a7fc700 1 -- 172.21.15.62:0/50591789 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c64012560 con 0x7f7c740b5c80 2021-12-17T18:19:01.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.643+0000 7f7c7a003700 1 -- 172.21.15.62:0/50591789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c74145110 con 0x7f7c740b5c80 2021-12-17T18:19:01.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.643+0000 7f7c6a7fc700 1 -- 172.21.15.62:0/50591789 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c640128c0 con 0x7f7c740b5c80 2021-12-17T18:19:01.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.643+0000 7f7c7a003700 1 -- 172.21.15.62:0/50591789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c741468b0 con 0x7f7c740b5c80 2021-12-17T18:19:01.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.643+0000 7f7c7a003700 1 -- 172.21.15.62:0/50591789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c740573d0 con 0x7f7c740b5c80 2021-12-17T18:19:01.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.643+0000 7f7c6a7fc700 1 -- 172.21.15.62:0/50591789 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7c64019030 con 0x7f7c740b5c80 2021-12-17T18:19:01.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.647+0000 7f7c6a7fc700 1 --2- 172.21.15.62:0/50591789 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7c5c0534f0 0x7f7c5c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:01.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.647+0000 7f7c6a7fc700 1 -- 172.21.15.62:0/50591789 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7c6406aaf0 con 0x7f7c740b5c80 2021-12-17T18:19:01.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.647+0000 7f7c78800700 1 --2- 172.21.15.62:0/50591789 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7c5c0534f0 0x7f7c5c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:01.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.647+0000 7f7c78800700 1 --2- 172.21.15.62:0/50591789 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7c5c0534f0 0x7f7c5c0559b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f7c7000d000 tx=0x7f7c70000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:01.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.651+0000 7f7c6a7fc700 1 -- 172.21.15.62:0/50591789 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7c64041c50 con 0x7f7c740b5c80 2021-12-17T18:19:01.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.815+0000 7f7c7a003700 1 -- 172.21.15.62:0/50591789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c7413ffd0 con 0x7f7c740b5c80 2021-12-17T18:19:01.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.819+0000 7f7c6a7fc700 1 -- 172.21.15.62:0/50591789 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f7c7413ffd0 con 0x7f7c740b5c80 2021-12-17T18:19:01.825 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:19:01.825 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4093989719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4093989719},{"type":"v1","addr":"172.21.15.62:6833","nonce":4093989719}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:19:00.503279+0000","modified":"2021-12-17T18:19:01.505814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4906},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4906":{"gid":4906,"name":"b","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/360945085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":360945085},{"type":"v1","addr":"172.21.15.109:6835","nonce":360945085}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-12-17T18:19:01.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.819+0000 7f7c7a003700 1 -- 172.21.15.62:0/50591789 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7c5c0534f0 msgr2=0x7f7c5c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.819+0000 7f7c7a003700 1 --2- 172.21.15.62:0/50591789 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7c5c0534f0 0x7f7c5c0559b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f7c7000d000 tx=0x7f7c70000bc0).stop 2021-12-17T18:19:01.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.819+0000 7f7c7a003700 1 -- 172.21.15.62:0/50591789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c740b5c80 msgr2=0x7f7c7413d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.819+0000 7f7c7a003700 1 --2- 172.21.15.62:0/50591789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c740b5c80 0x7f7c7413d890 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f7c640012a0 tx=0x7f7c640028a0).stop 2021-12-17T18:19:01.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.819+0000 7f7c7a003700 1 -- 172.21.15.62:0/50591789 shutdown_connections 2021-12-17T18:19:01.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.819+0000 7f7c7a003700 1 --2- 172.21.15.62:0/50591789 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7c5c0534f0 0x7f7c5c0559b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.819+0000 7f7c7a003700 1 --2- 172.21.15.62:0/50591789 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c7413fb60 0x7f7c740a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.819+0000 7f7c7a003700 1 --2- 172.21.15.62:0/50591789 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7c740b6060 0x7f7c74144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.819+0000 7f7c7a003700 1 --2- 172.21.15.62:0/50591789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c740b5c80 0x7f7c7413d890 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.819+0000 7f7c7a003700 1 -- 172.21.15.62:0/50591789 >> 172.21.15.62:0/50591789 conn(0x7f7c7405c750 msgr2=0x7f7c740ad480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:01.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.823+0000 7f7c7a003700 1 -- 172.21.15.62:0/50591789 shutdown_connections 2021-12-17T18:19:01.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.823+0000 7f7c7a003700 1 -- 172.21.15.62:0/50591789 wait complete. 2021-12-17T18:19:01.832 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 10 2021-12-17T18:19:01.843 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:19:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03acb94700 1 Processor -- start 2021-12-17T18:19:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03acb94700 1 -- start start 2021-12-17T18:19:01.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03acb94700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f03a80b3eb0 0x7f03a8145110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:01.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03acb94700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f03a8067770 0x7f03a80b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:01.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03acb94700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f03a80b4780 0x7f03a805f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:01.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03acb94700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a80b27c0 con 0x7f03a80b3eb0 2021-12-17T18:19:01.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03acb94700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a8144730 con 0x7f03a8067770 2021-12-17T18:19:01.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03acb94700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a81449d0 con 0x7f03a80b4780 2021-12-17T18:19:01.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03a659c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f03a80b3eb0 0x7f03a8145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:01.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03a659c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f03a80b3eb0 0x7f03a8145110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49318/0 (socket says 172.21.15.62:49318) 2021-12-17T18:19:01.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03a659c700 1 -- 172.21.15.62:0/3884998446 learned_addr learned my addr 172.21.15.62:0/3884998446 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:01.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03a5d9b700 1 --2- 172.21.15.62:0/3884998446 >> v2:172.21.15.109:3300/0 conn(0x7f03a8067770 0x7f03a80b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:01.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03a6d9d700 1 --2- 172.21.15.62:0/3884998446 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f03a80b4780 0x7f03a805f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:01.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03a659c700 1 -- 172.21.15.62:0/3884998446 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f03a80b4780 msgr2=0x7f03a805f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:01.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03a659c700 1 --2- 172.21.15.62:0/3884998446 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f03a80b4780 0x7f03a805f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03a659c700 1 -- 172.21.15.62:0/3884998446 >> v2:172.21.15.109:3300/0 conn(0x7f03a8067770 msgr2=0x7f03a80b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:01.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03a659c700 1 --2- 172.21.15.62:0/3884998446 >> v2:172.21.15.109:3300/0 conn(0x7f03a8067770 0x7f03a80b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03a659c700 1 -- 172.21.15.62:0/3884998446 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a8144c70 con 0x7f03a80b3eb0 2021-12-17T18:19:01.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.939+0000 7f03a659c700 1 --2- 172.21.15.62:0/3884998446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03a80b3eb0 0x7f03a8145110 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f039c002f70 tx=0x7f039c006eb0).ready entity=mon.0 client_cookie=ca907ef0febd64ef server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:01.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.943+0000 7f03a559a700 1 -- 172.21.15.62:0/3884998446 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f039c00d570 con 0x7f03a80b3eb0 2021-12-17T18:19:01.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.943+0000 7f03a559a700 1 -- 172.21.15.62:0/3884998446 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039c000e90 con 0x7f03a80b3eb0 2021-12-17T18:19:01.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.943+0000 7f03a559a700 1 -- 172.21.15.62:0/3884998446 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f039c00d900 con 0x7f03a80b3eb0 2021-12-17T18:19:01.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.943+0000 7f03acb94700 1 -- 172.21.15.62:0/3884998446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03a80b3eb0 msgr2=0x7f03a8145110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.943+0000 7f03acb94700 1 --2- 172.21.15.62:0/3884998446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03a80b3eb0 0x7f03a8145110 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f039c002f70 tx=0x7f039c006eb0).stop 2021-12-17T18:19:01.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.943+0000 7f03acb94700 1 -- 172.21.15.62:0/3884998446 shutdown_connections 2021-12-17T18:19:01.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.943+0000 7f03acb94700 1 --2- 172.21.15.62:0/3884998446 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f03a80b4780 0x7f03a805f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.943+0000 7f03acb94700 1 --2- 172.21.15.62:0/3884998446 >> v2:172.21.15.109:3300/0 conn(0x7f03a8067770 0x7f03a80b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.943+0000 7f03acb94700 1 --2- 172.21.15.62:0/3884998446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03a80b3eb0 0x7f03a8145110 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.943+0000 7f03acb94700 1 -- 172.21.15.62:0/3884998446 >> 172.21.15.62:0/3884998446 conn(0x7f03a805cb40 msgr2=0x7f03a805cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:01.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.943+0000 7f03acb94700 1 -- 172.21.15.62:0/3884998446 shutdown_connections 2021-12-17T18:19:01.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.943+0000 7f03acb94700 1 -- 172.21.15.62:0/3884998446 wait complete. 2021-12-17T18:19:01.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.943+0000 7f03acb94700 1 Processor -- start 2021-12-17T18:19:01.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.943+0000 7f03acb94700 1 -- start start 2021-12-17T18:19:01.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03acb94700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03a8067770 0x7f03a80b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:01.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03acb94700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f03a80b3eb0 0x7f03a80ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:01.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03acb94700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f03a80b4780 0x7f03a80b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:01.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03acb94700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a81488d0 con 0x7f03a8067770 2021-12-17T18:19:01.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03acb94700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80b0480 con 0x7f03a80b3eb0 2021-12-17T18:19:01.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03acb94700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80b0710 con 0x7f03a80b4780 2021-12-17T18:19:01.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03a659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03a8067770 0x7f03a80b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:01.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03a659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03a8067770 0x7f03a80b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49324/0 (socket says 172.21.15.62:49324) 2021-12-17T18:19:01.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03a659c700 1 -- 172.21.15.62:0/965872725 learned_addr learned my addr 172.21.15.62:0/965872725 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:01.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03a5d9b700 1 --2- 172.21.15.62:0/965872725 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f03a80b3eb0 0x7f03a80ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:01.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03a6d9d700 1 --2- 172.21.15.62:0/965872725 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f03a80b4780 0x7f03a80b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:01.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03a659c700 1 -- 172.21.15.62:0/965872725 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f03a80b4780 msgr2=0x7f03a80b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03a659c700 1 --2- 172.21.15.62:0/965872725 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f03a80b4780 0x7f03a80b68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03a659c700 1 -- 172.21.15.62:0/965872725 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f03a80b3eb0 msgr2=0x7f03a80ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:01.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03a659c700 1 --2- 172.21.15.62:0/965872725 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f03a80b3eb0 0x7f03a80ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:01.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03a659c700 1 -- 172.21.15.62:0/965872725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c00b1e0 con 0x7f03a8067770 2021-12-17T18:19:01.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03a659c700 1 --2- 172.21.15.62:0/965872725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03a8067770 0x7f03a80b10f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f039c002f70 tx=0x7f039c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:01.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03977fe700 1 -- 172.21.15.62:0/965872725 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f039c011760 con 0x7f03a8067770 2021-12-17T18:19:01.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03977fe700 1 -- 172.21.15.62:0/965872725 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039c0118c0 con 0x7f03a8067770 2021-12-17T18:19:01.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03acb94700 1 -- 172.21.15.62:0/965872725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a80b09b0 con 0x7f03a8067770 2021-12-17T18:19:01.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03977fe700 1 -- 172.21.15.62:0/965872725 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f039c011c20 con 0x7f03a8067770 2021-12-17T18:19:01.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.947+0000 7f03acb94700 1 -- 172.21.15.62:0/965872725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a80abdb0 con 0x7f03a8067770 2021-12-17T18:19:01.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.951+0000 7f03acb94700 1 -- 172.21.15.62:0/965872725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a80573d0 con 0x7f03a8067770 2021-12-17T18:19:01.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.951+0000 7f03977fe700 1 -- 172.21.15.62:0/965872725 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f039c025030 con 0x7f03a8067770 2021-12-17T18:19:01.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.951+0000 7f03977fe700 1 --2- 172.21.15.62:0/965872725 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0384053580 0x7f0384055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:01.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.951+0000 7f03977fe700 1 -- 172.21.15.62:0/965872725 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f039c06cc30 con 0x7f03a8067770 2021-12-17T18:19:01.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.951+0000 7f03a5d9b700 1 --2- 172.21.15.62:0/965872725 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0384053580 0x7f0384055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:01.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.951+0000 7f03a5d9b700 1 --2- 172.21.15.62:0/965872725 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0384053580 0x7f0384055a40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f039800c000 tx=0x7f0398008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:01.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:01.955+0000 7f03977fe700 1 -- 172.21.15.62:0/965872725 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f039c043c80 con 0x7f03a8067770 2021-12-17T18:19:02.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.083+0000 7f03acb94700 1 -- 172.21.15.62:0/965872725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03a806a2b0 con 0x7f03a8067770 2021-12-17T18:19:02.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.083+0000 7f03977fe700 1 -- 172.21.15.62:0/965872725 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f039c023020 con 0x7f03a8067770 2021-12-17T18:19:02.092 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:19:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":33,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:19:01.506520+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:58.549405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:59.508046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:19:02.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.087+0000 7f03acb94700 1 -- 172.21.15.62:0/965872725 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0384053580 msgr2=0x7f0384055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.087+0000 7f03acb94700 1 --2- 172.21.15.62:0/965872725 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0384053580 0x7f0384055a40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f039800c000 tx=0x7f0398008040).stop 2021-12-17T18:19:02.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.087+0000 7f03acb94700 1 -- 172.21.15.62:0/965872725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03a8067770 msgr2=0x7f03a80b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.087+0000 7f03acb94700 1 --2- 172.21.15.62:0/965872725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03a8067770 0x7f03a80b10f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f039c002f70 tx=0x7f039c015000).stop 2021-12-17T18:19:02.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.087+0000 7f03acb94700 1 -- 172.21.15.62:0/965872725 shutdown_connections 2021-12-17T18:19:02.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.087+0000 7f03acb94700 1 --2- 172.21.15.62:0/965872725 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0384053580 0x7f0384055a40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.087+0000 7f03acb94700 1 --2- 172.21.15.62:0/965872725 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f03a80b4780 0x7f03a80b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.087+0000 7f03acb94700 1 --2- 172.21.15.62:0/965872725 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f03a80b3eb0 0x7f03a80ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.087+0000 7f03acb94700 1 --2- 172.21.15.62:0/965872725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03a8067770 0x7f03a80b10f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.087+0000 7f03acb94700 1 -- 172.21.15.62:0/965872725 >> 172.21.15.62:0/965872725 conn(0x7f03a805cb40 msgr2=0x7f03a80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:02.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.087+0000 7f03acb94700 1 -- 172.21.15.62:0/965872725 shutdown_connections 2021-12-17T18:19:02.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.087+0000 7f03acb94700 1 -- 172.21.15.62:0/965872725 wait complete. 2021-12-17T18:19:02.105 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:19:02.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.207+0000 7f5d3db94700 1 Processor -- start 2021-12-17T18:19:02.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.207+0000 7f5d3db94700 1 -- start start 2021-12-17T18:19:02.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d3db94700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d38066a70 0x7f5d38144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d3db94700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5d38144d00 0x7f5d3805fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d3db94700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d381443b0 con 0x7f5d38062360 2021-12-17T18:19:02.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d3db94700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d380b3430 con 0x7f5d38144d00 2021-12-17T18:19:02.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d3db94700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380b3190 con 0x7f5d38066a70 2021-12-17T18:19:02.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d3d393700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5d38144d00 0x7f5d3805fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d2ffff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5d38062360 0x7f5d3805f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32914/0 (socket says 172.21.15.62:32914) 2021-12-17T18:19:02.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d2ffff700 1 -- 172.21.15.62:0/1957583082 learned_addr learned my addr 172.21.15.62:0/1957583082 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:19:02.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d3cb92700 1 --2- 172.21.15.62:0/1957583082 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d38066a70 0x7f5d38144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d3d393700 1 -- 172.21.15.62:0/1957583082 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d38066a70 msgr2=0x7f5d38144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:02.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d3d393700 1 --2- 172.21.15.62:0/1957583082 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d38066a70 0x7f5d38144810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d3d393700 1 -- 172.21.15.62:0/1957583082 >> v1:172.21.15.62:6789/0 conn(0x7f5d38062360 legacy=0x7f5d3805f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d2f7fe700 1 -- 172.21.15.62:0/1957583082 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34755916 0 0) 0x7f5d381443b0 con 0x7f5d38062360 2021-12-17T18:19:02.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d3d393700 1 -- 172.21.15.62:0/1957583082 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d38145160 con 0x7f5d38144d00 2021-12-17T18:19:02.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d3d393700 1 --2- 172.21.15.62:0/1957583082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d38144d00 0x7f5d3805fe40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f5d300032f0 tx=0x7f5d300091d0).ready entity=mon.0 client_cookie=bc52ba91456530ec server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:02.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d2f7fe700 1 -- 172.21.15.62:0/1957583082 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d3000b6c0 con 0x7f5d38144d00 2021-12-17T18:19:02.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d2f7fe700 1 -- 172.21.15.62:0/1957583082 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3000b820 con 0x7f5d38144d00 2021-12-17T18:19:02.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.211+0000 7f5d2f7fe700 1 -- 172.21.15.62:0/1957583082 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d3000b990 con 0x7f5d38144d00 2021-12-17T18:19:02.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.215+0000 7f5d3db94700 1 -- 172.21.15.62:0/1957583082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d38144d00 msgr2=0x7f5d3805fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.215+0000 7f5d3db94700 1 --2- 172.21.15.62:0/1957583082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d38144d00 0x7f5d3805fe40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f5d300032f0 tx=0x7f5d300091d0).stop 2021-12-17T18:19:02.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.215+0000 7f5d3db94700 1 -- 172.21.15.62:0/1957583082 shutdown_connections 2021-12-17T18:19:02.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.215+0000 7f5d3db94700 1 --2- 172.21.15.62:0/1957583082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d38144d00 0x7f5d3805fe40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.215+0000 7f5d3db94700 1 --2- 172.21.15.62:0/1957583082 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d38066a70 0x7f5d38144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.215+0000 7f5d3db94700 1 -- 172.21.15.62:0/1957583082 >> 172.21.15.62:0/1957583082 conn(0x7f5d3805bcd0 msgr2=0x7f5d38063510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:02.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.215+0000 7f5d3db94700 1 -- 172.21.15.62:0/1957583082 shutdown_connections 2021-12-17T18:19:02.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.215+0000 7f5d3db94700 1 -- 172.21.15.62:0/1957583082 wait complete. 2021-12-17T18:19:02.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.215+0000 7f5d3db94700 1 Processor -- start 2021-12-17T18:19:02.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.215+0000 7f5d3db94700 1 -- start start 2021-12-17T18:19:02.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d3db94700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d38062360 0x7f5d38142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d3db94700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d38066a70 0x7f5d38065130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d3db94700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d38144d00 0x7f5d38065620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d3db94700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d38142de0 con 0x7f5d38066a70 2021-12-17T18:19:02.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d3db94700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d38143080 con 0x7f5d38062360 2021-12-17T18:19:02.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d3db94700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d38143320 con 0x7f5d38144d00 2021-12-17T18:19:02.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d38066a70 0x7f5d38065130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d38066a70 0x7f5d38065130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49340/0 (socket says 172.21.15.62:49340) 2021-12-17T18:19:02.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d2ffff700 1 -- 172.21.15.62:0/870453513 learned_addr learned my addr 172.21.15.62:0/870453513 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:02.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d3cb92700 1 --2- 172.21.15.62:0/870453513 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d38062360 0x7f5d38142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d3d393700 1 --2- 172.21.15.62:0/870453513 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d38144d00 0x7f5d38065620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d2ffff700 1 -- 172.21.15.62:0/870453513 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d38144d00 msgr2=0x7f5d38065620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d2ffff700 1 --2- 172.21.15.62:0/870453513 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d38144d00 0x7f5d38065620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d2ffff700 1 -- 172.21.15.62:0/870453513 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d38062360 msgr2=0x7f5d38142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d2ffff700 1 --2- 172.21.15.62:0/870453513 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d38062360 0x7f5d38142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d2ffff700 1 -- 172.21.15.62:0/870453513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d30009470 con 0x7f5d38066a70 2021-12-17T18:19:02.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d2ffff700 1 --2- 172.21.15.62:0/870453513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d38066a70 0x7f5d38065130 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f5d28000ed0 tx=0x7f5d28007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:02.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d2dffb700 1 -- 172.21.15.62:0/870453513 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d280070d0 con 0x7f5d38066a70 2021-12-17T18:19:02.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d2dffb700 1 -- 172.21.15.62:0/870453513 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d28007230 con 0x7f5d38066a70 2021-12-17T18:19:02.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d2dffb700 1 -- 172.21.15.62:0/870453513 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d28005590 con 0x7f5d38066a70 2021-12-17T18:19:02.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d3db94700 1 -- 172.21.15.62:0/870453513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d381435c0 con 0x7f5d38066a70 2021-12-17T18:19:02.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d3db94700 1 -- 172.21.15.62:0/870453513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d380663e0 con 0x7f5d38066a70 2021-12-17T18:19:02.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d2dffb700 1 -- 172.21.15.62:0/870453513 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5d28010070 con 0x7f5d38066a70 2021-12-17T18:19:02.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d2dffb700 1 --2- 172.21.15.62:0/870453513 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5d18053580 0x7f5d18055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d3db94700 1 -- 172.21.15.62:0/870453513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d3813e030 con 0x7f5d38066a70 2021-12-17T18:19:02.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.219+0000 7f5d2dffb700 1 -- 172.21.15.62:0/870453513 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5d2806b130 con 0x7f5d38066a70 2021-12-17T18:19:02.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.223+0000 7f5d3cb92700 1 --2- 172.21.15.62:0/870453513 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5d18053580 0x7f5d18055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.223+0000 7f5d3cb92700 1 --2- 172.21.15.62:0/870453513 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5d18053580 0x7f5d18055a40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f5d3400b000 tx=0x7f5d34006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:02.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.227+0000 7f5d2dffb700 1 -- 172.21.15.62:0/870453513 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5d3813e030 con 0x7f5d38066a70 2021-12-17T18:19:02.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.395+0000 7f5d3db94700 1 -- 172.21.15.62:0/870453513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5d3813e030 con 0x7f5d38066a70 2021-12-17T18:19:02.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.399+0000 7f5d2dffb700 1 -- 172.21.15.62:0/870453513 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v11) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5d3813e030 con 0x7f5d38066a70 2021-12-17T18:19:02.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.403+0000 7f5d3db94700 1 -- 172.21.15.62:0/870453513 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5d18053580 msgr2=0x7f5d18055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.403+0000 7f5d3db94700 1 --2- 172.21.15.62:0/870453513 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5d18053580 0x7f5d18055a40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f5d3400b000 tx=0x7f5d34006df0).stop 2021-12-17T18:19:02.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.403+0000 7f5d3db94700 1 -- 172.21.15.62:0/870453513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d38066a70 msgr2=0x7f5d38065130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.403+0000 7f5d3db94700 1 --2- 172.21.15.62:0/870453513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d38066a70 0x7f5d38065130 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f5d28000ed0 tx=0x7f5d28007aa0).stop 2021-12-17T18:19:02.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.403+0000 7f5d3db94700 1 -- 172.21.15.62:0/870453513 shutdown_connections 2021-12-17T18:19:02.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.403+0000 7f5d3db94700 1 --2- 172.21.15.62:0/870453513 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5d18053580 0x7f5d18055a40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.403+0000 7f5d3db94700 1 --2- 172.21.15.62:0/870453513 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d38144d00 0x7f5d38065620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.403+0000 7f5d3db94700 1 --2- 172.21.15.62:0/870453513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d38066a70 0x7f5d38065130 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.403+0000 7f5d3db94700 1 --2- 172.21.15.62:0/870453513 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d38062360 0x7f5d38142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.403+0000 7f5d3db94700 1 -- 172.21.15.62:0/870453513 >> 172.21.15.62:0/870453513 conn(0x7f5d3805bcd0 msgr2=0x7f5d3813fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:02.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.403+0000 7f5d3db94700 1 -- 172.21.15.62:0/870453513 shutdown_connections 2021-12-17T18:19:02.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.403+0000 7f5d3db94700 1 -- 172.21.15.62:0/870453513 wait complete. 2021-12-17T18:19:02.413 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.0 2021-12-17T18:19:02.422 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:19:02.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.523+0000 7f8044a4d700 1 Processor -- start 2021-12-17T18:19:02.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.523+0000 7f8044a4d700 1 -- start start 2021-12-17T18:19:02.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f8044a4d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f80400b2940 0x7f8040140360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f8044a4d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8040140850 0x7f8040143740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f8044a4d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80400b1730 con 0x7f80400adad0 2021-12-17T18:19:02.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f8044a4d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80400ae5c0 con 0x7f80400b2940 2021-12-17T18:19:02.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f8044a4d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80400b2d80 con 0x7f8040140850 2021-12-17T18:19:02.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803e59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f80400adad0 0x7f80400adeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32926/0 (socket says 172.21.15.62:32926) 2021-12-17T18:19:02.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803e59c700 1 -- 172.21.15.62:0/3170413694 learned_addr learned my addr 172.21.15.62:0/3170413694 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:19:02.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803ed9d700 1 --2- 172.21.15.62:0/3170413694 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8040140850 0x7f8040143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f8037fff700 1 --2- 172.21.15.62:0/3170413694 >> v2:172.21.15.109:3300/0 conn(0x7f80400b2940 0x7f8040140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 -- 172.21.15.62:0/3170413694 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732867282 0 0) 0x7f80400b1730 con 0x7f80400adad0 2021-12-17T18:19:02.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 -- 172.21.15.62:0/3170413694 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8020003260 con 0x7f80400adad0 2021-12-17T18:19:02.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 -- 172.21.15.62:0/3170413694 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2690360279 0 0) 0x7f8020003260 con 0x7f80400adad0 2021-12-17T18:19:02.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 -- 172.21.15.62:0/3170413694 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8040140850 msgr2=0x7f8040143740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:02.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 --2- 172.21.15.62:0/3170413694 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8040140850 0x7f8040143740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 -- 172.21.15.62:0/3170413694 >> v2:172.21.15.109:3300/0 conn(0x7f80400b2940 msgr2=0x7f8040140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:02.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 --2- 172.21.15.62:0/3170413694 >> v2:172.21.15.109:3300/0 conn(0x7f80400b2940 0x7f8040140360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 -- 172.21.15.62:0/3170413694 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80400b19d0 con 0x7f80400adad0 2021-12-17T18:19:02.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 -- 172.21.15.62:0/3170413694 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f8030001660 con 0x7f80400adad0 2021-12-17T18:19:02.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 -- 172.21.15.62:0/3170413694 >> v1:172.21.15.62:6789/0 conn(0x7f80400adad0 legacy=0x7f80400adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 --2- 172.21.15.62:0/3170413694 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8020003750 0x7f8020003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 --2- 172.21.15.62:0/3170413694 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8040140850 0x7f8020004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 --2- 172.21.15.62:0/3170413694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80200049f0 0x7f8020004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 -- 172.21.15.62:0/3170413694 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80400ae5c0 con 0x7f80200049f0 2021-12-17T18:19:02.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 -- 172.21.15.62:0/3170413694 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8020004330 con 0x7f8020003750 2021-12-17T18:19:02.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 -- 172.21.15.62:0/3170413694 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802000d9b0 con 0x7f8040140850 2021-12-17T18:19:02.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f8037fff700 1 --2- 172.21.15.62:0/3170413694 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8040140850 0x7f8020004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803ed9d700 1 --2- 172.21.15.62:0/3170413694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80200049f0 0x7f8020004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803e59c700 1 --2- 172.21.15.62:0/3170413694 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8020003750 0x7f8020003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803ed9d700 1 -- 172.21.15.62:0/3170413694 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8040140850 msgr2=0x7f8020004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:02.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803ed9d700 1 --2- 172.21.15.62:0/3170413694 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8040140850 0x7f8020004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803ed9d700 1 -- 172.21.15.62:0/3170413694 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8020003750 msgr2=0x7f8020003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:02.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803ed9d700 1 --2- 172.21.15.62:0/3170413694 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8020003750 0x7f8020003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803ed9d700 1 -- 172.21.15.62:0/3170413694 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8020003260 con 0x7f80200049f0 2021-12-17T18:19:02.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803ed9d700 1 --2- 172.21.15.62:0/3170413694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80200049f0 0x7f8020004e70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f8020004470 tx=0x7f80380091d0).ready entity=mon.0 client_cookie=86701b173a46ef17 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:02.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 -- 172.21.15.62:0/3170413694 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f803800e7e0 con 0x7f80200049f0 2021-12-17T18:19:02.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 -- 172.21.15.62:0/3170413694 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803800e940 con 0x7f80200049f0 2021-12-17T18:19:02.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.527+0000 7f803dd9b700 1 -- 172.21.15.62:0/3170413694 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f803800eca0 con 0x7f80200049f0 2021-12-17T18:19:02.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.531+0000 7f8044a4d700 1 -- 172.21.15.62:0/3170413694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80200049f0 msgr2=0x7f8020004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.531+0000 7f8044a4d700 1 --2- 172.21.15.62:0/3170413694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80200049f0 0x7f8020004e70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f8020004470 tx=0x7f80380091d0).stop 2021-12-17T18:19:02.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.531+0000 7f803ed9d700 1 -- 172.21.15.62:0/3170413694 reap_dead start 2021-12-17T18:19:02.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.531+0000 7f8044a4d700 1 -- 172.21.15.62:0/3170413694 shutdown_connections 2021-12-17T18:19:02.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.531+0000 7f8044a4d700 1 -- 172.21.15.62:0/3170413694 >> 172.21.15.62:0/3170413694 conn(0x7f80400b64f0 msgr2=0x7f80400b68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:02.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.531+0000 7f8044a4d700 1 -- 172.21.15.62:0/3170413694 shutdown_connections 2021-12-17T18:19:02.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.531+0000 7f8044a4d700 1 -- 172.21.15.62:0/3170413694 wait complete. 2021-12-17T18:19:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.531+0000 7f8044a4d700 1 Processor -- start 2021-12-17T18:19:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.531+0000 7f8044a4d700 1 -- start start 2021-12-17T18:19:02.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f8044a4d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f80200049f0 0x7f8040143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f8044a4d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8040144b40 0x7f80400abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f8044a4d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80400acf40 0x7f80400ac440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f8044a4d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804013bc80 con 0x7f80400acf40 2021-12-17T18:19:02.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f8044a4d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80400aae40 con 0x7f80200049f0 2021-12-17T18:19:02.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f8044a4d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80400aa430 con 0x7f8040144b40 2021-12-17T18:19:02.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f803ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80400acf40 0x7f80400ac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f8037fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8040144b40 0x7f80400abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f803e59c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f80200049f0 0x7f8040143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f8037fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8040144b40 0x7f80400abf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:43060/0 (socket says 172.21.15.62:43060) 2021-12-17T18:19:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f803ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80400acf40 0x7f80400ac440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49362/0 (socket says 172.21.15.62:49362) 2021-12-17T18:19:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f8037fff700 1 -- 172.21.15.62:0/1458466999 learned_addr learned my addr 172.21.15.62:0/1458466999 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f803ed9d700 1 -- 172.21.15.62:0/1458466999 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8040144b40 msgr2=0x7f80400abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f803ed9d700 1 --2- 172.21.15.62:0/1458466999 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8040144b40 0x7f80400abf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f803ed9d700 1 -- 172.21.15.62:0/1458466999 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f80200049f0 msgr2=0x7f8040143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f803ed9d700 1 --2- 172.21.15.62:0/1458466999 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f80200049f0 0x7f8040143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f803ed9d700 1 -- 172.21.15.62:0/1458466999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80400aa6d0 con 0x7f80400acf40 2021-12-17T18:19:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f803ed9d700 1 --2- 172.21.15.62:0/1458466999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80400acf40 0x7f80400ac440 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f80300017c0 tx=0x7f803801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f80377fe700 1 -- 172.21.15.62:0/1458466999 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f803801db00 con 0x7f80400acf40 2021-12-17T18:19:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f80377fe700 1 -- 172.21.15.62:0/1458466999 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803801dc60 con 0x7f80400acf40 2021-12-17T18:19:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f8044a4d700 1 -- 172.21.15.62:0/1458466999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80400aa980 con 0x7f80400acf40 2021-12-17T18:19:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f80377fe700 1 -- 172.21.15.62:0/1458466999 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f803801b450 con 0x7f80400acf40 2021-12-17T18:19:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.535+0000 7f8044a4d700 1 -- 172.21.15.62:0/1458466999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80400ac930 con 0x7f80400acf40 2021-12-17T18:19:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.539+0000 7f8044a4d700 1 -- 172.21.15.62:0/1458466999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80400acd80 con 0x7f80400acf40 2021-12-17T18:19:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.539+0000 7f80377fe700 1 -- 172.21.15.62:0/1458466999 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f803801b5b0 con 0x7f80400acf40 2021-12-17T18:19:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.539+0000 7f80377fe700 1 --2- 172.21.15.62:0/1458466999 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8024053640 0x7f8024055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.539+0000 7f80377fe700 1 -- 172.21.15.62:0/1458466999 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f803806c9d0 con 0x7f80400acf40 2021-12-17T18:19:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.539+0000 7f803e59c700 1 --2- 172.21.15.62:0/1458466999 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8024053640 0x7f8024055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.539+0000 7f803e59c700 1 --2- 172.21.15.62:0/1458466999 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8024053640 0x7f8024055b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f8030005000 tx=0x7f80400b0f00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.543+0000 7f80377fe700 1 -- 172.21.15.62:0/1458466999 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8038043ad0 con 0x7f80400acf40 2021-12-17T18:19:02.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.711+0000 7f8044a4d700 1 -- 172.21.15.62:0/1458466999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f80400b1c70 con 0x7f80400acf40 2021-12-17T18:19:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.719+0000 7f80377fe700 1 -- 172.21.15.62:0/1458466999 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7f80380470f0 con 0x7f80400acf40 2021-12-17T18:19:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.723+0000 7f8044a4d700 1 -- 172.21.15.62:0/1458466999 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8024053640 msgr2=0x7f8024055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.723+0000 7f8044a4d700 1 --2- 172.21.15.62:0/1458466999 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8024053640 0x7f8024055b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f8030005000 tx=0x7f80400b0f00).stop 2021-12-17T18:19:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.723+0000 7f8044a4d700 1 -- 172.21.15.62:0/1458466999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80400acf40 msgr2=0x7f80400ac440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.723+0000 7f8044a4d700 1 --2- 172.21.15.62:0/1458466999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80400acf40 0x7f80400ac440 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f80300017c0 tx=0x7f803801a000).stop 2021-12-17T18:19:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.723+0000 7f8044a4d700 1 -- 172.21.15.62:0/1458466999 shutdown_connections 2021-12-17T18:19:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.723+0000 7f8044a4d700 1 --2- 172.21.15.62:0/1458466999 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8024053640 0x7f8024055b00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.723+0000 7f8044a4d700 1 --2- 172.21.15.62:0/1458466999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80400acf40 0x7f80400ac440 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.723+0000 7f8044a4d700 1 --2- 172.21.15.62:0/1458466999 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8040144b40 0x7f80400abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.723+0000 7f8044a4d700 1 --2- 172.21.15.62:0/1458466999 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f80200049f0 0x7f8040143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.723+0000 7f8044a4d700 1 -- 172.21.15.62:0/1458466999 >> 172.21.15.62:0/1458466999 conn(0x7f80400b64f0 msgr2=0x7f80400b68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.723+0000 7f8044a4d700 1 -- 172.21.15.62:0/1458466999 shutdown_connections 2021-12-17T18:19:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.723+0000 7f8044a4d700 1 -- 172.21.15.62:0/1458466999 wait complete. 2021-12-17T18:19:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.1 2021-12-17T18:19:02.742 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:19:02.814 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:19:02.817 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:19:02.819 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:19:02.822 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:19:02.825 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:19:02.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.851+0000 7f92556c6700 1 Processor -- start 2021-12-17T18:19:02.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.851+0000 7f92556c6700 1 -- start start 2021-12-17T18:19:02.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.851+0000 7f92556c6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f92500b34b0 0x7f92500b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.851+0000 7f92556c6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925005ce70 con 0x7f925005ca90 2021-12-17T18:19:02.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.851+0000 7f92556c6700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92500b2d70 con 0x7f92500604b0 2021-12-17T18:19:02.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.851+0000 7f92556c6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92500b3010 con 0x7f92500b34b0 2021-12-17T18:19:02.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.851+0000 7f924ffff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f925005ca90 0x7f9250145b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32946/0 (socket says 172.21.15.62:32946) 2021-12-17T18:19:02.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.851+0000 7f924ffff700 1 -- 172.21.15.62:0/607909721 learned_addr learned my addr 172.21.15.62:0/607909721 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:19:02.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.851+0000 7f924f7fe700 1 --2- 172.21.15.62:0/607909721 >> v2:172.21.15.62:3300/0 conn(0x7f92500b34b0 0x7f92500b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.851+0000 7f924effd700 1 -- 172.21.15.62:0/607909721 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010825653 0 0) 0x7f925005ce70 con 0x7f925005ca90 2021-12-17T18:19:02.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.851+0000 7f924f7fe700 1 -- 172.21.15.62:0/607909721 >> v1:172.21.15.109:6789/0 conn(0x7f92500604b0 legacy=0x7f92500b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.851+0000 7f924f7fe700 1 -- 172.21.15.62:0/607909721 >> v1:172.21.15.62:6789/0 conn(0x7f925005ca90 legacy=0x7f9250145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.851+0000 7f924f7fe700 1 -- 172.21.15.62:0/607909721 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92500b2ab0 con 0x7f92500b34b0 2021-12-17T18:19:02.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.855+0000 7f924f7fe700 1 --2- 172.21.15.62:0/607909721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92500b34b0 0x7f92500b2470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f9238002f70 tx=0x7f9238006df0).ready entity=mon.0 client_cookie=6062913c4cd15a74 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:02.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.855+0000 7f924effd700 1 -- 172.21.15.62:0/607909721 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f923800d610 con 0x7f92500b34b0 2021-12-17T18:19:02.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.855+0000 7f924effd700 1 -- 172.21.15.62:0/607909721 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9238000e90 con 0x7f92500b34b0 2021-12-17T18:19:02.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.855+0000 7f924effd700 1 -- 172.21.15.62:0/607909721 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f923800d960 con 0x7f92500b34b0 2021-12-17T18:19:02.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.855+0000 7f92556c6700 1 -- 172.21.15.62:0/607909721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92500b34b0 msgr2=0x7f92500b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.855+0000 7f92556c6700 1 --2- 172.21.15.62:0/607909721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92500b34b0 0x7f92500b2470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f9238002f70 tx=0x7f9238006df0).stop 2021-12-17T18:19:02.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.855+0000 7f92556c6700 1 -- 172.21.15.62:0/607909721 shutdown_connections 2021-12-17T18:19:02.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.855+0000 7f92556c6700 1 --2- 172.21.15.62:0/607909721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92500b34b0 0x7f92500b2470 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.855+0000 7f92556c6700 1 -- 172.21.15.62:0/607909721 >> 172.21.15.62:0/607909721 conn(0x7f925005bcd0 msgr2=0x7f9250062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:02.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.855+0000 7f92556c6700 1 -- 172.21.15.62:0/607909721 shutdown_connections 2021-12-17T18:19:02.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.855+0000 7f92556c6700 1 -- 172.21.15.62:0/607909721 wait complete. 2021-12-17T18:19:02.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.855+0000 7f92556c6700 1 Processor -- start 2021-12-17T18:19:02.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.855+0000 7f92556c6700 1 -- start start 2021-12-17T18:19:02.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f92556c6700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f925005ca90 0x7f92500a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f92556c6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92500604b0 0x7f92501424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f92556c6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92500b34b0 0x7f92501429c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f92556c6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92500a31f0 con 0x7f92500b34b0 2021-12-17T18:19:02.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f92556c6700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9250064f50 con 0x7f925005ca90 2021-12-17T18:19:02.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f92556c6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92500a3d70 con 0x7f92500604b0 2021-12-17T18:19:02.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f9254ec5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92500b34b0 0x7f92501429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f9254ec5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92500b34b0 0x7f92501429c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49376/0 (socket says 172.21.15.62:49376) 2021-12-17T18:19:02.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f9254ec5700 1 -- 172.21.15.62:0/980474738 learned_addr learned my addr 172.21.15.62:0/980474738 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:02.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f924ffff700 1 --2- 172.21.15.62:0/980474738 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f925005ca90 0x7f92500a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f924f7fe700 1 --2- 172.21.15.62:0/980474738 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92500604b0 0x7f92501424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f9254ec5700 1 -- 172.21.15.62:0/980474738 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92500604b0 msgr2=0x7f92501424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f9254ec5700 1 --2- 172.21.15.62:0/980474738 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92500604b0 0x7f92501424d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f9254ec5700 1 -- 172.21.15.62:0/980474738 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f925005ca90 msgr2=0x7f92500a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:02.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f9254ec5700 1 --2- 172.21.15.62:0/980474738 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f925005ca90 0x7f92500a3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:02.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f9254ec5700 1 -- 172.21.15.62:0/980474738 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923800b180 con 0x7f92500b34b0 2021-12-17T18:19:02.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f9254ec5700 1 --2- 172.21.15.62:0/980474738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92500b34b0 0x7f92501429c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f9250068710 tx=0x7f9240007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:02.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f924d7fa700 1 -- 172.21.15.62:0/980474738 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9240012400 con 0x7f92500b34b0 2021-12-17T18:19:02.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f924d7fa700 1 -- 172.21.15.62:0/980474738 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9240012560 con 0x7f92500b34b0 2021-12-17T18:19:02.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f92556c6700 1 -- 172.21.15.62:0/980474738 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92500a4010 con 0x7f92500b34b0 2021-12-17T18:19:02.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f924d7fa700 1 -- 172.21.15.62:0/980474738 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92400128c0 con 0x7f92500b34b0 2021-12-17T18:19:02.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.859+0000 7f92556c6700 1 -- 172.21.15.62:0/980474738 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9250142eb0 con 0x7f92500b34b0 2021-12-17T18:19:02.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.863+0000 7f92556c6700 1 -- 172.21.15.62:0/980474738 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9250152fb0 con 0x7f92500b34b0 2021-12-17T18:19:02.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.863+0000 7f924d7fa700 1 -- 172.21.15.62:0/980474738 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9240019030 con 0x7f92500b34b0 2021-12-17T18:19:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.863+0000 7f924d7fa700 1 --2- 172.21.15.62:0/980474738 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9234053610 0x7f9234055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.863+0000 7f924d7fa700 1 -- 172.21.15.62:0/980474738 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f924006ac70 con 0x7f92500b34b0 2021-12-17T18:19:02.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.863+0000 7f924ffff700 1 --2- 172.21.15.62:0/980474738 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9234053610 0x7f9234055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:02.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.863+0000 7f924ffff700 1 --2- 172.21.15.62:0/980474738 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9234053610 0x7f9234055ad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f924800d000 tx=0x7f9248001520).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:02.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:02.871+0000 7f924d7fa700 1 -- 172.21.15.62:0/980474738 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9240041dd0 con 0x7f92500b34b0 2021-12-17T18:19:03.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.039+0000 7f92556c6700 1 -- 172.21.15.62:0/980474738 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f92500b4500 con 0x7f92500b34b0 2021-12-17T18:19:03.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.047+0000 7f924d7fa700 1 -- 172.21.15.62:0/980474738 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7f92400453f0 con 0x7f92500b34b0 2021-12-17T18:19:03.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.051+0000 7f92556c6700 1 -- 172.21.15.62:0/980474738 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9234053610 msgr2=0x7f9234055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:03.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.051+0000 7f92556c6700 1 --2- 172.21.15.62:0/980474738 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9234053610 0x7f9234055ad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f924800d000 tx=0x7f9248001520).stop 2021-12-17T18:19:03.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.051+0000 7f92556c6700 1 -- 172.21.15.62:0/980474738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92500b34b0 msgr2=0x7f92501429c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:03.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.051+0000 7f92556c6700 1 --2- 172.21.15.62:0/980474738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92500b34b0 0x7f92501429c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f9250068710 tx=0x7f9240007bc0).stop 2021-12-17T18:19:03.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.051+0000 7f92556c6700 1 -- 172.21.15.62:0/980474738 shutdown_connections 2021-12-17T18:19:03.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.051+0000 7f92556c6700 1 --2- 172.21.15.62:0/980474738 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9234053610 0x7f9234055ad0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.051+0000 7f92556c6700 1 --2- 172.21.15.62:0/980474738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92500b34b0 0x7f92501429c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.051+0000 7f92556c6700 1 --2- 172.21.15.62:0/980474738 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92500604b0 0x7f92501424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.051+0000 7f92556c6700 1 --2- 172.21.15.62:0/980474738 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f925005ca90 0x7f92500a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.051+0000 7f92556c6700 1 -- 172.21.15.62:0/980474738 >> 172.21.15.62:0/980474738 conn(0x7f925005bcd0 msgr2=0x7f92500b9650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:03.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.051+0000 7f92556c6700 1 -- 172.21.15.62:0/980474738 shutdown_connections 2021-12-17T18:19:03.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.051+0000 7f92556c6700 1 -- 172.21.15.62:0/980474738 wait complete. 2021-12-17T18:19:03.060 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.2 2021-12-17T18:19:03.069 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:19:03.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.167+0000 7f2c623c9700 1 Processor -- start 2021-12-17T18:19:03.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.167+0000 7f2c623c9700 1 -- start start 2021-12-17T18:19:03.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.167+0000 7f2c623c9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2c5c0af8a0 0x7f2c5c144380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:03.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.167+0000 7f2c623c9700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f2c5c144870 0x7f2c5c13fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.167+0000 7f2c623c9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c5c0b1990 con 0x7f2c5c0b3a40 2021-12-17T18:19:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.167+0000 7f2c623c9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5c064400 con 0x7f2c5c0af8a0 2021-12-17T18:19:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.167+0000 7f2c623c9700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5c0b3e20 con 0x7f2c5c144870 2021-12-17T18:19:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c613c7700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2c5c0b3a40 0x7f2c5c063cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32960/0 (socket says 172.21.15.62:32960) 2021-12-17T18:19:03.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c613c7700 1 -- 172.21.15.62:0/1125568103 learned_addr learned my addr 172.21.15.62:0/1125568103 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:19:03.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c60bc6700 1 --2- 172.21.15.62:0/1125568103 >> v2:172.21.15.62:3300/0 conn(0x7f2c5c0af8a0 0x7f2c5c144380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:03.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c61bc8700 1 --2- 172.21.15.62:0/1125568103 >> v2:172.21.15.109:3300/0 conn(0x7f2c5c144870 0x7f2c5c13fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:03.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c4bfff700 1 -- 172.21.15.62:0/1125568103 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010002518 0 0) 0x7f2c5c0b1990 con 0x7f2c5c0b3a40 2021-12-17T18:19:03.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c4bfff700 1 -- 172.21.15.62:0/1125568103 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c44003260 con 0x7f2c5c0b3a40 2021-12-17T18:19:03.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c60bc6700 1 -- 172.21.15.62:0/1125568103 >> v2:172.21.15.109:3300/0 conn(0x7f2c5c144870 msgr2=0x7f2c5c13fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:03.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c60bc6700 1 --2- 172.21.15.62:0/1125568103 >> v2:172.21.15.109:3300/0 conn(0x7f2c5c144870 0x7f2c5c13fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c60bc6700 1 -- 172.21.15.62:0/1125568103 >> v1:172.21.15.62:6789/0 conn(0x7f2c5c0b3a40 legacy=0x7f2c5c063cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:03.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c60bc6700 1 -- 172.21.15.62:0/1125568103 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c063620 con 0x7f2c5c0af8a0 2021-12-17T18:19:03.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c60bc6700 1 --2- 172.21.15.62:0/1125568103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c5c0af8a0 0x7f2c5c144380 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f2c4c002f70 tx=0x7f2c4c006df0).ready entity=mon.0 client_cookie=d7a74d0df2cdddbe server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:03.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c4bfff700 1 -- 172.21.15.62:0/1125568103 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c4c00d4f0 con 0x7f2c5c0af8a0 2021-12-17T18:19:03.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c4bfff700 1 -- 172.21.15.62:0/1125568103 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4c000e90 con 0x7f2c5c0af8a0 2021-12-17T18:19:03.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c4bfff700 1 -- 172.21.15.62:0/1125568103 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c4c00d840 con 0x7f2c5c0af8a0 2021-12-17T18:19:03.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c623c9700 1 -- 172.21.15.62:0/1125568103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c5c0af8a0 msgr2=0x7f2c5c144380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:03.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c623c9700 1 --2- 172.21.15.62:0/1125568103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c5c0af8a0 0x7f2c5c144380 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f2c4c002f70 tx=0x7f2c4c006df0).stop 2021-12-17T18:19:03.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c623c9700 1 -- 172.21.15.62:0/1125568103 shutdown_connections 2021-12-17T18:19:03.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c623c9700 1 --2- 172.21.15.62:0/1125568103 >> v2:172.21.15.109:3300/0 conn(0x7f2c5c144870 0x7f2c5c13fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c623c9700 1 --2- 172.21.15.62:0/1125568103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c5c0af8a0 0x7f2c5c144380 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c623c9700 1 -- 172.21.15.62:0/1125568103 >> 172.21.15.62:0/1125568103 conn(0x7f2c5c0b7020 msgr2=0x7f2c5c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:03.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c623c9700 1 -- 172.21.15.62:0/1125568103 shutdown_connections 2021-12-17T18:19:03.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.171+0000 7f2c623c9700 1 -- 172.21.15.62:0/1125568103 wait complete. 2021-12-17T18:19:03.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c623c9700 1 Processor -- start 2021-12-17T18:19:03.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c623c9700 1 -- start start 2021-12-17T18:19:03.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c623c9700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2c5c0af8a0 0x7f2c5c148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:03.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c623c9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c5c0b3a40 0x7f2c5c13c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:03.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c623c9700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2c5c144870 0x7f2c5c13c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:03.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c623c9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c1474a0 con 0x7f2c5c0b3a40 2021-12-17T18:19:03.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c623c9700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c067990 con 0x7f2c5c0af8a0 2021-12-17T18:19:03.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c623c9700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c145bd0 con 0x7f2c5c144870 2021-12-17T18:19:03.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c60bc6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c5c0b3a40 0x7f2c5c13c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:03.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c60bc6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c5c0b3a40 0x7f2c5c13c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49388/0 (socket says 172.21.15.62:49388) 2021-12-17T18:19:03.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c60bc6700 1 -- 172.21.15.62:0/194840660 learned_addr learned my addr 172.21.15.62:0/194840660 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:03.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c613c7700 1 --2- 172.21.15.62:0/194840660 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2c5c0af8a0 0x7f2c5c148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:03.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c61bc8700 1 --2- 172.21.15.62:0/194840660 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2c5c144870 0x7f2c5c13c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:03.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c60bc6700 1 -- 172.21.15.62:0/194840660 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2c5c144870 msgr2=0x7f2c5c13c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:03.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c60bc6700 1 --2- 172.21.15.62:0/194840660 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2c5c144870 0x7f2c5c13c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c60bc6700 1 -- 172.21.15.62:0/194840660 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2c5c0af8a0 msgr2=0x7f2c5c148510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:03.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c60bc6700 1 --2- 172.21.15.62:0/194840660 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2c5c0af8a0 0x7f2c5c148510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c60bc6700 1 -- 172.21.15.62:0/194840660 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c00b180 con 0x7f2c5c0b3a40 2021-12-17T18:19:03.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c61bc8700 1 --2- 172.21.15.62:0/194840660 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2c5c144870 0x7f2c5c13c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:19:03.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c60bc6700 1 --2- 172.21.15.62:0/194840660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c5c0b3a40 0x7f2c5c13c460 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f2c5c067070 tx=0x7f2c4c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c4a7fc700 1 -- 172.21.15.62:0/194840660 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c4c016070 con 0x7f2c5c0b3a40 2021-12-17T18:19:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.175+0000 7f2c4a7fc700 1 -- 172.21.15.62:0/194840660 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4c0138d0 con 0x7f2c5c0b3a40 2021-12-17T18:19:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.179+0000 7f2c623c9700 1 -- 172.21.15.62:0/194840660 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c5c062760 con 0x7f2c5c0b3a40 2021-12-17T18:19:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.179+0000 7f2c4a7fc700 1 -- 172.21.15.62:0/194840660 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c4c013c30 con 0x7f2c5c0b3a40 2021-12-17T18:19:03.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.179+0000 7f2c623c9700 1 -- 172.21.15.62:0/194840660 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c5c146340 con 0x7f2c5c0b3a40 2021-12-17T18:19:03.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.179+0000 7f2c623c9700 1 -- 172.21.15.62:0/194840660 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c5c063850 con 0x7f2c5c0b3a40 2021-12-17T18:19:03.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.179+0000 7f2c4a7fc700 1 -- 172.21.15.62:0/194840660 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2c4c00f030 con 0x7f2c5c0b3a40 2021-12-17T18:19:03.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.179+0000 7f2c4a7fc700 1 --2- 172.21.15.62:0/194840660 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2c3c053610 0x7f2c3c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:03.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.179+0000 7f2c4a7fc700 1 -- 172.21.15.62:0/194840660 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2c4c06c6f0 con 0x7f2c5c0b3a40 2021-12-17T18:19:03.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.179+0000 7f2c613c7700 1 --2- 172.21.15.62:0/194840660 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2c3c053610 0x7f2c3c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:03.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.179+0000 7f2c613c7700 1 --2- 172.21.15.62:0/194840660 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2c3c053610 0x7f2c3c055ad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f2c5800d000 tx=0x7f2c58009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:03.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.183+0000 7f2c4a7fc700 1 -- 172.21.15.62:0/194840660 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2c4c0436c0 con 0x7f2c5c0b3a40 2021-12-17T18:19:03.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.347+0000 7f2c623c9700 1 -- 172.21.15.62:0/194840660 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c5c145d10 con 0x7f2c5c0b3a40 2021-12-17T18:19:03.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.347+0000 7f2c4a7fc700 1 -- 172.21.15.62:0/194840660 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f2c4c023020 con 0x7f2c5c0b3a40 2021-12-17T18:19:03.355 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:19:03.355 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4093989719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4093989719},{"type":"v1","addr":"172.21.15.62:6833","nonce":4093989719}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:19:00.503279+0000","modified":"2021-12-17T18:19:01.505814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4906},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4906":{"gid":4906,"name":"b","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/360945085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":360945085},{"type":"v1","addr":"172.21.15.109:6835","nonce":360945085}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-12-17T18:19:03.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.351+0000 7f2c623c9700 1 -- 172.21.15.62:0/194840660 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2c3c053610 msgr2=0x7f2c3c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:03.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.351+0000 7f2c623c9700 1 --2- 172.21.15.62:0/194840660 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2c3c053610 0x7f2c3c055ad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f2c5800d000 tx=0x7f2c58009040).stop 2021-12-17T18:19:03.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.351+0000 7f2c623c9700 1 -- 172.21.15.62:0/194840660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c5c0b3a40 msgr2=0x7f2c5c13c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:03.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.351+0000 7f2c623c9700 1 --2- 172.21.15.62:0/194840660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c5c0b3a40 0x7f2c5c13c460 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f2c5c067070 tx=0x7f2c4c014000).stop 2021-12-17T18:19:03.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.351+0000 7f2c623c9700 1 -- 172.21.15.62:0/194840660 shutdown_connections 2021-12-17T18:19:03.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.351+0000 7f2c623c9700 1 --2- 172.21.15.62:0/194840660 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2c3c053610 0x7f2c3c055ad0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.351+0000 7f2c623c9700 1 --2- 172.21.15.62:0/194840660 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2c5c144870 0x7f2c5c13c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.351+0000 7f2c623c9700 1 --2- 172.21.15.62:0/194840660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c5c0b3a40 0x7f2c5c13c460 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.351+0000 7f2c623c9700 1 --2- 172.21.15.62:0/194840660 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2c5c0af8a0 0x7f2c5c148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.351+0000 7f2c623c9700 1 -- 172.21.15.62:0/194840660 >> 172.21.15.62:0/194840660 conn(0x7f2c5c0b7020 msgr2=0x7f2c5c141630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:03.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.351+0000 7f2c623c9700 1 -- 172.21.15.62:0/194840660 shutdown_connections 2021-12-17T18:19:03.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.351+0000 7f2c623c9700 1 -- 172.21.15.62:0/194840660 wait complete. 2021-12-17T18:19:03.361 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 10 2021-12-17T18:19:03.573 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:19:00.503279+0000', 'modified': '2021-12-17T18:19:01.505814+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4906}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4906': {'gid': 4906, 'name': 'b', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.109:6835/360945085', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.109:6834', 'nonce': 360945085}, {'type': 'v1', 'addr': '172.21.15.109:6835', 'nonce': 360945085}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:19:03.574 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:19:03.575 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-12-17T18:19:03.692 INFO:teuthology.orchestra.run.smithi109.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":4906,"want_state":"up:active","state":"up:active","rank_uptime":3.174490509,"mdsmap_epoch":10,"osdmap_epoch":33,"osdmap_epoch_barrier":32,"uptime":9.7778736740000003} 2021-12-17T18:19:03.692 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 4906, "mdsmap_epoch": 10, "osdmap_epoch": 33, "osdmap_epoch_barrier": 32, "rank_uptime": 3.174490509, "state": "up:active", "uptime": 9.777873674, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:19:03.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:19:03.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.799+0000 7f22827d7700 1 Processor -- start 2021-12-17T18:19:03.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.799+0000 7f22827d7700 1 -- start start 2021-12-17T18:19:03.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f22827d7700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f227c1499a0 0x7f227c14bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:03.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f22827d7700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227c0b1990 con 0x7f227c0af8a0 2021-12-17T18:19:03.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f22827d7700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227c063620 con 0x7f227c0b3a40 2021-12-17T18:19:03.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f22827d7700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c064400 con 0x7f227c1499a0 2021-12-17T18:19:03.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f2280fd4700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f227c0af8a0 0x7f227c144380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32974/0 (socket says 172.21.15.62:32974) 2021-12-17T18:19:03.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f2280fd4700 1 -- 172.21.15.62:0/3837572097 learned_addr learned my addr 172.21.15.62:0/3837572097 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:19:03.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f2281fd6700 1 --2- 172.21.15.62:0/3837572097 >> v2:172.21.15.109:3300/0 conn(0x7f227c1499a0 0x7f227c14bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:03.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 -- 172.21.15.62:0/3837572097 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176197131 0 0) 0x7f227c0b1990 con 0x7f227c0af8a0 2021-12-17T18:19:03.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 -- 172.21.15.62:0/3837572097 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2264003260 con 0x7f227c0af8a0 2021-12-17T18:19:03.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 -- 172.21.15.62:0/3837572097 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3720845085 0 0) 0x7f2264003260 con 0x7f227c0af8a0 2021-12-17T18:19:03.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 -- 172.21.15.62:0/3837572097 >> v2:172.21.15.109:3300/0 conn(0x7f227c1499a0 msgr2=0x7f227c14bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:03.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 --2- 172.21.15.62:0/3837572097 >> v2:172.21.15.109:3300/0 conn(0x7f227c1499a0 0x7f227c14bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 -- 172.21.15.62:0/3837572097 >> v1:172.21.15.109:6789/0 conn(0x7f227c0b3a40 legacy=0x7f227c063cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:03.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 -- 172.21.15.62:0/3837572097 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c062760 con 0x7f227c0af8a0 2021-12-17T18:19:03.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 -- 172.21.15.62:0/3837572097 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f226c001660 con 0x7f227c0af8a0 2021-12-17T18:19:03.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 -- 172.21.15.62:0/3837572097 >> v1:172.21.15.62:6789/0 conn(0x7f227c0af8a0 legacy=0x7f227c144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:03.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 --2- 172.21.15.62:0/3837572097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2264003750 0x7f2264003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:03.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 --2- 172.21.15.62:0/3837572097 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2264004500 0x7f2264004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:03.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 --2- 172.21.15.62:0/3837572097 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2264004e70 0x7f226400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:03.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 -- 172.21.15.62:0/3837572097 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c064400 con 0x7f2264003750 2021-12-17T18:19:03.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 -- 172.21.15.62:0/3837572097 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226400bd20 con 0x7f2264004e70 2021-12-17T18:19:03.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 -- 172.21.15.62:0/3837572097 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226400bee0 con 0x7f2264004500 2021-12-17T18:19:03.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f22817d5700 1 --2- 172.21.15.62:0/3837572097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2264003750 0x7f2264003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:03.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f2281fd6700 1 --2- 172.21.15.62:0/3837572097 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2264004e70 0x7f226400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:03.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f2280fd4700 1 --2- 172.21.15.62:0/3837572097 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2264004500 0x7f2264004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:03.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f22817d5700 1 -- 172.21.15.62:0/3837572097 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2264004500 msgr2=0x7f2264004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:03.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f22817d5700 1 --2- 172.21.15.62:0/3837572097 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2264004500 0x7f2264004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f22817d5700 1 -- 172.21.15.62:0/3837572097 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2264004e70 msgr2=0x7f226400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:03.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f22817d5700 1 --2- 172.21.15.62:0/3837572097 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2264004e70 0x7f226400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f22817d5700 1 -- 172.21.15.62:0/3837572097 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2264003260 con 0x7f2264003750 2021-12-17T18:19:03.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f2280fd4700 1 --2- 172.21.15.62:0/3837572097 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2264004500 0x7f2264004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:19:03.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f2281fd6700 1 --2- 172.21.15.62:0/3837572097 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2264004e70 0x7f226400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:19:03.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f2281fd6700 1 -- 172.21.15.62:0/3837572097 reap_dead start 2021-12-17T18:19:03.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f22817d5700 1 --2- 172.21.15.62:0/3837572097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2264003750 0x7f2264003b70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f227c05d420 tx=0x7f2278007a00).ready entity=mon.0 client_cookie=5811d32b14376c5d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:03.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 -- 172.21.15.62:0/3837572097 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2278007d10 con 0x7f2264003750 2021-12-17T18:19:03.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 -- 172.21.15.62:0/3837572097 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2278007030 con 0x7f2264003750 2021-12-17T18:19:03.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.803+0000 7f226bfff700 1 -- 172.21.15.62:0/3837572097 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2278007390 con 0x7f2264003750 2021-12-17T18:19:03.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f22827d7700 1 -- 172.21.15.62:0/3837572097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2264003750 msgr2=0x7f2264003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:03.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f22827d7700 1 --2- 172.21.15.62:0/3837572097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2264003750 0x7f2264003b70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f227c05d420 tx=0x7f2278007a00).stop 2021-12-17T18:19:03.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f22827d7700 1 -- 172.21.15.62:0/3837572097 shutdown_connections 2021-12-17T18:19:03.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f22827d7700 1 --2- 172.21.15.62:0/3837572097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2264003750 0x7f2264003b70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f22827d7700 1 -- 172.21.15.62:0/3837572097 >> 172.21.15.62:0/3837572097 conn(0x7f227c0b7020 msgr2=0x7f227c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:03.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f22827d7700 1 -- 172.21.15.62:0/3837572097 shutdown_connections 2021-12-17T18:19:03.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f22827d7700 1 -- 172.21.15.62:0/3837572097 wait complete. 2021-12-17T18:19:03.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f22827d7700 1 Processor -- start 2021-12-17T18:19:03.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f22827d7700 1 -- start start 2021-12-17T18:19:03.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f22827d7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2264003750 0x7f227c139200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:03.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f22827d7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f227c13ff90 0x7f227c13e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:03.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f22827d7700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f227c142280 0x7f227c067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:03.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f22827d7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c066310 con 0x7f227c13ff90 2021-12-17T18:19:03.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f22827d7700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c139ce0 con 0x7f227c142280 2021-12-17T18:19:03.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f22827d7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c064bb0 con 0x7f2264003750 2021-12-17T18:19:03.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f2280fd4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f227c13ff90 0x7f227c13e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:03.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f2280fd4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f227c13ff90 0x7f227c13e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49406/0 (socket says 172.21.15.62:49406) 2021-12-17T18:19:03.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f2280fd4700 1 -- 172.21.15.62:0/3293248506 learned_addr learned my addr 172.21.15.62:0/3293248506 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:03.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f2281fd6700 1 --2- 172.21.15.62:0/3293248506 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f227c142280 0x7f227c067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:03.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.807+0000 7f22817d5700 1 --2- 172.21.15.62:0/3293248506 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2264003750 0x7f227c139200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:03.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.811+0000 7f2280fd4700 1 -- 172.21.15.62:0/3293248506 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2264003750 msgr2=0x7f227c139200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:03.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.811+0000 7f2280fd4700 1 --2- 172.21.15.62:0/3293248506 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2264003750 0x7f227c139200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.811+0000 7f2280fd4700 1 -- 172.21.15.62:0/3293248506 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f227c142280 msgr2=0x7f227c067300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:03.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.811+0000 7f2280fd4700 1 --2- 172.21.15.62:0/3293248506 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f227c142280 0x7f227c067300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.811+0000 7f2280fd4700 1 -- 172.21.15.62:0/3293248506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c065280 con 0x7f227c13ff90 2021-12-17T18:19:03.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.811+0000 7f22817d5700 1 --2- 172.21.15.62:0/3293248506 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2264003750 0x7f227c139200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:19:03.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.811+0000 7f2280fd4700 1 --2- 172.21.15.62:0/3293248506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f227c13ff90 0x7f227c13e910 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f227c0671a0 tx=0x7f226c001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:03.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.811+0000 7f226a7fc700 1 -- 172.21.15.62:0/3293248506 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f226c011780 con 0x7f227c13ff90 2021-12-17T18:19:03.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.811+0000 7f226a7fc700 1 -- 172.21.15.62:0/3293248506 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c0118e0 con 0x7f227c13ff90 2021-12-17T18:19:03.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.811+0000 7f22827d7700 1 -- 172.21.15.62:0/3293248506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c140510 con 0x7f227c13ff90 2021-12-17T18:19:03.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.811+0000 7f226a7fc700 1 -- 172.21.15.62:0/3293248506 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f226c011c40 con 0x7f227c13ff90 2021-12-17T18:19:03.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.811+0000 7f22827d7700 1 -- 172.21.15.62:0/3293248506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c0677f0 con 0x7f227c13ff90 2021-12-17T18:19:03.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.811+0000 7f22827d7700 1 -- 172.21.15.62:0/3293248506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c062990 con 0x7f227c13ff90 2021-12-17T18:19:03.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.811+0000 7f226a7fc700 1 -- 172.21.15.62:0/3293248506 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f226c01b030 con 0x7f227c13ff90 2021-12-17T18:19:03.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.811+0000 7f226a7fc700 1 --2- 172.21.15.62:0/3293248506 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f225c053640 0x7f225c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:03.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.811+0000 7f226a7fc700 1 -- 172.21.15.62:0/3293248506 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f226c06b500 con 0x7f227c13ff90 2021-12-17T18:19:03.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.811+0000 7f22817d5700 1 --2- 172.21.15.62:0/3293248506 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f225c053640 0x7f225c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:03.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.815+0000 7f22817d5700 1 --2- 172.21.15.62:0/3293248506 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f225c053640 0x7f225c055b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f2278019000 tx=0x7f2278015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:03.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.819+0000 7f226a7fc700 1 -- 172.21.15.62:0/3293248506 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f226c042600 con 0x7f227c13ff90 2021-12-17T18:19:03.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.947+0000 7f22827d7700 1 -- 172.21.15.62:0/3293248506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f227c0573d0 con 0x7f227c13ff90 2021-12-17T18:19:03.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.951+0000 7f226a7fc700 1 -- 172.21.15.62:0/3293248506 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f226c019030 con 0x7f227c13ff90 2021-12-17T18:19:03.957 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:19:03.957 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":33,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:19:01.506520+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:18:58.549405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-12-17T18:18:59.508046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:19:03.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.951+0000 7f22827d7700 1 -- 172.21.15.62:0/3293248506 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f225c053640 msgr2=0x7f225c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:03.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.951+0000 7f22827d7700 1 --2- 172.21.15.62:0/3293248506 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f225c053640 0x7f225c055b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f2278019000 tx=0x7f2278015000).stop 2021-12-17T18:19:03.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.951+0000 7f22827d7700 1 -- 172.21.15.62:0/3293248506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f227c13ff90 msgr2=0x7f227c13e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:03.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.951+0000 7f22827d7700 1 --2- 172.21.15.62:0/3293248506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f227c13ff90 0x7f227c13e910 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f227c0671a0 tx=0x7f226c001e10).stop 2021-12-17T18:19:03.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.951+0000 7f22827d7700 1 -- 172.21.15.62:0/3293248506 shutdown_connections 2021-12-17T18:19:03.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.951+0000 7f22827d7700 1 --2- 172.21.15.62:0/3293248506 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f225c053640 0x7f225c055b00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.951+0000 7f22827d7700 1 --2- 172.21.15.62:0/3293248506 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f227c142280 0x7f227c067300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.951+0000 7f22827d7700 1 --2- 172.21.15.62:0/3293248506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f227c13ff90 0x7f227c13e910 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.951+0000 7f22827d7700 1 --2- 172.21.15.62:0/3293248506 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2264003750 0x7f227c139200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:03.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.951+0000 7f22827d7700 1 -- 172.21.15.62:0/3293248506 >> 172.21.15.62:0/3293248506 conn(0x7f227c0b7020 msgr2=0x7f227c141a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:03.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.951+0000 7f22827d7700 1 -- 172.21.15.62:0/3293248506 shutdown_connections 2021-12-17T18:19:03.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:03.951+0000 7f22827d7700 1 -- 172.21.15.62:0/3293248506 wait complete. 2021-12-17T18:19:03.971 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:18:58.549405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:18:59.508046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:19:03.972 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:19:04.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.075+0000 7fba6b59e700 1 Processor -- start 2021-12-17T18:19:04.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba6b59e700 1 -- start start 2021-12-17T18:19:04.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba6b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba6c0b1f00 0x7fba6c066840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba6b59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fba6c0647a0 0x7fba6c141de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba6b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba6c0b6ae0 con 0x7fba6c0b6700 2021-12-17T18:19:04.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba6b59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba6c0632f0 con 0x7fba6c0647a0 2021-12-17T18:19:04.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba6b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c063590 con 0x7fba6c0b1f00 2021-12-17T18:19:04.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba6a59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fba6c0b6700 0x7fba6c066130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32996/0 (socket says 172.21.15.62:32996) 2021-12-17T18:19:04.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba6a59c700 1 -- 172.21.15.62:0/1280565586 learned_addr learned my addr 172.21.15.62:0/1280565586 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:19:04.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba63fff700 1 --2- 172.21.15.62:0/1280565586 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba6c0b1f00 0x7fba6c066840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba6ad9d700 1 --2- 172.21.15.62:0/1280565586 >> v2:172.21.15.109:3300/0 conn(0x7fba6c0647a0 0x7fba6c141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba69d9b700 1 -- 172.21.15.62:0/1280565586 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366948590 0 0) 0x7fba6c0b6ae0 con 0x7fba6c0b6700 2021-12-17T18:19:04.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba69d9b700 1 -- 172.21.15.62:0/1280565586 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba4c003260 con 0x7fba6c0b6700 2021-12-17T18:19:04.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba6ad9d700 1 -- 172.21.15.62:0/1280565586 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba6c0b1f00 msgr2=0x7fba6c066840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:04.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba6ad9d700 1 --2- 172.21.15.62:0/1280565586 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba6c0b1f00 0x7fba6c066840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba6ad9d700 1 -- 172.21.15.62:0/1280565586 >> v1:172.21.15.62:6789/0 conn(0x7fba6c0b6700 legacy=0x7fba6c066130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba6ad9d700 1 -- 172.21.15.62:0/1280565586 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6c063830 con 0x7fba6c0647a0 2021-12-17T18:19:04.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba6ad9d700 1 --2- 172.21.15.62:0/1280565586 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba6c0647a0 0x7fba6c141de0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fba640032f0 tx=0x7fba640091d0).ready entity=mon.1 client_cookie=f5430781b23b7f4b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:04.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba69d9b700 1 -- 172.21.15.62:0/1280565586 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba6400b600 con 0x7fba6c0647a0 2021-12-17T18:19:04.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba69d9b700 1 -- 172.21.15.62:0/1280565586 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6400b760 con 0x7fba6c0647a0 2021-12-17T18:19:04.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.079+0000 7fba69d9b700 1 -- 172.21.15.62:0/1280565586 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba6400b8d0 con 0x7fba6c0647a0 2021-12-17T18:19:04.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.083+0000 7fba6b59e700 1 -- 172.21.15.62:0/1280565586 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba6c0647a0 msgr2=0x7fba6c141de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.083+0000 7fba6b59e700 1 --2- 172.21.15.62:0/1280565586 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba6c0647a0 0x7fba6c141de0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fba640032f0 tx=0x7fba640091d0).stop 2021-12-17T18:19:04.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.083+0000 7fba6b59e700 1 -- 172.21.15.62:0/1280565586 shutdown_connections 2021-12-17T18:19:04.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.083+0000 7fba6b59e700 1 --2- 172.21.15.62:0/1280565586 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba6c0647a0 0x7fba6c141de0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.083+0000 7fba6b59e700 1 --2- 172.21.15.62:0/1280565586 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba6c0b1f00 0x7fba6c066840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.083+0000 7fba6b59e700 1 -- 172.21.15.62:0/1280565586 >> 172.21.15.62:0/1280565586 conn(0x7fba6c05c750 msgr2=0x7fba6c0b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:04.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.083+0000 7fba6b59e700 1 -- 172.21.15.62:0/1280565586 shutdown_connections 2021-12-17T18:19:04.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.083+0000 7fba6b59e700 1 -- 172.21.15.62:0/1280565586 wait complete. 2021-12-17T18:19:04.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.083+0000 7fba6b59e700 1 Processor -- start 2021-12-17T18:19:04.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.083+0000 7fba6b59e700 1 -- start start 2021-12-17T18:19:04.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba6c0647a0 0x7fba6c1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba6c0b1f00 0x7fba6c13b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6b59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba6c0b6700 0x7fba6c13feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c1464a0 con 0x7fba6c0647a0 2021-12-17T18:19:04.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6b59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c1444d0 con 0x7fba6c0b6700 2021-12-17T18:19:04.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c145d90 con 0x7fba6c0b1f00 2021-12-17T18:19:04.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba6c0647a0 0x7fba6c1558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba6c0647a0 0x7fba6c1558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49420/0 (socket says 172.21.15.62:49420) 2021-12-17T18:19:04.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6a59c700 1 -- 172.21.15.62:0/3581507946 learned_addr learned my addr 172.21.15.62:0/3581507946 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:04.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba63fff700 1 --2- 172.21.15.62:0/3581507946 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba6c0b1f00 0x7fba6c13b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6ad9d700 1 --2- 172.21.15.62:0/3581507946 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba6c0b6700 0x7fba6c13feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6a59c700 1 -- 172.21.15.62:0/3581507946 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba6c0b1f00 msgr2=0x7fba6c13b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6a59c700 1 --2- 172.21.15.62:0/3581507946 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba6c0b1f00 0x7fba6c13b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6a59c700 1 -- 172.21.15.62:0/3581507946 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba6c0b6700 msgr2=0x7fba6c13feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6a59c700 1 --2- 172.21.15.62:0/3581507946 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba6c0b6700 0x7fba6c13feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6a59c700 1 -- 172.21.15.62:0/3581507946 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba64009470 con 0x7fba6c0647a0 2021-12-17T18:19:04.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6a59c700 1 --2- 172.21.15.62:0/3581507946 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba6c0647a0 0x7fba6c1558d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fba5c001110 tx=0x7fba5c007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:04.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba637fe700 1 -- 172.21.15.62:0/3581507946 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba5c0070d0 con 0x7fba6c0647a0 2021-12-17T18:19:04.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba637fe700 1 -- 172.21.15.62:0/3581507946 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c007230 con 0x7fba6c0647a0 2021-12-17T18:19:04.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6b59e700 1 -- 172.21.15.62:0/3581507946 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba6c13d4e0 con 0x7fba6c0647a0 2021-12-17T18:19:04.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba637fe700 1 -- 172.21.15.62:0/3581507946 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba5c005610 con 0x7fba6c0647a0 2021-12-17T18:19:04.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba6b59e700 1 -- 172.21.15.62:0/3581507946 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba6c13e030 con 0x7fba6c0647a0 2021-12-17T18:19:04.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.087+0000 7fba637fe700 1 -- 172.21.15.62:0/3581507946 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fba5c010070 con 0x7fba6c0647a0 2021-12-17T18:19:04.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.091+0000 7fba6b59e700 1 -- 172.21.15.62:0/3581507946 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6c144690 con 0x7fba6c0647a0 2021-12-17T18:19:04.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.091+0000 7fba637fe700 1 --2- 172.21.15.62:0/3581507946 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba500534f0 0x7fba500559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.091+0000 7fba637fe700 1 -- 172.21.15.62:0/3581507946 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fba5c06b0a0 con 0x7fba6c0647a0 2021-12-17T18:19:04.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.091+0000 7fba63fff700 1 --2- 172.21.15.62:0/3581507946 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba500534f0 0x7fba500559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.091+0000 7fba63fff700 1 --2- 172.21.15.62:0/3581507946 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba500534f0 0x7fba500559b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fba5400b000 tx=0x7fba54006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:04.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.099+0000 7fba637fe700 1 -- 172.21.15.62:0/3581507946 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fba5c042070 con 0x7fba6c0647a0 2021-12-17T18:19:04.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.223+0000 7fba6b59e700 1 -- 172.21.15.62:0/3581507946 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fba6c0573d0 con 0x7fba6c0647a0 2021-12-17T18:19:04.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.227+0000 7fba637fe700 1 -- 172.21.15.62:0/3581507946 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v33) v1 ==== 110+0+10 (secure 0 0 0) 0x7fba5c018030 con 0x7fba6c0647a0 2021-12-17T18:19:04.232 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:19:04.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.227+0000 7fba6b59e700 1 -- 172.21.15.62:0/3581507946 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba500534f0 msgr2=0x7fba500559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.227+0000 7fba6b59e700 1 --2- 172.21.15.62:0/3581507946 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba500534f0 0x7fba500559b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fba5400b000 tx=0x7fba54006df0).stop 2021-12-17T18:19:04.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.227+0000 7fba6b59e700 1 -- 172.21.15.62:0/3581507946 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba6c0647a0 msgr2=0x7fba6c1558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.227+0000 7fba6b59e700 1 --2- 172.21.15.62:0/3581507946 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba6c0647a0 0x7fba6c1558d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fba5c001110 tx=0x7fba5c007aa0).stop 2021-12-17T18:19:04.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.227+0000 7fba6b59e700 1 -- 172.21.15.62:0/3581507946 shutdown_connections 2021-12-17T18:19:04.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.227+0000 7fba6b59e700 1 --2- 172.21.15.62:0/3581507946 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba500534f0 0x7fba500559b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.227+0000 7fba6b59e700 1 --2- 172.21.15.62:0/3581507946 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba6c0b6700 0x7fba6c13feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.227+0000 7fba6b59e700 1 --2- 172.21.15.62:0/3581507946 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba6c0b1f00 0x7fba6c13b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.227+0000 7fba6b59e700 1 --2- 172.21.15.62:0/3581507946 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba6c0647a0 0x7fba6c1558d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.227+0000 7fba6b59e700 1 -- 172.21.15.62:0/3581507946 >> 172.21.15.62:0/3581507946 conn(0x7fba6c05c750 msgr2=0x7fba6c067140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:04.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.227+0000 7fba6b59e700 1 -- 172.21.15.62:0/3581507946 shutdown_connections 2021-12-17T18:19:04.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.227+0000 7fba6b59e700 1 -- 172.21.15.62:0/3581507946 wait complete. 2021-12-17T18:19:04.245 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:19:04.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.343+0000 7f695759e700 1 Processor -- start 2021-12-17T18:19:04.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.343+0000 7f695759e700 1 -- start start 2021-12-17T18:19:04.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.343+0000 7f695759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f695805fc40 0x7f6958140d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.343+0000 7f695759e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f695805f730 0x7f6958066ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.343+0000 7f695759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69580af880 con 0x7f69580af4a0 2021-12-17T18:19:04.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.343+0000 7f695759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69580b0cf0 con 0x7f695805fc40 2021-12-17T18:19:04.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.343+0000 7f695759e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695805c060 con 0x7f695805f730 2021-12-17T18:19:04.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f6955d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f695805fc40 0x7f6958140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f695659c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f69580af4a0 0x7f6958060080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33008/0 (socket says 172.21.15.62:33008) 2021-12-17T18:19:04.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f695659c700 1 -- 172.21.15.62:0/2035684022 learned_addr learned my addr 172.21.15.62:0/2035684022 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:19:04.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f6956d9d700 1 --2- 172.21.15.62:0/2035684022 >> v2:172.21.15.109:3300/0 conn(0x7f695805f730 0x7f6958066ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f6955d9b700 1 -- 172.21.15.62:0/2035684022 >> v2:172.21.15.109:3300/0 conn(0x7f695805f730 msgr2=0x7f6958066ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:04.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f6955d9b700 1 --2- 172.21.15.62:0/2035684022 >> v2:172.21.15.109:3300/0 conn(0x7f695805f730 0x7f6958066ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f6955d9b700 1 -- 172.21.15.62:0/2035684022 >> v1:172.21.15.62:6789/0 conn(0x7f69580af4a0 legacy=0x7f6958060080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f6955d9b700 1 -- 172.21.15.62:0/2035684022 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6958144ed0 con 0x7f695805fc40 2021-12-17T18:19:04.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f6956d9d700 1 --2- 172.21.15.62:0/2035684022 >> v2:172.21.15.109:3300/0 conn(0x7f695805f730 0x7f6958066ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:19:04.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f6955d9b700 1 --2- 172.21.15.62:0/2035684022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695805fc40 0x7f6958140d70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f6940002f70 tx=0x7f6940006df0).ready entity=mon.0 client_cookie=e81dae62c8d49033 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:04.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f695559a700 1 -- 172.21.15.62:0/2035684022 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f694000d5c0 con 0x7f695805fc40 2021-12-17T18:19:04.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f695559a700 1 -- 172.21.15.62:0/2035684022 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6940000e90 con 0x7f695805fc40 2021-12-17T18:19:04.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f695559a700 1 -- 172.21.15.62:0/2035684022 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f694000d910 con 0x7f695805fc40 2021-12-17T18:19:04.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f695759e700 1 -- 172.21.15.62:0/2035684022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695805fc40 msgr2=0x7f6958140d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f695759e700 1 --2- 172.21.15.62:0/2035684022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695805fc40 0x7f6958140d70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f6940002f70 tx=0x7f6940006df0).stop 2021-12-17T18:19:04.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f695759e700 1 -- 172.21.15.62:0/2035684022 shutdown_connections 2021-12-17T18:19:04.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f695759e700 1 --2- 172.21.15.62:0/2035684022 >> v2:172.21.15.109:3300/0 conn(0x7f695805f730 0x7f6958066ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f695759e700 1 --2- 172.21.15.62:0/2035684022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695805fc40 0x7f6958140d70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f695759e700 1 -- 172.21.15.62:0/2035684022 >> 172.21.15.62:0/2035684022 conn(0x7f695805c750 msgr2=0x7f695805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:04.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f695759e700 1 -- 172.21.15.62:0/2035684022 shutdown_connections 2021-12-17T18:19:04.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f695759e700 1 -- 172.21.15.62:0/2035684022 wait complete. 2021-12-17T18:19:04.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f695759e700 1 Processor -- start 2021-12-17T18:19:04.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.347+0000 7f695759e700 1 -- start start 2021-12-17T18:19:04.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f695759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695805f730 0x7f695809f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f695759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f695805fc40 0x7f69580abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f695759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f69580af4a0 0x7f69580ac450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f695759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695809fba0 con 0x7f695805f730 2021-12-17T18:19:04.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f695759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69580a09d0 con 0x7f69580af4a0 2021-12-17T18:19:04.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f695759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69580a0c70 con 0x7f695805fc40 2021-12-17T18:19:04.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f695659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695805f730 0x7f695809f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f695659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695805f730 0x7f695809f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49434/0 (socket says 172.21.15.62:49434) 2021-12-17T18:19:04.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f695659c700 1 -- 172.21.15.62:0/136956080 learned_addr learned my addr 172.21.15.62:0/136956080 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:04.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f6956d9d700 1 --2- 172.21.15.62:0/136956080 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f69580af4a0 0x7f69580ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f6955d9b700 1 --2- 172.21.15.62:0/136956080 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f695805fc40 0x7f69580abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f695659c700 1 -- 172.21.15.62:0/136956080 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f695805fc40 msgr2=0x7f69580abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f695659c700 1 --2- 172.21.15.62:0/136956080 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f695805fc40 0x7f69580abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f695659c700 1 -- 172.21.15.62:0/136956080 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f69580af4a0 msgr2=0x7f69580ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f695659c700 1 --2- 172.21.15.62:0/136956080 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f69580af4a0 0x7f69580ac450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f695659c700 1 -- 172.21.15.62:0/136956080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694000b180 con 0x7f695805f730 2021-12-17T18:19:04.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f695659c700 1 --2- 172.21.15.62:0/136956080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695805f730 0x7f695809f250 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f6958062850 tx=0x7f6948007ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:04.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f694f7fe700 1 -- 172.21.15.62:0/136956080 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f694800ce30 con 0x7f695805f730 2021-12-17T18:19:04.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f694f7fe700 1 -- 172.21.15.62:0/136956080 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69480072e0 con 0x7f695805f730 2021-12-17T18:19:04.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f694f7fe700 1 -- 172.21.15.62:0/136956080 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6948005800 con 0x7f695805f730 2021-12-17T18:19:04.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f695759e700 1 -- 172.21.15.62:0/136956080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69580a0f10 con 0x7f695805f730 2021-12-17T18:19:04.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.351+0000 7f695759e700 1 -- 172.21.15.62:0/136956080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69580a13b0 con 0x7f695805f730 2021-12-17T18:19:04.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.355+0000 7f695759e700 1 -- 172.21.15.62:0/136956080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69580a10a0 con 0x7f695805f730 2021-12-17T18:19:04.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.355+0000 7f694f7fe700 1 -- 172.21.15.62:0/136956080 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6948010070 con 0x7f695805f730 2021-12-17T18:19:04.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.355+0000 7f694f7fe700 1 --2- 172.21.15.62:0/136956080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f693c053580 0x7f693c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.355+0000 7f694f7fe700 1 -- 172.21.15.62:0/136956080 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f694806afd0 con 0x7f695805f730 2021-12-17T18:19:04.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.355+0000 7f6955d9b700 1 --2- 172.21.15.62:0/136956080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f693c053580 0x7f693c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.355+0000 7f6955d9b700 1 --2- 172.21.15.62:0/136956080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f693c053580 0x7f693c055a40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f6940018000 tx=0x7f6940014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:04.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.363+0000 7f694f7fe700 1 -- 172.21.15.62:0/136956080 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f69480420b0 con 0x7f695805f730 2021-12-17T18:19:04.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.491+0000 7f695759e700 1 -- 172.21.15.62:0/136956080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f69580573d0 con 0x7f695805f730 2021-12-17T18:19:04.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.491+0000 7f694f7fe700 1 -- 172.21.15.62:0/136956080 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6948018070 con 0x7f695805f730 2021-12-17T18:19:04.500 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:19:04.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.495+0000 7f695759e700 1 -- 172.21.15.62:0/136956080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f693c053580 msgr2=0x7f693c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.495+0000 7f695759e700 1 --2- 172.21.15.62:0/136956080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f693c053580 0x7f693c055a40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f6940018000 tx=0x7f6940014000).stop 2021-12-17T18:19:04.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.495+0000 7f695759e700 1 -- 172.21.15.62:0/136956080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695805f730 msgr2=0x7f695809f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.495+0000 7f695759e700 1 --2- 172.21.15.62:0/136956080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695805f730 0x7f695809f250 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f6958062850 tx=0x7f6948007ca0).stop 2021-12-17T18:19:04.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.495+0000 7f695759e700 1 -- 172.21.15.62:0/136956080 shutdown_connections 2021-12-17T18:19:04.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.495+0000 7f695759e700 1 --2- 172.21.15.62:0/136956080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f693c053580 0x7f693c055a40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.495+0000 7f695759e700 1 --2- 172.21.15.62:0/136956080 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f69580af4a0 0x7f69580ac450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.495+0000 7f695759e700 1 --2- 172.21.15.62:0/136956080 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f695805fc40 0x7f69580abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.495+0000 7f695759e700 1 --2- 172.21.15.62:0/136956080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695805f730 0x7f695809f250 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.495+0000 7f695759e700 1 -- 172.21.15.62:0/136956080 >> 172.21.15.62:0/136956080 conn(0x7f695805c750 msgr2=0x7f695813ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:04.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.495+0000 7f695759e700 1 -- 172.21.15.62:0/136956080 shutdown_connections 2021-12-17T18:19:04.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.495+0000 7f695759e700 1 -- 172.21.15.62:0/136956080 wait complete. 2021-12-17T18:19:04.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:19:04.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.615+0000 7f02089a0700 1 Processor -- start 2021-12-17T18:19:04.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.615+0000 7f02089a0700 1 -- start start 2021-12-17T18:19:04.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f02040b40b0 0x7f0204143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02040b0870 con 0x7f020405ca90 2021-12-17T18:19:04.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020405ce70 con 0x7f02040b47c0 2021-12-17T18:19:04.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02040b05d0 con 0x7f02040b40b0 2021-12-17T18:19:04.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f020359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f02040b40b0 0x7f0204143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f020359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f02040b40b0 0x7f0204143ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49446/0 (socket says 172.21.15.62:49446) 2021-12-17T18:19:04.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f020359e700 1 -- 172.21.15.62:0/2642210703 learned_addr learned my addr 172.21.15.62:0/2642210703 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:04.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f0202d9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f020405ca90 0x7f02040b1d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33022/0 (socket says 172.21.15.62:33022) 2021-12-17T18:19:04.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f020359e700 1 -- 172.21.15.62:0/2642210703 >> v1:172.21.15.109:6789/0 conn(0x7f02040b47c0 legacy=0x7f02040b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f020359e700 1 -- 172.21.15.62:0/2642210703 >> v1:172.21.15.62:6789/0 conn(0x7f020405ca90 legacy=0x7f02040b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f020359e700 1 -- 172.21.15.62:0/2642210703 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02040b5250 con 0x7f02040b40b0 2021-12-17T18:19:04.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f020359e700 1 --2- 172.21.15.62:0/2642210703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02040b40b0 0x7f0204143ba0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f01fc0032f0 tx=0x7f01fc009290).ready entity=mon.0 client_cookie=27b5fe349bb104b5 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:04.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f0201d9b700 1 -- 172.21.15.62:0/2642210703 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01fc00b8a0 con 0x7f02040b40b0 2021-12-17T18:19:04.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f0201d9b700 1 -- 172.21.15.62:0/2642210703 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc00ba00 con 0x7f02040b40b0 2021-12-17T18:19:04.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f0201d9b700 1 -- 172.21.15.62:0/2642210703 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01fc00bb70 con 0x7f02040b40b0 2021-12-17T18:19:04.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 -- 172.21.15.62:0/2642210703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02040b40b0 msgr2=0x7f0204143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 --2- 172.21.15.62:0/2642210703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02040b40b0 0x7f0204143ba0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f01fc0032f0 tx=0x7f01fc009290).stop 2021-12-17T18:19:04.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 -- 172.21.15.62:0/2642210703 shutdown_connections 2021-12-17T18:19:04.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 --2- 172.21.15.62:0/2642210703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02040b40b0 0x7f0204143ba0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 -- 172.21.15.62:0/2642210703 >> 172.21.15.62:0/2642210703 conn(0x7f020405bcd0 msgr2=0x7f0204062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:04.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 -- 172.21.15.62:0/2642210703 shutdown_connections 2021-12-17T18:19:04.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 -- 172.21.15.62:0/2642210703 wait complete. 2021-12-17T18:19:04.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 Processor -- start 2021-12-17T18:19:04.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 -- start start 2021-12-17T18:19:04.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f020405ca90 0x7f0204149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f02040b40b0 0x7f0204142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f02040b47c0 0x7f0204142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02040667e0 con 0x7f020405ca90 2021-12-17T18:19:04.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0204066a80 con 0x7f02040b40b0 2021-12-17T18:19:04.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f02089a0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0204147c90 con 0x7f02040b47c0 2021-12-17T18:19:04.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f0202d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f020405ca90 0x7f0204149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f0202d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f020405ca90 0x7f0204149500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49448/0 (socket says 172.21.15.62:49448) 2021-12-17T18:19:04.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f0202d9d700 1 -- 172.21.15.62:0/1031256824 learned_addr learned my addr 172.21.15.62:0/1031256824 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:04.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.619+0000 7f020259c700 1 --2- 172.21.15.62:0/1031256824 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f02040b40b0 0x7f0204142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.623+0000 7f020359e700 1 --2- 172.21.15.62:0/1031256824 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f02040b47c0 0x7f0204142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.623+0000 7f0202d9d700 1 -- 172.21.15.62:0/1031256824 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f02040b47c0 msgr2=0x7f0204142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.623+0000 7f0202d9d700 1 --2- 172.21.15.62:0/1031256824 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f02040b47c0 0x7f0204142e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.623+0000 7f0202d9d700 1 -- 172.21.15.62:0/1031256824 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f02040b40b0 msgr2=0x7f0204142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.623+0000 7f0202d9d700 1 --2- 172.21.15.62:0/1031256824 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f02040b40b0 0x7f0204142960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.623+0000 7f0202d9d700 1 -- 172.21.15.62:0/1031256824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc009530 con 0x7f020405ca90 2021-12-17T18:19:04.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.623+0000 7f0202d9d700 1 --2- 172.21.15.62:0/1031256824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f020405ca90 0x7f0204149500 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f0204062e10 tx=0x7f01f8007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:04.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.623+0000 7f01f3fff700 1 -- 172.21.15.62:0/1031256824 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01f80070d0 con 0x7f020405ca90 2021-12-17T18:19:04.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.623+0000 7f02089a0700 1 -- 172.21.15.62:0/1031256824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0204143340 con 0x7f020405ca90 2021-12-17T18:19:04.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.623+0000 7f01f3fff700 1 -- 172.21.15.62:0/1031256824 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f8007230 con 0x7f020405ca90 2021-12-17T18:19:04.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.623+0000 7f01f3fff700 1 -- 172.21.15.62:0/1031256824 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01f8005740 con 0x7f020405ca90 2021-12-17T18:19:04.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.623+0000 7f02089a0700 1 -- 172.21.15.62:0/1031256824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0204067110 con 0x7f020405ca90 2021-12-17T18:19:04.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.623+0000 7f02089a0700 1 -- 172.21.15.62:0/1031256824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02040b3980 con 0x7f020405ca90 2021-12-17T18:19:04.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.623+0000 7f01f3fff700 1 -- 172.21.15.62:0/1031256824 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f01f8010070 con 0x7f020405ca90 2021-12-17T18:19:04.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.623+0000 7f01f3fff700 1 --2- 172.21.15.62:0/1031256824 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f01e0053580 0x7f01e0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.623+0000 7f01f3fff700 1 -- 172.21.15.62:0/1031256824 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f01f806aed0 con 0x7f020405ca90 2021-12-17T18:19:04.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.627+0000 7f020259c700 1 --2- 172.21.15.62:0/1031256824 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f01e0053580 0x7f01e0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.627+0000 7f020259c700 1 --2- 172.21.15.62:0/1031256824 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f01e0053580 0x7f01e0055a40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f01f400d000 tx=0x7f01f4007b70).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:04.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.631+0000 7f01f3fff700 1 -- 172.21.15.62:0/1031256824 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f01f8041f90 con 0x7f020405ca90 2021-12-17T18:19:04.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.759+0000 7f02089a0700 1 -- 172.21.15.62:0/1031256824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02040573d0 con 0x7f020405ca90 2021-12-17T18:19:04.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.759+0000 7f01f3fff700 1 -- 172.21.15.62:0/1031256824 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+10 (secure 0 0 0) 0x7f01f8018020 con 0x7f020405ca90 2021-12-17T18:19:04.768 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:19:04.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.763+0000 7f02089a0700 1 -- 172.21.15.62:0/1031256824 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f01e0053580 msgr2=0x7f01e0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.763+0000 7f02089a0700 1 --2- 172.21.15.62:0/1031256824 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f01e0053580 0x7f01e0055a40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f01f400d000 tx=0x7f01f4007b70).stop 2021-12-17T18:19:04.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.763+0000 7f02089a0700 1 -- 172.21.15.62:0/1031256824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f020405ca90 msgr2=0x7f0204149500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.763+0000 7f02089a0700 1 --2- 172.21.15.62:0/1031256824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f020405ca90 0x7f0204149500 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f0204062e10 tx=0x7f01f8007c00).stop 2021-12-17T18:19:04.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.763+0000 7f02089a0700 1 -- 172.21.15.62:0/1031256824 shutdown_connections 2021-12-17T18:19:04.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.763+0000 7f02089a0700 1 --2- 172.21.15.62:0/1031256824 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f01e0053580 0x7f01e0055a40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.763+0000 7f02089a0700 1 --2- 172.21.15.62:0/1031256824 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f02040b47c0 0x7f0204142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.763+0000 7f02089a0700 1 --2- 172.21.15.62:0/1031256824 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f02040b40b0 0x7f0204142960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.763+0000 7f02089a0700 1 --2- 172.21.15.62:0/1031256824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f020405ca90 0x7f0204149500 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.763+0000 7f02089a0700 1 -- 172.21.15.62:0/1031256824 >> 172.21.15.62:0/1031256824 conn(0x7f020405bcd0 msgr2=0x7f0204146900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:04.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.763+0000 7f02089a0700 1 -- 172.21.15.62:0/1031256824 shutdown_connections 2021-12-17T18:19:04.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.763+0000 7f02089a0700 1 -- 172.21.15.62:0/1031256824 wait complete. 2021-12-17T18:19:04.779 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:19:04.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.879+0000 7fe618aff700 1 Processor -- start 2021-12-17T18:19:04.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.879+0000 7fe618aff700 1 -- start start 2021-12-17T18:19:04.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe618aff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe6140601b0 0x7fe6140ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe618aff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe6140630e0 0x7fe6140b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe618aff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe614060590 con 0x7fe6140b34b0 2021-12-17T18:19:04.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe618aff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe61413f320 con 0x7fe6140601b0 2021-12-17T18:19:04.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe618aff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6140b2320 con 0x7fe6140630e0 2021-12-17T18:19:04.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe61259c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe6140601b0 0x7fe6140ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe61259c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe6140601b0 0x7fe6140ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49456/0 (socket says 172.21.15.62:49456) 2021-12-17T18:19:04.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe612d9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe6140b34b0 0x7fe6141429d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33040/0 (socket says 172.21.15.62:33040) 2021-12-17T18:19:04.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe61259c700 1 -- 172.21.15.62:0/3752858255 learned_addr learned my addr 172.21.15.62:0/3752858255 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:04.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe611d9b700 1 --2- 172.21.15.62:0/3752858255 >> v2:172.21.15.109:3300/0 conn(0x7fe6140630e0 0x7fe6140b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe61259c700 1 -- 172.21.15.62:0/3752858255 >> v2:172.21.15.109:3300/0 conn(0x7fe6140630e0 msgr2=0x7fe6140b2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:04.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe61259c700 1 --2- 172.21.15.62:0/3752858255 >> v2:172.21.15.109:3300/0 conn(0x7fe6140630e0 0x7fe6140b2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe61259c700 1 -- 172.21.15.62:0/3752858255 >> v1:172.21.15.62:6789/0 conn(0x7fe6140b34b0 legacy=0x7fe6141429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe61159a700 1 -- 172.21.15.62:0/3752858255 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573580523 0 0) 0x7fe614060590 con 0x7fe6140b34b0 2021-12-17T18:19:04.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe61259c700 1 -- 172.21.15.62:0/3752858255 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6140b2880 con 0x7fe6140601b0 2021-12-17T18:19:04.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe61259c700 1 --2- 172.21.15.62:0/3752858255 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6140601b0 0x7fe6140ad770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fe614060720 tx=0x7fe604006f40).ready entity=mon.0 client_cookie=b1d58bd52e4b2e2c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:04.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe61159a700 1 -- 172.21.15.62:0/3752858255 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe60400c900 con 0x7fe6140601b0 2021-12-17T18:19:04.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe61159a700 1 -- 172.21.15.62:0/3752858255 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe604000e90 con 0x7fe6140601b0 2021-12-17T18:19:04.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe61159a700 1 -- 172.21.15.62:0/3752858255 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe60400cc50 con 0x7fe6140601b0 2021-12-17T18:19:04.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe618aff700 1 -- 172.21.15.62:0/3752858255 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6140601b0 msgr2=0x7fe6140ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe618aff700 1 --2- 172.21.15.62:0/3752858255 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6140601b0 0x7fe6140ad770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fe614060720 tx=0x7fe604006f40).stop 2021-12-17T18:19:04.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe618aff700 1 -- 172.21.15.62:0/3752858255 shutdown_connections 2021-12-17T18:19:04.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe618aff700 1 --2- 172.21.15.62:0/3752858255 >> v2:172.21.15.109:3300/0 conn(0x7fe6140630e0 0x7fe6140b2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe618aff700 1 --2- 172.21.15.62:0/3752858255 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6140601b0 0x7fe6140ad770 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe618aff700 1 -- 172.21.15.62:0/3752858255 >> 172.21.15.62:0/3752858255 conn(0x7fe61405cac0 msgr2=0x7fe61405ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:04.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe618aff700 1 -- 172.21.15.62:0/3752858255 shutdown_connections 2021-12-17T18:19:04.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.883+0000 7fe618aff700 1 -- 172.21.15.62:0/3752858255 wait complete. 2021-12-17T18:19:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe618aff700 1 Processor -- start 2021-12-17T18:19:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe618aff700 1 -- start start 2021-12-17T18:19:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe618aff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6140601b0 0x7fe614148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe618aff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6140630e0 0x7fe61413d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe618aff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6140b34b0 0x7fe61413da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe618aff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6141488d0 con 0x7fe6140630e0 2021-12-17T18:19:04.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe618aff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe614110e70 con 0x7fe6140b34b0 2021-12-17T18:19:04.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe618aff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe614110950 con 0x7fe6140601b0 2021-12-17T18:19:04.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe611d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6140630e0 0x7fe61413d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe611d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6140630e0 0x7fe61413d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49464/0 (socket says 172.21.15.62:49464) 2021-12-17T18:19:04.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe611d9b700 1 -- 172.21.15.62:0/3982081731 learned_addr learned my addr 172.21.15.62:0/3982081731 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:04.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe61259c700 1 --2- 172.21.15.62:0/3982081731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6140601b0 0x7fe614148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe612d9d700 1 --2- 172.21.15.62:0/3982081731 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6140b34b0 0x7fe61413da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe611d9b700 1 -- 172.21.15.62:0/3982081731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6140601b0 msgr2=0x7fe614148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe611d9b700 1 --2- 172.21.15.62:0/3982081731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6140601b0 0x7fe614148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe611d9b700 1 -- 172.21.15.62:0/3982081731 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6140b34b0 msgr2=0x7fe61413da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe611d9b700 1 --2- 172.21.15.62:0/3982081731 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6140b34b0 0x7fe61413da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe611d9b700 1 -- 172.21.15.62:0/3982081731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60400a360 con 0x7fe6140630e0 2021-12-17T18:19:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe61259c700 1 --2- 172.21.15.62:0/3982081731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6140601b0 0x7fe614148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:19:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe611d9b700 1 --2- 172.21.15.62:0/3982081731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6140630e0 0x7fe61413d540 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fe6080030b0 tx=0x7fe608008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe6037fe700 1 -- 172.21.15.62:0/3982081731 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe608011780 con 0x7fe6140630e0 2021-12-17T18:19:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe6037fe700 1 -- 172.21.15.62:0/3982081731 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6080118e0 con 0x7fe6140630e0 2021-12-17T18:19:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe618aff700 1 -- 172.21.15.62:0/3982081731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe614110bd0 con 0x7fe6140630e0 2021-12-17T18:19:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe6037fe700 1 -- 172.21.15.62:0/3982081731 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe608011c40 con 0x7fe6140630e0 2021-12-17T18:19:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.887+0000 7fe618aff700 1 -- 172.21.15.62:0/3982081731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe614146740 con 0x7fe6140630e0 2021-12-17T18:19:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.891+0000 7fe618aff700 1 -- 172.21.15.62:0/3982081731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6140b2b20 con 0x7fe6140630e0 2021-12-17T18:19:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.891+0000 7fe6037fe700 1 -- 172.21.15.62:0/3982081731 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe60801c460 con 0x7fe6140630e0 2021-12-17T18:19:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.891+0000 7fe6037fe700 1 --2- 172.21.15.62:0/3982081731 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5f00536a0 0x7fe5f0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.891+0000 7fe6037fe700 1 -- 172.21.15.62:0/3982081731 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe60806bba0 con 0x7fe6140630e0 2021-12-17T18:19:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.891+0000 7fe61259c700 1 --2- 172.21.15.62:0/3982081731 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5f00536a0 0x7fe5f0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.891+0000 7fe61259c700 1 --2- 172.21.15.62:0/3982081731 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5f00536a0 0x7fe5f0055b60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fe604019000 tx=0x7fe6140b2a10).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:04.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:04.899+0000 7fe6037fe700 1 -- 172.21.15.62:0/3982081731 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe608042ca0 con 0x7fe6140630e0 2021-12-17T18:19:05.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.027+0000 7fe618aff700 1 -- 172.21.15.62:0/3982081731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6140573d0 con 0x7fe6140630e0 2021-12-17T18:19:05.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.027+0000 7fe6037fe700 1 -- 172.21.15.62:0/3982081731 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+10 (secure 0 0 0) 0x7fe6080462c0 con 0x7fe6140630e0 2021-12-17T18:19:05.035 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:19:05.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.031+0000 7fe618aff700 1 -- 172.21.15.62:0/3982081731 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5f00536a0 msgr2=0x7fe5f0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:05.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.031+0000 7fe618aff700 1 --2- 172.21.15.62:0/3982081731 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5f00536a0 0x7fe5f0055b60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fe604019000 tx=0x7fe6140b2a10).stop 2021-12-17T18:19:05.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.031+0000 7fe618aff700 1 -- 172.21.15.62:0/3982081731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6140630e0 msgr2=0x7fe61413d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:05.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.031+0000 7fe618aff700 1 --2- 172.21.15.62:0/3982081731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6140630e0 0x7fe61413d540 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fe6080030b0 tx=0x7fe608008040).stop 2021-12-17T18:19:05.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.031+0000 7fe618aff700 1 -- 172.21.15.62:0/3982081731 shutdown_connections 2021-12-17T18:19:05.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.031+0000 7fe618aff700 1 --2- 172.21.15.62:0/3982081731 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5f00536a0 0x7fe5f0055b60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:05.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.031+0000 7fe618aff700 1 --2- 172.21.15.62:0/3982081731 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6140b34b0 0x7fe61413da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:05.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.031+0000 7fe618aff700 1 --2- 172.21.15.62:0/3982081731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6140630e0 0x7fe61413d540 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:05.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.031+0000 7fe618aff700 1 --2- 172.21.15.62:0/3982081731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6140601b0 0x7fe614148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:05.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.031+0000 7fe618aff700 1 -- 172.21.15.62:0/3982081731 >> 172.21.15.62:0/3982081731 conn(0x7fe61405cac0 msgr2=0x7fe6140add50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:05.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.031+0000 7fe618aff700 1 -- 172.21.15.62:0/3982081731 shutdown_connections 2021-12-17T18:19:05.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.031+0000 7fe618aff700 1 -- 172.21.15.62:0/3982081731 wait complete. 2021-12-17T18:19:05.048 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:19:05.048 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:19:05.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67b6239700 1 Processor -- start 2021-12-17T18:19:05.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67b6239700 1 -- start start 2021-12-17T18:19:05.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67b6239700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b005fa70 0x7f67b0147860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:05.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67b6239700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f67b00aefb0 0x7f67b01467b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:05.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67b6239700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b005fe50 con 0x7f67b00af7e0 2021-12-17T18:19:05.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67b6239700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b0148460 con 0x7f67b00aefb0 2021-12-17T18:19:05.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67b6239700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b00ae5d0 con 0x7f67b005fa70 2021-12-17T18:19:05.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67affff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f67b00aefb0 0x7f67b01467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:05.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67affff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f67b00aefb0 0x7f67b01467b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49474/0 (socket says 172.21.15.62:49474) 2021-12-17T18:19:05.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67affff700 1 -- 172.21.15.62:0/1805328028 learned_addr learned my addr 172.21.15.62:0/1805328028 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67af7fe700 1 --2- 172.21.15.62:0/1805328028 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b005fa70 0x7f67b0147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67affff700 1 -- 172.21.15.62:0/1805328028 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b005fa70 msgr2=0x7f67b0147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67affff700 1 --2- 172.21.15.62:0/1805328028 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b005fa70 0x7f67b0147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67affff700 1 -- 172.21.15.62:0/1805328028 >> v1:172.21.15.109:6789/0 conn(0x7f67b00af7e0 legacy=0x7f67b0147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67affff700 1 -- 172.21.15.62:0/1805328028 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b00ae870 con 0x7f67b00aefb0 2021-12-17T18:19:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67affff700 1 --2- 172.21.15.62:0/1805328028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b00aefb0 0x7f67b01467b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f67a8002f70 tx=0x7f67a8006eb0).ready entity=mon.0 client_cookie=2940dd281defaa5 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67ae7fc700 1 -- 172.21.15.62:0/1805328028 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67a800d5c0 con 0x7f67b00aefb0 2021-12-17T18:19:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67ae7fc700 1 -- 172.21.15.62:0/1805328028 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a8000e90 con 0x7f67b00aefb0 2021-12-17T18:19:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67ae7fc700 1 -- 172.21.15.62:0/1805328028 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67a800d950 con 0x7f67b00aefb0 2021-12-17T18:19:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67b6239700 1 -- 172.21.15.62:0/1805328028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b00aefb0 msgr2=0x7f67b01467b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.143+0000 7f67b6239700 1 --2- 172.21.15.62:0/1805328028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b00aefb0 0x7f67b01467b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f67a8002f70 tx=0x7f67a8006eb0).stop 2021-12-17T18:19:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.147+0000 7f67b6239700 1 -- 172.21.15.62:0/1805328028 shutdown_connections 2021-12-17T18:19:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.147+0000 7f67b6239700 1 --2- 172.21.15.62:0/1805328028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b00aefb0 0x7f67b01467b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.147+0000 7f67b6239700 1 --2- 172.21.15.62:0/1805328028 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b005fa70 0x7f67b0147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.147+0000 7f67b6239700 1 -- 172.21.15.62:0/1805328028 >> 172.21.15.62:0/1805328028 conn(0x7f67b005c960 msgr2=0x7f67b005cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.147+0000 7f67b6239700 1 -- 172.21.15.62:0/1805328028 shutdown_connections 2021-12-17T18:19:05.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.147+0000 7f67b6239700 1 -- 172.21.15.62:0/1805328028 wait complete. 2021-12-17T18:19:05.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.147+0000 7f67b6239700 1 Processor -- start 2021-12-17T18:19:05.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.147+0000 7f67b6239700 1 -- start start 2021-12-17T18:19:05.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67b6239700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f67b005fa70 0x7f67b0063ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:05.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67b6239700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b00aefb0 0x7f67b00b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:05.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67b6239700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b00af7e0 0x7f67b00a8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:05.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67b6239700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b00644f0 con 0x7f67b00af7e0 2021-12-17T18:19:05.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67b6239700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b0064790 con 0x7f67b005fa70 2021-12-17T18:19:05.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67b6239700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b0064a30 con 0x7f67b00aefb0 2021-12-17T18:19:05.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67affff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b00af7e0 0x7f67b00a8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:05.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67affff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b00af7e0 0x7f67b00a8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49480/0 (socket says 172.21.15.62:49480) 2021-12-17T18:19:05.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67af7fe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f67b005fa70 0x7f67b0063ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:05.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67affff700 1 -- 172.21.15.62:0/2094712915 learned_addr learned my addr 172.21.15.62:0/2094712915 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:05.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67aeffd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b00aefb0 0x7f67b00b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:05.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67affff700 1 -- 172.21.15.62:0/2094712915 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b00aefb0 msgr2=0x7f67b00b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:05.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67affff700 1 --2- 172.21.15.62:0/2094712915 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b00aefb0 0x7f67b00b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:05.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67affff700 1 -- 172.21.15.62:0/2094712915 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f67b005fa70 msgr2=0x7f67b0063ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:05.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67affff700 1 --2- 172.21.15.62:0/2094712915 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f67b005fa70 0x7f67b0063ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:05.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67affff700 1 -- 172.21.15.62:0/2094712915 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a800b1e0 con 0x7f67b00af7e0 2021-12-17T18:19:05.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67affff700 1 --2- 172.21.15.62:0/2094712915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b00af7e0 0x7f67b00a8010 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f67a8002f70 tx=0x7f67a8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:05.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67acff9700 1 -- 172.21.15.62:0/2094712915 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67a80116e0 con 0x7f67b00af7e0 2021-12-17T18:19:05.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67acff9700 1 -- 172.21.15.62:0/2094712915 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a8011840 con 0x7f67b00af7e0 2021-12-17T18:19:05.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67acff9700 1 -- 172.21.15.62:0/2094712915 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67a8011ba0 con 0x7f67b00af7e0 2021-12-17T18:19:05.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67b6239700 1 -- 172.21.15.62:0/2094712915 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b00a8500 con 0x7f67b00af7e0 2021-12-17T18:19:05.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67b6239700 1 -- 172.21.15.62:0/2094712915 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b0156a00 con 0x7f67b00af7e0 2021-12-17T18:19:05.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67acff9700 1 -- 172.21.15.62:0/2094712915 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f67a8025030 con 0x7f67b00af7e0 2021-12-17T18:19:05.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.151+0000 7f67b6239700 1 -- 172.21.15.62:0/2094712915 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b00aeb10 con 0x7f67b00af7e0 2021-12-17T18:19:05.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.155+0000 7f67acff9700 1 --2- 172.21.15.62:0/2094712915 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6790053640 0x7f6790055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:05.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.155+0000 7f67acff9700 1 -- 172.21.15.62:0/2094712915 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f67a806ca30 con 0x7f67b00af7e0 2021-12-17T18:19:05.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.155+0000 7f67af7fe700 1 --2- 172.21.15.62:0/2094712915 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6790053640 0x7f6790055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:05.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.155+0000 7f67af7fe700 1 --2- 172.21.15.62:0/2094712915 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6790053640 0x7f6790055b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f67a400c000 tx=0x7f67a4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:05.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.159+0000 7f67acff9700 1 -- 172.21.15.62:0/2094712915 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f67a8043b90 con 0x7f67b00af7e0 2021-12-17T18:19:05.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.319+0000 7f67b6239700 1 -- 172.21.15.62:0/2094712915 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67b00573d0 con 0x7f67b00af7e0 2021-12-17T18:19:05.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.323+0000 7f67acff9700 1 -- 172.21.15.62:0/2094712915 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f67a8023020 con 0x7f67b00af7e0 2021-12-17T18:19:05.328 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:19:05.329 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4093989719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4093989719},{"type":"v1","addr":"172.21.15.62:6833","nonce":4093989719}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:19:00.503279+0000","modified":"2021-12-17T18:19:01.505814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4906},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4906":{"gid":4906,"name":"b","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/360945085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":360945085},{"type":"v1","addr":"172.21.15.109:6835","nonce":360945085}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-12-17T18:19:05.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.323+0000 7f67b6239700 1 -- 172.21.15.62:0/2094712915 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6790053640 msgr2=0x7f6790055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:05.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.323+0000 7f67b6239700 1 --2- 172.21.15.62:0/2094712915 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6790053640 0x7f6790055b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f67a400c000 tx=0x7f67a4008040).stop 2021-12-17T18:19:05.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.323+0000 7f67b6239700 1 -- 172.21.15.62:0/2094712915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b00af7e0 msgr2=0x7f67b00a8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:05.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.323+0000 7f67b6239700 1 --2- 172.21.15.62:0/2094712915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b00af7e0 0x7f67b00a8010 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f67a8002f70 tx=0x7f67a8015000).stop 2021-12-17T18:19:05.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.323+0000 7f67b6239700 1 -- 172.21.15.62:0/2094712915 shutdown_connections 2021-12-17T18:19:05.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.323+0000 7f67b6239700 1 --2- 172.21.15.62:0/2094712915 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6790053640 0x7f6790055b00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:05.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.323+0000 7f67b6239700 1 --2- 172.21.15.62:0/2094712915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b00af7e0 0x7f67b00a8010 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:05.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.323+0000 7f67b6239700 1 --2- 172.21.15.62:0/2094712915 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67b00aefb0 0x7f67b00b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:05.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.323+0000 7f67b6239700 1 --2- 172.21.15.62:0/2094712915 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f67b005fa70 0x7f67b0063ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:05.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.323+0000 7f67b6239700 1 -- 172.21.15.62:0/2094712915 >> 172.21.15.62:0/2094712915 conn(0x7f67b005c960 msgr2=0x7f67b014e220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:05.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.323+0000 7f67b6239700 1 -- 172.21.15.62:0/2094712915 shutdown_connections 2021-12-17T18:19:05.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:05.323+0000 7f67b6239700 1 -- 172.21.15.62:0/2094712915 wait complete. 2021-12-17T18:19:05.334 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 10 2021-12-17T18:19:05.543 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:19:00.503279+0000', 'modified': '2021-12-17T18:19:01.505814+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4906}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4906': {'gid': 4906, 'name': 'b', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.109:6835/360945085', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.109:6834', 'nonce': 360945085}, {'type': 'v1', 'addr': '172.21.15.109:6835', 'nonce': 360945085}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:19:05.543 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:19:05.544 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-12-17T18:19:05.657 INFO:teuthology.orchestra.run.smithi109.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":4906,"want_state":"up:active","state":"up:active","rank_uptime":5.139917209,"mdsmap_epoch":10,"osdmap_epoch":33,"osdmap_epoch_barrier":32,"uptime":11.743300001} 2021-12-17T18:19:05.658 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 4906, "mdsmap_epoch": 10, "osdmap_epoch": 33, "osdmap_epoch_barrier": 32, "rank_uptime": 5.139917209, "state": "up:active", "uptime": 11.743300001, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:19:05.658 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:19:05.659 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-12-17T18:19:05.659 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-12-17T18:19:05.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:19:05.660 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:19:05.669 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:19:05.729 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:19:05.729 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:19:05.740 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:19:05.741 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:19:05.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:19:05.742 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:19:05.747 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:19:05.748 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:19:05.750 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:19:05.768 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:19:05.768 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:19:05.827 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:19:05.828 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2021-12-17T18:19:05.823+0000 7f68ce8ae080 -1 init, newargv = 0x55d3b4f24420 newargc=9 2021-12-17T18:19:05.828 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[13949]: starting ceph client 2021-12-17T18:19:05.829 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:19:05.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:19:05.830 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:19:05.838 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[13949]: starting fuse 2021-12-17T18:19:06.936 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:19:06.954 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:19:06.955 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:19:07.011 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:19:07.012 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:19:07.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:19:07.014 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:19:07.020 INFO:teuthology.orchestra.run.smithi125.stdout:52 2021-12-17T18:19:07.020 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:19:07.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:19:07.021 DEBUG:teuthology.orchestra.run.smithi125:> sudo python3 -c ' 2021-12-17T18:19:07.022 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2021-12-17T18:19:07.022 DEBUG:teuthology.orchestra.run.smithi125:> import re 2021-12-17T18:19:07.023 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:19:07.023 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2021-12-17T18:19:07.024 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:19:07.024 DEBUG:teuthology.orchestra.run.smithi125:> def find_socket(client_name): 2021-12-17T18:19:07.024 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-12-17T18:19:07.025 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2021-12-17T18:19:07.025 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:19:07.026 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2021-12-17T18:19:07.026 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2021-12-17T18:19:07.026 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2021-12-17T18:19:07.027 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2021-12-17T18:19:07.027 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:19:07.028 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2021-12-17T18:19:07.028 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:19:07.028 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:19:07.029 DEBUG:teuthology.orchestra.run.smithi125:> return f 2021-12-17T18:19:07.029 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:19:07.030 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:19:07.030 DEBUG:teuthology.orchestra.run.smithi125:> print(find_socket("client.0")) 2021-12-17T18:19:07.030 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:19:07.073 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.13949.asok 2021-12-17T18:19:07.078 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13949.asok 2021-12-17T18:19:07.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:19:07.079 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13949.asok status 2021-12-17T18:19:07.167 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2021-12-17T18:19:07.168 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2021-12-17T18:19:07.168 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:19:07.168 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:19:07.168 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2021-12-17T18:19:07.169 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2021-12-17T18:19:07.169 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-12-17T18:19:07.169 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "13949", 2021-12-17T18:19:07.169 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2021-12-17T18:19:07.170 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:19:07.170 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2021-12-17T18:19:07.170 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2021-12-17T18:19:07.170 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5130, 2021-12-17T18:19:07.171 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2021-12-17T18:19:07.171 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2021-12-17T18:19:07.171 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2021-12-17T18:19:07.171 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 5130 2021-12-17T18:19:07.172 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:19:07.172 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:19:07.172 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:19:07.172 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:19:07.173 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 4173996375 2021-12-17T18:19:07.173 INFO:teuthology.orchestra.run.smithi125.stdout: } 2021-12-17T18:19:07.173 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:19:07.173 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:19:07.174 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:19:07.174 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:19:07.174 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 4173996375 2021-12-17T18:19:07.174 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:19:07.175 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.5130 172.21.15.125:0/4173996375", 2021-12-17T18:19:07.175 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "172.21.15.125:0/4173996375", 2021-12-17T18:19:07.175 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2021-12-17T18:19:07.175 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 10, 2021-12-17T18:19:07.176 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 33, 2021-12-17T18:19:07.176 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:19:07.176 INFO:teuthology.orchestra.run.smithi125.stdout: "blacklisted": false, 2021-12-17T18:19:07.176 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2021-12-17T18:19:07.177 INFO:teuthology.orchestra.run.smithi125.stdout:} 2021-12-17T18:19:07.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:19:07.179 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:19:07.180 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:19:07.186 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:19:07.187 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:19:07.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:19:07.188 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:19:07.206 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_min_caps_per_client 2021-12-17T18:19:07.314 INFO:teuthology.orchestra.run.smithi062.stdout:{"mds_min_caps_per_client":"100"} 2021-12-17T18:19:07.314 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_min_caps_per_client": "100" } 2021-12-17T18:19:07.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:19:07.315 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:19:07.316 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:19:07.324 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:19:07.326 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:19:07.327 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-12-17T18:19:07.327 DEBUG:teuthology.orchestra.run.smithi125:> import sys 2021-12-17T18:19:07.327 DEBUG:teuthology.orchestra.run.smithi125:> import time 2021-12-17T18:19:07.328 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:19:07.328 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:19:07.329 DEBUG:teuthology.orchestra.run.smithi125:> n = 1000 2021-12-17T18:19:07.329 DEBUG:teuthology.orchestra.run.smithi125:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-12-17T18:19:07.330 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:19:07.330 DEBUG:teuthology.orchestra.run.smithi125:> if not os.path.exists(os.path.dirname(abs_path)): 2021-12-17T18:19:07.330 DEBUG:teuthology.orchestra.run.smithi125:> os.makedirs(os.path.dirname(abs_path)) 2021-12-17T18:19:07.331 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:19:07.331 DEBUG:teuthology.orchestra.run.smithi125:> for i in range(0, n): 2021-12-17T18:19:07.332 DEBUG:teuthology.orchestra.run.smithi125:> fname = "{0}_{1}".format(abs_path, i) 2021-12-17T18:19:07.332 DEBUG:teuthology.orchestra.run.smithi125:> with open(fname, '"'"'w'"'"') as f: 2021-12-17T18:19:07.332 DEBUG:teuthology.orchestra.run.smithi125:> f.write('"'"'content'"'"') 2021-12-17T18:19:07.333 DEBUG:teuthology.orchestra.run.smithi125:> if True: 2021-12-17T18:19:07.333 DEBUG:teuthology.orchestra.run.smithi125:> f.flush() 2021-12-17T18:19:07.334 DEBUG:teuthology.orchestra.run.smithi125:> os.fsync(f.fileno()) 2021-12-17T18:19:07.334 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:19:18.218 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:19:18.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e533da700 1 Processor -- start 2021-12-17T18:19:18.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e533da700 1 -- start start 2021-12-17T18:19:18.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e533da700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3e4c067770 0x7f3e4c0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:18.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e533da700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f3e4c0b4780 0x7f3e4c1406a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:18.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e533da700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c0b27c0 con 0x7f3e4c0b3eb0 2021-12-17T18:19:18.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e533da700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c144730 con 0x7f3e4c067770 2021-12-17T18:19:18.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e533da700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c1449d0 con 0x7f3e4c0b4780 2021-12-17T18:19:18.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e50975700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3e4c067770 0x7f3e4c0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:18.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e50975700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3e4c067770 0x7f3e4c0b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49486/0 (socket says 172.21.15.62:49486) 2021-12-17T18:19:18.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e51176700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3e4c0b3eb0 0x7f3e4c145110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33064/0 (socket says 172.21.15.62:33064) 2021-12-17T18:19:18.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e50975700 1 -- 172.21.15.62:0/3901553522 learned_addr learned my addr 172.21.15.62:0/3901553522 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:18.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e51977700 1 --2- 172.21.15.62:0/3901553522 >> v2:172.21.15.109:3300/0 conn(0x7f3e4c0b4780 0x7f3e4c1406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:18.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e50975700 1 -- 172.21.15.62:0/3901553522 >> v2:172.21.15.109:3300/0 conn(0x7f3e4c0b4780 msgr2=0x7f3e4c1406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:18.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e50975700 1 --2- 172.21.15.62:0/3901553522 >> v2:172.21.15.109:3300/0 conn(0x7f3e4c0b4780 0x7f3e4c1406a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e50975700 1 -- 172.21.15.62:0/3901553522 >> v1:172.21.15.62:6789/0 conn(0x7f3e4c0b3eb0 legacy=0x7f3e4c145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:18.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e50975700 1 -- 172.21.15.62:0/3901553522 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c144c70 con 0x7f3e4c067770 2021-12-17T18:19:18.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e50975700 1 --2- 172.21.15.62:0/3901553522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c067770 0x7f3e4c0b4290 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f3e3c002f70 tx=0x7f3e3c006eb0).ready entity=mon.0 client_cookie=19636cb5375faf5 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:18.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e43fff700 1 -- 172.21.15.62:0/3901553522 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e3c00d610 con 0x7f3e4c067770 2021-12-17T18:19:18.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e43fff700 1 -- 172.21.15.62:0/3901553522 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c000e90 con 0x7f3e4c067770 2021-12-17T18:19:18.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e43fff700 1 -- 172.21.15.62:0/3901553522 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e3c00d9a0 con 0x7f3e4c067770 2021-12-17T18:19:18.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e533da700 1 -- 172.21.15.62:0/3901553522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c067770 msgr2=0x7f3e4c0b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:18.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e533da700 1 --2- 172.21.15.62:0/3901553522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c067770 0x7f3e4c0b4290 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f3e3c002f70 tx=0x7f3e3c006eb0).stop 2021-12-17T18:19:18.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e533da700 1 -- 172.21.15.62:0/3901553522 shutdown_connections 2021-12-17T18:19:18.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e533da700 1 --2- 172.21.15.62:0/3901553522 >> v2:172.21.15.109:3300/0 conn(0x7f3e4c0b4780 0x7f3e4c1406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e533da700 1 --2- 172.21.15.62:0/3901553522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c067770 0x7f3e4c0b4290 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e533da700 1 -- 172.21.15.62:0/3901553522 >> 172.21.15.62:0/3901553522 conn(0x7f3e4c05cb40 msgr2=0x7f3e4c05cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:18.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e533da700 1 -- 172.21.15.62:0/3901553522 shutdown_connections 2021-12-17T18:19:18.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.327+0000 7f3e533da700 1 -- 172.21.15.62:0/3901553522 wait complete. 2021-12-17T18:19:18.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.331+0000 7f3e533da700 1 Processor -- start 2021-12-17T18:19:18.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.331+0000 7f3e533da700 1 -- start start 2021-12-17T18:19:18.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e533da700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3e4c067770 0x7f3e4c140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:18.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e533da700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3e4c0b3eb0 0x7f3e4c0ac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:18.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e533da700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c0b4780 0x7f3e4c0ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:18.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e533da700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0abcd0 con 0x7f3e4c0b4780 2021-12-17T18:19:18.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e533da700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0aef90 con 0x7f3e4c0b3eb0 2021-12-17T18:19:18.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e533da700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c141410 con 0x7f3e4c067770 2021-12-17T18:19:18.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e51977700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c0b4780 0x7f3e4c0ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:18.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e51977700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c0b4780 0x7f3e4c0ac5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49494/0 (socket says 172.21.15.62:49494) 2021-12-17T18:19:18.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e51977700 1 -- 172.21.15.62:0/2004369489 learned_addr learned my addr 172.21.15.62:0/2004369489 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:18.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e50975700 1 --2- 172.21.15.62:0/2004369489 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3e4c0b3eb0 0x7f3e4c0ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:18.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e51176700 1 --2- 172.21.15.62:0/2004369489 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3e4c067770 0x7f3e4c140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:18.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e51977700 1 -- 172.21.15.62:0/2004369489 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3e4c067770 msgr2=0x7f3e4c140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:18.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e51977700 1 --2- 172.21.15.62:0/2004369489 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3e4c067770 0x7f3e4c140f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e51977700 1 -- 172.21.15.62:0/2004369489 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3e4c0b3eb0 msgr2=0x7f3e4c0ac100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:18.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e51977700 1 --2- 172.21.15.62:0/2004369489 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3e4c0b3eb0 0x7f3e4c0ac100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e51977700 1 -- 172.21.15.62:0/2004369489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c00b1e0 con 0x7f3e4c0b4780 2021-12-17T18:19:18.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e51977700 1 --2- 172.21.15.62:0/2004369489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c0b4780 0x7f3e4c0ac5f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f3e4400a000 tx=0x7f3e44008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:18.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e427fc700 1 -- 172.21.15.62:0/2004369489 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e440127e0 con 0x7f3e4c0b4780 2021-12-17T18:19:18.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e533da700 1 -- 172.21.15.62:0/2004369489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c0af230 con 0x7f3e4c0b4780 2021-12-17T18:19:18.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e427fc700 1 -- 172.21.15.62:0/2004369489 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e44012940 con 0x7f3e4c0b4780 2021-12-17T18:19:18.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e427fc700 1 -- 172.21.15.62:0/2004369489 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e44012ca0 con 0x7f3e4c0b4780 2021-12-17T18:19:18.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e533da700 1 -- 172.21.15.62:0/2004369489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c0ad3b0 con 0x7f3e4c0b4780 2021-12-17T18:19:18.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e427fc700 1 -- 172.21.15.62:0/2004369489 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3e44013480 con 0x7f3e4c0b4780 2021-12-17T18:19:18.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.335+0000 7f3e533da700 1 -- 172.21.15.62:0/2004369489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4c0573d0 con 0x7f3e4c0b4780 2021-12-17T18:19:18.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.339+0000 7f3e427fc700 1 --2- 172.21.15.62:0/2004369489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3e340534f0 0x7f3e340559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:18.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.339+0000 7f3e427fc700 1 -- 172.21.15.62:0/2004369489 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3e4406bca0 con 0x7f3e4c0b4780 2021-12-17T18:19:18.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.339+0000 7f3e51176700 1 --2- 172.21.15.62:0/2004369489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3e340534f0 0x7f3e340559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:18.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.339+0000 7f3e51176700 1 --2- 172.21.15.62:0/2004369489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3e340534f0 0x7f3e340559b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f3e4800d000 tx=0x7f3e48007b80).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:18.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.347+0000 7f3e427fc700 1 -- 172.21.15.62:0/2004369489 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3e44070070 con 0x7f3e4c0b4780 2021-12-17T18:19:18.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.511+0000 7f3e533da700 1 -- 172.21.15.62:0/2004369489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e4c06a2b0 con 0x7f3e4c0b4780 2021-12-17T18:19:18.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.511+0000 7f3e427fc700 1 -- 172.21.15.62:0/2004369489 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f3e44042d00 con 0x7f3e4c0b4780 2021-12-17T18:19:18.518 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:19:18.518 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4093989719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4093989719},{"type":"v1","addr":"172.21.15.62:6833","nonce":4093989719}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:19:00.503279+0000","modified":"2021-12-17T18:19:01.505814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4906},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4906":{"gid":4906,"name":"b","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/360945085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":360945085},{"type":"v1","addr":"172.21.15.109:6835","nonce":360945085}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-12-17T18:19:18.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.511+0000 7f3e533da700 1 -- 172.21.15.62:0/2004369489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3e340534f0 msgr2=0x7f3e340559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:18.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.511+0000 7f3e533da700 1 --2- 172.21.15.62:0/2004369489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3e340534f0 0x7f3e340559b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f3e4800d000 tx=0x7f3e48007b80).stop 2021-12-17T18:19:18.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.511+0000 7f3e533da700 1 -- 172.21.15.62:0/2004369489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c0b4780 msgr2=0x7f3e4c0ac5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:18.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.511+0000 7f3e533da700 1 --2- 172.21.15.62:0/2004369489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c0b4780 0x7f3e4c0ac5f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f3e4400a000 tx=0x7f3e44008040).stop 2021-12-17T18:19:18.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.511+0000 7f3e533da700 1 -- 172.21.15.62:0/2004369489 shutdown_connections 2021-12-17T18:19:18.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.511+0000 7f3e533da700 1 --2- 172.21.15.62:0/2004369489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3e340534f0 0x7f3e340559b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.511+0000 7f3e533da700 1 --2- 172.21.15.62:0/2004369489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c0b4780 0x7f3e4c0ac5f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.511+0000 7f3e533da700 1 --2- 172.21.15.62:0/2004369489 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3e4c0b3eb0 0x7f3e4c0ac100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.511+0000 7f3e533da700 1 --2- 172.21.15.62:0/2004369489 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3e4c067770 0x7f3e4c140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.511+0000 7f3e533da700 1 -- 172.21.15.62:0/2004369489 >> 172.21.15.62:0/2004369489 conn(0x7f3e4c05cb40 msgr2=0x7f3e4c143ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:18.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.515+0000 7f3e533da700 1 -- 172.21.15.62:0/2004369489 shutdown_connections 2021-12-17T18:19:18.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.515+0000 7f3e533da700 1 -- 172.21.15.62:0/2004369489 wait complete. 2021-12-17T18:19:18.523 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 10 2021-12-17T18:19:18.531 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_recall_max_caps 20 2021-12-17T18:19:18.645 INFO:teuthology.orchestra.run.smithi109.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-12-17T18:19:18.645 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-12-17T18:19:18.646 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:19:18.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.751+0000 7fe2a0f48700 1 Processor -- start 2021-12-17T18:19:18.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.751+0000 7fe2a0f48700 1 -- start start 2021-12-17T18:19:18.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.751+0000 7fe2a0f48700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe29c0b2370 0x7fe29c0b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:18.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.751+0000 7fe2a0f48700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe29c13f470 0x7fe29c143000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:18.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.751+0000 7fe2a0f48700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29c0ad9f0 con 0x7fe29c0ad610 2021-12-17T18:19:18.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.751+0000 7fe2a0f48700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29c0ad010 con 0x7fe29c0b2370 2021-12-17T18:19:18.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.751+0000 7fe2a0f48700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c0b19e0 con 0x7fe29c13f470 2021-12-17T18:19:18.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.751+0000 7fe29a59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe29c0ad610 0x7fe29c13ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33078/0 (socket says 172.21.15.62:33078) 2021-12-17T18:19:18.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.751+0000 7fe29a59c700 1 -- 172.21.15.62:0/4120475628 learned_addr learned my addr 172.21.15.62:0/4120475628 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:19:18.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe293fff700 1 --2- 172.21.15.62:0/4120475628 >> v2:172.21.15.109:3300/0 conn(0x7fe29c0b2370 0x7fe29c0b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:18.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe29ad9d700 1 --2- 172.21.15.62:0/4120475628 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe29c13f470 0x7fe29c143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:18.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 -- 172.21.15.62:0/4120475628 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402122490 0 0) 0x7fe29c0ad9f0 con 0x7fe29c0ad610 2021-12-17T18:19:18.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 -- 172.21.15.62:0/4120475628 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe27c004370 con 0x7fe29c0ad610 2021-12-17T18:19:18.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 -- 172.21.15.62:0/4120475628 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 291639025 0 0) 0x7fe27c004370 con 0x7fe29c0ad610 2021-12-17T18:19:18.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 -- 172.21.15.62:0/4120475628 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe29c13f470 msgr2=0x7fe29c143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:18.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 --2- 172.21.15.62:0/4120475628 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe29c13f470 0x7fe29c143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 -- 172.21.15.62:0/4120475628 >> v2:172.21.15.109:3300/0 conn(0x7fe29c0b2370 msgr2=0x7fe29c0b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:18.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 --2- 172.21.15.62:0/4120475628 >> v2:172.21.15.109:3300/0 conn(0x7fe29c0b2370 0x7fe29c0b0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 -- 172.21.15.62:0/4120475628 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c0b1c80 con 0x7fe29c0ad610 2021-12-17T18:19:18.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 -- 172.21.15.62:0/4120475628 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fe28c001660 con 0x7fe29c0ad610 2021-12-17T18:19:18.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 -- 172.21.15.62:0/4120475628 >> v1:172.21.15.62:6789/0 conn(0x7fe29c0ad610 legacy=0x7fe29c13ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:18.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 --2- 172.21.15.62:0/4120475628 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe27c004860 0x7fe27c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:18.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 --2- 172.21.15.62:0/4120475628 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe29c13f470 0x7fe27c005610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:18.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 --2- 172.21.15.62:0/4120475628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe27c005b00 0x7fe27c005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:18.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 -- 172.21.15.62:0/4120475628 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c0b19e0 con 0x7fe27c005b00 2021-12-17T18:19:18.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 -- 172.21.15.62:0/4120475628 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c005440 con 0x7fe27c004860 2021-12-17T18:19:18.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 -- 172.21.15.62:0/4120475628 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c00c8b0 con 0x7fe29c13f470 2021-12-17T18:19:18.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe29a59c700 1 --2- 172.21.15.62:0/4120475628 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe27c004860 0x7fe27c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:18.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe29ad9d700 1 --2- 172.21.15.62:0/4120475628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe27c005b00 0x7fe27c005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe293fff700 1 --2- 172.21.15.62:0/4120475628 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe29c13f470 0x7fe27c005610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe29a59c700 1 -- 172.21.15.62:0/4120475628 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe29c13f470 msgr2=0x7fe27c005610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe29a59c700 1 --2- 172.21.15.62:0/4120475628 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe29c13f470 0x7fe27c005610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe29a59c700 1 -- 172.21.15.62:0/4120475628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe27c005b00 msgr2=0x7fe27c005f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:18.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe29a59c700 1 --2- 172.21.15.62:0/4120475628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe27c005b00 0x7fe27c005f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe29a59c700 1 -- 172.21.15.62:0/4120475628 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c004370 con 0x7fe27c004860 2021-12-17T18:19:18.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe29a59c700 1 --2- 172.21.15.62:0/4120475628 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe27c004860 0x7fe27c004c80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fe28c001370 tx=0x7fe28c001e50).ready entity=mon.1 client_cookie=a7b6be2efe27bfcf server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:18.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 -- 172.21.15.62:0/4120475628 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe28c0070d0 con 0x7fe27c004860 2021-12-17T18:19:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 -- 172.21.15.62:0/4120475628 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c007230 con 0x7fe27c004860 2021-12-17T18:19:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe299d9b700 1 -- 172.21.15.62:0/4120475628 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe28c00c9c0 con 0x7fe27c004860 2021-12-17T18:19:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe2a0f48700 1 -- 172.21.15.62:0/4120475628 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe27c004860 msgr2=0x7fe27c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe2a0f48700 1 --2- 172.21.15.62:0/4120475628 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe27c004860 0x7fe27c004c80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fe28c001370 tx=0x7fe28c001e50).stop 2021-12-17T18:19:18.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe29ad9d700 1 -- 172.21.15.62:0/4120475628 reap_dead start 2021-12-17T18:19:18.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe2a0f48700 1 -- 172.21.15.62:0/4120475628 shutdown_connections 2021-12-17T18:19:18.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe2a0f48700 1 -- 172.21.15.62:0/4120475628 >> 172.21.15.62:0/4120475628 conn(0x7fe29c05c750 msgr2=0x7fe29c0630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:18.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe2a0f48700 1 -- 172.21.15.62:0/4120475628 shutdown_connections 2021-12-17T18:19:18.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.755+0000 7fe2a0f48700 1 -- 172.21.15.62:0/4120475628 wait complete. 2021-12-17T18:19:18.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe2a0f48700 1 Processor -- start 2021-12-17T18:19:18.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe2a0f48700 1 -- start start 2021-12-17T18:19:18.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe2a0f48700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe27c004860 0x7fe29c0ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:18.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe2a0f48700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe29c1516c0 0x7fe29c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:18.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe2a0f48700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe29c152030 0x7fe29c138f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:18.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe2a0f48700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c067590 con 0x7fe27c004860 2021-12-17T18:19:18.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe2a0f48700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c0645e0 con 0x7fe29c152030 2021-12-17T18:19:18.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe2a0f48700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c064880 con 0x7fe29c1516c0 2021-12-17T18:19:18.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe29a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe27c004860 0x7fe29c0ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:18.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe29a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe27c004860 0x7fe29c0ac1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49510/0 (socket says 172.21.15.62:49510) 2021-12-17T18:19:18.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe29a59c700 1 -- 172.21.15.62:0/3059000291 learned_addr learned my addr 172.21.15.62:0/3059000291 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:18.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe29ad9d700 1 --2- 172.21.15.62:0/3059000291 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe29c152030 0x7fe29c138f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:18.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe293fff700 1 --2- 172.21.15.62:0/3059000291 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe29c1516c0 0x7fe29c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:18.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe29a59c700 1 -- 172.21.15.62:0/3059000291 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe29c1516c0 msgr2=0x7fe29c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:18.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe29a59c700 1 --2- 172.21.15.62:0/3059000291 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe29c1516c0 0x7fe29c151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe29a59c700 1 -- 172.21.15.62:0/3059000291 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe29c152030 msgr2=0x7fe29c138f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe29a59c700 1 --2- 172.21.15.62:0/3059000291 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe29c152030 0x7fe29c138f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.759+0000 7fe29a59c700 1 -- 172.21.15.62:0/3059000291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c064b20 con 0x7fe27c004860 2021-12-17T18:19:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.763+0000 7fe29a59c700 1 --2- 172.21.15.62:0/3059000291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe27c004860 0x7fe29c0ac1f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fe28c001370 tx=0x7fe28c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.763+0000 7fe2937fe700 1 -- 172.21.15.62:0/3059000291 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe28c020030 con 0x7fe27c004860 2021-12-17T18:19:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.763+0000 7fe2937fe700 1 -- 172.21.15.62:0/3059000291 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c004520 con 0x7fe27c004860 2021-12-17T18:19:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.763+0000 7fe2a0f48700 1 -- 172.21.15.62:0/3059000291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29c1524b0 con 0x7fe27c004860 2021-12-17T18:19:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.763+0000 7fe2937fe700 1 -- 172.21.15.62:0/3059000291 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe28c004880 con 0x7fe27c004860 2021-12-17T18:19:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.763+0000 7fe2a0f48700 1 -- 172.21.15.62:0/3059000291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29c13e550 con 0x7fe27c004860 2021-12-17T18:19:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.763+0000 7fe2a0f48700 1 -- 172.21.15.62:0/3059000291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29c0b1f20 con 0x7fe27c004860 2021-12-17T18:19:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.763+0000 7fe2937fe700 1 -- 172.21.15.62:0/3059000291 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe28c010070 con 0x7fe27c004860 2021-12-17T18:19:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.763+0000 7fe2937fe700 1 --2- 172.21.15.62:0/3059000291 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe2800536a0 0x7fe280055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.763+0000 7fe2937fe700 1 -- 172.21.15.62:0/3059000291 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe28c021070 con 0x7fe27c004860 2021-12-17T18:19:18.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.763+0000 7fe293fff700 1 --2- 172.21.15.62:0/3059000291 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe2800536a0 0x7fe280055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:18.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.767+0000 7fe293fff700 1 --2- 172.21.15.62:0/3059000291 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe2800536a0 0x7fe280055b60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fe28400b000 tx=0x7fe284006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:18.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.771+0000 7fe2937fe700 1 -- 172.21.15.62:0/3059000291 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe28c045550 con 0x7fe27c004860 2021-12-17T18:19:18.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.935+0000 7fe2a0f48700 1 -- 172.21.15.62:0/3059000291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe29c0573d0 con 0x7fe27c004860 2021-12-17T18:19:18.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.939+0000 7fe2937fe700 1 -- 172.21.15.62:0/3059000291 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fe28c01a040 con 0x7fe27c004860 2021-12-17T18:19:18.944 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:19:18.944 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4093989719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4093989719},{"type":"v1","addr":"172.21.15.62:6833","nonce":4093989719}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:19:00.503279+0000","modified":"2021-12-17T18:19:01.505814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4906},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4906":{"gid":4906,"name":"b","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/360945085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":360945085},{"type":"v1","addr":"172.21.15.109:6835","nonce":360945085}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-12-17T18:19:18.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.939+0000 7fe2a0f48700 1 -- 172.21.15.62:0/3059000291 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe2800536a0 msgr2=0x7fe280055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:18.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.939+0000 7fe2a0f48700 1 --2- 172.21.15.62:0/3059000291 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe2800536a0 0x7fe280055b60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fe28400b000 tx=0x7fe284006df0).stop 2021-12-17T18:19:18.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.939+0000 7fe2a0f48700 1 -- 172.21.15.62:0/3059000291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe27c004860 msgr2=0x7fe29c0ac1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:18.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.939+0000 7fe2a0f48700 1 --2- 172.21.15.62:0/3059000291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe27c004860 0x7fe29c0ac1f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fe28c001370 tx=0x7fe28c015000).stop 2021-12-17T18:19:18.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.939+0000 7fe2a0f48700 1 -- 172.21.15.62:0/3059000291 shutdown_connections 2021-12-17T18:19:18.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.939+0000 7fe2a0f48700 1 --2- 172.21.15.62:0/3059000291 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe2800536a0 0x7fe280055b60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.939+0000 7fe2a0f48700 1 --2- 172.21.15.62:0/3059000291 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe29c152030 0x7fe29c138f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.939+0000 7fe2a0f48700 1 --2- 172.21.15.62:0/3059000291 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe29c1516c0 0x7fe29c151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.939+0000 7fe2a0f48700 1 --2- 172.21.15.62:0/3059000291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe27c004860 0x7fe29c0ac1f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:18.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.939+0000 7fe2a0f48700 1 -- 172.21.15.62:0/3059000291 >> 172.21.15.62:0/3059000291 conn(0x7fe29c05c750 msgr2=0x7fe29c13fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:18.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.939+0000 7fe2a0f48700 1 -- 172.21.15.62:0/3059000291 shutdown_connections 2021-12-17T18:19:18.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:18.939+0000 7fe2a0f48700 1 -- 172.21.15.62:0/3059000291 wait complete. 2021-12-17T18:19:18.949 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 10 2021-12-17T18:19:18.956 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_recall_max_decay_threshold 400 2021-12-17T18:19:19.058 INFO:teuthology.orchestra.run.smithi109.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-12-17T18:19:19.059 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-12-17T18:19:19.059 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:19:19.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.163+0000 7f6b2cc46700 1 Processor -- start 2021-12-17T18:19:19.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.163+0000 7f6b2cc46700 1 -- start start 2021-12-17T18:19:19.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.163+0000 7f6b2cc46700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6b280a8e10 0x7f6b28147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.163+0000 7f6b2cc46700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6b280a71e0 0x7f6b280a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.163+0000 7f6b2cc46700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b280b6270 con 0x7f6b28141480 2021-12-17T18:19:19.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.163+0000 7f6b2cc46700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b28147610 con 0x7f6b280a8e10 2021-12-17T18:19:19.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.163+0000 7f6b2cc46700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b281478b0 con 0x7f6b280a71e0 2021-12-17T18:19:19.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.163+0000 7f6b26ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6b280a8e10 0x7f6b28147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.163+0000 7f6b277fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6b28141480 0x7f6b280b5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33100/0 (socket says 172.21.15.62:33100) 2021-12-17T18:19:19.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.163+0000 7f6b277fe700 1 -- 172.21.15.62:0/668806628 learned_addr learned my addr 172.21.15.62:0/668806628 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:19:19.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.163+0000 7f6b27fff700 1 --2- 172.21.15.62:0/668806628 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6b280a71e0 0x7f6b280a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b267fc700 1 -- 172.21.15.62:0/668806628 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178757998 0 0) 0x7f6b280b6270 con 0x7f6b28141480 2021-12-17T18:19:19.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b26ffd700 1 -- 172.21.15.62:0/668806628 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6b280a71e0 msgr2=0x7f6b280a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:19.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b26ffd700 1 --2- 172.21.15.62:0/668806628 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6b280a71e0 0x7f6b280a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b26ffd700 1 -- 172.21.15.62:0/668806628 >> v1:172.21.15.62:6789/0 conn(0x7f6b28141480 legacy=0x7f6b280b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:19.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b26ffd700 1 -- 172.21.15.62:0/668806628 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b28147b50 con 0x7f6b280a8e10 2021-12-17T18:19:19.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b27fff700 1 --2- 172.21.15.62:0/668806628 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6b280a71e0 0x7f6b280a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:19:19.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b26ffd700 1 --2- 172.21.15.62:0/668806628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b280a8e10 0x7f6b28147ff0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f6b18002f70 tx=0x7f6b18006df0).ready entity=mon.0 client_cookie=9aafcc372c53d8c2 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:19.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b267fc700 1 -- 172.21.15.62:0/668806628 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b1800d570 con 0x7f6b280a8e10 2021-12-17T18:19:19.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b267fc700 1 -- 172.21.15.62:0/668806628 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b18000e90 con 0x7f6b280a8e10 2021-12-17T18:19:19.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b267fc700 1 -- 172.21.15.62:0/668806628 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b1800d8c0 con 0x7f6b280a8e10 2021-12-17T18:19:19.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b2cc46700 1 -- 172.21.15.62:0/668806628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b280a8e10 msgr2=0x7f6b28147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:19.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b2cc46700 1 --2- 172.21.15.62:0/668806628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b280a8e10 0x7f6b28147ff0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f6b18002f70 tx=0x7f6b18006df0).stop 2021-12-17T18:19:19.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b2cc46700 1 -- 172.21.15.62:0/668806628 shutdown_connections 2021-12-17T18:19:19.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b2cc46700 1 --2- 172.21.15.62:0/668806628 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6b280a71e0 0x7f6b280a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b2cc46700 1 --2- 172.21.15.62:0/668806628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b280a8e10 0x7f6b28147ff0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b2cc46700 1 -- 172.21.15.62:0/668806628 >> 172.21.15.62:0/668806628 conn(0x7f6b2805d220 msgr2=0x7f6b280b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:19.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b2cc46700 1 -- 172.21.15.62:0/668806628 shutdown_connections 2021-12-17T18:19:19.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.167+0000 7f6b2cc46700 1 -- 172.21.15.62:0/668806628 wait complete. 2021-12-17T18:19:19.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b2cc46700 1 Processor -- start 2021-12-17T18:19:19.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b2cc46700 1 -- start start 2021-12-17T18:19:19.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b2cc46700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b280a71e0 0x7f6b280ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b2cc46700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6b280a8e10 0x7f6b280abec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b2cc46700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6b28141480 0x7f6b280aa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b2cc46700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b28149480 con 0x7f6b280a71e0 2021-12-17T18:19:19.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b2cc46700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280ab250 con 0x7f6b28141480 2021-12-17T18:19:19.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b2cc46700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280ab4b0 con 0x7f6b280a8e10 2021-12-17T18:19:19.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b277fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b280a71e0 0x7f6b280ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b277fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b280a71e0 0x7f6b280ab950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49524/0 (socket says 172.21.15.62:49524) 2021-12-17T18:19:19.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b277fe700 1 -- 172.21.15.62:0/3893913018 learned_addr learned my addr 172.21.15.62:0/3893913018 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:19.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b26ffd700 1 --2- 172.21.15.62:0/3893913018 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6b280a8e10 0x7f6b280abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b27fff700 1 --2- 172.21.15.62:0/3893913018 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6b28141480 0x7f6b280aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b277fe700 1 -- 172.21.15.62:0/3893913018 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6b280a8e10 msgr2=0x7f6b280abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:19.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b277fe700 1 --2- 172.21.15.62:0/3893913018 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6b280a8e10 0x7f6b280abec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b277fe700 1 -- 172.21.15.62:0/3893913018 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6b28141480 msgr2=0x7f6b280aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:19.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b277fe700 1 --2- 172.21.15.62:0/3893913018 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6b28141480 0x7f6b280aa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b277fe700 1 -- 172.21.15.62:0/3893913018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1800b180 con 0x7f6b280a71e0 2021-12-17T18:19:19.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b277fe700 1 --2- 172.21.15.62:0/3893913018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b280a71e0 0x7f6b280ab950 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f6b1c000ed0 tx=0x7f6b1c007cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:19.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b24ff9700 1 -- 172.21.15.62:0/3893913018 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b1c0070d0 con 0x7f6b280a71e0 2021-12-17T18:19:19.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b24ff9700 1 -- 172.21.15.62:0/3893913018 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c007230 con 0x7f6b280a71e0 2021-12-17T18:19:19.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b2cc46700 1 -- 172.21.15.62:0/3893913018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b280aaa50 con 0x7f6b280a71e0 2021-12-17T18:19:19.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b24ff9700 1 -- 172.21.15.62:0/3893913018 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b1c005590 con 0x7f6b280a71e0 2021-12-17T18:19:19.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.171+0000 7f6b2cc46700 1 -- 172.21.15.62:0/3893913018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b280b5140 con 0x7f6b280a71e0 2021-12-17T18:19:19.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.175+0000 7f6b2cc46700 1 -- 172.21.15.62:0/3893913018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b280b1b90 con 0x7f6b280a71e0 2021-12-17T18:19:19.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.175+0000 7f6b24ff9700 1 -- 172.21.15.62:0/3893913018 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6b1c010070 con 0x7f6b280a71e0 2021-12-17T18:19:19.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.175+0000 7f6b24ff9700 1 --2- 172.21.15.62:0/3893913018 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6b08053580 0x7f6b08055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.175+0000 7f6b24ff9700 1 -- 172.21.15.62:0/3893913018 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6b1c06afb0 con 0x7f6b280a71e0 2021-12-17T18:19:19.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.175+0000 7f6b26ffd700 1 --2- 172.21.15.62:0/3893913018 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6b08053580 0x7f6b08055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.175+0000 7f6b26ffd700 1 --2- 172.21.15.62:0/3893913018 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6b08053580 0x7f6b08055a40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f6b1801a000 tx=0x7f6b18015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:19.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.179+0000 7f6b24ff9700 1 -- 172.21.15.62:0/3893913018 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6b1c042110 con 0x7f6b280a71e0 2021-12-17T18:19:19.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.343+0000 7f6b2cc46700 1 -- 172.21.15.62:0/3893913018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b280573d0 con 0x7f6b280a71e0 2021-12-17T18:19:19.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.343+0000 7f6b24ff9700 1 -- 172.21.15.62:0/3893913018 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f6b1c045730 con 0x7f6b280a71e0 2021-12-17T18:19:19.349 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:19:19.350 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4093989719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4093989719},{"type":"v1","addr":"172.21.15.62:6833","nonce":4093989719}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:19:00.503279+0000","modified":"2021-12-17T18:19:01.505814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4906},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4906":{"gid":4906,"name":"b","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/360945085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":360945085},{"type":"v1","addr":"172.21.15.109:6835","nonce":360945085}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-12-17T18:19:19.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.343+0000 7f6b2cc46700 1 -- 172.21.15.62:0/3893913018 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6b08053580 msgr2=0x7f6b08055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:19.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.343+0000 7f6b2cc46700 1 --2- 172.21.15.62:0/3893913018 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6b08053580 0x7f6b08055a40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f6b1801a000 tx=0x7f6b18015000).stop 2021-12-17T18:19:19.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.343+0000 7f6b2cc46700 1 -- 172.21.15.62:0/3893913018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b280a71e0 msgr2=0x7f6b280ab950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:19.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.343+0000 7f6b2cc46700 1 --2- 172.21.15.62:0/3893913018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b280a71e0 0x7f6b280ab950 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f6b1c000ed0 tx=0x7f6b1c007cb0).stop 2021-12-17T18:19:19.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.343+0000 7f6b2cc46700 1 -- 172.21.15.62:0/3893913018 shutdown_connections 2021-12-17T18:19:19.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.343+0000 7f6b2cc46700 1 --2- 172.21.15.62:0/3893913018 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6b08053580 0x7f6b08055a40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.343+0000 7f6b2cc46700 1 --2- 172.21.15.62:0/3893913018 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6b28141480 0x7f6b280aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.343+0000 7f6b2cc46700 1 --2- 172.21.15.62:0/3893913018 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6b280a8e10 0x7f6b280abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.343+0000 7f6b2cc46700 1 --2- 172.21.15.62:0/3893913018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b280a71e0 0x7f6b280ab950 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.343+0000 7f6b2cc46700 1 -- 172.21.15.62:0/3893913018 >> 172.21.15.62:0/3893913018 conn(0x7f6b2805d220 msgr2=0x7f6b281450d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:19.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.343+0000 7f6b2cc46700 1 -- 172.21.15.62:0/3893913018 shutdown_connections 2021-12-17T18:19:19.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.343+0000 7f6b2cc46700 1 -- 172.21.15.62:0/3893913018 wait complete. 2021-12-17T18:19:19.358 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 10 2021-12-17T18:19:19.362 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b cache drop 2021-12-17T18:19:19.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.467+0000 7fd4258d0700 1 Processor -- start 2021-12-17T18:19:19.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.467+0000 7fd4258d0700 1 -- start start 2021-12-17T18:19:19.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4258d0700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd4200b6450 0x7fd420144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4258d0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4200b0e40 0x7fd4200b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4258d0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd420141190 con 0x7fd4200b3150 2021-12-17T18:19:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4258d0700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd420142170 con 0x7fd4200b6450 2021-12-17T18:19:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4258d0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4200b2410 con 0x7fd4200b0e40 2021-12-17T18:19:19.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41ffff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd4200b3150 0x7fd4201418d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33112/0 (socket says 172.21.15.62:33112) 2021-12-17T18:19:19.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41ffff700 1 -- 172.21.15.62:0/2700938383 learned_addr learned my addr 172.21.15.62:0/2700938383 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:19:19.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4248ce700 1 --2- 172.21.15.62:0/2700938383 >> v2:172.21.15.109:3300/0 conn(0x7fd4200b6450 0x7fd420144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4250cf700 1 --2- 172.21.15.62:0/2700938383 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4200b0e40 0x7fd4200b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 -- 172.21.15.62:0/2700938383 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062190612 0 0) 0x7fd420141190 con 0x7fd4200b3150 2021-12-17T18:19:19.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 -- 172.21.15.62:0/2700938383 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd404003260 con 0x7fd4200b3150 2021-12-17T18:19:19.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 -- 172.21.15.62:0/2700938383 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 706086757 0 0) 0x7fd404003260 con 0x7fd4200b3150 2021-12-17T18:19:19.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 -- 172.21.15.62:0/2700938383 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4200b0e40 msgr2=0x7fd4200b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:19.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 --2- 172.21.15.62:0/2700938383 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4200b0e40 0x7fd4200b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 -- 172.21.15.62:0/2700938383 >> v2:172.21.15.109:3300/0 conn(0x7fd4200b6450 msgr2=0x7fd420144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:19.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 --2- 172.21.15.62:0/2700938383 >> v2:172.21.15.109:3300/0 conn(0x7fd4200b6450 0x7fd420144ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 -- 172.21.15.62:0/2700938383 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd420141430 con 0x7fd4200b3150 2021-12-17T18:19:19.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 -- 172.21.15.62:0/2700938383 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fd40c001680 con 0x7fd4200b3150 2021-12-17T18:19:19.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 -- 172.21.15.62:0/2700938383 >> v1:172.21.15.62:6789/0 conn(0x7fd4200b3150 legacy=0x7fd4201418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:19.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 --2- 172.21.15.62:0/2700938383 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4200b0e40 0x7fd404003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 --2- 172.21.15.62:0/2700938383 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd404003cb0 0x7fd404004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 --2- 172.21.15.62:0/2700938383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4040049f0 0x7fd404004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 -- 172.21.15.62:0/2700938383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4200b2410 con 0x7fd4040049f0 2021-12-17T18:19:19.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 -- 172.21.15.62:0/2700938383 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40400fb60 con 0x7fd404003cb0 2021-12-17T18:19:19.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 -- 172.21.15.62:0/2700938383 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40400fca0 con 0x7fd4200b0e40 2021-12-17T18:19:19.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4250cf700 1 --2- 172.21.15.62:0/2700938383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4040049f0 0x7fd404004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41ffff700 1 --2- 172.21.15.62:0/2700938383 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd404003cb0 0x7fd404004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4248ce700 1 --2- 172.21.15.62:0/2700938383 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4200b0e40 0x7fd404003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4250cf700 1 -- 172.21.15.62:0/2700938383 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4200b0e40 msgr2=0x7fd404003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:19.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4250cf700 1 --2- 172.21.15.62:0/2700938383 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd4200b0e40 0x7fd404003780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4250cf700 1 -- 172.21.15.62:0/2700938383 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd404003cb0 msgr2=0x7fd404004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:19.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4250cf700 1 --2- 172.21.15.62:0/2700938383 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd404003cb0 0x7fd404004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4250cf700 1 -- 172.21.15.62:0/2700938383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd404003260 con 0x7fd4040049f0 2021-12-17T18:19:19.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41ffff700 1 --2- 172.21.15.62:0/2700938383 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd404003cb0 0x7fd404004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:19:19.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4250cf700 1 --2- 172.21.15.62:0/2700938383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4040049f0 0x7fd404004e70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fd404004470 tx=0x7fd4180091d0).ready entity=mon.0 client_cookie=ee1dc9de92ecfc33 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:19.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 -- 172.21.15.62:0/2700938383 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd41800e7e0 con 0x7fd4040049f0 2021-12-17T18:19:19.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 -- 172.21.15.62:0/2700938383 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41800e940 con 0x7fd4040049f0 2021-12-17T18:19:19.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd41f7fe700 1 -- 172.21.15.62:0/2700938383 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd41800eca0 con 0x7fd4040049f0 2021-12-17T18:19:19.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4258d0700 1 -- 172.21.15.62:0/2700938383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4040049f0 msgr2=0x7fd404004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:19.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4258d0700 1 --2- 172.21.15.62:0/2700938383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4040049f0 0x7fd404004e70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fd404004470 tx=0x7fd4180091d0).stop 2021-12-17T18:19:19.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.471+0000 7fd4250cf700 1 -- 172.21.15.62:0/2700938383 reap_dead start 2021-12-17T18:19:19.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd4258d0700 1 -- 172.21.15.62:0/2700938383 shutdown_connections 2021-12-17T18:19:19.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd4258d0700 1 -- 172.21.15.62:0/2700938383 >> 172.21.15.62:0/2700938383 conn(0x7fd42005caf0 msgr2=0x7fd42005cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:19.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd4258d0700 1 -- 172.21.15.62:0/2700938383 shutdown_connections 2021-12-17T18:19:19.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd4258d0700 1 -- 172.21.15.62:0/2700938383 wait complete. 2021-12-17T18:19:19.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd4258d0700 1 Processor -- start 2021-12-17T18:19:19.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd4258d0700 1 -- start start 2021-12-17T18:19:19.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd4258d0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd420142d00 0x7fd4200aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd4258d0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4200b4500 0x7fd42009ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd4258d0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd420063f40 0x7fd42013ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd4258d0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4200b4980 con 0x7fd4200b4500 2021-12-17T18:19:19.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd4258d0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4200675d0 con 0x7fd420142d00 2021-12-17T18:19:19.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd4258d0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4201430e0 con 0x7fd420063f40 2021-12-17T18:19:19.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd41ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4200b4500 0x7fd42009ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd41ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4200b4500 0x7fd42009ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49544/0 (socket says 172.21.15.62:49544) 2021-12-17T18:19:19.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd41ffff700 1 -- 172.21.15.62:0/55752770 learned_addr learned my addr 172.21.15.62:0/55752770 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:19.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd4248ce700 1 --2- 172.21.15.62:0/55752770 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd420142d00 0x7fd4200aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd4250cf700 1 --2- 172.21.15.62:0/55752770 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd420063f40 0x7fd42013ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd41ffff700 1 -- 172.21.15.62:0/55752770 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd420063f40 msgr2=0x7fd42013ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:19.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd41ffff700 1 --2- 172.21.15.62:0/55752770 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd420063f40 0x7fd42013ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd41ffff700 1 -- 172.21.15.62:0/55752770 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd420142d00 msgr2=0x7fd4200aca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:19.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd41ffff700 1 --2- 172.21.15.62:0/55752770 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd420142d00 0x7fd4200aca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd41ffff700 1 -- 172.21.15.62:0/55752770 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42009f0c0 con 0x7fd4200b4500 2021-12-17T18:19:19.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd41ffff700 1 --2- 172.21.15.62:0/55752770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4200b4500 0x7fd42009ebd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fd40c00d000 tx=0x7fd420063c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:19.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd41dffb700 1 -- 172.21.15.62:0/55752770 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd40c00f8a0 con 0x7fd4200b4500 2021-12-17T18:19:19.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd41dffb700 1 -- 172.21.15.62:0/55752770 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c00fa00 con 0x7fd4200b4500 2021-12-17T18:19:19.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd4258d0700 1 -- 172.21.15.62:0/55752770 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd420067800 con 0x7fd4200b4500 2021-12-17T18:19:19.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd41dffb700 1 -- 172.21.15.62:0/55752770 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd40c00fd60 con 0x7fd4200b4500 2021-12-17T18:19:19.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.475+0000 7fd4258d0700 1 -- 172.21.15.62:0/55752770 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42014de80 con 0x7fd4200b4500 2021-12-17T18:19:19.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.479+0000 7fd41dffb700 1 -- 172.21.15.62:0/55752770 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd40c01b030 con 0x7fd4200b4500 2021-12-17T18:19:19.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.479+0000 7fd41dffb700 1 --2- 172.21.15.62:0/55752770 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4000535b0 0x7fd400055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.479+0000 7fd41dffb700 1 -- 172.21.15.62:0/55752770 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd40c06b760 con 0x7fd4200b4500 2021-12-17T18:19:19.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.479+0000 7fd4248ce700 1 --2- 172.21.15.62:0/55752770 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4000535b0 0x7fd400055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.479+0000 7fd4248ce700 1 --2- 172.21.15.62:0/55752770 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4000535b0 0x7fd400055a70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fd41400b000 tx=0x7fd414008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:19.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd430d75740 1 Processor -- start 2021-12-17T18:19:19.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd430d75740 1 -- start start 2021-12-17T18:19:19.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd430d75740 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1bd4d10 0x1bd9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd430d75740 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1c0f290 0x1bd7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd430d75740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1c187b0 0x1c18c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd430d75740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b4a450 con 0x1c187b0 2021-12-17T18:19:19.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd430d75740 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b2abc0 con 0x1bd4d10 2021-12-17T18:19:19.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd430d75740 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bd50f0 con 0x1c0f290 2021-12-17T18:19:19.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd4250cf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1c187b0 0x1c18c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd4250cf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1c187b0 0x1c18c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49554/0 (socket says 172.21.15.62:49554) 2021-12-17T18:19:19.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd4250cf700 1 -- 172.21.15.62:0/2443967090 learned_addr learned my addr 172.21.15.62:0/2443967090 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:19.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd41ffff700 1 --2- 172.21.15.62:0/2443967090 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1c0f290 0x1bd7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd4248ce700 1 --2- 172.21.15.62:0/2443967090 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1bd4d10 0x1bd9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd4250cf700 1 -- 172.21.15.62:0/2443967090 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1c0f290 msgr2=0x1bd7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:19.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd4250cf700 1 --2- 172.21.15.62:0/2443967090 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1c0f290 0x1bd7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd4250cf700 1 -- 172.21.15.62:0/2443967090 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1bd4d10 msgr2=0x1bd9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:19.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd4250cf700 1 --2- 172.21.15.62:0/2443967090 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1bd4d10 0x1bd9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd4250cf700 1 -- 172.21.15.62:0/2443967090 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1b81f00 con 0x1c187b0 2021-12-17T18:19:19.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd4250cf700 1 --2- 172.21.15.62:0/2443967090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1c187b0 0x1c18c40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fd420063ce0 tx=0x7fd41801a000).ready entity=mon.0 client_cookie=c4ad26a7f4d87ecb server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:19.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd4258d0700 1 -- 172.21.15.62:0/2443967090 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd418022070 con 0x1c187b0 2021-12-17T18:19:19.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd4258d0700 1 -- 172.21.15.62:0/2443967090 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41800eca0 con 0x1c187b0 2021-12-17T18:19:19.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd4258d0700 1 -- 172.21.15.62:0/2443967090 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd418006ea0 con 0x1c187b0 2021-12-17T18:19:19.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd430d75740 1 -- 172.21.15.62:0/2443967090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1c187b0 msgr2=0x1c18c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:19.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd430d75740 1 --2- 172.21.15.62:0/2443967090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1c187b0 0x1c18c40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fd420063ce0 tx=0x7fd41801a000).stop 2021-12-17T18:19:19.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd430d75740 1 -- 172.21.15.62:0/2443967090 shutdown_connections 2021-12-17T18:19:19.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd430d75740 1 --2- 172.21.15.62:0/2443967090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1c187b0 0x1c18c40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd430d75740 1 --2- 172.21.15.62:0/2443967090 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1c0f290 0x1bd7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd430d75740 1 --2- 172.21.15.62:0/2443967090 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1bd4d10 0x1bd9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd430d75740 1 -- 172.21.15.62:0/2443967090 >> 172.21.15.62:0/2443967090 conn(0x1bd72e0 msgr2=0x1bd85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:19.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd430d75740 1 -- 172.21.15.62:0/2443967090 shutdown_connections 2021-12-17T18:19:19.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.483+0000 7fd430d75740 1 -- 172.21.15.62:0/2443967090 wait complete. 2021-12-17T18:19:19.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 1 -- start start 2021-12-17T18:19:19.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 1 Processor -- start 2021-12-17T18:19:19.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1bd4d10 0x1c21ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1c0f290 0x1c223c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1c187b0 0x1c11e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c228b0 con 0x1bd4d10 2021-12-17T18:19:19.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c08690 con 0x1c187b0 2021-12-17T18:19:19.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c14560 con 0x1c0f290 2021-12-17T18:19:19.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 10 client.0 ll_register_callbacks cb 0x1b1ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-12-17T18:19:19.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd4248ce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1bd4d10 0x1c21ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd4248ce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1bd4d10 0x1c21ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49556/0 (socket says 172.21.15.62:49556) 2021-12-17T18:19:19.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd4248ce700 1 -- 172.21.15.62:0/4117702291 learned_addr learned my addr 172.21.15.62:0/4117702291 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:19.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd4250cf700 1 --2- 172.21.15.62:0/4117702291 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1c187b0 0x1c11e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd41ffff700 1 --2- 172.21.15.62:0/4117702291 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1c0f290 0x1c223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd4248ce700 1 -- 172.21.15.62:0/4117702291 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1c0f290 msgr2=0x1c223c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:19.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd4248ce700 1 --2- 172.21.15.62:0/4117702291 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1c0f290 0x1c223c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd4248ce700 1 -- 172.21.15.62:0/4117702291 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1c187b0 msgr2=0x1c11e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:19.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd4248ce700 1 --2- 172.21.15.62:0/4117702291 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1c187b0 0x1c11e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd4248ce700 1 -- 172.21.15.62:0/4117702291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd404003260 con 0x1bd4d10 2021-12-17T18:19:19.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd4250cf700 1 --2- 172.21.15.62:0/4117702291 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1c187b0 0x1c11e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:19:19.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd4248ce700 1 --2- 172.21.15.62:0/4117702291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1bd4d10 0x1c21ed0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x1c105d0 tx=0x7fd414018000).ready entity=mon.0 client_cookie=2d98c08cd8b081d4 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:19.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd3ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2021-12-17T18:19:19.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd3ff7fe700 1 -- 172.21.15.62:0/4117702291 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd414021700 con 0x1bd4d10 2021-12-17T18:19:19.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd3ff7fe700 1 -- 172.21.15.62:0/4117702291 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd414021860 con 0x1bd4d10 2021-12-17T18:19:19.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 1 -- 172.21.15.62:0/4117702291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1b40510 con 0x1bd4d10 2021-12-17T18:19:19.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd3ff7fe700 1 -- 172.21.15.62:0/4117702291 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd414021a20 con 0x1bd4d10 2021-12-17T18:19:19.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 10 client.5166 fetch_fsmap learned FSMap version 10 2021-12-17T18:19:19.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 1 -- 172.21.15.62:0/4117702291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x1b39df0 con 0x1bd4d10 2021-12-17T18:19:19.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd3ff7fe700 1 -- 172.21.15.62:0/4117702291 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1b40510 con 0x1bd4d10 2021-12-17T18:19:19.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd3ff7fe700 1 -- 172.21.15.62:0/4117702291 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 10) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fd414021b80 con 0x1bd4d10 2021-12-17T18:19:19.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 10 client.5166 fetch_fsmap finished waiting for FSMap version 10 2021-12-17T18:19:19.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 10 client.5166 resolve_mds: resolved ID 'b' to GID 4906 2021-12-17T18:19:19.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 20 client.5166 populate_metadata read hostname 'smithi062' 2021-12-17T18:19:19.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 1 --2- 172.21.15.62:0/4117702291 >> [v2:172.21.15.109:6834/360945085,v1:172.21.15.109:6835/360945085] conn(0x1c10100 0x1bdac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 4 client.5166 mds_command: new command op to 4906 tid=0[{"prefix": "get_command_descriptions"}] 2021-12-17T18:19:19.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd430d75740 1 -- 172.21.15.62:0/4117702291 --> [v2:172.21.15.109:6834/360945085,v1:172.21.15.109:6835/360945085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1b38880 con 0x1c10100 2021-12-17T18:19:19.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.487+0000 7fd41ffff700 1 --2- 172.21.15.62:0/4117702291 >> [v2:172.21.15.109:6834/360945085,v1:172.21.15.109:6835/360945085] conn(0x1c10100 0x1bdac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.491+0000 7fd41ffff700 1 --2- 172.21.15.62:0/4117702291 >> [v2:172.21.15.109:6834/360945085,v1:172.21.15.109:6835/360945085] conn(0x1c10100 0x1bdac00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e138d45b2f1bac76 server_cookie=969050af5f038737 in_seq=0 out_seq=0 2021-12-17T18:19:19.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.491+0000 7fd3ff7fe700 10 client.5166 ms_handle_connect on v2:172.21.15.109:6834/360945085 2021-12-17T18:19:19.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.491+0000 7fd3ff7fe700 1 -- 172.21.15.62:0/4117702291 <== mds.0 v2:172.21.15.109:6834/360945085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x1b38880 con 0x1c10100 2021-12-17T18:19:19.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.491+0000 7fd3ff7fe700 10 client.5166 handle_command_reply: tid=0 2021-12-17T18:19:19.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.491+0000 7fd430d75740 1 client.5166 shutdown 2021-12-17T18:19:19.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.491+0000 7fd430d75740 1 -- 172.21.15.62:0/4117702291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1bd4d10 msgr2=0x1c21ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:19.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.491+0000 7fd430d75740 1 --2- 172.21.15.62:0/4117702291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1bd4d10 0x1c21ed0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x1c105d0 tx=0x7fd414018000).stop 2021-12-17T18:19:19.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.491+0000 7fd430d75740 1 -- 172.21.15.62:0/4117702291 shutdown_connections 2021-12-17T18:19:19.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.491+0000 7fd430d75740 1 --2- 172.21.15.62:0/4117702291 >> [v2:172.21.15.109:6834/360945085,v1:172.21.15.109:6835/360945085] conn(0x1c10100 0x1bdac00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.491+0000 7fd430d75740 1 --2- 172.21.15.62:0/4117702291 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1c187b0 0x1c11e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.491+0000 7fd3ff7fe700 0 client.5166 ms_handle_reset on v2:172.21.15.109:6834/360945085 2021-12-17T18:19:19.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.491+0000 7fd430d75740 1 --2- 172.21.15.62:0/4117702291 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1c0f290 0x1c223c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.491+0000 7fd430d75740 1 --2- 172.21.15.62:0/4117702291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1bd4d10 0x1c21ed0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.491+0000 7fd430d75740 1 -- 172.21.15.62:0/4117702291 >> 172.21.15.62:0/4117702291 conn(0x1bd72e0 msgr2=0x1bd9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:19.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.491+0000 7fd430d75740 1 -- 172.21.15.62:0/4117702291 shutdown_connections 2021-12-17T18:19:19.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.491+0000 7fd430d75740 1 -- 172.21.15.62:0/4117702291 wait complete. 2021-12-17T18:19:19.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.491+0000 7fd430d75740 20 client.5166 trim_cache size 0 max 16384 2021-12-17T18:19:19.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd430d75740 1 Processor -- start 2021-12-17T18:19:19.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd430d75740 1 -- start start 2021-12-17T18:19:19.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd430d75740 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1bd4d10 0x1c0f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd430d75740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1c0f290 0x1c21b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd430d75740 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1c187b0 0x1c22030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd430d75740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ba1fc0 con 0x1c0f290 2021-12-17T18:19:19.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd430d75740 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b38880 con 0x1c187b0 2021-12-17T18:19:19.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd430d75740 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b40510 con 0x1bd4d10 2021-12-17T18:19:19.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd41ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1c0f290 0x1c21b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd41ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1c0f290 0x1c21b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49568/0 (socket says 172.21.15.62:49568) 2021-12-17T18:19:19.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd41ffff700 1 -- 172.21.15.62:0/1717325957 learned_addr learned my addr 172.21.15.62:0/1717325957 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:19.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd4248ce700 1 --2- 172.21.15.62:0/1717325957 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1bd4d10 0x1c0f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd4250cf700 1 --2- 172.21.15.62:0/1717325957 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1c187b0 0x1c22030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd41ffff700 1 -- 172.21.15.62:0/1717325957 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1bd4d10 msgr2=0x1c0f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:19.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd41ffff700 1 --2- 172.21.15.62:0/1717325957 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1bd4d10 0x1c0f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd41ffff700 1 -- 172.21.15.62:0/1717325957 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1c187b0 msgr2=0x1c22030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:19.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd41ffff700 1 --2- 172.21.15.62:0/1717325957 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1c187b0 0x1c22030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd41ffff700 1 -- 172.21.15.62:0/1717325957 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1b3f0e0 con 0x1c0f290 2021-12-17T18:19:19.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd41ffff700 1 --2- 172.21.15.62:0/1717325957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1c0f290 0x1c21b40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x1b41f80 tx=0x7fd40c006000).ready entity=mon.0 client_cookie=3411cc30a8a2903a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:19.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd409ffb700 1 -- 172.21.15.62:0/1717325957 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd40c045e40 con 0x1c0f290 2021-12-17T18:19:19.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd409ffb700 1 -- 172.21.15.62:0/1717325957 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c044620 con 0x1c0f290 2021-12-17T18:19:19.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd409ffb700 1 -- 172.21.15.62:0/1717325957 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd40c0459d0 con 0x1c0f290 2021-12-17T18:19:19.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd430d75740 1 -- 172.21.15.62:0/1717325957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1c0f290 msgr2=0x1c21b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:19:19.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd430d75740 1 --2- 172.21.15.62:0/1717325957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1c0f290 0x1c21b40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x1b41f80 tx=0x7fd40c006000).stop 2021-12-17T18:19:19.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd430d75740 1 -- 172.21.15.62:0/1717325957 shutdown_connections 2021-12-17T18:19:19.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd430d75740 1 --2- 172.21.15.62:0/1717325957 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1c187b0 0x1c22030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd430d75740 1 --2- 172.21.15.62:0/1717325957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1c0f290 0x1c21b40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd430d75740 1 --2- 172.21.15.62:0/1717325957 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1bd4d10 0x1c0f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd430d75740 1 -- 172.21.15.62:0/1717325957 >> 172.21.15.62:0/1717325957 conn(0x1bd72e0 msgr2=0x1c109e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:19:19.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd430d75740 1 -- 172.21.15.62:0/1717325957 shutdown_connections 2021-12-17T18:19:19.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.507+0000 7fd430d75740 1 -- 172.21.15.62:0/1717325957 wait complete. 2021-12-17T18:19:19.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 1 -- start start 2021-12-17T18:19:19.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 1 Processor -- start 2021-12-17T18:19:19.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1bd4d10 0x1bd81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1c0f290 0x1c087d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1c187b0 0x1c72c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c22710 con 0x1bd4d10 2021-12-17T18:19:19.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c724f0 con 0x1c187b0 2021-12-17T18:19:19.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c08e00 con 0x1c0f290 2021-12-17T18:19:19.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 10 client.0 ll_register_callbacks cb 0x1c13c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-12-17T18:19:19.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd4248ce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1bd4d10 0x1bd81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd4248ce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1bd4d10 0x1bd81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49570/0 (socket says 172.21.15.62:49570) 2021-12-17T18:19:19.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd4248ce700 1 -- 172.21.15.62:0/3262945372 learned_addr learned my addr 172.21.15.62:0/3262945372 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:19:19.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd41ffff700 1 --2- 172.21.15.62:0/3262945372 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1c0f290 0x1c087d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd4250cf700 1 --2- 172.21.15.62:0/3262945372 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1c187b0 0x1c72c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd4248ce700 1 -- 172.21.15.62:0/3262945372 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1c0f290 msgr2=0x1c087d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:19.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd4248ce700 1 --2- 172.21.15.62:0/3262945372 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1c0f290 0x1c087d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd4248ce700 1 -- 172.21.15.62:0/3262945372 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1c187b0 msgr2=0x1c72c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:19:19.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd4248ce700 1 --2- 172.21.15.62:0/3262945372 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1c187b0 0x1c72c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:19:19.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd4248ce700 1 -- 172.21.15.62:0/3262945372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42014de80 con 0x1bd4d10 2021-12-17T18:19:19.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd4250cf700 1 --2- 172.21.15.62:0/3262945372 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1c187b0 0x1c72c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:19:19.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd4248ce700 1 --2- 172.21.15.62:0/3262945372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1bd4d10 0x1bd81e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x1c72630 tx=0x7fd414024000).ready entity=mon.0 client_cookie=89f3626f6bbe6c5 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:19:19.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd408ff9700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2021-12-17T18:19:19.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd408ff9700 1 -- 172.21.15.62:0/3262945372 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd414039070 con 0x1bd4d10 2021-12-17T18:19:19.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd408ff9700 1 -- 172.21.15.62:0/3262945372 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd41402ac20 con 0x1bd4d10 2021-12-17T18:19:19.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 1 -- 172.21.15.62:0/3262945372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd41800eca0 con 0x1bd4d10 2021-12-17T18:19:19.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd408ff9700 1 -- 172.21.15.62:0/3262945372 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd414013890 con 0x1bd4d10 2021-12-17T18:19:19.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 10 client.5172 fetch_fsmap learned FSMap version 10 2021-12-17T18:19:19.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 1 -- 172.21.15.62:0/3262945372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x1b143f0 con 0x1bd4d10 2021-12-17T18:19:19.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd408ff9700 1 -- 172.21.15.62:0/3262945372 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41800eca0 con 0x1bd4d10 2021-12-17T18:19:19.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd408ff9700 1 -- 172.21.15.62:0/3262945372 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 10) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fd41403c020 con 0x1bd4d10 2021-12-17T18:19:19.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 10 client.5172 fetch_fsmap finished waiting for FSMap version 10 2021-12-17T18:19:19.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 10 client.5172 resolve_mds: resolved ID 'b' to GID 4906 2021-12-17T18:19:19.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 20 client.5172 populate_metadata read hostname 'smithi062' 2021-12-17T18:19:19.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 1 --2- 172.21.15.62:0/3262945372 >> [v2:172.21.15.109:6834/360945085,v1:172.21.15.109:6835/360945085] conn(0x1c73230 0x1c17040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:19:19.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 4 client.5172 mds_command: new command op to 4906 tid=0[{"prefix": "cache drop"}] 2021-12-17T18:19:19.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd430d75740 1 -- 172.21.15.62:0/3262945372 --> [v2:172.21.15.109:6834/360945085,v1:172.21.15.109:6835/360945085] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x1a2e590 con 0x1c73230 2021-12-17T18:19:19.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd41ffff700 1 --2- 172.21.15.62:0/3262945372 >> [v2:172.21.15.109:6834/360945085,v1:172.21.15.109:6835/360945085] conn(0x1c73230 0x1c17040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:19:19.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd408ff9700 10 client.5172 ms_handle_connect on v2:172.21.15.109:6834/360945085 2021-12-17T18:19:19.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:19:19.511+0000 7fd41ffff700 1 --2- 172.21.15.62:0/3262945372 >> [v2:172.21.15.109:6834/360945085,v1:172.21.15.109:6835/360945085] conn(0x1c73230 0x1c17040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8701e8d880b66e1c server_cookie=d845f5dfd10e2115 in_seq=0 out_seq=0 2021-12-17T18:19:32.895 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:19:32.898 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:19:32.901 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:19:32.904 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:19:32.907 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:20:02.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:20:02.994 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:20:02.997 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:20:03.000 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:20:03.002 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:20:03.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.878+0000 7fd408ff9700 1 -- 172.21.15.62:0/3262945372 <== mds.0 v2:172.21.15.109:6834/360945085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+386 (crc 0 0 0) 0x1a2e590 con 0x1c73230 2021-12-17T18:20:03.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.878+0000 7fd408ff9700 10 client.5172 handle_command_reply: tid=0 2021-12-17T18:20:03.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.878+0000 7fd430d75740 1 client.5172 shutdown 2021-12-17T18:20:03.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.878+0000 7fd430d75740 1 -- 172.21.15.62:0/3262945372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1bd4d10 msgr2=0x1bd81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:03.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.878+0000 7fd430d75740 1 --2- 172.21.15.62:0/3262945372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1bd4d10 0x1bd81e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x1c72630 tx=0x7fd414024000).stop 2021-12-17T18:20:03.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.878+0000 7fd430d75740 1 -- 172.21.15.62:0/3262945372 shutdown_connections 2021-12-17T18:20:03.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.878+0000 7fd430d75740 1 --2- 172.21.15.62:0/3262945372 >> [v2:172.21.15.109:6834/360945085,v1:172.21.15.109:6835/360945085] conn(0x1c73230 0x1c17040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:03.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.878+0000 7fd430d75740 1 --2- 172.21.15.62:0/3262945372 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x1c187b0 0x1c72c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:03.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.878+0000 7fd430d75740 1 --2- 172.21.15.62:0/3262945372 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x1c0f290 0x1c087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:03.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.878+0000 7fd430d75740 1 --2- 172.21.15.62:0/3262945372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1bd4d10 0x1bd81e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:03.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.878+0000 7fd408ff9700 0 client.5172 ms_handle_reset on v2:172.21.15.109:6834/360945085 2021-12-17T18:20:03.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.878+0000 7fd430d75740 1 -- 172.21.15.62:0/3262945372 >> 172.21.15.62:0/3262945372 conn(0x1bd72e0 msgr2=0x1c0f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:03.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.878+0000 7fd430d75740 1 -- 172.21.15.62:0/3262945372 shutdown_connections 2021-12-17T18:20:03.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.878+0000 7fd430d75740 1 -- 172.21.15.62:0/3262945372 wait complete. 2021-12-17T18:20:03.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.878+0000 7fd430d75740 20 client.5172 trim_cache size 0 max 16384 2021-12-17T18:20:03.891 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:20:03.891 INFO:teuthology.orchestra.run.smithi062.stdout: "client_recall": { 2021-12-17T18:20:03.891 INFO:teuthology.orchestra.run.smithi062.stdout: "return_code": 0, 2021-12-17T18:20:03.892 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "(0) Success", 2021-12-17T18:20:03.892 INFO:teuthology.orchestra.run.smithi062.stdout: "recalled": 920 2021-12-17T18:20:03.892 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:03.892 INFO:teuthology.orchestra.run.smithi062.stdout: "flush_journal": { 2021-12-17T18:20:03.892 INFO:teuthology.orchestra.run.smithi062.stdout: "return_code": 0, 2021-12-17T18:20:03.893 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "" 2021-12-17T18:20:03.893 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:03.894 INFO:teuthology.orchestra.run.smithi062.stdout: "trim_cache": { 2021-12-17T18:20:03.894 INFO:teuthology.orchestra.run.smithi062.stdout: "trimmed": 900 2021-12-17T18:20:03.894 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:03.894 INFO:teuthology.orchestra.run.smithi062.stdout: "cache": { 2021-12-17T18:20:03.895 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": { 2021-12-17T18:20:03.895 INFO:teuthology.orchestra.run.smithi062.stdout: "items": 2531, 2021-12-17T18:20:03.895 INFO:teuthology.orchestra.run.smithi062.stdout: "bytes": 431968 2021-12-17T18:20:03.895 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:03.896 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:03.896 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 44.365995480999999 2021-12-17T18:20:03.896 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:20:03.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.882+0000 7fd4258d0700 1 -- 172.21.15.62:0/55752770 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4000535b0 msgr2=0x7fd400055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:03.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.882+0000 7fd4258d0700 1 --2- 172.21.15.62:0/55752770 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4000535b0 0x7fd400055a70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fd41400b000 tx=0x7fd414008040).stop 2021-12-17T18:20:03.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.882+0000 7fd4258d0700 1 -- 172.21.15.62:0/55752770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4200b4500 msgr2=0x7fd42009ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:03.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.882+0000 7fd4258d0700 1 --2- 172.21.15.62:0/55752770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4200b4500 0x7fd42009ebd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fd40c00d000 tx=0x7fd420063c70).stop 2021-12-17T18:20:03.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.882+0000 7fd4258d0700 1 -- 172.21.15.62:0/55752770 shutdown_connections 2021-12-17T18:20:03.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.882+0000 7fd4258d0700 1 --2- 172.21.15.62:0/55752770 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4000535b0 0x7fd400055a70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:03.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.882+0000 7fd4258d0700 1 --2- 172.21.15.62:0/55752770 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd420063f40 0x7fd42013ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:03.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.882+0000 7fd4258d0700 1 --2- 172.21.15.62:0/55752770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4200b4500 0x7fd42009ebd0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:03.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.882+0000 7fd4258d0700 1 --2- 172.21.15.62:0/55752770 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd420142d00 0x7fd4200aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:03.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.882+0000 7fd4258d0700 1 -- 172.21.15.62:0/55752770 >> 172.21.15.62:0/55752770 conn(0x7fd42005caf0 msgr2=0x7fd420140730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:03.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.882+0000 7fd4258d0700 1 -- 172.21.15.62:0/55752770 shutdown_connections 2021-12-17T18:20:03.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:03.882+0000 7fd4258d0700 1 -- 172.21.15.62:0/55752770 wait complete. 2021-12-17T18:20:03.904 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:20:03.905 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:20:03.924 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:20:03.945 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:20:03.966 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:20:03.987 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:20:04.009 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:20:04.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:04.010 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:20:04.010 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:20:04.019 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:20:04.020 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:20:04.020 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:20:04.021 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:20:04.021 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:20:04.036 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[13949]: fuse finished with error 0 and tester_r 0 2021-12-17T18:20:04.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:04.039 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:20:04.039 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:20:04.087 INFO:teuthology.orchestra.run.smithi125.stdout:ext2/ext3 2021-12-17T18:20:04.088 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:20:04.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:20:04.101 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:20:04.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:04.108 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:20:04.108 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:20:04.116 INFO:teuthology.orchestra.run.smithi158.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:20:04.116 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:20:04.117 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-12-17T18:20:04.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:20:04.118 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:20:04.125 INFO:teuthology.orchestra.run.smithi158.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:20:04.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:20:04.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:04.127 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:20:04.127 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:20:04.135 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:20:04.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:20:04.136 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:20:04.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:20:04.137 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:20:04.144 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:20:04.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:20:04.145 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:20:04.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea37fff700 1 Processor -- start 2021-12-17T18:20:04.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea37fff700 1 -- start start 2021-12-17T18:20:04.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea37fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fea380b36c0 0x7fea380b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:04.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea37fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea38060890 con 0x7fea380b32e0 2021-12-17T18:20:04.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea37fff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea380b43a0 con 0x7fea380b2b30 2021-12-17T18:20:04.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea37fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea381478e0 con 0x7fea380b36c0 2021-12-17T18:20:04.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea36ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fea380b32e0 0x7fea380b4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33158/0 (socket says 172.21.15.62:33158) 2021-12-17T18:20:04.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea36ffd700 1 -- 172.21.15.62:0/2055531999 learned_addr learned my addr 172.21.15.62:0/2055531999 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:04.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea377fe700 1 --2- 172.21.15.62:0/2055531999 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fea380b36c0 0x7fea380b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:04.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea35ffb700 1 -- 172.21.15.62:0/2055531999 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796972723 0 0) 0x7fea38060890 con 0x7fea380b32e0 2021-12-17T18:20:04.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea35ffb700 1 -- 172.21.15.62:0/2055531999 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea1c003260 con 0x7fea380b32e0 2021-12-17T18:20:04.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea35ffb700 1 -- 172.21.15.62:0/2055531999 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1756990900 0 0) 0x7fea1c003260 con 0x7fea380b32e0 2021-12-17T18:20:04.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea35ffb700 1 -- 172.21.15.62:0/2055531999 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fea380b36c0 msgr2=0x7fea380b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:04.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea35ffb700 1 --2- 172.21.15.62:0/2055531999 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fea380b36c0 0x7fea380b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea35ffb700 1 -- 172.21.15.62:0/2055531999 >> v1:172.21.15.109:6789/0 conn(0x7fea380b2b30 legacy=0x7fea38146830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:04.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea35ffb700 1 -- 172.21.15.62:0/2055531999 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea380b0680 con 0x7fea380b32e0 2021-12-17T18:20:04.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea35ffb700 1 -- 172.21.15.62:0/2055531999 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fea28001680 con 0x7fea380b32e0 2021-12-17T18:20:04.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea35ffb700 1 -- 172.21.15.62:0/2055531999 >> v1:172.21.15.62:6789/0 conn(0x7fea380b32e0 legacy=0x7fea380b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:04.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea35ffb700 1 --2- 172.21.15.62:0/2055531999 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fea380b36c0 0x7fea1c003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:04.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea35ffb700 1 --2- 172.21.15.62:0/2055531999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea1c003d60 0x7fea1c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:04.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea35ffb700 1 --2- 172.21.15.62:0/2055531999 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fea1c0049f0 0x7fea1c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:04.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea35ffb700 1 -- 172.21.15.62:0/2055531999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c00b8d0 con 0x7fea1c003d60 2021-12-17T18:20:04.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea35ffb700 1 -- 172.21.15.62:0/2055531999 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c00ba40 con 0x7fea1c0049f0 2021-12-17T18:20:04.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea35ffb700 1 -- 172.21.15.62:0/2055531999 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c00bc00 con 0x7fea380b36c0 2021-12-17T18:20:04.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea367fc700 1 --2- 172.21.15.62:0/2055531999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea1c003d60 0x7fea1c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:04.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea36ffd700 1 --2- 172.21.15.62:0/2055531999 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fea380b36c0 0x7fea1c003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea377fe700 1 --2- 172.21.15.62:0/2055531999 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fea1c0049f0 0x7fea1c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea367fc700 1 -- 172.21.15.62:0/2055531999 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fea380b36c0 msgr2=0x7fea1c003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea367fc700 1 --2- 172.21.15.62:0/2055531999 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fea380b36c0 0x7fea1c003780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea367fc700 1 -- 172.21.15.62:0/2055531999 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fea1c0049f0 msgr2=0x7fea1c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:04.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea367fc700 1 --2- 172.21.15.62:0/2055531999 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fea1c0049f0 0x7fea1c004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea367fc700 1 -- 172.21.15.62:0/2055531999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c003260 con 0x7fea1c003d60 2021-12-17T18:20:04.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.254+0000 7fea367fc700 1 --2- 172.21.15.62:0/2055531999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea1c003d60 0x7fea1c004500 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fea38067ab0 tx=0x7fea2c007a00).ready entity=mon.0 client_cookie=b4c9d2d6093d3a7e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:04.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea35ffb700 1 -- 172.21.15.62:0/2055531999 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea2c007d10 con 0x7fea1c003d60 2021-12-17T18:20:04.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea35ffb700 1 -- 172.21.15.62:0/2055531999 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2c007030 con 0x7fea1c003d60 2021-12-17T18:20:04.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea35ffb700 1 -- 172.21.15.62:0/2055531999 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea2c007390 con 0x7fea1c003d60 2021-12-17T18:20:04.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea37fff700 1 -- 172.21.15.62:0/2055531999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea1c003d60 msgr2=0x7fea1c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:04.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea37fff700 1 --2- 172.21.15.62:0/2055531999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea1c003d60 0x7fea1c004500 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fea38067ab0 tx=0x7fea2c007a00).stop 2021-12-17T18:20:04.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea377fe700 1 -- 172.21.15.62:0/2055531999 reap_dead start 2021-12-17T18:20:04.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea37fff700 1 -- 172.21.15.62:0/2055531999 shutdown_connections 2021-12-17T18:20:04.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea37fff700 1 -- 172.21.15.62:0/2055531999 >> 172.21.15.62:0/2055531999 conn(0x7fea3805c750 msgr2=0x7fea3805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:04.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea37fff700 1 -- 172.21.15.62:0/2055531999 shutdown_connections 2021-12-17T18:20:04.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea37fff700 1 -- 172.21.15.62:0/2055531999 wait complete. 2021-12-17T18:20:04.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea37fff700 1 Processor -- start 2021-12-17T18:20:04.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea37fff700 1 -- start start 2021-12-17T18:20:04.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea37fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fea1c003d60 0x7fea38066b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:04.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea37fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fea38145a40 0x7fea38155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:04.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea37fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea38155d30 0x7fea381561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:04.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea37fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea380630c0 con 0x7fea38155d30 2021-12-17T18:20:04.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea37fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea38067040 con 0x7fea1c003d60 2021-12-17T18:20:04.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea37fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea381566a0 con 0x7fea38145a40 2021-12-17T18:20:04.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea377fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea38155d30 0x7fea381561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:04.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea377fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea38155d30 0x7fea381561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49594/0 (socket says 172.21.15.62:49594) 2021-12-17T18:20:04.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea377fe700 1 -- 172.21.15.62:0/1415415437 learned_addr learned my addr 172.21.15.62:0/1415415437 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:04.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea36ffd700 1 --2- 172.21.15.62:0/1415415437 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fea1c003d60 0x7fea38066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:04.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea367fc700 1 --2- 172.21.15.62:0/1415415437 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fea38145a40 0x7fea38155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:04.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea377fe700 1 -- 172.21.15.62:0/1415415437 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fea38145a40 msgr2=0x7fea38155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:04.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea377fe700 1 --2- 172.21.15.62:0/1415415437 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fea38145a40 0x7fea38155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea377fe700 1 -- 172.21.15.62:0/1415415437 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fea1c003d60 msgr2=0x7fea38066b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:04.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea377fe700 1 --2- 172.21.15.62:0/1415415437 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fea1c003d60 0x7fea38066b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea377fe700 1 -- 172.21.15.62:0/1415415437 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea38067280 con 0x7fea38155d30 2021-12-17T18:20:04.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea36ffd700 1 --2- 172.21.15.62:0/1415415437 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fea1c003d60 0x7fea38066b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:04.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea377fe700 1 --2- 172.21.15.62:0/1415415437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea38155d30 0x7fea381561b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fea381522a0 tx=0x7fea30008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:04.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea27fff700 1 -- 172.21.15.62:0/1415415437 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea30013550 con 0x7fea38155d30 2021-12-17T18:20:04.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea27fff700 1 -- 172.21.15.62:0/1415415437 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea300136b0 con 0x7fea38155d30 2021-12-17T18:20:04.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea37fff700 1 -- 172.21.15.62:0/1415415437 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea38066390 con 0x7fea38155d30 2021-12-17T18:20:04.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea27fff700 1 -- 172.21.15.62:0/1415415437 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea30013a10 con 0x7fea38155d30 2021-12-17T18:20:04.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.258+0000 7fea37fff700 1 -- 172.21.15.62:0/1415415437 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea38145640 con 0x7fea38155d30 2021-12-17T18:20:04.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.262+0000 7fea27fff700 1 -- 172.21.15.62:0/1415415437 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fea30012040 con 0x7fea38155d30 2021-12-17T18:20:04.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.262+0000 7fea37fff700 1 -- 172.21.15.62:0/1415415437 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea380b6be0 con 0x7fea38155d30 2021-12-17T18:20:04.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.262+0000 7fea27fff700 1 --2- 172.21.15.62:0/1415415437 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fea140535b0 0x7fea14055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:04.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.262+0000 7fea27fff700 1 -- 172.21.15.62:0/1415415437 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fea3006bbc0 con 0x7fea38155d30 2021-12-17T18:20:04.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.262+0000 7fea36ffd700 1 --2- 172.21.15.62:0/1415415437 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fea140535b0 0x7fea14055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:04.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.262+0000 7fea36ffd700 1 --2- 172.21.15.62:0/1415415437 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fea140535b0 0x7fea14055a70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fea28005000 tx=0x7fea28009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:04.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.270+0000 7fea27fff700 1 -- 172.21.15.62:0/1415415437 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fea30042d20 con 0x7fea38155d30 2021-12-17T18:20:04.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.398+0000 7fea37fff700 1 -- 172.21.15.62:0/1415415437 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fea38066520 con 0x7fea38155d30 2021-12-17T18:20:04.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.402+0000 7fea27fff700 1 -- 172.21.15.62:0/1415415437 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v33) v1 ==== 81+0+33693 (secure 0 0 0) 0x7fea30046340 con 0x7fea38155d30 2021-12-17T18:20:04.408 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:04.408 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:20:04.408 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 33, 2021-12-17T18:20:04.408 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:20:04.409 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:20:04.409 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:19:01.506520+0000", 2021-12-17T18:20:04.409 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:20:04.409 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:20:04.410 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:20:04.410 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:20:04.410 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:20:04.410 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:20:04.411 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:20:04.411 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:20:04.411 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:20:04.411 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:20:04.411 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:20:04.412 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:20:04.412 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:20:04.412 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:20:04.412 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:20:04.413 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 6, 2021-12-17T18:20:04.413 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:20:04.413 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:20:04.413 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:20:04.414 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:20:04.414 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:20:04.414 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.414 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:20:04.415 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:20:04.415 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:20:04.415 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:20:04.415 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:20:04.416 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:20:04.416 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:20:04.416 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:20:04.416 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:20:04.417 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:20:04.417 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:20:04.417 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:20:04.417 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:20:04.418 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:20:04.418 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:20:04.418 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:20:04.418 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:20:04.419 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:20:04.419 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:20:04.419 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:20:04.419 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:20:04.419 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:20:04.420 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:20:04.420 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.420 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:20:04.420 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:20:04.421 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:20:04.421 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:20:04.421 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:20:04.421 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:20:04.422 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:20:04.422 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:20:04.422 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:20:04.422 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:20:04.423 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:20:04.423 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:20:04.423 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:20:04.423 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:20:04.423 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:20:04.424 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:20:04.424 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:20:04.424 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:20:04.424 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:20:04.425 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:20:04.425 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:20:04.425 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:20:04.425 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:20:04.426 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:20:04.426 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:20:04.426 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:20:04.426 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:20:04.426 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.427 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:20:04.427 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:20:04.427 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:20:04.427 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:20:04.428 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:20:04.428 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:20:04.428 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:20:04.428 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:20:04.429 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:20:04.429 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:20:04.429 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:20:04.429 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:20:04.429 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:20:04.430 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.430 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:20:04.430 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:20:04.430 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.431 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.431 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.431 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:20:04.431 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:20:04.431 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:20:04.432 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:20:04.432 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:20:04.432 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:20:04.432 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:20:04.433 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:20:04.433 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:20:04.433 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:20:04.433 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:20:04.434 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:20:04.434 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:20:04.434 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:20:04.434 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:20:04.434 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:20:04.435 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:20:04.435 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:20:04.435 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:20:04.435 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:20:04.436 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:20:04.436 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:20:04.436 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:20:04.436 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.437 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:20:04.437 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:20:04.437 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:20:04.437 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:20:04.438 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:20:04.438 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:20:04.438 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:20:04.438 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:20:04.438 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:20:04.439 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:20:04.439 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:20:04.439 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:20:04.439 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:20:04.440 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:20:04.440 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:20:04.440 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:20:04.440 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:20:04.441 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:20:04.441 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:20:04.441 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:20:04.441 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:20:04.441 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:20:04.442 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:20:04.442 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:20:04.442 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:20:04.442 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:20:04.443 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:20:04.443 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.443 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:20:04.443 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:20:04.443 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:20:04.444 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:20:04.444 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:20:04.444 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:20:04.444 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:20:04.445 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:20:04.445 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:20:04.445 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:20:04.445 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:20:04.446 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:20:04.446 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:20:04.446 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:20:04.446 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.446 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.447 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.447 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 5, 2021-12-17T18:20:04.447 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2021-12-17T18:20:04.447 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:58.549405+0000", 2021-12-17T18:20:04.448 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:20:04.448 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:20:04.448 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:20:04.448 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:20:04.449 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:20:04.449 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:20:04.449 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:20:04.449 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:20:04.449 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:20:04.450 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:20:04.450 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:20:04.450 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:20:04.450 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:20:04.451 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:20:04.451 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:20:04.451 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:20:04.451 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:20:04.452 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:20:04.452 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:20:04.452 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:20:04.452 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.452 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "32", 2021-12-17T18:20:04.453 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:20:04.453 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:20:04.453 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:20:04.453 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:20:04.454 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:20:04.454 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:20:04.454 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:20:04.454 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:20:04.455 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:20:04.455 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:20:04.455 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:20:04.455 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:20:04.455 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:20:04.456 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:20:04.456 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:20:04.456 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:20:04.456 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:20:04.457 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:20:04.457 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:20:04.457 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:20:04.457 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:20:04.458 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:20:04.458 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:20:04.458 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:20:04.458 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:20:04.458 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:20:04.459 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.459 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:20:04.459 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:20:04.459 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:20:04.460 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:20:04.460 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:20:04.460 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:20:04.460 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:20:04.461 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:20:04.461 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:20:04.461 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:20:04.461 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:20:04.461 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:20:04.462 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2021-12-17T18:20:04.462 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2021-12-17T18:20:04.462 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2021-12-17T18:20:04.462 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.463 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:20:04.463 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:20:04.463 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2021-12-17T18:20:04.463 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.464 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.464 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.464 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.464 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 6, 2021-12-17T18:20:04.465 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2021-12-17T18:20:04.465 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:59.508046+0000", 2021-12-17T18:20:04.465 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:20:04.465 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:20:04.465 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:20:04.466 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:20:04.466 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:20:04.466 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:20:04.466 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:20:04.467 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:20:04.467 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:20:04.467 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:20:04.467 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:20:04.468 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:20:04.468 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:20:04.468 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:20:04.468 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:20:04.468 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:20:04.469 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:20:04.469 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:20:04.469 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:20:04.469 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:20:04.470 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.470 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "33", 2021-12-17T18:20:04.470 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:20:04.470 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:20:04.470 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:20:04.471 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:20:04.471 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:20:04.471 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:20:04.471 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:20:04.472 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:20:04.472 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:20:04.472 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:20:04.472 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:20:04.473 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:20:04.473 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:20:04.473 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:20:04.473 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:20:04.474 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:20:04.474 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:20:04.474 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:20:04.474 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:20:04.475 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:20:04.475 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:20:04.475 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:20:04.475 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:20:04.475 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:20:04.476 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:20:04.476 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:20:04.476 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.476 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:20:04.477 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:20:04.477 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:20:04.477 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:20:04.477 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:20:04.477 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:20:04.478 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:20:04.478 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:20:04.478 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:20:04.478 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:20:04.479 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:20:04.479 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:20:04.479 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:20:04.479 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:20:04.480 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2021-12-17T18:20:04.480 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.480 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.480 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.480 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:20:04.481 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:20:04.481 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.481 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:20:04.481 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:20:04.482 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:20:04.482 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:20:04.482 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:20:04.482 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:20:04.483 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:20:04.483 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:20:04.483 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:20:04.483 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 31, 2021-12-17T18:20:04.484 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:20:04.484 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:20:04.484 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:20:04.484 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.485 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.485 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.485 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:20:04.485 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:20:04.486 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.486 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.486 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.486 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:20:04.487 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:20:04.487 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.487 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.487 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.487 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:20:04.488 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.488 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.488 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.488 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:20:04.489 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:20:04.489 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.489 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.489 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.489 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:20:04.490 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:20:04.490 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.490 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.490 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.491 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:20:04.491 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.491 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.491 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.492 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:20:04.492 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:20:04.492 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.492 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.493 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.493 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:20:04.493 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:20:04.493 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.493 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.494 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.494 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:20:04.494 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.494 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.502 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.503 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:20:04.503 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:20:04.503 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.503 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.504 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.504 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:20:04.504 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:20:04.504 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.505 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.505 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.505 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:20:04.505 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:20:04.506 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:20:04.506 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:20:04.506 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:20:04.506 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:20:04.507 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:20:04.507 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.507 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.507 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.508 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:20:04.508 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:20:04.508 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:20:04.508 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:20:04.509 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:20:04.509 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:20:04.509 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:20:04.509 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:20:04.510 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:20:04.510 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 31, 2021-12-17T18:20:04.510 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:20:04.510 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:20:04.511 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:20:04.511 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.511 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.511 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.511 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:20:04.512 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:20:04.512 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.512 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.512 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.513 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:20:04.513 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:20:04.513 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.513 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.514 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.514 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:20:04.514 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.514 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.515 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.515 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:20:04.515 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:20:04.516 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.516 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.516 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.516 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:20:04.517 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:20:04.517 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.517 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.517 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.517 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:20:04.518 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.518 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.518 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.518 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:20:04.519 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:20:04.519 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.519 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.519 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.520 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:20:04.520 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:20:04.520 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.520 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.520 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.521 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:20:04.521 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.521 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.521 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.522 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:20:04.522 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:20:04.522 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.522 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.523 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.523 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:20:04.523 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:20:04.523 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.523 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.524 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.524 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:20:04.524 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:20:04.524 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:20:04.525 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:20:04.525 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:20:04.525 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:20:04.525 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:20:04.526 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.526 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.526 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.526 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:20:04.526 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:20:04.527 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:20:04.527 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:20:04.527 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:20:04.527 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:20:04.528 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:20:04.528 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:20:04.528 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:20:04.528 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 30, 2021-12-17T18:20:04.529 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:20:04.529 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:20:04.529 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:20:04.529 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.530 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.530 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.530 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:20:04.530 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:20:04.531 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.531 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.531 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.531 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:20:04.531 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:20:04.532 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.532 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.532 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.532 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:20:04.533 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.533 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.533 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.533 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:20:04.534 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:20:04.534 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.534 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.534 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.534 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:20:04.535 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:20:04.535 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.535 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.535 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.536 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:20:04.536 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.536 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.536 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.537 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:20:04.537 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:20:04.537 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.537 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.538 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.538 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:20:04.538 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:20:04.538 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.539 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.539 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.539 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:20:04.539 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.540 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.540 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.540 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:20:04.540 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:20:04.541 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.541 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.541 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.541 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:20:04.541 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:20:04.542 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.542 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.542 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.542 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:20:04.543 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:20:04.543 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:20:04.543 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:20:04.543 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:20:04.544 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:20:04.544 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:20:04.544 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.544 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.545 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:20:04.545 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:20:04.545 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:20:04.545 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:20:04.546 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:20:04.546 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:20:04.546 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:20:04.546 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:20:04.547 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:20:04.547 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 31, 2021-12-17T18:20:04.547 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:20:04.547 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:20:04.548 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:20:04.548 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.548 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.548 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.549 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:20:04.549 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:20:04.549 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.549 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.549 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.550 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:20:04.550 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:20:04.550 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.550 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.551 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.551 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:20:04.551 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.551 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.552 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.552 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:20:04.552 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:20:04.552 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.553 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.553 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.553 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:20:04.553 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:20:04.554 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.554 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.554 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.554 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:20:04.555 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.555 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.555 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.555 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:20:04.556 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:20:04.556 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.556 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.556 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.556 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:20:04.557 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:20:04.557 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.557 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.557 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.558 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:20:04.558 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.558 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.558 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.559 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:20:04.559 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:20:04.559 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.559 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.560 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.560 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:20:04.560 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:20:04.560 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.560 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.561 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:20:04.561 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:20:04.561 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:20:04.562 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:20:04.562 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:20:04.562 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:20:04.562 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:20:04.563 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.563 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.563 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.563 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:20:04.563 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:20:04.564 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:20:04.564 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:20:04.564 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:20:04.564 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:20:04.565 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:20:04.565 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:20:04.565 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:20:04.565 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 31, 2021-12-17T18:20:04.566 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:20:04.566 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:20:04.566 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:20:04.566 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.567 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.567 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.567 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:20:04.567 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:20:04.568 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.568 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.568 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.568 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:20:04.568 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:20:04.569 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.569 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.569 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.569 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:20:04.570 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.570 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.570 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.570 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:20:04.571 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:20:04.571 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.571 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.571 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.571 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:20:04.572 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:20:04.572 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.572 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.573 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:20:04.573 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.573 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.573 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.574 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:20:04.574 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:20:04.574 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.574 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.574 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.575 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:20:04.575 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:20:04.575 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.575 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.576 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:20:04.576 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.576 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.577 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.577 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:20:04.577 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:20:04.577 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.578 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.578 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.578 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:20:04.578 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:20:04.579 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.579 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.579 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.579 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:20:04.579 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:20:04.580 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:20:04.580 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:20:04.580 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:20:04.580 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:20:04.581 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:20:04.581 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.581 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.581 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:20:04.582 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:20:04.582 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:20:04.582 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:20:04.583 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:20:04.583 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:20:04.583 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:20:04.583 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:20:04.583 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:20:04.584 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 31, 2021-12-17T18:20:04.584 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:20:04.584 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:20:04.584 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:20:04.585 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.585 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.585 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.585 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:20:04.585 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:20:04.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.586 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.586 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.586 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:20:04.587 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:20:04.587 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.587 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.588 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:20:04.588 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.588 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.588 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.589 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:20:04.589 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:20:04.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.589 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.590 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.590 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:20:04.590 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:20:04.591 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.591 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.591 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:20:04.592 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.592 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.592 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.592 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:20:04.593 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:20:04.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.593 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.593 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.593 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:20:04.594 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:20:04.594 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.594 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.595 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:20:04.595 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.595 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.595 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.596 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:20:04.596 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:20:04.596 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.596 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.596 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.597 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:20:04.597 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:20:04.597 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.597 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.598 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:20:04.598 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:20:04.598 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:20:04.599 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:20:04.599 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:20:04.599 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:20:04.599 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:20:04.600 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.600 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.600 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.600 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:20:04.601 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:20:04.601 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:20:04.601 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:20:04.601 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:20:04.601 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:20:04.602 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:20:04.602 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:20:04.602 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:20:04.602 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 30, 2021-12-17T18:20:04.603 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:20:04.603 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:20:04.603 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:20:04.603 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.604 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.604 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.604 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:20:04.605 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:20:04.605 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.605 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.605 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.605 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:20:04.606 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:20:04.606 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.606 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.606 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.607 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:20:04.607 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.607 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.607 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.608 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:20:04.608 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:20:04.608 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.608 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.609 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.609 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:20:04.609 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:20:04.609 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.609 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.610 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:20:04.610 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.610 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.611 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.611 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:20:04.611 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:20:04.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.611 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.612 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.612 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:20:04.612 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:20:04.612 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.613 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.613 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.613 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:20:04.613 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.614 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.614 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.614 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:20:04.614 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:20:04.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.615 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.615 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.615 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:20:04.616 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:20:04.616 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.616 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.617 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:20:04.617 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:20:04.617 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:20:04.617 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:20:04.618 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:20:04.618 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:20:04.618 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:20:04.618 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.619 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.619 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.619 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:20:04.619 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:20:04.620 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:20:04.620 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:20:04.620 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:20:04.620 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:20:04.620 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:20:04.621 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:20:04.621 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:20:04.621 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 31, 2021-12-17T18:20:04.621 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:20:04.622 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:20:04.622 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:20:04.622 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.622 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.623 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.623 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:20:04.623 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:20:04.623 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.624 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.624 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.624 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:20:04.624 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:20:04.624 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.625 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.625 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.625 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:20:04.625 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.626 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.626 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.626 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:20:04.626 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:20:04.627 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.627 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.627 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.627 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:20:04.627 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:20:04.628 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.628 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.628 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.628 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:20:04.629 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.629 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.629 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.629 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:20:04.630 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:20:04.630 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.630 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.630 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.630 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:20:04.631 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:20:04.631 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.631 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.631 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.632 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:20:04.632 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:04.632 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.632 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:04.633 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:20:04.633 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:20:04.633 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.633 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.634 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:04.634 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:20:04.634 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:20:04.634 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.634 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.635 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.635 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:20:04.635 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:20:04.635 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:20:04.636 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:20:04.636 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:20:04.636 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:20:04.636 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:20:04.637 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:04.637 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.637 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:20:04.637 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:20:04.638 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.638 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:20:04.638 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:20:04.638 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:20:04.639 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:20:04.639 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:20:04.639 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:20:04.639 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:20:04.640 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:20:04.640 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.640 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.640 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:20:04.640 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:20:04.641 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:20:04.641 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:20:04.641 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:20:04.641 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:20:04.642 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:20:04.642 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:20:04.642 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.642 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.643 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:20:04.643 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:20:04.643 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:20:04.643 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:20:04.644 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:20:04.644 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:20:04.644 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:20:04.644 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:20:04.644 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.645 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.645 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:20:04.645 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:20:04.645 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:20:04.646 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:20:04.646 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:20:04.646 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:20:04.646 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:20:04.647 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:20:04.647 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.647 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.647 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:20:04.647 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:20:04.648 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:20:04.648 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:20:04.648 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:20:04.648 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:20:04.649 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:20:04.649 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:20:04.649 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.649 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.649 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:20:04.650 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:20:04.650 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:20:04.650 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:20:04.650 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:20:04.651 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:20:04.651 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:20:04.651 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:20:04.651 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.652 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.652 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:20:04.652 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:20:04.652 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:20:04.652 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:20:04.653 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:20:04.653 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:20:04.653 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:20:04.654 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:20:04.654 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.654 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:04.654 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:20:04.655 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:20:04.655 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:20:04.655 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:20:04.655 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:20:04.656 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:20:04.656 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:20:04.656 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:20:04.656 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.656 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:20:04.657 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:20:04.657 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:20:04.657 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:20:04.657 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:20:04.658 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": {}, 2021-12-17T18:20:04.658 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:20:04.658 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:20:04.658 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:20:04.659 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:20:04.659 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:20:04.659 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:20:04.659 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:20:04.660 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:20:04.660 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:04.660 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:04.660 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:20:04.661 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:20:04.661 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:20:04.661 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:20:04.661 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:20:04.662 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:20:04.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.402+0000 7fea37fff700 1 -- 172.21.15.62:0/1415415437 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fea140535b0 msgr2=0x7fea14055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:04.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.402+0000 7fea37fff700 1 --2- 172.21.15.62:0/1415415437 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fea140535b0 0x7fea14055a70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fea28005000 tx=0x7fea28009040).stop 2021-12-17T18:20:04.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.402+0000 7fea37fff700 1 -- 172.21.15.62:0/1415415437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea38155d30 msgr2=0x7fea381561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:04.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.402+0000 7fea37fff700 1 --2- 172.21.15.62:0/1415415437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea38155d30 0x7fea381561b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fea381522a0 tx=0x7fea30008040).stop 2021-12-17T18:20:04.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.402+0000 7fea37fff700 1 -- 172.21.15.62:0/1415415437 shutdown_connections 2021-12-17T18:20:04.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.402+0000 7fea37fff700 1 --2- 172.21.15.62:0/1415415437 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fea140535b0 0x7fea14055a70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.402+0000 7fea37fff700 1 --2- 172.21.15.62:0/1415415437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea38155d30 0x7fea381561b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.402+0000 7fea37fff700 1 --2- 172.21.15.62:0/1415415437 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fea38145a40 0x7fea38155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.402+0000 7fea37fff700 1 --2- 172.21.15.62:0/1415415437 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fea1c003d60 0x7fea38066b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.402+0000 7fea37fff700 1 -- 172.21.15.62:0/1415415437 >> 172.21.15.62:0/1415415437 conn(0x7fea3805c750 msgr2=0x7fea380b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:04.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.402+0000 7fea37fff700 1 -- 172.21.15.62:0/1415415437 shutdown_connections 2021-12-17T18:20:04.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.402+0000 7fea37fff700 1 -- 172.21.15.62:0/1415415437 wait complete. 2021-12-17T18:20:04.668 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:20:04.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.770+0000 7fba2c43d700 1 Processor -- start 2021-12-17T18:20:04.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.770+0000 7fba2c43d700 1 -- start start 2021-12-17T18:20:04.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2c43d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fba240b3eb0 0x7fba24145110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:04.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2c43d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fba24067770 0x7fba240b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:04.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2c43d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba240b27c0 con 0x7fba240b4780 2021-12-17T18:20:04.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2c43d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba24144730 con 0x7fba240b3eb0 2021-12-17T18:20:04.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2c43d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba241449d0 con 0x7fba24067770 2021-12-17T18:20:04.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2a9da700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fba240b4780 0x7fba2405f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33182/0 (socket says 172.21.15.62:33182) 2021-12-17T18:20:04.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2a9da700 1 -- 172.21.15.62:0/951183571 learned_addr learned my addr 172.21.15.62:0/951183571 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:04.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2a1d9700 1 --2- 172.21.15.62:0/951183571 >> v2:172.21.15.62:3300/0 conn(0x7fba240b3eb0 0x7fba24145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:04.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba299d8700 1 --2- 172.21.15.62:0/951183571 >> v2:172.21.15.109:3300/0 conn(0x7fba24067770 0x7fba240b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:04.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba291d7700 1 -- 172.21.15.62:0/951183571 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88024808 0 0) 0x7fba240b27c0 con 0x7fba240b4780 2021-12-17T18:20:04.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba291d7700 1 -- 172.21.15.62:0/951183571 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba0c003260 con 0x7fba240b4780 2021-12-17T18:20:04.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba291d7700 1 -- 172.21.15.62:0/951183571 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1881028462 0 0) 0x7fba0c003260 con 0x7fba240b4780 2021-12-17T18:20:04.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2a1d9700 1 -- 172.21.15.62:0/951183571 >> v2:172.21.15.109:3300/0 conn(0x7fba24067770 msgr2=0x7fba240b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:04.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2a1d9700 1 --2- 172.21.15.62:0/951183571 >> v2:172.21.15.109:3300/0 conn(0x7fba24067770 0x7fba240b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2a1d9700 1 -- 172.21.15.62:0/951183571 >> v1:172.21.15.62:6789/0 conn(0x7fba240b4780 legacy=0x7fba2405f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:04.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2a1d9700 1 -- 172.21.15.62:0/951183571 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba24144c70 con 0x7fba240b3eb0 2021-12-17T18:20:04.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2a1d9700 1 --2- 172.21.15.62:0/951183571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba240b3eb0 0x7fba24145110 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fba1c001b80 tx=0x7fba14006df0).ready entity=mon.0 client_cookie=a96f8b7c0ea180d5 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:04.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba291d7700 1 -- 172.21.15.62:0/951183571 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba1c0019e0 con 0x7fba240b3eb0 2021-12-17T18:20:04.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba291d7700 1 -- 172.21.15.62:0/951183571 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba14000e90 con 0x7fba240b3eb0 2021-12-17T18:20:04.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba291d7700 1 -- 172.21.15.62:0/951183571 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba14012460 con 0x7fba240b3eb0 2021-12-17T18:20:04.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2c43d700 1 -- 172.21.15.62:0/951183571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba240b3eb0 msgr2=0x7fba24145110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:04.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2c43d700 1 --2- 172.21.15.62:0/951183571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba240b3eb0 0x7fba24145110 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fba1c001b80 tx=0x7fba14006df0).stop 2021-12-17T18:20:04.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2c43d700 1 -- 172.21.15.62:0/951183571 shutdown_connections 2021-12-17T18:20:04.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2c43d700 1 --2- 172.21.15.62:0/951183571 >> v2:172.21.15.109:3300/0 conn(0x7fba24067770 0x7fba240b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2c43d700 1 --2- 172.21.15.62:0/951183571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba240b3eb0 0x7fba24145110 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2c43d700 1 -- 172.21.15.62:0/951183571 >> 172.21.15.62:0/951183571 conn(0x7fba2405cb40 msgr2=0x7fba2405cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:04.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2c43d700 1 -- 172.21.15.62:0/951183571 shutdown_connections 2021-12-17T18:20:04.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.774+0000 7fba2c43d700 1 -- 172.21.15.62:0/951183571 wait complete. 2021-12-17T18:20:04.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.778+0000 7fba2c43d700 1 Processor -- start 2021-12-17T18:20:04.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.778+0000 7fba2c43d700 1 -- start start 2021-12-17T18:20:04.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.778+0000 7fba2c43d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba24067770 0x7fba2413f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:04.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.778+0000 7fba2c43d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba240b3eb0 0x7fba240acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:04.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.778+0000 7fba2c43d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba240b4780 0x7fba24063e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:04.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.778+0000 7fba2c43d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba240b75b0 con 0x7fba240b3eb0 2021-12-17T18:20:04.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.778+0000 7fba2c43d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba240630e0 con 0x7fba24067770 2021-12-17T18:20:04.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.778+0000 7fba2c43d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba24063a10 con 0x7fba240b4780 2021-12-17T18:20:04.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.778+0000 7fba299d8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba240b3eb0 0x7fba240acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:04.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba299d8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba240b3eb0 0x7fba240acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49606/0 (socket says 172.21.15.62:49606) 2021-12-17T18:20:04.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba299d8700 1 -- 172.21.15.62:0/4029692815 learned_addr learned my addr 172.21.15.62:0/4029692815 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:04.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba2a1d9700 1 --2- 172.21.15.62:0/4029692815 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba24067770 0x7fba2413f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:04.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba2a9da700 1 --2- 172.21.15.62:0/4029692815 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba240b4780 0x7fba24063e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:04.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba299d8700 1 -- 172.21.15.62:0/4029692815 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba240b4780 msgr2=0x7fba24063e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:04.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba299d8700 1 --2- 172.21.15.62:0/4029692815 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba240b4780 0x7fba24063e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba299d8700 1 -- 172.21.15.62:0/4029692815 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba24067770 msgr2=0x7fba2413f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:04.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba299d8700 1 --2- 172.21.15.62:0/4029692815 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba24067770 0x7fba2413f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba299d8700 1 -- 172.21.15.62:0/4029692815 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1400b180 con 0x7fba240b3eb0 2021-12-17T18:20:04.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba299d8700 1 --2- 172.21.15.62:0/4029692815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba240b3eb0 0x7fba240acc80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fba240abad0 tx=0x7fba20006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:04.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba137fe700 1 -- 172.21.15.62:0/4029692815 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba20010780 con 0x7fba240b3eb0 2021-12-17T18:20:04.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba137fe700 1 -- 172.21.15.62:0/4029692815 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba200108e0 con 0x7fba240b3eb0 2021-12-17T18:20:04.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba2c43d700 1 -- 172.21.15.62:0/4029692815 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba24063310 con 0x7fba240b3eb0 2021-12-17T18:20:04.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba137fe700 1 -- 172.21.15.62:0/4029692815 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba20010c40 con 0x7fba240b3eb0 2021-12-17T18:20:04.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba2c43d700 1 -- 172.21.15.62:0/4029692815 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba240ae080 con 0x7fba240b3eb0 2021-12-17T18:20:04.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba2c43d700 1 -- 172.21.15.62:0/4029692815 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba240573d0 con 0x7fba240b3eb0 2021-12-17T18:20:04.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba137fe700 1 -- 172.21.15.62:0/4029692815 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fba2001c460 con 0x7fba240b3eb0 2021-12-17T18:20:04.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.782+0000 7fba137fe700 1 --2- 172.21.15.62:0/4029692815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba040536a0 0x7fba04055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:04.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.786+0000 7fba137fe700 1 -- 172.21.15.62:0/4029692815 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fba2006bcf0 con 0x7fba240b3eb0 2021-12-17T18:20:04.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.786+0000 7fba2a1d9700 1 --2- 172.21.15.62:0/4029692815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba040536a0 0x7fba04055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:04.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.786+0000 7fba2a1d9700 1 --2- 172.21.15.62:0/4029692815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba040536a0 0x7fba04055b60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fba1401a000 tx=0x7fba14014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:04.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.790+0000 7fba137fe700 1 -- 172.21.15.62:0/4029692815 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fba20042d50 con 0x7fba240b3eb0 2021-12-17T18:20:04.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.950+0000 7fba2c43d700 1 -- 172.21.15.62:0/4029692815 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba240ae390 con 0x7fba240b3eb0 2021-12-17T18:20:04.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.954+0000 7fba137fe700 1 -- 172.21.15.62:0/4029692815 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fba20046370 con 0x7fba240b3eb0 2021-12-17T18:20:04.959 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:04.959 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4093989719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4093989719},{"type":"v1","addr":"172.21.15.62:6833","nonce":4093989719}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:19:00.503279+0000","modified":"2021-12-17T18:19:01.505814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4906},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4906":{"gid":4906,"name":"b","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/360945085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":360945085},{"type":"v1","addr":"172.21.15.109:6835","nonce":360945085}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-12-17T18:20:04.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.954+0000 7fba2c43d700 1 -- 172.21.15.62:0/4029692815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba040536a0 msgr2=0x7fba04055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:04.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.954+0000 7fba2c43d700 1 --2- 172.21.15.62:0/4029692815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba040536a0 0x7fba04055b60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fba1401a000 tx=0x7fba14014000).stop 2021-12-17T18:20:04.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.954+0000 7fba2c43d700 1 -- 172.21.15.62:0/4029692815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba240b3eb0 msgr2=0x7fba240acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:04.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.954+0000 7fba2c43d700 1 --2- 172.21.15.62:0/4029692815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba240b3eb0 0x7fba240acc80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fba240abad0 tx=0x7fba20006df0).stop 2021-12-17T18:20:04.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.954+0000 7fba2c43d700 1 -- 172.21.15.62:0/4029692815 shutdown_connections 2021-12-17T18:20:04.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.954+0000 7fba2c43d700 1 --2- 172.21.15.62:0/4029692815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba040536a0 0x7fba04055b60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.954+0000 7fba2c43d700 1 --2- 172.21.15.62:0/4029692815 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba240b4780 0x7fba24063e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.954+0000 7fba2c43d700 1 --2- 172.21.15.62:0/4029692815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba240b3eb0 0x7fba240acc80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.954+0000 7fba2c43d700 1 --2- 172.21.15.62:0/4029692815 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba24067770 0x7fba2413f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:04.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.954+0000 7fba2c43d700 1 -- 172.21.15.62:0/4029692815 >> 172.21.15.62:0/4029692815 conn(0x7fba2405cb40 msgr2=0x7fba241430b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:04.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.954+0000 7fba2c43d700 1 -- 172.21.15.62:0/4029692815 shutdown_connections 2021-12-17T18:20:04.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:04.954+0000 7fba2c43d700 1 -- 172.21.15.62:0/4029692815 wait complete. 2021-12-17T18:20:04.964 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 10 2021-12-17T18:20:04.972 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-12-17T18:20:05.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.070+0000 7ffb5f59e700 1 Processor -- start 2021-12-17T18:20:05.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.070+0000 7ffb5f59e700 1 -- start start 2021-12-17T18:20:05.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb60062620 0x7ffb6013c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:05.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5f59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffb60143610 0x7ffb6014d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:05.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5f59e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb60146e30 con 0x7ffb6013cc60 2021-12-17T18:20:05.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5f59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb60062a00 con 0x7ffb60143610 2021-12-17T18:20:05.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb600b59e0 con 0x7ffb60062620 2021-12-17T18:20:05.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5ed9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffb60143610 0x7ffb6014d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:05.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5dd9b700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7ffb6013cc60 0x7ffb60142f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:49512/0 (socket says 172.21.15.62:49512) 2021-12-17T18:20:05.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5dd9b700 1 -- 172.21.15.62:0/3098684585 learned_addr learned my addr 172.21.15.62:0/3098684585 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:05.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5e59c700 1 --2- 172.21.15.62:0/3098684585 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb60062620 0x7ffb6013c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:05.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5d59a700 1 -- 172.21.15.62:0/3098684585 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847804896 0 0) 0x7ffb60146e30 con 0x7ffb6013cc60 2021-12-17T18:20:05.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5d59a700 1 -- 172.21.15.62:0/3098684585 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb44003260 con 0x7ffb6013cc60 2021-12-17T18:20:05.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5ed9d700 1 -- 172.21.15.62:0/3098684585 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb60062620 msgr2=0x7ffb6013c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:05.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5ed9d700 1 --2- 172.21.15.62:0/3098684585 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb60062620 0x7ffb6013c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:05.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5ed9d700 1 -- 172.21.15.62:0/3098684585 >> v1:172.21.15.109:6789/0 conn(0x7ffb6013cc60 legacy=0x7ffb60142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:05.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5ed9d700 1 -- 172.21.15.62:0/3098684585 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb60147060 con 0x7ffb60143610 2021-12-17T18:20:05.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5e59c700 1 --2- 172.21.15.62:0/3098684585 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb60062620 0x7ffb6013c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:20:05.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5ed9d700 1 --2- 172.21.15.62:0/3098684585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb60143610 0x7ffb6014d720 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7ffb58002f70 tx=0x7ffb58006df0).ready entity=mon.0 client_cookie=395680d2d6edf41b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:05.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5d59a700 1 -- 172.21.15.62:0/3098684585 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb5800d4a0 con 0x7ffb60143610 2021-12-17T18:20:05.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5d59a700 1 -- 172.21.15.62:0/3098684585 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb58000e90 con 0x7ffb60143610 2021-12-17T18:20:05.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5d59a700 1 -- 172.21.15.62:0/3098684585 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb5800d7f0 con 0x7ffb60143610 2021-12-17T18:20:05.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5f59e700 1 -- 172.21.15.62:0/3098684585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb60143610 msgr2=0x7ffb6014d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:05.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5f59e700 1 --2- 172.21.15.62:0/3098684585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb60143610 0x7ffb6014d720 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7ffb58002f70 tx=0x7ffb58006df0).stop 2021-12-17T18:20:05.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5f59e700 1 -- 172.21.15.62:0/3098684585 shutdown_connections 2021-12-17T18:20:05.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5f59e700 1 --2- 172.21.15.62:0/3098684585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb60143610 0x7ffb6014d720 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:05.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5f59e700 1 --2- 172.21.15.62:0/3098684585 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb60062620 0x7ffb6013c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:05.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5f59e700 1 -- 172.21.15.62:0/3098684585 >> 172.21.15.62:0/3098684585 conn(0x7ffb6005c750 msgr2=0x7ffb6005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:05.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5f59e700 1 -- 172.21.15.62:0/3098684585 shutdown_connections 2021-12-17T18:20:05.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.074+0000 7ffb5f59e700 1 -- 172.21.15.62:0/3098684585 wait complete. 2021-12-17T18:20:05.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.078+0000 7ffb5f59e700 1 Processor -- start 2021-12-17T18:20:05.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.078+0000 7ffb5f59e700 1 -- start start 2021-12-17T18:20:05.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5f59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb60062620 0x7ffb60145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:05.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb6013cc60 0x7ffb60062bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:05.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb60143610 0x7ffb600630c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:05.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6013c320 con 0x7ffb6013cc60 2021-12-17T18:20:05.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5f59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb601404a0 con 0x7ffb60062620 2021-12-17T18:20:05.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6013ef30 con 0x7ffb60143610 2021-12-17T18:20:05.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb6013cc60 0x7ffb60062bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:05.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb6013cc60 0x7ffb60062bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49620/0 (socket says 172.21.15.62:49620) 2021-12-17T18:20:05.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5dd9b700 1 -- 172.21.15.62:0/4070830117 learned_addr learned my addr 172.21.15.62:0/4070830117 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:05.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5e59c700 1 --2- 172.21.15.62:0/4070830117 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb60062620 0x7ffb60145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:05.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5ed9d700 1 --2- 172.21.15.62:0/4070830117 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb60143610 0x7ffb600630c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:05.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5dd9b700 1 -- 172.21.15.62:0/4070830117 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb60143610 msgr2=0x7ffb600630c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:05.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5dd9b700 1 --2- 172.21.15.62:0/4070830117 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb60143610 0x7ffb600630c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:05.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5dd9b700 1 -- 172.21.15.62:0/4070830117 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb60062620 msgr2=0x7ffb60145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:05.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5dd9b700 1 --2- 172.21.15.62:0/4070830117 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb60062620 0x7ffb60145a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:05.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5dd9b700 1 -- 172.21.15.62:0/4070830117 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5400b180 con 0x7ffb6013cc60 2021-12-17T18:20:05.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5e59c700 1 --2- 172.21.15.62:0/4070830117 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb60062620 0x7ffb60145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:05.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5ed9d700 1 --2- 172.21.15.62:0/4070830117 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb60143610 0x7ffb600630c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:20:05.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5dd9b700 1 --2- 172.21.15.62:0/4070830117 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb6013cc60 0x7ffb60062bd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7ffb50001490 tx=0x7ffb50007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:05.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb4f7fe700 1 -- 172.21.15.62:0/4070830117 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb50005ba0 con 0x7ffb6013cc60 2021-12-17T18:20:05.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb4f7fe700 1 -- 172.21.15.62:0/4070830117 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb50005d00 con 0x7ffb6013cc60 2021-12-17T18:20:05.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5f59e700 1 -- 172.21.15.62:0/4070830117 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5800b180 con 0x7ffb6013cc60 2021-12-17T18:20:05.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb4f7fe700 1 -- 172.21.15.62:0/4070830117 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb500072c0 con 0x7ffb6013cc60 2021-12-17T18:20:05.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5f59e700 1 -- 172.21.15.62:0/4070830117 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb600635b0 con 0x7ffb6013cc60 2021-12-17T18:20:05.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb5f59e700 1 -- 172.21.15.62:0/4070830117 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb600b42c0 con 0x7ffb6013cc60 2021-12-17T18:20:05.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.082+0000 7ffb4f7fe700 1 -- 172.21.15.62:0/4070830117 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffb5001a070 con 0x7ffb6013cc60 2021-12-17T18:20:05.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.086+0000 7ffb4f7fe700 1 --2- 172.21.15.62:0/4070830117 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb3c053520 0x7ffb3c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:05.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.086+0000 7ffb4f7fe700 1 -- 172.21.15.62:0/4070830117 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffb5006ad60 con 0x7ffb6013cc60 2021-12-17T18:20:05.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.086+0000 7ffb5e59c700 1 --2- 172.21.15.62:0/4070830117 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb3c053520 0x7ffb3c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:05.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.086+0000 7ffb5e59c700 1 --2- 172.21.15.62:0/4070830117 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb3c053520 0x7ffb3c0559e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7ffb5400b000 tx=0x7ffb54008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:05.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.086+0000 7ffb4f7fe700 1 -- 172.21.15.62:0/4070830117 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffb50041ec0 con 0x7ffb6013cc60 2021-12-17T18:20:05.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.250+0000 7ffb5f59e700 1 -- 172.21.15.62:0/4070830117 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ffb600573d0 con 0x7ffb6013cc60 2021-12-17T18:20:05.769 INFO:tasks.ceph.mon.a.smithi062.stderr:2021-12-17T18:20:05.766+0000 7f8d3b366700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-12-17T18:20:05.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.770+0000 7ffb4f7fe700 1 -- 172.21.15.62:0/4070830117 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v11) v1 ==== 161+0+0 (secure 0 0 0) 0x7ffb500454e0 con 0x7ffb6013cc60 2021-12-17T18:20:05.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.774+0000 7ffb5f59e700 1 -- 172.21.15.62:0/4070830117 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb3c053520 msgr2=0x7ffb3c0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:05.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.774+0000 7ffb5f59e700 1 --2- 172.21.15.62:0/4070830117 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb3c053520 0x7ffb3c0559e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7ffb5400b000 tx=0x7ffb54008040).stop 2021-12-17T18:20:05.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.774+0000 7ffb5f59e700 1 -- 172.21.15.62:0/4070830117 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb6013cc60 msgr2=0x7ffb60062bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:05.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.774+0000 7ffb5f59e700 1 --2- 172.21.15.62:0/4070830117 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb6013cc60 0x7ffb60062bd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7ffb50001490 tx=0x7ffb50007e20).stop 2021-12-17T18:20:05.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.774+0000 7ffb5f59e700 1 -- 172.21.15.62:0/4070830117 shutdown_connections 2021-12-17T18:20:05.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.774+0000 7ffb5f59e700 1 --2- 172.21.15.62:0/4070830117 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb3c053520 0x7ffb3c0559e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:05.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.774+0000 7ffb5f59e700 1 --2- 172.21.15.62:0/4070830117 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb60143610 0x7ffb600630c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:05.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.774+0000 7ffb5f59e700 1 --2- 172.21.15.62:0/4070830117 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb6013cc60 0x7ffb60062bd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:05.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.774+0000 7ffb5f59e700 1 --2- 172.21.15.62:0/4070830117 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb60062620 0x7ffb60145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:05.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.774+0000 7ffb5f59e700 1 -- 172.21.15.62:0/4070830117 >> 172.21.15.62:0/4070830117 conn(0x7ffb6005c750 msgr2=0x7ffb600b9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:05.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.774+0000 7ffb5f59e700 1 -- 172.21.15.62:0/4070830117 shutdown_connections 2021-12-17T18:20:05.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.774+0000 7ffb5f59e700 1 -- 172.21.15.62:0/4070830117 wait complete. 2021-12-17T18:20:05.783 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-12-17T18:20:05.796 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:20:05.814 INFO:tasks.ceph.mds.b.smithi109.stdout:starting mds.b at 2021-12-17T18:20:05.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff1907dc700 1 Processor -- start 2021-12-17T18:20:05.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff1907dc700 1 -- start start 2021-12-17T18:20:05.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff1907dc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff188067830 0x7ff188146940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:05.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff1907dc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff188147540 0x7ff1880b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:05.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff1907dc700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff188067c10 con 0x7ff1880aca60 2021-12-17T18:20:05.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff1907dc700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff188060520 con 0x7ff188147540 2021-12-17T18:20:05.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff1907dc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1880acf00 con 0x7ff188067830 2021-12-17T18:20:05.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff18dd77700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff1880aca60 0x7ff188146e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33206/0 (socket says 172.21.15.62:33206) 2021-12-17T18:20:05.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff18dd77700 1 -- 172.21.15.62:0/388569513 learned_addr learned my addr 172.21.15.62:0/388569513 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:05.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff18ed79700 1 --2- 172.21.15.62:0/388569513 >> v2:172.21.15.109:3300/0 conn(0x7ff188147540 0x7ff1880b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:05.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff18e578700 1 --2- 172.21.15.62:0/388569513 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff188067830 0x7ff188146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:05.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff18d576700 1 -- 172.21.15.62:0/388569513 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563795122 0 0) 0x7ff188067c10 con 0x7ff1880aca60 2021-12-17T18:20:05.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff18d576700 1 -- 172.21.15.62:0/388569513 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff170003260 con 0x7ff1880aca60 2021-12-17T18:20:05.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff18d576700 1 -- 172.21.15.62:0/388569513 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 708157817 0 0) 0x7ff170003260 con 0x7ff1880aca60 2021-12-17T18:20:05.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff18ed79700 1 -- 172.21.15.62:0/388569513 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff188067830 msgr2=0x7ff188146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:05.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff18ed79700 1 --2- 172.21.15.62:0/388569513 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff188067830 0x7ff188146940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:05.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff18ed79700 1 -- 172.21.15.62:0/388569513 >> v1:172.21.15.62:6789/0 conn(0x7ff1880aca60 legacy=0x7ff188146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:05.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.898+0000 7ff18ed79700 1 -- 172.21.15.62:0/388569513 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1880b12a0 con 0x7ff188147540 2021-12-17T18:20:05.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.902+0000 7ff18ed79700 1 --2- 172.21.15.62:0/388569513 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff188147540 0x7ff1880b1d30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7ff184001800 tx=0x7ff1800091d0).ready entity=mon.1 client_cookie=e376d9c211ccf389 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:05.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.902+0000 7ff18d576700 1 -- 172.21.15.62:0/388569513 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff184001660 con 0x7ff188147540 2021-12-17T18:20:05.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.902+0000 7ff18d576700 1 -- 172.21.15.62:0/388569513 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18000f510 con 0x7ff188147540 2021-12-17T18:20:05.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.902+0000 7ff18d576700 1 -- 172.21.15.62:0/388569513 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff18000f680 con 0x7ff188147540 2021-12-17T18:20:05.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.902+0000 7ff1907dc700 1 -- 172.21.15.62:0/388569513 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff188147540 msgr2=0x7ff1880b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:05.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.902+0000 7ff1907dc700 1 --2- 172.21.15.62:0/388569513 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff188147540 0x7ff1880b1d30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7ff184001800 tx=0x7ff1800091d0).stop 2021-12-17T18:20:05.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.902+0000 7ff1907dc700 1 -- 172.21.15.62:0/388569513 shutdown_connections 2021-12-17T18:20:05.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.902+0000 7ff1907dc700 1 --2- 172.21.15.62:0/388569513 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff188147540 0x7ff1880b1d30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:05.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.902+0000 7ff1907dc700 1 --2- 172.21.15.62:0/388569513 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff188067830 0x7ff188146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:05.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.902+0000 7ff1907dc700 1 -- 172.21.15.62:0/388569513 >> 172.21.15.62:0/388569513 conn(0x7ff18805f730 msgr2=0x7ff18805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:05.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.902+0000 7ff1907dc700 1 -- 172.21.15.62:0/388569513 shutdown_connections 2021-12-17T18:20:05.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.902+0000 7ff1907dc700 1 -- 172.21.15.62:0/388569513 wait complete. 2021-12-17T18:20:05.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.902+0000 7ff1907dc700 1 Processor -- start 2021-12-17T18:20:05.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.902+0000 7ff1907dc700 1 -- start start 2021-12-17T18:20:05.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff1907dc700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff188067830 0x7ff1881532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:05.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff1907dc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1880aca60 0x7ff1880a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:05.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff1907dc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff188147540 0x7ff188152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:05.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff1907dc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1880a0710 con 0x7ff1880aca60 2021-12-17T18:20:05.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff1907dc700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1880ac460 con 0x7ff188067830 2021-12-17T18:20:05.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff1907dc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff188153890 con 0x7ff188147540 2021-12-17T18:20:05.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff18dd77700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1880aca60 0x7ff1880a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:05.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff18e578700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff188067830 0x7ff1881532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:05.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff18ed79700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff188147540 0x7ff188152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:05.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff18e578700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff188067830 0x7ff1881532c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:56182/0 (socket says 172.21.15.62:56182) 2021-12-17T18:20:05.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff18e578700 1 -- 172.21.15.62:0/617413458 learned_addr learned my addr 172.21.15.62:0/617413458 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:05.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff18dd77700 1 -- 172.21.15.62:0/617413458 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff188147540 msgr2=0x7ff188152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:05.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff18dd77700 1 --2- 172.21.15.62:0/617413458 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff188147540 0x7ff188152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:05.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff18dd77700 1 -- 172.21.15.62:0/617413458 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff188067830 msgr2=0x7ff1881532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:05.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff18dd77700 1 --2- 172.21.15.62:0/617413458 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff188067830 0x7ff1881532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:05.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff18dd77700 1 -- 172.21.15.62:0/617413458 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff180009470 con 0x7ff1880aca60 2021-12-17T18:20:05.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff18dd77700 1 --2- 172.21.15.62:0/617413458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1880aca60 0x7ff1880a1bc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7ff1840018c0 tx=0x7ff184001a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:05.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff1777fe700 1 -- 172.21.15.62:0/617413458 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff184007170 con 0x7ff1880aca60 2021-12-17T18:20:05.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff1777fe700 1 -- 172.21.15.62:0/617413458 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1840072d0 con 0x7ff1880aca60 2021-12-17T18:20:05.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff1907dc700 1 -- 172.21.15.62:0/617413458 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff188150310 con 0x7ff1880aca60 2021-12-17T18:20:05.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff1777fe700 1 -- 172.21.15.62:0/617413458 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff184004920 con 0x7ff1880aca60 2021-12-17T18:20:05.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff1907dc700 1 -- 172.21.15.62:0/617413458 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1880abf50 con 0x7ff1880aca60 2021-12-17T18:20:05.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.906+0000 7ff1907dc700 1 -- 172.21.15.62:0/617413458 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1880ac620 con 0x7ff1880aca60 2021-12-17T18:20:05.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.910+0000 7ff1777fe700 1 -- 172.21.15.62:0/617413458 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff18401b070 con 0x7ff1880aca60 2021-12-17T18:20:05.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.910+0000 7ff1777fe700 1 --2- 172.21.15.62:0/617413458 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff168053610 0x7ff168055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:05.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.910+0000 7ff1777fe700 1 -- 172.21.15.62:0/617413458 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff18406b0a0 con 0x7ff1880aca60 2021-12-17T18:20:05.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.910+0000 7ff18e578700 1 --2- 172.21.15.62:0/617413458 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff168053610 0x7ff168055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:05.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.910+0000 7ff18e578700 1 --2- 172.21.15.62:0/617413458 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff168053610 0x7ff168055ad0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7ff17800b000 tx=0x7ff178006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:05.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:05.918+0000 7ff1777fe700 1 -- 172.21.15.62:0/617413458 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff1840421b0 con 0x7ff1880aca60 2021-12-17T18:20:06.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.082+0000 7ff1907dc700 1 -- 172.21.15.62:0/617413458 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1880b0fb0 con 0x7ff1880aca60 2021-12-17T18:20:06.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.082+0000 7ff1777fe700 1 -- 172.21.15.62:0/617413458 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1776 (secure 0 0 0) 0x7ff1840457d0 con 0x7ff1880aca60 2021-12-17T18:20:06.089 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:06.090 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4093989719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4093989719},{"type":"v1","addr":"172.21.15.62:6833","nonce":4093989719}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":11,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:19:00.503279+0000","modified":"2021-12-17T18:20:05.768565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-12-17T18:20:06.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.082+0000 7ff1907dc700 1 -- 172.21.15.62:0/617413458 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff168053610 msgr2=0x7ff168055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:06.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.082+0000 7ff1907dc700 1 --2- 172.21.15.62:0/617413458 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff168053610 0x7ff168055ad0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7ff17800b000 tx=0x7ff178006df0).stop 2021-12-17T18:20:06.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.086+0000 7ff1907dc700 1 -- 172.21.15.62:0/617413458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1880aca60 msgr2=0x7ff1880a1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:06.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.086+0000 7ff1907dc700 1 --2- 172.21.15.62:0/617413458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1880aca60 0x7ff1880a1bc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7ff1840018c0 tx=0x7ff184001a80).stop 2021-12-17T18:20:06.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.086+0000 7ff1907dc700 1 -- 172.21.15.62:0/617413458 shutdown_connections 2021-12-17T18:20:06.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.086+0000 7ff1907dc700 1 --2- 172.21.15.62:0/617413458 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff168053610 0x7ff168055ad0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:06.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.086+0000 7ff1907dc700 1 --2- 172.21.15.62:0/617413458 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff188147540 0x7ff188152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:06.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.086+0000 7ff1907dc700 1 --2- 172.21.15.62:0/617413458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1880aca60 0x7ff1880a1bc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:06.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.086+0000 7ff1907dc700 1 --2- 172.21.15.62:0/617413458 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff188067830 0x7ff1881532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:06.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.086+0000 7ff1907dc700 1 -- 172.21.15.62:0/617413458 >> 172.21.15.62:0/617413458 conn(0x7ff18805f730 msgr2=0x7ff188142dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:06.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.086+0000 7ff1907dc700 1 -- 172.21.15.62:0/617413458 shutdown_connections 2021-12-17T18:20:06.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.086+0000 7ff1907dc700 1 -- 172.21.15.62:0/617413458 wait complete. 2021-12-17T18:20:06.095 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 11 2021-12-17T18:20:06.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-12-17T18:20:06.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.206+0000 7f0ce359e700 1 Processor -- start 2021-12-17T18:20:06.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.206+0000 7f0ce359e700 1 -- start start 2021-12-17T18:20:06.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.206+0000 7f0ce359e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f0ce4065170 0x7f0ce4147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:06.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.206+0000 7f0ce359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce4141a20 con 0x7f0ce40b6680 2021-12-17T18:20:06.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.206+0000 7f0ce359e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce4064630 con 0x7f0ce4063f40 2021-12-17T18:20:06.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.206+0000 7f0ce359e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce41487e0 con 0x7f0ce4065170 2021-12-17T18:20:06.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.206+0000 7f0ce259c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0ce40b6680 0x7f0ce4064a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33220/0 (socket says 172.21.15.62:33220) 2021-12-17T18:20:06.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.206+0000 7f0ce259c700 1 -- 172.21.15.62:0/1495230039 learned_addr learned my addr 172.21.15.62:0/1495230039 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:06.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.206+0000 7f0cdbfff700 1 --2- 172.21.15.62:0/1495230039 >> v2:172.21.15.109:3300/0 conn(0x7f0ce4065170 0x7f0ce4147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:06.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.206+0000 7f0ce1d9b700 1 -- 172.21.15.62:0/1495230039 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826423261 0 0) 0x7f0ce4141a20 con 0x7f0ce40b6680 2021-12-17T18:20:06.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.206+0000 7f0ce1d9b700 1 -- 172.21.15.62:0/1495230039 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc4003260 con 0x7f0ce40b6680 2021-12-17T18:20:06.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.206+0000 7f0ce1d9b700 1 -- 172.21.15.62:0/1495230039 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 536801150 0 0) 0x7f0ce4064630 con 0x7f0ce4063f40 2021-12-17T18:20:06.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.206+0000 7f0ce1d9b700 1 -- 172.21.15.62:0/1495230039 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ce4141a20 con 0x7f0ce4063f40 2021-12-17T18:20:06.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.206+0000 7f0cdbfff700 1 -- 172.21.15.62:0/1495230039 >> v1:172.21.15.109:6789/0 conn(0x7f0ce4063f40 legacy=0x7f0ce4147a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:06.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.206+0000 7f0cdbfff700 1 -- 172.21.15.62:0/1495230039 >> v1:172.21.15.62:6789/0 conn(0x7f0ce40b6680 legacy=0x7f0ce4064a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:06.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.206+0000 7f0cdbfff700 1 -- 172.21.15.62:0/1495230039 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce4060010 con 0x7f0ce4065170 2021-12-17T18:20:06.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.210+0000 7f0cdbfff700 1 --2- 172.21.15.62:0/1495230039 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ce4065170 0x7f0ce4147560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f0ccc002f70 tx=0x7f0ccc006df0).ready entity=mon.1 client_cookie=dbfd693b441d4fd8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:06.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.210+0000 7f0ce1d9b700 1 -- 172.21.15.62:0/1495230039 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ccc00d540 con 0x7f0ce4065170 2021-12-17T18:20:06.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.210+0000 7f0ce1d9b700 1 -- 172.21.15.62:0/1495230039 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc000e90 con 0x7f0ce4065170 2021-12-17T18:20:06.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.210+0000 7f0ce1d9b700 1 -- 172.21.15.62:0/1495230039 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ccc00d890 con 0x7f0ce4065170 2021-12-17T18:20:06.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.210+0000 7f0ce359e700 1 -- 172.21.15.62:0/1495230039 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ce4065170 msgr2=0x7f0ce4147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:06.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.210+0000 7f0ce359e700 1 --2- 172.21.15.62:0/1495230039 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ce4065170 0x7f0ce4147560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f0ccc002f70 tx=0x7f0ccc006df0).stop 2021-12-17T18:20:06.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.210+0000 7f0ce359e700 1 -- 172.21.15.62:0/1495230039 shutdown_connections 2021-12-17T18:20:06.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.210+0000 7f0ce359e700 1 --2- 172.21.15.62:0/1495230039 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ce4065170 0x7f0ce4147560 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:06.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.210+0000 7f0ce359e700 1 -- 172.21.15.62:0/1495230039 >> 172.21.15.62:0/1495230039 conn(0x7f0ce40625b0 msgr2=0x7f0ce4063620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:06.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.210+0000 7f0ce359e700 1 -- 172.21.15.62:0/1495230039 shutdown_connections 2021-12-17T18:20:06.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.210+0000 7f0ce359e700 1 -- 172.21.15.62:0/1495230039 wait complete. 2021-12-17T18:20:06.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.210+0000 7f0ce359e700 1 Processor -- start 2021-12-17T18:20:06.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.210+0000 7f0ce359e700 1 -- start start 2021-12-17T18:20:06.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0ce4063f40 0x7f0ce4066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:06.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce359e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ce4065170 0x7f0ce4147450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:06.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ce40b6680 0x7f0ce4147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:06.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce4145130 con 0x7f0ce40b6680 2021-12-17T18:20:06.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce359e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce40ae790 con 0x7f0ce4065170 2021-12-17T18:20:06.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce359e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce4145360 con 0x7f0ce4063f40 2021-12-17T18:20:06.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce2d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ce40b6680 0x7f0ce4147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:06.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce2d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ce40b6680 0x7f0ce4147940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49650/0 (socket says 172.21.15.62:49650) 2021-12-17T18:20:06.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce2d9d700 1 -- 172.21.15.62:0/3427943308 learned_addr learned my addr 172.21.15.62:0/3427943308 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:06.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0cdbfff700 1 --2- 172.21.15.62:0/3427943308 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ce4065170 0x7f0ce4147450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:06.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce259c700 1 --2- 172.21.15.62:0/3427943308 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0ce4063f40 0x7f0ce4066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:06.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce2d9d700 1 -- 172.21.15.62:0/3427943308 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0ce4063f40 msgr2=0x7f0ce4066cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:06.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce2d9d700 1 --2- 172.21.15.62:0/3427943308 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0ce4063f40 0x7f0ce4066cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:06.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce2d9d700 1 -- 172.21.15.62:0/3427943308 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ce4065170 msgr2=0x7f0ce4147450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:06.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce2d9d700 1 --2- 172.21.15.62:0/3427943308 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ce4065170 0x7f0ce4147450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:06.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce2d9d700 1 -- 172.21.15.62:0/3427943308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc00b180 con 0x7f0ce40b6680 2021-12-17T18:20:06.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce2d9d700 1 --2- 172.21.15.62:0/3427943308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ce40b6680 0x7f0ce4147940 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f0cdc001490 tx=0x7f0cdc007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:06.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0cdb7fe700 1 -- 172.21.15.62:0/3427943308 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cdc002310 con 0x7f0ce40b6680 2021-12-17T18:20:06.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0cdb7fe700 1 -- 172.21.15.62:0/3427943308 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc002470 con 0x7f0ce40b6680 2021-12-17T18:20:06.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce359e700 1 -- 172.21.15.62:0/3427943308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce4145600 con 0x7f0ce40b6680 2021-12-17T18:20:06.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0cdb7fe700 1 -- 172.21.15.62:0/3427943308 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cdc001840 con 0x7f0ce40b6680 2021-12-17T18:20:06.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.214+0000 7f0ce359e700 1 -- 172.21.15.62:0/3427943308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce4145dc0 con 0x7f0ce40b6680 2021-12-17T18:20:06.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.218+0000 7f0ce359e700 1 -- 172.21.15.62:0/3427943308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce40604e0 con 0x7f0ce40b6680 2021-12-17T18:20:06.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.218+0000 7f0cdb7fe700 1 -- 172.21.15.62:0/3427943308 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0cdc010030 con 0x7f0ce40b6680 2021-12-17T18:20:06.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.218+0000 7f0cdb7fe700 1 --2- 172.21.15.62:0/3427943308 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0cc80536a0 0x7f0cc8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:06.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.218+0000 7f0cdb7fe700 1 -- 172.21.15.62:0/3427943308 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0cdc06b930 con 0x7f0ce40b6680 2021-12-17T18:20:06.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.218+0000 7f0ce259c700 1 --2- 172.21.15.62:0/3427943308 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0cc80536a0 0x7f0cc8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:06.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.218+0000 7f0ce259c700 1 --2- 172.21.15.62:0/3427943308 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0cc80536a0 0x7f0cc8055b60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f0cd400d000 tx=0x7f0cd4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:06.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.222+0000 7f0cdb7fe700 1 -- 172.21.15.62:0/3427943308 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0cdc0429a0 con 0x7f0ce40b6680 2021-12-17T18:20:06.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.386+0000 7f0ce359e700 1 -- 172.21.15.62:0/3427943308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0ce40573d0 con 0x7f0ce40b6680 2021-12-17T18:20:06.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.786+0000 7f0cdb7fe700 1 -- 172.21.15.62:0/3427943308 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0cdc045fc0 con 0x7f0ce40b6680 2021-12-17T18:20:06.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.790+0000 7f0ce359e700 1 -- 172.21.15.62:0/3427943308 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0cc80536a0 msgr2=0x7f0cc8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:06.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.790+0000 7f0ce359e700 1 --2- 172.21.15.62:0/3427943308 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0cc80536a0 0x7f0cc8055b60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f0cd400d000 tx=0x7f0cd4009040).stop 2021-12-17T18:20:06.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.790+0000 7f0ce359e700 1 -- 172.21.15.62:0/3427943308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ce40b6680 msgr2=0x7f0ce4147940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:06.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.790+0000 7f0ce359e700 1 --2- 172.21.15.62:0/3427943308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ce40b6680 0x7f0ce4147940 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f0cdc001490 tx=0x7f0cdc007dd0).stop 2021-12-17T18:20:06.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.790+0000 7f0ce359e700 1 -- 172.21.15.62:0/3427943308 shutdown_connections 2021-12-17T18:20:06.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.790+0000 7f0ce359e700 1 --2- 172.21.15.62:0/3427943308 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0cc80536a0 0x7f0cc8055b60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:06.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.790+0000 7f0ce359e700 1 --2- 172.21.15.62:0/3427943308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ce40b6680 0x7f0ce4147940 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:06.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.790+0000 7f0ce359e700 1 --2- 172.21.15.62:0/3427943308 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ce4065170 0x7f0ce4147450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:06.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.790+0000 7f0ce359e700 1 --2- 172.21.15.62:0/3427943308 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0ce4063f40 0x7f0ce4066cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:06.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.790+0000 7f0ce359e700 1 -- 172.21.15.62:0/3427943308 >> 172.21.15.62:0/3427943308 conn(0x7f0ce40625b0 msgr2=0x7f0ce40659f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:06.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.790+0000 7f0ce359e700 1 -- 172.21.15.62:0/3427943308 shutdown_connections 2021-12-17T18:20:06.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.790+0000 7f0ce359e700 1 -- 172.21.15.62:0/3427943308 wait complete. 2021-12-17T18:20:06.812 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-12-17T18:20:06.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.926+0000 7f0acf3ef700 1 Processor -- start 2021-12-17T18:20:06.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.926+0000 7f0acf3ef700 1 -- start start 2021-12-17T18:20:06.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0acf3ef700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0ac805fa70 0x7f0ac8061390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:06.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0acf3ef700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac805fe50 con 0x7f0ac81405f0 2021-12-17T18:20:06.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0acf3ef700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac80646a0 con 0x7f0ac8064de0 2021-12-17T18:20:06.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0acf3ef700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac8064940 con 0x7f0ac805fa70 2021-12-17T18:20:06.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0ace3ed700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0ac805fa70 0x7f0ac8061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:06.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0acebee700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0ac81405f0 0x7f0ac8142e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33236/0 (socket says 172.21.15.62:33236) 2021-12-17T18:20:06.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0acebee700 1 -- 172.21.15.62:0/4221355556 learned_addr learned my addr 172.21.15.62:0/4221355556 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:06.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0acd3eb700 1 -- 172.21.15.62:0/4221355556 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233978648 0 0) 0x7f0ac805fe50 con 0x7f0ac81405f0 2021-12-17T18:20:06.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0acd3eb700 1 -- 172.21.15.62:0/4221355556 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ab0003260 con 0x7f0ac81405f0 2021-12-17T18:20:06.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0acd3eb700 1 -- 172.21.15.62:0/4221355556 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113761250 0 0) 0x7f0ac80646a0 con 0x7f0ac8064de0 2021-12-17T18:20:06.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0acd3eb700 1 -- 172.21.15.62:0/4221355556 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ac805fe50 con 0x7f0ac8064de0 2021-12-17T18:20:06.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0ace3ed700 1 -- 172.21.15.62:0/4221355556 >> v1:172.21.15.109:6789/0 conn(0x7f0ac8064de0 legacy=0x7f0ac813fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:06.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0ace3ed700 1 -- 172.21.15.62:0/4221355556 >> v1:172.21.15.62:6789/0 conn(0x7f0ac81405f0 legacy=0x7f0ac8142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:06.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0ace3ed700 1 -- 172.21.15.62:0/4221355556 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac8062450 con 0x7f0ac805fa70 2021-12-17T18:20:06.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0ace3ed700 1 --2- 172.21.15.62:0/4221355556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac805fa70 0x7f0ac8061390 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f0ac4002f70 tx=0x7f0ac4006df0).ready entity=mon.0 client_cookie=8d0acd404c29b25d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:06.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0acd3eb700 1 -- 172.21.15.62:0/4221355556 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ac400d540 con 0x7f0ac805fa70 2021-12-17T18:20:06.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0acd3eb700 1 -- 172.21.15.62:0/4221355556 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac4000e90 con 0x7f0ac805fa70 2021-12-17T18:20:06.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.930+0000 7f0acd3eb700 1 -- 172.21.15.62:0/4221355556 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ac400d890 con 0x7f0ac805fa70 2021-12-17T18:20:06.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acf3ef700 1 -- 172.21.15.62:0/4221355556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac805fa70 msgr2=0x7f0ac8061390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:06.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acf3ef700 1 --2- 172.21.15.62:0/4221355556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac805fa70 0x7f0ac8061390 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f0ac4002f70 tx=0x7f0ac4006df0).stop 2021-12-17T18:20:06.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acf3ef700 1 -- 172.21.15.62:0/4221355556 shutdown_connections 2021-12-17T18:20:06.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acf3ef700 1 --2- 172.21.15.62:0/4221355556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac805fa70 0x7f0ac8061390 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:06.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acf3ef700 1 -- 172.21.15.62:0/4221355556 >> 172.21.15.62:0/4221355556 conn(0x7f0ac805bcd0 msgr2=0x7f0ac8063510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:06.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acf3ef700 1 -- 172.21.15.62:0/4221355556 shutdown_connections 2021-12-17T18:20:06.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acf3ef700 1 -- 172.21.15.62:0/4221355556 wait complete. 2021-12-17T18:20:06.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acf3ef700 1 Processor -- start 2021-12-17T18:20:06.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acf3ef700 1 -- start start 2021-12-17T18:20:06.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acf3ef700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0ac805fa70 0x7f0ac81446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:06.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acf3ef700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac8064de0 0x7f0ac8155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:06.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acf3ef700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ac81405f0 0x7f0ac8143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:06.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acf3ef700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac8142900 con 0x7f0ac8064de0 2021-12-17T18:20:06.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acf3ef700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac8142ba0 con 0x7f0ac81405f0 2021-12-17T18:20:06.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acf3ef700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac8142e60 con 0x7f0ac805fa70 2021-12-17T18:20:06.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acdbec700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac8064de0 0x7f0ac8155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:06.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acdbec700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac8064de0 0x7f0ac8155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49662/0 (socket says 172.21.15.62:49662) 2021-12-17T18:20:06.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acdbec700 1 -- 172.21.15.62:0/4227863464 learned_addr learned my addr 172.21.15.62:0/4227863464 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:06.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0ace3ed700 1 --2- 172.21.15.62:0/4227863464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0ac805fa70 0x7f0ac81446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:06.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acebee700 1 --2- 172.21.15.62:0/4227863464 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ac81405f0 0x7f0ac8143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:06.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acdbec700 1 -- 172.21.15.62:0/4227863464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0ac805fa70 msgr2=0x7f0ac81446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:06.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acdbec700 1 --2- 172.21.15.62:0/4227863464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0ac805fa70 0x7f0ac81446a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:06.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acdbec700 1 -- 172.21.15.62:0/4227863464 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ac81405f0 msgr2=0x7f0ac8143300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:06.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acdbec700 1 --2- 172.21.15.62:0/4227863464 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ac81405f0 0x7f0ac8143300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:06.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.934+0000 7f0acdbec700 1 -- 172.21.15.62:0/4227863464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac400b180 con 0x7f0ac8064de0 2021-12-17T18:20:06.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.938+0000 7f0acebee700 1 --2- 172.21.15.62:0/4227863464 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ac81405f0 0x7f0ac8143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:06.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.938+0000 7f0acdbec700 1 --2- 172.21.15.62:0/4227863464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac8064de0 0x7f0ac8155af0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f0ab8001110 tx=0x7f0ab8007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:06.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.938+0000 7f0ab77fe700 1 -- 172.21.15.62:0/4227863464 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ab800ce50 con 0x7f0ac8064de0 2021-12-17T18:20:06.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.938+0000 7f0ab77fe700 1 -- 172.21.15.62:0/4227863464 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab800f470 con 0x7f0ac8064de0 2021-12-17T18:20:06.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.938+0000 7f0acf3ef700 1 -- 172.21.15.62:0/4227863464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac80ae2d0 con 0x7f0ac8064de0 2021-12-17T18:20:06.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.938+0000 7f0ab77fe700 1 -- 172.21.15.62:0/4227863464 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ab800f7d0 con 0x7f0ac8064de0 2021-12-17T18:20:06.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.938+0000 7f0acf3ef700 1 -- 172.21.15.62:0/4227863464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac81437f0 con 0x7f0ac8064de0 2021-12-17T18:20:06.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.938+0000 7f0acf3ef700 1 -- 172.21.15.62:0/4227863464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac8143020 con 0x7f0ac8064de0 2021-12-17T18:20:06.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.938+0000 7f0ab77fe700 1 -- 172.21.15.62:0/4227863464 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0ab8019030 con 0x7f0ac8064de0 2021-12-17T18:20:06.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.942+0000 7f0ab77fe700 1 --2- 172.21.15.62:0/4227863464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0aa80535b0 0x7f0aa8055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:06.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.942+0000 7f0ab77fe700 1 -- 172.21.15.62:0/4227863464 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0ab806ad90 con 0x7f0ac8064de0 2021-12-17T18:20:06.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.942+0000 7f0ace3ed700 1 --2- 172.21.15.62:0/4227863464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0aa80535b0 0x7f0aa8055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:06.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.942+0000 7f0ace3ed700 1 --2- 172.21.15.62:0/4227863464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0aa80535b0 0x7f0aa8055a70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f0ac401a000 tx=0x7f0ac4014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:06.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:06.946+0000 7f0ab77fe700 1 -- 172.21.15.62:0/4227863464 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0ab8041ea0 con 0x7f0ac8064de0 2021-12-17T18:20:07.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.070+0000 7f0acf3ef700 1 -- 172.21.15.62:0/4227863464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ac80573d0 con 0x7f0ac8064de0 2021-12-17T18:20:07.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.798+0000 7f0ab77fe700 1 -- 172.21.15.62:0/4227863464 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) v1 ==== 185+0+0 (secure 0 0 0) 0x7f0ab80454c0 con 0x7f0ac8064de0 2021-12-17T18:20:07.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.806+0000 7f0acf3ef700 1 -- 172.21.15.62:0/4227863464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0aa80535b0 msgr2=0x7f0aa8055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:07.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.806+0000 7f0acf3ef700 1 --2- 172.21.15.62:0/4227863464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0aa80535b0 0x7f0aa8055a70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f0ac401a000 tx=0x7f0ac4014000).stop 2021-12-17T18:20:07.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.806+0000 7f0acf3ef700 1 -- 172.21.15.62:0/4227863464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac8064de0 msgr2=0x7f0ac8155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:07.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.806+0000 7f0acf3ef700 1 --2- 172.21.15.62:0/4227863464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac8064de0 0x7f0ac8155af0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f0ab8001110 tx=0x7f0ab8007ae0).stop 2021-12-17T18:20:07.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.806+0000 7f0acf3ef700 1 -- 172.21.15.62:0/4227863464 shutdown_connections 2021-12-17T18:20:07.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.806+0000 7f0acf3ef700 1 --2- 172.21.15.62:0/4227863464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0aa80535b0 0x7f0aa8055a70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:07.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.806+0000 7f0acf3ef700 1 --2- 172.21.15.62:0/4227863464 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ac81405f0 0x7f0ac8143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:07.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.806+0000 7f0acf3ef700 1 --2- 172.21.15.62:0/4227863464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac8064de0 0x7f0ac8155af0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:07.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.806+0000 7f0acf3ef700 1 --2- 172.21.15.62:0/4227863464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0ac805fa70 0x7f0ac81446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:07.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.806+0000 7f0acf3ef700 1 -- 172.21.15.62:0/4227863464 >> 172.21.15.62:0/4227863464 conn(0x7f0ac805bcd0 msgr2=0x7f0ac80b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:07.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.806+0000 7f0acf3ef700 1 -- 172.21.15.62:0/4227863464 shutdown_connections 2021-12-17T18:20:07.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.806+0000 7f0acf3ef700 1 -- 172.21.15.62:0/4227863464 wait complete. 2021-12-17T18:20:07.814 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2021-12-17T18:20:07.827 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-12-17T18:20:07.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.934+0000 7fb9d7070700 1 Processor -- start 2021-12-17T18:20:07.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.934+0000 7fb9d7070700 1 -- start start 2021-12-17T18:20:07.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d7070700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9d005ca90 0x7fb9d00b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:07.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d7070700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fb9d00b34b0 0x7fb9d0145b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:07.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d7070700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d005ce70 con 0x7fb9d00604b0 2021-12-17T18:20:07.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d7070700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d00b2d70 con 0x7fb9d00b34b0 2021-12-17T18:20:07.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d7070700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d00b3010 con 0x7fb9d005ca90 2021-12-17T18:20:07.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d686f700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb9d00604b0 0x7fb9d0146010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33252/0 (socket says 172.21.15.62:33252) 2021-12-17T18:20:07.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d686f700 1 -- 172.21.15.62:0/421130081 learned_addr learned my addr 172.21.15.62:0/421130081 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:07.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d586d700 1 --2- 172.21.15.62:0/421130081 >> v2:172.21.15.109:3300/0 conn(0x7fb9d00b34b0 0x7fb9d0145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:07.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d606e700 1 --2- 172.21.15.62:0/421130081 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9d005ca90 0x7fb9d00b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:07.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d506c700 1 -- 172.21.15.62:0/421130081 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123844237 0 0) 0x7fb9d005ce70 con 0x7fb9d00604b0 2021-12-17T18:20:07.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d506c700 1 -- 172.21.15.62:0/421130081 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9b8003260 con 0x7fb9d00604b0 2021-12-17T18:20:07.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d586d700 1 -- 172.21.15.62:0/421130081 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9d005ca90 msgr2=0x7fb9d00b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:07.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d586d700 1 --2- 172.21.15.62:0/421130081 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9d005ca90 0x7fb9d00b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:07.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d586d700 1 -- 172.21.15.62:0/421130081 >> v1:172.21.15.62:6789/0 conn(0x7fb9d00604b0 legacy=0x7fb9d0146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:07.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d586d700 1 -- 172.21.15.62:0/421130081 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d00b2ab0 con 0x7fb9d00b34b0 2021-12-17T18:20:07.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d586d700 1 --2- 172.21.15.62:0/421130081 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9d00b34b0 0x7fb9d0145b20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fb9c0002f70 tx=0x7fb9c0006df0).ready entity=mon.1 client_cookie=d5a0cf688aa1d953 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:07.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d506c700 1 -- 172.21.15.62:0/421130081 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9c000d4a0 con 0x7fb9d00b34b0 2021-12-17T18:20:07.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d506c700 1 -- 172.21.15.62:0/421130081 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c0000e90 con 0x7fb9d00b34b0 2021-12-17T18:20:07.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d506c700 1 -- 172.21.15.62:0/421130081 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9c000d7f0 con 0x7fb9d00b34b0 2021-12-17T18:20:07.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d7070700 1 -- 172.21.15.62:0/421130081 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9d00b34b0 msgr2=0x7fb9d0145b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:07.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d7070700 1 --2- 172.21.15.62:0/421130081 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9d00b34b0 0x7fb9d0145b20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fb9c0002f70 tx=0x7fb9c0006df0).stop 2021-12-17T18:20:07.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d7070700 1 -- 172.21.15.62:0/421130081 shutdown_connections 2021-12-17T18:20:07.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d7070700 1 --2- 172.21.15.62:0/421130081 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9d00b34b0 0x7fb9d0145b20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:07.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d7070700 1 --2- 172.21.15.62:0/421130081 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9d005ca90 0x7fb9d00b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:07.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d7070700 1 -- 172.21.15.62:0/421130081 >> 172.21.15.62:0/421130081 conn(0x7fb9d005bcd0 msgr2=0x7fb9d0062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:07.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d7070700 1 -- 172.21.15.62:0/421130081 shutdown_connections 2021-12-17T18:20:07.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.938+0000 7fb9d7070700 1 -- 172.21.15.62:0/421130081 wait complete. 2021-12-17T18:20:07.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d7070700 1 Processor -- start 2021-12-17T18:20:07.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d7070700 1 -- start start 2021-12-17T18:20:07.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d7070700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9d005ca90 0x7fb9d0146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:07.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d7070700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9d00604b0 0x7fb9d00a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:07.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d7070700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d00b34b0 0x7fb9d0155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:07.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d7070700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d01556f0 con 0x7fb9d00b34b0 2021-12-17T18:20:07.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d7070700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d00672b0 con 0x7fb9d00604b0 2021-12-17T18:20:07.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d7070700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d0155920 con 0x7fb9d005ca90 2021-12-17T18:20:07.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d686f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d00b34b0 0x7fb9d0155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:07.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d686f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d00b34b0 0x7fb9d0155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49678/0 (socket says 172.21.15.62:49678) 2021-12-17T18:20:07.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d686f700 1 -- 172.21.15.62:0/2978112577 learned_addr learned my addr 172.21.15.62:0/2978112577 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:07.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d586d700 1 --2- 172.21.15.62:0/2978112577 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9d00604b0 0x7fb9d00a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:07.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d606e700 1 --2- 172.21.15.62:0/2978112577 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9d005ca90 0x7fb9d0146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:07.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d686f700 1 -- 172.21.15.62:0/2978112577 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9d005ca90 msgr2=0x7fb9d0146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:07.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d686f700 1 --2- 172.21.15.62:0/2978112577 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9d005ca90 0x7fb9d0146460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:07.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d686f700 1 -- 172.21.15.62:0/2978112577 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9d00604b0 msgr2=0x7fb9d00a2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:07.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d686f700 1 --2- 172.21.15.62:0/2978112577 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9d00604b0 0x7fb9d00a2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:07.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d686f700 1 -- 172.21.15.62:0/2978112577 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c000b180 con 0x7fb9d00b34b0 2021-12-17T18:20:07.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d686f700 1 --2- 172.21.15.62:0/2978112577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d00b34b0 0x7fb9d0155dc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fb9c8001490 tx=0x7fb9c8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:07.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9bf7fe700 1 -- 172.21.15.62:0/2978112577 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9c8005ba0 con 0x7fb9d00b34b0 2021-12-17T18:20:07.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d7070700 1 -- 172.21.15.62:0/2978112577 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d0146950 con 0x7fb9d00b34b0 2021-12-17T18:20:07.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9bf7fe700 1 -- 172.21.15.62:0/2978112577 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c8005d00 con 0x7fb9d00b34b0 2021-12-17T18:20:07.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9d7070700 1 -- 172.21.15.62:0/2978112577 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d0066f30 con 0x7fb9d00b34b0 2021-12-17T18:20:07.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.942+0000 7fb9bf7fe700 1 -- 172.21.15.62:0/2978112577 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9c80072c0 con 0x7fb9d00b34b0 2021-12-17T18:20:07.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.946+0000 7fb9bf7fe700 1 -- 172.21.15.62:0/2978112577 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb9c8010070 con 0x7fb9d00b34b0 2021-12-17T18:20:07.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.946+0000 7fb9d7070700 1 -- 172.21.15.62:0/2978112577 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d00b4500 con 0x7fb9d00b34b0 2021-12-17T18:20:07.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.946+0000 7fb9bf7fe700 1 --2- 172.21.15.62:0/2978112577 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb9b0053610 0x7fb9b0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:07.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.946+0000 7fb9bf7fe700 1 -- 172.21.15.62:0/2978112577 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fb9c806b290 con 0x7fb9d00b34b0 2021-12-17T18:20:07.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.946+0000 7fb9d606e700 1 --2- 172.21.15.62:0/2978112577 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb9b0053610 0x7fb9b0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:07.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.946+0000 7fb9d606e700 1 --2- 172.21.15.62:0/2978112577 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb9b0053610 0x7fb9b0055ad0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fb9cc00b000 tx=0x7fb9cc006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:07.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:07.950+0000 7fb9bf7fe700 1 -- 172.21.15.62:0/2978112577 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb9c80424b0 con 0x7fb9d00b34b0 2021-12-17T18:20:08.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.074+0000 7fb9d7070700 1 -- 172.21.15.62:0/2978112577 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb9d00573d0 con 0x7fb9d00b34b0 2021-12-17T18:20:08.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.810+0000 7fb9bf7fe700 1 -- 172.21.15.62:0/2978112577 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) v1 ==== 173+0+0 (secure 0 0 0) 0x7fb9c8045ad0 con 0x7fb9d00b34b0 2021-12-17T18:20:08.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.818+0000 7fb9d7070700 1 -- 172.21.15.62:0/2978112577 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb9b0053610 msgr2=0x7fb9b0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:08.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.818+0000 7fb9d7070700 1 --2- 172.21.15.62:0/2978112577 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb9b0053610 0x7fb9b0055ad0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fb9cc00b000 tx=0x7fb9cc006df0).stop 2021-12-17T18:20:08.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.818+0000 7fb9d7070700 1 -- 172.21.15.62:0/2978112577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d00b34b0 msgr2=0x7fb9d0155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:08.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.818+0000 7fb9d7070700 1 --2- 172.21.15.62:0/2978112577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d00b34b0 0x7fb9d0155dc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fb9c8001490 tx=0x7fb9c8007e00).stop 2021-12-17T18:20:08.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.818+0000 7fb9d7070700 1 -- 172.21.15.62:0/2978112577 shutdown_connections 2021-12-17T18:20:08.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.818+0000 7fb9d7070700 1 --2- 172.21.15.62:0/2978112577 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb9b0053610 0x7fb9b0055ad0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:08.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.818+0000 7fb9d7070700 1 --2- 172.21.15.62:0/2978112577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d00b34b0 0x7fb9d0155dc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:08.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.818+0000 7fb9d7070700 1 --2- 172.21.15.62:0/2978112577 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9d00604b0 0x7fb9d00a2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:08.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.818+0000 7fb9d7070700 1 --2- 172.21.15.62:0/2978112577 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9d005ca90 0x7fb9d0146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:08.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.818+0000 7fb9d7070700 1 -- 172.21.15.62:0/2978112577 >> 172.21.15.62:0/2978112577 conn(0x7fb9d005bcd0 msgr2=0x7fb9d00b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:08.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.818+0000 7fb9d7070700 1 -- 172.21.15.62:0/2978112577 shutdown_connections 2021-12-17T18:20:08.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.818+0000 7fb9d7070700 1 -- 172.21.15.62:0/2978112577 wait complete. 2021-12-17T18:20:08.827 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2021-12-17T18:20:08.837 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-12-17T18:20:08.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.942+0000 7ff6a67de700 1 Processor -- start 2021-12-17T18:20:08.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.942+0000 7ff6a67de700 1 -- start start 2021-12-17T18:20:08.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff6a67de700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6a00b0040 0x7ff6a00ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:08.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff6a67de700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff6a00aecb0 0x7ff6a0143b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:08.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff6a67de700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a00a8e00 con 0x7ff6a00b5f60 2021-12-17T18:20:08.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff6a67de700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a00623d0 con 0x7ff6a00b0040 2021-12-17T18:20:08.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff6a67de700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a00b6340 con 0x7ff6a00aecb0 2021-12-17T18:20:08.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff69f7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6a00b0040 0x7ff6a00ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:08.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff69ffff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff6a00b5f60 0x7ff6a0146a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33262/0 (socket says 172.21.15.62:33262) 2021-12-17T18:20:08.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff69ffff700 1 -- 172.21.15.62:0/3969005284 learned_addr learned my addr 172.21.15.62:0/3969005284 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:08.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff6a4d7b700 1 --2- 172.21.15.62:0/3969005284 >> v2:172.21.15.109:3300/0 conn(0x7ff6a00aecb0 0x7ff6a0143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:08.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff69f7fe700 1 -- 172.21.15.62:0/3969005284 >> v2:172.21.15.109:3300/0 conn(0x7ff6a00aecb0 msgr2=0x7ff6a0143b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:08.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff69f7fe700 1 --2- 172.21.15.62:0/3969005284 >> v2:172.21.15.109:3300/0 conn(0x7ff6a00aecb0 0x7ff6a0143b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:08.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff69f7fe700 1 -- 172.21.15.62:0/3969005284 >> v1:172.21.15.62:6789/0 conn(0x7ff6a00b5f60 legacy=0x7ff6a0146a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:08.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff69f7fe700 1 -- 172.21.15.62:0/3969005284 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a00a92d0 con 0x7ff6a00b0040 2021-12-17T18:20:08.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff69effd700 1 -- 172.21.15.62:0/3969005284 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688440452 0 0) 0x7ff6a00a8e00 con 0x7ff6a00b5f60 2021-12-17T18:20:08.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff69f7fe700 1 --2- 172.21.15.62:0/3969005284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a00b0040 0x7ff6a00ae7c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7ff694002f70 tx=0x7ff694006df0).ready entity=mon.0 client_cookie=21dc61a78fad96f3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:08.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff69effd700 1 -- 172.21.15.62:0/3969005284 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff69400d5c0 con 0x7ff6a00b0040 2021-12-17T18:20:08.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff69effd700 1 -- 172.21.15.62:0/3969005284 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff694000e90 con 0x7ff6a00b0040 2021-12-17T18:20:08.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff69effd700 1 -- 172.21.15.62:0/3969005284 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff69400d910 con 0x7ff6a00b0040 2021-12-17T18:20:08.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff6a67de700 1 -- 172.21.15.62:0/3969005284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a00b0040 msgr2=0x7ff6a00ae7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:08.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff6a67de700 1 --2- 172.21.15.62:0/3969005284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a00b0040 0x7ff6a00ae7c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7ff694002f70 tx=0x7ff694006df0).stop 2021-12-17T18:20:08.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff6a67de700 1 -- 172.21.15.62:0/3969005284 shutdown_connections 2021-12-17T18:20:08.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff6a67de700 1 --2- 172.21.15.62:0/3969005284 >> v2:172.21.15.109:3300/0 conn(0x7ff6a00aecb0 0x7ff6a0143b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:08.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff6a67de700 1 --2- 172.21.15.62:0/3969005284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a00b0040 0x7ff6a00ae7c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:08.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff6a67de700 1 -- 172.21.15.62:0/3969005284 >> 172.21.15.62:0/3969005284 conn(0x7ff6a005ca00 msgr2=0x7ff6a005cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:08.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff6a67de700 1 -- 172.21.15.62:0/3969005284 shutdown_connections 2021-12-17T18:20:08.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.946+0000 7ff6a67de700 1 -- 172.21.15.62:0/3969005284 wait complete. 2021-12-17T18:20:08.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff6a67de700 1 Processor -- start 2021-12-17T18:20:08.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff6a67de700 1 -- start start 2021-12-17T18:20:08.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff6a67de700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a00aecb0 0x7ff6a0152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:08.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff6a67de700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff6a00b0040 0x7ff6a009ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:08.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff6a67de700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff6a00b5f60 0x7ff6a0155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:08.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff6a67de700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a009f3a0 con 0x7ff6a00aecb0 2021-12-17T18:20:08.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff6a67de700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a00a14d0 con 0x7ff6a00b5f60 2021-12-17T18:20:08.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff6a67de700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a00b49c0 con 0x7ff6a00b0040 2021-12-17T18:20:08.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff69ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a00aecb0 0x7ff6a0152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:08.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff69ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a00aecb0 0x7ff6a0152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49688/0 (socket says 172.21.15.62:49688) 2021-12-17T18:20:08.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff69ffff700 1 -- 172.21.15.62:0/2932961832 learned_addr learned my addr 172.21.15.62:0/2932961832 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:08.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff69f7fe700 1 --2- 172.21.15.62:0/2932961832 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff6a00b0040 0x7ff6a009ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:08.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff6a4d7b700 1 --2- 172.21.15.62:0/2932961832 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff6a00b5f60 0x7ff6a0155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:08.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff69ffff700 1 -- 172.21.15.62:0/2932961832 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff6a00b0040 msgr2=0x7ff6a009ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:08.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff69ffff700 1 --2- 172.21.15.62:0/2932961832 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff6a00b0040 0x7ff6a009ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:08.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff69ffff700 1 -- 172.21.15.62:0/2932961832 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff6a00b5f60 msgr2=0x7ff6a0155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:08.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff69ffff700 1 --2- 172.21.15.62:0/2932961832 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff6a00b5f60 0x7ff6a0155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:08.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff69ffff700 1 -- 172.21.15.62:0/2932961832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69400b180 con 0x7ff6a00aecb0 2021-12-17T18:20:08.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff69ffff700 1 --2- 172.21.15.62:0/2932961832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a00aecb0 0x7ff6a0152a20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7ff6a009f280 tx=0x7ff690007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:08.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff69d7fa700 1 -- 172.21.15.62:0/2932961832 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6900070d0 con 0x7ff6a00aecb0 2021-12-17T18:20:08.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff69d7fa700 1 -- 172.21.15.62:0/2932961832 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff690007230 con 0x7ff6a00aecb0 2021-12-17T18:20:08.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff6a67de700 1 -- 172.21.15.62:0/2932961832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a0153070 con 0x7ff6a00aecb0 2021-12-17T18:20:08.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff69d7fa700 1 -- 172.21.15.62:0/2932961832 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff690005610 con 0x7ff6a00aecb0 2021-12-17T18:20:08.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.950+0000 7ff6a67de700 1 -- 172.21.15.62:0/2932961832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a01539f0 con 0x7ff6a00aecb0 2021-12-17T18:20:08.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.954+0000 7ff6a67de700 1 -- 172.21.15.62:0/2932961832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a00a9030 con 0x7ff6a00aecb0 2021-12-17T18:20:08.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.954+0000 7ff69d7fa700 1 -- 172.21.15.62:0/2932961832 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff69001a060 con 0x7ff6a00aecb0 2021-12-17T18:20:08.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.954+0000 7ff69d7fa700 1 --2- 172.21.15.62:0/2932961832 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6800536a0 0x7ff680055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:08.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.954+0000 7ff69d7fa700 1 -- 172.21.15.62:0/2932961832 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5339+0+0 (secure 0 0 0) 0x7ff69006a820 con 0x7ff6a00aecb0 2021-12-17T18:20:08.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.954+0000 7ff69f7fe700 1 --2- 172.21.15.62:0/2932961832 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6800536a0 0x7ff680055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:08.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.954+0000 7ff69f7fe700 1 --2- 172.21.15.62:0/2932961832 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6800536a0 0x7ff680055b60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7ff69401a000 tx=0x7ff694014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:08.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:08.958+0000 7ff69d7fa700 1 -- 172.21.15.62:0/2932961832 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff690041c60 con 0x7ff6a00aecb0 2021-12-17T18:20:09.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.090+0000 7ff6a67de700 1 -- 172.21.15.62:0/2932961832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff6a00573d0 con 0x7ff6a00aecb0 2021-12-17T18:20:09.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.094+0000 7ff69d7fa700 1 -- 172.21.15.62:0/2932961832 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff6900180a0 con 0x7ff6a00aecb0 2021-12-17T18:20:09.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.098+0000 7ff6a67de700 1 -- 172.21.15.62:0/2932961832 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6800536a0 msgr2=0x7ff680055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:09.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.098+0000 7ff6a67de700 1 --2- 172.21.15.62:0/2932961832 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6800536a0 0x7ff680055b60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7ff69401a000 tx=0x7ff694014000).stop 2021-12-17T18:20:09.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.098+0000 7ff6a67de700 1 -- 172.21.15.62:0/2932961832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a00aecb0 msgr2=0x7ff6a0152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:09.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.098+0000 7ff6a67de700 1 --2- 172.21.15.62:0/2932961832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a00aecb0 0x7ff6a0152a20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7ff6a009f280 tx=0x7ff690007ac0).stop 2021-12-17T18:20:09.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.098+0000 7ff6a67de700 1 -- 172.21.15.62:0/2932961832 shutdown_connections 2021-12-17T18:20:09.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.098+0000 7ff6a67de700 1 --2- 172.21.15.62:0/2932961832 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6800536a0 0x7ff680055b60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.098+0000 7ff6a67de700 1 --2- 172.21.15.62:0/2932961832 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff6a00b5f60 0x7ff6a0155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.098+0000 7ff6a67de700 1 --2- 172.21.15.62:0/2932961832 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff6a00b0040 0x7ff6a009ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.098+0000 7ff6a67de700 1 --2- 172.21.15.62:0/2932961832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a00aecb0 0x7ff6a0152a20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.098+0000 7ff6a67de700 1 -- 172.21.15.62:0/2932961832 >> 172.21.15.62:0/2932961832 conn(0x7ff6a005ca00 msgr2=0x7ff6a00b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:09.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.098+0000 7ff6a67de700 1 -- 172.21.15.62:0/2932961832 shutdown_connections 2021-12-17T18:20:09.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.098+0000 7ff6a67de700 1 -- 172.21.15.62:0/2932961832 wait complete. 2021-12-17T18:20:09.115 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-12-17T18:20:09.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.210+0000 7f235ece4700 1 Processor -- start 2021-12-17T18:20:09.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.210+0000 7f235ece4700 1 -- start start 2021-12-17T18:20:09.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235ece4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f23580b5b20 0x7f23580b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:09.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235ece4700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f23580b3760 0x7f23580b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:09.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235ece4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23580b6c70 0x7f2358146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:09.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235ece4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23580b5f00 con 0x7f23580b5b20 2021-12-17T18:20:09.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235ece4700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23580b3020 con 0x7f23580b3760 2021-12-17T18:20:09.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235ece4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23580b32c0 con 0x7f23580b6c70 2021-12-17T18:20:09.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235dce2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f23580b5b20 0x7f23580b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:09.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235e4e3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23580b6c70 0x7f2358146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:09.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235dce2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f23580b5b20 0x7f23580b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49698/0 (socket says 172.21.15.62:49698) 2021-12-17T18:20:09.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235d4e1700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f23580b3760 0x7f23580b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:09.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235dce2700 1 -- 172.21.15.62:0/1334786930 learned_addr learned my addr 172.21.15.62:0/1334786930 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:09.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235dce2700 1 -- 172.21.15.62:0/1334786930 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23580b6c70 msgr2=0x7f2358146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:09.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235dce2700 1 --2- 172.21.15.62:0/1334786930 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23580b6c70 0x7f2358146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235dce2700 1 -- 172.21.15.62:0/1334786930 >> v2:172.21.15.109:3300/0 conn(0x7f23580b3760 msgr2=0x7f23580b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:09.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235dce2700 1 --2- 172.21.15.62:0/1334786930 >> v2:172.21.15.109:3300/0 conn(0x7f23580b3760 0x7f23580b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235dce2700 1 -- 172.21.15.62:0/1334786930 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23580b5440 con 0x7f23580b5b20 2021-12-17T18:20:09.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235d4e1700 1 --2- 172.21.15.62:0/1334786930 >> v2:172.21.15.109:3300/0 conn(0x7f23580b3760 0x7f23580b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:20:09.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235e4e3700 1 --2- 172.21.15.62:0/1334786930 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23580b6c70 0x7f2358146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:20:09.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235dce2700 1 --2- 172.21.15.62:0/1334786930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580b5b20 0x7f23580b6290 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f2348002f70 tx=0x7f2348006eb0).ready entity=mon.0 client_cookie=8510c9e78e2e2774 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:09.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235cce0700 1 -- 172.21.15.62:0/1334786930 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f234800d570 con 0x7f23580b5b20 2021-12-17T18:20:09.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235cce0700 1 -- 172.21.15.62:0/1334786930 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2348000e90 con 0x7f23580b5b20 2021-12-17T18:20:09.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235cce0700 1 -- 172.21.15.62:0/1334786930 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f234800d900 con 0x7f23580b5b20 2021-12-17T18:20:09.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235ece4700 1 -- 172.21.15.62:0/1334786930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580b5b20 msgr2=0x7f23580b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:09.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.214+0000 7f235ece4700 1 --2- 172.21.15.62:0/1334786930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580b5b20 0x7f23580b6290 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f2348002f70 tx=0x7f2348006eb0).stop 2021-12-17T18:20:09.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235ece4700 1 -- 172.21.15.62:0/1334786930 shutdown_connections 2021-12-17T18:20:09.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235ece4700 1 --2- 172.21.15.62:0/1334786930 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23580b6c70 0x7f2358146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235ece4700 1 --2- 172.21.15.62:0/1334786930 >> v2:172.21.15.109:3300/0 conn(0x7f23580b3760 0x7f23580b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235ece4700 1 --2- 172.21.15.62:0/1334786930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580b5b20 0x7f23580b6290 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235ece4700 1 -- 172.21.15.62:0/1334786930 >> 172.21.15.62:0/1334786930 conn(0x7f235805c750 msgr2=0x7f235805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:09.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235ece4700 1 -- 172.21.15.62:0/1334786930 shutdown_connections 2021-12-17T18:20:09.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235ece4700 1 -- 172.21.15.62:0/1334786930 wait complete. 2021-12-17T18:20:09.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235ece4700 1 Processor -- start 2021-12-17T18:20:09.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235ece4700 1 -- start start 2021-12-17T18:20:09.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235ece4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f23580b5b20 0x7f2358063660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:09.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235ece4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23580b6c70 0x7f2358064c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:09.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235ece4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2358067060 0x7f2358065120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:09.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235ece4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23581478d0 con 0x7f2358067060 2021-12-17T18:20:09.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235ece4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23580665c0 con 0x7f23580b5b20 2021-12-17T18:20:09.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235ece4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23580a55d0 con 0x7f23580b6c70 2021-12-17T18:20:09.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235e4e3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2358067060 0x7f2358065120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:09.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235d4e1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23580b6c70 0x7f2358064c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:09.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235e4e3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2358067060 0x7f2358065120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49706/0 (socket says 172.21.15.62:49706) 2021-12-17T18:20:09.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235dce2700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f23580b5b20 0x7f2358063660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:09.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235e4e3700 1 -- 172.21.15.62:0/3802629470 learned_addr learned my addr 172.21.15.62:0/3802629470 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:09.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235e4e3700 1 -- 172.21.15.62:0/3802629470 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23580b6c70 msgr2=0x7f2358064c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:09.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235e4e3700 1 --2- 172.21.15.62:0/3802629470 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23580b6c70 0x7f2358064c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235e4e3700 1 -- 172.21.15.62:0/3802629470 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f23580b5b20 msgr2=0x7f2358063660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:09.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235e4e3700 1 --2- 172.21.15.62:0/3802629470 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f23580b5b20 0x7f2358063660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235e4e3700 1 -- 172.21.15.62:0/3802629470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235400b180 con 0x7f2358067060 2021-12-17T18:20:09.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235e4e3700 1 --2- 172.21.15.62:0/3802629470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2358067060 0x7f2358065120 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f23580a5130 tx=0x7f23500091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:09.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f2346ffd700 1 -- 172.21.15.62:0/3802629470 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f235000eec0 con 0x7f2358067060 2021-12-17T18:20:09.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f2346ffd700 1 -- 172.21.15.62:0/3802629470 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235000c850 con 0x7f2358067060 2021-12-17T18:20:09.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.218+0000 7f235ece4700 1 -- 172.21.15.62:0/3802629470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2350009470 con 0x7f2358067060 2021-12-17T18:20:09.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.222+0000 7f2346ffd700 1 -- 172.21.15.62:0/3802629470 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f235000cbb0 con 0x7f2358067060 2021-12-17T18:20:09.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.222+0000 7f235ece4700 1 -- 172.21.15.62:0/3802629470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234800b1e0 con 0x7f2358067060 2021-12-17T18:20:09.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.222+0000 7f235ece4700 1 -- 172.21.15.62:0/3802629470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23581524b0 con 0x7f2358067060 2021-12-17T18:20:09.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.222+0000 7f2346ffd700 1 -- 172.21.15.62:0/3802629470 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2350022070 con 0x7f2358067060 2021-12-17T18:20:09.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.222+0000 7f2346ffd700 1 --2- 172.21.15.62:0/3802629470 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2338053610 0x7f2338055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:09.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.222+0000 7f2346ffd700 1 -- 172.21.15.62:0/3802629470 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f235006bcb0 con 0x7f2358067060 2021-12-17T18:20:09.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.222+0000 7f235dce2700 1 --2- 172.21.15.62:0/3802629470 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2338053610 0x7f2338055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:09.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.226+0000 7f235dce2700 1 --2- 172.21.15.62:0/3802629470 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2338053610 0x7f2338055ad0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f234801c000 tx=0x7f2348015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:09.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.230+0000 7f2346ffd700 1 -- 172.21.15.62:0/3802629470 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f23500430f0 con 0x7f2358067060 2021-12-17T18:20:09.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.406+0000 7f235ece4700 1 -- 172.21.15.62:0/3802629470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f2358068f30 con 0x7f2358067060 2021-12-17T18:20:09.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.814+0000 7f2346ffd700 1 -- 172.21.15.62:0/3802629470 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v97) v1 ==== 139+0+0 (secure 0 0 0) 0x7f2350016020 con 0x7f2358067060 2021-12-17T18:20:09.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.818+0000 7f235ece4700 1 -- 172.21.15.62:0/3802629470 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2338053610 msgr2=0x7f2338055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:09.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.818+0000 7f235ece4700 1 --2- 172.21.15.62:0/3802629470 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2338053610 0x7f2338055ad0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f234801c000 tx=0x7f2348015000).stop 2021-12-17T18:20:09.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.818+0000 7f235ece4700 1 -- 172.21.15.62:0/3802629470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2358067060 msgr2=0x7f2358065120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:09.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.818+0000 7f235ece4700 1 --2- 172.21.15.62:0/3802629470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2358067060 0x7f2358065120 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f23580a5130 tx=0x7f23500091d0).stop 2021-12-17T18:20:09.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.818+0000 7f235ece4700 1 -- 172.21.15.62:0/3802629470 shutdown_connections 2021-12-17T18:20:09.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.818+0000 7f235ece4700 1 --2- 172.21.15.62:0/3802629470 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2338053610 0x7f2338055ad0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.818+0000 7f235ece4700 1 --2- 172.21.15.62:0/3802629470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2358067060 0x7f2358065120 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.818+0000 7f235ece4700 1 --2- 172.21.15.62:0/3802629470 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23580b6c70 0x7f2358064c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.818+0000 7f235ece4700 1 --2- 172.21.15.62:0/3802629470 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f23580b5b20 0x7f2358063660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.818+0000 7f235ece4700 1 -- 172.21.15.62:0/3802629470 >> 172.21.15.62:0/3802629470 conn(0x7f235805c750 msgr2=0x7f235805f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:09.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.818+0000 7f235ece4700 1 -- 172.21.15.62:0/3802629470 shutdown_connections 2021-12-17T18:20:09.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.818+0000 7f235ece4700 1 -- 172.21.15.62:0/3802629470 wait complete. 2021-12-17T18:20:09.840 INFO:tasks.cephfs_test_runner:test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-12-17T18:20:09.840 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) 2021-12-17T18:20:09.841 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-12-17T18:20:09.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc044bca700 1 Processor -- start 2021-12-17T18:20:09.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc044bca700 1 -- start start 2021-12-17T18:20:09.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc044bca700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc040141480 0x7fc040147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:09.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc044bca700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc0400a8e10 0x7fc0400b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:09.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc044bca700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc040147610 con 0x7fc0400b6050 2021-12-17T18:20:09.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc044bca700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0401478b0 con 0x7fc0400a8e10 2021-12-17T18:20:09.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc044bca700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc040147b50 con 0x7fc040141480 2021-12-17T18:20:09.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03ffff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc0400b6050 0x7fc0400a7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33294/0 (socket says 172.21.15.62:33294) 2021-12-17T18:20:09.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03ffff700 1 -- 172.21.15.62:0/2599160831 learned_addr learned my addr 172.21.15.62:0/2599160831 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:09.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03effd700 1 --2- 172.21.15.62:0/2599160831 >> v2:172.21.15.109:3300/0 conn(0x7fc0400a8e10 0x7fc0400b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:09.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03f7fe700 1 --2- 172.21.15.62:0/2599160831 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc040141480 0x7fc040147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:09.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03e7fc700 1 -- 172.21.15.62:0/2599160831 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890127335 0 0) 0x7fc040147610 con 0x7fc0400b6050 2021-12-17T18:20:09.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03e7fc700 1 -- 172.21.15.62:0/2599160831 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc02c003260 con 0x7fc0400b6050 2021-12-17T18:20:09.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03e7fc700 1 -- 172.21.15.62:0/2599160831 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1888077548 0 0) 0x7fc02c003260 con 0x7fc0400b6050 2021-12-17T18:20:09.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03e7fc700 1 -- 172.21.15.62:0/2599160831 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc040141480 msgr2=0x7fc040147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:09.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03e7fc700 1 --2- 172.21.15.62:0/2599160831 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc040141480 0x7fc040147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03e7fc700 1 -- 172.21.15.62:0/2599160831 >> v2:172.21.15.109:3300/0 conn(0x7fc0400a8e10 msgr2=0x7fc0400b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:09.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03e7fc700 1 --2- 172.21.15.62:0/2599160831 >> v2:172.21.15.109:3300/0 conn(0x7fc0400a8e10 0x7fc0400b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03e7fc700 1 -- 172.21.15.62:0/2599160831 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0400b1b90 con 0x7fc0400b6050 2021-12-17T18:20:09.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03e7fc700 1 -- 172.21.15.62:0/2599160831 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fc0380019e0 con 0x7fc0400b6050 2021-12-17T18:20:09.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03e7fc700 1 -- 172.21.15.62:0/2599160831 >> v1:172.21.15.62:6789/0 conn(0x7fc0400b6050 legacy=0x7fc0400a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:09.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03e7fc700 1 --2- 172.21.15.62:0/2599160831 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc040141480 0x7fc02c003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:09.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03e7fc700 1 --2- 172.21.15.62:0/2599160831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc02c003c80 0x7fc02c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:09.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03e7fc700 1 --2- 172.21.15.62:0/2599160831 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc02c0049f0 0x7fc02c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:09.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03e7fc700 1 -- 172.21.15.62:0/2599160831 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0401478b0 con 0x7fc02c003c80 2021-12-17T18:20:09.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03e7fc700 1 -- 172.21.15.62:0/2599160831 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc040147b50 con 0x7fc02c0049f0 2021-12-17T18:20:09.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03e7fc700 1 -- 172.21.15.62:0/2599160831 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c00b750 con 0x7fc040141480 2021-12-17T18:20:09.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03effd700 1 --2- 172.21.15.62:0/2599160831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc02c003c80 0x7fc02c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:09.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03f7fe700 1 --2- 172.21.15.62:0/2599160831 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc040141480 0x7fc02c003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:09.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03ffff700 1 --2- 172.21.15.62:0/2599160831 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc02c0049f0 0x7fc02c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:09.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03effd700 1 -- 172.21.15.62:0/2599160831 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc040141480 msgr2=0x7fc02c003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:09.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03effd700 1 --2- 172.21.15.62:0/2599160831 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc040141480 0x7fc02c003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03effd700 1 -- 172.21.15.62:0/2599160831 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc02c0049f0 msgr2=0x7fc02c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:09.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03effd700 1 --2- 172.21.15.62:0/2599160831 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc02c0049f0 0x7fc02c004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03effd700 1 -- 172.21.15.62:0/2599160831 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02c003260 con 0x7fc02c003c80 2021-12-17T18:20:09.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.942+0000 7fc03ffff700 1 --2- 172.21.15.62:0/2599160831 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc02c0049f0 0x7fc02c004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:09.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.946+0000 7fc03effd700 1 --2- 172.21.15.62:0/2599160831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc02c003c80 0x7fc02c004500 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fc02c0054d0 tx=0x7fc030006df0).ready entity=mon.0 client_cookie=6141ebd5d8be1838 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:09.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.946+0000 7fc03e7fc700 1 -- 172.21.15.62:0/2599160831 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc03000e830 con 0x7fc02c003c80 2021-12-17T18:20:09.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.946+0000 7fc03e7fc700 1 -- 172.21.15.62:0/2599160831 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03000e990 con 0x7fc02c003c80 2021-12-17T18:20:09.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.946+0000 7fc03e7fc700 1 -- 172.21.15.62:0/2599160831 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc03000ecf0 con 0x7fc02c003c80 2021-12-17T18:20:09.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.946+0000 7fc044bca700 1 -- 172.21.15.62:0/2599160831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc02c003c80 msgr2=0x7fc02c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:09.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.946+0000 7fc044bca700 1 --2- 172.21.15.62:0/2599160831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc02c003c80 0x7fc02c004500 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fc02c0054d0 tx=0x7fc030006df0).stop 2021-12-17T18:20:09.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.946+0000 7fc03ffff700 1 -- 172.21.15.62:0/2599160831 reap_dead start 2021-12-17T18:20:09.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.946+0000 7fc044bca700 1 -- 172.21.15.62:0/2599160831 shutdown_connections 2021-12-17T18:20:09.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.946+0000 7fc044bca700 1 -- 172.21.15.62:0/2599160831 >> 172.21.15.62:0/2599160831 conn(0x7fc04005d220 msgr2=0x7fc0400b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:09.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.946+0000 7fc044bca700 1 -- 172.21.15.62:0/2599160831 shutdown_connections 2021-12-17T18:20:09.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.946+0000 7fc044bca700 1 -- 172.21.15.62:0/2599160831 wait complete. 2021-12-17T18:20:09.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.946+0000 7fc044bca700 1 Processor -- start 2021-12-17T18:20:09.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.946+0000 7fc044bca700 1 -- start start 2021-12-17T18:20:09.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc044bca700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc02c003c80 0x7fc0400acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:09.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc044bca700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0401489d0 0x7fc040157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:09.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc044bca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc040157bf0 0x7fc04014a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:09.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc044bca700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04014b360 con 0x7fc040157bf0 2021-12-17T18:20:09.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc044bca700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc040149790 con 0x7fc02c003c80 2021-12-17T18:20:09.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc044bca700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc040148e70 con 0x7fc0401489d0 2021-12-17T18:20:09.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc03ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc040157bf0 0x7fc04014a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:09.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc03ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc040157bf0 0x7fc04014a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49726/0 (socket says 172.21.15.62:49726) 2021-12-17T18:20:09.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc03ffff700 1 -- 172.21.15.62:0/1359904035 learned_addr learned my addr 172.21.15.62:0/1359904035 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:09.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc03f7fe700 1 --2- 172.21.15.62:0/1359904035 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc02c003c80 0x7fc0400acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:09.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc03effd700 1 --2- 172.21.15.62:0/1359904035 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0401489d0 0x7fc040157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:09.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc03ffff700 1 -- 172.21.15.62:0/1359904035 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0401489d0 msgr2=0x7fc040157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:09.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc03ffff700 1 --2- 172.21.15.62:0/1359904035 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0401489d0 0x7fc040157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc03ffff700 1 -- 172.21.15.62:0/1359904035 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc02c003c80 msgr2=0x7fc0400acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:09.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc03ffff700 1 --2- 172.21.15.62:0/1359904035 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc02c003c80 0x7fc0400acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:09.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc03ffff700 1 -- 172.21.15.62:0/1359904035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0401499c0 con 0x7fc040157bf0 2021-12-17T18:20:09.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc03effd700 1 --2- 172.21.15.62:0/1359904035 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0401489d0 0x7fc040157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:09.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc03f7fe700 1 --2- 172.21.15.62:0/1359904035 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc02c003c80 0x7fc0400acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:09.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc03ffff700 1 --2- 172.21.15.62:0/1359904035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc040157bf0 0x7fc04014a500 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fc040156cf0 tx=0x7fc038001300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:09.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc03cff9700 1 -- 172.21.15.62:0/1359904035 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc038010710 con 0x7fc040157bf0 2021-12-17T18:20:09.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc03cff9700 1 -- 172.21.15.62:0/1359904035 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc038010870 con 0x7fc040157bf0 2021-12-17T18:20:09.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc044bca700 1 -- 172.21.15.62:0/1359904035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0400ad270 con 0x7fc040157bf0 2021-12-17T18:20:09.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc03cff9700 1 -- 172.21.15.62:0/1359904035 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc038010bd0 con 0x7fc040157bf0 2021-12-17T18:20:09.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc044bca700 1 -- 172.21.15.62:0/1359904035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04014a9f0 con 0x7fc040157bf0 2021-12-17T18:20:09.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.950+0000 7fc044bca700 1 -- 172.21.15.62:0/1359904035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc040149b50 con 0x7fc040157bf0 2021-12-17T18:20:09.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.954+0000 7fc03cff9700 1 -- 172.21.15.62:0/1359904035 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc038010d30 con 0x7fc040157bf0 2021-12-17T18:20:09.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.954+0000 7fc03cff9700 1 --2- 172.21.15.62:0/1359904035 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc020053580 0x7fc020055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:09.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.954+0000 7fc03cff9700 1 -- 172.21.15.62:0/1359904035 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fc03806b7c0 con 0x7fc040157bf0 2021-12-17T18:20:09.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.954+0000 7fc03f7fe700 1 --2- 172.21.15.62:0/1359904035 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc020053580 0x7fc020055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:09.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.954+0000 7fc03f7fe700 1 --2- 172.21.15.62:0/1359904035 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc020053580 0x7fc020055a40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fc03400b000 tx=0x7fc034008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:09.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:09.962+0000 7fc03cff9700 1 -- 172.21.15.62:0/1359904035 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc038042c00 con 0x7fc040157bf0 2021-12-17T18:20:10.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.130+0000 7fc044bca700 1 -- 172.21.15.62:0/1359904035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7fc040141860 con 0x7fc040157bf0 2021-12-17T18:20:10.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.818+0000 7fc03cff9700 1 -- 172.21.15.62:0/1359904035 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v98) v1 ==== 147+0+0 (secure 0 0 0) 0x7fc038046220 con 0x7fc040157bf0 2021-12-17T18:20:10.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.822+0000 7fc044bca700 1 -- 172.21.15.62:0/1359904035 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc020053580 msgr2=0x7fc020055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:10.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.822+0000 7fc044bca700 1 --2- 172.21.15.62:0/1359904035 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc020053580 0x7fc020055a40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fc03400b000 tx=0x7fc034008040).stop 2021-12-17T18:20:10.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.822+0000 7fc044bca700 1 -- 172.21.15.62:0/1359904035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc040157bf0 msgr2=0x7fc04014a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:10.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.822+0000 7fc044bca700 1 --2- 172.21.15.62:0/1359904035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc040157bf0 0x7fc04014a500 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fc040156cf0 tx=0x7fc038001300).stop 2021-12-17T18:20:10.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.822+0000 7fc044bca700 1 -- 172.21.15.62:0/1359904035 shutdown_connections 2021-12-17T18:20:10.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.822+0000 7fc044bca700 1 --2- 172.21.15.62:0/1359904035 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc020053580 0x7fc020055a40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:10.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.822+0000 7fc044bca700 1 --2- 172.21.15.62:0/1359904035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc040157bf0 0x7fc04014a500 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:10.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.822+0000 7fc044bca700 1 --2- 172.21.15.62:0/1359904035 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0401489d0 0x7fc040157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:10.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.822+0000 7fc044bca700 1 --2- 172.21.15.62:0/1359904035 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc02c003c80 0x7fc0400acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:10.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.822+0000 7fc044bca700 1 -- 172.21.15.62:0/1359904035 >> 172.21.15.62:0/1359904035 conn(0x7fc04005d220 msgr2=0x7fc04005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:10.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.822+0000 7fc044bca700 1 -- 172.21.15.62:0/1359904035 shutdown_connections 2021-12-17T18:20:10.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.822+0000 7fc044bca700 1 -- 172.21.15.62:0/1359904035 wait complete. 2021-12-17T18:20:10.842 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-12-17T18:20:10.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3de20b1700 1 Processor -- start 2021-12-17T18:20:10.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3de20b1700 1 -- start start 2021-12-17T18:20:10.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3de20b1700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f3ddc0b6400 0x7f3ddc0b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:10.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3de20b1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ddc143720 0x7f3ddc13eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:10.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3de20b1700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc0b2110 con 0x7f3ddc0af940 2021-12-17T18:20:10.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3de20b1700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ddc0ae980 con 0x7f3ddc0b6400 2021-12-17T18:20:10.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3de20b1700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc0b00f0 con 0x7f3ddc143720 2021-12-17T18:20:10.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3ddb7fe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f3ddc0b6400 0x7f3ddc0b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:10.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3ddaffd700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f3ddc0af940 0x7f3ddc143010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:49632/0 (socket says 172.21.15.62:49632) 2021-12-17T18:20:10.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3ddbfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ddc143720 0x7f3ddc13eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:10.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3ddaffd700 1 -- 172.21.15.62:0/2170555199 learned_addr learned my addr 172.21.15.62:0/2170555199 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:10.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3ddb7fe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f3ddc0b6400 0x7f3ddc0b67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:56280/0 (socket says 172.21.15.62:56280) 2021-12-17T18:20:10.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3ddb7fe700 1 -- 172.21.15.62:0/2170555199 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ddc143720 msgr2=0x7f3ddc13eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:10.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3ddb7fe700 1 --2- 172.21.15.62:0/2170555199 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ddc143720 0x7f3ddc13eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:10.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3ddb7fe700 1 -- 172.21.15.62:0/2170555199 >> v1:172.21.15.109:6789/0 conn(0x7f3ddc0af940 legacy=0x7f3ddc143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:10.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3ddb7fe700 1 -- 172.21.15.62:0/2170555199 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc0b0390 con 0x7f3ddc0b6400 2021-12-17T18:20:10.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3ddb7fe700 1 --2- 172.21.15.62:0/2170555199 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3ddc0b6400 0x7f3ddc0b67e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3dcc002f70 tx=0x7f3dcc006df0).ready entity=mon.1 client_cookie=f692bbc1dc825b23 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:10.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3dda7fc700 1 -- 172.21.15.62:0/2170555199 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dcc014070 con 0x7f3ddc0b6400 2021-12-17T18:20:10.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3dda7fc700 1 -- 172.21.15.62:0/2170555199 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc000e90 con 0x7f3ddc0b6400 2021-12-17T18:20:10.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.946+0000 7f3dda7fc700 1 -- 172.21.15.62:0/2170555199 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dcc00fb60 con 0x7f3ddc0b6400 2021-12-17T18:20:10.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3de20b1700 1 -- 172.21.15.62:0/2170555199 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3ddc0b6400 msgr2=0x7f3ddc0b67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:10.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3de20b1700 1 --2- 172.21.15.62:0/2170555199 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3ddc0b6400 0x7f3ddc0b67e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3dcc002f70 tx=0x7f3dcc006df0).stop 2021-12-17T18:20:10.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3de20b1700 1 -- 172.21.15.62:0/2170555199 shutdown_connections 2021-12-17T18:20:10.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3de20b1700 1 --2- 172.21.15.62:0/2170555199 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ddc143720 0x7f3ddc13eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:10.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3de20b1700 1 --2- 172.21.15.62:0/2170555199 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3ddc0b6400 0x7f3ddc0b67e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:10.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3de20b1700 1 -- 172.21.15.62:0/2170555199 >> 172.21.15.62:0/2170555199 conn(0x7f3ddc05c8f0 msgr2=0x7f3ddc0b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:10.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3de20b1700 1 -- 172.21.15.62:0/2170555199 shutdown_connections 2021-12-17T18:20:10.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3de20b1700 1 -- 172.21.15.62:0/2170555199 wait complete. 2021-12-17T18:20:10.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3de20b1700 1 Processor -- start 2021-12-17T18:20:10.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3de20b1700 1 -- start start 2021-12-17T18:20:10.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3de20b1700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3ddc0af940 0x7f3ddc066ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:10.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3de20b1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ddc0b6400 0x7f3ddc0b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:10.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3de20b1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ddc143720 0x7f3ddc152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:10.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3de20b1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc064850 con 0x7f3ddc0b6400 2021-12-17T18:20:10.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3de20b1700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc064a80 con 0x7f3ddc0af940 2021-12-17T18:20:10.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3de20b1700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc064d20 con 0x7f3ddc143720 2021-12-17T18:20:10.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3ddaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ddc0b6400 0x7f3ddc0b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:10.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3ddaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ddc0b6400 0x7f3ddc0b4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49738/0 (socket says 172.21.15.62:49738) 2021-12-17T18:20:10.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3ddaffd700 1 -- 172.21.15.62:0/2466212382 learned_addr learned my addr 172.21.15.62:0/2466212382 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:10.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3ddb7fe700 1 --2- 172.21.15.62:0/2466212382 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3ddc0af940 0x7f3ddc066ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:10.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.950+0000 7f3ddbfff700 1 --2- 172.21.15.62:0/2466212382 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ddc143720 0x7f3ddc152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:10.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.954+0000 7f3ddaffd700 1 -- 172.21.15.62:0/2466212382 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ddc143720 msgr2=0x7f3ddc152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:10.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.954+0000 7f3ddaffd700 1 --2- 172.21.15.62:0/2466212382 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ddc143720 0x7f3ddc152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:10.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.954+0000 7f3ddaffd700 1 -- 172.21.15.62:0/2466212382 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3ddc0af940 msgr2=0x7f3ddc066ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:10.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.954+0000 7f3ddaffd700 1 --2- 172.21.15.62:0/2466212382 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3ddc0af940 0x7f3ddc066ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:10.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.954+0000 7f3ddaffd700 1 -- 172.21.15.62:0/2466212382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc00b180 con 0x7f3ddc0b6400 2021-12-17T18:20:10.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.954+0000 7f3ddaffd700 1 --2- 172.21.15.62:0/2466212382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ddc0b6400 0x7f3ddc0b4fe0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f3ddc060ae0 tx=0x7f3dd0007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:10.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.954+0000 7f3dd8ff9700 1 -- 172.21.15.62:0/2466212382 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dd00060d0 con 0x7f3ddc0b6400 2021-12-17T18:20:10.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.954+0000 7f3dd8ff9700 1 -- 172.21.15.62:0/2466212382 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd0006230 con 0x7f3ddc0b6400 2021-12-17T18:20:10.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.954+0000 7f3de20b1700 1 -- 172.21.15.62:0/2466212382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ddc064fc0 con 0x7f3ddc0b6400 2021-12-17T18:20:10.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.954+0000 7f3dd8ff9700 1 -- 172.21.15.62:0/2466212382 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dd0004710 con 0x7f3ddc0b6400 2021-12-17T18:20:10.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.954+0000 7f3de20b1700 1 -- 172.21.15.62:0/2466212382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ddc152ad0 con 0x7f3ddc0b6400 2021-12-17T18:20:10.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.954+0000 7f3de20b1700 1 -- 172.21.15.62:0/2466212382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ddc065d50 con 0x7f3ddc0b6400 2021-12-17T18:20:10.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.954+0000 7f3dd8ff9700 1 -- 172.21.15.62:0/2466212382 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3dd0010070 con 0x7f3ddc0b6400 2021-12-17T18:20:10.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.954+0000 7f3dd8ff9700 1 --2- 172.21.15.62:0/2466212382 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3dbc053640 0x7f3dbc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:10.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.954+0000 7f3dd8ff9700 1 -- 172.21.15.62:0/2466212382 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f3dd006ab50 con 0x7f3ddc0b6400 2021-12-17T18:20:10.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.954+0000 7f3ddb7fe700 1 --2- 172.21.15.62:0/2466212382 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3dbc053640 0x7f3dbc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:10.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.958+0000 7f3ddb7fe700 1 --2- 172.21.15.62:0/2466212382 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3dbc053640 0x7f3dbc055b00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f3dcc01b000 tx=0x7f3dcc016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:10.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:10.966+0000 7f3dd8ff9700 1 -- 172.21.15.62:0/2466212382 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3ddc065d50 con 0x7f3ddc0b6400 2021-12-17T18:20:11.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.094+0000 7f3de20b1700 1 -- 172.21.15.62:0/2466212382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3ddc065d50 con 0x7f3ddc0b6400 2021-12-17T18:20:11.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.102+0000 7f3dd8ff9700 1 -- 172.21.15.62:0/2466212382 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3ddc065d50 con 0x7f3ddc0b6400 2021-12-17T18:20:11.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.106+0000 7f3de20b1700 1 -- 172.21.15.62:0/2466212382 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3dbc053640 msgr2=0x7f3dbc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:11.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.106+0000 7f3de20b1700 1 --2- 172.21.15.62:0/2466212382 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3dbc053640 0x7f3dbc055b00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f3dcc01b000 tx=0x7f3dcc016000).stop 2021-12-17T18:20:11.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.106+0000 7f3de20b1700 1 -- 172.21.15.62:0/2466212382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ddc0b6400 msgr2=0x7f3ddc0b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:11.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.106+0000 7f3de20b1700 1 --2- 172.21.15.62:0/2466212382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ddc0b6400 0x7f3ddc0b4fe0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f3ddc060ae0 tx=0x7f3dd0007c00).stop 2021-12-17T18:20:11.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.106+0000 7f3de20b1700 1 -- 172.21.15.62:0/2466212382 shutdown_connections 2021-12-17T18:20:11.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.106+0000 7f3de20b1700 1 --2- 172.21.15.62:0/2466212382 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3dbc053640 0x7f3dbc055b00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.106+0000 7f3de20b1700 1 --2- 172.21.15.62:0/2466212382 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ddc143720 0x7f3ddc152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.106+0000 7f3de20b1700 1 --2- 172.21.15.62:0/2466212382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ddc0b6400 0x7f3ddc0b4fe0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.106+0000 7f3de20b1700 1 --2- 172.21.15.62:0/2466212382 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3ddc0af940 0x7f3ddc066ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.106+0000 7f3de20b1700 1 -- 172.21.15.62:0/2466212382 >> 172.21.15.62:0/2466212382 conn(0x7f3ddc05c8f0 msgr2=0x7f3ddc05bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:11.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.106+0000 7f3de20b1700 1 -- 172.21.15.62:0/2466212382 shutdown_connections 2021-12-17T18:20:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.106+0000 7f3de20b1700 1 -- 172.21.15.62:0/2466212382 wait complete. 2021-12-17T18:20:11.128 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:20:11.129 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:20:11.142 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:20:11.164 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:20:11.185 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:20:11.206 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:20:11.227 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:20:11.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:11.228 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:20:11.229 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:20:11.236 INFO:teuthology.orchestra.run.smithi125.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-12-17T18:20:11.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:20:11.238 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-12-17T18:20:11.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:11.239 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:20:11.239 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:20:11.246 INFO:teuthology.orchestra.run.smithi158.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:20:11.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:20:11.248 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-12-17T18:20:11.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:11.249 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:20:11.249 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:20:11.257 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:20:11.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:20:11.258 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:20:11.259 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:20:11.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de88e9700 1 Processor -- start 2021-12-17T18:20:11.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de88e9700 1 -- start start 2021-12-17T18:20:11.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de88e9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1de40a8e10 0x7f1de4147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:11.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de88e9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de40b6270 con 0x7f1de40a71e0 2021-12-17T18:20:11.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de88e9700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de4147610 con 0x7f1de4141480 2021-12-17T18:20:11.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de88e9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de41478b0 con 0x7f1de40a8e10 2021-12-17T18:20:11.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de2ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1de40a8e10 0x7f1de4147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:11.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de3fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1de40a71e0 0x7f1de40a7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33326/0 (socket says 172.21.15.62:33326) 2021-12-17T18:20:11.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de3fff700 1 -- 172.21.15.62:0/1314718887 learned_addr learned my addr 172.21.15.62:0/1314718887 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:11.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de2ffd700 1 -- 172.21.15.62:0/1314718887 >> v1:172.21.15.109:6789/0 conn(0x7f1de4141480 legacy=0x7f1de40b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:11.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de2ffd700 1 -- 172.21.15.62:0/1314718887 >> v1:172.21.15.62:6789/0 conn(0x7f1de40a71e0 legacy=0x7f1de40a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:11.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de2ffd700 1 -- 172.21.15.62:0/1314718887 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de4147b50 con 0x7f1de40a8e10 2021-12-17T18:20:11.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de2ffd700 1 --2- 172.21.15.62:0/1314718887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de40a8e10 0x7f1de4147ff0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f1dd8002f70 tx=0x7f1dd8006df0).ready entity=mon.0 client_cookie=846f392f326be7f9 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:11.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de27fc700 1 -- 172.21.15.62:0/1314718887 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dd800d610 con 0x7f1de40a8e10 2021-12-17T18:20:11.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de27fc700 1 -- 172.21.15.62:0/1314718887 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd8000e90 con 0x7f1de40a8e10 2021-12-17T18:20:11.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de27fc700 1 -- 172.21.15.62:0/1314718887 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dd800d960 con 0x7f1de40a8e10 2021-12-17T18:20:11.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de88e9700 1 -- 172.21.15.62:0/1314718887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de40a8e10 msgr2=0x7f1de4147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:11.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de88e9700 1 --2- 172.21.15.62:0/1314718887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de40a8e10 0x7f1de4147ff0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f1dd8002f70 tx=0x7f1dd8006df0).stop 2021-12-17T18:20:11.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de88e9700 1 -- 172.21.15.62:0/1314718887 shutdown_connections 2021-12-17T18:20:11.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de88e9700 1 --2- 172.21.15.62:0/1314718887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de40a8e10 0x7f1de4147ff0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de88e9700 1 -- 172.21.15.62:0/1314718887 >> 172.21.15.62:0/1314718887 conn(0x7f1de405d220 msgr2=0x7f1de40b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:11.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de88e9700 1 -- 172.21.15.62:0/1314718887 shutdown_connections 2021-12-17T18:20:11.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.370+0000 7f1de88e9700 1 -- 172.21.15.62:0/1314718887 wait complete. 2021-12-17T18:20:11.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de88e9700 1 Processor -- start 2021-12-17T18:20:11.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de88e9700 1 -- start start 2021-12-17T18:20:11.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de88e9700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1de40a71e0 0x7f1de40ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:11.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de88e9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de40a8e10 0x7f1de415a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:11.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de88e9700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1de4141480 0x7f1de415aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:11.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de88e9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de413e9a0 con 0x7f1de40a8e10 2021-12-17T18:20:11.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de88e9700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de41489d0 con 0x7f1de4141480 2021-12-17T18:20:11.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de88e9700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de4148c70 con 0x7f1de40a71e0 2021-12-17T18:20:11.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de40a8e10 0x7f1de415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:11.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de40a8e10 0x7f1de415a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49750/0 (socket says 172.21.15.62:49750) 2021-12-17T18:20:11.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de2ffd700 1 -- 172.21.15.62:0/3021686837 learned_addr learned my addr 172.21.15.62:0/3021686837 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:11.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de3fff700 1 --2- 172.21.15.62:0/3021686837 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1de4141480 0x7f1de415aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:11.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de37fe700 1 --2- 172.21.15.62:0/3021686837 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1de40a71e0 0x7f1de40ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:11.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de2ffd700 1 -- 172.21.15.62:0/3021686837 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1de40a71e0 msgr2=0x7f1de40ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:11.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de2ffd700 1 --2- 172.21.15.62:0/3021686837 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1de40a71e0 0x7f1de40ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de2ffd700 1 -- 172.21.15.62:0/3021686837 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1de4141480 msgr2=0x7f1de415aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:11.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de2ffd700 1 --2- 172.21.15.62:0/3021686837 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1de4141480 0x7f1de415aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de2ffd700 1 -- 172.21.15.62:0/3021686837 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd800b180 con 0x7f1de40a8e10 2021-12-17T18:20:11.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de37fe700 1 --2- 172.21.15.62:0/3021686837 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1de40a71e0 0x7f1de40ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:11.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.374+0000 7f1de2ffd700 1 --2- 172.21.15.62:0/3021686837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de40a8e10 0x7f1de415a600 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f1dd8002f70 tx=0x7f1dd8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:11.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.378+0000 7f1de0ff9700 1 -- 172.21.15.62:0/3021686837 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dd800d990 con 0x7f1de40a8e10 2021-12-17T18:20:11.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.378+0000 7f1de0ff9700 1 -- 172.21.15.62:0/3021686837 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd8011bf0 con 0x7f1de40a8e10 2021-12-17T18:20:11.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.378+0000 7f1de88e9700 1 -- 172.21.15.62:0/3021686837 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de4148f10 con 0x7f1de40a8e10 2021-12-17T18:20:11.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.378+0000 7f1de0ff9700 1 -- 172.21.15.62:0/3021686837 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dd801e460 con 0x7f1de40a8e10 2021-12-17T18:20:11.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.378+0000 7f1de88e9700 1 -- 172.21.15.62:0/3021686837 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de40ac040 con 0x7f1de40a8e10 2021-12-17T18:20:11.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.378+0000 7f1de88e9700 1 -- 172.21.15.62:0/3021686837 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de40ac260 con 0x7f1de40a8e10 2021-12-17T18:20:11.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.378+0000 7f1de0ff9700 1 -- 172.21.15.62:0/3021686837 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1dd8025030 con 0x7f1de40a8e10 2021-12-17T18:20:11.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.378+0000 7f1de0ff9700 1 --2- 172.21.15.62:0/3021686837 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1dc4053580 0x7f1dc4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:11.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.378+0000 7f1de0ff9700 1 -- 172.21.15.62:0/3021686837 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f1dd806cb40 con 0x7f1de40a8e10 2021-12-17T18:20:11.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.378+0000 7f1de37fe700 1 --2- 172.21.15.62:0/3021686837 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1dc4053580 0x7f1dc4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:11.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.382+0000 7f1de37fe700 1 --2- 172.21.15.62:0/3021686837 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1dc4053580 0x7f1dc4055a40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f1dd400b000 tx=0x7f1dd4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:11.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.386+0000 7f1de0ff9700 1 -- 172.21.15.62:0/3021686837 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1dd8043e70 con 0x7f1de40a8e10 2021-12-17T18:20:11.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.514+0000 7f1de88e9700 1 -- 172.21.15.62:0/3021686837 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1de40abd10 con 0x7f1de40a8e10 2021-12-17T18:20:11.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.518+0000 7f1de0ff9700 1 -- 172.21.15.62:0/3021686837 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v36) v1 ==== 81+0+28875 (secure 0 0 0) 0x7f1de40abd10 con 0x7f1de40a8e10 2021-12-17T18:20:11.525 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:11.525 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:20:11.526 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 36, 2021-12-17T18:20:11.526 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:20:11.526 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:20:11.526 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:20:08.803669+0000", 2021-12-17T18:20:11.527 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:20:11.527 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:20:11.527 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:20:11.528 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:20:11.528 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:20:11.528 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:20:11.528 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:20:11.528 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:20:11.529 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:20:11.529 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:20:11.529 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:20:11.529 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:20:11.530 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:20:11.530 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:20:11.530 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:20:11.530 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 6, 2021-12-17T18:20:11.531 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:20:11.531 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:20:11.531 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:20:11.531 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:20:11.532 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:20:11.532 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.532 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:20:11.532 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:20:11.533 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:20:11.533 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:20:11.533 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:20:11.533 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:20:11.534 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:20:11.534 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:20:11.534 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:20:11.534 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:20:11.535 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:20:11.535 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:20:11.535 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:20:11.535 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:20:11.536 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:20:11.536 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:20:11.536 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:20:11.536 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:20:11.537 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:20:11.537 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:20:11.537 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:20:11.537 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:20:11.537 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:20:11.538 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.538 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:20:11.538 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:20:11.538 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:20:11.539 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:20:11.539 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:20:11.539 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:20:11.539 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:20:11.540 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:20:11.540 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:20:11.540 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:20:11.540 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:20:11.540 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:20:11.541 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:20:11.541 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:20:11.541 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:20:11.541 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:20:11.542 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:20:11.542 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:20:11.542 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:20:11.542 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:20:11.543 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:20:11.543 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:20:11.543 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:20:11.543 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:20:11.544 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:20:11.544 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:20:11.544 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:20:11.544 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.545 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:20:11.545 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:20:11.545 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:20:11.545 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:20:11.546 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:20:11.546 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:20:11.546 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:20:11.546 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:20:11.546 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:20:11.547 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:20:11.547 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:20:11.547 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:20:11.547 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:20:11.548 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.548 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:20:11.548 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:20:11.548 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.549 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.549 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.549 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:20:11.549 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:20:11.549 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:20:11.550 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:20:11.550 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:20:11.550 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:20:11.550 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:20:11.551 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:20:11.551 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:20:11.551 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:20:11.552 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:20:11.552 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:20:11.552 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:20:11.552 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:20:11.552 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:20:11.553 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:20:11.553 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:20:11.553 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:20:11.553 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:20:11.554 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:20:11.554 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:20:11.554 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:20:11.554 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:20:11.555 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.555 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:20:11.555 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:20:11.555 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:20:11.555 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:20:11.556 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:20:11.556 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:20:11.556 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:20:11.556 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:20:11.557 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:20:11.557 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:20:11.557 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:20:11.557 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:20:11.557 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:20:11.558 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:20:11.558 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:20:11.558 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:20:11.558 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:20:11.559 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:20:11.559 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:20:11.559 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:20:11.559 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:20:11.560 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:20:11.560 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:20:11.560 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:20:11.560 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:20:11.560 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:20:11.561 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:20:11.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.561 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:20:11.561 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:20:11.562 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:20:11.562 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:20:11.562 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:20:11.562 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:20:11.563 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:20:11.563 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:20:11.563 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:20:11.563 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:20:11.564 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:20:11.564 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:20:11.564 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:20:11.564 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:20:11.564 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.565 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.565 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:20:11.565 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:20:11.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.566 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:20:11.566 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:20:11.566 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:20:11.566 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:20:11.567 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:20:11.567 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:20:11.567 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:20:11.567 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:20:11.567 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:20:11.568 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 31, 2021-12-17T18:20:11.568 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:20:11.568 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:20:11.568 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:20:11.569 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.569 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.569 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.569 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:20:11.570 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:20:11.570 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.570 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.570 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.571 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:20:11.571 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:20:11.571 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.571 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.572 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:20:11.572 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.572 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.572 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.573 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:20:11.573 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:20:11.573 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.573 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.574 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.574 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:20:11.574 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:20:11.574 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.575 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.575 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.575 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:20:11.575 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.576 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.576 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.576 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:20:11.576 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:20:11.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.577 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.577 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.577 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:20:11.577 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:20:11.578 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.578 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.578 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.578 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:20:11.579 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.579 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.579 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.579 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:20:11.580 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:20:11.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.580 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.580 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.581 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:20:11.581 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:20:11.581 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.581 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.582 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:20:11.582 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:20:11.582 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:20:11.582 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:20:11.583 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:20:11.583 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:20:11.583 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:20:11.583 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.584 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.584 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:20:11.584 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:20:11.584 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:20:11.585 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:20:11.585 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:20:11.585 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:20:11.585 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:20:11.586 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:20:11.586 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:20:11.586 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 31, 2021-12-17T18:20:11.586 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:20:11.587 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:20:11.587 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:20:11.587 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.587 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.587 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.588 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:20:11.588 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:20:11.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.588 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.589 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.589 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:20:11.589 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:20:11.589 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.590 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.590 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:20:11.590 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.591 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.591 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.591 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:20:11.591 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:20:11.592 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.592 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.592 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.592 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:20:11.592 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:20:11.593 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.593 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.593 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:20:11.594 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.594 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.594 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.594 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:20:11.595 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:20:11.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.595 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.595 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.596 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:20:11.596 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:20:11.596 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.596 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.597 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:20:11.597 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.597 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.598 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.598 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:20:11.598 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:20:11.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.598 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.599 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.599 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:20:11.599 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:20:11.599 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.600 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.600 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.600 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:20:11.601 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:20:11.601 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:20:11.601 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:20:11.601 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:20:11.602 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:20:11.602 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:20:11.602 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.602 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.603 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.603 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:20:11.603 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:20:11.603 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:20:11.604 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:20:11.604 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:20:11.604 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:20:11.604 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:20:11.605 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:20:11.605 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:20:11.605 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 30, 2021-12-17T18:20:11.605 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:20:11.605 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:20:11.606 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:20:11.606 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.606 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.606 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.607 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:20:11.607 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:20:11.607 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.607 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.608 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.608 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:20:11.608 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:20:11.608 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.608 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.609 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:20:11.609 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.610 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.610 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:20:11.610 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:20:11.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.610 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.611 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.611 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:20:11.611 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:20:11.611 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.612 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.612 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.612 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:20:11.612 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.613 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.613 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.613 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:20:11.613 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:20:11.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.614 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.614 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.614 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:20:11.615 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:20:11.615 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.615 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.616 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:20:11.616 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.616 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.617 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:20:11.617 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:20:11.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.617 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.618 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:20:11.618 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:20:11.618 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.618 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.619 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.619 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:20:11.619 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:20:11.619 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:20:11.620 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:20:11.620 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:20:11.620 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:20:11.620 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:20:11.620 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.621 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.621 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.621 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:20:11.621 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:20:11.622 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:20:11.622 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:20:11.622 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:20:11.622 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:20:11.623 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:20:11.623 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:20:11.623 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:20:11.623 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 31, 2021-12-17T18:20:11.623 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:20:11.624 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:20:11.624 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:20:11.624 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.624 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.625 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.625 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:20:11.625 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:20:11.625 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.626 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.626 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.626 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:20:11.626 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:20:11.626 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.627 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.627 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.627 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:20:11.627 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.628 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.628 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.628 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:20:11.628 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:20:11.629 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.629 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.629 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.629 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:20:11.629 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:20:11.630 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.630 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.630 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.630 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:20:11.631 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.631 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.631 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.631 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:20:11.632 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:20:11.632 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.632 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.632 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.632 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:20:11.633 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:20:11.633 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.633 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.633 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.634 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:20:11.634 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.634 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.634 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.635 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:20:11.635 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:20:11.635 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.635 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.635 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.636 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:20:11.636 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:20:11.636 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.636 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.637 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.637 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:20:11.637 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:20:11.637 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:20:11.638 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:20:11.638 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:20:11.638 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:20:11.638 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:20:11.639 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.639 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.639 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.639 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:20:11.640 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:20:11.640 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:20:11.640 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:20:11.640 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:20:11.640 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:20:11.641 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:20:11.641 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:20:11.641 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:20:11.641 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 31, 2021-12-17T18:20:11.642 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:20:11.642 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:20:11.642 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:20:11.642 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.643 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.643 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.643 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:20:11.643 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:20:11.644 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.644 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.644 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.644 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:20:11.645 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:20:11.645 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.645 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.645 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.646 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:20:11.646 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.646 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.647 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.647 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:20:11.647 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:20:11.647 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.648 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.648 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.648 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:20:11.648 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:20:11.649 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.649 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.649 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.649 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:20:11.650 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.650 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.650 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.650 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:20:11.650 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:20:11.651 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.651 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.651 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.651 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:20:11.652 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:20:11.652 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.652 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.652 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.653 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:20:11.653 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.653 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.653 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.653 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:20:11.654 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:20:11.654 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.654 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.654 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.655 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:20:11.655 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:20:11.655 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.655 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.656 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.656 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:20:11.656 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:20:11.656 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:20:11.657 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:20:11.657 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:20:11.657 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:20:11.657 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:20:11.658 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.658 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.658 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.658 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:20:11.659 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:20:11.659 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:20:11.659 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:20:11.659 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:20:11.660 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:20:11.660 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:20:11.660 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:20:11.660 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:20:11.661 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 31, 2021-12-17T18:20:11.661 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:20:11.661 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:20:11.661 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:20:11.661 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.662 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.662 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.662 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:20:11.662 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:20:11.663 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.663 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.663 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.663 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:20:11.663 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:20:11.664 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.664 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.664 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.664 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:20:11.665 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.665 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.665 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.665 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:20:11.666 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:20:11.666 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.666 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.666 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.667 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:20:11.667 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:20:11.667 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.667 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.668 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.668 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:20:11.668 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.668 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.669 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.669 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:20:11.669 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:20:11.669 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.669 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.670 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.670 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:20:11.670 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:20:11.670 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.671 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.671 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.671 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:20:11.671 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.672 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.672 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.672 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:20:11.672 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:20:11.672 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.673 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.673 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.673 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:20:11.673 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:20:11.674 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.674 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.674 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.674 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:20:11.674 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:20:11.675 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:20:11.675 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:20:11.675 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:20:11.675 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:20:11.676 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:20:11.676 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.676 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.676 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.677 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:20:11.677 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:20:11.677 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:20:11.677 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:20:11.678 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:20:11.678 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:20:11.678 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:20:11.678 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:20:11.678 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:20:11.679 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 30, 2021-12-17T18:20:11.679 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:20:11.679 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:20:11.679 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:20:11.680 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.680 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.680 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.680 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:20:11.681 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:20:11.681 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.681 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.681 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.681 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:20:11.682 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:20:11.682 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.682 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.682 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.683 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:20:11.683 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.683 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.683 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.684 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:20:11.684 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:20:11.684 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.684 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.685 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.685 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:20:11.685 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:20:11.685 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.685 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.686 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.686 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:20:11.686 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.686 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.687 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.687 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:20:11.687 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:20:11.687 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.688 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.688 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.688 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:20:11.688 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:20:11.688 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.689 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.689 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.689 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:20:11.689 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.690 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.690 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.690 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:20:11.690 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:20:11.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.691 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.691 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:20:11.691 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:20:11.692 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.692 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.692 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.692 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:20:11.693 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:20:11.693 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:20:11.693 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:20:11.693 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:20:11.693 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:20:11.694 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:20:11.694 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.694 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.694 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.695 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:20:11.695 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:20:11.695 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:20:11.695 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:20:11.696 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:20:11.696 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:20:11.696 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:20:11.697 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:20:11.697 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:20:11.697 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 31, 2021-12-17T18:20:11.697 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:20:11.697 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:20:11.698 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:20:11.698 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.698 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.699 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:20:11.699 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:20:11.699 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.699 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.700 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.700 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:20:11.700 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:20:11.700 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.700 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.701 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.701 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:20:11.701 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.701 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.702 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.702 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:20:11.702 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:20:11.702 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.703 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.703 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.703 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:20:11.703 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:20:11.704 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.704 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.704 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:20:11.704 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.705 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.705 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.705 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:20:11.705 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:20:11.706 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.706 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.706 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.706 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:20:11.707 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:20:11.707 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.707 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.707 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.708 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:20:11.708 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:20:11.708 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.708 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:20:11.709 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:20:11.709 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:20:11.709 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.709 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.709 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:20:11.710 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:20:11.710 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:20:11.710 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.710 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.711 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.711 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:20:11.711 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:20:11.711 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:20:11.712 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:20:11.712 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:20:11.712 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:20:11.712 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:20:11.713 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:11.713 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.713 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:20:11.713 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:20:11.714 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.714 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:20:11.714 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:20:11.714 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:20:11.714 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:20:11.715 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:20:11.715 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:20:11.715 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:20:11.715 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:20:11.716 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.716 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.716 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:20:11.716 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:20:11.717 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:20:11.717 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:20:11.717 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:20:11.717 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:20:11.718 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:20:11.718 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:20:11.718 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.718 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.719 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:20:11.719 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:20:11.719 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:20:11.719 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:20:11.720 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:20:11.720 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:20:11.720 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:20:11.720 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:20:11.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.721 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.721 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:20:11.721 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:20:11.721 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:20:11.722 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:20:11.722 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:20:11.722 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:20:11.722 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:20:11.723 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:20:11.723 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.723 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.723 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:20:11.724 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:20:11.724 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:20:11.724 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:20:11.724 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:20:11.725 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:20:11.725 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:20:11.725 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:20:11.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.726 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.726 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:20:11.726 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:20:11.726 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:20:11.727 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:20:11.727 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:20:11.727 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:20:11.727 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:20:11.728 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:20:11.728 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.728 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.728 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:20:11.728 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:20:11.729 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:20:11.729 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:20:11.729 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:20:11.729 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:20:11.730 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:20:11.730 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:20:11.730 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.730 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:11.731 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:20:11.731 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:20:11.731 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:20:11.731 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:20:11.732 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:20:11.732 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:20:11.732 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:20:11.732 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:20:11.732 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.733 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:20:11.733 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:20:11.733 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:20:11.733 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:20:11.734 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:20:11.734 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": { 2021-12-17T18:20:11.734 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.109:6835/360945085": "2021-12-18T18:20:05.256244+0000", 2021-12-17T18:20:11.734 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.109:6834/360945085": "2021-12-18T18:20:05.256244+0000" 2021-12-17T18:20:11.735 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.735 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:20:11.735 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:20:11.735 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:20:11.736 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:20:11.736 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:20:11.736 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:20:11.736 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:20:11.737 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:20:11.737 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:11.737 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:11.737 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:20:11.738 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:20:11.738 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:20:11.738 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:20:11.738 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:20:11.738 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:20:11.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.518+0000 7f1de88e9700 1 -- 172.21.15.62:0/3021686837 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1dc4053580 msgr2=0x7f1dc4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:11.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.518+0000 7f1de88e9700 1 --2- 172.21.15.62:0/3021686837 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1dc4053580 0x7f1dc4055a40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f1dd400b000 tx=0x7f1dd4009040).stop 2021-12-17T18:20:11.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.518+0000 7f1de88e9700 1 -- 172.21.15.62:0/3021686837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de40a8e10 msgr2=0x7f1de415a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:11.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.518+0000 7f1de88e9700 1 --2- 172.21.15.62:0/3021686837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de40a8e10 0x7f1de415a600 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f1dd8002f70 tx=0x7f1dd8015000).stop 2021-12-17T18:20:11.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.522+0000 7f1de88e9700 1 -- 172.21.15.62:0/3021686837 shutdown_connections 2021-12-17T18:20:11.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.522+0000 7f1de88e9700 1 --2- 172.21.15.62:0/3021686837 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1dc4053580 0x7f1dc4055a40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.522+0000 7f1de88e9700 1 --2- 172.21.15.62:0/3021686837 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1de4141480 0x7f1de415aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.522+0000 7f1de88e9700 1 --2- 172.21.15.62:0/3021686837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de40a8e10 0x7f1de415a600 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.522+0000 7f1de88e9700 1 --2- 172.21.15.62:0/3021686837 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1de40a71e0 0x7f1de40ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.522+0000 7f1de88e9700 1 -- 172.21.15.62:0/3021686837 >> 172.21.15.62:0/3021686837 conn(0x7f1de405d220 msgr2=0x7f1de405ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:11.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.522+0000 7f1de88e9700 1 -- 172.21.15.62:0/3021686837 shutdown_connections 2021-12-17T18:20:11.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.522+0000 7f1de88e9700 1 -- 172.21.15.62:0/3021686837 wait complete. 2021-12-17T18:20:11.744 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:20:11.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.850+0000 7f687e622700 1 Processor -- start 2021-12-17T18:20:11.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.850+0000 7f687e622700 1 -- start start 2021-12-17T18:20:11.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.850+0000 7f687e622700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68780af680 0x7f68781401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:11.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.850+0000 7f687e622700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f68780b3260 0x7f68781406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:11.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.850+0000 7f687e622700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f68780b0c90 0x7f6878063dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:11.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.850+0000 7f687e622700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68780b13a0 con 0x7f68780b3260 2021-12-17T18:20:11.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.850+0000 7f687e622700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68780afa60 con 0x7f68780b0c90 2021-12-17T18:20:11.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.850+0000 7f687e622700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68780b29a0 con 0x7f68780af680 2021-12-17T18:20:11.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.850+0000 7f687ce1f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f68780b3260 0x7f68781406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:11.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.850+0000 7f687ce1f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f68780b3260 0x7f68781406e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49760/0 (socket says 172.21.15.62:49760) 2021-12-17T18:20:11.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.850+0000 7f687ce1f700 1 -- 172.21.15.62:0/777708689 learned_addr learned my addr 172.21.15.62:0/777708689 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:11.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.850+0000 7f687d620700 1 --2- 172.21.15.62:0/777708689 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68780af680 0x7f68781401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:11.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.850+0000 7f687de21700 1 --2- 172.21.15.62:0/777708689 >> v2:172.21.15.109:3300/0 conn(0x7f68780b0c90 0x7f6878063dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:11.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687ce1f700 1 -- 172.21.15.62:0/777708689 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68780af680 msgr2=0x7f68781401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:11.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687ce1f700 1 --2- 172.21.15.62:0/777708689 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68780af680 0x7f68781401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687ce1f700 1 -- 172.21.15.62:0/777708689 >> v2:172.21.15.109:3300/0 conn(0x7f68780b0c90 msgr2=0x7f6878063dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:11.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687ce1f700 1 --2- 172.21.15.62:0/777708689 >> v2:172.21.15.109:3300/0 conn(0x7f68780b0c90 0x7f6878063dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687ce1f700 1 -- 172.21.15.62:0/777708689 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68780b2c40 con 0x7f68780b3260 2021-12-17T18:20:11.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687ce1f700 1 --2- 172.21.15.62:0/777708689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68780b3260 0x7f68781406e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f6868002f70 tx=0x7f6868006eb0).ready entity=mon.0 client_cookie=3275d795e362ca6b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:11.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f686ffff700 1 -- 172.21.15.62:0/777708689 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f686800d570 con 0x7f68780b3260 2021-12-17T18:20:11.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f686ffff700 1 -- 172.21.15.62:0/777708689 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6868000e90 con 0x7f68780b3260 2021-12-17T18:20:11.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f686ffff700 1 -- 172.21.15.62:0/777708689 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f686800d900 con 0x7f68780b3260 2021-12-17T18:20:11.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687e622700 1 -- 172.21.15.62:0/777708689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68780b3260 msgr2=0x7f68781406e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:11.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687e622700 1 --2- 172.21.15.62:0/777708689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68780b3260 0x7f68781406e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f6868002f70 tx=0x7f6868006eb0).stop 2021-12-17T18:20:11.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687e622700 1 -- 172.21.15.62:0/777708689 shutdown_connections 2021-12-17T18:20:11.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687e622700 1 --2- 172.21.15.62:0/777708689 >> v2:172.21.15.109:3300/0 conn(0x7f68780b0c90 0x7f6878063dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687e622700 1 --2- 172.21.15.62:0/777708689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68780b3260 0x7f68781406e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687e622700 1 --2- 172.21.15.62:0/777708689 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68780af680 0x7f68781401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687e622700 1 -- 172.21.15.62:0/777708689 >> 172.21.15.62:0/777708689 conn(0x7f687805c750 msgr2=0x7f687805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:11.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687e622700 1 -- 172.21.15.62:0/777708689 shutdown_connections 2021-12-17T18:20:11.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687e622700 1 -- 172.21.15.62:0/777708689 wait complete. 2021-12-17T18:20:11.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687e622700 1 Processor -- start 2021-12-17T18:20:11.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687e622700 1 -- start start 2021-12-17T18:20:11.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687e622700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f68780af680 0x7f6878142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:11.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687e622700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68780b0c90 0x7f6878155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:11.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687e622700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68780b3260 0x7f68780ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:11.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687e622700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68780ae500 con 0x7f68780b0c90 2021-12-17T18:20:11.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687e622700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687813c550 con 0x7f68780af680 2021-12-17T18:20:11.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687e622700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687813c7f0 con 0x7f68780b3260 2021-12-17T18:20:11.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.854+0000 7f687ce1f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68780b0c90 0x7f6878155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:11.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f687d620700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f68780af680 0x7f6878142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:11.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f687d620700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f68780af680 0x7f6878142720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:56314/0 (socket says 172.21.15.62:56314) 2021-12-17T18:20:11.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f687ce1f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68780b0c90 0x7f6878155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49766/0 (socket says 172.21.15.62:49766) 2021-12-17T18:20:11.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f687d620700 1 -- 172.21.15.62:0/3704997700 learned_addr learned my addr 172.21.15.62:0/3704997700 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:11.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f687de21700 1 --2- 172.21.15.62:0/3704997700 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68780b3260 0x7f68780ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:11.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f687ce1f700 1 -- 172.21.15.62:0/3704997700 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68780b3260 msgr2=0x7f68780ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:11.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f687ce1f700 1 --2- 172.21.15.62:0/3704997700 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68780b3260 0x7f68780ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f687ce1f700 1 -- 172.21.15.62:0/3704997700 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f68780af680 msgr2=0x7f6878142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:11.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f687ce1f700 1 --2- 172.21.15.62:0/3704997700 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f68780af680 0x7f6878142720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:11.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f687ce1f700 1 -- 172.21.15.62:0/3704997700 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686800b1e0 con 0x7f68780b0c90 2021-12-17T18:20:11.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f687d620700 1 --2- 172.21.15.62:0/3704997700 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f68780af680 0x7f6878142720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:20:11.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f687ce1f700 1 --2- 172.21.15.62:0/3704997700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68780b0c90 0x7f6878155720 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f6868002f70 tx=0x7f6868015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:11.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f686e7fc700 1 -- 172.21.15.62:0/3704997700 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68680116e0 con 0x7f68780b0c90 2021-12-17T18:20:11.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f686e7fc700 1 -- 172.21.15.62:0/3704997700 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6868011840 con 0x7f68780b0c90 2021-12-17T18:20:11.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f687e622700 1 -- 172.21.15.62:0/3704997700 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687813c1d0 con 0x7f68780b0c90 2021-12-17T18:20:11.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f686e7fc700 1 -- 172.21.15.62:0/3704997700 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6868011ba0 con 0x7f68780b0c90 2021-12-17T18:20:11.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f687e622700 1 -- 172.21.15.62:0/3704997700 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6878155c10 con 0x7f68780b0c90 2021-12-17T18:20:11.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f687e622700 1 -- 172.21.15.62:0/3704997700 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68780ae670 con 0x7f68780b0c90 2021-12-17T18:20:11.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.858+0000 7f686e7fc700 1 -- 172.21.15.62:0/3704997700 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f686801a040 con 0x7f68780b0c90 2021-12-17T18:20:11.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.862+0000 7f686e7fc700 1 --2- 172.21.15.62:0/3704997700 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68600534f0 0x7f68600559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:11.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.862+0000 7f686e7fc700 1 -- 172.21.15.62:0/3704997700 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f686806c550 con 0x7f68780b0c90 2021-12-17T18:20:11.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.862+0000 7f687d620700 1 --2- 172.21.15.62:0/3704997700 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68600534f0 0x7f68600559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:11.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.862+0000 7f687d620700 1 --2- 172.21.15.62:0/3704997700 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68600534f0 0x7f68600559b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f6870006e00 tx=0x7f68700091d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:11.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:11.866+0000 7f686e7fc700 1 -- 172.21.15.62:0/3704997700 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6868043880 con 0x7f68780b0c90 2021-12-17T18:20:12.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.034+0000 7f687e622700 1 -- 172.21.15.62:0/3704997700 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68780b2ee0 con 0x7f68780b0c90 2021-12-17T18:20:12.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.034+0000 7f686e7fc700 1 -- 172.21.15.62:0/3704997700 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+1211 (secure 0 0 0) 0x7f6868046ea0 con 0x7f68780b0c90 2021-12-17T18:20:12.041 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:12.041 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3762456539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3762456539},{"type":"v1","addr":"172.21.15.109:6835","nonce":3762456539}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":12},{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4093989719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4093989719},{"type":"v1","addr":"172.21.15.62:6833","nonce":4093989719}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[]} 2021-12-17T18:20:12.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.034+0000 7f687e622700 1 -- 172.21.15.62:0/3704997700 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68600534f0 msgr2=0x7f68600559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:12.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.034+0000 7f687e622700 1 --2- 172.21.15.62:0/3704997700 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68600534f0 0x7f68600559b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f6870006e00 tx=0x7f68700091d0).stop 2021-12-17T18:20:12.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.034+0000 7f687e622700 1 -- 172.21.15.62:0/3704997700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68780b0c90 msgr2=0x7f6878155720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:12.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.034+0000 7f687e622700 1 --2- 172.21.15.62:0/3704997700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68780b0c90 0x7f6878155720 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f6868002f70 tx=0x7f6868015000).stop 2021-12-17T18:20:12.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.034+0000 7f687e622700 1 -- 172.21.15.62:0/3704997700 shutdown_connections 2021-12-17T18:20:12.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.034+0000 7f687e622700 1 --2- 172.21.15.62:0/3704997700 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68600534f0 0x7f68600559b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.034+0000 7f687e622700 1 --2- 172.21.15.62:0/3704997700 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68780b3260 0x7f68780ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.034+0000 7f687e622700 1 --2- 172.21.15.62:0/3704997700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68780b0c90 0x7f6878155720 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.034+0000 7f687e622700 1 --2- 172.21.15.62:0/3704997700 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f68780af680 0x7f6878142720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.034+0000 7f687e622700 1 -- 172.21.15.62:0/3704997700 >> 172.21.15.62:0/3704997700 conn(0x7f687805c750 msgr2=0x7f68780b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:12.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.038+0000 7f687e622700 1 -- 172.21.15.62:0/3704997700 shutdown_connections 2021-12-17T18:20:12.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.038+0000 7f687e622700 1 -- 172.21.15.62:0/3704997700 wait complete. 2021-12-17T18:20:12.046 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 12 2021-12-17T18:20:12.054 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:20:12.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6185aa7700 1 Processor -- start 2021-12-17T18:20:12.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6185aa7700 1 -- start start 2021-12-17T18:20:12.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6185aa7700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f61800b5ea0 0x7f6180140860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:12.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6185aa7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f61800682c0 0x7f6180140d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:12.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6185aa7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f61800afdf0 0x7f61800b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:12.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6185aa7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61800ad8e0 con 0x7f61800afdf0 2021-12-17T18:20:12.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6185aa7700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61800b6280 con 0x7f61800b5ea0 2021-12-17T18:20:12.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6185aa7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61800ad310 con 0x7f61800682c0 2021-12-17T18:20:12.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f61852a6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f61800afdf0 0x7f61800b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:12.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f61852a6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f61800afdf0 0x7f61800b0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49772/0 (socket says 172.21.15.62:49772) 2021-12-17T18:20:12.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f61852a6700 1 -- 172.21.15.62:0/4106154731 learned_addr learned my addr 172.21.15.62:0/4106154731 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:12.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6184aa5700 1 --2- 172.21.15.62:0/4106154731 >> v2:172.21.15.109:3300/0 conn(0x7f61800b5ea0 0x7f6180140860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:12.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f617ffff700 1 --2- 172.21.15.62:0/4106154731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f61800682c0 0x7f6180140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:12.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f61852a6700 1 -- 172.21.15.62:0/4106154731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f61800682c0 msgr2=0x7f6180140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:12.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f61852a6700 1 --2- 172.21.15.62:0/4106154731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f61800682c0 0x7f6180140d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f61852a6700 1 -- 172.21.15.62:0/4106154731 >> v2:172.21.15.109:3300/0 conn(0x7f61800b5ea0 msgr2=0x7f6180140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:12.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f61852a6700 1 --2- 172.21.15.62:0/4106154731 >> v2:172.21.15.109:3300/0 conn(0x7f61800b5ea0 0x7f6180140860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f61852a6700 1 -- 172.21.15.62:0/4106154731 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61800ac930 con 0x7f61800afdf0 2021-12-17T18:20:12.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6184aa5700 1 --2- 172.21.15.62:0/4106154731 >> v2:172.21.15.109:3300/0 conn(0x7f61800b5ea0 0x7f6180140860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:12.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f617ffff700 1 --2- 172.21.15.62:0/4106154731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f61800682c0 0x7f6180140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:20:12.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f61852a6700 1 --2- 172.21.15.62:0/4106154731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800afdf0 0x7f61800b0280 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f61780032f0 tx=0x7f617800b530).ready entity=mon.0 client_cookie=d371e80468aac82e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:12.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f617f7fe700 1 -- 172.21.15.62:0/4106154731 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f617800be70 con 0x7f61800afdf0 2021-12-17T18:20:12.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f617f7fe700 1 -- 172.21.15.62:0/4106154731 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6178010470 con 0x7f61800afdf0 2021-12-17T18:20:12.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f617f7fe700 1 -- 172.21.15.62:0/4106154731 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61780107d0 con 0x7f61800afdf0 2021-12-17T18:20:12.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6185aa7700 1 -- 172.21.15.62:0/4106154731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800afdf0 msgr2=0x7f61800b0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:12.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6185aa7700 1 --2- 172.21.15.62:0/4106154731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800afdf0 0x7f61800b0280 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f61780032f0 tx=0x7f617800b530).stop 2021-12-17T18:20:12.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6185aa7700 1 -- 172.21.15.62:0/4106154731 shutdown_connections 2021-12-17T18:20:12.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6185aa7700 1 --2- 172.21.15.62:0/4106154731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800afdf0 0x7f61800b0280 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6185aa7700 1 --2- 172.21.15.62:0/4106154731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f61800682c0 0x7f6180140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6185aa7700 1 --2- 172.21.15.62:0/4106154731 >> v2:172.21.15.109:3300/0 conn(0x7f61800b5ea0 0x7f6180140860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6185aa7700 1 -- 172.21.15.62:0/4106154731 >> 172.21.15.62:0/4106154731 conn(0x7f618005d220 msgr2=0x7f61800b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:12.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6185aa7700 1 -- 172.21.15.62:0/4106154731 shutdown_connections 2021-12-17T18:20:12.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.158+0000 7f6185aa7700 1 -- 172.21.15.62:0/4106154731 wait complete. 2021-12-17T18:20:12.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f6185aa7700 1 Processor -- start 2021-12-17T18:20:12.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f6185aa7700 1 -- start start 2021-12-17T18:20:12.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f6185aa7700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f61800682c0 0x7f6180153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:12.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f6185aa7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800afdf0 0x7f618013fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:12.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f6185aa7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f61800b5ea0 0x7f61800a8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:12.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f6185aa7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6180152560 con 0x7f61800afdf0 2021-12-17T18:20:12.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f6185aa7700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6180143820 con 0x7f61800682c0 2021-12-17T18:20:12.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f6185aa7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61800b3f10 con 0x7f61800b5ea0 2021-12-17T18:20:12.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f617ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800afdf0 0x7f618013fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:12.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f617ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800afdf0 0x7f618013fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49780/0 (socket says 172.21.15.62:49780) 2021-12-17T18:20:12.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f617ffff700 1 -- 172.21.15.62:0/929111229 learned_addr learned my addr 172.21.15.62:0/929111229 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:12.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f61852a6700 1 --2- 172.21.15.62:0/929111229 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f61800b5ea0 0x7f61800a8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:12.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f6184aa5700 1 --2- 172.21.15.62:0/929111229 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f61800682c0 0x7f6180153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:12.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f617ffff700 1 -- 172.21.15.62:0/929111229 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f61800b5ea0 msgr2=0x7f61800a8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:12.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f617ffff700 1 --2- 172.21.15.62:0/929111229 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f61800b5ea0 0x7f61800a8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f617ffff700 1 -- 172.21.15.62:0/929111229 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f61800682c0 msgr2=0x7f6180153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:12.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f617ffff700 1 --2- 172.21.15.62:0/929111229 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f61800682c0 0x7f6180153120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f617ffff700 1 -- 172.21.15.62:0/929111229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617800b7d0 con 0x7f61800afdf0 2021-12-17T18:20:12.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f617ffff700 1 --2- 172.21.15.62:0/929111229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800afdf0 0x7f618013fc60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f616c007000 tx=0x7f616c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:12.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.162+0000 7f617dffb700 1 -- 172.21.15.62:0/929111229 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f616c010580 con 0x7f61800afdf0 2021-12-17T18:20:12.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.166+0000 7f617dffb700 1 -- 172.21.15.62:0/929111229 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616c0106e0 con 0x7f61800afdf0 2021-12-17T18:20:12.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.166+0000 7f617dffb700 1 -- 172.21.15.62:0/929111229 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f616c010a40 con 0x7f61800afdf0 2021-12-17T18:20:12.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.166+0000 7f6185aa7700 1 -- 172.21.15.62:0/929111229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6180143fb0 con 0x7f61800afdf0 2021-12-17T18:20:12.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.166+0000 7f6185aa7700 1 -- 172.21.15.62:0/929111229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61800a86f0 con 0x7f61800afdf0 2021-12-17T18:20:12.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.166+0000 7f6185aa7700 1 -- 172.21.15.62:0/929111229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61800acbd0 con 0x7f61800afdf0 2021-12-17T18:20:12.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.166+0000 7f617dffb700 1 -- 172.21.15.62:0/929111229 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f616c010ba0 con 0x7f61800afdf0 2021-12-17T18:20:12.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.166+0000 7f617dffb700 1 --2- 172.21.15.62:0/929111229 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6160053610 0x7f6160055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:12.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.166+0000 7f617dffb700 1 -- 172.21.15.62:0/929111229 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f616c06b6c0 con 0x7f61800afdf0 2021-12-17T18:20:12.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.166+0000 7f6184aa5700 1 --2- 172.21.15.62:0/929111229 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6160053610 0x7f6160055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:12.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.170+0000 7f6184aa5700 1 --2- 172.21.15.62:0/929111229 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6160053610 0x7f6160055ad0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f617400c000 tx=0x7f6174008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:12.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.174+0000 7f617dffb700 1 -- 172.21.15.62:0/929111229 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f616c042aa0 con 0x7f61800afdf0 2021-12-17T18:20:12.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.338+0000 7f6185aa7700 1 -- 172.21.15.62:0/929111229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61800573d0 con 0x7f61800afdf0 2021-12-17T18:20:12.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.338+0000 7f617dffb700 1 -- 172.21.15.62:0/929111229 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+1211 (secure 0 0 0) 0x7f616c0460c0 con 0x7f61800afdf0 2021-12-17T18:20:12.344 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:12.345 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3762456539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3762456539},{"type":"v1","addr":"172.21.15.109:6835","nonce":3762456539}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":12},{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4093989719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4093989719},{"type":"v1","addr":"172.21.15.62:6833","nonce":4093989719}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[]} 2021-12-17T18:20:12.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.338+0000 7f6185aa7700 1 -- 172.21.15.62:0/929111229 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6160053610 msgr2=0x7f6160055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:12.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.338+0000 7f6185aa7700 1 --2- 172.21.15.62:0/929111229 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6160053610 0x7f6160055ad0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f617400c000 tx=0x7f6174008040).stop 2021-12-17T18:20:12.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.338+0000 7f6185aa7700 1 -- 172.21.15.62:0/929111229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800afdf0 msgr2=0x7f618013fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:12.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.338+0000 7f6185aa7700 1 --2- 172.21.15.62:0/929111229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800afdf0 0x7f618013fc60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f616c007000 tx=0x7f616c008040).stop 2021-12-17T18:20:12.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.338+0000 7f6185aa7700 1 -- 172.21.15.62:0/929111229 shutdown_connections 2021-12-17T18:20:12.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.338+0000 7f6185aa7700 1 --2- 172.21.15.62:0/929111229 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6160053610 0x7f6160055ad0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.338+0000 7f6185aa7700 1 --2- 172.21.15.62:0/929111229 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f61800b5ea0 0x7f61800a8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.338+0000 7f6185aa7700 1 --2- 172.21.15.62:0/929111229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800afdf0 0x7f618013fc60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.338+0000 7f6185aa7700 1 --2- 172.21.15.62:0/929111229 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f61800682c0 0x7f6180153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.338+0000 7f6185aa7700 1 -- 172.21.15.62:0/929111229 >> 172.21.15.62:0/929111229 conn(0x7f618005d220 msgr2=0x7f61800ab5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:12.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.338+0000 7f6185aa7700 1 -- 172.21.15.62:0/929111229 shutdown_connections 2021-12-17T18:20:12.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.338+0000 7f6185aa7700 1 -- 172.21.15.62:0/929111229 wait complete. 2021-12-17T18:20:12.349 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 12 2021-12-17T18:20:12.358 INFO:tasks.ceph.mds.a:Restarting daemon 2021-12-17T18:20:12.358 INFO:tasks.ceph.mds.a:Stopping old one... 2021-12-17T18:20:12.359 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-12-17T18:20:12.359 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:20:12.360 INFO:tasks.ceph.mds.b:Restarting daemon 2021-12-17T18:20:12.360 INFO:tasks.ceph.mds.b:Stopping old one... 2021-12-17T18:20:12.360 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-12-17T18:20:12.361 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:20:12.369 INFO:tasks.ceph.mds.a:Stopped 2021-12-17T18:20:12.369 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-12-17T18:20:12.372 INFO:tasks.ceph.mds.a:Started 2021-12-17T18:20:12.372 DEBUG:teuthology.parallel:result is None 2021-12-17T18:20:12.376 INFO:tasks.ceph.mds.b:Stopped 2021-12-17T18:20:12.377 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-12-17T18:20:12.379 INFO:tasks.ceph.mds.b:Started 2021-12-17T18:20:12.380 DEBUG:teuthology.parallel:result is None 2021-12-17T18:20:12.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-12-17T18:20:12.435 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:20:12.448 INFO:tasks.ceph.mds.b.smithi109.stdout:starting mds.b at 2021-12-17T18:20:12.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb78111c700 1 Processor -- start 2021-12-17T18:20:12.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb78111c700 1 -- start start 2021-12-17T18:20:12.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb78111c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb77c0b6160 0x7fb77c05c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:12.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb78111c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fb77c13efb0 0x7fb77c13f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:12.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb78111c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77c0b6540 con 0x7fb77c0ad2d0 2021-12-17T18:20:12.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb78111c700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77c0b2420 con 0x7fb77c13efb0 2021-12-17T18:20:12.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb78111c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c1402e0 con 0x7fb77c0b6160 2021-12-17T18:20:12.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb77ad9d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb77c0b6160 0x7fb77c05c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:12.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb77a59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb77c0ad2d0 0x7fb77c140780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33380/0 (socket says 172.21.15.62:33380) 2021-12-17T18:20:12.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb77a59c700 1 -- 172.21.15.62:0/2737689086 learned_addr learned my addr 172.21.15.62:0/2737689086 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:12.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb77b59e700 1 --2- 172.21.15.62:0/2737689086 >> v2:172.21.15.109:3300/0 conn(0x7fb77c13efb0 0x7fb77c13f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:12.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb77ad9d700 1 -- 172.21.15.62:0/2737689086 >> v2:172.21.15.109:3300/0 conn(0x7fb77c13efb0 msgr2=0x7fb77c13f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:12.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb77ad9d700 1 --2- 172.21.15.62:0/2737689086 >> v2:172.21.15.109:3300/0 conn(0x7fb77c13efb0 0x7fb77c13f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb77ad9d700 1 -- 172.21.15.62:0/2737689086 >> v1:172.21.15.62:6789/0 conn(0x7fb77c0ad2d0 legacy=0x7fb77c140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:12.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb77ad9d700 1 -- 172.21.15.62:0/2737689086 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c0b2110 con 0x7fb77c0b6160 2021-12-17T18:20:12.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb77ad9d700 1 --2- 172.21.15.62:0/2737689086 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb77c0b6160 0x7fb77c05c020 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb76c002f70 tx=0x7fb76c006df0).ready entity=mon.2 client_cookie=a52be9c53753955 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:12.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb779d9b700 1 -- 172.21.15.62:0/2737689086 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb76c00d570 con 0x7fb77c0b6160 2021-12-17T18:20:12.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb779d9b700 1 -- 172.21.15.62:0/2737689086 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c000e90 con 0x7fb77c0b6160 2021-12-17T18:20:12.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.486+0000 7fb779d9b700 1 -- 172.21.15.62:0/2737689086 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb76c00d8c0 con 0x7fb77c0b6160 2021-12-17T18:20:12.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb78111c700 1 -- 172.21.15.62:0/2737689086 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb77c0b6160 msgr2=0x7fb77c05c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:12.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb78111c700 1 --2- 172.21.15.62:0/2737689086 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb77c0b6160 0x7fb77c05c020 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb76c002f70 tx=0x7fb76c006df0).stop 2021-12-17T18:20:12.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb78111c700 1 -- 172.21.15.62:0/2737689086 shutdown_connections 2021-12-17T18:20:12.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb78111c700 1 --2- 172.21.15.62:0/2737689086 >> v2:172.21.15.109:3300/0 conn(0x7fb77c13efb0 0x7fb77c13f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb78111c700 1 --2- 172.21.15.62:0/2737689086 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb77c0b6160 0x7fb77c05c020 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb78111c700 1 -- 172.21.15.62:0/2737689086 >> 172.21.15.62:0/2737689086 conn(0x7fb77c05c750 msgr2=0x7fb77c0630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:12.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb78111c700 1 -- 172.21.15.62:0/2737689086 shutdown_connections 2021-12-17T18:20:12.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb78111c700 1 -- 172.21.15.62:0/2737689086 wait complete. 2021-12-17T18:20:12.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb78111c700 1 Processor -- start 2021-12-17T18:20:12.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb78111c700 1 -- start start 2021-12-17T18:20:12.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb78111c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb77c0ad2d0 0x7fb77c0b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:12.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb78111c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c0b6160 0x7fb77c150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:12.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb78111c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb77c13efb0 0x7fb77c13ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:12.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb78111c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c1508f0 con 0x7fb77c0b6160 2021-12-17T18:20:12.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb78111c700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c13d200 con 0x7fb77c0ad2d0 2021-12-17T18:20:12.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb78111c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c13d4a0 con 0x7fb77c13efb0 2021-12-17T18:20:12.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb77ad9d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb77c0ad2d0 0x7fb77c0b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:12.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb77b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb77c13efb0 0x7fb77c13ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:12.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb77a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c0b6160 0x7fb77c150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:12.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb77ad9d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb77c0ad2d0 0x7fb77c0b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:56354/0 (socket says 172.21.15.62:56354) 2021-12-17T18:20:12.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb77b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb77c13efb0 0x7fb77c13ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:43510/0 (socket says 172.21.15.62:43510) 2021-12-17T18:20:12.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb77ad9d700 1 -- 172.21.15.62:0/378240784 learned_addr learned my addr 172.21.15.62:0/378240784 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:12.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb77ad9d700 1 -- 172.21.15.62:0/378240784 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb77c13efb0 msgr2=0x7fb77c13ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:12.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb77ad9d700 1 --2- 172.21.15.62:0/378240784 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb77c13efb0 0x7fb77c13ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb77ad9d700 1 -- 172.21.15.62:0/378240784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c0b6160 msgr2=0x7fb77c150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:12.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.490+0000 7fb77ad9d700 1 --2- 172.21.15.62:0/378240784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c0b6160 0x7fb77c150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:12.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.494+0000 7fb77ad9d700 1 -- 172.21.15.62:0/378240784 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c00b180 con 0x7fb77c0ad2d0 2021-12-17T18:20:12.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.494+0000 7fb77b59e700 1 --2- 172.21.15.62:0/378240784 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb77c13efb0 0x7fb77c13ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:20:12.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.494+0000 7fb77ad9d700 1 --2- 172.21.15.62:0/378240784 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb77c0ad2d0 0x7fb77c0b3ca0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fb76c002f70 tx=0x7fb76c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:12.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.494+0000 7fb76bfff700 1 -- 172.21.15.62:0/378240784 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb76c00dea0 con 0x7fb77c0ad2d0 2021-12-17T18:20:12.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.494+0000 7fb76bfff700 1 -- 172.21.15.62:0/378240784 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c013de0 con 0x7fb77c0ad2d0 2021-12-17T18:20:12.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.494+0000 7fb78111c700 1 -- 172.21.15.62:0/378240784 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c1539c0 con 0x7fb77c0ad2d0 2021-12-17T18:20:12.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.494+0000 7fb76bfff700 1 -- 172.21.15.62:0/378240784 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb76c01e5f0 con 0x7fb77c0ad2d0 2021-12-17T18:20:12.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.494+0000 7fb78111c700 1 -- 172.21.15.62:0/378240784 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c13e330 con 0x7fb77c0ad2d0 2021-12-17T18:20:12.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.494+0000 7fb76bfff700 1 -- 172.21.15.62:0/378240784 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb76c025030 con 0x7fb77c0ad2d0 2021-12-17T18:20:12.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.494+0000 7fb78111c700 1 -- 172.21.15.62:0/378240784 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77c153b80 con 0x7fb77c0ad2d0 2021-12-17T18:20:12.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.494+0000 7fb76bfff700 1 --2- 172.21.15.62:0/378240784 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb758053610 0x7fb758055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:12.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.494+0000 7fb76bfff700 1 -- 172.21.15.62:0/378240784 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fb76c06c320 con 0x7fb77c0ad2d0 2021-12-17T18:20:12.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.494+0000 7fb77a59c700 1 --2- 172.21.15.62:0/378240784 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb758053610 0x7fb758055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:12.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.494+0000 7fb77a59c700 1 --2- 172.21.15.62:0/378240784 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb758053610 0x7fb758055ad0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fb77000d000 tx=0x7fb770009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:12.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.498+0000 7fb76bfff700 1 -- 172.21.15.62:0/378240784 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb76c043650 con 0x7fb77c0ad2d0 2021-12-17T18:20:12.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:12.638+0000 7fb78111c700 1 -- 172.21.15.62:0/378240784 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fb77c140e90 con 0x7fb77c0ad2d0 2021-12-17T18:20:13.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.578+0000 7fb76bfff700 1 -- 172.21.15.62:0/378240784 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v38) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb76c023020 con 0x7fb77c0ad2d0 2021-12-17T18:20:13.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.582+0000 7fb78111c700 1 -- 172.21.15.62:0/378240784 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb758053610 msgr2=0x7fb758055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:13.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.582+0000 7fb78111c700 1 --2- 172.21.15.62:0/378240784 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb758053610 0x7fb758055ad0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fb77000d000 tx=0x7fb770009040).stop 2021-12-17T18:20:13.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.582+0000 7fb78111c700 1 -- 172.21.15.62:0/378240784 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb77c0ad2d0 msgr2=0x7fb77c0b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:13.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.582+0000 7fb78111c700 1 --2- 172.21.15.62:0/378240784 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb77c0ad2d0 0x7fb77c0b3ca0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fb76c002f70 tx=0x7fb76c014000).stop 2021-12-17T18:20:13.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.582+0000 7fb78111c700 1 -- 172.21.15.62:0/378240784 shutdown_connections 2021-12-17T18:20:13.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.582+0000 7fb78111c700 1 --2- 172.21.15.62:0/378240784 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb758053610 0x7fb758055ad0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:13.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.582+0000 7fb78111c700 1 --2- 172.21.15.62:0/378240784 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb77c13efb0 0x7fb77c13ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:13.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.582+0000 7fb78111c700 1 --2- 172.21.15.62:0/378240784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c0b6160 0x7fb77c150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:13.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.582+0000 7fb78111c700 1 --2- 172.21.15.62:0/378240784 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb77c0ad2d0 0x7fb77c0b3ca0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:13.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.582+0000 7fb78111c700 1 -- 172.21.15.62:0/378240784 >> 172.21.15.62:0/378240784 conn(0x7fb77c05c750 msgr2=0x7fb77c063040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:13.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.582+0000 7fb78111c700 1 -- 172.21.15.62:0/378240784 shutdown_connections 2021-12-17T18:20:13.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.582+0000 7fb78111c700 1 -- 172.21.15.62:0/378240784 wait complete. 2021-12-17T18:20:13.590 INFO:teuthology.orchestra.run.smithi062.stderr: removed all blacklist entries 2021-12-17T18:20:13.603 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-12-17T18:20:13.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-12-17T18:20:13.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.710+0000 7f08262f0700 1 Processor -- start 2021-12-17T18:20:13.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f08262f0700 1 -- start start 2021-12-17T18:20:13.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f08262f0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b3eb0 0x7f0820145110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:13.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f08262f0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08200b27c0 con 0x7f08201406a0 2021-12-17T18:20:13.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f08262f0700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0820144730 con 0x7f0820067770 2021-12-17T18:20:13.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f08262f0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08201449d0 con 0x7f08200b3eb0 2021-12-17T18:20:13.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f082488d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f08201406a0 0x7f0820140b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33396/0 (socket says 172.21.15.62:33396) 2021-12-17T18:20:13.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f082488d700 1 -- 172.21.15.62:0/59542473 learned_addr learned my addr 172.21.15.62:0/59542473 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:13.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f081ffff700 1 --2- 172.21.15.62:0/59542473 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b3eb0 0x7f0820145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:13.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f081f7fe700 1 -- 172.21.15.62:0/59542473 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233233371 0 0) 0x7f08200b27c0 con 0x7f08201406a0 2021-12-17T18:20:13.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f081f7fe700 1 -- 172.21.15.62:0/59542473 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0800003260 con 0x7f08201406a0 2021-12-17T18:20:13.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f081f7fe700 1 -- 172.21.15.62:0/59542473 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272500386 0 0) 0x7f0820144730 con 0x7f0820067770 2021-12-17T18:20:13.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f081f7fe700 1 -- 172.21.15.62:0/59542473 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08200b27c0 con 0x7f0820067770 2021-12-17T18:20:13.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f081ffff700 1 -- 172.21.15.62:0/59542473 >> v1:172.21.15.109:6789/0 conn(0x7f0820067770 legacy=0x7f08200b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:13.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f081ffff700 1 -- 172.21.15.62:0/59542473 >> v1:172.21.15.62:6789/0 conn(0x7f08201406a0 legacy=0x7f0820140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:13.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f081ffff700 1 -- 172.21.15.62:0/59542473 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0820144c70 con 0x7f08200b3eb0 2021-12-17T18:20:13.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f081ffff700 1 --2- 172.21.15.62:0/59542473 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b3eb0 0x7f0820145110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0810002f70 tx=0x7f0810006df0).ready entity=mon.2 client_cookie=8c425f8a8215d8f3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:13.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f081f7fe700 1 -- 172.21.15.62:0/59542473 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f081000d5c0 con 0x7f08200b3eb0 2021-12-17T18:20:13.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f081f7fe700 1 -- 172.21.15.62:0/59542473 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0810000e90 con 0x7f08200b3eb0 2021-12-17T18:20:13.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.714+0000 7f081f7fe700 1 -- 172.21.15.62:0/59542473 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f081000d910 con 0x7f08200b3eb0 2021-12-17T18:20:13.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.718+0000 7f08262f0700 1 -- 172.21.15.62:0/59542473 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b3eb0 msgr2=0x7f0820145110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:13.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.718+0000 7f08262f0700 1 --2- 172.21.15.62:0/59542473 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b3eb0 0x7f0820145110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0810002f70 tx=0x7f0810006df0).stop 2021-12-17T18:20:13.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.718+0000 7f08262f0700 1 -- 172.21.15.62:0/59542473 shutdown_connections 2021-12-17T18:20:13.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.718+0000 7f08262f0700 1 --2- 172.21.15.62:0/59542473 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b3eb0 0x7f0820145110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:13.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.718+0000 7f08262f0700 1 -- 172.21.15.62:0/59542473 >> 172.21.15.62:0/59542473 conn(0x7f082005cb40 msgr2=0x7f082005cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:13.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.718+0000 7f08262f0700 1 -- 172.21.15.62:0/59542473 shutdown_connections 2021-12-17T18:20:13.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.718+0000 7f08262f0700 1 -- 172.21.15.62:0/59542473 wait complete. 2021-12-17T18:20:13.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.718+0000 7f08262f0700 1 Processor -- start 2021-12-17T18:20:13.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.718+0000 7f08262f0700 1 -- start start 2021-12-17T18:20:13.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f08262f0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0820067770 0x7f08200aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:13.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f08262f0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b3eb0 0x7f082009ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:13.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f08262f0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08201406a0 0x7f08200add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:13.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f08262f0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08200afce0 con 0x7f08201406a0 2021-12-17T18:20:13.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f08262f0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08200b0030 con 0x7f0820067770 2021-12-17T18:20:13.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f08262f0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08200af0a0 con 0x7f08200b3eb0 2021-12-17T18:20:13.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f082488d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08201406a0 0x7f08200add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:13.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f081ffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0820067770 0x7f08200aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:13.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f082488d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08201406a0 0x7f08200add70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49822/0 (socket says 172.21.15.62:49822) 2021-12-17T18:20:13.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f081ffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0820067770 0x7f08200aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:56368/0 (socket says 172.21.15.62:56368) 2021-12-17T18:20:13.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f081ffff700 1 -- 172.21.15.62:0/4261130312 learned_addr learned my addr 172.21.15.62:0/4261130312 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:13.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f0817fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b3eb0 0x7f082009ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:13.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f081ffff700 1 -- 172.21.15.62:0/4261130312 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b3eb0 msgr2=0x7f082009ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:13.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f081ffff700 1 --2- 172.21.15.62:0/4261130312 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b3eb0 0x7f082009ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:13.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f081ffff700 1 -- 172.21.15.62:0/4261130312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08201406a0 msgr2=0x7f08200add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:13.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f081ffff700 1 --2- 172.21.15.62:0/4261130312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08201406a0 0x7f08200add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:13.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f081ffff700 1 -- 172.21.15.62:0/4261130312 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081000b180 con 0x7f0820067770 2021-12-17T18:20:13.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f082488d700 1 --2- 172.21.15.62:0/4261130312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08201406a0 0x7f08200add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:20:13.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f0817fff700 1 --2- 172.21.15.62:0/4261130312 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b3eb0 0x7f082009ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:20:13.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f081ffff700 1 --2- 172.21.15.62:0/4261130312 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0820067770 0x7f08200aebb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f0810002f70 tx=0x7f0810014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:13.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f081dffb700 1 -- 172.21.15.62:0/4261130312 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0810013de0 con 0x7f0820067770 2021-12-17T18:20:13.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f081dffb700 1 -- 172.21.15.62:0/4261130312 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081001e400 con 0x7f0820067770 2021-12-17T18:20:13.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f08262f0700 1 -- 172.21.15.62:0/4261130312 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08201514b0 con 0x7f0820067770 2021-12-17T18:20:13.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f081dffb700 1 -- 172.21.15.62:0/4261130312 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f081001e760 con 0x7f0820067770 2021-12-17T18:20:13.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.722+0000 7f08262f0700 1 -- 172.21.15.62:0/4261130312 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0820151730 con 0x7f0820067770 2021-12-17T18:20:13.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.726+0000 7f08262f0700 1 -- 172.21.15.62:0/4261130312 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08200b1af0 con 0x7f0820067770 2021-12-17T18:20:13.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.726+0000 7f081dffb700 1 -- 172.21.15.62:0/4261130312 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0810025030 con 0x7f0820067770 2021-12-17T18:20:13.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.726+0000 7f081dffb700 1 --2- 172.21.15.62:0/4261130312 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f08040536d0 0x7f0804055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:13.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.726+0000 7f081dffb700 1 -- 172.21.15.62:0/4261130312 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f081006c300 con 0x7f0820067770 2021-12-17T18:20:13.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.726+0000 7f0817fff700 1 --2- 172.21.15.62:0/4261130312 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f08040536d0 0x7f0804055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:13.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.726+0000 7f0817fff700 1 --2- 172.21.15.62:0/4261130312 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f08040536d0 0x7f0804055b90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f080800d000 tx=0x7f0808007a20).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:13.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.734+0000 7f081dffb700 1 -- 172.21.15.62:0/4261130312 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0810043680 con 0x7f0820067770 2021-12-17T18:20:13.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.906+0000 7f08262f0700 1 -- 172.21.15.62:0/4261130312 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f08200b0170 con 0x7f0820067770 2021-12-17T18:20:13.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.906+0000 7f081dffb700 1 -- 172.21.15.62:0/4261130312 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f0810023020 con 0x7f0820067770 2021-12-17T18:20:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:13.914 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:20:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_dump": [ 2021-12-17T18:20:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.a", 2021-12-17T18:20:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhxCS0LBAAtUlkgWYg4l3fQ2au7jMUDg==", 2021-12-17T18:20:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:20:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:20:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:20:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:20:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:20:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.b", 2021-12-17T18:20:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhoRJAMxAAP/NmDQRwJjYip2rxJsQlYg==", 2021-12-17T18:20:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:20:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:20:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:20:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:20:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:20:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.0", 2021-12-17T18:20:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBA1LxhJXzhKhAAUnxP3G5VuATkQLoDALFjVg==", 2021-12-17T18:20:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:20:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:20:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:20:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:20:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:13.922 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:13.922 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:13.922 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.1", 2021-12-17T18:20:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBD1LxhregUDhAABrxQ2jQ4BwXvuWh/D9SkbQ==", 2021-12-17T18:20:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:20:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:20:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:20:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:20:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.2", 2021-12-17T18:20:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBF1LxhOo/SLhAAhQQLW/VKFx1sgm8chnD5tw==", 2021-12-17T18:20:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:20:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:20:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:20:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:20:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.3", 2021-12-17T18:20:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBI1LxhT2ZQExAA999j8V5bJAJ2PuaQqSkUOw==", 2021-12-17T18:20:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:20:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:20:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:20:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:20:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.4", 2021-12-17T18:20:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBN1LxhKBDzFhAAKmPF0FXnnfXtweo+6z9nxg==", 2021-12-17T18:20:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:20:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:20:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:20:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:20:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.5", 2021-12-17T18:20:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBP1LxhtqkAORAAVaFLVNIUMs4Sytk8WRaGNA==", 2021-12-17T18:20:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:20:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:20:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:20:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:20:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.6", 2021-12-17T18:20:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBS1LxhNtncGhAAgG64g1ie54CDp9Y7uldKQA==", 2021-12-17T18:20:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:20:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:20:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:20:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:20:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.7", 2021-12-17T18:20:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBV1Lxh3DcDABAAHVskSVtoEJ8BxCCAs3ZDVA==", 2021-12-17T18:20:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:20:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:20:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:20:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:20:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.0", 2021-12-17T18:20:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxh9QhCNxAALkWTJorDpbt9yrikL7/NWg==", 2021-12-17T18:20:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:20:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:20:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:20:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:20:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.1", 2021-12-17T18:20:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxhxm52OxAAbqXVaqRDmt4Ezj9xyCEODQ==", 2021-12-17T18:20:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:20:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:20:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:20:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:20:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.2", 2021-12-17T18:20:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+1LxhXu08BBAATRcUAZvMNg9ou4PLszDtmA==", 2021-12-17T18:20:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:20:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:20:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:20:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:20:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.admin", 2021-12-17T18:20:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhyAGlDRAA2ggSG5yBBFbMgK2fCBk2mQ==", 2021-12-17T18:20:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:20:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:20:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:20:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:20:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:20:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.x", 2021-12-17T18:20:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhzvntKRAAFQlg69Z6d2nWX0GxSshsMw==", 2021-12-17T18:20:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:20:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:20:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:20:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:20:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.y", 2021-12-17T18:20:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhKdTGJRAArzUN3A1U5Efw0NG9Gw2Gcw==", 2021-12-17T18:20:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:20:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:20:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:20:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:20:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:13.950 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:20:13.950 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:20:13.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.910+0000 7f08262f0700 1 -- 172.21.15.62:0/4261130312 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f08040536d0 msgr2=0x7f0804055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:13.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.910+0000 7f08262f0700 1 --2- 172.21.15.62:0/4261130312 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f08040536d0 0x7f0804055b90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f080800d000 tx=0x7f0808007a20).stop 2021-12-17T18:20:13.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.910+0000 7f08262f0700 1 -- 172.21.15.62:0/4261130312 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0820067770 msgr2=0x7f08200aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:13.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.910+0000 7f08262f0700 1 --2- 172.21.15.62:0/4261130312 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0820067770 0x7f08200aebb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f0810002f70 tx=0x7f0810014000).stop 2021-12-17T18:20:13.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.910+0000 7f08262f0700 1 -- 172.21.15.62:0/4261130312 shutdown_connections 2021-12-17T18:20:13.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.910+0000 7f08262f0700 1 --2- 172.21.15.62:0/4261130312 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f08040536d0 0x7f0804055b90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:13.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.910+0000 7f08262f0700 1 --2- 172.21.15.62:0/4261130312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08201406a0 0x7f08200add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:13.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.910+0000 7f08262f0700 1 --2- 172.21.15.62:0/4261130312 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b3eb0 0x7f082009ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:13.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.910+0000 7f08262f0700 1 --2- 172.21.15.62:0/4261130312 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0820067770 0x7f08200aebb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:13.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.910+0000 7f08262f0700 1 -- 172.21.15.62:0/4261130312 >> 172.21.15.62:0/4261130312 conn(0x7f082005cb40 msgr2=0x7f082013db80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:13.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.910+0000 7f08262f0700 1 -- 172.21.15.62:0/4261130312 shutdown_connections 2021-12-17T18:20:13.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:13.910+0000 7f08262f0700 1 -- 172.21.15.62:0/4261130312 wait complete. 2021-12-17T18:20:13.955 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:20:14.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88e5a41700 1 Processor -- start 2021-12-17T18:20:14.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88e5a41700 1 -- start start 2021-12-17T18:20:14.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88e5a41700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f88e00b3760 0x7f88e00b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88e5a41700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88e01458d0 0x7f88e0145d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88e5a41700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e00b5f00 con 0x7f88e00b5b20 2021-12-17T18:20:14.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88e5a41700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e00b3020 con 0x7f88e00b3760 2021-12-17T18:20:14.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88e5a41700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00b32c0 con 0x7f88e01458d0 2021-12-17T18:20:14.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88dffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f88e00b3760 0x7f88e00b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88dffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f88e00b3760 0x7f88e00b69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49828/0 (socket says 172.21.15.62:49828) 2021-12-17T18:20:14.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88dffff700 1 -- 172.21.15.62:0/3375387793 learned_addr learned my addr 172.21.15.62:0/3375387793 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:14.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88e5240700 1 --2- 172.21.15.62:0/3375387793 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88e01458d0 0x7f88e0145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88dffff700 1 -- 172.21.15.62:0/3375387793 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88e01458d0 msgr2=0x7f88e0145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:14.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88dffff700 1 --2- 172.21.15.62:0/3375387793 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88e01458d0 0x7f88e0145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88dffff700 1 -- 172.21.15.62:0/3375387793 >> v1:172.21.15.109:6789/0 conn(0x7f88e00b5b20 legacy=0x7f88e00b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88dffff700 1 -- 172.21.15.62:0/3375387793 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e00b6e90 con 0x7f88e00b3760 2021-12-17T18:20:14.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88dffff700 1 --2- 172.21.15.62:0/3375387793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88e00b3760 0x7f88e00b69a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f88cc002f70 tx=0x7f88cc006eb0).ready entity=mon.0 client_cookie=d7d73850860ae6a8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:14.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88df7fe700 1 -- 172.21.15.62:0/3375387793 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88cc00d5c0 con 0x7f88e00b3760 2021-12-17T18:20:14.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88df7fe700 1 -- 172.21.15.62:0/3375387793 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88cc000e90 con 0x7f88e00b3760 2021-12-17T18:20:14.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88df7fe700 1 -- 172.21.15.62:0/3375387793 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88cc00d950 con 0x7f88e00b3760 2021-12-17T18:20:14.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88e5a41700 1 -- 172.21.15.62:0/3375387793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88e00b3760 msgr2=0x7f88e00b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88e5a41700 1 --2- 172.21.15.62:0/3375387793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88e00b3760 0x7f88e00b69a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f88cc002f70 tx=0x7f88cc006eb0).stop 2021-12-17T18:20:14.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88e5a41700 1 -- 172.21.15.62:0/3375387793 shutdown_connections 2021-12-17T18:20:14.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88e5a41700 1 --2- 172.21.15.62:0/3375387793 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88e01458d0 0x7f88e0145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88e5a41700 1 --2- 172.21.15.62:0/3375387793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88e00b3760 0x7f88e00b69a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88e5a41700 1 -- 172.21.15.62:0/3375387793 >> 172.21.15.62:0/3375387793 conn(0x7f88e005c750 msgr2=0x7f88e005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:14.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88e5a41700 1 -- 172.21.15.62:0/3375387793 shutdown_connections 2021-12-17T18:20:14.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.058+0000 7f88e5a41700 1 -- 172.21.15.62:0/3375387793 wait complete. 2021-12-17T18:20:14.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5a41700 1 Processor -- start 2021-12-17T18:20:14.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5a41700 1 -- start start 2021-12-17T18:20:14.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5a41700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88e00b5b20 0x7f88e01492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5a41700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88e01458d0 0x7f88e0063b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5a41700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88e00ae1b0 0x7f88e0152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5a41700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00affb0 con 0x7f88e00ae1b0 2021-12-17T18:20:14.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5a41700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00ad9f0 con 0x7f88e01458d0 2021-12-17T18:20:14.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5a41700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00633f0 con 0x7f88e00b5b20 2021-12-17T18:20:14.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5240700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88e00ae1b0 0x7f88e0152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5240700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88e00ae1b0 0x7f88e0152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49834/0 (socket says 172.21.15.62:49834) 2021-12-17T18:20:14.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5240700 1 -- 172.21.15.62:0/2758383930 learned_addr learned my addr 172.21.15.62:0/2758383930 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:14.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88dffff700 1 --2- 172.21.15.62:0/2758383930 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88e01458d0 0x7f88e0063b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e4a3f700 1 --2- 172.21.15.62:0/2758383930 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88e00b5b20 0x7f88e01492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5240700 1 -- 172.21.15.62:0/2758383930 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88e00b5b20 msgr2=0x7f88e01492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5240700 1 --2- 172.21.15.62:0/2758383930 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88e00b5b20 0x7f88e01492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5240700 1 -- 172.21.15.62:0/2758383930 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88e01458d0 msgr2=0x7f88e0063b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5240700 1 --2- 172.21.15.62:0/2758383930 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88e01458d0 0x7f88e0063b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5240700 1 -- 172.21.15.62:0/2758383930 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc00b1e0 con 0x7f88e00ae1b0 2021-12-17T18:20:14.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5240700 1 --2- 172.21.15.62:0/2758383930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88e00ae1b0 0x7f88e0152590 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f88d800a000 tx=0x7f88d8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:14.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88ddffb700 1 -- 172.21.15.62:0/2758383930 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d80127e0 con 0x7f88e00ae1b0 2021-12-17T18:20:14.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88ddffb700 1 -- 172.21.15.62:0/2758383930 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d8012940 con 0x7f88e00ae1b0 2021-12-17T18:20:14.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5a41700 1 -- 172.21.15.62:0/2758383930 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e0063690 con 0x7f88e00ae1b0 2021-12-17T18:20:14.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88ddffb700 1 -- 172.21.15.62:0/2758383930 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d8012ca0 con 0x7f88e00ae1b0 2021-12-17T18:20:14.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5a41700 1 -- 172.21.15.62:0/2758383930 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e00ad670 con 0x7f88e00ae1b0 2021-12-17T18:20:14.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.062+0000 7f88e5a41700 1 -- 172.21.15.62:0/2758383930 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e00b2de0 con 0x7f88e00ae1b0 2021-12-17T18:20:14.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.066+0000 7f88ddffb700 1 -- 172.21.15.62:0/2758383930 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f88d8013480 con 0x7f88e00ae1b0 2021-12-17T18:20:14.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.066+0000 7f88ddffb700 1 --2- 172.21.15.62:0/2758383930 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88c0053610 0x7f88c0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.066+0000 7f88ddffb700 1 -- 172.21.15.62:0/2758383930 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f88d806bb00 con 0x7f88e00ae1b0 2021-12-17T18:20:14.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.066+0000 7f88e4a3f700 1 --2- 172.21.15.62:0/2758383930 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88c0053610 0x7f88c0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.066+0000 7f88e4a3f700 1 --2- 172.21.15.62:0/2758383930 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88c0053610 0x7f88c0055ad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f88d400b000 tx=0x7f88d4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:14.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.070+0000 7f88ddffb700 1 -- 172.21.15.62:0/2758383930 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f88e00b2de0 con 0x7f88e00ae1b0 2021-12-17T18:20:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.202+0000 7f88e5a41700 1 -- 172.21.15.62:0/2758383930 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88e00b2de0 con 0x7f88e00ae1b0 2021-12-17T18:20:14.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.202+0000 7f88ddffb700 1 -- 172.21.15.62:0/2758383930 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+13229 (secure 0 0 0) 0x7f88e00b2de0 con 0x7f88e00ae1b0 2021-12-17T18:20:14.209 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:14.209 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":38,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:20:13.574004+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:20:14.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.202+0000 7f88e5a41700 1 -- 172.21.15.62:0/2758383930 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88c0053610 msgr2=0x7f88c0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.202+0000 7f88e5a41700 1 --2- 172.21.15.62:0/2758383930 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88c0053610 0x7f88c0055ad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f88d400b000 tx=0x7f88d4009040).stop 2021-12-17T18:20:14.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.202+0000 7f88e5a41700 1 -- 172.21.15.62:0/2758383930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88e00ae1b0 msgr2=0x7f88e0152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.202+0000 7f88e5a41700 1 --2- 172.21.15.62:0/2758383930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88e00ae1b0 0x7f88e0152590 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f88d800a000 tx=0x7f88d8008040).stop 2021-12-17T18:20:14.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.202+0000 7f88e5a41700 1 -- 172.21.15.62:0/2758383930 shutdown_connections 2021-12-17T18:20:14.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.202+0000 7f88e5a41700 1 --2- 172.21.15.62:0/2758383930 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88c0053610 0x7f88c0055ad0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.206+0000 7f88e5a41700 1 --2- 172.21.15.62:0/2758383930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88e00ae1b0 0x7f88e0152590 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.206+0000 7f88e5a41700 1 --2- 172.21.15.62:0/2758383930 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88e01458d0 0x7f88e0063b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.206+0000 7f88e5a41700 1 --2- 172.21.15.62:0/2758383930 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88e00b5b20 0x7f88e01492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.206+0000 7f88e5a41700 1 -- 172.21.15.62:0/2758383930 >> 172.21.15.62:0/2758383930 conn(0x7f88e005c750 msgr2=0x7f88e0060210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:14.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.206+0000 7f88e5a41700 1 -- 172.21.15.62:0/2758383930 shutdown_connections 2021-12-17T18:20:14.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.206+0000 7f88e5a41700 1 -- 172.21.15.62:0/2758383930 wait complete. 2021-12-17T18:20:14.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-12-17T18:20:14.228 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:20:14.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecdaf0f700 1 Processor -- start 2021-12-17T18:20:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecdaf0f700 1 -- start start 2021-12-17T18:20:14.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecdaf0f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fecd40b6560 0x7fecd4065520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecdaf0f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd40ae3b0 con 0x7fecd4066930 2021-12-17T18:20:14.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecdaf0f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd4064930 con 0x7fecd40adfd0 2021-12-17T18:20:14.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecdaf0f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd4064bd0 con 0x7fecd40b6560 2021-12-17T18:20:14.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecd970c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fecd4066930 0x7fecd413f1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33420/0 (socket says 172.21.15.62:33420) 2021-12-17T18:20:14.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecd970c700 1 -- 172.21.15.62:0/2019172019 learned_addr learned my addr 172.21.15.62:0/2019172019 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:14.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecd9f0d700 1 --2- 172.21.15.62:0/2019172019 >> v2:172.21.15.109:3300/0 conn(0x7fecd40b6560 0x7fecd4065520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecd8f0b700 1 -- 172.21.15.62:0/2019172019 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440735846 0 0) 0x7fecd40ae3b0 con 0x7fecd4066930 2021-12-17T18:20:14.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecd8f0b700 1 -- 172.21.15.62:0/2019172019 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecbc003260 con 0x7fecd4066930 2021-12-17T18:20:14.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecd8f0b700 1 -- 172.21.15.62:0/2019172019 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347732458 0 0) 0x7fecd4064930 con 0x7fecd40adfd0 2021-12-17T18:20:14.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecd8f0b700 1 -- 172.21.15.62:0/2019172019 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecd40ae3b0 con 0x7fecd40adfd0 2021-12-17T18:20:14.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecd9f0d700 1 -- 172.21.15.62:0/2019172019 >> v1:172.21.15.109:6789/0 conn(0x7fecd40adfd0 legacy=0x7fecd40630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecd9f0d700 1 -- 172.21.15.62:0/2019172019 >> v1:172.21.15.62:6789/0 conn(0x7fecd4066930 legacy=0x7fecd413f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecd9f0d700 1 -- 172.21.15.62:0/2019172019 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd413f8b0 con 0x7fecd40b6560 2021-12-17T18:20:14.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecd9f0d700 1 --2- 172.21.15.62:0/2019172019 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fecd40b6560 0x7fecd4065520 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fecd0002f70 tx=0x7fecd0006df0).ready entity=mon.1 client_cookie=c935e6b7bea7f66c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:14.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecd8f0b700 1 -- 172.21.15.62:0/2019172019 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecd000d540 con 0x7fecd40b6560 2021-12-17T18:20:14.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecd8f0b700 1 -- 172.21.15.62:0/2019172019 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd0000e90 con 0x7fecd40b6560 2021-12-17T18:20:14.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.330+0000 7fecd8f0b700 1 -- 172.21.15.62:0/2019172019 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecd000d890 con 0x7fecd40b6560 2021-12-17T18:20:14.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.334+0000 7fecdaf0f700 1 -- 172.21.15.62:0/2019172019 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fecd40b6560 msgr2=0x7fecd4065520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.334+0000 7fecdaf0f700 1 --2- 172.21.15.62:0/2019172019 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fecd40b6560 0x7fecd4065520 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fecd0002f70 tx=0x7fecd0006df0).stop 2021-12-17T18:20:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.334+0000 7fecdaf0f700 1 -- 172.21.15.62:0/2019172019 shutdown_connections 2021-12-17T18:20:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.334+0000 7fecdaf0f700 1 --2- 172.21.15.62:0/2019172019 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fecd40b6560 0x7fecd4065520 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.334+0000 7fecdaf0f700 1 -- 172.21.15.62:0/2019172019 >> 172.21.15.62:0/2019172019 conn(0x7fecd405c750 msgr2=0x7fecd40b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:14.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.334+0000 7fecdaf0f700 1 -- 172.21.15.62:0/2019172019 shutdown_connections 2021-12-17T18:20:14.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.334+0000 7fecdaf0f700 1 -- 172.21.15.62:0/2019172019 wait complete. 2021-12-17T18:20:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.334+0000 7fecdaf0f700 1 Processor -- start 2021-12-17T18:20:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.334+0000 7fecdaf0f700 1 -- start start 2021-12-17T18:20:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecdaf0f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fecd4066930 0x7fecd405fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecdaf0f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fecd40adfd0 0x7fecd413d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecdaf0f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd40b6560 0x7fecd4153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecdaf0f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd413e4e0 con 0x7fecd40b6560 2021-12-17T18:20:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecdaf0f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4110f60 con 0x7fecd40adfd0 2021-12-17T18:20:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecdaf0f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd413d910 con 0x7fecd4066930 2021-12-17T18:20:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecda70e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd40b6560 0x7fecd4153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecda70e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd40b6560 0x7fecd4153b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49850/0 (socket says 172.21.15.62:49850) 2021-12-17T18:20:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecda70e700 1 -- 172.21.15.62:0/1443178185 learned_addr learned my addr 172.21.15.62:0/1443178185 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecd9f0d700 1 --2- 172.21.15.62:0/1443178185 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fecd4066930 0x7fecd405fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecd970c700 1 --2- 172.21.15.62:0/1443178185 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fecd40adfd0 0x7fecd413d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecda70e700 1 -- 172.21.15.62:0/1443178185 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fecd4066930 msgr2=0x7fecd405fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecda70e700 1 --2- 172.21.15.62:0/1443178185 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fecd4066930 0x7fecd405fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecda70e700 1 -- 172.21.15.62:0/1443178185 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fecd40adfd0 msgr2=0x7fecd413d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecda70e700 1 --2- 172.21.15.62:0/1443178185 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fecd40adfd0 0x7fecd413d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecda70e700 1 -- 172.21.15.62:0/1443178185 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd000b180 con 0x7fecd40b6560 2021-12-17T18:20:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecda70e700 1 --2- 172.21.15.62:0/1443178185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd40b6560 0x7fecd4153b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fecd41407d0 tx=0x7feccc007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecc6ffd700 1 -- 172.21.15.62:0/1443178185 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feccc002310 con 0x7fecd40b6560 2021-12-17T18:20:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecc6ffd700 1 -- 172.21.15.62:0/1443178185 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc002470 con 0x7fecd40b6560 2021-12-17T18:20:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecdaf0f700 1 -- 172.21.15.62:0/1443178185 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd4110cc0 con 0x7fecd40b6560 2021-12-17T18:20:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecc6ffd700 1 -- 172.21.15.62:0/1443178185 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feccc001840 con 0x7fecd40b6560 2021-12-17T18:20:14.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecdaf0f700 1 -- 172.21.15.62:0/1443178185 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd4063de0 con 0x7fecd40b6560 2021-12-17T18:20:14.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.338+0000 7fecc6ffd700 1 -- 172.21.15.62:0/1443178185 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feccc019020 con 0x7fecd40b6560 2021-12-17T18:20:14.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.342+0000 7fecdaf0f700 1 -- 172.21.15.62:0/1443178185 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd4063420 con 0x7fecd40b6560 2021-12-17T18:20:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.342+0000 7fecc6ffd700 1 --2- 172.21.15.62:0/1443178185 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fecb40536a0 0x7fecb4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.342+0000 7fecc6ffd700 1 -- 172.21.15.62:0/1443178185 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5253+0+0 (secure 0 0 0) 0x7feccc06b410 con 0x7fecd40b6560 2021-12-17T18:20:14.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.342+0000 7fecd9f0d700 1 --2- 172.21.15.62:0/1443178185 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fecb40536a0 0x7fecb4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.342+0000 7fecd9f0d700 1 --2- 172.21.15.62:0/1443178185 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fecb40536a0 0x7fecb4055b60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fecd0018000 tx=0x7fecd0014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:14.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.346+0000 7fecc6ffd700 1 -- 172.21.15.62:0/1443178185 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fecd4063420 con 0x7fecd40b6560 2021-12-17T18:20:14.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.474+0000 7fecdaf0f700 1 -- 172.21.15.62:0/1443178185 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fecd4064e70 con 0x7fecd40b6560 2021-12-17T18:20:14.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.474+0000 7fecc6ffd700 1 -- 172.21.15.62:0/1443178185 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v38) v1 ==== 110+0+10 (secure 0 0 0) 0x7fecd4064e70 con 0x7fecd40b6560 2021-12-17T18:20:14.482 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:20:14.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.478+0000 7fecdaf0f700 1 -- 172.21.15.62:0/1443178185 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fecb40536a0 msgr2=0x7fecb4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.478+0000 7fecdaf0f700 1 --2- 172.21.15.62:0/1443178185 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fecb40536a0 0x7fecb4055b60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fecd0018000 tx=0x7fecd0014000).stop 2021-12-17T18:20:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.478+0000 7fecdaf0f700 1 -- 172.21.15.62:0/1443178185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd40b6560 msgr2=0x7fecd4153b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.478+0000 7fecdaf0f700 1 --2- 172.21.15.62:0/1443178185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd40b6560 0x7fecd4153b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fecd41407d0 tx=0x7feccc007dd0).stop 2021-12-17T18:20:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.478+0000 7fecdaf0f700 1 -- 172.21.15.62:0/1443178185 shutdown_connections 2021-12-17T18:20:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.478+0000 7fecdaf0f700 1 --2- 172.21.15.62:0/1443178185 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fecb40536a0 0x7fecb4055b60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.478+0000 7fecdaf0f700 1 --2- 172.21.15.62:0/1443178185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd40b6560 0x7fecd4153b00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.478+0000 7fecdaf0f700 1 --2- 172.21.15.62:0/1443178185 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fecd40adfd0 0x7fecd413d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.478+0000 7fecdaf0f700 1 --2- 172.21.15.62:0/1443178185 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fecd4066930 0x7fecd405fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.478+0000 7fecdaf0f700 1 -- 172.21.15.62:0/1443178185 >> 172.21.15.62:0/1443178185 conn(0x7fecd405c750 msgr2=0x7fecd40b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.478+0000 7fecdaf0f700 1 -- 172.21.15.62:0/1443178185 shutdown_connections 2021-12-17T18:20:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.478+0000 7fecdaf0f700 1 -- 172.21.15.62:0/1443178185 wait complete. 2021-12-17T18:20:14.496 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:20:14.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f0228c2f700 1 Processor -- start 2021-12-17T18:20:14.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f0228c2f700 1 -- start start 2021-12-17T18:20:14.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f0228c2f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f02240b1010 0x7f0224143110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f0228c2f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02240af810 con 0x7f022405ce70 2021-12-17T18:20:14.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f0228c2f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02240afef0 con 0x7f02240adb90 2021-12-17T18:20:14.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f0228c2f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022413f320 con 0x7f02240b1010 2021-12-17T18:20:14.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f0222d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f02240b1010 0x7f0224143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f0222d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f02240b1010 0x7f0224143110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49858/0 (socket says 172.21.15.62:49858) 2021-12-17T18:20:14.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f0222d9d700 1 -- 172.21.15.62:0/3502663907 learned_addr learned my addr 172.21.15.62:0/3502663907 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:14.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f022259c700 1 --1- 172.21.15.62:0/3502663907 >> v1:172.21.15.62:6789/0 conn(0x7f022405ce70 0x7f0224142a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33436/0 (socket says 172.21.15.62:33436) 2021-12-17T18:20:14.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f022159a700 1 -- 172.21.15.62:0/3502663907 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553880220 0 0) 0x7f02140011d0 con 0x7f022405ce70 2021-12-17T18:20:14.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f0222d9d700 1 -- 172.21.15.62:0/3502663907 >> v1:172.21.15.109:6789/0 conn(0x7f02240adb90 legacy=0x7f022413e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f0222d9d700 1 -- 172.21.15.62:0/3502663907 >> v1:172.21.15.62:6789/0 conn(0x7f022405ce70 legacy=0x7f0224142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f0222d9d700 1 -- 172.21.15.62:0/3502663907 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022405d250 con 0x7f02240b1010 2021-12-17T18:20:14.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f0222d9d700 1 --2- 172.21.15.62:0/3502663907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02240b1010 0x7f0224143110 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f021c0032f0 tx=0x7f021c00b530).ready entity=mon.0 client_cookie=d6348bc5ceba2572 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f022159a700 1 -- 172.21.15.62:0/3502663907 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f021c010660 con 0x7f02240b1010 2021-12-17T18:20:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f022159a700 1 -- 172.21.15.62:0/3502663907 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021c0107c0 con 0x7f02240b1010 2021-12-17T18:20:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f022159a700 1 -- 172.21.15.62:0/3502663907 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f021c010b20 con 0x7f02240b1010 2021-12-17T18:20:14.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f0228c2f700 1 -- 172.21.15.62:0/3502663907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02240b1010 msgr2=0x7f0224143110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.594+0000 7f0228c2f700 1 --2- 172.21.15.62:0/3502663907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02240b1010 0x7f0224143110 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f021c0032f0 tx=0x7f021c00b530).stop 2021-12-17T18:20:14.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0228c2f700 1 -- 172.21.15.62:0/3502663907 shutdown_connections 2021-12-17T18:20:14.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0228c2f700 1 --2- 172.21.15.62:0/3502663907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02240b1010 0x7f0224143110 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0228c2f700 1 -- 172.21.15.62:0/3502663907 >> 172.21.15.62:0/3502663907 conn(0x7f022405c750 msgr2=0x7f0224062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0228c2f700 1 -- 172.21.15.62:0/3502663907 shutdown_connections 2021-12-17T18:20:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0228c2f700 1 -- 172.21.15.62:0/3502663907 wait complete. 2021-12-17T18:20:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0228c2f700 1 Processor -- start 2021-12-17T18:20:14.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0228c2f700 1 -- start start 2021-12-17T18:20:14.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0228c2f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f022405ce70 0x7f0224139ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0228c2f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f02240adb90 0x7f0224136d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0228c2f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02240b1010 0x7f022413ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0228c2f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0224066720 con 0x7f02240b1010 2021-12-17T18:20:14.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0228c2f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0224066e20 con 0x7f022405ce70 2021-12-17T18:20:14.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0228c2f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02240670c0 con 0x7f02240adb90 2021-12-17T18:20:14.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0222d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02240b1010 0x7f022413ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0222d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02240b1010 0x7f022413ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49864/0 (socket says 172.21.15.62:49864) 2021-12-17T18:20:14.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0222d9d700 1 -- 172.21.15.62:0/3603456864 learned_addr learned my addr 172.21.15.62:0/3603456864 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:14.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f022259c700 1 --2- 172.21.15.62:0/3603456864 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f022405ce70 0x7f0224139ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0221d9b700 1 --2- 172.21.15.62:0/3603456864 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f02240adb90 0x7f0224136d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0222d9d700 1 -- 172.21.15.62:0/3603456864 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f02240adb90 msgr2=0x7f0224136d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0222d9d700 1 --2- 172.21.15.62:0/3603456864 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f02240adb90 0x7f0224136d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0222d9d700 1 -- 172.21.15.62:0/3603456864 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f022405ce70 msgr2=0x7f0224139ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0222d9d700 1 --2- 172.21.15.62:0/3603456864 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f022405ce70 0x7f0224139ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0222d9d700 1 -- 172.21.15.62:0/3603456864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c00b7d0 con 0x7f02240b1010 2021-12-17T18:20:14.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f022259c700 1 --2- 172.21.15.62:0/3603456864 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f022405ce70 0x7f0224139ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:20:14.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.598+0000 7f0222d9d700 1 --2- 172.21.15.62:0/3603456864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02240b1010 0x7f022413ca40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f021c0032f0 tx=0x7f02240b0080).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:14.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.602+0000 7f021b7fe700 1 -- 172.21.15.62:0/3603456864 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f021c01d070 con 0x7f02240b1010 2021-12-17T18:20:14.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.602+0000 7f021b7fe700 1 -- 172.21.15.62:0/3603456864 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021c010470 con 0x7f02240b1010 2021-12-17T18:20:14.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.602+0000 7f021b7fe700 1 -- 172.21.15.62:0/3603456864 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f021c010b20 con 0x7f02240b1010 2021-12-17T18:20:14.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.602+0000 7f0228c2f700 1 -- 172.21.15.62:0/3603456864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02240663a0 con 0x7f02240b1010 2021-12-17T18:20:14.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.602+0000 7f0228c2f700 1 -- 172.21.15.62:0/3603456864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0224137230 con 0x7f02240b1010 2021-12-17T18:20:14.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.602+0000 7f0228c2f700 1 -- 172.21.15.62:0/3603456864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0224067280 con 0x7f02240b1010 2021-12-17T18:20:14.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.602+0000 7f021b7fe700 1 -- 172.21.15.62:0/3603456864 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f021c00f3d0 con 0x7f02240b1010 2021-12-17T18:20:14.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.602+0000 7f021b7fe700 1 --2- 172.21.15.62:0/3603456864 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f02080536d0 0x7f0208055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.602+0000 7f021b7fe700 1 -- 172.21.15.62:0/3603456864 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f021c06cdd0 con 0x7f02240b1010 2021-12-17T18:20:14.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.602+0000 7f022259c700 1 --2- 172.21.15.62:0/3603456864 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f02080536d0 0x7f0208055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.606+0000 7f022259c700 1 --2- 172.21.15.62:0/3603456864 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f02080536d0 0x7f0208055b90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f021400d000 tx=0x7f0214001790).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:14.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.610+0000 7f021b7fe700 1 -- 172.21.15.62:0/3603456864 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f021c0441b0 con 0x7f02240b1010 2021-12-17T18:20:14.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.734+0000 7f0228c2f700 1 -- 172.21.15.62:0/3603456864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f022413d0d0 con 0x7f02240b1010 2021-12-17T18:20:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.734+0000 7f021b7fe700 1 -- 172.21.15.62:0/3603456864 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7f021c0477d0 con 0x7f02240b1010 2021-12-17T18:20:14.743 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:20:14.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.738+0000 7f0228c2f700 1 -- 172.21.15.62:0/3603456864 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f02080536d0 msgr2=0x7f0208055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.738+0000 7f0228c2f700 1 --2- 172.21.15.62:0/3603456864 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f02080536d0 0x7f0208055b90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f021400d000 tx=0x7f0214001790).stop 2021-12-17T18:20:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.738+0000 7f0228c2f700 1 -- 172.21.15.62:0/3603456864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02240b1010 msgr2=0x7f022413ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.738+0000 7f0228c2f700 1 --2- 172.21.15.62:0/3603456864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02240b1010 0x7f022413ca40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f021c0032f0 tx=0x7f02240b0080).stop 2021-12-17T18:20:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.738+0000 7f0228c2f700 1 -- 172.21.15.62:0/3603456864 shutdown_connections 2021-12-17T18:20:14.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.738+0000 7f0228c2f700 1 --2- 172.21.15.62:0/3603456864 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f02080536d0 0x7f0208055b90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.738+0000 7f0228c2f700 1 --2- 172.21.15.62:0/3603456864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02240b1010 0x7f022413ca40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.738+0000 7f0228c2f700 1 --2- 172.21.15.62:0/3603456864 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f02240adb90 0x7f0224136d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.738+0000 7f0228c2f700 1 --2- 172.21.15.62:0/3603456864 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f022405ce70 0x7f0224139ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.738+0000 7f0228c2f700 1 -- 172.21.15.62:0/3603456864 >> 172.21.15.62:0/3603456864 conn(0x7f022405c750 msgr2=0x7f02240b5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:14.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.738+0000 7f0228c2f700 1 -- 172.21.15.62:0/3603456864 shutdown_connections 2021-12-17T18:20:14.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.738+0000 7f0228c2f700 1 -- 172.21.15.62:0/3603456864 wait complete. 2021-12-17T18:20:14.760 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-12-17T18:20:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.858+0000 7fc4ada42700 1 Processor -- start 2021-12-17T18:20:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.858+0000 7fc4ada42700 1 -- start start 2021-12-17T18:20:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.858+0000 7fc4ada42700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc4a81473c0 0x7fc4a805fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.858+0000 7fc4ada42700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc4a8060330 0x7fc4a80b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.858+0000 7fc4ada42700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a80af3a0 con 0x7fc4a80aefc0 2021-12-17T18:20:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.858+0000 7fc4ada42700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a80b4c80 con 0x7fc4a8060330 2021-12-17T18:20:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.858+0000 7fc4ada42700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a80b42a0 con 0x7fc4a81473c0 2021-12-17T18:20:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.858+0000 7fc4a6ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc4a80aefc0 0x7fc4a805f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33450/0 (socket says 172.21.15.62:33450) 2021-12-17T18:20:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.858+0000 7fc4a6ffd700 1 -- 172.21.15.62:0/2164891893 learned_addr learned my addr 172.21.15.62:0/2164891893 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.858+0000 7fc4a77fe700 1 --2- 172.21.15.62:0/2164891893 >> v2:172.21.15.109:3300/0 conn(0x7fc4a8060330 0x7fc4a80b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.858+0000 7fc4a67fc700 1 --2- 172.21.15.62:0/2164891893 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc4a81473c0 0x7fc4a805fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.858+0000 7fc4a5ffb700 1 -- 172.21.15.62:0/2164891893 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431375140 0 0) 0x7fc4a80af3a0 con 0x7fc4a80aefc0 2021-12-17T18:20:14.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.858+0000 7fc4a5ffb700 1 -- 172.21.15.62:0/2164891893 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc48c003260 con 0x7fc4a80aefc0 2021-12-17T18:20:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.858+0000 7fc4a77fe700 1 -- 172.21.15.62:0/2164891893 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc4a81473c0 msgr2=0x7fc4a805fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.858+0000 7fc4a77fe700 1 --2- 172.21.15.62:0/2164891893 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc4a81473c0 0x7fc4a805fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.858+0000 7fc4a77fe700 1 -- 172.21.15.62:0/2164891893 >> v1:172.21.15.62:6789/0 conn(0x7fc4a80aefc0 legacy=0x7fc4a805f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.858+0000 7fc4a77fe700 1 -- 172.21.15.62:0/2164891893 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a80b4540 con 0x7fc4a8060330 2021-12-17T18:20:14.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.862+0000 7fc4a77fe700 1 --2- 172.21.15.62:0/2164891893 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc4a8060330 0x7fc4a80b27e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc4a00032f0 tx=0x7fc4a00091d0).ready entity=mon.1 client_cookie=e5e9030f31ef4d4d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:14.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.862+0000 7fc4a5ffb700 1 -- 172.21.15.62:0/2164891893 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4a000b600 con 0x7fc4a8060330 2021-12-17T18:20:14.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.862+0000 7fc4a5ffb700 1 -- 172.21.15.62:0/2164891893 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a000b760 con 0x7fc4a8060330 2021-12-17T18:20:14.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.862+0000 7fc4a5ffb700 1 -- 172.21.15.62:0/2164891893 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4a000b8d0 con 0x7fc4a8060330 2021-12-17T18:20:14.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.862+0000 7fc4ada42700 1 -- 172.21.15.62:0/2164891893 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc4a8060330 msgr2=0x7fc4a80b27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.862+0000 7fc4ada42700 1 --2- 172.21.15.62:0/2164891893 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc4a8060330 0x7fc4a80b27e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc4a00032f0 tx=0x7fc4a00091d0).stop 2021-12-17T18:20:14.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.862+0000 7fc4ada42700 1 -- 172.21.15.62:0/2164891893 shutdown_connections 2021-12-17T18:20:14.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.862+0000 7fc4ada42700 1 --2- 172.21.15.62:0/2164891893 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc4a8060330 0x7fc4a80b27e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.862+0000 7fc4ada42700 1 --2- 172.21.15.62:0/2164891893 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc4a81473c0 0x7fc4a805fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.862+0000 7fc4ada42700 1 -- 172.21.15.62:0/2164891893 >> 172.21.15.62:0/2164891893 conn(0x7fc4a805cb40 msgr2=0x7fc4a805cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:14.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.862+0000 7fc4ada42700 1 -- 172.21.15.62:0/2164891893 shutdown_connections 2021-12-17T18:20:14.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.862+0000 7fc4ada42700 1 -- 172.21.15.62:0/2164891893 wait complete. 2021-12-17T18:20:14.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.862+0000 7fc4ada42700 1 Processor -- start 2021-12-17T18:20:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.862+0000 7fc4ada42700 1 -- start start 2021-12-17T18:20:14.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4ada42700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc4a8060330 0x7fc4a814a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4ada42700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc4a80aefc0 0x7fc4a8155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4ada42700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4a81473c0 0x7fc4a80667c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4ada42700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a8063ee0 con 0x7fc4a81473c0 2021-12-17T18:20:14.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4ada42700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a8064180 con 0x7fc4a8060330 2021-12-17T18:20:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4ada42700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a8064420 con 0x7fc4a80aefc0 2021-12-17T18:20:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4a77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4a81473c0 0x7fc4a80667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4a77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4a81473c0 0x7fc4a80667c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49878/0 (socket says 172.21.15.62:49878) 2021-12-17T18:20:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4a77fe700 1 -- 172.21.15.62:0/2285087899 learned_addr learned my addr 172.21.15.62:0/2285087899 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4a67fc700 1 --2- 172.21.15.62:0/2285087899 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc4a80aefc0 0x7fc4a8155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4a6ffd700 1 --2- 172.21.15.62:0/2285087899 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc4a8060330 0x7fc4a814a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4a77fe700 1 -- 172.21.15.62:0/2285087899 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc4a80aefc0 msgr2=0x7fc4a8155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4a77fe700 1 --2- 172.21.15.62:0/2285087899 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc4a80aefc0 0x7fc4a8155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4a77fe700 1 -- 172.21.15.62:0/2285087899 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc4a8060330 msgr2=0x7fc4a814a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:14.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4a77fe700 1 --2- 172.21.15.62:0/2285087899 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc4a8060330 0x7fc4a814a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:14.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4a77fe700 1 -- 172.21.15.62:0/2285087899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a0009470 con 0x7fc4a81473c0 2021-12-17T18:20:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4a77fe700 1 --2- 172.21.15.62:0/2285087899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4a81473c0 0x7fc4a80667c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fc4a00032f0 tx=0x7fc4a0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc497fff700 1 -- 172.21.15.62:0/2285087899 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4a000b8d0 con 0x7fc4a81473c0 2021-12-17T18:20:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc497fff700 1 -- 172.21.15.62:0/2285087899 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a0021630 con 0x7fc4a81473c0 2021-12-17T18:20:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4ada42700 1 -- 172.21.15.62:0/2285087899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a80ad750 con 0x7fc4a81473c0 2021-12-17T18:20:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc497fff700 1 -- 172.21.15.62:0/2285087899 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4a000b600 con 0x7fc4a81473c0 2021-12-17T18:20:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4ada42700 1 -- 172.21.15.62:0/2285087899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a80ae4c0 con 0x7fc4a81473c0 2021-12-17T18:20:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.866+0000 7fc4ada42700 1 -- 172.21.15.62:0/2285087899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a80b47e0 con 0x7fc4a81473c0 2021-12-17T18:20:14.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.870+0000 7fc497fff700 1 -- 172.21.15.62:0/2285087899 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc4a0027020 con 0x7fc4a81473c0 2021-12-17T18:20:14.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.870+0000 7fc497fff700 1 --2- 172.21.15.62:0/2285087899 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc484053610 0x7fc484055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:14.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.870+0000 7fc497fff700 1 -- 172.21.15.62:0/2285087899 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc4a006cbd0 con 0x7fc4a81473c0 2021-12-17T18:20:14.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.870+0000 7fc4a6ffd700 1 --2- 172.21.15.62:0/2285087899 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc484053610 0x7fc484055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:14.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.870+0000 7fc4a6ffd700 1 --2- 172.21.15.62:0/2285087899 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc484053610 0x7fc484055ad0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fc49c00d000 tx=0x7fc49c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:14.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:14.878+0000 7fc497fff700 1 -- 172.21.15.62:0/2285087899 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc4a0043f50 con 0x7fc4a81473c0 2021-12-17T18:20:15.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.002+0000 7fc4ada42700 1 -- 172.21.15.62:0/2285087899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc4a80573d0 con 0x7fc4a81473c0 2021-12-17T18:20:15.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.002+0000 7fc497fff700 1 -- 172.21.15.62:0/2285087899 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v38) v1 ==== 84+0+143 (secure 0 0 0) 0x7fc4a0015020 con 0x7fc4a81473c0 2021-12-17T18:20:15.009 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:15.010 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2021-12-17T18:20:15.010 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:15.010 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2021-12-17T18:20:15.010 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "device_health_metrics" 2021-12-17T18:20:15.011 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:15.011 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:20:15.011 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2021-12-17T18:20:15.011 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2021-12-17T18:20:15.012 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:15.012 INFO:teuthology.orchestra.run.smithi062.stdout:] 2021-12-17T18:20:15.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.006+0000 7fc4ada42700 1 -- 172.21.15.62:0/2285087899 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc484053610 msgr2=0x7fc484055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:15.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.006+0000 7fc4ada42700 1 --2- 172.21.15.62:0/2285087899 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc484053610 0x7fc484055ad0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fc49c00d000 tx=0x7fc49c009040).stop 2021-12-17T18:20:15.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.006+0000 7fc4ada42700 1 -- 172.21.15.62:0/2285087899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4a81473c0 msgr2=0x7fc4a80667c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:15.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.006+0000 7fc4ada42700 1 --2- 172.21.15.62:0/2285087899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4a81473c0 0x7fc4a80667c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fc4a00032f0 tx=0x7fc4a0016000).stop 2021-12-17T18:20:15.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.006+0000 7fc4ada42700 1 -- 172.21.15.62:0/2285087899 shutdown_connections 2021-12-17T18:20:15.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.006+0000 7fc4ada42700 1 --2- 172.21.15.62:0/2285087899 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc484053610 0x7fc484055ad0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:15.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.006+0000 7fc4ada42700 1 --2- 172.21.15.62:0/2285087899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4a81473c0 0x7fc4a80667c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:15.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.006+0000 7fc4ada42700 1 --2- 172.21.15.62:0/2285087899 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc4a80aefc0 0x7fc4a8155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:15.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.006+0000 7fc4ada42700 1 --2- 172.21.15.62:0/2285087899 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc4a8060330 0x7fc4a814a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:15.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.006+0000 7fc4ada42700 1 -- 172.21.15.62:0/2285087899 >> 172.21.15.62:0/2285087899 conn(0x7fc4a805cb40 msgr2=0x7fc4a8146980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:15.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.006+0000 7fc4ada42700 1 -- 172.21.15.62:0/2285087899 shutdown_connections 2021-12-17T18:20:15.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.006+0000 7fc4ada42700 1 -- 172.21.15.62:0/2285087899 wait complete. 2021-12-17T18:20:15.027 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-12-17T18:20:15.027 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-12-17T18:20:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.126+0000 7f8848d4d700 1 Processor -- start 2021-12-17T18:20:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.126+0000 7f8848d4d700 1 -- start start 2021-12-17T18:20:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8848d4d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88440b07c0 0x7f88440b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:15.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8848d4d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8844147440 0x7f884405fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:15.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8848d4d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88440606e0 con 0x7f88440b5330 2021-12-17T18:20:15.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8848d4d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8844141950 con 0x7f8844147440 2021-12-17T18:20:15.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8848d4d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884405fa10 con 0x7f88440b07c0 2021-12-17T18:20:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f884259c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f88440b5330 0x7f8844147b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33462/0 (socket says 172.21.15.62:33462) 2021-12-17T18:20:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f884259c700 1 -- 172.21.15.62:0/1724363695 learned_addr learned my addr 172.21.15.62:0/1724363695 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8842d9d700 1 --2- 172.21.15.62:0/1724363695 >> v2:172.21.15.62:3300/0 conn(0x7f8844147440 0x7f884405fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8841d9b700 1 --2- 172.21.15.62:0/1724363695 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88440b07c0 0x7f88440b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f884159a700 1 -- 172.21.15.62:0/1724363695 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448074304 0 0) 0x7f88440606e0 con 0x7f88440b5330 2021-12-17T18:20:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f884159a700 1 -- 172.21.15.62:0/1724363695 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8828003260 con 0x7f88440b5330 2021-12-17T18:20:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8841d9b700 1 -- 172.21.15.62:0/1724363695 >> v2:172.21.15.62:3300/0 conn(0x7f8844147440 msgr2=0x7f884405fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8841d9b700 1 --2- 172.21.15.62:0/1724363695 >> v2:172.21.15.62:3300/0 conn(0x7f8844147440 0x7f884405fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8841d9b700 1 -- 172.21.15.62:0/1724363695 >> v1:172.21.15.62:6789/0 conn(0x7f88440b5330 legacy=0x7f8844147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f884159a700 1 -- 172.21.15.62:0/1724363695 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3083048789 0 0) 0x7f8828003260 con 0x7f88440b5330 2021-12-17T18:20:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8841d9b700 1 -- 172.21.15.62:0/1724363695 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8844060980 con 0x7f88440b07c0 2021-12-17T18:20:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8842d9d700 1 --2- 172.21.15.62:0/1724363695 >> v2:172.21.15.62:3300/0 conn(0x7f8844147440 0x7f884405fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:20:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8841d9b700 1 --2- 172.21.15.62:0/1724363695 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88440b07c0 0x7f88440b5710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f8838002f70 tx=0x7f8838006df0).ready entity=mon.2 client_cookie=18b1aef70fe55361 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f884159a700 1 -- 172.21.15.62:0/1724363695 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f883800d4a0 con 0x7f88440b07c0 2021-12-17T18:20:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f884159a700 1 -- 172.21.15.62:0/1724363695 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8838000e90 con 0x7f88440b07c0 2021-12-17T18:20:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f884159a700 1 -- 172.21.15.62:0/1724363695 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f883800d7f0 con 0x7f88440b07c0 2021-12-17T18:20:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8848d4d700 1 -- 172.21.15.62:0/1724363695 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88440b07c0 msgr2=0x7f88440b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8848d4d700 1 --2- 172.21.15.62:0/1724363695 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88440b07c0 0x7f88440b5710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f8838002f70 tx=0x7f8838006df0).stop 2021-12-17T18:20:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8848d4d700 1 -- 172.21.15.62:0/1724363695 shutdown_connections 2021-12-17T18:20:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8848d4d700 1 --2- 172.21.15.62:0/1724363695 >> v2:172.21.15.62:3300/0 conn(0x7f8844147440 0x7f884405fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8848d4d700 1 --2- 172.21.15.62:0/1724363695 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88440b07c0 0x7f88440b5710 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8848d4d700 1 -- 172.21.15.62:0/1724363695 >> 172.21.15.62:0/1724363695 conn(0x7f884405c750 msgr2=0x7f884405cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8848d4d700 1 -- 172.21.15.62:0/1724363695 shutdown_connections 2021-12-17T18:20:15.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.130+0000 7f8848d4d700 1 -- 172.21.15.62:0/1724363695 wait complete. 2021-12-17T18:20:15.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.134+0000 7f8848d4d700 1 Processor -- start 2021-12-17T18:20:15.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.134+0000 7f8848d4d700 1 -- start start 2021-12-17T18:20:15.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.134+0000 7f8848d4d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88440b07c0 0x7f8844145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:15.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.134+0000 7f8848d4d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88440b5330 0x7f8844159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:15.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.134+0000 7f8848d4d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8844147440 0x7f884415a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:15.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.134+0000 7f8848d4d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88440adda0 con 0x7f8844147440 2021-12-17T18:20:15.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.134+0000 7f8848d4d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8844144c80 con 0x7f88440b07c0 2021-12-17T18:20:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.134+0000 7f8848d4d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88441449e0 con 0x7f88440b5330 2021-12-17T18:20:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.134+0000 7f8842d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8844147440 0x7f884415a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.134+0000 7f8842d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8844147440 0x7f884415a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49892/0 (socket says 172.21.15.62:49892) 2021-12-17T18:20:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.134+0000 7f8842d9d700 1 -- 172.21.15.62:0/2260561021 learned_addr learned my addr 172.21.15.62:0/2260561021 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:15.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.134+0000 7f8841d9b700 1 --2- 172.21.15.62:0/2260561021 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88440b5330 0x7f8844159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:15.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.134+0000 7f884259c700 1 --2- 172.21.15.62:0/2260561021 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88440b07c0 0x7f8844145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:15.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.138+0000 7f8842d9d700 1 -- 172.21.15.62:0/2260561021 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88440b5330 msgr2=0x7f8844159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:15.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.138+0000 7f8842d9d700 1 --2- 172.21.15.62:0/2260561021 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88440b5330 0x7f8844159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:15.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.138+0000 7f8842d9d700 1 -- 172.21.15.62:0/2260561021 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88440b07c0 msgr2=0x7f8844145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:15.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.138+0000 7f8842d9d700 1 --2- 172.21.15.62:0/2260561021 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88440b07c0 0x7f8844145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:15.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.138+0000 7f8842d9d700 1 -- 172.21.15.62:0/2260561021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883400b180 con 0x7f8844147440 2021-12-17T18:20:15.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.138+0000 7f8842d9d700 1 --2- 172.21.15.62:0/2260561021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8844147440 0x7f884415a010 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f8844144e10 tx=0x7f8834006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:15.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.138+0000 7f88337fe700 1 -- 172.21.15.62:0/2260561021 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8834010780 con 0x7f8844147440 2021-12-17T18:20:15.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.138+0000 7f88337fe700 1 -- 172.21.15.62:0/2260561021 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88340108e0 con 0x7f8844147440 2021-12-17T18:20:15.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.138+0000 7f8848d4d700 1 -- 172.21.15.62:0/2260561021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883800b180 con 0x7f8844147440 2021-12-17T18:20:15.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.138+0000 7f88337fe700 1 -- 172.21.15.62:0/2260561021 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8834010c40 con 0x7f8844147440 2021-12-17T18:20:15.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.138+0000 7f8848d4d700 1 -- 172.21.15.62:0/2260561021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8844144220 con 0x7f8844147440 2021-12-17T18:20:15.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.138+0000 7f8848d4d700 1 -- 172.21.15.62:0/2260561021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8844143fc0 con 0x7f8844147440 2021-12-17T18:20:15.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.138+0000 7f88337fe700 1 -- 172.21.15.62:0/2260561021 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f883401c460 con 0x7f8844147440 2021-12-17T18:20:15.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.138+0000 7f88337fe700 1 --2- 172.21.15.62:0/2260561021 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8820053610 0x7f8820055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:15.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.138+0000 7f88337fe700 1 -- 172.21.15.62:0/2260561021 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f883406bb00 con 0x7f8844147440 2021-12-17T18:20:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.138+0000 7f884259c700 1 --2- 172.21.15.62:0/2260561021 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8820053610 0x7f8820055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.142+0000 7f884259c700 1 --2- 172.21.15.62:0/2260561021 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8820053610 0x7f8820055ad0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f883c00d000 tx=0x7f883c007b00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:15.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.146+0000 7f88337fe700 1 -- 172.21.15.62:0/2260561021 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8834042e90 con 0x7f8844147440 2021-12-17T18:20:15.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:15.274+0000 7f8848d4d700 1 -- 172.21.15.62:0/2260561021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f88440573d0 con 0x7f8844147440 2021-12-17T18:20:16.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.130+0000 7f88337fe700 1 -- 172.21.15.62:0/2260561021 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v39) v1 ==== 133+0+0 (secure 0 0 0) 0x7f88340464b0 con 0x7f8844147440 2021-12-17T18:20:16.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.134+0000 7f8848d4d700 1 -- 172.21.15.62:0/2260561021 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8820053610 msgr2=0x7f8820055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.134+0000 7f8848d4d700 1 --2- 172.21.15.62:0/2260561021 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8820053610 0x7f8820055ad0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f883c00d000 tx=0x7f883c007b00).stop 2021-12-17T18:20:16.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.134+0000 7f8848d4d700 1 -- 172.21.15.62:0/2260561021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8844147440 msgr2=0x7f884415a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.134+0000 7f8848d4d700 1 --2- 172.21.15.62:0/2260561021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8844147440 0x7f884415a010 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f8844144e10 tx=0x7f8834006df0).stop 2021-12-17T18:20:16.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.134+0000 7f8848d4d700 1 -- 172.21.15.62:0/2260561021 shutdown_connections 2021-12-17T18:20:16.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.134+0000 7f8848d4d700 1 --2- 172.21.15.62:0/2260561021 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8820053610 0x7f8820055ad0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.134+0000 7f8848d4d700 1 --2- 172.21.15.62:0/2260561021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8844147440 0x7f884415a010 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.134+0000 7f8848d4d700 1 --2- 172.21.15.62:0/2260561021 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88440b5330 0x7f8844159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.134+0000 7f8848d4d700 1 --2- 172.21.15.62:0/2260561021 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88440b07c0 0x7f8844145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.134+0000 7f8848d4d700 1 -- 172.21.15.62:0/2260561021 >> 172.21.15.62:0/2260561021 conn(0x7f884405c750 msgr2=0x7f8844148aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:16.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.134+0000 7f8848d4d700 1 -- 172.21.15.62:0/2260561021 shutdown_connections 2021-12-17T18:20:16.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.138+0000 7f8848d4d700 1 -- 172.21.15.62:0/2260561021 wait complete. 2021-12-17T18:20:16.145 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2021-12-17T18:20:16.156 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-12-17T18:20:16.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e6f1e0700 1 Processor -- start 2021-12-17T18:20:16.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e6f1e0700 1 -- start start 2021-12-17T18:20:16.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e6f1e0700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7e68064a40 0x7f7e68141910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e6f1e0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7e680b2250 0x7f7e68144450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e6f1e0700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e68060400 con 0x7f7e68060020 2021-12-17T18:20:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e6f1e0700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6813b2e0 con 0x7f7e68064a40 2021-12-17T18:20:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e6f1e0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68067970 con 0x7f7e680b2250 2021-12-17T18:20:16.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e5ffff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7e68064a40 0x7f7e68141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:16.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e6d77d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7e680b2250 0x7f7e68144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:16.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e6cf7c700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f7e68060020 0x7f7e68141200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:49796/0 (socket says 172.21.15.62:49796) 2021-12-17T18:20:16.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e6cf7c700 1 -- 172.21.15.62:0/3803062889 learned_addr learned my addr 172.21.15.62:0/3803062889 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:16.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e5f7fe700 1 -- 172.21.15.62:0/3803062889 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009427044 0 0) 0x7f7e68060400 con 0x7f7e68060020 2021-12-17T18:20:16.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e5f7fe700 1 -- 172.21.15.62:0/3803062889 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e54003260 con 0x7f7e68060020 2021-12-17T18:20:16.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e6d77d700 1 -- 172.21.15.62:0/3803062889 >> v2:172.21.15.109:3300/0 conn(0x7f7e68064a40 msgr2=0x7f7e68141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:16.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e6d77d700 1 --2- 172.21.15.62:0/3803062889 >> v2:172.21.15.109:3300/0 conn(0x7f7e68064a40 0x7f7e68141910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e6d77d700 1 -- 172.21.15.62:0/3803062889 >> v1:172.21.15.109:6789/0 conn(0x7f7e68060020 legacy=0x7f7e68141200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e6d77d700 1 -- 172.21.15.62:0/3803062889 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e68067c10 con 0x7f7e680b2250 2021-12-17T18:20:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e6d77d700 1 --2- 172.21.15.62:0/3803062889 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7e680b2250 0x7f7e68144450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f7e600032f0 tx=0x7f7e600091d0).ready entity=mon.2 client_cookie=de0457fbe64ad711 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e5f7fe700 1 -- 172.21.15.62:0/3803062889 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e6000b600 con 0x7f7e680b2250 2021-12-17T18:20:16.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e5f7fe700 1 -- 172.21.15.62:0/3803062889 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6000b760 con 0x7f7e680b2250 2021-12-17T18:20:16.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.266+0000 7f7e5f7fe700 1 -- 172.21.15.62:0/3803062889 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e6000b8d0 con 0x7f7e680b2250 2021-12-17T18:20:16.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.270+0000 7f7e6f1e0700 1 -- 172.21.15.62:0/3803062889 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7e680b2250 msgr2=0x7f7e68144450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.270+0000 7f7e6f1e0700 1 --2- 172.21.15.62:0/3803062889 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7e680b2250 0x7f7e68144450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f7e600032f0 tx=0x7f7e600091d0).stop 2021-12-17T18:20:16.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.270+0000 7f7e6f1e0700 1 -- 172.21.15.62:0/3803062889 shutdown_connections 2021-12-17T18:20:16.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.270+0000 7f7e6f1e0700 1 --2- 172.21.15.62:0/3803062889 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7e680b2250 0x7f7e68144450 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.270+0000 7f7e6f1e0700 1 --2- 172.21.15.62:0/3803062889 >> v2:172.21.15.109:3300/0 conn(0x7f7e68064a40 0x7f7e68141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.270+0000 7f7e6f1e0700 1 -- 172.21.15.62:0/3803062889 >> 172.21.15.62:0/3803062889 conn(0x7f7e6805cac0 msgr2=0x7f7e6805ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:16.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.270+0000 7f7e6f1e0700 1 -- 172.21.15.62:0/3803062889 shutdown_connections 2021-12-17T18:20:16.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.270+0000 7f7e6f1e0700 1 -- 172.21.15.62:0/3803062889 wait complete. 2021-12-17T18:20:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.270+0000 7f7e6f1e0700 1 Processor -- start 2021-12-17T18:20:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.270+0000 7f7e6f1e0700 1 -- start start 2021-12-17T18:20:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.270+0000 7f7e6f1e0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7e68060020 0x7f7e680b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.270+0000 7f7e6f1e0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7e68064a40 0x7f7e6813a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e6f1e0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e680b2250 0x7f7e6813ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e6f1e0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e681431f0 con 0x7f7e680b2250 2021-12-17T18:20:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e6f1e0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6813b080 con 0x7f7e68064a40 2021-12-17T18:20:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e6f1e0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e680ae3a0 con 0x7f7e68060020 2021-12-17T18:20:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e6d77d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e680b2250 0x7f7e6813ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e6d77d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e680b2250 0x7f7e6813ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49906/0 (socket says 172.21.15.62:49906) 2021-12-17T18:20:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e6d77d700 1 -- 172.21.15.62:0/2331661734 learned_addr learned my addr 172.21.15.62:0/2331661734 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e6cf7c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7e68060020 0x7f7e680b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e5ffff700 1 --2- 172.21.15.62:0/2331661734 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7e68064a40 0x7f7e6813a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:16.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e6d77d700 1 -- 172.21.15.62:0/2331661734 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7e68060020 msgr2=0x7f7e680b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e6d77d700 1 --2- 172.21.15.62:0/2331661734 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7e68060020 0x7f7e680b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e6d77d700 1 -- 172.21.15.62:0/2331661734 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7e68064a40 msgr2=0x7f7e6813a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e6d77d700 1 --2- 172.21.15.62:0/2331661734 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7e68064a40 0x7f7e6813a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e6d77d700 1 -- 172.21.15.62:0/2331661734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e60009470 con 0x7f7e680b2250 2021-12-17T18:20:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e6d77d700 1 --2- 172.21.15.62:0/2331661734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e680b2250 0x7f7e6813ab90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f7e600032f0 tx=0x7f7e60016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e5dffb700 1 -- 172.21.15.62:0/2331661734 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e6000b600 con 0x7f7e680b2250 2021-12-17T18:20:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e5dffb700 1 -- 172.21.15.62:0/2331661734 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e60011c10 con 0x7f7e680b2250 2021-12-17T18:20:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e6f1e0700 1 -- 172.21.15.62:0/2331661734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e68143420 con 0x7f7e680b2250 2021-12-17T18:20:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e5dffb700 1 -- 172.21.15.62:0/2331661734 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e6001f3f0 con 0x7f7e680b2250 2021-12-17T18:20:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e6f1e0700 1 -- 172.21.15.62:0/2331661734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e681555b0 con 0x7f7e680b2250 2021-12-17T18:20:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.274+0000 7f7e6f1e0700 1 -- 172.21.15.62:0/2331661734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e680573d0 con 0x7f7e680b2250 2021-12-17T18:20:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.278+0000 7f7e5dffb700 1 -- 172.21.15.62:0/2331661734 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7e60026030 con 0x7f7e680b2250 2021-12-17T18:20:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.278+0000 7f7e5dffb700 1 --2- 172.21.15.62:0/2331661734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7e48053610 0x7f7e48055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.278+0000 7f7e5dffb700 1 -- 172.21.15.62:0/2331661734 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f7e6006c1d0 con 0x7f7e680b2250 2021-12-17T18:20:16.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.278+0000 7f7e6cf7c700 1 --2- 172.21.15.62:0/2331661734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7e48053610 0x7f7e48055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:16.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.278+0000 7f7e6cf7c700 1 --2- 172.21.15.62:0/2331661734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7e48053610 0x7f7e48055ad0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f7e6400d000 tx=0x7f7e64009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:16.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.282+0000 7f7e5dffb700 1 -- 172.21.15.62:0/2331661734 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7e60043540 con 0x7f7e680b2250 2021-12-17T18:20:16.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.406+0000 7f7e6f1e0700 1 -- 172.21.15.62:0/2331661734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f7e680ae4e0 con 0x7f7e680b2250 2021-12-17T18:20:16.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.482+0000 7f7e5dffb700 1 -- 172.21.15.62:0/2331661734 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v40) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7e600150a0 con 0x7f7e680b2250 2021-12-17T18:20:16.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.486+0000 7f7e6f1e0700 1 -- 172.21.15.62:0/2331661734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7e48053610 msgr2=0x7f7e48055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.486+0000 7f7e6f1e0700 1 --2- 172.21.15.62:0/2331661734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7e48053610 0x7f7e48055ad0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f7e6400d000 tx=0x7f7e64009040).stop 2021-12-17T18:20:16.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.486+0000 7f7e6f1e0700 1 -- 172.21.15.62:0/2331661734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e680b2250 msgr2=0x7f7e6813ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.486+0000 7f7e6f1e0700 1 --2- 172.21.15.62:0/2331661734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e680b2250 0x7f7e6813ab90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f7e600032f0 tx=0x7f7e60016000).stop 2021-12-17T18:20:16.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.486+0000 7f7e6f1e0700 1 -- 172.21.15.62:0/2331661734 shutdown_connections 2021-12-17T18:20:16.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.486+0000 7f7e6f1e0700 1 --2- 172.21.15.62:0/2331661734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7e48053610 0x7f7e48055ad0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.486+0000 7f7e6f1e0700 1 --2- 172.21.15.62:0/2331661734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e680b2250 0x7f7e6813ab90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.486+0000 7f7e6f1e0700 1 --2- 172.21.15.62:0/2331661734 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7e68064a40 0x7f7e6813a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.486+0000 7f7e6f1e0700 1 --2- 172.21.15.62:0/2331661734 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7e68060020 0x7f7e680b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.486+0000 7f7e6f1e0700 1 -- 172.21.15.62:0/2331661734 >> 172.21.15.62:0/2331661734 conn(0x7f7e6805cac0 msgr2=0x7f7e680b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:16.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.486+0000 7f7e6f1e0700 1 -- 172.21.15.62:0/2331661734 shutdown_connections 2021-12-17T18:20:16.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.486+0000 7f7e6f1e0700 1 -- 172.21.15.62:0/2331661734 wait complete. 2021-12-17T18:20:16.497 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2021-12-17T18:20:16.507 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-12-17T18:20:16.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.606+0000 7f56cdd52700 1 Processor -- start 2021-12-17T18:20:16.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.606+0000 7f56cdd52700 1 -- start start 2021-12-17T18:20:16.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56cdd52700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f56c8062360 0x7f56c8140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:16.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56cdd52700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c81443b0 con 0x7f56c8066a70 2021-12-17T18:20:16.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56cdd52700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c80b3190 con 0x7f56c8144f20 2021-12-17T18:20:16.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56cdd52700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c80b3430 con 0x7f56c8062360 2021-12-17T18:20:16.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56bffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f56c8062360 0x7f56c8140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:16.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56ccd50700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f56c8066a70 0x7f56c8144810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33490/0 (socket says 172.21.15.62:33490) 2021-12-17T18:20:16.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56bffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f56c8062360 0x7f56c8140060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49912/0 (socket says 172.21.15.62:49912) 2021-12-17T18:20:16.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56ccd50700 1 -- 172.21.15.62:0/126861161 learned_addr learned my addr 172.21.15.62:0/126861161 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:16.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56bffff700 1 -- 172.21.15.62:0/126861161 >> v1:172.21.15.109:6789/0 conn(0x7f56c8144f20 legacy=0x7f56c8140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56bffff700 1 -- 172.21.15.62:0/126861161 >> v1:172.21.15.62:6789/0 conn(0x7f56c8066a70 legacy=0x7f56c8144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56bf7fe700 1 -- 172.21.15.62:0/126861161 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763175313 0 0) 0x7f56c81443b0 con 0x7f56c8066a70 2021-12-17T18:20:16.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56bffff700 1 -- 172.21.15.62:0/126861161 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c8066e50 con 0x7f56c8062360 2021-12-17T18:20:16.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56bffff700 1 --2- 172.21.15.62:0/126861161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56c8062360 0x7f56c8140060 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f56b8002f70 tx=0x7f56b8006df0).ready entity=mon.0 client_cookie=bb7955d448015a6b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:16.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56bf7fe700 1 -- 172.21.15.62:0/126861161 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56b800d610 con 0x7f56c8062360 2021-12-17T18:20:16.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56bf7fe700 1 -- 172.21.15.62:0/126861161 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b8000e90 con 0x7f56c8062360 2021-12-17T18:20:16.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56bf7fe700 1 -- 172.21.15.62:0/126861161 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56b800d960 con 0x7f56c8062360 2021-12-17T18:20:16.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56cdd52700 1 -- 172.21.15.62:0/126861161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56c8062360 msgr2=0x7f56c8140060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56cdd52700 1 --2- 172.21.15.62:0/126861161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56c8062360 0x7f56c8140060 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f56b8002f70 tx=0x7f56b8006df0).stop 2021-12-17T18:20:16.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56cdd52700 1 -- 172.21.15.62:0/126861161 shutdown_connections 2021-12-17T18:20:16.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56cdd52700 1 --2- 172.21.15.62:0/126861161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56c8062360 0x7f56c8140060 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56cdd52700 1 -- 172.21.15.62:0/126861161 >> 172.21.15.62:0/126861161 conn(0x7f56c805bcd0 msgr2=0x7f56c8063510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:16.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56cdd52700 1 -- 172.21.15.62:0/126861161 shutdown_connections 2021-12-17T18:20:16.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.610+0000 7f56cdd52700 1 -- 172.21.15.62:0/126861161 wait complete. 2021-12-17T18:20:16.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56cdd52700 1 Processor -- start 2021-12-17T18:20:16.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56cdd52700 1 -- start start 2021-12-17T18:20:16.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56cdd52700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56c8062360 0x7f56c813dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:16.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56cdd52700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56c8066a70 0x7f56c80af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:16.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56cdd52700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56c8144f20 0x7f56c813bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:16.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56cdd52700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c8110550 con 0x7f56c8066a70 2021-12-17T18:20:16.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56cdd52700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c80aef90 con 0x7f56c8062360 2021-12-17T18:20:16.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56cdd52700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c8110780 con 0x7f56c8144f20 2021-12-17T18:20:16.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56bffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56c8066a70 0x7f56c80af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:16.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56ccd50700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56c8062360 0x7f56c813dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:16.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56bffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56c8066a70 0x7f56c80af570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49918/0 (socket says 172.21.15.62:49918) 2021-12-17T18:20:16.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56bffff700 1 -- 172.21.15.62:0/1355047339 learned_addr learned my addr 172.21.15.62:0/1355047339 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:16.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56cd551700 1 --2- 172.21.15.62:0/1355047339 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56c8144f20 0x7f56c813bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:16.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56bffff700 1 -- 172.21.15.62:0/1355047339 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56c8144f20 msgr2=0x7f56c813bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56bffff700 1 --2- 172.21.15.62:0/1355047339 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56c8144f20 0x7f56c813bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56bffff700 1 -- 172.21.15.62:0/1355047339 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56c8062360 msgr2=0x7f56c813dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56bffff700 1 --2- 172.21.15.62:0/1355047339 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56c8062360 0x7f56c813dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56bffff700 1 -- 172.21.15.62:0/1355047339 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b800b180 con 0x7f56c8066a70 2021-12-17T18:20:16.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56bffff700 1 --2- 172.21.15.62:0/1355047339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56c8066a70 0x7f56c80af570 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f56b8002f70 tx=0x7f56b8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:16.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56bdffb700 1 -- 172.21.15.62:0/1355047339 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56b800de70 con 0x7f56c8066a70 2021-12-17T18:20:16.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56bdffb700 1 -- 172.21.15.62:0/1355047339 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b8011b00 con 0x7f56c8066a70 2021-12-17T18:20:16.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56cdd52700 1 -- 172.21.15.62:0/1355047339 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c813e250 con 0x7f56c8066a70 2021-12-17T18:20:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56bdffb700 1 -- 172.21.15.62:0/1355047339 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56b8011e60 con 0x7f56c8066a70 2021-12-17T18:20:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.614+0000 7f56cdd52700 1 -- 172.21.15.62:0/1355047339 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c80afa60 con 0x7f56c8066a70 2021-12-17T18:20:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.618+0000 7f56cdd52700 1 -- 172.21.15.62:0/1355047339 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c80b3670 con 0x7f56c8066a70 2021-12-17T18:20:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.618+0000 7f56bdffb700 1 -- 172.21.15.62:0/1355047339 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f56b8025030 con 0x7f56c8066a70 2021-12-17T18:20:16.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.618+0000 7f56bdffb700 1 --2- 172.21.15.62:0/1355047339 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56a80534f0 0x7f56a80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:16.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.618+0000 7f56bdffb700 1 -- 172.21.15.62:0/1355047339 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f56b806cc10 con 0x7f56c8066a70 2021-12-17T18:20:16.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.618+0000 7f56ccd50700 1 --2- 172.21.15.62:0/1355047339 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56a80534f0 0x7f56a80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:16.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.622+0000 7f56ccd50700 1 --2- 172.21.15.62:0/1355047339 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56a80534f0 0x7f56a80559b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f56c400d000 tx=0x7f56c40011a0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:16.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.626+0000 7f56bdffb700 1 -- 172.21.15.62:0/1355047339 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f56b8043cd0 con 0x7f56c8066a70 2021-12-17T18:20:16.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.794+0000 7f56cdd52700 1 -- 172.21.15.62:0/1355047339 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f56c80573d0 con 0x7f56c8066a70 2021-12-17T18:20:16.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.806+0000 7f56bdffb700 1 -- 172.21.15.62:0/1355047339 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 7 and data pool 8 v14) v1 ==== 187+0+0 (secure 0 0 0) 0x7f56b8023020 con 0x7f56c8066a70 2021-12-17T18:20:16.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.810+0000 7f56cdd52700 1 -- 172.21.15.62:0/1355047339 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56a80534f0 msgr2=0x7f56a80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.810+0000 7f56cdd52700 1 --2- 172.21.15.62:0/1355047339 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56a80534f0 0x7f56a80559b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f56c400d000 tx=0x7f56c40011a0).stop 2021-12-17T18:20:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.810+0000 7f56cdd52700 1 -- 172.21.15.62:0/1355047339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56c8066a70 msgr2=0x7f56c80af570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.810+0000 7f56cdd52700 1 --2- 172.21.15.62:0/1355047339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56c8066a70 0x7f56c80af570 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f56b8002f70 tx=0x7f56b8015000).stop 2021-12-17T18:20:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.810+0000 7f56cdd52700 1 -- 172.21.15.62:0/1355047339 shutdown_connections 2021-12-17T18:20:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.810+0000 7f56cdd52700 1 --2- 172.21.15.62:0/1355047339 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56a80534f0 0x7f56a80559b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.810+0000 7f56cdd52700 1 --2- 172.21.15.62:0/1355047339 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56c8144f20 0x7f56c813bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.810+0000 7f56cdd52700 1 --2- 172.21.15.62:0/1355047339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56c8066a70 0x7f56c80af570 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.810+0000 7f56cdd52700 1 --2- 172.21.15.62:0/1355047339 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56c8062360 0x7f56c813dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.810+0000 7f56cdd52700 1 -- 172.21.15.62:0/1355047339 >> 172.21.15.62:0/1355047339 conn(0x7f56c805bcd0 msgr2=0x7f56c80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:16.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.810+0000 7f56cdd52700 1 -- 172.21.15.62:0/1355047339 shutdown_connections 2021-12-17T18:20:16.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.810+0000 7f56cdd52700 1 -- 172.21.15.62:0/1355047339 wait complete. 2021-12-17T18:20:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 7 and data pool 8 2021-12-17T18:20:16.830 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:20:16.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.914+0000 7f800f6f4700 1 Processor -- start 2021-12-17T18:20:16.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.914+0000 7f800f6f4700 1 -- start start 2021-12-17T18:20:16.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800f6f4700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f80080b1730 0x7f80080ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:16.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800f6f4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f80080a7bb0 0x7f8008067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:16.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800f6f4700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80080b2ce0 con 0x7f80080b21f0 2021-12-17T18:20:16.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800f6f4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800814b5b0 con 0x7f80080a7bb0 2021-12-17T18:20:16.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800f6f4700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8008147870 con 0x7f80080b1730 2021-12-17T18:20:16.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800dc91700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f80080a7bb0 0x7f8008067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:16.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800dc91700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f80080a7bb0 0x7f8008067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49940/0 (socket says 172.21.15.62:49940) 2021-12-17T18:20:16.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800dc91700 1 -- 172.21.15.62:0/600038446 learned_addr learned my addr 172.21.15.62:0/600038446 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:16.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800cc8f700 1 --2- 172.21.15.62:0/600038446 >> v2:172.21.15.109:3300/0 conn(0x7f80080b1730 0x7f80080ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:16.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800dc91700 1 -- 172.21.15.62:0/600038446 >> v2:172.21.15.109:3300/0 conn(0x7f80080b1730 msgr2=0x7f80080ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:16.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800dc91700 1 --2- 172.21.15.62:0/600038446 >> v2:172.21.15.109:3300/0 conn(0x7f80080b1730 0x7f80080ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800dc91700 1 -- 172.21.15.62:0/600038446 >> v1:172.21.15.109:6789/0 conn(0x7f80080b21f0 legacy=0x7f800814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800dc91700 1 -- 172.21.15.62:0/600038446 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80080aca60 con 0x7f80080a7bb0 2021-12-17T18:20:16.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800cc8f700 1 --2- 172.21.15.62:0/600038446 >> v2:172.21.15.109:3300/0 conn(0x7f80080b1730 0x7f80080ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:16.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800dc91700 1 --2- 172.21.15.62:0/600038446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80080a7bb0 0x7f8008067120 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f80080b1c00 tx=0x7f7ff8006eb0).ready entity=mon.0 client_cookie=8c649f49929b034c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:16.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f8007fff700 1 -- 172.21.15.62:0/600038446 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff800d610 con 0x7f80080a7bb0 2021-12-17T18:20:16.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f8007fff700 1 -- 172.21.15.62:0/600038446 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff8000e90 con 0x7f80080a7bb0 2021-12-17T18:20:16.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f8007fff700 1 -- 172.21.15.62:0/600038446 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff800d960 con 0x7f80080a7bb0 2021-12-17T18:20:16.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800f6f4700 1 -- 172.21.15.62:0/600038446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80080a7bb0 msgr2=0x7f8008067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800f6f4700 1 --2- 172.21.15.62:0/600038446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80080a7bb0 0x7f8008067120 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f80080b1c00 tx=0x7f7ff8006eb0).stop 2021-12-17T18:20:16.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800f6f4700 1 -- 172.21.15.62:0/600038446 shutdown_connections 2021-12-17T18:20:16.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800f6f4700 1 --2- 172.21.15.62:0/600038446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80080a7bb0 0x7f8008067120 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800f6f4700 1 --2- 172.21.15.62:0/600038446 >> v2:172.21.15.109:3300/0 conn(0x7f80080b1730 0x7f80080ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800f6f4700 1 -- 172.21.15.62:0/600038446 >> 172.21.15.62:0/600038446 conn(0x7f800805f730 msgr2=0x7f800805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:16.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800f6f4700 1 -- 172.21.15.62:0/600038446 shutdown_connections 2021-12-17T18:20:16.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800f6f4700 1 -- 172.21.15.62:0/600038446 wait complete. 2021-12-17T18:20:16.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.918+0000 7f800f6f4700 1 Processor -- start 2021-12-17T18:20:16.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800f6f4700 1 -- start start 2021-12-17T18:20:16.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800f6f4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f80080a7bb0 0x7f80080ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:16.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800f6f4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f80080b1730 0x7f800814ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:16.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800f6f4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80080b21f0 0x7f8008066860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:16.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800f6f4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80080ab830 con 0x7f80080b21f0 2021-12-17T18:20:16.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800f6f4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80080abad0 con 0x7f80080b1730 2021-12-17T18:20:16.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800f6f4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80080abd70 con 0x7f80080a7bb0 2021-12-17T18:20:16.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800dc91700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80080b21f0 0x7f8008066860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:16.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800dc91700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80080b21f0 0x7f8008066860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49946/0 (socket says 172.21.15.62:49946) 2021-12-17T18:20:16.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800dc91700 1 -- 172.21.15.62:0/1687074148 learned_addr learned my addr 172.21.15.62:0/1687074148 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:16.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800cc8f700 1 --2- 172.21.15.62:0/1687074148 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f80080b1730 0x7f800814ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:16.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800d490700 1 --2- 172.21.15.62:0/1687074148 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f80080a7bb0 0x7f80080ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:16.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800dc91700 1 -- 172.21.15.62:0/1687074148 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f80080a7bb0 msgr2=0x7f80080ac210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800dc91700 1 --2- 172.21.15.62:0/1687074148 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f80080a7bb0 0x7f80080ac210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800dc91700 1 -- 172.21.15.62:0/1687074148 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f80080b1730 msgr2=0x7f800814ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:16.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800dc91700 1 --2- 172.21.15.62:0/1687074148 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f80080b1730 0x7f800814ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:16.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800dc91700 1 -- 172.21.15.62:0/1687074148 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff800b1e0 con 0x7f80080b21f0 2021-12-17T18:20:16.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800cc8f700 1 --2- 172.21.15.62:0/1687074148 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f80080b1730 0x7f800814ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:16.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800dc91700 1 --2- 172.21.15.62:0/1687074148 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80080b21f0 0x7f8008066860 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f80080b1c00 tx=0x7f7ff8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:16.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f80067fc700 1 -- 172.21.15.62:0/1687074148 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff800d290 con 0x7f80080b21f0 2021-12-17T18:20:16.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f80067fc700 1 -- 172.21.15.62:0/1687074148 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff800d990 con 0x7f80080b21f0 2021-12-17T18:20:16.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f80067fc700 1 -- 172.21.15.62:0/1687074148 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff8011e90 con 0x7f80080b21f0 2021-12-17T18:20:16.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800f6f4700 1 -- 172.21.15.62:0/1687074148 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800814cf30 con 0x7f80080b21f0 2021-12-17T18:20:16.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.922+0000 7f800f6f4700 1 -- 172.21.15.62:0/1687074148 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8008063060 con 0x7f80080b21f0 2021-12-17T18:20:16.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.926+0000 7f800f6f4700 1 -- 172.21.15.62:0/1687074148 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80080ab650 con 0x7f80080b21f0 2021-12-17T18:20:16.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.926+0000 7f80067fc700 1 -- 172.21.15.62:0/1687074148 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7ff8025030 con 0x7f80080b21f0 2021-12-17T18:20:16.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.926+0000 7f80067fc700 1 --2- 172.21.15.62:0/1687074148 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fe80536d0 0x7f7fe8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:16.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.926+0000 7f80067fc700 1 -- 172.21.15.62:0/1687074148 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7ff806cb50 con 0x7f80080b21f0 2021-12-17T18:20:16.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.926+0000 7f800d490700 1 --2- 172.21.15.62:0/1687074148 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fe80536d0 0x7f7fe8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:16.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.926+0000 7f800d490700 1 --2- 172.21.15.62:0/1687074148 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fe80536d0 0x7f7fe8055b90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f800000b000 tx=0x7f8000009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:16.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:16.934+0000 7f80067fc700 1 -- 172.21.15.62:0/1687074148 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7ff8043cb0 con 0x7f80080b21f0 2021-12-17T18:20:17.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.066+0000 7f800f6f4700 1 -- 172.21.15.62:0/1687074148 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80080ad380 con 0x7f80080b21f0 2021-12-17T18:20:17.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.066+0000 7f80067fc700 1 -- 172.21.15.62:0/1687074148 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16112 (secure 0 0 0) 0x7f7ff8023020 con 0x7f80080b21f0 2021-12-17T18:20:17.075 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:17.075 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":41,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:20:16.800807+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:20:15.333250+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-12-17T18:20:16.462772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:20:17.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.070+0000 7f800f6f4700 1 -- 172.21.15.62:0/1687074148 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fe80536d0 msgr2=0x7f7fe8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.070+0000 7f800f6f4700 1 --2- 172.21.15.62:0/1687074148 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fe80536d0 0x7f7fe8055b90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f800000b000 tx=0x7f8000009040).stop 2021-12-17T18:20:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.070+0000 7f800f6f4700 1 -- 172.21.15.62:0/1687074148 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80080b21f0 msgr2=0x7f8008066860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.070+0000 7f800f6f4700 1 --2- 172.21.15.62:0/1687074148 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80080b21f0 0x7f8008066860 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f80080b1c00 tx=0x7f7ff8015000).stop 2021-12-17T18:20:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.070+0000 7f800f6f4700 1 -- 172.21.15.62:0/1687074148 shutdown_connections 2021-12-17T18:20:17.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.070+0000 7f800f6f4700 1 --2- 172.21.15.62:0/1687074148 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fe80536d0 0x7f7fe8055b90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.070+0000 7f800f6f4700 1 --2- 172.21.15.62:0/1687074148 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80080b21f0 0x7f8008066860 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.070+0000 7f800f6f4700 1 --2- 172.21.15.62:0/1687074148 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f80080b1730 0x7f800814ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.070+0000 7f800f6f4700 1 --2- 172.21.15.62:0/1687074148 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f80080a7bb0 0x7f80080ac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.070+0000 7f800f6f4700 1 -- 172.21.15.62:0/1687074148 >> 172.21.15.62:0/1687074148 conn(0x7f800805f730 msgr2=0x7f80080aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.070+0000 7f800f6f4700 1 -- 172.21.15.62:0/1687074148 shutdown_connections 2021-12-17T18:20:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.070+0000 7f800f6f4700 1 -- 172.21.15.62:0/1687074148 wait complete. 2021-12-17T18:20:17.092 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:20:17.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.186+0000 7f6d3e914700 1 Processor -- start 2021-12-17T18:20:17.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d3e914700 1 -- start start 2021-12-17T18:20:17.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d3e914700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d380ad610 0x7f6d380b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:17.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d3e914700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6d380b0e00 0x7f6d3813ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:17.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d3e914700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d380ad9f0 con 0x7f6d3813f250 2021-12-17T18:20:17.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d3e914700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d380ad010 con 0x7f6d380b0e00 2021-12-17T18:20:17.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d3e914700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d380b19e0 con 0x7f6d380ad610 2021-12-17T18:20:17.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d377fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6d380b0e00 0x7f6d3813ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:17.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d377fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6d380b0e00 0x7f6d3813ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49950/0 (socket says 172.21.15.62:49950) 2021-12-17T18:20:17.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d377fe700 1 -- 172.21.15.62:0/2790081871 learned_addr learned my addr 172.21.15.62:0/2790081871 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:17.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d37fff700 1 --2- 172.21.15.62:0/2790081871 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d380ad610 0x7f6d380b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:17.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d377fe700 1 -- 172.21.15.62:0/2790081871 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d380ad610 msgr2=0x7f6d380b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:17.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d377fe700 1 --2- 172.21.15.62:0/2790081871 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d380ad610 0x7f6d380b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d377fe700 1 -- 172.21.15.62:0/2790081871 >> v1:172.21.15.109:6789/0 conn(0x7f6d3813f250 legacy=0x7f6d38143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:17.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d377fe700 1 -- 172.21.15.62:0/2790081871 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d380b1c80 con 0x7f6d380b0e00 2021-12-17T18:20:17.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d377fe700 1 --2- 172.21.15.62:0/2790081871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d380b0e00 0x7f6d3813ed60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f6d28002f70 tx=0x7f6d28006eb0).ready entity=mon.0 client_cookie=48bc7955f8936611 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d36ffd700 1 -- 172.21.15.62:0/2790081871 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d2800d5c0 con 0x7f6d380b0e00 2021-12-17T18:20:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d36ffd700 1 -- 172.21.15.62:0/2790081871 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d28000e90 con 0x7f6d380b0e00 2021-12-17T18:20:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d36ffd700 1 -- 172.21.15.62:0/2790081871 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d2800d950 con 0x7f6d380b0e00 2021-12-17T18:20:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d3e914700 1 -- 172.21.15.62:0/2790081871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d380b0e00 msgr2=0x7f6d3813ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d3e914700 1 --2- 172.21.15.62:0/2790081871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d380b0e00 0x7f6d3813ed60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f6d28002f70 tx=0x7f6d28006eb0).stop 2021-12-17T18:20:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d3e914700 1 -- 172.21.15.62:0/2790081871 shutdown_connections 2021-12-17T18:20:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d3e914700 1 --2- 172.21.15.62:0/2790081871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d380b0e00 0x7f6d3813ed60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d3e914700 1 --2- 172.21.15.62:0/2790081871 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d380ad610 0x7f6d380b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d3e914700 1 -- 172.21.15.62:0/2790081871 >> 172.21.15.62:0/2790081871 conn(0x7f6d3805c750 msgr2=0x7f6d380630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:17.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d3e914700 1 -- 172.21.15.62:0/2790081871 shutdown_connections 2021-12-17T18:20:17.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.190+0000 7f6d3e914700 1 -- 172.21.15.62:0/2790081871 wait complete. 2021-12-17T18:20:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.194+0000 7f6d3e914700 1 Processor -- start 2021-12-17T18:20:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.194+0000 7f6d3e914700 1 -- start start 2021-12-17T18:20:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.194+0000 7f6d3e914700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6d380ad610 0x7f6d3812efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.194+0000 7f6d3e914700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d380b0e00 0x7f6d380abe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.194+0000 7f6d3e914700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d3813f250 0x7f6d380ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.194+0000 7f6d3e914700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d38142980 con 0x7f6d380b0e00 2021-12-17T18:20:17.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.194+0000 7f6d3e914700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d38150920 con 0x7f6d380ad610 2021-12-17T18:20:17.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.194+0000 7f6d3e914700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d380ac870 con 0x7f6d3813f250 2021-12-17T18:20:17.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.194+0000 7f6d377fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d380b0e00 0x7f6d380abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:17.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.194+0000 7f6d377fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d380b0e00 0x7f6d380abe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49958/0 (socket says 172.21.15.62:49958) 2021-12-17T18:20:17.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.194+0000 7f6d377fe700 1 -- 172.21.15.62:0/3909837947 learned_addr learned my addr 172.21.15.62:0/3909837947 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:17.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.194+0000 7f6d3ceb1700 1 --2- 172.21.15.62:0/3909837947 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d3813f250 0x7f6d380ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:17.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.198+0000 7f6d37fff700 1 --2- 172.21.15.62:0/3909837947 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6d380ad610 0x7f6d3812efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:17.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.198+0000 7f6d377fe700 1 -- 172.21.15.62:0/3909837947 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d3813f250 msgr2=0x7f6d380ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:17.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.198+0000 7f6d377fe700 1 --2- 172.21.15.62:0/3909837947 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d3813f250 0x7f6d380ac380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.198+0000 7f6d377fe700 1 -- 172.21.15.62:0/3909837947 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6d380ad610 msgr2=0x7f6d3812efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:17.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.198+0000 7f6d377fe700 1 --2- 172.21.15.62:0/3909837947 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6d380ad610 0x7f6d3812efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.198+0000 7f6d377fe700 1 -- 172.21.15.62:0/3909837947 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2800b1e0 con 0x7f6d380b0e00 2021-12-17T18:20:17.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.198+0000 7f6d377fe700 1 --2- 172.21.15.62:0/3909837947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d380b0e00 0x7f6d380abe90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f6d28002f70 tx=0x7f6d28015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:17.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.198+0000 7f6d357fa700 1 -- 172.21.15.62:0/3909837947 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d28006b40 con 0x7f6d380b0e00 2021-12-17T18:20:17.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.198+0000 7f6d357fa700 1 -- 172.21.15.62:0/3909837947 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2800d940 con 0x7f6d380b0e00 2021-12-17T18:20:17.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.198+0000 7f6d3e914700 1 -- 172.21.15.62:0/3909837947 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d381425c0 con 0x7f6d380b0e00 2021-12-17T18:20:17.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.198+0000 7f6d357fa700 1 -- 172.21.15.62:0/3909837947 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d28011d30 con 0x7f6d380b0e00 2021-12-17T18:20:17.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.198+0000 7f6d3e914700 1 -- 172.21.15.62:0/3909837947 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d38064c30 con 0x7f6d380b0e00 2021-12-17T18:20:17.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.198+0000 7f6d3e914700 1 -- 172.21.15.62:0/3909837947 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d38150770 con 0x7f6d380b0e00 2021-12-17T18:20:17.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.198+0000 7f6d357fa700 1 -- 172.21.15.62:0/3909837947 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6d28025030 con 0x7f6d380b0e00 2021-12-17T18:20:17.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.198+0000 7f6d357fa700 1 --2- 172.21.15.62:0/3909837947 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d1c0534f0 0x7f6d1c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:17.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.198+0000 7f6d357fa700 1 -- 172.21.15.62:0/3909837947 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6d2806caa0 con 0x7f6d380b0e00 2021-12-17T18:20:17.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.202+0000 7f6d37fff700 1 --2- 172.21.15.62:0/3909837947 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d1c0534f0 0x7f6d1c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:17.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.202+0000 7f6d37fff700 1 --2- 172.21.15.62:0/3909837947 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d1c0534f0 0x7f6d1c0559b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f6d2000c000 tx=0x7f6d20008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:17.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.206+0000 7f6d357fa700 1 -- 172.21.15.62:0/3909837947 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6d28043c00 con 0x7f6d380b0e00 2021-12-17T18:20:17.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.326+0000 7f6d3e914700 1 -- 172.21.15.62:0/3909837947 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d380b1f20 con 0x7f6d380b0e00 2021-12-17T18:20:17.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.326+0000 7f6d357fa700 1 -- 172.21.15.62:0/3909837947 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16112 (secure 0 0 0) 0x7f6d28023020 con 0x7f6d380b0e00 2021-12-17T18:20:17.335 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:17.335 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":41,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:20:16.800807+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:20:15.333250+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-12-17T18:20:16.462772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:20:17.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.330+0000 7f6d3e914700 1 -- 172.21.15.62:0/3909837947 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d1c0534f0 msgr2=0x7f6d1c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.330+0000 7f6d3e914700 1 --2- 172.21.15.62:0/3909837947 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d1c0534f0 0x7f6d1c0559b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f6d2000c000 tx=0x7f6d20008040).stop 2021-12-17T18:20:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.330+0000 7f6d3e914700 1 -- 172.21.15.62:0/3909837947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d380b0e00 msgr2=0x7f6d380abe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.330+0000 7f6d3e914700 1 --2- 172.21.15.62:0/3909837947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d380b0e00 0x7f6d380abe90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f6d28002f70 tx=0x7f6d28015000).stop 2021-12-17T18:20:17.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.330+0000 7f6d3e914700 1 -- 172.21.15.62:0/3909837947 shutdown_connections 2021-12-17T18:20:17.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.330+0000 7f6d3e914700 1 --2- 172.21.15.62:0/3909837947 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6d1c0534f0 0x7f6d1c0559b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.330+0000 7f6d3e914700 1 --2- 172.21.15.62:0/3909837947 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6d3813f250 0x7f6d380ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.330+0000 7f6d3e914700 1 --2- 172.21.15.62:0/3909837947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d380b0e00 0x7f6d380abe90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.330+0000 7f6d3e914700 1 --2- 172.21.15.62:0/3909837947 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6d380ad610 0x7f6d3812efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.330+0000 7f6d3e914700 1 -- 172.21.15.62:0/3909837947 >> 172.21.15.62:0/3909837947 conn(0x7f6d3805c750 msgr2=0x7f6d380aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:17.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.330+0000 7f6d3e914700 1 -- 172.21.15.62:0/3909837947 shutdown_connections 2021-12-17T18:20:17.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.330+0000 7f6d3e914700 1 -- 172.21.15.62:0/3909837947 wait complete. 2021-12-17T18:20:17.348 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-12-17T18:20:17.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.450+0000 7f9f6f59e700 1 Processor -- start 2021-12-17T18:20:17.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.450+0000 7f9f6f59e700 1 -- start start 2021-12-17T18:20:17.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6f59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9f700b1260 0x7f9f70063ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:17.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f70061670 0x7f9f700621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:17.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6f59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f70143dc0 con 0x7f9f70063b00 2021-12-17T18:20:17.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6f59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f70061b20 con 0x7f9f700b1260 2021-12-17T18:20:17.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700b1b90 con 0x7f9f70061670 2021-12-17T18:20:17.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f67fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9f700b1260 0x7f9f70063ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:17.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6e59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9f70063b00 0x7f9f7013cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33544/0 (socket says 172.21.15.62:33544) 2021-12-17T18:20:17.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6e59c700 1 -- 172.21.15.62:0/365606849 learned_addr learned my addr 172.21.15.62:0/365606849 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:17.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6ed9d700 1 --2- 172.21.15.62:0/365606849 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f70061670 0x7f9f700621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:17.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f67fff700 1 -- 172.21.15.62:0/365606849 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f70061670 msgr2=0x7f9f700621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:17.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f67fff700 1 --2- 172.21.15.62:0/365606849 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f70061670 0x7f9f700621a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f67fff700 1 -- 172.21.15.62:0/365606849 >> v1:172.21.15.62:6789/0 conn(0x7f9f70063b00 legacy=0x7f9f7013cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:17.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f67fff700 1 -- 172.21.15.62:0/365606849 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f70061d00 con 0x7f9f700b1260 2021-12-17T18:20:17.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6dd9b700 1 -- 172.21.15.62:0/365606849 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015964821 0 0) 0x7f9f70143dc0 con 0x7f9f70063b00 2021-12-17T18:20:17.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f67fff700 1 --2- 172.21.15.62:0/365606849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f700b1260 0x7f9f70063ee0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f9f58002f70 tx=0x7f9f58006df0).ready entity=mon.0 client_cookie=a6da5d13f8c2dc1f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:17.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6dd9b700 1 -- 172.21.15.62:0/365606849 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f5800d570 con 0x7f9f700b1260 2021-12-17T18:20:17.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6dd9b700 1 -- 172.21.15.62:0/365606849 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f58000e90 con 0x7f9f700b1260 2021-12-17T18:20:17.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6dd9b700 1 -- 172.21.15.62:0/365606849 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f5800d8c0 con 0x7f9f700b1260 2021-12-17T18:20:17.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6f59e700 1 -- 172.21.15.62:0/365606849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f700b1260 msgr2=0x7f9f70063ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:17.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6f59e700 1 --2- 172.21.15.62:0/365606849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f700b1260 0x7f9f70063ee0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f9f58002f70 tx=0x7f9f58006df0).stop 2021-12-17T18:20:17.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6f59e700 1 -- 172.21.15.62:0/365606849 shutdown_connections 2021-12-17T18:20:17.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6f59e700 1 --2- 172.21.15.62:0/365606849 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f70061670 0x7f9f700621a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6f59e700 1 --2- 172.21.15.62:0/365606849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f700b1260 0x7f9f70063ee0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6f59e700 1 -- 172.21.15.62:0/365606849 >> 172.21.15.62:0/365606849 conn(0x7f9f70060a50 msgr2=0x7f9f7005bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:17.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6f59e700 1 -- 172.21.15.62:0/365606849 shutdown_connections 2021-12-17T18:20:17.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.454+0000 7f9f6f59e700 1 -- 172.21.15.62:0/365606849 wait complete. 2021-12-17T18:20:17.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6f59e700 1 Processor -- start 2021-12-17T18:20:17.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6f59e700 1 -- start start 2021-12-17T18:20:17.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f70061670 0x7f9f70141400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:17.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6f59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9f70063b00 0x7f9f70065990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:17.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f700b1260 0x7f9f701562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:17.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f70065e80 con 0x7f9f700b1260 2021-12-17T18:20:17.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6f59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f701567b0 con 0x7f9f70063b00 2021-12-17T18:20:17.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f701558e0 con 0x7f9f70061670 2021-12-17T18:20:17.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f700b1260 0x7f9f701562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:17.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f700b1260 0x7f9f701562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49974/0 (socket says 172.21.15.62:49974) 2021-12-17T18:20:17.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6ed9d700 1 -- 172.21.15.62:0/337862003 learned_addr learned my addr 172.21.15.62:0/337862003 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:17.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6e59c700 1 --2- 172.21.15.62:0/337862003 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f70061670 0x7f9f70141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:17.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f67fff700 1 --2- 172.21.15.62:0/337862003 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9f70063b00 0x7f9f70065990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:17.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6ed9d700 1 -- 172.21.15.62:0/337862003 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f70061670 msgr2=0x7f9f70141400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:17.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6ed9d700 1 --2- 172.21.15.62:0/337862003 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f70061670 0x7f9f70141400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6ed9d700 1 -- 172.21.15.62:0/337862003 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9f70063b00 msgr2=0x7f9f70065990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:17.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6ed9d700 1 --2- 172.21.15.62:0/337862003 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9f70063b00 0x7f9f70065990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:17.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6ed9d700 1 -- 172.21.15.62:0/337862003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5800b180 con 0x7f9f700b1260 2021-12-17T18:20:17.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6ed9d700 1 --2- 172.21.15.62:0/337862003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f700b1260 0x7f9f701562c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f9f68006e00 tx=0x7f9f680091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:17.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f677fe700 1 -- 172.21.15.62:0/337862003 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f6800c850 con 0x7f9f700b1260 2021-12-17T18:20:17.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f677fe700 1 -- 172.21.15.62:0/337862003 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6800c9b0 con 0x7f9f700b1260 2021-12-17T18:20:17.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6f59e700 1 -- 172.21.15.62:0/337862003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f70155b80 con 0x7f9f700b1260 2021-12-17T18:20:17.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f677fe700 1 -- 172.21.15.62:0/337862003 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f6800cd10 con 0x7f9f700b1260 2021-12-17T18:20:17.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.458+0000 7f9f6f59e700 1 -- 172.21.15.62:0/337862003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f70144700 con 0x7f9f700b1260 2021-12-17T18:20:17.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.462+0000 7f9f6f59e700 1 -- 172.21.15.62:0/337862003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f701439c0 con 0x7f9f700b1260 2021-12-17T18:20:17.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.462+0000 7f9f677fe700 1 -- 172.21.15.62:0/337862003 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9f680123f0 con 0x7f9f700b1260 2021-12-17T18:20:17.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.462+0000 7f9f677fe700 1 --2- 172.21.15.62:0/337862003 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f540536a0 0x7f9f54055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:17.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.462+0000 7f9f677fe700 1 -- 172.21.15.62:0/337862003 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9f6806bdc0 con 0x7f9f700b1260 2021-12-17T18:20:17.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.462+0000 7f9f6e59c700 1 --2- 172.21.15.62:0/337862003 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f540536a0 0x7f9f54055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:17.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.462+0000 7f9f6e59c700 1 --2- 172.21.15.62:0/337862003 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f540536a0 0x7f9f54055b60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f9f6000b000 tx=0x7f9f60009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:17.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.470+0000 7f9f677fe700 1 -- 172.21.15.62:0/337862003 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9f68042db0 con 0x7f9f700b1260 2021-12-17T18:20:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:17.638+0000 7f9f6f59e700 1 -- 172.21.15.62:0/337862003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9f700573d0 con 0x7f9f700b1260 2021-12-17T18:20:18.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.582+0000 7f9f677fe700 1 -- 172.21.15.62:0/337862003 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9f680463d0 con 0x7f9f700b1260 2021-12-17T18:20:18.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.586+0000 7f9f6f59e700 1 -- 172.21.15.62:0/337862003 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f540536a0 msgr2=0x7f9f54055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:18.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.586+0000 7f9f6f59e700 1 --2- 172.21.15.62:0/337862003 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f540536a0 0x7f9f54055b60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f9f6000b000 tx=0x7f9f60009040).stop 2021-12-17T18:20:18.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.586+0000 7f9f6f59e700 1 -- 172.21.15.62:0/337862003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f700b1260 msgr2=0x7f9f701562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:18.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.586+0000 7f9f6f59e700 1 --2- 172.21.15.62:0/337862003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f700b1260 0x7f9f701562c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f9f68006e00 tx=0x7f9f680091d0).stop 2021-12-17T18:20:18.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.586+0000 7f9f6f59e700 1 -- 172.21.15.62:0/337862003 shutdown_connections 2021-12-17T18:20:18.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.586+0000 7f9f6f59e700 1 --2- 172.21.15.62:0/337862003 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f540536a0 0x7f9f54055b60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:18.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.586+0000 7f9f6f59e700 1 --2- 172.21.15.62:0/337862003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f700b1260 0x7f9f701562c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:18.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.586+0000 7f9f6f59e700 1 --2- 172.21.15.62:0/337862003 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9f70063b00 0x7f9f70065990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:18.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.586+0000 7f9f6f59e700 1 --2- 172.21.15.62:0/337862003 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f70061670 0x7f9f70141400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:18.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.586+0000 7f9f6f59e700 1 -- 172.21.15.62:0/337862003 >> 172.21.15.62:0/337862003 conn(0x7f9f70060a50 msgr2=0x7f9f700b3370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:18.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.586+0000 7f9f6f59e700 1 -- 172.21.15.62:0/337862003 shutdown_connections 2021-12-17T18:20:18.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.586+0000 7f9f6f59e700 1 -- 172.21.15.62:0/337862003 wait complete. 2021-12-17T18:20:18.610 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:20:18.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.714+0000 7ff5a9791700 1 Processor -- start 2021-12-17T18:20:18.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.714+0000 7ff5a9791700 1 -- start start 2021-12-17T18:20:18.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a9791700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff5a40b3a40 0x7ff5a40b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:18.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a9791700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff5a40b07d0 0x7ff5a41432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:18.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a9791700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a40b3e20 con 0x7ff5a4067870 2021-12-17T18:20:18.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a9791700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a40af900 con 0x7ff5a40b07d0 2021-12-17T18:20:18.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a9791700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a40afba0 con 0x7ff5a40b3a40 2021-12-17T18:20:18.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff59bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff5a40b07d0 0x7ff5a41432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:18.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff59bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff5a40b07d0 0x7ff5a41432c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49980/0 (socket says 172.21.15.62:49980) 2021-12-17T18:20:18.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a8f90700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff5a4067870 0x7ff5a41437b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33562/0 (socket says 172.21.15.62:33562) 2021-12-17T18:20:18.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff59bfff700 1 -- 172.21.15.62:0/3625596081 learned_addr learned my addr 172.21.15.62:0/3625596081 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:18.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a3fff700 1 --2- 172.21.15.62:0/3625596081 >> v2:172.21.15.109:3300/0 conn(0x7ff5a40b3a40 0x7ff5a40b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:18.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff59bfff700 1 -- 172.21.15.62:0/3625596081 >> v2:172.21.15.109:3300/0 conn(0x7ff5a40b3a40 msgr2=0x7ff5a40b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:18.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff59bfff700 1 --2- 172.21.15.62:0/3625596081 >> v2:172.21.15.109:3300/0 conn(0x7ff5a40b3a40 0x7ff5a40b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:18.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff59bfff700 1 -- 172.21.15.62:0/3625596081 >> v1:172.21.15.62:6789/0 conn(0x7ff5a4067870 legacy=0x7ff5a41437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:18.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff59bfff700 1 -- 172.21.15.62:0/3625596081 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a40afe40 con 0x7ff5a40b07d0 2021-12-17T18:20:18.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff59bfff700 1 --2- 172.21.15.62:0/3625596081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5a40b07d0 0x7ff5a41432c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7ff58c002f70 tx=0x7ff58c006eb0).ready entity=mon.0 client_cookie=d0d827c1fad72aca server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:18.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a37fe700 1 -- 172.21.15.62:0/3625596081 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff58c00f9c0 con 0x7ff5a40b07d0 2021-12-17T18:20:18.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a37fe700 1 -- 172.21.15.62:0/3625596081 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c000e90 con 0x7ff5a40b07d0 2021-12-17T18:20:18.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a37fe700 1 -- 172.21.15.62:0/3625596081 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff58c00fd50 con 0x7ff5a40b07d0 2021-12-17T18:20:18.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a9791700 1 -- 172.21.15.62:0/3625596081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5a40b07d0 msgr2=0x7ff5a41432c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:18.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a9791700 1 --2- 172.21.15.62:0/3625596081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5a40b07d0 0x7ff5a41432c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7ff58c002f70 tx=0x7ff58c006eb0).stop 2021-12-17T18:20:18.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a9791700 1 -- 172.21.15.62:0/3625596081 shutdown_connections 2021-12-17T18:20:18.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a9791700 1 --2- 172.21.15.62:0/3625596081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5a40b07d0 0x7ff5a41432c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:18.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a9791700 1 --2- 172.21.15.62:0/3625596081 >> v2:172.21.15.109:3300/0 conn(0x7ff5a40b3a40 0x7ff5a40b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:18.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a9791700 1 -- 172.21.15.62:0/3625596081 >> 172.21.15.62:0/3625596081 conn(0x7ff5a40b7020 msgr2=0x7ff5a40b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:18.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a9791700 1 -- 172.21.15.62:0/3625596081 shutdown_connections 2021-12-17T18:20:18.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.718+0000 7ff5a9791700 1 -- 172.21.15.62:0/3625596081 wait complete. 2021-12-17T18:20:18.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a9791700 1 Processor -- start 2021-12-17T18:20:18.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a9791700 1 -- start start 2021-12-17T18:20:18.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a9791700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff5a4067870 0x7ff5a413a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:18.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a9791700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff5a40b07d0 0x7ff5a40667d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:18.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a9791700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5a40b3a40 0x7ff5a4066cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:18.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a9791700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4143100 con 0x7ff5a40b3a40 2021-12-17T18:20:18.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a9791700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4142ae0 con 0x7ff5a4067870 2021-12-17T18:20:18.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a9791700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4142d80 con 0x7ff5a40b07d0 2021-12-17T18:20:18.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a8f90700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5a40b3a40 0x7ff5a4066cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:18.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a3fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff5a4067870 0x7ff5a413a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:18.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a8f90700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5a40b3a40 0x7ff5a4066cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49988/0 (socket says 172.21.15.62:49988) 2021-12-17T18:20:18.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a8f90700 1 -- 172.21.15.62:0/1286288931 learned_addr learned my addr 172.21.15.62:0/1286288931 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:18.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff59bfff700 1 --2- 172.21.15.62:0/1286288931 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff5a40b07d0 0x7ff5a40667d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:18.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a8f90700 1 -- 172.21.15.62:0/1286288931 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff5a40b07d0 msgr2=0x7ff5a40667d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:18.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a8f90700 1 --2- 172.21.15.62:0/1286288931 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff5a40b07d0 0x7ff5a40667d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:18.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a8f90700 1 -- 172.21.15.62:0/1286288931 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff5a4067870 msgr2=0x7ff5a413a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:18.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a8f90700 1 --2- 172.21.15.62:0/1286288931 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff5a4067870 0x7ff5a413a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:18.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a8f90700 1 -- 172.21.15.62:0/1286288931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c00b1e0 con 0x7ff5a40b3a40 2021-12-17T18:20:18.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a8f90700 1 --2- 172.21.15.62:0/1286288931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5a40b3a40 0x7ff5a4066cc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7ff5a40ae600 tx=0x7ff59c007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:18.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a1ffb700 1 -- 172.21.15.62:0/1286288931 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff59c005ae0 con 0x7ff5a40b3a40 2021-12-17T18:20:18.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.722+0000 7ff5a1ffb700 1 -- 172.21.15.62:0/1286288931 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c005c40 con 0x7ff5a40b3a40 2021-12-17T18:20:18.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.726+0000 7ff5a9791700 1 -- 172.21.15.62:0/1286288931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a413e8d0 con 0x7ff5a40b3a40 2021-12-17T18:20:18.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.726+0000 7ff5a1ffb700 1 -- 172.21.15.62:0/1286288931 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff59c0070d0 con 0x7ff5a40b3a40 2021-12-17T18:20:18.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.726+0000 7ff5a9791700 1 -- 172.21.15.62:0/1286288931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a4064f20 con 0x7ff5a40b3a40 2021-12-17T18:20:18.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.726+0000 7ff5a9791700 1 -- 172.21.15.62:0/1286288931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a40ad740 con 0x7ff5a40b3a40 2021-12-17T18:20:18.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.726+0000 7ff5a1ffb700 1 -- 172.21.15.62:0/1286288931 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff59c01a060 con 0x7ff5a40b3a40 2021-12-17T18:20:18.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.726+0000 7ff5a1ffb700 1 --2- 172.21.15.62:0/1286288931 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff5880535b0 0x7ff588055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:18.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.726+0000 7ff5a1ffb700 1 -- 172.21.15.62:0/1286288931 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff59c06b3a0 con 0x7ff5a40b3a40 2021-12-17T18:20:18.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.726+0000 7ff5a3fff700 1 --2- 172.21.15.62:0/1286288931 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff5880535b0 0x7ff588055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:18.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.726+0000 7ff5a3fff700 1 --2- 172.21.15.62:0/1286288931 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff5880535b0 0x7ff588055a70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7ff59400b000 tx=0x7ff594006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:18.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.730+0000 7ff5a1ffb700 1 -- 172.21.15.62:0/1286288931 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff59c0423f0 con 0x7ff5a40b3a40 2021-12-17T18:20:18.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.894+0000 7ff5a9791700 1 -- 172.21.15.62:0/1286288931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5a40573d0 con 0x7ff5a40b3a40 2021-12-17T18:20:18.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.894+0000 7ff5a1ffb700 1 -- 172.21.15.62:0/1286288931 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2135 (secure 0 0 0) 0x7ff59c018070 con 0x7ff5a40b3a40 2021-12-17T18:20:18.900 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:18.901 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/16961477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":16961477},{"type":"v1","addr":"172.21.15.109:6835","nonce":16961477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:20:16.801183+0000","modified":"2021-12-17T18:20:18.581684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/3317956606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3317956606},{"type":"v1","addr":"172.21.15.62:6833","nonce":3317956606}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-12-17T18:20:18.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.898+0000 7ff5a9791700 1 -- 172.21.15.62:0/1286288931 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff5880535b0 msgr2=0x7ff588055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:18.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.898+0000 7ff5a9791700 1 --2- 172.21.15.62:0/1286288931 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff5880535b0 0x7ff588055a70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7ff59400b000 tx=0x7ff594006df0).stop 2021-12-17T18:20:18.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.898+0000 7ff5a9791700 1 -- 172.21.15.62:0/1286288931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5a40b3a40 msgr2=0x7ff5a4066cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:18.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.898+0000 7ff5a9791700 1 --2- 172.21.15.62:0/1286288931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5a40b3a40 0x7ff5a4066cc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7ff5a40ae600 tx=0x7ff59c007f10).stop 2021-12-17T18:20:18.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.898+0000 7ff5a9791700 1 -- 172.21.15.62:0/1286288931 shutdown_connections 2021-12-17T18:20:18.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.898+0000 7ff5a9791700 1 --2- 172.21.15.62:0/1286288931 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff5880535b0 0x7ff588055a70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:18.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.898+0000 7ff5a9791700 1 --2- 172.21.15.62:0/1286288931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5a40b3a40 0x7ff5a4066cc0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:18.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.898+0000 7ff5a9791700 1 --2- 172.21.15.62:0/1286288931 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff5a40b07d0 0x7ff5a40667d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:18.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.898+0000 7ff5a9791700 1 --2- 172.21.15.62:0/1286288931 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff5a4067870 0x7ff5a413a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:18.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.898+0000 7ff5a9791700 1 -- 172.21.15.62:0/1286288931 >> 172.21.15.62:0/1286288931 conn(0x7ff5a40b7020 msgr2=0x7ff5a40b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:18.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.898+0000 7ff5a9791700 1 -- 172.21.15.62:0/1286288931 shutdown_connections 2021-12-17T18:20:18.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:18.898+0000 7ff5a9791700 1 -- 172.21.15.62:0/1286288931 wait complete. 2021-12-17T18:20:18.907 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2021-12-17T18:20:18.919 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:20:19.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cef59e700 1 Processor -- start 2021-12-17T18:20:19.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cef59e700 1 -- start start 2021-12-17T18:20:19.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cef59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cf00b3a40 0x7f2cf00b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cef59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2cf00b2b60 0x7f2cf0143760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cef59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f2cf0143c50 0x7f2cf00b1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cef59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf0143090 con 0x7f2cf00b2b60 2021-12-17T18:20:19.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cef59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf00b3e20 con 0x7f2cf0143c50 2021-12-17T18:20:19.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cef59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf0146550 con 0x7f2cf00b3a40 2021-12-17T18:20:19.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cedd9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2cf00b2b60 0x7f2cf0143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cedd9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2cf00b2b60 0x7f2cf0143760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49992/0 (socket says 172.21.15.62:49992) 2021-12-17T18:20:19.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cedd9b700 1 -- 172.21.15.62:0/3918174097 learned_addr learned my addr 172.21.15.62:0/3918174097 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:19.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cee59c700 1 --2- 172.21.15.62:0/3918174097 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cf00b3a40 0x7f2cf00b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2ceed9d700 1 --2- 172.21.15.62:0/3918174097 >> v2:172.21.15.109:3300/0 conn(0x7f2cf0143c50 0x7f2cf00b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cedd9b700 1 -- 172.21.15.62:0/3918174097 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cf00b3a40 msgr2=0x7f2cf00b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:19.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cedd9b700 1 --2- 172.21.15.62:0/3918174097 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cf00b3a40 0x7f2cf00b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cedd9b700 1 -- 172.21.15.62:0/3918174097 >> v2:172.21.15.109:3300/0 conn(0x7f2cf0143c50 msgr2=0x7f2cf00b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:19.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cedd9b700 1 --2- 172.21.15.62:0/3918174097 >> v2:172.21.15.109:3300/0 conn(0x7f2cf0143c50 0x7f2cf00b1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cedd9b700 1 -- 172.21.15.62:0/3918174097 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf01432c0 con 0x7f2cf00b2b60 2021-12-17T18:20:19.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2ceed9d700 1 --2- 172.21.15.62:0/3918174097 >> v2:172.21.15.109:3300/0 conn(0x7f2cf0143c50 0x7f2cf00b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:19.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2cedd9b700 1 --2- 172.21.15.62:0/3918174097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cf00b2b60 0x7f2cf0143760 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f2cf0142fb0 tx=0x7f2ce4006eb0).ready entity=mon.0 client_cookie=147128d6509be820 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:19.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2ced59a700 1 -- 172.21.15.62:0/3918174097 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ce400d570 con 0x7f2cf00b2b60 2021-12-17T18:20:19.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2ced59a700 1 -- 172.21.15.62:0/3918174097 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce4000e90 con 0x7f2cf00b2b60 2021-12-17T18:20:19.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.014+0000 7f2ced59a700 1 -- 172.21.15.62:0/3918174097 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ce400d900 con 0x7f2cf00b2b60 2021-12-17T18:20:19.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.018+0000 7f2cef59e700 1 -- 172.21.15.62:0/3918174097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cf00b2b60 msgr2=0x7f2cf0143760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.018+0000 7f2cef59e700 1 --2- 172.21.15.62:0/3918174097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cf00b2b60 0x7f2cf0143760 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f2cf0142fb0 tx=0x7f2ce4006eb0).stop 2021-12-17T18:20:19.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.018+0000 7f2cef59e700 1 -- 172.21.15.62:0/3918174097 shutdown_connections 2021-12-17T18:20:19.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.018+0000 7f2cef59e700 1 --2- 172.21.15.62:0/3918174097 >> v2:172.21.15.109:3300/0 conn(0x7f2cf0143c50 0x7f2cf00b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.018+0000 7f2cef59e700 1 --2- 172.21.15.62:0/3918174097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cf00b2b60 0x7f2cf0143760 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.018+0000 7f2cef59e700 1 --2- 172.21.15.62:0/3918174097 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cf00b3a40 0x7f2cf00b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.018+0000 7f2cef59e700 1 -- 172.21.15.62:0/3918174097 >> 172.21.15.62:0/3918174097 conn(0x7f2cf00b7020 msgr2=0x7f2cf00b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:19.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.018+0000 7f2cef59e700 1 -- 172.21.15.62:0/3918174097 shutdown_connections 2021-12-17T18:20:19.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.018+0000 7f2cef59e700 1 -- 172.21.15.62:0/3918174097 wait complete. 2021-12-17T18:20:19.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.018+0000 7f2cef59e700 1 Processor -- start 2021-12-17T18:20:19.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.018+0000 7f2cef59e700 1 -- start start 2021-12-17T18:20:19.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.018+0000 7f2cef59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cf00b2b60 0x7f2cf00aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.018+0000 7f2cef59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cf00b3a40 0x7f2cf0152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.018+0000 7f2cef59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cf0143c50 0x7f2cf0149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.018+0000 7f2cef59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf012da30 con 0x7f2cf00b3a40 2021-12-17T18:20:19.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.018+0000 7f2cef59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf0148f10 con 0x7f2cf0143c50 2021-12-17T18:20:19.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.018+0000 7f2cef59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf00af760 con 0x7f2cf00b2b60 2021-12-17T18:20:19.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.022+0000 7f2cedd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cf00b3a40 0x7f2cf0152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.022+0000 7f2cedd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cf00b3a40 0x7f2cf0152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50000/0 (socket says 172.21.15.62:50000) 2021-12-17T18:20:19.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.022+0000 7f2cedd9b700 1 -- 172.21.15.62:0/3217298032 learned_addr learned my addr 172.21.15.62:0/3217298032 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:19.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.022+0000 7f2cee59c700 1 --2- 172.21.15.62:0/3217298032 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cf00b2b60 0x7f2cf00aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.022+0000 7f2ceed9d700 1 --2- 172.21.15.62:0/3217298032 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cf0143c50 0x7f2cf0149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.022+0000 7f2cedd9b700 1 -- 172.21.15.62:0/3217298032 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cf00b2b60 msgr2=0x7f2cf00aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.022+0000 7f2cedd9b700 1 --2- 172.21.15.62:0/3217298032 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cf00b2b60 0x7f2cf00aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.022+0000 7f2cedd9b700 1 -- 172.21.15.62:0/3217298032 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cf0143c50 msgr2=0x7f2cf0149360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.022+0000 7f2cedd9b700 1 --2- 172.21.15.62:0/3217298032 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cf0143c50 0x7f2cf0149360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.022+0000 7f2cedd9b700 1 -- 172.21.15.62:0/3217298032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce400b1e0 con 0x7f2cf00b3a40 2021-12-17T18:20:19.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.022+0000 7f2cedd9b700 1 --2- 172.21.15.62:0/3217298032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cf00b3a40 0x7f2cf0152450 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f2cf0142fb0 tx=0x7f2ce4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:19.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.022+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/3217298032 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ce40116e0 con 0x7f2cf00b3a40 2021-12-17T18:20:19.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.022+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/3217298032 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce4011840 con 0x7f2cf00b3a40 2021-12-17T18:20:19.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.022+0000 7f2cef59e700 1 -- 172.21.15.62:0/3217298032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf012dc60 con 0x7f2cf00b3a40 2021-12-17T18:20:19.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.022+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/3217298032 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ce4011ba0 con 0x7f2cf00b3a40 2021-12-17T18:20:19.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.022+0000 7f2cef59e700 1 -- 172.21.15.62:0/3217298032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf0152ae0 con 0x7f2cf00b3a40 2021-12-17T18:20:19.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.022+0000 7f2cef59e700 1 -- 172.21.15.62:0/3217298032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf01467f0 con 0x7f2cf00b3a40 2021-12-17T18:20:19.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.026+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/3217298032 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2ce4025030 con 0x7f2cf00b3a40 2021-12-17T18:20:19.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.026+0000 7f2cdf7fe700 1 --2- 172.21.15.62:0/3217298032 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ccc053610 0x7f2ccc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.026+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/3217298032 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2ce406cba0 con 0x7f2cf00b3a40 2021-12-17T18:20:19.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.026+0000 7f2cee59c700 1 --2- 172.21.15.62:0/3217298032 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ccc053610 0x7f2ccc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.026+0000 7f2cee59c700 1 --2- 172.21.15.62:0/3217298032 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ccc053610 0x7f2ccc055ad0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f2ce000b000 tx=0x7f2ce00091d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:19.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.034+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/3217298032 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2ce4043bf0 con 0x7f2cf00b3a40 2021-12-17T18:20:19.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.158+0000 7f2cef59e700 1 -- 172.21.15.62:0/3217298032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cf00573d0 con 0x7f2cf00b3a40 2021-12-17T18:20:19.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.162+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/3217298032 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f2ce4023020 con 0x7f2cf00b3a40 2021-12-17T18:20:19.168 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:19.169 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":42,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:20:17.803894+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:20:15.333250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-12-17T18:20:16.462772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:20:19.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.162+0000 7f2cef59e700 1 -- 172.21.15.62:0/3217298032 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ccc053610 msgr2=0x7f2ccc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.162+0000 7f2cef59e700 1 --2- 172.21.15.62:0/3217298032 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ccc053610 0x7f2ccc055ad0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f2ce000b000 tx=0x7f2ce00091d0).stop 2021-12-17T18:20:19.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.162+0000 7f2cef59e700 1 -- 172.21.15.62:0/3217298032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cf00b3a40 msgr2=0x7f2cf0152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.162+0000 7f2cef59e700 1 --2- 172.21.15.62:0/3217298032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cf00b3a40 0x7f2cf0152450 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f2cf0142fb0 tx=0x7f2ce4015000).stop 2021-12-17T18:20:19.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.162+0000 7f2cef59e700 1 -- 172.21.15.62:0/3217298032 shutdown_connections 2021-12-17T18:20:19.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.162+0000 7f2cef59e700 1 --2- 172.21.15.62:0/3217298032 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ccc053610 0x7f2ccc055ad0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.162+0000 7f2cef59e700 1 --2- 172.21.15.62:0/3217298032 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cf0143c50 0x7f2cf0149360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.162+0000 7f2cef59e700 1 --2- 172.21.15.62:0/3217298032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cf00b3a40 0x7f2cf0152450 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.162+0000 7f2cef59e700 1 --2- 172.21.15.62:0/3217298032 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cf00b2b60 0x7f2cf00aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.162+0000 7f2cef59e700 1 -- 172.21.15.62:0/3217298032 >> 172.21.15.62:0/3217298032 conn(0x7f2cf00b7020 msgr2=0x7f2cf0061b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:19.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.162+0000 7f2cef59e700 1 -- 172.21.15.62:0/3217298032 shutdown_connections 2021-12-17T18:20:19.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.162+0000 7f2cef59e700 1 -- 172.21.15.62:0/3217298032 wait complete. 2021-12-17T18:20:19.182 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:20:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.290+0000 7f2cc4f56700 1 Processor -- start 2021-12-17T18:20:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.290+0000 7f2cc4f56700 1 -- start start 2021-12-17T18:20:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cc4f56700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f2cc00af770 0x7f2cc014de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cc4f56700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc00b6600 con 0x7f2cc005fa70 2021-12-17T18:20:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cc4f56700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc00627d0 con 0x7f2cc005bcd0 2021-12-17T18:20:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cc4f56700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc00ac470 con 0x7f2cc00af770 2021-12-17T18:20:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cbf7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2cc005fa70 0x7f2cc00b0e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33586/0 (socket says 172.21.15.62:33586) 2021-12-17T18:20:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cbf7fe700 1 -- 172.21.15.62:0/759924571 learned_addr learned my addr 172.21.15.62:0/759924571 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cbffff700 1 --2- 172.21.15.62:0/759924571 >> v2:172.21.15.109:3300/0 conn(0x7f2cc00af770 0x7f2cc014de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cbe7fc700 1 -- 172.21.15.62:0/759924571 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223313330 0 0) 0x7f2cc00b6600 con 0x7f2cc005fa70 2021-12-17T18:20:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cbe7fc700 1 -- 172.21.15.62:0/759924571 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cac003260 con 0x7f2cc005fa70 2021-12-17T18:20:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cbffff700 1 -- 172.21.15.62:0/759924571 >> v1:172.21.15.109:6789/0 conn(0x7f2cc005bcd0 legacy=0x7f2cc00ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cbffff700 1 -- 172.21.15.62:0/759924571 >> v1:172.21.15.62:6789/0 conn(0x7f2cc005fa70 legacy=0x7f2cc00b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cbffff700 1 -- 172.21.15.62:0/759924571 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc005fe50 con 0x7f2cc00af770 2021-12-17T18:20:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cbffff700 1 --2- 172.21.15.62:0/759924571 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cc00af770 0x7f2cc014de20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f2cc00acf50 tx=0x7f2cb80091d0).ready entity=mon.1 client_cookie=c6f303e4dd406a1c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cbe7fc700 1 -- 172.21.15.62:0/759924571 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cb800b680 con 0x7f2cc00af770 2021-12-17T18:20:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cbe7fc700 1 -- 172.21.15.62:0/759924571 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb800b7e0 con 0x7f2cc00af770 2021-12-17T18:20:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cbe7fc700 1 -- 172.21.15.62:0/759924571 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cb800b950 con 0x7f2cc00af770 2021-12-17T18:20:19.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cc4f56700 1 -- 172.21.15.62:0/759924571 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cc00af770 msgr2=0x7f2cc014de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cc4f56700 1 --2- 172.21.15.62:0/759924571 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cc00af770 0x7f2cc014de20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f2cc00acf50 tx=0x7f2cb80091d0).stop 2021-12-17T18:20:19.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cc4f56700 1 -- 172.21.15.62:0/759924571 shutdown_connections 2021-12-17T18:20:19.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cc4f56700 1 --2- 172.21.15.62:0/759924571 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cc00af770 0x7f2cc014de20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cc4f56700 1 -- 172.21.15.62:0/759924571 >> 172.21.15.62:0/759924571 conn(0x7f2cc00b5ae0 msgr2=0x7f2cc00b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:19.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cc4f56700 1 -- 172.21.15.62:0/759924571 shutdown_connections 2021-12-17T18:20:19.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.294+0000 7f2cc4f56700 1 -- 172.21.15.62:0/759924571 wait complete. 2021-12-17T18:20:19.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cc4f56700 1 Processor -- start 2021-12-17T18:20:19.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cc4f56700 1 -- start start 2021-12-17T18:20:19.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cc4f56700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cc005bcd0 0x7f2cc00a3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cc4f56700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc005fa70 0x7f2cc0155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cc4f56700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cc00af770 0x7f2cc0144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cc4f56700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc00a46a0 con 0x7f2cc005fa70 2021-12-17T18:20:19.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cc4f56700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0065540 con 0x7f2cc005bcd0 2021-12-17T18:20:19.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cc4f56700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc00657e0 con 0x7f2cc00af770 2021-12-17T18:20:19.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cbeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc005fa70 0x7f2cc0155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cbeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc005fa70 0x7f2cc0155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50014/0 (socket says 172.21.15.62:50014) 2021-12-17T18:20:19.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cbeffd700 1 -- 172.21.15.62:0/3775972433 learned_addr learned my addr 172.21.15.62:0/3775972433 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:19.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cbf7fe700 1 --2- 172.21.15.62:0/3775972433 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cc005bcd0 0x7f2cc00a3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cbffff700 1 --2- 172.21.15.62:0/3775972433 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cc00af770 0x7f2cc0144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cbeffd700 1 -- 172.21.15.62:0/3775972433 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cc00af770 msgr2=0x7f2cc0144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cbeffd700 1 --2- 172.21.15.62:0/3775972433 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cc00af770 0x7f2cc0144080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cbeffd700 1 -- 172.21.15.62:0/3775972433 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cc005bcd0 msgr2=0x7f2cc00a3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cbeffd700 1 --2- 172.21.15.62:0/3775972433 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cc005bcd0 0x7f2cc00a3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cbeffd700 1 -- 172.21.15.62:0/3775972433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb8009470 con 0x7f2cc005fa70 2021-12-17T18:20:19.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cbffff700 1 --2- 172.21.15.62:0/3775972433 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cc00af770 0x7f2cc0144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:19.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cbeffd700 1 --2- 172.21.15.62:0/3775972433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc005fa70 0x7f2cc0155980 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f2cc00aca50 tx=0x7f2cb4007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:19.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cbcff9700 1 -- 172.21.15.62:0/3775972433 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cb4012400 con 0x7f2cc005fa70 2021-12-17T18:20:19.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cbcff9700 1 -- 172.21.15.62:0/3775972433 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb4012560 con 0x7f2cc005fa70 2021-12-17T18:20:19.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cc4f56700 1 -- 172.21.15.62:0/3775972433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc0144570 con 0x7f2cc005fa70 2021-12-17T18:20:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cbcff9700 1 -- 172.21.15.62:0/3775972433 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cb40128c0 con 0x7f2cc005fa70 2021-12-17T18:20:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cc4f56700 1 -- 172.21.15.62:0/3775972433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc0066990 con 0x7f2cc005fa70 2021-12-17T18:20:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.298+0000 7f2cc4f56700 1 -- 172.21.15.62:0/3775972433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc00a4810 con 0x7f2cc005fa70 2021-12-17T18:20:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.302+0000 7f2cbcff9700 1 -- 172.21.15.62:0/3775972433 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2cb4019030 con 0x7f2cc005fa70 2021-12-17T18:20:19.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.302+0000 7f2cbcff9700 1 --2- 172.21.15.62:0/3775972433 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ca00535b0 0x7f2ca0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.302+0000 7f2cbcff9700 1 -- 172.21.15.62:0/3775972433 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2cb406acb0 con 0x7f2cc005fa70 2021-12-17T18:20:19.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.302+0000 7f2cbf7fe700 1 --2- 172.21.15.62:0/3775972433 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ca00535b0 0x7f2ca0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.302+0000 7f2cbf7fe700 1 --2- 172.21.15.62:0/3775972433 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ca00535b0 0x7f2ca0055a70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f2cb000d000 tx=0x7f2cb0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:19.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.306+0000 7f2cbcff9700 1 -- 172.21.15.62:0/3775972433 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2cb4041db0 con 0x7f2cc005fa70 2021-12-17T18:20:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.470+0000 7f2cc4f56700 1 -- 172.21.15.62:0/3775972433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f2cc00b6830 con 0x7f2cc005fa70 2021-12-17T18:20:19.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.478+0000 7f2cbcff9700 1 -- 172.21.15.62:0/3775972433 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2cb40453d0 con 0x7f2cc005fa70 2021-12-17T18:20:19.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.482+0000 7f2cc4f56700 1 -- 172.21.15.62:0/3775972433 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ca00535b0 msgr2=0x7f2ca0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.482+0000 7f2cc4f56700 1 --2- 172.21.15.62:0/3775972433 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ca00535b0 0x7f2ca0055a70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f2cb000d000 tx=0x7f2cb0009040).stop 2021-12-17T18:20:19.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.482+0000 7f2cc4f56700 1 -- 172.21.15.62:0/3775972433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc005fa70 msgr2=0x7f2cc0155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.482+0000 7f2cc4f56700 1 --2- 172.21.15.62:0/3775972433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc005fa70 0x7f2cc0155980 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f2cc00aca50 tx=0x7f2cb4007c50).stop 2021-12-17T18:20:19.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.482+0000 7f2cc4f56700 1 -- 172.21.15.62:0/3775972433 shutdown_connections 2021-12-17T18:20:19.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.482+0000 7f2cc4f56700 1 --2- 172.21.15.62:0/3775972433 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ca00535b0 0x7f2ca0055a70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.482+0000 7f2cc4f56700 1 --2- 172.21.15.62:0/3775972433 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cc00af770 0x7f2cc0144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.482+0000 7f2cc4f56700 1 --2- 172.21.15.62:0/3775972433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc005fa70 0x7f2cc0155980 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.482+0000 7f2cc4f56700 1 --2- 172.21.15.62:0/3775972433 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cc005bcd0 0x7f2cc00a3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.482+0000 7f2cc4f56700 1 -- 172.21.15.62:0/3775972433 >> 172.21.15.62:0/3775972433 conn(0x7f2cc00b5ae0 msgr2=0x7f2cc00b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:19.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.482+0000 7f2cc4f56700 1 -- 172.21.15.62:0/3775972433 shutdown_connections 2021-12-17T18:20:19.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.482+0000 7f2cc4f56700 1 -- 172.21.15.62:0/3775972433 wait complete. 2021-12-17T18:20:19.492 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.0 2021-12-17T18:20:19.503 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:20:19.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.614+0000 7f3977430700 1 Processor -- start 2021-12-17T18:20:19.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.614+0000 7f3977430700 1 -- start start 2021-12-17T18:20:19.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.614+0000 7f3977430700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39701405f0 0x7f3970061390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.614+0000 7f3977430700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f3970064de0 0x7f3970062450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.614+0000 7f3977430700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397005fe50 con 0x7f397005fa70 2021-12-17T18:20:19.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.614+0000 7f3977430700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39700646a0 con 0x7f3970064de0 2021-12-17T18:20:19.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.614+0000 7f3977430700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3970064940 con 0x7f39701405f0 2021-12-17T18:20:19.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.614+0000 7f3975c2d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39701405f0 0x7f3970061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.614+0000 7f3976c2f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f3970064de0 0x7f3970062450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.614+0000 7f3975c2d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39701405f0 0x7f3970061390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:43724/0 (socket says 172.21.15.62:43724) 2021-12-17T18:20:19.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.614+0000 7f3975c2d700 1 -- 172.21.15.62:0/946373331 learned_addr learned my addr 172.21.15.62:0/946373331 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:19.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.614+0000 7f397642e700 1 --1- 172.21.15.62:0/946373331 >> v1:172.21.15.109:6789/0 conn(0x7f397005fa70 0x7f397013fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:49920/0 (socket says 172.21.15.62:49920) 2021-12-17T18:20:19.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.614+0000 7f3975c2d700 1 -- 172.21.15.62:0/946373331 >> v2:172.21.15.109:3300/0 conn(0x7f3970064de0 msgr2=0x7f3970062450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:19.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.614+0000 7f3975c2d700 1 --2- 172.21.15.62:0/946373331 >> v2:172.21.15.109:3300/0 conn(0x7f3970064de0 0x7f3970062450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.614+0000 7f3975c2d700 1 -- 172.21.15.62:0/946373331 >> v1:172.21.15.109:6789/0 conn(0x7f397005fa70 legacy=0x7f397013fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.614+0000 7f3975c2d700 1 -- 172.21.15.62:0/946373331 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3970142e50 con 0x7f39701405f0 2021-12-17T18:20:19.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.614+0000 7f3976c2f700 1 --2- 172.21.15.62:0/946373331 >> v2:172.21.15.109:3300/0 conn(0x7f3970064de0 0x7f3970062450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:20:19.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.618+0000 7f3975c2d700 1 --2- 172.21.15.62:0/946373331 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39701405f0 0x7f3970061390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3960002f70 tx=0x7f3960006eb0).ready entity=mon.2 client_cookie=e57abc0c23b83cfe server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:19.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.618+0000 7f397542c700 1 -- 172.21.15.62:0/946373331 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f396000d570 con 0x7f39701405f0 2021-12-17T18:20:19.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.618+0000 7f397542c700 1 -- 172.21.15.62:0/946373331 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3960000e90 con 0x7f39701405f0 2021-12-17T18:20:19.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.618+0000 7f397542c700 1 -- 172.21.15.62:0/946373331 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f396000d900 con 0x7f39701405f0 2021-12-17T18:20:19.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.618+0000 7f3977430700 1 -- 172.21.15.62:0/946373331 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39701405f0 msgr2=0x7f3970061390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.618+0000 7f3977430700 1 --2- 172.21.15.62:0/946373331 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39701405f0 0x7f3970061390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3960002f70 tx=0x7f3960006eb0).stop 2021-12-17T18:20:19.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.618+0000 7f3977430700 1 -- 172.21.15.62:0/946373331 shutdown_connections 2021-12-17T18:20:19.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.618+0000 7f3977430700 1 --2- 172.21.15.62:0/946373331 >> v2:172.21.15.109:3300/0 conn(0x7f3970064de0 0x7f3970062450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.618+0000 7f3977430700 1 --2- 172.21.15.62:0/946373331 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39701405f0 0x7f3970061390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.618+0000 7f3977430700 1 -- 172.21.15.62:0/946373331 >> 172.21.15.62:0/946373331 conn(0x7f397005bcd0 msgr2=0x7f3970063510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:19.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.618+0000 7f3977430700 1 -- 172.21.15.62:0/946373331 shutdown_connections 2021-12-17T18:20:19.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.618+0000 7f3977430700 1 -- 172.21.15.62:0/946373331 wait complete. 2021-12-17T18:20:19.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.618+0000 7f3977430700 1 Processor -- start 2021-12-17T18:20:19.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.618+0000 7f3977430700 1 -- start start 2021-12-17T18:20:19.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3977430700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f397005fa70 0x7f3970113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3977430700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3970064de0 0x7f3970115330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3977430700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39701405f0 0x7f3970115820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3977430700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39701528c0 con 0x7f3970064de0 2021-12-17T18:20:19.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3977430700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3970152b60 con 0x7f397005fa70 2021-12-17T18:20:19.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3977430700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3970152e00 con 0x7f39701405f0 2021-12-17T18:20:19.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3975c2d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3970064de0 0x7f3970115330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3975c2d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3970064de0 0x7f3970115330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50026/0 (socket says 172.21.15.62:50026) 2021-12-17T18:20:19.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3975c2d700 1 -- 172.21.15.62:0/2953613114 learned_addr learned my addr 172.21.15.62:0/2953613114 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:19.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f397642e700 1 --2- 172.21.15.62:0/2953613114 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f397005fa70 0x7f3970113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3976c2f700 1 --2- 172.21.15.62:0/2953613114 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39701405f0 0x7f3970115820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3975c2d700 1 -- 172.21.15.62:0/2953613114 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39701405f0 msgr2=0x7f3970115820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3975c2d700 1 --2- 172.21.15.62:0/2953613114 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39701405f0 0x7f3970115820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3975c2d700 1 -- 172.21.15.62:0/2953613114 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f397005fa70 msgr2=0x7f3970113ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3975c2d700 1 --2- 172.21.15.62:0/2953613114 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f397005fa70 0x7f3970113ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3975c2d700 1 -- 172.21.15.62:0/2953613114 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3968009470 con 0x7f3970064de0 2021-12-17T18:20:19.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f397642e700 1 --2- 172.21.15.62:0/2953613114 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f397005fa70 0x7f3970113ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:19.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3975c2d700 1 --2- 172.21.15.62:0/2953613114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3970064de0 0x7f3970115330 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f3960002f70 tx=0x7f3960015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:19.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f395f7fe700 1 -- 172.21.15.62:0/2953613114 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39600117e0 con 0x7f3970064de0 2021-12-17T18:20:19.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f395f7fe700 1 -- 172.21.15.62:0/2953613114 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3960011940 con 0x7f3970064de0 2021-12-17T18:20:19.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3977430700 1 -- 172.21.15.62:0/2953613114 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396000b1e0 con 0x7f3970064de0 2021-12-17T18:20:19.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f395f7fe700 1 -- 172.21.15.62:0/2953613114 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3960011ca0 con 0x7f3970064de0 2021-12-17T18:20:19.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3977430700 1 -- 172.21.15.62:0/2953613114 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3970114890 con 0x7f3970064de0 2021-12-17T18:20:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.622+0000 7f3977430700 1 -- 172.21.15.62:0/2953613114 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39700573d0 con 0x7f3970064de0 2021-12-17T18:20:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.626+0000 7f395f7fe700 1 -- 172.21.15.62:0/2953613114 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f396001a040 con 0x7f3970064de0 2021-12-17T18:20:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.626+0000 7f395f7fe700 1 --2- 172.21.15.62:0/2953613114 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3950053640 0x7f3950055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.626+0000 7f395f7fe700 1 -- 172.21.15.62:0/2953613114 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f396006d0c0 con 0x7f3970064de0 2021-12-17T18:20:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.626+0000 7f397642e700 1 --2- 172.21.15.62:0/2953613114 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3950053640 0x7f3950055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.626+0000 7f397642e700 1 --2- 172.21.15.62:0/2953613114 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3950053640 0x7f3950055b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f396c00b000 tx=0x7f396c0070e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:19.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.630+0000 7f395f7fe700 1 -- 172.21.15.62:0/2953613114 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3960047bf0 con 0x7f3970064de0 2021-12-17T18:20:19.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.798+0000 7f3977430700 1 -- 172.21.15.62:0/2953613114 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f3970063ea0 con 0x7f3970064de0 2021-12-17T18:20:19.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.806+0000 7f395f7fe700 1 -- 172.21.15.62:0/2953613114 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7f396002c0e0 con 0x7f3970064de0 2021-12-17T18:20:19.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.810+0000 7f3977430700 1 -- 172.21.15.62:0/2953613114 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3950053640 msgr2=0x7f3950055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.810+0000 7f3977430700 1 --2- 172.21.15.62:0/2953613114 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3950053640 0x7f3950055b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f396c00b000 tx=0x7f396c0070e0).stop 2021-12-17T18:20:19.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.810+0000 7f3977430700 1 -- 172.21.15.62:0/2953613114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3970064de0 msgr2=0x7f3970115330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.810+0000 7f3977430700 1 --2- 172.21.15.62:0/2953613114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3970064de0 0x7f3970115330 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f3960002f70 tx=0x7f3960015000).stop 2021-12-17T18:20:19.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.810+0000 7f3977430700 1 -- 172.21.15.62:0/2953613114 shutdown_connections 2021-12-17T18:20:19.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.810+0000 7f3977430700 1 --2- 172.21.15.62:0/2953613114 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3950053640 0x7f3950055b00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.810+0000 7f3977430700 1 --2- 172.21.15.62:0/2953613114 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39701405f0 0x7f3970115820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.810+0000 7f3977430700 1 --2- 172.21.15.62:0/2953613114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3970064de0 0x7f3970115330 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.810+0000 7f3977430700 1 --2- 172.21.15.62:0/2953613114 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f397005fa70 0x7f3970113ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.810+0000 7f3977430700 1 -- 172.21.15.62:0/2953613114 >> 172.21.15.62:0/2953613114 conn(0x7f397005bcd0 msgr2=0x7f3970063430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:19.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.810+0000 7f3977430700 1 -- 172.21.15.62:0/2953613114 shutdown_connections 2021-12-17T18:20:19.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.810+0000 7f3977430700 1 -- 172.21.15.62:0/2953613114 wait complete. 2021-12-17T18:20:19.821 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.1 2021-12-17T18:20:19.833 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:20:19.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.942+0000 7f2eeadf0700 1 Processor -- start 2021-12-17T18:20:19.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.942+0000 7f2eeadf0700 1 -- start start 2021-12-17T18:20:19.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2eeadf0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ee40626a0 0x7f2ee4065d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2eeadf0700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f2ee413eb10 0x7f2ee413efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2eeadf0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee40b35a0 con 0x7f2ee40b31c0 2021-12-17T18:20:19.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2eeadf0700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee40653d0 con 0x7f2ee413eb10 2021-12-17T18:20:19.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2eeadf0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40661f0 con 0x7f2ee40626a0 2021-12-17T18:20:19.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2ee9dee700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2ee40b31c0 0x7f2ee4143170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33612/0 (socket says 172.21.15.62:33612) 2021-12-17T18:20:19.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2ee9dee700 1 -- 172.21.15.62:0/1390079324 learned_addr learned my addr 172.21.15.62:0/1390079324 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:19.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2ee95ed700 1 --2- 172.21.15.62:0/1390079324 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ee40626a0 0x7f2ee4065d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2eea5ef700 1 --2- 172.21.15.62:0/1390079324 >> v2:172.21.15.109:3300/0 conn(0x7f2ee413eb10 0x7f2ee413efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2ee8dec700 1 -- 172.21.15.62:0/1390079324 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366409487 0 0) 0x7f2ee40b35a0 con 0x7f2ee40b31c0 2021-12-17T18:20:19.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2ee8dec700 1 -- 172.21.15.62:0/1390079324 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ecc003260 con 0x7f2ee40b31c0 2021-12-17T18:20:19.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2ee95ed700 1 -- 172.21.15.62:0/1390079324 >> v2:172.21.15.109:3300/0 conn(0x7f2ee413eb10 msgr2=0x7f2ee413efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:19.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2ee95ed700 1 --2- 172.21.15.62:0/1390079324 >> v2:172.21.15.109:3300/0 conn(0x7f2ee413eb10 0x7f2ee413efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2ee95ed700 1 -- 172.21.15.62:0/1390079324 >> v1:172.21.15.62:6789/0 conn(0x7f2ee40b31c0 legacy=0x7f2ee4143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2ee95ed700 1 -- 172.21.15.62:0/1390079324 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee40655c0 con 0x7f2ee40626a0 2021-12-17T18:20:19.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2eea5ef700 1 --2- 172.21.15.62:0/1390079324 >> v2:172.21.15.109:3300/0 conn(0x7f2ee413eb10 0x7f2ee413efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:20:19.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2ee95ed700 1 --2- 172.21.15.62:0/1390079324 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ee40626a0 0x7f2ee4065d00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2ed4002f70 tx=0x7f2ed4006df0).ready entity=mon.2 client_cookie=2815e87a4c4c4dae server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:19.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2ee8dec700 1 -- 172.21.15.62:0/1390079324 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ed4014070 con 0x7f2ee40626a0 2021-12-17T18:20:19.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2ee8dec700 1 -- 172.21.15.62:0/1390079324 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed4000e90 con 0x7f2ee40626a0 2021-12-17T18:20:19.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2ee8dec700 1 -- 172.21.15.62:0/1390079324 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ed400fa90 con 0x7f2ee40626a0 2021-12-17T18:20:19.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2eeadf0700 1 -- 172.21.15.62:0/1390079324 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ee40626a0 msgr2=0x7f2ee4065d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2eeadf0700 1 --2- 172.21.15.62:0/1390079324 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ee40626a0 0x7f2ee4065d00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2ed4002f70 tx=0x7f2ed4006df0).stop 2021-12-17T18:20:19.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2eeadf0700 1 -- 172.21.15.62:0/1390079324 shutdown_connections 2021-12-17T18:20:19.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2eeadf0700 1 --2- 172.21.15.62:0/1390079324 >> v2:172.21.15.109:3300/0 conn(0x7f2ee413eb10 0x7f2ee413efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2eeadf0700 1 --2- 172.21.15.62:0/1390079324 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ee40626a0 0x7f2ee4065d00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2eeadf0700 1 -- 172.21.15.62:0/1390079324 >> 172.21.15.62:0/1390079324 conn(0x7f2ee405bcd0 msgr2=0x7f2ee4063510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:19.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2eeadf0700 1 -- 172.21.15.62:0/1390079324 shutdown_connections 2021-12-17T18:20:19.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.946+0000 7f2eeadf0700 1 -- 172.21.15.62:0/1390079324 wait complete. 2021-12-17T18:20:19.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.950+0000 7f2eeadf0700 1 Processor -- start 2021-12-17T18:20:19.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.950+0000 7f2eeadf0700 1 -- start start 2021-12-17T18:20:19.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.950+0000 7f2eeadf0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ee40626a0 0x7f2ee41433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.950+0000 7f2eeadf0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ee40b31c0 0x7f2ee40b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.950+0000 7f2eeadf0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2ee413eb10 0x7f2ee40af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.950+0000 7f2eeadf0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee4142a00 con 0x7f2ee40626a0 2021-12-17T18:20:19.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.950+0000 7f2eeadf0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee4142ca0 con 0x7f2ee413eb10 2021-12-17T18:20:19.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.950+0000 7f2eeadf0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee4142f40 con 0x7f2ee40b31c0 2021-12-17T18:20:19.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.950+0000 7f2ee9dee700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ee40626a0 0x7f2ee41433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.950+0000 7f2ee9dee700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ee40626a0 0x7f2ee41433e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50038/0 (socket says 172.21.15.62:50038) 2021-12-17T18:20:19.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.950+0000 7f2ee9dee700 1 -- 172.21.15.62:0/4148124004 learned_addr learned my addr 172.21.15.62:0/4148124004 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:19.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.950+0000 7f2eea5ef700 1 --2- 172.21.15.62:0/4148124004 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2ee413eb10 0x7f2ee40af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.954+0000 7f2ee95ed700 1 --2- 172.21.15.62:0/4148124004 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ee40b31c0 0x7f2ee40b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.954+0000 7f2eea5ef700 1 -- 172.21.15.62:0/4148124004 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ee40b31c0 msgr2=0x7f2ee40b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.954+0000 7f2eea5ef700 1 --2- 172.21.15.62:0/4148124004 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ee40b31c0 0x7f2ee40b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.954+0000 7f2eea5ef700 1 -- 172.21.15.62:0/4148124004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ee40626a0 msgr2=0x7f2ee41433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:19.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.954+0000 7f2eea5ef700 1 --2- 172.21.15.62:0/4148124004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ee40626a0 0x7f2ee41433e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:19.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.954+0000 7f2eea5ef700 1 -- 172.21.15.62:0/4148124004 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc009470 con 0x7f2ee413eb10 2021-12-17T18:20:19.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.954+0000 7f2eea5ef700 1 --2- 172.21.15.62:0/4148124004 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2ee413eb10 0x7f2ee40af7a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f2edc00c000 tx=0x7f2edc0091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:19.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.954+0000 7f2ed2ffd700 1 -- 172.21.15.62:0/4148124004 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2edc00c610 con 0x7f2ee413eb10 2021-12-17T18:20:19.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.954+0000 7f2ed2ffd700 1 -- 172.21.15.62:0/4148124004 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2edc00c770 con 0x7f2ee413eb10 2021-12-17T18:20:19.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.954+0000 7f2eeadf0700 1 -- 172.21.15.62:0/4148124004 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed400b180 con 0x7f2ee413eb10 2021-12-17T18:20:19.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.954+0000 7f2ed2ffd700 1 -- 172.21.15.62:0/4148124004 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2edc00cad0 con 0x7f2ee413eb10 2021-12-17T18:20:19.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.954+0000 7f2eeadf0700 1 -- 172.21.15.62:0/4148124004 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee40afc90 con 0x7f2ee413eb10 2021-12-17T18:20:19.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.954+0000 7f2eeadf0700 1 -- 172.21.15.62:0/4148124004 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee4143100 con 0x7f2ee413eb10 2021-12-17T18:20:19.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.954+0000 7f2ed2ffd700 1 -- 172.21.15.62:0/4148124004 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2edc00cc30 con 0x7f2ee413eb10 2021-12-17T18:20:19.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.954+0000 7f2ed2ffd700 1 --2- 172.21.15.62:0/4148124004 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ec4053610 0x7f2ec4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:19.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.954+0000 7f2ed2ffd700 1 -- 172.21.15.62:0/4148124004 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2edc06bff0 con 0x7f2ee413eb10 2021-12-17T18:20:19.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.954+0000 7f2ee9dee700 1 --2- 172.21.15.62:0/4148124004 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ec4053610 0x7f2ec4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:19.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.958+0000 7f2ee9dee700 1 --2- 172.21.15.62:0/4148124004 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ec4053610 0x7f2ec4055ad0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f2ee000d000 tx=0x7f2ee0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:19.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:19.966+0000 7f2ed2ffd700 1 -- 172.21.15.62:0/4148124004 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2edc043060 con 0x7f2ee413eb10 2021-12-17T18:20:20.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.134+0000 7f2eeadf0700 1 -- 172.21.15.62:0/4148124004 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f2ee4065860 con 0x7f2ee413eb10 2021-12-17T18:20:20.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.142+0000 7f2ed2ffd700 1 -- 172.21.15.62:0/4148124004 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2edc016070 con 0x7f2ee413eb10 2021-12-17T18:20:20.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.146+0000 7f2eeadf0700 1 -- 172.21.15.62:0/4148124004 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ec4053610 msgr2=0x7f2ec4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:20.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.146+0000 7f2eeadf0700 1 --2- 172.21.15.62:0/4148124004 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ec4053610 0x7f2ec4055ad0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f2ee000d000 tx=0x7f2ee0009040).stop 2021-12-17T18:20:20.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.146+0000 7f2eeadf0700 1 -- 172.21.15.62:0/4148124004 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2ee413eb10 msgr2=0x7f2ee40af7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.146+0000 7f2eeadf0700 1 --2- 172.21.15.62:0/4148124004 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2ee413eb10 0x7f2ee40af7a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f2edc00c000 tx=0x7f2edc0091d0).stop 2021-12-17T18:20:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.146+0000 7f2eeadf0700 1 -- 172.21.15.62:0/4148124004 shutdown_connections 2021-12-17T18:20:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.146+0000 7f2eeadf0700 1 --2- 172.21.15.62:0/4148124004 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ec4053610 0x7f2ec4055ad0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.146+0000 7f2eeadf0700 1 --2- 172.21.15.62:0/4148124004 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2ee413eb10 0x7f2ee40af7a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.146+0000 7f2eeadf0700 1 --2- 172.21.15.62:0/4148124004 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ee40b31c0 0x7f2ee40b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.146+0000 7f2eeadf0700 1 --2- 172.21.15.62:0/4148124004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ee40626a0 0x7f2ee41433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.146+0000 7f2eeadf0700 1 -- 172.21.15.62:0/4148124004 >> 172.21.15.62:0/4148124004 conn(0x7f2ee405bcd0 msgr2=0x7f2ee413efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:20.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.146+0000 7f2eeadf0700 1 -- 172.21.15.62:0/4148124004 shutdown_connections 2021-12-17T18:20:20.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.146+0000 7f2eeadf0700 1 -- 172.21.15.62:0/4148124004 wait complete. 2021-12-17T18:20:20.156 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.2 2021-12-17T18:20:20.165 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:20:20.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.262+0000 7f001a45f700 1 Processor -- start 2021-12-17T18:20:20.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.262+0000 7f001a45f700 1 -- start start 2021-12-17T18:20:20.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f001a45f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00140ad360 0x7f00140679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:20.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f001a45f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f00140b57e0 0x7f00140b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:20.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f001a45f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00140b2e90 con 0x7f001405ffe0 2021-12-17T18:20:20.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f001a45f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00140b4b70 con 0x7f00140b57e0 2021-12-17T18:20:20.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f001a45f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00140b4e10 con 0x7f00140ad360 2021-12-17T18:20:20.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f00189fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f00140b57e0 0x7f00140b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:20.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f00189fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f00140b57e0 0x7f00140b39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50050/0 (socket says 172.21.15.62:50050) 2021-12-17T18:20:20.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f00189fc700 1 -- 172.21.15.62:0/1445953743 learned_addr learned my addr 172.21.15.62:0/1445953743 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:20.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f00137fe700 1 --2- 172.21.15.62:0/1445953743 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00140ad360 0x7f00140679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:20.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f00189fc700 1 -- 172.21.15.62:0/1445953743 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00140ad360 msgr2=0x7f00140679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:20.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f00189fc700 1 --2- 172.21.15.62:0/1445953743 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00140ad360 0x7f00140679c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f00189fc700 1 -- 172.21.15.62:0/1445953743 >> v1:172.21.15.109:6789/0 conn(0x7f001405ffe0 legacy=0x7f00140b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:20.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f00189fc700 1 -- 172.21.15.62:0/1445953743 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00140b52b0 con 0x7f00140b57e0 2021-12-17T18:20:20.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f00189fc700 1 --2- 172.21.15.62:0/1445953743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00140b57e0 0x7f00140b39d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f00140b74a0 tx=0x7f000c006eb0).ready entity=mon.0 client_cookie=bab26b9ac4a63880 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:20.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f0012ffd700 1 -- 172.21.15.62:0/1445953743 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f000c00d570 con 0x7f00140b57e0 2021-12-17T18:20:20.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f0012ffd700 1 -- 172.21.15.62:0/1445953743 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c000e90 con 0x7f00140b57e0 2021-12-17T18:20:20.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f0012ffd700 1 -- 172.21.15.62:0/1445953743 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f000c00d8c0 con 0x7f00140b57e0 2021-12-17T18:20:20.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f001a45f700 1 -- 172.21.15.62:0/1445953743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00140b57e0 msgr2=0x7f00140b39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:20.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f001a45f700 1 --2- 172.21.15.62:0/1445953743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00140b57e0 0x7f00140b39d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f00140b74a0 tx=0x7f000c006eb0).stop 2021-12-17T18:20:20.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f001a45f700 1 -- 172.21.15.62:0/1445953743 shutdown_connections 2021-12-17T18:20:20.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f001a45f700 1 --2- 172.21.15.62:0/1445953743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00140b57e0 0x7f00140b39d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f001a45f700 1 --2- 172.21.15.62:0/1445953743 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00140ad360 0x7f00140679c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f001a45f700 1 -- 172.21.15.62:0/1445953743 >> 172.21.15.62:0/1445953743 conn(0x7f00140626d0 msgr2=0x7f001405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:20.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f001a45f700 1 -- 172.21.15.62:0/1445953743 shutdown_connections 2021-12-17T18:20:20.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f001a45f700 1 -- 172.21.15.62:0/1445953743 wait complete. 2021-12-17T18:20:20.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f001a45f700 1 Processor -- start 2021-12-17T18:20:20.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.266+0000 7f001a45f700 1 -- start start 2021-12-17T18:20:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f001a45f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f001405ffe0 0x7f0014146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f001a45f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00140ad360 0x7f0014152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f001a45f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00140b57e0 0x7f0014153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f001a45f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00140645b0 con 0x7f00140ad360 2021-12-17T18:20:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f001a45f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0014155f40 con 0x7f001405ffe0 2021-12-17T18:20:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f001a45f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00140af350 con 0x7f00140b57e0 2021-12-17T18:20:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f00137fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00140ad360 0x7f0014152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f00137fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00140ad360 0x7f0014152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50054/0 (socket says 172.21.15.62:50054) 2021-12-17T18:20:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f00137fe700 1 -- 172.21.15.62:0/2893559478 learned_addr learned my addr 172.21.15.62:0/2893559478 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f0013fff700 1 --2- 172.21.15.62:0/2893559478 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f001405ffe0 0x7f0014146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f00189fc700 1 --2- 172.21.15.62:0/2893559478 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00140b57e0 0x7f0014153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:20.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f00137fe700 1 -- 172.21.15.62:0/2893559478 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00140b57e0 msgr2=0x7f0014153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:20.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f00137fe700 1 --2- 172.21.15.62:0/2893559478 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00140b57e0 0x7f0014153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f00137fe700 1 -- 172.21.15.62:0/2893559478 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f001405ffe0 msgr2=0x7f0014146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:20.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f00137fe700 1 --2- 172.21.15.62:0/2893559478 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f001405ffe0 0x7f0014146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f00137fe700 1 -- 172.21.15.62:0/2893559478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c00b1e0 con 0x7f00140ad360 2021-12-17T18:20:20.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f0013fff700 1 --2- 172.21.15.62:0/2893559478 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f001405ffe0 0x7f0014146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:20.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f00137fe700 1 --2- 172.21.15.62:0/2893559478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00140ad360 0x7f0014152920 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f000400a000 tx=0x7f0004008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:20.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f00117fa700 1 -- 172.21.15.62:0/2893559478 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0004013430 con 0x7f00140ad360 2021-12-17T18:20:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f00117fa700 1 -- 172.21.15.62:0/2893559478 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0004013590 con 0x7f00140ad360 2021-12-17T18:20:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f001a45f700 1 -- 172.21.15.62:0/2893559478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00140af5f0 con 0x7f00140ad360 2021-12-17T18:20:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f00117fa700 1 -- 172.21.15.62:0/2893559478 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00040138f0 con 0x7f00140ad360 2021-12-17T18:20:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.270+0000 7f001a45f700 1 -- 172.21.15.62:0/2893559478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00140639a0 con 0x7f00140ad360 2021-12-17T18:20:20.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.274+0000 7f00117fa700 1 -- 172.21.15.62:0/2893559478 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0004013a50 con 0x7f00140ad360 2021-12-17T18:20:20.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.274+0000 7f001a45f700 1 -- 172.21.15.62:0/2893559478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00140573d0 con 0x7f00140ad360 2021-12-17T18:20:20.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.274+0000 7f00117fa700 1 --2- 172.21.15.62:0/2893559478 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efff40536a0 0x7efff4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:20.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.274+0000 7f00117fa700 1 -- 172.21.15.62:0/2893559478 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f000406ba70 con 0x7f00140ad360 2021-12-17T18:20:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.274+0000 7f0013fff700 1 --2- 172.21.15.62:0/2893559478 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efff40536a0 0x7efff4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.274+0000 7f0013fff700 1 --2- 172.21.15.62:0/2893559478 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efff40536a0 0x7efff4055b60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f000800b000 tx=0x7f0008009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:20.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.278+0000 7f00117fa700 1 -- 172.21.15.62:0/2893559478 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0004042b30 con 0x7f00140ad360 2021-12-17T18:20:20.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.442+0000 7f001a45f700 1 -- 172.21.15.62:0/2893559478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f001406a2b0 con 0x7f00140ad360 2021-12-17T18:20:20.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.442+0000 7f00117fa700 1 -- 172.21.15.62:0/2893559478 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2135 (secure 0 0 0) 0x7f000406be60 con 0x7f00140ad360 2021-12-17T18:20:20.449 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:20.449 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/16961477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":16961477},{"type":"v1","addr":"172.21.15.109:6835","nonce":16961477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:20:16.801183+0000","modified":"2021-12-17T18:20:18.581684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/3317956606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3317956606},{"type":"v1","addr":"172.21.15.62:6833","nonce":3317956606}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-12-17T18:20:20.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.442+0000 7f001a45f700 1 -- 172.21.15.62:0/2893559478 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efff40536a0 msgr2=0x7efff4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:20.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.442+0000 7f001a45f700 1 --2- 172.21.15.62:0/2893559478 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efff40536a0 0x7efff4055b60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f000800b000 tx=0x7f0008009040).stop 2021-12-17T18:20:20.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.442+0000 7f001a45f700 1 -- 172.21.15.62:0/2893559478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00140ad360 msgr2=0x7f0014152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:20.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.442+0000 7f001a45f700 1 --2- 172.21.15.62:0/2893559478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00140ad360 0x7f0014152920 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f000400a000 tx=0x7f0004008040).stop 2021-12-17T18:20:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.446+0000 7f001a45f700 1 -- 172.21.15.62:0/2893559478 shutdown_connections 2021-12-17T18:20:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.446+0000 7f001a45f700 1 --2- 172.21.15.62:0/2893559478 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efff40536a0 0x7efff4055b60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.446+0000 7f001a45f700 1 --2- 172.21.15.62:0/2893559478 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00140b57e0 0x7f0014153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.446+0000 7f001a45f700 1 --2- 172.21.15.62:0/2893559478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00140ad360 0x7f0014152920 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.446+0000 7f001a45f700 1 --2- 172.21.15.62:0/2893559478 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f001405ffe0 0x7f0014146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.446+0000 7f001a45f700 1 -- 172.21.15.62:0/2893559478 >> 172.21.15.62:0/2893559478 conn(0x7f00140626d0 msgr2=0x7f001405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:20.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.446+0000 7f001a45f700 1 -- 172.21.15.62:0/2893559478 shutdown_connections 2021-12-17T18:20:20.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.446+0000 7f001a45f700 1 -- 172.21.15.62:0/2893559478 wait complete. 2021-12-17T18:20:20.454 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2021-12-17T18:20:20.668 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:20:16.801183+0000', 'modified': '2021-12-17T18:20:18.581684+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5277}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5277': {'gid': 5277, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/3317956606', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 3317956606}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 3317956606}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:20:20.669 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:20:20.670 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:20:20.786 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":5277,"want_state":"up:active","state":"up:active","rank_uptime":3.972775189,"mdsmap_epoch":16,"osdmap_epoch":42,"osdmap_epoch_barrier":42,"uptime":8.3394745819999994} 2021-12-17T18:20:20.787 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 5277, "mdsmap_epoch": 16, "osdmap_epoch": 42, "osdmap_epoch_barrier": 42, "rank_uptime": 3.972775189, "state": "up:active", "uptime": 8.339474582, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:20:20.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:20:20.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.886+0000 7fa8188df700 1 Processor -- start 2021-12-17T18:20:20.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.886+0000 7fa8188df700 1 -- start start 2021-12-17T18:20:20.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.886+0000 7fa8188df700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa814141480 0x7fa814147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:20.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.886+0000 7fa8188df700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa8140a8e10 0x7fa8140b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:20.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.886+0000 7fa8188df700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa814147610 con 0x7fa8140b6050 2021-12-17T18:20:20.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.886+0000 7fa8188df700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8141478b0 con 0x7fa8140a8e10 2021-12-17T18:20:20.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.886+0000 7fa8188df700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa814147b50 con 0x7fa814141480 2021-12-17T18:20:20.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa812ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa8140a8e10 0x7fa8140b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:20.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa812ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa8140a8e10 0x7fa8140b5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50060/0 (socket says 172.21.15.62:50060) 2021-12-17T18:20:20.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa812ffd700 1 -- 172.21.15.62:0/6053965 learned_addr learned my addr 172.21.15.62:0/6053965 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:20.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa8137fe700 1 --2- 172.21.15.62:0/6053965 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa814141480 0x7fa814147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:20.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa812ffd700 1 -- 172.21.15.62:0/6053965 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa814141480 msgr2=0x7fa814147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:20.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa812ffd700 1 --2- 172.21.15.62:0/6053965 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa814141480 0x7fa814147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa812ffd700 1 -- 172.21.15.62:0/6053965 >> v1:172.21.15.109:6789/0 conn(0x7fa8140b6050 legacy=0x7fa8140a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:20.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa812ffd700 1 -- 172.21.15.62:0/6053965 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8140b1b90 con 0x7fa8140a8e10 2021-12-17T18:20:20.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa812ffd700 1 --2- 172.21.15.62:0/6053965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8140a8e10 0x7fa8140b5b60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fa8040032f0 tx=0x7fa804009290).ready entity=mon.0 client_cookie=8dc2a0561250b7d0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:20.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa8127fc700 1 -- 172.21.15.62:0/6053965 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa80400b8a0 con 0x7fa8140a8e10 2021-12-17T18:20:20.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa8127fc700 1 -- 172.21.15.62:0/6053965 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80400ba00 con 0x7fa8140a8e10 2021-12-17T18:20:20.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa8127fc700 1 -- 172.21.15.62:0/6053965 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa80400bb70 con 0x7fa8140a8e10 2021-12-17T18:20:20.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa8188df700 1 -- 172.21.15.62:0/6053965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8140a8e10 msgr2=0x7fa8140b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:20.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa8188df700 1 --2- 172.21.15.62:0/6053965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8140a8e10 0x7fa8140b5b60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fa8040032f0 tx=0x7fa804009290).stop 2021-12-17T18:20:20.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa8188df700 1 -- 172.21.15.62:0/6053965 shutdown_connections 2021-12-17T18:20:20.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa8188df700 1 --2- 172.21.15.62:0/6053965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8140a8e10 0x7fa8140b5b60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa8188df700 1 --2- 172.21.15.62:0/6053965 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa814141480 0x7fa814147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa8188df700 1 -- 172.21.15.62:0/6053965 >> 172.21.15.62:0/6053965 conn(0x7fa81405d220 msgr2=0x7fa8140b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:20.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa8188df700 1 -- 172.21.15.62:0/6053965 shutdown_connections 2021-12-17T18:20:20.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.890+0000 7fa8188df700 1 -- 172.21.15.62:0/6053965 wait complete. 2021-12-17T18:20:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8188df700 1 Processor -- start 2021-12-17T18:20:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8188df700 1 -- start start 2021-12-17T18:20:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8188df700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8140a8e10 0x7fa81414a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:20.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8188df700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8140b6050 0x7fa8140ae420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:20.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8188df700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa814141480 0x7fa8140ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:20.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8188df700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81414b7f0 con 0x7fa8140a8e10 2021-12-17T18:20:20.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8188df700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81414a1f0 con 0x7fa8140b6050 2021-12-17T18:20:20.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8188df700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81414b4a0 con 0x7fa814141480 2021-12-17T18:20:20.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8137fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8140a8e10 0x7fa81414a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:20.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8137fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8140a8e10 0x7fa81414a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50066/0 (socket says 172.21.15.62:50066) 2021-12-17T18:20:20.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8137fe700 1 -- 172.21.15.62:0/3475335576 learned_addr learned my addr 172.21.15.62:0/3475335576 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:20.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa812ffd700 1 --2- 172.21.15.62:0/3475335576 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8140b6050 0x7fa8140ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:20.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa813fff700 1 --2- 172.21.15.62:0/3475335576 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa814141480 0x7fa8140ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:20.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8137fe700 1 -- 172.21.15.62:0/3475335576 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa814141480 msgr2=0x7fa8140ab040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:20.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8137fe700 1 --2- 172.21.15.62:0/3475335576 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa814141480 0x7fa8140ab040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8137fe700 1 -- 172.21.15.62:0/3475335576 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8140b6050 msgr2=0x7fa8140ae420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:20.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8137fe700 1 --2- 172.21.15.62:0/3475335576 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8140b6050 0x7fa8140ae420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:20.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8137fe700 1 -- 172.21.15.62:0/3475335576 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa804009530 con 0x7fa8140a8e10 2021-12-17T18:20:20.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8137fe700 1 --2- 172.21.15.62:0/3475335576 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8140a8e10 0x7fa81414a650 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fa8080030b0 tx=0x7fa808008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:20.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa810ff9700 1 -- 172.21.15.62:0/3475335576 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa808011780 con 0x7fa8140a8e10 2021-12-17T18:20:20.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa810ff9700 1 -- 172.21.15.62:0/3475335576 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8080118e0 con 0x7fa8140a8e10 2021-12-17T18:20:20.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8188df700 1 -- 172.21.15.62:0/3475335576 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81414b200 con 0x7fa8140a8e10 2021-12-17T18:20:20.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa810ff9700 1 -- 172.21.15.62:0/3475335576 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa808011c40 con 0x7fa8140a8e10 2021-12-17T18:20:20.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.894+0000 7fa8188df700 1 -- 172.21.15.62:0/3475335576 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81414aea0 con 0x7fa8140a8e10 2021-12-17T18:20:20.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.898+0000 7fa8188df700 1 -- 172.21.15.62:0/3475335576 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8140ac390 con 0x7fa8140a8e10 2021-12-17T18:20:20.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.898+0000 7fa810ff9700 1 -- 172.21.15.62:0/3475335576 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa808012420 con 0x7fa8140a8e10 2021-12-17T18:20:20.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.898+0000 7fa810ff9700 1 --2- 172.21.15.62:0/3475335576 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa7f4053580 0x7fa7f4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:20.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.898+0000 7fa810ff9700 1 -- 172.21.15.62:0/3475335576 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa80806b7d0 con 0x7fa8140a8e10 2021-12-17T18:20:20.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.898+0000 7fa812ffd700 1 --2- 172.21.15.62:0/3475335576 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa7f4053580 0x7fa7f4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:20.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.898+0000 7fa812ffd700 1 --2- 172.21.15.62:0/3475335576 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa7f4053580 0x7fa7f4055a40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fa80401b000 tx=0x7fa804016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:20.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:20.902+0000 7fa810ff9700 1 -- 172.21.15.62:0/3475335576 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa8140ac390 con 0x7fa8140a8e10 2021-12-17T18:20:21.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.026+0000 7fa8188df700 1 -- 172.21.15.62:0/3475335576 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8140ac390 con 0x7fa8140a8e10 2021-12-17T18:20:21.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.030+0000 7fa810ff9700 1 -- 172.21.15.62:0/3475335576 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16086 (secure 0 0 0) 0x7fa8140ac390 con 0x7fa8140a8e10 2021-12-17T18:20:21.036 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:21.037 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":42,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:20:17.803894+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:20:15.333250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-12-17T18:20:16.462772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:20:21.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.034+0000 7fa8188df700 1 -- 172.21.15.62:0/3475335576 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa7f4053580 msgr2=0x7fa7f4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.034+0000 7fa8188df700 1 --2- 172.21.15.62:0/3475335576 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa7f4053580 0x7fa7f4055a40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fa80401b000 tx=0x7fa804016000).stop 2021-12-17T18:20:21.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.034+0000 7fa8188df700 1 -- 172.21.15.62:0/3475335576 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8140a8e10 msgr2=0x7fa81414a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.034+0000 7fa8188df700 1 --2- 172.21.15.62:0/3475335576 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8140a8e10 0x7fa81414a650 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fa8080030b0 tx=0x7fa808008040).stop 2021-12-17T18:20:21.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.034+0000 7fa8188df700 1 -- 172.21.15.62:0/3475335576 shutdown_connections 2021-12-17T18:20:21.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.034+0000 7fa8188df700 1 --2- 172.21.15.62:0/3475335576 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa7f4053580 0x7fa7f4055a40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.034+0000 7fa8188df700 1 --2- 172.21.15.62:0/3475335576 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa814141480 0x7fa8140ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.034+0000 7fa8188df700 1 --2- 172.21.15.62:0/3475335576 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8140b6050 0x7fa8140ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.034+0000 7fa8188df700 1 --2- 172.21.15.62:0/3475335576 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8140a8e10 0x7fa81414a650 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.034+0000 7fa8188df700 1 -- 172.21.15.62:0/3475335576 >> 172.21.15.62:0/3475335576 conn(0x7fa81405d220 msgr2=0x7fa8140b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:21.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.034+0000 7fa8188df700 1 -- 172.21.15.62:0/3475335576 shutdown_connections 2021-12-17T18:20:21.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.034+0000 7fa8188df700 1 -- 172.21.15.62:0/3475335576 wait complete. 2021-12-17T18:20:21.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:20:15.333250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:20:16.462772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:20:21.055 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:20:21.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.154+0000 7fe16b59e700 1 Processor -- start 2021-12-17T18:20:21.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.154+0000 7fe16b59e700 1 -- start start 2021-12-17T18:20:21.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe16c067380 0x7fe16c1412c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16c140e60 con 0x7fe16c0ae9f0 2021-12-17T18:20:21.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16b59e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16c141ec0 con 0x7fe16c05ce60 2021-12-17T18:20:21.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16c0605a0 con 0x7fe16c067380 2021-12-17T18:20:21.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16ad9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe16c0ae9f0 0x7fe16c1417b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33658/0 (socket says 172.21.15.62:33658) 2021-12-17T18:20:21.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16ad9d700 1 -- 172.21.15.62:0/1732137288 learned_addr learned my addr 172.21.15.62:0/1732137288 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:21.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe169d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe16c067380 0x7fe16c1412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16959a700 1 -- 172.21.15.62:0/1732137288 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040350098 0 0) 0x7fe16c140e60 con 0x7fe16c0ae9f0 2021-12-17T18:20:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16959a700 1 -- 172.21.15.62:0/1732137288 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe150003260 con 0x7fe16c0ae9f0 2021-12-17T18:20:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16959a700 1 -- 172.21.15.62:0/1732137288 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270896524 0 0) 0x7fe16c141ec0 con 0x7fe16c05ce60 2021-12-17T18:20:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16959a700 1 -- 172.21.15.62:0/1732137288 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe16c140e60 con 0x7fe16c05ce60 2021-12-17T18:20:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe169d9b700 1 -- 172.21.15.62:0/1732137288 >> v1:172.21.15.109:6789/0 conn(0x7fe16c05ce60 legacy=0x7fe16c066c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16959a700 1 -- 172.21.15.62:0/1732137288 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2817585146 0 0) 0x7fe150003260 con 0x7fe16c0ae9f0 2021-12-17T18:20:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe169d9b700 1 -- 172.21.15.62:0/1732137288 >> v1:172.21.15.62:6789/0 conn(0x7fe16c0ae9f0 legacy=0x7fe16c1417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe169d9b700 1 -- 172.21.15.62:0/1732137288 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c140bc0 con 0x7fe16c067380 2021-12-17T18:20:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe169d9b700 1 --2- 172.21.15.62:0/1732137288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c067380 0x7fe16c1412c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fe164001490 tx=0x7fe160006df0).ready entity=mon.0 client_cookie=4528b5e252d886dd server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:21.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16959a700 1 -- 172.21.15.62:0/1732137288 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe164001a00 con 0x7fe16c067380 2021-12-17T18:20:21.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16959a700 1 -- 172.21.15.62:0/1732137288 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe160000e90 con 0x7fe16c067380 2021-12-17T18:20:21.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16959a700 1 -- 172.21.15.62:0/1732137288 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe160012460 con 0x7fe16c067380 2021-12-17T18:20:21.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16b59e700 1 -- 172.21.15.62:0/1732137288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c067380 msgr2=0x7fe16c1412c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16b59e700 1 --2- 172.21.15.62:0/1732137288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c067380 0x7fe16c1412c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fe164001490 tx=0x7fe160006df0).stop 2021-12-17T18:20:21.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16b59e700 1 -- 172.21.15.62:0/1732137288 shutdown_connections 2021-12-17T18:20:21.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16b59e700 1 --2- 172.21.15.62:0/1732137288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c067380 0x7fe16c1412c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16b59e700 1 -- 172.21.15.62:0/1732137288 >> 172.21.15.62:0/1732137288 conn(0x7fe16c062850 msgr2=0x7fe16c05bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:21.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16b59e700 1 -- 172.21.15.62:0/1732137288 shutdown_connections 2021-12-17T18:20:21.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.158+0000 7fe16b59e700 1 -- 172.21.15.62:0/1732137288 wait complete. 2021-12-17T18:20:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe16b59e700 1 Processor -- start 2021-12-17T18:20:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe16b59e700 1 -- start start 2021-12-17T18:20:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe16b59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe16c05ce60 0x7fe16c064eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe16b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c0ae9f0 0x7fe16c063880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe16b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe16c09e9d0 0x7fe16c0a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe16b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c063d70 con 0x7fe16c0ae9f0 2021-12-17T18:20:21.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe16b59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c066840 con 0x7fe16c05ce60 2021-12-17T18:20:21.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe16b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c0a06e0 con 0x7fe16c09e9d0 2021-12-17T18:20:21.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe169d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c0ae9f0 0x7fe16c063880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe169d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c0ae9f0 0x7fe16c063880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50082/0 (socket says 172.21.15.62:50082) 2021-12-17T18:20:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe169d9b700 1 -- 172.21.15.62:0/635727767 learned_addr learned my addr 172.21.15.62:0/635727767 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe16a59c700 1 --2- 172.21.15.62:0/635727767 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe16c05ce60 0x7fe16c064eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe16ad9d700 1 --2- 172.21.15.62:0/635727767 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe16c09e9d0 0x7fe16c0a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe169d9b700 1 -- 172.21.15.62:0/635727767 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe16c09e9d0 msgr2=0x7fe16c0a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe169d9b700 1 --2- 172.21.15.62:0/635727767 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe16c09e9d0 0x7fe16c0a0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe169d9b700 1 -- 172.21.15.62:0/635727767 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe16c05ce60 msgr2=0x7fe16c064eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe169d9b700 1 --2- 172.21.15.62:0/635727767 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe16c05ce60 0x7fe16c064eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe169d9b700 1 -- 172.21.15.62:0/635727767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16000b180 con 0x7fe16c0ae9f0 2021-12-17T18:20:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe16ad9d700 1 --2- 172.21.15.62:0/635727767 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe16c09e9d0 0x7fe16c0a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe169d9b700 1 --2- 172.21.15.62:0/635727767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c0ae9f0 0x7fe16c063880 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fe160007000 tx=0x7fe160014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe15b7fe700 1 -- 172.21.15.62:0/635727767 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe160016070 con 0x7fe16c0ae9f0 2021-12-17T18:20:21.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe15b7fe700 1 -- 172.21.15.62:0/635727767 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16000db40 con 0x7fe16c0ae9f0 2021-12-17T18:20:21.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe16b59e700 1 -- 172.21.15.62:0/635727767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16c09eee0 con 0x7fe16c0ae9f0 2021-12-17T18:20:21.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe15b7fe700 1 -- 172.21.15.62:0/635727767 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe160012460 con 0x7fe16c0ae9f0 2021-12-17T18:20:21.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.162+0000 7fe16b59e700 1 -- 172.21.15.62:0/635727767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16c065d30 con 0x7fe16c0ae9f0 2021-12-17T18:20:21.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.166+0000 7fe16b59e700 1 -- 172.21.15.62:0/635727767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16c060300 con 0x7fe16c0ae9f0 2021-12-17T18:20:21.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.166+0000 7fe15b7fe700 1 -- 172.21.15.62:0/635727767 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe160024020 con 0x7fe16c0ae9f0 2021-12-17T18:20:21.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.166+0000 7fe15b7fe700 1 --2- 172.21.15.62:0/635727767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe148053610 0x7fe148055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.166+0000 7fe15b7fe700 1 -- 172.21.15.62:0/635727767 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe16006c7c0 con 0x7fe16c0ae9f0 2021-12-17T18:20:21.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.166+0000 7fe16a59c700 1 --2- 172.21.15.62:0/635727767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe148053610 0x7fe148055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.166+0000 7fe16a59c700 1 --2- 172.21.15.62:0/635727767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe148053610 0x7fe148055ad0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fe15c00d000 tx=0x7fe15c007a20).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:21.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.174+0000 7fe15b7fe700 1 -- 172.21.15.62:0/635727767 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe1600439d0 con 0x7fe16c0ae9f0 2021-12-17T18:20:21.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.302+0000 7fe16b59e700 1 -- 172.21.15.62:0/635727767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe16c0573d0 con 0x7fe16c0ae9f0 2021-12-17T18:20:21.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.302+0000 7fe15b7fe700 1 -- 172.21.15.62:0/635727767 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v42) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe160046ff0 con 0x7fe16c0ae9f0 2021-12-17T18:20:21.311 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:20:21.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.306+0000 7fe16b59e700 1 -- 172.21.15.62:0/635727767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe148053610 msgr2=0x7fe148055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.306+0000 7fe16b59e700 1 --2- 172.21.15.62:0/635727767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe148053610 0x7fe148055ad0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fe15c00d000 tx=0x7fe15c007a20).stop 2021-12-17T18:20:21.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.306+0000 7fe16b59e700 1 -- 172.21.15.62:0/635727767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c0ae9f0 msgr2=0x7fe16c063880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.306+0000 7fe16b59e700 1 --2- 172.21.15.62:0/635727767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c0ae9f0 0x7fe16c063880 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fe160007000 tx=0x7fe160014000).stop 2021-12-17T18:20:21.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.306+0000 7fe16b59e700 1 -- 172.21.15.62:0/635727767 shutdown_connections 2021-12-17T18:20:21.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.306+0000 7fe16b59e700 1 --2- 172.21.15.62:0/635727767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe148053610 0x7fe148055ad0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.306+0000 7fe16b59e700 1 --2- 172.21.15.62:0/635727767 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe16c09e9d0 0x7fe16c0a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.306+0000 7fe16b59e700 1 --2- 172.21.15.62:0/635727767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c0ae9f0 0x7fe16c063880 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.306+0000 7fe16b59e700 1 --2- 172.21.15.62:0/635727767 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe16c05ce60 0x7fe16c064eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.306+0000 7fe16b59e700 1 -- 172.21.15.62:0/635727767 >> 172.21.15.62:0/635727767 conn(0x7fe16c062850 msgr2=0x7fe16c141650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:21.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.306+0000 7fe16b59e700 1 -- 172.21.15.62:0/635727767 shutdown_connections 2021-12-17T18:20:21.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.306+0000 7fe16b59e700 1 -- 172.21.15.62:0/635727767 wait complete. 2021-12-17T18:20:21.325 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:20:21.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.434+0000 7f83c3fff700 1 Processor -- start 2021-12-17T18:20:21.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.434+0000 7f83c3fff700 1 -- start start 2021-12-17T18:20:21.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c3fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83c4148810 0x7f83c414ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c3fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c413fd30 con 0x7f83c40b2fb0 2021-12-17T18:20:21.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c3fff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c413ff90 con 0x7f83c4062910 2021-12-17T18:20:21.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c3fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40653d0 con 0x7f83c4148810 2021-12-17T18:20:21.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c2ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f83c40b2fb0 0x7f83c4061390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33668/0 (socket says 172.21.15.62:33668) 2021-12-17T18:20:21.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c2ffd700 1 -- 172.21.15.62:0/3680332737 learned_addr learned my addr 172.21.15.62:0/3680332737 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:21.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c37fe700 1 --2- 172.21.15.62:0/3680332737 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83c4148810 0x7f83c414ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c27fc700 1 -- 172.21.15.62:0/3680332737 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622364539 0 0) 0x7f83c413fd30 con 0x7f83c40b2fb0 2021-12-17T18:20:21.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c27fc700 1 -- 172.21.15.62:0/3680332737 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83a4003260 con 0x7f83c40b2fb0 2021-12-17T18:20:21.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c27fc700 1 -- 172.21.15.62:0/3680332737 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2189766387 0 0) 0x7f83c413ff90 con 0x7f83c4062910 2021-12-17T18:20:21.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c27fc700 1 -- 172.21.15.62:0/3680332737 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83c413fd30 con 0x7f83c4062910 2021-12-17T18:20:21.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c37fe700 1 -- 172.21.15.62:0/3680332737 >> v1:172.21.15.109:6789/0 conn(0x7f83c4062910 legacy=0x7f83c4140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c37fe700 1 -- 172.21.15.62:0/3680332737 >> v1:172.21.15.62:6789/0 conn(0x7f83c40b2fb0 legacy=0x7f83c4061390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c37fe700 1 -- 172.21.15.62:0/3680332737 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c40656a0 con 0x7f83c4148810 2021-12-17T18:20:21.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c37fe700 1 --2- 172.21.15.62:0/3680332737 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83c4148810 0x7f83c414ac00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f83bc0032f0 tx=0x7f83bc0091d0).ready entity=mon.2 client_cookie=62b2bb48fd822b96 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:21.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c27fc700 1 -- 172.21.15.62:0/3680332737 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83bc00b640 con 0x7f83c4148810 2021-12-17T18:20:21.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c27fc700 1 -- 172.21.15.62:0/3680332737 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc00b7a0 con 0x7f83c4148810 2021-12-17T18:20:21.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c27fc700 1 -- 172.21.15.62:0/3680332737 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83bc00b910 con 0x7f83c4148810 2021-12-17T18:20:21.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c3fff700 1 -- 172.21.15.62:0/3680332737 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83c4148810 msgr2=0x7f83c414ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c3fff700 1 --2- 172.21.15.62:0/3680332737 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83c4148810 0x7f83c414ac00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f83bc0032f0 tx=0x7f83bc0091d0).stop 2021-12-17T18:20:21.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c3fff700 1 -- 172.21.15.62:0/3680332737 shutdown_connections 2021-12-17T18:20:21.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c3fff700 1 --2- 172.21.15.62:0/3680332737 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83c4148810 0x7f83c414ac00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c3fff700 1 -- 172.21.15.62:0/3680332737 >> 172.21.15.62:0/3680332737 conn(0x7f83c4063510 msgr2=0x7f83c40638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:21.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c3fff700 1 -- 172.21.15.62:0/3680332737 shutdown_connections 2021-12-17T18:20:21.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.438+0000 7f83c3fff700 1 -- 172.21.15.62:0/3680332737 wait complete. 2021-12-17T18:20:21.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.442+0000 7f83c3fff700 1 Processor -- start 2021-12-17T18:20:21.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.442+0000 7f83c3fff700 1 -- start start 2021-12-17T18:20:21.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.442+0000 7f83c3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83c4062910 0x7f83c4148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.442+0000 7f83c3fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83c40b2fb0 0x7f83c414a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.442+0000 7f83c3fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f83c4148810 0x7f83c40afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.442+0000 7f83c3fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40b5400 con 0x7f83c4062910 2021-12-17T18:20:21.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.442+0000 7f83c3fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c4129540 con 0x7f83c4148810 2021-12-17T18:20:21.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.442+0000 7f83c3fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c4129000 con 0x7f83c40b2fb0 2021-12-17T18:20:21.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.442+0000 7f83c2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83c4062910 0x7f83c4148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.442+0000 7f83c2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83c4062910 0x7f83c4148f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50094/0 (socket says 172.21.15.62:50094) 2021-12-17T18:20:21.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.442+0000 7f83ba7fc700 1 --2- 172.21.15.62:0/2703676598 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83c40b2fb0 0x7f83c414a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.442+0000 7f83c2ffd700 1 -- 172.21.15.62:0/2703676598 learned_addr learned my addr 172.21.15.62:0/2703676598 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:21.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.446+0000 7f83c37fe700 1 --2- 172.21.15.62:0/2703676598 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f83c4148810 0x7f83c40afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.446+0000 7f83c2ffd700 1 -- 172.21.15.62:0/2703676598 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83c40b2fb0 msgr2=0x7f83c414a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.446+0000 7f83c2ffd700 1 --2- 172.21.15.62:0/2703676598 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83c40b2fb0 0x7f83c414a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.446+0000 7f83c2ffd700 1 -- 172.21.15.62:0/2703676598 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f83c4148810 msgr2=0x7f83c40afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.446+0000 7f83c2ffd700 1 --2- 172.21.15.62:0/2703676598 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f83c4148810 0x7f83c40afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.446+0000 7f83c2ffd700 1 -- 172.21.15.62:0/2703676598 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc009470 con 0x7f83c4062910 2021-12-17T18:20:21.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.446+0000 7f83c2ffd700 1 --2- 172.21.15.62:0/2703676598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83c4062910 0x7f83c4148f30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f83c41296d0 tx=0x7f83b4007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:21.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.446+0000 7f83c0ff9700 1 -- 172.21.15.62:0/2703676598 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83b40070d0 con 0x7f83c4062910 2021-12-17T18:20:21.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.446+0000 7f83c0ff9700 1 -- 172.21.15.62:0/2703676598 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b4007230 con 0x7f83c4062910 2021-12-17T18:20:21.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.446+0000 7f83c3fff700 1 -- 172.21.15.62:0/2703676598 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c41292a0 con 0x7f83c4062910 2021-12-17T18:20:21.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.446+0000 7f83c0ff9700 1 -- 172.21.15.62:0/2703676598 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83b4005610 con 0x7f83c4062910 2021-12-17T18:20:21.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.446+0000 7f83c3fff700 1 -- 172.21.15.62:0/2703676598 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c40b05f0 con 0x7f83c4062910 2021-12-17T18:20:21.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.446+0000 7f83c0ff9700 1 -- 172.21.15.62:0/2703676598 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f83b4010070 con 0x7f83c4062910 2021-12-17T18:20:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.446+0000 7f83c3fff700 1 -- 172.21.15.62:0/2703676598 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c40b0400 con 0x7f83c4062910 2021-12-17T18:20:21.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.450+0000 7f83c0ff9700 1 --2- 172.21.15.62:0/2703676598 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83a8053610 0x7f83a8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.450+0000 7f83c0ff9700 1 -- 172.21.15.62:0/2703676598 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f83b406b0c0 con 0x7f83c4062910 2021-12-17T18:20:21.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.450+0000 7f83ba7fc700 1 --2- 172.21.15.62:0/2703676598 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83a8053610 0x7f83a8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.450+0000 7f83ba7fc700 1 --2- 172.21.15.62:0/2703676598 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83a8053610 0x7f83a8055ad0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f83ac00d000 tx=0x7f83ac007a00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:21.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.458+0000 7f83c0ff9700 1 -- 172.21.15.62:0/2703676598 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f83c40b0400 con 0x7f83c4062910 2021-12-17T18:20:21.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.582+0000 7f83c3fff700 1 -- 172.21.15.62:0/2703676598 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f83c40b0400 con 0x7f83c4062910 2021-12-17T18:20:21.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.586+0000 7f83c0ff9700 1 -- 172.21.15.62:0/2703676598 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7f83c40b0400 con 0x7f83c4062910 2021-12-17T18:20:21.591 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:20:21.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.586+0000 7f83c3fff700 1 -- 172.21.15.62:0/2703676598 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83a8053610 msgr2=0x7f83a8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.586+0000 7f83c3fff700 1 --2- 172.21.15.62:0/2703676598 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83a8053610 0x7f83a8055ad0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f83ac00d000 tx=0x7f83ac007a00).stop 2021-12-17T18:20:21.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.586+0000 7f83c3fff700 1 -- 172.21.15.62:0/2703676598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83c4062910 msgr2=0x7f83c4148f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.586+0000 7f83c3fff700 1 --2- 172.21.15.62:0/2703676598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83c4062910 0x7f83c4148f30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f83c41296d0 tx=0x7f83b4007b50).stop 2021-12-17T18:20:21.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.586+0000 7f83c3fff700 1 -- 172.21.15.62:0/2703676598 shutdown_connections 2021-12-17T18:20:21.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.586+0000 7f83c3fff700 1 --2- 172.21.15.62:0/2703676598 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83a8053610 0x7f83a8055ad0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.586+0000 7f83c3fff700 1 --2- 172.21.15.62:0/2703676598 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f83c4148810 0x7f83c40afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.586+0000 7f83c3fff700 1 --2- 172.21.15.62:0/2703676598 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83c40b2fb0 0x7f83c414a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.586+0000 7f83c3fff700 1 --2- 172.21.15.62:0/2703676598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83c4062910 0x7f83c4148f30 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.586+0000 7f83c3fff700 1 -- 172.21.15.62:0/2703676598 >> 172.21.15.62:0/2703676598 conn(0x7f83c4063510 msgr2=0x7f83c40663e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:21.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.586+0000 7f83c3fff700 1 -- 172.21.15.62:0/2703676598 shutdown_connections 2021-12-17T18:20:21.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.586+0000 7f83c3fff700 1 -- 172.21.15.62:0/2703676598 wait complete. 2021-12-17T18:20:21.604 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:20:21.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.710+0000 7f594d2fc700 1 Processor -- start 2021-12-17T18:20:21.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.710+0000 7f594d2fc700 1 -- start start 2021-12-17T18:20:21.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.710+0000 7f594d2fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f59480b2d00 0x7f59480b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.710+0000 7f594d2fc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5948062b60 0x7f594813fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.710+0000 7f594d2fc700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5948140140 con 0x7f59480625b0 2021-12-17T18:20:21.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.710+0000 7f594d2fc700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5948140e60 con 0x7f59480b2d00 2021-12-17T18:20:21.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.710+0000 7f594d2fc700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59480aecb0 con 0x7f5948062b60 2021-12-17T18:20:21.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f5947fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f59480b2d00 0x7f59480b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594cafb700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f59480625b0 0x7f5948139870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33686/0 (socket says 172.21.15.62:33686) 2021-12-17T18:20:21.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594cafb700 1 -- 172.21.15.62:0/1497582165 learned_addr learned my addr 172.21.15.62:0/1497582165 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:21.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f593f7fe700 1 --2- 172.21.15.62:0/1497582165 >> v2:172.21.15.109:3300/0 conn(0x7f5948062b60 0x7f594813fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f59477fe700 1 -- 172.21.15.62:0/1497582165 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491260374 0 0) 0x7f5940001490 con 0x7f59480625b0 2021-12-17T18:20:21.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f59477fe700 1 -- 172.21.15.62:0/1497582165 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5928003260 con 0x7f59480625b0 2021-12-17T18:20:21.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f5947fff700 1 -- 172.21.15.62:0/1497582165 >> v2:172.21.15.109:3300/0 conn(0x7f5948062b60 msgr2=0x7f594813fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:21.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f5947fff700 1 --2- 172.21.15.62:0/1497582165 >> v2:172.21.15.109:3300/0 conn(0x7f5948062b60 0x7f594813fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f5947fff700 1 -- 172.21.15.62:0/1497582165 >> v1:172.21.15.62:6789/0 conn(0x7f59480625b0 legacy=0x7f5948139870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f5947fff700 1 -- 172.21.15.62:0/1497582165 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59480aef50 con 0x7f59480b2d00 2021-12-17T18:20:21.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f593f7fe700 1 --2- 172.21.15.62:0/1497582165 >> v2:172.21.15.109:3300/0 conn(0x7f5948062b60 0x7f594813fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:21.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f5947fff700 1 --2- 172.21.15.62:0/1497582165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59480b2d00 0x7f59480b30e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f5938002f70 tx=0x7f5938006df0).ready entity=mon.0 client_cookie=6546e3538cd320c4 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:21.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f59477fe700 1 -- 172.21.15.62:0/1497582165 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5938014a70 con 0x7f59480b2d00 2021-12-17T18:20:21.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f59477fe700 1 -- 172.21.15.62:0/1497582165 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5938000e90 con 0x7f59480b2d00 2021-12-17T18:20:21.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f59477fe700 1 -- 172.21.15.62:0/1497582165 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5938014dc0 con 0x7f59480b2d00 2021-12-17T18:20:21.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594d2fc700 1 -- 172.21.15.62:0/1497582165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59480b2d00 msgr2=0x7f59480b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594d2fc700 1 --2- 172.21.15.62:0/1497582165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59480b2d00 0x7f59480b30e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f5938002f70 tx=0x7f5938006df0).stop 2021-12-17T18:20:21.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594d2fc700 1 -- 172.21.15.62:0/1497582165 shutdown_connections 2021-12-17T18:20:21.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594d2fc700 1 --2- 172.21.15.62:0/1497582165 >> v2:172.21.15.109:3300/0 conn(0x7f5948062b60 0x7f594813fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594d2fc700 1 --2- 172.21.15.62:0/1497582165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59480b2d00 0x7f59480b30e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594d2fc700 1 -- 172.21.15.62:0/1497582165 >> 172.21.15.62:0/1497582165 conn(0x7f5948060a50 msgr2=0x7f594805bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:21.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594d2fc700 1 -- 172.21.15.62:0/1497582165 shutdown_connections 2021-12-17T18:20:21.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594d2fc700 1 -- 172.21.15.62:0/1497582165 wait complete. 2021-12-17T18:20:21.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594d2fc700 1 Processor -- start 2021-12-17T18:20:21.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594d2fc700 1 -- start start 2021-12-17T18:20:21.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594d2fc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f59480625b0 0x7f594813d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594d2fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5948062b60 0x7f594813b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594d2fc700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f59480b2d00 0x7f594814e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594d2fc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594813c250 con 0x7f5948062b60 2021-12-17T18:20:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594d2fc700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594813a960 con 0x7f59480b2d00 2021-12-17T18:20:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.714+0000 7f594d2fc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594813c480 con 0x7f59480625b0 2021-12-17T18:20:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f593f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5948062b60 0x7f594813b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f593f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5948062b60 0x7f594813b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50112/0 (socket says 172.21.15.62:50112) 2021-12-17T18:20:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f593f7fe700 1 -- 172.21.15.62:0/1117408331 learned_addr learned my addr 172.21.15.62:0/1117408331 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f594cafb700 1 --2- 172.21.15.62:0/1117408331 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f59480b2d00 0x7f594814e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f5947fff700 1 --2- 172.21.15.62:0/1117408331 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f59480625b0 0x7f594813d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f593f7fe700 1 -- 172.21.15.62:0/1117408331 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f59480625b0 msgr2=0x7f594813d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f593f7fe700 1 --2- 172.21.15.62:0/1117408331 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f59480625b0 0x7f594813d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f593f7fe700 1 -- 172.21.15.62:0/1117408331 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f59480b2d00 msgr2=0x7f594814e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f593f7fe700 1 --2- 172.21.15.62:0/1117408331 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f59480b2d00 0x7f594814e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f593f7fe700 1 -- 172.21.15.62:0/1117408331 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593800b180 con 0x7f5948062b60 2021-12-17T18:20:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f593f7fe700 1 --2- 172.21.15.62:0/1117408331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5948062b60 0x7f594813b150 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f5930006940 tx=0x7f5930008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:21.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f5945ffb700 1 -- 172.21.15.62:0/1117408331 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5930011780 con 0x7f5948062b60 2021-12-17T18:20:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f5945ffb700 1 -- 172.21.15.62:0/1117408331 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59300118e0 con 0x7f5948062b60 2021-12-17T18:20:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f594d2fc700 1 -- 172.21.15.62:0/1117408331 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594814dc70 con 0x7f5948062b60 2021-12-17T18:20:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f5945ffb700 1 -- 172.21.15.62:0/1117408331 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5930011c40 con 0x7f5948062b60 2021-12-17T18:20:21.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f594d2fc700 1 -- 172.21.15.62:0/1117408331 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594813f4b0 con 0x7f5948062b60 2021-12-17T18:20:21.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f594d2fc700 1 -- 172.21.15.62:0/1117408331 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594813a3c0 con 0x7f5948062b60 2021-12-17T18:20:21.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f5945ffb700 1 -- 172.21.15.62:0/1117408331 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f593001c460 con 0x7f5948062b60 2021-12-17T18:20:21.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f5945ffb700 1 --2- 172.21.15.62:0/1117408331 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f592c053580 0x7f592c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.718+0000 7f5945ffb700 1 -- 172.21.15.62:0/1117408331 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f593006b970 con 0x7f5948062b60 2021-12-17T18:20:21.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.722+0000 7f5947fff700 1 --2- 172.21.15.62:0/1117408331 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f592c053580 0x7f592c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.722+0000 7f5947fff700 1 --2- 172.21.15.62:0/1117408331 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f592c053580 0x7f592c055a40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f593801f000 tx=0x7f5938018000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:21.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.726+0000 7f5945ffb700 1 -- 172.21.15.62:0/1117408331 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f594813a3c0 con 0x7f5948062b60 2021-12-17T18:20:21.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.850+0000 7f594d2fc700 1 -- 172.21.15.62:0/1117408331 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f594813a390 con 0x7f5948062b60 2021-12-17T18:20:21.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.850+0000 7f5945ffb700 1 -- 172.21.15.62:0/1117408331 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5930042a70 con 0x7f5948062b60 2021-12-17T18:20:21.857 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:20:21.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.854+0000 7f594d2fc700 1 -- 172.21.15.62:0/1117408331 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f592c053580 msgr2=0x7f592c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.854+0000 7f594d2fc700 1 --2- 172.21.15.62:0/1117408331 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f592c053580 0x7f592c055a40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f593801f000 tx=0x7f5938018000).stop 2021-12-17T18:20:21.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.854+0000 7f594d2fc700 1 -- 172.21.15.62:0/1117408331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5948062b60 msgr2=0x7f594813b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.854+0000 7f594d2fc700 1 --2- 172.21.15.62:0/1117408331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5948062b60 0x7f594813b150 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f5930006940 tx=0x7f5930008040).stop 2021-12-17T18:20:21.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.854+0000 7f594d2fc700 1 -- 172.21.15.62:0/1117408331 shutdown_connections 2021-12-17T18:20:21.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.854+0000 7f594d2fc700 1 --2- 172.21.15.62:0/1117408331 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f592c053580 0x7f592c055a40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.854+0000 7f594d2fc700 1 --2- 172.21.15.62:0/1117408331 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f59480b2d00 0x7f594814e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.854+0000 7f594d2fc700 1 --2- 172.21.15.62:0/1117408331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5948062b60 0x7f594813b150 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.854+0000 7f594d2fc700 1 --2- 172.21.15.62:0/1117408331 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f59480625b0 0x7f594813d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.854+0000 7f594d2fc700 1 -- 172.21.15.62:0/1117408331 >> 172.21.15.62:0/1117408331 conn(0x7f5948060a50 msgr2=0x7f594805ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:21.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.854+0000 7f594d2fc700 1 -- 172.21.15.62:0/1117408331 shutdown_connections 2021-12-17T18:20:21.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.854+0000 7f594d2fc700 1 -- 172.21.15.62:0/1117408331 wait complete. 2021-12-17T18:20:21.870 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:20:21.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.966+0000 7f1d0353b700 1 Processor -- start 2021-12-17T18:20:21.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d0353b700 1 -- start start 2021-12-17T18:20:21.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d0353b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1cfc0b1160 0x7f1cfc142190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d0353b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cfc05fe50 con 0x7f1cfc142680 2021-12-17T18:20:21.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d0353b700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cfc061390 con 0x7f1cfc05fa70 2021-12-17T18:20:21.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d0353b700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cfc061df0 con 0x7f1cfc0b1160 2021-12-17T18:20:21.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d02d3a700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1cfc142680 0x7f1cfc142af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33700/0 (socket says 172.21.15.62:33700) 2021-12-17T18:20:21.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d02d3a700 1 -- 172.21.15.62:0/1985734016 learned_addr learned my addr 172.21.15.62:0/1985734016 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:21.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d01d38700 1 --2- 172.21.15.62:0/1985734016 >> v2:172.21.15.109:3300/0 conn(0x7f1cfc0b1160 0x7f1cfc142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d01537700 1 -- 172.21.15.62:0/1985734016 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024671235 0 0) 0x7f1cfc05fe50 con 0x7f1cfc142680 2021-12-17T18:20:21.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d01537700 1 -- 172.21.15.62:0/1985734016 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ce4003260 con 0x7f1cfc142680 2021-12-17T18:20:21.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d01537700 1 -- 172.21.15.62:0/1985734016 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774670543 0 0) 0x7f1cfc061390 con 0x7f1cfc05fa70 2021-12-17T18:20:21.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d01537700 1 -- 172.21.15.62:0/1985734016 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cfc05fe50 con 0x7f1cfc05fa70 2021-12-17T18:20:21.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d01d38700 1 -- 172.21.15.62:0/1985734016 >> v1:172.21.15.109:6789/0 conn(0x7f1cfc05fa70 legacy=0x7f1cfc064910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d01d38700 1 -- 172.21.15.62:0/1985734016 >> v1:172.21.15.62:6789/0 conn(0x7f1cfc142680 legacy=0x7f1cfc142af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d01d38700 1 -- 172.21.15.62:0/1985734016 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc061630 con 0x7f1cfc0b1160 2021-12-17T18:20:21.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d01d38700 1 --2- 172.21.15.62:0/1985734016 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cfc0b1160 0x7f1cfc142190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f1cec002f70 tx=0x7f1cec006df0).ready entity=mon.1 client_cookie=930cfddba7ab1654 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:21.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d01537700 1 -- 172.21.15.62:0/1985734016 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cec00d540 con 0x7f1cfc0b1160 2021-12-17T18:20:21.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d01537700 1 -- 172.21.15.62:0/1985734016 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec000e90 con 0x7f1cfc0b1160 2021-12-17T18:20:21.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.970+0000 7f1d01537700 1 -- 172.21.15.62:0/1985734016 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cec00d890 con 0x7f1cfc0b1160 2021-12-17T18:20:21.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.974+0000 7f1d0353b700 1 -- 172.21.15.62:0/1985734016 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cfc0b1160 msgr2=0x7f1cfc142190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.974+0000 7f1d0353b700 1 --2- 172.21.15.62:0/1985734016 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cfc0b1160 0x7f1cfc142190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f1cec002f70 tx=0x7f1cec006df0).stop 2021-12-17T18:20:21.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.974+0000 7f1d0353b700 1 -- 172.21.15.62:0/1985734016 shutdown_connections 2021-12-17T18:20:21.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.974+0000 7f1d0353b700 1 --2- 172.21.15.62:0/1985734016 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cfc0b1160 0x7f1cfc142190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.974+0000 7f1d0353b700 1 -- 172.21.15.62:0/1985734016 >> 172.21.15.62:0/1985734016 conn(0x7f1cfc063510 msgr2=0x7f1cfc0638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:21.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.974+0000 7f1d0353b700 1 -- 172.21.15.62:0/1985734016 shutdown_connections 2021-12-17T18:20:21.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.974+0000 7f1d0353b700 1 -- 172.21.15.62:0/1985734016 wait complete. 2021-12-17T18:20:21.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.974+0000 7f1d0353b700 1 Processor -- start 2021-12-17T18:20:21.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.974+0000 7f1d0353b700 1 -- start start 2021-12-17T18:20:21.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d0353b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1cfc05fa70 0x7f1cfc146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d0353b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cfc0b1160 0x7f1cfc155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d0353b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cfc142680 0x7f1cfc0ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d0353b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc13ee80 con 0x7f1cfc0b1160 2021-12-17T18:20:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d0353b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc156a70 con 0x7f1cfc142680 2021-12-17T18:20:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d0353b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc1567d0 con 0x7f1cfc05fa70 2021-12-17T18:20:21.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d01d38700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cfc0b1160 0x7f1cfc155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d01d38700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cfc0b1160 0x7f1cfc155ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50124/0 (socket says 172.21.15.62:50124) 2021-12-17T18:20:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d01d38700 1 -- 172.21.15.62:0/3477285910 learned_addr learned my addr 172.21.15.62:0/3477285910 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:21.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d02539700 1 --2- 172.21.15.62:0/3477285910 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1cfc05fa70 0x7f1cfc146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d02d3a700 1 --2- 172.21.15.62:0/3477285910 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cfc142680 0x7f1cfc0ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d01d38700 1 -- 172.21.15.62:0/3477285910 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1cfc05fa70 msgr2=0x7f1cfc146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d01d38700 1 --2- 172.21.15.62:0/3477285910 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1cfc05fa70 0x7f1cfc146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d01d38700 1 -- 172.21.15.62:0/3477285910 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cfc142680 msgr2=0x7f1cfc0ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d01d38700 1 --2- 172.21.15.62:0/3477285910 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cfc142680 0x7f1cfc0ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:21.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d01d38700 1 -- 172.21.15.62:0/3477285910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec00b180 con 0x7f1cfc0b1160 2021-12-17T18:20:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d02539700 1 --2- 172.21.15.62:0/3477285910 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1cfc05fa70 0x7f1cfc146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:20:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d01d38700 1 --2- 172.21.15.62:0/3477285910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cfc0b1160 0x7f1cfc155ea0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f1cec002f70 tx=0x7f1cec014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:21.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1ceb7fe700 1 -- 172.21.15.62:0/3477285910 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cec016070 con 0x7f1cfc0b1160 2021-12-17T18:20:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1ceb7fe700 1 -- 172.21.15.62:0/3477285910 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec013850 con 0x7f1cfc0b1160 2021-12-17T18:20:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d0353b700 1 -- 172.21.15.62:0/3477285910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cfc146850 con 0x7f1cfc0b1160 2021-12-17T18:20:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1ceb7fe700 1 -- 172.21.15.62:0/3477285910 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cec013bb0 con 0x7f1cfc0b1160 2021-12-17T18:20:21.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.978+0000 7f1d0353b700 1 -- 172.21.15.62:0/3477285910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cfc156390 con 0x7f1cfc0b1160 2021-12-17T18:20:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.982+0000 7f1d0353b700 1 -- 172.21.15.62:0/3477285910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cfc1565e0 con 0x7f1cfc0b1160 2021-12-17T18:20:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.982+0000 7f1ceb7fe700 1 -- 172.21.15.62:0/3477285910 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1cec025030 con 0x7f1cfc0b1160 2021-12-17T18:20:21.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.982+0000 7f1ceb7fe700 1 --2- 172.21.15.62:0/3477285910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cdc0536a0 0x7f1cdc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:21.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.982+0000 7f1ceb7fe700 1 -- 172.21.15.62:0/3477285910 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1cec06c8b0 con 0x7f1cfc0b1160 2021-12-17T18:20:21.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.982+0000 7f1d02539700 1 --2- 172.21.15.62:0/3477285910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cdc0536a0 0x7f1cdc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:21.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.982+0000 7f1d02539700 1 --2- 172.21.15.62:0/3477285910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cdc0536a0 0x7f1cdc055b60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f1cf800d000 tx=0x7f1cf8007da0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:21.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:21.990+0000 7f1ceb7fe700 1 -- 172.21.15.62:0/3477285910 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1cec043a10 con 0x7f1cfc0b1160 2021-12-17T18:20:22.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.118+0000 7f1d0353b700 1 -- 172.21.15.62:0/3477285910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1cfc0618d0 con 0x7f1cfc0b1160 2021-12-17T18:20:22.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.118+0000 7f1ceb7fe700 1 -- 172.21.15.62:0/3477285910 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1cec023020 con 0x7f1cfc0b1160 2021-12-17T18:20:22.125 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:20:22.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.118+0000 7f1d0353b700 1 -- 172.21.15.62:0/3477285910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cdc0536a0 msgr2=0x7f1cdc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:22.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.118+0000 7f1d0353b700 1 --2- 172.21.15.62:0/3477285910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cdc0536a0 0x7f1cdc055b60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f1cf800d000 tx=0x7f1cf8007da0).stop 2021-12-17T18:20:22.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.122+0000 7f1d0353b700 1 -- 172.21.15.62:0/3477285910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cfc0b1160 msgr2=0x7f1cfc155ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:22.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.122+0000 7f1d0353b700 1 --2- 172.21.15.62:0/3477285910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cfc0b1160 0x7f1cfc155ea0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f1cec002f70 tx=0x7f1cec014000).stop 2021-12-17T18:20:22.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.122+0000 7f1d0353b700 1 -- 172.21.15.62:0/3477285910 shutdown_connections 2021-12-17T18:20:22.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.122+0000 7f1d0353b700 1 --2- 172.21.15.62:0/3477285910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cdc0536a0 0x7f1cdc055b60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:22.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.122+0000 7f1d0353b700 1 --2- 172.21.15.62:0/3477285910 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cfc142680 0x7f1cfc0ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:22.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.122+0000 7f1d0353b700 1 --2- 172.21.15.62:0/3477285910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cfc0b1160 0x7f1cfc155ea0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:22.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.122+0000 7f1d0353b700 1 --2- 172.21.15.62:0/3477285910 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1cfc05fa70 0x7f1cfc146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:22.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.122+0000 7f1d0353b700 1 -- 172.21.15.62:0/3477285910 >> 172.21.15.62:0/3477285910 conn(0x7f1cfc063510 msgr2=0x7f1cfc0b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:22.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.122+0000 7f1d0353b700 1 -- 172.21.15.62:0/3477285910 shutdown_connections 2021-12-17T18:20:22.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.122+0000 7f1d0353b700 1 -- 172.21.15.62:0/3477285910 wait complete. 2021-12-17T18:20:22.146 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:20:22.147 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:20:22.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66b2827700 1 Processor -- start 2021-12-17T18:20:22.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66b2827700 1 -- start start 2021-12-17T18:20:22.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66b2827700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66ac0b5fc0 0x7f66ac148180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:22.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66b2827700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66ac05bed0 0x7f66ac0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:22.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66b2827700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ac0ad450 con 0x7f66ac14acb0 2021-12-17T18:20:22.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66b2827700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ac0ab8d0 con 0x7f66ac05bed0 2021-12-17T18:20:22.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66b2827700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac148740 con 0x7f66ac0b5fc0 2021-12-17T18:20:22.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66ab7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66ac05bed0 0x7f66ac0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:22.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66ab7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66ac05bed0 0x7f66ac0b2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50130/0 (socket says 172.21.15.62:50130) 2021-12-17T18:20:22.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66ab7fe700 1 -- 172.21.15.62:0/668530103 learned_addr learned my addr 172.21.15.62:0/668530103 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:22.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66b0dc4700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f66ac14acb0 0x7f66ac146d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33714/0 (socket says 172.21.15.62:33714) 2021-12-17T18:20:22.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66abfff700 1 --2- 172.21.15.62:0/668530103 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66ac0b5fc0 0x7f66ac148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:22.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66ab7fe700 1 -- 172.21.15.62:0/668530103 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66ac0b5fc0 msgr2=0x7f66ac148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:22.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66ab7fe700 1 --2- 172.21.15.62:0/668530103 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66ac0b5fc0 0x7f66ac148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:22.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66ab7fe700 1 -- 172.21.15.62:0/668530103 >> v1:172.21.15.62:6789/0 conn(0x7f66ac14acb0 legacy=0x7f66ac146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:22.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66ab7fe700 1 -- 172.21.15.62:0/668530103 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac0ad6f0 con 0x7f66ac05bed0 2021-12-17T18:20:22.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66abfff700 1 --2- 172.21.15.62:0/668530103 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66ac0b5fc0 0x7f66ac148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:22.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66ab7fe700 1 --2- 172.21.15.62:0/668530103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66ac05bed0 0x7f66ac0b2120 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f6694002f70 tx=0x7f6694006eb0).ready entity=mon.0 client_cookie=bffe700432e180ee server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:22.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66aaffd700 1 -- 172.21.15.62:0/668530103 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f669400d5c0 con 0x7f66ac05bed0 2021-12-17T18:20:22.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66aaffd700 1 -- 172.21.15.62:0/668530103 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6694000e90 con 0x7f66ac05bed0 2021-12-17T18:20:22.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66aaffd700 1 -- 172.21.15.62:0/668530103 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f669400d950 con 0x7f66ac05bed0 2021-12-17T18:20:22.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66b2827700 1 -- 172.21.15.62:0/668530103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66ac05bed0 msgr2=0x7f66ac0b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:22.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66b2827700 1 --2- 172.21.15.62:0/668530103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66ac05bed0 0x7f66ac0b2120 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f6694002f70 tx=0x7f6694006eb0).stop 2021-12-17T18:20:22.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66b2827700 1 -- 172.21.15.62:0/668530103 shutdown_connections 2021-12-17T18:20:22.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66b2827700 1 --2- 172.21.15.62:0/668530103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66ac05bed0 0x7f66ac0b2120 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:22.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66b2827700 1 --2- 172.21.15.62:0/668530103 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66ac0b5fc0 0x7f66ac148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:22.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66b2827700 1 -- 172.21.15.62:0/668530103 >> 172.21.15.62:0/668530103 conn(0x7f66ac05c750 msgr2=0x7f66ac0630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:22.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66b2827700 1 -- 172.21.15.62:0/668530103 shutdown_connections 2021-12-17T18:20:22.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.242+0000 7f66b2827700 1 -- 172.21.15.62:0/668530103 wait complete. 2021-12-17T18:20:22.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66b2827700 1 Processor -- start 2021-12-17T18:20:22.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66b2827700 1 -- start start 2021-12-17T18:20:22.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66b2827700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66ac05bed0 0x7f66ac14e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:22.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66b2827700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66ac0b5fc0 0x7f66ac15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:22.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66b2827700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66ac14acb0 0x7f66ac14cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:22.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66b2827700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac14dc00 con 0x7f66ac0b5fc0 2021-12-17T18:20:22.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66b2827700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac14dea0 con 0x7f66ac14acb0 2021-12-17T18:20:22.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66b2827700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac066400 con 0x7f66ac05bed0 2021-12-17T18:20:22.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66ab7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66ac0b5fc0 0x7f66ac15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:22.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66ab7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66ac0b5fc0 0x7f66ac15a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50138/0 (socket says 172.21.15.62:50138) 2021-12-17T18:20:22.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66ab7fe700 1 -- 172.21.15.62:0/206946856 learned_addr learned my addr 172.21.15.62:0/206946856 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:22.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66abfff700 1 --2- 172.21.15.62:0/206946856 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66ac05bed0 0x7f66ac14e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:22.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66b0dc4700 1 --2- 172.21.15.62:0/206946856 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66ac14acb0 0x7f66ac14cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:22.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66ab7fe700 1 -- 172.21.15.62:0/206946856 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66ac05bed0 msgr2=0x7f66ac14e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:22.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66ab7fe700 1 --2- 172.21.15.62:0/206946856 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66ac05bed0 0x7f66ac14e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:22.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66ab7fe700 1 -- 172.21.15.62:0/206946856 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66ac14acb0 msgr2=0x7f66ac14cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:22.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66ab7fe700 1 --2- 172.21.15.62:0/206946856 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66ac14acb0 0x7f66ac14cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:22.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66ab7fe700 1 -- 172.21.15.62:0/206946856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669400b1e0 con 0x7f66ac0b5fc0 2021-12-17T18:20:22.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66b0dc4700 1 --2- 172.21.15.62:0/206946856 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66ac14acb0 0x7f66ac14cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:20:22.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66ab7fe700 1 --2- 172.21.15.62:0/206946856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66ac0b5fc0 0x7f66ac15a320 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f6694002f70 tx=0x7f6694015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:22.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66a97fa700 1 -- 172.21.15.62:0/206946856 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6694011950 con 0x7f66ac0b5fc0 2021-12-17T18:20:22.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66a97fa700 1 -- 172.21.15.62:0/206946856 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6694011ab0 con 0x7f66ac0b5fc0 2021-12-17T18:20:22.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66a97fa700 1 -- 172.21.15.62:0/206946856 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6694011e10 con 0x7f66ac0b5fc0 2021-12-17T18:20:22.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66b2827700 1 -- 172.21.15.62:0/206946856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ac15a810 con 0x7f66ac0b5fc0 2021-12-17T18:20:22.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.246+0000 7f66b2827700 1 -- 172.21.15.62:0/206946856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ac14d1f0 con 0x7f66ac0b5fc0 2021-12-17T18:20:22.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.250+0000 7f66b2827700 1 -- 172.21.15.62:0/206946856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ac14e0a0 con 0x7f66ac0b5fc0 2021-12-17T18:20:22.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.250+0000 7f66a97fa700 1 -- 172.21.15.62:0/206946856 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6694025030 con 0x7f66ac0b5fc0 2021-12-17T18:20:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.250+0000 7f66a97fa700 1 --2- 172.21.15.62:0/206946856 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f66900536a0 0x7f6690055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.250+0000 7f66a97fa700 1 -- 172.21.15.62:0/206946856 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f669406ccb0 con 0x7f66ac0b5fc0 2021-12-17T18:20:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.250+0000 7f66abfff700 1 --2- 172.21.15.62:0/206946856 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f66900536a0 0x7f6690055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.250+0000 7f66abfff700 1 --2- 172.21.15.62:0/206946856 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f66900536a0 0x7f6690055b60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f669c00d000 tx=0x7f669c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.254+0000 7f66a97fa700 1 -- 172.21.15.62:0/206946856 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6694043e10 con 0x7f66ac0b5fc0 2021-12-17T18:20:22.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.418+0000 7f66b2827700 1 -- 172.21.15.62:0/206946856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66ac0665c0 con 0x7f66ac0b5fc0 2021-12-17T18:20:22.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.418+0000 7f66a97fa700 1 -- 172.21.15.62:0/206946856 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2135 (secure 0 0 0) 0x7f6694023020 con 0x7f66ac0b5fc0 2021-12-17T18:20:22.427 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:22.427 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/16961477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":16961477},{"type":"v1","addr":"172.21.15.109:6835","nonce":16961477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:20:16.801183+0000","modified":"2021-12-17T18:20:18.581684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/3317956606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3317956606},{"type":"v1","addr":"172.21.15.62:6833","nonce":3317956606}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-12-17T18:20:22.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.422+0000 7f66b2827700 1 -- 172.21.15.62:0/206946856 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f66900536a0 msgr2=0x7f6690055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:22.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.422+0000 7f66b2827700 1 --2- 172.21.15.62:0/206946856 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f66900536a0 0x7f6690055b60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f669c00d000 tx=0x7f669c008040).stop 2021-12-17T18:20:22.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.422+0000 7f66b2827700 1 -- 172.21.15.62:0/206946856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66ac0b5fc0 msgr2=0x7f66ac15a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:22.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.422+0000 7f66b2827700 1 --2- 172.21.15.62:0/206946856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66ac0b5fc0 0x7f66ac15a320 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f6694002f70 tx=0x7f6694015000).stop 2021-12-17T18:20:22.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.422+0000 7f66b2827700 1 -- 172.21.15.62:0/206946856 shutdown_connections 2021-12-17T18:20:22.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.422+0000 7f66b2827700 1 --2- 172.21.15.62:0/206946856 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f66900536a0 0x7f6690055b60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:22.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.422+0000 7f66b2827700 1 --2- 172.21.15.62:0/206946856 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66ac14acb0 0x7f66ac14cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:22.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.422+0000 7f66b2827700 1 --2- 172.21.15.62:0/206946856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66ac0b5fc0 0x7f66ac15a320 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:22.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.422+0000 7f66b2827700 1 --2- 172.21.15.62:0/206946856 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66ac05bed0 0x7f66ac14e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:22.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.422+0000 7f66b2827700 1 -- 172.21.15.62:0/206946856 >> 172.21.15.62:0/206946856 conn(0x7f66ac05c750 msgr2=0x7f66ac0b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:22.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.426+0000 7f66b2827700 1 -- 172.21.15.62:0/206946856 shutdown_connections 2021-12-17T18:20:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:22.426+0000 7f66b2827700 1 -- 172.21.15.62:0/206946856 wait complete. 2021-12-17T18:20:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2021-12-17T18:20:22.647 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:20:16.801183+0000', 'modified': '2021-12-17T18:20:18.581684+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5277}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5277': {'gid': 5277, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/3317956606', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 3317956606}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 3317956606}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:20:22.647 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:20:22.648 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:20:22.763 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":5277,"want_state":"up:active","state":"up:active","rank_uptime":5.9496667050000003,"mdsmap_epoch":16,"osdmap_epoch":42,"osdmap_epoch_barrier":42,"uptime":10.316366465} 2021-12-17T18:20:22.764 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 5277, "mdsmap_epoch": 16, "osdmap_epoch": 42, "osdmap_epoch_barrier": 42, "rank_uptime": 5.949666705, "state": "up:active", "uptime": 10.316366465, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:20:22.764 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:20:22.765 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-12-17T18:20:22.765 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-12-17T18:20:22.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:22.766 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:20:22.774 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:20:22.834 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:20:22.834 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:20:22.848 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:20:22.849 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:20:22.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:22.851 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:20:22.857 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:20:22.858 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:20:22.861 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:20:22.878 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:20:22.879 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:20:22.890 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:20:22.891 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:20:22.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:22.892 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:20:22.935 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2021-12-17T18:20:22.932+0000 7fab4319a080 -1 init, newargv = 0x55827b992ea0 newargc=9 2021-12-17T18:20:22.935 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14050]: starting ceph client 2021-12-17T18:20:22.945 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14050]: starting fuse 2021-12-17T18:20:24.044 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:20:24.063 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:20:24.064 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:20:24.120 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:20:24.121 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:20:24.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:24.123 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:20:24.128 INFO:teuthology.orchestra.run.smithi125.stdout:52 2021-12-17T18:20:24.129 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:20:24.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:24.130 DEBUG:teuthology.orchestra.run.smithi125:> sudo python3 -c ' 2021-12-17T18:20:24.130 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2021-12-17T18:20:24.131 DEBUG:teuthology.orchestra.run.smithi125:> import re 2021-12-17T18:20:24.131 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:20:24.132 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2021-12-17T18:20:24.132 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:20:24.133 DEBUG:teuthology.orchestra.run.smithi125:> def find_socket(client_name): 2021-12-17T18:20:24.133 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-12-17T18:20:24.134 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2021-12-17T18:20:24.134 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:20:24.135 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2021-12-17T18:20:24.135 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2021-12-17T18:20:24.135 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2021-12-17T18:20:24.136 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2021-12-17T18:20:24.136 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:20:24.137 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2021-12-17T18:20:24.137 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:20:24.138 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:20:24.138 DEBUG:teuthology.orchestra.run.smithi125:> return f 2021-12-17T18:20:24.138 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:20:24.139 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:20:24.139 DEBUG:teuthology.orchestra.run.smithi125:> print(find_socket("client.0")) 2021-12-17T18:20:24.140 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:20:24.182 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.14050.asok 2021-12-17T18:20:24.187 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14050.asok 2021-12-17T18:20:24.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:24.188 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14050.asok status 2021-12-17T18:20:24.325 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2021-12-17T18:20:24.325 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2021-12-17T18:20:24.325 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:20:24.326 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:20:24.326 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2021-12-17T18:20:24.326 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2021-12-17T18:20:24.327 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-12-17T18:20:24.327 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "14050", 2021-12-17T18:20:24.327 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2021-12-17T18:20:24.327 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:20:24.328 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2021-12-17T18:20:24.328 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2021-12-17T18:20:24.328 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5401, 2021-12-17T18:20:24.328 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2021-12-17T18:20:24.328 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2021-12-17T18:20:24.329 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2021-12-17T18:20:24.329 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 5401 2021-12-17T18:20:24.329 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:20:24.329 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:20:24.330 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:20:24.330 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:20:24.330 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 2285445983 2021-12-17T18:20:24.330 INFO:teuthology.orchestra.run.smithi125.stdout: } 2021-12-17T18:20:24.330 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:20:24.331 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:20:24.331 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:20:24.331 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:20:24.331 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 2285445983 2021-12-17T18:20:24.332 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:20:24.332 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.5401 172.21.15.125:0/2285445983", 2021-12-17T18:20:24.332 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "172.21.15.125:0/2285445983", 2021-12-17T18:20:24.332 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2021-12-17T18:20:24.333 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 16, 2021-12-17T18:20:24.333 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 42, 2021-12-17T18:20:24.333 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:20:24.333 INFO:teuthology.orchestra.run.smithi125.stdout: "blacklisted": false, 2021-12-17T18:20:24.333 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2021-12-17T18:20:24.334 INFO:teuthology.orchestra.run.smithi125.stdout:} 2021-12-17T18:20:24.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:24.336 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:20:24.337 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:20:24.343 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:20:24.344 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:20:24.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:24.345 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:20:24.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:24.363 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:20:24.363 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:20:24.412 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:20:24.413 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:20:24.414 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-12-17T18:20:24.415 DEBUG:teuthology.orchestra.run.smithi125:> import sys 2021-12-17T18:20:24.415 DEBUG:teuthology.orchestra.run.smithi125:> import time 2021-12-17T18:20:24.415 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:20:24.416 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:20:24.416 DEBUG:teuthology.orchestra.run.smithi125:> n = 1000 2021-12-17T18:20:24.417 DEBUG:teuthology.orchestra.run.smithi125:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-12-17T18:20:24.417 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:20:24.417 DEBUG:teuthology.orchestra.run.smithi125:> if not os.path.exists(os.path.dirname(abs_path)): 2021-12-17T18:20:24.418 DEBUG:teuthology.orchestra.run.smithi125:> os.makedirs(os.path.dirname(abs_path)) 2021-12-17T18:20:24.418 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:20:24.419 DEBUG:teuthology.orchestra.run.smithi125:> for i in range(0, n): 2021-12-17T18:20:24.419 DEBUG:teuthology.orchestra.run.smithi125:> fname = "{0}_{1}".format(abs_path, i) 2021-12-17T18:20:24.419 DEBUG:teuthology.orchestra.run.smithi125:> with open(fname, '"'"'w'"'"') as f: 2021-12-17T18:20:24.420 DEBUG:teuthology.orchestra.run.smithi125:> f.write('"'"'content'"'"') 2021-12-17T18:20:24.420 DEBUG:teuthology.orchestra.run.smithi125:> if True: 2021-12-17T18:20:24.421 DEBUG:teuthology.orchestra.run.smithi125:> f.flush() 2021-12-17T18:20:24.421 DEBUG:teuthology.orchestra.run.smithi125:> os.fsync(f.fileno()) 2021-12-17T18:20:24.421 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:20:33.055 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:20:33.059 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:20:33.062 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:20:33.065 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:20:33.069 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:20:35.307 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:20:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.418+0000 7f8826856700 1 Processor -- start 2021-12-17T18:20:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.418+0000 7f8826856700 1 -- start start 2021-12-17T18:20:35.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8826856700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88200a8010 0x7f8820147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:35.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8826856700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88200b6270 con 0x7f8820141480 2021-12-17T18:20:35.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8826856700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8820147610 con 0x7f88200a8e10 2021-12-17T18:20:35.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8826856700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88201478b0 con 0x7f88200a8010 2021-12-17T18:20:35.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8825854700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8820141480 0x7f88200b5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33728/0 (socket says 172.21.15.62:33728) 2021-12-17T18:20:35.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8825854700 1 -- 172.21.15.62:0/163068190 learned_addr learned my addr 172.21.15.62:0/163068190 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:35.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8826055700 1 --2- 172.21.15.62:0/163068190 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88200a8010 0x7f8820147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:35.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8824852700 1 -- 172.21.15.62:0/163068190 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235022534 0 0) 0x7f88200b6270 con 0x7f8820141480 2021-12-17T18:20:35.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8824852700 1 -- 172.21.15.62:0/163068190 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8808003260 con 0x7f8820141480 2021-12-17T18:20:35.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8824852700 1 -- 172.21.15.62:0/163068190 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239578076 0 0) 0x7f8820147610 con 0x7f88200a8e10 2021-12-17T18:20:35.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8824852700 1 -- 172.21.15.62:0/163068190 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88200b6270 con 0x7f88200a8e10 2021-12-17T18:20:35.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8826055700 1 -- 172.21.15.62:0/163068190 >> v1:172.21.15.109:6789/0 conn(0x7f88200a8e10 legacy=0x7f88200a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:35.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8824852700 1 -- 172.21.15.62:0/163068190 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1056752852 0 0) 0x7f8808003260 con 0x7f8820141480 2021-12-17T18:20:35.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8826055700 1 -- 172.21.15.62:0/163068190 >> v1:172.21.15.62:6789/0 conn(0x7f8820141480 legacy=0x7f88200b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:35.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8826055700 1 -- 172.21.15.62:0/163068190 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8820147b50 con 0x7f88200a8010 2021-12-17T18:20:35.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8826055700 1 --2- 172.21.15.62:0/163068190 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88200a8010 0x7f8820147ff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8810001110 tx=0x7f88180091d0).ready entity=mon.2 client_cookie=15b933f58d1ffd66 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:35.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8824852700 1 -- 172.21.15.62:0/163068190 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8810001660 con 0x7f88200a8010 2021-12-17T18:20:35.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8824852700 1 -- 172.21.15.62:0/163068190 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881800f510 con 0x7f88200a8010 2021-12-17T18:20:35.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8824852700 1 -- 172.21.15.62:0/163068190 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f881800f680 con 0x7f88200a8010 2021-12-17T18:20:35.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8826856700 1 -- 172.21.15.62:0/163068190 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88200a8010 msgr2=0x7f8820147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8826856700 1 --2- 172.21.15.62:0/163068190 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88200a8010 0x7f8820147ff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8810001110 tx=0x7f88180091d0).stop 2021-12-17T18:20:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8826856700 1 -- 172.21.15.62:0/163068190 shutdown_connections 2021-12-17T18:20:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8826856700 1 --2- 172.21.15.62:0/163068190 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88200a8010 0x7f8820147ff0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8826856700 1 -- 172.21.15.62:0/163068190 >> 172.21.15.62:0/163068190 conn(0x7f882005d220 msgr2=0x7f88200b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:35.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8826856700 1 -- 172.21.15.62:0/163068190 shutdown_connections 2021-12-17T18:20:35.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.422+0000 7f8826856700 1 -- 172.21.15.62:0/163068190 wait complete. 2021-12-17T18:20:35.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8826856700 1 Processor -- start 2021-12-17T18:20:35.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8826856700 1 -- start start 2021-12-17T18:20:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8826856700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88200a8010 0x7f882015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8826856700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88200a8e10 0x7f88200ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8826856700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8820141480 0x7f882013e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8826856700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8820148bd0 con 0x7f88200a8e10 2021-12-17T18:20:35.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8826856700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882014aa80 con 0x7f8820141480 2021-12-17T18:20:35.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8826856700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88200adfc0 con 0x7f88200a8010 2021-12-17T18:20:35.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8825053700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88200a8e10 0x7f88200ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:35.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8825053700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88200a8e10 0x7f88200ab3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50154/0 (socket says 172.21.15.62:50154) 2021-12-17T18:20:35.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8825053700 1 -- 172.21.15.62:0/3722663455 learned_addr learned my addr 172.21.15.62:0/3722663455 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:35.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8826055700 1 --2- 172.21.15.62:0/3722663455 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8820141480 0x7f882013e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:35.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8825854700 1 --2- 172.21.15.62:0/3722663455 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88200a8010 0x7f882015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:35.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8825053700 1 -- 172.21.15.62:0/3722663455 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88200a8010 msgr2=0x7f882015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:35.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8825053700 1 --2- 172.21.15.62:0/3722663455 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88200a8010 0x7f882015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:35.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8825053700 1 -- 172.21.15.62:0/3722663455 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8820141480 msgr2=0x7f882013e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:35.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8825053700 1 --2- 172.21.15.62:0/3722663455 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8820141480 0x7f882013e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:35.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8825053700 1 -- 172.21.15.62:0/3722663455 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8818009470 con 0x7f88200a8e10 2021-12-17T18:20:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8825854700 1 --2- 172.21.15.62:0/3722663455 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88200a8010 0x7f882015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:20:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8825053700 1 --2- 172.21.15.62:0/3722663455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88200a8e10 0x7f88200ab3c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f882014a950 tx=0x7f881c007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f880effd700 1 -- 172.21.15.62:0/3722663455 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f881c012400 con 0x7f88200a8e10 2021-12-17T18:20:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f880effd700 1 -- 172.21.15.62:0/3722663455 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c012560 con 0x7f88200a8e10 2021-12-17T18:20:35.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8826856700 1 -- 172.21.15.62:0/3722663455 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88200ae260 con 0x7f88200a8e10 2021-12-17T18:20:35.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f880effd700 1 -- 172.21.15.62:0/3722663455 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f881c0128c0 con 0x7f88200a8e10 2021-12-17T18:20:35.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.426+0000 7f8826856700 1 -- 172.21.15.62:0/3722663455 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88200ab8b0 con 0x7f88200a8e10 2021-12-17T18:20:35.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.430+0000 7f8826856700 1 -- 172.21.15.62:0/3722663455 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88200b1b90 con 0x7f88200a8e10 2021-12-17T18:20:35.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.430+0000 7f880effd700 1 -- 172.21.15.62:0/3722663455 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f881c019030 con 0x7f88200a8e10 2021-12-17T18:20:35.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.430+0000 7f880effd700 1 --2- 172.21.15.62:0/3722663455 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8800053580 0x7f8800055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:35.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.430+0000 7f880effd700 1 -- 172.21.15.62:0/3722663455 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f881c06acb0 con 0x7f88200a8e10 2021-12-17T18:20:35.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.430+0000 7f8825854700 1 --2- 172.21.15.62:0/3722663455 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8800053580 0x7f8800055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:35.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.430+0000 7f8825854700 1 --2- 172.21.15.62:0/3722663455 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8800053580 0x7f8800055a40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f881000d000 tx=0x7f8810000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:35.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.438+0000 7f880effd700 1 -- 172.21.15.62:0/3722663455 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f881c041e10 con 0x7f88200a8e10 2021-12-17T18:20:35.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.606+0000 7f8826856700 1 -- 172.21.15.62:0/3722663455 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88200684f0 con 0x7f88200a8e10 2021-12-17T18:20:35.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.606+0000 7f880effd700 1 -- 172.21.15.62:0/3722663455 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2135 (secure 0 0 0) 0x7f881c045430 con 0x7f88200a8e10 2021-12-17T18:20:35.611 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:35.611 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/16961477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":16961477},{"type":"v1","addr":"172.21.15.109:6835","nonce":16961477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:20:16.801183+0000","modified":"2021-12-17T18:20:18.581684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/3317956606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3317956606},{"type":"v1","addr":"172.21.15.62:6833","nonce":3317956606}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-12-17T18:20:35.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.610+0000 7f8826856700 1 -- 172.21.15.62:0/3722663455 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8800053580 msgr2=0x7f8800055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:35.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.610+0000 7f8826856700 1 --2- 172.21.15.62:0/3722663455 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8800053580 0x7f8800055a40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f881000d000 tx=0x7f8810000bc0).stop 2021-12-17T18:20:35.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.610+0000 7f8826856700 1 -- 172.21.15.62:0/3722663455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88200a8e10 msgr2=0x7f88200ab3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.610+0000 7f8826856700 1 --2- 172.21.15.62:0/3722663455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88200a8e10 0x7f88200ab3c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f882014a950 tx=0x7f881c007ae0).stop 2021-12-17T18:20:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.610+0000 7f8826856700 1 -- 172.21.15.62:0/3722663455 shutdown_connections 2021-12-17T18:20:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.610+0000 7f8826856700 1 --2- 172.21.15.62:0/3722663455 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8800053580 0x7f8800055a40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:35.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.610+0000 7f8826856700 1 --2- 172.21.15.62:0/3722663455 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8820141480 0x7f882013e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:35.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.610+0000 7f8826856700 1 --2- 172.21.15.62:0/3722663455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88200a8e10 0x7f88200ab3c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:35.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.610+0000 7f8826856700 1 --2- 172.21.15.62:0/3722663455 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88200a8010 0x7f882015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:35.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.610+0000 7f8826856700 1 -- 172.21.15.62:0/3722663455 >> 172.21.15.62:0/3722663455 conn(0x7f882005d220 msgr2=0x7f882013ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:35.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.610+0000 7f8826856700 1 -- 172.21.15.62:0/3722663455 shutdown_connections 2021-12-17T18:20:35.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.610+0000 7f8826856700 1 -- 172.21.15.62:0/3722663455 wait complete. 2021-12-17T18:20:35.616 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2021-12-17T18:20:35.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-12-17T18:20:35.727 INFO:teuthology.orchestra.run.smithi062.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-12-17T18:20:35.727 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-12-17T18:20:35.728 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:20:35.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.822+0000 7fa3ec861700 1 Processor -- start 2021-12-17T18:20:35.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.822+0000 7fa3ec861700 1 -- start start 2021-12-17T18:20:35.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3ec861700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa3e80a8e10 0x7fa3e8147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:35.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3ec861700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e80b6270 con 0x7fa3e8141480 2021-12-17T18:20:35.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3ec861700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e8147610 con 0x7fa3e80a71e0 2021-12-17T18:20:35.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3ec861700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e81478b0 con 0x7fa3e80a8e10 2021-12-17T18:20:35.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3e77fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa3e8141480 0x7fa3e80b5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33742/0 (socket says 172.21.15.62:33742) 2021-12-17T18:20:35.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3e77fe700 1 -- 172.21.15.62:0/3271676413 learned_addr learned my addr 172.21.15.62:0/3271676413 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:35.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3e7fff700 1 --1- 172.21.15.62:0/3271676413 >> v1:172.21.15.109:6789/0 conn(0x7fa3e80a71e0 0x7fa3e80a7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:50064/0 (socket says 172.21.15.62:50064) 2021-12-17T18:20:35.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3e6ffd700 1 --2- 172.21.15.62:0/3271676413 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa3e80a8e10 0x7fa3e8147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:35.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3e67fc700 1 -- 172.21.15.62:0/3271676413 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474823606 0 0) 0x7fa3e80b6270 con 0x7fa3e8141480 2021-12-17T18:20:35.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3e67fc700 1 -- 172.21.15.62:0/3271676413 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3c8003260 con 0x7fa3e8141480 2021-12-17T18:20:35.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3e67fc700 1 -- 172.21.15.62:0/3271676413 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481712411 0 0) 0x7fa3e8147610 con 0x7fa3e80a71e0 2021-12-17T18:20:35.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3e67fc700 1 -- 172.21.15.62:0/3271676413 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3e80b6270 con 0x7fa3e80a71e0 2021-12-17T18:20:35.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3e6ffd700 1 -- 172.21.15.62:0/3271676413 >> v1:172.21.15.109:6789/0 conn(0x7fa3e80a71e0 legacy=0x7fa3e80a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:35.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3e6ffd700 1 -- 172.21.15.62:0/3271676413 >> v1:172.21.15.62:6789/0 conn(0x7fa3e8141480 legacy=0x7fa3e80b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:35.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3e6ffd700 1 -- 172.21.15.62:0/3271676413 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e8147b50 con 0x7fa3e80a8e10 2021-12-17T18:20:35.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3e6ffd700 1 --2- 172.21.15.62:0/3271676413 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa3e80a8e10 0x7fa3e8147ff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa3d8002f70 tx=0x7fa3d8006df0).ready entity=mon.2 client_cookie=a0cb6da293ea8a99 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:35.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3e67fc700 1 -- 172.21.15.62:0/3271676413 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3d800d5c0 con 0x7fa3e80a8e10 2021-12-17T18:20:35.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3e67fc700 1 -- 172.21.15.62:0/3271676413 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d8000e90 con 0x7fa3e80a8e10 2021-12-17T18:20:35.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3e67fc700 1 -- 172.21.15.62:0/3271676413 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3d800d910 con 0x7fa3e80a8e10 2021-12-17T18:20:35.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3ec861700 1 -- 172.21.15.62:0/3271676413 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa3e80a8e10 msgr2=0x7fa3e8147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:35.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3ec861700 1 --2- 172.21.15.62:0/3271676413 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa3e80a8e10 0x7fa3e8147ff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa3d8002f70 tx=0x7fa3d8006df0).stop 2021-12-17T18:20:35.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3ec861700 1 -- 172.21.15.62:0/3271676413 shutdown_connections 2021-12-17T18:20:35.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3ec861700 1 --2- 172.21.15.62:0/3271676413 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa3e80a8e10 0x7fa3e8147ff0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:35.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3ec861700 1 -- 172.21.15.62:0/3271676413 >> 172.21.15.62:0/3271676413 conn(0x7fa3e805d220 msgr2=0x7fa3e80b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:35.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3ec861700 1 -- 172.21.15.62:0/3271676413 shutdown_connections 2021-12-17T18:20:35.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.826+0000 7fa3ec861700 1 -- 172.21.15.62:0/3271676413 wait complete. 2021-12-17T18:20:35.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3ec861700 1 Processor -- start 2021-12-17T18:20:35.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3ec861700 1 -- start start 2021-12-17T18:20:35.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3ec861700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa3e80a71e0 0x7fa3e8148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:35.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3ec861700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa3e80a8e10 0x7fa3e814acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:35.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3ec861700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3e8141480 0x7fa3e8135680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:35.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3ec861700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80add80 con 0x7fa3e8141480 2021-12-17T18:20:35.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3ec861700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80ae020 con 0x7fa3e80a71e0 2021-12-17T18:20:35.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3ec861700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80ae2c0 con 0x7fa3e80a8e10 2021-12-17T18:20:35.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3e7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3e8141480 0x7fa3e8135680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:35.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3e7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3e8141480 0x7fa3e8135680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50170/0 (socket says 172.21.15.62:50170) 2021-12-17T18:20:35.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3e7fff700 1 -- 172.21.15.62:0/4023350009 learned_addr learned my addr 172.21.15.62:0/4023350009 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:35.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3e77fe700 1 --2- 172.21.15.62:0/4023350009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa3e80a71e0 0x7fa3e8148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:35.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3e6ffd700 1 --2- 172.21.15.62:0/4023350009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa3e80a8e10 0x7fa3e814acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:35.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3e7fff700 1 -- 172.21.15.62:0/4023350009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa3e80a8e10 msgr2=0x7fa3e814acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:35.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3e7fff700 1 --2- 172.21.15.62:0/4023350009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa3e80a8e10 0x7fa3e814acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:35.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3e7fff700 1 -- 172.21.15.62:0/4023350009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa3e80a71e0 msgr2=0x7fa3e8148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:35.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3e7fff700 1 --2- 172.21.15.62:0/4023350009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa3e80a71e0 0x7fa3e8148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:35.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3e7fff700 1 -- 172.21.15.62:0/4023350009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d800b180 con 0x7fa3e8141480 2021-12-17T18:20:35.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3e6ffd700 1 --2- 172.21.15.62:0/4023350009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa3e80a8e10 0x7fa3e814acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:35.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3e77fe700 1 --2- 172.21.15.62:0/4023350009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa3e80a71e0 0x7fa3e8148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:35.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3e7fff700 1 --2- 172.21.15.62:0/4023350009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3e8141480 0x7fa3e8135680 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fa3e0001490 tx=0x7fa3e0007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:35.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3e4ff9700 1 -- 172.21.15.62:0/4023350009 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e0005bb0 con 0x7fa3e8141480 2021-12-17T18:20:35.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3e4ff9700 1 -- 172.21.15.62:0/4023350009 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e0005d10 con 0x7fa3e8141480 2021-12-17T18:20:35.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3ec861700 1 -- 172.21.15.62:0/4023350009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e814b340 con 0x7fa3e8141480 2021-12-17T18:20:35.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3e4ff9700 1 -- 172.21.15.62:0/4023350009 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e0007300 con 0x7fa3e8141480 2021-12-17T18:20:35.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3ec861700 1 -- 172.21.15.62:0/4023350009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e8135b70 con 0x7fa3e8141480 2021-12-17T18:20:35.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.830+0000 7fa3ec861700 1 -- 172.21.15.62:0/4023350009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e80ae480 con 0x7fa3e8141480 2021-12-17T18:20:35.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.834+0000 7fa3e4ff9700 1 -- 172.21.15.62:0/4023350009 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa3e0010030 con 0x7fa3e8141480 2021-12-17T18:20:35.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.834+0000 7fa3e4ff9700 1 --2- 172.21.15.62:0/4023350009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa3cc053580 0x7fa3cc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:35.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.834+0000 7fa3e4ff9700 1 -- 172.21.15.62:0/4023350009 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa3e006ba00 con 0x7fa3e8141480 2021-12-17T18:20:35.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.834+0000 7fa3e77fe700 1 --2- 172.21.15.62:0/4023350009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa3cc053580 0x7fa3cc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:35.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.834+0000 7fa3e77fe700 1 --2- 172.21.15.62:0/4023350009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa3cc053580 0x7fa3cc055a40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fa3d000b000 tx=0x7fa3d0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:35.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:35.838+0000 7fa3e4ff9700 1 -- 172.21.15.62:0/4023350009 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa3e0042ac0 con 0x7fa3e8141480 2021-12-17T18:20:36.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.002+0000 7fa3ec861700 1 -- 172.21.15.62:0/4023350009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3e80b1b90 con 0x7fa3e8141480 2021-12-17T18:20:36.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.002+0000 7fa3e4ff9700 1 -- 172.21.15.62:0/4023350009 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2135 (secure 0 0 0) 0x7fa3e00460e0 con 0x7fa3e8141480 2021-12-17T18:20:36.004 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:36.004 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/16961477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":16961477},{"type":"v1","addr":"172.21.15.109:6835","nonce":16961477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:20:16.801183+0000","modified":"2021-12-17T18:20:18.581684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/3317956606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3317956606},{"type":"v1","addr":"172.21.15.62:6833","nonce":3317956606}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-12-17T18:20:36.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.006+0000 7fa3ec861700 1 -- 172.21.15.62:0/4023350009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa3cc053580 msgr2=0x7fa3cc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:36.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.006+0000 7fa3ec861700 1 --2- 172.21.15.62:0/4023350009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa3cc053580 0x7fa3cc055a40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fa3d000b000 tx=0x7fa3d0009040).stop 2021-12-17T18:20:36.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.006+0000 7fa3ec861700 1 -- 172.21.15.62:0/4023350009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3e8141480 msgr2=0x7fa3e8135680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:36.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.006+0000 7fa3ec861700 1 --2- 172.21.15.62:0/4023350009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3e8141480 0x7fa3e8135680 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fa3e0001490 tx=0x7fa3e0007de0).stop 2021-12-17T18:20:36.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.006+0000 7fa3ec861700 1 -- 172.21.15.62:0/4023350009 shutdown_connections 2021-12-17T18:20:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.006+0000 7fa3ec861700 1 --2- 172.21.15.62:0/4023350009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa3cc053580 0x7fa3cc055a40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.006+0000 7fa3ec861700 1 --2- 172.21.15.62:0/4023350009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3e8141480 0x7fa3e8135680 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.006+0000 7fa3ec861700 1 --2- 172.21.15.62:0/4023350009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa3e80a8e10 0x7fa3e814acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.006+0000 7fa3ec861700 1 --2- 172.21.15.62:0/4023350009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa3e80a71e0 0x7fa3e8148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.006+0000 7fa3ec861700 1 -- 172.21.15.62:0/4023350009 >> 172.21.15.62:0/4023350009 conn(0x7fa3e805d220 msgr2=0x7fa3e81450d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:36.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.006+0000 7fa3ec861700 1 -- 172.21.15.62:0/4023350009 shutdown_connections 2021-12-17T18:20:36.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.006+0000 7fa3ec861700 1 -- 172.21.15.62:0/4023350009 wait complete. 2021-12-17T18:20:36.011 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2021-12-17T18:20:36.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-12-17T18:20:36.121 INFO:teuthology.orchestra.run.smithi062.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-12-17T18:20:36.122 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-12-17T18:20:36.123 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:20:36.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:20:36.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.242+0000 7f628d05e700 1 Processor -- start 2021-12-17T18:20:36.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.242+0000 7f628d05e700 1 -- start start 2021-12-17T18:20:36.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f62880b1730 0x7f62880ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62880a7bb0 0x7f6288067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62880b2ce0 con 0x7f62880b21f0 2021-12-17T18:20:36.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628814b5b0 con 0x7f62880b1730 2021-12-17T18:20:36.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6288147870 con 0x7f62880a7bb0 2021-12-17T18:20:36.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628659c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f62880b1730 0x7f62880ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628659c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f62880b1730 0x7f62880ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50174/0 (socket says 172.21.15.62:50174) 2021-12-17T18:20:36.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628659c700 1 -- 172.21.15.62:0/3886724403 learned_addr learned my addr 172.21.15.62:0/3886724403 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:36.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628759e700 1 --2- 172.21.15.62:0/3886724403 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62880a7bb0 0x7f6288067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628659c700 1 -- 172.21.15.62:0/3886724403 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62880a7bb0 msgr2=0x7f6288067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:36.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628659c700 1 --2- 172.21.15.62:0/3886724403 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62880a7bb0 0x7f6288067120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628659c700 1 -- 172.21.15.62:0/3886724403 >> v1:172.21.15.62:6789/0 conn(0x7f62880b21f0 legacy=0x7f628814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:36.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628659c700 1 -- 172.21.15.62:0/3886724403 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62880aca60 con 0x7f62880b1730 2021-12-17T18:20:36.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628759e700 1 --2- 172.21.15.62:0/3886724403 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62880a7bb0 0x7f6288067120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:20:36.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628659c700 1 --2- 172.21.15.62:0/3886724403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62880b1730 0x7f62880ace90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f6278002f70 tx=0x7f6278006eb0).ready entity=mon.0 client_cookie=50d3848319f4b05f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:36.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f6285d9b700 1 -- 172.21.15.62:0/3886724403 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f627800d5c0 con 0x7f62880b1730 2021-12-17T18:20:36.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f6285d9b700 1 -- 172.21.15.62:0/3886724403 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6278000e90 con 0x7f62880b1730 2021-12-17T18:20:36.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f6285d9b700 1 -- 172.21.15.62:0/3886724403 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f627800d950 con 0x7f62880b1730 2021-12-17T18:20:36.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 -- 172.21.15.62:0/3886724403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62880b1730 msgr2=0x7f62880ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:36.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 --2- 172.21.15.62:0/3886724403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62880b1730 0x7f62880ace90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f6278002f70 tx=0x7f6278006eb0).stop 2021-12-17T18:20:36.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 -- 172.21.15.62:0/3886724403 shutdown_connections 2021-12-17T18:20:36.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 --2- 172.21.15.62:0/3886724403 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62880a7bb0 0x7f6288067120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 --2- 172.21.15.62:0/3886724403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62880b1730 0x7f62880ace90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 -- 172.21.15.62:0/3886724403 >> 172.21.15.62:0/3886724403 conn(0x7f628805f730 msgr2=0x7f628805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:36.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 -- 172.21.15.62:0/3886724403 shutdown_connections 2021-12-17T18:20:36.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 -- 172.21.15.62:0/3886724403 wait complete. 2021-12-17T18:20:36.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 Processor -- start 2021-12-17T18:20:36.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 -- start start 2021-12-17T18:20:36.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62880a7bb0 0x7f62880ab480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f62880b1730 0x7f62881579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62880b21f0 0x7f6288148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62880671f0 con 0x7f62880b21f0 2021-12-17T18:20:36.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62880a9680 con 0x7f62880b1730 2021-12-17T18:20:36.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.246+0000 7f628d05e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62880a9920 con 0x7f62880a7bb0 2021-12-17T18:20:36.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f628759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62880b21f0 0x7f6288148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f628759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62880b21f0 0x7f6288148da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50184/0 (socket says 172.21.15.62:50184) 2021-12-17T18:20:36.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f628759e700 1 -- 172.21.15.62:0/3270351130 learned_addr learned my addr 172.21.15.62:0/3270351130 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:36.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f6286d9d700 1 --2- 172.21.15.62:0/3270351130 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62880a7bb0 0x7f62880ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f628659c700 1 --2- 172.21.15.62:0/3270351130 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f62880b1730 0x7f62881579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f628759e700 1 -- 172.21.15.62:0/3270351130 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62880a7bb0 msgr2=0x7f62880ab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:36.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f628759e700 1 --2- 172.21.15.62:0/3270351130 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62880a7bb0 0x7f62880ab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f628759e700 1 -- 172.21.15.62:0/3270351130 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f62880b1730 msgr2=0x7f62881579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:36.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f628759e700 1 --2- 172.21.15.62:0/3270351130 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f62880b1730 0x7f62881579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f628759e700 1 -- 172.21.15.62:0/3270351130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627800b1e0 con 0x7f62880b21f0 2021-12-17T18:20:36.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f628759e700 1 --2- 172.21.15.62:0/3270351130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62880b21f0 0x7f6288148da0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f6280007000 tx=0x7f6280008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:36.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f6277fff700 1 -- 172.21.15.62:0/3270351130 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6280010580 con 0x7f62880b21f0 2021-12-17T18:20:36.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f6277fff700 1 -- 172.21.15.62:0/3270351130 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62800106e0 con 0x7f62880b21f0 2021-12-17T18:20:36.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f628d05e700 1 -- 172.21.15.62:0/3270351130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6288157ee0 con 0x7f62880b21f0 2021-12-17T18:20:36.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f6277fff700 1 -- 172.21.15.62:0/3270351130 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6280010a40 con 0x7f62880b21f0 2021-12-17T18:20:36.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f628d05e700 1 -- 172.21.15.62:0/3270351130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62881494b0 con 0x7f62880b21f0 2021-12-17T18:20:36.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f628d05e700 1 -- 172.21.15.62:0/3270351130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62880a9ae0 con 0x7f62880b21f0 2021-12-17T18:20:36.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.250+0000 7f6277fff700 1 -- 172.21.15.62:0/3270351130 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6280010ba0 con 0x7f62880b21f0 2021-12-17T18:20:36.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.254+0000 7f6277fff700 1 --2- 172.21.15.62:0/3270351130 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f62640536a0 0x7f6264055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.254+0000 7f6277fff700 1 -- 172.21.15.62:0/3270351130 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f628006bcf0 con 0x7f62880b21f0 2021-12-17T18:20:36.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.254+0000 7f6286d9d700 1 --2- 172.21.15.62:0/3270351130 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f62640536a0 0x7f6264055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.254+0000 7f6286d9d700 1 --2- 172.21.15.62:0/3270351130 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f62640536a0 0x7f6264055b60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f627c00d000 tx=0x7f627c007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:36.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.258+0000 7f6277fff700 1 -- 172.21.15.62:0/3270351130 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6280042e50 con 0x7f62880b21f0 2021-12-17T18:20:36.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.426+0000 7f628d05e700 1 -- 172.21.15.62:0/3270351130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62880b2f10 con 0x7f62880b21f0 2021-12-17T18:20:36.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.426+0000 7f6277fff700 1 -- 172.21.15.62:0/3270351130 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2135 (secure 0 0 0) 0x7f6280046470 con 0x7f62880b21f0 2021-12-17T18:20:36.429 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:36.429 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/16961477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":16961477},{"type":"v1","addr":"172.21.15.109:6835","nonce":16961477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:20:16.801183+0000","modified":"2021-12-17T18:20:18.581684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/3317956606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3317956606},{"type":"v1","addr":"172.21.15.62:6833","nonce":3317956606}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-12-17T18:20:36.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.426+0000 7f628d05e700 1 -- 172.21.15.62:0/3270351130 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f62640536a0 msgr2=0x7f6264055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:36.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.426+0000 7f628d05e700 1 --2- 172.21.15.62:0/3270351130 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f62640536a0 0x7f6264055b60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f627c00d000 tx=0x7f627c007b90).stop 2021-12-17T18:20:36.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.426+0000 7f628d05e700 1 -- 172.21.15.62:0/3270351130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62880b21f0 msgr2=0x7f6288148da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:36.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.426+0000 7f628d05e700 1 --2- 172.21.15.62:0/3270351130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62880b21f0 0x7f6288148da0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f6280007000 tx=0x7f6280008040).stop 2021-12-17T18:20:36.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.426+0000 7f628d05e700 1 -- 172.21.15.62:0/3270351130 shutdown_connections 2021-12-17T18:20:36.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.426+0000 7f628d05e700 1 --2- 172.21.15.62:0/3270351130 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f62640536a0 0x7f6264055b60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.426+0000 7f628d05e700 1 --2- 172.21.15.62:0/3270351130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62880b21f0 0x7f6288148da0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.426+0000 7f628d05e700 1 --2- 172.21.15.62:0/3270351130 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f62880b1730 0x7f62881579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.426+0000 7f628d05e700 1 --2- 172.21.15.62:0/3270351130 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62880a7bb0 0x7f62880ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.426+0000 7f628d05e700 1 -- 172.21.15.62:0/3270351130 >> 172.21.15.62:0/3270351130 conn(0x7f628805f730 msgr2=0x7f62880ae620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:36.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.426+0000 7f628d05e700 1 -- 172.21.15.62:0/3270351130 shutdown_connections 2021-12-17T18:20:36.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.426+0000 7f628d05e700 1 -- 172.21.15.62:0/3270351130 wait complete. 2021-12-17T18:20:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2021-12-17T18:20:36.441 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 2021-12-17T18:20:36.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45929700 1 Processor -- start 2021-12-17T18:20:36.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45929700 1 -- start start 2021-12-17T18:20:36.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45929700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7faf400b1bd0 0x7faf400b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45929700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faf4014b5c0 0x7faf40147480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45929700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4014aa80 con 0x7faf400afdd0 2021-12-17T18:20:36.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45929700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf401419a0 con 0x7faf4014b5c0 2021-12-17T18:20:36.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45929700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf400ad810 con 0x7faf400b1bd0 2021-12-17T18:20:36.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf37fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7faf400afdd0 0x7faf4014aeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33770/0 (socket says 172.21.15.62:33770) 2021-12-17T18:20:36.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf37fff700 1 -- 172.21.15.62:0/1958333477 learned_addr learned my addr 172.21.15.62:0/1958333477 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:36.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45128700 1 --2- 172.21.15.62:0/1958333477 >> v2:172.21.15.62:3300/0 conn(0x7faf4014b5c0 0x7faf40147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf44927700 1 --2- 172.21.15.62:0/1958333477 >> v2:172.21.15.109:3300/0 conn(0x7faf400b1bd0 0x7faf400b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf377fe700 1 -- 172.21.15.62:0/1958333477 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365219126 0 0) 0x7faf4014aa80 con 0x7faf400afdd0 2021-12-17T18:20:36.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf377fe700 1 -- 172.21.15.62:0/1958333477 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf2c003260 con 0x7faf400afdd0 2021-12-17T18:20:36.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45128700 1 -- 172.21.15.62:0/1958333477 >> v2:172.21.15.109:3300/0 conn(0x7faf400b1bd0 msgr2=0x7faf400b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:36.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45128700 1 --2- 172.21.15.62:0/1958333477 >> v2:172.21.15.109:3300/0 conn(0x7faf400b1bd0 0x7faf400b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45128700 1 -- 172.21.15.62:0/1958333477 >> v1:172.21.15.62:6789/0 conn(0x7faf400afdd0 legacy=0x7faf4014aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:36.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45128700 1 -- 172.21.15.62:0/1958333477 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf400af230 con 0x7faf4014b5c0 2021-12-17T18:20:36.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf44927700 1 --2- 172.21.15.62:0/1958333477 >> v2:172.21.15.109:3300/0 conn(0x7faf400b1bd0 0x7faf400b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:20:36.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45128700 1 --2- 172.21.15.62:0/1958333477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf4014b5c0 0x7faf40147480 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7faf380032f0 tx=0x7faf380091d0).ready entity=mon.0 client_cookie=e1862b3cd8ec2e74 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:36.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf377fe700 1 -- 172.21.15.62:0/1958333477 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3800b600 con 0x7faf4014b5c0 2021-12-17T18:20:36.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf377fe700 1 -- 172.21.15.62:0/1958333477 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3800b760 con 0x7faf4014b5c0 2021-12-17T18:20:36.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf377fe700 1 -- 172.21.15.62:0/1958333477 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3800b8d0 con 0x7faf4014b5c0 2021-12-17T18:20:36.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45929700 1 -- 172.21.15.62:0/1958333477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf4014b5c0 msgr2=0x7faf40147480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:36.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45929700 1 --2- 172.21.15.62:0/1958333477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf4014b5c0 0x7faf40147480 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7faf380032f0 tx=0x7faf380091d0).stop 2021-12-17T18:20:36.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45929700 1 -- 172.21.15.62:0/1958333477 shutdown_connections 2021-12-17T18:20:36.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45929700 1 --2- 172.21.15.62:0/1958333477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf4014b5c0 0x7faf40147480 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45929700 1 --2- 172.21.15.62:0/1958333477 >> v2:172.21.15.109:3300/0 conn(0x7faf400b1bd0 0x7faf400b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.550+0000 7faf45929700 1 -- 172.21.15.62:0/1958333477 >> 172.21.15.62:0/1958333477 conn(0x7faf4005c750 msgr2=0x7faf4005cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:36.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf45929700 1 -- 172.21.15.62:0/1958333477 shutdown_connections 2021-12-17T18:20:36.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf45929700 1 -- 172.21.15.62:0/1958333477 wait complete. 2021-12-17T18:20:36.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf45929700 1 Processor -- start 2021-12-17T18:20:36.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf45929700 1 -- start start 2021-12-17T18:20:36.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf45929700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faf400afdd0 0x7faf4014c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf45929700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf400b1bd0 0x7faf40066990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf45929700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faf4014b5c0 0x7faf40066e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf45929700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf40147950 con 0x7faf400b1bd0 2021-12-17T18:20:36.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf45929700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf401476b0 con 0x7faf400afdd0 2021-12-17T18:20:36.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf45929700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf40147e80 con 0x7faf4014b5c0 2021-12-17T18:20:36.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf37fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf400b1bd0 0x7faf40066990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf37fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf400b1bd0 0x7faf40066990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50196/0 (socket says 172.21.15.62:50196) 2021-12-17T18:20:36.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf37fff700 1 -- 172.21.15.62:0/1034119186 learned_addr learned my addr 172.21.15.62:0/1034119186 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:36.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf44927700 1 --2- 172.21.15.62:0/1034119186 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faf400afdd0 0x7faf4014c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf45128700 1 --2- 172.21.15.62:0/1034119186 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faf4014b5c0 0x7faf40066e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf37fff700 1 -- 172.21.15.62:0/1034119186 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faf4014b5c0 msgr2=0x7faf40066e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf37fff700 1 --2- 172.21.15.62:0/1034119186 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faf4014b5c0 0x7faf40066e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf37fff700 1 -- 172.21.15.62:0/1034119186 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faf400afdd0 msgr2=0x7faf4014c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf37fff700 1 --2- 172.21.15.62:0/1034119186 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faf400afdd0 0x7faf4014c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf37fff700 1 -- 172.21.15.62:0/1034119186 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c00b180 con 0x7faf400b1bd0 2021-12-17T18:20:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf44927700 1 --2- 172.21.15.62:0/1034119186 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faf400afdd0 0x7faf4014c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf37fff700 1 --2- 172.21.15.62:0/1034119186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf400b1bd0 0x7faf40066990 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7faf30001110 tx=0x7faf30007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.554+0000 7faf35ffb700 1 -- 172.21.15.62:0/1034119186 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3000ce20 con 0x7faf400b1bd0 2021-12-17T18:20:36.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.558+0000 7faf35ffb700 1 -- 172.21.15.62:0/1034119186 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf300072e0 con 0x7faf400b1bd0 2021-12-17T18:20:36.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.558+0000 7faf45929700 1 -- 172.21.15.62:0/1034119186 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf38009470 con 0x7faf400b1bd0 2021-12-17T18:20:36.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.558+0000 7faf35ffb700 1 -- 172.21.15.62:0/1034119186 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf30005800 con 0x7faf400b1bd0 2021-12-17T18:20:36.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.558+0000 7faf45929700 1 -- 172.21.15.62:0/1034119186 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf40067370 con 0x7faf400b1bd0 2021-12-17T18:20:36.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.558+0000 7faf35ffb700 1 -- 172.21.15.62:0/1034119186 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faf3001a060 con 0x7faf400b1bd0 2021-12-17T18:20:36.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.558+0000 7faf35ffb700 1 --2- 172.21.15.62:0/1034119186 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faf20053610 0x7faf20055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.558+0000 7faf35ffb700 1 -- 172.21.15.62:0/1034119186 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faf3006b1b0 con 0x7faf400b1bd0 2021-12-17T18:20:36.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.558+0000 7faf44927700 1 --2- 172.21.15.62:0/1034119186 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faf20053610 0x7faf20055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf50dce740 1 Processor -- start 2021-12-17T18:20:36.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf50dce740 1 -- start start 2021-12-17T18:20:36.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf44927700 1 --2- 172.21.15.62:0/1034119186 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faf20053610 0x7faf20055ad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7faf3c00b000 tx=0x7faf3c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:36.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf50dce740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x2036bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf50dce740 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x206c290 0x2034c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf50dce740 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x20757b0 0x2075c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf50dce740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fa7450 con 0x2031d10 2021-12-17T18:20:36.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf50dce740 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f87bc0 con 0x20757b0 2021-12-17T18:20:36.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf50dce740 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x20320f0 con 0x206c290 2021-12-17T18:20:36.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf44927700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x2036bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf44927700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x2036bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50202/0 (socket says 172.21.15.62:50202) 2021-12-17T18:20:36.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf44927700 1 -- 172.21.15.62:0/3237891984 learned_addr learned my addr 172.21.15.62:0/3237891984 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:36.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf37fff700 1 --2- 172.21.15.62:0/3237891984 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x206c290 0x2034c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf45128700 1 --2- 172.21.15.62:0/3237891984 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x20757b0 0x2075c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf44927700 1 -- 172.21.15.62:0/3237891984 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x206c290 msgr2=0x2034c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:36.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf44927700 1 --2- 172.21.15.62:0/3237891984 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x206c290 0x2034c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf44927700 1 -- 172.21.15.62:0/3237891984 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x20757b0 msgr2=0x2075c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:36.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf44927700 1 --2- 172.21.15.62:0/3237891984 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x20757b0 0x2075c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf44927700 1 -- 172.21.15.62:0/3237891984 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1fdef00 con 0x2031d10 2021-12-17T18:20:36.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf44927700 1 --2- 172.21.15.62:0/3237891984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x2036bc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7faf3c012000 tx=0x7faf3c015000).ready entity=mon.0 client_cookie=f0d96638de2a80aa server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:36.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf45929700 1 -- 172.21.15.62:0/3237891984 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3c010e80 con 0x2031d10 2021-12-17T18:20:36.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf45929700 1 -- 172.21.15.62:0/3237891984 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c014e30 con 0x2031d10 2021-12-17T18:20:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf45929700 1 -- 172.21.15.62:0/3237891984 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3c01f5f0 con 0x2031d10 2021-12-17T18:20:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf50dce740 1 -- 172.21.15.62:0/3237891984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 msgr2=0x2036bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf50dce740 1 --2- 172.21.15.62:0/3237891984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x2036bc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7faf3c012000 tx=0x7faf3c015000).stop 2021-12-17T18:20:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf50dce740 1 -- 172.21.15.62:0/3237891984 shutdown_connections 2021-12-17T18:20:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf50dce740 1 --2- 172.21.15.62:0/3237891984 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x20757b0 0x2075c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf50dce740 1 --2- 172.21.15.62:0/3237891984 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x206c290 0x2034c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf50dce740 1 --2- 172.21.15.62:0/3237891984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x2036bc0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf50dce740 1 -- 172.21.15.62:0/3237891984 >> 172.21.15.62:0/3237891984 conn(0x20342e0 msgr2=0x20355e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:36.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.562+0000 7faf50dce740 1 -- 172.21.15.62:0/3237891984 shutdown_connections 2021-12-17T18:20:36.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf50dce740 1 -- 172.21.15.62:0/3237891984 wait complete. 2021-12-17T18:20:36.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf50dce740 1 -- start start 2021-12-17T18:20:36.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf50dce740 1 Processor -- start 2021-12-17T18:20:36.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf50dce740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x2064970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf50dce740 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x206c290 0x2064e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf50dce740 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x20757b0 0x2065350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf50dce740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x2039320 con 0x2031d10 2021-12-17T18:20:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf50dce740 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x206b820 con 0x206c290 2021-12-17T18:20:36.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf50dce740 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x2071fa0 con 0x20757b0 2021-12-17T18:20:36.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf50dce740 10 client.0 ll_register_callbacks cb 0x1f7be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-12-17T18:20:36.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf44927700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x2064970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf44927700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x2064970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50210/0 (socket says 172.21.15.62:50210) 2021-12-17T18:20:36.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf44927700 1 -- 172.21.15.62:0/3299006060 learned_addr learned my addr 172.21.15.62:0/3299006060 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:36.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf45128700 1 --2- 172.21.15.62:0/3299006060 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x20757b0 0x2065350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf37fff700 1 --2- 172.21.15.62:0/3299006060 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x206c290 0x2064e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf44927700 1 -- 172.21.15.62:0/3299006060 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x20757b0 msgr2=0x2065350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:36.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf44927700 1 --2- 172.21.15.62:0/3299006060 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x20757b0 0x2065350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf44927700 1 -- 172.21.15.62:0/3299006060 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x206c290 msgr2=0x2064e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:36.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf44927700 1 --2- 172.21.15.62:0/3299006060 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x206c290 0x2064e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf44927700 1 -- 172.21.15.62:0/3299006060 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c010a30 con 0x2031d10 2021-12-17T18:20:36.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.566+0000 7faf37fff700 1 --2- 172.21.15.62:0/3299006060 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x206c290 0x2064e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:20:36.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf44927700 1 --2- 172.21.15.62:0/3299006060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x2064970 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7faf3c012000 tx=0x7faf3c01f000).ready entity=mon.0 client_cookie=74b52cf0f260109f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:36.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf1f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2021-12-17T18:20:36.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf1f7fe700 1 -- 172.21.15.62:0/3299006060 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3c029630 con 0x2031d10 2021-12-17T18:20:36.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf1f7fe700 1 -- 172.21.15.62:0/3299006060 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faf3c010e80 con 0x2031d10 2021-12-17T18:20:36.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 1 -- 172.21.15.62:0/3299006060 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1f9d510 con 0x2031d10 2021-12-17T18:20:36.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf1f7fe700 1 -- 172.21.15.62:0/3299006060 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf3c029790 con 0x2031d10 2021-12-17T18:20:36.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 10 client.5490 fetch_fsmap learned FSMap version 16 2021-12-17T18:20:36.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 1 -- 172.21.15.62:0/3299006060 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x1f96df0 con 0x2031d10 2021-12-17T18:20:36.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf1f7fe700 1 -- 172.21.15.62:0/3299006060 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1f9d510 con 0x2031d10 2021-12-17T18:20:36.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf1f7fe700 1 -- 172.21.15.62:0/3299006060 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 16) v1 ==== 1247+0+0 (secure 0 0 0) 0x7faf3c0133d0 con 0x2031d10 2021-12-17T18:20:36.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 10 client.5490 fetch_fsmap finished waiting for FSMap version 16 2021-12-17T18:20:36.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 10 client.5490 resolve_mds: resolved ID 'a' to GID 5277 2021-12-17T18:20:36.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 20 client.5490 populate_metadata read hostname 'smithi062' 2021-12-17T18:20:36.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 1 --2- 172.21.15.62:0/3299006060 >> [v2:172.21.15.62:6832/3317956606,v1:172.21.15.62:6833/3317956606] conn(0x2037930 0x2037d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 4 client.5490 mds_command: new command op to 5277 tid=0[{"prefix": "get_command_descriptions"}] 2021-12-17T18:20:36.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 1 -- 172.21.15.62:0/3299006060 --> [v2:172.21.15.62:6832/3317956606,v1:172.21.15.62:6833/3317956606] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1f95880 con 0x2037930 2021-12-17T18:20:36.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf37fff700 1 --2- 172.21.15.62:0/3299006060 >> [v2:172.21.15.62:6832/3317956606,v1:172.21.15.62:6833/3317956606] conn(0x2037930 0x2037d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf1f7fe700 10 client.5490 ms_handle_connect on v2:172.21.15.62:6832/3317956606 2021-12-17T18:20:36.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf37fff700 1 --2- 172.21.15.62:0/3299006060 >> [v2:172.21.15.62:6832/3317956606,v1:172.21.15.62:6833/3317956606] conn(0x2037930 0x2037d10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=cacbe6c8f60cf19c server_cookie=a0888581c3ca8dca in_seq=0 out_seq=0 2021-12-17T18:20:36.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf1f7fe700 1 -- 172.21.15.62:0/3299006060 <== mds.0 v2:172.21.15.62:6832/3317956606 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x1f95880 con 0x2037930 2021-12-17T18:20:36.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf1f7fe700 10 client.5490 handle_command_reply: tid=0 2021-12-17T18:20:36.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 1 client.5490 shutdown 2021-12-17T18:20:36.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 1 -- 172.21.15.62:0/3299006060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 msgr2=0x2064970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:36.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 1 --2- 172.21.15.62:0/3299006060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x2064970 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7faf3c012000 tx=0x7faf3c01f000).stop 2021-12-17T18:20:36.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 1 -- 172.21.15.62:0/3299006060 shutdown_connections 2021-12-17T18:20:36.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 1 --2- 172.21.15.62:0/3299006060 >> [v2:172.21.15.62:6832/3317956606,v1:172.21.15.62:6833/3317956606] conn(0x2037930 0x2037d10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 1 --2- 172.21.15.62:0/3299006060 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x20757b0 0x2065350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 1 --2- 172.21.15.62:0/3299006060 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x206c290 0x2064e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 1 --2- 172.21.15.62:0/3299006060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x2064970 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf1f7fe700 0 client.5490 ms_handle_reset on v2:172.21.15.62:6832/3317956606 2021-12-17T18:20:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 1 -- 172.21.15.62:0/3299006060 >> 172.21.15.62:0/3299006060 conn(0x20342e0 msgr2=0x2036a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 1 -- 172.21.15.62:0/3299006060 shutdown_connections 2021-12-17T18:20:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 1 -- 172.21.15.62:0/3299006060 wait complete. 2021-12-17T18:20:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.570+0000 7faf50dce740 20 client.5490 trim_cache size 0 max 16384 2021-12-17T18:20:36.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf50dce740 1 Processor -- start 2021-12-17T18:20:36.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf50dce740 1 -- start start 2021-12-17T18:20:36.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf50dce740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x20370d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf50dce740 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x206c290 0x2034b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf50dce740 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x20757b0 0x2035060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf50dce740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x206b4f0 con 0x2031d10 2021-12-17T18:20:36.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf50dce740 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x20362c0 con 0x206c290 2021-12-17T18:20:36.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf50dce740 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ffefc0 con 0x20757b0 2021-12-17T18:20:36.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf44927700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x20370d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf44927700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x20370d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50216/0 (socket says 172.21.15.62:50216) 2021-12-17T18:20:36.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf44927700 1 -- 172.21.15.62:0/1241263974 learned_addr learned my addr 172.21.15.62:0/1241263974 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:36.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf45128700 1 --2- 172.21.15.62:0/1241263974 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x20757b0 0x2035060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf37fff700 1 --2- 172.21.15.62:0/1241263974 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x206c290 0x2034b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf44927700 1 -- 172.21.15.62:0/1241263974 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x20757b0 msgr2=0x2035060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf44927700 1 --2- 172.21.15.62:0/1241263974 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x20757b0 0x2035060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf44927700 1 -- 172.21.15.62:0/1241263974 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x206c290 msgr2=0x2034b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:36.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf44927700 1 --2- 172.21.15.62:0/1241263974 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x206c290 0x2034b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf44927700 1 -- 172.21.15.62:0/1241263974 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1f9c0e0 con 0x2031d10 2021-12-17T18:20:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf45128700 1 --2- 172.21.15.62:0/1241263974 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x20757b0 0x2035060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:20:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf44927700 1 --2- 172.21.15.62:0/1241263974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x20370d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7faf3c012000 tx=0x7faf3c028000).ready entity=mon.0 client_cookie=7f155b06a9c2afa0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:36.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf25ffb700 1 -- 172.21.15.62:0/1241263974 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3c010e80 con 0x2031d10 2021-12-17T18:20:36.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf25ffb700 1 -- 172.21.15.62:0/1241263974 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c01fc30 con 0x2031d10 2021-12-17T18:20:36.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf25ffb700 1 -- 172.21.15.62:0/1241263974 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3c00be70 con 0x2031d10 2021-12-17T18:20:36.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf50dce740 1 -- 172.21.15.62:0/1241263974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 msgr2=0x20370d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:36.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf50dce740 1 --2- 172.21.15.62:0/1241263974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x20370d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7faf3c012000 tx=0x7faf3c028000).stop 2021-12-17T18:20:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf50dce740 1 -- 172.21.15.62:0/1241263974 shutdown_connections 2021-12-17T18:20:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf50dce740 1 --2- 172.21.15.62:0/1241263974 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x20757b0 0x2035060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf50dce740 1 --2- 172.21.15.62:0/1241263974 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x206c290 0x2034b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf50dce740 1 --2- 172.21.15.62:0/1241263974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x20370d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.586+0000 7faf50dce740 1 -- 172.21.15.62:0/1241263974 >> 172.21.15.62:0/1241263974 conn(0x20342e0 msgr2=0x2035a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:36.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 1 -- 172.21.15.62:0/1241263974 shutdown_connections 2021-12-17T18:20:36.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 1 -- 172.21.15.62:0/1241263974 wait complete. 2021-12-17T18:20:36.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 1 -- start start 2021-12-17T18:20:36.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 1 Processor -- start 2021-12-17T18:20:36.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x207f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x206c290 0x20d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x20757b0 0x2068f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x2034c50 con 0x2031d10 2021-12-17T18:20:36.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x207eac0 con 0x20757b0 2021-12-17T18:20:36.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x20d2410 con 0x206c290 2021-12-17T18:20:36.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 10 client.0 ll_register_callbacks cb 0x20701d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-12-17T18:20:36.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf44927700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x207f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf44927700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x207f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50222/0 (socket says 172.21.15.62:50222) 2021-12-17T18:20:36.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf44927700 1 -- 172.21.15.62:0/2535079022 learned_addr learned my addr 172.21.15.62:0/2535079022 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:36.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf37fff700 1 --2- 172.21.15.62:0/2535079022 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x206c290 0x20d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf45128700 1 --2- 172.21.15.62:0/2535079022 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x20757b0 0x2068f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf44927700 1 -- 172.21.15.62:0/2535079022 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x206c290 msgr2=0x20d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:36.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf44927700 1 --2- 172.21.15.62:0/2535079022 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x206c290 0x20d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf44927700 1 -- 172.21.15.62:0/2535079022 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x20757b0 msgr2=0x2068f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:36.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf44927700 1 --2- 172.21.15.62:0/2535079022 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x20757b0 0x2068f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:36.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf44927700 1 -- 172.21.15.62:0/2535079022 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1f96df0 con 0x2031d10 2021-12-17T18:20:36.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf44927700 1 --2- 172.21.15.62:0/2535079022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x207f540 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7faf3c012000 tx=0x7faf3c021070).ready entity=mon.0 client_cookie=4e28e83606a81861 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:36.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf24ff9700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2021-12-17T18:20:36.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf24ff9700 1 -- 172.21.15.62:0/2535079022 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3c013aa0 con 0x2031d10 2021-12-17T18:20:36.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf24ff9700 1 -- 172.21.15.62:0/2535079022 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faf3c010e80 con 0x2031d10 2021-12-17T18:20:36.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 1 -- 172.21.15.62:0/2535079022 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf3c014e30 con 0x2031d10 2021-12-17T18:20:36.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf24ff9700 1 -- 172.21.15.62:0/2535079022 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf3c00be70 con 0x2031d10 2021-12-17T18:20:36.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 10 client.5496 fetch_fsmap learned FSMap version 16 2021-12-17T18:20:36.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 1 -- 172.21.15.62:0/2535079022 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x1f713f0 con 0x2031d10 2021-12-17T18:20:36.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf24ff9700 1 -- 172.21.15.62:0/2535079022 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c014e30 con 0x2031d10 2021-12-17T18:20:36.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf24ff9700 1 -- 172.21.15.62:0/2535079022 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 16) v1 ==== 1247+0+0 (secure 0 0 0) 0x7faf3c013c00 con 0x2031d10 2021-12-17T18:20:36.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 10 client.5496 fetch_fsmap finished waiting for FSMap version 16 2021-12-17T18:20:36.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 10 client.5496 resolve_mds: resolved ID 'a' to GID 5277 2021-12-17T18:20:36.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 20 client.5496 populate_metadata read hostname 'smithi062' 2021-12-17T18:20:36.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 1 --2- 172.21.15.62:0/2535079022 >> [v2:172.21.15.62:6832/3317956606,v1:172.21.15.62:6833/3317956606] conn(0x20d2fd0 0x2069440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:36.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 4 client.5496 mds_command: new command op to 5277 tid=0[{"prefix": "cache drop"}] 2021-12-17T18:20:36.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf50dce740 1 -- 172.21.15.62:0/2535079022 --> [v2:172.21.15.62:6832/3317956606,v1:172.21.15.62:6833/3317956606] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x1e8b590 con 0x20d2fd0 2021-12-17T18:20:36.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.590+0000 7faf37fff700 1 --2- 172.21.15.62:0/2535079022 >> [v2:172.21.15.62:6832/3317956606,v1:172.21.15.62:6833/3317956606] conn(0x20d2fd0 0x2069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:36.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.594+0000 7faf24ff9700 10 client.5496 ms_handle_connect on v2:172.21.15.62:6832/3317956606 2021-12-17T18:20:36.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:36.594+0000 7faf37fff700 1 --2- 172.21.15.62:0/2535079022 >> [v2:172.21.15.62:6832/3317956606,v1:172.21.15.62:6833/3317956606] conn(0x20d2fd0 0x2069440 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6f133398eef5ef68 server_cookie=492a2042b4b0ac5e in_seq=0 out_seq=0 2021-12-17T18:20:47.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf24ff9700 1 -- 172.21.15.62:0/2535079022 <== mds.0 v2:172.21.15.62:6832/3317956606 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+380 (crc 0 0 0) 0x1e8b590 con 0x20d2fd0 2021-12-17T18:20:47.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf24ff9700 10 client.5496 handle_command_reply: tid=0 2021-12-17T18:20:47.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf50dce740 1 client.5496 shutdown 2021-12-17T18:20:47.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf50dce740 1 -- 172.21.15.62:0/2535079022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 msgr2=0x207f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:47.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf50dce740 1 --2- 172.21.15.62:0/2535079022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x207f540 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7faf3c012000 tx=0x7faf3c021070).stop 2021-12-17T18:20:47.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf50dce740 1 -- 172.21.15.62:0/2535079022 shutdown_connections 2021-12-17T18:20:47.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf50dce740 1 --2- 172.21.15.62:0/2535079022 >> [v2:172.21.15.62:6832/3317956606,v1:172.21.15.62:6833/3317956606] conn(0x20d2fd0 0x2069440 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:47.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf50dce740 1 --2- 172.21.15.62:0/2535079022 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x20757b0 0x2068f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:47.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf50dce740 1 --2- 172.21.15.62:0/2535079022 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x206c290 0x20d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:47.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf24ff9700 0 client.5496 ms_handle_reset on v2:172.21.15.62:6832/3317956606 2021-12-17T18:20:47.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf50dce740 1 --2- 172.21.15.62:0/2535079022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2031d10 0x207f540 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:47.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf50dce740 1 -- 172.21.15.62:0/2535079022 >> 172.21.15.62:0/2535079022 conn(0x20342e0 msgr2=0x2035220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:47.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf50dce740 1 -- 172.21.15.62:0/2535079022 shutdown_connections 2021-12-17T18:20:47.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf50dce740 1 -- 172.21.15.62:0/2535079022 wait complete. 2021-12-17T18:20:47.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf50dce740 20 client.5496 trim_cache size 0 max 16384 2021-12-17T18:20:47.792 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:20:47.793 INFO:teuthology.orchestra.run.smithi062.stdout: "client_recall": { 2021-12-17T18:20:47.793 INFO:teuthology.orchestra.run.smithi062.stdout: "return_code": 0, 2021-12-17T18:20:47.793 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "(0) Success", 2021-12-17T18:20:47.794 INFO:teuthology.orchestra.run.smithi062.stdout: "recalled": 220 2021-12-17T18:20:47.794 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:47.794 INFO:teuthology.orchestra.run.smithi062.stdout: "flush_journal": { 2021-12-17T18:20:47.794 INFO:teuthology.orchestra.run.smithi062.stdout: "return_code": 0, 2021-12-17T18:20:47.795 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "" 2021-12-17T18:20:47.795 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:47.795 INFO:teuthology.orchestra.run.smithi062.stdout: "trim_cache": { 2021-12-17T18:20:47.795 INFO:teuthology.orchestra.run.smithi062.stdout: "trimmed": 0 2021-12-17T18:20:47.796 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:47.796 INFO:teuthology.orchestra.run.smithi062.stdout: "cache": { 2021-12-17T18:20:47.796 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": { 2021-12-17T18:20:47.796 INFO:teuthology.orchestra.run.smithi062.stdout: "items": 19973, 2021-12-17T18:20:47.797 INFO:teuthology.orchestra.run.smithi062.stdout: "bytes": 3098592 2021-12-17T18:20:47.797 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:20:47.797 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:20:47.797 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 11.192553638 2021-12-17T18:20:47.798 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:20:47.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf45929700 1 -- 172.21.15.62:0/1034119186 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faf20053610 msgr2=0x7faf20055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:47.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf45929700 1 --2- 172.21.15.62:0/1034119186 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faf20053610 0x7faf20055ad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7faf3c00b000 tx=0x7faf3c008040).stop 2021-12-17T18:20:47.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf45929700 1 -- 172.21.15.62:0/1034119186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf400b1bd0 msgr2=0x7faf40066990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:47.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf45929700 1 --2- 172.21.15.62:0/1034119186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf400b1bd0 0x7faf40066990 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7faf30001110 tx=0x7faf30007ad0).stop 2021-12-17T18:20:47.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf45929700 1 -- 172.21.15.62:0/1034119186 shutdown_connections 2021-12-17T18:20:47.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf45929700 1 --2- 172.21.15.62:0/1034119186 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faf20053610 0x7faf20055ad0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:47.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf45929700 1 --2- 172.21.15.62:0/1034119186 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faf4014b5c0 0x7faf40066e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:47.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf45929700 1 --2- 172.21.15.62:0/1034119186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf400b1bd0 0x7faf40066990 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:47.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf45929700 1 --2- 172.21.15.62:0/1034119186 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faf400afdd0 0x7faf4014c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:47.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf45929700 1 -- 172.21.15.62:0/1034119186 >> 172.21.15.62:0/1034119186 conn(0x7faf4005c750 msgr2=0x7faf400b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:47.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf45929700 1 -- 172.21.15.62:0/1034119186 shutdown_connections 2021-12-17T18:20:47.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.782+0000 7faf45929700 1 -- 172.21.15.62:0/1034119186 wait complete. 2021-12-17T18:20:47.803 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-12-17T18:20:47.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:47.804 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:20:47.804 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:20:47.812 INFO:teuthology.orchestra.run.smithi125.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-12-17T18:20:47.813 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:20:47.814 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-12-17T18:20:47.815 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:20:47.815 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:20:47.815 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:20:47.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:47.836 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:20:47.837 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:20:47.884 INFO:teuthology.orchestra.run.smithi125.stdout:ext2/ext3 2021-12-17T18:20:47.885 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:20:47.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:20:47.886 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:20:47.894 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:20:48.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a1fc5700 1 Processor -- start 2021-12-17T18:20:48.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a1fc5700 1 -- start start 2021-12-17T18:20:48.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a1fc5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe99c0b2b60 0x7fe99c143760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a1fc5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe99c143c50 0x7fe99c0b1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a1fc5700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe99c143090 con 0x7fe99c0b3a40 2021-12-17T18:20:48.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a1fc5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe99c0b1600 con 0x7fe99c143c50 2021-12-17T18:20:48.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a1fc5700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c0b3e20 con 0x7fe99c0b2b60 2021-12-17T18:20:48.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a17c4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe99c143c50 0x7fe99c0b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a17c4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe99c143c50 0x7fe99c0b1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50236/0 (socket says 172.21.15.62:50236) 2021-12-17T18:20:48.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a17c4700 1 -- 172.21.15.62:0/2637115664 learned_addr learned my addr 172.21.15.62:0/2637115664 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:48.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe99bfff700 1 --2- 172.21.15.62:0/2637115664 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe99c0b2b60 0x7fe99c143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a17c4700 1 -- 172.21.15.62:0/2637115664 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe99c0b2b60 msgr2=0x7fe99c143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:48.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a17c4700 1 --2- 172.21.15.62:0/2637115664 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe99c0b2b60 0x7fe99c143760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a17c4700 1 -- 172.21.15.62:0/2637115664 >> v1:172.21.15.109:6789/0 conn(0x7fe99c0b3a40 legacy=0x7fe99c0b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a17c4700 1 -- 172.21.15.62:0/2637115664 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c146550 con 0x7fe99c143c50 2021-12-17T18:20:48.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a17c4700 1 --2- 172.21.15.62:0/2637115664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe99c143c50 0x7fe99c0b1970 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fe99c142fb0 tx=0x7fe994009290).ready entity=mon.0 client_cookie=ca914574e48c5318 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:48.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe99b7fe700 1 -- 172.21.15.62:0/2637115664 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe99400b860 con 0x7fe99c143c50 2021-12-17T18:20:48.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe99b7fe700 1 -- 172.21.15.62:0/2637115664 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99400b9c0 con 0x7fe99c143c50 2021-12-17T18:20:48.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe99b7fe700 1 -- 172.21.15.62:0/2637115664 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe99400bb30 con 0x7fe99c143c50 2021-12-17T18:20:48.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a1fc5700 1 -- 172.21.15.62:0/2637115664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe99c143c50 msgr2=0x7fe99c0b1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a1fc5700 1 --2- 172.21.15.62:0/2637115664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe99c143c50 0x7fe99c0b1970 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fe99c142fb0 tx=0x7fe994009290).stop 2021-12-17T18:20:48.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a1fc5700 1 -- 172.21.15.62:0/2637115664 shutdown_connections 2021-12-17T18:20:48.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a1fc5700 1 --2- 172.21.15.62:0/2637115664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe99c143c50 0x7fe99c0b1970 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a1fc5700 1 --2- 172.21.15.62:0/2637115664 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe99c0b2b60 0x7fe99c143760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a1fc5700 1 -- 172.21.15.62:0/2637115664 >> 172.21.15.62:0/2637115664 conn(0x7fe99c0b7020 msgr2=0x7fe99c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:48.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a1fc5700 1 -- 172.21.15.62:0/2637115664 shutdown_connections 2021-12-17T18:20:48.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:47.998+0000 7fe9a1fc5700 1 -- 172.21.15.62:0/2637115664 wait complete. 2021-12-17T18:20:48.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.002+0000 7fe9a1fc5700 1 Processor -- start 2021-12-17T18:20:48.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.002+0000 7fe9a1fc5700 1 -- start start 2021-12-17T18:20:48.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe9a1fc5700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe99c0b2b60 0x7fe99c147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe9a1fc5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe99c0b3a40 0x7fe99c144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe9a1fc5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe99c143c50 0x7fe99c152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe9a1fc5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c0aeb30 con 0x7fe99c0b3a40 2021-12-17T18:20:48.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe9a1fc5700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c152730 con 0x7fe99c0b2b60 2021-12-17T18:20:48.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe9a1fc5700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c152430 con 0x7fe99c143c50 2021-12-17T18:20:48.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe99bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe99c0b3a40 0x7fe99c144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe99bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe99c0b3a40 0x7fe99c144450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50240/0 (socket says 172.21.15.62:50240) 2021-12-17T18:20:48.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe99bfff700 1 -- 172.21.15.62:0/1349068899 learned_addr learned my addr 172.21.15.62:0/1349068899 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:48.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe9a17c4700 1 --2- 172.21.15.62:0/1349068899 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe99c143c50 0x7fe99c152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe9a0fc3700 1 --2- 172.21.15.62:0/1349068899 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe99c0b2b60 0x7fe99c147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe99bfff700 1 -- 172.21.15.62:0/1349068899 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe99c143c50 msgr2=0x7fe99c152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe99bfff700 1 --2- 172.21.15.62:0/1349068899 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe99c143c50 0x7fe99c152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe99bfff700 1 -- 172.21.15.62:0/1349068899 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe99c0b2b60 msgr2=0x7fe99c147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe99bfff700 1 --2- 172.21.15.62:0/1349068899 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe99c0b2b60 0x7fe99c147f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe99bfff700 1 -- 172.21.15.62:0/1349068899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe994009530 con 0x7fe99c0b3a40 2021-12-17T18:20:48.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe99bfff700 1 --2- 172.21.15.62:0/1349068899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe99c0b3a40 0x7fe99c144450 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fe98800a000 tx=0x7fe988008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:48.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe999ffb700 1 -- 172.21.15.62:0/1349068899 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9880106e0 con 0x7fe99c0b3a40 2021-12-17T18:20:48.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe999ffb700 1 -- 172.21.15.62:0/1349068899 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe988010840 con 0x7fe99c0b3a40 2021-12-17T18:20:48.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe9a1fc5700 1 -- 172.21.15.62:0/1349068899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99c153590 con 0x7fe99c0b3a40 2021-12-17T18:20:48.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe999ffb700 1 -- 172.21.15.62:0/1349068899 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe988010ba0 con 0x7fe99c0b3a40 2021-12-17T18:20:48.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe9a1fc5700 1 -- 172.21.15.62:0/1349068899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99c0ae660 con 0x7fe99c0b3a40 2021-12-17T18:20:48.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe9a1fc5700 1 -- 172.21.15.62:0/1349068899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99c1432c0 con 0x7fe99c0b3a40 2021-12-17T18:20:48.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.006+0000 7fe999ffb700 1 -- 172.21.15.62:0/1349068899 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe98801a030 con 0x7fe99c0b3a40 2021-12-17T18:20:48.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.010+0000 7fe999ffb700 1 --2- 172.21.15.62:0/1349068899 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe97c053610 0x7fe97c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.010+0000 7fe999ffb700 1 -- 172.21.15.62:0/1349068899 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe98806b440 con 0x7fe99c0b3a40 2021-12-17T18:20:48.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.010+0000 7fe9a0fc3700 1 --2- 172.21.15.62:0/1349068899 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe97c053610 0x7fe97c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.010+0000 7fe9a0fc3700 1 --2- 172.21.15.62:0/1349068899 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe97c053610 0x7fe97c055ad0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fe99000d000 tx=0x7fe990007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:48.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.014+0000 7fe999ffb700 1 -- 172.21.15.62:0/1349068899 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe9880425a0 con 0x7fe99c0b3a40 2021-12-17T18:20:48.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.138+0000 7fe9a1fc5700 1 -- 172.21.15.62:0/1349068899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe99c0573d0 con 0x7fe99c0b3a40 2021-12-17T18:20:48.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.138+0000 7fe999ffb700 1 -- 172.21.15.62:0/1349068899 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16086 (secure 0 0 0) 0x7fe988045bc0 con 0x7fe99c0b3a40 2021-12-17T18:20:48.145 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:48.146 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":42,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:20:17.803894+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:20:15.333250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-12-17T18:20:16.462772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:20:48.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.142+0000 7fe9a1fc5700 1 -- 172.21.15.62:0/1349068899 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe97c053610 msgr2=0x7fe97c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.142+0000 7fe9a1fc5700 1 --2- 172.21.15.62:0/1349068899 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe97c053610 0x7fe97c055ad0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fe99000d000 tx=0x7fe990007b90).stop 2021-12-17T18:20:48.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.142+0000 7fe9a1fc5700 1 -- 172.21.15.62:0/1349068899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe99c0b3a40 msgr2=0x7fe99c144450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.142+0000 7fe9a1fc5700 1 --2- 172.21.15.62:0/1349068899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe99c0b3a40 0x7fe99c144450 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fe98800a000 tx=0x7fe988008040).stop 2021-12-17T18:20:48.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.142+0000 7fe9a1fc5700 1 -- 172.21.15.62:0/1349068899 shutdown_connections 2021-12-17T18:20:48.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.142+0000 7fe9a1fc5700 1 --2- 172.21.15.62:0/1349068899 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe97c053610 0x7fe97c055ad0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.142+0000 7fe9a1fc5700 1 --2- 172.21.15.62:0/1349068899 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe99c143c50 0x7fe99c152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.142+0000 7fe9a1fc5700 1 --2- 172.21.15.62:0/1349068899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe99c0b3a40 0x7fe99c144450 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.142+0000 7fe9a1fc5700 1 --2- 172.21.15.62:0/1349068899 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe99c0b2b60 0x7fe99c147f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.142+0000 7fe9a1fc5700 1 -- 172.21.15.62:0/1349068899 >> 172.21.15.62:0/1349068899 conn(0x7fe99c0b7020 msgr2=0x7fe99c12bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:48.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.142+0000 7fe9a1fc5700 1 -- 172.21.15.62:0/1349068899 shutdown_connections 2021-12-17T18:20:48.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.142+0000 7fe9a1fc5700 1 -- 172.21.15.62:0/1349068899 wait complete. 2021-12-17T18:20:48.158 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:20:15.333250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:20:16.462772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:20:48.159 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:20:48.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc46365700 1 Processor -- start 2021-12-17T18:20:48.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc46365700 1 -- start start 2021-12-17T18:20:48.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc46365700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc400b2d00 0x7fcc400b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc46365700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcc40062b60 0x7fcc4013fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc46365700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fcc400625b0 0x7fcc40139870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc46365700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc40140140 con 0x7fcc40062b60 2021-12-17T18:20:48.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc46365700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc40140e60 con 0x7fcc400625b0 2021-12-17T18:20:48.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc46365700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc400aecb0 con 0x7fcc400b2d00 2021-12-17T18:20:48.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc44b62700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcc40062b60 0x7fcc4013fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc44b62700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcc40062b60 0x7fcc4013fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50248/0 (socket says 172.21.15.62:50248) 2021-12-17T18:20:48.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc44b62700 1 -- 172.21.15.62:0/250209429 learned_addr learned my addr 172.21.15.62:0/250209429 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:48.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc45363700 1 --2- 172.21.15.62:0/250209429 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc400b2d00 0x7fcc400b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc45b64700 1 --2- 172.21.15.62:0/250209429 >> v2:172.21.15.109:3300/0 conn(0x7fcc400625b0 0x7fcc40139870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc44b62700 1 -- 172.21.15.62:0/250209429 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc400b2d00 msgr2=0x7fcc400b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:48.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc44b62700 1 --2- 172.21.15.62:0/250209429 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc400b2d00 0x7fcc400b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc44b62700 1 -- 172.21.15.62:0/250209429 >> v2:172.21.15.109:3300/0 conn(0x7fcc400625b0 msgr2=0x7fcc40139870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:48.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc44b62700 1 --2- 172.21.15.62:0/250209429 >> v2:172.21.15.109:3300/0 conn(0x7fcc400625b0 0x7fcc40139870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc44b62700 1 -- 172.21.15.62:0/250209429 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc400aef50 con 0x7fcc40062b60 2021-12-17T18:20:48.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.262+0000 7fcc44b62700 1 --2- 172.21.15.62:0/250209429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc40062b60 0x7fcc4013fc50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fcc34002f70 tx=0x7fcc34006eb0).ready entity=mon.0 client_cookie=28cedd79a721dec7 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:48.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc33fff700 1 -- 172.21.15.62:0/250209429 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc3400d570 con 0x7fcc40062b60 2021-12-17T18:20:48.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc33fff700 1 -- 172.21.15.62:0/250209429 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc34000e90 con 0x7fcc40062b60 2021-12-17T18:20:48.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc33fff700 1 -- 172.21.15.62:0/250209429 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc3400d900 con 0x7fcc40062b60 2021-12-17T18:20:48.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc46365700 1 -- 172.21.15.62:0/250209429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc40062b60 msgr2=0x7fcc4013fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc46365700 1 --2- 172.21.15.62:0/250209429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc40062b60 0x7fcc4013fc50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fcc34002f70 tx=0x7fcc34006eb0).stop 2021-12-17T18:20:48.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc46365700 1 -- 172.21.15.62:0/250209429 shutdown_connections 2021-12-17T18:20:48.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc46365700 1 --2- 172.21.15.62:0/250209429 >> v2:172.21.15.109:3300/0 conn(0x7fcc400625b0 0x7fcc40139870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc46365700 1 --2- 172.21.15.62:0/250209429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc40062b60 0x7fcc4013fc50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc46365700 1 --2- 172.21.15.62:0/250209429 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc400b2d00 0x7fcc400b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc46365700 1 -- 172.21.15.62:0/250209429 >> 172.21.15.62:0/250209429 conn(0x7fcc40060a50 msgr2=0x7fcc4005bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:48.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc46365700 1 -- 172.21.15.62:0/250209429 shutdown_connections 2021-12-17T18:20:48.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc46365700 1 -- 172.21.15.62:0/250209429 wait complete. 2021-12-17T18:20:48.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc46365700 1 Processor -- start 2021-12-17T18:20:48.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc46365700 1 -- start start 2021-12-17T18:20:48.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc46365700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc400625b0 0x7fcc4005fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc46365700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc40062b60 0x7fcc4014ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc46365700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc400b2d00 0x7fcc40138d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc46365700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc40153eb0 con 0x7fcc400b2d00 2021-12-17T18:20:48.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc46365700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc40143c70 con 0x7fcc40062b60 2021-12-17T18:20:48.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc46365700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc40144490 con 0x7fcc400625b0 2021-12-17T18:20:48.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc45b64700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc400b2d00 0x7fcc40138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc45b64700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc400b2d00 0x7fcc40138d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50254/0 (socket says 172.21.15.62:50254) 2021-12-17T18:20:48.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc45b64700 1 -- 172.21.15.62:0/988218230 learned_addr learned my addr 172.21.15.62:0/988218230 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:48.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc45363700 1 --2- 172.21.15.62:0/988218230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc400625b0 0x7fcc4005fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc44b62700 1 --2- 172.21.15.62:0/988218230 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc40062b60 0x7fcc4014ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc45b64700 1 -- 172.21.15.62:0/988218230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc400625b0 msgr2=0x7fcc4005fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.266+0000 7fcc45b64700 1 --2- 172.21.15.62:0/988218230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc400625b0 0x7fcc4005fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.270+0000 7fcc45b64700 1 -- 172.21.15.62:0/988218230 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc40062b60 msgr2=0x7fcc4014ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.270+0000 7fcc45b64700 1 --2- 172.21.15.62:0/988218230 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc40062b60 0x7fcc4014ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.270+0000 7fcc45b64700 1 -- 172.21.15.62:0/988218230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3400b1e0 con 0x7fcc400b2d00 2021-12-17T18:20:48.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.270+0000 7fcc45b64700 1 --2- 172.21.15.62:0/988218230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc400b2d00 0x7fcc40138d20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fcc3800c000 tx=0x7fcc38006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:48.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.270+0000 7fcc327fc700 1 -- 172.21.15.62:0/988218230 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc38011750 con 0x7fcc400b2d00 2021-12-17T18:20:48.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.270+0000 7fcc327fc700 1 -- 172.21.15.62:0/988218230 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc380118b0 con 0x7fcc400b2d00 2021-12-17T18:20:48.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.270+0000 7fcc46365700 1 -- 172.21.15.62:0/988218230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc40154130 con 0x7fcc400b2d00 2021-12-17T18:20:48.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.270+0000 7fcc327fc700 1 -- 172.21.15.62:0/988218230 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc38011c10 con 0x7fcc400b2d00 2021-12-17T18:20:48.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.270+0000 7fcc46365700 1 -- 172.21.15.62:0/988218230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc401438a0 con 0x7fcc400b2d00 2021-12-17T18:20:48.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.270+0000 7fcc46365700 1 -- 172.21.15.62:0/988218230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc401542c0 con 0x7fcc400b2d00 2021-12-17T18:20:48.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.270+0000 7fcc327fc700 1 -- 172.21.15.62:0/988218230 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcc38011d70 con 0x7fcc400b2d00 2021-12-17T18:20:48.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.270+0000 7fcc327fc700 1 --2- 172.21.15.62:0/988218230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcc20053580 0x7fcc20055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.270+0000 7fcc327fc700 1 -- 172.21.15.62:0/988218230 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcc3806bdc0 con 0x7fcc400b2d00 2021-12-17T18:20:48.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.270+0000 7fcc45363700 1 --2- 172.21.15.62:0/988218230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcc20053580 0x7fcc20055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.274+0000 7fcc45363700 1 --2- 172.21.15.62:0/988218230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcc20053580 0x7fcc20055a40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fcc3c00b000 tx=0x7fcc3c0091d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:48.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.278+0000 7fcc327fc700 1 -- 172.21.15.62:0/988218230 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcc38042e80 con 0x7fcc400b2d00 2021-12-17T18:20:48.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.402+0000 7fcc46365700 1 -- 172.21.15.62:0/988218230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcc400af1f0 con 0x7fcc400b2d00 2021-12-17T18:20:48.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.402+0000 7fcc327fc700 1 -- 172.21.15.62:0/988218230 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v42) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcc380464a0 con 0x7fcc400b2d00 2021-12-17T18:20:48.411 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:20:48.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.406+0000 7fcc46365700 1 -- 172.21.15.62:0/988218230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcc20053580 msgr2=0x7fcc20055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.406+0000 7fcc46365700 1 --2- 172.21.15.62:0/988218230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcc20053580 0x7fcc20055a40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fcc3c00b000 tx=0x7fcc3c0091d0).stop 2021-12-17T18:20:48.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.406+0000 7fcc46365700 1 -- 172.21.15.62:0/988218230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc400b2d00 msgr2=0x7fcc40138d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.406+0000 7fcc46365700 1 --2- 172.21.15.62:0/988218230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc400b2d00 0x7fcc40138d20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fcc3800c000 tx=0x7fcc38006df0).stop 2021-12-17T18:20:48.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.406+0000 7fcc46365700 1 -- 172.21.15.62:0/988218230 shutdown_connections 2021-12-17T18:20:48.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.406+0000 7fcc46365700 1 --2- 172.21.15.62:0/988218230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcc20053580 0x7fcc20055a40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.406+0000 7fcc46365700 1 --2- 172.21.15.62:0/988218230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc400b2d00 0x7fcc40138d20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.406+0000 7fcc46365700 1 --2- 172.21.15.62:0/988218230 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc40062b60 0x7fcc4014ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.406+0000 7fcc46365700 1 --2- 172.21.15.62:0/988218230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc400625b0 0x7fcc4005fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.406+0000 7fcc46365700 1 -- 172.21.15.62:0/988218230 >> 172.21.15.62:0/988218230 conn(0x7fcc40060a50 msgr2=0x7fcc400b6350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:48.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.406+0000 7fcc46365700 1 -- 172.21.15.62:0/988218230 shutdown_connections 2021-12-17T18:20:48.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.406+0000 7fcc46365700 1 -- 172.21.15.62:0/988218230 wait complete. 2021-12-17T18:20:48.423 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:20:48.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5bf252d700 1 Processor -- start 2021-12-17T18:20:48.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5bf252d700 1 -- start start 2021-12-17T18:20:48.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5bf252d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5bec0af3a0 0x7f5bec0b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5bf252d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5bec141890 0x7f5bec1445e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5bf252d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec05f9d0 con 0x7f5bec05c8f0 2021-12-17T18:20:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5bf252d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec0abe60 con 0x7f5bec141890 2021-12-17T18:20:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5bf252d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec05ff60 con 0x7f5bec0af3a0 2021-12-17T18:20:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5bf152b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5bec05c8f0 0x7f5bec141180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33840/0 (socket says 172.21.15.62:33840) 2021-12-17T18:20:48.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5bf152b700 1 -- 172.21.15.62:0/3906463339 learned_addr learned my addr 172.21.15.62:0/3906463339 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:48.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5bf0d2a700 1 --2- 172.21.15.62:0/3906463339 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5bec0af3a0 0x7f5bec0b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5bf1d2c700 1 --2- 172.21.15.62:0/3906463339 >> v2:172.21.15.109:3300/0 conn(0x7f5bec141890 0x7f5bec1445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5be3fff700 1 -- 172.21.15.62:0/3906463339 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2451575033 0 0) 0x7f5bec05f9d0 con 0x7f5bec05c8f0 2021-12-17T18:20:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5be3fff700 1 -- 172.21.15.62:0/3906463339 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd0003260 con 0x7f5bec05c8f0 2021-12-17T18:20:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5bf0d2a700 1 -- 172.21.15.62:0/3906463339 >> v2:172.21.15.109:3300/0 conn(0x7f5bec141890 msgr2=0x7f5bec1445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5bf0d2a700 1 --2- 172.21.15.62:0/3906463339 >> v2:172.21.15.109:3300/0 conn(0x7f5bec141890 0x7f5bec1445e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5bf0d2a700 1 -- 172.21.15.62:0/3906463339 >> v1:172.21.15.62:6789/0 conn(0x7f5bec05c8f0 legacy=0x7f5bec141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5bf0d2a700 1 -- 172.21.15.62:0/3906463339 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec05ccd0 con 0x7f5bec0af3a0 2021-12-17T18:20:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.530+0000 7f5bf0d2a700 1 --2- 172.21.15.62:0/3906463339 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5bec0af3a0 0x7f5bec0b0620 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f5be8002f70 tx=0x7f5be8006df0).ready entity=mon.2 client_cookie=d545b0dccfa9a223 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.534+0000 7f5be3fff700 1 -- 172.21.15.62:0/3906463339 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5be800d4a0 con 0x7f5bec0af3a0 2021-12-17T18:20:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.534+0000 7f5be3fff700 1 -- 172.21.15.62:0/3906463339 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be8000e90 con 0x7f5bec0af3a0 2021-12-17T18:20:48.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.534+0000 7f5be3fff700 1 -- 172.21.15.62:0/3906463339 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5be800d7f0 con 0x7f5bec0af3a0 2021-12-17T18:20:48.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.534+0000 7f5bf252d700 1 -- 172.21.15.62:0/3906463339 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5bec0af3a0 msgr2=0x7f5bec0b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.534+0000 7f5bf252d700 1 --2- 172.21.15.62:0/3906463339 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5bec0af3a0 0x7f5bec0b0620 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f5be8002f70 tx=0x7f5be8006df0).stop 2021-12-17T18:20:48.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.534+0000 7f5bf252d700 1 -- 172.21.15.62:0/3906463339 shutdown_connections 2021-12-17T18:20:48.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.534+0000 7f5bf252d700 1 --2- 172.21.15.62:0/3906463339 >> v2:172.21.15.109:3300/0 conn(0x7f5bec141890 0x7f5bec1445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.534+0000 7f5bf252d700 1 --2- 172.21.15.62:0/3906463339 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5bec0af3a0 0x7f5bec0b0620 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.534+0000 7f5bf252d700 1 -- 172.21.15.62:0/3906463339 >> 172.21.15.62:0/3906463339 conn(0x7f5bec05be70 msgr2=0x7f5bec062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:48.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.534+0000 7f5bf252d700 1 -- 172.21.15.62:0/3906463339 shutdown_connections 2021-12-17T18:20:48.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.534+0000 7f5bf252d700 1 -- 172.21.15.62:0/3906463339 wait complete. 2021-12-17T18:20:48.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.534+0000 7f5bf252d700 1 Processor -- start 2021-12-17T18:20:48.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.534+0000 7f5bf252d700 1 -- start start 2021-12-17T18:20:48.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.534+0000 7f5bf252d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5bec05c8f0 0x7f5bec145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.534+0000 7f5bf252d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5bec0af3a0 0x7f5bec140410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.534+0000 7f5bf252d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bec141890 0x7f5bec13ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf252d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec140900 con 0x7f5bec141890 2021-12-17T18:20:48.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf252d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec140b90 con 0x7f5bec0af3a0 2021-12-17T18:20:48.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf252d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec140e30 con 0x7f5bec05c8f0 2021-12-17T18:20:48.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf152b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5bec05c8f0 0x7f5bec145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf1d2c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bec141890 0x7f5bec13ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf152b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5bec05c8f0 0x7f5bec145de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:43968/0 (socket says 172.21.15.62:43968) 2021-12-17T18:20:48.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf152b700 1 -- 172.21.15.62:0/1129028792 learned_addr learned my addr 172.21.15.62:0/1129028792 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:48.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf1d2c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bec141890 0x7f5bec13ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50270/0 (socket says 172.21.15.62:50270) 2021-12-17T18:20:48.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf0d2a700 1 --2- 172.21.15.62:0/1129028792 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5bec0af3a0 0x7f5bec140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf1d2c700 1 -- 172.21.15.62:0/1129028792 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5bec05c8f0 msgr2=0x7f5bec145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf1d2c700 1 --2- 172.21.15.62:0/1129028792 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5bec05c8f0 0x7f5bec145de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf1d2c700 1 -- 172.21.15.62:0/1129028792 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5bec0af3a0 msgr2=0x7f5bec140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf1d2c700 1 --2- 172.21.15.62:0/1129028792 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5bec0af3a0 0x7f5bec140410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf1d2c700 1 -- 172.21.15.62:0/1129028792 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be800b180 con 0x7f5bec141890 2021-12-17T18:20:48.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf1d2c700 1 --2- 172.21.15.62:0/1129028792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bec141890 0x7f5bec13ef10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f5be400c000 tx=0x7f5be40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:48.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5be27fc700 1 -- 172.21.15.62:0/1129028792 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5be4012600 con 0x7f5bec141890 2021-12-17T18:20:48.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf252d700 1 -- 172.21.15.62:0/1129028792 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec13ea70 con 0x7f5bec141890 2021-12-17T18:20:48.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5be27fc700 1 -- 172.21.15.62:0/1129028792 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be4012760 con 0x7f5bec141890 2021-12-17T18:20:48.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5be27fc700 1 -- 172.21.15.62:0/1129028792 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5be4012ac0 con 0x7f5bec141890 2021-12-17T18:20:48.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf252d700 1 -- 172.21.15.62:0/1129028792 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec067110 con 0x7f5bec141890 2021-12-17T18:20:48.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf252d700 1 -- 172.21.15.62:0/1129028792 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec141d40 con 0x7f5bec141890 2021-12-17T18:20:48.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5be27fc700 1 -- 172.21.15.62:0/1129028792 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5be4012c20 con 0x7f5bec141890 2021-12-17T18:20:48.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5be27fc700 1 --2- 172.21.15.62:0/1129028792 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bd4053580 0x7f5bd4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5be27fc700 1 -- 172.21.15.62:0/1129028792 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5be406bb90 con 0x7f5bec141890 2021-12-17T18:20:48.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.538+0000 7f5bf152b700 1 --2- 172.21.15.62:0/1129028792 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bd4053580 0x7f5bd4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.542+0000 7f5bf152b700 1 --2- 172.21.15.62:0/1129028792 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bd4053580 0x7f5bd4055a40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f5bdc00d000 tx=0x7f5bdc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:48.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.546+0000 7f5be27fc700 1 -- 172.21.15.62:0/1129028792 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5be4042cf0 con 0x7f5bec141890 2021-12-17T18:20:48.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.666+0000 7f5bf252d700 1 -- 172.21.15.62:0/1129028792 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5bec0573d0 con 0x7f5bec141890 2021-12-17T18:20:48.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.666+0000 7f5be27fc700 1 -- 172.21.15.62:0/1129028792 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5be4016020 con 0x7f5bec141890 2021-12-17T18:20:48.671 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:20:48.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.666+0000 7f5bf252d700 1 -- 172.21.15.62:0/1129028792 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bd4053580 msgr2=0x7f5bd4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.666+0000 7f5bf252d700 1 --2- 172.21.15.62:0/1129028792 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bd4053580 0x7f5bd4055a40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f5bdc00d000 tx=0x7f5bdc009040).stop 2021-12-17T18:20:48.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.666+0000 7f5bf252d700 1 -- 172.21.15.62:0/1129028792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bec141890 msgr2=0x7f5bec13ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.666+0000 7f5bf252d700 1 --2- 172.21.15.62:0/1129028792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bec141890 0x7f5bec13ef10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f5be400c000 tx=0x7f5be40091d0).stop 2021-12-17T18:20:48.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.666+0000 7f5bf252d700 1 -- 172.21.15.62:0/1129028792 shutdown_connections 2021-12-17T18:20:48.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.666+0000 7f5bf252d700 1 --2- 172.21.15.62:0/1129028792 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bd4053580 0x7f5bd4055a40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.666+0000 7f5bf252d700 1 --2- 172.21.15.62:0/1129028792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bec141890 0x7f5bec13ef10 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.666+0000 7f5bf252d700 1 --2- 172.21.15.62:0/1129028792 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5bec0af3a0 0x7f5bec140410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.666+0000 7f5bf252d700 1 --2- 172.21.15.62:0/1129028792 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5bec05c8f0 0x7f5bec145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.666+0000 7f5bf252d700 1 -- 172.21.15.62:0/1129028792 >> 172.21.15.62:0/1129028792 conn(0x7f5bec05be70 msgr2=0x7f5bec13d880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.666+0000 7f5bf252d700 1 -- 172.21.15.62:0/1129028792 shutdown_connections 2021-12-17T18:20:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.666+0000 7f5bf252d700 1 -- 172.21.15.62:0/1129028792 wait complete. 2021-12-17T18:20:48.684 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:20:48.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.786+0000 7f37cffff700 1 Processor -- start 2021-12-17T18:20:48.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.786+0000 7f37cffff700 1 -- start start 2021-12-17T18:20:48.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.786+0000 7f37cffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f37d00b47c0 0x7f37d00b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.786+0000 7f37cffff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f37d00b5be0 0x7f37d0143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.786+0000 7f37cffff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d00b0870 con 0x7f37d005ca90 2021-12-17T18:20:48.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.786+0000 7f37cffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d005ce70 con 0x7f37d00b47c0 2021-12-17T18:20:48.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.786+0000 7f37cffff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d00b05d0 con 0x7f37d00b5be0 2021-12-17T18:20:48.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.786+0000 7f37ce7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f37d00b47c0 0x7f37d00b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.786+0000 7f37ce7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f37d00b47c0 0x7f37d00b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50274/0 (socket says 172.21.15.62:50274) 2021-12-17T18:20:48.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.786+0000 7f37ce7fc700 1 -- 172.21.15.62:0/3051657106 learned_addr learned my addr 172.21.15.62:0/3051657106 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:48.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.786+0000 7f37cf7fe700 1 --2- 172.21.15.62:0/3051657106 >> v2:172.21.15.109:3300/0 conn(0x7f37d00b5be0 0x7f37d0143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37ce7fc700 1 -- 172.21.15.62:0/3051657106 >> v2:172.21.15.109:3300/0 conn(0x7f37d00b5be0 msgr2=0x7f37d0143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:20:48.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37ce7fc700 1 --2- 172.21.15.62:0/3051657106 >> v2:172.21.15.109:3300/0 conn(0x7f37d00b5be0 0x7f37d0143ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37ce7fc700 1 -- 172.21.15.62:0/3051657106 >> v1:172.21.15.109:6789/0 conn(0x7f37d005ca90 legacy=0x7f37d00b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37ce7fc700 1 -- 172.21.15.62:0/3051657106 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d00b5250 con 0x7f37d00b47c0 2021-12-17T18:20:48.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37ce7fc700 1 --2- 172.21.15.62:0/3051657106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37d00b47c0 0x7f37d00b56f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f37c0002f70 tx=0x7f37c0006eb0).ready entity=mon.0 client_cookie=1c5b4e456b728f54 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:48.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37cdffb700 1 -- 172.21.15.62:0/3051657106 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37c000d610 con 0x7f37d00b47c0 2021-12-17T18:20:48.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37cdffb700 1 -- 172.21.15.62:0/3051657106 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c0000e90 con 0x7f37d00b47c0 2021-12-17T18:20:48.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37cdffb700 1 -- 172.21.15.62:0/3051657106 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37c000d9a0 con 0x7f37d00b47c0 2021-12-17T18:20:48.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37cffff700 1 -- 172.21.15.62:0/3051657106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37d00b47c0 msgr2=0x7f37d00b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37cffff700 1 --2- 172.21.15.62:0/3051657106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37d00b47c0 0x7f37d00b56f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f37c0002f70 tx=0x7f37c0006eb0).stop 2021-12-17T18:20:48.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37cffff700 1 -- 172.21.15.62:0/3051657106 shutdown_connections 2021-12-17T18:20:48.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37cffff700 1 --2- 172.21.15.62:0/3051657106 >> v2:172.21.15.109:3300/0 conn(0x7f37d00b5be0 0x7f37d0143ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37cffff700 1 --2- 172.21.15.62:0/3051657106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37d00b47c0 0x7f37d00b56f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37cffff700 1 -- 172.21.15.62:0/3051657106 >> 172.21.15.62:0/3051657106 conn(0x7f37d005bcd0 msgr2=0x7f37d0062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:48.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37cffff700 1 -- 172.21.15.62:0/3051657106 shutdown_connections 2021-12-17T18:20:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37cffff700 1 -- 172.21.15.62:0/3051657106 wait complete. 2021-12-17T18:20:48.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37cffff700 1 Processor -- start 2021-12-17T18:20:48.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.790+0000 7f37cffff700 1 -- start start 2021-12-17T18:20:48.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37cffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37d005ca90 0x7f37d0155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37cffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37d00b47c0 0x7f37d0065540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37cffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37d00b5be0 0x7f37d00a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37cffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d0147de0 con 0x7f37d00b47c0 2021-12-17T18:20:48.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37cffff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d00a5310 con 0x7f37d005ca90 2021-12-17T18:20:48.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37cffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d01476a0 con 0x7f37d00b5be0 2021-12-17T18:20:48.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37ce7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37d00b47c0 0x7f37d0065540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37ce7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37d00b47c0 0x7f37d0065540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50280/0 (socket says 172.21.15.62:50280) 2021-12-17T18:20:48.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37ce7fc700 1 -- 172.21.15.62:0/637119799 learned_addr learned my addr 172.21.15.62:0/637119799 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:48.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37cf7fe700 1 --2- 172.21.15.62:0/637119799 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37d00b5be0 0x7f37d00a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37ceffd700 1 --2- 172.21.15.62:0/637119799 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37d005ca90 0x7f37d0155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37ce7fc700 1 -- 172.21.15.62:0/637119799 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37d00b5be0 msgr2=0x7f37d00a2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37ce7fc700 1 --2- 172.21.15.62:0/637119799 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37d00b5be0 0x7f37d00a2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37ce7fc700 1 -- 172.21.15.62:0/637119799 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37d005ca90 msgr2=0x7f37d0155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37ce7fc700 1 --2- 172.21.15.62:0/637119799 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37d005ca90 0x7f37d0155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37ce7fc700 1 -- 172.21.15.62:0/637119799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c000b1e0 con 0x7f37d00b47c0 2021-12-17T18:20:48.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37ceffd700 1 --2- 172.21.15.62:0/637119799 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37d005ca90 0x7f37d0155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:20:48.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37ce7fc700 1 --2- 172.21.15.62:0/637119799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37d00b47c0 0x7f37d0065540 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f37c0002f70 tx=0x7f37c0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:48.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37bffff700 1 -- 172.21.15.62:0/637119799 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37c000d990 con 0x7f37d00b47c0 2021-12-17T18:20:48.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37bffff700 1 -- 172.21.15.62:0/637119799 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c0011ca0 con 0x7f37d00b47c0 2021-12-17T18:20:48.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37cffff700 1 -- 172.21.15.62:0/637119799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d0147940 con 0x7f37d00b47c0 2021-12-17T18:20:48.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37bffff700 1 -- 172.21.15.62:0/637119799 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37c001e460 con 0x7f37d00b47c0 2021-12-17T18:20:48.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37cffff700 1 -- 172.21.15.62:0/637119799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d00a4f90 con 0x7f37d00b47c0 2021-12-17T18:20:48.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.794+0000 7f37cffff700 1 -- 172.21.15.62:0/637119799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d00b3980 con 0x7f37d00b47c0 2021-12-17T18:20:48.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.798+0000 7f37bffff700 1 -- 172.21.15.62:0/637119799 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f37c0025030 con 0x7f37d00b47c0 2021-12-17T18:20:48.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.798+0000 7f37bffff700 1 --2- 172.21.15.62:0/637119799 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37ac053580 0x7f37ac055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:48.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.798+0000 7f37bffff700 1 -- 172.21.15.62:0/637119799 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f37c006cc00 con 0x7f37d00b47c0 2021-12-17T18:20:48.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.798+0000 7f37ceffd700 1 --2- 172.21.15.62:0/637119799 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37ac053580 0x7f37ac055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:48.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.798+0000 7f37ceffd700 1 --2- 172.21.15.62:0/637119799 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37ac053580 0x7f37ac055a40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f37c4008000 tx=0x7f37c4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:48.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.802+0000 7f37bffff700 1 -- 172.21.15.62:0/637119799 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f37c0072020 con 0x7f37d00b47c0 2021-12-17T18:20:48.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.930+0000 7f37cffff700 1 -- 172.21.15.62:0/637119799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37d00573d0 con 0x7f37d00b47c0 2021-12-17T18:20:48.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.930+0000 7f37bffff700 1 -- 172.21.15.62:0/637119799 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+10 (secure 0 0 0) 0x7f37c0043d60 con 0x7f37d00b47c0 2021-12-17T18:20:48.937 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:20:48.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.934+0000 7f37cffff700 1 -- 172.21.15.62:0/637119799 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37ac053580 msgr2=0x7f37ac055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.934+0000 7f37cffff700 1 --2- 172.21.15.62:0/637119799 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37ac053580 0x7f37ac055a40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f37c4008000 tx=0x7f37c4009040).stop 2021-12-17T18:20:48.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.934+0000 7f37cffff700 1 -- 172.21.15.62:0/637119799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37d00b47c0 msgr2=0x7f37d0065540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:48.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.934+0000 7f37cffff700 1 --2- 172.21.15.62:0/637119799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37d00b47c0 0x7f37d0065540 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f37c0002f70 tx=0x7f37c0015000).stop 2021-12-17T18:20:48.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.934+0000 7f37cffff700 1 -- 172.21.15.62:0/637119799 shutdown_connections 2021-12-17T18:20:48.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.934+0000 7f37cffff700 1 --2- 172.21.15.62:0/637119799 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37ac053580 0x7f37ac055a40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.934+0000 7f37cffff700 1 --2- 172.21.15.62:0/637119799 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37d00b5be0 0x7f37d00a2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.934+0000 7f37cffff700 1 --2- 172.21.15.62:0/637119799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37d00b47c0 0x7f37d0065540 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.934+0000 7f37cffff700 1 --2- 172.21.15.62:0/637119799 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37d005ca90 0x7f37d0155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:48.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.934+0000 7f37cffff700 1 -- 172.21.15.62:0/637119799 >> 172.21.15.62:0/637119799 conn(0x7f37d005bcd0 msgr2=0x7f37d00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:48.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.934+0000 7f37cffff700 1 -- 172.21.15.62:0/637119799 shutdown_connections 2021-12-17T18:20:48.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:48.934+0000 7f37cffff700 1 -- 172.21.15.62:0/637119799 wait complete. 2021-12-17T18:20:48.950 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:20:49.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.047+0000 7fb8b9afb700 1 Processor -- start 2021-12-17T18:20:49.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.047+0000 7fb8b9afb700 1 -- start start 2021-12-17T18:20:49.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b9afb700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fb8b40b4230 0x7fb8b40b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:49.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b9afb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b405ce70 con 0x7fb8b40b3540 2021-12-17T18:20:49.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b9afb700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b40b1bc0 con 0x7fb8b405ca90 2021-12-17T18:20:49.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b9afb700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b40b1e60 con 0x7fb8b40b4230 2021-12-17T18:20:49.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b3fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb8b40b3540 0x7fb8b4145a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33870/0 (socket says 172.21.15.62:33870) 2021-12-17T18:20:49.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b3fff700 1 -- 172.21.15.62:0/3831241410 learned_addr learned my addr 172.21.15.62:0/3831241410 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:49.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b92fa700 1 --2- 172.21.15.62:0/3831241410 >> v2:172.21.15.109:3300/0 conn(0x7fb8b40b4230 0x7fb8b40b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:49.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b37fe700 1 -- 172.21.15.62:0/3831241410 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942508605 0 0) 0x7fb8b405ce70 con 0x7fb8b40b3540 2021-12-17T18:20:49.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b37fe700 1 -- 172.21.15.62:0/3831241410 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8a0003260 con 0x7fb8b40b3540 2021-12-17T18:20:49.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b92fa700 1 -- 172.21.15.62:0/3831241410 >> v1:172.21.15.109:6789/0 conn(0x7fb8b405ca90 legacy=0x7fb8b40b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:49.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b92fa700 1 -- 172.21.15.62:0/3831241410 >> v1:172.21.15.62:6789/0 conn(0x7fb8b40b3540 legacy=0x7fb8b4145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:49.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b92fa700 1 -- 172.21.15.62:0/3831241410 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b40b2100 con 0x7fb8b40b4230 2021-12-17T18:20:49.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b92fa700 1 --2- 172.21.15.62:0/3831241410 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8b40b4230 0x7fb8b40b25a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fb8ac0032f0 tx=0x7fb8ac0091d0).ready entity=mon.1 client_cookie=71f50a68552a38d8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:49.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b37fe700 1 -- 172.21.15.62:0/3831241410 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ac00b6c0 con 0x7fb8b40b4230 2021-12-17T18:20:49.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b37fe700 1 -- 172.21.15.62:0/3831241410 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ac00b820 con 0x7fb8b40b4230 2021-12-17T18:20:49.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b37fe700 1 -- 172.21.15.62:0/3831241410 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ac00b990 con 0x7fb8b40b4230 2021-12-17T18:20:49.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b9afb700 1 -- 172.21.15.62:0/3831241410 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8b40b4230 msgr2=0x7fb8b40b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:49.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.051+0000 7fb8b9afb700 1 --2- 172.21.15.62:0/3831241410 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8b40b4230 0x7fb8b40b25a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fb8ac0032f0 tx=0x7fb8ac0091d0).stop 2021-12-17T18:20:49.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.055+0000 7fb8b9afb700 1 -- 172.21.15.62:0/3831241410 shutdown_connections 2021-12-17T18:20:49.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.055+0000 7fb8b9afb700 1 --2- 172.21.15.62:0/3831241410 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8b40b4230 0x7fb8b40b25a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:49.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.055+0000 7fb8b9afb700 1 -- 172.21.15.62:0/3831241410 >> 172.21.15.62:0/3831241410 conn(0x7fb8b405bcd0 msgr2=0x7fb8b4062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:49.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.055+0000 7fb8b9afb700 1 -- 172.21.15.62:0/3831241410 shutdown_connections 2021-12-17T18:20:49.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.055+0000 7fb8b9afb700 1 -- 172.21.15.62:0/3831241410 wait complete. 2021-12-17T18:20:49.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.055+0000 7fb8b9afb700 1 Processor -- start 2021-12-17T18:20:49.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.055+0000 7fb8b9afb700 1 -- start start 2021-12-17T18:20:49.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.055+0000 7fb8b9afb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8b405ca90 0x7fb8b40a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:49.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.055+0000 7fb8b9afb700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8b40b3540 0x7fb8b41414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:49.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.055+0000 7fb8b9afb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8b40b4230 0x7fb8b4064740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:49.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.055+0000 7fb8b9afb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40637d0 con 0x7fb8b40b4230 2021-12-17T18:20:49.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.055+0000 7fb8b9afb700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b4152220 con 0x7fb8b40b3540 2021-12-17T18:20:49.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.055+0000 7fb8b9afb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b4067200 con 0x7fb8b405ca90 2021-12-17T18:20:49.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.055+0000 7fb8b92fa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8b40b4230 0x7fb8b4064740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:49.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.055+0000 7fb8b92fa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8b40b4230 0x7fb8b4064740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50298/0 (socket says 172.21.15.62:50298) 2021-12-17T18:20:49.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.055+0000 7fb8b92fa700 1 -- 172.21.15.62:0/3599018461 learned_addr learned my addr 172.21.15.62:0/3599018461 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:49.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.055+0000 7fb8b8af9700 1 --2- 172.21.15.62:0/3599018461 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8b405ca90 0x7fb8b40a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:49.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.059+0000 7fb8b3fff700 1 --2- 172.21.15.62:0/3599018461 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8b40b3540 0x7fb8b41414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:49.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.059+0000 7fb8b92fa700 1 -- 172.21.15.62:0/3599018461 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8b405ca90 msgr2=0x7fb8b40a2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:49.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.059+0000 7fb8b92fa700 1 --2- 172.21.15.62:0/3599018461 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8b405ca90 0x7fb8b40a2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:49.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.059+0000 7fb8b92fa700 1 -- 172.21.15.62:0/3599018461 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8b40b3540 msgr2=0x7fb8b41414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:49.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.059+0000 7fb8b92fa700 1 --2- 172.21.15.62:0/3599018461 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8b40b3540 0x7fb8b41414d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:49.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.059+0000 7fb8b92fa700 1 -- 172.21.15.62:0/3599018461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac009470 con 0x7fb8b40b4230 2021-12-17T18:20:49.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.059+0000 7fb8b92fa700 1 --2- 172.21.15.62:0/3599018461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8b40b4230 0x7fb8b4064740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fb8ac0032f0 tx=0x7fb8ac016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:49.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.059+0000 7fb8b1ffb700 1 -- 172.21.15.62:0/3599018461 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ac00b6c0 con 0x7fb8b40b4230 2021-12-17T18:20:49.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.059+0000 7fb8b1ffb700 1 -- 172.21.15.62:0/3599018461 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ac021670 con 0x7fb8b40b4230 2021-12-17T18:20:49.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.059+0000 7fb8b9afb700 1 -- 172.21.15.62:0/3599018461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b4063a20 con 0x7fb8b40b4230 2021-12-17T18:20:49.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.059+0000 7fb8b1ffb700 1 -- 172.21.15.62:0/3599018461 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ac0219d0 con 0x7fb8b40b4230 2021-12-17T18:20:49.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.059+0000 7fb8b9afb700 1 -- 172.21.15.62:0/3599018461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b40642e0 con 0x7fb8b40b4230 2021-12-17T18:20:49.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.059+0000 7fb8b9afb700 1 -- 172.21.15.62:0/3599018461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b4067400 con 0x7fb8b40b4230 2021-12-17T18:20:49.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.059+0000 7fb8b1ffb700 1 -- 172.21.15.62:0/3599018461 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb8ac00f070 con 0x7fb8b40b4230 2021-12-17T18:20:49.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.059+0000 7fb8b1ffb700 1 --2- 172.21.15.62:0/3599018461 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb894053580 0x7fb894055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:49.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.063+0000 7fb8b1ffb700 1 -- 172.21.15.62:0/3599018461 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb8ac06d180 con 0x7fb8b40b4230 2021-12-17T18:20:49.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.063+0000 7fb8b8af9700 1 --2- 172.21.15.62:0/3599018461 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb894053580 0x7fb894055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:49.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.063+0000 7fb8b8af9700 1 --2- 172.21.15.62:0/3599018461 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb894053580 0x7fb894055a40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fb8a800d000 tx=0x7fb8a8000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:49.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.067+0000 7fb8b1ffb700 1 -- 172.21.15.62:0/3599018461 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb8ac0441d0 con 0x7fb8b40b4230 2021-12-17T18:20:49.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.195+0000 7fb8b9afb700 1 -- 172.21.15.62:0/3599018461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8b4067030 con 0x7fb8b40b4230 2021-12-17T18:20:49.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.195+0000 7fb8b1ffb700 1 -- 172.21.15.62:0/3599018461 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb8ac015020 con 0x7fb8b40b4230 2021-12-17T18:20:49.201 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:20:49.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.199+0000 7fb8b9afb700 1 -- 172.21.15.62:0/3599018461 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb894053580 msgr2=0x7fb894055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:49.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.199+0000 7fb8b9afb700 1 --2- 172.21.15.62:0/3599018461 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb894053580 0x7fb894055a40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fb8a800d000 tx=0x7fb8a8000bc0).stop 2021-12-17T18:20:49.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.199+0000 7fb8b9afb700 1 -- 172.21.15.62:0/3599018461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8b40b4230 msgr2=0x7fb8b4064740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:49.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.199+0000 7fb8b9afb700 1 --2- 172.21.15.62:0/3599018461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8b40b4230 0x7fb8b4064740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fb8ac0032f0 tx=0x7fb8ac016000).stop 2021-12-17T18:20:49.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.199+0000 7fb8b9afb700 1 -- 172.21.15.62:0/3599018461 shutdown_connections 2021-12-17T18:20:49.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.199+0000 7fb8b9afb700 1 --2- 172.21.15.62:0/3599018461 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb894053580 0x7fb894055a40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:49.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.199+0000 7fb8b9afb700 1 --2- 172.21.15.62:0/3599018461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8b40b4230 0x7fb8b4064740 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:49.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.199+0000 7fb8b9afb700 1 --2- 172.21.15.62:0/3599018461 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8b40b3540 0x7fb8b41414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:49.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.199+0000 7fb8b9afb700 1 --2- 172.21.15.62:0/3599018461 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8b405ca90 0x7fb8b40a2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:49.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.199+0000 7fb8b9afb700 1 -- 172.21.15.62:0/3599018461 >> 172.21.15.62:0/3599018461 conn(0x7fb8b405bcd0 msgr2=0x7fb8b4062610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:49.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.199+0000 7fb8b9afb700 1 -- 172.21.15.62:0/3599018461 shutdown_connections 2021-12-17T18:20:49.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.199+0000 7fb8b9afb700 1 -- 172.21.15.62:0/3599018461 wait complete. 2021-12-17T18:20:49.218 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:20:49.218 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:20:49.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.315+0000 7f78af42d700 1 Processor -- start 2021-12-17T18:20:49.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.315+0000 7f78af42d700 1 -- start start 2021-12-17T18:20:49.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.315+0000 7f78af42d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78a80b2f10 0x7f78a80b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:49.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.315+0000 7f78af42d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a80b25c0 con 0x7f78a813d270 2021-12-17T18:20:49.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.315+0000 7f78af42d700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a80b5cd0 con 0x7f78a8067830 2021-12-17T18:20:49.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.315+0000 7f78af42d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a80ad690 con 0x7f78a80b2f10 2021-12-17T18:20:49.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78adc2a700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f78a813d270 0x7f78a80b6100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33882/0 (socket says 172.21.15.62:33882) 2021-12-17T18:20:49.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78adc2a700 1 -- 172.21.15.62:0/4123943636 learned_addr learned my addr 172.21.15.62:0/4123943636 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:20:49.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78aec2c700 1 --2- 172.21.15.62:0/4123943636 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78a80b2f10 0x7f78a80b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:49.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78ad429700 1 -- 172.21.15.62:0/4123943636 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498240158 0 0) 0x7f78a80b25c0 con 0x7f78a813d270 2021-12-17T18:20:49.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78ad429700 1 -- 172.21.15.62:0/4123943636 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7890003260 con 0x7f78a813d270 2021-12-17T18:20:49.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78aec2c700 1 -- 172.21.15.62:0/4123943636 >> v1:172.21.15.109:6789/0 conn(0x7f78a8067830 legacy=0x7f78a813cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:49.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78aec2c700 1 -- 172.21.15.62:0/4123943636 >> v1:172.21.15.62:6789/0 conn(0x7f78a813d270 legacy=0x7f78a80b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:49.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78ad429700 1 -- 172.21.15.62:0/4123943636 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234233397 0 0) 0x7f78a80b5cd0 con 0x7f78a8067830 2021-12-17T18:20:49.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78aec2c700 1 -- 172.21.15.62:0/4123943636 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a8067c10 con 0x7f78a80b2f10 2021-12-17T18:20:49.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78aec2c700 1 --2- 172.21.15.62:0/4123943636 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78a80b2f10 0x7f78a80b1250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f78a00032f0 tx=0x7f78a00091d0).ready entity=mon.2 client_cookie=7433a3ce83c1c4a1 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:49.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78ad429700 1 -- 172.21.15.62:0/4123943636 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78a000b6c0 con 0x7f78a80b2f10 2021-12-17T18:20:49.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78ad429700 1 -- 172.21.15.62:0/4123943636 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a000b820 con 0x7f78a80b2f10 2021-12-17T18:20:49.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78ad429700 1 -- 172.21.15.62:0/4123943636 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78a000b990 con 0x7f78a80b2f10 2021-12-17T18:20:49.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78af42d700 1 -- 172.21.15.62:0/4123943636 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78a80b2f10 msgr2=0x7f78a80b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:49.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78af42d700 1 --2- 172.21.15.62:0/4123943636 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78a80b2f10 0x7f78a80b1250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f78a00032f0 tx=0x7f78a00091d0).stop 2021-12-17T18:20:49.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78af42d700 1 -- 172.21.15.62:0/4123943636 shutdown_connections 2021-12-17T18:20:49.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78af42d700 1 --2- 172.21.15.62:0/4123943636 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78a80b2f10 0x7f78a80b1250 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:49.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78af42d700 1 -- 172.21.15.62:0/4123943636 >> 172.21.15.62:0/4123943636 conn(0x7f78a805c750 msgr2=0x7f78a805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:49.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78af42d700 1 -- 172.21.15.62:0/4123943636 shutdown_connections 2021-12-17T18:20:49.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78af42d700 1 -- 172.21.15.62:0/4123943636 wait complete. 2021-12-17T18:20:49.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78af42d700 1 Processor -- start 2021-12-17T18:20:49.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.319+0000 7f78af42d700 1 -- start start 2021-12-17T18:20:49.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78af42d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78a8067830 0x7f78a809eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:49.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78af42d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a80b2f10 0x7f78a8152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:49.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78af42d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f78a813d270 0x7f78a8152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:49.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78af42d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a813d830 con 0x7f78a80b2f10 2021-12-17T18:20:49.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78af42d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a81523c0 con 0x7f78a813d270 2021-12-17T18:20:49.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78af42d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a81463a0 con 0x7f78a8067830 2021-12-17T18:20:49.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78adc2a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a80b2f10 0x7f78a8152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:49.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78adc2a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a80b2f10 0x7f78a8152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50310/0 (socket says 172.21.15.62:50310) 2021-12-17T18:20:49.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78adc2a700 1 -- 172.21.15.62:0/1656817007 learned_addr learned my addr 172.21.15.62:0/1656817007 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:20:49.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78ae42b700 1 --2- 172.21.15.62:0/1656817007 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78a8067830 0x7f78a809eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:49.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78aec2c700 1 --2- 172.21.15.62:0/1656817007 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f78a813d270 0x7f78a8152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:49.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78adc2a700 1 -- 172.21.15.62:0/1656817007 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78a8067830 msgr2=0x7f78a809eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:49.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78adc2a700 1 --2- 172.21.15.62:0/1656817007 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78a8067830 0x7f78a809eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:49.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78adc2a700 1 -- 172.21.15.62:0/1656817007 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f78a813d270 msgr2=0x7f78a8152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:49.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78adc2a700 1 --2- 172.21.15.62:0/1656817007 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f78a813d270 0x7f78a8152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:49.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78adc2a700 1 -- 172.21.15.62:0/1656817007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a0009470 con 0x7f78a80b2f10 2021-12-17T18:20:49.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78ae42b700 1 --2- 172.21.15.62:0/1656817007 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78a8067830 0x7f78a809eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:20:49.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78adc2a700 1 --2- 172.21.15.62:0/1656817007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a80b2f10 0x7f78a8152860 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f789c001110 tx=0x7f789c007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:49.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f789b7fe700 1 -- 172.21.15.62:0/1656817007 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f789c00ce00 con 0x7f78a80b2f10 2021-12-17T18:20:49.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f789b7fe700 1 -- 172.21.15.62:0/1656817007 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c0070d0 con 0x7f78a80b2f10 2021-12-17T18:20:49.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78af42d700 1 -- 172.21.15.62:0/1656817007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a8153240 con 0x7f78a80b2f10 2021-12-17T18:20:49.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f789b7fe700 1 -- 172.21.15.62:0/1656817007 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f789c007430 con 0x7f78a80b2f10 2021-12-17T18:20:49.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78af42d700 1 -- 172.21.15.62:0/1656817007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a8140850 con 0x7f78a80b2f10 2021-12-17T18:20:49.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.323+0000 7f78af42d700 1 -- 172.21.15.62:0/1656817007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a8152580 con 0x7f78a80b2f10 2021-12-17T18:20:49.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.327+0000 7f789b7fe700 1 -- 172.21.15.62:0/1656817007 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f789c010070 con 0x7f78a80b2f10 2021-12-17T18:20:49.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.327+0000 7f789b7fe700 1 --2- 172.21.15.62:0/1656817007 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f78880536d0 0x7f7888055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:20:49.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.327+0000 7f789b7fe700 1 -- 172.21.15.62:0/1656817007 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f789c06ae90 con 0x7f78a80b2f10 2021-12-17T18:20:49.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.327+0000 7f78ae42b700 1 --2- 172.21.15.62:0/1656817007 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f78880536d0 0x7f7888055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:20:49.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.327+0000 7f78ae42b700 1 --2- 172.21.15.62:0/1656817007 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f78880536d0 0x7f7888055b90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f78a400d000 tx=0x7f78a4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:20:49.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.335+0000 7f789b7fe700 1 -- 172.21.15.62:0/1656817007 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f789c041ff0 con 0x7f78a80b2f10 2021-12-17T18:20:49.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.499+0000 7f78af42d700 1 -- 172.21.15.62:0/1656817007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78a8143c60 con 0x7f78a80b2f10 2021-12-17T18:20:49.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.499+0000 7f789b7fe700 1 -- 172.21.15.62:0/1656817007 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2135 (secure 0 0 0) 0x7f789c045610 con 0x7f78a80b2f10 2021-12-17T18:20:49.503 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:20:49.504 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/16961477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":16961477},{"type":"v1","addr":"172.21.15.109:6835","nonce":16961477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:20:16.801183+0000","modified":"2021-12-17T18:20:18.581684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/3317956606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3317956606},{"type":"v1","addr":"172.21.15.62:6833","nonce":3317956606}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-12-17T18:20:49.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.499+0000 7f78af42d700 1 -- 172.21.15.62:0/1656817007 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f78880536d0 msgr2=0x7f7888055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:49.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.499+0000 7f78af42d700 1 --2- 172.21.15.62:0/1656817007 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f78880536d0 0x7f7888055b90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f78a400d000 tx=0x7f78a4009040).stop 2021-12-17T18:20:49.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.499+0000 7f78af42d700 1 -- 172.21.15.62:0/1656817007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a80b2f10 msgr2=0x7f78a8152860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:20:49.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.499+0000 7f78af42d700 1 --2- 172.21.15.62:0/1656817007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a80b2f10 0x7f78a8152860 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f789c001110 tx=0x7f789c007aa0).stop 2021-12-17T18:20:49.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.499+0000 7f78af42d700 1 -- 172.21.15.62:0/1656817007 shutdown_connections 2021-12-17T18:20:49.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.499+0000 7f78af42d700 1 --2- 172.21.15.62:0/1656817007 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f78880536d0 0x7f7888055b90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:49.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.499+0000 7f78af42d700 1 --2- 172.21.15.62:0/1656817007 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f78a813d270 0x7f78a8152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:49.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.499+0000 7f78af42d700 1 --2- 172.21.15.62:0/1656817007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a80b2f10 0x7f78a8152860 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:49.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.499+0000 7f78af42d700 1 --2- 172.21.15.62:0/1656817007 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78a8067830 0x7f78a809eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:20:49.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.499+0000 7f78af42d700 1 -- 172.21.15.62:0/1656817007 >> 172.21.15.62:0/1656817007 conn(0x7f78a805c750 msgr2=0x7f78a813a840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:20:49.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.499+0000 7f78af42d700 1 -- 172.21.15.62:0/1656817007 shutdown_connections 2021-12-17T18:20:49.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:20:49.499+0000 7f78af42d700 1 -- 172.21.15.62:0/1656817007 wait complete. 2021-12-17T18:20:49.509 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2021-12-17T18:20:49.718 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:20:16.801183+0000', 'modified': '2021-12-17T18:20:18.581684+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5277}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5277': {'gid': 5277, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/3317956606', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 3317956606}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 3317956606}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:20:49.719 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:20:49.719 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:20:49.836 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":5277,"want_state":"up:active","state":"up:active","rank_uptime":33.023047874,"mdsmap_epoch":16,"osdmap_epoch":42,"osdmap_epoch_barrier":42,"uptime":37.389767644000003} 2021-12-17T18:20:49.836 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 5277, "mdsmap_epoch": 16, "osdmap_epoch": 42, "osdmap_epoch_barrier": 42, "rank_uptime": 33.023047874, "state": "up:active", "uptime": 37.389767644, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:20:49.837 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:20:49.837 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-12-17T18:20:49.838 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-12-17T18:20:49.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:49.839 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:20:49.847 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:20:49.866 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:20:49.866 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:20:49.881 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:20:49.882 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:20:49.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:49.884 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:20:49.932 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:20:49.934 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:20:49.937 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:20:49.952 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:20:49.953 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:20:50.011 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2021-12-17T18:20:50.008+0000 7f3e5e145080 -1 init, newargv = 0x555ba5e88df0 newargc=9 2021-12-17T18:20:50.011 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14130]: starting ceph client 2021-12-17T18:20:50.012 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:20:50.013 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:20:50.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:50.014 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:20:50.020 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14130]: starting fuse 2021-12-17T18:20:51.120 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:20:51.140 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:20:51.140 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:20:51.197 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:20:51.197 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:20:51.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:51.199 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:20:51.204 INFO:teuthology.orchestra.run.smithi125.stdout:52 2021-12-17T18:20:51.204 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:20:51.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:51.205 DEBUG:teuthology.orchestra.run.smithi125:> sudo python3 -c ' 2021-12-17T18:20:51.206 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2021-12-17T18:20:51.206 DEBUG:teuthology.orchestra.run.smithi125:> import re 2021-12-17T18:20:51.206 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:20:51.207 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2021-12-17T18:20:51.207 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:20:51.208 DEBUG:teuthology.orchestra.run.smithi125:> def find_socket(client_name): 2021-12-17T18:20:51.208 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-12-17T18:20:51.208 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2021-12-17T18:20:51.209 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:20:51.209 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2021-12-17T18:20:51.210 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2021-12-17T18:20:51.210 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2021-12-17T18:20:51.211 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2021-12-17T18:20:51.211 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:20:51.212 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2021-12-17T18:20:51.213 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:20:51.214 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:20:51.215 DEBUG:teuthology.orchestra.run.smithi125:> return f 2021-12-17T18:20:51.216 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:20:51.216 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:20:51.216 DEBUG:teuthology.orchestra.run.smithi125:> print(find_socket("client.0")) 2021-12-17T18:20:51.217 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:20:51.260 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.14130.asok 2021-12-17T18:20:51.265 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14130.asok 2021-12-17T18:20:51.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:51.267 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14130.asok status 2021-12-17T18:20:51.358 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2021-12-17T18:20:51.359 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2021-12-17T18:20:51.360 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:20:51.360 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:20:51.360 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2021-12-17T18:20:51.361 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2021-12-17T18:20:51.361 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-12-17T18:20:51.362 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "14130", 2021-12-17T18:20:51.362 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2021-12-17T18:20:51.363 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:20:51.363 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2021-12-17T18:20:51.364 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2021-12-17T18:20:51.364 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5538, 2021-12-17T18:20:51.364 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2021-12-17T18:20:51.365 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2021-12-17T18:20:51.365 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2021-12-17T18:20:51.366 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 5538 2021-12-17T18:20:51.366 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:20:51.367 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:20:51.367 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:20:51.368 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:20:51.368 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 2040708356 2021-12-17T18:20:51.368 INFO:teuthology.orchestra.run.smithi125.stdout: } 2021-12-17T18:20:51.369 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:20:51.369 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:20:51.370 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:20:51.370 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:20:51.371 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 2040708356 2021-12-17T18:20:51.371 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:20:51.372 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.5538 172.21.15.125:0/2040708356", 2021-12-17T18:20:51.374 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "172.21.15.125:0/2040708356", 2021-12-17T18:20:51.374 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2021-12-17T18:20:51.374 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 16, 2021-12-17T18:20:51.375 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 42, 2021-12-17T18:20:51.375 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:20:51.375 INFO:teuthology.orchestra.run.smithi125.stdout: "blacklisted": false, 2021-12-17T18:20:51.375 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2021-12-17T18:20:51.376 INFO:teuthology.orchestra.run.smithi125.stdout:} 2021-12-17T18:20:51.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:51.378 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:20:51.378 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:20:51.386 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:20:51.388 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:20:51.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:20:51.389 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:21:03.318 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:21:03.321 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:21:03.323 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:21:03.326 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:21:03.329 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:21:33.674 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:21:33.678 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:21:33.681 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:21:33.684 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:21:33.686 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:21:37.443 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:21:37.444 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:21:37.465 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:21:37.487 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:21:37.508 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:21:37.529 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:21:37.550 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:21:37.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:21:37.552 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:21:37.552 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:21:37.560 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:21:37.561 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:21:37.562 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:21:37.562 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:21:37.563 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:21:37.619 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14130]: fuse finished with error 0 and tester_r 0 2021-12-17T18:21:37.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:21:37.621 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:21:37.622 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:21:37.629 INFO:teuthology.orchestra.run.smithi125.stdout:ext2/ext3 2021-12-17T18:21:37.630 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:21:37.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:21:37.672 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:21:37.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:21:37.680 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:21:37.680 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:21:37.687 INFO:teuthology.orchestra.run.smithi158.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:21:37.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:21:37.689 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-12-17T18:21:37.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:21:37.690 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:21:37.696 INFO:teuthology.orchestra.run.smithi158.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:21:37.697 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:21:37.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:21:37.698 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:21:37.699 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:21:37.706 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:21:37.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:21:37.707 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:21:37.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:21:37.709 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:21:37.715 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:21:37.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:21:37.717 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:21:37.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f3164205700 1 Processor -- start 2021-12-17T18:21:37.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f3164205700 1 -- start start 2021-12-17T18:21:37.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f3164205700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f315c0b21f0 0x7f315c14aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:37.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f3164205700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f315c0b1730 0x7f315c0ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:37.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f3164205700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315c0b2ce0 con 0x7f315c0a7bb0 2021-12-17T18:21:37.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f3164205700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315c147870 con 0x7f315c0b1730 2021-12-17T18:21:37.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f3164205700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0b2f10 con 0x7f315c0b21f0 2021-12-17T18:21:37.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f31617a0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f315c0b1730 0x7f315c0ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:37.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f31617a0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f315c0b1730 0x7f315c0ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50320/0 (socket says 172.21.15.62:50320) 2021-12-17T18:21:37.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f31617a0700 1 -- 172.21.15.62:0/2373403392 learned_addr learned my addr 172.21.15.62:0/2373403392 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:37.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f31627a2700 1 --1- 172.21.15.62:0/2373403392 >> v1:172.21.15.62:6789/0 conn(0x7f315c0a7bb0 0x7f315c067120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33898/0 (socket says 172.21.15.62:33898) 2021-12-17T18:21:37.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f3161fa1700 1 --2- 172.21.15.62:0/2373403392 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f315c0b21f0 0x7f315c14aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:37.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f31617a0700 1 -- 172.21.15.62:0/2373403392 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f315c0b21f0 msgr2=0x7f315c14aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:37.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f31617a0700 1 --2- 172.21.15.62:0/2373403392 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f315c0b21f0 0x7f315c14aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:37.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f31617a0700 1 -- 172.21.15.62:0/2373403392 >> v1:172.21.15.62:6789/0 conn(0x7f315c0a7bb0 legacy=0x7f315c067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:37.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f31617a0700 1 -- 172.21.15.62:0/2373403392 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c0aca60 con 0x7f315c0b1730 2021-12-17T18:21:37.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f31617a0700 1 --2- 172.21.15.62:0/2373403392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f315c0b1730 0x7f315c0ace90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f31540032f0 tx=0x7f3154009290).ready entity=mon.0 client_cookie=6185e58b352c2775 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:37.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f3160f9f700 1 -- 172.21.15.62:0/2373403392 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f315400b8a0 con 0x7f315c0b1730 2021-12-17T18:21:37.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f3160f9f700 1 -- 172.21.15.62:0/2373403392 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315400ba00 con 0x7f315c0b1730 2021-12-17T18:21:37.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.828+0000 7f3160f9f700 1 -- 172.21.15.62:0/2373403392 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f315400bb70 con 0x7f315c0b1730 2021-12-17T18:21:37.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.832+0000 7f3164205700 1 -- 172.21.15.62:0/2373403392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f315c0b1730 msgr2=0x7f315c0ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:37.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.832+0000 7f3164205700 1 --2- 172.21.15.62:0/2373403392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f315c0b1730 0x7f315c0ace90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f31540032f0 tx=0x7f3154009290).stop 2021-12-17T18:21:37.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.832+0000 7f3164205700 1 -- 172.21.15.62:0/2373403392 shutdown_connections 2021-12-17T18:21:37.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.832+0000 7f3164205700 1 --2- 172.21.15.62:0/2373403392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f315c0b1730 0x7f315c0ace90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:37.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.832+0000 7f3164205700 1 --2- 172.21.15.62:0/2373403392 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f315c0b21f0 0x7f315c14aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:37.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.832+0000 7f3164205700 1 -- 172.21.15.62:0/2373403392 >> 172.21.15.62:0/2373403392 conn(0x7f315c05f730 msgr2=0x7f315c05fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:37.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.832+0000 7f3164205700 1 -- 172.21.15.62:0/2373403392 shutdown_connections 2021-12-17T18:21:37.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.832+0000 7f3164205700 1 -- 172.21.15.62:0/2373403392 wait complete. 2021-12-17T18:21:37.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.832+0000 7f3164205700 1 Processor -- start 2021-12-17T18:21:37.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.832+0000 7f3164205700 1 -- start start 2021-12-17T18:21:37.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.832+0000 7f3164205700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f315c0a7bb0 0x7f315c0aab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:37.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.832+0000 7f3164205700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f315c0b1730 0x7f315c1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:37.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.832+0000 7f3164205700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f315c0b21f0 0x7f315c14d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:37.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.832+0000 7f3164205700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c14cd40 con 0x7f315c0a7bb0 2021-12-17T18:21:37.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.832+0000 7f3164205700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c156dd0 con 0x7f315c0b1730 2021-12-17T18:21:37.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.832+0000 7f3164205700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c157000 con 0x7f315c0b21f0 2021-12-17T18:21:37.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f3161fa1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f315c0a7bb0 0x7f315c0aab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:37.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f3161fa1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f315c0a7bb0 0x7f315c0aab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50322/0 (socket says 172.21.15.62:50322) 2021-12-17T18:21:37.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f3161fa1700 1 -- 172.21.15.62:0/428925721 learned_addr learned my addr 172.21.15.62:0/428925721 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:37.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f31627a2700 1 --2- 172.21.15.62:0/428925721 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f315c0b21f0 0x7f315c14d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:37.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f31617a0700 1 --2- 172.21.15.62:0/428925721 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f315c0b1730 0x7f315c1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:37.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f3161fa1700 1 -- 172.21.15.62:0/428925721 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f315c0b21f0 msgr2=0x7f315c14d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:37.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f3161fa1700 1 --2- 172.21.15.62:0/428925721 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f315c0b21f0 0x7f315c14d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:37.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f3161fa1700 1 -- 172.21.15.62:0/428925721 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f315c0b1730 msgr2=0x7f315c1579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:37.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f3161fa1700 1 --2- 172.21.15.62:0/428925721 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f315c0b1730 0x7f315c1579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:37.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f3161fa1700 1 -- 172.21.15.62:0/428925721 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3154009530 con 0x7f315c0a7bb0 2021-12-17T18:21:37.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f31617a0700 1 --2- 172.21.15.62:0/428925721 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f315c0b1730 0x7f315c1579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:21:37.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f3161fa1700 1 --2- 172.21.15.62:0/428925721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f315c0a7bb0 0x7f315c0aab80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f315800c000 tx=0x7f3158006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:37.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f3152ffd700 1 -- 172.21.15.62:0/428925721 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3158010780 con 0x7f315c0a7bb0 2021-12-17T18:21:37.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f3164205700 1 -- 172.21.15.62:0/428925721 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315c1572a0 con 0x7f315c0a7bb0 2021-12-17T18:21:37.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f3152ffd700 1 -- 172.21.15.62:0/428925721 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31580108e0 con 0x7f315c0a7bb0 2021-12-17T18:21:37.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f3152ffd700 1 -- 172.21.15.62:0/428925721 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3158010c40 con 0x7f315c0a7bb0 2021-12-17T18:21:37.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f3164205700 1 -- 172.21.15.62:0/428925721 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c157f50 con 0x7f315c0a7bb0 2021-12-17T18:21:37.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f3164205700 1 -- 172.21.15.62:0/428925721 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315c0573d0 con 0x7f315c0a7bb0 2021-12-17T18:21:37.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.836+0000 7f3152ffd700 1 -- 172.21.15.62:0/428925721 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f315801c460 con 0x7f315c0a7bb0 2021-12-17T18:21:37.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.840+0000 7f3152ffd700 1 --2- 172.21.15.62:0/428925721 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f313c053610 0x7f313c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:37.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.840+0000 7f3152ffd700 1 -- 172.21.15.62:0/428925721 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f315806c900 con 0x7f315c0a7bb0 2021-12-17T18:21:37.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.840+0000 7f31617a0700 1 --2- 172.21.15.62:0/428925721 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f313c053610 0x7f313c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:37.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.840+0000 7f31617a0700 1 --2- 172.21.15.62:0/428925721 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f313c053610 0x7f313c055ad0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f3154019000 tx=0x7f3154016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:37.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.848+0000 7f3152ffd700 1 -- 172.21.15.62:0/428925721 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f31580438f0 con 0x7f315c0a7bb0 2021-12-17T18:21:37.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.972+0000 7f3164205700 1 -- 172.21.15.62:0/428925721 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f315c06a2b0 con 0x7f315c0a7bb0 2021-12-17T18:21:37.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.976+0000 7f3152ffd700 1 -- 172.21.15.62:0/428925721 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v42) v1 ==== 81+0+33693 (secure 0 0 0) 0x7f3158046f10 con 0x7f315c0a7bb0 2021-12-17T18:21:37.979 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:21:37.979 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:21:37.979 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 42, 2021-12-17T18:21:37.980 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:21:37.980 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:21:37.980 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:20:17.803894+0000", 2021-12-17T18:21:37.980 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:21:37.980 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:21:37.981 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:21:37.981 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:21:37.981 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:21:37.981 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:21:37.982 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:21:37.982 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:21:37.982 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:21:37.982 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:21:37.982 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:21:37.983 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:21:37.983 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:21:37.983 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:21:37.983 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:21:37.984 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 8, 2021-12-17T18:21:37.984 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:21:37.984 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:21:37.985 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:21:37.985 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:21:37.985 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:21:37.985 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:37.986 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:21:37.986 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:21:37.986 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:21:37.986 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:21:37.986 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:21:37.987 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:21:37.987 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:21:37.987 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:21:37.987 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:21:37.988 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:21:37.988 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:21:37.988 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:21:37.988 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:21:37.988 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:21:37.989 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:21:37.989 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:21:37.989 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:21:37.989 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:21:37.990 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:21:37.990 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:21:37.990 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:21:37.990 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:21:37.990 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:21:37.991 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:37.991 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:21:37.991 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:21:37.991 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:21:37.992 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:21:37.992 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:21:37.992 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:21:37.992 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:21:37.992 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:21:37.993 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:21:37.993 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:21:37.993 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:21:37.993 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:21:37.993 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:21:37.994 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:21:37.994 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:21:37.994 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:21:37.994 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:21:37.995 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:21:37.995 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:21:37.995 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:21:37.995 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:21:37.995 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:21:37.996 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:21:37.996 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:21:37.996 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:21:37.996 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:21:37.997 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:21:37.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:37.997 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:21:37.997 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:21:37.997 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:21:37.998 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:21:37.998 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:21:37.998 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:21:37.998 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:21:37.999 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:21:37.999 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:21:37.999 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:21:37.999 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:21:37.999 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:21:38.000 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:21:38.000 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.000 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:21:38.000 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:21:38.001 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.001 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.001 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.001 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:21:38.001 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:21:38.002 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:21:38.002 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:21:38.002 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:21:38.002 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:21:38.003 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:21:38.003 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:21:38.003 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:21:38.003 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:21:38.003 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:21:38.004 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:21:38.004 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:21:38.004 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:21:38.004 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:21:38.005 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:21:38.005 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:21:38.005 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:21:38.005 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:21:38.005 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:21:38.006 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:21:38.006 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:21:38.006 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:21:38.006 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.007 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:21:38.007 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:21:38.007 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:21:38.007 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:21:38.007 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:21:38.008 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:21:38.008 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:21:38.008 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:21:38.008 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:21:38.009 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:21:38.009 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:21:38.009 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:21:38.009 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:21:38.009 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:21:38.010 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:21:38.010 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:21:38.010 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:21:38.010 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:21:38.011 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:21:38.011 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:21:38.011 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:21:38.011 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:21:38.011 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:21:38.012 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:21:38.012 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:21:38.012 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:21:38.012 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:21:38.012 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.013 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:21:38.013 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:21:38.013 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:21:38.013 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:21:38.014 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:21:38.014 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:21:38.014 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:21:38.014 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:21:38.015 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:21:38.015 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:21:38.015 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:21:38.015 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:21:38.015 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:21:38.016 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:21:38.016 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.016 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.016 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.016 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 7, 2021-12-17T18:21:38.017 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2021-12-17T18:21:38.017 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:20:15.333250+0000", 2021-12-17T18:21:38.017 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:21:38.017 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:21:38.018 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:21:38.018 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:21:38.018 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:21:38.018 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:21:38.018 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:21:38.019 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:21:38.019 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:21:38.019 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:21:38.019 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:21:38.020 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:21:38.020 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:21:38.020 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:21:38.020 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:21:38.021 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:21:38.021 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:21:38.021 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:21:38.021 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:21:38.021 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:21:38.022 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.022 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "42", 2021-12-17T18:21:38.022 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:21:38.022 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:21:38.022 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:21:38.023 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:21:38.023 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:21:38.023 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:21:38.023 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:21:38.024 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:21:38.024 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:21:38.024 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:21:38.024 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:21:38.024 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:21:38.025 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:21:38.025 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:21:38.025 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:21:38.025 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:21:38.026 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:21:38.026 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:21:38.026 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:21:38.026 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:21:38.026 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:21:38.027 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:21:38.027 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:21:38.027 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:21:38.027 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:21:38.028 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:21:38.028 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.028 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:21:38.028 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:21:38.028 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:21:38.029 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:21:38.029 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:21:38.029 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:21:38.030 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:21:38.030 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:21:38.030 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:21:38.030 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:21:38.031 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:21:38.031 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:21:38.031 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2021-12-17T18:21:38.031 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2021-12-17T18:21:38.031 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2021-12-17T18:21:38.032 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.032 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:21:38.032 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:21:38.032 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2021-12-17T18:21:38.033 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.033 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.033 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.033 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.034 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 8, 2021-12-17T18:21:38.034 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2021-12-17T18:21:38.034 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:20:16.462772+0000", 2021-12-17T18:21:38.034 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:21:38.034 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:21:38.035 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:21:38.035 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:21:38.035 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:21:38.035 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:21:38.036 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:21:38.036 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:21:38.036 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:21:38.036 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:21:38.036 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:21:38.037 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:21:38.037 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:21:38.037 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:21:38.037 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:21:38.038 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:21:38.038 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:21:38.038 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:21:38.038 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:21:38.038 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:21:38.039 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.039 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "42", 2021-12-17T18:21:38.039 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:21:38.039 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:21:38.040 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:21:38.040 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:21:38.040 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:21:38.040 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:21:38.040 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:21:38.041 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:21:38.041 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:21:38.041 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:21:38.041 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:21:38.042 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:21:38.042 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:21:38.042 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:21:38.042 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:21:38.042 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:21:38.043 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:21:38.043 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:21:38.043 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:21:38.043 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:21:38.044 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:21:38.044 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:21:38.044 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:21:38.044 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:21:38.044 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:21:38.045 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:21:38.045 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.045 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:21:38.045 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:21:38.046 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:21:38.046 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:21:38.046 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:21:38.046 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:21:38.047 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:21:38.047 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:21:38.047 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:21:38.047 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:21:38.047 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:21:38.048 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:21:38.048 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:21:38.048 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:21:38.048 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2021-12-17T18:21:38.049 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.049 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.049 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.049 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:21:38.049 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:21:38.050 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.050 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:21:38.050 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:21:38.050 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:21:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:21:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:21:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:21:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:21:38.051 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:21:38.052 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:21:38.052 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 40, 2021-12-17T18:21:38.052 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:21:38.052 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:21:38.053 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:21:38.053 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.053 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.053 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.053 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:21:38.054 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:21:38.054 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.054 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.054 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.055 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:21:38.055 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:21:38.055 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.055 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.055 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.056 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:21:38.056 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.056 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.056 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.056 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:21:38.057 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:21:38.057 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.057 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.057 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.058 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:21:38.058 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:21:38.058 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.058 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.059 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:21:38.059 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.059 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.059 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.060 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:21:38.060 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:21:38.060 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.060 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.060 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.061 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:21:38.061 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:21:38.061 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.061 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.062 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.062 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:21:38.062 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.062 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.062 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.063 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:21:38.063 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:21:38.063 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.063 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.064 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.064 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:21:38.064 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:21:38.064 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.064 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.065 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:21:38.065 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:21:38.065 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:21:38.066 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:21:38.066 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:21:38.066 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:21:38.066 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:21:38.066 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.067 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.067 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.067 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:21:38.067 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:21:38.067 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:21:38.068 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:21:38.068 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:21:38.068 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:21:38.068 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:21:38.069 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:21:38.069 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:21:38.069 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 40, 2021-12-17T18:21:38.069 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:21:38.069 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:21:38.070 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:21:38.070 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.070 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.070 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:21:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:21:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.071 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.072 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:21:38.072 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:21:38.072 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.072 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:21:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.073 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:21:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:21:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.074 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.075 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.075 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:21:38.075 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:21:38.075 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.075 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.076 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.076 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:21:38.076 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.076 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.077 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.077 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:21:38.077 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:21:38.077 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.077 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.078 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.078 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:21:38.078 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:21:38.078 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.078 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.079 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.079 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:21:38.079 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.079 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.080 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.080 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:21:38.080 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:21:38.080 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.080 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.081 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.081 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:21:38.081 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:21:38.081 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.081 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.082 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.082 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:21:38.082 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:21:38.082 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:21:38.083 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:21:38.083 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:21:38.083 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:21:38.083 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:21:38.083 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.084 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.084 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.084 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:21:38.084 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:21:38.085 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:21:38.085 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:21:38.085 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:21:38.085 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:21:38.085 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:21:38.086 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:21:38.086 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:21:38.086 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 30, 2021-12-17T18:21:38.086 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:21:38.086 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:21:38.087 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:21:38.087 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.087 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.087 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.088 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:21:38.088 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:21:38.088 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.088 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.088 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.089 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:21:38.089 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:21:38.089 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.089 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.090 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.090 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:21:38.090 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.090 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.090 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.091 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:21:38.091 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:21:38.091 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.091 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.091 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.092 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:21:38.092 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:21:38.092 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.092 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.093 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.093 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:21:38.093 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.093 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.093 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.094 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:21:38.094 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:21:38.094 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.094 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.095 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.095 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:21:38.095 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:21:38.095 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.095 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.096 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.096 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:21:38.096 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.096 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.097 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.097 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:21:38.097 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:21:38.097 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.097 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.098 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.098 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:21:38.098 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:21:38.098 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.099 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.099 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.099 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:21:38.099 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:21:38.100 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:21:38.100 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:21:38.100 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:21:38.100 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:21:38.100 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:21:38.101 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.101 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.101 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.101 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:21:38.102 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:21:38.102 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:21:38.102 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:21:38.102 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:21:38.102 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:21:38.103 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:21:38.103 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:21:38.103 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:21:38.103 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 40, 2021-12-17T18:21:38.103 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:21:38.104 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:21:38.104 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:21:38.104 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.104 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.105 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.105 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:21:38.105 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:21:38.105 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.105 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.106 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.106 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:21:38.106 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:21:38.106 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.107 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.107 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.107 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:21:38.107 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.107 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.108 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.108 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:21:38.108 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:21:38.108 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.108 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.109 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.109 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:21:38.109 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:21:38.109 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.110 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.110 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.110 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:21:38.110 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.110 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.111 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.111 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:21:38.111 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:21:38.111 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.112 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.112 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.112 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:21:38.112 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:21:38.112 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.113 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.113 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.113 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:21:38.113 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.113 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.114 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.114 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:21:38.114 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:21:38.114 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.115 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.115 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.115 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:21:38.115 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:21:38.115 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.116 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.116 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.116 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:21:38.116 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:21:38.116 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:21:38.117 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:21:38.117 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:21:38.117 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:21:38.117 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:21:38.118 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.118 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.118 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.118 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:21:38.118 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:21:38.119 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:21:38.119 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:21:38.119 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:21:38.119 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:21:38.120 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:21:38.120 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:21:38.120 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:21:38.120 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 40, 2021-12-17T18:21:38.120 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:21:38.121 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:21:38.121 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:21:38.121 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.121 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.121 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.122 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:21:38.122 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:21:38.122 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.122 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.123 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.123 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:21:38.123 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:21:38.123 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.123 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.124 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.124 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:21:38.124 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.124 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.125 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.125 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:21:38.125 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:21:38.125 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.125 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.126 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.126 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:21:38.126 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:21:38.126 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.127 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.127 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.127 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:21:38.127 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.127 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.128 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.128 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:21:38.128 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:21:38.128 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.129 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.129 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.129 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:21:38.129 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:21:38.129 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.130 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.130 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.130 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:21:38.130 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.131 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.131 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.131 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:21:38.131 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:21:38.131 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.132 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.132 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.132 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:21:38.132 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:21:38.133 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.133 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.133 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.134 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:21:38.134 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:21:38.134 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:21:38.134 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:21:38.135 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:21:38.135 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:21:38.135 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:21:38.136 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.136 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.136 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.136 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:21:38.137 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:21:38.137 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:21:38.137 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:21:38.138 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:21:38.138 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:21:38.138 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:21:38.139 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:21:38.139 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:21:38.139 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 40, 2021-12-17T18:21:38.140 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:21:38.140 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:21:38.140 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:21:38.141 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.141 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.141 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.141 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:21:38.142 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:21:38.142 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.142 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.143 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.143 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:21:38.143 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:21:38.143 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.144 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.144 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.144 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:21:38.144 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.145 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.145 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.145 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:21:38.145 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:21:38.145 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.146 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.146 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.146 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:21:38.146 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:21:38.147 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.147 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.147 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.147 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:21:38.147 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.148 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.148 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.148 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:21:38.148 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:21:38.149 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.149 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.149 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.150 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:21:38.150 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:21:38.150 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.150 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.151 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.151 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:21:38.151 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.152 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.152 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.152 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:21:38.153 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:21:38.153 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.153 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.153 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.154 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:21:38.154 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:21:38.154 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.154 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.155 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.155 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:21:38.155 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:21:38.155 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:21:38.155 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:21:38.156 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:21:38.156 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:21:38.156 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:21:38.156 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.157 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.157 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.157 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:21:38.157 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:21:38.157 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:21:38.158 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:21:38.158 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:21:38.158 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:21:38.158 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:21:38.158 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:21:38.159 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:21:38.159 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 40, 2021-12-17T18:21:38.159 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:21:38.160 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:21:38.160 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:21:38.160 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.161 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.161 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.161 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:21:38.161 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:21:38.162 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.162 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.162 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.162 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:21:38.162 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:21:38.163 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.163 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.163 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.163 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:21:38.164 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.164 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.164 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.164 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:21:38.165 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:21:38.165 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.165 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.165 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.165 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:21:38.166 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:21:38.166 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.166 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.166 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:21:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:21:38.168 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:21:38.168 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.168 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.168 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:21:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:21:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:21:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:21:38.171 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:21:38.171 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.171 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.171 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.172 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:21:38.172 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:21:38.172 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.172 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.172 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.173 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:21:38.173 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:21:38.173 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:21:38.173 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:21:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:21:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:21:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:21:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.175 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.175 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:21:38.175 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:21:38.175 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:21:38.176 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:21:38.176 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:21:38.176 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:21:38.176 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:21:38.176 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:21:38.177 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:21:38.177 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 39, 2021-12-17T18:21:38.177 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:21:38.177 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:21:38.178 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:21:38.178 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.178 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.179 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.179 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:21:38.179 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:21:38.179 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:21:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:21:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.181 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.181 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.181 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:21:38.181 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:21:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:21:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:21:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:21:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.184 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.184 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.184 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:21:38.184 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:21:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:21:38.186 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.186 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.186 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.186 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:21:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:21:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:21:38.188 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:38.188 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.188 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:38.188 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:21:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:21:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:21:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:21:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:21:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:21:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:21:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:21:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:21:38.192 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:21:38.192 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:21:38.192 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:38.192 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:21:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:21:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:21:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:21:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:21:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:21:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:21:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:21:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:21:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:21:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.196 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:21:38.196 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:21:38.196 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:21:38.196 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:21:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:21:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:21:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:21:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:21:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:21:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:21:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:21:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:21:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:21:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:21:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:21:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:21:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:21:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:21:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:21:38.201 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:21:38.201 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:21:38.201 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:21:38.201 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:21:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:21:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:21:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:21:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:21:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:21:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:21:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:21:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:21:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:21:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:21:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:21:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:21:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:21:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:21:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:21:38.206 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:21:38.206 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:21:38.206 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.206 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:21:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:21:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:21:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:21:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:21:38.208 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:21:38.208 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:21:38.208 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:21:38.208 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:21:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:21:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:21:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:21:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:21:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:21:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:21:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:21:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:21:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:21:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:21:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:21:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:21:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": {}, 2021-12-17T18:21:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:21:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:21:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:21:38.213 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:21:38.213 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:21:38.213 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:21:38.213 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:21:38.213 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:21:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:21:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:21:38.215 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:21:38.215 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:21:38.215 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:21:38.215 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:21:38.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.980+0000 7f3164205700 1 -- 172.21.15.62:0/428925721 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f313c053610 msgr2=0x7f313c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:38.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.980+0000 7f3164205700 1 --2- 172.21.15.62:0/428925721 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f313c053610 0x7f313c055ad0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f3154019000 tx=0x7f3154016000).stop 2021-12-17T18:21:38.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.980+0000 7f3164205700 1 -- 172.21.15.62:0/428925721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f315c0a7bb0 msgr2=0x7f315c0aab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:38.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.980+0000 7f3164205700 1 --2- 172.21.15.62:0/428925721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f315c0a7bb0 0x7f315c0aab80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f315800c000 tx=0x7f3158006df0).stop 2021-12-17T18:21:38.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.980+0000 7f3164205700 1 -- 172.21.15.62:0/428925721 shutdown_connections 2021-12-17T18:21:38.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.980+0000 7f3164205700 1 --2- 172.21.15.62:0/428925721 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f313c053610 0x7f313c055ad0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:38.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.980+0000 7f3164205700 1 --2- 172.21.15.62:0/428925721 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f315c0b21f0 0x7f315c14d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:38.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.980+0000 7f3164205700 1 --2- 172.21.15.62:0/428925721 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f315c0b1730 0x7f315c1579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:38.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.980+0000 7f3164205700 1 --2- 172.21.15.62:0/428925721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f315c0a7bb0 0x7f315c0aab80 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:38.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.980+0000 7f3164205700 1 -- 172.21.15.62:0/428925721 >> 172.21.15.62:0/428925721 conn(0x7f315c05f730 msgr2=0x7f315c0afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:38.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.980+0000 7f3164205700 1 -- 172.21.15.62:0/428925721 shutdown_connections 2021-12-17T18:21:38.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:37.980+0000 7f3164205700 1 -- 172.21.15.62:0/428925721 wait complete. 2021-12-17T18:21:38.221 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:21:38.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e7ae84700 1 Processor -- start 2021-12-17T18:21:38.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e7ae84700 1 -- start start 2021-12-17T18:21:38.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e7ae84700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f4e740b3760 0x7f4e740b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:38.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e7ae84700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e740b5f00 con 0x7f4e740b5b20 2021-12-17T18:21:38.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e7ae84700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e740b3020 con 0x7f4e741458d0 2021-12-17T18:21:38.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e7ae84700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e740b32c0 con 0x7f4e740b3760 2021-12-17T18:21:38.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e79e82700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4e740b5b20 0x7f4e740b6290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33910/0 (socket says 172.21.15.62:33910) 2021-12-17T18:21:38.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e79e82700 1 -- 172.21.15.62:0/2241840921 learned_addr learned my addr 172.21.15.62:0/2241840921 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:38.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e79681700 1 --2- 172.21.15.62:0/2241840921 >> v2:172.21.15.109:3300/0 conn(0x7f4e740b3760 0x7f4e740b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:38.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e78e80700 1 -- 172.21.15.62:0/2241840921 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431411218 0 0) 0x7f4e740b5f00 con 0x7f4e740b5b20 2021-12-17T18:21:38.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e78e80700 1 -- 172.21.15.62:0/2241840921 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e60003260 con 0x7f4e740b5b20 2021-12-17T18:21:38.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e78e80700 1 -- 172.21.15.62:0/2241840921 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656979252 0 0) 0x7f4e740b3020 con 0x7f4e741458d0 2021-12-17T18:21:38.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e78e80700 1 -- 172.21.15.62:0/2241840921 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e740b5f00 con 0x7f4e741458d0 2021-12-17T18:21:38.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e78e80700 1 -- 172.21.15.62:0/2241840921 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3494798527 0 0) 0x7f4e60003260 con 0x7f4e740b5b20 2021-12-17T18:21:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e79681700 1 -- 172.21.15.62:0/2241840921 >> v1:172.21.15.109:6789/0 conn(0x7f4e741458d0 legacy=0x7f4e74145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e79681700 1 -- 172.21.15.62:0/2241840921 >> v1:172.21.15.62:6789/0 conn(0x7f4e740b5b20 legacy=0x7f4e740b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e79681700 1 -- 172.21.15.62:0/2241840921 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e740b6e90 con 0x7f4e740b3760 2021-12-17T18:21:38.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e79681700 1 --2- 172.21.15.62:0/2241840921 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e740b3760 0x7f4e740b69a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f4e64001490 tx=0x7f4e68006df0).ready entity=mon.1 client_cookie=6154f3bb1b48d123 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:38.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.332+0000 7f4e78e80700 1 -- 172.21.15.62:0/2241840921 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e640019e0 con 0x7f4e740b3760 2021-12-17T18:21:38.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e78e80700 1 -- 172.21.15.62:0/2241840921 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e68000e90 con 0x7f4e740b3760 2021-12-17T18:21:38.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e78e80700 1 -- 172.21.15.62:0/2241840921 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e68012460 con 0x7f4e740b3760 2021-12-17T18:21:38.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7ae84700 1 -- 172.21.15.62:0/2241840921 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e740b3760 msgr2=0x7f4e740b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:38.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7ae84700 1 --2- 172.21.15.62:0/2241840921 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e740b3760 0x7f4e740b69a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f4e64001490 tx=0x7f4e68006df0).stop 2021-12-17T18:21:38.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7ae84700 1 -- 172.21.15.62:0/2241840921 shutdown_connections 2021-12-17T18:21:38.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7ae84700 1 --2- 172.21.15.62:0/2241840921 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e740b3760 0x7f4e740b69a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:38.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7ae84700 1 -- 172.21.15.62:0/2241840921 >> 172.21.15.62:0/2241840921 conn(0x7f4e7405c750 msgr2=0x7f4e7405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:38.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7ae84700 1 -- 172.21.15.62:0/2241840921 shutdown_connections 2021-12-17T18:21:38.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7ae84700 1 -- 172.21.15.62:0/2241840921 wait complete. 2021-12-17T18:21:38.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7ae84700 1 Processor -- start 2021-12-17T18:21:38.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7ae84700 1 -- start start 2021-12-17T18:21:38.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7ae84700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e740b5b20 0x7f4e740b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:38.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7ae84700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e741458d0 0x7f4e74063940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:38.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7ae84700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e74064770 0x7f4e74152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:38.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7ae84700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e741477f0 con 0x7f4e74064770 2021-12-17T18:21:38.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7ae84700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e74063200 con 0x7f4e740b5b20 2021-12-17T18:21:38.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7ae84700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e740634a0 con 0x7f4e741458d0 2021-12-17T18:21:38.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7a683700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e74064770 0x7f4e74152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:38.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7a683700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e74064770 0x7f4e74152320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50340/0 (socket says 172.21.15.62:50340) 2021-12-17T18:21:38.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e79e82700 1 --2- 172.21.15.62:0/1007926704 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e740b5b20 0x7f4e740b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:38.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7a683700 1 -- 172.21.15.62:0/1007926704 learned_addr learned my addr 172.21.15.62:0/1007926704 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:38.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e79681700 1 --2- 172.21.15.62:0/1007926704 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e741458d0 0x7f4e74063940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:38.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7a683700 1 -- 172.21.15.62:0/1007926704 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e741458d0 msgr2=0x7f4e74063940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:38.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7a683700 1 --2- 172.21.15.62:0/1007926704 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e741458d0 0x7f4e74063940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:38.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7a683700 1 -- 172.21.15.62:0/1007926704 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e740b5b20 msgr2=0x7f4e740b8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:38.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7a683700 1 --2- 172.21.15.62:0/1007926704 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e740b5b20 0x7f4e740b8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:38.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.336+0000 7f4e7a683700 1 -- 172.21.15.62:0/1007926704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6800b180 con 0x7f4e74064770 2021-12-17T18:21:38.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.340+0000 7f4e7a683700 1 --2- 172.21.15.62:0/1007926704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e74064770 0x7f4e74152320 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f4e6c001110 tx=0x7f4e6c007a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:38.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.340+0000 7f4e72ffd700 1 -- 172.21.15.62:0/1007926704 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e6c00cd80 con 0x7f4e74064770 2021-12-17T18:21:38.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.340+0000 7f4e72ffd700 1 -- 172.21.15.62:0/1007926704 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6c012400 con 0x7f4e74064770 2021-12-17T18:21:38.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.340+0000 7f4e7ae84700 1 -- 172.21.15.62:0/1007926704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e74063e30 con 0x7f4e74064770 2021-12-17T18:21:38.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.340+0000 7f4e72ffd700 1 -- 172.21.15.62:0/1007926704 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e6c012760 con 0x7f4e74064770 2021-12-17T18:21:38.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.340+0000 7f4e7ae84700 1 -- 172.21.15.62:0/1007926704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e740b9420 con 0x7f4e74064770 2021-12-17T18:21:38.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.340+0000 7f4e7ae84700 1 -- 172.21.15.62:0/1007926704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e74063660 con 0x7f4e74064770 2021-12-17T18:21:38.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.340+0000 7f4e72ffd700 1 -- 172.21.15.62:0/1007926704 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4e6c019030 con 0x7f4e74064770 2021-12-17T18:21:38.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.340+0000 7f4e72ffd700 1 --2- 172.21.15.62:0/1007926704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4e54053610 0x7f4e54055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:38.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.340+0000 7f4e72ffd700 1 -- 172.21.15.62:0/1007926704 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4e6c06aae0 con 0x7f4e74064770 2021-12-17T18:21:38.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.340+0000 7f4e79e82700 1 --2- 172.21.15.62:0/1007926704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4e54053610 0x7f4e54055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:38.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.340+0000 7f4e79e82700 1 --2- 172.21.15.62:0/1007926704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4e54053610 0x7f4e54055ad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f4e6400d000 tx=0x7f4e64000f40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:38.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.344+0000 7f4e72ffd700 1 -- 172.21.15.62:0/1007926704 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4e6c041c40 con 0x7f4e74064770 2021-12-17T18:21:38.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.508+0000 7f4e7ae84700 1 -- 172.21.15.62:0/1007926704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e74146c90 con 0x7f4e74064770 2021-12-17T18:21:38.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.508+0000 7f4e72ffd700 1 -- 172.21.15.62:0/1007926704 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2135 (secure 0 0 0) 0x7f4e6c06a020 con 0x7f4e74064770 2021-12-17T18:21:38.512 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:21:38.512 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/16961477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":16961477},{"type":"v1","addr":"172.21.15.109:6835","nonce":16961477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:20:16.801183+0000","modified":"2021-12-17T18:20:18.581684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/3317956606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3317956606},{"type":"v1","addr":"172.21.15.62:6833","nonce":3317956606}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-12-17T18:21:38.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.512+0000 7f4e7ae84700 1 -- 172.21.15.62:0/1007926704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4e54053610 msgr2=0x7f4e54055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:38.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.512+0000 7f4e7ae84700 1 --2- 172.21.15.62:0/1007926704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4e54053610 0x7f4e54055ad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f4e6400d000 tx=0x7f4e64000f40).stop 2021-12-17T18:21:38.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.512+0000 7f4e7ae84700 1 -- 172.21.15.62:0/1007926704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e74064770 msgr2=0x7f4e74152320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:38.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.512+0000 7f4e7ae84700 1 --2- 172.21.15.62:0/1007926704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e74064770 0x7f4e74152320 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f4e6c001110 tx=0x7f4e6c007a50).stop 2021-12-17T18:21:38.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.512+0000 7f4e7ae84700 1 -- 172.21.15.62:0/1007926704 shutdown_connections 2021-12-17T18:21:38.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.512+0000 7f4e7ae84700 1 --2- 172.21.15.62:0/1007926704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4e54053610 0x7f4e54055ad0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:38.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.512+0000 7f4e7ae84700 1 --2- 172.21.15.62:0/1007926704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e74064770 0x7f4e74152320 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:38.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.512+0000 7f4e7ae84700 1 --2- 172.21.15.62:0/1007926704 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4e741458d0 0x7f4e74063940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:38.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.512+0000 7f4e7ae84700 1 --2- 172.21.15.62:0/1007926704 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4e740b5b20 0x7f4e740b8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:38.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.512+0000 7f4e7ae84700 1 -- 172.21.15.62:0/1007926704 >> 172.21.15.62:0/1007926704 conn(0x7f4e7405c750 msgr2=0x7f4e7405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:38.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.512+0000 7f4e7ae84700 1 -- 172.21.15.62:0/1007926704 shutdown_connections 2021-12-17T18:21:38.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.512+0000 7f4e7ae84700 1 -- 172.21.15.62:0/1007926704 wait complete. 2021-12-17T18:21:38.517 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2021-12-17T18:21:38.524 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-12-17T18:21:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.620+0000 7f63f70f0700 1 Processor -- start 2021-12-17T18:21:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.620+0000 7f63f70f0700 1 -- start start 2021-12-17T18:21:38.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f70f0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63f013ce80 0x7f63f0142f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:38.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f70f0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f63f01433f0 0x7f63f0143840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:38.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f70f0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f0146e30 con 0x7f63f0062620 2021-12-17T18:21:38.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f70f0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f0062a00 con 0x7f63f01433f0 2021-12-17T18:21:38.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f70f0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f00b59e0 con 0x7f63f013ce80 2021-12-17T18:21:38.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f60ee700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f63f0062620 0x7f63f013c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33924/0 (socket says 172.21.15.62:33924) 2021-12-17T18:21:38.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f60ee700 1 -- 172.21.15.62:0/30460279 learned_addr learned my addr 172.21.15.62:0/30460279 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:38.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f68ef700 1 --2- 172.21.15.62:0/30460279 >> v2:172.21.15.62:3300/0 conn(0x7f63f01433f0 0x7f63f0143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:38.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f58ed700 1 --2- 172.21.15.62:0/30460279 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63f013ce80 0x7f63f0142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:38.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f68ef700 1 -- 172.21.15.62:0/30460279 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63f013ce80 msgr2=0x7f63f0142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:38.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f68ef700 1 --2- 172.21.15.62:0/30460279 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63f013ce80 0x7f63f0142f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:38.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f68ef700 1 -- 172.21.15.62:0/30460279 >> v1:172.21.15.62:6789/0 conn(0x7f63f0062620 legacy=0x7f63f013c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:38.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f68ef700 1 -- 172.21.15.62:0/30460279 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f0143d30 con 0x7f63f01433f0 2021-12-17T18:21:38.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f50ec700 1 -- 172.21.15.62:0/30460279 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423058449 0 0) 0x7f63f0146e30 con 0x7f63f0062620 2021-12-17T18:21:38.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f58ed700 1 --2- 172.21.15.62:0/30460279 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63f013ce80 0x7f63f0142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:21:38.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f68ef700 1 --2- 172.21.15.62:0/30460279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63f01433f0 0x7f63f0143840 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f63e80032f0 tx=0x7f63e80091d0).ready entity=mon.0 client_cookie=b54aa57e9a465937 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:38.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f50ec700 1 -- 172.21.15.62:0/30460279 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e8009ea0 con 0x7f63f01433f0 2021-12-17T18:21:38.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f50ec700 1 -- 172.21.15.62:0/30460279 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e800b8a0 con 0x7f63f01433f0 2021-12-17T18:21:38.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f50ec700 1 -- 172.21.15.62:0/30460279 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e800ba10 con 0x7f63f01433f0 2021-12-17T18:21:38.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f70f0700 1 -- 172.21.15.62:0/30460279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63f01433f0 msgr2=0x7f63f0143840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:38.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f70f0700 1 --2- 172.21.15.62:0/30460279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63f01433f0 0x7f63f0143840 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f63e80032f0 tx=0x7f63e80091d0).stop 2021-12-17T18:21:38.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f70f0700 1 -- 172.21.15.62:0/30460279 shutdown_connections 2021-12-17T18:21:38.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f70f0700 1 --2- 172.21.15.62:0/30460279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63f01433f0 0x7f63f0143840 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f70f0700 1 --2- 172.21.15.62:0/30460279 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63f013ce80 0x7f63f0142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f70f0700 1 -- 172.21.15.62:0/30460279 >> 172.21.15.62:0/30460279 conn(0x7f63f005c750 msgr2=0x7f63f005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f70f0700 1 -- 172.21.15.62:0/30460279 shutdown_connections 2021-12-17T18:21:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.624+0000 7f63f70f0700 1 -- 172.21.15.62:0/30460279 wait complete. 2021-12-17T18:21:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f70f0700 1 Processor -- start 2021-12-17T18:21:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f70f0700 1 -- start start 2021-12-17T18:21:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f70f0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f63f0062620 0x7f63f0140390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f70f0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63f013ce80 0x7f63f0142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f70f0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63f01433f0 0x7f63f0064b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:38.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f70f0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f013f190 con 0x7f63f013ce80 2021-12-17T18:21:38.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f70f0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f013fc50 con 0x7f63f0062620 2021-12-17T18:21:38.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f70f0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f013fef0 con 0x7f63f01433f0 2021-12-17T18:21:38.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f58ed700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63f013ce80 0x7f63f0142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:38.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f58ed700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63f013ce80 0x7f63f0142620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50352/0 (socket says 172.21.15.62:50352) 2021-12-17T18:21:38.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f58ed700 1 -- 172.21.15.62:0/2211473789 learned_addr learned my addr 172.21.15.62:0/2211473789 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:38.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f68ef700 1 --2- 172.21.15.62:0/2211473789 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63f01433f0 0x7f63f0064b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:38.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f60ee700 1 --2- 172.21.15.62:0/2211473789 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f63f0062620 0x7f63f0140390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:38.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f58ed700 1 -- 172.21.15.62:0/2211473789 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63f01433f0 msgr2=0x7f63f0064b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:38.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f58ed700 1 --2- 172.21.15.62:0/2211473789 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63f01433f0 0x7f63f0064b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:38.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f58ed700 1 -- 172.21.15.62:0/2211473789 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f63f0062620 msgr2=0x7f63f0140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:38.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f58ed700 1 --2- 172.21.15.62:0/2211473789 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f63f0062620 0x7f63f0140390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:38.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f58ed700 1 -- 172.21.15.62:0/2211473789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e8009470 con 0x7f63f013ce80 2021-12-17T18:21:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f60ee700 1 --2- 172.21.15.62:0/2211473789 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f63f0062620 0x7f63f0140390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:21:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f58ed700 1 --2- 172.21.15.62:0/2211473789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63f013ce80 0x7f63f0142620 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f63e0007000 tx=0x7f63e0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63df7fe700 1 -- 172.21.15.62:0/2211473789 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e0010580 con 0x7f63f013ce80 2021-12-17T18:21:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63df7fe700 1 -- 172.21.15.62:0/2211473789 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e00106e0 con 0x7f63f013ce80 2021-12-17T18:21:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f70f0700 1 -- 172.21.15.62:0/2211473789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f013ee10 con 0x7f63f013ce80 2021-12-17T18:21:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63df7fe700 1 -- 172.21.15.62:0/2211473789 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e0010a40 con 0x7f63f013ce80 2021-12-17T18:21:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.628+0000 7f63f70f0700 1 -- 172.21.15.62:0/2211473789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f00637c0 con 0x7f63f013ce80 2021-12-17T18:21:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.632+0000 7f63f70f0700 1 -- 172.21.15.62:0/2211473789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f00b04a0 con 0x7f63f013ce80 2021-12-17T18:21:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.632+0000 7f63df7fe700 1 -- 172.21.15.62:0/2211473789 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f63e0010ba0 con 0x7f63f013ce80 2021-12-17T18:21:38.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.632+0000 7f63df7fe700 1 --2- 172.21.15.62:0/2211473789 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f63d0053610 0x7f63d0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:38.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.632+0000 7f63df7fe700 1 -- 172.21.15.62:0/2211473789 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f63e006bc00 con 0x7f63f013ce80 2021-12-17T18:21:38.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.632+0000 7f63f60ee700 1 --2- 172.21.15.62:0/2211473789 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f63d0053610 0x7f63d0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:38.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.632+0000 7f63f60ee700 1 --2- 172.21.15.62:0/2211473789 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f63d0053610 0x7f63d0055ad0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f63ec00b000 tx=0x7f63ec009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:38.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.640+0000 7f63df7fe700 1 -- 172.21.15.62:0/2211473789 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f63f00b04a0 con 0x7f63f013ce80 2021-12-17T18:21:38.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:38.800+0000 7f63f70f0700 1 -- 172.21.15.62:0/2211473789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f63f00b04a0 con 0x7f63f013ce80 2021-12-17T18:21:39.602 INFO:tasks.ceph.mon.a.smithi062.stderr:2021-12-17T18:21:39.600+0000 7f8d3b366700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-12-17T18:21:39.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.612+0000 7f63df7fe700 1 -- 172.21.15.62:0/2211473789 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f63f00b04a0 con 0x7f63f013ce80 2021-12-17T18:21:39.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.616+0000 7f63f70f0700 1 -- 172.21.15.62:0/2211473789 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f63d0053610 msgr2=0x7f63d0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:39.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.616+0000 7f63f70f0700 1 --2- 172.21.15.62:0/2211473789 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f63d0053610 0x7f63d0055ad0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f63ec00b000 tx=0x7f63ec009040).stop 2021-12-17T18:21:39.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.616+0000 7f63f70f0700 1 -- 172.21.15.62:0/2211473789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63f013ce80 msgr2=0x7f63f0142620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:39.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.616+0000 7f63f70f0700 1 --2- 172.21.15.62:0/2211473789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63f013ce80 0x7f63f0142620 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f63e0007000 tx=0x7f63e0008040).stop 2021-12-17T18:21:39.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.616+0000 7f63f70f0700 1 -- 172.21.15.62:0/2211473789 shutdown_connections 2021-12-17T18:21:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.616+0000 7f63f70f0700 1 --2- 172.21.15.62:0/2211473789 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f63d0053610 0x7f63d0055ad0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.616+0000 7f63f70f0700 1 --2- 172.21.15.62:0/2211473789 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63f01433f0 0x7f63f0064b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.616+0000 7f63f70f0700 1 --2- 172.21.15.62:0/2211473789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63f013ce80 0x7f63f0142620 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.616+0000 7f63f70f0700 1 --2- 172.21.15.62:0/2211473789 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f63f0062620 0x7f63f0140390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:39.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.616+0000 7f63f70f0700 1 -- 172.21.15.62:0/2211473789 >> 172.21.15.62:0/2211473789 conn(0x7f63f005c750 msgr2=0x7f63f00b5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:39.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.616+0000 7f63f70f0700 1 -- 172.21.15.62:0/2211473789 shutdown_connections 2021-12-17T18:21:39.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.616+0000 7f63f70f0700 1 -- 172.21.15.62:0/2211473789 wait complete. 2021-12-17T18:21:39.620 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-12-17T18:21:39.632 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:21:39.654 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:21:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.732+0000 7ff3f9822700 1 Processor -- start 2021-12-17T18:21:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.732+0000 7ff3f9822700 1 -- start start 2021-12-17T18:21:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.732+0000 7ff3f9822700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff3f40b21a0 0x7ff3f40afe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:39.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.732+0000 7ff3f9822700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3f4147fb0 0x7ff3f405fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:39.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.732+0000 7ff3f9822700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f40b2580 con 0x7ff3f40b0530 2021-12-17T18:21:39.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.732+0000 7ff3f9822700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f40b2e60 con 0x7ff3f40b21a0 2021-12-17T18:21:39.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f9822700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f405f8b0 con 0x7ff3f4147fb0 2021-12-17T18:21:39.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f8820700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff3f40b21a0 0x7ff3f40afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:39.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f9021700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7ff3f40b0530 0x7ff3f4144600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:50276/0 (socket says 172.21.15.62:50276) 2021-12-17T18:21:39.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f9021700 1 -- 172.21.15.62:0/3136894898 learned_addr learned my addr 172.21.15.62:0/3136894898 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:39.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f3fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3f4147fb0 0x7ff3f405fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:39.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f8820700 1 -- 172.21.15.62:0/3136894898 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3f4147fb0 msgr2=0x7ff3f405fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:39.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f8820700 1 --2- 172.21.15.62:0/3136894898 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3f4147fb0 0x7ff3f405fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:39.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f8820700 1 -- 172.21.15.62:0/3136894898 >> v1:172.21.15.109:6789/0 conn(0x7ff3f40b0530 legacy=0x7ff3f4144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:39.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f37fe700 1 -- 172.21.15.62:0/3136894898 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197844423 0 0) 0x7ff3f40b2580 con 0x7ff3f40b0530 2021-12-17T18:21:39.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f8820700 1 -- 172.21.15.62:0/3136894898 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f405fb50 con 0x7ff3f40b21a0 2021-12-17T18:21:39.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f8820700 1 --2- 172.21.15.62:0/3136894898 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3f40b21a0 0x7ff3f40afe10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7ff3e8002f70 tx=0x7ff3e8006df0).ready entity=mon.1 client_cookie=c2fdcc283cd8d410 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:39.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f37fe700 1 -- 172.21.15.62:0/3136894898 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3e800d570 con 0x7ff3f40b21a0 2021-12-17T18:21:39.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f37fe700 1 -- 172.21.15.62:0/3136894898 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e8000e90 con 0x7ff3f40b21a0 2021-12-17T18:21:39.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f37fe700 1 -- 172.21.15.62:0/3136894898 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3e800d8c0 con 0x7ff3f40b21a0 2021-12-17T18:21:39.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f9822700 1 -- 172.21.15.62:0/3136894898 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3f40b21a0 msgr2=0x7ff3f40afe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f9822700 1 --2- 172.21.15.62:0/3136894898 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3f40b21a0 0x7ff3f40afe10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7ff3e8002f70 tx=0x7ff3e8006df0).stop 2021-12-17T18:21:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f9822700 1 -- 172.21.15.62:0/3136894898 shutdown_connections 2021-12-17T18:21:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f9822700 1 --2- 172.21.15.62:0/3136894898 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3f4147fb0 0x7ff3f405fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f9822700 1 --2- 172.21.15.62:0/3136894898 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3f40b21a0 0x7ff3f40afe10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f9822700 1 -- 172.21.15.62:0/3136894898 >> 172.21.15.62:0/3136894898 conn(0x7ff3f4062430 msgr2=0x7ff3f4062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f9822700 1 -- 172.21.15.62:0/3136894898 shutdown_connections 2021-12-17T18:21:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f9822700 1 -- 172.21.15.62:0/3136894898 wait complete. 2021-12-17T18:21:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f9822700 1 Processor -- start 2021-12-17T18:21:39.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.736+0000 7ff3f9822700 1 -- start start 2021-12-17T18:21:39.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f9822700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3f40b0530 0x7ff3f41476b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:39.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f9822700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3f40b21a0 0x7ff3f4159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:39.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f9822700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3f4147fb0 0x7ff3f415a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:39.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f9822700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f4156840 con 0x7ff3f4147fb0 2021-12-17T18:21:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f9822700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f40a8440 con 0x7ff3f40b0530 2021-12-17T18:21:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f9822700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f40a8670 con 0x7ff3f40b21a0 2021-12-17T18:21:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f9021700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3f4147fb0 0x7ff3f415a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:39.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f9021700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3f4147fb0 0x7ff3f415a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50384/0 (socket says 172.21.15.62:50384) 2021-12-17T18:21:39.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f9021700 1 -- 172.21.15.62:0/1634591666 learned_addr learned my addr 172.21.15.62:0/1634591666 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:39.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f3fff700 1 --2- 172.21.15.62:0/1634591666 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3f40b21a0 0x7ff3f4159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:39.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f8820700 1 --2- 172.21.15.62:0/1634591666 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3f40b0530 0x7ff3f41476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:39.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f3fff700 1 -- 172.21.15.62:0/1634591666 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3f40b0530 msgr2=0x7ff3f41476b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:39.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f3fff700 1 --2- 172.21.15.62:0/1634591666 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3f40b0530 0x7ff3f41476b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:39.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f3fff700 1 -- 172.21.15.62:0/1634591666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3f4147fb0 msgr2=0x7ff3f415a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:39.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f3fff700 1 --2- 172.21.15.62:0/1634591666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3f4147fb0 0x7ff3f415a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:39.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f3fff700 1 -- 172.21.15.62:0/1634591666 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e800b180 con 0x7ff3f40b21a0 2021-12-17T18:21:39.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f3fff700 1 --2- 172.21.15.62:0/1634591666 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3f40b21a0 0x7ff3f4159ee0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ff3e000c000 tx=0x7ff3e0006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:39.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f1ffb700 1 -- 172.21.15.62:0/1634591666 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3e0011750 con 0x7ff3f40b21a0 2021-12-17T18:21:39.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f1ffb700 1 -- 172.21.15.62:0/1634591666 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e00118b0 con 0x7ff3f40b21a0 2021-12-17T18:21:39.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f9822700 1 -- 172.21.15.62:0/1634591666 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f4064490 con 0x7ff3f40b21a0 2021-12-17T18:21:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f1ffb700 1 -- 172.21.15.62:0/1634591666 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3e0011c10 con 0x7ff3f40b21a0 2021-12-17T18:21:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f9822700 1 -- 172.21.15.62:0/1634591666 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f40651f0 con 0x7ff3f40b21a0 2021-12-17T18:21:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.740+0000 7ff3f9822700 1 -- 172.21.15.62:0/1634591666 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f4064620 con 0x7ff3f40b21a0 2021-12-17T18:21:39.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.744+0000 7ff3f1ffb700 1 -- 172.21.15.62:0/1634591666 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff3e0011d70 con 0x7ff3f40b21a0 2021-12-17T18:21:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.744+0000 7ff3f1ffb700 1 --2- 172.21.15.62:0/1634591666 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff3d40536a0 0x7ff3d4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.744+0000 7ff3f1ffb700 1 -- 172.21.15.62:0/1634591666 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff3e006c2c0 con 0x7ff3f40b21a0 2021-12-17T18:21:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.744+0000 7ff3f8820700 1 --2- 172.21.15.62:0/1634591666 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff3d40536a0 0x7ff3d4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:39.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.744+0000 7ff3f8820700 1 --2- 172.21.15.62:0/1634591666 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff3d40536a0 0x7ff3d4055b60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7ff3e801a000 tx=0x7ff3e8014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:39.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.752+0000 7ff3f1ffb700 1 -- 172.21.15.62:0/1634591666 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff3e00432f0 con 0x7ff3f40b21a0 2021-12-17T18:21:39.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.912+0000 7ff3f9822700 1 -- 172.21.15.62:0/1634591666 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3f40a87b0 con 0x7ff3f40b21a0 2021-12-17T18:21:39.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.916+0000 7ff3f1ffb700 1 -- 172.21.15.62:0/1634591666 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+1774 (secure 0 0 0) 0x7ff3e0046910 con 0x7ff3f40b21a0 2021-12-17T18:21:39.916 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:21:39.916 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/16961477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":16961477},{"type":"v1","addr":"172.21.15.109:6835","nonce":16961477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:20:16.801183+0000","modified":"2021-12-17T18:21:39.604869+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":43,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-12-17T18:21:39.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.916+0000 7ff3f9822700 1 -- 172.21.15.62:0/1634591666 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff3d40536a0 msgr2=0x7ff3d4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:39.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.916+0000 7ff3f9822700 1 --2- 172.21.15.62:0/1634591666 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff3d40536a0 0x7ff3d4055b60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7ff3e801a000 tx=0x7ff3e8014000).stop 2021-12-17T18:21:39.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.916+0000 7ff3f9822700 1 -- 172.21.15.62:0/1634591666 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3f40b21a0 msgr2=0x7ff3f4159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.916+0000 7ff3f9822700 1 --2- 172.21.15.62:0/1634591666 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3f40b21a0 0x7ff3f4159ee0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ff3e000c000 tx=0x7ff3e0006df0).stop 2021-12-17T18:21:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.916+0000 7ff3f9822700 1 -- 172.21.15.62:0/1634591666 shutdown_connections 2021-12-17T18:21:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.916+0000 7ff3f9822700 1 --2- 172.21.15.62:0/1634591666 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff3d40536a0 0x7ff3d4055b60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:39.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.916+0000 7ff3f9822700 1 --2- 172.21.15.62:0/1634591666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3f4147fb0 0x7ff3f415a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.916+0000 7ff3f9822700 1 --2- 172.21.15.62:0/1634591666 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3f40b21a0 0x7ff3f4159ee0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.916+0000 7ff3f9822700 1 --2- 172.21.15.62:0/1634591666 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3f40b0530 0x7ff3f41476b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.916+0000 7ff3f9822700 1 -- 172.21.15.62:0/1634591666 >> 172.21.15.62:0/1634591666 conn(0x7ff3f4062430 msgr2=0x7ff3f414a850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.916+0000 7ff3f9822700 1 -- 172.21.15.62:0/1634591666 shutdown_connections 2021-12-17T18:21:39.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:39.916+0000 7ff3f9822700 1 -- 172.21.15.62:0/1634591666 wait complete. 2021-12-17T18:21:39.921 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 17 2021-12-17T18:21:39.930 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-12-17T18:21:40.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.032+0000 7feb4b4d0700 1 Processor -- start 2021-12-17T18:21:40.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.032+0000 7feb4b4d0700 1 -- start start 2021-12-17T18:21:40.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.032+0000 7feb4b4d0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feb440b65f0 0x7feb440648f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:40.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.032+0000 7feb4b4d0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feb440b3060 0x7feb440b1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:40.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.032+0000 7feb4b4d0700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7feb441445f0 0x7feb44144a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:40.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.032+0000 7feb4b4d0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb44140f70 con 0x7feb440b65f0 2021-12-17T18:21:40.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.032+0000 7feb4b4d0700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb440b69d0 con 0x7feb441445f0 2021-12-17T18:21:40.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.032+0000 7feb4b4d0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb44063f10 con 0x7feb440b3060 2021-12-17T18:21:40.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.032+0000 7feb4a4ce700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feb440b65f0 0x7feb440648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:40.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.032+0000 7feb4a4ce700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feb440b65f0 0x7feb440648f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50388/0 (socket says 172.21.15.62:50388) 2021-12-17T18:21:40.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.032+0000 7feb4a4ce700 1 -- 172.21.15.62:0/734531698 learned_addr learned my addr 172.21.15.62:0/734531698 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:40.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.032+0000 7feb4accf700 1 --2- 172.21.15.62:0/734531698 >> v2:172.21.15.109:3300/0 conn(0x7feb441445f0 0x7feb44144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:40.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.032+0000 7feb49ccd700 1 --2- 172.21.15.62:0/734531698 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feb440b3060 0x7feb440b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:40.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.032+0000 7feb4a4ce700 1 -- 172.21.15.62:0/734531698 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feb440b3060 msgr2=0x7feb440b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:40.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.032+0000 7feb4a4ce700 1 --2- 172.21.15.62:0/734531698 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feb440b3060 0x7feb440b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:40.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.032+0000 7feb4a4ce700 1 -- 172.21.15.62:0/734531698 >> v2:172.21.15.109:3300/0 conn(0x7feb441445f0 msgr2=0x7feb44144a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:40.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.032+0000 7feb4a4ce700 1 --2- 172.21.15.62:0/734531698 >> v2:172.21.15.109:3300/0 conn(0x7feb441445f0 0x7feb44144a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:40.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.036+0000 7feb4a4ce700 1 -- 172.21.15.62:0/734531698 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb440641b0 con 0x7feb440b65f0 2021-12-17T18:21:40.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.036+0000 7feb49ccd700 1 --2- 172.21.15.62:0/734531698 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feb440b3060 0x7feb440b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:21:40.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.036+0000 7feb4a4ce700 1 --2- 172.21.15.62:0/734531698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb440b65f0 0x7feb440648f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7feb40002f70 tx=0x7feb40006eb0).ready entity=mon.0 client_cookie=31473e12b35c1eb1 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:40.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.036+0000 7feb494cc700 1 -- 172.21.15.62:0/734531698 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb4000d570 con 0x7feb440b65f0 2021-12-17T18:21:40.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.036+0000 7feb494cc700 1 -- 172.21.15.62:0/734531698 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb40000e90 con 0x7feb440b65f0 2021-12-17T18:21:40.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.036+0000 7feb494cc700 1 -- 172.21.15.62:0/734531698 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb4000d900 con 0x7feb440b65f0 2021-12-17T18:21:40.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.036+0000 7feb4b4d0700 1 -- 172.21.15.62:0/734531698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb440b65f0 msgr2=0x7feb440648f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:40.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.036+0000 7feb4b4d0700 1 --2- 172.21.15.62:0/734531698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb440b65f0 0x7feb440648f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7feb40002f70 tx=0x7feb40006eb0).stop 2021-12-17T18:21:40.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.036+0000 7feb4b4d0700 1 -- 172.21.15.62:0/734531698 shutdown_connections 2021-12-17T18:21:40.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.036+0000 7feb4b4d0700 1 --2- 172.21.15.62:0/734531698 >> v2:172.21.15.109:3300/0 conn(0x7feb441445f0 0x7feb44144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:40.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.036+0000 7feb4b4d0700 1 --2- 172.21.15.62:0/734531698 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feb440b3060 0x7feb440b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:40.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.036+0000 7feb4b4d0700 1 --2- 172.21.15.62:0/734531698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb440b65f0 0x7feb440648f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:40.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.036+0000 7feb4b4d0700 1 -- 172.21.15.62:0/734531698 >> 172.21.15.62:0/734531698 conn(0x7feb4405caf0 msgr2=0x7feb4405cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:40.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.036+0000 7feb4b4d0700 1 -- 172.21.15.62:0/734531698 shutdown_connections 2021-12-17T18:21:40.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.036+0000 7feb4b4d0700 1 -- 172.21.15.62:0/734531698 wait complete. 2021-12-17T18:21:40.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.036+0000 7feb4b4d0700 1 Processor -- start 2021-12-17T18:21:40.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.036+0000 7feb4b4d0700 1 -- start start 2021-12-17T18:21:40.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4b4d0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feb440b3060 0x7feb440a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:40.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4b4d0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feb440b65f0 0x7feb440ac440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:40.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4b4d0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb441445f0 0x7feb440ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:40.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4b4d0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4409fa20 con 0x7feb441445f0 2021-12-17T18:21:40.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4b4d0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb440a20d0 con 0x7feb440b65f0 2021-12-17T18:21:40.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4b4d0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb440ace20 con 0x7feb440b3060 2021-12-17T18:21:40.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4accf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb441445f0 0x7feb440ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:40.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4accf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb441445f0 0x7feb440ac930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50398/0 (socket says 172.21.15.62:50398) 2021-12-17T18:21:40.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4accf700 1 -- 172.21.15.62:0/3760845883 learned_addr learned my addr 172.21.15.62:0/3760845883 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:40.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb49ccd700 1 --2- 172.21.15.62:0/3760845883 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feb440b65f0 0x7feb440ac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:40.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4a4ce700 1 --2- 172.21.15.62:0/3760845883 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feb440b3060 0x7feb440a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:40.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4accf700 1 -- 172.21.15.62:0/3760845883 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feb440b3060 msgr2=0x7feb440a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4accf700 1 --2- 172.21.15.62:0/3760845883 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feb440b3060 0x7feb440a02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4accf700 1 -- 172.21.15.62:0/3760845883 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feb440b65f0 msgr2=0x7feb440ac440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4accf700 1 --2- 172.21.15.62:0/3760845883 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feb440b65f0 0x7feb440ac440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:40.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4accf700 1 -- 172.21.15.62:0/3760845883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4000b1e0 con 0x7feb441445f0 2021-12-17T18:21:40.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4accf700 1 --2- 172.21.15.62:0/3760845883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb441445f0 0x7feb440ac930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7feb3c006e00 tx=0x7feb3c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:40.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb337fe700 1 -- 172.21.15.62:0/3760845883 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb3c00c7f0 con 0x7feb441445f0 2021-12-17T18:21:40.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb337fe700 1 -- 172.21.15.62:0/3760845883 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c00c950 con 0x7feb441445f0 2021-12-17T18:21:40.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4b4d0700 1 -- 172.21.15.62:0/3760845883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb440a0790 con 0x7feb441445f0 2021-12-17T18:21:40.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb337fe700 1 -- 172.21.15.62:0/3760845883 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb3c00ccb0 con 0x7feb441445f0 2021-12-17T18:21:40.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4b4d0700 1 -- 172.21.15.62:0/3760845883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb440a0c00 con 0x7feb441445f0 2021-12-17T18:21:40.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb4b4d0700 1 -- 172.21.15.62:0/3760845883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4409fc20 con 0x7feb441445f0 2021-12-17T18:21:40.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb337fe700 1 -- 172.21.15.62:0/3760845883 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feb3c022070 con 0x7feb441445f0 2021-12-17T18:21:40.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.040+0000 7feb337fe700 1 --2- 172.21.15.62:0/3760845883 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feb24053580 0x7feb24055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:40.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.044+0000 7feb337fe700 1 -- 172.21.15.62:0/3760845883 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6159+0+0 (secure 0 0 0) 0x7feb3c06bfe0 con 0x7feb441445f0 2021-12-17T18:21:40.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.044+0000 7feb4a4ce700 1 --2- 172.21.15.62:0/3760845883 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feb24053580 0x7feb24055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:40.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.044+0000 7feb4a4ce700 1 --2- 172.21.15.62:0/3760845883 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feb24053580 0x7feb24055a40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7feb4001a000 tx=0x7feb40015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:40.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.044+0000 7feb337fe700 1 -- 172.21.15.62:0/3760845883 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feb3c0430f0 con 0x7feb441445f0 2021-12-17T18:21:40.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.212+0000 7feb4b4d0700 1 -- 172.21.15.62:0/3760845883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7feb440a2290 con 0x7feb441445f0 2021-12-17T18:21:40.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.616+0000 7feb337fe700 1 -- 172.21.15.62:0/3760845883 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7feb3c0160a0 con 0x7feb441445f0 2021-12-17T18:21:40.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.620+0000 7feb4b4d0700 1 -- 172.21.15.62:0/3760845883 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feb24053580 msgr2=0x7feb24055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:40.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.620+0000 7feb4b4d0700 1 --2- 172.21.15.62:0/3760845883 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feb24053580 0x7feb24055a40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7feb4001a000 tx=0x7feb40015000).stop 2021-12-17T18:21:40.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.620+0000 7feb4b4d0700 1 -- 172.21.15.62:0/3760845883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb441445f0 msgr2=0x7feb440ac930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.620+0000 7feb4b4d0700 1 --2- 172.21.15.62:0/3760845883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb441445f0 0x7feb440ac930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7feb3c006e00 tx=0x7feb3c0091d0).stop 2021-12-17T18:21:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.620+0000 7feb4b4d0700 1 -- 172.21.15.62:0/3760845883 shutdown_connections 2021-12-17T18:21:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.620+0000 7feb4b4d0700 1 --2- 172.21.15.62:0/3760845883 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feb24053580 0x7feb24055a40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:40.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.620+0000 7feb4b4d0700 1 --2- 172.21.15.62:0/3760845883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb441445f0 0x7feb440ac930 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.620+0000 7feb4b4d0700 1 --2- 172.21.15.62:0/3760845883 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feb440b65f0 0x7feb440ac440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.620+0000 7feb4b4d0700 1 --2- 172.21.15.62:0/3760845883 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feb440b3060 0x7feb440a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.620+0000 7feb4b4d0700 1 -- 172.21.15.62:0/3760845883 >> 172.21.15.62:0/3760845883 conn(0x7feb4405caf0 msgr2=0x7feb440b3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:40.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.620+0000 7feb4b4d0700 1 -- 172.21.15.62:0/3760845883 shutdown_connections 2021-12-17T18:21:40.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.620+0000 7feb4b4d0700 1 -- 172.21.15.62:0/3760845883 wait complete. 2021-12-17T18:21:40.638 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-12-17T18:21:40.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.756+0000 7febc8178700 1 Processor -- start 2021-12-17T18:21:40.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.756+0000 7febc8178700 1 -- start start 2021-12-17T18:21:40.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.756+0000 7febc8178700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7febc00b4340 0x7febc01471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:40.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.756+0000 7febc8178700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febc00b51a0 0x7febc00b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:40.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.756+0000 7febc8178700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc00b09e0 con 0x7febc0142660 2021-12-17T18:21:40.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.756+0000 7febc8178700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc01467d0 con 0x7febc00b4340 2021-12-17T18:21:40.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.756+0000 7febc8178700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc0146a70 con 0x7febc00b51a0 2021-12-17T18:21:40.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc6715700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7febc0142660 0x7febc00b5a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33986/0 (socket says 172.21.15.62:33986) 2021-12-17T18:21:40.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc6715700 1 -- 172.21.15.62:0/31938987 learned_addr learned my addr 172.21.15.62:0/31938987 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:40.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc5f14700 1 --2- 172.21.15.62:0/31938987 >> v2:172.21.15.62:3300/0 conn(0x7febc00b4340 0x7febc01471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:40.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc5713700 1 --2- 172.21.15.62:0/31938987 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febc00b51a0 0x7febc00b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:40.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc4f12700 1 -- 172.21.15.62:0/31938987 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766474760 0 0) 0x7febc00b09e0 con 0x7febc0142660 2021-12-17T18:21:40.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc4f12700 1 -- 172.21.15.62:0/31938987 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feba8003260 con 0x7febc0142660 2021-12-17T18:21:40.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc5f14700 1 -- 172.21.15.62:0/31938987 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febc00b51a0 msgr2=0x7febc00b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:40.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc5f14700 1 --2- 172.21.15.62:0/31938987 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febc00b51a0 0x7febc00b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:40.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc5f14700 1 -- 172.21.15.62:0/31938987 >> v1:172.21.15.62:6789/0 conn(0x7febc0142660 legacy=0x7febc00b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:40.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc5f14700 1 -- 172.21.15.62:0/31938987 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc0146d10 con 0x7febc00b4340 2021-12-17T18:21:40.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc5713700 1 --2- 172.21.15.62:0/31938987 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febc00b51a0 0x7febc00b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:21:40.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc5f14700 1 --2- 172.21.15.62:0/31938987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febc00b4340 0x7febc01471b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7febbc002f70 tx=0x7febbc006df0).ready entity=mon.0 client_cookie=e81f0113f6874c04 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:40.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc4f12700 1 -- 172.21.15.62:0/31938987 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febbc00d4a0 con 0x7febc00b4340 2021-12-17T18:21:40.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc4f12700 1 -- 172.21.15.62:0/31938987 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc000e90 con 0x7febc00b4340 2021-12-17T18:21:40.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc4f12700 1 -- 172.21.15.62:0/31938987 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febbc00d7f0 con 0x7febc00b4340 2021-12-17T18:21:40.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc8178700 1 -- 172.21.15.62:0/31938987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febc00b4340 msgr2=0x7febc01471b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:40.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc8178700 1 --2- 172.21.15.62:0/31938987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febc00b4340 0x7febc01471b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7febbc002f70 tx=0x7febbc006df0).stop 2021-12-17T18:21:40.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc8178700 1 -- 172.21.15.62:0/31938987 shutdown_connections 2021-12-17T18:21:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc8178700 1 --2- 172.21.15.62:0/31938987 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febc00b51a0 0x7febc00b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc8178700 1 --2- 172.21.15.62:0/31938987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febc00b4340 0x7febc01471b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc8178700 1 -- 172.21.15.62:0/31938987 >> 172.21.15.62:0/31938987 conn(0x7febc005c750 msgr2=0x7febc005cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc8178700 1 -- 172.21.15.62:0/31938987 shutdown_connections 2021-12-17T18:21:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc8178700 1 -- 172.21.15.62:0/31938987 wait complete. 2021-12-17T18:21:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc8178700 1 Processor -- start 2021-12-17T18:21:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.760+0000 7febc8178700 1 -- start start 2021-12-17T18:21:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc8178700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7febc00b4340 0x7febc0145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc8178700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febc00b51a0 0x7febc00b9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc8178700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febc0142660 0x7febc00b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc8178700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc0147880 con 0x7febc00b51a0 2021-12-17T18:21:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc8178700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc0149610 con 0x7febc00b4340 2021-12-17T18:21:40.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc8178700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc01475e0 con 0x7febc0142660 2021-12-17T18:21:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc5713700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febc00b51a0 0x7febc00b9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc5713700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febc00b51a0 0x7febc00b9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50410/0 (socket says 172.21.15.62:50410) 2021-12-17T18:21:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc5713700 1 -- 172.21.15.62:0/3880744882 learned_addr learned my addr 172.21.15.62:0/3880744882 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc6715700 1 --2- 172.21.15.62:0/3880744882 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febc0142660 0x7febc00b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:40.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc5f14700 1 --2- 172.21.15.62:0/3880744882 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7febc00b4340 0x7febc0145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc5713700 1 -- 172.21.15.62:0/3880744882 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febc0142660 msgr2=0x7febc00b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc5713700 1 --2- 172.21.15.62:0/3880744882 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febc0142660 0x7febc00b8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc5713700 1 -- 172.21.15.62:0/3880744882 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7febc00b4340 msgr2=0x7febc0145490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:40.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc5713700 1 --2- 172.21.15.62:0/3880744882 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7febc00b4340 0x7febc0145490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc5713700 1 -- 172.21.15.62:0/3880744882 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb400b180 con 0x7febc00b51a0 2021-12-17T18:21:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc6715700 1 --2- 172.21.15.62:0/3880744882 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febc0142660 0x7febc00b8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:21:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc5f14700 1 --2- 172.21.15.62:0/3880744882 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7febc00b4340 0x7febc0145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:21:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc5713700 1 --2- 172.21.15.62:0/3880744882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febc00b51a0 0x7febc00b9bf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7febb400c000 tx=0x7febb4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febb2ffd700 1 -- 172.21.15.62:0/3880744882 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febb400c9e0 con 0x7febc00b51a0 2021-12-17T18:21:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febb2ffd700 1 -- 172.21.15.62:0/3880744882 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb400cb40 con 0x7febc00b51a0 2021-12-17T18:21:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc8178700 1 -- 172.21.15.62:0/3880744882 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febbc00b180 con 0x7febc00b51a0 2021-12-17T18:21:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febb2ffd700 1 -- 172.21.15.62:0/3880744882 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febb400cea0 con 0x7febc00b51a0 2021-12-17T18:21:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.764+0000 7febc8178700 1 -- 172.21.15.62:0/3880744882 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc0060910 con 0x7febc00b51a0 2021-12-17T18:21:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.768+0000 7febb2ffd700 1 -- 172.21.15.62:0/3880744882 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7febb401c460 con 0x7febc00b51a0 2021-12-17T18:21:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.768+0000 7febc8178700 1 -- 172.21.15.62:0/3880744882 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc00ba660 con 0x7febc00b51a0 2021-12-17T18:21:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.768+0000 7febb2ffd700 1 --2- 172.21.15.62:0/3880744882 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feba00536a0 0x7feba0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.768+0000 7febb2ffd700 1 -- 172.21.15.62:0/3880744882 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6159+0+0 (secure 0 0 0) 0x7febb406c050 con 0x7febc00b51a0 2021-12-17T18:21:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.768+0000 7febc5f14700 1 --2- 172.21.15.62:0/3880744882 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feba00536a0 0x7feba0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.768+0000 7febc5f14700 1 --2- 172.21.15.62:0/3880744882 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feba00536a0 0x7feba0055b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7febbc018000 tx=0x7febbc014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:40.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.776+0000 7febb2ffd700 1 -- 172.21.15.62:0/3880744882 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7febb4043100 con 0x7febc00b51a0 2021-12-17T18:21:40.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:40.900+0000 7febc8178700 1 -- 172.21.15.62:0/3880744882 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7febc00ba280 con 0x7febc00b51a0 2021-12-17T18:21:41.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.628+0000 7febb2ffd700 1 -- 172.21.15.62:0/3880744882 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 185+0+0 (secure 0 0 0) 0x7febb4046720 con 0x7febc00b51a0 2021-12-17T18:21:41.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.640+0000 7febc8178700 1 -- 172.21.15.62:0/3880744882 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feba00536a0 msgr2=0x7feba0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:41.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.640+0000 7febc8178700 1 --2- 172.21.15.62:0/3880744882 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feba00536a0 0x7feba0055b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7febbc018000 tx=0x7febbc014000).stop 2021-12-17T18:21:41.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.640+0000 7febc8178700 1 -- 172.21.15.62:0/3880744882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febc00b51a0 msgr2=0x7febc00b9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:41.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.640+0000 7febc8178700 1 --2- 172.21.15.62:0/3880744882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febc00b51a0 0x7febc00b9bf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7febb400c000 tx=0x7febb4006df0).stop 2021-12-17T18:21:41.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.640+0000 7febc8178700 1 -- 172.21.15.62:0/3880744882 shutdown_connections 2021-12-17T18:21:41.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.640+0000 7febc8178700 1 --2- 172.21.15.62:0/3880744882 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feba00536a0 0x7feba0055b60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:41.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.640+0000 7febc8178700 1 --2- 172.21.15.62:0/3880744882 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febc0142660 0x7febc00b8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:41.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.640+0000 7febc8178700 1 --2- 172.21.15.62:0/3880744882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febc00b51a0 0x7febc00b9bf0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:41.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.640+0000 7febc8178700 1 --2- 172.21.15.62:0/3880744882 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7febc00b4340 0x7febc0145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:41.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.640+0000 7febc8178700 1 -- 172.21.15.62:0/3880744882 >> 172.21.15.62:0/3880744882 conn(0x7febc005c750 msgr2=0x7febc00b6120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:41.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.640+0000 7febc8178700 1 -- 172.21.15.62:0/3880744882 shutdown_connections 2021-12-17T18:21:41.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.640+0000 7febc8178700 1 -- 172.21.15.62:0/3880744882 wait complete. 2021-12-17T18:21:41.645 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2021-12-17T18:21:41.654 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-12-17T18:21:41.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.760+0000 7ffb53fff700 1 Processor -- start 2021-12-17T18:21:41.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.760+0000 7ffb53fff700 1 -- start start 2021-12-17T18:21:41.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb53fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb5405ca90 0x7ffb540b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:41.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb53fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffb540b34b0 0x7ffb54145b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:41.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb53fff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5405ce70 con 0x7ffb540604b0 2021-12-17T18:21:41.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb53fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb540b2d70 con 0x7ffb540b34b0 2021-12-17T18:21:41.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb53fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540b3010 con 0x7ffb5405ca90 2021-12-17T18:21:41.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb4a7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffb540b34b0 0x7ffb54145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:41.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb4a7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffb540b34b0 0x7ffb54145b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50420/0 (socket says 172.21.15.62:50420) 2021-12-17T18:21:41.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb4a7fc700 1 -- 172.21.15.62:0/4245220599 learned_addr learned my addr 172.21.15.62:0/4245220599 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:41.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb52ffd700 1 --2- 172.21.15.62:0/4245220599 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb5405ca90 0x7ffb540b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:41.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb4a7fc700 1 -- 172.21.15.62:0/4245220599 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb5405ca90 msgr2=0x7ffb540b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:41.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb4a7fc700 1 --2- 172.21.15.62:0/4245220599 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb5405ca90 0x7ffb540b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:41.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb4a7fc700 1 -- 172.21.15.62:0/4245220599 >> v1:172.21.15.109:6789/0 conn(0x7ffb540604b0 legacy=0x7ffb54146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:41.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb4a7fc700 1 -- 172.21.15.62:0/4245220599 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb540b2ab0 con 0x7ffb540b34b0 2021-12-17T18:21:41.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb4a7fc700 1 --2- 172.21.15.62:0/4245220599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb540b34b0 0x7ffb54145b20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7ffb3c002f70 tx=0x7ffb3c006eb0).ready entity=mon.0 client_cookie=aa1083c71c37a828 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:41.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb527fc700 1 -- 172.21.15.62:0/4245220599 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb3c00d570 con 0x7ffb540b34b0 2021-12-17T18:21:41.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb527fc700 1 -- 172.21.15.62:0/4245220599 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c000e90 con 0x7ffb540b34b0 2021-12-17T18:21:41.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb527fc700 1 -- 172.21.15.62:0/4245220599 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb3c00d900 con 0x7ffb540b34b0 2021-12-17T18:21:41.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb53fff700 1 -- 172.21.15.62:0/4245220599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb540b34b0 msgr2=0x7ffb54145b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:41.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb53fff700 1 --2- 172.21.15.62:0/4245220599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb540b34b0 0x7ffb54145b20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7ffb3c002f70 tx=0x7ffb3c006eb0).stop 2021-12-17T18:21:41.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb53fff700 1 -- 172.21.15.62:0/4245220599 shutdown_connections 2021-12-17T18:21:41.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb53fff700 1 --2- 172.21.15.62:0/4245220599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb540b34b0 0x7ffb54145b20 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:41.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb53fff700 1 --2- 172.21.15.62:0/4245220599 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb5405ca90 0x7ffb540b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:41.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb53fff700 1 -- 172.21.15.62:0/4245220599 >> 172.21.15.62:0/4245220599 conn(0x7ffb5405bcd0 msgr2=0x7ffb54062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:41.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.764+0000 7ffb53fff700 1 -- 172.21.15.62:0/4245220599 shutdown_connections 2021-12-17T18:21:41.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.768+0000 7ffb53fff700 1 -- 172.21.15.62:0/4245220599 wait complete. 2021-12-17T18:21:41.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.768+0000 7ffb53fff700 1 Processor -- start 2021-12-17T18:21:41.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.768+0000 7ffb53fff700 1 -- start start 2021-12-17T18:21:41.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.768+0000 7ffb53fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb5405ca90 0x7ffb54063e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:41.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.768+0000 7ffb53fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb540604b0 0x7ffb540a5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:41.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.768+0000 7ffb53fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb540b34b0 0x7ffb540a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:41.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.768+0000 7ffb53fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb54066bc0 con 0x7ffb540b34b0 2021-12-17T18:21:41.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.768+0000 7ffb53fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540a33a0 con 0x7ffb540604b0 2021-12-17T18:21:41.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.768+0000 7ffb53fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb54067030 con 0x7ffb5405ca90 2021-12-17T18:21:41.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.768+0000 7ffb537fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb540b34b0 0x7ffb540a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:41.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.768+0000 7ffb4a7fc700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb540604b0 0x7ffb540a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:41.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.768+0000 7ffb537fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb540b34b0 0x7ffb540a5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50428/0 (socket says 172.21.15.62:50428) 2021-12-17T18:21:41.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.768+0000 7ffb52ffd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb5405ca90 0x7ffb54063e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:41.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.768+0000 7ffb537fe700 1 -- 172.21.15.62:0/1295781500 learned_addr learned my addr 172.21.15.62:0/1295781500 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:41.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.772+0000 7ffb537fe700 1 -- 172.21.15.62:0/1295781500 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb5405ca90 msgr2=0x7ffb54063e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:41.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.772+0000 7ffb537fe700 1 --2- 172.21.15.62:0/1295781500 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb5405ca90 0x7ffb54063e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:41.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.772+0000 7ffb537fe700 1 -- 172.21.15.62:0/1295781500 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb540604b0 msgr2=0x7ffb540a5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:41.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.772+0000 7ffb537fe700 1 --2- 172.21.15.62:0/1295781500 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb540604b0 0x7ffb540a5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:41.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.772+0000 7ffb537fe700 1 -- 172.21.15.62:0/1295781500 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c00b1e0 con 0x7ffb540b34b0 2021-12-17T18:21:41.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.772+0000 7ffb537fe700 1 --2- 172.21.15.62:0/1295781500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb540b34b0 0x7ffb540a5e20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7ffb5405d2a0 tx=0x7ffb4c007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:41.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.772+0000 7ffb50ff9700 1 -- 172.21.15.62:0/1295781500 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb4c00e4a0 con 0x7ffb540b34b0 2021-12-17T18:21:41.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.772+0000 7ffb50ff9700 1 -- 172.21.15.62:0/1295781500 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c00e600 con 0x7ffb540b34b0 2021-12-17T18:21:41.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.772+0000 7ffb53fff700 1 -- 172.21.15.62:0/1295781500 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb540a3840 con 0x7ffb540b34b0 2021-12-17T18:21:41.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.772+0000 7ffb50ff9700 1 -- 172.21.15.62:0/1295781500 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb4c00e960 con 0x7ffb540b34b0 2021-12-17T18:21:41.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.772+0000 7ffb53fff700 1 -- 172.21.15.62:0/1295781500 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb54066720 con 0x7ffb540b34b0 2021-12-17T18:21:41.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.772+0000 7ffb50ff9700 1 -- 172.21.15.62:0/1295781500 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffb4c019030 con 0x7ffb540b34b0 2021-12-17T18:21:41.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.772+0000 7ffb53fff700 1 -- 172.21.15.62:0/1295781500 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb54066dc0 con 0x7ffb540b34b0 2021-12-17T18:21:41.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.772+0000 7ffb50ff9700 1 --2- 172.21.15.62:0/1295781500 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb38053640 0x7ffb38055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:41.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.772+0000 7ffb50ff9700 1 -- 172.21.15.62:0/1295781500 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5721+0+0 (secure 0 0 0) 0x7ffb4c06aff0 con 0x7ffb540b34b0 2021-12-17T18:21:41.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.772+0000 7ffb52ffd700 1 --2- 172.21.15.62:0/1295781500 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb38053640 0x7ffb38055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:41.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.776+0000 7ffb52ffd700 1 --2- 172.21.15.62:0/1295781500 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb38053640 0x7ffb38055b00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7ffb4400b000 tx=0x7ffb44006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:41.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.780+0000 7ffb50ff9700 1 -- 172.21.15.62:0/1295781500 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffb4c042120 con 0x7ffb540b34b0 2021-12-17T18:21:41.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:41.900+0000 7ffb53fff700 1 -- 172.21.15.62:0/1295781500 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffb540b4500 con 0x7ffb540b34b0 2021-12-17T18:21:43.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:42.632+0000 7ffb50ff9700 1 -- 172.21.15.62:0/1295781500 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 173+0+0 (secure 0 0 0) 0x7ffb4c045740 con 0x7ffb540b34b0 2021-12-17T18:21:43.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:42.636+0000 7ffb53fff700 1 -- 172.21.15.62:0/1295781500 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb38053640 msgr2=0x7ffb38055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:43.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:42.636+0000 7ffb53fff700 1 --2- 172.21.15.62:0/1295781500 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb38053640 0x7ffb38055b00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7ffb4400b000 tx=0x7ffb44006df0).stop 2021-12-17T18:21:43.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:42.636+0000 7ffb53fff700 1 -- 172.21.15.62:0/1295781500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb540b34b0 msgr2=0x7ffb540a5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:43.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:42.636+0000 7ffb53fff700 1 --2- 172.21.15.62:0/1295781500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb540b34b0 0x7ffb540a5e20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7ffb5405d2a0 tx=0x7ffb4c007f40).stop 2021-12-17T18:21:43.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:42.636+0000 7ffb53fff700 1 -- 172.21.15.62:0/1295781500 shutdown_connections 2021-12-17T18:21:43.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:42.636+0000 7ffb53fff700 1 --2- 172.21.15.62:0/1295781500 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb38053640 0x7ffb38055b00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:43.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:42.636+0000 7ffb53fff700 1 --2- 172.21.15.62:0/1295781500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb540b34b0 0x7ffb540a5e20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:43.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:42.636+0000 7ffb53fff700 1 --2- 172.21.15.62:0/1295781500 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb540604b0 0x7ffb540a5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:43.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:42.636+0000 7ffb53fff700 1 --2- 172.21.15.62:0/1295781500 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb5405ca90 0x7ffb54063e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:43.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:42.636+0000 7ffb53fff700 1 -- 172.21.15.62:0/1295781500 >> 172.21.15.62:0/1295781500 conn(0x7ffb5405bcd0 msgr2=0x7ffb54144f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:43.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:42.636+0000 7ffb53fff700 1 -- 172.21.15.62:0/1295781500 shutdown_connections 2021-12-17T18:21:43.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:42.636+0000 7ffb53fff700 1 -- 172.21.15.62:0/1295781500 wait complete. 2021-12-17T18:21:43.406 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2021-12-17T18:21:43.407 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-12-17T18:21:43.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.524+0000 7f407b59e700 1 Processor -- start 2021-12-17T18:21:43.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.524+0000 7f407b59e700 1 -- start start 2021-12-17T18:21:43.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.524+0000 7f407b59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f407c0b0310 0x7f407c0aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:43.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.524+0000 7f407b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f407c14b4e0 con 0x7f407c0ae820 2021-12-17T18:21:43.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.524+0000 7f407b59e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f407c0b2980 con 0x7f407c0afe00 2021-12-17T18:21:43.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.524+0000 7f407b59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407c14b710 con 0x7f407c0b0310 2021-12-17T18:21:43.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.524+0000 7f407a59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f407c0ae820 0x7f407c141100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34012/0 (socket says 172.21.15.62:34012) 2021-12-17T18:21:43.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.524+0000 7f407a59c700 1 -- 172.21.15.62:0/3928895479 learned_addr learned my addr 172.21.15.62:0/3928895479 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:43.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f4079d9b700 1 --2- 172.21.15.62:0/3928895479 >> v2:172.21.15.109:3300/0 conn(0x7f407c0b0310 0x7f407c0aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:43.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f407959a700 1 -- 172.21.15.62:0/3928895479 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241104928 0 0) 0x7f407c14b4e0 con 0x7f407c0ae820 2021-12-17T18:21:43.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f407959a700 1 -- 172.21.15.62:0/3928895479 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f405c003260 con 0x7f407c0ae820 2021-12-17T18:21:43.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f407959a700 1 -- 172.21.15.62:0/3928895479 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954249070 0 0) 0x7f407c0b2980 con 0x7f407c0afe00 2021-12-17T18:21:43.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f407959a700 1 -- 172.21.15.62:0/3928895479 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f407c14b4e0 con 0x7f407c0afe00 2021-12-17T18:21:43.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f4079d9b700 1 -- 172.21.15.62:0/3928895479 >> v1:172.21.15.109:6789/0 conn(0x7f407c0afe00 legacy=0x7f407c147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:43.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f4079d9b700 1 -- 172.21.15.62:0/3928895479 >> v1:172.21.15.62:6789/0 conn(0x7f407c0ae820 legacy=0x7f407c141100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:43.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f4079d9b700 1 -- 172.21.15.62:0/3928895479 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c0b2c20 con 0x7f407c0b0310 2021-12-17T18:21:43.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f4079d9b700 1 --2- 172.21.15.62:0/3928895479 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f407c0b0310 0x7f407c0aec00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f4064002f70 tx=0x7f4064006df0).ready entity=mon.1 client_cookie=3e174ecfe015924 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:43.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f407959a700 1 -- 172.21.15.62:0/3928895479 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f406400d540 con 0x7f407c0b0310 2021-12-17T18:21:43.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f407959a700 1 -- 172.21.15.62:0/3928895479 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4064000e90 con 0x7f407c0b0310 2021-12-17T18:21:43.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f407959a700 1 -- 172.21.15.62:0/3928895479 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f406400d890 con 0x7f407c0b0310 2021-12-17T18:21:43.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f407b59e700 1 -- 172.21.15.62:0/3928895479 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f407c0b0310 msgr2=0x7f407c0aec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:43.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f407b59e700 1 --2- 172.21.15.62:0/3928895479 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f407c0b0310 0x7f407c0aec00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f4064002f70 tx=0x7f4064006df0).stop 2021-12-17T18:21:43.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f407b59e700 1 -- 172.21.15.62:0/3928895479 shutdown_connections 2021-12-17T18:21:43.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f407b59e700 1 --2- 172.21.15.62:0/3928895479 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f407c0b0310 0x7f407c0aec00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:43.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f407b59e700 1 -- 172.21.15.62:0/3928895479 >> 172.21.15.62:0/3928895479 conn(0x7f407c062430 msgr2=0x7f407c062840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:43.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f407b59e700 1 -- 172.21.15.62:0/3928895479 shutdown_connections 2021-12-17T18:21:43.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.528+0000 7f407b59e700 1 -- 172.21.15.62:0/3928895479 wait complete. 2021-12-17T18:21:43.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f407b59e700 1 Processor -- start 2021-12-17T18:21:43.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f407b59e700 1 -- start start 2021-12-17T18:21:43.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f407b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f407c0ae820 0x7f407c064180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:43.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f407b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f407c0afe00 0x7f407c1436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:43.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f407b59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f407c0b0310 0x7f407c0668f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:43.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f407b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c142d30 con 0x7f407c0afe00 2021-12-17T18:21:43.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f407b59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c141cd0 con 0x7f407c0b0310 2021-12-17T18:21:43.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f407b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407c142110 con 0x7f407c0ae820 2021-12-17T18:21:43.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f4079d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f407c0afe00 0x7f407c1436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:43.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f4079d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f407c0afe00 0x7f407c1436e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50440/0 (socket says 172.21.15.62:50440) 2021-12-17T18:21:43.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f4079d9b700 1 -- 172.21.15.62:0/29180945 learned_addr learned my addr 172.21.15.62:0/29180945 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:43.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f407a59c700 1 --2- 172.21.15.62:0/29180945 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f407c0ae820 0x7f407c064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:43.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f407ad9d700 1 --2- 172.21.15.62:0/29180945 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f407c0b0310 0x7f407c0668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:43.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f4079d9b700 1 -- 172.21.15.62:0/29180945 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f407c0ae820 msgr2=0x7f407c064180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:43.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f4079d9b700 1 --2- 172.21.15.62:0/29180945 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f407c0ae820 0x7f407c064180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:43.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f4079d9b700 1 -- 172.21.15.62:0/29180945 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f407c0b0310 msgr2=0x7f407c0668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:43.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f4079d9b700 1 --2- 172.21.15.62:0/29180945 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f407c0b0310 0x7f407c0668f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:43.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f4079d9b700 1 -- 172.21.15.62:0/29180945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406400b180 con 0x7f407c0afe00 2021-12-17T18:21:43.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f4079d9b700 1 --2- 172.21.15.62:0/29180945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f407c0afe00 0x7f407c1436e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f4064002f70 tx=0x7f4064014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:43.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f40737fe700 1 -- 172.21.15.62:0/29180945 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4064016070 con 0x7f407c0afe00 2021-12-17T18:21:43.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f40737fe700 1 -- 172.21.15.62:0/29180945 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40640138d0 con 0x7f407c0afe00 2021-12-17T18:21:43.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f407b59e700 1 -- 172.21.15.62:0/29180945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407c1476b0 con 0x7f407c0afe00 2021-12-17T18:21:43.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f40737fe700 1 -- 172.21.15.62:0/29180945 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4064013c30 con 0x7f407c0afe00 2021-12-17T18:21:43.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.532+0000 7f407b59e700 1 -- 172.21.15.62:0/29180945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407c143d70 con 0x7f407c0afe00 2021-12-17T18:21:43.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.536+0000 7f407b59e700 1 -- 172.21.15.62:0/29180945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407c063f60 con 0x7f407c0afe00 2021-12-17T18:21:43.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.536+0000 7f40737fe700 1 -- 172.21.15.62:0/29180945 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4064025030 con 0x7f407c0afe00 2021-12-17T18:21:43.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.536+0000 7f40737fe700 1 --2- 172.21.15.62:0/29180945 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4060053640 0x7f4060055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:43.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.536+0000 7f40737fe700 1 -- 172.21.15.62:0/29180945 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f406406c500 con 0x7f407c0afe00 2021-12-17T18:21:43.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.536+0000 7f407a59c700 1 --2- 172.21.15.62:0/29180945 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4060053640 0x7f4060055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:43.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.536+0000 7f407a59c700 1 --2- 172.21.15.62:0/29180945 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4060053640 0x7f4060055b00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f407400d000 tx=0x7f4074009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:43.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.544+0000 7f40737fe700 1 -- 172.21.15.62:0/29180945 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4064043940 con 0x7f407c0afe00 2021-12-17T18:21:43.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.680+0000 7f407b59e700 1 -- 172.21.15.62:0/29180945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f407c141e90 con 0x7f407c0afe00 2021-12-17T18:21:43.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.688+0000 7f40737fe700 1 -- 172.21.15.62:0/29180945 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f40640230a0 con 0x7f407c0afe00 2021-12-17T18:21:43.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.688+0000 7f407b59e700 1 -- 172.21.15.62:0/29180945 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4060053640 msgr2=0x7f4060055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:43.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.688+0000 7f407b59e700 1 --2- 172.21.15.62:0/29180945 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4060053640 0x7f4060055b00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f407400d000 tx=0x7f4074009040).stop 2021-12-17T18:21:43.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.688+0000 7f407b59e700 1 -- 172.21.15.62:0/29180945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f407c0afe00 msgr2=0x7f407c1436e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:43.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.688+0000 7f407b59e700 1 --2- 172.21.15.62:0/29180945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f407c0afe00 0x7f407c1436e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f4064002f70 tx=0x7f4064014000).stop 2021-12-17T18:21:43.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.688+0000 7f407b59e700 1 -- 172.21.15.62:0/29180945 shutdown_connections 2021-12-17T18:21:43.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.688+0000 7f407b59e700 1 --2- 172.21.15.62:0/29180945 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4060053640 0x7f4060055b00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:43.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.688+0000 7f407b59e700 1 --2- 172.21.15.62:0/29180945 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f407c0b0310 0x7f407c0668f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:43.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.688+0000 7f407b59e700 1 --2- 172.21.15.62:0/29180945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f407c0afe00 0x7f407c1436e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:43.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.688+0000 7f407b59e700 1 --2- 172.21.15.62:0/29180945 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f407c0ae820 0x7f407c064180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:43.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.688+0000 7f407b59e700 1 -- 172.21.15.62:0/29180945 >> 172.21.15.62:0/29180945 conn(0x7f407c062430 msgr2=0x7f407c0b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:43.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.688+0000 7f407b59e700 1 -- 172.21.15.62:0/29180945 shutdown_connections 2021-12-17T18:21:43.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.688+0000 7f407b59e700 1 -- 172.21.15.62:0/29180945 wait complete. 2021-12-17T18:21:43.704 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-12-17T18:21:43.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.800+0000 7f231bfff700 1 Processor -- start 2021-12-17T18:21:43.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.800+0000 7f231bfff700 1 -- start start 2021-12-17T18:21:43.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f231c0b3a40 0x7f231c0b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:43.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231bfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f231c0b07d0 0x7f231c1432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:43.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231bfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231c0b3e20 con 0x7f231c067870 2021-12-17T18:21:43.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231bfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231c0af900 con 0x7f231c0b3a40 2021-12-17T18:21:43.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231bfff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231c0afba0 con 0x7f231c0b07d0 2021-12-17T18:21:43.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231affd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f231c0b3a40 0x7f231c0b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:43.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231b7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f231c067870 0x7f231c1437b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34028/0 (socket says 172.21.15.62:34028) 2021-12-17T18:21:43.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231b7fe700 1 -- 172.21.15.62:0/1787571726 learned_addr learned my addr 172.21.15.62:0/1787571726 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:43.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231a7fc700 1 --2- 172.21.15.62:0/1787571726 >> v2:172.21.15.109:3300/0 conn(0x7f231c0b07d0 0x7f231c1432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:43.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231affd700 1 -- 172.21.15.62:0/1787571726 >> v2:172.21.15.109:3300/0 conn(0x7f231c0b07d0 msgr2=0x7f231c1432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:43.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231affd700 1 --2- 172.21.15.62:0/1787571726 >> v2:172.21.15.109:3300/0 conn(0x7f231c0b07d0 0x7f231c1432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:43.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231affd700 1 -- 172.21.15.62:0/1787571726 >> v1:172.21.15.62:6789/0 conn(0x7f231c067870 legacy=0x7f231c1437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:43.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f2319ffb700 1 -- 172.21.15.62:0/1787571726 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130177292 0 0) 0x7f231c0b3e20 con 0x7f231c067870 2021-12-17T18:21:43.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231affd700 1 -- 172.21.15.62:0/1787571726 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c0afe40 con 0x7f231c0b3a40 2021-12-17T18:21:43.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231affd700 1 --2- 172.21.15.62:0/1787571726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f231c0b3a40 0x7f231c0b02e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f230c002f70 tx=0x7f230c006df0).ready entity=mon.0 client_cookie=17a76d1303369a68 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:43.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f2319ffb700 1 -- 172.21.15.62:0/1787571726 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230c00d5c0 con 0x7f231c0b3a40 2021-12-17T18:21:43.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f2319ffb700 1 -- 172.21.15.62:0/1787571726 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c000e90 con 0x7f231c0b3a40 2021-12-17T18:21:43.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f2319ffb700 1 -- 172.21.15.62:0/1787571726 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230c00d910 con 0x7f231c0b3a40 2021-12-17T18:21:43.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231bfff700 1 -- 172.21.15.62:0/1787571726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f231c0b3a40 msgr2=0x7f231c0b02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:43.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231bfff700 1 --2- 172.21.15.62:0/1787571726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f231c0b3a40 0x7f231c0b02e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f230c002f70 tx=0x7f230c006df0).stop 2021-12-17T18:21:43.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231bfff700 1 -- 172.21.15.62:0/1787571726 shutdown_connections 2021-12-17T18:21:43.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231bfff700 1 --2- 172.21.15.62:0/1787571726 >> v2:172.21.15.109:3300/0 conn(0x7f231c0b07d0 0x7f231c1432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:43.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231bfff700 1 --2- 172.21.15.62:0/1787571726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f231c0b3a40 0x7f231c0b02e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:43.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231bfff700 1 -- 172.21.15.62:0/1787571726 >> 172.21.15.62:0/1787571726 conn(0x7f231c0b7020 msgr2=0x7f231c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:43.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.804+0000 7f231bfff700 1 -- 172.21.15.62:0/1787571726 shutdown_connections 2021-12-17T18:21:43.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.808+0000 7f231bfff700 1 -- 172.21.15.62:0/1787571726 wait complete. 2021-12-17T18:21:43.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.808+0000 7f231bfff700 1 Processor -- start 2021-12-17T18:21:43.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.808+0000 7f231bfff700 1 -- start start 2021-12-17T18:21:43.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f231c067870 0x7f231c10fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:43.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231bfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f231c0b07d0 0x7f231c14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:43.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231bfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f231c0b3a40 0x7f231c063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:43.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c066480 con 0x7f231c067870 2021-12-17T18:21:43.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231bfff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c065c90 con 0x7f231c0b3a40 2021-12-17T18:21:43.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231bfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231c065f40 con 0x7f231c0b07d0 2021-12-17T18:21:43.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f231c067870 0x7f231c10fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:43.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f231c067870 0x7f231c10fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50452/0 (socket says 172.21.15.62:50452) 2021-12-17T18:21:43.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231affd700 1 -- 172.21.15.62:0/3086642087 learned_addr learned my addr 172.21.15.62:0/3086642087 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:43.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231b7fe700 1 --2- 172.21.15.62:0/3086642087 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f231c0b3a40 0x7f231c063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:43.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231a7fc700 1 --2- 172.21.15.62:0/3086642087 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f231c0b07d0 0x7f231c14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:43.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231affd700 1 -- 172.21.15.62:0/3086642087 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f231c0b07d0 msgr2=0x7f231c14ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:43.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231affd700 1 --2- 172.21.15.62:0/3086642087 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f231c0b07d0 0x7f231c14ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:43.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231affd700 1 -- 172.21.15.62:0/3086642087 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f231c0b3a40 msgr2=0x7f231c063620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:43.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231affd700 1 --2- 172.21.15.62:0/3086642087 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f231c0b3a40 0x7f231c063620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:43.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231affd700 1 -- 172.21.15.62:0/3086642087 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c00b180 con 0x7f231c067870 2021-12-17T18:21:43.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231a7fc700 1 --2- 172.21.15.62:0/3086642087 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f231c0b07d0 0x7f231c14ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:21:43.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231affd700 1 --2- 172.21.15.62:0/3086642087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f231c067870 0x7f231c10fa80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f230c002f70 tx=0x7f230c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:43.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f230bfff700 1 -- 172.21.15.62:0/3086642087 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230c016070 con 0x7f231c067870 2021-12-17T18:21:43.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f230bfff700 1 -- 172.21.15.62:0/3086642087 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c00de40 con 0x7f231c067870 2021-12-17T18:21:43.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231bfff700 1 -- 172.21.15.62:0/3086642087 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231c0661e0 con 0x7f231c067870 2021-12-17T18:21:43.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f230bfff700 1 -- 172.21.15.62:0/3086642087 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230c013e50 con 0x7f231c067870 2021-12-17T18:21:43.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231bfff700 1 -- 172.21.15.62:0/3086642087 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231c066fa0 con 0x7f231c067870 2021-12-17T18:21:43.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f231bfff700 1 -- 172.21.15.62:0/3086642087 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231c0675b0 con 0x7f231c067870 2021-12-17T18:21:43.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f230bfff700 1 -- 172.21.15.62:0/3086642087 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f230c025030 con 0x7f231c067870 2021-12-17T18:21:43.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.812+0000 7f230bfff700 1 --2- 172.21.15.62:0/3086642087 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22f8053640 0x7f22f8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:43.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.816+0000 7f230bfff700 1 -- 172.21.15.62:0/3086642087 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f230c06c580 con 0x7f231c067870 2021-12-17T18:21:43.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.816+0000 7f231a7fc700 1 --2- 172.21.15.62:0/3086642087 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22f8053640 0x7f22f8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:43.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.816+0000 7f231a7fc700 1 --2- 172.21.15.62:0/3086642087 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22f8053640 0x7f22f8055b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f231000c000 tx=0x7f2310008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:43.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.820+0000 7f230bfff700 1 -- 172.21.15.62:0/3086642087 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f231c0675b0 con 0x7f231c067870 2021-12-17T18:21:43.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:43.988+0000 7f231bfff700 1 -- 172.21.15.62:0/3086642087 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f231c0675b0 con 0x7f231c067870 2021-12-17T18:21:44.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.652+0000 7f230bfff700 1 -- 172.21.15.62:0/3086642087 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v156) v1 ==== 144+0+0 (secure 0 0 0) 0x7f231c0675b0 con 0x7f231c067870 2021-12-17T18:21:44.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.656+0000 7f231bfff700 1 -- 172.21.15.62:0/3086642087 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22f8053640 msgr2=0x7f22f8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:44.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.656+0000 7f231bfff700 1 --2- 172.21.15.62:0/3086642087 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22f8053640 0x7f22f8055b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f231000c000 tx=0x7f2310008040).stop 2021-12-17T18:21:44.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.656+0000 7f231bfff700 1 -- 172.21.15.62:0/3086642087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f231c067870 msgr2=0x7f231c10fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:44.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.656+0000 7f231bfff700 1 --2- 172.21.15.62:0/3086642087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f231c067870 0x7f231c10fa80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f230c002f70 tx=0x7f230c014000).stop 2021-12-17T18:21:44.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.656+0000 7f231bfff700 1 -- 172.21.15.62:0/3086642087 shutdown_connections 2021-12-17T18:21:44.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.656+0000 7f231bfff700 1 --2- 172.21.15.62:0/3086642087 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22f8053640 0x7f22f8055b00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:44.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.656+0000 7f231bfff700 1 --2- 172.21.15.62:0/3086642087 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f231c0b3a40 0x7f231c063620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:44.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.656+0000 7f231bfff700 1 --2- 172.21.15.62:0/3086642087 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f231c0b07d0 0x7f231c14ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:44.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.656+0000 7f231bfff700 1 --2- 172.21.15.62:0/3086642087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f231c067870 0x7f231c10fa80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:44.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.656+0000 7f231bfff700 1 -- 172.21.15.62:0/3086642087 >> 172.21.15.62:0/3086642087 conn(0x7f231c0b7020 msgr2=0x7f231c0b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:44.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.656+0000 7f231bfff700 1 -- 172.21.15.62:0/3086642087 shutdown_connections 2021-12-17T18:21:44.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.656+0000 7f231bfff700 1 -- 172.21.15.62:0/3086642087 wait complete. 2021-12-17T18:21:44.676 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-12-17T18:21:44.677 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-12-17T18:21:44.677 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-12-17T18:21:44.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcbed9a700 1 Processor -- start 2021-12-17T18:21:44.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcbed9a700 1 -- start start 2021-12-17T18:21:44.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcbed9a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efcb80b1730 0x7efcb80ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:44.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcbed9a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efcb80a7bb0 0x7efcb8067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:44.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcbed9a700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb80b2ce0 con 0x7efcb80b21f0 2021-12-17T18:21:44.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcbed9a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb814b5b0 con 0x7efcb80a7bb0 2021-12-17T18:21:44.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcbed9a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb8147870 con 0x7efcb80b1730 2021-12-17T18:21:44.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcbd337700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efcb80a7bb0 0x7efcb8067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:44.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcbd337700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efcb80a7bb0 0x7efcb8067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50464/0 (socket says 172.21.15.62:50464) 2021-12-17T18:21:44.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcbd337700 1 -- 172.21.15.62:0/514172101 learned_addr learned my addr 172.21.15.62:0/514172101 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:44.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcb7fff700 1 --2- 172.21.15.62:0/514172101 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efcb80b1730 0x7efcb80ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:44.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcbd337700 1 -- 172.21.15.62:0/514172101 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efcb80b1730 msgr2=0x7efcb80ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:44.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcbd337700 1 --2- 172.21.15.62:0/514172101 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efcb80b1730 0x7efcb80ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:44.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcbd337700 1 -- 172.21.15.62:0/514172101 >> v1:172.21.15.109:6789/0 conn(0x7efcb80b21f0 legacy=0x7efcb814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:44.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcbd337700 1 -- 172.21.15.62:0/514172101 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb80aca60 con 0x7efcb80a7bb0 2021-12-17T18:21:44.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcb7fff700 1 --2- 172.21.15.62:0/514172101 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efcb80b1730 0x7efcb80ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:21:44.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcbd337700 1 --2- 172.21.15.62:0/514172101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcb80a7bb0 0x7efcb8067120 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7efcb00032f0 tx=0x7efcb0009290).ready entity=mon.0 client_cookie=bf6af63310ea98a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:44.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcb77fe700 1 -- 172.21.15.62:0/514172101 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcb000b8a0 con 0x7efcb80a7bb0 2021-12-17T18:21:44.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcb77fe700 1 -- 172.21.15.62:0/514172101 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb000ba00 con 0x7efcb80a7bb0 2021-12-17T18:21:44.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.788+0000 7efcb77fe700 1 -- 172.21.15.62:0/514172101 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcb000bb70 con 0x7efcb80a7bb0 2021-12-17T18:21:44.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbed9a700 1 -- 172.21.15.62:0/514172101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcb80a7bb0 msgr2=0x7efcb8067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:44.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbed9a700 1 --2- 172.21.15.62:0/514172101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcb80a7bb0 0x7efcb8067120 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7efcb00032f0 tx=0x7efcb0009290).stop 2021-12-17T18:21:44.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbed9a700 1 -- 172.21.15.62:0/514172101 shutdown_connections 2021-12-17T18:21:44.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbed9a700 1 --2- 172.21.15.62:0/514172101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcb80a7bb0 0x7efcb8067120 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:44.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbed9a700 1 --2- 172.21.15.62:0/514172101 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efcb80b1730 0x7efcb80ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:44.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbed9a700 1 -- 172.21.15.62:0/514172101 >> 172.21.15.62:0/514172101 conn(0x7efcb805f730 msgr2=0x7efcb805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:44.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbed9a700 1 -- 172.21.15.62:0/514172101 shutdown_connections 2021-12-17T18:21:44.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbed9a700 1 -- 172.21.15.62:0/514172101 wait complete. 2021-12-17T18:21:44.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbed9a700 1 Processor -- start 2021-12-17T18:21:44.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbed9a700 1 -- start start 2021-12-17T18:21:44.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbed9a700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efcb80a7bb0 0x7efcb80ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:44.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbed9a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efcb80b1730 0x7efcb80667c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:44.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbed9a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcb80b21f0 0x7efcb81572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:44.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbed9a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb8065e50 con 0x7efcb80b21f0 2021-12-17T18:21:44.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbed9a700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb8066080 con 0x7efcb80a7bb0 2021-12-17T18:21:44.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbed9a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb8066320 con 0x7efcb80b1730 2021-12-17T18:21:44.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbd337700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcb80b21f0 0x7efcb81572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:44.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcbcb36700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efcb80a7bb0 0x7efcb80ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:44.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcb7fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efcb80b1730 0x7efcb80667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:44.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcb7fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efcb80b1730 0x7efcb80667c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:44170/0 (socket says 172.21.15.62:44170) 2021-12-17T18:21:44.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.792+0000 7efcb7fff700 1 -- 172.21.15.62:0/1135141659 learned_addr learned my addr 172.21.15.62:0/1135141659 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:44.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.796+0000 7efcbd337700 1 -- 172.21.15.62:0/1135141659 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efcb80b1730 msgr2=0x7efcb80667c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:44.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.796+0000 7efcbd337700 1 --2- 172.21.15.62:0/1135141659 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efcb80b1730 0x7efcb80667c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:44.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.796+0000 7efcbd337700 1 -- 172.21.15.62:0/1135141659 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efcb80a7bb0 msgr2=0x7efcb80ac2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:44.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.796+0000 7efcbd337700 1 --2- 172.21.15.62:0/1135141659 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efcb80a7bb0 0x7efcb80ac2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:44.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.796+0000 7efcbd337700 1 -- 172.21.15.62:0/1135141659 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca800b180 con 0x7efcb80b21f0 2021-12-17T18:21:44.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.796+0000 7efcbd337700 1 --2- 172.21.15.62:0/1135141659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcb80b21f0 0x7efcb81572f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7efcb00032f0 tx=0x7efcb0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:44.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.796+0000 7efcb5ffb700 1 -- 172.21.15.62:0/1135141659 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcb000b8a0 con 0x7efcb80b21f0 2021-12-17T18:21:44.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.796+0000 7efcb5ffb700 1 -- 172.21.15.62:0/1135141659 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb0021440 con 0x7efcb80b21f0 2021-12-17T18:21:44.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.796+0000 7efcbed9a700 1 -- 172.21.15.62:0/1135141659 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb0009530 con 0x7efcb80b21f0 2021-12-17T18:21:44.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.796+0000 7efcb5ffb700 1 -- 172.21.15.62:0/1135141659 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcb00217a0 con 0x7efcb80b21f0 2021-12-17T18:21:44.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.796+0000 7efcbed9a700 1 -- 172.21.15.62:0/1135141659 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb80636a0 con 0x7efcb80b21f0 2021-12-17T18:21:44.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.796+0000 7efcb5ffb700 1 -- 172.21.15.62:0/1135141659 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efcb0027020 con 0x7efcb80b21f0 2021-12-17T18:21:44.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.796+0000 7efcbed9a700 1 -- 172.21.15.62:0/1135141659 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb80b2f10 con 0x7efcb80b21f0 2021-12-17T18:21:44.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.796+0000 7efcb5ffb700 1 --2- 172.21.15.62:0/1135141659 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efc980536a0 0x7efc98055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:44.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.796+0000 7efcb5ffb700 1 -- 172.21.15.62:0/1135141659 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5339+0+0 (secure 0 0 0) 0x7efcb006cbb0 con 0x7efcb80b21f0 2021-12-17T18:21:44.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.796+0000 7efcbcb36700 1 --2- 172.21.15.62:0/1135141659 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efc980536a0 0x7efc98055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:44.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.800+0000 7efcbcb36700 1 --2- 172.21.15.62:0/1135141659 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efc980536a0 0x7efc98055b60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7efcac00d000 tx=0x7efcac007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:44.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.804+0000 7efcb5ffb700 1 -- 172.21.15.62:0/1135141659 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efcb0043ee0 con 0x7efcb80b21f0 2021-12-17T18:21:44.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:44.976+0000 7efcbed9a700 1 -- 172.21.15.62:0/1135141659 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7efcb80573d0 con 0x7efcb80b21f0 2021-12-17T18:21:45.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.664+0000 7efcb5ffb700 1 -- 172.21.15.62:0/1135141659 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v157) v1 ==== 155+0+0 (secure 0 0 0) 0x7efcb0015020 con 0x7efcb80b21f0 2021-12-17T18:21:45.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.668+0000 7efcbed9a700 1 -- 172.21.15.62:0/1135141659 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efc980536a0 msgr2=0x7efc98055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:45.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.668+0000 7efcbed9a700 1 --2- 172.21.15.62:0/1135141659 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efc980536a0 0x7efc98055b60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7efcac00d000 tx=0x7efcac007b90).stop 2021-12-17T18:21:45.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.668+0000 7efcbed9a700 1 -- 172.21.15.62:0/1135141659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcb80b21f0 msgr2=0x7efcb81572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:45.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.668+0000 7efcbed9a700 1 --2- 172.21.15.62:0/1135141659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcb80b21f0 0x7efcb81572f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7efcb00032f0 tx=0x7efcb0016000).stop 2021-12-17T18:21:45.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.668+0000 7efcbed9a700 1 -- 172.21.15.62:0/1135141659 shutdown_connections 2021-12-17T18:21:45.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.668+0000 7efcbed9a700 1 --2- 172.21.15.62:0/1135141659 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efc980536a0 0x7efc98055b60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:45.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.668+0000 7efcbed9a700 1 --2- 172.21.15.62:0/1135141659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcb80b21f0 0x7efcb81572f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:45.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.668+0000 7efcbed9a700 1 --2- 172.21.15.62:0/1135141659 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efcb80b1730 0x7efcb80667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:45.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.668+0000 7efcbed9a700 1 --2- 172.21.15.62:0/1135141659 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efcb80a7bb0 0x7efcb80ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:45.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.668+0000 7efcbed9a700 1 -- 172.21.15.62:0/1135141659 >> 172.21.15.62:0/1135141659 conn(0x7efcb805f730 msgr2=0x7efcb80ad7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:45.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.668+0000 7efcbed9a700 1 -- 172.21.15.62:0/1135141659 shutdown_connections 2021-12-17T18:21:45.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.668+0000 7efcbed9a700 1 -- 172.21.15.62:0/1135141659 wait complete. 2021-12-17T18:21:45.688 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-12-17T18:21:45.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52b094f700 1 Processor -- start 2021-12-17T18:21:45.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52b094f700 1 -- start start 2021-12-17T18:21:45.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52b094f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f52ac05d0a0 0x7f52ac0b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:45.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52b094f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f52ac146900 0x7f52ac146d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:45.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52b094f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ac060af0 con 0x7f52ac0b41f0 2021-12-17T18:21:45.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52b094f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ac05d480 con 0x7f52ac146900 2021-12-17T18:21:45.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52b094f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ac0b2b00 con 0x7f52ac05d0a0 2021-12-17T18:21:45.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52aad9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f52ac146900 0x7f52ac146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:45.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52aa59c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f52ac05d0a0 0x7f52ac0b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:45.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52aa59c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f52ac05d0a0 0x7f52ac0b2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:57024/0 (socket says 172.21.15.62:57024) 2021-12-17T18:21:45.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52aad9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f52ac146900 0x7f52ac146d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50478/0 (socket says 172.21.15.62:50478) 2021-12-17T18:21:45.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52aa59c700 1 -- 172.21.15.62:0/205525439 learned_addr learned my addr 172.21.15.62:0/205525439 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:45.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52a9d9b700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f52ac0b41f0 0x7f52ac0b9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:50374/0 (socket says 172.21.15.62:50374) 2021-12-17T18:21:45.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52aad9d700 1 -- 172.21.15.62:0/205525439 >> v2:172.21.15.109:3300/0 conn(0x7f52ac05d0a0 msgr2=0x7f52ac0b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:45.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52aad9d700 1 --2- 172.21.15.62:0/205525439 >> v2:172.21.15.109:3300/0 conn(0x7f52ac05d0a0 0x7f52ac0b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:45.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52aad9d700 1 -- 172.21.15.62:0/205525439 >> v1:172.21.15.109:6789/0 conn(0x7f52ac0b41f0 legacy=0x7f52ac0b9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:45.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52aad9d700 1 -- 172.21.15.62:0/205525439 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac0b98a0 con 0x7f52ac146900 2021-12-17T18:21:45.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52a959a700 1 -- 172.21.15.62:0/205525439 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762226357 0 0) 0x7f52ac060af0 con 0x7f52ac0b41f0 2021-12-17T18:21:45.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.804+0000 7f52aa59c700 1 --2- 172.21.15.62:0/205525439 >> v2:172.21.15.109:3300/0 conn(0x7f52ac05d0a0 0x7f52ac0b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:21:45.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.808+0000 7f52aad9d700 1 --2- 172.21.15.62:0/205525439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52ac146900 0x7f52ac146d30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f52a40032f0 tx=0x7f52a40091d0).ready entity=mon.0 client_cookie=c41934971535d249 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:45.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.808+0000 7f52a959a700 1 -- 172.21.15.62:0/205525439 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52a400b680 con 0x7f52ac146900 2021-12-17T18:21:45.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.808+0000 7f52a959a700 1 -- 172.21.15.62:0/205525439 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a400b7e0 con 0x7f52ac146900 2021-12-17T18:21:45.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.808+0000 7f52a959a700 1 -- 172.21.15.62:0/205525439 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52a400b950 con 0x7f52ac146900 2021-12-17T18:21:45.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.808+0000 7f52b094f700 1 -- 172.21.15.62:0/205525439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52ac146900 msgr2=0x7f52ac146d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:45.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.808+0000 7f52b094f700 1 --2- 172.21.15.62:0/205525439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52ac146900 0x7f52ac146d30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f52a40032f0 tx=0x7f52a40091d0).stop 2021-12-17T18:21:45.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.808+0000 7f52b094f700 1 -- 172.21.15.62:0/205525439 shutdown_connections 2021-12-17T18:21:45.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.808+0000 7f52b094f700 1 --2- 172.21.15.62:0/205525439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52ac146900 0x7f52ac146d30 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:45.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.808+0000 7f52b094f700 1 --2- 172.21.15.62:0/205525439 >> v2:172.21.15.109:3300/0 conn(0x7f52ac05d0a0 0x7f52ac0b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:45.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.808+0000 7f52b094f700 1 -- 172.21.15.62:0/205525439 >> 172.21.15.62:0/205525439 conn(0x7f52ac062510 msgr2=0x7f52ac0628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:45.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.808+0000 7f52b094f700 1 -- 172.21.15.62:0/205525439 shutdown_connections 2021-12-17T18:21:45.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.808+0000 7f52b094f700 1 -- 172.21.15.62:0/205525439 wait complete. 2021-12-17T18:21:45.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.808+0000 7f52b094f700 1 Processor -- start 2021-12-17T18:21:45.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.808+0000 7f52b094f700 1 -- start start 2021-12-17T18:21:45.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.808+0000 7f52b094f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52ac05d0a0 0x7f52ac14e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:45.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52b094f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f52ac0b41f0 0x7f52ac156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:45.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52b094f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f52ac146900 0x7f52ac156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:45.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52b094f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac14a180 con 0x7f52ac05d0a0 2021-12-17T18:21:45.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52b094f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac149ee0 con 0x7f52ac0b41f0 2021-12-17T18:21:45.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52b094f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac0b8e30 con 0x7f52ac146900 2021-12-17T18:21:45.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52aa59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52ac05d0a0 0x7f52ac14e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:45.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52aa59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52ac05d0a0 0x7f52ac14e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50480/0 (socket says 172.21.15.62:50480) 2021-12-17T18:21:45.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52aa59c700 1 -- 172.21.15.62:0/45609805 learned_addr learned my addr 172.21.15.62:0/45609805 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:45.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52a9d9b700 1 --2- 172.21.15.62:0/45609805 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f52ac0b41f0 0x7f52ac156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:45.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52aad9d700 1 --2- 172.21.15.62:0/45609805 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f52ac146900 0x7f52ac156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:45.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52aa59c700 1 -- 172.21.15.62:0/45609805 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f52ac146900 msgr2=0x7f52ac156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:45.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52aa59c700 1 --2- 172.21.15.62:0/45609805 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f52ac146900 0x7f52ac156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:45.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52aa59c700 1 -- 172.21.15.62:0/45609805 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f52ac0b41f0 msgr2=0x7f52ac156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:45.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52aa59c700 1 --2- 172.21.15.62:0/45609805 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f52ac0b41f0 0x7f52ac156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:45.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52aa59c700 1 -- 172.21.15.62:0/45609805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c00b1e0 con 0x7f52ac05d0a0 2021-12-17T18:21:45.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52aad9d700 1 --2- 172.21.15.62:0/45609805 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f52ac146900 0x7f52ac156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:21:45.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52aa59c700 1 --2- 172.21.15.62:0/45609805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52ac05d0a0 0x7f52ac14e840 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f529c00c000 tx=0x7f529c006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:45.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f529b7fe700 1 -- 172.21.15.62:0/45609805 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f529c012600 con 0x7f52ac05d0a0 2021-12-17T18:21:45.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f529b7fe700 1 -- 172.21.15.62:0/45609805 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c012760 con 0x7f52ac05d0a0 2021-12-17T18:21:45.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52b094f700 1 -- 172.21.15.62:0/45609805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a4009470 con 0x7f52ac05d0a0 2021-12-17T18:21:45.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f529b7fe700 1 -- 172.21.15.62:0/45609805 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f529c012ac0 con 0x7f52ac05d0a0 2021-12-17T18:21:45.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52b094f700 1 -- 172.21.15.62:0/45609805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ac144c50 con 0x7f52ac05d0a0 2021-12-17T18:21:45.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f52b094f700 1 -- 172.21.15.62:0/45609805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ac0573d0 con 0x7f52ac05d0a0 2021-12-17T18:21:45.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.812+0000 7f529b7fe700 1 -- 172.21.15.62:0/45609805 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f529c022070 con 0x7f52ac05d0a0 2021-12-17T18:21:45.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.816+0000 7f529b7fe700 1 --2- 172.21.15.62:0/45609805 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f52880536d0 0x7f5288055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:45.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.816+0000 7f529b7fe700 1 -- 172.21.15.62:0/45609805 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f529c06bbb0 con 0x7f52ac05d0a0 2021-12-17T18:21:45.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.816+0000 7f52a9d9b700 1 --2- 172.21.15.62:0/45609805 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f52880536d0 0x7f5288055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:45.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.816+0000 7f52a9d9b700 1 --2- 172.21.15.62:0/45609805 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f52880536d0 0x7f5288055b90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f52a000d000 tx=0x7f52a0007a00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:45.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.820+0000 7f529b7fe700 1 -- 172.21.15.62:0/45609805 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f529c072080 con 0x7f52ac05d0a0 2021-12-17T18:21:45.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.948+0000 7f52b094f700 1 -- 172.21.15.62:0/45609805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f52ac0b2800 con 0x7f52ac05d0a0 2021-12-17T18:21:45.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.956+0000 7f529b7fe700 1 -- 172.21.15.62:0/45609805 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f529c042f50 con 0x7f52ac05d0a0 2021-12-17T18:21:45.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.960+0000 7f52b094f700 1 -- 172.21.15.62:0/45609805 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f52880536d0 msgr2=0x7f5288055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:45.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.960+0000 7f52b094f700 1 --2- 172.21.15.62:0/45609805 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f52880536d0 0x7f5288055b90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f52a000d000 tx=0x7f52a0007a00).stop 2021-12-17T18:21:45.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.960+0000 7f52b094f700 1 -- 172.21.15.62:0/45609805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52ac05d0a0 msgr2=0x7f52ac14e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:45.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.960+0000 7f52b094f700 1 --2- 172.21.15.62:0/45609805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52ac05d0a0 0x7f52ac14e840 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f529c00c000 tx=0x7f529c006eb0).stop 2021-12-17T18:21:45.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.960+0000 7f52b094f700 1 -- 172.21.15.62:0/45609805 shutdown_connections 2021-12-17T18:21:45.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.960+0000 7f52b094f700 1 --2- 172.21.15.62:0/45609805 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f52880536d0 0x7f5288055b90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:45.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.960+0000 7f52b094f700 1 --2- 172.21.15.62:0/45609805 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f52ac146900 0x7f52ac156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:45.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.960+0000 7f52b094f700 1 --2- 172.21.15.62:0/45609805 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f52ac0b41f0 0x7f52ac156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:45.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.960+0000 7f52b094f700 1 --2- 172.21.15.62:0/45609805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52ac05d0a0 0x7f52ac14e840 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:45.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.960+0000 7f52b094f700 1 -- 172.21.15.62:0/45609805 >> 172.21.15.62:0/45609805 conn(0x7f52ac062510 msgr2=0x7f52ac0b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:45.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.960+0000 7f52b094f700 1 -- 172.21.15.62:0/45609805 shutdown_connections 2021-12-17T18:21:45.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:45.960+0000 7f52b094f700 1 -- 172.21.15.62:0/45609805 wait complete. 2021-12-17T18:21:45.973 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:21:45.974 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:21:45.995 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:21:46.017 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:21:46.038 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:21:46.060 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:21:46.081 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:21:46.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:21:46.082 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:21:46.082 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:21:46.089 INFO:teuthology.orchestra.run.smithi125.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-12-17T18:21:46.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:21:46.091 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-12-17T18:21:46.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:21:46.092 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:21:46.092 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:21:46.108 INFO:teuthology.orchestra.run.smithi158.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:21:46.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:21:46.109 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-12-17T18:21:46.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:21:46.111 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:21:46.112 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:21:46.119 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:21:46.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:21:46.121 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:21:46.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:21:46.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf22fcb700 1 Processor -- start 2021-12-17T18:21:46.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf22fcb700 1 -- start start 2021-12-17T18:21:46.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf22fcb700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fcf1c0b57e0 0x7fcf1c0679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:46.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf22fcb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c0b2e90 con 0x7fcf1c05ffe0 2021-12-17T18:21:46.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf22fcb700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c0b4b70 con 0x7fcf1c0ad360 2021-12-17T18:21:46.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf22fcb700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c0b4e10 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf20d67700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcf1c05ffe0 0x7fcf1c0b32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34070/0 (socket says 172.21.15.62:34070) 2021-12-17T18:21:46.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf20d67700 1 -- 172.21.15.62:0/2097123238 learned_addr learned my addr 172.21.15.62:0/2097123238 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:46.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf21568700 1 --2- 172.21.15.62:0/2097123238 >> v2:172.21.15.109:3300/0 conn(0x7fcf1c0b57e0 0x7fcf1c0679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:46.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf1b7fe700 1 -- 172.21.15.62:0/2097123238 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142814230 0 0) 0x7fcf1c0b2e90 con 0x7fcf1c05ffe0 2021-12-17T18:21:46.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf1b7fe700 1 -- 172.21.15.62:0/2097123238 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcefc003260 con 0x7fcf1c05ffe0 2021-12-17T18:21:46.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf21568700 1 -- 172.21.15.62:0/2097123238 >> v1:172.21.15.109:6789/0 conn(0x7fcf1c0ad360 legacy=0x7fcf1c1438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:46.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf21568700 1 -- 172.21.15.62:0/2097123238 >> v1:172.21.15.62:6789/0 conn(0x7fcf1c05ffe0 legacy=0x7fcf1c0b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:46.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf1b7fe700 1 -- 172.21.15.62:0/2097123238 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 57286702 0 0) 0x7fcefc003260 con 0x7fcf1c05ffe0 2021-12-17T18:21:46.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf21568700 1 -- 172.21.15.62:0/2097123238 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c0b52b0 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf21568700 1 --2- 172.21.15.62:0/2097123238 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf1c0b57e0 0x7fcf1c0679c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fcf04001800 tx=0x7fcf140091d0).ready entity=mon.1 client_cookie=4d2eee9d53ace7cc server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:46.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf1b7fe700 1 -- 172.21.15.62:0/2097123238 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf04001660 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf1b7fe700 1 -- 172.21.15.62:0/2097123238 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1400b520 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf1b7fe700 1 -- 172.21.15.62:0/2097123238 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf1400b690 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf22fcb700 1 -- 172.21.15.62:0/2097123238 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf1c0b57e0 msgr2=0x7fcf1c0679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:46.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf22fcb700 1 --2- 172.21.15.62:0/2097123238 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf1c0b57e0 0x7fcf1c0679c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fcf04001800 tx=0x7fcf140091d0).stop 2021-12-17T18:21:46.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf22fcb700 1 -- 172.21.15.62:0/2097123238 shutdown_connections 2021-12-17T18:21:46.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf22fcb700 1 --2- 172.21.15.62:0/2097123238 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf1c0b57e0 0x7fcf1c0679c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:46.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf22fcb700 1 -- 172.21.15.62:0/2097123238 >> 172.21.15.62:0/2097123238 conn(0x7fcf1c0626d0 msgr2=0x7fcf1c05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:46.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf22fcb700 1 -- 172.21.15.62:0/2097123238 shutdown_connections 2021-12-17T18:21:46.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.232+0000 7fcf22fcb700 1 -- 172.21.15.62:0/2097123238 wait complete. 2021-12-17T18:21:46.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf22fcb700 1 Processor -- start 2021-12-17T18:21:46.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf22fcb700 1 -- start start 2021-12-17T18:21:46.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf22fcb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf1c05ffe0 0x7fcf1c155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:46.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf22fcb700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf1c0ad360 0x7fcf1c146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:46.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf22fcb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c0b57e0 0x7fcf1c0a3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:46.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf22fcb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c142a50 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf22fcb700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c066af0 con 0x7fcf1c0ad360 2021-12-17T18:21:46.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf22fcb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c066d90 con 0x7fcf1c05ffe0 2021-12-17T18:21:46.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf21568700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c0b57e0 0x7fcf1c0a3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:46.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf21568700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c0b57e0 0x7fcf1c0a3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50498/0 (socket says 172.21.15.62:50498) 2021-12-17T18:21:46.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf21568700 1 -- 172.21.15.62:0/902953975 learned_addr learned my addr 172.21.15.62:0/902953975 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:46.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf1bfff700 1 --2- 172.21.15.62:0/902953975 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf1c0ad360 0x7fcf1c146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:46.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf20d67700 1 --2- 172.21.15.62:0/902953975 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf1c05ffe0 0x7fcf1c155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:46.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf21568700 1 -- 172.21.15.62:0/902953975 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf1c05ffe0 msgr2=0x7fcf1c155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:46.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf21568700 1 --2- 172.21.15.62:0/902953975 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf1c05ffe0 0x7fcf1c155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:46.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf21568700 1 -- 172.21.15.62:0/902953975 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf1c0ad360 msgr2=0x7fcf1c146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:46.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf21568700 1 --2- 172.21.15.62:0/902953975 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf1c0ad360 0x7fcf1c146bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:46.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf21568700 1 -- 172.21.15.62:0/902953975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf14009470 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf21568700 1 --2- 172.21.15.62:0/902953975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c0b57e0 0x7fcf1c0a3d30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fcf04001800 tx=0x7fcf14016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:46.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf19ffb700 1 -- 172.21.15.62:0/902953975 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf14011b40 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf19ffb700 1 -- 172.21.15.62:0/902953975 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf14011ca0 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf22fcb700 1 -- 172.21.15.62:0/902953975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1c0641c0 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf19ffb700 1 -- 172.21.15.62:0/902953975 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf14021480 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.236+0000 7fcf22fcb700 1 -- 172.21.15.62:0/902953975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c1470a0 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.240+0000 7fcf22fcb700 1 -- 172.21.15.62:0/902953975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c066f50 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.240+0000 7fcf19ffb700 1 -- 172.21.15.62:0/902953975 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcf1400f070 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.240+0000 7fcf19ffb700 1 --2- 172.21.15.62:0/902953975 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcf00053580 0x7fcf00055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:46.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.240+0000 7fcf19ffb700 1 -- 172.21.15.62:0/902953975 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fcf1406c820 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.240+0000 7fcf20d67700 1 --2- 172.21.15.62:0/902953975 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcf00053580 0x7fcf00055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:46.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.240+0000 7fcf20d67700 1 --2- 172.21.15.62:0/902953975 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcf00053580 0x7fcf00055a40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fcf0400d000 tx=0x7fcf04000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:46.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.244+0000 7fcf19ffb700 1 -- 172.21.15.62:0/902953975 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf14043c60 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.372+0000 7fcf22fcb700 1 -- 172.21.15.62:0/902953975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcf1c066910 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.376+0000 7fcf19ffb700 1 -- 172.21.15.62:0/902953975 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v45) v1 ==== 81+0+28875 (secure 0 0 0) 0x7fcf14015020 con 0x7fcf1c0b57e0 2021-12-17T18:21:46.377 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:21:46.377 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:21:46.378 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 45, 2021-12-17T18:21:46.378 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:21:46.378 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:21:46.378 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:21:42.627509+0000", 2021-12-17T18:21:46.379 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:21:46.379 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:21:46.379 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:21:46.379 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:21:46.380 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:21:46.380 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:21:46.380 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:21:46.380 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:21:46.380 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:21:46.381 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:21:46.381 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:21:46.381 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:21:46.382 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:21:46.382 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:21:46.383 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:21:46.383 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 8, 2021-12-17T18:21:46.383 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:21:46.383 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:21:46.384 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:21:46.384 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:21:46.384 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:21:46.384 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.385 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:21:46.385 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:21:46.385 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:21:46.385 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:21:46.385 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:21:46.386 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:21:46.386 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:21:46.386 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:21:46.386 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:21:46.387 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:21:46.387 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:21:46.387 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:21:46.388 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:21:46.388 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:21:46.388 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:21:46.388 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:21:46.389 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:21:46.389 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:21:46.389 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:21:46.389 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:21:46.390 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:21:46.390 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:21:46.390 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:21:46.390 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.390 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:21:46.391 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:21:46.391 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:21:46.391 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:21:46.391 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:21:46.392 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:21:46.392 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:21:46.392 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:21:46.393 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:21:46.393 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:21:46.393 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:21:46.393 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:21:46.394 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:21:46.394 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:21:46.394 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:21:46.394 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:21:46.395 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:21:46.395 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:21:46.395 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:21:46.395 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:21:46.396 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:21:46.396 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:21:46.396 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:21:46.397 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:21:46.398 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:21:46.398 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:21:46.398 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:21:46.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.399 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:21:46.399 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:21:46.399 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:21:46.399 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:21:46.400 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:21:46.400 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:21:46.400 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:21:46.400 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:21:46.401 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:21:46.401 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:21:46.401 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:21:46.401 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:21:46.401 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:21:46.402 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.402 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:21:46.402 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:21:46.402 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.403 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.403 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.403 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:21:46.403 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:21:46.404 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:21:46.404 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:21:46.404 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:21:46.404 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:21:46.405 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:21:46.405 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:21:46.405 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:21:46.405 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:21:46.406 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:21:46.406 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:21:46.406 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:21:46.406 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:21:46.407 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:21:46.407 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:21:46.407 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:21:46.408 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:21:46.408 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:21:46.408 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:21:46.408 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:21:46.409 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:21:46.409 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:21:46.409 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.409 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:21:46.410 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:21:46.410 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:21:46.410 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:21:46.410 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:21:46.410 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:21:46.411 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:21:46.411 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:21:46.411 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:21:46.411 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:21:46.412 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:21:46.412 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:21:46.412 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:21:46.412 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:21:46.413 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:21:46.413 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:21:46.413 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:21:46.413 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:21:46.413 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:21:46.414 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:21:46.414 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:21:46.414 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:21:46.414 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:21:46.415 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:21:46.415 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:21:46.415 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:21:46.415 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:21:46.416 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.416 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:21:46.416 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:21:46.416 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:21:46.416 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:21:46.417 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:21:46.417 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:21:46.417 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:21:46.418 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:21:46.418 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:21:46.418 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:21:46.418 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:21:46.419 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:21:46.419 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:21:46.419 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:21:46.419 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.419 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.420 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:21:46.420 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:21:46.420 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.420 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:21:46.421 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:21:46.421 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:21:46.421 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:21:46.421 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:21:46.422 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:21:46.422 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:21:46.422 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:21:46.422 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:21:46.423 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 40, 2021-12-17T18:21:46.423 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:21:46.423 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:21:46.423 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:21:46.423 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.424 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.424 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.424 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:21:46.424 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:21:46.425 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.425 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.425 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.425 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:21:46.426 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:21:46.426 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.426 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.426 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.427 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:21:46.427 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.427 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.427 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.428 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:21:46.428 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:21:46.428 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.428 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.429 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.429 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:21:46.429 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:21:46.429 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.430 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.430 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.430 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:21:46.430 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.431 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.431 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.431 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:21:46.431 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:21:46.432 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.432 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.432 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.432 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:21:46.433 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:21:46.433 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.433 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.433 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.433 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:21:46.434 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.434 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.434 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.434 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:21:46.435 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:21:46.435 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.435 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.435 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.436 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:21:46.436 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:21:46.436 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.436 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.437 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.437 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:21:46.437 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:21:46.437 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:21:46.438 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:21:46.438 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:21:46.438 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:21:46.439 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:21:46.439 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.439 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.439 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.440 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:21:46.440 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:21:46.440 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:21:46.440 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:21:46.441 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:21:46.441 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:21:46.441 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:21:46.441 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:21:46.441 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:21:46.442 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 40, 2021-12-17T18:21:46.442 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:21:46.442 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:21:46.442 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:21:46.443 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.443 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.443 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.443 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:21:46.444 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:21:46.444 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.444 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.444 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.445 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:21:46.445 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:21:46.445 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.445 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.446 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.446 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:21:46.446 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.446 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.446 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.447 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:21:46.447 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:21:46.447 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.448 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.448 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.448 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:21:46.448 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:21:46.449 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.449 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.449 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.450 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:21:46.450 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.450 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.450 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.450 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:21:46.451 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:21:46.451 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.451 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.451 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.452 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:21:46.452 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:21:46.452 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.452 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.453 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.453 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:21:46.453 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.453 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.453 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.454 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:21:46.454 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:21:46.454 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.454 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.455 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.455 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:21:46.455 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:21:46.455 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.455 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.456 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.456 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:21:46.456 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:21:46.456 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:21:46.456 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:21:46.457 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:21:46.457 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:21:46.457 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:21:46.457 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.458 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.458 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.458 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:21:46.458 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:21:46.458 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:21:46.459 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:21:46.459 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:21:46.460 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:21:46.460 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:21:46.460 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:21:46.460 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:21:46.461 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 30, 2021-12-17T18:21:46.461 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:21:46.461 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:21:46.461 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:21:46.462 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.462 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.462 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.462 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:21:46.463 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:21:46.463 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.463 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.463 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.464 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:21:46.464 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:21:46.464 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.464 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.465 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.465 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:21:46.465 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.465 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.465 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.466 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:21:46.466 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:21:46.466 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.466 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.466 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.467 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:21:46.467 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:21:46.467 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.467 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.468 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.468 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:21:46.468 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.468 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.468 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.469 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:21:46.469 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:21:46.469 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.469 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.470 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.470 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:21:46.470 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:21:46.470 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.471 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.471 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.471 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:21:46.471 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.472 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.472 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.472 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:21:46.472 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:21:46.473 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.473 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.473 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.473 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:21:46.473 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:21:46.474 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.474 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.474 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.474 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:21:46.475 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:21:46.475 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:21:46.475 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:21:46.475 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:21:46.475 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:21:46.476 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:21:46.476 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.476 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.476 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.476 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:21:46.477 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:21:46.477 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:21:46.477 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:21:46.477 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:21:46.478 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:21:46.478 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:21:46.478 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:21:46.478 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:21:46.479 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 40, 2021-12-17T18:21:46.479 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:21:46.479 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:21:46.479 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:21:46.480 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.480 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.480 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.480 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:21:46.481 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:21:46.481 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.481 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.481 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.482 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:21:46.482 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:21:46.482 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.482 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.483 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.483 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:21:46.483 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.483 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.484 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.484 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:21:46.484 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:21:46.484 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.484 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.485 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.485 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:21:46.485 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:21:46.485 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.485 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.486 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.486 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:21:46.486 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.486 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.487 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.487 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:21:46.487 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:21:46.487 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.488 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.488 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.488 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:21:46.488 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:21:46.489 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.489 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.489 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.489 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:21:46.489 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.490 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.490 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.490 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:21:46.490 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:21:46.491 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.491 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.491 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.491 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:21:46.492 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:21:46.492 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.492 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.492 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.493 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:21:46.493 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:21:46.493 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:21:46.493 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:21:46.494 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:21:46.494 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:21:46.494 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:21:46.495 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.495 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.495 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.495 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:21:46.495 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:21:46.496 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:21:46.496 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:21:46.496 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:21:46.496 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:21:46.497 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:21:46.497 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:21:46.497 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:21:46.497 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 40, 2021-12-17T18:21:46.497 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:21:46.498 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:21:46.498 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:21:46.498 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.498 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.499 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.499 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:21:46.499 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:21:46.499 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.500 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.500 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.500 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:21:46.500 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:21:46.500 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.501 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.501 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.501 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:21:46.502 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.502 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.502 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.502 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:21:46.503 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:21:46.503 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.503 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.503 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.503 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:21:46.504 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:21:46.504 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.504 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.504 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.505 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:21:46.505 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.505 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.505 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.506 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:21:46.506 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:21:46.506 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.506 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.506 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.507 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:21:46.507 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:21:46.507 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.507 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.508 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.508 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:21:46.508 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.508 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.508 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.509 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:21:46.509 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:21:46.509 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.509 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.510 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.510 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:21:46.510 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:21:46.510 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.510 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.511 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.511 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:21:46.511 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:21:46.512 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:21:46.512 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:21:46.512 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:21:46.512 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:21:46.513 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:21:46.513 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.513 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.513 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.513 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:21:46.514 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:21:46.514 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:21:46.514 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:21:46.514 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:21:46.514 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:21:46.515 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:21:46.515 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:21:46.515 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:21:46.515 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 40, 2021-12-17T18:21:46.516 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:21:46.516 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:21:46.516 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:21:46.516 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.516 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.517 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.517 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:21:46.517 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:21:46.517 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.517 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.518 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.518 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:21:46.518 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:21:46.518 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.518 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.519 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.519 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:21:46.519 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.519 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.519 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.520 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:21:46.520 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:21:46.520 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.520 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.521 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.521 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:21:46.521 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:21:46.521 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.522 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.522 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.522 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:21:46.522 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.523 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.523 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.523 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:21:46.523 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:21:46.524 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.524 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.524 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.524 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:21:46.525 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:21:46.525 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.525 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.525 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.525 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:21:46.526 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.526 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.526 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.526 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:21:46.527 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:21:46.527 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.527 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.527 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.527 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:21:46.528 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:21:46.528 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.528 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.528 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.529 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:21:46.529 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:21:46.529 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:21:46.529 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:21:46.529 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:21:46.530 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:21:46.530 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:21:46.530 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.530 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.531 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.531 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:21:46.531 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:21:46.531 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:21:46.531 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:21:46.532 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:21:46.532 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:21:46.532 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:21:46.533 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:21:46.533 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:21:46.533 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 40, 2021-12-17T18:21:46.533 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:21:46.534 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:21:46.534 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:21:46.534 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.534 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.535 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.535 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:21:46.535 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:21:46.535 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.536 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.536 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.536 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:21:46.536 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:21:46.536 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.537 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.537 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.537 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:21:46.537 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.538 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.538 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.538 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:21:46.538 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:21:46.539 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.539 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.539 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.539 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:21:46.540 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:21:46.540 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.540 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.540 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.540 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:21:46.541 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.541 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.541 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.541 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:21:46.542 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:21:46.542 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.542 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.542 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.543 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:21:46.543 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:21:46.543 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.544 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.544 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.544 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:21:46.544 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.545 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.545 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:21:46.545 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:21:46.545 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.546 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.546 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.546 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:21:46.546 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:21:46.547 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.547 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.547 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.547 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:21:46.548 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:21:46.548 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:21:46.548 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:21:46.548 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:21:46.549 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:21:46.549 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:21:46.549 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.549 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:21:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:21:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:21:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:21:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:21:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:21:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:21:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:21:46.552 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:21:46.552 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 39, 2021-12-17T18:21:46.552 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:21:46.552 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:21:46.553 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:21:46.553 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.553 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.554 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.554 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:21:46.554 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:21:46.555 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.555 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.555 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.555 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:21:46.555 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:21:46.556 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.556 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.556 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.556 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:21:46.557 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.557 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.557 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.557 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:21:46.558 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:21:46.558 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.558 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.558 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.558 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:21:46.559 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:21:46.559 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.559 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.560 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:21:46.560 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.560 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.561 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.561 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:21:46.561 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:21:46.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.562 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.562 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.562 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:21:46.562 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:21:46.563 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.563 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.563 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.563 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:21:46.563 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:21:46.564 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.564 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:21:46.564 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:21:46.565 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:21:46.565 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.566 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:21:46.566 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:21:46.566 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:21:46.567 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.567 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.567 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.567 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:21:46.568 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:21:46.568 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:21:46.568 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:21:46.568 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:21:46.569 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:21:46.569 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:21:46.569 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:46.569 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.570 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:21:46.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:21:46.570 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:21:46.570 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:21:46.571 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:21:46.571 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:21:46.571 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:21:46.571 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:21:46.572 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:21:46.572 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:21:46.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.572 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.572 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:21:46.573 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:21:46.573 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:21:46.573 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:21:46.573 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:21:46.574 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:21:46.574 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:21:46.574 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:21:46.574 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.575 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.575 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:21:46.575 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:21:46.576 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:21:46.576 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:21:46.576 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:21:46.576 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:21:46.576 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:21:46.577 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:21:46.577 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.577 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.577 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:21:46.578 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:21:46.578 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:21:46.578 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:21:46.578 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:21:46.579 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:21:46.579 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:21:46.579 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:21:46.579 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.579 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.580 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:21:46.580 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:21:46.580 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:21:46.580 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:21:46.581 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:21:46.581 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:21:46.581 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:21:46.581 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:21:46.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.582 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.582 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:21:46.582 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:21:46.582 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:21:46.583 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:21:46.583 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:21:46.583 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:21:46.583 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:21:46.584 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:21:46.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.584 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.584 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:21:46.584 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:21:46.585 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:21:46.585 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:21:46.585 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:21:46.586 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:21:46.586 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:21:46.586 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:21:46.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.586 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:46.587 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:21:46.587 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:21:46.587 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:21:46.587 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:21:46.588 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:21:46.588 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:21:46.588 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:21:46.588 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:21:46.589 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.589 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:21:46.589 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:21:46.589 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:21:46.589 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:21:46.590 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:21:46.590 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": { 2021-12-17T18:21:46.590 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6833/3317956606": "2021-12-18T18:21:38.805335+0000", 2021-12-17T18:21:46.590 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6832/3317956606": "2021-12-18T18:21:38.805335+0000" 2021-12-17T18:21:46.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.591 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:21:46.591 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:21:46.591 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:21:46.591 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:21:46.592 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:21:46.592 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:21:46.592 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:21:46.592 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:21:46.593 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:46.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:46.593 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:21:46.594 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:21:46.594 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:21:46.594 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:21:46.594 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:21:46.595 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:21:46.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.376+0000 7fcf22fcb700 1 -- 172.21.15.62:0/902953975 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcf00053580 msgr2=0x7fcf00055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:46.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.376+0000 7fcf22fcb700 1 --2- 172.21.15.62:0/902953975 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcf00053580 0x7fcf00055a40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fcf0400d000 tx=0x7fcf04000bc0).stop 2021-12-17T18:21:46.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.376+0000 7fcf22fcb700 1 -- 172.21.15.62:0/902953975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c0b57e0 msgr2=0x7fcf1c0a3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:46.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.376+0000 7fcf22fcb700 1 --2- 172.21.15.62:0/902953975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c0b57e0 0x7fcf1c0a3d30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fcf04001800 tx=0x7fcf14016000).stop 2021-12-17T18:21:46.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.376+0000 7fcf22fcb700 1 -- 172.21.15.62:0/902953975 shutdown_connections 2021-12-17T18:21:46.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.376+0000 7fcf22fcb700 1 --2- 172.21.15.62:0/902953975 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcf00053580 0x7fcf00055a40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:46.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.376+0000 7fcf22fcb700 1 --2- 172.21.15.62:0/902953975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c0b57e0 0x7fcf1c0a3d30 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:46.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.376+0000 7fcf22fcb700 1 --2- 172.21.15.62:0/902953975 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf1c0ad360 0x7fcf1c146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:46.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.376+0000 7fcf22fcb700 1 --2- 172.21.15.62:0/902953975 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf1c05ffe0 0x7fcf1c155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:46.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.376+0000 7fcf22fcb700 1 -- 172.21.15.62:0/902953975 >> 172.21.15.62:0/902953975 conn(0x7fcf1c0626d0 msgr2=0x7fcf1c143ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:46.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.376+0000 7fcf22fcb700 1 -- 172.21.15.62:0/902953975 shutdown_connections 2021-12-17T18:21:46.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.376+0000 7fcf22fcb700 1 -- 172.21.15.62:0/902953975 wait complete. 2021-12-17T18:21:46.601 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:21:46.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f1170a5d700 1 Processor -- start 2021-12-17T18:21:46.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f1170a5d700 1 -- start start 2021-12-17T18:21:46.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f1170a5d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f116c0b3760 0x7f116c0b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:46.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f1170a5d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f116c0b5f00 con 0x7f116c0b5b20 2021-12-17T18:21:46.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f1170a5d700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f116c0b3020 con 0x7f116c1458d0 2021-12-17T18:21:46.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f1170a5d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f116c0b32c0 con 0x7f116c0b3760 2021-12-17T18:21:46.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f116ad9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f116c0b5b20 0x7f116c0b6290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34082/0 (socket says 172.21.15.62:34082) 2021-12-17T18:21:46.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f116ad9d700 1 -- 172.21.15.62:0/3574426612 learned_addr learned my addr 172.21.15.62:0/3574426612 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:46.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f116a59c700 1 --2- 172.21.15.62:0/3574426612 >> v2:172.21.15.109:3300/0 conn(0x7f116c0b3760 0x7f116c0b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:46.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f1169d9b700 1 -- 172.21.15.62:0/3574426612 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395110469 0 0) 0x7f116c0b5f00 con 0x7f116c0b5b20 2021-12-17T18:21:46.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f1169d9b700 1 -- 172.21.15.62:0/3574426612 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f114c003260 con 0x7f116c0b5b20 2021-12-17T18:21:46.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f116a59c700 1 -- 172.21.15.62:0/3574426612 >> v1:172.21.15.109:6789/0 conn(0x7f116c1458d0 legacy=0x7f116c145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:46.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f116a59c700 1 -- 172.21.15.62:0/3574426612 >> v1:172.21.15.62:6789/0 conn(0x7f116c0b5b20 legacy=0x7f116c0b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:46.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f116a59c700 1 -- 172.21.15.62:0/3574426612 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c0b6e90 con 0x7f116c0b3760 2021-12-17T18:21:46.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f116a59c700 1 --2- 172.21.15.62:0/3574426612 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f116c0b3760 0x7f116c0b69a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f1164001490 tx=0x7f1154006df0).ready entity=mon.1 client_cookie=36147b671d121b8b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:46.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f1169d9b700 1 -- 172.21.15.62:0/3574426612 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f115400d4f0 con 0x7f116c0b3760 2021-12-17T18:21:46.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f1169d9b700 1 -- 172.21.15.62:0/3574426612 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1154000e90 con 0x7f116c0b3760 2021-12-17T18:21:46.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f1169d9b700 1 -- 172.21.15.62:0/3574426612 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f115400d840 con 0x7f116c0b3760 2021-12-17T18:21:46.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f1170a5d700 1 -- 172.21.15.62:0/3574426612 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f116c0b3760 msgr2=0x7f116c0b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:46.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.716+0000 7f1170a5d700 1 --2- 172.21.15.62:0/3574426612 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f116c0b3760 0x7f116c0b69a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f1164001490 tx=0x7f1154006df0).stop 2021-12-17T18:21:46.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1170a5d700 1 -- 172.21.15.62:0/3574426612 shutdown_connections 2021-12-17T18:21:46.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1170a5d700 1 --2- 172.21.15.62:0/3574426612 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f116c0b3760 0x7f116c0b69a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:46.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1170a5d700 1 -- 172.21.15.62:0/3574426612 >> 172.21.15.62:0/3574426612 conn(0x7f116c05c750 msgr2=0x7f116c05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:46.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1170a5d700 1 -- 172.21.15.62:0/3574426612 shutdown_connections 2021-12-17T18:21:46.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1170a5d700 1 -- 172.21.15.62:0/3574426612 wait complete. 2021-12-17T18:21:46.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1170a5d700 1 Processor -- start 2021-12-17T18:21:46.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1170a5d700 1 -- start start 2021-12-17T18:21:46.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1170a5d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f116c0b5b20 0x7f116c063220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:46.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1170a5d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f116c1458d0 0x7f116c0ac440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:46.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1170a5d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f116c1524c0 0x7f116c0ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:46.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1170a5d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116c1533b0 con 0x7f116c1524c0 2021-12-17T18:21:46.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1170a5d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116c1529d0 con 0x7f116c1458d0 2021-12-17T18:21:46.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1170a5d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116c152c70 con 0x7f116c0b5b20 2021-12-17T18:21:46.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f116b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f116c1524c0 0x7f116c0ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:46.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f116b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f116c1524c0 0x7f116c0ac930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50512/0 (socket says 172.21.15.62:50512) 2021-12-17T18:21:46.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f116b59e700 1 -- 172.21.15.62:0/1097584218 learned_addr learned my addr 172.21.15.62:0/1097584218 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:46.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f116ad9d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f116c0b5b20 0x7f116c063220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:46.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f116a59c700 1 --2- 172.21.15.62:0/1097584218 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f116c1458d0 0x7f116c0ac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:46.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f116b59e700 1 -- 172.21.15.62:0/1097584218 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f116c0b5b20 msgr2=0x7f116c063220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:46.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f116b59e700 1 --2- 172.21.15.62:0/1097584218 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f116c0b5b20 0x7f116c063220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:46.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f116b59e700 1 -- 172.21.15.62:0/1097584218 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f116c1458d0 msgr2=0x7f116c0ac440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:46.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f116b59e700 1 --2- 172.21.15.62:0/1097584218 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f116c1458d0 0x7f116c0ac440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:46.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f116b59e700 1 -- 172.21.15.62:0/1097584218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115400b180 con 0x7f116c1524c0 2021-12-17T18:21:46.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f116a59c700 1 --2- 172.21.15.62:0/1097584218 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f116c1458d0 0x7f116c0ac440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:21:46.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f116b59e700 1 --2- 172.21.15.62:0/1097584218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f116c1524c0 0x7f116c0ac930 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f1164001360 tx=0x7f1164007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:46.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1163fff700 1 -- 172.21.15.62:0/1097584218 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1164010510 con 0x7f116c1524c0 2021-12-17T18:21:46.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1163fff700 1 -- 172.21.15.62:0/1097584218 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1164010670 con 0x7f116c1524c0 2021-12-17T18:21:46.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1170a5d700 1 -- 172.21.15.62:0/1097584218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f116c152f10 con 0x7f116c1524c0 2021-12-17T18:21:46.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1163fff700 1 -- 172.21.15.62:0/1097584218 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11640107e0 con 0x7f116c1524c0 2021-12-17T18:21:46.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.720+0000 7f1170a5d700 1 -- 172.21.15.62:0/1097584218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f116c063790 con 0x7f116c1524c0 2021-12-17T18:21:46.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.724+0000 7f1170a5d700 1 -- 172.21.15.62:0/1097584218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f116c0acf70 con 0x7f116c1524c0 2021-12-17T18:21:46.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.724+0000 7f1163fff700 1 -- 172.21.15.62:0/1097584218 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1164010070 con 0x7f116c1524c0 2021-12-17T18:21:46.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.724+0000 7f1163fff700 1 --2- 172.21.15.62:0/1097584218 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1150053610 0x7f1150055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:46.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.724+0000 7f1163fff700 1 -- 172.21.15.62:0/1097584218 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f116406b410 con 0x7f116c1524c0 2021-12-17T18:21:46.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.724+0000 7f116ad9d700 1 --2- 172.21.15.62:0/1097584218 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1150053610 0x7f1150055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:46.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.724+0000 7f116ad9d700 1 --2- 172.21.15.62:0/1097584218 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1150053610 0x7f1150055ad0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f115c00d000 tx=0x7f115c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:46.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.732+0000 7f1163fff700 1 -- 172.21.15.62:0/1097584218 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f11640426c0 con 0x7f116c1524c0 2021-12-17T18:21:46.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.900+0000 7f1170a5d700 1 -- 172.21.15.62:0/1097584218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f116c1530a0 con 0x7f116c1524c0 2021-12-17T18:21:46.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.900+0000 7f1163fff700 1 -- 172.21.15.62:0/1097584218 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+1206 (secure 0 0 0) 0x7f1164045ce0 con 0x7f116c1524c0 2021-12-17T18:21:46.901 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:21:46.901 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/16961477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":16961477},{"type":"v1","addr":"172.21.15.109:6835","nonce":16961477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3206070581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3206070581},{"type":"v1","addr":"172.21.15.62:6833","nonce":3206070581}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":18}],"filesystems":[]} 2021-12-17T18:21:46.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.900+0000 7f1170a5d700 1 -- 172.21.15.62:0/1097584218 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1150053610 msgr2=0x7f1150055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:46.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.900+0000 7f1170a5d700 1 --2- 172.21.15.62:0/1097584218 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1150053610 0x7f1150055ad0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f115c00d000 tx=0x7f115c009040).stop 2021-12-17T18:21:46.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.900+0000 7f1170a5d700 1 -- 172.21.15.62:0/1097584218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f116c1524c0 msgr2=0x7f116c0ac930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:46.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.900+0000 7f1170a5d700 1 --2- 172.21.15.62:0/1097584218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f116c1524c0 0x7f116c0ac930 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f1164001360 tx=0x7f1164007f40).stop 2021-12-17T18:21:46.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.900+0000 7f1170a5d700 1 -- 172.21.15.62:0/1097584218 shutdown_connections 2021-12-17T18:21:46.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.900+0000 7f1170a5d700 1 --2- 172.21.15.62:0/1097584218 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1150053610 0x7f1150055ad0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:46.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.900+0000 7f1170a5d700 1 --2- 172.21.15.62:0/1097584218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f116c1524c0 0x7f116c0ac930 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:46.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.900+0000 7f1170a5d700 1 --2- 172.21.15.62:0/1097584218 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f116c1458d0 0x7f116c0ac440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:46.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.900+0000 7f1170a5d700 1 --2- 172.21.15.62:0/1097584218 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f116c0b5b20 0x7f116c063220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:46.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.900+0000 7f1170a5d700 1 -- 172.21.15.62:0/1097584218 >> 172.21.15.62:0/1097584218 conn(0x7f116c05c750 msgr2=0x7f116c144aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:46.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.900+0000 7f1170a5d700 1 -- 172.21.15.62:0/1097584218 shutdown_connections 2021-12-17T18:21:46.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:46.900+0000 7f1170a5d700 1 -- 172.21.15.62:0/1097584218 wait complete. 2021-12-17T18:21:46.906 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 18 2021-12-17T18:21:46.914 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:21:47.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafe25ce700 1 Processor -- start 2021-12-17T18:21:47.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafe25ce700 1 -- start start 2021-12-17T18:21:47.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafe25ce700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fafdc0b9e80 0x7fafdc0b0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:47.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafe25ce700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafdc0ba260 con 0x7fafdc0b10d0 2021-12-17T18:21:47.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafe25ce700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafdc0678a0 con 0x7fafdc0b5bc0 2021-12-17T18:21:47.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafe25ce700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafdc0b3450 con 0x7fafdc0b9e80 2021-12-17T18:21:47.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafdbfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fafdc0b9e80 0x7fafdc0b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:47.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafe0b6b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fafdc0b10d0 0x7fafdc147bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34100/0 (socket says 172.21.15.62:34100) 2021-12-17T18:21:47.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafe0b6b700 1 -- 172.21.15.62:0/2172911235 learned_addr learned my addr 172.21.15.62:0/2172911235 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:47.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafdb7fe700 1 -- 172.21.15.62:0/2172911235 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46298772 0 0) 0x7fafdc0ba260 con 0x7fafdc0b10d0 2021-12-17T18:21:47.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafdb7fe700 1 -- 172.21.15.62:0/2172911235 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafbc003260 con 0x7fafdc0b10d0 2021-12-17T18:21:47.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafdb7fe700 1 -- 172.21.15.62:0/2172911235 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502925812 0 0) 0x7fafdc0678a0 con 0x7fafdc0b5bc0 2021-12-17T18:21:47.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafdb7fe700 1 -- 172.21.15.62:0/2172911235 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafdc0ba260 con 0x7fafdc0b5bc0 2021-12-17T18:21:47.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafdbfff700 1 -- 172.21.15.62:0/2172911235 >> v1:172.21.15.109:6789/0 conn(0x7fafdc0b5bc0 legacy=0x7fafdc0b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:47.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafdbfff700 1 -- 172.21.15.62:0/2172911235 >> v1:172.21.15.62:6789/0 conn(0x7fafdc0b10d0 legacy=0x7fafdc147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:47.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafdb7fe700 1 -- 172.21.15.62:0/2172911235 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2056047949 0 0) 0x7fafbc003260 con 0x7fafdc0b10d0 2021-12-17T18:21:47.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafdbfff700 1 -- 172.21.15.62:0/2172911235 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc0b4a90 con 0x7fafdc0b9e80 2021-12-17T18:21:47.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafdbfff700 1 --2- 172.21.15.62:0/2172911235 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafdc0b9e80 0x7fafdc0b0850 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fafd4001490 tx=0x7fafcc006df0).ready entity=mon.0 client_cookie=1dfe2103365ab5ee server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:47.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafdb7fe700 1 -- 172.21.15.62:0/2172911235 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafd40019e0 con 0x7fafdc0b9e80 2021-12-17T18:21:47.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafdb7fe700 1 -- 172.21.15.62:0/2172911235 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc000e90 con 0x7fafdc0b9e80 2021-12-17T18:21:47.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafdb7fe700 1 -- 172.21.15.62:0/2172911235 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafcc012460 con 0x7fafdc0b9e80 2021-12-17T18:21:47.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafe25ce700 1 -- 172.21.15.62:0/2172911235 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafdc0b9e80 msgr2=0x7fafdc0b0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:47.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.016+0000 7fafe25ce700 1 --2- 172.21.15.62:0/2172911235 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafdc0b9e80 0x7fafdc0b0850 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fafd4001490 tx=0x7fafcc006df0).stop 2021-12-17T18:21:47.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.020+0000 7fafe25ce700 1 -- 172.21.15.62:0/2172911235 shutdown_connections 2021-12-17T18:21:47.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.020+0000 7fafe25ce700 1 --2- 172.21.15.62:0/2172911235 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafdc0b9e80 0x7fafdc0b0850 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:47.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.020+0000 7fafe25ce700 1 -- 172.21.15.62:0/2172911235 >> 172.21.15.62:0/2172911235 conn(0x7fafdc05cb40 msgr2=0x7fafdc05cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:47.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.020+0000 7fafe25ce700 1 -- 172.21.15.62:0/2172911235 shutdown_connections 2021-12-17T18:21:47.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.020+0000 7fafe25ce700 1 -- 172.21.15.62:0/2172911235 wait complete. 2021-12-17T18:21:47.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.020+0000 7fafe25ce700 1 Processor -- start 2021-12-17T18:21:47.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.020+0000 7fafe25ce700 1 -- start start 2021-12-17T18:21:47.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafe25ce700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fafdc0b10d0 0x7fafdc082480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:47.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafe25ce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafdc0b5bc0 0x7fafdc066390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:47.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafe25ce700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fafdc0b9e80 0x7fafdc0afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:47.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafe25ce700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc145fd0 con 0x7fafdc0b5bc0 2021-12-17T18:21:47.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafe25ce700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc0ae6d0 con 0x7fafdc0b10d0 2021-12-17T18:21:47.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafe25ce700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc0ae430 con 0x7fafdc0b9e80 2021-12-17T18:21:47.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafd37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafdc0b5bc0 0x7fafdc066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:47.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafd37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafdc0b5bc0 0x7fafdc066390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50524/0 (socket says 172.21.15.62:50524) 2021-12-17T18:21:47.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafd37fe700 1 -- 172.21.15.62:0/3342701309 learned_addr learned my addr 172.21.15.62:0/3342701309 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:47.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafe0b6b700 1 --2- 172.21.15.62:0/3342701309 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fafdc0b9e80 0x7fafdc0afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:47.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafdbfff700 1 --2- 172.21.15.62:0/3342701309 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fafdc0b10d0 0x7fafdc082480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:47.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafe0b6b700 1 -- 172.21.15.62:0/3342701309 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fafdc0b10d0 msgr2=0x7fafdc082480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:47.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafe0b6b700 1 --2- 172.21.15.62:0/3342701309 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fafdc0b10d0 0x7fafdc082480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:47.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafe0b6b700 1 -- 172.21.15.62:0/3342701309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafdc0b5bc0 msgr2=0x7fafdc066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:47.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafe0b6b700 1 --2- 172.21.15.62:0/3342701309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafdc0b5bc0 0x7fafdc066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:47.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafe0b6b700 1 -- 172.21.15.62:0/3342701309 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc00b180 con 0x7fafdc0b9e80 2021-12-17T18:21:47.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafdbfff700 1 --2- 172.21.15.62:0/3342701309 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fafdc0b10d0 0x7fafdc082480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:21:47.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafd37fe700 1 --2- 172.21.15.62:0/3342701309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafdc0b5bc0 0x7fafdc066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:21:47.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafe0b6b700 1 --2- 172.21.15.62:0/3342701309 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fafdc0b9e80 0x7fafdc0afc50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fafdc146110 tx=0x7fafd40019c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:47.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafd9ffb700 1 -- 172.21.15.62:0/3342701309 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafd4004ab0 con 0x7fafdc0b9e80 2021-12-17T18:21:47.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafd9ffb700 1 -- 172.21.15.62:0/3342701309 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd4004c10 con 0x7fafdc0b9e80 2021-12-17T18:21:47.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafe25ce700 1 -- 172.21.15.62:0/3342701309 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafdc066880 con 0x7fafdc0b9e80 2021-12-17T18:21:47.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafd9ffb700 1 -- 172.21.15.62:0/3342701309 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafd4007170 con 0x7fafdc0b9e80 2021-12-17T18:21:47.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.024+0000 7fafe25ce700 1 -- 172.21.15.62:0/3342701309 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafdc083de0 con 0x7fafdc0b9e80 2021-12-17T18:21:47.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.028+0000 7fafe25ce700 1 -- 172.21.15.62:0/3342701309 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafdc0ab5f0 con 0x7fafdc0b9e80 2021-12-17T18:21:47.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.028+0000 7fafd9ffb700 1 -- 172.21.15.62:0/3342701309 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fafd401b070 con 0x7fafdc0b9e80 2021-12-17T18:21:47.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.028+0000 7fafd9ffb700 1 --2- 172.21.15.62:0/3342701309 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fafc0053580 0x7fafc0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:47.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.028+0000 7fafd9ffb700 1 -- 172.21.15.62:0/3342701309 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fafd406af00 con 0x7fafdc0b9e80 2021-12-17T18:21:47.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.028+0000 7fafdbfff700 1 --2- 172.21.15.62:0/3342701309 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fafc0053580 0x7fafc0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:47.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.028+0000 7fafdbfff700 1 --2- 172.21.15.62:0/3342701309 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fafc0053580 0x7fafc0055a40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fafcc01a000 tx=0x7fafcc014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:47.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.036+0000 7fafd9ffb700 1 -- 172.21.15.62:0/3342701309 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fafd4042230 con 0x7fafdc0b9e80 2021-12-17T18:21:47.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.208+0000 7fafe25ce700 1 -- 172.21.15.62:0/3342701309 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fafdc0573d0 con 0x7fafdc0b9e80 2021-12-17T18:21:47.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.208+0000 7fafd9ffb700 1 -- 172.21.15.62:0/3342701309 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+1206 (secure 0 0 0) 0x7fafd4048090 con 0x7fafdc0b9e80 2021-12-17T18:21:47.210 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:21:47.211 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/16961477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":16961477},{"type":"v1","addr":"172.21.15.109:6835","nonce":16961477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3206070581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3206070581},{"type":"v1","addr":"172.21.15.62:6833","nonce":3206070581}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":18}],"filesystems":[]} 2021-12-17T18:21:47.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.212+0000 7fafe25ce700 1 -- 172.21.15.62:0/3342701309 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fafc0053580 msgr2=0x7fafc0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:47.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.212+0000 7fafe25ce700 1 --2- 172.21.15.62:0/3342701309 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fafc0053580 0x7fafc0055a40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fafcc01a000 tx=0x7fafcc014000).stop 2021-12-17T18:21:47.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.212+0000 7fafe25ce700 1 -- 172.21.15.62:0/3342701309 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fafdc0b9e80 msgr2=0x7fafdc0afc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:47.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.212+0000 7fafe25ce700 1 --2- 172.21.15.62:0/3342701309 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fafdc0b9e80 0x7fafdc0afc50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fafdc146110 tx=0x7fafd40019c0).stop 2021-12-17T18:21:47.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.212+0000 7fafe25ce700 1 -- 172.21.15.62:0/3342701309 shutdown_connections 2021-12-17T18:21:47.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.212+0000 7fafe25ce700 1 --2- 172.21.15.62:0/3342701309 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fafc0053580 0x7fafc0055a40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:47.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.212+0000 7fafe25ce700 1 --2- 172.21.15.62:0/3342701309 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fafdc0b9e80 0x7fafdc0afc50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:47.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.212+0000 7fafe25ce700 1 --2- 172.21.15.62:0/3342701309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafdc0b5bc0 0x7fafdc066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:47.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.212+0000 7fafe25ce700 1 --2- 172.21.15.62:0/3342701309 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fafdc0b10d0 0x7fafdc082480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:47.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.212+0000 7fafe25ce700 1 -- 172.21.15.62:0/3342701309 >> 172.21.15.62:0/3342701309 conn(0x7fafdc05cb40 msgr2=0x7fafdc0b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:47.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.212+0000 7fafe25ce700 1 -- 172.21.15.62:0/3342701309 shutdown_connections 2021-12-17T18:21:47.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.212+0000 7fafe25ce700 1 -- 172.21.15.62:0/3342701309 wait complete. 2021-12-17T18:21:47.216 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 18 2021-12-17T18:21:47.224 INFO:tasks.ceph.mds.a:Restarting daemon 2021-12-17T18:21:47.224 INFO:tasks.ceph.mds.a:Stopping old one... 2021-12-17T18:21:47.224 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-12-17T18:21:47.225 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:21:47.225 INFO:tasks.ceph.mds.b:Restarting daemon 2021-12-17T18:21:47.225 INFO:tasks.ceph.mds.b:Stopping old one... 2021-12-17T18:21:47.226 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-12-17T18:21:47.226 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:21:47.238 INFO:tasks.ceph.mds.a:Stopped 2021-12-17T18:21:47.238 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-12-17T18:21:47.241 INFO:tasks.ceph.mds.a:Started 2021-12-17T18:21:47.241 DEBUG:teuthology.parallel:result is None 2021-12-17T18:21:47.242 INFO:tasks.ceph.mds.b:Stopped 2021-12-17T18:21:47.243 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-12-17T18:21:47.245 INFO:tasks.ceph.mds.b:Started 2021-12-17T18:21:47.245 DEBUG:teuthology.parallel:result is None 2021-12-17T18:21:47.246 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-12-17T18:21:47.314 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:21:47.317 INFO:tasks.ceph.mds.b.smithi109.stdout:starting mds.b at 2021-12-17T18:21:47.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.340+0000 7fc583fc4700 1 Processor -- start 2021-12-17T18:21:47.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.340+0000 7fc583fc4700 1 -- start start 2021-12-17T18:21:47.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.340+0000 7fc583fc4700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc57c0b6140 0x7fc57c1435e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:47.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.340+0000 7fc583fc4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc57c0b01c0 0x7fc57c143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:47.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.340+0000 7fc583fc4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57c0b6520 con 0x7fc57c0b2190 2021-12-17T18:21:47.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.340+0000 7fc583fc4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c0ae7c0 con 0x7fc57c0b01c0 2021-12-17T18:21:47.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.340+0000 7fc583fc4700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c067790 con 0x7fc57c0b6140 2021-12-17T18:21:47.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.340+0000 7fc582561700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc57c0b2190 0x7fc57c0ad420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34126/0 (socket says 172.21.15.62:34126) 2021-12-17T18:21:47.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.340+0000 7fc582561700 1 -- 172.21.15.62:0/3657789869 learned_addr learned my addr 172.21.15.62:0/3657789869 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:47.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.340+0000 7fc581d60700 1 --2- 172.21.15.62:0/3657789869 >> v2:172.21.15.109:3300/0 conn(0x7fc57c0b6140 0x7fc57c1435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:47.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.340+0000 7fc58155f700 1 --2- 172.21.15.62:0/3657789869 >> v2:172.21.15.62:3300/0 conn(0x7fc57c0b01c0 0x7fc57c143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:47.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.344+0000 7fc581d60700 1 -- 172.21.15.62:0/3657789869 >> v2:172.21.15.62:3300/0 conn(0x7fc57c0b01c0 msgr2=0x7fc57c143ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:47.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.344+0000 7fc581d60700 1 --2- 172.21.15.62:0/3657789869 >> v2:172.21.15.62:3300/0 conn(0x7fc57c0b01c0 0x7fc57c143ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:47.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.344+0000 7fc581d60700 1 -- 172.21.15.62:0/3657789869 >> v1:172.21.15.62:6789/0 conn(0x7fc57c0b2190 legacy=0x7fc57c0ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:47.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.344+0000 7fc581d60700 1 -- 172.21.15.62:0/3657789869 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c067a30 con 0x7fc57c0b6140 2021-12-17T18:21:47.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.344+0000 7fc581d60700 1 --2- 172.21.15.62:0/3657789869 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc57c0b6140 0x7fc57c1435e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fc578002f70 tx=0x7fc578006df0).ready entity=mon.1 client_cookie=f954b6206bb318c8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:47.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.348+0000 7fc580d5e700 1 -- 172.21.15.62:0/3657789869 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc57800d570 con 0x7fc57c0b6140 2021-12-17T18:21:47.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.348+0000 7fc580d5e700 1 -- 172.21.15.62:0/3657789869 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc578000e90 con 0x7fc57c0b6140 2021-12-17T18:21:47.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.348+0000 7fc580d5e700 1 -- 172.21.15.62:0/3657789869 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc57800d8c0 con 0x7fc57c0b6140 2021-12-17T18:21:47.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.348+0000 7fc583fc4700 1 -- 172.21.15.62:0/3657789869 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc57c0b6140 msgr2=0x7fc57c1435e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:47.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.348+0000 7fc583fc4700 1 --2- 172.21.15.62:0/3657789869 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc57c0b6140 0x7fc57c1435e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fc578002f70 tx=0x7fc578006df0).stop 2021-12-17T18:21:47.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.348+0000 7fc583fc4700 1 -- 172.21.15.62:0/3657789869 shutdown_connections 2021-12-17T18:21:47.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.348+0000 7fc583fc4700 1 --2- 172.21.15.62:0/3657789869 >> v2:172.21.15.62:3300/0 conn(0x7fc57c0b01c0 0x7fc57c143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:47.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.348+0000 7fc583fc4700 1 --2- 172.21.15.62:0/3657789869 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc57c0b6140 0x7fc57c1435e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:47.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.348+0000 7fc583fc4700 1 -- 172.21.15.62:0/3657789869 >> 172.21.15.62:0/3657789869 conn(0x7fc57c05c750 msgr2=0x7fc57c0630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:47.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.348+0000 7fc583fc4700 1 -- 172.21.15.62:0/3657789869 shutdown_connections 2021-12-17T18:21:47.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.348+0000 7fc583fc4700 1 -- 172.21.15.62:0/3657789869 wait complete. 2021-12-17T18:21:47.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc583fc4700 1 Processor -- start 2021-12-17T18:21:47.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc583fc4700 1 -- start start 2021-12-17T18:21:47.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc583fc4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc57c0b01c0 0x7fc57c0a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:47.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc583fc4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc57c0b2190 0x7fc57c0a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:47.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc583fc4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc57c0b6140 0x7fc57c14f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:47.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc583fc4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c0a3520 con 0x7fc57c0b2190 2021-12-17T18:21:47.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc583fc4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c0a3750 con 0x7fc57c0b01c0 2021-12-17T18:21:47.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc583fc4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c09f0f0 con 0x7fc57c0b6140 2021-12-17T18:21:47.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc58155f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc57c0b2190 0x7fc57c0a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:47.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc58155f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc57c0b2190 0x7fc57c0a0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50550/0 (socket says 172.21.15.62:50550) 2021-12-17T18:21:47.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc58155f700 1 -- 172.21.15.62:0/3049876718 learned_addr learned my addr 172.21.15.62:0/3049876718 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:47.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc581d60700 1 --2- 172.21.15.62:0/3049876718 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc57c0b01c0 0x7fc57c0a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:47.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc582561700 1 --2- 172.21.15.62:0/3049876718 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc57c0b6140 0x7fc57c14f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:47.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc58155f700 1 -- 172.21.15.62:0/3049876718 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc57c0b6140 msgr2=0x7fc57c14f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:47.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc58155f700 1 --2- 172.21.15.62:0/3049876718 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc57c0b6140 0x7fc57c14f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:47.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc58155f700 1 -- 172.21.15.62:0/3049876718 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc57c0b01c0 msgr2=0x7fc57c0a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:47.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc58155f700 1 --2- 172.21.15.62:0/3049876718 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc57c0b01c0 0x7fc57c0a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:47.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc58155f700 1 -- 172.21.15.62:0/3049876718 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57800b180 con 0x7fc57c0b2190 2021-12-17T18:21:47.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc582561700 1 --2- 172.21.15.62:0/3049876718 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc57c0b6140 0x7fc57c14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:21:47.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc58155f700 1 --2- 172.21.15.62:0/3049876718 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc57c0b2190 0x7fc57c0a0c00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fc56c00c000 tx=0x7fc56c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:47.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc56affd700 1 -- 172.21.15.62:0/3049876718 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc56c010780 con 0x7fc57c0b2190 2021-12-17T18:21:47.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc56affd700 1 -- 172.21.15.62:0/3049876718 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c0108e0 con 0x7fc57c0b2190 2021-12-17T18:21:47.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc56affd700 1 -- 172.21.15.62:0/3049876718 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc56c010c40 con 0x7fc57c0b2190 2021-12-17T18:21:47.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc583fc4700 1 -- 172.21.15.62:0/3049876718 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57c09f800 con 0x7fc57c0b2190 2021-12-17T18:21:47.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.352+0000 7fc583fc4700 1 -- 172.21.15.62:0/3049876718 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c0a13c0 con 0x7fc57c0b2190 2021-12-17T18:21:47.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.356+0000 7fc56affd700 1 -- 172.21.15.62:0/3049876718 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc56c01c460 con 0x7fc57c0b2190 2021-12-17T18:21:47.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.356+0000 7fc583fc4700 1 -- 172.21.15.62:0/3049876718 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57c0573d0 con 0x7fc57c0b2190 2021-12-17T18:21:47.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.356+0000 7fc56affd700 1 --2- 172.21.15.62:0/3049876718 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc55c053610 0x7fc55c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:47.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.356+0000 7fc56affd700 1 -- 172.21.15.62:0/3049876718 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fc56c06ba30 con 0x7fc57c0b2190 2021-12-17T18:21:47.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.356+0000 7fc581d60700 1 --2- 172.21.15.62:0/3049876718 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc55c053610 0x7fc55c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:47.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.356+0000 7fc581d60700 1 --2- 172.21.15.62:0/3049876718 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc55c053610 0x7fc55c055ad0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fc57801a000 tx=0x7fc578014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:47.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.364+0000 7fc56affd700 1 -- 172.21.15.62:0/3049876718 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc56c042e10 con 0x7fc57c0b2190 2021-12-17T18:21:47.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:47.500+0000 7fc583fc4700 1 -- 172.21.15.62:0/3049876718 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fc57c0a3910 con 0x7fc57c0b2190 2021-12-17T18:21:48.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.368+0000 7fc56affd700 1 -- 172.21.15.62:0/3049876718 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v47) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc56c046430 con 0x7fc57c0b2190 2021-12-17T18:21:48.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.368+0000 7fc583fc4700 1 -- 172.21.15.62:0/3049876718 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc55c053610 msgr2=0x7fc55c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:48.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.368+0000 7fc583fc4700 1 --2- 172.21.15.62:0/3049876718 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc55c053610 0x7fc55c055ad0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fc57801a000 tx=0x7fc578014000).stop 2021-12-17T18:21:48.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.368+0000 7fc583fc4700 1 -- 172.21.15.62:0/3049876718 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc57c0b2190 msgr2=0x7fc57c0a0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:48.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.368+0000 7fc583fc4700 1 --2- 172.21.15.62:0/3049876718 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc57c0b2190 0x7fc57c0a0c00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fc56c00c000 tx=0x7fc56c006df0).stop 2021-12-17T18:21:48.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.368+0000 7fc583fc4700 1 -- 172.21.15.62:0/3049876718 shutdown_connections 2021-12-17T18:21:48.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.368+0000 7fc583fc4700 1 --2- 172.21.15.62:0/3049876718 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc55c053610 0x7fc55c055ad0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.368+0000 7fc583fc4700 1 --2- 172.21.15.62:0/3049876718 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc57c0b6140 0x7fc57c14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.368+0000 7fc583fc4700 1 --2- 172.21.15.62:0/3049876718 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc57c0b2190 0x7fc57c0a0c00 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.368+0000 7fc583fc4700 1 --2- 172.21.15.62:0/3049876718 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc57c0b01c0 0x7fc57c0a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.368+0000 7fc583fc4700 1 -- 172.21.15.62:0/3049876718 >> 172.21.15.62:0/3049876718 conn(0x7fc57c05c750 msgr2=0x7fc57c0b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.368+0000 7fc583fc4700 1 -- 172.21.15.62:0/3049876718 shutdown_connections 2021-12-17T18:21:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.368+0000 7fc583fc4700 1 -- 172.21.15.62:0/3049876718 wait complete. 2021-12-17T18:21:48.374 INFO:teuthology.orchestra.run.smithi062.stderr: removed all blacklist entries 2021-12-17T18:21:48.388 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-12-17T18:21:48.388 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-12-17T18:21:48.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7abf0e700 1 Processor -- start 2021-12-17T18:21:48.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7abf0e700 1 -- start start 2021-12-17T18:21:48.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7abf0e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc7a40b21f0 0x7fc7a414aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:48.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7abf0e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc7a40b1730 0x7fc7a40ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:48.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7abf0e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a40b2ce0 con 0x7fc7a40a7bb0 2021-12-17T18:21:48.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7abf0e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a4147870 con 0x7fc7a40b21f0 2021-12-17T18:21:48.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7abf0e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a40b2f10 con 0x7fc7a40b1730 2021-12-17T18:21:48.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7aa4ab700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc7a40a7bb0 0x7fc7a4067120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34140/0 (socket says 172.21.15.62:34140) 2021-12-17T18:21:48.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7aa4ab700 1 -- 172.21.15.62:0/3087088875 learned_addr learned my addr 172.21.15.62:0/3087088875 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:48.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a94a9700 1 --2- 172.21.15.62:0/3087088875 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc7a40b1730 0x7fc7a40ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:48.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a9caa700 1 --2- 172.21.15.62:0/3087088875 >> v2:172.21.15.109:3300/0 conn(0x7fc7a40b21f0 0x7fc7a414aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:48.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a8ca8700 1 -- 172.21.15.62:0/3087088875 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007173845 0 0) 0x7fc7a40b2ce0 con 0x7fc7a40a7bb0 2021-12-17T18:21:48.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a8ca8700 1 -- 172.21.15.62:0/3087088875 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc788003260 con 0x7fc7a40a7bb0 2021-12-17T18:21:48.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a8ca8700 1 -- 172.21.15.62:0/3087088875 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3576721346 0 0) 0x7fc788003260 con 0x7fc7a40a7bb0 2021-12-17T18:21:48.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a8ca8700 1 -- 172.21.15.62:0/3087088875 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc7a40b1730 msgr2=0x7fc7a40ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:48.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a8ca8700 1 --2- 172.21.15.62:0/3087088875 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc7a40b1730 0x7fc7a40ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a8ca8700 1 -- 172.21.15.62:0/3087088875 >> v2:172.21.15.109:3300/0 conn(0x7fc7a40b21f0 msgr2=0x7fc7a414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:48.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a8ca8700 1 --2- 172.21.15.62:0/3087088875 >> v2:172.21.15.109:3300/0 conn(0x7fc7a40b21f0 0x7fc7a414aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a8ca8700 1 -- 172.21.15.62:0/3087088875 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a40aca60 con 0x7fc7a40a7bb0 2021-12-17T18:21:48.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a8ca8700 1 -- 172.21.15.62:0/3087088875 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fc79c0019e0 con 0x7fc7a40a7bb0 2021-12-17T18:21:48.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a8ca8700 1 -- 172.21.15.62:0/3087088875 >> v1:172.21.15.62:6789/0 conn(0x7fc7a40a7bb0 legacy=0x7fc7a4067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:48.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a8ca8700 1 --2- 172.21.15.62:0/3087088875 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc788003750 0x7fc788003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:48.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a8ca8700 1 --2- 172.21.15.62:0/3087088875 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc7a40b1730 0x7fc788004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:48.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a8ca8700 1 --2- 172.21.15.62:0/3087088875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7880049f0 0x7fc788004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:48.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a8ca8700 1 -- 172.21.15.62:0/3087088875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a40b2f10 con 0x7fc7880049f0 2021-12-17T18:21:48.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a8ca8700 1 -- 172.21.15.62:0/3087088875 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc788004330 con 0x7fc788003750 2021-12-17T18:21:48.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a8ca8700 1 -- 172.21.15.62:0/3087088875 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78800b7a0 con 0x7fc7a40b1730 2021-12-17T18:21:48.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7aa4ab700 1 --2- 172.21.15.62:0/3087088875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7880049f0 0x7fc788004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:48.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a9caa700 1 --2- 172.21.15.62:0/3087088875 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc788003750 0x7fc788003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:48.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a94a9700 1 --2- 172.21.15.62:0/3087088875 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc7a40b1730 0x7fc788004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:48.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a9caa700 1 -- 172.21.15.62:0/3087088875 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc7a40b1730 msgr2=0x7fc788004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:48.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a9caa700 1 --2- 172.21.15.62:0/3087088875 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc7a40b1730 0x7fc788004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a9caa700 1 -- 172.21.15.62:0/3087088875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7880049f0 msgr2=0x7fc788004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:48.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a9caa700 1 --2- 172.21.15.62:0/3087088875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7880049f0 0x7fc788004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7a9caa700 1 -- 172.21.15.62:0/3087088875 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc788003260 con 0x7fc788003750 2021-12-17T18:21:48.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.500+0000 7fc7aa4ab700 1 --2- 172.21.15.62:0/3087088875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7880049f0 0x7fc788004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:21:48.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.504+0000 7fc7a9caa700 1 --2- 172.21.15.62:0/3087088875 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc788003750 0x7fc788003b70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fc79400c000 tx=0x7fc794006df0).ready entity=mon.1 client_cookie=a903fee7669adffa server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:48.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.504+0000 7fc7a8ca8700 1 -- 172.21.15.62:0/3087088875 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc79400e830 con 0x7fc788003750 2021-12-17T18:21:48.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.504+0000 7fc7a8ca8700 1 -- 172.21.15.62:0/3087088875 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79400e990 con 0x7fc788003750 2021-12-17T18:21:48.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.504+0000 7fc7a8ca8700 1 -- 172.21.15.62:0/3087088875 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc79400ecf0 con 0x7fc788003750 2021-12-17T18:21:48.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.504+0000 7fc7abf0e700 1 -- 172.21.15.62:0/3087088875 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc788003750 msgr2=0x7fc788003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:48.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.504+0000 7fc7abf0e700 1 --2- 172.21.15.62:0/3087088875 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc788003750 0x7fc788003b70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fc79400c000 tx=0x7fc794006df0).stop 2021-12-17T18:21:48.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.504+0000 7fc7aa4ab700 1 -- 172.21.15.62:0/3087088875 reap_dead start 2021-12-17T18:21:48.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.504+0000 7fc7abf0e700 1 -- 172.21.15.62:0/3087088875 shutdown_connections 2021-12-17T18:21:48.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.504+0000 7fc7abf0e700 1 -- 172.21.15.62:0/3087088875 >> 172.21.15.62:0/3087088875 conn(0x7fc7a405f730 msgr2=0x7fc7a405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:48.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.504+0000 7fc7abf0e700 1 -- 172.21.15.62:0/3087088875 shutdown_connections 2021-12-17T18:21:48.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.504+0000 7fc7abf0e700 1 -- 172.21.15.62:0/3087088875 wait complete. 2021-12-17T18:21:48.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7abf0e700 1 Processor -- start 2021-12-17T18:21:48.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7abf0e700 1 -- start start 2021-12-17T18:21:48.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7abf0e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc788003750 0x7fc7a414def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:48.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7abf0e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7a414e3e0 0x7fc7a4156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:48.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7abf0e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc7a41571f0 0x7fc7a41576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:48.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7abf0e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a414d430 con 0x7fc7a414e3e0 2021-12-17T18:21:48.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7abf0e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a414c600 con 0x7fc788003750 2021-12-17T18:21:48.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7abf0e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a414d660 con 0x7fc7a41571f0 2021-12-17T18:21:48.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7a94a9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7a414e3e0 0x7fc7a4156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:48.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7a94a9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7a414e3e0 0x7fc7a4156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50572/0 (socket says 172.21.15.62:50572) 2021-12-17T18:21:48.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7a94a9700 1 -- 172.21.15.62:0/989137725 learned_addr learned my addr 172.21.15.62:0/989137725 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:48.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7a9caa700 1 --2- 172.21.15.62:0/989137725 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc788003750 0x7fc7a414def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:48.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7aa4ab700 1 --2- 172.21.15.62:0/989137725 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc7a41571f0 0x7fc7a41576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:48.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7a94a9700 1 -- 172.21.15.62:0/989137725 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc7a41571f0 msgr2=0x7fc7a41576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:48.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7a94a9700 1 --2- 172.21.15.62:0/989137725 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc7a41571f0 0x7fc7a41576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7a94a9700 1 -- 172.21.15.62:0/989137725 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc788003750 msgr2=0x7fc7a414def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:48.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7a94a9700 1 --2- 172.21.15.62:0/989137725 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc788003750 0x7fc7a414def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7a94a9700 1 -- 172.21.15.62:0/989137725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a40ac560 con 0x7fc7a414e3e0 2021-12-17T18:21:48.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7a94a9700 1 --2- 172.21.15.62:0/989137725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7a414e3e0 0x7fc7a4156d00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fc7a000b000 tx=0x7fc7a0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:48.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc79affd700 1 -- 172.21.15.62:0/989137725 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7a0011e70 con 0x7fc7a414e3e0 2021-12-17T18:21:48.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc79affd700 1 -- 172.21.15.62:0/989137725 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a000f940 con 0x7fc7a414e3e0 2021-12-17T18:21:48.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc79affd700 1 -- 172.21.15.62:0/989137725 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7a000fca0 con 0x7fc7a414e3e0 2021-12-17T18:21:48.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7abf0e700 1 -- 172.21.15.62:0/989137725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a4063660 con 0x7fc7a414e3e0 2021-12-17T18:21:48.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.508+0000 7fc7abf0e700 1 -- 172.21.15.62:0/989137725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a415a250 con 0x7fc7a414e3e0 2021-12-17T18:21:48.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.512+0000 7fc7abf0e700 1 -- 172.21.15.62:0/989137725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a414c770 con 0x7fc7a414e3e0 2021-12-17T18:21:48.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.512+0000 7fc79affd700 1 -- 172.21.15.62:0/989137725 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc7a0014440 con 0x7fc7a414e3e0 2021-12-17T18:21:48.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.512+0000 7fc79affd700 1 --2- 172.21.15.62:0/989137725 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc78c0536a0 0x7fc78c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:48.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.512+0000 7fc79affd700 1 -- 172.21.15.62:0/989137725 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc7a006c000 con 0x7fc7a414e3e0 2021-12-17T18:21:48.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.512+0000 7fc7a9caa700 1 --2- 172.21.15.62:0/989137725 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc78c0536a0 0x7fc78c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:48.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.512+0000 7fc7a9caa700 1 --2- 172.21.15.62:0/989137725 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc78c0536a0 0x7fc78c055b60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fc79401c000 tx=0x7fc794019000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:48.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.516+0000 7fc79affd700 1 -- 172.21.15.62:0/989137725 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc7a414c770 con 0x7fc7a414e3e0 2021-12-17T18:21:48.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.688+0000 7fc7abf0e700 1 -- 172.21.15.62:0/989137725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc7a414c770 con 0x7fc7a414e3e0 2021-12-17T18:21:48.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.688+0000 7fc79affd700 1 -- 172.21.15.62:0/989137725 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fc7a414c770 con 0x7fc7a414e3e0 2021-12-17T18:21:48.690 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:21:48.691 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:21:48.691 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_dump": [ 2021-12-17T18:21:48.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:48.691 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.a", 2021-12-17T18:21:48.692 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhxCS0LBAAtUlkgWYg4l3fQ2au7jMUDg==", 2021-12-17T18:21:48.692 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:21:48.692 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:21:48.692 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:21:48.693 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:21:48.693 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:21:48.693 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:48.693 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:48.694 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:48.694 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.b", 2021-12-17T18:21:48.694 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhoRJAMxAAP/NmDQRwJjYip2rxJsQlYg==", 2021-12-17T18:21:48.694 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:21:48.695 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:21:48.695 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:21:48.695 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:21:48.695 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:21:48.696 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:48.696 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:48.696 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:48.696 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.0", 2021-12-17T18:21:48.696 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBA1LxhJXzhKhAAUnxP3G5VuATkQLoDALFjVg==", 2021-12-17T18:21:48.697 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:21:48.697 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:21:48.697 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:21:48.697 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:21:48.698 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:48.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:48.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:48.698 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.1", 2021-12-17T18:21:48.699 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBD1LxhregUDhAABrxQ2jQ4BwXvuWh/D9SkbQ==", 2021-12-17T18:21:48.699 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:21:48.699 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:21:48.699 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:21:48.699 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:21:48.700 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:48.700 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:48.700 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:48.700 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.2", 2021-12-17T18:21:48.701 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBF1LxhOo/SLhAAhQQLW/VKFx1sgm8chnD5tw==", 2021-12-17T18:21:48.701 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:21:48.701 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:21:48.701 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:21:48.702 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:21:48.702 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:48.702 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:48.702 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:48.703 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.3", 2021-12-17T18:21:48.703 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBI1LxhT2ZQExAA999j8V5bJAJ2PuaQqSkUOw==", 2021-12-17T18:21:48.703 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:21:48.703 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:21:48.703 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:21:48.704 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:21:48.704 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:48.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:48.704 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:48.705 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.4", 2021-12-17T18:21:48.705 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBN1LxhKBDzFhAAKmPF0FXnnfXtweo+6z9nxg==", 2021-12-17T18:21:48.705 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:21:48.705 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:21:48.705 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:21:48.706 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:21:48.706 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:48.706 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:48.706 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:48.707 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.5", 2021-12-17T18:21:48.707 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBP1LxhtqkAORAAVaFLVNIUMs4Sytk8WRaGNA==", 2021-12-17T18:21:48.707 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:21:48.707 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:21:48.708 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:21:48.708 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:21:48.708 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:48.708 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:48.708 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:48.709 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.6", 2021-12-17T18:21:48.709 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBS1LxhNtncGhAAgG64g1ie54CDp9Y7uldKQA==", 2021-12-17T18:21:48.709 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:21:48.709 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:21:48.710 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:21:48.710 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:21:48.710 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:48.710 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:48.710 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:48.711 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.7", 2021-12-17T18:21:48.711 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBV1Lxh3DcDABAAHVskSVtoEJ8BxCCAs3ZDVA==", 2021-12-17T18:21:48.711 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:21:48.711 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:21:48.712 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:21:48.712 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:21:48.712 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:48.712 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:48.712 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:48.713 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.0", 2021-12-17T18:21:48.713 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxh9QhCNxAALkWTJorDpbt9yrikL7/NWg==", 2021-12-17T18:21:48.713 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:21:48.713 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:21:48.714 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:21:48.714 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:21:48.714 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:48.714 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:48.715 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:48.715 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.1", 2021-12-17T18:21:48.715 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxhxm52OxAAbqXVaqRDmt4Ezj9xyCEODQ==", 2021-12-17T18:21:48.715 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:21:48.715 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:21:48.716 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:21:48.716 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:21:48.716 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:48.716 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:48.717 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:48.717 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.2", 2021-12-17T18:21:48.717 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+1LxhXu08BBAATRcUAZvMNg9ou4PLszDtmA==", 2021-12-17T18:21:48.717 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:21:48.718 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:21:48.718 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:21:48.718 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:21:48.718 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:48.719 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:48.719 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:48.719 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.admin", 2021-12-17T18:21:48.719 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhyAGlDRAA2ggSG5yBBFbMgK2fCBk2mQ==", 2021-12-17T18:21:48.719 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:21:48.720 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:21:48.720 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:21:48.720 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:21:48.720 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:21:48.721 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:48.721 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:48.721 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:48.721 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.x", 2021-12-17T18:21:48.721 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhzvntKRAAFQlg69Z6d2nWX0GxSshsMw==", 2021-12-17T18:21:48.722 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:21:48.722 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:21:48.722 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:21:48.722 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:21:48.723 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:48.723 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:48.723 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:48.723 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.y", 2021-12-17T18:21:48.723 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhKdTGJRAArzUN3A1U5Efw0NG9Gw2Gcw==", 2021-12-17T18:21:48.724 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:21:48.724 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:21:48.724 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:21:48.724 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:21:48.725 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:48.725 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:48.725 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:21:48.725 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:21:48.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.692+0000 7fc7abf0e700 1 -- 172.21.15.62:0/989137725 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc78c0536a0 msgr2=0x7fc78c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:48.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.692+0000 7fc7abf0e700 1 --2- 172.21.15.62:0/989137725 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc78c0536a0 0x7fc78c055b60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fc79401c000 tx=0x7fc794019000).stop 2021-12-17T18:21:48.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.692+0000 7fc7abf0e700 1 -- 172.21.15.62:0/989137725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7a414e3e0 msgr2=0x7fc7a4156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:48.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.692+0000 7fc7abf0e700 1 --2- 172.21.15.62:0/989137725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7a414e3e0 0x7fc7a4156d00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fc7a000b000 tx=0x7fc7a0006df0).stop 2021-12-17T18:21:48.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.692+0000 7fc7abf0e700 1 -- 172.21.15.62:0/989137725 shutdown_connections 2021-12-17T18:21:48.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.692+0000 7fc7abf0e700 1 --2- 172.21.15.62:0/989137725 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc78c0536a0 0x7fc78c055b60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.692+0000 7fc7abf0e700 1 --2- 172.21.15.62:0/989137725 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc7a41571f0 0x7fc7a41576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.692+0000 7fc7abf0e700 1 --2- 172.21.15.62:0/989137725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7a414e3e0 0x7fc7a4156d00 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.692+0000 7fc7abf0e700 1 --2- 172.21.15.62:0/989137725 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc788003750 0x7fc7a414def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.692+0000 7fc7abf0e700 1 -- 172.21.15.62:0/989137725 >> 172.21.15.62:0/989137725 conn(0x7fc7a405f730 msgr2=0x7fc7a4149660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:48.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.692+0000 7fc7abf0e700 1 -- 172.21.15.62:0/989137725 shutdown_connections 2021-12-17T18:21:48.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.692+0000 7fc7abf0e700 1 -- 172.21.15.62:0/989137725 wait complete. 2021-12-17T18:21:48.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:21:48.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.836+0000 7fe0af59e700 1 Processor -- start 2021-12-17T18:21:48.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.836+0000 7fe0af59e700 1 -- start start 2021-12-17T18:21:48.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.836+0000 7fe0af59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe0b0141480 0x7fe0b0147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:48.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.836+0000 7fe0af59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe0b00a71e0 0x7fe0b00a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:48.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.836+0000 7fe0af59e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b00b6270 con 0x7fe0b00a8e10 2021-12-17T18:21:48.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.836+0000 7fe0af59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b0147610 con 0x7fe0b00a71e0 2021-12-17T18:21:48.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.836+0000 7fe0af59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b01478b0 con 0x7fe0b0141480 2021-12-17T18:21:48.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.836+0000 7fe0aed9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe0b00a71e0 0x7fe0b00a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:48.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.836+0000 7fe0aed9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe0b00a71e0 0x7fe0b00a7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50580/0 (socket says 172.21.15.62:50580) 2021-12-17T18:21:48.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.836+0000 7fe0aed9d700 1 -- 172.21.15.62:0/3862532438 learned_addr learned my addr 172.21.15.62:0/3862532438 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:48.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.836+0000 7fe0ae59c700 1 --2- 172.21.15.62:0/3862532438 >> v2:172.21.15.109:3300/0 conn(0x7fe0b0141480 0x7fe0b0147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:48.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.836+0000 7fe0aed9d700 1 -- 172.21.15.62:0/3862532438 >> v2:172.21.15.109:3300/0 conn(0x7fe0b0141480 msgr2=0x7fe0b0147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:48.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.836+0000 7fe0aed9d700 1 --2- 172.21.15.62:0/3862532438 >> v2:172.21.15.109:3300/0 conn(0x7fe0b0141480 0x7fe0b0147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.836+0000 7fe0aed9d700 1 -- 172.21.15.62:0/3862532438 >> v1:172.21.15.109:6789/0 conn(0x7fe0b00a8e10 legacy=0x7fe0b00b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:48.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.840+0000 7fe0aed9d700 1 -- 172.21.15.62:0/3862532438 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b0147b50 con 0x7fe0b00a71e0 2021-12-17T18:21:48.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.840+0000 7fe0ad59a700 1 -- 172.21.15.62:0/3862532438 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894033036 0 0) 0x7fe0b00b6270 con 0x7fe0b00a8e10 2021-12-17T18:21:48.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.840+0000 7fe0aed9d700 1 --2- 172.21.15.62:0/3862532438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0b00a71e0 0x7fe0b00a7900 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fe0a80032f0 tx=0x7fe0a8009290).ready entity=mon.0 client_cookie=9074361d394adb19 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:48.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.840+0000 7fe0ad59a700 1 -- 172.21.15.62:0/3862532438 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0a800b870 con 0x7fe0b00a71e0 2021-12-17T18:21:48.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.840+0000 7fe0ad59a700 1 -- 172.21.15.62:0/3862532438 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a800b9d0 con 0x7fe0b00a71e0 2021-12-17T18:21:48.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.840+0000 7fe0ad59a700 1 -- 172.21.15.62:0/3862532438 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0a800bb40 con 0x7fe0b00a71e0 2021-12-17T18:21:48.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.840+0000 7fe0af59e700 1 -- 172.21.15.62:0/3862532438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0b00a71e0 msgr2=0x7fe0b00a7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:48.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.840+0000 7fe0af59e700 1 --2- 172.21.15.62:0/3862532438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0b00a71e0 0x7fe0b00a7900 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fe0a80032f0 tx=0x7fe0a8009290).stop 2021-12-17T18:21:48.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.840+0000 7fe0af59e700 1 -- 172.21.15.62:0/3862532438 shutdown_connections 2021-12-17T18:21:48.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.840+0000 7fe0af59e700 1 --2- 172.21.15.62:0/3862532438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0b00a71e0 0x7fe0b00a7900 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.840+0000 7fe0af59e700 1 --2- 172.21.15.62:0/3862532438 >> v2:172.21.15.109:3300/0 conn(0x7fe0b0141480 0x7fe0b0147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.840+0000 7fe0af59e700 1 -- 172.21.15.62:0/3862532438 >> 172.21.15.62:0/3862532438 conn(0x7fe0b005d220 msgr2=0x7fe0b00b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:48.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.840+0000 7fe0af59e700 1 -- 172.21.15.62:0/3862532438 shutdown_connections 2021-12-17T18:21:48.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.840+0000 7fe0af59e700 1 -- 172.21.15.62:0/3862532438 wait complete. 2021-12-17T18:21:48.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0af59e700 1 Processor -- start 2021-12-17T18:21:48.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0af59e700 1 -- start start 2021-12-17T18:21:48.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0af59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0b00a71e0 0x7fe0b0148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:48.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0af59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0b00a8e10 0x7fe0b015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:48.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0af59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0b0141480 0x7fe0b015b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:48.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0af59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b00b5810 con 0x7fe0b00a8e10 2021-12-17T18:21:48.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0af59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b00b5ab0 con 0x7fe0b00a71e0 2021-12-17T18:21:48.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0af59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b00b5d50 con 0x7fe0b0141480 2021-12-17T18:21:48.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0add9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0b00a8e10 0x7fe0b015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:48.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0add9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0b00a8e10 0x7fe0b015ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50584/0 (socket says 172.21.15.62:50584) 2021-12-17T18:21:48.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0add9b700 1 -- 172.21.15.62:0/3705016383 learned_addr learned my addr 172.21.15.62:0/3705016383 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:48.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0aed9d700 1 --2- 172.21.15.62:0/3705016383 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0b0141480 0x7fe0b015b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:48.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0ae59c700 1 --2- 172.21.15.62:0/3705016383 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0b00a71e0 0x7fe0b0148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:48.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0add9b700 1 -- 172.21.15.62:0/3705016383 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0b0141480 msgr2=0x7fe0b015b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:48.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0add9b700 1 --2- 172.21.15.62:0/3705016383 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0b0141480 0x7fe0b015b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0add9b700 1 -- 172.21.15.62:0/3705016383 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0b00a71e0 msgr2=0x7fe0b0148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:48.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0add9b700 1 --2- 172.21.15.62:0/3705016383 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0b00a71e0 0x7fe0b0148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0add9b700 1 -- 172.21.15.62:0/3705016383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a8009530 con 0x7fe0b00a8e10 2021-12-17T18:21:48.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe0add9b700 1 --2- 172.21.15.62:0/3705016383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0b00a8e10 0x7fe0b015ab50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fe0a0000bc0 tx=0x7fe0a0007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:48.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.844+0000 7fe09f7fe700 1 -- 172.21.15.62:0/3705016383 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0a0012400 con 0x7fe0b00a8e10 2021-12-17T18:21:48.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.848+0000 7fe09f7fe700 1 -- 172.21.15.62:0/3705016383 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a0012560 con 0x7fe0b00a8e10 2021-12-17T18:21:48.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.848+0000 7fe0af59e700 1 -- 172.21.15.62:0/3705016383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b00ab430 con 0x7fe0b00a8e10 2021-12-17T18:21:48.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.848+0000 7fe09f7fe700 1 -- 172.21.15.62:0/3705016383 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0a00128c0 con 0x7fe0b00a8e10 2021-12-17T18:21:48.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.848+0000 7fe0af59e700 1 -- 172.21.15.62:0/3705016383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b00b4840 con 0x7fe0b00a8e10 2021-12-17T18:21:48.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.848+0000 7fe0af59e700 1 -- 172.21.15.62:0/3705016383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b00b5f10 con 0x7fe0b00a8e10 2021-12-17T18:21:48.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.848+0000 7fe09f7fe700 1 -- 172.21.15.62:0/3705016383 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe0a0019030 con 0x7fe0b00a8e10 2021-12-17T18:21:48.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.848+0000 7fe09f7fe700 1 --2- 172.21.15.62:0/3705016383 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe08c053610 0x7fe08c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:48.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.848+0000 7fe09f7fe700 1 -- 172.21.15.62:0/3705016383 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe0a006a840 con 0x7fe0b00a8e10 2021-12-17T18:21:48.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.848+0000 7fe0ae59c700 1 --2- 172.21.15.62:0/3705016383 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe08c053610 0x7fe08c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:48.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.852+0000 7fe0ae59c700 1 --2- 172.21.15.62:0/3705016383 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe08c053610 0x7fe08c055ad0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fe0a400b000 tx=0x7fe0a4006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:48.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.856+0000 7fe09f7fe700 1 -- 172.21.15.62:0/3705016383 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe0a0041d80 con 0x7fe0b00a8e10 2021-12-17T18:21:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.984+0000 7fe0af59e700 1 -- 172.21.15.62:0/3705016383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0b00b5600 con 0x7fe0b00a8e10 2021-12-17T18:21:48.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.984+0000 7fe09f7fe700 1 -- 172.21.15.62:0/3705016383 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+13229 (secure 0 0 0) 0x7fe0a00243c0 con 0x7fe0b00a8e10 2021-12-17T18:21:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:21:48.988 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":47,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:21:48.355817+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:21:48.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.988+0000 7fe0af59e700 1 -- 172.21.15.62:0/3705016383 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe08c053610 msgr2=0x7fe08c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:48.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.988+0000 7fe0af59e700 1 --2- 172.21.15.62:0/3705016383 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe08c053610 0x7fe08c055ad0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fe0a400b000 tx=0x7fe0a4006df0).stop 2021-12-17T18:21:48.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.988+0000 7fe0af59e700 1 -- 172.21.15.62:0/3705016383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0b00a8e10 msgr2=0x7fe0b015ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.988+0000 7fe0af59e700 1 --2- 172.21.15.62:0/3705016383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0b00a8e10 0x7fe0b015ab50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fe0a0000bc0 tx=0x7fe0a0007a70).stop 2021-12-17T18:21:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.988+0000 7fe0af59e700 1 -- 172.21.15.62:0/3705016383 shutdown_connections 2021-12-17T18:21:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.988+0000 7fe0af59e700 1 --2- 172.21.15.62:0/3705016383 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe08c053610 0x7fe08c055ad0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.988+0000 7fe0af59e700 1 --2- 172.21.15.62:0/3705016383 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0b0141480 0x7fe0b015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.988+0000 7fe0af59e700 1 --2- 172.21.15.62:0/3705016383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0b00a8e10 0x7fe0b015ab50 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.988+0000 7fe0af59e700 1 --2- 172.21.15.62:0/3705016383 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0b00a71e0 0x7fe0b0148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:48.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.988+0000 7fe0af59e700 1 -- 172.21.15.62:0/3705016383 >> 172.21.15.62:0/3705016383 conn(0x7fe0b005d220 msgr2=0x7fe0b005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:48.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.988+0000 7fe0af59e700 1 -- 172.21.15.62:0/3705016383 shutdown_connections 2021-12-17T18:21:48.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:48.988+0000 7fe0af59e700 1 -- 172.21.15.62:0/3705016383 wait complete. 2021-12-17T18:21:49.001 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-12-17T18:21:49.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:21:49.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.112+0000 7fe47f024700 1 Processor -- start 2021-12-17T18:21:49.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.112+0000 7fe47f024700 1 -- start start 2021-12-17T18:21:49.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.112+0000 7fe47f024700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4780b0f20 0x7fe4780b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.112+0000 7fe47f024700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe478063c60 con 0x7fe478143610 2021-12-17T18:21:49.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.112+0000 7fe47f024700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4780b1430 con 0x7fe478063880 2021-12-17T18:21:49.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.112+0000 7fe47f024700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4780b3e90 con 0x7fe4780b0f20 2021-12-17T18:21:49.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.112+0000 7fe46ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4780b0f20 0x7fe4780b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.112+0000 7fe46ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4780b0f20 0x7fe4780b1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50592/0 (socket says 172.21.15.62:50592) 2021-12-17T18:21:49.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.112+0000 7fe46ffff700 1 -- 172.21.15.62:0/2499331185 learned_addr learned my addr 172.21.15.62:0/2499331185 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:49.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.112+0000 7fe46ffff700 1 -- 172.21.15.62:0/2499331185 >> v1:172.21.15.109:6789/0 conn(0x7fe478063880 legacy=0x7fe4780aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.112+0000 7fe46ffff700 1 -- 172.21.15.62:0/2499331185 >> v1:172.21.15.62:6789/0 conn(0x7fe478143610 legacy=0x7fe478143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.112+0000 7fe46ffff700 1 -- 172.21.15.62:0/2499331185 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4780ab5a0 con 0x7fe4780b0f20 2021-12-17T18:21:49.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.112+0000 7fe46ffff700 1 --2- 172.21.15.62:0/2499331185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4780b0f20 0x7fe4780b1ab0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fe468002f70 tx=0x7fe468006eb0).ready entity=mon.0 client_cookie=49747295524cb003 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:49.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.112+0000 7fe46f7fe700 1 -- 172.21.15.62:0/2499331185 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe46800d660 con 0x7fe4780b0f20 2021-12-17T18:21:49.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.112+0000 7fe46f7fe700 1 -- 172.21.15.62:0/2499331185 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe468000e90 con 0x7fe4780b0f20 2021-12-17T18:21:49.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.112+0000 7fe46f7fe700 1 -- 172.21.15.62:0/2499331185 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe46800d9f0 con 0x7fe4780b0f20 2021-12-17T18:21:49.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47f024700 1 -- 172.21.15.62:0/2499331185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4780b0f20 msgr2=0x7fe4780b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47f024700 1 --2- 172.21.15.62:0/2499331185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4780b0f20 0x7fe4780b1ab0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fe468002f70 tx=0x7fe468006eb0).stop 2021-12-17T18:21:49.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47f024700 1 -- 172.21.15.62:0/2499331185 shutdown_connections 2021-12-17T18:21:49.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47f024700 1 --2- 172.21.15.62:0/2499331185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4780b0f20 0x7fe4780b1ab0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47f024700 1 -- 172.21.15.62:0/2499331185 >> 172.21.15.62:0/2499331185 conn(0x7fe4780625b0 msgr2=0x7fe478062990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:49.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47f024700 1 -- 172.21.15.62:0/2499331185 shutdown_connections 2021-12-17T18:21:49.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47f024700 1 -- 172.21.15.62:0/2499331185 wait complete. 2021-12-17T18:21:49.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47f024700 1 Processor -- start 2021-12-17T18:21:49.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47f024700 1 -- start start 2021-12-17T18:21:49.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47f024700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe478063880 0x7fe4781460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47f024700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4780b0f20 0x7fe478155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47f024700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe478143610 0x7fe4780adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47f024700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47813b560 con 0x7fe4780b0f20 2021-12-17T18:21:49.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47f024700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe478155f60 con 0x7fe478063880 2021-12-17T18:21:49.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47f024700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4781421a0 con 0x7fe478143610 2021-12-17T18:21:49.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe46ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4780b0f20 0x7fe478155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47d5c1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe478143610 0x7fe4780adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47cdc0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe478063880 0x7fe4781460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47cdc0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe478063880 0x7fe4781460d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:57146/0 (socket says 172.21.15.62:57146) 2021-12-17T18:21:49.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.116+0000 7fe47cdc0700 1 -- 172.21.15.62:0/1627719539 learned_addr learned my addr 172.21.15.62:0/1627719539 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:49.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.120+0000 7fe47cdc0700 1 -- 172.21.15.62:0/1627719539 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe478143610 msgr2=0x7fe4780adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.120+0000 7fe47cdc0700 1 --2- 172.21.15.62:0/1627719539 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe478143610 0x7fe4780adea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.120+0000 7fe47cdc0700 1 -- 172.21.15.62:0/1627719539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4780b0f20 msgr2=0x7fe478155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.120+0000 7fe47cdc0700 1 --2- 172.21.15.62:0/1627719539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4780b0f20 0x7fe478155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.120+0000 7fe47cdc0700 1 -- 172.21.15.62:0/1627719539 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46800b1e0 con 0x7fe478063880 2021-12-17T18:21:49.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.120+0000 7fe46ffff700 1 --2- 172.21.15.62:0/1627719539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4780b0f20 0x7fe478155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:21:49.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.120+0000 7fe47cdc0700 1 --2- 172.21.15.62:0/1627719539 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe478063880 0x7fe4781460d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fe47813b6a0 tx=0x7fe474007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:49.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.120+0000 7fe46dffb700 1 -- 172.21.15.62:0/1627719539 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe474012400 con 0x7fe478063880 2021-12-17T18:21:49.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.120+0000 7fe47f024700 1 -- 172.21.15.62:0/1627719539 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe478141f00 con 0x7fe478063880 2021-12-17T18:21:49.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.120+0000 7fe46dffb700 1 -- 172.21.15.62:0/1627719539 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe474012560 con 0x7fe478063880 2021-12-17T18:21:49.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.120+0000 7fe46dffb700 1 -- 172.21.15.62:0/1627719539 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4740128c0 con 0x7fe478063880 2021-12-17T18:21:49.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.120+0000 7fe47f024700 1 -- 172.21.15.62:0/1627719539 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe478141b30 con 0x7fe478063880 2021-12-17T18:21:49.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.120+0000 7fe47f024700 1 -- 172.21.15.62:0/1627719539 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4780adc00 con 0x7fe478063880 2021-12-17T18:21:49.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.120+0000 7fe46dffb700 1 -- 172.21.15.62:0/1627719539 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe474019030 con 0x7fe478063880 2021-12-17T18:21:49.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.120+0000 7fe46dffb700 1 --2- 172.21.15.62:0/1627719539 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe458053610 0x7fe458055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.124+0000 7fe46dffb700 1 -- 172.21.15.62:0/1627719539 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe47406aaa0 con 0x7fe478063880 2021-12-17T18:21:49.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.124+0000 7fe46ffff700 1 --2- 172.21.15.62:0/1627719539 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe458053610 0x7fe458055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.124+0000 7fe46ffff700 1 --2- 172.21.15.62:0/1627719539 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe458053610 0x7fe458055ad0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fe46801c000 tx=0x7fe468015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:49.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.132+0000 7fe46dffb700 1 -- 172.21.15.62:0/1627719539 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe4780adc00 con 0x7fe478063880 2021-12-17T18:21:49.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.256+0000 7fe47f024700 1 -- 172.21.15.62:0/1627719539 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe4780adc00 con 0x7fe478063880 2021-12-17T18:21:49.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.260+0000 7fe46dffb700 1 -- 172.21.15.62:0/1627719539 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v47) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe4780adc00 con 0x7fe478063880 2021-12-17T18:21:49.260 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:21:49.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.260+0000 7fe47f024700 1 -- 172.21.15.62:0/1627719539 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe458053610 msgr2=0x7fe458055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.260+0000 7fe47f024700 1 --2- 172.21.15.62:0/1627719539 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe458053610 0x7fe458055ad0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fe46801c000 tx=0x7fe468015000).stop 2021-12-17T18:21:49.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.260+0000 7fe47f024700 1 -- 172.21.15.62:0/1627719539 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe478063880 msgr2=0x7fe4781460d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.260+0000 7fe47f024700 1 --2- 172.21.15.62:0/1627719539 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe478063880 0x7fe4781460d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fe47813b6a0 tx=0x7fe474007c50).stop 2021-12-17T18:21:49.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.260+0000 7fe47f024700 1 -- 172.21.15.62:0/1627719539 shutdown_connections 2021-12-17T18:21:49.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.260+0000 7fe47f024700 1 --2- 172.21.15.62:0/1627719539 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe458053610 0x7fe458055ad0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.260+0000 7fe47f024700 1 --2- 172.21.15.62:0/1627719539 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe478143610 0x7fe4780adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.260+0000 7fe47f024700 1 --2- 172.21.15.62:0/1627719539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4780b0f20 0x7fe478155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.260+0000 7fe47f024700 1 --2- 172.21.15.62:0/1627719539 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe478063880 0x7fe4781460d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.260+0000 7fe47f024700 1 -- 172.21.15.62:0/1627719539 >> 172.21.15.62:0/1627719539 conn(0x7fe4780625b0 msgr2=0x7fe4781403d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:49.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.260+0000 7fe47f024700 1 -- 172.21.15.62:0/1627719539 shutdown_connections 2021-12-17T18:21:49.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.260+0000 7fe47f024700 1 -- 172.21.15.62:0/1627719539 wait complete. 2021-12-17T18:21:49.278 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:21:49.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.384+0000 7f352b244700 1 Processor -- start 2021-12-17T18:21:49.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.384+0000 7f352b244700 1 -- start start 2021-12-17T18:21:49.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.384+0000 7f352b244700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3524060260 0x7f352405cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.384+0000 7f352b244700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3524146f70 0x7f35240b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.384+0000 7f352b244700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3524142ff0 con 0x7f352405c750 2021-12-17T18:21:49.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.384+0000 7f352b244700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3524147420 con 0x7f3524060260 2021-12-17T18:21:49.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.384+0000 7f352b244700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3524143290 con 0x7f3524146f70 2021-12-17T18:21:49.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.384+0000 7f3523fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3524060260 0x7f352405cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.384+0000 7f3523fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3524060260 0x7f352405cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50606/0 (socket says 172.21.15.62:50606) 2021-12-17T18:21:49.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.384+0000 7f3523fff700 1 -- 172.21.15.62:0/3737855082 learned_addr learned my addr 172.21.15.62:0/3737855082 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:49.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.384+0000 7f35297e1700 1 --2- 172.21.15.62:0/3737855082 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3524146f70 0x7f35240b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f3523fff700 1 -- 172.21.15.62:0/3737855082 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3524146f70 msgr2=0x7f35240b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:49.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f3523fff700 1 --2- 172.21.15.62:0/3737855082 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3524146f70 0x7f35240b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f3523fff700 1 -- 172.21.15.62:0/3737855082 >> v1:172.21.15.109:6789/0 conn(0x7f352405c750 legacy=0x7f35241439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f3523fff700 1 -- 172.21.15.62:0/3737855082 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3524143530 con 0x7f3524060260 2021-12-17T18:21:49.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f3523fff700 1 --2- 172.21.15.62:0/3737855082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3524060260 0x7f352405cb30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f3514002f70 tx=0x7f3514006eb0).ready entity=mon.0 client_cookie=bc34b240de759808 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:49.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f35237fe700 1 -- 172.21.15.62:0/3737855082 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f351400d570 con 0x7f3524060260 2021-12-17T18:21:49.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f35237fe700 1 -- 172.21.15.62:0/3737855082 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3514000e90 con 0x7f3524060260 2021-12-17T18:21:49.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f35237fe700 1 -- 172.21.15.62:0/3737855082 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f351400d900 con 0x7f3524060260 2021-12-17T18:21:49.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f352b244700 1 -- 172.21.15.62:0/3737855082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3524060260 msgr2=0x7f352405cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f352b244700 1 --2- 172.21.15.62:0/3737855082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3524060260 0x7f352405cb30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f3514002f70 tx=0x7f3514006eb0).stop 2021-12-17T18:21:49.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f352b244700 1 -- 172.21.15.62:0/3737855082 shutdown_connections 2021-12-17T18:21:49.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f352b244700 1 --2- 172.21.15.62:0/3737855082 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3524146f70 0x7f35240b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f352b244700 1 --2- 172.21.15.62:0/3737855082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3524060260 0x7f352405cb30 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f352b244700 1 -- 172.21.15.62:0/3737855082 >> 172.21.15.62:0/3737855082 conn(0x7f3524062430 msgr2=0x7f3524062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:49.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f352b244700 1 -- 172.21.15.62:0/3737855082 shutdown_connections 2021-12-17T18:21:49.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f352b244700 1 -- 172.21.15.62:0/3737855082 wait complete. 2021-12-17T18:21:49.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f352b244700 1 Processor -- start 2021-12-17T18:21:49.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f352b244700 1 -- start start 2021-12-17T18:21:49.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f352b244700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f352405c750 0x7f35240b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f352b244700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3524060260 0x7f352413fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f352b244700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3524146f70 0x7f3524140190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f352b244700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3524064760 con 0x7f3524146f70 2021-12-17T18:21:49.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f352b244700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3524064950 con 0x7f3524060260 2021-12-17T18:21:49.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f352b244700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3524064bf0 con 0x7f352405c750 2021-12-17T18:21:49.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f35297e1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3524146f70 0x7f3524140190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f35297e1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3524146f70 0x7f3524140190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50614/0 (socket says 172.21.15.62:50614) 2021-12-17T18:21:49.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f35297e1700 1 -- 172.21.15.62:0/518174502 learned_addr learned my addr 172.21.15.62:0/518174502 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:49.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f3523fff700 1 --2- 172.21.15.62:0/518174502 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3524060260 0x7f352413fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f3528fe0700 1 --2- 172.21.15.62:0/518174502 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f352405c750 0x7f35240b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f35297e1700 1 -- 172.21.15.62:0/518174502 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f352405c750 msgr2=0x7f35240b99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f35297e1700 1 --2- 172.21.15.62:0/518174502 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f352405c750 0x7f35240b99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f35297e1700 1 -- 172.21.15.62:0/518174502 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3524060260 msgr2=0x7f352413fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f35297e1700 1 --2- 172.21.15.62:0/518174502 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3524060260 0x7f352413fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.388+0000 7f35297e1700 1 -- 172.21.15.62:0/518174502 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351400b1e0 con 0x7f3524146f70 2021-12-17T18:21:49.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.392+0000 7f35297e1700 1 --2- 172.21.15.62:0/518174502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3524146f70 0x7f3524140190 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f351c006e00 tx=0x7f351c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:49.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.392+0000 7f3521ffb700 1 -- 172.21.15.62:0/518174502 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f351c012600 con 0x7f3524146f70 2021-12-17T18:21:49.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.392+0000 7f3521ffb700 1 -- 172.21.15.62:0/518174502 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351c012760 con 0x7f3524146f70 2021-12-17T18:21:49.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.392+0000 7f352b244700 1 -- 172.21.15.62:0/518174502 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3524064e90 con 0x7f3524146f70 2021-12-17T18:21:49.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.392+0000 7f3521ffb700 1 -- 172.21.15.62:0/518174502 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f351c012ac0 con 0x7f3524146f70 2021-12-17T18:21:49.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.392+0000 7f352b244700 1 -- 172.21.15.62:0/518174502 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352413ed00 con 0x7f3524146f70 2021-12-17T18:21:49.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.392+0000 7f352b244700 1 -- 172.21.15.62:0/518174502 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35240655c0 con 0x7f3524146f70 2021-12-17T18:21:49.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.392+0000 7f3521ffb700 1 -- 172.21.15.62:0/518174502 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f351c022070 con 0x7f3524146f70 2021-12-17T18:21:49.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.392+0000 7f3521ffb700 1 --2- 172.21.15.62:0/518174502 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3508053640 0x7f3508055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.396+0000 7f3521ffb700 1 -- 172.21.15.62:0/518174502 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f351c06bc90 con 0x7f3524146f70 2021-12-17T18:21:49.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.396+0000 7f3528fe0700 1 --2- 172.21.15.62:0/518174502 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3508053640 0x7f3508055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.396+0000 7f3528fe0700 1 --2- 172.21.15.62:0/518174502 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3508053640 0x7f3508055b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f350c00d000 tx=0x7f350c007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:49.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.400+0000 7f3521ffb700 1 -- 172.21.15.62:0/518174502 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f351c042f90 con 0x7f3524146f70 2021-12-17T18:21:49.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.524+0000 7f352b244700 1 -- 172.21.15.62:0/518174502 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f35240573d0 con 0x7f3524146f70 2021-12-17T18:21:49.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.524+0000 7f3521ffb700 1 -- 172.21.15.62:0/518174502 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7f351c016020 con 0x7f3524146f70 2021-12-17T18:21:49.527 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:21:49.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.528+0000 7f352b244700 1 -- 172.21.15.62:0/518174502 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3508053640 msgr2=0x7f3508055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.528+0000 7f352b244700 1 --2- 172.21.15.62:0/518174502 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3508053640 0x7f3508055b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f350c00d000 tx=0x7f350c007b90).stop 2021-12-17T18:21:49.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.528+0000 7f352b244700 1 -- 172.21.15.62:0/518174502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3524146f70 msgr2=0x7f3524140190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.528+0000 7f352b244700 1 --2- 172.21.15.62:0/518174502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3524146f70 0x7f3524140190 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f351c006e00 tx=0x7f351c0091d0).stop 2021-12-17T18:21:49.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.528+0000 7f352b244700 1 -- 172.21.15.62:0/518174502 shutdown_connections 2021-12-17T18:21:49.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.528+0000 7f352b244700 1 --2- 172.21.15.62:0/518174502 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3508053640 0x7f3508055b00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.528+0000 7f352b244700 1 --2- 172.21.15.62:0/518174502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3524146f70 0x7f3524140190 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.528+0000 7f352b244700 1 --2- 172.21.15.62:0/518174502 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3524060260 0x7f352413fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.528+0000 7f352b244700 1 --2- 172.21.15.62:0/518174502 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f352405c750 0x7f35240b99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.528+0000 7f352b244700 1 -- 172.21.15.62:0/518174502 >> 172.21.15.62:0/518174502 conn(0x7f3524062430 msgr2=0x7f35241458b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.528+0000 7f352b244700 1 -- 172.21.15.62:0/518174502 shutdown_connections 2021-12-17T18:21:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.528+0000 7f352b244700 1 -- 172.21.15.62:0/518174502 wait complete. 2021-12-17T18:21:49.540 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-12-17T18:21:49.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.636+0000 7f769d4da700 1 Processor -- start 2021-12-17T18:21:49.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.636+0000 7f769d4da700 1 -- start start 2021-12-17T18:21:49.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f769d4da700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f76980b1730 0x7f76980ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f769d4da700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f76980a7bb0 0x7f7698067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f769d4da700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76980b2ce0 con 0x7f76980b21f0 2021-12-17T18:21:49.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f769d4da700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769814b5b0 con 0x7f76980b1730 2021-12-17T18:21:49.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f769d4da700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7698147870 con 0x7f76980a7bb0 2021-12-17T18:21:49.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f76967fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f76980b1730 0x7f76980ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f76967fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f76980b1730 0x7f76980ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50618/0 (socket says 172.21.15.62:50618) 2021-12-17T18:21:49.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f76967fc700 1 -- 172.21.15.62:0/4121131138 learned_addr learned my addr 172.21.15.62:0/4121131138 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:49.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f76977fe700 1 --2- 172.21.15.62:0/4121131138 >> v2:172.21.15.109:3300/0 conn(0x7f76980a7bb0 0x7f7698067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f76967fc700 1 -- 172.21.15.62:0/4121131138 >> v2:172.21.15.109:3300/0 conn(0x7f76980a7bb0 msgr2=0x7f7698067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:49.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f76967fc700 1 --2- 172.21.15.62:0/4121131138 >> v2:172.21.15.109:3300/0 conn(0x7f76980a7bb0 0x7f7698067120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f76967fc700 1 -- 172.21.15.62:0/4121131138 >> v1:172.21.15.109:6789/0 conn(0x7f76980b21f0 legacy=0x7f769814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:49.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f76967fc700 1 -- 172.21.15.62:0/4121131138 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76980aca60 con 0x7f76980b1730 2021-12-17T18:21:49.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f76967fc700 1 --2- 172.21.15.62:0/4121131138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76980b1730 0x7f76980ace90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f76980a88d0 tx=0x7f7680006eb0).ready entity=mon.0 client_cookie=a44f60be9d76284c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:49.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f7695ffb700 1 -- 172.21.15.62:0/4121131138 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f768000d5c0 con 0x7f76980b1730 2021-12-17T18:21:49.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f7695ffb700 1 -- 172.21.15.62:0/4121131138 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7680000e90 con 0x7f76980b1730 2021-12-17T18:21:49.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f7695ffb700 1 -- 172.21.15.62:0/4121131138 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f768000d950 con 0x7f76980b1730 2021-12-17T18:21:49.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f769d4da700 1 -- 172.21.15.62:0/4121131138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76980b1730 msgr2=0x7f76980ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f769d4da700 1 --2- 172.21.15.62:0/4121131138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76980b1730 0x7f76980ace90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f76980a88d0 tx=0x7f7680006eb0).stop 2021-12-17T18:21:49.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f769d4da700 1 -- 172.21.15.62:0/4121131138 shutdown_connections 2021-12-17T18:21:49.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f769d4da700 1 --2- 172.21.15.62:0/4121131138 >> v2:172.21.15.109:3300/0 conn(0x7f76980a7bb0 0x7f7698067120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f769d4da700 1 --2- 172.21.15.62:0/4121131138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76980b1730 0x7f76980ace90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f769d4da700 1 -- 172.21.15.62:0/4121131138 >> 172.21.15.62:0/4121131138 conn(0x7f769805f730 msgr2=0x7f769805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:49.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f769d4da700 1 -- 172.21.15.62:0/4121131138 shutdown_connections 2021-12-17T18:21:49.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f769d4da700 1 -- 172.21.15.62:0/4121131138 wait complete. 2021-12-17T18:21:49.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f769d4da700 1 Processor -- start 2021-12-17T18:21:49.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.640+0000 7f769d4da700 1 -- start start 2021-12-17T18:21:49.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f769d4da700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f76980a7bb0 0x7f76980b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f769d4da700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76980b1730 0x7f7698063a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f769d4da700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f76980b21f0 0x7f7698063ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f769d4da700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76980abbc0 con 0x7f76980b1730 2021-12-17T18:21:49.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f769d4da700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7698066730 con 0x7f76980b21f0 2021-12-17T18:21:49.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f769d4da700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76980669d0 con 0x7f76980a7bb0 2021-12-17T18:21:49.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f76967fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76980b1730 0x7f7698063a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f76967fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76980b1730 0x7f7698063a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50626/0 (socket says 172.21.15.62:50626) 2021-12-17T18:21:49.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f76967fc700 1 -- 172.21.15.62:0/674422945 learned_addr learned my addr 172.21.15.62:0/674422945 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:49.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f76977fe700 1 --2- 172.21.15.62:0/674422945 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f76980b21f0 0x7f7698063ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f7696ffd700 1 --2- 172.21.15.62:0/674422945 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f76980a7bb0 0x7f76980b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f76967fc700 1 -- 172.21.15.62:0/674422945 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f76980a7bb0 msgr2=0x7f76980b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f76967fc700 1 --2- 172.21.15.62:0/674422945 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f76980a7bb0 0x7f76980b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f76967fc700 1 -- 172.21.15.62:0/674422945 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f76980b21f0 msgr2=0x7f7698063ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f76967fc700 1 --2- 172.21.15.62:0/674422945 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f76980b21f0 0x7f7698063ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f76967fc700 1 -- 172.21.15.62:0/674422945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768000b1e0 con 0x7f76980b1730 2021-12-17T18:21:49.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f76977fe700 1 --2- 172.21.15.62:0/674422945 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f76980b21f0 0x7f7698063ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:21:49.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f76967fc700 1 --2- 172.21.15.62:0/674422945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76980b1730 0x7f7698063a00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f76980a88d0 tx=0x7f7680015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:49.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f768ffff700 1 -- 172.21.15.62:0/674422945 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7680011990 con 0x7f76980b1730 2021-12-17T18:21:49.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f768ffff700 1 -- 172.21.15.62:0/674422945 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7680011af0 con 0x7f76980b1730 2021-12-17T18:21:49.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f769d4da700 1 -- 172.21.15.62:0/674422945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76980add20 con 0x7f76980b1730 2021-12-17T18:21:49.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f769d4da700 1 -- 172.21.15.62:0/674422945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76980abff0 con 0x7f76980b1730 2021-12-17T18:21:49.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f768ffff700 1 -- 172.21.15.62:0/674422945 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7680011e50 con 0x7f76980b1730 2021-12-17T18:21:49.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f769d4da700 1 -- 172.21.15.62:0/674422945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76980abd30 con 0x7f76980b1730 2021-12-17T18:21:49.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.644+0000 7f768ffff700 1 -- 172.21.15.62:0/674422945 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7680025030 con 0x7f76980b1730 2021-12-17T18:21:49.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.648+0000 7f768ffff700 1 --2- 172.21.15.62:0/674422945 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f767c0536a0 0x7f767c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.648+0000 7f768ffff700 1 -- 172.21.15.62:0/674422945 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f768006c940 con 0x7f76980b1730 2021-12-17T18:21:49.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.648+0000 7f7696ffd700 1 --2- 172.21.15.62:0/674422945 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f767c0536a0 0x7f767c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.648+0000 7f7696ffd700 1 --2- 172.21.15.62:0/674422945 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f767c0536a0 0x7f767c055b60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f768800a000 tx=0x7f7688008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:49.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.652+0000 7f768ffff700 1 -- 172.21.15.62:0/674422945 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f76980abd30 con 0x7f76980b1730 2021-12-17T18:21:49.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.780+0000 7f769d4da700 1 -- 172.21.15.62:0/674422945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f76980abd00 con 0x7f76980b1730 2021-12-17T18:21:49.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.780+0000 7f768ffff700 1 -- 172.21.15.62:0/674422945 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) v1 ==== 84+0+143 (secure 0 0 0) 0x7f7680023070 con 0x7f76980b1730 2021-12-17T18:21:49.783 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:21:49.783 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2021-12-17T18:21:49.783 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:49.783 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2021-12-17T18:21:49.784 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "device_health_metrics" 2021-12-17T18:21:49.784 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:21:49.784 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:21:49.784 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2021-12-17T18:21:49.785 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2021-12-17T18:21:49.785 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:21:49.785 INFO:teuthology.orchestra.run.smithi062.stdout:] 2021-12-17T18:21:49.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.784+0000 7f769d4da700 1 -- 172.21.15.62:0/674422945 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f767c0536a0 msgr2=0x7f767c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.784+0000 7f769d4da700 1 --2- 172.21.15.62:0/674422945 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f767c0536a0 0x7f767c055b60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f768800a000 tx=0x7f7688008040).stop 2021-12-17T18:21:49.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.784+0000 7f769d4da700 1 -- 172.21.15.62:0/674422945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76980b1730 msgr2=0x7f7698063a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.784+0000 7f769d4da700 1 --2- 172.21.15.62:0/674422945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76980b1730 0x7f7698063a00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f76980a88d0 tx=0x7f7680015000).stop 2021-12-17T18:21:49.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.784+0000 7f769d4da700 1 -- 172.21.15.62:0/674422945 shutdown_connections 2021-12-17T18:21:49.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.784+0000 7f769d4da700 1 --2- 172.21.15.62:0/674422945 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f767c0536a0 0x7f767c055b60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.784+0000 7f769d4da700 1 --2- 172.21.15.62:0/674422945 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f76980b21f0 0x7f7698063ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.784+0000 7f769d4da700 1 --2- 172.21.15.62:0/674422945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76980b1730 0x7f7698063a00 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.784+0000 7f769d4da700 1 --2- 172.21.15.62:0/674422945 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f76980a7bb0 0x7f76980b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.784+0000 7f769d4da700 1 -- 172.21.15.62:0/674422945 >> 172.21.15.62:0/674422945 conn(0x7f769805f730 msgr2=0x7f7698146ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:49.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.784+0000 7f769d4da700 1 -- 172.21.15.62:0/674422945 shutdown_connections 2021-12-17T18:21:49.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.784+0000 7f769d4da700 1 -- 172.21.15.62:0/674422945 wait complete. 2021-12-17T18:21:49.796 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-12-17T18:21:49.797 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-12-17T18:21:49.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.900+0000 7f5af4f1e700 1 Processor -- start 2021-12-17T18:21:49.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.900+0000 7f5af4f1e700 1 -- start start 2021-12-17T18:21:49.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5af4f1e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af00b05b0 0x7f5af0146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5af4f1e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5af00b5dd0 0x7f5af0146b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5af4f1e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af00b2010 con 0x7f5af0147070 2021-12-17T18:21:49.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5af4f1e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af00b0990 con 0x7f5af00b5dd0 2021-12-17T18:21:49.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5af4f1e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af00b2240 con 0x7f5af00b05b0 2021-12-17T18:21:49.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5aeed9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5af0147070 0x7f5af005f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34216/0 (socket says 172.21.15.62:34216) 2021-12-17T18:21:49.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5aeed9d700 1 -- 172.21.15.62:0/2786607703 learned_addr learned my addr 172.21.15.62:0/2786607703 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:49.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5aee59c700 1 --2- 172.21.15.62:0/2786607703 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af00b05b0 0x7f5af0146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5ae7fff700 1 --2- 172.21.15.62:0/2786607703 >> v2:172.21.15.109:3300/0 conn(0x7f5af00b5dd0 0x7f5af0146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5aedd9b700 1 -- 172.21.15.62:0/2786607703 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243040289 0 0) 0x7f5af00b2010 con 0x7f5af0147070 2021-12-17T18:21:49.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5aedd9b700 1 -- 172.21.15.62:0/2786607703 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ad0003260 con 0x7f5af0147070 2021-12-17T18:21:49.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5aedd9b700 1 -- 172.21.15.62:0/2786607703 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2659213617 0 0) 0x7f5ad0003260 con 0x7f5af0147070 2021-12-17T18:21:49.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5aee59c700 1 -- 172.21.15.62:0/2786607703 >> v2:172.21.15.109:3300/0 conn(0x7f5af00b5dd0 msgr2=0x7f5af0146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:49.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5aee59c700 1 --2- 172.21.15.62:0/2786607703 >> v2:172.21.15.109:3300/0 conn(0x7f5af00b5dd0 0x7f5af0146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5aee59c700 1 -- 172.21.15.62:0/2786607703 >> v1:172.21.15.62:6789/0 conn(0x7f5af0147070 legacy=0x7f5af005f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5aee59c700 1 -- 172.21.15.62:0/2786607703 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af00b24e0 con 0x7f5af00b05b0 2021-12-17T18:21:49.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5aee59c700 1 --2- 172.21.15.62:0/2786607703 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af00b05b0 0x7f5af0146690 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f5ae8001b80 tx=0x7f5ae0006df0).ready entity=mon.2 client_cookie=809ee905ff2fbd36 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:49.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5aedd9b700 1 -- 172.21.15.62:0/2786607703 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ae80019e0 con 0x7f5af00b05b0 2021-12-17T18:21:49.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5aedd9b700 1 -- 172.21.15.62:0/2786607703 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae0000e90 con 0x7f5af00b05b0 2021-12-17T18:21:49.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5aedd9b700 1 -- 172.21.15.62:0/2786607703 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ae0012460 con 0x7f5af00b05b0 2021-12-17T18:21:49.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5af4f1e700 1 -- 172.21.15.62:0/2786607703 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af00b05b0 msgr2=0x7f5af0146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5af4f1e700 1 --2- 172.21.15.62:0/2786607703 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af00b05b0 0x7f5af0146690 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f5ae8001b80 tx=0x7f5ae0006df0).stop 2021-12-17T18:21:49.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5af4f1e700 1 -- 172.21.15.62:0/2786607703 shutdown_connections 2021-12-17T18:21:49.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5af4f1e700 1 --2- 172.21.15.62:0/2786607703 >> v2:172.21.15.109:3300/0 conn(0x7f5af00b5dd0 0x7f5af0146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5af4f1e700 1 --2- 172.21.15.62:0/2786607703 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af00b05b0 0x7f5af0146690 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5af4f1e700 1 -- 172.21.15.62:0/2786607703 >> 172.21.15.62:0/2786607703 conn(0x7f5af0062510 msgr2=0x7f5af00628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:49.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5af4f1e700 1 -- 172.21.15.62:0/2786607703 shutdown_connections 2021-12-17T18:21:49.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.904+0000 7f5af4f1e700 1 -- 172.21.15.62:0/2786607703 wait complete. 2021-12-17T18:21:49.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5af4f1e700 1 Processor -- start 2021-12-17T18:21:49.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5af4f1e700 1 -- start start 2021-12-17T18:21:49.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5af4f1e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af00b05b0 0x7f5af0063570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5af4f1e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5af00b5dd0 0x7f5af0152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5af4f1e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af0064c80 0x7f5af0145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5af4f1e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af0142d30 con 0x7f5af00b05b0 2021-12-17T18:21:49.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5af4f1e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af00a46d0 con 0x7f5af00b5dd0 2021-12-17T18:21:49.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5af4f1e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af0152440 con 0x7f5af0064c80 2021-12-17T18:21:49.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5aee59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af00b05b0 0x7f5af0063570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5aee59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af00b05b0 0x7f5af0063570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50638/0 (socket says 172.21.15.62:50638) 2021-12-17T18:21:49.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5aee59c700 1 -- 172.21.15.62:0/4128315333 learned_addr learned my addr 172.21.15.62:0/4128315333 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:49.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5ae7fff700 1 --2- 172.21.15.62:0/4128315333 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5af00b5dd0 0x7f5af0152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5aee59c700 1 -- 172.21.15.62:0/4128315333 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af0064c80 msgr2=0x7f5af0145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5aeed9d700 1 --2- 172.21.15.62:0/4128315333 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af0064c80 0x7f5af0145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5aee59c700 1 --2- 172.21.15.62:0/4128315333 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af0064c80 0x7f5af0145520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5aee59c700 1 -- 172.21.15.62:0/4128315333 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5af00b5dd0 msgr2=0x7f5af0152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:49.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5aee59c700 1 --2- 172.21.15.62:0/4128315333 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5af00b5dd0 0x7f5af0152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:49.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5aee59c700 1 -- 172.21.15.62:0/4128315333 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae000b180 con 0x7f5af00b05b0 2021-12-17T18:21:49.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5aeed9d700 1 --2- 172.21.15.62:0/4128315333 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af0064c80 0x7f5af0145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:21:49.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5aee59c700 1 --2- 172.21.15.62:0/4128315333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af00b05b0 0x7f5af0063570 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f5ae8001b80 tx=0x7f5ae0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:49.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5ae77fe700 1 -- 172.21.15.62:0/4128315333 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ae000da20 con 0x7f5af00b05b0 2021-12-17T18:21:49.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5ae77fe700 1 -- 172.21.15.62:0/4128315333 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae000db80 con 0x7f5af00b05b0 2021-12-17T18:21:49.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5ae77fe700 1 -- 172.21.15.62:0/4128315333 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ae001e400 con 0x7f5af00b05b0 2021-12-17T18:21:49.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5af4f1e700 1 -- 172.21.15.62:0/4128315333 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af01526e0 con 0x7f5af00b05b0 2021-12-17T18:21:49.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5af4f1e700 1 -- 172.21.15.62:0/4128315333 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af0063a60 con 0x7f5af00b05b0 2021-12-17T18:21:49.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.908+0000 7f5af4f1e700 1 -- 172.21.15.62:0/4128315333 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af0152870 con 0x7f5af00b05b0 2021-12-17T18:21:49.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.912+0000 7f5ae77fe700 1 -- 172.21.15.62:0/4128315333 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5ae001c070 con 0x7f5af00b05b0 2021-12-17T18:21:49.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.912+0000 7f5ae77fe700 1 --2- 172.21.15.62:0/4128315333 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5ad4053610 0x7f5ad4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:49.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.912+0000 7f5ae77fe700 1 -- 172.21.15.62:0/4128315333 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5ae006c170 con 0x7f5af00b05b0 2021-12-17T18:21:49.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.912+0000 7f5ae7fff700 1 --2- 172.21.15.62:0/4128315333 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5ad4053610 0x7f5ad4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:49.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.912+0000 7f5ae7fff700 1 --2- 172.21.15.62:0/4128315333 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5ad4053610 0x7f5ad4055ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f5ad800b000 tx=0x7f5ad8008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:49.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:49.920+0000 7f5ae77fe700 1 -- 172.21.15.62:0/4128315333 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ae00434f0 con 0x7f5af00b05b0 2021-12-17T18:21:50.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.044+0000 7f5af4f1e700 1 -- 172.21.15.62:0/4128315333 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f5af00b2780 con 0x7f5af00b05b0 2021-12-17T18:21:50.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.708+0000 7f5ae77fe700 1 -- 172.21.15.62:0/4128315333 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5ae00230a0 con 0x7f5af00b05b0 2021-12-17T18:21:50.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.708+0000 7f5af4f1e700 1 -- 172.21.15.62:0/4128315333 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5ad4053610 msgr2=0x7f5ad4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:50.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.708+0000 7f5af4f1e700 1 --2- 172.21.15.62:0/4128315333 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5ad4053610 0x7f5ad4055ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f5ad800b000 tx=0x7f5ad8008040).stop 2021-12-17T18:21:50.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.708+0000 7f5af4f1e700 1 -- 172.21.15.62:0/4128315333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af00b05b0 msgr2=0x7f5af0063570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:50.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.708+0000 7f5af4f1e700 1 --2- 172.21.15.62:0/4128315333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af00b05b0 0x7f5af0063570 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f5ae8001b80 tx=0x7f5ae0014000).stop 2021-12-17T18:21:50.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.708+0000 7f5af4f1e700 1 -- 172.21.15.62:0/4128315333 shutdown_connections 2021-12-17T18:21:50.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.708+0000 7f5af4f1e700 1 --2- 172.21.15.62:0/4128315333 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5ad4053610 0x7f5ad4055ad0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:50.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.708+0000 7f5af4f1e700 1 --2- 172.21.15.62:0/4128315333 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5af0064c80 0x7f5af0145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:50.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.708+0000 7f5af4f1e700 1 --2- 172.21.15.62:0/4128315333 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5af00b5dd0 0x7f5af0152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:50.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.708+0000 7f5af4f1e700 1 --2- 172.21.15.62:0/4128315333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af00b05b0 0x7f5af0063570 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:50.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.708+0000 7f5af4f1e700 1 -- 172.21.15.62:0/4128315333 >> 172.21.15.62:0/4128315333 conn(0x7f5af0062510 msgr2=0x7f5af00b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:50.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.708+0000 7f5af4f1e700 1 -- 172.21.15.62:0/4128315333 shutdown_connections 2021-12-17T18:21:50.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.708+0000 7f5af4f1e700 1 -- 172.21.15.62:0/4128315333 wait complete. 2021-12-17T18:21:50.714 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2021-12-17T18:21:50.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-12-17T18:21:50.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f4839d32700 1 Processor -- start 2021-12-17T18:21:50.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f4839d32700 1 -- start start 2021-12-17T18:21:50.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f4839d32700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f483405ca90 0x7f48340b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:50.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f4839d32700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48340b4230 0x7f48340b5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:50.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f4839d32700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483405ce70 con 0x7f48340b3540 2021-12-17T18:21:50.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f4839d32700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48340b1bc0 con 0x7f483405ca90 2021-12-17T18:21:50.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f4839d32700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48340b1e60 con 0x7f48340b4230 2021-12-17T18:21:50.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f4838d30700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f483405ca90 0x7f48340b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:50.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f4833fff700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f48340b3540 0x7f48340b4f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:50548/0 (socket says 172.21.15.62:50548) 2021-12-17T18:21:50.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f4833fff700 1 -- 172.21.15.62:0/4096180697 learned_addr learned my addr 172.21.15.62:0/4096180697 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:50.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f4839531700 1 --2- 172.21.15.62:0/4096180697 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48340b4230 0x7f48340b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:50.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f4838d30700 1 -- 172.21.15.62:0/4096180697 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48340b4230 msgr2=0x7f48340b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:50.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f4838d30700 1 --2- 172.21.15.62:0/4096180697 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48340b4230 0x7f48340b5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:50.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f4838d30700 1 -- 172.21.15.62:0/4096180697 >> v1:172.21.15.109:6789/0 conn(0x7f48340b3540 legacy=0x7f48340b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:50.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f4838d30700 1 -- 172.21.15.62:0/4096180697 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48340b2100 con 0x7f483405ca90 2021-12-17T18:21:50.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f4839531700 1 --2- 172.21.15.62:0/4096180697 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48340b4230 0x7f48340b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:21:50.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f48337fe700 1 -- 172.21.15.62:0/4096180697 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603184808 0 0) 0x7f483405ce70 con 0x7f48340b3540 2021-12-17T18:21:50.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f4838d30700 1 --2- 172.21.15.62:0/4096180697 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f483405ca90 0x7f48340b25a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f4824002f70 tx=0x7f4824006df0).ready entity=mon.1 client_cookie=47219ca5c2e147e6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:50.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f48337fe700 1 -- 172.21.15.62:0/4096180697 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f482400d570 con 0x7f483405ca90 2021-12-17T18:21:50.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f48337fe700 1 -- 172.21.15.62:0/4096180697 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4824000e90 con 0x7f483405ca90 2021-12-17T18:21:50.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.835+0000 7f48337fe700 1 -- 172.21.15.62:0/4096180697 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f482400d8c0 con 0x7f483405ca90 2021-12-17T18:21:50.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.839+0000 7f4839d32700 1 -- 172.21.15.62:0/4096180697 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f483405ca90 msgr2=0x7f48340b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:50.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.839+0000 7f4839d32700 1 --2- 172.21.15.62:0/4096180697 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f483405ca90 0x7f48340b25a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f4824002f70 tx=0x7f4824006df0).stop 2021-12-17T18:21:50.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.839+0000 7f4839d32700 1 -- 172.21.15.62:0/4096180697 shutdown_connections 2021-12-17T18:21:50.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.839+0000 7f4839d32700 1 --2- 172.21.15.62:0/4096180697 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48340b4230 0x7f48340b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:50.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.839+0000 7f4839d32700 1 --2- 172.21.15.62:0/4096180697 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f483405ca90 0x7f48340b25a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:50.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.839+0000 7f4839d32700 1 -- 172.21.15.62:0/4096180697 >> 172.21.15.62:0/4096180697 conn(0x7f483405bcd0 msgr2=0x7f4834062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:50.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.839+0000 7f4839d32700 1 -- 172.21.15.62:0/4096180697 shutdown_connections 2021-12-17T18:21:50.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.839+0000 7f4839d32700 1 -- 172.21.15.62:0/4096180697 wait complete. 2021-12-17T18:21:50.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.839+0000 7f4839d32700 1 Processor -- start 2021-12-17T18:21:50.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.839+0000 7f4839d32700 1 -- start start 2021-12-17T18:21:50.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839d32700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f483405ca90 0x7f48340a3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:50.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839d32700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48340b3540 0x7f48341494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:50.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839d32700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48340b4230 0x7f4834155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:50.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839d32700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483414a780 con 0x7f48340b4230 2021-12-17T18:21:50.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839d32700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48340a5f40 con 0x7f483405ca90 2021-12-17T18:21:50.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839d32700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483414a9b0 con 0x7f48340b3540 2021-12-17T18:21:50.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839531700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48340b4230 0x7f4834155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:50.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839531700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48340b4230 0x7f4834155f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50656/0 (socket says 172.21.15.62:50656) 2021-12-17T18:21:50.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839531700 1 -- 172.21.15.62:0/2654452195 learned_addr learned my addr 172.21.15.62:0/2654452195 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:50.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4833fff700 1 --2- 172.21.15.62:0/2654452195 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48340b3540 0x7f48341494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:50.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4838d30700 1 --2- 172.21.15.62:0/2654452195 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f483405ca90 0x7f48340a3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:50.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839531700 1 -- 172.21.15.62:0/2654452195 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48340b3540 msgr2=0x7f48341494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:50.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839531700 1 --2- 172.21.15.62:0/2654452195 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48340b3540 0x7f48341494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:50.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839531700 1 -- 172.21.15.62:0/2654452195 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f483405ca90 msgr2=0x7f48340a3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:50.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839531700 1 --2- 172.21.15.62:0/2654452195 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f483405ca90 0x7f48340a3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:50.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839531700 1 -- 172.21.15.62:0/2654452195 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c00b180 con 0x7f48340b4230 2021-12-17T18:21:50.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839531700 1 --2- 172.21.15.62:0/2654452195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48340b4230 0x7f4834155f60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f482c00c000 tx=0x7f482c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:50.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4831ffb700 1 -- 172.21.15.62:0/2654452195 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f482c010780 con 0x7f48340b4230 2021-12-17T18:21:50.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839d32700 1 -- 172.21.15.62:0/2654452195 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f482400b180 con 0x7f48340b4230 2021-12-17T18:21:50.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4831ffb700 1 -- 172.21.15.62:0/2654452195 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482c0108e0 con 0x7f48340b4230 2021-12-17T18:21:50.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839d32700 1 -- 172.21.15.62:0/2654452195 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48340a5c00 con 0x7f48340b4230 2021-12-17T18:21:50.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4831ffb700 1 -- 172.21.15.62:0/2654452195 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f482c010c40 con 0x7f48340b4230 2021-12-17T18:21:50.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.843+0000 7f4839d32700 1 -- 172.21.15.62:0/2654452195 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48340603f0 con 0x7f48340b4230 2021-12-17T18:21:50.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.847+0000 7f4831ffb700 1 -- 172.21.15.62:0/2654452195 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f482c0123f0 con 0x7f48340b4230 2021-12-17T18:21:50.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.847+0000 7f4831ffb700 1 --2- 172.21.15.62:0/2654452195 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f48180536a0 0x7f4818055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:50.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.847+0000 7f4831ffb700 1 -- 172.21.15.62:0/2654452195 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f482c06bce0 con 0x7f48340b4230 2021-12-17T18:21:50.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.847+0000 7f4838d30700 1 --2- 172.21.15.62:0/2654452195 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f48180536a0 0x7f4818055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:50.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.847+0000 7f4838d30700 1 --2- 172.21.15.62:0/2654452195 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f48180536a0 0x7f4818055b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f482401a000 tx=0x7f4824014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:50.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.855+0000 7f4831ffb700 1 -- 172.21.15.62:0/2654452195 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f482c042f10 con 0x7f48340b4230 2021-12-17T18:21:50.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:50.983+0000 7f4839d32700 1 -- 172.21.15.62:0/2654452195 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f48340573d0 con 0x7f48340b4230 2021-12-17T18:21:51.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.367+0000 7f4831ffb700 1 -- 172.21.15.62:0/2654452195 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v49) v1 ==== 125+0+0 (secure 0 0 0) 0x7f482c046530 con 0x7f48340b4230 2021-12-17T18:21:51.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.371+0000 7f4839d32700 1 -- 172.21.15.62:0/2654452195 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f48180536a0 msgr2=0x7f4818055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:51.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.371+0000 7f4839d32700 1 --2- 172.21.15.62:0/2654452195 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f48180536a0 0x7f4818055b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f482401a000 tx=0x7f4824014000).stop 2021-12-17T18:21:51.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.371+0000 7f4839d32700 1 -- 172.21.15.62:0/2654452195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48340b4230 msgr2=0x7f4834155f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:51.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.371+0000 7f4839d32700 1 --2- 172.21.15.62:0/2654452195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48340b4230 0x7f4834155f60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f482c00c000 tx=0x7f482c006df0).stop 2021-12-17T18:21:51.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.375+0000 7f4839d32700 1 -- 172.21.15.62:0/2654452195 shutdown_connections 2021-12-17T18:21:51.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.375+0000 7f4839d32700 1 --2- 172.21.15.62:0/2654452195 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f48180536a0 0x7f4818055b60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.375+0000 7f4839d32700 1 --2- 172.21.15.62:0/2654452195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48340b4230 0x7f4834155f60 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.375+0000 7f4839d32700 1 --2- 172.21.15.62:0/2654452195 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48340b3540 0x7f48341494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.375+0000 7f4839d32700 1 --2- 172.21.15.62:0/2654452195 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f483405ca90 0x7f48340a3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.375+0000 7f4839d32700 1 -- 172.21.15.62:0/2654452195 >> 172.21.15.62:0/2654452195 conn(0x7f483405bcd0 msgr2=0x7f4834062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:51.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.375+0000 7f4839d32700 1 -- 172.21.15.62:0/2654452195 shutdown_connections 2021-12-17T18:21:51.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.375+0000 7f4839d32700 1 -- 172.21.15.62:0/2654452195 wait complete. 2021-12-17T18:21:51.379 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2021-12-17T18:21:51.389 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-12-17T18:21:51.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.495+0000 7f42dfecb700 1 Processor -- start 2021-12-17T18:21:51.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.495+0000 7f42dfecb700 1 -- start start 2021-12-17T18:21:51.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dfecb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42d80b4340 0x7f42d81471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:51.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dfecb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42d80b51a0 0x7f42d80b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:51.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dfecb700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f42d8142660 0x7f42d8142af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:51.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dfecb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d80b09e0 con 0x7f42d80b51a0 2021-12-17T18:21:51.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dfecb700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d8142fe0 con 0x7f42d8142660 2021-12-17T18:21:51.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dfecb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d81467d0 con 0x7f42d80b4340 2021-12-17T18:21:51.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dd466700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42d80b51a0 0x7f42d80b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:51.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dd466700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42d80b51a0 0x7f42d80b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50662/0 (socket says 172.21.15.62:50662) 2021-12-17T18:21:51.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dd466700 1 -- 172.21.15.62:0/1482443026 learned_addr learned my addr 172.21.15.62:0/1482443026 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:51.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42de468700 1 --2- 172.21.15.62:0/1482443026 >> v2:172.21.15.109:3300/0 conn(0x7f42d8142660 0x7f42d8142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:51.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42ddc67700 1 --2- 172.21.15.62:0/1482443026 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42d80b4340 0x7f42d81471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:51.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dd466700 1 -- 172.21.15.62:0/1482443026 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42d80b4340 msgr2=0x7f42d81471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:51.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dd466700 1 --2- 172.21.15.62:0/1482443026 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42d80b4340 0x7f42d81471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dd466700 1 -- 172.21.15.62:0/1482443026 >> v2:172.21.15.109:3300/0 conn(0x7f42d8142660 msgr2=0x7f42d8142af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:51.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dd466700 1 --2- 172.21.15.62:0/1482443026 >> v2:172.21.15.109:3300/0 conn(0x7f42d8142660 0x7f42d8142af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dd466700 1 -- 172.21.15.62:0/1482443026 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d8146a70 con 0x7f42d80b51a0 2021-12-17T18:21:51.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dd466700 1 --2- 172.21.15.62:0/1482443026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d80b51a0 0x7f42d80b28f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f42d80b1610 tx=0x7f42cc006eb0).ready entity=mon.0 client_cookie=fb8bf35ed401ca9f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:51.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dcc65700 1 -- 172.21.15.62:0/1482443026 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42cc00d570 con 0x7f42d80b51a0 2021-12-17T18:21:51.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dcc65700 1 -- 172.21.15.62:0/1482443026 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc000e90 con 0x7f42d80b51a0 2021-12-17T18:21:51.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dcc65700 1 -- 172.21.15.62:0/1482443026 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42cc00d8c0 con 0x7f42d80b51a0 2021-12-17T18:21:51.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dfecb700 1 -- 172.21.15.62:0/1482443026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d80b51a0 msgr2=0x7f42d80b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:51.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dfecb700 1 --2- 172.21.15.62:0/1482443026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d80b51a0 0x7f42d80b28f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f42d80b1610 tx=0x7f42cc006eb0).stop 2021-12-17T18:21:51.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dfecb700 1 -- 172.21.15.62:0/1482443026 shutdown_connections 2021-12-17T18:21:51.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dfecb700 1 --2- 172.21.15.62:0/1482443026 >> v2:172.21.15.109:3300/0 conn(0x7f42d8142660 0x7f42d8142af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dfecb700 1 --2- 172.21.15.62:0/1482443026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d80b51a0 0x7f42d80b28f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dfecb700 1 --2- 172.21.15.62:0/1482443026 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42d80b4340 0x7f42d81471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dfecb700 1 -- 172.21.15.62:0/1482443026 >> 172.21.15.62:0/1482443026 conn(0x7f42d805c750 msgr2=0x7f42d805cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:51.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dfecb700 1 -- 172.21.15.62:0/1482443026 shutdown_connections 2021-12-17T18:21:51.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dfecb700 1 -- 172.21.15.62:0/1482443026 wait complete. 2021-12-17T18:21:51.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dfecb700 1 Processor -- start 2021-12-17T18:21:51.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.499+0000 7f42dfecb700 1 -- start start 2021-12-17T18:21:51.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dfecb700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42d80b4340 0x7f42d813caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:51.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dfecb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d80b51a0 0x7f42d80b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:51.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dfecb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42d8142660 0x7f42d80b9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:51.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dfecb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d80b9b40 con 0x7f42d80b51a0 2021-12-17T18:21:51.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dfecb700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d813f650 con 0x7f42d80b4340 2021-12-17T18:21:51.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dfecb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d813f8f0 con 0x7f42d8142660 2021-12-17T18:21:51.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dd466700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d80b51a0 0x7f42d80b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:51.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dd466700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d80b51a0 0x7f42d80b8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50668/0 (socket says 172.21.15.62:50668) 2021-12-17T18:21:51.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dd466700 1 -- 172.21.15.62:0/4262436093 learned_addr learned my addr 172.21.15.62:0/4262436093 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:51.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42de468700 1 --2- 172.21.15.62:0/4262436093 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42d8142660 0x7f42d80b9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:51.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42ddc67700 1 --2- 172.21.15.62:0/4262436093 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42d80b4340 0x7f42d813caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:51.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dd466700 1 -- 172.21.15.62:0/4262436093 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42d8142660 msgr2=0x7f42d80b9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:51.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dd466700 1 --2- 172.21.15.62:0/4262436093 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42d8142660 0x7f42d80b9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dd466700 1 -- 172.21.15.62:0/4262436093 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42d80b4340 msgr2=0x7f42d813caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:51.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dd466700 1 --2- 172.21.15.62:0/4262436093 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42d80b4340 0x7f42d813caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dd466700 1 -- 172.21.15.62:0/4262436093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc00b1e0 con 0x7f42d80b51a0 2021-12-17T18:21:51.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dd466700 1 --2- 172.21.15.62:0/4262436093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d80b51a0 0x7f42d80b8a90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f42d80b1610 tx=0x7f42cc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:51.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42caffd700 1 -- 172.21.15.62:0/4262436093 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42cc011760 con 0x7f42d80b51a0 2021-12-17T18:21:51.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42caffd700 1 -- 172.21.15.62:0/4262436093 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc0118c0 con 0x7f42d80b51a0 2021-12-17T18:21:51.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dfecb700 1 -- 172.21.15.62:0/4262436093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d813d550 con 0x7f42d80b51a0 2021-12-17T18:21:51.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42caffd700 1 -- 172.21.15.62:0/4262436093 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42cc011c20 con 0x7f42d80b51a0 2021-12-17T18:21:51.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dfecb700 1 -- 172.21.15.62:0/4262436093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d813dc10 con 0x7f42d80b51a0 2021-12-17T18:21:51.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.503+0000 7f42dfecb700 1 -- 172.21.15.62:0/4262436093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d8146d10 con 0x7f42d80b51a0 2021-12-17T18:21:51.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.507+0000 7f42caffd700 1 -- 172.21.15.62:0/4262436093 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f42cc025030 con 0x7f42d80b51a0 2021-12-17T18:21:51.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.507+0000 7f42caffd700 1 --2- 172.21.15.62:0/4262436093 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f42b80536a0 0x7f42b8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:51.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.507+0000 7f42caffd700 1 -- 172.21.15.62:0/4262436093 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f42cc06ca10 con 0x7f42d80b51a0 2021-12-17T18:21:51.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.507+0000 7f42ddc67700 1 --2- 172.21.15.62:0/4262436093 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f42b80536a0 0x7f42b8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:51.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.507+0000 7f42ddc67700 1 --2- 172.21.15.62:0/4262436093 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f42b80536a0 0x7f42b8055b60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f42d400c000 tx=0x7f42d4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:51.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.511+0000 7f42caffd700 1 -- 172.21.15.62:0/4262436093 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f42cc043be0 con 0x7f42d80b51a0 2021-12-17T18:21:51.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.683+0000 7f42dfecb700 1 -- 172.21.15.62:0/4262436093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f42d80573d0 con 0x7f42d80b51a0 2021-12-17T18:21:51.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.695+0000 7f42caffd700 1 -- 172.21.15.62:0/4262436093 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 9 and data pool 10 v20) v1 ==== 188+0+0 (secure 0 0 0) 0x7f42cc023070 con 0x7f42d80b51a0 2021-12-17T18:21:51.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.699+0000 7f42dfecb700 1 -- 172.21.15.62:0/4262436093 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f42b80536a0 msgr2=0x7f42b8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:51.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.699+0000 7f42dfecb700 1 --2- 172.21.15.62:0/4262436093 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f42b80536a0 0x7f42b8055b60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f42d400c000 tx=0x7f42d4008040).stop 2021-12-17T18:21:51.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.699+0000 7f42dfecb700 1 -- 172.21.15.62:0/4262436093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d80b51a0 msgr2=0x7f42d80b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:51.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.699+0000 7f42dfecb700 1 --2- 172.21.15.62:0/4262436093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d80b51a0 0x7f42d80b8a90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f42d80b1610 tx=0x7f42cc015000).stop 2021-12-17T18:21:51.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.699+0000 7f42dfecb700 1 -- 172.21.15.62:0/4262436093 shutdown_connections 2021-12-17T18:21:51.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.699+0000 7f42dfecb700 1 --2- 172.21.15.62:0/4262436093 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f42b80536a0 0x7f42b8055b60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.699+0000 7f42dfecb700 1 --2- 172.21.15.62:0/4262436093 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42d8142660 0x7f42d80b9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.699+0000 7f42dfecb700 1 --2- 172.21.15.62:0/4262436093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d80b51a0 0x7f42d80b8a90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.699+0000 7f42dfecb700 1 --2- 172.21.15.62:0/4262436093 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42d80b4340 0x7f42d813caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.699+0000 7f42dfecb700 1 -- 172.21.15.62:0/4262436093 >> 172.21.15.62:0/4262436093 conn(0x7f42d805c750 msgr2=0x7f42d8143120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:51.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.699+0000 7f42dfecb700 1 -- 172.21.15.62:0/4262436093 shutdown_connections 2021-12-17T18:21:51.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.699+0000 7f42dfecb700 1 -- 172.21.15.62:0/4262436093 wait complete. 2021-12-17T18:21:51.706 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 9 and data pool 10 2021-12-17T18:21:51.718 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:21:51.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.807+0000 7f7a00ddd700 1 Processor -- start 2021-12-17T18:21:51.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.807+0000 7f7a00ddd700 1 -- start start 2021-12-17T18:21:51.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.807+0000 7f7a00ddd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79fc0ad610 0x7f79fc0b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:51.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.807+0000 7f7a00ddd700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79fc0ad9f0 con 0x7f79fc13f470 2021-12-17T18:21:51.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.807+0000 7f7a00ddd700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79fc0b19e0 con 0x7f79fc0b0e00 2021-12-17T18:21:51.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.807+0000 7f7a00ddd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0ad010 con 0x7f79fc0ad610 2021-12-17T18:21:51.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.807+0000 7f79fad9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f79fc13f470 0x7f79fc143000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34270/0 (socket says 172.21.15.62:34270) 2021-12-17T18:21:51.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.807+0000 7f79fad9d700 1 -- 172.21.15.62:0/861168843 learned_addr learned my addr 172.21.15.62:0/861168843 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:51.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.807+0000 7f79fa59c700 1 --2- 172.21.15.62:0/861168843 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79fc0ad610 0x7f79fc0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:51.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.807+0000 7f79f959a700 1 -- 172.21.15.62:0/861168843 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362805889 0 0) 0x7f79fc0ad9f0 con 0x7f79fc13f470 2021-12-17T18:21:51.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.807+0000 7f79f959a700 1 -- 172.21.15.62:0/861168843 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79e0003260 con 0x7f79fc13f470 2021-12-17T18:21:51.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.807+0000 7f79f959a700 1 -- 172.21.15.62:0/861168843 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38697133 0 0) 0x7f79fc0b19e0 con 0x7f79fc0b0e00 2021-12-17T18:21:51.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f79f959a700 1 -- 172.21.15.62:0/861168843 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79fc0ad9f0 con 0x7f79fc0b0e00 2021-12-17T18:21:51.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f79fa59c700 1 -- 172.21.15.62:0/861168843 >> v1:172.21.15.109:6789/0 conn(0x7f79fc0b0e00 legacy=0x7f79fc13ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:51.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f79fa59c700 1 -- 172.21.15.62:0/861168843 >> v1:172.21.15.62:6789/0 conn(0x7f79fc13f470 legacy=0x7f79fc143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:51.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f79f959a700 1 -- 172.21.15.62:0/861168843 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2267666637 0 0) 0x7f79e0003260 con 0x7f79fc13f470 2021-12-17T18:21:51.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f79fa59c700 1 -- 172.21.15.62:0/861168843 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc0b1c80 con 0x7f79fc0ad610 2021-12-17T18:21:51.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f79fa59c700 1 --2- 172.21.15.62:0/861168843 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79fc0ad610 0x7f79fc0b2370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f79ec001110 tx=0x7f79f40091d0).ready entity=mon.2 client_cookie=ee4747eb5a6b8fe server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:51.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f79f959a700 1 -- 172.21.15.62:0/861168843 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79ec001680 con 0x7f79fc0ad610 2021-12-17T18:21:51.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f79f959a700 1 -- 172.21.15.62:0/861168843 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f400f510 con 0x7f79fc0ad610 2021-12-17T18:21:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f79f959a700 1 -- 172.21.15.62:0/861168843 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79f400f680 con 0x7f79fc0ad610 2021-12-17T18:21:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f7a00ddd700 1 -- 172.21.15.62:0/861168843 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79fc0ad610 msgr2=0x7f79fc0b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f7a00ddd700 1 --2- 172.21.15.62:0/861168843 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79fc0ad610 0x7f79fc0b2370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f79ec001110 tx=0x7f79f40091d0).stop 2021-12-17T18:21:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f7a00ddd700 1 -- 172.21.15.62:0/861168843 shutdown_connections 2021-12-17T18:21:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f7a00ddd700 1 --2- 172.21.15.62:0/861168843 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79fc0ad610 0x7f79fc0b2370 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f7a00ddd700 1 -- 172.21.15.62:0/861168843 >> 172.21.15.62:0/861168843 conn(0x7f79fc05c750 msgr2=0x7f79fc0630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f7a00ddd700 1 -- 172.21.15.62:0/861168843 shutdown_connections 2021-12-17T18:21:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f7a00ddd700 1 -- 172.21.15.62:0/861168843 wait complete. 2021-12-17T18:21:51.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f7a00ddd700 1 Processor -- start 2021-12-17T18:21:51.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.811+0000 7f7a00ddd700 1 -- start start 2021-12-17T18:21:51.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f7a00ddd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79fc0ad610 0x7f79fc065ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:51.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f7a00ddd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79fc0b0e00 0x7f79fc067060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:51.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f7a00ddd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79fc13f470 0x7f79fc1380e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:51.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f7a00ddd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc065770 con 0x7f79fc13f470 2021-12-17T18:21:51.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f7a00ddd700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0b2880 con 0x7f79fc0b0e00 2021-12-17T18:21:51.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f7a00ddd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0b2b20 con 0x7f79fc0ad610 2021-12-17T18:21:51.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f79fad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79fc13f470 0x7f79fc1380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:51.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f79fa59c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79fc0ad610 0x7f79fc065ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:51.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f79f9d9b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79fc0b0e00 0x7f79fc067060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:51.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f79fad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79fc13f470 0x7f79fc1380e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50696/0 (socket says 172.21.15.62:50696) 2021-12-17T18:21:51.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f79fa59c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79fc0ad610 0x7f79fc065ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:44394/0 (socket says 172.21.15.62:44394) 2021-12-17T18:21:51.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f79fa59c700 1 -- 172.21.15.62:0/2794547057 learned_addr learned my addr 172.21.15.62:0/2794547057 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:51.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f79fad9d700 1 -- 172.21.15.62:0/2794547057 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79fc0ad610 msgr2=0x7f79fc065ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:51.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f79fad9d700 1 --2- 172.21.15.62:0/2794547057 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79fc0ad610 0x7f79fc065ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f79fad9d700 1 -- 172.21.15.62:0/2794547057 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79fc0b0e00 msgr2=0x7f79fc067060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:51.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f79fad9d700 1 --2- 172.21.15.62:0/2794547057 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79fc0b0e00 0x7f79fc067060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f79fad9d700 1 -- 172.21.15.62:0/2794547057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f4009470 con 0x7f79fc13f470 2021-12-17T18:21:51.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f79fad9d700 1 --2- 172.21.15.62:0/2794547057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79fc13f470 0x7f79fc1380e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f79ec001860 tx=0x7f79ec001980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:51.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f79eb7fe700 1 -- 172.21.15.62:0/2794547057 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79ec00ce10 con 0x7f79fc13f470 2021-12-17T18:21:51.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f79eb7fe700 1 -- 172.21.15.62:0/2794547057 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ec007170 con 0x7f79fc13f470 2021-12-17T18:21:51.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f79eb7fe700 1 -- 172.21.15.62:0/2794547057 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79ec004730 con 0x7f79fc13f470 2021-12-17T18:21:51.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f7a00ddd700 1 -- 172.21.15.62:0/2794547057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79fc0b2dc0 con 0x7f79fc13f470 2021-12-17T18:21:51.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f7a00ddd700 1 -- 172.21.15.62:0/2794547057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79fc0b2370 con 0x7f79fc13f470 2021-12-17T18:21:51.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.815+0000 7f7a00ddd700 1 -- 172.21.15.62:0/2794547057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79fc0b2680 con 0x7f79fc13f470 2021-12-17T18:21:51.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.819+0000 7f79eb7fe700 1 -- 172.21.15.62:0/2794547057 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f79ec01b070 con 0x7f79fc13f470 2021-12-17T18:21:51.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.819+0000 7f79eb7fe700 1 --2- 172.21.15.62:0/2794547057 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79d8053610 0x7f79d8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:51.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.819+0000 7f79eb7fe700 1 -- 172.21.15.62:0/2794547057 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f79ec06b0c0 con 0x7f79fc13f470 2021-12-17T18:21:51.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.819+0000 7f79fa59c700 1 --2- 172.21.15.62:0/2794547057 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79d8053610 0x7f79d8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:51.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.819+0000 7f79fa59c700 1 --2- 172.21.15.62:0/2794547057 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79d8053610 0x7f79d8055ad0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f79f401b000 tx=0x7f79f4016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:51.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.827+0000 7f79eb7fe700 1 -- 172.21.15.62:0/2794547057 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f79ec042110 con 0x7f79fc13f470 2021-12-17T18:21:51.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.951+0000 7f7a00ddd700 1 -- 172.21.15.62:0/2794547057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79fc0b1f20 con 0x7f79fc13f470 2021-12-17T18:21:51.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.955+0000 7f79eb7fe700 1 -- 172.21.15.62:0/2794547057 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16101 (secure 0 0 0) 0x7f79ec045730 con 0x7f79fc13f470 2021-12-17T18:21:51.957 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:21:51.957 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":50,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:21:51.687501+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:21:50.101305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-12-17T18:21:51.041096+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:21:51.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.955+0000 7f7a00ddd700 1 -- 172.21.15.62:0/2794547057 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79d8053610 msgr2=0x7f79d8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:51.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.955+0000 7f7a00ddd700 1 --2- 172.21.15.62:0/2794547057 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79d8053610 0x7f79d8055ad0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f79f401b000 tx=0x7f79f4016000).stop 2021-12-17T18:21:51.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.955+0000 7f7a00ddd700 1 -- 172.21.15.62:0/2794547057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79fc13f470 msgr2=0x7f79fc1380e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:51.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.955+0000 7f7a00ddd700 1 --2- 172.21.15.62:0/2794547057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79fc13f470 0x7f79fc1380e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f79ec001860 tx=0x7f79ec001980).stop 2021-12-17T18:21:51.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.955+0000 7f7a00ddd700 1 -- 172.21.15.62:0/2794547057 shutdown_connections 2021-12-17T18:21:51.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.955+0000 7f7a00ddd700 1 --2- 172.21.15.62:0/2794547057 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79d8053610 0x7f79d8055ad0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.955+0000 7f7a00ddd700 1 --2- 172.21.15.62:0/2794547057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79fc13f470 0x7f79fc1380e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.955+0000 7f7a00ddd700 1 --2- 172.21.15.62:0/2794547057 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79fc0b0e00 0x7f79fc067060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.955+0000 7f7a00ddd700 1 --2- 172.21.15.62:0/2794547057 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79fc0ad610 0x7f79fc065ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:51.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.955+0000 7f7a00ddd700 1 -- 172.21.15.62:0/2794547057 >> 172.21.15.62:0/2794547057 conn(0x7f79fc05c750 msgr2=0x7f79fc13fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:51.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.955+0000 7f7a00ddd700 1 -- 172.21.15.62:0/2794547057 shutdown_connections 2021-12-17T18:21:51.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:51.955+0000 7f7a00ddd700 1 -- 172.21.15.62:0/2794547057 wait complete. 2021-12-17T18:21:51.970 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:21:52.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f385a62d700 1 Processor -- start 2021-12-17T18:21:52.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f385a62d700 1 -- start start 2021-12-17T18:21:52.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f385a62d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f38541416b0 0x7f385414bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f385a62d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38540b27c0 con 0x7f3854067770 2021-12-17T18:21:52.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f385a62d700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3854144730 con 0x7f38540b3eb0 2021-12-17T18:21:52.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f385a62d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38541449d0 con 0x7f38541416b0 2021-12-17T18:21:52.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f38537fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3854067770 0x7f38540b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34282/0 (socket says 172.21.15.62:34282) 2021-12-17T18:21:52.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f38537fe700 1 -- 172.21.15.62:0/74247682 learned_addr learned my addr 172.21.15.62:0/74247682 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:52.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f3858bca700 1 --2- 172.21.15.62:0/74247682 >> v2:172.21.15.62:3300/0 conn(0x7f38541416b0 0x7f385414bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f3852ffd700 1 -- 172.21.15.62:0/74247682 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177897201 0 0) 0x7f38540b27c0 con 0x7f3854067770 2021-12-17T18:21:52.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f3852ffd700 1 -- 172.21.15.62:0/74247682 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3840003260 con 0x7f3854067770 2021-12-17T18:21:52.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f3852ffd700 1 -- 172.21.15.62:0/74247682 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911799592 0 0) 0x7f3854144730 con 0x7f38540b3eb0 2021-12-17T18:21:52.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f3858bca700 1 -- 172.21.15.62:0/74247682 >> v1:172.21.15.109:6789/0 conn(0x7f38540b3eb0 legacy=0x7f3854145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:52.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f3858bca700 1 -- 172.21.15.62:0/74247682 >> v1:172.21.15.62:6789/0 conn(0x7f3854067770 legacy=0x7f38540b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:52.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f3858bca700 1 -- 172.21.15.62:0/74247682 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3854144c70 con 0x7f38541416b0 2021-12-17T18:21:52.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f3858bca700 1 --2- 172.21.15.62:0/74247682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38541416b0 0x7f385414bad0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f384c0032f0 tx=0x7f384c0091d0).ready entity=mon.0 client_cookie=24124c14ca3923b9 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:52.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f3852ffd700 1 -- 172.21.15.62:0/74247682 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f384c00b6c0 con 0x7f38541416b0 2021-12-17T18:21:52.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f3852ffd700 1 -- 172.21.15.62:0/74247682 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384c00b820 con 0x7f38541416b0 2021-12-17T18:21:52.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.071+0000 7f3852ffd700 1 -- 172.21.15.62:0/74247682 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f384c00b990 con 0x7f38541416b0 2021-12-17T18:21:52.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f385a62d700 1 -- 172.21.15.62:0/74247682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38541416b0 msgr2=0x7f385414bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:52.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f385a62d700 1 --2- 172.21.15.62:0/74247682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38541416b0 0x7f385414bad0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f384c0032f0 tx=0x7f384c0091d0).stop 2021-12-17T18:21:52.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f385a62d700 1 -- 172.21.15.62:0/74247682 shutdown_connections 2021-12-17T18:21:52.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f385a62d700 1 --2- 172.21.15.62:0/74247682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38541416b0 0x7f385414bad0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f385a62d700 1 -- 172.21.15.62:0/74247682 >> 172.21.15.62:0/74247682 conn(0x7f385405cb40 msgr2=0x7f385405cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:52.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f385a62d700 1 -- 172.21.15.62:0/74247682 shutdown_connections 2021-12-17T18:21:52.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f385a62d700 1 -- 172.21.15.62:0/74247682 wait complete. 2021-12-17T18:21:52.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f385a62d700 1 Processor -- start 2021-12-17T18:21:52.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f385a62d700 1 -- start start 2021-12-17T18:21:52.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f385a62d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3854067770 0x7f3854153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f385a62d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38540b3eb0 0x7f3854147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f385a62d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38541416b0 0x7f385409ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f385a62d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38540aebb0 con 0x7f3854067770 2021-12-17T18:21:52.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f385a62d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38540aede0 con 0x7f38540b3eb0 2021-12-17T18:21:52.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f385a62d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38540af080 con 0x7f38541416b0 2021-12-17T18:21:52.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f3853fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3854067770 0x7f3854153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f3853fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3854067770 0x7f3854153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50706/0 (socket says 172.21.15.62:50706) 2021-12-17T18:21:52.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f3853fff700 1 -- 172.21.15.62:0/2365173762 learned_addr learned my addr 172.21.15.62:0/2365173762 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:52.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f3858bca700 1 --2- 172.21.15.62:0/2365173762 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38541416b0 0x7f385409ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.075+0000 7f38537fe700 1 --2- 172.21.15.62:0/2365173762 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38540b3eb0 0x7f3854147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.079+0000 7f3853fff700 1 -- 172.21.15.62:0/2365173762 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38541416b0 msgr2=0x7f385409ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:52.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.079+0000 7f3853fff700 1 --2- 172.21.15.62:0/2365173762 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38541416b0 0x7f385409ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.079+0000 7f3853fff700 1 -- 172.21.15.62:0/2365173762 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38540b3eb0 msgr2=0x7f3854147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:52.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.079+0000 7f3853fff700 1 --2- 172.21.15.62:0/2365173762 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38540b3eb0 0x7f3854147190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.079+0000 7f3853fff700 1 -- 172.21.15.62:0/2365173762 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c009470 con 0x7f3854067770 2021-12-17T18:21:52.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.079+0000 7f3853fff700 1 --2- 172.21.15.62:0/2365173762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3854067770 0x7f3854153950 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f3844000ed0 tx=0x7f3844007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:52.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.079+0000 7f38517fa700 1 -- 172.21.15.62:0/2365173762 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3844012400 con 0x7f3854067770 2021-12-17T18:21:52.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.079+0000 7f38517fa700 1 -- 172.21.15.62:0/2365173762 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3844012560 con 0x7f3854067770 2021-12-17T18:21:52.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.079+0000 7f385a62d700 1 -- 172.21.15.62:0/2365173762 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38540afa20 con 0x7f3854067770 2021-12-17T18:21:52.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.079+0000 7f38517fa700 1 -- 172.21.15.62:0/2365173762 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38440128c0 con 0x7f3854067770 2021-12-17T18:21:52.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.079+0000 7f385a62d700 1 -- 172.21.15.62:0/2365173762 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38541436e0 con 0x7f3854067770 2021-12-17T18:21:52.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.079+0000 7f385a62d700 1 -- 172.21.15.62:0/2365173762 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38540af240 con 0x7f3854067770 2021-12-17T18:21:52.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.079+0000 7f38517fa700 1 -- 172.21.15.62:0/2365173762 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3844019030 con 0x7f3854067770 2021-12-17T18:21:52.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.083+0000 7f38517fa700 1 --2- 172.21.15.62:0/2365173762 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3834053610 0x7f3834055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.083+0000 7f38517fa700 1 -- 172.21.15.62:0/2365173762 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f384406abd0 con 0x7f3854067770 2021-12-17T18:21:52.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.083+0000 7f38537fe700 1 --2- 172.21.15.62:0/2365173762 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3834053610 0x7f3834055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.083+0000 7f38537fe700 1 --2- 172.21.15.62:0/2365173762 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3834053610 0x7f3834055ad0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f384800d000 tx=0x7f3848009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:52.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.087+0000 7f38517fa700 1 -- 172.21.15.62:0/2365173762 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3844041de0 con 0x7f3854067770 2021-12-17T18:21:52.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.215+0000 7f385a62d700 1 -- 172.21.15.62:0/2365173762 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38540573d0 con 0x7f3854067770 2021-12-17T18:21:52.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.215+0000 7f38517fa700 1 -- 172.21.15.62:0/2365173762 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16101 (secure 0 0 0) 0x7f3844024f00 con 0x7f3854067770 2021-12-17T18:21:52.220 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:21:52.220 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":50,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:21:51.687501+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:21:50.101305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-12-17T18:21:51.041096+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:21:52.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.219+0000 7f385a62d700 1 -- 172.21.15.62:0/2365173762 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3834053610 msgr2=0x7f3834055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:52.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.219+0000 7f385a62d700 1 --2- 172.21.15.62:0/2365173762 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3834053610 0x7f3834055ad0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f384800d000 tx=0x7f3848009040).stop 2021-12-17T18:21:52.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.219+0000 7f385a62d700 1 -- 172.21.15.62:0/2365173762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3854067770 msgr2=0x7f3854153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:52.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.219+0000 7f385a62d700 1 --2- 172.21.15.62:0/2365173762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3854067770 0x7f3854153950 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f3844000ed0 tx=0x7f3844007ac0).stop 2021-12-17T18:21:52.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.219+0000 7f385a62d700 1 -- 172.21.15.62:0/2365173762 shutdown_connections 2021-12-17T18:21:52.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.219+0000 7f385a62d700 1 --2- 172.21.15.62:0/2365173762 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3834053610 0x7f3834055ad0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.219+0000 7f385a62d700 1 --2- 172.21.15.62:0/2365173762 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38541416b0 0x7f385409ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.219+0000 7f385a62d700 1 --2- 172.21.15.62:0/2365173762 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38540b3eb0 0x7f3854147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.219+0000 7f385a62d700 1 --2- 172.21.15.62:0/2365173762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3854067770 0x7f3854153950 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.219+0000 7f385a62d700 1 -- 172.21.15.62:0/2365173762 >> 172.21.15.62:0/2365173762 conn(0x7f385405cb40 msgr2=0x7f38540b8070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:52.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.219+0000 7f385a62d700 1 -- 172.21.15.62:0/2365173762 shutdown_connections 2021-12-17T18:21:52.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.219+0000 7f385a62d700 1 -- 172.21.15.62:0/2365173762 wait complete. 2021-12-17T18:21:52.234 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-12-17T18:21:52.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.339+0000 7fa595caa700 1 Processor -- start 2021-12-17T18:21:52.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.339+0000 7fa595caa700 1 -- start start 2021-12-17T18:21:52.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa595caa700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5900ae470 0x7fa590063430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa595caa700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa5900ad640 0x7fa590142820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa595caa700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5900b7ce0 con 0x7fa5900b7900 2021-12-17T18:21:52.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa595caa700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa590065120 con 0x7fa5900ad640 2021-12-17T18:21:52.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa595caa700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5900b29e0 con 0x7fa5900ae470 2021-12-17T18:21:52.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa58effd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5900ae470 0x7fa590063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa58ffff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa5900ad640 0x7fa590142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa58f7fe700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7fa5900b7900 0x7fa590064450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:50614/0 (socket says 172.21.15.62:50614) 2021-12-17T18:21:52.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa58effd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5900ae470 0x7fa590063430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:44416/0 (socket says 172.21.15.62:44416) 2021-12-17T18:21:52.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa58ffff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa5900ad640 0x7fa590142820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:57268/0 (socket says 172.21.15.62:57268) 2021-12-17T18:21:52.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa58f7fe700 1 -- 172.21.15.62:0/4069360868 learned_addr learned my addr 172.21.15.62:0/4069360868 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:52.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa58e7fc700 1 -- 172.21.15.62:0/4069360868 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222076459 0 0) 0x7fa5900b7ce0 con 0x7fa5900b7900 2021-12-17T18:21:52.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa58ffff700 1 -- 172.21.15.62:0/4069360868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5900ae470 msgr2=0x7fa590063430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:52.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa58ffff700 1 --2- 172.21.15.62:0/4069360868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5900ae470 0x7fa590063430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa58ffff700 1 -- 172.21.15.62:0/4069360868 >> v1:172.21.15.109:6789/0 conn(0x7fa5900b7900 legacy=0x7fa590064450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:52.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa58ffff700 1 -- 172.21.15.62:0/4069360868 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5900b2c80 con 0x7fa5900ad640 2021-12-17T18:21:52.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa58effd700 1 --2- 172.21.15.62:0/4069360868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5900ae470 0x7fa590063430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:21:52.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa58ffff700 1 --2- 172.21.15.62:0/4069360868 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa5900ad640 0x7fa590142820 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fa5880032f0 tx=0x7fa5880091d0).ready entity=mon.1 client_cookie=ef80fb3d3bdc9e70 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:52.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa58e7fc700 1 -- 172.21.15.62:0/4069360868 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa58800b6c0 con 0x7fa5900ad640 2021-12-17T18:21:52.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa58e7fc700 1 -- 172.21.15.62:0/4069360868 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58800b820 con 0x7fa5900ad640 2021-12-17T18:21:52.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa58e7fc700 1 -- 172.21.15.62:0/4069360868 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa58800b990 con 0x7fa5900ad640 2021-12-17T18:21:52.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa595caa700 1 -- 172.21.15.62:0/4069360868 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa5900ad640 msgr2=0x7fa590142820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:52.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa595caa700 1 --2- 172.21.15.62:0/4069360868 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa5900ad640 0x7fa590142820 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fa5880032f0 tx=0x7fa5880091d0).stop 2021-12-17T18:21:52.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa595caa700 1 -- 172.21.15.62:0/4069360868 shutdown_connections 2021-12-17T18:21:52.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa595caa700 1 --2- 172.21.15.62:0/4069360868 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa5900ad640 0x7fa590142820 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa595caa700 1 --2- 172.21.15.62:0/4069360868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5900ae470 0x7fa590063430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa595caa700 1 -- 172.21.15.62:0/4069360868 >> 172.21.15.62:0/4069360868 conn(0x7fa590062510 msgr2=0x7fa590062920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:52.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa595caa700 1 -- 172.21.15.62:0/4069360868 shutdown_connections 2021-12-17T18:21:52.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.343+0000 7fa595caa700 1 -- 172.21.15.62:0/4069360868 wait complete. 2021-12-17T18:21:52.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa595caa700 1 Processor -- start 2021-12-17T18:21:52.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa595caa700 1 -- start start 2021-12-17T18:21:52.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa595caa700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5900ad640 0x7fa590156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa595caa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5900ae470 0x7fa59013ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa595caa700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa5900b7900 0x7fa590142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa595caa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa590155c90 con 0x7fa5900ae470 2021-12-17T18:21:52.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa595caa700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa590155f30 con 0x7fa5900b7900 2021-12-17T18:21:52.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa595caa700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5901561d0 con 0x7fa5900ad640 2021-12-17T18:21:52.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa58effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5900ae470 0x7fa59013ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa58effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5900ae470 0x7fa59013ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50722/0 (socket says 172.21.15.62:50722) 2021-12-17T18:21:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa58effd700 1 -- 172.21.15.62:0/170177998 learned_addr learned my addr 172.21.15.62:0/170177998 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa58ffff700 1 --2- 172.21.15.62:0/170177998 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa5900b7900 0x7fa590142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa58f7fe700 1 --2- 172.21.15.62:0/170177998 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5900ad640 0x7fa590156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa58effd700 1 -- 172.21.15.62:0/170177998 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5900ad640 msgr2=0x7fa590156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:52.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa58effd700 1 --2- 172.21.15.62:0/170177998 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5900ad640 0x7fa590156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa58effd700 1 -- 172.21.15.62:0/170177998 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa5900b7900 msgr2=0x7fa590142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:52.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa58effd700 1 --2- 172.21.15.62:0/170177998 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa5900b7900 0x7fa590142930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa58effd700 1 -- 172.21.15.62:0/170177998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57800b180 con 0x7fa5900ae470 2021-12-17T18:21:52.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.347+0000 7fa58effd700 1 --2- 172.21.15.62:0/170177998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5900ae470 0x7fa59013ed80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fa57800c000 tx=0x7fa578006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:52.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.351+0000 7fa58cff9700 1 -- 172.21.15.62:0/170177998 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa578010780 con 0x7fa5900ae470 2021-12-17T18:21:52.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.351+0000 7fa58cff9700 1 -- 172.21.15.62:0/170177998 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5780108e0 con 0x7fa5900ae470 2021-12-17T18:21:52.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.351+0000 7fa595caa700 1 -- 172.21.15.62:0/170177998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa588009470 con 0x7fa5900ae470 2021-12-17T18:21:52.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.351+0000 7fa58cff9700 1 -- 172.21.15.62:0/170177998 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa578010c40 con 0x7fa5900ae470 2021-12-17T18:21:52.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.351+0000 7fa595caa700 1 -- 172.21.15.62:0/170177998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5900b16e0 con 0x7fa5900ae470 2021-12-17T18:21:52.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.351+0000 7fa595caa700 1 -- 172.21.15.62:0/170177998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa590156390 con 0x7fa5900ae470 2021-12-17T18:21:52.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.351+0000 7fa58cff9700 1 -- 172.21.15.62:0/170177998 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa57801c460 con 0x7fa5900ae470 2021-12-17T18:21:52.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.351+0000 7fa58cff9700 1 --2- 172.21.15.62:0/170177998 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa5740536a0 0x7fa574055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.351+0000 7fa58cff9700 1 -- 172.21.15.62:0/170177998 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa57806bf30 con 0x7fa5900ae470 2021-12-17T18:21:52.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.351+0000 7fa58f7fe700 1 --2- 172.21.15.62:0/170177998 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa5740536a0 0x7fa574055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.351+0000 7fa58f7fe700 1 --2- 172.21.15.62:0/170177998 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa5740536a0 0x7fa574055b60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fa58000d000 tx=0x7fa580007c20).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:52.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.359+0000 7fa58cff9700 1 -- 172.21.15.62:0/170177998 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa578042f90 con 0x7fa5900ae470 2021-12-17T18:21:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.519+0000 7fa595caa700 1 -- 172.21.15.62:0/170177998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa5900573d0 con 0x7fa5900ae470 2021-12-17T18:21:52.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.715+0000 7fa58cff9700 1 -- 172.21.15.62:0/170177998 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa5780465b0 con 0x7fa5900ae470 2021-12-17T18:21:52.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.719+0000 7fa595caa700 1 -- 172.21.15.62:0/170177998 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa5740536a0 msgr2=0x7fa574055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:52.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.719+0000 7fa595caa700 1 --2- 172.21.15.62:0/170177998 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa5740536a0 0x7fa574055b60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fa58000d000 tx=0x7fa580007c20).stop 2021-12-17T18:21:52.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.719+0000 7fa595caa700 1 -- 172.21.15.62:0/170177998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5900ae470 msgr2=0x7fa59013ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:52.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.719+0000 7fa595caa700 1 --2- 172.21.15.62:0/170177998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5900ae470 0x7fa59013ed80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fa57800c000 tx=0x7fa578006df0).stop 2021-12-17T18:21:52.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.719+0000 7fa595caa700 1 -- 172.21.15.62:0/170177998 shutdown_connections 2021-12-17T18:21:52.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.719+0000 7fa595caa700 1 --2- 172.21.15.62:0/170177998 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa5740536a0 0x7fa574055b60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.719+0000 7fa595caa700 1 --2- 172.21.15.62:0/170177998 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa5900b7900 0x7fa590142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.719+0000 7fa595caa700 1 --2- 172.21.15.62:0/170177998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5900ae470 0x7fa59013ed80 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.719+0000 7fa595caa700 1 --2- 172.21.15.62:0/170177998 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5900ad640 0x7fa590156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.719+0000 7fa595caa700 1 -- 172.21.15.62:0/170177998 >> 172.21.15.62:0/170177998 conn(0x7fa590062510 msgr2=0x7fa59013c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:52.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.719+0000 7fa595caa700 1 -- 172.21.15.62:0/170177998 shutdown_connections 2021-12-17T18:21:52.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.719+0000 7fa595caa700 1 -- 172.21.15.62:0/170177998 wait complete. 2021-12-17T18:21:52.740 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:21:52.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c83fff700 1 Processor -- start 2021-12-17T18:21:52.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c83fff700 1 -- start start 2021-12-17T18:21:52.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c83fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3c84141480 0x7f3c84147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c83fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f3c840a8e10 0x7f3c840b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c83fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c840b6050 0x7f3c840a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c83fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c84147610 con 0x7f3c84141480 2021-12-17T18:21:52.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c83fff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c841478b0 con 0x7f3c840a8e10 2021-12-17T18:21:52.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c83fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c84147b50 con 0x7f3c840b6050 2021-12-17T18:21:52.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c82ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3c84141480 0x7f3c84147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c827fc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f3c840a8e10 0x7f3c840b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c82ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3c84141480 0x7f3c84147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50730/0 (socket says 172.21.15.62:50730) 2021-12-17T18:21:52.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c82ffd700 1 -- 172.21.15.62:0/597608831 learned_addr learned my addr 172.21.15.62:0/597608831 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:52.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c837fe700 1 --2- 172.21.15.62:0/597608831 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c840b6050 0x7f3c840a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c82ffd700 1 -- 172.21.15.62:0/597608831 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c840b6050 msgr2=0x7f3c840a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:52.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c82ffd700 1 --2- 172.21.15.62:0/597608831 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c840b6050 0x7f3c840a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c82ffd700 1 -- 172.21.15.62:0/597608831 >> v2:172.21.15.109:3300/0 conn(0x7f3c840a8e10 msgr2=0x7f3c840b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:52.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c82ffd700 1 --2- 172.21.15.62:0/597608831 >> v2:172.21.15.109:3300/0 conn(0x7f3c840a8e10 0x7f3c840b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c82ffd700 1 -- 172.21.15.62:0/597608831 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c840b1b90 con 0x7f3c84141480 2021-12-17T18:21:52.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c827fc700 1 --2- 172.21.15.62:0/597608831 >> v2:172.21.15.109:3300/0 conn(0x7f3c840a8e10 0x7f3c840b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:21:52.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c837fe700 1 --2- 172.21.15.62:0/597608831 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c840b6050 0x7f3c840a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:21:52.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.843+0000 7f3c82ffd700 1 --2- 172.21.15.62:0/597608831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84141480 0x7f3c84147ff0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f3c78002f70 tx=0x7f3c78006eb0).ready entity=mon.0 client_cookie=42c3eead0fc6d017 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:52.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.847+0000 7f3c81ffb700 1 -- 172.21.15.62:0/597608831 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c7800d570 con 0x7f3c84141480 2021-12-17T18:21:52.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.847+0000 7f3c81ffb700 1 -- 172.21.15.62:0/597608831 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c78000e90 con 0x7f3c84141480 2021-12-17T18:21:52.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.847+0000 7f3c81ffb700 1 -- 172.21.15.62:0/597608831 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c7800d900 con 0x7f3c84141480 2021-12-17T18:21:52.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.847+0000 7f3c83fff700 1 -- 172.21.15.62:0/597608831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84141480 msgr2=0x7f3c84147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:52.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.847+0000 7f3c83fff700 1 --2- 172.21.15.62:0/597608831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84141480 0x7f3c84147ff0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f3c78002f70 tx=0x7f3c78006eb0).stop 2021-12-17T18:21:52.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.847+0000 7f3c83fff700 1 -- 172.21.15.62:0/597608831 shutdown_connections 2021-12-17T18:21:52.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.847+0000 7f3c83fff700 1 --2- 172.21.15.62:0/597608831 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c840b6050 0x7f3c840a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.847+0000 7f3c83fff700 1 --2- 172.21.15.62:0/597608831 >> v2:172.21.15.109:3300/0 conn(0x7f3c840a8e10 0x7f3c840b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.847+0000 7f3c83fff700 1 --2- 172.21.15.62:0/597608831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84141480 0x7f3c84147ff0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.847+0000 7f3c83fff700 1 -- 172.21.15.62:0/597608831 >> 172.21.15.62:0/597608831 conn(0x7f3c8405d220 msgr2=0x7f3c840b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:52.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.847+0000 7f3c83fff700 1 -- 172.21.15.62:0/597608831 shutdown_connections 2021-12-17T18:21:52.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.847+0000 7f3c83fff700 1 -- 172.21.15.62:0/597608831 wait complete. 2021-12-17T18:21:52.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.847+0000 7f3c83fff700 1 Processor -- start 2021-12-17T18:21:52.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c83fff700 1 -- start start 2021-12-17T18:21:52.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c83fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c840a8e10 0x7f3c84063240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c83fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3c840b6050 0x7f3c84156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c83fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84141480 0x7f3c84064f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c83fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8414a140 con 0x7f3c84141480 2021-12-17T18:21:52.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c83fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8414a380 con 0x7f3c840b6050 2021-12-17T18:21:52.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c83fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c84064ae0 con 0x7f3c840a8e10 2021-12-17T18:21:52.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c837fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84141480 0x7f3c84064f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c837fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84141480 0x7f3c84064f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50736/0 (socket says 172.21.15.62:50736) 2021-12-17T18:21:52.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c837fe700 1 -- 172.21.15.62:0/1156950039 learned_addr learned my addr 172.21.15.62:0/1156950039 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:52.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c827fc700 1 --2- 172.21.15.62:0/1156950039 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3c840b6050 0x7f3c84156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c82ffd700 1 --2- 172.21.15.62:0/1156950039 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c840a8e10 0x7f3c84063240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c837fe700 1 -- 172.21.15.62:0/1156950039 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c840a8e10 msgr2=0x7f3c84063240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:52.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c837fe700 1 --2- 172.21.15.62:0/1156950039 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c840a8e10 0x7f3c84063240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c837fe700 1 -- 172.21.15.62:0/1156950039 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3c840b6050 msgr2=0x7f3c84156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:52.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c837fe700 1 --2- 172.21.15.62:0/1156950039 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3c840b6050 0x7f3c84156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:52.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c837fe700 1 -- 172.21.15.62:0/1156950039 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7400b180 con 0x7f3c84141480 2021-12-17T18:21:52.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c837fe700 1 --2- 172.21.15.62:0/1156950039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84141480 0x7f3c84064f40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f3c7c00a000 tx=0x7f3c7c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:52.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c73fff700 1 -- 172.21.15.62:0/1156950039 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c7c013620 con 0x7f3c84141480 2021-12-17T18:21:52.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c73fff700 1 -- 172.21.15.62:0/1156950039 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c013780 con 0x7f3c84141480 2021-12-17T18:21:52.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c83fff700 1 -- 172.21.15.62:0/1156950039 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7800b1e0 con 0x7f3c84141480 2021-12-17T18:21:52.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c73fff700 1 -- 172.21.15.62:0/1156950039 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c7c013ae0 con 0x7f3c84141480 2021-12-17T18:21:52.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.851+0000 7f3c83fff700 1 -- 172.21.15.62:0/1156950039 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c84148e40 con 0x7f3c84141480 2021-12-17T18:21:52.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.855+0000 7f3c83fff700 1 -- 172.21.15.62:0/1156950039 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c84149f90 con 0x7f3c84141480 2021-12-17T18:21:52.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.855+0000 7f3c73fff700 1 -- 172.21.15.62:0/1156950039 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3c7c013c40 con 0x7f3c84141480 2021-12-17T18:21:52.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.855+0000 7f3c73fff700 1 --2- 172.21.15.62:0/1156950039 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c600534f0 0x7f3c600559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:52.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.855+0000 7f3c73fff700 1 -- 172.21.15.62:0/1156950039 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3c7c06b7b0 con 0x7f3c84141480 2021-12-17T18:21:52.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.855+0000 7f3c82ffd700 1 --2- 172.21.15.62:0/1156950039 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c600534f0 0x7f3c600559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:52.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.855+0000 7f3c82ffd700 1 --2- 172.21.15.62:0/1156950039 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c600534f0 0x7f3c600559b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f3c7801c000 tx=0x7f3c78015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:52.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:52.863+0000 7f3c73fff700 1 -- 172.21.15.62:0/1156950039 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3c7c042800 con 0x7f3c84141480 2021-12-17T18:21:53.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.023+0000 7f3c83fff700 1 -- 172.21.15.62:0/1156950039 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c84141860 con 0x7f3c84141480 2021-12-17T18:21:53.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.027+0000 7f3c73fff700 1 -- 172.21.15.62:0/1156950039 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f3c7c00f040 con 0x7f3c84141480 2021-12-17T18:21:53.029 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:21:53.029 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3056253780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3056253780},{"type":"v1","addr":"172.21.15.109:6835","nonce":3056253780}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:21:51.687672+0000","modified":"2021-12-17T18:21:52.715134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/3358597467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3358597467},{"type":"v1","addr":"172.21.15.62:6833","nonce":3358597467}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-12-17T18:21:53.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.027+0000 7f3c83fff700 1 -- 172.21.15.62:0/1156950039 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c600534f0 msgr2=0x7f3c600559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.027+0000 7f3c83fff700 1 --2- 172.21.15.62:0/1156950039 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c600534f0 0x7f3c600559b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f3c7801c000 tx=0x7f3c78015000).stop 2021-12-17T18:21:53.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.027+0000 7f3c83fff700 1 -- 172.21.15.62:0/1156950039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84141480 msgr2=0x7f3c84064f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.027+0000 7f3c83fff700 1 --2- 172.21.15.62:0/1156950039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84141480 0x7f3c84064f40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f3c7c00a000 tx=0x7f3c7c008040).stop 2021-12-17T18:21:53.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.027+0000 7f3c83fff700 1 -- 172.21.15.62:0/1156950039 shutdown_connections 2021-12-17T18:21:53.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.027+0000 7f3c83fff700 1 --2- 172.21.15.62:0/1156950039 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c600534f0 0x7f3c600559b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.027+0000 7f3c83fff700 1 --2- 172.21.15.62:0/1156950039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84141480 0x7f3c84064f40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.027+0000 7f3c83fff700 1 --2- 172.21.15.62:0/1156950039 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3c840b6050 0x7f3c84156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.027+0000 7f3c83fff700 1 --2- 172.21.15.62:0/1156950039 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c840a8e10 0x7f3c84063240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.027+0000 7f3c83fff700 1 -- 172.21.15.62:0/1156950039 >> 172.21.15.62:0/1156950039 conn(0x7f3c8405d220 msgr2=0x7f3c840b4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:53.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.027+0000 7f3c83fff700 1 -- 172.21.15.62:0/1156950039 shutdown_connections 2021-12-17T18:21:53.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.027+0000 7f3c83fff700 1 -- 172.21.15.62:0/1156950039 wait complete. 2021-12-17T18:21:53.034 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2021-12-17T18:21:53.048 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:21:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.147+0000 7f2879eaf700 1 Processor -- start 2021-12-17T18:21:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.147+0000 7f2879eaf700 1 -- start start 2021-12-17T18:21:53.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.147+0000 7f2879eaf700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f28740b21f0 0x7f287414aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.147+0000 7f2879eaf700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28740b1730 0x7f28740ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.147+0000 7f2879eaf700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28740b2ce0 con 0x7f28740a7bb0 2021-12-17T18:21:53.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.147+0000 7f2879eaf700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2874147870 con 0x7f28740b21f0 2021-12-17T18:21:53.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.147+0000 7f2879eaf700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28740b2f10 con 0x7f28740b1730 2021-12-17T18:21:53.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.147+0000 7f28737fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f28740b21f0 0x7f287414aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f28737fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f28740b21f0 0x7f287414aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50744/0 (socket says 172.21.15.62:50744) 2021-12-17T18:21:53.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f28737fe700 1 -- 172.21.15.62:0/3486987753 learned_addr learned my addr 172.21.15.62:0/3486987753 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:53.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f2872ffd700 1 --2- 172.21.15.62:0/3486987753 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28740b1730 0x7f28740ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f28737fe700 1 -- 172.21.15.62:0/3486987753 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28740b1730 msgr2=0x7f28740ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:53.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f28737fe700 1 --2- 172.21.15.62:0/3486987753 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28740b1730 0x7f28740ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f28727fc700 1 -- 172.21.15.62:0/3486987753 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904107225 0 0) 0x7f28740b2ce0 con 0x7f28740a7bb0 2021-12-17T18:21:53.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f28737fe700 1 -- 172.21.15.62:0/3486987753 >> v1:172.21.15.109:6789/0 conn(0x7f28740a7bb0 legacy=0x7f2874067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f28737fe700 1 -- 172.21.15.62:0/3486987753 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28740aca60 con 0x7f28740b21f0 2021-12-17T18:21:53.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f28737fe700 1 --2- 172.21.15.62:0/3486987753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28740b21f0 0x7f287414aea0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f2868002f70 tx=0x7f2868006eb0).ready entity=mon.0 client_cookie=a4dce64831b41f1c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:53.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f28727fc700 1 -- 172.21.15.62:0/3486987753 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286800d570 con 0x7f28740b21f0 2021-12-17T18:21:53.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f28727fc700 1 -- 172.21.15.62:0/3486987753 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2868000e90 con 0x7f28740b21f0 2021-12-17T18:21:53.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f28727fc700 1 -- 172.21.15.62:0/3486987753 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286800d8c0 con 0x7f28740b21f0 2021-12-17T18:21:53.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f2879eaf700 1 -- 172.21.15.62:0/3486987753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28740b21f0 msgr2=0x7f287414aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f2879eaf700 1 --2- 172.21.15.62:0/3486987753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28740b21f0 0x7f287414aea0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f2868002f70 tx=0x7f2868006eb0).stop 2021-12-17T18:21:53.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f2879eaf700 1 -- 172.21.15.62:0/3486987753 shutdown_connections 2021-12-17T18:21:53.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f2879eaf700 1 --2- 172.21.15.62:0/3486987753 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28740b1730 0x7f28740ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f2879eaf700 1 --2- 172.21.15.62:0/3486987753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28740b21f0 0x7f287414aea0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f2879eaf700 1 -- 172.21.15.62:0/3486987753 >> 172.21.15.62:0/3486987753 conn(0x7f287405f730 msgr2=0x7f287405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:53.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f2879eaf700 1 -- 172.21.15.62:0/3486987753 shutdown_connections 2021-12-17T18:21:53.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.151+0000 7f2879eaf700 1 -- 172.21.15.62:0/3486987753 wait complete. 2021-12-17T18:21:53.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f2879eaf700 1 Processor -- start 2021-12-17T18:21:53.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f2879eaf700 1 -- start start 2021-12-17T18:21:53.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f2879eaf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28740a7bb0 0x7f28740aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f2879eaf700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28740b1730 0x7f2874156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f2879eaf700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28740b21f0 0x7f287414b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f2879eaf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2874157280 con 0x7f28740a7bb0 2021-12-17T18:21:53.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f2879eaf700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2874157520 con 0x7f28740b1730 2021-12-17T18:21:53.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f2879eaf700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28741577c0 con 0x7f28740b21f0 2021-12-17T18:21:53.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f28737fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28740a7bb0 0x7f28740aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f28737fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28740a7bb0 0x7f28740aafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50748/0 (socket says 172.21.15.62:50748) 2021-12-17T18:21:53.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f28737fe700 1 -- 172.21.15.62:0/1086658491 learned_addr learned my addr 172.21.15.62:0/1086658491 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:53.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f2872ffd700 1 --2- 172.21.15.62:0/1086658491 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28740b1730 0x7f2874156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f2873fff700 1 --2- 172.21.15.62:0/1086658491 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28740b21f0 0x7f287414b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f28737fe700 1 -- 172.21.15.62:0/1086658491 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28740b21f0 msgr2=0x7f287414b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f28737fe700 1 --2- 172.21.15.62:0/1086658491 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28740b21f0 0x7f287414b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f28737fe700 1 -- 172.21.15.62:0/1086658491 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28740b1730 msgr2=0x7f2874156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f28737fe700 1 --2- 172.21.15.62:0/1086658491 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28740b1730 0x7f2874156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.155+0000 7f28737fe700 1 -- 172.21.15.62:0/1086658491 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286800b1e0 con 0x7f28740a7bb0 2021-12-17T18:21:53.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.159+0000 7f28737fe700 1 --2- 172.21.15.62:0/1086658491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28740a7bb0 0x7f28740aafc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f2868002f70 tx=0x7f2868015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:53.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.159+0000 7f2870ff9700 1 -- 172.21.15.62:0/1086658491 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2868011760 con 0x7f28740a7bb0 2021-12-17T18:21:53.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.159+0000 7f2870ff9700 1 -- 172.21.15.62:0/1086658491 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28680118c0 con 0x7f28740a7bb0 2021-12-17T18:21:53.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.159+0000 7f2879eaf700 1 -- 172.21.15.62:0/1086658491 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2874157c60 con 0x7f28740a7bb0 2021-12-17T18:21:53.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.159+0000 7f2870ff9700 1 -- 172.21.15.62:0/1086658491 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2868011c20 con 0x7f28740a7bb0 2021-12-17T18:21:53.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.159+0000 7f2879eaf700 1 -- 172.21.15.62:0/1086658491 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287414dc20 con 0x7f28740a7bb0 2021-12-17T18:21:53.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.159+0000 7f2879eaf700 1 -- 172.21.15.62:0/1086658491 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28741570d0 con 0x7f28740a7bb0 2021-12-17T18:21:53.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.159+0000 7f2870ff9700 1 -- 172.21.15.62:0/1086658491 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2868025030 con 0x7f28740a7bb0 2021-12-17T18:21:53.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.159+0000 7f2870ff9700 1 --2- 172.21.15.62:0/1086658491 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f28540536d0 0x7f2854055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.159+0000 7f2870ff9700 1 -- 172.21.15.62:0/1086658491 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f286806cbf0 con 0x7f28740a7bb0 2021-12-17T18:21:53.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.159+0000 7f2872ffd700 1 --2- 172.21.15.62:0/1086658491 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f28540536d0 0x7f2854055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.159+0000 7f2872ffd700 1 --2- 172.21.15.62:0/1086658491 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f28540536d0 0x7f2854055b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f286400b000 tx=0x7f2864006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:53.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.171+0000 7f2870ff9700 1 -- 172.21.15.62:0/1086658491 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2868043c40 con 0x7f28740a7bb0 2021-12-17T18:21:53.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.299+0000 7f2879eaf700 1 -- 172.21.15.62:0/1086658491 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28740573d0 con 0x7f28740a7bb0 2021-12-17T18:21:53.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.303+0000 7f2870ff9700 1 -- 172.21.15.62:0/1086658491 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16088 (secure 0 0 0) 0x7f2868023020 con 0x7f28740a7bb0 2021-12-17T18:21:53.304 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:21:53.305 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":51,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:21:52.690524+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:21:50.101305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-12-17T18:21:51.041096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:21:53.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.303+0000 7f2879eaf700 1 -- 172.21.15.62:0/1086658491 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f28540536d0 msgr2=0x7f2854055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.303+0000 7f2879eaf700 1 --2- 172.21.15.62:0/1086658491 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f28540536d0 0x7f2854055b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f286400b000 tx=0x7f2864006df0).stop 2021-12-17T18:21:53.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.303+0000 7f2879eaf700 1 -- 172.21.15.62:0/1086658491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28740a7bb0 msgr2=0x7f28740aafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.303+0000 7f2879eaf700 1 --2- 172.21.15.62:0/1086658491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28740a7bb0 0x7f28740aafc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f2868002f70 tx=0x7f2868015000).stop 2021-12-17T18:21:53.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.303+0000 7f2879eaf700 1 -- 172.21.15.62:0/1086658491 shutdown_connections 2021-12-17T18:21:53.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.303+0000 7f2879eaf700 1 --2- 172.21.15.62:0/1086658491 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f28540536d0 0x7f2854055b90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.303+0000 7f2879eaf700 1 --2- 172.21.15.62:0/1086658491 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28740b21f0 0x7f287414b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.303+0000 7f2879eaf700 1 --2- 172.21.15.62:0/1086658491 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28740b1730 0x7f2874156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.303+0000 7f2879eaf700 1 --2- 172.21.15.62:0/1086658491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28740a7bb0 0x7f28740aafc0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.303+0000 7f2879eaf700 1 -- 172.21.15.62:0/1086658491 >> 172.21.15.62:0/1086658491 conn(0x7f287405f730 msgr2=0x7f28740ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:53.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.303+0000 7f2879eaf700 1 -- 172.21.15.62:0/1086658491 shutdown_connections 2021-12-17T18:21:53.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.303+0000 7f2879eaf700 1 -- 172.21.15.62:0/1086658491 wait complete. 2021-12-17T18:21:53.317 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:21:53.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.427+0000 7f884897e700 1 Processor -- start 2021-12-17T18:21:53.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.427+0000 7f884897e700 1 -- start start 2021-12-17T18:21:53.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.427+0000 7f884897e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f8844066a70 0x7f8844144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.427+0000 7f884897e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8844062360 0x7f8844144d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.427+0000 7f884897e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f884405f730 0x7f884405fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.427+0000 7f884897e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88440b3430 con 0x7f884405f730 2021-12-17T18:21:53.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.427+0000 7f884897e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88441451f0 con 0x7f8844066a70 2021-12-17T18:21:53.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.427+0000 7f884897e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88441443b0 con 0x7f8844062360 2021-12-17T18:21:53.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.427+0000 7f884359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f884405f730 0x7f884405fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.427+0000 7f884359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f884405f730 0x7f884405fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50760/0 (socket says 172.21.15.62:50760) 2021-12-17T18:21:53.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.427+0000 7f884359e700 1 -- 172.21.15.62:0/537524494 learned_addr learned my addr 172.21.15.62:0/537524494 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:53.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.427+0000 7f884259c700 1 --2- 172.21.15.62:0/537524494 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8844062360 0x7f8844144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.427+0000 7f8842d9d700 1 --2- 172.21.15.62:0/537524494 >> v2:172.21.15.109:3300/0 conn(0x7f8844066a70 0x7f8844144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.427+0000 7f884359e700 1 -- 172.21.15.62:0/537524494 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8844062360 msgr2=0x7f8844144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:53.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.427+0000 7f884359e700 1 --2- 172.21.15.62:0/537524494 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8844062360 0x7f8844144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884359e700 1 -- 172.21.15.62:0/537524494 >> v2:172.21.15.109:3300/0 conn(0x7f8844066a70 msgr2=0x7f8844144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:53.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884359e700 1 --2- 172.21.15.62:0/537524494 >> v2:172.21.15.109:3300/0 conn(0x7f8844066a70 0x7f8844144810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884359e700 1 -- 172.21.15.62:0/537524494 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88440b3190 con 0x7f884405f730 2021-12-17T18:21:53.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884359e700 1 --2- 172.21.15.62:0/537524494 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f884405f730 0x7f884405fb90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f883c0032f0 tx=0x7f883c009290).ready entity=mon.0 client_cookie=b398ce691bce2ac3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:53.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f8841d9b700 1 -- 172.21.15.62:0/537524494 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f883c00b680 con 0x7f884405f730 2021-12-17T18:21:53.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f8841d9b700 1 -- 172.21.15.62:0/537524494 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c00b7e0 con 0x7f884405f730 2021-12-17T18:21:53.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f8841d9b700 1 -- 172.21.15.62:0/537524494 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f883c00b950 con 0x7f884405f730 2021-12-17T18:21:53.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884897e700 1 -- 172.21.15.62:0/537524494 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f884405f730 msgr2=0x7f884405fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884897e700 1 --2- 172.21.15.62:0/537524494 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f884405f730 0x7f884405fb90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f883c0032f0 tx=0x7f883c009290).stop 2021-12-17T18:21:53.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884897e700 1 -- 172.21.15.62:0/537524494 shutdown_connections 2021-12-17T18:21:53.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884897e700 1 --2- 172.21.15.62:0/537524494 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f884405f730 0x7f884405fb90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884897e700 1 --2- 172.21.15.62:0/537524494 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8844062360 0x7f8844144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884897e700 1 --2- 172.21.15.62:0/537524494 >> v2:172.21.15.109:3300/0 conn(0x7f8844066a70 0x7f8844144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884897e700 1 -- 172.21.15.62:0/537524494 >> 172.21.15.62:0/537524494 conn(0x7f884405bcd0 msgr2=0x7f8844063510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:53.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884897e700 1 -- 172.21.15.62:0/537524494 shutdown_connections 2021-12-17T18:21:53.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884897e700 1 -- 172.21.15.62:0/537524494 wait complete. 2021-12-17T18:21:53.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884897e700 1 Processor -- start 2021-12-17T18:21:53.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884897e700 1 -- start start 2021-12-17T18:21:53.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884897e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f884405f730 0x7f884413cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884897e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8844062360 0x7f884413d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884897e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8844066a70 0x7f88440adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884897e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88440b0610 con 0x7f884405f730 2021-12-17T18:21:53.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884897e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88440b08b0 con 0x7f8844062360 2021-12-17T18:21:53.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884897e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8844064e40 con 0x7f8844066a70 2021-12-17T18:21:53.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f8842d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f884405f730 0x7f884413cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f8842d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f884405f730 0x7f884413cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50762/0 (socket says 172.21.15.62:50762) 2021-12-17T18:21:53.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f8842d9d700 1 -- 172.21.15.62:0/4220624768 learned_addr learned my addr 172.21.15.62:0/4220624768 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:53.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884359e700 1 --2- 172.21.15.62:0/4220624768 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8844066a70 0x7f88440adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884259c700 1 --2- 172.21.15.62:0/4220624768 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8844062360 0x7f884413d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f8842d9d700 1 -- 172.21.15.62:0/4220624768 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8844066a70 msgr2=0x7f88440adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f8842d9d700 1 --2- 172.21.15.62:0/4220624768 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8844066a70 0x7f88440adab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f8842d9d700 1 -- 172.21.15.62:0/4220624768 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8844062360 msgr2=0x7f884413d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f8842d9d700 1 --2- 172.21.15.62:0/4220624768 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8844062360 0x7f884413d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f8842d9d700 1 -- 172.21.15.62:0/4220624768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c009530 con 0x7f884405f730 2021-12-17T18:21:53.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f884259c700 1 --2- 172.21.15.62:0/4220624768 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8844062360 0x7f884413d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:21:53.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.431+0000 7f8842d9d700 1 --2- 172.21.15.62:0/4220624768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f884405f730 0x7f884413cc00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f883400c000 tx=0x7f8834006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:53.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.435+0000 7f8833fff700 1 -- 172.21.15.62:0/4220624768 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8834010780 con 0x7f884405f730 2021-12-17T18:21:53.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.435+0000 7f8833fff700 1 -- 172.21.15.62:0/4220624768 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88340108e0 con 0x7f884405f730 2021-12-17T18:21:53.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.435+0000 7f884897e700 1 -- 172.21.15.62:0/4220624768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88440b0340 con 0x7f884405f730 2021-12-17T18:21:53.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.435+0000 7f8833fff700 1 -- 172.21.15.62:0/4220624768 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8834010c40 con 0x7f884405f730 2021-12-17T18:21:53.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.435+0000 7f884897e700 1 -- 172.21.15.62:0/4220624768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8844065500 con 0x7f884405f730 2021-12-17T18:21:53.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.435+0000 7f8833fff700 1 -- 172.21.15.62:0/4220624768 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f883401c460 con 0x7f884405f730 2021-12-17T18:21:53.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.435+0000 7f884897e700 1 -- 172.21.15.62:0/4220624768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88440664d0 con 0x7f884405f730 2021-12-17T18:21:53.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.435+0000 7f8833fff700 1 --2- 172.21.15.62:0/4220624768 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8820053610 0x7f8820055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.435+0000 7f8833fff700 1 -- 172.21.15.62:0/4220624768 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f883406be30 con 0x7f884405f730 2021-12-17T18:21:53.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.435+0000 7f884259c700 1 --2- 172.21.15.62:0/4220624768 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8820053610 0x7f8820055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.435+0000 7f884259c700 1 --2- 172.21.15.62:0/4220624768 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8820053610 0x7f8820055ad0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f883800b000 tx=0x7f8838008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:53.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.443+0000 7f8833fff700 1 -- 172.21.15.62:0/4220624768 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f88440664d0 con 0x7f884405f730 2021-12-17T18:21:53.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.611+0000 7f884897e700 1 -- 172.21.15.62:0/4220624768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f88440664d0 con 0x7f884405f730 2021-12-17T18:21:53.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.619+0000 7f8833fff700 1 -- 172.21.15.62:0/4220624768 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7f88440664d0 con 0x7f884405f730 2021-12-17T18:21:53.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.619+0000 7f884897e700 1 -- 172.21.15.62:0/4220624768 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8820053610 msgr2=0x7f8820055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.619+0000 7f884897e700 1 --2- 172.21.15.62:0/4220624768 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8820053610 0x7f8820055ad0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f883800b000 tx=0x7f8838008040).stop 2021-12-17T18:21:53.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.619+0000 7f884897e700 1 -- 172.21.15.62:0/4220624768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f884405f730 msgr2=0x7f884413cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.619+0000 7f884897e700 1 --2- 172.21.15.62:0/4220624768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f884405f730 0x7f884413cc00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f883400c000 tx=0x7f8834006df0).stop 2021-12-17T18:21:53.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.619+0000 7f884897e700 1 -- 172.21.15.62:0/4220624768 shutdown_connections 2021-12-17T18:21:53.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.619+0000 7f884897e700 1 --2- 172.21.15.62:0/4220624768 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8820053610 0x7f8820055ad0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.619+0000 7f884897e700 1 --2- 172.21.15.62:0/4220624768 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8844066a70 0x7f88440adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.619+0000 7f884897e700 1 --2- 172.21.15.62:0/4220624768 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8844062360 0x7f884413d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.619+0000 7f884897e700 1 --2- 172.21.15.62:0/4220624768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f884405f730 0x7f884413cc00 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.619+0000 7f884897e700 1 -- 172.21.15.62:0/4220624768 >> 172.21.15.62:0/4220624768 conn(0x7f884405bcd0 msgr2=0x7f8844144730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:53.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.619+0000 7f884897e700 1 -- 172.21.15.62:0/4220624768 shutdown_connections 2021-12-17T18:21:53.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.619+0000 7f884897e700 1 -- 172.21.15.62:0/4220624768 wait complete. 2021-12-17T18:21:53.626 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.0 2021-12-17T18:21:53.634 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:21:53.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.747+0000 7f712f59e700 1 Processor -- start 2021-12-17T18:21:53.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.747+0000 7f712f59e700 1 -- start start 2021-12-17T18:21:53.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.747+0000 7f712f59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f713005ca90 0x7f71300b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.747+0000 7f712f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71300b34b0 0x7f7130145b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.747+0000 7f712f59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f71300604b0 0x7f7130146010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712f59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713005ce70 con 0x7f713005ca90 2021-12-17T18:21:53.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712f59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71300b2d70 con 0x7f71300604b0 2021-12-17T18:21:53.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71300b3010 con 0x7f71300b34b0 2021-12-17T18:21:53.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712e59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f713005ca90 0x7f71300b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712e59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f713005ca90 0x7f71300b2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50770/0 (socket says 172.21.15.62:50770) 2021-12-17T18:21:53.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712e59c700 1 -- 172.21.15.62:0/1066930361 learned_addr learned my addr 172.21.15.62:0/1066930361 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:53.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712ed9d700 1 --2- 172.21.15.62:0/1066930361 >> v2:172.21.15.109:3300/0 conn(0x7f71300604b0 0x7f7130146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712dd9b700 1 --2- 172.21.15.62:0/1066930361 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71300b34b0 0x7f7130145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712e59c700 1 -- 172.21.15.62:0/1066930361 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71300b34b0 msgr2=0x7f7130145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:53.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712e59c700 1 --2- 172.21.15.62:0/1066930361 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71300b34b0 0x7f7130145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712e59c700 1 -- 172.21.15.62:0/1066930361 >> v2:172.21.15.109:3300/0 conn(0x7f71300604b0 msgr2=0x7f7130146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:53.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712e59c700 1 --2- 172.21.15.62:0/1066930361 >> v2:172.21.15.109:3300/0 conn(0x7f71300604b0 0x7f7130146010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712e59c700 1 -- 172.21.15.62:0/1066930361 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71300b2ab0 con 0x7f713005ca90 2021-12-17T18:21:53.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712dd9b700 1 --2- 172.21.15.62:0/1066930361 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71300b34b0 0x7f7130145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:21:53.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712e59c700 1 --2- 172.21.15.62:0/1066930361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f713005ca90 0x7f71300b2470 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f7120002f70 tx=0x7f7120006eb0).ready entity=mon.0 client_cookie=bbc4e04b85b2461e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:53.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712d59a700 1 -- 172.21.15.62:0/1066930361 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f712000d570 con 0x7f713005ca90 2021-12-17T18:21:53.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712d59a700 1 -- 172.21.15.62:0/1066930361 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7120000e90 con 0x7f713005ca90 2021-12-17T18:21:53.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712d59a700 1 -- 172.21.15.62:0/1066930361 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f712000d900 con 0x7f713005ca90 2021-12-17T18:21:53.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712f59e700 1 -- 172.21.15.62:0/1066930361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f713005ca90 msgr2=0x7f71300b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712f59e700 1 --2- 172.21.15.62:0/1066930361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f713005ca90 0x7f71300b2470 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f7120002f70 tx=0x7f7120006eb0).stop 2021-12-17T18:21:53.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712f59e700 1 -- 172.21.15.62:0/1066930361 shutdown_connections 2021-12-17T18:21:53.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712f59e700 1 --2- 172.21.15.62:0/1066930361 >> v2:172.21.15.109:3300/0 conn(0x7f71300604b0 0x7f7130146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712f59e700 1 --2- 172.21.15.62:0/1066930361 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71300b34b0 0x7f7130145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712f59e700 1 --2- 172.21.15.62:0/1066930361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f713005ca90 0x7f71300b2470 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712f59e700 1 -- 172.21.15.62:0/1066930361 >> 172.21.15.62:0/1066930361 conn(0x7f713005bcd0 msgr2=0x7f7130062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:53.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712f59e700 1 -- 172.21.15.62:0/1066930361 shutdown_connections 2021-12-17T18:21:53.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712f59e700 1 -- 172.21.15.62:0/1066930361 wait complete. 2021-12-17T18:21:53.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.751+0000 7f712f59e700 1 Processor -- start 2021-12-17T18:21:53.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712f59e700 1 -- start start 2021-12-17T18:21:53.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712f59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f713005ca90 0x7f71300a6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71300604b0 0x7f71300a3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71300b34b0 0x7f7130141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7130066650 con 0x7f71300b34b0 2021-12-17T18:21:53.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712f59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71300a6550 con 0x7f713005ca90 2021-12-17T18:21:53.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71300a66c0 con 0x7f71300604b0 2021-12-17T18:21:53.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71300b34b0 0x7f7130141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712dd9b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71300604b0 0x7f71300a3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71300b34b0 0x7f7130141970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50780/0 (socket says 172.21.15.62:50780) 2021-12-17T18:21:53.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712dd9b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71300604b0 0x7f71300a3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:44480/0 (socket says 172.21.15.62:44480) 2021-12-17T18:21:53.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712e59c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f713005ca90 0x7f71300a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712dd9b700 1 -- 172.21.15.62:0/3542137239 learned_addr learned my addr 172.21.15.62:0/3542137239 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:53.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712ed9d700 1 -- 172.21.15.62:0/3542137239 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71300604b0 msgr2=0x7f71300a3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712ed9d700 1 --2- 172.21.15.62:0/3542137239 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71300604b0 0x7f71300a3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712ed9d700 1 -- 172.21.15.62:0/3542137239 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f713005ca90 msgr2=0x7f71300a6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712ed9d700 1 --2- 172.21.15.62:0/3542137239 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f713005ca90 0x7f71300a6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712ed9d700 1 -- 172.21.15.62:0/3542137239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712000b1e0 con 0x7f71300b34b0 2021-12-17T18:21:53.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712dd9b700 1 --2- 172.21.15.62:0/3542137239 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71300604b0 0x7f71300a3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:21:53.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712ed9d700 1 --2- 172.21.15.62:0/3542137239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71300b34b0 0x7f7130141970 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f7130066810 tx=0x7f7128008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:53.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f71277fe700 1 -- 172.21.15.62:0/3542137239 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f712800c070 con 0x7f71300b34b0 2021-12-17T18:21:53.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f71277fe700 1 -- 172.21.15.62:0/3542137239 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71280133f0 con 0x7f71300b34b0 2021-12-17T18:21:53.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712f59e700 1 -- 172.21.15.62:0/3542137239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71300a3d50 con 0x7f71300b34b0 2021-12-17T18:21:53.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f71277fe700 1 -- 172.21.15.62:0/3542137239 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7128013750 con 0x7f71300b34b0 2021-12-17T18:21:53.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.755+0000 7f712f59e700 1 -- 172.21.15.62:0/3542137239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71300671f0 con 0x7f71300b34b0 2021-12-17T18:21:53.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.759+0000 7f712f59e700 1 -- 172.21.15.62:0/3542137239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7130066850 con 0x7f71300b34b0 2021-12-17T18:21:53.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.759+0000 7f71277fe700 1 -- 172.21.15.62:0/3542137239 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f71280138b0 con 0x7f71300b34b0 2021-12-17T18:21:53.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.759+0000 7f71277fe700 1 --2- 172.21.15.62:0/3542137239 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7114053580 0x7f7114055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:53.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.759+0000 7f71277fe700 1 -- 172.21.15.62:0/3542137239 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f712806b580 con 0x7f71300b34b0 2021-12-17T18:21:53.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.759+0000 7f712e59c700 1 --2- 172.21.15.62:0/3542137239 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7114053580 0x7f7114055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:53.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.759+0000 7f712e59c700 1 --2- 172.21.15.62:0/3542137239 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7114053580 0x7f7114055a40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f712001c000 tx=0x7f7120015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:53.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.767+0000 7f71277fe700 1 -- 172.21.15.62:0/3542137239 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f71280425d0 con 0x7f71300b34b0 2021-12-17T18:21:53.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.939+0000 7f712f59e700 1 -- 172.21.15.62:0/3542137239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f71300b4500 con 0x7f71300b34b0 2021-12-17T18:21:53.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.947+0000 7f71277fe700 1 -- 172.21.15.62:0/3542137239 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7128045bf0 con 0x7f71300b34b0 2021-12-17T18:21:53.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.947+0000 7f712f59e700 1 -- 172.21.15.62:0/3542137239 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7114053580 msgr2=0x7f7114055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.947+0000 7f712f59e700 1 --2- 172.21.15.62:0/3542137239 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7114053580 0x7f7114055a40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f712001c000 tx=0x7f7120015000).stop 2021-12-17T18:21:53.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.947+0000 7f712f59e700 1 -- 172.21.15.62:0/3542137239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71300b34b0 msgr2=0x7f7130141970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:53.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.947+0000 7f712f59e700 1 --2- 172.21.15.62:0/3542137239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71300b34b0 0x7f7130141970 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f7130066810 tx=0x7f7128008040).stop 2021-12-17T18:21:53.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.947+0000 7f712f59e700 1 -- 172.21.15.62:0/3542137239 shutdown_connections 2021-12-17T18:21:53.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.947+0000 7f712f59e700 1 --2- 172.21.15.62:0/3542137239 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7114053580 0x7f7114055a40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.947+0000 7f712f59e700 1 --2- 172.21.15.62:0/3542137239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71300b34b0 0x7f7130141970 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.947+0000 7f712f59e700 1 --2- 172.21.15.62:0/3542137239 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71300604b0 0x7f71300a3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.947+0000 7f712f59e700 1 --2- 172.21.15.62:0/3542137239 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f713005ca90 0x7f71300a6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:53.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.947+0000 7f712f59e700 1 -- 172.21.15.62:0/3542137239 >> 172.21.15.62:0/3542137239 conn(0x7f713005bcd0 msgr2=0x7f7130062350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:53.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.947+0000 7f712f59e700 1 -- 172.21.15.62:0/3542137239 shutdown_connections 2021-12-17T18:21:53.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:53.947+0000 7f712f59e700 1 -- 172.21.15.62:0/3542137239 wait complete. 2021-12-17T18:21:53.956 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.1 2021-12-17T18:21:53.964 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:21:54.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.083+0000 7f8115468700 1 Processor -- start 2021-12-17T18:21:54.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.083+0000 7f8115468700 1 -- start start 2021-12-17T18:21:54.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.083+0000 7f8115468700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f811005fa70 0x7f8110061390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:54.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.083+0000 7f8115468700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8110064de0 0x7f8110062450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:54.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.083+0000 7f8115468700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811005fe50 con 0x7f811013fee0 2021-12-17T18:21:54.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.083+0000 7f8115468700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81100646a0 con 0x7f8110064de0 2021-12-17T18:21:54.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.083+0000 7f8115468700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8110064940 con 0x7f811005fa70 2021-12-17T18:21:54.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.083+0000 7f8114c67700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f811013fee0 0x7f8110140320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34366/0 (socket says 172.21.15.62:34366) 2021-12-17T18:21:54.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.083+0000 7f8114c67700 1 -- 172.21.15.62:0/1563715813 learned_addr learned my addr 172.21.15.62:0/1563715813 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:54.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.083+0000 7f810f7fe700 1 --2- 172.21.15.62:0/1563715813 >> v2:172.21.15.62:3300/0 conn(0x7f8110064de0 0x7f8110062450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:54.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.083+0000 7f810ffff700 1 --2- 172.21.15.62:0/1563715813 >> v2:172.21.15.109:3300/0 conn(0x7f811005fa70 0x7f8110061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:54.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.083+0000 7f810effd700 1 -- 172.21.15.62:0/1563715813 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029939173 0 0) 0x7f811005fe50 con 0x7f811013fee0 2021-12-17T18:21:54.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.083+0000 7f810effd700 1 -- 172.21.15.62:0/1563715813 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80fc003260 con 0x7f811013fee0 2021-12-17T18:21:54.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.083+0000 7f810f7fe700 1 -- 172.21.15.62:0/1563715813 >> v2:172.21.15.109:3300/0 conn(0x7f811005fa70 msgr2=0x7f8110061390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:54.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.083+0000 7f810f7fe700 1 --2- 172.21.15.62:0/1563715813 >> v2:172.21.15.109:3300/0 conn(0x7f811005fa70 0x7f8110061390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.083+0000 7f810f7fe700 1 -- 172.21.15.62:0/1563715813 >> v1:172.21.15.62:6789/0 conn(0x7f811013fee0 legacy=0x7f8110140320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:54.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.083+0000 7f810f7fe700 1 -- 172.21.15.62:0/1563715813 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8110142e50 con 0x7f8110064de0 2021-12-17T18:21:54.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f810f7fe700 1 --2- 172.21.15.62:0/1563715813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8110064de0 0x7f8110062450 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f8104002f70 tx=0x7f8104006df0).ready entity=mon.0 client_cookie=df46c5b5c1a4be20 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:54.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f810effd700 1 -- 172.21.15.62:0/1563715813 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f810400d4f0 con 0x7f8110064de0 2021-12-17T18:21:54.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f810effd700 1 -- 172.21.15.62:0/1563715813 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8104000e90 con 0x7f8110064de0 2021-12-17T18:21:54.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f810effd700 1 -- 172.21.15.62:0/1563715813 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f810400d840 con 0x7f8110064de0 2021-12-17T18:21:54.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f8115468700 1 -- 172.21.15.62:0/1563715813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8110064de0 msgr2=0x7f8110062450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:54.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f8115468700 1 --2- 172.21.15.62:0/1563715813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8110064de0 0x7f8110062450 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f8104002f70 tx=0x7f8104006df0).stop 2021-12-17T18:21:54.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f8115468700 1 -- 172.21.15.62:0/1563715813 shutdown_connections 2021-12-17T18:21:54.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f8115468700 1 --2- 172.21.15.62:0/1563715813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8110064de0 0x7f8110062450 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f8115468700 1 --2- 172.21.15.62:0/1563715813 >> v2:172.21.15.109:3300/0 conn(0x7f811005fa70 0x7f8110061390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f8115468700 1 -- 172.21.15.62:0/1563715813 >> 172.21.15.62:0/1563715813 conn(0x7f811005bcd0 msgr2=0x7f8110063510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:54.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f8115468700 1 -- 172.21.15.62:0/1563715813 shutdown_connections 2021-12-17T18:21:54.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f8115468700 1 -- 172.21.15.62:0/1563715813 wait complete. 2021-12-17T18:21:54.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f8115468700 1 Processor -- start 2021-12-17T18:21:54.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f8115468700 1 -- start start 2021-12-17T18:21:54.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f8115468700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811005fa70 0x7f8110141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:54.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f8115468700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8110064de0 0x7f8110066230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:54.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f8115468700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f811013fee0 0x7f8110155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:54.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f8115468700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8110145c10 con 0x7f811005fa70 2021-12-17T18:21:54.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f8115468700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8110065d90 con 0x7f8110064de0 2021-12-17T18:21:54.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.087+0000 7f8115468700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8110066720 con 0x7f811013fee0 2021-12-17T18:21:54.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f810ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811005fa70 0x7f8110141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:54.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f810ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811005fa70 0x7f8110141ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50790/0 (socket says 172.21.15.62:50790) 2021-12-17T18:21:54.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f810ffff700 1 -- 172.21.15.62:0/2560063969 learned_addr learned my addr 172.21.15.62:0/2560063969 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:54.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f810ffff700 1 -- 172.21.15.62:0/2560063969 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f811013fee0 msgr2=0x7f8110155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:54.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f8114c67700 1 --2- 172.21.15.62:0/2560063969 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f811013fee0 0x7f8110155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:54.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f810f7fe700 1 --2- 172.21.15.62:0/2560063969 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8110064de0 0x7f8110066230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:54.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f810ffff700 1 --2- 172.21.15.62:0/2560063969 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f811013fee0 0x7f8110155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f810ffff700 1 -- 172.21.15.62:0/2560063969 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8110064de0 msgr2=0x7f8110066230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:54.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f810ffff700 1 --2- 172.21.15.62:0/2560063969 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8110064de0 0x7f8110066230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f810ffff700 1 -- 172.21.15.62:0/2560063969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810400b180 con 0x7f811005fa70 2021-12-17T18:21:54.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f8114c67700 1 --2- 172.21.15.62:0/2560063969 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f811013fee0 0x7f8110155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:21:54.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f810f7fe700 1 --2- 172.21.15.62:0/2560063969 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8110064de0 0x7f8110066230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:21:54.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f810ffff700 1 --2- 172.21.15.62:0/2560063969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811005fa70 0x7f8110141ec0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f810000c000 tx=0x7f8100006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:54.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f810d7fa700 1 -- 172.21.15.62:0/2560063969 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8100010780 con 0x7f811005fa70 2021-12-17T18:21:54.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f810d7fa700 1 -- 172.21.15.62:0/2560063969 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81000108e0 con 0x7f811005fa70 2021-12-17T18:21:54.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f8115468700 1 -- 172.21.15.62:0/2560063969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81101460f0 con 0x7f811005fa70 2021-12-17T18:21:54.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f810d7fa700 1 -- 172.21.15.62:0/2560063969 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8100010c40 con 0x7f811005fa70 2021-12-17T18:21:54.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f8115468700 1 -- 172.21.15.62:0/2560063969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8110145920 con 0x7f811005fa70 2021-12-17T18:21:54.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f8115468700 1 -- 172.21.15.62:0/2560063969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81100573d0 con 0x7f811005fa70 2021-12-17T18:21:54.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.091+0000 7f810d7fa700 1 -- 172.21.15.62:0/2560063969 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f810001c460 con 0x7f811005fa70 2021-12-17T18:21:54.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.095+0000 7f810d7fa700 1 --2- 172.21.15.62:0/2560063969 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f80f00534f0 0x7f80f00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:54.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.095+0000 7f810d7fa700 1 -- 172.21.15.62:0/2560063969 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f810006be80 con 0x7f811005fa70 2021-12-17T18:21:54.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.095+0000 7f810f7fe700 1 --2- 172.21.15.62:0/2560063969 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f80f00534f0 0x7f80f00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:54.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.095+0000 7f810f7fe700 1 --2- 172.21.15.62:0/2560063969 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f80f00534f0 0x7f80f00559b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f8104015000 tx=0x7f8104014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:54.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.099+0000 7f810d7fa700 1 -- 172.21.15.62:0/2560063969 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8100042f80 con 0x7f811005fa70 2021-12-17T18:21:54.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.267+0000 7f8115468700 1 -- 172.21.15.62:0/2560063969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8110063ea0 con 0x7f811005fa70 2021-12-17T18:21:54.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.271+0000 7f810d7fa700 1 -- 172.21.15.62:0/2560063969 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v19) v1 ==== 184+0+0 (secure 0 0 0) 0x7f81000465a0 con 0x7f811005fa70 2021-12-17T18:21:54.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.275+0000 7f8115468700 1 -- 172.21.15.62:0/2560063969 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f80f00534f0 msgr2=0x7f80f00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:54.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.275+0000 7f8115468700 1 --2- 172.21.15.62:0/2560063969 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f80f00534f0 0x7f80f00559b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f8104015000 tx=0x7f8104014000).stop 2021-12-17T18:21:54.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.275+0000 7f8115468700 1 -- 172.21.15.62:0/2560063969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811005fa70 msgr2=0x7f8110141ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:54.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.275+0000 7f8115468700 1 --2- 172.21.15.62:0/2560063969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811005fa70 0x7f8110141ec0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f810000c000 tx=0x7f8100006df0).stop 2021-12-17T18:21:54.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.275+0000 7f8115468700 1 -- 172.21.15.62:0/2560063969 shutdown_connections 2021-12-17T18:21:54.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.275+0000 7f8115468700 1 --2- 172.21.15.62:0/2560063969 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f80f00534f0 0x7f80f00559b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.275+0000 7f8115468700 1 --2- 172.21.15.62:0/2560063969 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f811013fee0 0x7f8110155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.275+0000 7f8115468700 1 --2- 172.21.15.62:0/2560063969 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8110064de0 0x7f8110066230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.275+0000 7f8115468700 1 --2- 172.21.15.62:0/2560063969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811005fa70 0x7f8110141ec0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.275+0000 7f8115468700 1 -- 172.21.15.62:0/2560063969 >> 172.21.15.62:0/2560063969 conn(0x7f811005bcd0 msgr2=0x7f81100b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:54.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.275+0000 7f8115468700 1 -- 172.21.15.62:0/2560063969 shutdown_connections 2021-12-17T18:21:54.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.275+0000 7f8115468700 1 -- 172.21.15.62:0/2560063969 wait complete. 2021-12-17T18:21:54.281 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.2 2021-12-17T18:21:54.291 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:21:54.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc34d69700 1 Processor -- start 2021-12-17T18:21:54.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc34d69700 1 -- start start 2021-12-17T18:21:54.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc34d69700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fbc30141480 0x7fbc30147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:54.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc34d69700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbc300a8e10 0x7fbc300b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:54.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc34d69700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc30147610 con 0x7fbc300b6050 2021-12-17T18:21:54.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc34d69700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc301478b0 con 0x7fbc300a8e10 2021-12-17T18:21:54.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc34d69700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc30147b50 con 0x7fbc30141480 2021-12-17T18:21:54.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc2effd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbc300a8e10 0x7fbc300b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:54.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc2effd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbc300a8e10 0x7fbc300b5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50798/0 (socket says 172.21.15.62:50798) 2021-12-17T18:21:54.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc2effd700 1 -- 172.21.15.62:0/136371843 learned_addr learned my addr 172.21.15.62:0/136371843 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:54.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc2f7fe700 1 --2- 172.21.15.62:0/136371843 >> v2:172.21.15.109:3300/0 conn(0x7fbc30141480 0x7fbc30147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:54.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc2effd700 1 -- 172.21.15.62:0/136371843 >> v2:172.21.15.109:3300/0 conn(0x7fbc30141480 msgr2=0x7fbc30147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:54.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc2effd700 1 --2- 172.21.15.62:0/136371843 >> v2:172.21.15.109:3300/0 conn(0x7fbc30141480 0x7fbc30147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc2effd700 1 -- 172.21.15.62:0/136371843 >> v1:172.21.15.109:6789/0 conn(0x7fbc300b6050 legacy=0x7fbc300a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:54.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc2effd700 1 -- 172.21.15.62:0/136371843 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc300b1b90 con 0x7fbc300a8e10 2021-12-17T18:21:54.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc2effd700 1 --2- 172.21.15.62:0/136371843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc300a8e10 0x7fbc300b5b60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fbc200032f0 tx=0x7fbc20009290).ready entity=mon.0 client_cookie=165b0ac70cd58cd server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:54.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc2e7fc700 1 -- 172.21.15.62:0/136371843 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc2000b870 con 0x7fbc300a8e10 2021-12-17T18:21:54.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc2e7fc700 1 -- 172.21.15.62:0/136371843 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2000b9d0 con 0x7fbc300a8e10 2021-12-17T18:21:54.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.395+0000 7fbc2e7fc700 1 -- 172.21.15.62:0/136371843 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc2000bb40 con 0x7fbc300a8e10 2021-12-17T18:21:54.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc34d69700 1 -- 172.21.15.62:0/136371843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc300a8e10 msgr2=0x7fbc300b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:54.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc34d69700 1 --2- 172.21.15.62:0/136371843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc300a8e10 0x7fbc300b5b60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fbc200032f0 tx=0x7fbc20009290).stop 2021-12-17T18:21:54.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc34d69700 1 -- 172.21.15.62:0/136371843 shutdown_connections 2021-12-17T18:21:54.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc34d69700 1 --2- 172.21.15.62:0/136371843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc300a8e10 0x7fbc300b5b60 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc34d69700 1 --2- 172.21.15.62:0/136371843 >> v2:172.21.15.109:3300/0 conn(0x7fbc30141480 0x7fbc30147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc34d69700 1 -- 172.21.15.62:0/136371843 >> 172.21.15.62:0/136371843 conn(0x7fbc3005d220 msgr2=0x7fbc300b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:54.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc34d69700 1 -- 172.21.15.62:0/136371843 shutdown_connections 2021-12-17T18:21:54.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc34d69700 1 -- 172.21.15.62:0/136371843 wait complete. 2021-12-17T18:21:54.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc34d69700 1 Processor -- start 2021-12-17T18:21:54.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc34d69700 1 -- start start 2021-12-17T18:21:54.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc34d69700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbc300a8e10 0x7fbc30148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:54.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc34d69700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbc300b6050 0x7fbc300ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:54.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc34d69700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc30141480 0x7fbc3014a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:54.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc34d69700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300ae0d0 con 0x7fbc30141480 2021-12-17T18:21:54.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc34d69700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300abb20 con 0x7fbc300a8e10 2021-12-17T18:21:54.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc34d69700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300ae9f0 con 0x7fbc300b6050 2021-12-17T18:21:54.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc2ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc30141480 0x7fbc3014a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:54.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc2f7fe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbc300a8e10 0x7fbc30148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:54.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc2ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc30141480 0x7fbc3014a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50808/0 (socket says 172.21.15.62:50808) 2021-12-17T18:21:54.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc2ffff700 1 -- 172.21.15.62:0/1171401444 learned_addr learned my addr 172.21.15.62:0/1171401444 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:54.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc2effd700 1 --2- 172.21.15.62:0/1171401444 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbc300b6050 0x7fbc300ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:54.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc2ffff700 1 -- 172.21.15.62:0/1171401444 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbc300b6050 msgr2=0x7fbc300ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:54.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc2ffff700 1 --2- 172.21.15.62:0/1171401444 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbc300b6050 0x7fbc300ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc2ffff700 1 -- 172.21.15.62:0/1171401444 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbc300a8e10 msgr2=0x7fbc30148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:54.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc2ffff700 1 --2- 172.21.15.62:0/1171401444 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbc300a8e10 0x7fbc30148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc2ffff700 1 -- 172.21.15.62:0/1171401444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc20009530 con 0x7fbc30141480 2021-12-17T18:21:54.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.399+0000 7fbc2ffff700 1 --2- 172.21.15.62:0/1171401444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc30141480 0x7fbc3014a560 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fbc30061fe0 tx=0x7fbc28007b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:54.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.403+0000 7fbc2cff9700 1 -- 172.21.15.62:0/1171401444 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc28012400 con 0x7fbc30141480 2021-12-17T18:21:54.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.403+0000 7fbc2cff9700 1 -- 172.21.15.62:0/1171401444 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc28012560 con 0x7fbc30141480 2021-12-17T18:21:54.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.403+0000 7fbc34d69700 1 -- 172.21.15.62:0/1171401444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc300abdc0 con 0x7fbc30141480 2021-12-17T18:21:54.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.403+0000 7fbc2cff9700 1 -- 172.21.15.62:0/1171401444 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc280128c0 con 0x7fbc30141480 2021-12-17T18:21:54.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.403+0000 7fbc34d69700 1 -- 172.21.15.62:0/1171401444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc300ac1f0 con 0x7fbc30141480 2021-12-17T18:21:54.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.403+0000 7fbc34d69700 1 -- 172.21.15.62:0/1171401444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc300ae240 con 0x7fbc30141480 2021-12-17T18:21:54.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.403+0000 7fbc2cff9700 1 -- 172.21.15.62:0/1171401444 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbc28019030 con 0x7fbc30141480 2021-12-17T18:21:54.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.403+0000 7fbc2cff9700 1 --2- 172.21.15.62:0/1171401444 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbc10053640 0x7fbc10055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:54.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.403+0000 7fbc2cff9700 1 -- 172.21.15.62:0/1171401444 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbc2806ac90 con 0x7fbc30141480 2021-12-17T18:21:54.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.403+0000 7fbc2f7fe700 1 --2- 172.21.15.62:0/1171401444 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbc10053640 0x7fbc10055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:54.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.407+0000 7fbc2f7fe700 1 --2- 172.21.15.62:0/1171401444 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbc10053640 0x7fbc10055b00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fbc2400c000 tx=0x7fbc24008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:54.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.411+0000 7fbc2cff9700 1 -- 172.21.15.62:0/1171401444 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbc300ae240 con 0x7fbc30141480 2021-12-17T18:21:54.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.571+0000 7fbc34d69700 1 -- 172.21.15.62:0/1171401444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc300ae210 con 0x7fbc30141480 2021-12-17T18:21:54.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.571+0000 7fbc2cff9700 1 -- 172.21.15.62:0/1171401444 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2142 (secure 0 0 0) 0x7fbc28017070 con 0x7fbc30141480 2021-12-17T18:21:54.576 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:21:54.576 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3056253780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3056253780},{"type":"v1","addr":"172.21.15.109:6835","nonce":3056253780}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:21:51.687672+0000","modified":"2021-12-17T18:21:52.715134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/3358597467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3358597467},{"type":"v1","addr":"172.21.15.62:6833","nonce":3358597467}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-12-17T18:21:54.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.575+0000 7fbc34d69700 1 -- 172.21.15.62:0/1171401444 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbc10053640 msgr2=0x7fbc10055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:54.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.575+0000 7fbc34d69700 1 --2- 172.21.15.62:0/1171401444 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbc10053640 0x7fbc10055b00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fbc2400c000 tx=0x7fbc24008040).stop 2021-12-17T18:21:54.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.575+0000 7fbc34d69700 1 -- 172.21.15.62:0/1171401444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc30141480 msgr2=0x7fbc3014a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:54.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.575+0000 7fbc34d69700 1 --2- 172.21.15.62:0/1171401444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc30141480 0x7fbc3014a560 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fbc30061fe0 tx=0x7fbc28007b80).stop 2021-12-17T18:21:54.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.575+0000 7fbc34d69700 1 -- 172.21.15.62:0/1171401444 shutdown_connections 2021-12-17T18:21:54.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.575+0000 7fbc34d69700 1 --2- 172.21.15.62:0/1171401444 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbc10053640 0x7fbc10055b00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.575+0000 7fbc34d69700 1 --2- 172.21.15.62:0/1171401444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc30141480 0x7fbc3014a560 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.575+0000 7fbc34d69700 1 --2- 172.21.15.62:0/1171401444 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbc300b6050 0x7fbc300ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.575+0000 7fbc34d69700 1 --2- 172.21.15.62:0/1171401444 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbc300a8e10 0x7fbc30148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:54.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.575+0000 7fbc34d69700 1 -- 172.21.15.62:0/1171401444 >> 172.21.15.62:0/1171401444 conn(0x7fbc3005d220 msgr2=0x7fbc3005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:54.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.575+0000 7fbc34d69700 1 -- 172.21.15.62:0/1171401444 shutdown_connections 2021-12-17T18:21:54.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:54.575+0000 7fbc34d69700 1 -- 172.21.15.62:0/1171401444 wait complete. 2021-12-17T18:21:54.582 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2021-12-17T18:21:54.796 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:21:51.687672+0000', 'modified': '2021-12-17T18:21:52.715134+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5646}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5646': {'gid': 5646, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/3358597467', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 3358597467}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 3358597467}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:21:54.796 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:21:54.797 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:21:54.914 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":5646,"want_state":"up:active","state":"up:active","rank_uptime":3.21603029,"mdsmap_epoch":21,"osdmap_epoch":51,"osdmap_epoch_barrier":51,"uptime":7.5892094800000001} 2021-12-17T18:21:54.915 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 5646, "mdsmap_epoch": 21, "osdmap_epoch": 51, "osdmap_epoch_barrier": 51, "rank_uptime": 3.21603029, "state": "up:active", "uptime": 7.58920948, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:21:54.916 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:21:55.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.015+0000 7f42472a8700 1 Processor -- start 2021-12-17T18:21:55.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.015+0000 7f42472a8700 1 -- start start 2021-12-17T18:21:55.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.015+0000 7f42472a8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42400b21f0 0x7f424014aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.015+0000 7f42472a8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42400a7bb0 0x7f4240067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.015+0000 7f42472a8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42400b2ce0 con 0x7f42400b1730 2021-12-17T18:21:55.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.015+0000 7f42472a8700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4240147870 con 0x7f42400a7bb0 2021-12-17T18:21:55.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.015+0000 7f42472a8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42400b2f10 con 0x7f42400b21f0 2021-12-17T18:21:55.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.015+0000 7f4245845700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42400a7bb0 0x7f4240067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.015+0000 7f4244843700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f42400b1730 0x7f42400ace90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34392/0 (socket says 172.21.15.62:34392) 2021-12-17T18:21:55.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.015+0000 7f4244843700 1 -- 172.21.15.62:0/43849093 learned_addr learned my addr 172.21.15.62:0/43849093 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:55.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.015+0000 7f4245845700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42400a7bb0 0x7f4240067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50816/0 (socket says 172.21.15.62:50816) 2021-12-17T18:21:55.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.015+0000 7f4245044700 1 --2- 172.21.15.62:0/43849093 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42400b21f0 0x7f424014aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.015+0000 7f4245845700 1 -- 172.21.15.62:0/43849093 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42400b21f0 msgr2=0x7f424014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:55.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.015+0000 7f4245845700 1 --2- 172.21.15.62:0/43849093 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42400b21f0 0x7f424014aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.015+0000 7f4245845700 1 -- 172.21.15.62:0/43849093 >> v1:172.21.15.62:6789/0 conn(0x7f42400b1730 legacy=0x7f42400ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.015+0000 7f4237fff700 1 -- 172.21.15.62:0/43849093 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713824910 0 0) 0x7f42400b2ce0 con 0x7f42400b1730 2021-12-17T18:21:55.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.015+0000 7f4245845700 1 -- 172.21.15.62:0/43849093 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42400aca60 con 0x7f42400a7bb0 2021-12-17T18:21:55.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.019+0000 7f4245845700 1 --2- 172.21.15.62:0/43849093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42400a7bb0 0x7f4240067120 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f4238002f70 tx=0x7f4238006df0).ready entity=mon.0 client_cookie=cf9b1e14633e94de server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:55.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.019+0000 7f4237fff700 1 -- 172.21.15.62:0/43849093 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423800d570 con 0x7f42400a7bb0 2021-12-17T18:21:55.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.019+0000 7f4237fff700 1 -- 172.21.15.62:0/43849093 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4238000e90 con 0x7f42400a7bb0 2021-12-17T18:21:55.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.019+0000 7f4237fff700 1 -- 172.21.15.62:0/43849093 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423800d8c0 con 0x7f42400a7bb0 2021-12-17T18:21:55.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.019+0000 7f42472a8700 1 -- 172.21.15.62:0/43849093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42400a7bb0 msgr2=0x7f4240067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.019+0000 7f42472a8700 1 --2- 172.21.15.62:0/43849093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42400a7bb0 0x7f4240067120 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f4238002f70 tx=0x7f4238006df0).stop 2021-12-17T18:21:55.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.019+0000 7f42472a8700 1 -- 172.21.15.62:0/43849093 shutdown_connections 2021-12-17T18:21:55.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.019+0000 7f42472a8700 1 --2- 172.21.15.62:0/43849093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42400a7bb0 0x7f4240067120 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.019+0000 7f42472a8700 1 --2- 172.21.15.62:0/43849093 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42400b21f0 0x7f424014aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.019+0000 7f42472a8700 1 -- 172.21.15.62:0/43849093 >> 172.21.15.62:0/43849093 conn(0x7f424005f730 msgr2=0x7f424005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:55.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.019+0000 7f42472a8700 1 -- 172.21.15.62:0/43849093 shutdown_connections 2021-12-17T18:21:55.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.019+0000 7f42472a8700 1 -- 172.21.15.62:0/43849093 wait complete. 2021-12-17T18:21:55.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.019+0000 7f42472a8700 1 Processor -- start 2021-12-17T18:21:55.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.019+0000 7f42472a8700 1 -- start start 2021-12-17T18:21:55.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f42472a8700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42400a7bb0 0x7f424014c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f42472a8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42400b1730 0x7f424014dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f42472a8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42400b21f0 0x7f42400aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f42472a8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424014e160 con 0x7f42400b1730 2021-12-17T18:21:55.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f42472a8700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424014bd00 con 0x7f42400a7bb0 2021-12-17T18:21:55.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f42472a8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4240157bd0 con 0x7f42400b21f0 2021-12-17T18:21:55.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f4244843700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42400b1730 0x7f424014dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f4244843700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42400b1730 0x7f424014dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50820/0 (socket says 172.21.15.62:50820) 2021-12-17T18:21:55.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f4244843700 1 -- 172.21.15.62:0/2622841588 learned_addr learned my addr 172.21.15.62:0/2622841588 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:55.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f4245044700 1 --2- 172.21.15.62:0/2622841588 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42400a7bb0 0x7f424014c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f4245845700 1 --2- 172.21.15.62:0/2622841588 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42400b21f0 0x7f42400aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f4244843700 1 -- 172.21.15.62:0/2622841588 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42400b21f0 msgr2=0x7f42400aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f4244843700 1 --2- 172.21.15.62:0/2622841588 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42400b21f0 0x7f42400aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f4244843700 1 -- 172.21.15.62:0/2622841588 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42400a7bb0 msgr2=0x7f424014c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f4244843700 1 --2- 172.21.15.62:0/2622841588 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42400a7bb0 0x7f424014c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f4244843700 1 -- 172.21.15.62:0/2622841588 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423800b180 con 0x7f42400b1730 2021-12-17T18:21:55.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f4244843700 1 --2- 172.21.15.62:0/2622841588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42400b1730 0x7f424014dc70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f423c001250 tx=0x7f423c007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:55.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f42367fc700 1 -- 172.21.15.62:0/2622841588 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423c005ba0 con 0x7f42400b1730 2021-12-17T18:21:55.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f42367fc700 1 -- 172.21.15.62:0/2622841588 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c005d00 con 0x7f42400b1730 2021-12-17T18:21:55.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f42472a8700 1 -- 172.21.15.62:0/2622841588 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f424014d7d0 con 0x7f42400b1730 2021-12-17T18:21:55.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f42367fc700 1 -- 172.21.15.62:0/2622841588 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423c0072c0 con 0x7f42400b1730 2021-12-17T18:21:55.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f42472a8700 1 -- 172.21.15.62:0/2622841588 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4240157820 con 0x7f42400b1730 2021-12-17T18:21:55.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f42472a8700 1 -- 172.21.15.62:0/2622841588 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f424014d630 con 0x7f42400b1730 2021-12-17T18:21:55.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f42367fc700 1 -- 172.21.15.62:0/2622841588 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f423c01a060 con 0x7f42400b1730 2021-12-17T18:21:55.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.023+0000 7f42367fc700 1 --2- 172.21.15.62:0/2622841588 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4228053580 0x7f4228055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.027+0000 7f42367fc700 1 -- 172.21.15.62:0/2622841588 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f423c06b450 con 0x7f42400b1730 2021-12-17T18:21:55.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.027+0000 7f4245044700 1 --2- 172.21.15.62:0/2622841588 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4228053580 0x7f4228055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.027+0000 7f4245044700 1 --2- 172.21.15.62:0/2622841588 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4228053580 0x7f4228055a40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f423000b000 tx=0x7f4230006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:55.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.031+0000 7f42367fc700 1 -- 172.21.15.62:0/2622841588 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f424014d630 con 0x7f42400b1730 2021-12-17T18:21:55.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.155+0000 7f42472a8700 1 -- 172.21.15.62:0/2622841588 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f424014d630 con 0x7f42400b1730 2021-12-17T18:21:55.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.155+0000 7f42367fc700 1 -- 172.21.15.62:0/2622841588 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16088 (secure 0 0 0) 0x7f424014d630 con 0x7f42400b1730 2021-12-17T18:21:55.160 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:21:55.160 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":51,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:21:52.690524+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:21:50.101305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-12-17T18:21:51.041096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:21:55.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.159+0000 7f42472a8700 1 -- 172.21.15.62:0/2622841588 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4228053580 msgr2=0x7f4228055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.159+0000 7f42472a8700 1 --2- 172.21.15.62:0/2622841588 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4228053580 0x7f4228055a40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f423000b000 tx=0x7f4230006df0).stop 2021-12-17T18:21:55.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.159+0000 7f42472a8700 1 -- 172.21.15.62:0/2622841588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42400b1730 msgr2=0x7f424014dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.159+0000 7f42472a8700 1 --2- 172.21.15.62:0/2622841588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42400b1730 0x7f424014dc70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f423c001250 tx=0x7f423c007e40).stop 2021-12-17T18:21:55.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.159+0000 7f42472a8700 1 -- 172.21.15.62:0/2622841588 shutdown_connections 2021-12-17T18:21:55.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.159+0000 7f42472a8700 1 --2- 172.21.15.62:0/2622841588 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4228053580 0x7f4228055a40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.159+0000 7f42472a8700 1 --2- 172.21.15.62:0/2622841588 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42400b21f0 0x7f42400aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.159+0000 7f42472a8700 1 --2- 172.21.15.62:0/2622841588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42400b1730 0x7f424014dc70 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.159+0000 7f42472a8700 1 --2- 172.21.15.62:0/2622841588 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42400a7bb0 0x7f424014c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.159+0000 7f42472a8700 1 -- 172.21.15.62:0/2622841588 >> 172.21.15.62:0/2622841588 conn(0x7f424005f730 msgr2=0x7f42400afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:55.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.159+0000 7f42472a8700 1 -- 172.21.15.62:0/2622841588 shutdown_connections 2021-12-17T18:21:55.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.159+0000 7f42472a8700 1 -- 172.21.15.62:0/2622841588 wait complete. 2021-12-17T18:21:55.173 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:21:50.101305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:21:51.041096+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:21:55.174 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:21:55.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.279+0000 7ff33f59e700 1 Processor -- start 2021-12-17T18:21:55.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.279+0000 7ff33f59e700 1 -- start start 2021-12-17T18:21:55.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33f59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff340063b00 0x7ff340063ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3400b1260 0x7ff340061670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33f59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff340143dc0 con 0x7ff34013cc70 2021-12-17T18:21:55.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33f59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3400b1b90 con 0x7ff340063b00 2021-12-17T18:21:55.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff340061d00 con 0x7ff3400b1260 2021-12-17T18:21:55.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33ed9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff34013cc70 0x7ff3400621a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34410/0 (socket says 172.21.15.62:34410) 2021-12-17T18:21:55.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33ed9d700 1 -- 172.21.15.62:0/2706406312 learned_addr learned my addr 172.21.15.62:0/2706406312 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:55.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff337fff700 1 --2- 172.21.15.62:0/2706406312 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3400b1260 0x7ff340061670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33e59c700 1 --2- 172.21.15.62:0/2706406312 >> v2:172.21.15.109:3300/0 conn(0x7ff340063b00 0x7ff340063ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 -- 172.21.15.62:0/2706406312 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064388201 0 0) 0x7ff340143dc0 con 0x7ff34013cc70 2021-12-17T18:21:55.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 -- 172.21.15.62:0/2706406312 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff320003260 con 0x7ff34013cc70 2021-12-17T18:21:55.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 -- 172.21.15.62:0/2706406312 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1672256897 0 0) 0x7ff320003260 con 0x7ff34013cc70 2021-12-17T18:21:55.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 -- 172.21.15.62:0/2706406312 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3400b1260 msgr2=0x7ff340061670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:55.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 --2- 172.21.15.62:0/2706406312 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3400b1260 0x7ff340061670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 -- 172.21.15.62:0/2706406312 >> v2:172.21.15.109:3300/0 conn(0x7ff340063b00 msgr2=0x7ff340063ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:55.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 --2- 172.21.15.62:0/2706406312 >> v2:172.21.15.109:3300/0 conn(0x7ff340063b00 0x7ff340063ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 -- 172.21.15.62:0/2706406312 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3401439c0 con 0x7ff34013cc70 2021-12-17T18:21:55.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 -- 172.21.15.62:0/2706406312 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7ff3380019e0 con 0x7ff34013cc70 2021-12-17T18:21:55.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33e59c700 1 --2- 172.21.15.62:0/2706406312 >> v2:172.21.15.109:3300/0 conn(0x7ff340063b00 0x7ff340063ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:21:55.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 -- 172.21.15.62:0/2706406312 >> v1:172.21.15.62:6789/0 conn(0x7ff34013cc70 legacy=0x7ff3400621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 --2- 172.21.15.62:0/2706406312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff320003750 0x7ff320003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 --2- 172.21.15.62:0/2706406312 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3200040b0 0x7ff320004580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 --2- 172.21.15.62:0/2706406312 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff320004b50 0x7ff320005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 -- 172.21.15.62:0/2706406312 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3400b1b90 con 0x7ff320003750 2021-12-17T18:21:55.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 -- 172.21.15.62:0/2706406312 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff340061d00 con 0x7ff320004b50 2021-12-17T18:21:55.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 -- 172.21.15.62:0/2706406312 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32000bab0 con 0x7ff3200040b0 2021-12-17T18:21:55.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33e59c700 1 --2- 172.21.15.62:0/2706406312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff320003750 0x7ff320003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff337fff700 1 --2- 172.21.15.62:0/2706406312 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3400b1260 0x7ff340061670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:21:55.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33ed9d700 1 --2- 172.21.15.62:0/2706406312 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff320004b50 0x7ff320005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33e59c700 1 -- 172.21.15.62:0/2706406312 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3200040b0 msgr2=0x7ff320004580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:55.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff337fff700 1 --2- 172.21.15.62:0/2706406312 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3200040b0 0x7ff320004580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33e59c700 1 --2- 172.21.15.62:0/2706406312 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3200040b0 0x7ff320004580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33e59c700 1 -- 172.21.15.62:0/2706406312 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff320004b50 msgr2=0x7ff320005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:55.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33e59c700 1 --2- 172.21.15.62:0/2706406312 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff320004b50 0x7ff320005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33e59c700 1 -- 172.21.15.62:0/2706406312 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff320003260 con 0x7ff320003750 2021-12-17T18:21:55.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33ed9d700 1 --2- 172.21.15.62:0/2706406312 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff320004b50 0x7ff320005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:21:55.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33e59c700 1 --2- 172.21.15.62:0/2706406312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff320003750 0x7ff320003b30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7ff33000c000 tx=0x7ff330006df0).ready entity=mon.0 client_cookie=2ac3866c6a4f1007 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:55.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 -- 172.21.15.62:0/2706406312 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff33000e830 con 0x7ff320003750 2021-12-17T18:21:55.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 -- 172.21.15.62:0/2706406312 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33000e990 con 0x7ff320003750 2021-12-17T18:21:55.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.283+0000 7ff33dd9b700 1 -- 172.21.15.62:0/2706406312 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff33000ecf0 con 0x7ff320003750 2021-12-17T18:21:55.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.287+0000 7ff33f59e700 1 -- 172.21.15.62:0/2706406312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff320003750 msgr2=0x7ff320003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.287+0000 7ff33f59e700 1 --2- 172.21.15.62:0/2706406312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff320003750 0x7ff320003b30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7ff33000c000 tx=0x7ff330006df0).stop 2021-12-17T18:21:55.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.287+0000 7ff33ed9d700 1 -- 172.21.15.62:0/2706406312 reap_dead start 2021-12-17T18:21:55.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.287+0000 7ff33f59e700 1 -- 172.21.15.62:0/2706406312 shutdown_connections 2021-12-17T18:21:55.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.287+0000 7ff33f59e700 1 -- 172.21.15.62:0/2706406312 >> 172.21.15.62:0/2706406312 conn(0x7ff340060a50 msgr2=0x7ff34005bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:55.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.287+0000 7ff33f59e700 1 -- 172.21.15.62:0/2706406312 shutdown_connections 2021-12-17T18:21:55.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.287+0000 7ff33f59e700 1 -- 172.21.15.62:0/2706406312 wait complete. 2021-12-17T18:21:55.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.287+0000 7ff33f59e700 1 Processor -- start 2021-12-17T18:21:55.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.287+0000 7ff33f59e700 1 -- start start 2021-12-17T18:21:55.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33f59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff320003750 0x7ff340147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3401557c0 0x7ff3400ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff340146c90 0x7ff340141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3401462f0 con 0x7ff340146c90 2021-12-17T18:21:55.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33f59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff340145aa0 con 0x7ff320003750 2021-12-17T18:21:55.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff340145db0 con 0x7ff3401557c0 2021-12-17T18:21:55.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff340146c90 0x7ff340141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff340146c90 0x7ff340141e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50842/0 (socket says 172.21.15.62:50842) 2021-12-17T18:21:55.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33ed9d700 1 -- 172.21.15.62:0/273522748 learned_addr learned my addr 172.21.15.62:0/273522748 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:55.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33e59c700 1 --2- 172.21.15.62:0/273522748 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff320003750 0x7ff340147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff337fff700 1 --2- 172.21.15.62:0/273522748 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3401557c0 0x7ff3400ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33ed9d700 1 -- 172.21.15.62:0/273522748 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3401557c0 msgr2=0x7ff3400ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33ed9d700 1 --2- 172.21.15.62:0/273522748 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3401557c0 0x7ff3400ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33ed9d700 1 -- 172.21.15.62:0/273522748 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff320003750 msgr2=0x7ff340147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33ed9d700 1 --2- 172.21.15.62:0/273522748 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff320003750 0x7ff340147bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33ed9d700 1 -- 172.21.15.62:0/273522748 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff340146050 con 0x7ff340146c90 2021-12-17T18:21:55.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33ed9d700 1 --2- 172.21.15.62:0/273522748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff340146c90 0x7ff340141e60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7ff33800c000 tx=0x7ff338001f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:55.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff3377fe700 1 -- 172.21.15.62:0/273522748 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff33800e610 con 0x7ff340146c90 2021-12-17T18:21:55.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff3377fe700 1 -- 172.21.15.62:0/273522748 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33800e770 con 0x7ff340146c90 2021-12-17T18:21:55.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33f59e700 1 -- 172.21.15.62:0/273522748 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff340142350 con 0x7ff340146c90 2021-12-17T18:21:55.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff3377fe700 1 -- 172.21.15.62:0/273522748 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff33800ead0 con 0x7ff340146c90 2021-12-17T18:21:55.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33f59e700 1 -- 172.21.15.62:0/273522748 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff340142880 con 0x7ff340146c90 2021-12-17T18:21:55.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff33f59e700 1 -- 172.21.15.62:0/273522748 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3400b2910 con 0x7ff340146c90 2021-12-17T18:21:55.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff3377fe700 1 -- 172.21.15.62:0/273522748 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff33800ec30 con 0x7ff340146c90 2021-12-17T18:21:55.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff3377fe700 1 --2- 172.21.15.62:0/273522748 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff324053580 0x7ff324055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.291+0000 7ff3377fe700 1 -- 172.21.15.62:0/273522748 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff33806b870 con 0x7ff340146c90 2021-12-17T18:21:55.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.295+0000 7ff33e59c700 1 --2- 172.21.15.62:0/273522748 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff324053580 0x7ff324055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.295+0000 7ff33e59c700 1 --2- 172.21.15.62:0/273522748 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff324053580 0x7ff324055a40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7ff33001c000 tx=0x7ff330019000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:55.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.299+0000 7ff3377fe700 1 -- 172.21.15.62:0/273522748 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff3380429d0 con 0x7ff340146c90 2021-12-17T18:21:55.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.423+0000 7ff33f59e700 1 -- 172.21.15.62:0/273522748 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff3400573d0 con 0x7ff340146c90 2021-12-17T18:21:55.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.427+0000 7ff3377fe700 1 -- 172.21.15.62:0/273522748 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v51) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff338045ff0 con 0x7ff340146c90 2021-12-17T18:21:55.429 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:21:55.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.427+0000 7ff33f59e700 1 -- 172.21.15.62:0/273522748 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff324053580 msgr2=0x7ff324055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.427+0000 7ff33f59e700 1 --2- 172.21.15.62:0/273522748 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff324053580 0x7ff324055a40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7ff33001c000 tx=0x7ff330019000).stop 2021-12-17T18:21:55.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.427+0000 7ff33f59e700 1 -- 172.21.15.62:0/273522748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff340146c90 msgr2=0x7ff340141e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.427+0000 7ff33f59e700 1 --2- 172.21.15.62:0/273522748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff340146c90 0x7ff340141e60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7ff33800c000 tx=0x7ff338001f70).stop 2021-12-17T18:21:55.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.427+0000 7ff33f59e700 1 -- 172.21.15.62:0/273522748 shutdown_connections 2021-12-17T18:21:55.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.427+0000 7ff33f59e700 1 --2- 172.21.15.62:0/273522748 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff324053580 0x7ff324055a40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.427+0000 7ff33f59e700 1 --2- 172.21.15.62:0/273522748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff340146c90 0x7ff340141e60 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.427+0000 7ff33f59e700 1 --2- 172.21.15.62:0/273522748 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3401557c0 0x7ff3400ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.427+0000 7ff33f59e700 1 --2- 172.21.15.62:0/273522748 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff320003750 0x7ff340147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.427+0000 7ff33f59e700 1 -- 172.21.15.62:0/273522748 >> 172.21.15.62:0/273522748 conn(0x7ff340060a50 msgr2=0x7ff3400b6370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:55.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.427+0000 7ff33f59e700 1 -- 172.21.15.62:0/273522748 shutdown_connections 2021-12-17T18:21:55.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.427+0000 7ff33f59e700 1 -- 172.21.15.62:0/273522748 wait complete. 2021-12-17T18:21:55.443 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:21:55.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.551+0000 7f61f359e700 1 Processor -- start 2021-12-17T18:21:55.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.551+0000 7f61f359e700 1 -- start start 2021-12-17T18:21:55.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f359e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f61f40b1e70 0x7f61f413f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f61f40ac8c0 0x7f61f413e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f40ad100 con 0x7f61f40ac180 2021-12-17T18:21:55.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f4143680 con 0x7f61f40ac8c0 2021-12-17T18:21:55.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f359e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f4143920 con 0x7f61f40b1e70 2021-12-17T18:21:55.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f2d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f61f40ac8c0 0x7f61f413e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61e9d9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f61f40ac180 0x7f61f413f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34426/0 (socket says 172.21.15.62:34426) 2021-12-17T18:21:55.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61e9d9b700 1 -- 172.21.15.62:0/2498881412 learned_addr learned my addr 172.21.15.62:0/2498881412 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:55.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f259c700 1 --2- 172.21.15.62:0/2498881412 >> v2:172.21.15.109:3300/0 conn(0x7f61f40b1e70 0x7f61f413f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f1d9b700 1 -- 172.21.15.62:0/2498881412 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989561197 0 0) 0x7f61f40ad100 con 0x7f61f40ac180 2021-12-17T18:21:55.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f2d9d700 1 -- 172.21.15.62:0/2498881412 >> v2:172.21.15.109:3300/0 conn(0x7f61f40b1e70 msgr2=0x7f61f413f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:55.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f2d9d700 1 --2- 172.21.15.62:0/2498881412 >> v2:172.21.15.109:3300/0 conn(0x7f61f40b1e70 0x7f61f413f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f2d9d700 1 -- 172.21.15.62:0/2498881412 >> v1:172.21.15.62:6789/0 conn(0x7f61f40ac180 legacy=0x7f61f413f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f2d9d700 1 -- 172.21.15.62:0/2498881412 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f40b2250 con 0x7f61f40ac8c0 2021-12-17T18:21:55.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f2d9d700 1 --2- 172.21.15.62:0/2498881412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f40ac8c0 0x7f61f413e390 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f61f40ade10 tx=0x7f61ec0091d0).ready entity=mon.0 client_cookie=27134a2baa885e74 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:55.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f1d9b700 1 -- 172.21.15.62:0/2498881412 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61ec00b640 con 0x7f61f40ac8c0 2021-12-17T18:21:55.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f1d9b700 1 -- 172.21.15.62:0/2498881412 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ec00b7a0 con 0x7f61f40ac8c0 2021-12-17T18:21:55.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f1d9b700 1 -- 172.21.15.62:0/2498881412 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61ec00b910 con 0x7f61f40ac8c0 2021-12-17T18:21:55.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f359e700 1 -- 172.21.15.62:0/2498881412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f40ac8c0 msgr2=0x7f61f413e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f359e700 1 --2- 172.21.15.62:0/2498881412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f40ac8c0 0x7f61f413e390 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f61f40ade10 tx=0x7f61ec0091d0).stop 2021-12-17T18:21:55.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f359e700 1 -- 172.21.15.62:0/2498881412 shutdown_connections 2021-12-17T18:21:55.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f359e700 1 --2- 172.21.15.62:0/2498881412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f40ac8c0 0x7f61f413e390 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f359e700 1 --2- 172.21.15.62:0/2498881412 >> v2:172.21.15.109:3300/0 conn(0x7f61f40b1e70 0x7f61f413f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f359e700 1 -- 172.21.15.62:0/2498881412 >> 172.21.15.62:0/2498881412 conn(0x7f61f405be70 msgr2=0x7f61f4062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:55.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f359e700 1 -- 172.21.15.62:0/2498881412 shutdown_connections 2021-12-17T18:21:55.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f359e700 1 -- 172.21.15.62:0/2498881412 wait complete. 2021-12-17T18:21:55.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.555+0000 7f61f359e700 1 Processor -- start 2021-12-17T18:21:55.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f359e700 1 -- start start 2021-12-17T18:21:55.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f359e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f61f40ac180 0x7f61f40a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f40ac8c0 0x7f61f41530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f61f40b1e70 0x7f61f4063750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f4066690 con 0x7f61f40ac8c0 2021-12-17T18:21:55.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f359e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40668c0 con 0x7f61f40ac180 2021-12-17T18:21:55.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f359e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40a3b90 con 0x7f61f40b1e70 2021-12-17T18:21:55.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61e9d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f40ac8c0 0x7f61f41530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f2d9d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f61f40b1e70 0x7f61f4063750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f259c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f61f40ac180 0x7f61f40a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f2d9d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f61f40b1e70 0x7f61f4063750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:44556/0 (socket says 172.21.15.62:44556) 2021-12-17T18:21:55.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f2d9d700 1 -- 172.21.15.62:0/375001342 learned_addr learned my addr 172.21.15.62:0/375001342 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:55.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f259c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f61f40ac180 0x7f61f40a3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:57402/0 (socket says 172.21.15.62:57402) 2021-12-17T18:21:55.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61e9d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f40ac8c0 0x7f61f41530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50856/0 (socket says 172.21.15.62:50856) 2021-12-17T18:21:55.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f259c700 1 -- 172.21.15.62:0/375001342 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f61f40b1e70 msgr2=0x7f61f4063750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f259c700 1 --2- 172.21.15.62:0/375001342 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f61f40b1e70 0x7f61f4063750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f259c700 1 -- 172.21.15.62:0/375001342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f40ac8c0 msgr2=0x7f61f41530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f259c700 1 --2- 172.21.15.62:0/375001342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f40ac8c0 0x7f61f41530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f259c700 1 -- 172.21.15.62:0/375001342 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec009470 con 0x7f61f40ac180 2021-12-17T18:21:55.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61e9d9b700 1 --2- 172.21.15.62:0/375001342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f40ac8c0 0x7f61f41530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:21:55.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f259c700 1 --2- 172.21.15.62:0/375001342 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f61f40ac180 0x7f61f40a3540 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f61e400c000 tx=0x7f61e4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:55.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61ebfff700 1 -- 172.21.15.62:0/375001342 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61e4011750 con 0x7f61f40ac180 2021-12-17T18:21:55.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61ebfff700 1 -- 172.21.15.62:0/375001342 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e40118b0 con 0x7f61f40ac180 2021-12-17T18:21:55.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f359e700 1 -- 172.21.15.62:0/375001342 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f4066290 con 0x7f61f40ac180 2021-12-17T18:21:55.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61ebfff700 1 -- 172.21.15.62:0/375001342 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61e4011c10 con 0x7f61f40ac180 2021-12-17T18:21:55.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.559+0000 7f61f359e700 1 -- 172.21.15.62:0/375001342 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f4065740 con 0x7f61f40ac180 2021-12-17T18:21:55.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.563+0000 7f61f359e700 1 -- 172.21.15.62:0/375001342 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f4140080 con 0x7f61f40ac180 2021-12-17T18:21:55.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.563+0000 7f61ebfff700 1 -- 172.21.15.62:0/375001342 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f61e4011d70 con 0x7f61f40ac180 2021-12-17T18:21:55.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.563+0000 7f61ebfff700 1 --2- 172.21.15.62:0/375001342 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f61d80535b0 0x7f61d8055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.563+0000 7f61ebfff700 1 -- 172.21.15.62:0/375001342 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f61e406bc80 con 0x7f61f40ac180 2021-12-17T18:21:55.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.563+0000 7f61e9d9b700 1 --2- 172.21.15.62:0/375001342 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f61d80535b0 0x7f61d8055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.563+0000 7f61e9d9b700 1 --2- 172.21.15.62:0/375001342 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f61d80535b0 0x7f61d8055a70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f61dc00d000 tx=0x7f61dc007a00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:55.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.571+0000 7f61ebfff700 1 -- 172.21.15.62:0/375001342 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f61e4042ce0 con 0x7f61f40ac180 2021-12-17T18:21:55.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.699+0000 7f61f359e700 1 -- 172.21.15.62:0/375001342 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f61f4066480 con 0x7f61f40ac180 2021-12-17T18:21:55.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.699+0000 7f61ebfff700 1 -- 172.21.15.62:0/375001342 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v51) v1 ==== 92+0+10 (secure 0 0 0) 0x7f61e4046300 con 0x7f61f40ac180 2021-12-17T18:21:55.703 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:21:55.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.703+0000 7f61f359e700 1 -- 172.21.15.62:0/375001342 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f61d80535b0 msgr2=0x7f61d8055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.703+0000 7f61f359e700 1 --2- 172.21.15.62:0/375001342 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f61d80535b0 0x7f61d8055a70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f61dc00d000 tx=0x7f61dc007a00).stop 2021-12-17T18:21:55.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.703+0000 7f61f359e700 1 -- 172.21.15.62:0/375001342 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f61f40ac180 msgr2=0x7f61f40a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.703+0000 7f61f359e700 1 --2- 172.21.15.62:0/375001342 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f61f40ac180 0x7f61f40a3540 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f61e400c000 tx=0x7f61e4006df0).stop 2021-12-17T18:21:55.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.703+0000 7f61f359e700 1 -- 172.21.15.62:0/375001342 shutdown_connections 2021-12-17T18:21:55.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.703+0000 7f61f359e700 1 --2- 172.21.15.62:0/375001342 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f61d80535b0 0x7f61d8055a70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.703+0000 7f61f359e700 1 --2- 172.21.15.62:0/375001342 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f61f40b1e70 0x7f61f4063750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.703+0000 7f61f359e700 1 --2- 172.21.15.62:0/375001342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f40ac8c0 0x7f61f41530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.703+0000 7f61f359e700 1 --2- 172.21.15.62:0/375001342 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f61f40ac180 0x7f61f40a3540 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.703+0000 7f61f359e700 1 -- 172.21.15.62:0/375001342 >> 172.21.15.62:0/375001342 conn(0x7f61f405be70 msgr2=0x7f61f413f460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:55.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.703+0000 7f61f359e700 1 -- 172.21.15.62:0/375001342 shutdown_connections 2021-12-17T18:21:55.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.703+0000 7f61f359e700 1 -- 172.21.15.62:0/375001342 wait complete. 2021-12-17T18:21:55.722 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:21:55.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.831+0000 7f733b105700 1 Processor -- start 2021-12-17T18:21:55.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.831+0000 7f733b105700 1 -- start start 2021-12-17T18:21:55.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.831+0000 7f733b105700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7334064110 0x7f7334143200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.831+0000 7f733b105700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7334067840 con 0x7f73340ad630 2021-12-17T18:21:55.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.831+0000 7f733b105700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f733413fca0 con 0x7f73340b6700 2021-12-17T18:21:55.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.831+0000 7f733b105700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7334066840 con 0x7f7334064110 2021-12-17T18:21:55.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f733a904700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f73340ad630 0x7f733413f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34444/0 (socket says 172.21.15.62:34444) 2021-12-17T18:21:55.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f733a904700 1 -- 172.21.15.62:0/1870841709 learned_addr learned my addr 172.21.15.62:0/1870841709 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:55.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f7339902700 1 --2- 172.21.15.62:0/1870841709 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7334064110 0x7f7334143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f7339101700 1 -- 172.21.15.62:0/1870841709 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923245009 0 0) 0x7f7334067840 con 0x7f73340ad630 2021-12-17T18:21:55.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f7339101700 1 -- 172.21.15.62:0/1870841709 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f731c004370 con 0x7f73340ad630 2021-12-17T18:21:55.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f7339101700 1 -- 172.21.15.62:0/1870841709 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835537878 0 0) 0x7f733413fca0 con 0x7f73340b6700 2021-12-17T18:21:55.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f7339101700 1 -- 172.21.15.62:0/1870841709 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7334067840 con 0x7f73340b6700 2021-12-17T18:21:55.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f7339902700 1 -- 172.21.15.62:0/1870841709 >> v1:172.21.15.109:6789/0 conn(0x7f73340b6700 legacy=0x7f733405f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f7339902700 1 -- 172.21.15.62:0/1870841709 >> v1:172.21.15.62:6789/0 conn(0x7f73340ad630 legacy=0x7f733413f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f7339902700 1 -- 172.21.15.62:0/1870841709 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73340adac0 con 0x7f7334064110 2021-12-17T18:21:55.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f7339902700 1 --2- 172.21.15.62:0/1870841709 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7334064110 0x7f7334143200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f7324002f70 tx=0x7f7324006df0).ready entity=mon.2 client_cookie=d361703c769cd04d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:55.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f7339101700 1 -- 172.21.15.62:0/1870841709 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f732400d5c0 con 0x7f7334064110 2021-12-17T18:21:55.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f7339101700 1 -- 172.21.15.62:0/1870841709 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7324000e90 con 0x7f7334064110 2021-12-17T18:21:55.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f7339101700 1 -- 172.21.15.62:0/1870841709 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f732400d910 con 0x7f7334064110 2021-12-17T18:21:55.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f733b105700 1 -- 172.21.15.62:0/1870841709 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7334064110 msgr2=0x7f7334143200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f733b105700 1 --2- 172.21.15.62:0/1870841709 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7334064110 0x7f7334143200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f7324002f70 tx=0x7f7324006df0).stop 2021-12-17T18:21:55.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f733b105700 1 -- 172.21.15.62:0/1870841709 shutdown_connections 2021-12-17T18:21:55.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f733b105700 1 --2- 172.21.15.62:0/1870841709 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7334064110 0x7f7334143200 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f733b105700 1 -- 172.21.15.62:0/1870841709 >> 172.21.15.62:0/1870841709 conn(0x7f733405c750 msgr2=0x7f73340b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:55.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f733b105700 1 -- 172.21.15.62:0/1870841709 shutdown_connections 2021-12-17T18:21:55.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.835+0000 7f733b105700 1 -- 172.21.15.62:0/1870841709 wait complete. 2021-12-17T18:21:55.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733b105700 1 Processor -- start 2021-12-17T18:21:55.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733b105700 1 -- start start 2021-12-17T18:21:55.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733b105700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7334064110 0x7f733413ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733b105700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f73340ad630 0x7f73340b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733b105700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f73340b6700 0x7f73340afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733b105700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733412e5d0 con 0x7f7334064110 2021-12-17T18:21:55.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733b105700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73340b04d0 con 0x7f73340ad630 2021-12-17T18:21:55.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733b105700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73340b0770 con 0x7f73340b6700 2021-12-17T18:21:55.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733a103700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7334064110 0x7f733413ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733a103700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7334064110 0x7f733413ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50866/0 (socket says 172.21.15.62:50866) 2021-12-17T18:21:55.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733a103700 1 -- 172.21.15.62:0/2035562906 learned_addr learned my addr 172.21.15.62:0/2035562906 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:55.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733a904700 1 --2- 172.21.15.62:0/2035562906 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f73340b6700 0x7f73340afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f7339902700 1 --2- 172.21.15.62:0/2035562906 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f73340ad630 0x7f73340b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733a103700 1 -- 172.21.15.62:0/2035562906 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f73340b6700 msgr2=0x7f73340afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733a103700 1 --2- 172.21.15.62:0/2035562906 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f73340b6700 0x7f73340afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733a103700 1 -- 172.21.15.62:0/2035562906 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f73340ad630 msgr2=0x7f73340b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733a103700 1 --2- 172.21.15.62:0/2035562906 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f73340ad630 0x7f73340b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733a103700 1 -- 172.21.15.62:0/2035562906 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732400b180 con 0x7f7334064110 2021-12-17T18:21:55.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f7339902700 1 --2- 172.21.15.62:0/2035562906 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f73340ad630 0x7f73340b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:21:55.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733a103700 1 --2- 172.21.15.62:0/2035562906 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7334064110 0x7f733413ff20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f7330001110 tx=0x7f7330007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:55.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f73237fe700 1 -- 172.21.15.62:0/2035562906 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7330011470 con 0x7f7334064110 2021-12-17T18:21:55.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f73237fe700 1 -- 172.21.15.62:0/2035562906 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73300115d0 con 0x7f7334064110 2021-12-17T18:21:55.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733b105700 1 -- 172.21.15.62:0/2035562906 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73341513b0 con 0x7f7334064110 2021-12-17T18:21:55.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f73237fe700 1 -- 172.21.15.62:0/2035562906 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7330011930 con 0x7f7334064110 2021-12-17T18:21:55.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.839+0000 7f733b105700 1 -- 172.21.15.62:0/2035562906 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7334151850 con 0x7f7334064110 2021-12-17T18:21:55.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.843+0000 7f733b105700 1 -- 172.21.15.62:0/2035562906 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73340573d0 con 0x7f7334064110 2021-12-17T18:21:55.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.843+0000 7f73237fe700 1 -- 172.21.15.62:0/2035562906 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7330021070 con 0x7f7334064110 2021-12-17T18:21:55.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.843+0000 7f73237fe700 1 --2- 172.21.15.62:0/2035562906 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7314053640 0x7f7314055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:55.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.843+0000 7f73237fe700 1 -- 172.21.15.62:0/2035562906 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f733006d770 con 0x7f7334064110 2021-12-17T18:21:55.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.843+0000 7f7339902700 1 --2- 172.21.15.62:0/2035562906 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7314053640 0x7f7314055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:55.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.843+0000 7f7339902700 1 --2- 172.21.15.62:0/2035562906 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7314053640 0x7f7314055b00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f7324018000 tx=0x7f7324014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:55.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.851+0000 7f73237fe700 1 -- 172.21.15.62:0/2035562906 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f73300447c0 con 0x7f7334064110 2021-12-17T18:21:55.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.971+0000 7f733b105700 1 -- 172.21.15.62:0/2035562906 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f73340645f0 con 0x7f7334064110 2021-12-17T18:21:55.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.975+0000 7f73237fe700 1 -- 172.21.15.62:0/2035562906 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7330015020 con 0x7f7334064110 2021-12-17T18:21:55.977 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:21:55.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.975+0000 7f733b105700 1 -- 172.21.15.62:0/2035562906 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7314053640 msgr2=0x7f7314055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.975+0000 7f733b105700 1 --2- 172.21.15.62:0/2035562906 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7314053640 0x7f7314055b00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f7324018000 tx=0x7f7324014000).stop 2021-12-17T18:21:55.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.975+0000 7f733b105700 1 -- 172.21.15.62:0/2035562906 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7334064110 msgr2=0x7f733413ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:55.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.975+0000 7f733b105700 1 --2- 172.21.15.62:0/2035562906 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7334064110 0x7f733413ff20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f7330001110 tx=0x7f7330007ae0).stop 2021-12-17T18:21:55.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.975+0000 7f733b105700 1 -- 172.21.15.62:0/2035562906 shutdown_connections 2021-12-17T18:21:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.975+0000 7f733b105700 1 --2- 172.21.15.62:0/2035562906 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7314053640 0x7f7314055b00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.975+0000 7f733b105700 1 --2- 172.21.15.62:0/2035562906 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f73340b6700 0x7f73340afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.975+0000 7f733b105700 1 --2- 172.21.15.62:0/2035562906 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f73340ad630 0x7f73340b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.975+0000 7f733b105700 1 --2- 172.21.15.62:0/2035562906 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7334064110 0x7f733413ff20 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.975+0000 7f733b105700 1 -- 172.21.15.62:0/2035562906 >> 172.21.15.62:0/2035562906 conn(0x7f733405c750 msgr2=0x7f7334064f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:55.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.975+0000 7f733b105700 1 -- 172.21.15.62:0/2035562906 shutdown_connections 2021-12-17T18:21:55.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:55.975+0000 7f733b105700 1 -- 172.21.15.62:0/2035562906 wait complete. 2021-12-17T18:21:55.989 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:21:56.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.095+0000 7f201f59e700 1 Processor -- start 2021-12-17T18:21:56.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.095+0000 7f201f59e700 1 -- start start 2021-12-17T18:21:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f202005ca90 0x7f202014b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201f59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f20200ac040 0x7f20201475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201f59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2020147ab0 0x7f20200b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201f59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2020060750 con 0x7f2020147ab0 2021-12-17T18:21:56.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201f59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202014ac00 con 0x7f20200ac040 2021-12-17T18:21:56.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202014aea0 con 0x7f202005ca90 2021-12-17T18:21:56.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201ed9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2020147ab0 0x7f20200b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:56.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201ed9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2020147ab0 0x7f20200b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50876/0 (socket says 172.21.15.62:50876) 2021-12-17T18:21:56.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201ed9d700 1 -- 172.21.15.62:0/3291018916 learned_addr learned my addr 172.21.15.62:0/3291018916 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:56.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201e59c700 1 --2- 172.21.15.62:0/3291018916 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f202005ca90 0x7f202014b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:56.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201dd9b700 1 --2- 172.21.15.62:0/3291018916 >> v2:172.21.15.109:3300/0 conn(0x7f20200ac040 0x7f20201475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:56.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201ed9d700 1 -- 172.21.15.62:0/3291018916 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f202005ca90 msgr2=0x7f202014b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:56.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201ed9d700 1 --2- 172.21.15.62:0/3291018916 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f202005ca90 0x7f202014b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201ed9d700 1 -- 172.21.15.62:0/3291018916 >> v2:172.21.15.109:3300/0 conn(0x7f20200ac040 msgr2=0x7f20201475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:56.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201ed9d700 1 --2- 172.21.15.62:0/3291018916 >> v2:172.21.15.109:3300/0 conn(0x7f20200ac040 0x7f20201475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201ed9d700 1 -- 172.21.15.62:0/3291018916 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202005ce70 con 0x7f2020147ab0 2021-12-17T18:21:56.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201dd9b700 1 --2- 172.21.15.62:0/3291018916 >> v2:172.21.15.109:3300/0 conn(0x7f20200ac040 0x7f20201475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:21:56.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201ed9d700 1 --2- 172.21.15.62:0/3291018916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2020147ab0 0x7f20200b1ca0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f2018002f70 tx=0x7f2018006eb0).ready entity=mon.0 client_cookie=aab17d712a81d1f1 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:56.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201d59a700 1 -- 172.21.15.62:0/3291018916 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f201800d570 con 0x7f2020147ab0 2021-12-17T18:21:56.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201d59a700 1 -- 172.21.15.62:0/3291018916 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2018000e90 con 0x7f2020147ab0 2021-12-17T18:21:56.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201d59a700 1 -- 172.21.15.62:0/3291018916 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f201800d900 con 0x7f2020147ab0 2021-12-17T18:21:56.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201f59e700 1 -- 172.21.15.62:0/3291018916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2020147ab0 msgr2=0x7f20200b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:56.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201f59e700 1 --2- 172.21.15.62:0/3291018916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2020147ab0 0x7f20200b1ca0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f2018002f70 tx=0x7f2018006eb0).stop 2021-12-17T18:21:56.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201f59e700 1 -- 172.21.15.62:0/3291018916 shutdown_connections 2021-12-17T18:21:56.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201f59e700 1 --2- 172.21.15.62:0/3291018916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2020147ab0 0x7f20200b1ca0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201f59e700 1 --2- 172.21.15.62:0/3291018916 >> v2:172.21.15.109:3300/0 conn(0x7f20200ac040 0x7f20201475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201f59e700 1 --2- 172.21.15.62:0/3291018916 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f202005ca90 0x7f202014b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201f59e700 1 -- 172.21.15.62:0/3291018916 >> 172.21.15.62:0/3291018916 conn(0x7f202005be70 msgr2=0x7f2020062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201f59e700 1 -- 172.21.15.62:0/3291018916 shutdown_connections 2021-12-17T18:21:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201f59e700 1 -- 172.21.15.62:0/3291018916 wait complete. 2021-12-17T18:21:56.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201f59e700 1 Processor -- start 2021-12-17T18:21:56.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.099+0000 7f201f59e700 1 -- start start 2021-12-17T18:21:56.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201f59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f202005ca90 0x7f2020149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:56.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f20200ac040 0x7f2020159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:56.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2020147ab0 0x7f2020064d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:56.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2020064920 con 0x7f2020147ab0 2021-12-17T18:21:56.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201f59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20200a1c00 con 0x7f202005ca90 2021-12-17T18:21:56.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20200a1680 con 0x7f20200ac040 2021-12-17T18:21:56.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2020147ab0 0x7f2020064d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:56.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2020147ab0 0x7f2020064d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50884/0 (socket says 172.21.15.62:50884) 2021-12-17T18:21:56.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201e59c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f202005ca90 0x7f2020149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:56.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201ed9d700 1 -- 172.21.15.62:0/2377936617 learned_addr learned my addr 172.21.15.62:0/2377936617 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:56.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201dd9b700 1 --2- 172.21.15.62:0/2377936617 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f20200ac040 0x7f2020159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:56.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201ed9d700 1 -- 172.21.15.62:0/2377936617 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f20200ac040 msgr2=0x7f2020159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:56.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201ed9d700 1 --2- 172.21.15.62:0/2377936617 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f20200ac040 0x7f2020159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201ed9d700 1 -- 172.21.15.62:0/2377936617 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f202005ca90 msgr2=0x7f2020149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:56.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201ed9d700 1 --2- 172.21.15.62:0/2377936617 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f202005ca90 0x7f2020149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201ed9d700 1 -- 172.21.15.62:0/2377936617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201800b1e0 con 0x7f2020147ab0 2021-12-17T18:21:56.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201dd9b700 1 --2- 172.21.15.62:0/2377936617 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f20200ac040 0x7f2020159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:21:56.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201ed9d700 1 --2- 172.21.15.62:0/2377936617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2020147ab0 0x7f2020064d50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f2018002f70 tx=0x7f2018015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:56.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f20177fe700 1 -- 172.21.15.62:0/2377936617 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20180116e0 con 0x7f2020147ab0 2021-12-17T18:21:56.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f20177fe700 1 -- 172.21.15.62:0/2377936617 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2018011840 con 0x7f2020147ab0 2021-12-17T18:21:56.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201f59e700 1 -- 172.21.15.62:0/2377936617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20200a0c10 con 0x7f2020147ab0 2021-12-17T18:21:56.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f20177fe700 1 -- 172.21.15.62:0/2377936617 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2018011ba0 con 0x7f2020147ab0 2021-12-17T18:21:56.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201f59e700 1 -- 172.21.15.62:0/2377936617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20200a0300 con 0x7f2020147ab0 2021-12-17T18:21:56.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f201f59e700 1 -- 172.21.15.62:0/2377936617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2020064a90 con 0x7f2020147ab0 2021-12-17T18:21:56.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f20177fe700 1 -- 172.21.15.62:0/2377936617 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f201801a040 con 0x7f2020147ab0 2021-12-17T18:21:56.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.103+0000 7f20177fe700 1 --2- 172.21.15.62:0/2377936617 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f20040534f0 0x7f20040559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:56.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.107+0000 7f20177fe700 1 -- 172.21.15.62:0/2377936617 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f201806c820 con 0x7f2020147ab0 2021-12-17T18:21:56.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.107+0000 7f201e59c700 1 --2- 172.21.15.62:0/2377936617 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f20040534f0 0x7f20040559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:56.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.107+0000 7f201e59c700 1 --2- 172.21.15.62:0/2377936617 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f20040534f0 0x7f20040559b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f200800c000 tx=0x7f2008008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:56.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.111+0000 7f20177fe700 1 -- 172.21.15.62:0/2377936617 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2020064a90 con 0x7f2020147ab0 2021-12-17T18:21:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.243+0000 7f201f59e700 1 -- 172.21.15.62:0/2377936617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2020064a60 con 0x7f2020147ab0 2021-12-17T18:21:56.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.243+0000 7f20177fe700 1 -- 172.21.15.62:0/2377936617 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2018043920 con 0x7f2020147ab0 2021-12-17T18:21:56.245 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:21:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.243+0000 7f201f59e700 1 -- 172.21.15.62:0/2377936617 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f20040534f0 msgr2=0x7f20040559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.243+0000 7f201f59e700 1 --2- 172.21.15.62:0/2377936617 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f20040534f0 0x7f20040559b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f200800c000 tx=0x7f2008008040).stop 2021-12-17T18:21:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.243+0000 7f201f59e700 1 -- 172.21.15.62:0/2377936617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2020147ab0 msgr2=0x7f2020064d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.243+0000 7f201f59e700 1 --2- 172.21.15.62:0/2377936617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2020147ab0 0x7f2020064d50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f2018002f70 tx=0x7f2018015000).stop 2021-12-17T18:21:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.243+0000 7f201f59e700 1 -- 172.21.15.62:0/2377936617 shutdown_connections 2021-12-17T18:21:56.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.243+0000 7f201f59e700 1 --2- 172.21.15.62:0/2377936617 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f20040534f0 0x7f20040559b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.243+0000 7f201f59e700 1 --2- 172.21.15.62:0/2377936617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2020147ab0 0x7f2020064d50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.243+0000 7f201f59e700 1 --2- 172.21.15.62:0/2377936617 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f20200ac040 0x7f2020159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.243+0000 7f201f59e700 1 --2- 172.21.15.62:0/2377936617 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f202005ca90 0x7f2020149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.243+0000 7f201f59e700 1 -- 172.21.15.62:0/2377936617 >> 172.21.15.62:0/2377936617 conn(0x7f202005be70 msgr2=0x7f2020146480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:56.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.243+0000 7f201f59e700 1 -- 172.21.15.62:0/2377936617 shutdown_connections 2021-12-17T18:21:56.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.243+0000 7f201f59e700 1 -- 172.21.15.62:0/2377936617 wait complete. 2021-12-17T18:21:56.258 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:21:56.259 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:21:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.359+0000 7fc8f2c56700 1 Processor -- start 2021-12-17T18:21:56.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.359+0000 7fc8f2c56700 1 -- start start 2021-12-17T18:21:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.359+0000 7fc8f2c56700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc8ec0b6060 0x7fc8ec13fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:56.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.359+0000 7fc8f2c56700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8ec0afcf0 0x7fc8ec05bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.359+0000 7fc8f2c56700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ec0b1540 con 0x7fc8ec0b5c80 2021-12-17T18:21:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.359+0000 7fc8f2c56700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8ec0b0160 con 0x7fc8ec0b6060 2021-12-17T18:21:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.359+0000 7fc8f2c56700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0af5b0 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.359+0000 7fc8f1c54700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc8ec0b5c80 0x7fc8ec142b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34468/0 (socket says 172.21.15.62:34468) 2021-12-17T18:21:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.359+0000 7fc8f1c54700 1 -- 172.21.15.62:0/1395406107 learned_addr learned my addr 172.21.15.62:0/1395406107 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:21:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.359+0000 7fc8f1453700 1 --2- 172.21.15.62:0/1395406107 >> v2:172.21.15.109:3300/0 conn(0x7fc8ec0b6060 0x7fc8ec13fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.359+0000 7fc8f2455700 1 --2- 172.21.15.62:0/1395406107 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8ec0afcf0 0x7fc8ec05bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f0c52700 1 -- 172.21.15.62:0/1395406107 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570166672 0 0) 0x7fc8ec0b1540 con 0x7fc8ec0b5c80 2021-12-17T18:21:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f0c52700 1 -- 172.21.15.62:0/1395406107 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8d0003260 con 0x7fc8ec0b5c80 2021-12-17T18:21:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f2455700 1 -- 172.21.15.62:0/1395406107 >> v2:172.21.15.109:3300/0 conn(0x7fc8ec0b6060 msgr2=0x7fc8ec13fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:21:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f2455700 1 --2- 172.21.15.62:0/1395406107 >> v2:172.21.15.109:3300/0 conn(0x7fc8ec0b6060 0x7fc8ec13fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f2455700 1 -- 172.21.15.62:0/1395406107 >> v1:172.21.15.62:6789/0 conn(0x7fc8ec0b5c80 legacy=0x7fc8ec142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:56.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f0c52700 1 -- 172.21.15.62:0/1395406107 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2011684760 0 0) 0x7fc8d0003260 con 0x7fc8ec0b5c80 2021-12-17T18:21:56.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f2455700 1 -- 172.21.15.62:0/1395406107 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec0af850 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f2455700 1 --2- 172.21.15.62:0/1395406107 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8ec0afcf0 0x7fc8ec05bcd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fc8dc001800 tx=0x7fc8e40091d0).ready entity=mon.2 client_cookie=73791d51db052e65 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:56.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f0c52700 1 -- 172.21.15.62:0/1395406107 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8dc001660 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f0c52700 1 -- 172.21.15.62:0/1395406107 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e400f510 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f0c52700 1 -- 172.21.15.62:0/1395406107 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8e400f680 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f2c56700 1 -- 172.21.15.62:0/1395406107 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8ec0afcf0 msgr2=0x7fc8ec05bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:56.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f2c56700 1 --2- 172.21.15.62:0/1395406107 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8ec0afcf0 0x7fc8ec05bcd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fc8dc001800 tx=0x7fc8e40091d0).stop 2021-12-17T18:21:56.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f2c56700 1 -- 172.21.15.62:0/1395406107 shutdown_connections 2021-12-17T18:21:56.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f2c56700 1 --2- 172.21.15.62:0/1395406107 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8ec0afcf0 0x7fc8ec05bcd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f2c56700 1 --2- 172.21.15.62:0/1395406107 >> v2:172.21.15.109:3300/0 conn(0x7fc8ec0b6060 0x7fc8ec13fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f2c56700 1 -- 172.21.15.62:0/1395406107 >> 172.21.15.62:0/1395406107 conn(0x7fc8ec05c750 msgr2=0x7fc8ec05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:56.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f2c56700 1 -- 172.21.15.62:0/1395406107 shutdown_connections 2021-12-17T18:21:56.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f2c56700 1 -- 172.21.15.62:0/1395406107 wait complete. 2021-12-17T18:21:56.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f2c56700 1 Processor -- start 2021-12-17T18:21:56.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.363+0000 7fc8f2c56700 1 -- start start 2021-12-17T18:21:56.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f2c56700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8ec0afcf0 0x7fc8ec064a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:56.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f2c56700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8ec0b5c80 0x7fc8ec131d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:56.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f2c56700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8ec0b6060 0x7fc8ec132240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:56.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f2c56700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec066db0 con 0x7fc8ec0b6060 2021-12-17T18:21:56.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f2c56700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec1427d0 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f2c56700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec066220 con 0x7fc8ec0b5c80 2021-12-17T18:21:56.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f2455700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8ec0b6060 0x7fc8ec132240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:56.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f1c54700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8ec0afcf0 0x7fc8ec064a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:56.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f1453700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8ec0b5c80 0x7fc8ec131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:56.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f2455700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8ec0b6060 0x7fc8ec132240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50898/0 (socket says 172.21.15.62:50898) 2021-12-17T18:21:56.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f2455700 1 -- 172.21.15.62:0/1205686165 learned_addr learned my addr 172.21.15.62:0/1205686165 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:21:56.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f1c54700 1 -- 172.21.15.62:0/1205686165 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8ec0b5c80 msgr2=0x7fc8ec131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:56.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f1c54700 1 --2- 172.21.15.62:0/1205686165 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8ec0b5c80 0x7fc8ec131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f1c54700 1 -- 172.21.15.62:0/1205686165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8ec0b6060 msgr2=0x7fc8ec132240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:56.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f1c54700 1 --2- 172.21.15.62:0/1205686165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8ec0b6060 0x7fc8ec132240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f1c54700 1 -- 172.21.15.62:0/1205686165 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e4009470 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f1c54700 1 --2- 172.21.15.62:0/1205686165 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8ec0afcf0 0x7fc8ec064a60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fc8dc0018c0 tx=0x7fc8dc001a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:56.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8e2ffd700 1 -- 172.21.15.62:0/1205686165 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8dc00cea0 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8e2ffd700 1 -- 172.21.15.62:0/1205686165 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8dc007170 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f2c56700 1 -- 172.21.15.62:0/1205686165 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ec0664c0 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8e2ffd700 1 -- 172.21.15.62:0/1205686165 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8dc004730 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.367+0000 7fc8f2c56700 1 -- 172.21.15.62:0/1205686165 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ec132730 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.371+0000 7fc8f2c56700 1 -- 172.21.15.62:0/1205686165 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ec0573d0 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.371+0000 7fc8e2ffd700 1 -- 172.21.15.62:0/1205686165 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc8dc004890 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.371+0000 7fc8e2ffd700 1 --2- 172.21.15.62:0/1205686165 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8d40534f0 0x7fc8d40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:21:56.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.371+0000 7fc8e2ffd700 1 -- 172.21.15.62:0/1205686165 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc8dc06b4b0 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.371+0000 7fc8f1453700 1 --2- 172.21.15.62:0/1205686165 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8d40534f0 0x7fc8d40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:21:56.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.371+0000 7fc8f1453700 1 --2- 172.21.15.62:0/1205686165 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8d40534f0 0x7fc8d40559b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fc8e800b000 tx=0x7fc8e8006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:21:56.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.383+0000 7fc8e2ffd700 1 -- 172.21.15.62:0/1205686165 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc8dc042500 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.543+0000 7fc8f2c56700 1 -- 172.21.15.62:0/1205686165 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8ec0668d0 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.547+0000 7fc8e2ffd700 1 -- 172.21.15.62:0/1205686165 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2142 (secure 0 0 0) 0x7fc8dc045b20 con 0x7fc8ec0afcf0 2021-12-17T18:21:56.549 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:21:56.550 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3056253780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3056253780},{"type":"v1","addr":"172.21.15.109:6835","nonce":3056253780}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:21:51.687672+0000","modified":"2021-12-17T18:21:52.715134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/3358597467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3358597467},{"type":"v1","addr":"172.21.15.62:6833","nonce":3358597467}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-12-17T18:21:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.547+0000 7fc8f2c56700 1 -- 172.21.15.62:0/1205686165 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8d40534f0 msgr2=0x7fc8d40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.547+0000 7fc8f2c56700 1 --2- 172.21.15.62:0/1205686165 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8d40534f0 0x7fc8d40559b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fc8e800b000 tx=0x7fc8e8006df0).stop 2021-12-17T18:21:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.551+0000 7fc8f2c56700 1 -- 172.21.15.62:0/1205686165 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8ec0afcf0 msgr2=0x7fc8ec064a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:21:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.551+0000 7fc8f2c56700 1 --2- 172.21.15.62:0/1205686165 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8ec0afcf0 0x7fc8ec064a60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fc8dc0018c0 tx=0x7fc8dc001a80).stop 2021-12-17T18:21:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.551+0000 7fc8f2c56700 1 -- 172.21.15.62:0/1205686165 shutdown_connections 2021-12-17T18:21:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.551+0000 7fc8f2c56700 1 --2- 172.21.15.62:0/1205686165 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8d40534f0 0x7fc8d40559b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.551+0000 7fc8f2c56700 1 --2- 172.21.15.62:0/1205686165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8ec0b6060 0x7fc8ec132240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.551+0000 7fc8f2c56700 1 --2- 172.21.15.62:0/1205686165 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8ec0b5c80 0x7fc8ec131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.551+0000 7fc8f2c56700 1 --2- 172.21.15.62:0/1205686165 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8ec0afcf0 0x7fc8ec064a60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:21:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.551+0000 7fc8f2c56700 1 -- 172.21.15.62:0/1205686165 >> 172.21.15.62:0/1205686165 conn(0x7fc8ec05c750 msgr2=0x7fc8ec05bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:21:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.551+0000 7fc8f2c56700 1 -- 172.21.15.62:0/1205686165 shutdown_connections 2021-12-17T18:21:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:21:56.551+0000 7fc8f2c56700 1 -- 172.21.15.62:0/1205686165 wait complete. 2021-12-17T18:21:56.556 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2021-12-17T18:21:56.768 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:21:51.687672+0000', 'modified': '2021-12-17T18:21:52.715134+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5646}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5646': {'gid': 5646, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/3358597467', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 3358597467}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 3358597467}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:21:56.769 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:21:56.770 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:21:56.887 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":5646,"want_state":"up:active","state":"up:active","rank_uptime":5.188713656,"mdsmap_epoch":21,"osdmap_epoch":51,"osdmap_epoch_barrier":51,"uptime":9.5618846390000005} 2021-12-17T18:21:56.887 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 5646, "mdsmap_epoch": 21, "osdmap_epoch": 51, "osdmap_epoch_barrier": 51, "rank_uptime": 5.188713656, "state": "up:active", "uptime": 9.561884639, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:21:56.888 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:21:56.888 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-12-17T18:21:56.889 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-12-17T18:21:56.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:21:56.890 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:21:56.898 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:21:56.957 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:21:56.958 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:21:56.968 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:21:56.969 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:21:56.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:21:56.970 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:21:56.975 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:21:56.976 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:21:56.978 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:21:56.996 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:21:56.996 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:21:57.006 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:21:57.007 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:21:57.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:21:57.008 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:21:57.052 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2021-12-17T18:21:57.047+0000 7f141a8a5080 -1 init, newargv = 0x55c597c93fc0 newargc=9ceph-fuse[ 2021-12-17T18:21:57.053 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:14221]: starting ceph client 2021-12-17T18:21:57.062 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14221]: starting fuse 2021-12-17T18:21:58.157 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:21:58.175 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:21:58.176 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:21:58.232 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:21:58.233 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:21:58.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:21:58.234 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:21:58.239 INFO:teuthology.orchestra.run.smithi125.stdout:52 2021-12-17T18:21:58.239 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:21:58.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:21:58.240 DEBUG:teuthology.orchestra.run.smithi125:> sudo python3 -c ' 2021-12-17T18:21:58.241 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2021-12-17T18:21:58.241 DEBUG:teuthology.orchestra.run.smithi125:> import re 2021-12-17T18:21:58.242 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:21:58.242 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2021-12-17T18:21:58.243 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:21:58.243 DEBUG:teuthology.orchestra.run.smithi125:> def find_socket(client_name): 2021-12-17T18:21:58.244 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-12-17T18:21:58.244 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2021-12-17T18:21:58.244 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:21:58.245 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2021-12-17T18:21:58.245 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2021-12-17T18:21:58.246 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2021-12-17T18:21:58.246 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2021-12-17T18:21:58.246 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:21:58.247 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2021-12-17T18:21:58.247 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:21:58.248 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:21:58.248 DEBUG:teuthology.orchestra.run.smithi125:> return f 2021-12-17T18:21:58.249 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:21:58.249 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:21:58.250 DEBUG:teuthology.orchestra.run.smithi125:> print(find_socket("client.0")) 2021-12-17T18:21:58.250 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:21:58.289 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.14221.asok 2021-12-17T18:21:58.294 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14221.asok 2021-12-17T18:21:58.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:21:58.295 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14221.asok status 2021-12-17T18:21:58.429 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2021-12-17T18:21:58.430 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2021-12-17T18:21:58.430 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:21:58.430 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:21:58.430 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2021-12-17T18:21:58.431 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2021-12-17T18:21:58.431 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-12-17T18:21:58.431 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "14221", 2021-12-17T18:21:58.432 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2021-12-17T18:21:58.432 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:21:58.432 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2021-12-17T18:21:58.433 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2021-12-17T18:21:58.433 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5743, 2021-12-17T18:21:58.433 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2021-12-17T18:21:58.434 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2021-12-17T18:21:58.434 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2021-12-17T18:21:58.434 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 5743 2021-12-17T18:21:58.434 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:21:58.435 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:21:58.435 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:21:58.435 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:21:58.435 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 4179724457 2021-12-17T18:21:58.436 INFO:teuthology.orchestra.run.smithi125.stdout: } 2021-12-17T18:21:58.436 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:21:58.436 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:21:58.436 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:21:58.437 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:21:58.437 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 4179724457 2021-12-17T18:21:58.437 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:21:58.437 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.5743 172.21.15.125:0/4179724457", 2021-12-17T18:21:58.438 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "172.21.15.125:0/4179724457", 2021-12-17T18:21:58.438 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2021-12-17T18:21:58.438 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 21, 2021-12-17T18:21:58.438 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 51, 2021-12-17T18:21:58.439 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:21:58.439 INFO:teuthology.orchestra.run.smithi125.stdout: "blacklisted": false, 2021-12-17T18:21:58.439 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2021-12-17T18:21:58.439 INFO:teuthology.orchestra.run.smithi125.stdout:} 2021-12-17T18:21:58.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:21:58.441 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:21:58.442 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:21:58.449 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:21:58.450 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:21:58.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:21:58.451 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:21:58.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:21:58.470 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:21:58.471 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:21:58.478 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:21:58.479 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:21:58.479 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-12-17T18:21:58.480 DEBUG:teuthology.orchestra.run.smithi125:> import sys 2021-12-17T18:21:58.480 DEBUG:teuthology.orchestra.run.smithi125:> import time 2021-12-17T18:21:58.481 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:21:58.481 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:21:58.481 DEBUG:teuthology.orchestra.run.smithi125:> n = 1000 2021-12-17T18:21:58.482 DEBUG:teuthology.orchestra.run.smithi125:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-12-17T18:21:58.482 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:21:58.483 DEBUG:teuthology.orchestra.run.smithi125:> if not os.path.exists(os.path.dirname(abs_path)): 2021-12-17T18:21:58.483 DEBUG:teuthology.orchestra.run.smithi125:> os.makedirs(os.path.dirname(abs_path)) 2021-12-17T18:21:58.483 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:21:58.484 DEBUG:teuthology.orchestra.run.smithi125:> for i in range(0, n): 2021-12-17T18:21:58.484 DEBUG:teuthology.orchestra.run.smithi125:> fname = "{0}_{1}".format(abs_path, i) 2021-12-17T18:21:58.485 DEBUG:teuthology.orchestra.run.smithi125:> with open(fname, '"'"'w'"'"') as f: 2021-12-17T18:21:58.485 DEBUG:teuthology.orchestra.run.smithi125:> f.write('"'"'content'"'"') 2021-12-17T18:21:58.485 DEBUG:teuthology.orchestra.run.smithi125:> if True: 2021-12-17T18:21:58.486 DEBUG:teuthology.orchestra.run.smithi125:> f.flush() 2021-12-17T18:21:58.486 DEBUG:teuthology.orchestra.run.smithi125:> os.fsync(f.fileno()) 2021-12-17T18:21:58.487 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:22:03.840 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:22:03.843 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:22:03.846 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:22:03.849 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:22:03.851 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:22:09.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:22:09.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.710+0000 7f1725371700 1 Processor -- start 2021-12-17T18:22:09.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.710+0000 7f1725371700 1 -- start start 2021-12-17T18:22:09.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1725371700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1720141480 0x7f1720147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:09.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1725371700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17200a8e10 0x7f17200b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:09.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1725371700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f17200b6050 0x7f17200a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:09.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1725371700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1720147610 con 0x7f17200b6050 2021-12-17T18:22:09.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1725371700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17201478b0 con 0x7f1720141480 2021-12-17T18:22:09.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1725371700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1720147b50 con 0x7f17200a8e10 2021-12-17T18:22:09.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1724b70700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f17200b6050 0x7f17200a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:09.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1724b70700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f17200b6050 0x7f17200a7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50906/0 (socket says 172.21.15.62:50906) 2021-12-17T18:22:09.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1724b70700 1 -- 172.21.15.62:0/3970874612 learned_addr learned my addr 172.21.15.62:0/3970874612 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:09.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f171ffff700 1 --2- 172.21.15.62:0/3970874612 >> v2:172.21.15.109:3300/0 conn(0x7f1720141480 0x7f1720147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:09.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f171f7fe700 1 --2- 172.21.15.62:0/3970874612 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17200a8e10 0x7f17200b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:09.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1724b70700 1 -- 172.21.15.62:0/3970874612 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17200a8e10 msgr2=0x7f17200b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:09.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1724b70700 1 --2- 172.21.15.62:0/3970874612 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17200a8e10 0x7f17200b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:09.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1724b70700 1 -- 172.21.15.62:0/3970874612 >> v2:172.21.15.109:3300/0 conn(0x7f1720141480 msgr2=0x7f1720147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:09.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1724b70700 1 --2- 172.21.15.62:0/3970874612 >> v2:172.21.15.109:3300/0 conn(0x7f1720141480 0x7f1720147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:09.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1724b70700 1 -- 172.21.15.62:0/3970874612 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17200b1b90 con 0x7f17200b6050 2021-12-17T18:22:09.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1724b70700 1 --2- 172.21.15.62:0/3970874612 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17200b6050 0x7f17200a7900 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f17180032f0 tx=0x7f1718009290).ready entity=mon.0 client_cookie=b1eb1fa43f2b16be server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:09.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f171effd700 1 -- 172.21.15.62:0/3970874612 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171800b680 con 0x7f17200b6050 2021-12-17T18:22:09.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f171effd700 1 -- 172.21.15.62:0/3970874612 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171800b7e0 con 0x7f17200b6050 2021-12-17T18:22:09.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f171effd700 1 -- 172.21.15.62:0/3970874612 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171800b950 con 0x7f17200b6050 2021-12-17T18:22:09.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1725371700 1 -- 172.21.15.62:0/3970874612 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17200b6050 msgr2=0x7f17200a7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:09.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1725371700 1 --2- 172.21.15.62:0/3970874612 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17200b6050 0x7f17200a7900 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f17180032f0 tx=0x7f1718009290).stop 2021-12-17T18:22:09.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1725371700 1 -- 172.21.15.62:0/3970874612 shutdown_connections 2021-12-17T18:22:09.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1725371700 1 --2- 172.21.15.62:0/3970874612 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17200b6050 0x7f17200a7900 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:09.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1725371700 1 --2- 172.21.15.62:0/3970874612 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17200a8e10 0x7f17200b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:09.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1725371700 1 --2- 172.21.15.62:0/3970874612 >> v2:172.21.15.109:3300/0 conn(0x7f1720141480 0x7f1720147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:09.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1725371700 1 -- 172.21.15.62:0/3970874612 >> 172.21.15.62:0/3970874612 conn(0x7f172005d220 msgr2=0x7f17200b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:09.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1725371700 1 -- 172.21.15.62:0/3970874612 shutdown_connections 2021-12-17T18:22:09.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.714+0000 7f1725371700 1 -- 172.21.15.62:0/3970874612 wait complete. 2021-12-17T18:22:09.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.718+0000 7f1725371700 1 Processor -- start 2021-12-17T18:22:09.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.718+0000 7f1725371700 1 -- start start 2021-12-17T18:22:09.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.718+0000 7f1725371700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17200a8e10 0x7f17200a9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:09.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.718+0000 7f1725371700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17200b6050 0x7f1720148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:09.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.718+0000 7f1725371700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1720141480 0x7f17201490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:09.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.718+0000 7f1725371700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17200ae250 con 0x7f17200b6050 2021-12-17T18:22:09.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.718+0000 7f1725371700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17200ae4f0 con 0x7f1720141480 2021-12-17T18:22:09.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.718+0000 7f1725371700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17200ae790 con 0x7f17200a8e10 2021-12-17T18:22:09.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.718+0000 7f171f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17200b6050 0x7f1720148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:09.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.718+0000 7f171f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17200b6050 0x7f1720148bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50910/0 (socket says 172.21.15.62:50910) 2021-12-17T18:22:09.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.718+0000 7f171f7fe700 1 -- 172.21.15.62:0/3322280958 learned_addr learned my addr 172.21.15.62:0/3322280958 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:09.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.718+0000 7f1724b70700 1 --2- 172.21.15.62:0/3322280958 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1720141480 0x7f17201490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:09.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.718+0000 7f171ffff700 1 --2- 172.21.15.62:0/3322280958 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17200a8e10 0x7f17200a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:09.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.722+0000 7f1724b70700 1 -- 172.21.15.62:0/3322280958 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17200a8e10 msgr2=0x7f17200a9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:09.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.722+0000 7f1724b70700 1 --2- 172.21.15.62:0/3322280958 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17200a8e10 0x7f17200a9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:09.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.722+0000 7f1724b70700 1 -- 172.21.15.62:0/3322280958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17200b6050 msgr2=0x7f1720148bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:09.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.722+0000 7f1724b70700 1 --2- 172.21.15.62:0/3322280958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17200b6050 0x7f1720148bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:09.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.722+0000 7f1724b70700 1 -- 172.21.15.62:0/3322280958 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1718009530 con 0x7f1720141480 2021-12-17T18:22:09.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.722+0000 7f171f7fe700 1 --2- 172.21.15.62:0/3322280958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17200b6050 0x7f1720148bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:22:09.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.722+0000 7f1724b70700 1 --2- 172.21.15.62:0/3322280958 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1720141480 0x7f17201490c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f17180032f0 tx=0x7f1718017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:09.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.722+0000 7f171d7fa700 1 -- 172.21.15.62:0/3322280958 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1718020070 con 0x7f1720141480 2021-12-17T18:22:09.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.722+0000 7f171d7fa700 1 -- 172.21.15.62:0/3322280958 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171800bea0 con 0x7f1720141480 2021-12-17T18:22:09.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.722+0000 7f1725371700 1 -- 172.21.15.62:0/3322280958 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17200aada0 con 0x7f1720141480 2021-12-17T18:22:09.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.722+0000 7f171d7fa700 1 -- 172.21.15.62:0/3322280958 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171800b680 con 0x7f1720141480 2021-12-17T18:22:09.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.722+0000 7f1725371700 1 -- 172.21.15.62:0/3322280958 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1720149b70 con 0x7f1720141480 2021-12-17T18:22:09.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.722+0000 7f1725371700 1 -- 172.21.15.62:0/3322280958 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17200ae0b0 con 0x7f1720141480 2021-12-17T18:22:09.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.722+0000 7f171d7fa700 1 -- 172.21.15.62:0/3322280958 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f171800f070 con 0x7f1720141480 2021-12-17T18:22:09.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.722+0000 7f171d7fa700 1 --2- 172.21.15.62:0/3322280958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f17000536a0 0x7f1700055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:09.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.726+0000 7f171d7fa700 1 -- 172.21.15.62:0/3322280958 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f171806cd80 con 0x7f1720141480 2021-12-17T18:22:09.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.726+0000 7f171ffff700 1 --2- 172.21.15.62:0/3322280958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f17000536a0 0x7f1700055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:09.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.726+0000 7f171ffff700 1 --2- 172.21.15.62:0/3322280958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f17000536a0 0x7f1700055b60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f171400b000 tx=0x7f1714006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:09.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.734+0000 7f171d7fa700 1 -- 172.21.15.62:0/3322280958 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f17200ae0b0 con 0x7f1720141480 2021-12-17T18:22:09.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.898+0000 7f1725371700 1 -- 172.21.15.62:0/3322280958 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17200ae0b0 con 0x7f1720141480 2021-12-17T18:22:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.898+0000 7f171d7fa700 1 -- 172.21.15.62:0/3322280958 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f17200ae0b0 con 0x7f1720141480 2021-12-17T18:22:09.901 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:22:09.901 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3056253780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3056253780},{"type":"v1","addr":"172.21.15.109:6835","nonce":3056253780}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:21:51.687672+0000","modified":"2021-12-17T18:21:52.715134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/3358597467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3358597467},{"type":"v1","addr":"172.21.15.62:6833","nonce":3358597467}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-12-17T18:22:09.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.902+0000 7f1725371700 1 -- 172.21.15.62:0/3322280958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f17000536a0 msgr2=0x7f1700055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:09.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.902+0000 7f1725371700 1 --2- 172.21.15.62:0/3322280958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f17000536a0 0x7f1700055b60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f171400b000 tx=0x7f1714006df0).stop 2021-12-17T18:22:09.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.902+0000 7f1725371700 1 -- 172.21.15.62:0/3322280958 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1720141480 msgr2=0x7f17201490c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:09.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.902+0000 7f1725371700 1 --2- 172.21.15.62:0/3322280958 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1720141480 0x7f17201490c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f17180032f0 tx=0x7f1718017000).stop 2021-12-17T18:22:09.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.902+0000 7f1725371700 1 -- 172.21.15.62:0/3322280958 shutdown_connections 2021-12-17T18:22:09.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.902+0000 7f1725371700 1 --2- 172.21.15.62:0/3322280958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f17000536a0 0x7f1700055b60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:09.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.902+0000 7f1725371700 1 --2- 172.21.15.62:0/3322280958 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1720141480 0x7f17201490c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:09.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.902+0000 7f1725371700 1 --2- 172.21.15.62:0/3322280958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17200b6050 0x7f1720148bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:09.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.902+0000 7f1725371700 1 --2- 172.21.15.62:0/3322280958 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17200a8e10 0x7f17200a9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:09.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.902+0000 7f1725371700 1 -- 172.21.15.62:0/3322280958 >> 172.21.15.62:0/3322280958 conn(0x7f172005d220 msgr2=0x7f172013f560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:09.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.902+0000 7f1725371700 1 -- 172.21.15.62:0/3322280958 shutdown_connections 2021-12-17T18:22:09.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:09.902+0000 7f1725371700 1 -- 172.21.15.62:0/3322280958 wait complete. 2021-12-17T18:22:09.909 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2021-12-17T18:22:09.914 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-12-17T18:22:10.022 INFO:teuthology.orchestra.run.smithi062.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-12-17T18:22:10.022 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-12-17T18:22:10.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:22:10.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5dfc9b6700 1 Processor -- start 2021-12-17T18:22:10.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5dfc9b6700 1 -- start start 2021-12-17T18:22:10.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5dfc9b6700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5df813fb60 0x7f5df80afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5dfc9b6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df80b1540 con 0x7f5df80b6060 2021-12-17T18:22:10.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5dfc9b6700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df813ffd0 con 0x7f5df80b5c80 2021-12-17T18:22:10.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5dfc9b6700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df8143990 con 0x7f5df813fb60 2021-12-17T18:22:10.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df659c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5df80b6060 0x7f5df8143280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34496/0 (socket says 172.21.15.62:34496) 2021-12-17T18:22:10.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df659c700 1 -- 172.21.15.62:0/3678018775 learned_addr learned my addr 172.21.15.62:0/3678018775 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:22:10.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df759e700 1 --2- 172.21.15.62:0/3678018775 >> v2:172.21.15.109:3300/0 conn(0x7f5df813fb60 0x7f5df80afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df5d9b700 1 -- 172.21.15.62:0/3678018775 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776845208 0 0) 0x7f5df80b1540 con 0x7f5df80b6060 2021-12-17T18:22:10.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df5d9b700 1 -- 172.21.15.62:0/3678018775 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ddc004370 con 0x7f5df80b6060 2021-12-17T18:22:10.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df5d9b700 1 -- 172.21.15.62:0/3678018775 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3955918942 0 0) 0x7f5ddc004370 con 0x7f5df80b6060 2021-12-17T18:22:10.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df5d9b700 1 -- 172.21.15.62:0/3678018775 >> v2:172.21.15.109:3300/0 conn(0x7f5df813fb60 msgr2=0x7f5df80afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:10.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df5d9b700 1 --2- 172.21.15.62:0/3678018775 >> v2:172.21.15.109:3300/0 conn(0x7f5df813fb60 0x7f5df80afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df5d9b700 1 -- 172.21.15.62:0/3678018775 >> v1:172.21.15.109:6789/0 conn(0x7f5df80b5c80 legacy=0x7f5df8142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df5d9b700 1 -- 172.21.15.62:0/3678018775 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df80af5b0 con 0x7f5df80b6060 2021-12-17T18:22:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df5d9b700 1 -- 172.21.15.62:0/3678018775 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f5dec001660 con 0x7f5df80b6060 2021-12-17T18:22:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df759e700 1 --2- 172.21.15.62:0/3678018775 >> v2:172.21.15.109:3300/0 conn(0x7f5df813fb60 0x7f5df80afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:22:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df5d9b700 1 -- 172.21.15.62:0/3678018775 >> v1:172.21.15.62:6789/0 conn(0x7f5df80b6060 legacy=0x7f5df8143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df5d9b700 1 --2- 172.21.15.62:0/3678018775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc004860 0x7f5ddc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df5d9b700 1 --2- 172.21.15.62:0/3678018775 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ddc005610 0x7f5ddc005a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df5d9b700 1 --2- 172.21.15.62:0/3678018775 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ddc005f80 0x7f5ddc00c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df5d9b700 1 -- 172.21.15.62:0/3678018775 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8143990 con 0x7f5ddc004860 2021-12-17T18:22:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df5d9b700 1 -- 172.21.15.62:0/3678018775 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc00ce30 con 0x7f5ddc005f80 2021-12-17T18:22:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df5d9b700 1 -- 172.21.15.62:0/3678018775 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc003200 con 0x7f5ddc005610 2021-12-17T18:22:10.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.122+0000 7f5df6d9d700 1 --2- 172.21.15.62:0/3678018775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc004860 0x7f5ddc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5df759e700 1 --2- 172.21.15.62:0/3678018775 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ddc005f80 0x7f5ddc00c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5df659c700 1 --2- 172.21.15.62:0/3678018775 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ddc005610 0x7f5ddc005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5df6d9d700 1 -- 172.21.15.62:0/3678018775 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ddc005610 msgr2=0x7f5ddc005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5df6d9d700 1 --2- 172.21.15.62:0/3678018775 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ddc005610 0x7f5ddc005a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5df6d9d700 1 -- 172.21.15.62:0/3678018775 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ddc005f80 msgr2=0x7f5ddc00c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5df6d9d700 1 --2- 172.21.15.62:0/3678018775 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ddc005f80 0x7f5ddc00c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5df759e700 1 -- 172.21.15.62:0/3678018775 reap_dead start 2021-12-17T18:22:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5df6d9d700 1 -- 172.21.15.62:0/3678018775 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc004370 con 0x7f5ddc004860 2021-12-17T18:22:10.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5df659c700 1 --2- 172.21.15.62:0/3678018775 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ddc005610 0x7f5ddc005a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:22:10.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5df6d9d700 1 --2- 172.21.15.62:0/3678018775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc004860 0x7f5ddc004c80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f5df80afbd0 tx=0x7f5de8007a00).ready entity=mon.0 client_cookie=1d4cd49ec903746 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:10.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5df5d9b700 1 -- 172.21.15.62:0/3678018775 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5de8007d10 con 0x7f5ddc004860 2021-12-17T18:22:10.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5df5d9b700 1 -- 172.21.15.62:0/3678018775 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de8007030 con 0x7f5ddc004860 2021-12-17T18:22:10.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5df5d9b700 1 -- 172.21.15.62:0/3678018775 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5de8007390 con 0x7f5ddc004860 2021-12-17T18:22:10.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5dfc9b6700 1 -- 172.21.15.62:0/3678018775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc004860 msgr2=0x7f5ddc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5dfc9b6700 1 --2- 172.21.15.62:0/3678018775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc004860 0x7f5ddc004c80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f5df80afbd0 tx=0x7f5de8007a00).stop 2021-12-17T18:22:10.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5dfc9b6700 1 -- 172.21.15.62:0/3678018775 shutdown_connections 2021-12-17T18:22:10.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5dfc9b6700 1 --2- 172.21.15.62:0/3678018775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc004860 0x7f5ddc004c80 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5dfc9b6700 1 -- 172.21.15.62:0/3678018775 >> 172.21.15.62:0/3678018775 conn(0x7f5df805c750 msgr2=0x7f5df805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:10.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5dfc9b6700 1 -- 172.21.15.62:0/3678018775 shutdown_connections 2021-12-17T18:22:10.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5dfc9b6700 1 -- 172.21.15.62:0/3678018775 wait complete. 2021-12-17T18:22:10.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5dfc9b6700 1 Processor -- start 2021-12-17T18:22:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.126+0000 7f5dfc9b6700 1 -- start start 2021-12-17T18:22:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5dfc9b6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc004860 0x7f5df8066510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5dfc9b6700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5df8067230 0x7f5df80a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5dfc9b6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5df80a5880 0x7f5df80ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5dfc9b6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8066140 con 0x7f5ddc004860 2021-12-17T18:22:10.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5dfc9b6700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df81562d0 con 0x7f5df8067230 2021-12-17T18:22:10.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5dfc9b6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8156560 con 0x7f5df80a5880 2021-12-17T18:22:10.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5df6d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc004860 0x7f5df8066510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5df6d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc004860 0x7f5df8066510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50928/0 (socket says 172.21.15.62:50928) 2021-12-17T18:22:10.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5df6d9d700 1 -- 172.21.15.62:0/2033313850 learned_addr learned my addr 172.21.15.62:0/2033313850 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:10.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5df659c700 1 --2- 172.21.15.62:0/2033313850 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5df8067230 0x7f5df80a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5df759e700 1 --2- 172.21.15.62:0/2033313850 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5df80a5880 0x7f5df80ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5df6d9d700 1 -- 172.21.15.62:0/2033313850 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5df80a5880 msgr2=0x7f5df80ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5df6d9d700 1 --2- 172.21.15.62:0/2033313850 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5df80a5880 0x7f5df80ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5df6d9d700 1 -- 172.21.15.62:0/2033313850 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5df8067230 msgr2=0x7f5df80a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5df6d9d700 1 --2- 172.21.15.62:0/2033313850 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5df8067230 0x7f5df80a5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5df6d9d700 1 -- 172.21.15.62:0/2033313850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df8156800 con 0x7f5ddc004860 2021-12-17T18:22:10.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5df6d9d700 1 --2- 172.21.15.62:0/2033313850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc004860 0x7f5df8066510 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f5df80afbd0 tx=0x7f5de8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:10.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5de7fff700 1 -- 172.21.15.62:0/2033313850 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5de8007d10 con 0x7f5ddc004860 2021-12-17T18:22:10.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5de7fff700 1 -- 172.21.15.62:0/2033313850 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de80127b0 con 0x7f5ddc004860 2021-12-17T18:22:10.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5de7fff700 1 -- 172.21.15.62:0/2033313850 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5de8012b10 con 0x7f5ddc004860 2021-12-17T18:22:10.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5dfc9b6700 1 -- 172.21.15.62:0/2033313850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df80ac7e0 con 0x7f5ddc004860 2021-12-17T18:22:10.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5dfc9b6700 1 -- 172.21.15.62:0/2033313850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df81523b0 con 0x7f5ddc004860 2021-12-17T18:22:10.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.130+0000 7f5dfc9b6700 1 -- 172.21.15.62:0/2033313850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df80af850 con 0x7f5ddc004860 2021-12-17T18:22:10.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.134+0000 7f5de7fff700 1 -- 172.21.15.62:0/2033313850 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5de801d070 con 0x7f5ddc004860 2021-12-17T18:22:10.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.134+0000 7f5de7fff700 1 --2- 172.21.15.62:0/2033313850 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5dd40536a0 0x7f5dd4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.134+0000 7f5de7fff700 1 -- 172.21.15.62:0/2033313850 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5de8001e40 con 0x7f5ddc004860 2021-12-17T18:22:10.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.134+0000 7f5df659c700 1 --2- 172.21.15.62:0/2033313850 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5dd40536a0 0x7f5dd4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.134+0000 7f5df659c700 1 --2- 172.21.15.62:0/2033313850 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5dd40536a0 0x7f5dd4055b60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f5dec00d000 tx=0x7f5dec007040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:10.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.138+0000 7f5de7fff700 1 -- 172.21.15.62:0/2033313850 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5de8043600 con 0x7f5ddc004860 2021-12-17T18:22:10.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.302+0000 7f5dfc9b6700 1 -- 172.21.15.62:0/2033313850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5df813ffd0 con 0x7f5ddc004860 2021-12-17T18:22:10.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.306+0000 7f5de7fff700 1 -- 172.21.15.62:0/2033313850 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f5df813ffd0 con 0x7f5ddc004860 2021-12-17T18:22:10.305 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:22:10.305 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3056253780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3056253780},{"type":"v1","addr":"172.21.15.109:6835","nonce":3056253780}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:21:51.687672+0000","modified":"2021-12-17T18:21:52.715134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/3358597467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3358597467},{"type":"v1","addr":"172.21.15.62:6833","nonce":3358597467}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-12-17T18:22:10.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.306+0000 7f5dfc9b6700 1 -- 172.21.15.62:0/2033313850 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5dd40536a0 msgr2=0x7f5dd4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.306+0000 7f5dfc9b6700 1 --2- 172.21.15.62:0/2033313850 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5dd40536a0 0x7f5dd4055b60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f5dec00d000 tx=0x7f5dec007040).stop 2021-12-17T18:22:10.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.306+0000 7f5dfc9b6700 1 -- 172.21.15.62:0/2033313850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc004860 msgr2=0x7f5df8066510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.306+0000 7f5dfc9b6700 1 --2- 172.21.15.62:0/2033313850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc004860 0x7f5df8066510 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f5df80afbd0 tx=0x7f5de8015000).stop 2021-12-17T18:22:10.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.306+0000 7f5dfc9b6700 1 -- 172.21.15.62:0/2033313850 shutdown_connections 2021-12-17T18:22:10.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.306+0000 7f5dfc9b6700 1 --2- 172.21.15.62:0/2033313850 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5dd40536a0 0x7f5dd4055b60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.306+0000 7f5dfc9b6700 1 --2- 172.21.15.62:0/2033313850 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5df80a5880 0x7f5df80ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.306+0000 7f5dfc9b6700 1 --2- 172.21.15.62:0/2033313850 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5df8067230 0x7f5df80a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.306+0000 7f5dfc9b6700 1 --2- 172.21.15.62:0/2033313850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc004860 0x7f5df8066510 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.306+0000 7f5dfc9b6700 1 -- 172.21.15.62:0/2033313850 >> 172.21.15.62:0/2033313850 conn(0x7f5df805c750 msgr2=0x7f5df8142a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:10.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.306+0000 7f5dfc9b6700 1 -- 172.21.15.62:0/2033313850 shutdown_connections 2021-12-17T18:22:10.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.306+0000 7f5dfc9b6700 1 -- 172.21.15.62:0/2033313850 wait complete. 2021-12-17T18:22:10.310 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2021-12-17T18:22:10.318 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-12-17T18:22:10.426 INFO:teuthology.orchestra.run.smithi062.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-12-17T18:22:10.426 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-12-17T18:22:10.427 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:22:10.445 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:22:10.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffaa2289700 1 Processor -- start 2021-12-17T18:22:10.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffaa2289700 1 -- start start 2021-12-17T18:22:10.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffaa2289700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffa9c05f8d0 0x7ffa9c0b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffaa2289700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa9c0af370 0x7ffa9c0af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffaa2289700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9c0ae4e0 con 0x7ffa9c0b2ed0 2021-12-17T18:22:10.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffaa2289700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9c0ae780 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffaa2289700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0b12e0 con 0x7ffa9c0af370 2021-12-17T18:22:10.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffa9bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffa9c05f8d0 0x7ffa9c0b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffa9bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffa9c05f8d0 0x7ffa9c0b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50936/0 (socket says 172.21.15.62:50936) 2021-12-17T18:22:10.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffa9bfff700 1 -- 172.21.15.62:0/53281262 learned_addr learned my addr 172.21.15.62:0/53281262 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:10.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffaa0826700 1 --2- 172.21.15.62:0/53281262 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa9c0af370 0x7ffa9c0af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffa9bfff700 1 -- 172.21.15.62:0/53281262 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa9c0af370 msgr2=0x7ffa9c0af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:10.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffa9bfff700 1 --2- 172.21.15.62:0/53281262 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa9c0af370 0x7ffa9c0af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffa9bfff700 1 -- 172.21.15.62:0/53281262 >> v1:172.21.15.109:6789/0 conn(0x7ffa9c0b2ed0 legacy=0x7ffa9c0aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffa9bfff700 1 -- 172.21.15.62:0/53281262 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c05fcb0 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffa9bfff700 1 --2- 172.21.15.62:0/53281262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa9c05f8d0 0x7ffa9c0b36b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7ffa940032f0 tx=0x7ffa94009290).ready entity=mon.0 client_cookie=f00925e8110e756a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:10.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffa9affd700 1 -- 172.21.15.62:0/53281262 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa9400b8a0 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffa9affd700 1 -- 172.21.15.62:0/53281262 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9400ba00 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.550+0000 7ffa9affd700 1 -- 172.21.15.62:0/53281262 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa9400bb70 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.554+0000 7ffaa2289700 1 -- 172.21.15.62:0/53281262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa9c05f8d0 msgr2=0x7ffa9c0b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.554+0000 7ffaa2289700 1 --2- 172.21.15.62:0/53281262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa9c05f8d0 0x7ffa9c0b36b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7ffa940032f0 tx=0x7ffa94009290).stop 2021-12-17T18:22:10.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.554+0000 7ffaa2289700 1 -- 172.21.15.62:0/53281262 shutdown_connections 2021-12-17T18:22:10.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.554+0000 7ffaa2289700 1 --2- 172.21.15.62:0/53281262 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa9c0af370 0x7ffa9c0af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.554+0000 7ffaa2289700 1 --2- 172.21.15.62:0/53281262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa9c05f8d0 0x7ffa9c0b36b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.554+0000 7ffaa2289700 1 -- 172.21.15.62:0/53281262 >> 172.21.15.62:0/53281262 conn(0x7ffa9c05bcd0 msgr2=0x7ffa9c0638c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:10.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.554+0000 7ffaa2289700 1 -- 172.21.15.62:0/53281262 shutdown_connections 2021-12-17T18:22:10.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.554+0000 7ffaa2289700 1 -- 172.21.15.62:0/53281262 wait complete. 2021-12-17T18:22:10.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.554+0000 7ffaa2289700 1 Processor -- start 2021-12-17T18:22:10.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.554+0000 7ffaa2289700 1 -- start start 2021-12-17T18:22:10.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffaa2289700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa9c05f8d0 0x7ffa9c0a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffaa2289700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa9c0af370 0x7ffa9c066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffaa2289700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffa9c0b2ed0 0x7ffa9c0a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffaa2289700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0a96d0 con 0x7ffa9c0af370 2021-12-17T18:22:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffaa2289700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c15a130 con 0x7ffa9c0b2ed0 2021-12-17T18:22:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffaa2289700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0a98f0 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffa9b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa9c0af370 0x7ffa9c066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffaa0826700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffa9c0b2ed0 0x7ffa9c0a91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffa9bfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa9c05f8d0 0x7ffa9c0a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffaa0826700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffa9c0b2ed0 0x7ffa9c0a91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:57494/0 (socket says 172.21.15.62:57494) 2021-12-17T18:22:10.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffa9b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa9c0af370 0x7ffa9c066ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50946/0 (socket says 172.21.15.62:50946) 2021-12-17T18:22:10.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffa9bfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa9c05f8d0 0x7ffa9c0a1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:44644/0 (socket says 172.21.15.62:44644) 2021-12-17T18:22:10.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffaa0826700 1 -- 172.21.15.62:0/1351319853 learned_addr learned my addr 172.21.15.62:0/1351319853 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:10.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffa9bfff700 1 -- 172.21.15.62:0/1351319853 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffa9c0b2ed0 msgr2=0x7ffa9c0a91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffa9bfff700 1 --2- 172.21.15.62:0/1351319853 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffa9c0b2ed0 0x7ffa9c0a91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffa9bfff700 1 -- 172.21.15.62:0/1351319853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa9c0af370 msgr2=0x7ffa9c066ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffa9bfff700 1 --2- 172.21.15.62:0/1351319853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa9c0af370 0x7ffa9c066ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffa9bfff700 1 -- 172.21.15.62:0/1351319853 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa94009530 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffa9b7fe700 1 --2- 172.21.15.62:0/1351319853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa9c0af370 0x7ffa9c066ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:22:10.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffa9bfff700 1 --2- 172.21.15.62:0/1351319853 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa9c05f8d0 0x7ffa9c0a1760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7ffa9c0a9810 tx=0x7ffa94016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:10.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffa997fa700 1 -- 172.21.15.62:0/1351319853 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa9400b8a0 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffa997fa700 1 -- 172.21.15.62:0/1351319853 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa94021440 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffaa2289700 1 -- 172.21.15.62:0/1351319853 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9c0a9b90 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffa997fa700 1 -- 172.21.15.62:0/1351319853 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa940217a0 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.558+0000 7ffaa2289700 1 -- 172.21.15.62:0/1351319853 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9c15a780 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.562+0000 7ffaa2289700 1 -- 172.21.15.62:0/1351319853 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa9c0573d0 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.562+0000 7ffa997fa700 1 -- 172.21.15.62:0/1351319853 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffa94027020 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.562+0000 7ffa997fa700 1 --2- 172.21.15.62:0/1351319853 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffa7c0536d0 0x7ffa7c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.562+0000 7ffa997fa700 1 -- 172.21.15.62:0/1351319853 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffa9406cf80 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.562+0000 7ffa9b7fe700 1 --2- 172.21.15.62:0/1351319853 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffa7c0536d0 0x7ffa7c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.562+0000 7ffa9b7fe700 1 --2- 172.21.15.62:0/1351319853 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffa7c0536d0 0x7ffa7c055b90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7ffa9000d000 tx=0x7ffa90009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:10.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.570+0000 7ffa997fa700 1 -- 172.21.15.62:0/1351319853 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffa94043fd0 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.738+0000 7ffaa2289700 1 -- 172.21.15.62:0/1351319853 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa9c068f30 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.738+0000 7ffa997fa700 1 -- 172.21.15.62:0/1351319853 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2142 (secure 0 0 0) 0x7ffa94015070 con 0x7ffa9c05f8d0 2021-12-17T18:22:10.739 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:22:10.739 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3056253780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3056253780},{"type":"v1","addr":"172.21.15.109:6835","nonce":3056253780}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:21:51.687672+0000","modified":"2021-12-17T18:21:52.715134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/3358597467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3358597467},{"type":"v1","addr":"172.21.15.62:6833","nonce":3358597467}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-12-17T18:22:10.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.742+0000 7ffaa2289700 1 -- 172.21.15.62:0/1351319853 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffa7c0536d0 msgr2=0x7ffa7c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.742+0000 7ffaa2289700 1 --2- 172.21.15.62:0/1351319853 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffa7c0536d0 0x7ffa7c055b90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7ffa9000d000 tx=0x7ffa90009040).stop 2021-12-17T18:22:10.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.742+0000 7ffaa2289700 1 -- 172.21.15.62:0/1351319853 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa9c05f8d0 msgr2=0x7ffa9c0a1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.742+0000 7ffaa2289700 1 --2- 172.21.15.62:0/1351319853 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa9c05f8d0 0x7ffa9c0a1760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7ffa9c0a9810 tx=0x7ffa94016000).stop 2021-12-17T18:22:10.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.742+0000 7ffaa2289700 1 -- 172.21.15.62:0/1351319853 shutdown_connections 2021-12-17T18:22:10.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.742+0000 7ffaa2289700 1 --2- 172.21.15.62:0/1351319853 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffa7c0536d0 0x7ffa7c055b90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.742+0000 7ffaa2289700 1 --2- 172.21.15.62:0/1351319853 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffa9c0b2ed0 0x7ffa9c0a91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.742+0000 7ffaa2289700 1 --2- 172.21.15.62:0/1351319853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa9c0af370 0x7ffa9c066ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.742+0000 7ffaa2289700 1 --2- 172.21.15.62:0/1351319853 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa9c05f8d0 0x7ffa9c0a1760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.742+0000 7ffaa2289700 1 -- 172.21.15.62:0/1351319853 >> 172.21.15.62:0/1351319853 conn(0x7ffa9c05bcd0 msgr2=0x7ffa9c0b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:10.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.742+0000 7ffaa2289700 1 -- 172.21.15.62:0/1351319853 shutdown_connections 2021-12-17T18:22:10.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.742+0000 7ffaa2289700 1 -- 172.21.15.62:0/1351319853 wait complete. 2021-12-17T18:22:10.745 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2021-12-17T18:22:10.755 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 5 2021-12-17T18:22:10.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.862+0000 7fa310bdd700 1 Processor -- start 2021-12-17T18:22:10.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa310bdd700 1 -- start start 2021-12-17T18:22:10.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa310bdd700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa30c0b4230 0x7fa30c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa310bdd700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30c05ce70 con 0x7fa30c0b3540 2021-12-17T18:22:10.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa310bdd700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30c0b1bc0 con 0x7fa30c05ca90 2021-12-17T18:22:10.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa310bdd700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30c0b1e60 con 0x7fa30c0b4230 2021-12-17T18:22:10.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30affd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa30c0b3540 0x7fa30c145a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34532/0 (socket says 172.21.15.62:34532) 2021-12-17T18:22:10.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30affd700 1 -- 172.21.15.62:0/3352735383 learned_addr learned my addr 172.21.15.62:0/3352735383 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:22:10.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30bfff700 1 --2- 172.21.15.62:0/3352735383 >> v2:172.21.15.109:3300/0 conn(0x7fa30c0b4230 0x7fa30c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 -- 172.21.15.62:0/3352735383 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152849389 0 0) 0x7fa30c05ce70 con 0x7fa30c0b3540 2021-12-17T18:22:10.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 -- 172.21.15.62:0/3352735383 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f8003260 con 0x7fa30c0b3540 2021-12-17T18:22:10.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 -- 172.21.15.62:0/3352735383 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3397548911 0 0) 0x7fa2f8003260 con 0x7fa30c0b3540 2021-12-17T18:22:10.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 -- 172.21.15.62:0/3352735383 >> v2:172.21.15.109:3300/0 conn(0x7fa30c0b4230 msgr2=0x7fa30c0b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:10.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 --2- 172.21.15.62:0/3352735383 >> v2:172.21.15.109:3300/0 conn(0x7fa30c0b4230 0x7fa30c0b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 -- 172.21.15.62:0/3352735383 >> v1:172.21.15.109:6789/0 conn(0x7fa30c05ca90 legacy=0x7fa30c0b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 -- 172.21.15.62:0/3352735383 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c0b2100 con 0x7fa30c0b3540 2021-12-17T18:22:10.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 -- 172.21.15.62:0/3352735383 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fa3000017e0 con 0x7fa30c0b3540 2021-12-17T18:22:10.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 -- 172.21.15.62:0/3352735383 >> v1:172.21.15.62:6789/0 conn(0x7fa30c0b3540 legacy=0x7fa30c145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 --2- 172.21.15.62:0/3352735383 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa2f8003750 0x7fa2f8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 --2- 172.21.15.62:0/3352735383 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa2f8004500 0x7fa2f8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 --2- 172.21.15.62:0/3352735383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2f8004e70 0x7fa2f800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 -- 172.21.15.62:0/3352735383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0b1e60 con 0x7fa2f8004e70 2021-12-17T18:22:10.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 -- 172.21.15.62:0/3352735383 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f800bd20 con 0x7fa2f8003750 2021-12-17T18:22:10.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 -- 172.21.15.62:0/3352735383 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f800bee0 con 0x7fa2f8004500 2021-12-17T18:22:10.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30bfff700 1 --2- 172.21.15.62:0/3352735383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2f8004e70 0x7fa2f800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30b7fe700 1 --2- 172.21.15.62:0/3352735383 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa2f8003750 0x7fa2f8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30affd700 1 --2- 172.21.15.62:0/3352735383 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa2f8004500 0x7fa2f8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30bfff700 1 -- 172.21.15.62:0/3352735383 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa2f8004500 msgr2=0x7fa2f8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:10.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30bfff700 1 --2- 172.21.15.62:0/3352735383 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa2f8004500 0x7fa2f8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30bfff700 1 -- 172.21.15.62:0/3352735383 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa2f8003750 msgr2=0x7fa2f8003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:10.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30bfff700 1 --2- 172.21.15.62:0/3352735383 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa2f8003750 0x7fa2f8003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30bfff700 1 -- 172.21.15.62:0/3352735383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f8003260 con 0x7fa2f8004e70 2021-12-17T18:22:10.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30bfff700 1 -- 172.21.15.62:0/3352735383 reap_dead start 2021-12-17T18:22:10.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30bfff700 1 --2- 172.21.15.62:0/3352735383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2f8004e70 0x7fa2f800b750 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fa30400c000 tx=0x7fa3040091d0).ready entity=mon.0 client_cookie=76d3af1dabcebace server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:10.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 -- 172.21.15.62:0/3352735383 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa30400e7e0 con 0x7fa2f8004e70 2021-12-17T18:22:10.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 -- 172.21.15.62:0/3352735383 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30400e940 con 0x7fa2f8004e70 2021-12-17T18:22:10.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.866+0000 7fa30a7fc700 1 -- 172.21.15.62:0/3352735383 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa30400eca0 con 0x7fa2f8004e70 2021-12-17T18:22:10.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa310bdd700 1 -- 172.21.15.62:0/3352735383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2f8004e70 msgr2=0x7fa2f800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa310bdd700 1 --2- 172.21.15.62:0/3352735383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2f8004e70 0x7fa2f800b750 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fa30400c000 tx=0x7fa3040091d0).stop 2021-12-17T18:22:10.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa310bdd700 1 -- 172.21.15.62:0/3352735383 shutdown_connections 2021-12-17T18:22:10.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa310bdd700 1 --2- 172.21.15.62:0/3352735383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2f8004e70 0x7fa2f800b750 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa310bdd700 1 -- 172.21.15.62:0/3352735383 >> 172.21.15.62:0/3352735383 conn(0x7fa30c05bcd0 msgr2=0x7fa30c062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:10.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa310bdd700 1 -- 172.21.15.62:0/3352735383 shutdown_connections 2021-12-17T18:22:10.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa310bdd700 1 -- 172.21.15.62:0/3352735383 wait complete. 2021-12-17T18:22:10.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa310bdd700 1 Processor -- start 2021-12-17T18:22:10.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa310bdd700 1 -- start start 2021-12-17T18:22:10.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa310bdd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa2f8004e70 0x7fa30c148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa310bdd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa30c066730 0x7fa30c0a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa310bdd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa30c1558c0 0x7fa30c0a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa310bdd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0a3160 con 0x7fa30c1558c0 2021-12-17T18:22:10.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa310bdd700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0a4d00 con 0x7fa30c066730 2021-12-17T18:22:10.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa310bdd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0a4a60 con 0x7fa2f8004e70 2021-12-17T18:22:10.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa30bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa30c1558c0 0x7fa30c0a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa30bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa30c1558c0 0x7fa30c0a6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50966/0 (socket says 172.21.15.62:50966) 2021-12-17T18:22:10.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa30bfff700 1 -- 172.21.15.62:0/2232496443 learned_addr learned my addr 172.21.15.62:0/2232496443 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:10.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa30affd700 1 --2- 172.21.15.62:0/2232496443 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa30c066730 0x7fa30c0a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa30b7fe700 1 --2- 172.21.15.62:0/2232496443 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa2f8004e70 0x7fa30c148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa30bfff700 1 -- 172.21.15.62:0/2232496443 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa2f8004e70 msgr2=0x7fa30c148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa30bfff700 1 --2- 172.21.15.62:0/2232496443 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa2f8004e70 0x7fa30c148050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa30bfff700 1 -- 172.21.15.62:0/2232496443 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa30c066730 msgr2=0x7fa30c0a6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa30bfff700 1 --2- 172.21.15.62:0/2232496443 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa30c066730 0x7fa30c0a6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.870+0000 7fa30bfff700 1 -- 172.21.15.62:0/2232496443 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c0a2de0 con 0x7fa30c1558c0 2021-12-17T18:22:10.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.874+0000 7fa30bfff700 1 --2- 172.21.15.62:0/2232496443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa30c1558c0 0x7fa30c0a6920 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fa30400c000 tx=0x7fa304019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:10.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.874+0000 7fa308ff9700 1 -- 172.21.15.62:0/2232496443 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa304009600 con 0x7fa30c1558c0 2021-12-17T18:22:10.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.874+0000 7fa308ff9700 1 -- 172.21.15.62:0/2232496443 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30401dd60 con 0x7fa30c1558c0 2021-12-17T18:22:10.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.874+0000 7fa310bdd700 1 -- 172.21.15.62:0/2232496443 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30c0a6e10 con 0x7fa30c1558c0 2021-12-17T18:22:10.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.874+0000 7fa308ff9700 1 -- 172.21.15.62:0/2232496443 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa30401b640 con 0x7fa30c1558c0 2021-12-17T18:22:10.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.874+0000 7fa310bdd700 1 -- 172.21.15.62:0/2232496443 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30c0a3d30 con 0x7fa30c1558c0 2021-12-17T18:22:10.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.874+0000 7fa308ff9700 1 -- 172.21.15.62:0/2232496443 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa304018020 con 0x7fa30c1558c0 2021-12-17T18:22:10.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.874+0000 7fa308ff9700 1 --2- 172.21.15.62:0/2232496443 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa2ec0535b0 0x7fa2ec055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.874+0000 7fa308ff9700 1 -- 172.21.15.62:0/2232496443 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa30406d240 con 0x7fa30c1558c0 2021-12-17T18:22:10.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.874+0000 7fa30b7fe700 1 --2- 172.21.15.62:0/2232496443 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa2ec0535b0 0x7fa2ec055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa30b7fe700 1 --2- 172.21.15.62:0/2232496443 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa2ec0535b0 0x7fa2ec055a70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fa2fc00d000 tx=0x7fa2fc00c040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:10.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa31c082740 1 Processor -- start 2021-12-17T18:22:10.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa31c082740 1 -- start start 2021-12-17T18:22:10.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa31c082740 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x17b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa31c082740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17f34d0 0x17ba1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa31c082740 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17ba690 0x17bbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa31c082740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x172a500 con 0x17f34d0 2021-12-17T18:22:10.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa31c082740 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x170ac70 con 0x17ba690 2021-12-17T18:22:10.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa31c082740 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x17b51a0 con 0x17b4dc0 2021-12-17T18:22:10.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa30affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17f34d0 0x17ba1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa30affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17f34d0 0x17ba1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50972/0 (socket says 172.21.15.62:50972) 2021-12-17T18:22:10.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa30affd700 1 -- 172.21.15.62:0/3354802493 learned_addr learned my addr 172.21.15.62:0/3354802493 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:10.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa30b7fe700 1 --2- 172.21.15.62:0/3354802493 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x17b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa30bfff700 1 --2- 172.21.15.62:0/3354802493 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17ba690 0x17bbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa30affd700 1 -- 172.21.15.62:0/3354802493 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 msgr2=0x17b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:10.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa30affd700 1 --2- 172.21.15.62:0/3354802493 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x17b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa30affd700 1 -- 172.21.15.62:0/3354802493 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17ba690 msgr2=0x17bbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:10.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa30affd700 1 --2- 172.21.15.62:0/3354802493 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17ba690 0x17bbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa30affd700 1 -- 172.21.15.62:0/3354802493 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1761fb0 con 0x17f34d0 2021-12-17T18:22:10.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa30bfff700 1 --2- 172.21.15.62:0/3354802493 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17ba690 0x17bbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:22:10.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa30affd700 1 --2- 172.21.15.62:0/3354802493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17f34d0 0x17ba1a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x1789420 tx=0x7fa30000c040).ready entity=mon.0 client_cookie=e638e880ab70b4ee server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:10.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa310bdd700 1 -- 172.21.15.62:0/3354802493 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3000070d0 con 0x17f34d0 2021-12-17T18:22:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa310bdd700 1 -- 172.21.15.62:0/3354802493 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa300010040 con 0x17f34d0 2021-12-17T18:22:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.878+0000 7fa310bdd700 1 -- 172.21.15.62:0/3354802493 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3000056f0 con 0x17f34d0 2021-12-17T18:22:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 1 -- 172.21.15.62:0/3354802493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17f34d0 msgr2=0x17ba1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 1 --2- 172.21.15.62:0/3354802493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17f34d0 0x17ba1a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x1789420 tx=0x7fa30000c040).stop 2021-12-17T18:22:10.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 1 -- 172.21.15.62:0/3354802493 shutdown_connections 2021-12-17T18:22:10.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 1 --2- 172.21.15.62:0/3354802493 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17ba690 0x17bbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 1 --2- 172.21.15.62:0/3354802493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17f34d0 0x17ba1a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 1 --2- 172.21.15.62:0/3354802493 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x17b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 1 -- 172.21.15.62:0/3354802493 >> 172.21.15.62:0/3354802493 conn(0x17b6a40 msgr2=0x17b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:10.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 1 -- 172.21.15.62:0/3354802493 shutdown_connections 2021-12-17T18:22:10.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 1 -- 172.21.15.62:0/3354802493 wait complete. 2021-12-17T18:22:10.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 1 -- start start 2021-12-17T18:22:10.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 1 Processor -- start 2021-12-17T18:22:10.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x17ee670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17ba690 0x17fefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17f34d0 0x17ff4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x17efcf0 con 0x17ba690 2021-12-17T18:22:10.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x17eff90 con 0x17f34d0 2021-12-17T18:22:10.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x17f0230 con 0x17b4dc0 2021-12-17T18:22:10.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa31c082740 10 client.0 ll_register_callbacks cb 0x1771590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-12-17T18:22:10.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa30affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17ba690 0x17fefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa30affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17ba690 0x17fefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50978/0 (socket says 172.21.15.62:50978) 2021-12-17T18:22:10.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa30affd700 1 -- 172.21.15.62:0/670674518 learned_addr learned my addr 172.21.15.62:0/670674518 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:10.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa30bfff700 1 --2- 172.21.15.62:0/670674518 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17f34d0 0x17ff4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.882+0000 7fa30b7fe700 1 --2- 172.21.15.62:0/670674518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x17ee670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa30affd700 1 -- 172.21.15.62:0/670674518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 msgr2=0x17ee670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:10.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa30affd700 1 --2- 172.21.15.62:0/670674518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x17ee670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa30affd700 1 -- 172.21.15.62:0/670674518 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17f34d0 msgr2=0x17ff4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:10.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa30affd700 1 --2- 172.21.15.62:0/670674518 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17f34d0 0x17ff4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa30affd700 1 -- 172.21.15.62:0/670674518 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30c0b2100 con 0x17ba690 2021-12-17T18:22:10.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa30b7fe700 1 --2- 172.21.15.62:0/670674518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x17ee670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:22:10.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa30affd700 1 --2- 172.21.15.62:0/670674518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17ba690 0x17fefc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x1789420 tx=0x7fa300015000).ready entity=mon.0 client_cookie=ccb9af76327c0d2 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:10.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa2ea7fc700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2021-12-17T18:22:10.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa2ea7fc700 1 -- 172.21.15.62:0/670674518 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa300020450 con 0x17ba690 2021-12-17T18:22:10.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa2ea7fc700 1 -- 172.21.15.62:0/670674518 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa300021de0 con 0x17ba690 2021-12-17T18:22:10.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 1 -- 172.21.15.62:0/670674518 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x17205c0 con 0x17ba690 2021-12-17T18:22:10.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa2ea7fc700 1 -- 172.21.15.62:0/670674518 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa300001b70 con 0x17ba690 2021-12-17T18:22:10.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 10 client.5835 fetch_fsmap learned FSMap version 21 2021-12-17T18:22:10.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 1 -- 172.21.15.62:0/670674518 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x1719ea0 con 0x17ba690 2021-12-17T18:22:10.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa2ea7fc700 1 -- 172.21.15.62:0/670674518 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x17205c0 con 0x17ba690 2021-12-17T18:22:10.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa2ea7fc700 1 -- 172.21.15.62:0/670674518 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 21) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fa300016980 con 0x17ba690 2021-12-17T18:22:10.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 10 client.5835 fetch_fsmap finished waiting for FSMap version 21 2021-12-17T18:22:10.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 10 client.5835 resolve_mds: resolved ID 'a' to GID 5646 2021-12-17T18:22:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 20 client.5835 populate_metadata read hostname 'smithi062' 2021-12-17T18:22:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 1 --2- 172.21.15.62:0/670674518 >> [v2:172.21.15.62:6832/3358597467,v1:172.21.15.62:6833/3358597467] conn(0x17e8d40 0x17e9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 4 client.5835 mds_command: new command op to 5646 tid=0[{"prefix": "get_command_descriptions"}] 2021-12-17T18:22:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 1 -- 172.21.15.62:0/670674518 --> [v2:172.21.15.62:6832/3358597467,v1:172.21.15.62:6833/3358597467] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1718930 con 0x17e8d40 2021-12-17T18:22:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa30b7fe700 1 --2- 172.21.15.62:0/670674518 >> [v2:172.21.15.62:6832/3358597467,v1:172.21.15.62:6833/3358597467] conn(0x17e8d40 0x17e9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa2ea7fc700 10 client.5835 ms_handle_connect on v2:172.21.15.62:6832/3358597467 2021-12-17T18:22:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa30b7fe700 1 --2- 172.21.15.62:0/670674518 >> [v2:172.21.15.62:6832/3358597467,v1:172.21.15.62:6833/3358597467] conn(0x17e8d40 0x17e9120 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f639ae50b0e3a51e server_cookie=8c39c3f997fdae00 in_seq=0 out_seq=0 2021-12-17T18:22:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa2ea7fc700 1 -- 172.21.15.62:0/670674518 <== mds.0 v2:172.21.15.62:6832/3358597467 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x1718930 con 0x17e8d40 2021-12-17T18:22:10.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa2ea7fc700 10 client.5835 handle_command_reply: tid=0 2021-12-17T18:22:10.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 1 client.5835 shutdown 2021-12-17T18:22:10.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 1 -- 172.21.15.62:0/670674518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17ba690 msgr2=0x17fefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 1 --2- 172.21.15.62:0/670674518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17ba690 0x17fefc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x1789420 tx=0x7fa300015000).stop 2021-12-17T18:22:10.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 1 -- 172.21.15.62:0/670674518 shutdown_connections 2021-12-17T18:22:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 1 --2- 172.21.15.62:0/670674518 >> [v2:172.21.15.62:6832/3358597467,v1:172.21.15.62:6833/3358597467] conn(0x17e8d40 0x17e9120 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 1 --2- 172.21.15.62:0/670674518 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17f34d0 0x17ff4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 1 --2- 172.21.15.62:0/670674518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17ba690 0x17fefc0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 1 --2- 172.21.15.62:0/670674518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x17ee670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa31c082740 1 -- 172.21.15.62:0/670674518 >> 172.21.15.62:0/670674518 conn(0x17b6a40 msgr2=0x17f38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.886+0000 7fa2ea7fc700 0 client.5835 ms_handle_reset on v2:172.21.15.62:6832/3358597467 2021-12-17T18:22:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.890+0000 7fa31c082740 1 -- 172.21.15.62:0/670674518 shutdown_connections 2021-12-17T18:22:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.890+0000 7fa31c082740 1 -- 172.21.15.62:0/670674518 wait complete. 2021-12-17T18:22:10.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.890+0000 7fa31c082740 20 client.5835 trim_cache size 0 max 16384 2021-12-17T18:22:10.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.898+0000 7fa31c082740 1 Processor -- start 2021-12-17T18:22:10.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.898+0000 7fa31c082740 1 -- start start 2021-12-17T18:22:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa31c082740 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x17ef170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa31c082740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17ba690 0x17b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa31c082740 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17f34d0 0x17b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa31c082740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x17b6e20 con 0x17ba690 2021-12-17T18:22:10.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa31c082740 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x1782070 con 0x17f34d0 2021-12-17T18:22:10.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa31c082740 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x17b9a90 con 0x17b4dc0 2021-12-17T18:22:10.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa30affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17ba690 0x17b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa30affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17ba690 0x17b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50986/0 (socket says 172.21.15.62:50986) 2021-12-17T18:22:10.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa30affd700 1 -- 172.21.15.62:0/3758478568 learned_addr learned my addr 172.21.15.62:0/3758478568 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:10.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa30b7fe700 1 --2- 172.21.15.62:0/3758478568 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x17ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa30bfff700 1 --2- 172.21.15.62:0/3758478568 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17f34d0 0x17b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa30affd700 1 -- 172.21.15.62:0/3758478568 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 msgr2=0x17ef170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:10.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa30affd700 1 --2- 172.21.15.62:0/3758478568 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x17ef170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa30affd700 1 -- 172.21.15.62:0/3758478568 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17f34d0 msgr2=0x17b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa30affd700 1 --2- 172.21.15.62:0/3758478568 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17f34d0 0x17b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa30affd700 1 -- 172.21.15.62:0/3758478568 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x17227a0 con 0x17ba690 2021-12-17T18:22:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa30b7fe700 1 --2- 172.21.15.62:0/3758478568 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x17ef170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:22:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa30affd700 1 --2- 172.21.15.62:0/3758478568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17ba690 0x17b5a70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x17ee040 tx=0x7fa30001e000).ready entity=mon.0 client_cookie=52fe2b6f0db3b6d0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa2f0ff9700 1 -- 172.21.15.62:0/3758478568 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa300002d80 con 0x17ba690 2021-12-17T18:22:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa2f0ff9700 1 -- 172.21.15.62:0/3758478568 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa300005a20 con 0x17ba690 2021-12-17T18:22:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa2f0ff9700 1 -- 172.21.15.62:0/3758478568 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa300005b90 con 0x17ba690 2021-12-17T18:22:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa31c082740 1 -- 172.21.15.62:0/3758478568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17ba690 msgr2=0x17b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:10.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa31c082740 1 --2- 172.21.15.62:0/3758478568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17ba690 0x17b5a70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x17ee040 tx=0x7fa30001e000).stop 2021-12-17T18:22:10.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa31c082740 1 -- 172.21.15.62:0/3758478568 shutdown_connections 2021-12-17T18:22:10.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa31c082740 1 --2- 172.21.15.62:0/3758478568 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17f34d0 0x17b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa31c082740 1 --2- 172.21.15.62:0/3758478568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17ba690 0x17b5a70 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa31c082740 1 --2- 172.21.15.62:0/3758478568 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x17ef170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa31c082740 1 -- 172.21.15.62:0/3758478568 >> 172.21.15.62:0/3758478568 conn(0x17b6a40 msgr2=0x17eb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:10.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa31c082740 1 -- 172.21.15.62:0/3758478568 shutdown_connections 2021-12-17T18:22:10.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa31c082740 1 -- 172.21.15.62:0/3758478568 wait complete. 2021-12-17T18:22:10.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.902+0000 7fa31c082740 1 -- start start 2021-12-17T18:22:10.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa31c082740 1 Processor -- start 2021-12-17T18:22:10.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa31c082740 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x184f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa31c082740 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17ba690 0x184f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa31c082740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17f34d0 0x18521c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa31c082740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x184fc70 con 0x17f34d0 2021-12-17T18:22:10.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa31c082740 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x17e9f50 con 0x17ba690 2021-12-17T18:22:10.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa31c082740 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x17ff6b0 con 0x17b4dc0 2021-12-17T18:22:10.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa31c082740 10 client.0 ll_register_callbacks cb 0x17be110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-12-17T18:22:10.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa30bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17f34d0 0x18521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa30bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17f34d0 0x18521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50994/0 (socket says 172.21.15.62:50994) 2021-12-17T18:22:10.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa30bfff700 1 -- 172.21.15.62:0/2822536147 learned_addr learned my addr 172.21.15.62:0/2822536147 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:10.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa30affd700 1 --2- 172.21.15.62:0/2822536147 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17ba690 0x184f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa30b7fe700 1 --2- 172.21.15.62:0/2822536147 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x184f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa30bfff700 1 -- 172.21.15.62:0/2822536147 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 msgr2=0x184f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:10.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa30bfff700 1 --2- 172.21.15.62:0/2822536147 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x184f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa30bfff700 1 -- 172.21.15.62:0/2822536147 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17ba690 msgr2=0x184f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:10.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa30bfff700 1 --2- 172.21.15.62:0/2822536147 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17ba690 0x184f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:10.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa30bfff700 1 -- 172.21.15.62:0/2822536147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1719ea0 con 0x17f34d0 2021-12-17T18:22:10.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa30affd700 1 --2- 172.21.15.62:0/2822536147 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17ba690 0x184f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:22:10.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa30bfff700 1 --2- 172.21.15.62:0/2822536147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17f34d0 0x18521c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fa304032000 tx=0x7fa304006b30).ready entity=mon.0 client_cookie=658314626b53fc58 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:10.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa2eb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2021-12-17T18:22:10.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa2eb7fe700 1 -- 172.21.15.62:0/2822536147 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa30403a070 con 0x17f34d0 2021-12-17T18:22:10.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa2eb7fe700 1 -- 172.21.15.62:0/2822536147 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa304047e10 con 0x17f34d0 2021-12-17T18:22:10.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.906+0000 7fa31c082740 1 -- 172.21.15.62:0/2822536147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa300010040 con 0x17f34d0 2021-12-17T18:22:10.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.910+0000 7fa2eb7fe700 1 -- 172.21.15.62:0/2822536147 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa304047550 con 0x17f34d0 2021-12-17T18:22:10.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.910+0000 7fa31c082740 10 client.5841 fetch_fsmap learned FSMap version 21 2021-12-17T18:22:10.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.910+0000 7fa31c082740 1 -- 172.21.15.62:0/2822536147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x171f190 con 0x17f34d0 2021-12-17T18:22:10.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.910+0000 7fa2eb7fe700 1 -- 172.21.15.62:0/2822536147 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa300010040 con 0x17f34d0 2021-12-17T18:22:10.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.910+0000 7fa2eb7fe700 1 -- 172.21.15.62:0/2822536147 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 21) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fa304043c60 con 0x17f34d0 2021-12-17T18:22:10.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.910+0000 7fa31c082740 10 client.5841 fetch_fsmap finished waiting for FSMap version 21 2021-12-17T18:22:10.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.910+0000 7fa31c082740 10 client.5841 resolve_mds: resolved ID 'a' to GID 5646 2021-12-17T18:22:10.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.910+0000 7fa31c082740 20 client.5841 populate_metadata read hostname 'smithi062' 2021-12-17T18:22:10.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.910+0000 7fa31c082740 1 --2- 172.21.15.62:0/2822536147 >> [v2:172.21.15.62:6832/3358597467,v1:172.21.15.62:6833/3358597467] conn(0x17ecc60 0x18526b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:10.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.910+0000 7fa31c082740 4 client.5841 mds_command: new command op to 5646 tid=0[{"prefix": "cache drop", "timeout": 5}] 2021-12-17T18:22:10.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.910+0000 7fa31c082740 1 -- 172.21.15.62:0/2822536147 --> [v2:172.21.15.62:6832/3358597467,v1:172.21.15.62:6833/3358597467] -- command(tid 0: {"prefix": "cache drop", "timeout": 5}) v1 -- 0x160e5e0 con 0x17ecc60 2021-12-17T18:22:10.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.910+0000 7fa30b7fe700 1 --2- 172.21.15.62:0/2822536147 >> [v2:172.21.15.62:6832/3358597467,v1:172.21.15.62:6833/3358597467] conn(0x17ecc60 0x18526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:10.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.910+0000 7fa2eb7fe700 10 client.5841 ms_handle_connect on v2:172.21.15.62:6832/3358597467 2021-12-17T18:22:10.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:10.910+0000 7fa30b7fe700 1 --2- 172.21.15.62:0/2822536147 >> [v2:172.21.15.62:6832/3358597467,v1:172.21.15.62:6833/3358597467] conn(0x17ecc60 0x18526b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=bd76aa40fd6f4952 server_cookie=5074a86273e46d19 in_seq=0 out_seq=0 2021-12-17T18:22:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa2eb7fe700 1 -- 172.21.15.62:0/2822536147 <== mds.0 v2:172.21.15.62:6832/3358597467 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+404 (crc 0 0 0) 0x160e5e0 con 0x17ecc60 2021-12-17T18:22:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa2eb7fe700 10 client.5841 handle_command_reply: tid=0 2021-12-17T18:22:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa31c082740 1 client.5841 shutdown 2021-12-17T18:22:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa31c082740 1 -- 172.21.15.62:0/2822536147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17f34d0 msgr2=0x18521c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa31c082740 1 --2- 172.21.15.62:0/2822536147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17f34d0 0x18521c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fa304032000 tx=0x7fa304006b30).stop 2021-12-17T18:22:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa31c082740 1 -- 172.21.15.62:0/2822536147 shutdown_connections 2021-12-17T18:22:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa31c082740 1 --2- 172.21.15.62:0/2822536147 >> [v2:172.21.15.62:6832/3358597467,v1:172.21.15.62:6833/3358597467] conn(0x17ecc60 0x18526b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa31c082740 1 --2- 172.21.15.62:0/2822536147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x17f34d0 0x18521c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa2eb7fe700 0 client.5841 ms_handle_reset on v2:172.21.15.62:6832/3358597467 2021-12-17T18:22:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa31c082740 1 --2- 172.21.15.62:0/2822536147 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x17ba690 0x184f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa31c082740 1 --2- 172.21.15.62:0/2822536147 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x17b4dc0 0x184f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa31c082740 1 -- 172.21.15.62:0/2822536147 >> 172.21.15.62:0/2822536147 conn(0x17b6a40 msgr2=0x17ea700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa31c082740 1 -- 172.21.15.62:0/2822536147 shutdown_connections 2021-12-17T18:22:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa31c082740 1 -- 172.21.15.62:0/2822536147 wait complete. 2021-12-17T18:22:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa31c082740 20 client.5841 trim_cache size 0 max 16384 2021-12-17T18:22:16.099 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:22:16.100 INFO:teuthology.orchestra.run.smithi062.stdout: "client_recall": { 2021-12-17T18:22:16.100 INFO:teuthology.orchestra.run.smithi062.stdout: "return_code": -110, 2021-12-17T18:22:16.100 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "(110) Connection timed out", 2021-12-17T18:22:16.100 INFO:teuthology.orchestra.run.smithi062.stdout: "recalled": 120 2021-12-17T18:22:16.101 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:22:16.101 INFO:teuthology.orchestra.run.smithi062.stdout: "flush_journal": { 2021-12-17T18:22:16.101 INFO:teuthology.orchestra.run.smithi062.stdout: "return_code": 0, 2021-12-17T18:22:16.101 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "" 2021-12-17T18:22:16.101 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:22:16.102 INFO:teuthology.orchestra.run.smithi062.stdout: "trim_cache": { 2021-12-17T18:22:16.102 INFO:teuthology.orchestra.run.smithi062.stdout: "trimmed": 0 2021-12-17T18:22:16.102 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:22:16.102 INFO:teuthology.orchestra.run.smithi062.stdout: "cache": { 2021-12-17T18:22:16.103 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": { 2021-12-17T18:22:16.103 INFO:teuthology.orchestra.run.smithi062.stdout: "items": 19979, 2021-12-17T18:22:16.103 INFO:teuthology.orchestra.run.smithi062.stdout: "bytes": 3098976 2021-12-17T18:22:16.103 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:22:16.104 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:22:16.104 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1829925110000001 2021-12-17T18:22:16.104 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:22:16.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa310bdd700 1 -- 172.21.15.62:0/2232496443 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa2ec0535b0 msgr2=0x7fa2ec055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa310bdd700 1 --2- 172.21.15.62:0/2232496443 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa2ec0535b0 0x7fa2ec055a70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fa2fc00d000 tx=0x7fa2fc00c040).stop 2021-12-17T18:22:16.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa310bdd700 1 -- 172.21.15.62:0/2232496443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa30c1558c0 msgr2=0x7fa30c0a6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa310bdd700 1 --2- 172.21.15.62:0/2232496443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa30c1558c0 0x7fa30c0a6920 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fa30400c000 tx=0x7fa304019000).stop 2021-12-17T18:22:16.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa310bdd700 1 -- 172.21.15.62:0/2232496443 shutdown_connections 2021-12-17T18:22:16.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa310bdd700 1 --2- 172.21.15.62:0/2232496443 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa2ec0535b0 0x7fa2ec055a70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa310bdd700 1 --2- 172.21.15.62:0/2232496443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa30c1558c0 0x7fa30c0a6920 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa310bdd700 1 --2- 172.21.15.62:0/2232496443 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa30c066730 0x7fa30c0a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa310bdd700 1 --2- 172.21.15.62:0/2232496443 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa2f8004e70 0x7fa30c148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa310bdd700 1 -- 172.21.15.62:0/2232496443 >> 172.21.15.62:0/2232496443 conn(0x7fa30c05bcd0 msgr2=0x7fa30c0b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:16.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa310bdd700 1 -- 172.21.15.62:0/2232496443 shutdown_connections 2021-12-17T18:22:16.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.094+0000 7fa310bdd700 1 -- 172.21.15.62:0/2232496443 wait complete. 2021-12-17T18:22:16.110 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-12-17T18:22:16.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:22:16.111 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:22:16.111 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:22:16.118 INFO:teuthology.orchestra.run.smithi125.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-12-17T18:22:16.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:22:16.120 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-12-17T18:22:16.121 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:22:16.121 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:22:16.122 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:22:16.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:22:16.141 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:22:16.142 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:22:16.149 INFO:teuthology.orchestra.run.smithi125.stdout:ext2/ext3 2021-12-17T18:22:16.150 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:22:16.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:22:16.151 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:22:16.200 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:22:16.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.310+0000 7f8c25d0f700 1 Processor -- start 2021-12-17T18:22:16.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.310+0000 7f8c25d0f700 1 -- start start 2021-12-17T18:22:16.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.310+0000 7f8c25d0f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f8c200b2370 0x7f8c200b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:16.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.310+0000 7f8c25d0f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8c2013f470 0x7f8c20143000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:16.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c25d0f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c200ad9f0 con 0x7f8c200ad610 2021-12-17T18:22:16.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c25d0f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c200ad010 con 0x7f8c2013f470 2021-12-17T18:22:16.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c25d0f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c200b19e0 con 0x7f8c200b2370 2021-12-17T18:22:16.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c1f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8c200ad610 0x7f8c2013ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34584/0 (socket says 172.21.15.62:34584) 2021-12-17T18:22:16.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c1f7fe700 1 -- 172.21.15.62:0/230337926 learned_addr learned my addr 172.21.15.62:0/230337926 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:22:16.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c1ffff700 1 --2- 172.21.15.62:0/230337926 >> v2:172.21.15.62:3300/0 conn(0x7f8c2013f470 0x7f8c20143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:16.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c16ffd700 1 --2- 172.21.15.62:0/230337926 >> v2:172.21.15.109:3300/0 conn(0x7f8c200b2370 0x7f8c200b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:16.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c1effd700 1 -- 172.21.15.62:0/230337926 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581800221 0 0) 0x7f8c200ad9f0 con 0x7f8c200ad610 2021-12-17T18:22:16.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c1effd700 1 -- 172.21.15.62:0/230337926 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c00003260 con 0x7f8c200ad610 2021-12-17T18:22:16.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c1ffff700 1 -- 172.21.15.62:0/230337926 >> v2:172.21.15.109:3300/0 conn(0x7f8c200b2370 msgr2=0x7f8c200b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:16.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c1ffff700 1 --2- 172.21.15.62:0/230337926 >> v2:172.21.15.109:3300/0 conn(0x7f8c200b2370 0x7f8c200b0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c1ffff700 1 -- 172.21.15.62:0/230337926 >> v1:172.21.15.62:6789/0 conn(0x7f8c200ad610 legacy=0x7f8c2013ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c1effd700 1 -- 172.21.15.62:0/230337926 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 777213719 0 0) 0x7f8c00003260 con 0x7f8c200ad610 2021-12-17T18:22:16.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c1ffff700 1 -- 172.21.15.62:0/230337926 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c200b1c80 con 0x7f8c2013f470 2021-12-17T18:22:16.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c1ffff700 1 --2- 172.21.15.62:0/230337926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c2013f470 0x7f8c20143000 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f8c10001800 tx=0x7f8c180091d0).ready entity=mon.0 client_cookie=642c9cdd492c1de1 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:16.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c1effd700 1 -- 172.21.15.62:0/230337926 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c10001660 con 0x7f8c2013f470 2021-12-17T18:22:16.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c1effd700 1 -- 172.21.15.62:0/230337926 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1800f510 con 0x7f8c2013f470 2021-12-17T18:22:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c1effd700 1 -- 172.21.15.62:0/230337926 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c1800f680 con 0x7f8c2013f470 2021-12-17T18:22:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c25d0f700 1 -- 172.21.15.62:0/230337926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c2013f470 msgr2=0x7f8c20143000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c25d0f700 1 --2- 172.21.15.62:0/230337926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c2013f470 0x7f8c20143000 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f8c10001800 tx=0x7f8c180091d0).stop 2021-12-17T18:22:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c25d0f700 1 -- 172.21.15.62:0/230337926 shutdown_connections 2021-12-17T18:22:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c25d0f700 1 --2- 172.21.15.62:0/230337926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c2013f470 0x7f8c20143000 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c25d0f700 1 --2- 172.21.15.62:0/230337926 >> v2:172.21.15.109:3300/0 conn(0x7f8c200b2370 0x7f8c200b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c25d0f700 1 -- 172.21.15.62:0/230337926 >> 172.21.15.62:0/230337926 conn(0x7f8c2005c750 msgr2=0x7f8c200630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c25d0f700 1 -- 172.21.15.62:0/230337926 shutdown_connections 2021-12-17T18:22:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.314+0000 7f8c25d0f700 1 -- 172.21.15.62:0/230337926 wait complete. 2021-12-17T18:22:16.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c25d0f700 1 Processor -- start 2021-12-17T18:22:16.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c25d0f700 1 -- start start 2021-12-17T18:22:16.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c25d0f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c200ad610 0x7f8c20150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:16.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c25d0f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c200b2370 0x7f8c20151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:16.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c25d0f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c2013f470 0x7f8c20152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:16.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c25d0f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c20130470 con 0x7f8c200ad610 2021-12-17T18:22:16.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c25d0f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c20063ec0 con 0x7f8c2013f470 2021-12-17T18:22:16.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c25d0f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c20064160 con 0x7f8c200b2370 2021-12-17T18:22:16.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c1f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c200ad610 0x7f8c20150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:16.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c1f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c200ad610 0x7f8c20150840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51010/0 (socket says 172.21.15.62:51010) 2021-12-17T18:22:16.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c1f7fe700 1 -- 172.21.15.62:0/2695808796 learned_addr learned my addr 172.21.15.62:0/2695808796 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:16.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c16ffd700 1 --2- 172.21.15.62:0/2695808796 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c200b2370 0x7f8c20151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:16.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c1ffff700 1 --2- 172.21.15.62:0/2695808796 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c2013f470 0x7f8c20152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:16.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c1f7fe700 1 -- 172.21.15.62:0/2695808796 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c200b2370 msgr2=0x7f8c20151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c1f7fe700 1 --2- 172.21.15.62:0/2695808796 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c200b2370 0x7f8c20151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c1f7fe700 1 -- 172.21.15.62:0/2695808796 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c2013f470 msgr2=0x7f8c20152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c1f7fe700 1 --2- 172.21.15.62:0/2695808796 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c2013f470 0x7f8c20152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c1f7fe700 1 -- 172.21.15.62:0/2695808796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c18009470 con 0x7f8c200ad610 2021-12-17T18:22:16.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c1ffff700 1 --2- 172.21.15.62:0/2695808796 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c2013f470 0x7f8c20152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:22:16.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.318+0000 7f8c16ffd700 1 --2- 172.21.15.62:0/2695808796 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c200b2370 0x7f8c20151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:22:16.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.322+0000 7f8c1f7fe700 1 --2- 172.21.15.62:0/2695808796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c200ad610 0x7f8c20150840 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f8c10001840 tx=0x7f8c10001b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:16.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.322+0000 7f8c1d7fa700 1 -- 172.21.15.62:0/2695808796 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c10016070 con 0x7f8c200ad610 2021-12-17T18:22:16.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.322+0000 7f8c1d7fa700 1 -- 172.21.15.62:0/2695808796 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c10007360 con 0x7f8c200ad610 2021-12-17T18:22:16.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.322+0000 7f8c25d0f700 1 -- 172.21.15.62:0/2695808796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c20066ad0 con 0x7f8c200ad610 2021-12-17T18:22:16.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.322+0000 7f8c1d7fa700 1 -- 172.21.15.62:0/2695808796 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c1000cc20 con 0x7f8c200ad610 2021-12-17T18:22:16.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.322+0000 7f8c25d0f700 1 -- 172.21.15.62:0/2695808796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c20064600 con 0x7f8c200ad610 2021-12-17T18:22:16.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.322+0000 7f8c25d0f700 1 -- 172.21.15.62:0/2695808796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c20064320 con 0x7f8c200ad610 2021-12-17T18:22:16.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.322+0000 7f8c1d7fa700 1 -- 172.21.15.62:0/2695808796 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8c10004520 con 0x7f8c200ad610 2021-12-17T18:22:16.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.322+0000 7f8c1d7fa700 1 --2- 172.21.15.62:0/2695808796 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c040536a0 0x7f8c04055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:16.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.322+0000 7f8c1d7fa700 1 -- 172.21.15.62:0/2695808796 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8c1006e070 con 0x7f8c200ad610 2021-12-17T18:22:16.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.322+0000 7f8c16ffd700 1 --2- 172.21.15.62:0/2695808796 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c040536a0 0x7f8c04055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:16.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.322+0000 7f8c16ffd700 1 --2- 172.21.15.62:0/2695808796 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c040536a0 0x7f8c04055b60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f8c0800b000 tx=0x7f8c08008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:16.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.326+0000 7f8c1d7fa700 1 -- 172.21.15.62:0/2695808796 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8c10045060 con 0x7f8c200ad610 2021-12-17T18:22:16.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.446+0000 7f8c25d0f700 1 -- 172.21.15.62:0/2695808796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c200b1f20 con 0x7f8c200ad610 2021-12-17T18:22:16.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.450+0000 7f8c1d7fa700 1 -- 172.21.15.62:0/2695808796 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16088 (secure 0 0 0) 0x7f8c1000ee60 con 0x7f8c200ad610 2021-12-17T18:22:16.450 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:22:16.450 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":51,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:21:52.690524+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:21:50.101305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-12-17T18:21:51.041096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:22:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.450+0000 7f8c25d0f700 1 -- 172.21.15.62:0/2695808796 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c040536a0 msgr2=0x7f8c04055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.450+0000 7f8c25d0f700 1 --2- 172.21.15.62:0/2695808796 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c040536a0 0x7f8c04055b60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f8c0800b000 tx=0x7f8c08008040).stop 2021-12-17T18:22:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.450+0000 7f8c25d0f700 1 -- 172.21.15.62:0/2695808796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c200ad610 msgr2=0x7f8c20150840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.450+0000 7f8c25d0f700 1 --2- 172.21.15.62:0/2695808796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c200ad610 0x7f8c20150840 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f8c10001840 tx=0x7f8c10001b30).stop 2021-12-17T18:22:16.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.450+0000 7f8c25d0f700 1 -- 172.21.15.62:0/2695808796 shutdown_connections 2021-12-17T18:22:16.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.450+0000 7f8c25d0f700 1 --2- 172.21.15.62:0/2695808796 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c040536a0 0x7f8c04055b60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.450+0000 7f8c25d0f700 1 --2- 172.21.15.62:0/2695808796 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c2013f470 0x7f8c20152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.450+0000 7f8c25d0f700 1 --2- 172.21.15.62:0/2695808796 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c200b2370 0x7f8c20151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.450+0000 7f8c25d0f700 1 --2- 172.21.15.62:0/2695808796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c200ad610 0x7f8c20150840 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.450+0000 7f8c25d0f700 1 -- 172.21.15.62:0/2695808796 >> 172.21.15.62:0/2695808796 conn(0x7f8c2005c750 msgr2=0x7f8c200aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:16.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.450+0000 7f8c25d0f700 1 -- 172.21.15.62:0/2695808796 shutdown_connections 2021-12-17T18:22:16.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.450+0000 7f8c25d0f700 1 -- 172.21.15.62:0/2695808796 wait complete. 2021-12-17T18:22:16.467 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:21:50.101305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:21:51.041096+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:22:16.468 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:22:16.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.574+0000 7fda32506700 1 Processor -- start 2021-12-17T18:22:16.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.574+0000 7fda32506700 1 -- start start 2021-12-17T18:22:16.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.574+0000 7fda32506700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda2c0b1260 0x7fda2c063ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:16.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.574+0000 7fda32506700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fda2c061670 0x7fda2c0621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:16.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.574+0000 7fda32506700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2c143dc0 con 0x7fda2c063b00 2021-12-17T18:22:16.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.574+0000 7fda32506700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2c061b20 con 0x7fda2c061670 2021-12-17T18:22:16.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.574+0000 7fda32506700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c0b1b90 con 0x7fda2c0b1260 2021-12-17T18:22:16.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda31d05700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fda2c061670 0x7fda2c0621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:16.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda31d05700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fda2c061670 0x7fda2c0621a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51020/0 (socket says 172.21.15.62:51020) 2021-12-17T18:22:16.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda31d05700 1 -- 172.21.15.62:0/2131429009 learned_addr learned my addr 172.21.15.62:0/2131429009 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:16.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda30d03700 1 --2- 172.21.15.62:0/2131429009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda2c0b1260 0x7fda2c063ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:16.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda31d05700 1 -- 172.21.15.62:0/2131429009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda2c0b1260 msgr2=0x7fda2c063ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:16.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda31d05700 1 --2- 172.21.15.62:0/2131429009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda2c0b1260 0x7fda2c063ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda31d05700 1 -- 172.21.15.62:0/2131429009 >> v1:172.21.15.62:6789/0 conn(0x7fda2c063b00 legacy=0x7fda2c13cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda31d05700 1 -- 172.21.15.62:0/2131429009 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c061d00 con 0x7fda2c061670 2021-12-17T18:22:16.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda31d05700 1 --2- 172.21.15.62:0/2131429009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda2c061670 0x7fda2c0621a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fda240032f0 tx=0x7fda24009290).ready entity=mon.0 client_cookie=632d6770670fe459 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:16.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda1bfff700 1 -- 172.21.15.62:0/2131429009 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda2400b8a0 con 0x7fda2c061670 2021-12-17T18:22:16.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda1bfff700 1 -- 172.21.15.62:0/2131429009 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2400ba00 con 0x7fda2c061670 2021-12-17T18:22:16.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda1bfff700 1 -- 172.21.15.62:0/2131429009 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda2400bb70 con 0x7fda2c061670 2021-12-17T18:22:16.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda32506700 1 -- 172.21.15.62:0/2131429009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda2c061670 msgr2=0x7fda2c0621a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda32506700 1 --2- 172.21.15.62:0/2131429009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda2c061670 0x7fda2c0621a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fda240032f0 tx=0x7fda24009290).stop 2021-12-17T18:22:16.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda32506700 1 -- 172.21.15.62:0/2131429009 shutdown_connections 2021-12-17T18:22:16.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda32506700 1 --2- 172.21.15.62:0/2131429009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda2c061670 0x7fda2c0621a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda32506700 1 --2- 172.21.15.62:0/2131429009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda2c0b1260 0x7fda2c063ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda32506700 1 -- 172.21.15.62:0/2131429009 >> 172.21.15.62:0/2131429009 conn(0x7fda2c060a50 msgr2=0x7fda2c05bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:16.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda32506700 1 -- 172.21.15.62:0/2131429009 shutdown_connections 2021-12-17T18:22:16.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda32506700 1 -- 172.21.15.62:0/2131429009 wait complete. 2021-12-17T18:22:16.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda32506700 1 Processor -- start 2021-12-17T18:22:16.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.578+0000 7fda32506700 1 -- start start 2021-12-17T18:22:16.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda32506700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda2c061670 0x7fda2c0aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:16.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda32506700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fda2c063b00 0x7fda2c065aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:16.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda32506700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda2c0b1260 0x7fda2c144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:16.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda32506700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c067380 con 0x7fda2c061670 2021-12-17T18:22:16.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda32506700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c0664c0 con 0x7fda2c063b00 2021-12-17T18:22:16.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda32506700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c065f90 con 0x7fda2c0b1260 2021-12-17T18:22:16.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda31504700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda2c061670 0x7fda2c0aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:16.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda30d03700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fda2c063b00 0x7fda2c065aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:16.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda31504700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda2c061670 0x7fda2c0aecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51026/0 (socket says 172.21.15.62:51026) 2021-12-17T18:22:16.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda31504700 1 -- 172.21.15.62:0/3227261762 learned_addr learned my addr 172.21.15.62:0/3227261762 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:16.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda31d05700 1 --2- 172.21.15.62:0/3227261762 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda2c0b1260 0x7fda2c144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:16.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda31504700 1 -- 172.21.15.62:0/3227261762 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda2c0b1260 msgr2=0x7fda2c144a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda31504700 1 --2- 172.21.15.62:0/3227261762 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda2c0b1260 0x7fda2c144a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda31504700 1 -- 172.21.15.62:0/3227261762 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fda2c063b00 msgr2=0x7fda2c065aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda31504700 1 --2- 172.21.15.62:0/3227261762 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fda2c063b00 0x7fda2c065aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda31504700 1 -- 172.21.15.62:0/3227261762 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24009530 con 0x7fda2c061670 2021-12-17T18:22:16.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda31504700 1 --2- 172.21.15.62:0/3227261762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda2c061670 0x7fda2c0aecf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fda2c144480 tx=0x7fda28007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:16.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda1a7fc700 1 -- 172.21.15.62:0/3227261762 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda28012400 con 0x7fda2c061670 2021-12-17T18:22:16.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda1a7fc700 1 -- 172.21.15.62:0/3227261762 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda28012560 con 0x7fda2c061670 2021-12-17T18:22:16.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda1a7fc700 1 -- 172.21.15.62:0/3227261762 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda280128c0 con 0x7fda2c061670 2021-12-17T18:22:16.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda32506700 1 -- 172.21.15.62:0/3227261762 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2c066220 con 0x7fda2c061670 2021-12-17T18:22:16.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda32506700 1 -- 172.21.15.62:0/3227261762 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2c144f70 con 0x7fda2c061670 2021-12-17T18:22:16.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.582+0000 7fda32506700 1 -- 172.21.15.62:0/3227261762 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2c1439c0 con 0x7fda2c061670 2021-12-17T18:22:16.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.586+0000 7fda1a7fc700 1 -- 172.21.15.62:0/3227261762 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fda28019030 con 0x7fda2c061670 2021-12-17T18:22:16.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.586+0000 7fda1a7fc700 1 --2- 172.21.15.62:0/3227261762 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fda0c053520 0x7fda0c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:16.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.586+0000 7fda1a7fc700 1 -- 172.21.15.62:0/3227261762 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fda2806ad80 con 0x7fda2c061670 2021-12-17T18:22:16.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.586+0000 7fda30d03700 1 --2- 172.21.15.62:0/3227261762 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fda0c053520 0x7fda0c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:16.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.586+0000 7fda30d03700 1 --2- 172.21.15.62:0/3227261762 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fda0c053520 0x7fda0c0559e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fda1c00b000 tx=0x7fda1c006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:16.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.594+0000 7fda1a7fc700 1 -- 172.21.15.62:0/3227261762 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fda28041d70 con 0x7fda2c061670 2021-12-17T18:22:16.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.722+0000 7fda32506700 1 -- 172.21.15.62:0/3227261762 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fda2c0573d0 con 0x7fda2c061670 2021-12-17T18:22:16.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.722+0000 7fda1a7fc700 1 -- 172.21.15.62:0/3227261762 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v51) v1 ==== 110+0+10 (secure 0 0 0) 0x7fda28045390 con 0x7fda2c061670 2021-12-17T18:22:16.723 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:22:16.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.722+0000 7fda32506700 1 -- 172.21.15.62:0/3227261762 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fda0c053520 msgr2=0x7fda0c0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.722+0000 7fda32506700 1 --2- 172.21.15.62:0/3227261762 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fda0c053520 0x7fda0c0559e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fda1c00b000 tx=0x7fda1c006df0).stop 2021-12-17T18:22:16.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.722+0000 7fda32506700 1 -- 172.21.15.62:0/3227261762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda2c061670 msgr2=0x7fda2c0aecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.722+0000 7fda32506700 1 --2- 172.21.15.62:0/3227261762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda2c061670 0x7fda2c0aecf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fda2c144480 tx=0x7fda28007c50).stop 2021-12-17T18:22:16.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.722+0000 7fda32506700 1 -- 172.21.15.62:0/3227261762 shutdown_connections 2021-12-17T18:22:16.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.722+0000 7fda32506700 1 --2- 172.21.15.62:0/3227261762 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fda0c053520 0x7fda0c0559e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.722+0000 7fda32506700 1 --2- 172.21.15.62:0/3227261762 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda2c0b1260 0x7fda2c144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.722+0000 7fda32506700 1 --2- 172.21.15.62:0/3227261762 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fda2c063b00 0x7fda2c065aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.722+0000 7fda32506700 1 --2- 172.21.15.62:0/3227261762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda2c061670 0x7fda2c0aecf0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.722+0000 7fda32506700 1 -- 172.21.15.62:0/3227261762 >> 172.21.15.62:0/3227261762 conn(0x7fda2c060a50 msgr2=0x7fda2c0b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:16.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.722+0000 7fda32506700 1 -- 172.21.15.62:0/3227261762 shutdown_connections 2021-12-17T18:22:16.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.722+0000 7fda32506700 1 -- 172.21.15.62:0/3227261762 wait complete. 2021-12-17T18:22:16.736 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:22:16.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.842+0000 7f3737fff700 1 Processor -- start 2021-12-17T18:22:16.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.842+0000 7f3737fff700 1 -- start start 2021-12-17T18:22:16.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.842+0000 7f3737fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f37380b4230 0x7f37380b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:16.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.842+0000 7f3737fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373805ce70 con 0x7f373805ca90 2021-12-17T18:22:16.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.842+0000 7f3737fff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37380b1bc0 con 0x7f37380b3540 2021-12-17T18:22:16.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.842+0000 7f3737fff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37380b1e60 con 0x7f37380b4230 2021-12-17T18:22:16.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.842+0000 7f3736ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f373805ca90 0x7f37380b4f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34610/0 (socket says 172.21.15.62:34610) 2021-12-17T18:22:16.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.842+0000 7f3736ffd700 1 -- 172.21.15.62:0/3356713454 learned_addr learned my addr 172.21.15.62:0/3356713454 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:22:16.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.842+0000 7f37377fe700 1 --2- 172.21.15.62:0/3356713454 >> v2:172.21.15.109:3300/0 conn(0x7f37380b4230 0x7f37380b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.842+0000 7f3735ffb700 1 -- 172.21.15.62:0/3356713454 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415624046 0 0) 0x7f373805ce70 con 0x7f373805ca90 2021-12-17T18:22:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f3735ffb700 1 -- 172.21.15.62:0/3356713454 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f371c003260 con 0x7f373805ca90 2021-12-17T18:22:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f3735ffb700 1 -- 172.21.15.62:0/3356713454 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639477849 0 0) 0x7f37380b1bc0 con 0x7f37380b3540 2021-12-17T18:22:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f3735ffb700 1 -- 172.21.15.62:0/3356713454 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f373805ce70 con 0x7f37380b3540 2021-12-17T18:22:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f37377fe700 1 -- 172.21.15.62:0/3356713454 >> v1:172.21.15.109:6789/0 conn(0x7f37380b3540 legacy=0x7f3738145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f37377fe700 1 -- 172.21.15.62:0/3356713454 >> v1:172.21.15.62:6789/0 conn(0x7f373805ca90 legacy=0x7f37380b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f37377fe700 1 -- 172.21.15.62:0/3356713454 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37380b2100 con 0x7f37380b4230 2021-12-17T18:22:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f37377fe700 1 --2- 172.21.15.62:0/3356713454 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37380b4230 0x7f37380b25a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f3730002f70 tx=0x7f3730006df0).ready entity=mon.1 client_cookie=81d898e15ed9a4c5 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f3735ffb700 1 -- 172.21.15.62:0/3356713454 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f373000d540 con 0x7f37380b4230 2021-12-17T18:22:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f3735ffb700 1 -- 172.21.15.62:0/3356713454 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3730000e90 con 0x7f37380b4230 2021-12-17T18:22:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f3735ffb700 1 -- 172.21.15.62:0/3356713454 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f373000d890 con 0x7f37380b4230 2021-12-17T18:22:16.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f3737fff700 1 -- 172.21.15.62:0/3356713454 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37380b4230 msgr2=0x7f37380b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f3737fff700 1 --2- 172.21.15.62:0/3356713454 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37380b4230 0x7f37380b25a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f3730002f70 tx=0x7f3730006df0).stop 2021-12-17T18:22:16.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f3737fff700 1 -- 172.21.15.62:0/3356713454 shutdown_connections 2021-12-17T18:22:16.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f3737fff700 1 --2- 172.21.15.62:0/3356713454 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37380b4230 0x7f37380b25a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f3737fff700 1 -- 172.21.15.62:0/3356713454 >> 172.21.15.62:0/3356713454 conn(0x7f373805bcd0 msgr2=0x7f3738062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:16.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f3737fff700 1 -- 172.21.15.62:0/3356713454 shutdown_connections 2021-12-17T18:22:16.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f3737fff700 1 -- 172.21.15.62:0/3356713454 wait complete. 2021-12-17T18:22:16.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f3737fff700 1 Processor -- start 2021-12-17T18:22:16.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.846+0000 7f3737fff700 1 -- start start 2021-12-17T18:22:16.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3737fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f373805ca90 0x7f3738152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:16.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3737fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37380b3540 0x7f37380a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:16.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3737fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37380b4230 0x7f37381414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3737fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3738155a20 con 0x7f373805ca90 2021-12-17T18:22:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3737fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3738146d40 con 0x7f37380b4230 2021-12-17T18:22:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3737fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3738146fe0 con 0x7f37380b3540 2021-12-17T18:22:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3736ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f373805ca90 0x7f3738152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3736ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f373805ca90 0x7f3738152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51038/0 (socket says 172.21.15.62:51038) 2021-12-17T18:22:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3736ffd700 1 -- 172.21.15.62:0/746461754 learned_addr learned my addr 172.21.15.62:0/746461754 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f37377fe700 1 --2- 172.21.15.62:0/746461754 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37380b4230 0x7f37381414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f37367fc700 1 --2- 172.21.15.62:0/746461754 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37380b3540 0x7f37380a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3736ffd700 1 -- 172.21.15.62:0/746461754 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37380b3540 msgr2=0x7f37380a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3736ffd700 1 --2- 172.21.15.62:0/746461754 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37380b3540 0x7f37380a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3736ffd700 1 -- 172.21.15.62:0/746461754 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37380b4230 msgr2=0x7f37381414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3736ffd700 1 --2- 172.21.15.62:0/746461754 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37380b4230 0x7f37381414d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3736ffd700 1 -- 172.21.15.62:0/746461754 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373000b180 con 0x7f373805ca90 2021-12-17T18:22:16.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3736ffd700 1 --2- 172.21.15.62:0/746461754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f373805ca90 0x7f3738152400 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f372c0011d0 tx=0x7f372c007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:16.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3727fff700 1 -- 172.21.15.62:0/746461754 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f372c0070d0 con 0x7f373805ca90 2021-12-17T18:22:16.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3737fff700 1 -- 172.21.15.62:0/746461754 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3738147280 con 0x7f373805ca90 2021-12-17T18:22:16.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3737fff700 1 -- 172.21.15.62:0/746461754 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3738066a60 con 0x7f373805ca90 2021-12-17T18:22:16.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3727fff700 1 -- 172.21.15.62:0/746461754 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c007230 con 0x7f373805ca90 2021-12-17T18:22:16.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3727fff700 1 -- 172.21.15.62:0/746461754 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f372c005610 con 0x7f373805ca90 2021-12-17T18:22:16.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.850+0000 7f3737fff700 1 -- 172.21.15.62:0/746461754 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3738147410 con 0x7f373805ca90 2021-12-17T18:22:16.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.854+0000 7f3727fff700 1 -- 172.21.15.62:0/746461754 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f372c010070 con 0x7f373805ca90 2021-12-17T18:22:16.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.854+0000 7f3727fff700 1 --2- 172.21.15.62:0/746461754 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37140536a0 0x7f3714055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:16.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.854+0000 7f3727fff700 1 -- 172.21.15.62:0/746461754 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f372c06b030 con 0x7f373805ca90 2021-12-17T18:22:16.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.854+0000 7f37367fc700 1 --2- 172.21.15.62:0/746461754 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37140536a0 0x7f3714055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:16.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.854+0000 7f37367fc700 1 --2- 172.21.15.62:0/746461754 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37140536a0 0x7f3714055b60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f372800d000 tx=0x7f3728007d70).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:16.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.862+0000 7f3727fff700 1 -- 172.21.15.62:0/746461754 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f372c0420f0 con 0x7f373805ca90 2021-12-17T18:22:16.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.986+0000 7f3737fff700 1 -- 172.21.15.62:0/746461754 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f37380603f0 con 0x7f373805ca90 2021-12-17T18:22:16.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.990+0000 7f3727fff700 1 -- 172.21.15.62:0/746461754 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v51) v1 ==== 92+0+10 (secure 0 0 0) 0x7f372c045710 con 0x7f373805ca90 2021-12-17T18:22:16.990 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:22:16.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.990+0000 7f3737fff700 1 -- 172.21.15.62:0/746461754 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37140536a0 msgr2=0x7f3714055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.990+0000 7f3737fff700 1 --2- 172.21.15.62:0/746461754 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37140536a0 0x7f3714055b60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f372800d000 tx=0x7f3728007d70).stop 2021-12-17T18:22:16.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.990+0000 7f3737fff700 1 -- 172.21.15.62:0/746461754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f373805ca90 msgr2=0x7f3738152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:16.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.990+0000 7f3737fff700 1 --2- 172.21.15.62:0/746461754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f373805ca90 0x7f3738152400 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f372c0011d0 tx=0x7f372c007b50).stop 2021-12-17T18:22:16.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.990+0000 7f3737fff700 1 -- 172.21.15.62:0/746461754 shutdown_connections 2021-12-17T18:22:16.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.990+0000 7f3737fff700 1 --2- 172.21.15.62:0/746461754 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37140536a0 0x7f3714055b60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.990+0000 7f3737fff700 1 --2- 172.21.15.62:0/746461754 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37380b4230 0x7f37381414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.990+0000 7f3737fff700 1 --2- 172.21.15.62:0/746461754 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37380b3540 0x7f37380a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.990+0000 7f3737fff700 1 --2- 172.21.15.62:0/746461754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f373805ca90 0x7f3738152400 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:16.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.990+0000 7f3737fff700 1 -- 172.21.15.62:0/746461754 >> 172.21.15.62:0/746461754 conn(0x7f373805bcd0 msgr2=0x7f37380b97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:16.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.990+0000 7f3737fff700 1 -- 172.21.15.62:0/746461754 shutdown_connections 2021-12-17T18:22:16.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:16.990+0000 7f3737fff700 1 -- 172.21.15.62:0/746461754 wait complete. 2021-12-17T18:22:17.006 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:22:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.110+0000 7efcee1d4700 1 Processor -- start 2021-12-17T18:22:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.110+0000 7efcee1d4700 1 -- start start 2021-12-17T18:22:17.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.110+0000 7efcee1d4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efce80b47c0 0x7efce80b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.110+0000 7efcee1d4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efce80b5be0 0x7efce8143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.110+0000 7efcee1d4700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce80b0870 con 0x7efce805ca90 2021-12-17T18:22:17.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.110+0000 7efcee1d4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce805ce70 con 0x7efce80b5be0 2021-12-17T18:22:17.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.110+0000 7efcee1d4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce80b05d0 con 0x7efce80b47c0 2021-12-17T18:22:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.110+0000 7efced9d3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efce80b5be0 0x7efce8143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.110+0000 7efced9d3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efce80b5be0 0x7efce8143ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51048/0 (socket says 172.21.15.62:51048) 2021-12-17T18:22:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.110+0000 7efced9d3700 1 -- 172.21.15.62:0/1882681025 learned_addr learned my addr 172.21.15.62:0/1882681025 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.110+0000 7efcec9d1700 1 --2- 172.21.15.62:0/1882681025 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efce80b47c0 0x7efce80b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.110+0000 7efced9d3700 1 -- 172.21.15.62:0/1882681025 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efce80b47c0 msgr2=0x7efce80b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:17.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.110+0000 7efced9d3700 1 --2- 172.21.15.62:0/1882681025 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efce80b47c0 0x7efce80b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.110+0000 7efced9d3700 1 -- 172.21.15.62:0/1882681025 >> v1:172.21.15.109:6789/0 conn(0x7efce805ca90 legacy=0x7efce80b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.110+0000 7efced9d3700 1 -- 172.21.15.62:0/1882681025 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce80b5250 con 0x7efce80b5be0 2021-12-17T18:22:17.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efced9d3700 1 --2- 172.21.15.62:0/1882681025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efce80b5be0 0x7efce8143ba0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7efce00032f0 tx=0x7efce0009290).ready entity=mon.0 client_cookie=59fd47ba9eeccff6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:17.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcdffff700 1 -- 172.21.15.62:0/1882681025 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efce000b8a0 con 0x7efce80b5be0 2021-12-17T18:22:17.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcdffff700 1 -- 172.21.15.62:0/1882681025 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce000ba00 con 0x7efce80b5be0 2021-12-17T18:22:17.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcdffff700 1 -- 172.21.15.62:0/1882681025 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efce000bb70 con 0x7efce80b5be0 2021-12-17T18:22:17.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcee1d4700 1 -- 172.21.15.62:0/1882681025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efce80b5be0 msgr2=0x7efce8143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcee1d4700 1 --2- 172.21.15.62:0/1882681025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efce80b5be0 0x7efce8143ba0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7efce00032f0 tx=0x7efce0009290).stop 2021-12-17T18:22:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcee1d4700 1 -- 172.21.15.62:0/1882681025 shutdown_connections 2021-12-17T18:22:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcee1d4700 1 --2- 172.21.15.62:0/1882681025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efce80b5be0 0x7efce8143ba0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcee1d4700 1 --2- 172.21.15.62:0/1882681025 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efce80b47c0 0x7efce80b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcee1d4700 1 -- 172.21.15.62:0/1882681025 >> 172.21.15.62:0/1882681025 conn(0x7efce805bcd0 msgr2=0x7efce8062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:17.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcee1d4700 1 -- 172.21.15.62:0/1882681025 shutdown_connections 2021-12-17T18:22:17.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcee1d4700 1 -- 172.21.15.62:0/1882681025 wait complete. 2021-12-17T18:22:17.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcee1d4700 1 Processor -- start 2021-12-17T18:22:17.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcee1d4700 1 -- start start 2021-12-17T18:22:17.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcee1d4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efce805ca90 0x7efce8064800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcee1d4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efce80b47c0 0x7efce80a3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcee1d4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efce80b5be0 0x7efce8144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcee1d4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce8063eb0 con 0x7efce80b47c0 2021-12-17T18:22:17.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcee1d4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce80657b0 con 0x7efce80b5be0 2021-12-17T18:22:17.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcee1d4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce8063530 con 0x7efce805ca90 2021-12-17T18:22:17.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcec9d1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efce80b47c0 0x7efce80a3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcec9d1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efce80b47c0 0x7efce80a3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51054/0 (socket says 172.21.15.62:51054) 2021-12-17T18:22:17.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efced1d2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efce805ca90 0x7efce8064800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efcec9d1700 1 -- 172.21.15.62:0/325387966 learned_addr learned my addr 172.21.15.62:0/325387966 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.114+0000 7efced9d3700 1 --2- 172.21.15.62:0/325387966 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efce80b5be0 0x7efce8144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.118+0000 7efcec9d1700 1 -- 172.21.15.62:0/325387966 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efce805ca90 msgr2=0x7efce8064800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.118+0000 7efcec9d1700 1 --2- 172.21.15.62:0/325387966 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efce805ca90 0x7efce8064800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.118+0000 7efcec9d1700 1 -- 172.21.15.62:0/325387966 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efce80b5be0 msgr2=0x7efce8144e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.118+0000 7efcec9d1700 1 --2- 172.21.15.62:0/325387966 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efce80b5be0 0x7efce8144e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.118+0000 7efcec9d1700 1 -- 172.21.15.62:0/325387966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce0009530 con 0x7efce80b47c0 2021-12-17T18:22:17.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.118+0000 7efced1d2700 1 --2- 172.21.15.62:0/325387966 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efce805ca90 0x7efce8064800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:22:17.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.118+0000 7efcec9d1700 1 --2- 172.21.15.62:0/325387966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efce80b47c0 0x7efce80a3120 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7efce400c000 tx=0x7efce4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:17.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.118+0000 7efcde7fc700 1 -- 172.21.15.62:0/325387966 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efce4010780 con 0x7efce80b47c0 2021-12-17T18:22:17.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.118+0000 7efcde7fc700 1 -- 172.21.15.62:0/325387966 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce40108e0 con 0x7efce80b47c0 2021-12-17T18:22:17.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.118+0000 7efcee1d4700 1 -- 172.21.15.62:0/325387966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce8065a50 con 0x7efce80b47c0 2021-12-17T18:22:17.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.118+0000 7efcde7fc700 1 -- 172.21.15.62:0/325387966 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efce4010c40 con 0x7efce80b47c0 2021-12-17T18:22:17.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.118+0000 7efcee1d4700 1 -- 172.21.15.62:0/325387966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce8145320 con 0x7efce80b47c0 2021-12-17T18:22:17.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.118+0000 7efcee1d4700 1 -- 172.21.15.62:0/325387966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce80671f0 con 0x7efce80b47c0 2021-12-17T18:22:17.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.118+0000 7efcde7fc700 1 -- 172.21.15.62:0/325387966 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efce401c460 con 0x7efce80b47c0 2021-12-17T18:22:17.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.118+0000 7efcde7fc700 1 --2- 172.21.15.62:0/325387966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efcd0053580 0x7efcd0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.118+0000 7efcde7fc700 1 -- 172.21.15.62:0/325387966 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efce406bc90 con 0x7efce80b47c0 2021-12-17T18:22:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.118+0000 7efced1d2700 1 --2- 172.21.15.62:0/325387966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efcd0053580 0x7efcd0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.122+0000 7efced1d2700 1 --2- 172.21.15.62:0/325387966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efcd0053580 0x7efcd0055a40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7efcd800d000 tx=0x7efcd8009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:17.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.126+0000 7efcde7fc700 1 -- 172.21.15.62:0/325387966 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efce80671f0 con 0x7efce80b47c0 2021-12-17T18:22:17.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.250+0000 7efcee1d4700 1 -- 172.21.15.62:0/325387966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efce80671f0 con 0x7efce80b47c0 2021-12-17T18:22:17.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.254+0000 7efcde7fc700 1 -- 172.21.15.62:0/325387966 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+10 (secure 0 0 0) 0x7efce80671f0 con 0x7efce80b47c0 2021-12-17T18:22:17.254 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:22:17.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.254+0000 7efcee1d4700 1 -- 172.21.15.62:0/325387966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efcd0053580 msgr2=0x7efcd0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.254+0000 7efcee1d4700 1 --2- 172.21.15.62:0/325387966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efcd0053580 0x7efcd0055a40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7efcd800d000 tx=0x7efcd8009040).stop 2021-12-17T18:22:17.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.254+0000 7efcee1d4700 1 -- 172.21.15.62:0/325387966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efce80b47c0 msgr2=0x7efce80a3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.254+0000 7efcee1d4700 1 --2- 172.21.15.62:0/325387966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efce80b47c0 0x7efce80a3120 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7efce400c000 tx=0x7efce4006df0).stop 2021-12-17T18:22:17.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.254+0000 7efcee1d4700 1 -- 172.21.15.62:0/325387966 shutdown_connections 2021-12-17T18:22:17.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.254+0000 7efcee1d4700 1 --2- 172.21.15.62:0/325387966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efcd0053580 0x7efcd0055a40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.254+0000 7efcee1d4700 1 --2- 172.21.15.62:0/325387966 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efce80b5be0 0x7efce8144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.254+0000 7efcee1d4700 1 --2- 172.21.15.62:0/325387966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efce80b47c0 0x7efce80a3120 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.254+0000 7efcee1d4700 1 --2- 172.21.15.62:0/325387966 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efce805ca90 0x7efce8064800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.254+0000 7efcee1d4700 1 -- 172.21.15.62:0/325387966 >> 172.21.15.62:0/325387966 conn(0x7efce805bcd0 msgr2=0x7efce80b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:17.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.254+0000 7efcee1d4700 1 -- 172.21.15.62:0/325387966 shutdown_connections 2021-12-17T18:22:17.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.254+0000 7efcee1d4700 1 -- 172.21.15.62:0/325387966 wait complete. 2021-12-17T18:22:17.267 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:22:17.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.382+0000 7fe19d791700 1 Processor -- start 2021-12-17T18:22:17.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.382+0000 7fe19d791700 1 -- start start 2021-12-17T18:22:17.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19d791700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe19805ca90 0x7fe198144520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19d791700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe19813a910 0x7fe19813adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19d791700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19805ce70 con 0x7fe198065a40 2021-12-17T18:22:17.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19d791700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1980604c0 con 0x7fe19813a910 2021-12-17T18:22:17.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19d791700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe198142080 con 0x7fe19805ca90 2021-12-17T18:22:17.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19cf90700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe19813a910 0x7fe19813adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe1977fe700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7fe198065a40 0x7fe198065ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:50958/0 (socket says 172.21.15.62:50958) 2021-12-17T18:22:17.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe197fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe19805ca90 0x7fe198144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe1977fe700 1 -- 172.21.15.62:0/1787494677 learned_addr learned my addr 172.21.15.62:0/1787494677 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:22:17.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19cf90700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe19813a910 0x7fe19813adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:57612/0 (socket says 172.21.15.62:57612) 2021-12-17T18:22:17.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19cf90700 1 -- 172.21.15.62:0/1787494677 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe19805ca90 msgr2=0x7fe198144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:17.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19cf90700 1 --2- 172.21.15.62:0/1787494677 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe19805ca90 0x7fe198144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19cf90700 1 -- 172.21.15.62:0/1787494677 >> v1:172.21.15.109:6789/0 conn(0x7fe198065a40 legacy=0x7fe198065ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19cf90700 1 -- 172.21.15.62:0/1787494677 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1980adb50 con 0x7fe19813a910 2021-12-17T18:22:17.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19cf90700 1 --2- 172.21.15.62:0/1787494677 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe19813a910 0x7fe19813adc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fe1900032f0 tx=0x7fe1900091d0).ready entity=mon.1 client_cookie=d7f92bb9ef6a3fca server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:17.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe196ffd700 1 -- 172.21.15.62:0/1787494677 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe19000b6c0 con 0x7fe19813a910 2021-12-17T18:22:17.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe196ffd700 1 -- 172.21.15.62:0/1787494677 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19000b820 con 0x7fe19813a910 2021-12-17T18:22:17.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe196ffd700 1 -- 172.21.15.62:0/1787494677 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe19000b990 con 0x7fe19813a910 2021-12-17T18:22:17.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19d791700 1 -- 172.21.15.62:0/1787494677 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe19813a910 msgr2=0x7fe19813adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19d791700 1 --2- 172.21.15.62:0/1787494677 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe19813a910 0x7fe19813adc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fe1900032f0 tx=0x7fe1900091d0).stop 2021-12-17T18:22:17.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19d791700 1 -- 172.21.15.62:0/1787494677 shutdown_connections 2021-12-17T18:22:17.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19d791700 1 --2- 172.21.15.62:0/1787494677 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe19813a910 0x7fe19813adc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19d791700 1 --2- 172.21.15.62:0/1787494677 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe19805ca90 0x7fe198144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19d791700 1 -- 172.21.15.62:0/1787494677 >> 172.21.15.62:0/1787494677 conn(0x7fe19805be70 msgr2=0x7fe198062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:17.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19d791700 1 -- 172.21.15.62:0/1787494677 shutdown_connections 2021-12-17T18:22:17.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.386+0000 7fe19d791700 1 -- 172.21.15.62:0/1787494677 wait complete. 2021-12-17T18:22:17.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.390+0000 7fe19d791700 1 Processor -- start 2021-12-17T18:22:17.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.390+0000 7fe19d791700 1 -- start start 2021-12-17T18:22:17.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.390+0000 7fe19d791700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe19805ca90 0x7fe198143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.390+0000 7fe19d791700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe198065a40 0x7fe198150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.390+0000 7fe19d791700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe19813a910 0x7fe198150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.390+0000 7fe19d791700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe198153720 con 0x7fe19805ca90 2021-12-17T18:22:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.390+0000 7fe19d791700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19813f150 con 0x7fe198065a40 2021-12-17T18:22:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.390+0000 7fe19d791700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe198141a60 con 0x7fe19813a910 2021-12-17T18:22:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.390+0000 7fe197fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe19805ca90 0x7fe198143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.394+0000 7fe197fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe19805ca90 0x7fe198143990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51066/0 (socket says 172.21.15.62:51066) 2021-12-17T18:22:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.394+0000 7fe197fff700 1 -- 172.21.15.62:0/3871612196 learned_addr learned my addr 172.21.15.62:0/3871612196 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.394+0000 7fe1977fe700 1 --2- 172.21.15.62:0/3871612196 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe198065a40 0x7fe198150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.394+0000 7fe19cf90700 1 --2- 172.21.15.62:0/3871612196 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe19813a910 0x7fe198150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.394+0000 7fe197fff700 1 -- 172.21.15.62:0/3871612196 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe19813a910 msgr2=0x7fe198150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.394+0000 7fe197fff700 1 --2- 172.21.15.62:0/3871612196 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe19813a910 0x7fe198150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.394+0000 7fe197fff700 1 -- 172.21.15.62:0/3871612196 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe198065a40 msgr2=0x7fe198150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.394+0000 7fe197fff700 1 --2- 172.21.15.62:0/3871612196 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe198065a40 0x7fe198150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.394+0000 7fe197fff700 1 -- 172.21.15.62:0/3871612196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe190009470 con 0x7fe19805ca90 2021-12-17T18:22:17.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.394+0000 7fe197fff700 1 --2- 172.21.15.62:0/3871612196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe19805ca90 0x7fe198143990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fe18800c000 tx=0x7fe188006d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:17.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.394+0000 7fe1957fa700 1 -- 172.21.15.62:0/3871612196 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1880104c0 con 0x7fe19805ca90 2021-12-17T18:22:17.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.394+0000 7fe1957fa700 1 -- 172.21.15.62:0/3871612196 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe188010620 con 0x7fe19805ca90 2021-12-17T18:22:17.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.394+0000 7fe19d791700 1 -- 172.21.15.62:0/3871612196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1980b80e0 con 0x7fe19805ca90 2021-12-17T18:22:17.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.394+0000 7fe1957fa700 1 -- 172.21.15.62:0/3871612196 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe188010980 con 0x7fe19805ca90 2021-12-17T18:22:17.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.394+0000 7fe19d791700 1 -- 172.21.15.62:0/3871612196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19813eec0 con 0x7fe19805ca90 2021-12-17T18:22:17.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.394+0000 7fe19d791700 1 -- 172.21.15.62:0/3871612196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe198153890 con 0x7fe19805ca90 2021-12-17T18:22:17.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.398+0000 7fe1957fa700 1 -- 172.21.15.62:0/3871612196 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe18801a070 con 0x7fe19805ca90 2021-12-17T18:22:17.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.398+0000 7fe1957fa700 1 --2- 172.21.15.62:0/3871612196 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe17c053640 0x7fe17c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.398+0000 7fe1957fa700 1 -- 172.21.15.62:0/3871612196 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe18806b6b0 con 0x7fe19805ca90 2021-12-17T18:22:17.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.398+0000 7fe1977fe700 1 --2- 172.21.15.62:0/3871612196 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe17c053640 0x7fe17c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.398+0000 7fe1977fe700 1 --2- 172.21.15.62:0/3871612196 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe17c053640 0x7fe17c055b00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fe18000d000 tx=0x7fe180009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:17.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.402+0000 7fe1957fa700 1 -- 172.21.15.62:0/3871612196 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe198153890 con 0x7fe19805ca90 2021-12-17T18:22:17.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.526+0000 7fe19d791700 1 -- 172.21.15.62:0/3871612196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe19813b060 con 0x7fe19805ca90 2021-12-17T18:22:17.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.526+0000 7fe1957fa700 1 -- 172.21.15.62:0/3871612196 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+10 (secure 0 0 0) 0x7fe1880427b0 con 0x7fe19805ca90 2021-12-17T18:22:17.528 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:22:17.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.530+0000 7fe19d791700 1 -- 172.21.15.62:0/3871612196 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe17c053640 msgr2=0x7fe17c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.530+0000 7fe19d791700 1 --2- 172.21.15.62:0/3871612196 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe17c053640 0x7fe17c055b00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fe18000d000 tx=0x7fe180009040).stop 2021-12-17T18:22:17.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.530+0000 7fe19d791700 1 -- 172.21.15.62:0/3871612196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe19805ca90 msgr2=0x7fe198143990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.530+0000 7fe19d791700 1 --2- 172.21.15.62:0/3871612196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe19805ca90 0x7fe198143990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fe18800c000 tx=0x7fe188006d90).stop 2021-12-17T18:22:17.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.530+0000 7fe19d791700 1 -- 172.21.15.62:0/3871612196 shutdown_connections 2021-12-17T18:22:17.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.530+0000 7fe19d791700 1 --2- 172.21.15.62:0/3871612196 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe17c053640 0x7fe17c055b00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.530+0000 7fe19d791700 1 --2- 172.21.15.62:0/3871612196 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe19813a910 0x7fe198150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.530+0000 7fe19d791700 1 --2- 172.21.15.62:0/3871612196 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe198065a40 0x7fe198150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.530+0000 7fe19d791700 1 --2- 172.21.15.62:0/3871612196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe19805ca90 0x7fe198143990 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.530+0000 7fe19d791700 1 -- 172.21.15.62:0/3871612196 >> 172.21.15.62:0/3871612196 conn(0x7fe19805be70 msgr2=0x7fe1980b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:17.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.530+0000 7fe19d791700 1 -- 172.21.15.62:0/3871612196 shutdown_connections 2021-12-17T18:22:17.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.530+0000 7fe19d791700 1 -- 172.21.15.62:0/3871612196 wait complete. 2021-12-17T18:22:17.542 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:22:17.542 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:22:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.642+0000 7f6f76fdd700 1 Processor -- start 2021-12-17T18:22:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.642+0000 7f6f76fdd700 1 -- start start 2021-12-17T18:22:17.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.646+0000 7f6f76fdd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6f70065630 0x7f6f70066bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.646+0000 7f6f76fdd700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6f700b1ff0 0x7f6f70144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.646+0000 7f6f76fdd700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f70065a10 con 0x7f6f70144d80 2021-12-17T18:22:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.646+0000 7f6f76fdd700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f700670c0 con 0x7f6f700b1ff0 2021-12-17T18:22:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.646+0000 7f6f76fdd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f70067330 con 0x7f6f70065630 2021-12-17T18:22:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.646+0000 7f6f757da700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6f700b1ff0 0x7f6f70144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.646+0000 7f6f767dc700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f6f70144d80 0x7f6f701404b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:50976/0 (socket says 172.21.15.62:50976) 2021-12-17T18:22:17.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.646+0000 7f6f767dc700 1 -- 172.21.15.62:0/160435961 learned_addr learned my addr 172.21.15.62:0/160435961 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:22:17.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.646+0000 7f6f75fdb700 1 --2- 172.21.15.62:0/160435961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6f70065630 0x7f6f70066bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.646+0000 7f6f757da700 1 -- 172.21.15.62:0/160435961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6f70065630 msgr2=0x7f6f70066bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:22:17.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.646+0000 7f6f757da700 1 --2- 172.21.15.62:0/160435961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6f70065630 0x7f6f70066bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.646+0000 7f6f757da700 1 -- 172.21.15.62:0/160435961 >> v1:172.21.15.109:6789/0 conn(0x7f6f70144d80 legacy=0x7f6f701404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.646+0000 7f6f757da700 1 -- 172.21.15.62:0/160435961 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f700675d0 con 0x7f6f700b1ff0 2021-12-17T18:22:17.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.646+0000 7f6f757da700 1 --2- 172.21.15.62:0/160435961 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6f700b1ff0 0x7f6f70144890 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f6f60002f70 tx=0x7f6f60006df0).ready entity=mon.1 client_cookie=c0a15478bcdf6a69 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:17.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.646+0000 7f6f74fd9700 1 -- 172.21.15.62:0/160435961 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6000d570 con 0x7f6f700b1ff0 2021-12-17T18:22:17.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.646+0000 7f6f74fd9700 1 -- 172.21.15.62:0/160435961 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f60000e90 con 0x7f6f700b1ff0 2021-12-17T18:22:17.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.646+0000 7f6f74fd9700 1 -- 172.21.15.62:0/160435961 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6000d8c0 con 0x7f6f700b1ff0 2021-12-17T18:22:17.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f76fdd700 1 -- 172.21.15.62:0/160435961 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6f700b1ff0 msgr2=0x7f6f70144890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f76fdd700 1 --2- 172.21.15.62:0/160435961 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6f700b1ff0 0x7f6f70144890 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f6f60002f70 tx=0x7f6f60006df0).stop 2021-12-17T18:22:17.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f76fdd700 1 -- 172.21.15.62:0/160435961 shutdown_connections 2021-12-17T18:22:17.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f76fdd700 1 --2- 172.21.15.62:0/160435961 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6f700b1ff0 0x7f6f70144890 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f76fdd700 1 --2- 172.21.15.62:0/160435961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6f70065630 0x7f6f70066bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f76fdd700 1 -- 172.21.15.62:0/160435961 >> 172.21.15.62:0/160435961 conn(0x7f6f7005c750 msgr2=0x7f6f7005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:17.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f76fdd700 1 -- 172.21.15.62:0/160435961 shutdown_connections 2021-12-17T18:22:17.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f76fdd700 1 -- 172.21.15.62:0/160435961 wait complete. 2021-12-17T18:22:17.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f76fdd700 1 Processor -- start 2021-12-17T18:22:17.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f76fdd700 1 -- start start 2021-12-17T18:22:17.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f76fdd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f70065630 0x7f6f700aca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f76fdd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6f700b1ff0 0x7f6f70155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f76fdd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6f70144d80 0x7f6f701564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f76fdd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f700aac60 con 0x7f6f70065630 2021-12-17T18:22:17.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f76fdd700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f700a2e80 con 0x7f6f700b1ff0 2021-12-17T18:22:17.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f76fdd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f700a3120 con 0x7f6f70144d80 2021-12-17T18:22:17.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f75fdb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f70065630 0x7f6f700aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f767dc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6f70144d80 0x7f6f701564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f757da700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6f700b1ff0 0x7f6f70155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f75fdb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f70065630 0x7f6f700aca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51080/0 (socket says 172.21.15.62:51080) 2021-12-17T18:22:17.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.650+0000 7f6f75fdb700 1 -- 172.21.15.62:0/435137932 learned_addr learned my addr 172.21.15.62:0/435137932 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:22:17.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.654+0000 7f6f767dc700 1 -- 172.21.15.62:0/435137932 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6f700b1ff0 msgr2=0x7f6f70155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.654+0000 7f6f767dc700 1 --2- 172.21.15.62:0/435137932 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6f700b1ff0 0x7f6f70155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.654+0000 7f6f767dc700 1 -- 172.21.15.62:0/435137932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f70065630 msgr2=0x7f6f700aca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.654+0000 7f6f767dc700 1 --2- 172.21.15.62:0/435137932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f70065630 0x7f6f700aca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.654+0000 7f6f767dc700 1 -- 172.21.15.62:0/435137932 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6000b180 con 0x7f6f70144d80 2021-12-17T18:22:17.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.654+0000 7f6f757da700 1 --2- 172.21.15.62:0/435137932 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6f700b1ff0 0x7f6f70155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:22:17.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.654+0000 7f6f767dc700 1 --2- 172.21.15.62:0/435137932 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6f70144d80 0x7f6f701564b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f6f700adbb0 tx=0x7f6f68007ef0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:17.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.654+0000 7f6f5effd700 1 -- 172.21.15.62:0/435137932 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6800ce30 con 0x7f6f70144d80 2021-12-17T18:22:17.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.654+0000 7f6f5effd700 1 -- 172.21.15.62:0/435137932 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f68005ba0 con 0x7f6f70144d80 2021-12-17T18:22:17.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.654+0000 7f6f76fdd700 1 -- 172.21.15.62:0/435137932 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f700aa820 con 0x7f6f70144d80 2021-12-17T18:22:17.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.654+0000 7f6f5effd700 1 -- 172.21.15.62:0/435137932 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f680070d0 con 0x7f6f70144d80 2021-12-17T18:22:17.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.654+0000 7f6f76fdd700 1 -- 172.21.15.62:0/435137932 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f70064a20 con 0x7f6f70144d80 2021-12-17T18:22:17.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.654+0000 7f6f76fdd700 1 -- 172.21.15.62:0/435137932 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f700573d0 con 0x7f6f70144d80 2021-12-17T18:22:17.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.654+0000 7f6f5effd700 1 -- 172.21.15.62:0/435137932 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6f6801a060 con 0x7f6f70144d80 2021-12-17T18:22:17.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.654+0000 7f6f5effd700 1 --2- 172.21.15.62:0/435137932 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6f500534f0 0x7f6f500559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:22:17.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.654+0000 7f6f5effd700 1 -- 172.21.15.62:0/435137932 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6f6806b020 con 0x7f6f70144d80 2021-12-17T18:22:17.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.658+0000 7f6f75fdb700 1 --2- 172.21.15.62:0/435137932 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6f500534f0 0x7f6f500559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:22:17.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.658+0000 7f6f75fdb700 1 --2- 172.21.15.62:0/435137932 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6f500534f0 0x7f6f500559b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f6f6c00b000 tx=0x7f6f6c006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:22:17.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.666+0000 7f6f5effd700 1 -- 172.21.15.62:0/435137932 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6f68042180 con 0x7f6f70144d80 2021-12-17T18:22:17.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.830+0000 7f6f76fdd700 1 -- 172.21.15.62:0/435137932 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f700b3e20 con 0x7f6f70144d80 2021-12-17T18:22:17.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.830+0000 7f6f5effd700 1 -- 172.21.15.62:0/435137932 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f6f68018070 con 0x7f6f70144d80 2021-12-17T18:22:17.834 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:22:17.834 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3056253780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3056253780},{"type":"v1","addr":"172.21.15.109:6835","nonce":3056253780}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:21:51.687672+0000","modified":"2021-12-17T18:21:52.715134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/3358597467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3358597467},{"type":"v1","addr":"172.21.15.62:6833","nonce":3358597467}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-12-17T18:22:17.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.834+0000 7f6f76fdd700 1 -- 172.21.15.62:0/435137932 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6f500534f0 msgr2=0x7f6f500559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.834+0000 7f6f76fdd700 1 --2- 172.21.15.62:0/435137932 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6f500534f0 0x7f6f500559b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f6f6c00b000 tx=0x7f6f6c006df0).stop 2021-12-17T18:22:17.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.834+0000 7f6f76fdd700 1 -- 172.21.15.62:0/435137932 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6f70144d80 msgr2=0x7f6f701564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:22:17.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.834+0000 7f6f76fdd700 1 --2- 172.21.15.62:0/435137932 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6f70144d80 0x7f6f701564b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f6f700adbb0 tx=0x7f6f68007ef0).stop 2021-12-17T18:22:17.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.834+0000 7f6f76fdd700 1 -- 172.21.15.62:0/435137932 shutdown_connections 2021-12-17T18:22:17.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.834+0000 7f6f76fdd700 1 --2- 172.21.15.62:0/435137932 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6f500534f0 0x7f6f500559b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.834+0000 7f6f76fdd700 1 --2- 172.21.15.62:0/435137932 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6f70144d80 0x7f6f701564b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.834+0000 7f6f76fdd700 1 --2- 172.21.15.62:0/435137932 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6f700b1ff0 0x7f6f70155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.834+0000 7f6f76fdd700 1 --2- 172.21.15.62:0/435137932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f70065630 0x7f6f700aca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:22:17.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.834+0000 7f6f76fdd700 1 -- 172.21.15.62:0/435137932 >> 172.21.15.62:0/435137932 conn(0x7f6f7005c750 msgr2=0x7f6f70141030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:22:17.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.834+0000 7f6f76fdd700 1 -- 172.21.15.62:0/435137932 shutdown_connections 2021-12-17T18:22:17.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:22:17.834+0000 7f6f76fdd700 1 -- 172.21.15.62:0/435137932 wait complete. 2021-12-17T18:22:17.838 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2021-12-17T18:22:18.051 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:21:51.687672+0000', 'modified': '2021-12-17T18:21:52.715134+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5646}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5646': {'gid': 5646, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/3358597467', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 3358597467}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 3358597467}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:22:18.051 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:22:18.052 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:22:18.171 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":5646,"want_state":"up:active","state":"up:active","rank_uptime":26.471999613000001,"mdsmap_epoch":21,"osdmap_epoch":51,"osdmap_epoch_barrier":51,"uptime":30.84518426} 2021-12-17T18:22:18.172 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 5646, "mdsmap_epoch": 21, "osdmap_epoch": 51, "osdmap_epoch_barrier": 51, "rank_uptime": 26.471999613, "state": "up:active", "uptime": 30.84518426, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:22:18.172 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:22:18.173 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-12-17T18:22:18.173 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-12-17T18:22:18.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:22:18.174 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:22:18.182 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:22:18.242 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:22:18.242 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:22:18.259 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:22:18.260 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:22:18.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:22:18.261 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:22:18.267 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:22:18.267 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:22:18.311 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:22:18.327 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:22:18.328 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:22:18.338 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:22:18.339 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:22:18.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:22:18.340 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:22:18.387 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2021-12-17T18:22:18.382+0000 7ff46d6eb080 -1 init, newargv = 0x556d0bc52050 newargc=9ceph-fuse[14303]: starting ceph client 2021-12-17T18:22:18.388 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr: 2021-12-17T18:22:18.397 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14303]: starting fuse 2021-12-17T18:22:19.447 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:22:19.465 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:22:19.466 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:22:19.524 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:22:19.525 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:22:19.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:22:19.527 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:22:19.532 INFO:teuthology.orchestra.run.smithi125.stdout:52 2021-12-17T18:22:19.532 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:22:19.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:22:19.533 DEBUG:teuthology.orchestra.run.smithi125:> sudo python3 -c ' 2021-12-17T18:22:19.533 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2021-12-17T18:22:19.534 DEBUG:teuthology.orchestra.run.smithi125:> import re 2021-12-17T18:22:19.534 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:22:19.535 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2021-12-17T18:22:19.535 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:22:19.535 DEBUG:teuthology.orchestra.run.smithi125:> def find_socket(client_name): 2021-12-17T18:22:19.536 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-12-17T18:22:19.536 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2021-12-17T18:22:19.537 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:22:19.537 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2021-12-17T18:22:19.537 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2021-12-17T18:22:19.538 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2021-12-17T18:22:19.538 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2021-12-17T18:22:19.539 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:22:19.539 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2021-12-17T18:22:19.540 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:22:19.540 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:22:19.540 DEBUG:teuthology.orchestra.run.smithi125:> return f 2021-12-17T18:22:19.541 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:22:19.541 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:22:19.542 DEBUG:teuthology.orchestra.run.smithi125:> print(find_socket("client.0")) 2021-12-17T18:22:19.542 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:22:19.584 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.14303.asok 2021-12-17T18:22:19.588 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14303.asok 2021-12-17T18:22:19.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:22:19.589 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14303.asok status 2021-12-17T18:22:19.724 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2021-12-17T18:22:19.724 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2021-12-17T18:22:19.724 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:22:19.724 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:22:19.725 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2021-12-17T18:22:19.725 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2021-12-17T18:22:19.725 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-12-17T18:22:19.725 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "14303", 2021-12-17T18:22:19.726 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2021-12-17T18:22:19.726 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:22:19.726 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2021-12-17T18:22:19.726 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2021-12-17T18:22:19.727 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5883, 2021-12-17T18:22:19.727 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2021-12-17T18:22:19.727 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2021-12-17T18:22:19.727 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2021-12-17T18:22:19.728 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 5883 2021-12-17T18:22:19.728 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:22:19.728 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:22:19.728 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:22:19.728 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:22:19.729 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 1508023784 2021-12-17T18:22:19.729 INFO:teuthology.orchestra.run.smithi125.stdout: } 2021-12-17T18:22:19.729 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:22:19.729 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:22:19.730 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:22:19.730 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:22:19.730 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 1508023784 2021-12-17T18:22:19.730 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:22:19.731 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.5883 172.21.15.125:0/1508023784", 2021-12-17T18:22:19.731 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "172.21.15.125:0/1508023784", 2021-12-17T18:22:19.731 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2021-12-17T18:22:19.731 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 21, 2021-12-17T18:22:19.731 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 51, 2021-12-17T18:22:19.732 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:22:19.732 INFO:teuthology.orchestra.run.smithi125.stdout: "blacklisted": false, 2021-12-17T18:22:19.732 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2021-12-17T18:22:19.732 INFO:teuthology.orchestra.run.smithi125.stdout:} 2021-12-17T18:22:19.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:22:19.734 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:22:19.735 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:22:19.742 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:22:19.743 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:22:19.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:22:19.744 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:22:33.900 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:22:33.903 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:22:33.906 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:22:33.909 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:22:33.911 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:23:04.013 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:23:04.017 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:23:04.019 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:23:04.022 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:23:04.024 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:23:12.333 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:23:12.334 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:23:12.353 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:23:12.372 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:23:12.394 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:23:12.415 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:23:12.436 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:23:12.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:12.437 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:23:12.438 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:23:12.446 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:23:12.447 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:23:12.448 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:23:12.448 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:23:12.448 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:23:12.464 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14303]: fuse finished with error 0 and tester_r 0 2021-12-17T18:23:12.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:12.466 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:23:12.467 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:23:12.474 INFO:teuthology.orchestra.run.smithi125.stdout:ext2/ext3 2021-12-17T18:23:12.475 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:23:12.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:23:12.592 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:23:12.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:12.600 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:23:12.601 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:23:12.608 INFO:teuthology.orchestra.run.smithi158.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:23:12.608 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:23:12.609 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-12-17T18:23:12.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:23:12.610 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:23:12.659 INFO:teuthology.orchestra.run.smithi158.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:23:12.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:23:12.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:12.662 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:23:12.662 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:23:12.669 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:23:12.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:23:12.671 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:23:12.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:23:12.672 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:23:12.679 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:23:12.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:23:12.681 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:23:12.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.788+0000 7fe2ca2f8700 1 Processor -- start 2021-12-17T18:23:12.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.788+0000 7fe2ca2f8700 1 -- start start 2021-12-17T18:23:12.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.788+0000 7fe2ca2f8700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe2c40b6060 0x7fe2c413fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:12.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.788+0000 7fe2ca2f8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c40b1540 con 0x7fe2c40afcf0 2021-12-17T18:23:12.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.788+0000 7fe2ca2f8700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c40b0160 con 0x7fe2c40b5c80 2021-12-17T18:23:12.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.788+0000 7fe2ca2f8700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c4143990 con 0x7fe2c40b6060 2021-12-17T18:23:12.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.788+0000 7fe2c9af7700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe2c40afcf0 0x7fe2c4143280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34670/0 (socket says 172.21.15.62:34670) 2021-12-17T18:23:12.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.788+0000 7fe2c9af7700 1 -- 172.21.15.62:0/1177688381 learned_addr learned my addr 172.21.15.62:0/1177688381 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:12.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2c8af5700 1 --2- 172.21.15.62:0/1177688381 >> v2:172.21.15.109:3300/0 conn(0x7fe2c40b6060 0x7fe2c413fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:12.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2b7fff700 1 -- 172.21.15.62:0/1177688381 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2492156148 0 0) 0x7fe2c40b1540 con 0x7fe2c40afcf0 2021-12-17T18:23:12.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2b7fff700 1 -- 172.21.15.62:0/1177688381 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2a8003260 con 0x7fe2c40afcf0 2021-12-17T18:23:12.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2c8af5700 1 -- 172.21.15.62:0/1177688381 >> v1:172.21.15.109:6789/0 conn(0x7fe2c40b5c80 legacy=0x7fe2c4142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:12.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2c8af5700 1 -- 172.21.15.62:0/1177688381 >> v1:172.21.15.62:6789/0 conn(0x7fe2c40afcf0 legacy=0x7fe2c4143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:12.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2c8af5700 1 -- 172.21.15.62:0/1177688381 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c40af5b0 con 0x7fe2c40b6060 2021-12-17T18:23:12.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2c8af5700 1 --2- 172.21.15.62:0/1177688381 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe2c40b6060 0x7fe2c413fb60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fe2c0002f70 tx=0x7fe2c0006df0).ready entity=mon.1 client_cookie=95603e36edaa85aa server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:12.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2b7fff700 1 -- 172.21.15.62:0/1177688381 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2c000d610 con 0x7fe2c40b6060 2021-12-17T18:23:12.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2b7fff700 1 -- 172.21.15.62:0/1177688381 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c0000e90 con 0x7fe2c40b6060 2021-12-17T18:23:12.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2b7fff700 1 -- 172.21.15.62:0/1177688381 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2c000d960 con 0x7fe2c40b6060 2021-12-17T18:23:12.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2ca2f8700 1 -- 172.21.15.62:0/1177688381 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe2c40b6060 msgr2=0x7fe2c413fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:12.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2ca2f8700 1 --2- 172.21.15.62:0/1177688381 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe2c40b6060 0x7fe2c413fb60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fe2c0002f70 tx=0x7fe2c0006df0).stop 2021-12-17T18:23:12.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2ca2f8700 1 -- 172.21.15.62:0/1177688381 shutdown_connections 2021-12-17T18:23:12.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2ca2f8700 1 --2- 172.21.15.62:0/1177688381 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe2c40b6060 0x7fe2c413fb60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:12.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2ca2f8700 1 -- 172.21.15.62:0/1177688381 >> 172.21.15.62:0/1177688381 conn(0x7fe2c405c750 msgr2=0x7fe2c405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:12.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2ca2f8700 1 -- 172.21.15.62:0/1177688381 shutdown_connections 2021-12-17T18:23:12.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2ca2f8700 1 -- 172.21.15.62:0/1177688381 wait complete. 2021-12-17T18:23:12.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2ca2f8700 1 Processor -- start 2021-12-17T18:23:12.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.792+0000 7fe2ca2f8700 1 -- start start 2021-12-17T18:23:12.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2ca2f8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2c40afcf0 0x7fe2c41467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:12.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2ca2f8700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe2c40b5c80 0x7fe2c41490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:12.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2ca2f8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2c40b6060 0x7fe2c413eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:12.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2ca2f8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c414a540 con 0x7fe2c40afcf0 2021-12-17T18:23:12.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2ca2f8700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c414a7e0 con 0x7fe2c40b5c80 2021-12-17T18:23:12.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2ca2f8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c414aa80 con 0x7fe2c40b6060 2021-12-17T18:23:12.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2c92f6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2c40afcf0 0x7fe2c41467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:12.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2c92f6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2c40afcf0 0x7fe2c41467f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51092/0 (socket says 172.21.15.62:51092) 2021-12-17T18:23:12.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2c92f6700 1 -- 172.21.15.62:0/2603277880 learned_addr learned my addr 172.21.15.62:0/2603277880 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:12.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2c8af5700 1 --2- 172.21.15.62:0/2603277880 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe2c40b5c80 0x7fe2c41490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:12.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2c9af7700 1 --2- 172.21.15.62:0/2603277880 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2c40b6060 0x7fe2c413eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:12.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2c92f6700 1 -- 172.21.15.62:0/2603277880 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2c40b6060 msgr2=0x7fe2c413eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:12.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2c92f6700 1 --2- 172.21.15.62:0/2603277880 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2c40b6060 0x7fe2c413eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:12.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2c92f6700 1 -- 172.21.15.62:0/2603277880 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe2c40b5c80 msgr2=0x7fe2c41490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:12.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2c92f6700 1 --2- 172.21.15.62:0/2603277880 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe2c40b5c80 0x7fe2c41490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:12.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2c92f6700 1 -- 172.21.15.62:0/2603277880 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c000b180 con 0x7fe2c40afcf0 2021-12-17T18:23:12.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2c92f6700 1 --2- 172.21.15.62:0/2603277880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2c40afcf0 0x7fe2c41467f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fe2c40afbd0 tx=0x7fe2b8007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:12.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2b67fc700 1 -- 172.21.15.62:0/2603277880 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2b8007030 con 0x7fe2c40afcf0 2021-12-17T18:23:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2b67fc700 1 -- 172.21.15.62:0/2603277880 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b8007190 con 0x7fe2c40afcf0 2021-12-17T18:23:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2ca2f8700 1 -- 172.21.15.62:0/2603277880 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c414a270 con 0x7fe2c40afcf0 2021-12-17T18:23:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2b67fc700 1 -- 172.21.15.62:0/2603277880 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2b8006510 con 0x7fe2c40afcf0 2021-12-17T18:23:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2ca2f8700 1 -- 172.21.15.62:0/2603277880 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c41495d0 con 0x7fe2c40afcf0 2021-12-17T18:23:12.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.796+0000 7fe2ca2f8700 1 -- 172.21.15.62:0/2603277880 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c40573d0 con 0x7fe2c40afcf0 2021-12-17T18:23:12.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.800+0000 7fe2b67fc700 1 -- 172.21.15.62:0/2603277880 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe2b8010030 con 0x7fe2c40afcf0 2021-12-17T18:23:12.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.800+0000 7fe2b67fc700 1 --2- 172.21.15.62:0/2603277880 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe2ac0536d0 0x7fe2ac055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:12.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.800+0000 7fe2b67fc700 1 -- 172.21.15.62:0/2603277880 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe2b806b9a0 con 0x7fe2c40afcf0 2021-12-17T18:23:12.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.804+0000 7fe2c8af5700 1 --2- 172.21.15.62:0/2603277880 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe2ac0536d0 0x7fe2ac055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:12.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.804+0000 7fe2c8af5700 1 --2- 172.21.15.62:0/2603277880 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe2ac0536d0 0x7fe2ac055b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fe2c001a000 tx=0x7fe2c0014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:12.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.808+0000 7fe2b67fc700 1 -- 172.21.15.62:0/2603277880 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe2b8042b00 con 0x7fe2c40afcf0 2021-12-17T18:23:12.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.935+0000 7fe2ca2f8700 1 -- 172.21.15.62:0/2603277880 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe2c4068f30 con 0x7fe2c40afcf0 2021-12-17T18:23:12.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.935+0000 7fe2b67fc700 1 -- 172.21.15.62:0/2603277880 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v51) v1 ==== 81+0+33695 (secure 0 0 0) 0x7fe2b8046120 con 0x7fe2c40afcf0 2021-12-17T18:23:12.943 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:12.943 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:23:12.944 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 51, 2021-12-17T18:23:12.945 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:23:12.945 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:23:12.945 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:21:52.690524+0000", 2021-12-17T18:23:12.946 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:23:12.946 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:23:12.946 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:23:12.946 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:23:12.947 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:23:12.947 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:23:12.947 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:23:12.947 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:23:12.948 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:23:12.948 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:23:12.948 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:23:12.948 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:23:12.948 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:23:12.949 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:23:12.949 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:23:12.949 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 10, 2021-12-17T18:23:12.949 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:23:12.950 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:23:12.950 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:23:12.950 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:23:12.950 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:23:12.951 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:12.951 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:23:12.951 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:23:12.951 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:23:12.951 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:23:12.952 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:23:12.953 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:23:12.953 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:23:12.953 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:23:12.953 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:23:12.954 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:23:12.954 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:23:12.954 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:23:12.954 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:23:12.955 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:23:12.955 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:23:12.956 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:23:12.956 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:23:12.956 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:23:12.956 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:23:12.956 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:23:12.957 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:23:12.957 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:23:12.957 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:23:12.957 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:12.958 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:23:12.958 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:23:12.958 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:23:12.958 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:23:12.959 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:23:12.959 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:23:12.959 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:23:12.959 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:23:12.960 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:23:12.960 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:23:12.960 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:23:12.960 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:23:12.961 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:23:12.961 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:23:12.962 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:23:12.962 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:23:12.962 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:23:12.963 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:23:12.963 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:23:12.963 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:23:12.963 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:23:12.963 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:23:12.964 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:23:12.964 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:23:12.964 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:23:12.964 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:23:12.965 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:23:12.965 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:12.965 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:23:12.966 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:23:12.966 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:23:12.966 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:23:12.966 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:23:12.967 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:23:12.967 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:23:12.967 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:23:12.967 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:23:12.968 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:23:12.968 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:23:12.968 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:23:12.968 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:23:12.969 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:12.971 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:23:12.971 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:23:12.971 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:12.972 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:12.972 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:12.972 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:23:12.972 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:23:12.973 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:23:12.973 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:23:12.973 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:23:12.973 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:23:12.974 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:23:12.974 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:23:12.974 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:23:12.974 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:23:12.975 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:23:12.975 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:23:12.975 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:23:12.975 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:23:12.976 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:23:12.976 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:23:12.977 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:23:12.977 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:23:12.977 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:23:12.978 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:23:12.978 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:23:12.978 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:23:12.979 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:23:12.979 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:12.979 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:23:12.979 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:23:12.980 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:23:12.980 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:23:12.980 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:23:12.980 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:23:12.980 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:23:12.981 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:23:12.981 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:23:12.981 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:23:12.981 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:23:12.982 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:23:12.982 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:23:12.982 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:23:12.982 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:23:12.983 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:23:12.983 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:23:12.983 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:23:12.983 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:23:12.984 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:23:12.984 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:23:12.984 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:23:12.984 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:23:12.984 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:23:12.985 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:23:12.985 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:23:12.986 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:23:12.986 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:12.986 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:23:12.986 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:23:12.987 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:23:12.987 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:23:12.987 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:23:12.987 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:23:12.987 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:23:12.988 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:23:12.988 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:23:12.988 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:23:12.988 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:23:12.989 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:23:12.989 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:23:12.989 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:23:12.989 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:12.989 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:12.990 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:12.990 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 9, 2021-12-17T18:23:12.990 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2021-12-17T18:23:12.990 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:21:50.101305+0000", 2021-12-17T18:23:12.991 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:23:12.991 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:23:12.991 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:23:12.991 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:23:12.992 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:23:12.992 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:23:12.992 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:23:12.992 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:23:12.993 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:23:12.993 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:23:12.994 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:23:12.994 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:23:12.994 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:23:12.994 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:23:12.995 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:23:12.995 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:23:12.995 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:23:12.996 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:23:12.996 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:23:12.996 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:23:12.996 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:12.997 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "50", 2021-12-17T18:23:12.997 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:23:12.997 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:23:12.997 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:23:12.997 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:23:12.998 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:23:12.998 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:23:12.998 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:23:12.998 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:23:12.999 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:23:12.999 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:23:12.999 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:23:12.999 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:23:13.000 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:23:13.000 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:23:13.000 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:23:13.000 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:23:13.001 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:23:13.001 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:23:13.001 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:23:13.002 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:23:13.002 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:23:13.002 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:23:13.003 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:23:13.003 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:23:13.004 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:23:13.004 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:23:13.004 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.004 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:23:13.005 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:23:13.005 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:23:13.006 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:23:13.006 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:23:13.006 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:23:13.007 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:23:13.007 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:23:13.007 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:23:13.007 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:23:13.008 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:23:13.008 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:23:13.008 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2021-12-17T18:23:13.009 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2021-12-17T18:23:13.009 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2021-12-17T18:23:13.009 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.010 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:23:13.010 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:23:13.010 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2021-12-17T18:23:13.011 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.011 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.011 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.011 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.012 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 10, 2021-12-17T18:23:13.012 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2021-12-17T18:23:13.012 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:21:51.041096+0000", 2021-12-17T18:23:13.012 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:23:13.013 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:23:13.013 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:23:13.013 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:23:13.013 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:23:13.014 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:23:13.014 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:23:13.014 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:23:13.015 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:23:13.015 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:23:13.015 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:23:13.015 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:23:13.016 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:23:13.016 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:23:13.016 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:23:13.017 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:23:13.017 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:23:13.017 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:23:13.017 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:23:13.018 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:23:13.018 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.018 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "51", 2021-12-17T18:23:13.019 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:23:13.019 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:23:13.019 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:23:13.020 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:23:13.020 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:23:13.020 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:23:13.021 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:23:13.021 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:23:13.021 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:23:13.021 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:23:13.022 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:23:13.022 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:23:13.022 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:23:13.023 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:23:13.023 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:23:13.023 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:23:13.024 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:23:13.024 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:23:13.024 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:23:13.024 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:23:13.025 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:23:13.025 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:23:13.025 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:23:13.025 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:23:13.026 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:23:13.026 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:23:13.027 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.027 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:23:13.027 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:23:13.028 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:23:13.028 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:23:13.028 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:23:13.028 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:23:13.029 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:23:13.029 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:23:13.029 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:23:13.030 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:23:13.030 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:23:13.030 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:23:13.031 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:23:13.031 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:23:13.031 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2021-12-17T18:23:13.031 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.032 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.032 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.032 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:23:13.033 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:23:13.033 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.033 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:23:13.034 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:23:13.034 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:13.034 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:13.035 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:13.035 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:13.035 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:13.035 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:13.036 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:13.036 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 49, 2021-12-17T18:23:13.036 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:13.037 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:13.037 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:13.037 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.037 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.038 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.038 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:23:13.038 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:13.038 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.039 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.039 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.039 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:23:13.039 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:13.040 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.040 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.040 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.041 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:13.041 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.041 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.041 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.042 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:23:13.042 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:13.042 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.043 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.043 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.043 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:23:13.043 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:13.044 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.044 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.044 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.045 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:13.045 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.045 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.045 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.046 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:23:13.046 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:13.046 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.047 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.047 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.047 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:23:13.047 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:13.048 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.048 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.048 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.048 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:13.049 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.049 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.049 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.050 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:23:13.050 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:13.050 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.051 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.051 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.052 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:23:13.052 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:13.052 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.053 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.053 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.053 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:23:13.054 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:23:13.054 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:23:13.054 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:23:13.054 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:13.055 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:13.055 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:13.055 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.055 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.056 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.056 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:23:13.056 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:23:13.057 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:13.057 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:13.057 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:13.057 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:13.058 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:13.058 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:13.058 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:13.058 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 49, 2021-12-17T18:23:13.059 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:13.059 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:13.060 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:13.060 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.060 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.061 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.061 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:23:13.061 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:13.061 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.062 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.062 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.062 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:23:13.063 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:13.063 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.063 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.063 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.064 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:13.064 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.064 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.064 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.065 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:23:13.065 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:13.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.066 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.066 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.066 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:23:13.066 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:13.067 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.067 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.067 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.068 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:13.068 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.069 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.069 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.069 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:23:13.069 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:13.070 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.070 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.070 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.071 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:23:13.071 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:13.071 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.071 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.072 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.072 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:13.072 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.072 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.073 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.073 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:23:13.073 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:13.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.074 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.074 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.074 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:23:13.075 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:13.075 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.075 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.076 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.076 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:23:13.076 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:23:13.077 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:23:13.077 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:23:13.077 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:13.078 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:13.078 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:13.078 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.079 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.079 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.079 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:23:13.079 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:23:13.080 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:13.080 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:13.080 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:13.080 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:13.081 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:13.081 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:13.081 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:13.081 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 49, 2021-12-17T18:23:13.082 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:13.082 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:13.082 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:13.083 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.083 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.083 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.084 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:23:13.084 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:13.084 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.084 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.085 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.085 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:23:13.085 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:13.085 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.086 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.086 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.086 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:13.087 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.087 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.087 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.087 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:23:13.088 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:13.088 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.088 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.089 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.089 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:23:13.089 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:13.089 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.089 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.090 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.090 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:13.090 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.090 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.091 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.091 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:23:13.091 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:13.092 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.092 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.092 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.093 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:23:13.093 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:13.093 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.093 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.094 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.094 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:13.094 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.094 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.095 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.095 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:23:13.095 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:13.096 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.096 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.096 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.097 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:23:13.097 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:13.097 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.098 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.098 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.098 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:23:13.098 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:23:13.098 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:23:13.099 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:23:13.099 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:13.099 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:13.100 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:13.100 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.100 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.101 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.101 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:23:13.101 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:23:13.101 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:13.101 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:13.102 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:13.102 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:13.102 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:13.102 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:13.103 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:13.103 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 48, 2021-12-17T18:23:13.103 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:13.103 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:13.104 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:13.104 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.104 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.104 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.105 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:23:13.105 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:13.105 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.105 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.106 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.106 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:23:13.106 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:13.106 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.106 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.107 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.107 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:13.107 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.107 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.108 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.108 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:23:13.108 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:13.109 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.109 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.109 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.109 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:23:13.110 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:13.110 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.110 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.110 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.110 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:13.111 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.111 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.111 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.112 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:23:13.112 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:13.112 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.112 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.113 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.113 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:23:13.113 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:13.114 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.114 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.115 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.115 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:13.115 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.116 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.116 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.117 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:23:13.117 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:13.118 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.118 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.118 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.119 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:23:13.119 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:13.120 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.120 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.121 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.121 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:23:13.122 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:23:13.122 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:23:13.123 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:23:13.123 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:13.123 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:13.124 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:13.124 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.124 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.125 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.125 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:23:13.126 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:23:13.126 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:13.127 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:13.127 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:13.127 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:13.128 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:13.128 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:13.129 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:13.129 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 49, 2021-12-17T18:23:13.130 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:13.130 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:13.131 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:13.131 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.131 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.132 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.132 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:23:13.133 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:13.133 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.133 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.134 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.134 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:23:13.135 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:13.135 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.136 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.136 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.136 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:13.137 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.137 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.137 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.137 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:23:13.138 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:13.138 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.138 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.139 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.139 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:23:13.139 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:13.140 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.140 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.140 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.141 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:13.141 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.142 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.142 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.142 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:23:13.143 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:13.143 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.144 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.145 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.145 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:23:13.145 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:13.146 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.146 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.147 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.147 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:13.148 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.148 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.149 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.149 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:23:13.149 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:13.150 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.150 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.151 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.151 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:23:13.151 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:13.152 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.152 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.152 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.152 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:23:13.153 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:23:13.153 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:23:13.153 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:23:13.153 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:13.154 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:13.154 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:13.154 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.154 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.155 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.155 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:23:13.155 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:23:13.155 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:13.156 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:13.156 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:13.156 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:13.156 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:13.156 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:13.157 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:13.157 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 49, 2021-12-17T18:23:13.157 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:13.157 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:13.158 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:13.158 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.158 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.158 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.159 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:23:13.159 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:13.159 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.159 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.159 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.160 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:23:13.160 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:13.160 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.160 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.161 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.161 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:13.161 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.161 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.161 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.162 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:23:13.162 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:13.162 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.162 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.163 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.163 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:23:13.163 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:13.163 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.163 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.164 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.164 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:13.164 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.164 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.165 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.165 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:23:13.165 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:13.165 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.166 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.166 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.166 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:23:13.166 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:13.167 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.167 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.167 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.167 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:13.168 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.168 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.168 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.169 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:23:13.169 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:13.169 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.169 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.170 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.170 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:23:13.170 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:13.170 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:23:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:23:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:23:13.172 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:23:13.172 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:13.172 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:13.172 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:13.173 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.173 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.173 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.173 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:23:13.174 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:23:13.174 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:13.174 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:13.174 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:13.174 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:13.175 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:13.175 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:13.175 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:13.175 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 49, 2021-12-17T18:23:13.176 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:13.176 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:13.176 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:13.176 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.176 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.177 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.177 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:23:13.177 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:13.177 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.178 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.178 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.178 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:23:13.178 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:13.178 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.179 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.179 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.179 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:13.179 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.180 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.180 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.180 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:23:13.180 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:13.181 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.181 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.181 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.181 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:23:13.182 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:13.182 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.182 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.182 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.183 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:13.183 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.183 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.183 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.183 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:23:13.184 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:13.184 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.184 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.184 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.185 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:23:13.185 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:13.185 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.185 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.186 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.186 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:13.186 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.186 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.186 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.187 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:23:13.187 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:13.187 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.187 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.188 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.188 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:23:13.188 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:13.188 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.189 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.189 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.189 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:23:13.189 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:23:13.190 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:23:13.190 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:23:13.190 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:13.190 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:13.190 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:13.191 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.191 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.191 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.191 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:23:13.192 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:23:13.192 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:13.192 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:13.192 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:13.193 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:13.193 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:13.193 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:13.193 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:13.193 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 48, 2021-12-17T18:23:13.194 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:13.194 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:13.194 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:13.194 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.195 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.195 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.195 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:23:13.195 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:13.196 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.196 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.196 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.196 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:23:13.197 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:13.197 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.197 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.197 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.197 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:13.198 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.198 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.198 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.198 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:23:13.199 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:13.199 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.199 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.199 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.200 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:23:13.200 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:13.200 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.200 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.200 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.201 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:13.201 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.201 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.201 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.202 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:23:13.202 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:13.202 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.202 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.203 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.203 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:23:13.203 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:13.203 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.203 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.204 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.204 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:13.204 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:13.204 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.205 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:13.205 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:23:13.205 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:13.205 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.206 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.206 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:13.206 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:23:13.206 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:13.206 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.207 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.207 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.207 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:23:13.207 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:23:13.208 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:23:13.208 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:23:13.209 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:13.209 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:13.209 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:13.209 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:13.209 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.210 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:23:13.210 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:23:13.210 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.210 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:23:13.211 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:13.211 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:13.211 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:13.211 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:13.212 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:13.212 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:23:13.212 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:13.212 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.212 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.213 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:23:13.213 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:13.213 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:13.213 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:13.214 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:13.214 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:13.214 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:23:13.214 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:13.215 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.215 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.215 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:23:13.215 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:13.216 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:13.216 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:13.216 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:13.216 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:13.217 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:23:13.217 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:13.217 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.217 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.217 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:23:13.218 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:13.218 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:13.218 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:13.218 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:13.219 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:13.219 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:23:13.219 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:13.219 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.220 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.220 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:23:13.220 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:13.220 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:13.221 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:13.221 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:13.221 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:13.221 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:23:13.222 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:13.222 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.222 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.222 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:23:13.223 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:13.223 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:13.223 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:13.223 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:13.223 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:13.224 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:23:13.224 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:13.224 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.224 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.225 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:23:13.225 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:13.225 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:13.225 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:13.226 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:13.226 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:13.226 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:23:13.226 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:13.227 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.227 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:13.227 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:23:13.227 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:13.227 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:13.228 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:13.228 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:13.228 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:13.228 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:23:13.229 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:13.229 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.229 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:23:13.229 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:23:13.229 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:23:13.230 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:23:13.230 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:23:13.230 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": {}, 2021-12-17T18:23:13.230 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:23:13.231 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:23:13.231 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:23:13.231 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:23:13.231 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:23:13.231 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:23:13.232 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:23:13.232 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:23:13.232 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:13.232 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:13.233 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:23:13.233 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:23:13.233 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:23:13.233 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:23:13.234 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:23:13.234 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:23:13.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.939+0000 7fe2ca2f8700 1 -- 172.21.15.62:0/2603277880 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe2ac0536d0 msgr2=0x7fe2ac055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:13.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.939+0000 7fe2ca2f8700 1 --2- 172.21.15.62:0/2603277880 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe2ac0536d0 0x7fe2ac055b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fe2c001a000 tx=0x7fe2c0014000).stop 2021-12-17T18:23:13.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.939+0000 7fe2ca2f8700 1 -- 172.21.15.62:0/2603277880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2c40afcf0 msgr2=0x7fe2c41467f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:13.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.939+0000 7fe2ca2f8700 1 --2- 172.21.15.62:0/2603277880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2c40afcf0 0x7fe2c41467f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fe2c40afbd0 tx=0x7fe2b8007c10).stop 2021-12-17T18:23:13.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.939+0000 7fe2ca2f8700 1 -- 172.21.15.62:0/2603277880 shutdown_connections 2021-12-17T18:23:13.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.939+0000 7fe2ca2f8700 1 --2- 172.21.15.62:0/2603277880 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe2ac0536d0 0x7fe2ac055b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.939+0000 7fe2ca2f8700 1 --2- 172.21.15.62:0/2603277880 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2c40b6060 0x7fe2c413eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.939+0000 7fe2ca2f8700 1 --2- 172.21.15.62:0/2603277880 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe2c40b5c80 0x7fe2c41490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.939+0000 7fe2ca2f8700 1 --2- 172.21.15.62:0/2603277880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2c40afcf0 0x7fe2c41467f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.939+0000 7fe2ca2f8700 1 -- 172.21.15.62:0/2603277880 >> 172.21.15.62:0/2603277880 conn(0x7fe2c405c750 msgr2=0x7fe2c405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:13.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.939+0000 7fe2ca2f8700 1 -- 172.21.15.62:0/2603277880 shutdown_connections 2021-12-17T18:23:13.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:12.939+0000 7fe2ca2f8700 1 -- 172.21.15.62:0/2603277880 wait complete. 2021-12-17T18:23:13.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:23:13.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff8294700 1 Processor -- start 2021-12-17T18:23:13.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff8294700 1 -- start start 2021-12-17T18:23:13.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff8294700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f0ff00b21f0 0x7f0ff014aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:13.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff8294700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0ff00a7bb0 0x7f0ff0067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:13.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff8294700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff00b2ce0 con 0x7f0ff00b1730 2021-12-17T18:23:13.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff8294700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff0147870 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff8294700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff00b2f10 con 0x7f0ff00b21f0 2021-12-17T18:23:13.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff6831700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0ff00a7bb0 0x7f0ff0067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:13.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff6030700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f0ff00b21f0 0x7f0ff014aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:13.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff6030700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f0ff00b21f0 0x7f0ff014aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:57652/0 (socket says 172.21.15.62:57652) 2021-12-17T18:23:13.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff6831700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0ff00a7bb0 0x7f0ff0067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51104/0 (socket says 172.21.15.62:51104) 2021-12-17T18:23:13.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff6030700 1 -- 172.21.15.62:0/3776314565 learned_addr learned my addr 172.21.15.62:0/3776314565 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:13.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff582f700 1 --1- 172.21.15.62:0/3776314565 >> v1:172.21.15.109:6789/0 conn(0x7f0ff00b1730 0x7f0ff00ace90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:51000/0 (socket says 172.21.15.62:51000) 2021-12-17T18:23:13.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff6831700 1 -- 172.21.15.62:0/3776314565 >> v2:172.21.15.109:3300/0 conn(0x7f0ff00b21f0 msgr2=0x7f0ff014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:13.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff6831700 1 --2- 172.21.15.62:0/3776314565 >> v2:172.21.15.109:3300/0 conn(0x7f0ff00b21f0 0x7f0ff014aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff6831700 1 -- 172.21.15.62:0/3776314565 >> v1:172.21.15.109:6789/0 conn(0x7f0ff00b1730 legacy=0x7f0ff00ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:13.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff6831700 1 -- 172.21.15.62:0/3776314565 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff00aca60 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff6030700 1 --2- 172.21.15.62:0/3776314565 >> v2:172.21.15.109:3300/0 conn(0x7f0ff00b21f0 0x7f0ff014aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:13.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff6831700 1 --2- 172.21.15.62:0/3776314565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ff00a7bb0 0x7f0ff0067120 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f0ff00b1c00 tx=0x7f0fe0006df0).ready entity=mon.0 client_cookie=408b380fe5ef6bc8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:13.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff502e700 1 -- 172.21.15.62:0/3776314565 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fe000d5c0 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff502e700 1 -- 172.21.15.62:0/3776314565 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe0000e90 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.351+0000 7f0ff502e700 1 -- 172.21.15.62:0/3776314565 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fe000d910 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.355+0000 7f0ff8294700 1 -- 172.21.15.62:0/3776314565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ff00a7bb0 msgr2=0x7f0ff0067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:13.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.355+0000 7f0ff8294700 1 --2- 172.21.15.62:0/3776314565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ff00a7bb0 0x7f0ff0067120 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f0ff00b1c00 tx=0x7f0fe0006df0).stop 2021-12-17T18:23:13.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.355+0000 7f0ff8294700 1 -- 172.21.15.62:0/3776314565 shutdown_connections 2021-12-17T18:23:13.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.355+0000 7f0ff8294700 1 --2- 172.21.15.62:0/3776314565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ff00a7bb0 0x7f0ff0067120 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.355+0000 7f0ff8294700 1 --2- 172.21.15.62:0/3776314565 >> v2:172.21.15.109:3300/0 conn(0x7f0ff00b21f0 0x7f0ff014aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.355+0000 7f0ff8294700 1 -- 172.21.15.62:0/3776314565 >> 172.21.15.62:0/3776314565 conn(0x7f0ff005f730 msgr2=0x7f0ff005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:13.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.355+0000 7f0ff8294700 1 -- 172.21.15.62:0/3776314565 shutdown_connections 2021-12-17T18:23:13.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.355+0000 7f0ff8294700 1 -- 172.21.15.62:0/3776314565 wait complete. 2021-12-17T18:23:13.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.355+0000 7f0ff8294700 1 Processor -- start 2021-12-17T18:23:13.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.355+0000 7f0ff8294700 1 -- start start 2021-12-17T18:23:13.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff8294700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0ff00a7bb0 0x7f0ff014bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:13.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff8294700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ff00b1730 0x7f0ff0146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:13.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff8294700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ff00b21f0 0x7f0ff0146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:13.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff8294700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff0064250 con 0x7f0ff00b1730 2021-12-17T18:23:13.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff8294700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff00ab930 con 0x7f0ff00b21f0 2021-12-17T18:23:13.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff8294700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff0064480 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff582f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ff00b1730 0x7f0ff0146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:13.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff6030700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0ff00a7bb0 0x7f0ff014bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:13.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff6831700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ff00b21f0 0x7f0ff0146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:13.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff6030700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0ff00a7bb0 0x7f0ff014bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:44808/0 (socket says 172.21.15.62:44808) 2021-12-17T18:23:13.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff6030700 1 -- 172.21.15.62:0/565472371 learned_addr learned my addr 172.21.15.62:0/565472371 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:13.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff6030700 1 -- 172.21.15.62:0/565472371 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ff00b21f0 msgr2=0x7f0ff0146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:13.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff6030700 1 --2- 172.21.15.62:0/565472371 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ff00b21f0 0x7f0ff0146d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff6030700 1 -- 172.21.15.62:0/565472371 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ff00b1730 msgr2=0x7f0ff0146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:13.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff6030700 1 --2- 172.21.15.62:0/565472371 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ff00b1730 0x7f0ff0146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff6030700 1 -- 172.21.15.62:0/565472371 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd800b1e0 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff6831700 1 --2- 172.21.15.62:0/565472371 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ff00b21f0 0x7f0ff0146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:13.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff582f700 1 --2- 172.21.15.62:0/565472371 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ff00b1730 0x7f0ff0146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:13.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff6030700 1 --2- 172.21.15.62:0/565472371 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0ff00a7bb0 0x7f0ff014bb20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f0fd800c000 tx=0x7f0fd8006eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:13.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0fef7fe700 1 -- 172.21.15.62:0/565472371 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fd800b420 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0fef7fe700 1 -- 172.21.15.62:0/565472371 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd8012600 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff8294700 1 -- 172.21.15.62:0/565472371 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe000b180 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0fef7fe700 1 -- 172.21.15.62:0/565472371 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fd8012960 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.359+0000 7f0ff8294700 1 -- 172.21.15.62:0/565472371 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff0147240 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.363+0000 7f0ff8294700 1 -- 172.21.15.62:0/565472371 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff0064640 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.363+0000 7f0fef7fe700 1 -- 172.21.15.62:0/565472371 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0fd8022070 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.363+0000 7f0fef7fe700 1 --2- 172.21.15.62:0/565472371 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0fd40536a0 0x7f0fd4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:13.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.363+0000 7f0fef7fe700 1 -- 172.21.15.62:0/565472371 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0fd806bd40 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.363+0000 7f0ff582f700 1 --2- 172.21.15.62:0/565472371 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0fd40536a0 0x7f0fd4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:13.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.363+0000 7f0ff582f700 1 --2- 172.21.15.62:0/565472371 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0fd40536a0 0x7f0fd4055b60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f0fe800d000 tx=0x7f0fe8007f90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.375+0000 7f0fef7fe700 1 -- 172.21.15.62:0/565472371 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0fd8042d90 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.539+0000 7f0ff8294700 1 -- 172.21.15.62:0/565472371 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ff00ad5a0 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.543+0000 7f0fef7fe700 1 -- 172.21.15.62:0/565472371 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f0fd80463b0 con 0x7f0ff00a7bb0 2021-12-17T18:23:13.548 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:13.548 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3056253780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3056253780},{"type":"v1","addr":"172.21.15.109:6835","nonce":3056253780}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:21:51.687672+0000","modified":"2021-12-17T18:21:52.715134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/3358597467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3358597467},{"type":"v1","addr":"172.21.15.62:6833","nonce":3358597467}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-12-17T18:23:13.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.543+0000 7f0ff8294700 1 -- 172.21.15.62:0/565472371 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0fd40536a0 msgr2=0x7f0fd4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:13.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.543+0000 7f0ff8294700 1 --2- 172.21.15.62:0/565472371 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0fd40536a0 0x7f0fd4055b60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f0fe800d000 tx=0x7f0fe8007f90).stop 2021-12-17T18:23:13.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.543+0000 7f0ff8294700 1 -- 172.21.15.62:0/565472371 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0ff00a7bb0 msgr2=0x7f0ff014bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:13.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.543+0000 7f0ff8294700 1 --2- 172.21.15.62:0/565472371 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0ff00a7bb0 0x7f0ff014bb20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f0fd800c000 tx=0x7f0fd8006eb0).stop 2021-12-17T18:23:13.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.543+0000 7f0ff8294700 1 -- 172.21.15.62:0/565472371 shutdown_connections 2021-12-17T18:23:13.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.543+0000 7f0ff8294700 1 --2- 172.21.15.62:0/565472371 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0fd40536a0 0x7f0fd4055b60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.543+0000 7f0ff8294700 1 --2- 172.21.15.62:0/565472371 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0ff00b21f0 0x7f0ff0146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.543+0000 7f0ff8294700 1 --2- 172.21.15.62:0/565472371 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ff00b1730 0x7f0ff0146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.543+0000 7f0ff8294700 1 --2- 172.21.15.62:0/565472371 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0ff00a7bb0 0x7f0ff014bb20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.543+0000 7f0ff8294700 1 -- 172.21.15.62:0/565472371 >> 172.21.15.62:0/565472371 conn(0x7f0ff005f730 msgr2=0x7f0ff00afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:13.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.543+0000 7f0ff8294700 1 -- 172.21.15.62:0/565472371 shutdown_connections 2021-12-17T18:23:13.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.543+0000 7f0ff8294700 1 -- 172.21.15.62:0/565472371 wait complete. 2021-12-17T18:23:13.553 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2021-12-17T18:23:13.561 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-12-17T18:23:13.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf3fff700 1 Processor -- start 2021-12-17T18:23:13.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf3fff700 1 -- start start 2021-12-17T18:23:13.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf3fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7faaf40b1d10 0x7faaf4147b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:13.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf3fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faaf40b20f0 0x7faaf4144580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:13.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf3fff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf40ad7a0 con 0x7faaf40afba0 2021-12-17T18:23:13.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf3fff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf40ac420 con 0x7faaf40b1d10 2021-12-17T18:23:13.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf3fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4148430 con 0x7faaf40b20f0 2021-12-17T18:23:13.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf37fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faaf40b20f0 0x7faaf4144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:13.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf2ffd700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7faaf40b1d10 0x7faaf4147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:13.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf37fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faaf40b20f0 0x7faaf4144580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:44818/0 (socket says 172.21.15.62:44818) 2021-12-17T18:23:13.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf37fe700 1 -- 172.21.15.62:0/4217328610 learned_addr learned my addr 172.21.15.62:0/4217328610 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:13.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf37fe700 1 -- 172.21.15.62:0/4217328610 >> v2:172.21.15.109:3300/0 conn(0x7faaf40b1d10 msgr2=0x7faaf4147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:13.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf37fe700 1 --2- 172.21.15.62:0/4217328610 >> v2:172.21.15.109:3300/0 conn(0x7faaf40b1d10 0x7faaf4147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf37fe700 1 -- 172.21.15.62:0/4217328610 >> v1:172.21.15.109:6789/0 conn(0x7faaf40afba0 legacy=0x7faaf414a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:13.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf37fe700 1 -- 172.21.15.62:0/4217328610 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf41473c0 con 0x7faaf40b20f0 2021-12-17T18:23:13.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf2ffd700 1 --2- 172.21.15.62:0/4217328610 >> v2:172.21.15.109:3300/0 conn(0x7faaf40b1d10 0x7faaf4147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:13.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf37fe700 1 --2- 172.21.15.62:0/4217328610 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faaf40b20f0 0x7faaf4144580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7faaec002f70 tx=0x7faaec006eb0).ready entity=mon.2 client_cookie=f1fe2c35841bf253 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:13.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf1ffb700 1 -- 172.21.15.62:0/4217328610 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaec00d570 con 0x7faaf40b20f0 2021-12-17T18:23:13.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf1ffb700 1 -- 172.21.15.62:0/4217328610 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec000e90 con 0x7faaf40b20f0 2021-12-17T18:23:13.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.663+0000 7faaf1ffb700 1 -- 172.21.15.62:0/4217328610 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaec00d900 con 0x7faaf40b20f0 2021-12-17T18:23:13.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.667+0000 7faaf3fff700 1 -- 172.21.15.62:0/4217328610 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faaf40b20f0 msgr2=0x7faaf4144580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:13.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.667+0000 7faaf3fff700 1 --2- 172.21.15.62:0/4217328610 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faaf40b20f0 0x7faaf4144580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7faaec002f70 tx=0x7faaec006eb0).stop 2021-12-17T18:23:13.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.667+0000 7faaf3fff700 1 -- 172.21.15.62:0/4217328610 shutdown_connections 2021-12-17T18:23:13.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.667+0000 7faaf3fff700 1 --2- 172.21.15.62:0/4217328610 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faaf40b20f0 0x7faaf4144580 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.667+0000 7faaf3fff700 1 --2- 172.21.15.62:0/4217328610 >> v2:172.21.15.109:3300/0 conn(0x7faaf40b1d10 0x7faaf4147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.667+0000 7faaf3fff700 1 -- 172.21.15.62:0/4217328610 >> 172.21.15.62:0/4217328610 conn(0x7faaf40623c0 msgr2=0x7faaf40627d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:13.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.667+0000 7faaf3fff700 1 -- 172.21.15.62:0/4217328610 shutdown_connections 2021-12-17T18:23:13.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.667+0000 7faaf3fff700 1 -- 172.21.15.62:0/4217328610 wait complete. 2021-12-17T18:23:13.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.667+0000 7faaf3fff700 1 Processor -- start 2021-12-17T18:23:13.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.667+0000 7faaf3fff700 1 -- start start 2021-12-17T18:23:13.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.667+0000 7faaf3fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faaf40afba0 0x7faaf40b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:13.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.667+0000 7faaf3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaf40b1d10 0x7faaf4145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:13.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.667+0000 7faaf3fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faaf40b20f0 0x7faaf4145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:13.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.667+0000 7faaf3fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4063a50 con 0x7faaf40b1d10 2021-12-17T18:23:13.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.667+0000 7faaf3fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4145330 con 0x7faaf40b20f0 2021-12-17T18:23:13.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.667+0000 7faaf3fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40637b0 con 0x7faaf40afba0 2021-12-17T18:23:13.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.667+0000 7faaf27fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaf40b1d10 0x7faaf4145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:13.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faaf2ffd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faaf40afba0 0x7faaf40b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:13.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faaf27fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaf40b1d10 0x7faaf4145790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51120/0 (socket says 172.21.15.62:51120) 2021-12-17T18:23:13.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faaf27fc700 1 -- 172.21.15.62:0/3972250080 learned_addr learned my addr 172.21.15.62:0/3972250080 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:13.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faaf37fe700 1 --2- 172.21.15.62:0/3972250080 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faaf40b20f0 0x7faaf4145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:13.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faaf27fc700 1 -- 172.21.15.62:0/3972250080 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faaf40afba0 msgr2=0x7faaf40b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:13.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faaf27fc700 1 --2- 172.21.15.62:0/3972250080 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faaf40afba0 0x7faaf40b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faaf27fc700 1 -- 172.21.15.62:0/3972250080 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faaf40b20f0 msgr2=0x7faaf4145c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:13.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faaf27fc700 1 --2- 172.21.15.62:0/3972250080 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faaf40b20f0 0x7faaf4145c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:13.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faaf27fc700 1 -- 172.21.15.62:0/3972250080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae800b180 con 0x7faaf40b1d10 2021-12-17T18:23:13.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faaf2ffd700 1 --2- 172.21.15.62:0/3972250080 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faaf40afba0 0x7faaf40b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:13.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faaf37fe700 1 --2- 172.21.15.62:0/3972250080 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faaf40b20f0 0x7faaf4145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:13.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faaf27fc700 1 --2- 172.21.15.62:0/3972250080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaf40b1d10 0x7faaf4145790 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7faaf4061ab0 tx=0x7faae4007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:13.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faae3fff700 1 -- 172.21.15.62:0/3972250080 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faae4006aa0 con 0x7faaf40b1d10 2021-12-17T18:23:13.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faae3fff700 1 -- 172.21.15.62:0/3972250080 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae4006c00 con 0x7faaf40b1d10 2021-12-17T18:23:13.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faaf3fff700 1 -- 172.21.15.62:0/3972250080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaec00b1e0 con 0x7faaf40b1d10 2021-12-17T18:23:13.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faae3fff700 1 -- 172.21.15.62:0/3972250080 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faae4007030 con 0x7faaf40b1d10 2021-12-17T18:23:13.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faaf3fff700 1 -- 172.21.15.62:0/3972250080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf40b3e10 con 0x7faaf40b1d10 2021-12-17T18:23:13.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faae3fff700 1 -- 172.21.15.62:0/3972250080 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faae4010030 con 0x7faaf40b1d10 2021-12-17T18:23:13.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faaf3fff700 1 -- 172.21.15.62:0/3972250080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf4147660 con 0x7faaf40b1d10 2021-12-17T18:23:13.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faae3fff700 1 --2- 172.21.15.62:0/3972250080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faad00536a0 0x7faad0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:13.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.671+0000 7faae3fff700 1 -- 172.21.15.62:0/3972250080 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faae406b7f0 con 0x7faaf40b1d10 2021-12-17T18:23:13.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.675+0000 7faaf2ffd700 1 --2- 172.21.15.62:0/3972250080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faad00536a0 0x7faad0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:13.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.675+0000 7faaf2ffd700 1 --2- 172.21.15.62:0/3972250080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faad00536a0 0x7faad0055b60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7faae800b000 tx=0x7faae8006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:13.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.675+0000 7faae3fff700 1 -- 172.21.15.62:0/3972250080 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faae4042850 con 0x7faaf40b1d10 2021-12-17T18:23:13.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:13.839+0000 7faaf3fff700 1 -- 172.21.15.62:0/3972250080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7faaf40573d0 con 0x7faaf40b1d10 2021-12-17T18:23:14.811 INFO:tasks.ceph.mon.a.smithi062.stderr:2021-12-17T18:23:14.807+0000 7f8d3b366700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-12-17T18:23:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.819+0000 7faae3fff700 1 -- 172.21.15.62:0/3972250080 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7faae4045e70 con 0x7faaf40b1d10 2021-12-17T18:23:14.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.823+0000 7faaf3fff700 1 -- 172.21.15.62:0/3972250080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faad00536a0 msgr2=0x7faad0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:14.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.823+0000 7faaf3fff700 1 --2- 172.21.15.62:0/3972250080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faad00536a0 0x7faad0055b60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7faae800b000 tx=0x7faae8006df0).stop 2021-12-17T18:23:14.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.823+0000 7faaf3fff700 1 -- 172.21.15.62:0/3972250080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaf40b1d10 msgr2=0x7faaf4145790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:14.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.823+0000 7faaf3fff700 1 --2- 172.21.15.62:0/3972250080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaf40b1d10 0x7faaf4145790 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7faaf4061ab0 tx=0x7faae4007f90).stop 2021-12-17T18:23:14.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.823+0000 7faaf3fff700 1 -- 172.21.15.62:0/3972250080 shutdown_connections 2021-12-17T18:23:14.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.823+0000 7faaf3fff700 1 --2- 172.21.15.62:0/3972250080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faad00536a0 0x7faad0055b60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:14.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.823+0000 7faaf3fff700 1 --2- 172.21.15.62:0/3972250080 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faaf40b20f0 0x7faaf4145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:14.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.823+0000 7faaf3fff700 1 --2- 172.21.15.62:0/3972250080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaf40b1d10 0x7faaf4145790 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:14.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.823+0000 7faaf3fff700 1 --2- 172.21.15.62:0/3972250080 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faaf40afba0 0x7faaf40b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:14.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.823+0000 7faaf3fff700 1 -- 172.21.15.62:0/3972250080 >> 172.21.15.62:0/3972250080 conn(0x7faaf40623c0 msgr2=0x7faaf40ae280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:14.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.823+0000 7faaf3fff700 1 -- 172.21.15.62:0/3972250080 shutdown_connections 2021-12-17T18:23:14.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.823+0000 7faaf3fff700 1 -- 172.21.15.62:0/3972250080 wait complete. 2021-12-17T18:23:14.833 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-12-17T18:23:14.846 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:23:14.871 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:23:14.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.943+0000 7f783759e700 1 Processor -- start 2021-12-17T18:23:14.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.943+0000 7f783759e700 1 -- start start 2021-12-17T18:23:14.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f783759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7838067830 0x7f78380b1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:14.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f783759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78380b0690 0x7f78381438c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:14.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f783759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78380b2570 con 0x7f7838143db0 2021-12-17T18:23:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f783759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7838067c10 con 0x7f7838067830 2021-12-17T18:23:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f783759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7838147520 con 0x7f78380b0690 2021-12-17T18:23:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f783659c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7838067830 0x7f78380b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f7836d9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7838143db0 0x7f783813cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34722/0 (socket says 172.21.15.62:34722) 2021-12-17T18:23:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f7836d9d700 1 -- 172.21.15.62:0/1424899737 learned_addr learned my addr 172.21.15.62:0/1424899737 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f782ffff700 1 --2- 172.21.15.62:0/1424899737 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78380b0690 0x7f78381438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f7835d9b700 1 -- 172.21.15.62:0/1424899737 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807734999 0 0) 0x7f78380b2570 con 0x7f7838143db0 2021-12-17T18:23:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f7835d9b700 1 -- 172.21.15.62:0/1424899737 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7818003260 con 0x7f7838143db0 2021-12-17T18:23:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f783659c700 1 -- 172.21.15.62:0/1424899737 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78380b0690 msgr2=0x7f78381438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f783659c700 1 --2- 172.21.15.62:0/1424899737 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78380b0690 0x7f78381438c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f783659c700 1 -- 172.21.15.62:0/1424899737 >> v1:172.21.15.62:6789/0 conn(0x7f7838143db0 legacy=0x7f783813cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:14.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f783659c700 1 -- 172.21.15.62:0/1424899737 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7838143420 con 0x7f7838067830 2021-12-17T18:23:14.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f783659c700 1 --2- 172.21.15.62:0/1424899737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7838067830 0x7f78380b1360 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f7828002f70 tx=0x7f7828006df0).ready entity=mon.0 client_cookie=3a4582c76a04a33d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:14.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f7835d9b700 1 -- 172.21.15.62:0/1424899737 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f782800d4a0 con 0x7f7838067830 2021-12-17T18:23:14.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f7835d9b700 1 -- 172.21.15.62:0/1424899737 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7828000e90 con 0x7f7838067830 2021-12-17T18:23:14.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.947+0000 7f7835d9b700 1 -- 172.21.15.62:0/1424899737 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f782800d7f0 con 0x7f7838067830 2021-12-17T18:23:14.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.951+0000 7f783759e700 1 -- 172.21.15.62:0/1424899737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7838067830 msgr2=0x7f78380b1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.951+0000 7f783759e700 1 --2- 172.21.15.62:0/1424899737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7838067830 0x7f78380b1360 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f7828002f70 tx=0x7f7828006df0).stop 2021-12-17T18:23:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.951+0000 7f783759e700 1 -- 172.21.15.62:0/1424899737 shutdown_connections 2021-12-17T18:23:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.951+0000 7f783759e700 1 --2- 172.21.15.62:0/1424899737 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78380b0690 0x7f78381438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.951+0000 7f783759e700 1 --2- 172.21.15.62:0/1424899737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7838067830 0x7f78380b1360 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:14.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.951+0000 7f783759e700 1 -- 172.21.15.62:0/1424899737 >> 172.21.15.62:0/1424899737 conn(0x7f783805c750 msgr2=0x7f783805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:14.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.951+0000 7f783759e700 1 -- 172.21.15.62:0/1424899737 shutdown_connections 2021-12-17T18:23:14.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.951+0000 7f783759e700 1 -- 172.21.15.62:0/1424899737 wait complete. 2021-12-17T18:23:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.951+0000 7f783759e700 1 Processor -- start 2021-12-17T18:23:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f783759e700 1 -- start start 2021-12-17T18:23:14.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f783759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7838067830 0x7f78380b6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:14.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f783759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78380b0690 0x7f78380b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f783759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7838143db0 0x7f7838152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f783759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78380b56c0 con 0x7f7838143db0 2021-12-17T18:23:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f783759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78380b5920 con 0x7f7838067830 2021-12-17T18:23:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f783759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78380b5bc0 con 0x7f78380b0690 2021-12-17T18:23:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f7836d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7838143db0 0x7f7838152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f782ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78380b0690 0x7f78380b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f7836d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7838143db0 0x7f7838152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51148/0 (socket says 172.21.15.62:51148) 2021-12-17T18:23:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f7836d9d700 1 -- 172.21.15.62:0/1214655361 learned_addr learned my addr 172.21.15.62:0/1214655361 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f783659c700 1 --2- 172.21.15.62:0/1214655361 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7838067830 0x7f78380b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f7836d9d700 1 -- 172.21.15.62:0/1214655361 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78380b0690 msgr2=0x7f78380b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f7836d9d700 1 --2- 172.21.15.62:0/1214655361 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78380b0690 0x7f78380b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f7836d9d700 1 -- 172.21.15.62:0/1214655361 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7838067830 msgr2=0x7f78380b6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f7836d9d700 1 --2- 172.21.15.62:0/1214655361 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7838067830 0x7f78380b6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f7836d9d700 1 -- 172.21.15.62:0/1214655361 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782800b180 con 0x7f7838143db0 2021-12-17T18:23:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f7836d9d700 1 --2- 172.21.15.62:0/1214655361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7838143db0 0x7f7838152370 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f7830001490 tx=0x7f7830007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f782f7fe700 1 -- 172.21.15.62:0/1214655361 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7830005ba0 con 0x7f7838143db0 2021-12-17T18:23:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f782f7fe700 1 -- 172.21.15.62:0/1214655361 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7830005d00 con 0x7f7838143db0 2021-12-17T18:23:14.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f783759e700 1 -- 172.21.15.62:0/1214655361 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f783813ac40 con 0x7f7838143db0 2021-12-17T18:23:14.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f782f7fe700 1 -- 172.21.15.62:0/1214655361 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78300072c0 con 0x7f7838143db0 2021-12-17T18:23:14.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.955+0000 7f783759e700 1 -- 172.21.15.62:0/1214655361 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7838139370 con 0x7f7838143db0 2021-12-17T18:23:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.959+0000 7f783759e700 1 -- 172.21.15.62:0/1214655361 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78380b5d80 con 0x7f7838143db0 2021-12-17T18:23:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.959+0000 7f782f7fe700 1 -- 172.21.15.62:0/1214655361 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f783001a060 con 0x7f7838143db0 2021-12-17T18:23:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.959+0000 7f782f7fe700 1 --2- 172.21.15.62:0/1214655361 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f781c053610 0x7f781c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.959+0000 7f782f7fe700 1 -- 172.21.15.62:0/1214655361 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f783006b450 con 0x7f7838143db0 2021-12-17T18:23:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.959+0000 7f783659c700 1 --2- 172.21.15.62:0/1214655361 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f781c053610 0x7f781c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.959+0000 7f783659c700 1 --2- 172.21.15.62:0/1214655361 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f781c053610 0x7f781c055ad0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f782801a000 tx=0x7f7828014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:14.967+0000 7f782f7fe700 1 -- 172.21.15.62:0/1214655361 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7830042560 con 0x7f7838143db0 2021-12-17T18:23:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.131+0000 7f783759e700 1 -- 172.21.15.62:0/1214655361 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78381430d0 con 0x7f7838143db0 2021-12-17T18:23:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.131+0000 7f782f7fe700 1 -- 172.21.15.62:0/1214655361 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+1781 (secure 0 0 0) 0x7f7830018070 con 0x7f7838143db0 2021-12-17T18:23:15.137 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:15.138 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":22,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3056253780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3056253780},{"type":"v1","addr":"172.21.15.109:6835","nonce":3056253780}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:21:51.687672+0000","modified":"2021-12-17T18:23:14.811390+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-12-17T18:23:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.131+0000 7f783759e700 1 -- 172.21.15.62:0/1214655361 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f781c053610 msgr2=0x7f781c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.131+0000 7f783759e700 1 --2- 172.21.15.62:0/1214655361 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f781c053610 0x7f781c055ad0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f782801a000 tx=0x7f7828014000).stop 2021-12-17T18:23:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.131+0000 7f783759e700 1 -- 172.21.15.62:0/1214655361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7838143db0 msgr2=0x7f7838152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.131+0000 7f783759e700 1 --2- 172.21.15.62:0/1214655361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7838143db0 0x7f7838152370 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f7830001490 tx=0x7f7830007e00).stop 2021-12-17T18:23:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.131+0000 7f783759e700 1 -- 172.21.15.62:0/1214655361 shutdown_connections 2021-12-17T18:23:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.131+0000 7f783759e700 1 --2- 172.21.15.62:0/1214655361 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f781c053610 0x7f781c055ad0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.131+0000 7f783759e700 1 --2- 172.21.15.62:0/1214655361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7838143db0 0x7f7838152370 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.131+0000 7f783759e700 1 --2- 172.21.15.62:0/1214655361 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f78380b0690 0x7f78380b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.131+0000 7f783759e700 1 --2- 172.21.15.62:0/1214655361 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7838067830 0x7f78380b6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.131+0000 7f783759e700 1 -- 172.21.15.62:0/1214655361 >> 172.21.15.62:0/1214655361 conn(0x7f783805c750 msgr2=0x7f783813c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.135+0000 7f783759e700 1 -- 172.21.15.62:0/1214655361 shutdown_connections 2021-12-17T18:23:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.135+0000 7f783759e700 1 -- 172.21.15.62:0/1214655361 wait complete. 2021-12-17T18:23:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 22 2021-12-17T18:23:15.150 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-12-17T18:23:15.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.251+0000 7f5c8c12a700 1 Processor -- start 2021-12-17T18:23:15.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.251+0000 7f5c8c12a700 1 -- start start 2021-12-17T18:23:15.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.251+0000 7f5c8c12a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5c8405fa70 0x7f5c84144950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.251+0000 7f5c8c12a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c84143870 0x7f5c84143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.251+0000 7f5c8c12a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c840b48c0 con 0x7f5c840b0910 2021-12-17T18:23:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.251+0000 7f5c8c12a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c8405fe50 con 0x7f5c8405fa70 2021-12-17T18:23:15.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.251+0000 7f5c8c12a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c840b1620 con 0x7f5c84143870 2021-12-17T18:23:15.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.251+0000 7f5c89ec6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5c8405fa70 0x7f5c84144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:15.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.251+0000 7f5c896c5700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5c840b0910 0x7f5c84144e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34732/0 (socket says 172.21.15.62:34732) 2021-12-17T18:23:15.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.251+0000 7f5c896c5700 1 -- 172.21.15.62:0/4056477975 learned_addr learned my addr 172.21.15.62:0/4056477975 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:15.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.251+0000 7f5c8a6c7700 1 --2- 172.21.15.62:0/4056477975 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c84143870 0x7f5c84143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:15.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.251+0000 7f5c88ec4700 1 -- 172.21.15.62:0/4056477975 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323799265 0 0) 0x7f5c840b48c0 con 0x7f5c840b0910 2021-12-17T18:23:15.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.251+0000 7f5c88ec4700 1 -- 172.21.15.62:0/4056477975 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c6c003260 con 0x7f5c840b0910 2021-12-17T18:23:15.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.251+0000 7f5c89ec6700 1 -- 172.21.15.62:0/4056477975 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c84143870 msgr2=0x7f5c84143ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:15.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.251+0000 7f5c89ec6700 1 --2- 172.21.15.62:0/4056477975 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c84143870 0x7f5c84143ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.251+0000 7f5c89ec6700 1 -- 172.21.15.62:0/4056477975 >> v1:172.21.15.62:6789/0 conn(0x7f5c840b0910 legacy=0x7f5c84144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:15.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.251+0000 7f5c89ec6700 1 -- 172.21.15.62:0/4056477975 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c840b3610 con 0x7f5c8405fa70 2021-12-17T18:23:15.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.255+0000 7f5c8a6c7700 1 --2- 172.21.15.62:0/4056477975 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c84143870 0x7f5c84143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:15.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.255+0000 7f5c89ec6700 1 --2- 172.21.15.62:0/4056477975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c8405fa70 0x7f5c84144950 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f5c74002f70 tx=0x7f5c74006df0).ready entity=mon.0 client_cookie=4dbc7b9debbeec1 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:15.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.255+0000 7f5c88ec4700 1 -- 172.21.15.62:0/4056477975 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c7400d4a0 con 0x7f5c8405fa70 2021-12-17T18:23:15.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.255+0000 7f5c88ec4700 1 -- 172.21.15.62:0/4056477975 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c74000e90 con 0x7f5c8405fa70 2021-12-17T18:23:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.255+0000 7f5c88ec4700 1 -- 172.21.15.62:0/4056477975 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c7400d7f0 con 0x7f5c8405fa70 2021-12-17T18:23:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.255+0000 7f5c8c12a700 1 -- 172.21.15.62:0/4056477975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c8405fa70 msgr2=0x7f5c84144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.255+0000 7f5c8c12a700 1 --2- 172.21.15.62:0/4056477975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c8405fa70 0x7f5c84144950 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f5c74002f70 tx=0x7f5c74006df0).stop 2021-12-17T18:23:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.255+0000 7f5c8c12a700 1 -- 172.21.15.62:0/4056477975 shutdown_connections 2021-12-17T18:23:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.255+0000 7f5c8c12a700 1 --2- 172.21.15.62:0/4056477975 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c84143870 0x7f5c84143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.255+0000 7f5c8c12a700 1 --2- 172.21.15.62:0/4056477975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c8405fa70 0x7f5c84144950 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.255+0000 7f5c8c12a700 1 -- 172.21.15.62:0/4056477975 >> 172.21.15.62:0/4056477975 conn(0x7f5c8405c960 msgr2=0x7f5c8405cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.255+0000 7f5c8c12a700 1 -- 172.21.15.62:0/4056477975 shutdown_connections 2021-12-17T18:23:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.255+0000 7f5c8c12a700 1 -- 172.21.15.62:0/4056477975 wait complete. 2021-12-17T18:23:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c8c12a700 1 Processor -- start 2021-12-17T18:23:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c8c12a700 1 -- start start 2021-12-17T18:23:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c8c12a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c8405fa70 0x7f5c84065fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c8c12a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c840b0910 0x7f5c84064c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c8c12a700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c84143870 0x7f5c8414a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c8c12a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c840652c0 con 0x7f5c8405fa70 2021-12-17T18:23:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c8c12a700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c84065560 con 0x7f5c84143870 2021-12-17T18:23:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c8c12a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c840a40b0 con 0x7f5c840b0910 2021-12-17T18:23:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c89ec6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c8405fa70 0x7f5c84065fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c89ec6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c8405fa70 0x7f5c84065fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51158/0 (socket says 172.21.15.62:51158) 2021-12-17T18:23:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c89ec6700 1 -- 172.21.15.62:0/2549590912 learned_addr learned my addr 172.21.15.62:0/2549590912 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:15.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c8a6c7700 1 --2- 172.21.15.62:0/2549590912 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c84143870 0x7f5c8414a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:15.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c896c5700 1 --2- 172.21.15.62:0/2549590912 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c840b0910 0x7f5c84064c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:15.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c89ec6700 1 -- 172.21.15.62:0/2549590912 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c840b0910 msgr2=0x7f5c84064c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:15.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c89ec6700 1 --2- 172.21.15.62:0/2549590912 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c840b0910 0x7f5c84064c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c89ec6700 1 -- 172.21.15.62:0/2549590912 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c84143870 msgr2=0x7f5c8414a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c89ec6700 1 --2- 172.21.15.62:0/2549590912 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c84143870 0x7f5c8414a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c89ec6700 1 -- 172.21.15.62:0/2549590912 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c009470 con 0x7f5c8405fa70 2021-12-17T18:23:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c896c5700 1 --2- 172.21.15.62:0/2549590912 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c840b0910 0x7f5c84064c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c89ec6700 1 --2- 172.21.15.62:0/2549590912 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c8405fa70 0x7f5c84065fa0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f5c74002f70 tx=0x7f5c74014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:15.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c72ffd700 1 -- 172.21.15.62:0/2549590912 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c74016070 con 0x7f5c8405fa70 2021-12-17T18:23:15.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c72ffd700 1 -- 172.21.15.62:0/2549590912 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c74013930 con 0x7f5c8405fa70 2021-12-17T18:23:15.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c72ffd700 1 -- 172.21.15.62:0/2549590912 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c74013c90 con 0x7f5c8405fa70 2021-12-17T18:23:15.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.259+0000 7f5c8c12a700 1 -- 172.21.15.62:0/2549590912 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7400b180 con 0x7f5c8405fa70 2021-12-17T18:23:15.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.263+0000 7f5c8c12a700 1 -- 172.21.15.62:0/2549590912 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c84155ed0 con 0x7f5c8405fa70 2021-12-17T18:23:15.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.263+0000 7f5c8c12a700 1 -- 172.21.15.62:0/2549590912 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c840b0ee0 con 0x7f5c8405fa70 2021-12-17T18:23:15.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.263+0000 7f5c72ffd700 1 -- 172.21.15.62:0/2549590912 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5c74025030 con 0x7f5c8405fa70 2021-12-17T18:23:15.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.263+0000 7f5c72ffd700 1 --2- 172.21.15.62:0/2549590912 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c640536a0 0x7f5c64055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:15.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.263+0000 7f5c72ffd700 1 -- 172.21.15.62:0/2549590912 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f5c7406caf0 con 0x7f5c8405fa70 2021-12-17T18:23:15.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.263+0000 7f5c896c5700 1 --2- 172.21.15.62:0/2549590912 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c640536a0 0x7f5c64055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:15.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.263+0000 7f5c896c5700 1 --2- 172.21.15.62:0/2549590912 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c640536a0 0x7f5c64055b60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f5c8000b000 tx=0x7f5c80009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:15.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.271+0000 7f5c72ffd700 1 -- 172.21.15.62:0/2549590912 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5c74043af0 con 0x7f5c8405fa70 2021-12-17T18:23:15.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.435+0000 7f5c8c12a700 1 -- 172.21.15.62:0/2549590912 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5c840573d0 con 0x7f5c8405fa70 2021-12-17T18:23:15.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.827+0000 7f5c72ffd700 1 -- 172.21.15.62:0/2549590912 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5c74023020 con 0x7f5c8405fa70 2021-12-17T18:23:15.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.827+0000 7f5c8c12a700 1 -- 172.21.15.62:0/2549590912 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c640536a0 msgr2=0x7f5c64055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:15.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.827+0000 7f5c8c12a700 1 --2- 172.21.15.62:0/2549590912 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c640536a0 0x7f5c64055b60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f5c8000b000 tx=0x7f5c80009040).stop 2021-12-17T18:23:15.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.827+0000 7f5c8c12a700 1 -- 172.21.15.62:0/2549590912 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c8405fa70 msgr2=0x7f5c84065fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:15.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.827+0000 7f5c8c12a700 1 --2- 172.21.15.62:0/2549590912 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c8405fa70 0x7f5c84065fa0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f5c74002f70 tx=0x7f5c74014000).stop 2021-12-17T18:23:15.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.827+0000 7f5c8c12a700 1 -- 172.21.15.62:0/2549590912 shutdown_connections 2021-12-17T18:23:15.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.831+0000 7f5c8c12a700 1 --2- 172.21.15.62:0/2549590912 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c640536a0 0x7f5c64055b60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.831+0000 7f5c8c12a700 1 --2- 172.21.15.62:0/2549590912 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c84143870 0x7f5c8414a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.831+0000 7f5c8c12a700 1 --2- 172.21.15.62:0/2549590912 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c840b0910 0x7f5c84064c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.831+0000 7f5c8c12a700 1 --2- 172.21.15.62:0/2549590912 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c8405fa70 0x7f5c84065fa0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.831+0000 7f5c8c12a700 1 -- 172.21.15.62:0/2549590912 >> 172.21.15.62:0/2549590912 conn(0x7f5c8405c960 msgr2=0x7f5c840ba140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:15.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.831+0000 7f5c8c12a700 1 -- 172.21.15.62:0/2549590912 shutdown_connections 2021-12-17T18:23:15.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.831+0000 7f5c8c12a700 1 -- 172.21.15.62:0/2549590912 wait complete. 2021-12-17T18:23:15.850 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-12-17T18:23:15.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b14f35700 1 Processor -- start 2021-12-17T18:23:15.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b14f35700 1 -- start start 2021-12-17T18:23:15.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b14f35700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f8b1005f730 0x7f8b1005fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:15.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b14f35700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b101471c0 0x7f8b100b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:15.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b14f35700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b10147630 con 0x7f8b10062730 2021-12-17T18:23:15.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b14f35700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b10143210 con 0x7f8b1005f730 2021-12-17T18:23:15.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b14f35700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b101434b0 con 0x7f8b101471c0 2021-12-17T18:23:15.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b0ed9d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b101471c0 0x7f8b100b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:15.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b0e59c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f8b1005f730 0x7f8b1005fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:15.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b0ed9d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b101471c0 0x7f8b100b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:44874/0 (socket says 172.21.15.62:44874) 2021-12-17T18:23:15.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b0dd9b700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f8b10062730 0x7f8b10143bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:51068/0 (socket says 172.21.15.62:51068) 2021-12-17T18:23:15.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b0ed9d700 1 -- 172.21.15.62:0/2069035878 learned_addr learned my addr 172.21.15.62:0/2069035878 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:15.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b0ed9d700 1 -- 172.21.15.62:0/2069035878 >> v2:172.21.15.109:3300/0 conn(0x7f8b1005f730 msgr2=0x7f8b1005fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:15.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b0ed9d700 1 --2- 172.21.15.62:0/2069035878 >> v2:172.21.15.109:3300/0 conn(0x7f8b1005f730 0x7f8b1005fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b0ed9d700 1 -- 172.21.15.62:0/2069035878 >> v1:172.21.15.109:6789/0 conn(0x7f8b10062730 legacy=0x7f8b10143bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b0d59a700 1 -- 172.21.15.62:0/2069035878 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257790387 0 0) 0x7f8b10147630 con 0x7f8b10062730 2021-12-17T18:23:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b0ed9d700 1 -- 172.21.15.62:0/2069035878 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b10143750 con 0x7f8b101471c0 2021-12-17T18:23:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b0ed9d700 1 --2- 172.21.15.62:0/2069035878 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b101471c0 0x7f8b100b1630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f8b101445d0 tx=0x7f8b08009290).ready entity=mon.2 client_cookie=d394231d76cda88b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b0d59a700 1 -- 172.21.15.62:0/2069035878 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b0800b860 con 0x7f8b101471c0 2021-12-17T18:23:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b0d59a700 1 -- 172.21.15.62:0/2069035878 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0800b9c0 con 0x7f8b101471c0 2021-12-17T18:23:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.963+0000 7f8b0d59a700 1 -- 172.21.15.62:0/2069035878 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b0800bb30 con 0x7f8b101471c0 2021-12-17T18:23:15.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b14f35700 1 -- 172.21.15.62:0/2069035878 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b101471c0 msgr2=0x7f8b100b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:15.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b14f35700 1 --2- 172.21.15.62:0/2069035878 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b101471c0 0x7f8b100b1630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f8b101445d0 tx=0x7f8b08009290).stop 2021-12-17T18:23:15.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b14f35700 1 -- 172.21.15.62:0/2069035878 shutdown_connections 2021-12-17T18:23:15.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b14f35700 1 --2- 172.21.15.62:0/2069035878 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b101471c0 0x7f8b100b1630 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b14f35700 1 --2- 172.21.15.62:0/2069035878 >> v2:172.21.15.109:3300/0 conn(0x7f8b1005f730 0x7f8b1005fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b14f35700 1 -- 172.21.15.62:0/2069035878 >> 172.21.15.62:0/2069035878 conn(0x7f8b100b64f0 msgr2=0x7f8b100b68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:15.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b14f35700 1 -- 172.21.15.62:0/2069035878 shutdown_connections 2021-12-17T18:23:15.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b14f35700 1 -- 172.21.15.62:0/2069035878 wait complete. 2021-12-17T18:23:15.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b14f35700 1 Processor -- start 2021-12-17T18:23:15.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b14f35700 1 -- start start 2021-12-17T18:23:15.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b14f35700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b1005f730 0x7f8b100aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:15.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b14f35700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8b10062730 0x7f8b10152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:15.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b14f35700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b101471c0 0x7f8b100ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:15.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b14f35700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100ab240 con 0x7f8b1005f730 2021-12-17T18:23:15.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b14f35700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b10153440 con 0x7f8b10062730 2021-12-17T18:23:15.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b14f35700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100ad130 con 0x7f8b101471c0 2021-12-17T18:23:15.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b0e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b1005f730 0x7f8b100aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:15.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b0e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b1005f730 0x7f8b100aad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51174/0 (socket says 172.21.15.62:51174) 2021-12-17T18:23:15.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b0e59c700 1 -- 172.21.15.62:0/1445729466 learned_addr learned my addr 172.21.15.62:0/1445729466 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:15.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b0dd9b700 1 --2- 172.21.15.62:0/1445729466 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8b10062730 0x7f8b10152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:15.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.967+0000 7f8b0ed9d700 1 --2- 172.21.15.62:0/1445729466 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b101471c0 0x7f8b100ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:15.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.971+0000 7f8b0dd9b700 1 -- 172.21.15.62:0/1445729466 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b101471c0 msgr2=0x7f8b100ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:15.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.971+0000 7f8b0dd9b700 1 --2- 172.21.15.62:0/1445729466 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b101471c0 0x7f8b100ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.971+0000 7f8b0dd9b700 1 -- 172.21.15.62:0/1445729466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b1005f730 msgr2=0x7f8b100aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:15.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.971+0000 7f8b0dd9b700 1 --2- 172.21.15.62:0/1445729466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b1005f730 0x7f8b100aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:15.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.971+0000 7f8b0dd9b700 1 -- 172.21.15.62:0/1445729466 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b08009530 con 0x7f8b10062730 2021-12-17T18:23:15.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.971+0000 7f8b0dd9b700 1 --2- 172.21.15.62:0/1445729466 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8b10062730 0x7f8b10152f50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f8b100ab380 tx=0x7f8b00007a00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:15.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.971+0000 7f8b077fe700 1 -- 172.21.15.62:0/1445729466 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b000070d0 con 0x7f8b10062730 2021-12-17T18:23:15.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.971+0000 7f8b077fe700 1 -- 172.21.15.62:0/1445729466 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b00007230 con 0x7f8b10062730 2021-12-17T18:23:15.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.971+0000 7f8b14f35700 1 -- 172.21.15.62:0/1445729466 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b100ad3d0 con 0x7f8b10062730 2021-12-17T18:23:15.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.971+0000 7f8b077fe700 1 -- 172.21.15.62:0/1445729466 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b00005550 con 0x7f8b10062730 2021-12-17T18:23:15.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.971+0000 7f8b14f35700 1 -- 172.21.15.62:0/1445729466 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b100ac030 con 0x7f8b10062730 2021-12-17T18:23:15.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.971+0000 7f8b14f35700 1 -- 172.21.15.62:0/1445729466 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b100573d0 con 0x7f8b10062730 2021-12-17T18:23:15.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.971+0000 7f8b077fe700 1 -- 172.21.15.62:0/1445729466 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8b00010070 con 0x7f8b10062730 2021-12-17T18:23:15.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.971+0000 7f8b077fe700 1 --2- 172.21.15.62:0/1445729466 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8af4053520 0x7f8af40559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:15.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.971+0000 7f8b077fe700 1 -- 172.21.15.62:0/1445729466 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8b0006aff0 con 0x7f8b10062730 2021-12-17T18:23:15.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.971+0000 7f8b0e59c700 1 --2- 172.21.15.62:0/1445729466 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8af4053520 0x7f8af40559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:15.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.975+0000 7f8b0e59c700 1 --2- 172.21.15.62:0/1445729466 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8af4053520 0x7f8af40559e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f8af800b000 tx=0x7f8af8006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:15.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:15.983+0000 7f8b077fe700 1 -- 172.21.15.62:0/1445729466 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8b00041f90 con 0x7f8b10062730 2021-12-17T18:23:16.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:16.111+0000 7f8b14f35700 1 -- 172.21.15.62:0/1445729466 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8b10060ec0 con 0x7f8b10062730 2021-12-17T18:23:16.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:16.887+0000 7f8b077fe700 1 -- 172.21.15.62:0/1445729466 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) v1 ==== 185+0+0 (secure 0 0 0) 0x7f8b000455b0 con 0x7f8b10062730 2021-12-17T18:23:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:16.891+0000 7f8b14f35700 1 -- 172.21.15.62:0/1445729466 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8af4053520 msgr2=0x7f8af40559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:16.891+0000 7f8b14f35700 1 --2- 172.21.15.62:0/1445729466 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8af4053520 0x7f8af40559e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f8af800b000 tx=0x7f8af8006df0).stop 2021-12-17T18:23:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:16.891+0000 7f8b14f35700 1 -- 172.21.15.62:0/1445729466 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8b10062730 msgr2=0x7f8b10152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:16.891+0000 7f8b14f35700 1 --2- 172.21.15.62:0/1445729466 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8b10062730 0x7f8b10152f50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f8b100ab380 tx=0x7f8b00007a00).stop 2021-12-17T18:23:16.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:16.891+0000 7f8b14f35700 1 -- 172.21.15.62:0/1445729466 shutdown_connections 2021-12-17T18:23:16.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:16.891+0000 7f8b14f35700 1 --2- 172.21.15.62:0/1445729466 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8af4053520 0x7f8af40559e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:16.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:16.891+0000 7f8b14f35700 1 --2- 172.21.15.62:0/1445729466 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b101471c0 0x7f8b100ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:16.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:16.891+0000 7f8b14f35700 1 --2- 172.21.15.62:0/1445729466 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8b10062730 0x7f8b10152f50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:16.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:16.891+0000 7f8b14f35700 1 --2- 172.21.15.62:0/1445729466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b1005f730 0x7f8b100aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:16.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:16.891+0000 7f8b14f35700 1 -- 172.21.15.62:0/1445729466 >> 172.21.15.62:0/1445729466 conn(0x7f8b100b64f0 msgr2=0x7f8b10149bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:16.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:16.891+0000 7f8b14f35700 1 -- 172.21.15.62:0/1445729466 shutdown_connections 2021-12-17T18:23:16.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:16.891+0000 7f8b14f35700 1 -- 172.21.15.62:0/1445729466 wait complete. 2021-12-17T18:23:16.904 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2021-12-17T18:23:16.914 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-12-17T18:23:17.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.023+0000 7f79d759e700 1 Processor -- start 2021-12-17T18:23:17.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.023+0000 7f79d759e700 1 -- start start 2021-12-17T18:23:17.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.027+0000 7f79d759e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f79d80626a0 0x7f79d8065d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:17.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.027+0000 7f79d759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d80b35a0 con 0x7f79d80b31c0 2021-12-17T18:23:17.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.027+0000 7f79d759e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d80661f0 con 0x7f79d813eb10 2021-12-17T18:23:17.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.027+0000 7f79d759e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d80653d0 con 0x7f79d80626a0 2021-12-17T18:23:17.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.027+0000 7f79d659c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f79d80b31c0 0x7f79d8143170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34762/0 (socket says 172.21.15.62:34762) 2021-12-17T18:23:17.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.027+0000 7f79d659c700 1 -- 172.21.15.62:0/2730892044 learned_addr learned my addr 172.21.15.62:0/2730892044 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:17.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.027+0000 7f79cdd9b700 1 --2- 172.21.15.62:0/2730892044 >> v2:172.21.15.109:3300/0 conn(0x7f79d80626a0 0x7f79d8065d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:17.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.027+0000 7f79d5d9b700 1 -- 172.21.15.62:0/2730892044 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 948113672 0 0) 0x7f79d80b35a0 con 0x7f79d80b31c0 2021-12-17T18:23:17.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.027+0000 7f79d5d9b700 1 -- 172.21.15.62:0/2730892044 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79bc003260 con 0x7f79d80b31c0 2021-12-17T18:23:17.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.027+0000 7f79cdd9b700 1 -- 172.21.15.62:0/2730892044 >> v1:172.21.15.109:6789/0 conn(0x7f79d813eb10 legacy=0x7f79d813ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:17.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.027+0000 7f79cdd9b700 1 -- 172.21.15.62:0/2730892044 >> v1:172.21.15.62:6789/0 conn(0x7f79d80b31c0 legacy=0x7f79d8143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:17.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.027+0000 7f79d5d9b700 1 -- 172.21.15.62:0/2730892044 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4174699989 0 0) 0x7f79bc003260 con 0x7f79d80b31c0 2021-12-17T18:23:17.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.027+0000 7f79cdd9b700 1 -- 172.21.15.62:0/2730892044 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d80655c0 con 0x7f79d80626a0 2021-12-17T18:23:17.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.027+0000 7f79cdd9b700 1 --2- 172.21.15.62:0/2730892044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79d80626a0 0x7f79d8065d00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f79c8001800 tx=0x7f79c0006df0).ready entity=mon.1 client_cookie=5979cab22fef517a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:17.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.027+0000 7f79d5d9b700 1 -- 172.21.15.62:0/2730892044 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79c8001660 con 0x7f79d80626a0 2021-12-17T18:23:17.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.027+0000 7f79d5d9b700 1 -- 172.21.15.62:0/2730892044 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c0000e90 con 0x7f79d80626a0 2021-12-17T18:23:17.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.027+0000 7f79d5d9b700 1 -- 172.21.15.62:0/2730892044 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79c000d4f0 con 0x7f79d80626a0 2021-12-17T18:23:17.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79d759e700 1 -- 172.21.15.62:0/2730892044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79d80626a0 msgr2=0x7f79d8065d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:17.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79d759e700 1 --2- 172.21.15.62:0/2730892044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79d80626a0 0x7f79d8065d00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f79c8001800 tx=0x7f79c0006df0).stop 2021-12-17T18:23:17.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79d759e700 1 -- 172.21.15.62:0/2730892044 shutdown_connections 2021-12-17T18:23:17.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79d759e700 1 --2- 172.21.15.62:0/2730892044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79d80626a0 0x7f79d8065d00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:17.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79d759e700 1 -- 172.21.15.62:0/2730892044 >> 172.21.15.62:0/2730892044 conn(0x7f79d805bcd0 msgr2=0x7f79d8063510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:17.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79d759e700 1 -- 172.21.15.62:0/2730892044 shutdown_connections 2021-12-17T18:23:17.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79d759e700 1 -- 172.21.15.62:0/2730892044 wait complete. 2021-12-17T18:23:17.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79d759e700 1 Processor -- start 2021-12-17T18:23:17.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79d759e700 1 -- start start 2021-12-17T18:23:17.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79d759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79d80626a0 0x7f79d80b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:17.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79d759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79d80b31c0 0x7f79d8142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:17.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79d759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79d813eb10 0x7f79d8144380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:17.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79d759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8143600 con 0x7f79d80b31c0 2021-12-17T18:23:17.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79d759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8141310 con 0x7f79d813eb10 2021-12-17T18:23:17.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79d759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8141070 con 0x7f79d80626a0 2021-12-17T18:23:17.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79cdd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79d80b31c0 0x7f79d8142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:17.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79cdd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79d80b31c0 0x7f79d8142530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51188/0 (socket says 172.21.15.62:51188) 2021-12-17T18:23:17.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.031+0000 7f79cdd9b700 1 -- 172.21.15.62:0/1115954676 learned_addr learned my addr 172.21.15.62:0/1115954676 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:17.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.035+0000 7f79d6d9d700 1 --2- 172.21.15.62:0/1115954676 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79d813eb10 0x7f79d8144380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:17.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.035+0000 7f79d659c700 1 --2- 172.21.15.62:0/1115954676 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79d80626a0 0x7f79d80b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:17.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.035+0000 7f79cdd9b700 1 -- 172.21.15.62:0/1115954676 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79d80626a0 msgr2=0x7f79d80b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:17.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.035+0000 7f79cdd9b700 1 --2- 172.21.15.62:0/1115954676 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79d80626a0 0x7f79d80b5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:17.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.035+0000 7f79cdd9b700 1 -- 172.21.15.62:0/1115954676 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79d813eb10 msgr2=0x7f79d8144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:17.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.035+0000 7f79cdd9b700 1 --2- 172.21.15.62:0/1115954676 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79d813eb10 0x7f79d8144380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:17.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.035+0000 7f79cdd9b700 1 -- 172.21.15.62:0/1115954676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c000b180 con 0x7f79d80b31c0 2021-12-17T18:23:17.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.035+0000 7f79d6d9d700 1 --2- 172.21.15.62:0/1115954676 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79d813eb10 0x7f79d8144380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:17.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.035+0000 7f79cdd9b700 1 --2- 172.21.15.62:0/1115954676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79d80b31c0 0x7f79d8142530 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f79d80afe50 tx=0x7f79c0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:17.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.035+0000 7f79cffff700 1 -- 172.21.15.62:0/1115954676 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79c00139f0 con 0x7f79d80b31c0 2021-12-17T18:23:17.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.035+0000 7f79cffff700 1 -- 172.21.15.62:0/1115954676 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c0013b50 con 0x7f79d80b31c0 2021-12-17T18:23:17.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.035+0000 7f79d759e700 1 -- 172.21.15.62:0/1115954676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d8141dc0 con 0x7f79d80b31c0 2021-12-17T18:23:17.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.035+0000 7f79cffff700 1 -- 172.21.15.62:0/1115954676 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79c001e400 con 0x7f79d80b31c0 2021-12-17T18:23:17.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.035+0000 7f79d759e700 1 -- 172.21.15.62:0/1115954676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d8142a20 con 0x7f79d80b31c0 2021-12-17T18:23:17.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.035+0000 7f79d759e700 1 -- 172.21.15.62:0/1115954676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d8142240 con 0x7f79d80b31c0 2021-12-17T18:23:17.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.035+0000 7f79cffff700 1 -- 172.21.15.62:0/1115954676 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f79c0025030 con 0x7f79d80b31c0 2021-12-17T18:23:17.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.039+0000 7f79cffff700 1 --2- 172.21.15.62:0/1115954676 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79b0053580 0x7f79b0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.039+0000 7f79cffff700 1 -- 172.21.15.62:0/1115954676 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f79c006c5d0 con 0x7f79d80b31c0 2021-12-17T18:23:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.039+0000 7f79d659c700 1 --2- 172.21.15.62:0/1115954676 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79b0053580 0x7f79b0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.039+0000 7f79d659c700 1 --2- 172.21.15.62:0/1115954676 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79b0053580 0x7f79b0055a40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f79c800b000 tx=0x7f79c8000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:17.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.047+0000 7f79cffff700 1 -- 172.21.15.62:0/1115954676 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f79c0043830 con 0x7f79d80b31c0 2021-12-17T18:23:17.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.179+0000 7f79d759e700 1 -- 172.21.15.62:0/1115954676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f79d8065860 con 0x7f79d80b31c0 2021-12-17T18:23:17.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.887+0000 7f79cffff700 1 -- 172.21.15.62:0/1115954676 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) v1 ==== 173+0+0 (secure 0 0 0) 0x7f79c0023020 con 0x7f79d80b31c0 2021-12-17T18:23:17.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.895+0000 7f79d759e700 1 -- 172.21.15.62:0/1115954676 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79b0053580 msgr2=0x7f79b0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:17.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.895+0000 7f79d759e700 1 --2- 172.21.15.62:0/1115954676 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79b0053580 0x7f79b0055a40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f79c800b000 tx=0x7f79c8000bc0).stop 2021-12-17T18:23:17.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.895+0000 7f79d759e700 1 -- 172.21.15.62:0/1115954676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79d80b31c0 msgr2=0x7f79d8142530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:17.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.895+0000 7f79d759e700 1 --2- 172.21.15.62:0/1115954676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79d80b31c0 0x7f79d8142530 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f79d80afe50 tx=0x7f79c0014000).stop 2021-12-17T18:23:17.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.895+0000 7f79d759e700 1 -- 172.21.15.62:0/1115954676 shutdown_connections 2021-12-17T18:23:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.895+0000 7f79d759e700 1 --2- 172.21.15.62:0/1115954676 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f79b0053580 0x7f79b0055a40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.895+0000 7f79d759e700 1 --2- 172.21.15.62:0/1115954676 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f79d813eb10 0x7f79d8144380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.895+0000 7f79d759e700 1 --2- 172.21.15.62:0/1115954676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79d80b31c0 0x7f79d8142530 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.895+0000 7f79d759e700 1 --2- 172.21.15.62:0/1115954676 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f79d80626a0 0x7f79d80b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:17.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.895+0000 7f79d759e700 1 -- 172.21.15.62:0/1115954676 >> 172.21.15.62:0/1115954676 conn(0x7f79d805bcd0 msgr2=0x7f79d813ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:17.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.895+0000 7f79d759e700 1 -- 172.21.15.62:0/1115954676 shutdown_connections 2021-12-17T18:23:17.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:17.895+0000 7f79d759e700 1 -- 172.21.15.62:0/1115954676 wait complete. 2021-12-17T18:23:17.905 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2021-12-17T18:23:17.916 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-12-17T18:23:18.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.019+0000 7fd47359e700 1 Processor -- start 2021-12-17T18:23:18.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.019+0000 7fd47359e700 1 -- start start 2021-12-17T18:23:18.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd4740b39c0 0x7fd4740b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:18.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47359e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd4740b4210 0x7fd4741437b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:18.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4740b3590 con 0x7fd47405fa70 2021-12-17T18:23:18.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd474143ca0 con 0x7fd4740b39c0 2021-12-17T18:23:18.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47359e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd474060130 con 0x7fd4740b4210 2021-12-17T18:23:18.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd471d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd4740b39c0 0x7fd4740b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:18.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47259c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd47405fa70 0x7fd4741430a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34776/0 (socket says 172.21.15.62:34776) 2021-12-17T18:23:18.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47259c700 1 -- 172.21.15.62:0/3519146229 learned_addr learned my addr 172.21.15.62:0/3519146229 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:18.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd472d9d700 1 --2- 172.21.15.62:0/3519146229 >> v2:172.21.15.109:3300/0 conn(0x7fd4740b4210 0x7fd4741437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:18.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd471d9b700 1 -- 172.21.15.62:0/3519146229 >> v2:172.21.15.109:3300/0 conn(0x7fd4740b4210 msgr2=0x7fd4741437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:18.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd471d9b700 1 --2- 172.21.15.62:0/3519146229 >> v2:172.21.15.109:3300/0 conn(0x7fd4740b4210 0x7fd4741437b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:18.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd471d9b700 1 -- 172.21.15.62:0/3519146229 >> v1:172.21.15.62:6789/0 conn(0x7fd47405fa70 legacy=0x7fd4741430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:18.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47159a700 1 -- 172.21.15.62:0/3519146229 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046718690 0 0) 0x7fd4740b3590 con 0x7fd47405fa70 2021-12-17T18:23:18.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd471d9b700 1 -- 172.21.15.62:0/3519146229 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4740603d0 con 0x7fd4740b39c0 2021-12-17T18:23:18.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd471d9b700 1 --2- 172.21.15.62:0/3519146229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4740b39c0 0x7fd4740b6d90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fd45c002f70 tx=0x7fd45c006df0).ready entity=mon.0 client_cookie=2b00f6adec838b1 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:18.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47159a700 1 -- 172.21.15.62:0/3519146229 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd45c00d570 con 0x7fd4740b39c0 2021-12-17T18:23:18.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47159a700 1 -- 172.21.15.62:0/3519146229 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c000e90 con 0x7fd4740b39c0 2021-12-17T18:23:18.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47159a700 1 -- 172.21.15.62:0/3519146229 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd45c00d8c0 con 0x7fd4740b39c0 2021-12-17T18:23:18.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47359e700 1 -- 172.21.15.62:0/3519146229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4740b39c0 msgr2=0x7fd4740b6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:18.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47359e700 1 --2- 172.21.15.62:0/3519146229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4740b39c0 0x7fd4740b6d90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fd45c002f70 tx=0x7fd45c006df0).stop 2021-12-17T18:23:18.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47359e700 1 -- 172.21.15.62:0/3519146229 shutdown_connections 2021-12-17T18:23:18.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47359e700 1 --2- 172.21.15.62:0/3519146229 >> v2:172.21.15.109:3300/0 conn(0x7fd4740b4210 0x7fd4741437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:18.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47359e700 1 --2- 172.21.15.62:0/3519146229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4740b39c0 0x7fd4740b6d90 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:18.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47359e700 1 -- 172.21.15.62:0/3519146229 >> 172.21.15.62:0/3519146229 conn(0x7fd47405c750 msgr2=0x7fd47405cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:18.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47359e700 1 -- 172.21.15.62:0/3519146229 shutdown_connections 2021-12-17T18:23:18.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.023+0000 7fd47359e700 1 -- 172.21.15.62:0/3519146229 wait complete. 2021-12-17T18:23:18.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd47359e700 1 Processor -- start 2021-12-17T18:23:18.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd47359e700 1 -- start start 2021-12-17T18:23:18.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd47359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd47405fa70 0x7fd474148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:18.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd47359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4740b39c0 0x7fd4741563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:18.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd47359e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4740b4210 0x7fd474152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:18.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd47359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4741568e0 con 0x7fd4740b39c0 2021-12-17T18:23:18.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd47359e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd474152590 con 0x7fd4740b4210 2021-12-17T18:23:18.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd47359e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd474152830 con 0x7fd47405fa70 2021-12-17T18:23:18.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd471d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4740b39c0 0x7fd4741563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:18.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd47259c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd47405fa70 0x7fd474148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:18.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd471d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4740b39c0 0x7fd4741563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51204/0 (socket says 172.21.15.62:51204) 2021-12-17T18:23:18.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd471d9b700 1 -- 172.21.15.62:0/2036169313 learned_addr learned my addr 172.21.15.62:0/2036169313 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:18.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd472d9d700 1 --2- 172.21.15.62:0/2036169313 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4740b4210 0x7fd474152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:18.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd47259c700 1 -- 172.21.15.62:0/2036169313 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4740b4210 msgr2=0x7fd474152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:18.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd47259c700 1 --2- 172.21.15.62:0/2036169313 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4740b4210 0x7fd474152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:18.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd47259c700 1 -- 172.21.15.62:0/2036169313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4740b39c0 msgr2=0x7fd4741563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:18.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd47259c700 1 --2- 172.21.15.62:0/2036169313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4740b39c0 0x7fd4741563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:18.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd47259c700 1 -- 172.21.15.62:0/2036169313 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c00b180 con 0x7fd47405fa70 2021-12-17T18:23:18.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd471d9b700 1 --2- 172.21.15.62:0/2036169313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4740b39c0 0x7fd4741563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:18.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd47259c700 1 --2- 172.21.15.62:0/2036169313 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd47405fa70 0x7fd474148dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fd464000ed0 tx=0x7fd464007a00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:18.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd46b7fe700 1 -- 172.21.15.62:0/2036169313 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4640070d0 con 0x7fd47405fa70 2021-12-17T18:23:18.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd46b7fe700 1 -- 172.21.15.62:0/2036169313 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd464007230 con 0x7fd47405fa70 2021-12-17T18:23:18.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd47359e700 1 -- 172.21.15.62:0/2036169313 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd474152ad0 con 0x7fd47405fa70 2021-12-17T18:23:18.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd46b7fe700 1 -- 172.21.15.62:0/2036169313 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd464005610 con 0x7fd47405fa70 2021-12-17T18:23:18.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.027+0000 7fd47359e700 1 -- 172.21.15.62:0/2036169313 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd474153600 con 0x7fd47405fa70 2021-12-17T18:23:18.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.031+0000 7fd47359e700 1 -- 172.21.15.62:0/2036169313 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd474146320 con 0x7fd47405fa70 2021-12-17T18:23:18.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.031+0000 7fd46b7fe700 1 -- 172.21.15.62:0/2036169313 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd464010070 con 0x7fd47405fa70 2021-12-17T18:23:18.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.031+0000 7fd46b7fe700 1 --2- 172.21.15.62:0/2036169313 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd44c053610 0x7fd44c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:18.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.031+0000 7fd46b7fe700 1 -- 172.21.15.62:0/2036169313 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fd46406acf0 con 0x7fd47405fa70 2021-12-17T18:23:18.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.031+0000 7fd471d9b700 1 --2- 172.21.15.62:0/2036169313 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd44c053610 0x7fd44c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:18.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.031+0000 7fd471d9b700 1 --2- 172.21.15.62:0/2036169313 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd44c053610 0x7fd44c055ad0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fd45c01a000 tx=0x7fd45c014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:18.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.039+0000 7fd46b7fe700 1 -- 172.21.15.62:0/2036169313 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd474146320 con 0x7fd47405fa70 2021-12-17T18:23:18.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.167+0000 7fd47359e700 1 -- 172.21.15.62:0/2036169313 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd474146320 con 0x7fd47405fa70 2021-12-17T18:23:18.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.179+0000 7fd46b7fe700 1 -- 172.21.15.62:0/2036169313 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd474146320 con 0x7fd47405fa70 2021-12-17T18:23:18.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.183+0000 7fd47359e700 1 -- 172.21.15.62:0/2036169313 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd44c053610 msgr2=0x7fd44c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:18.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.183+0000 7fd47359e700 1 --2- 172.21.15.62:0/2036169313 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd44c053610 0x7fd44c055ad0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fd45c01a000 tx=0x7fd45c014000).stop 2021-12-17T18:23:18.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.183+0000 7fd47359e700 1 -- 172.21.15.62:0/2036169313 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd47405fa70 msgr2=0x7fd474148dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:18.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.183+0000 7fd47359e700 1 --2- 172.21.15.62:0/2036169313 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd47405fa70 0x7fd474148dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fd464000ed0 tx=0x7fd464007a00).stop 2021-12-17T18:23:18.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.183+0000 7fd47359e700 1 -- 172.21.15.62:0/2036169313 shutdown_connections 2021-12-17T18:23:18.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.183+0000 7fd47359e700 1 --2- 172.21.15.62:0/2036169313 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd44c053610 0x7fd44c055ad0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:18.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.183+0000 7fd47359e700 1 --2- 172.21.15.62:0/2036169313 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd4740b4210 0x7fd474152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:18.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.183+0000 7fd47359e700 1 --2- 172.21.15.62:0/2036169313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4740b39c0 0x7fd4741563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:18.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.183+0000 7fd47359e700 1 --2- 172.21.15.62:0/2036169313 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd47405fa70 0x7fd474148dc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:18.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.183+0000 7fd47359e700 1 -- 172.21.15.62:0/2036169313 >> 172.21.15.62:0/2036169313 conn(0x7fd47405c750 msgr2=0x7fd4740b7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:18.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.183+0000 7fd47359e700 1 -- 172.21.15.62:0/2036169313 shutdown_connections 2021-12-17T18:23:18.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.183+0000 7fd47359e700 1 -- 172.21.15.62:0/2036169313 wait complete. 2021-12-17T18:23:18.201 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-12-17T18:23:18.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.299+0000 7fdce7cab700 1 Processor -- start 2021-12-17T18:23:18.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.299+0000 7fdce7cab700 1 -- start start 2021-12-17T18:23:18.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.299+0000 7fdce7cab700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdce0067120 0x7fdce00675a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:18.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.299+0000 7fdce7cab700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdce0067a90 0x7fdce00b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:18.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.299+0000 7fdce7cab700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce00ad7f0 con 0x7fdce0143780 2021-12-17T18:23:18.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.299+0000 7fdce7cab700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce00ada90 con 0x7fdce0067a90 2021-12-17T18:23:18.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.299+0000 7fdce7cab700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce00add30 con 0x7fdce0067120 2021-12-17T18:23:18.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.299+0000 7fdce5a47700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdce0143780 0x7fdce0143b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34792/0 (socket says 172.21.15.62:34792) 2021-12-17T18:23:18.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.299+0000 7fdce6248700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdce0067a90 0x7fdce00b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:18.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.299+0000 7fdce5a47700 1 -- 172.21.15.62:0/4288626708 learned_addr learned my addr 172.21.15.62:0/4288626708 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:18.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.299+0000 7fdce5246700 1 --2- 172.21.15.62:0/4288626708 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdce0067120 0x7fdce00675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:18.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.299+0000 7fdce6248700 1 -- 172.21.15.62:0/4288626708 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdce0067120 msgr2=0x7fdce00675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:18.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.299+0000 7fdce6248700 1 --2- 172.21.15.62:0/4288626708 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdce0067120 0x7fdce00675a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:18.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.299+0000 7fdce6248700 1 -- 172.21.15.62:0/4288626708 >> v1:172.21.15.62:6789/0 conn(0x7fdce0143780 legacy=0x7fdce0143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:18.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.299+0000 7fdce6248700 1 -- 172.21.15.62:0/4288626708 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce00ad3c0 con 0x7fdce0067a90 2021-12-17T18:23:18.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.303+0000 7fdce6248700 1 --2- 172.21.15.62:0/4288626708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0067a90 0x7fdce00b1260 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fdcd80032f0 tx=0x7fdcd80091d0).ready entity=mon.0 client_cookie=209c7b5580590bf7 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:18.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.303+0000 7fdce4a45700 1 -- 172.21.15.62:0/4288626708 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcd800b6c0 con 0x7fdce0067a90 2021-12-17T18:23:18.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.303+0000 7fdce4a45700 1 -- 172.21.15.62:0/4288626708 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd800b820 con 0x7fdce0067a90 2021-12-17T18:23:18.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.303+0000 7fdce4a45700 1 -- 172.21.15.62:0/4288626708 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcd800b990 con 0x7fdce0067a90 2021-12-17T18:23:18.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.303+0000 7fdce7cab700 1 -- 172.21.15.62:0/4288626708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0067a90 msgr2=0x7fdce00b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:18.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.303+0000 7fdce7cab700 1 --2- 172.21.15.62:0/4288626708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0067a90 0x7fdce00b1260 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fdcd80032f0 tx=0x7fdcd80091d0).stop 2021-12-17T18:23:18.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.303+0000 7fdce7cab700 1 -- 172.21.15.62:0/4288626708 shutdown_connections 2021-12-17T18:23:18.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.303+0000 7fdce7cab700 1 --2- 172.21.15.62:0/4288626708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0067a90 0x7fdce00b1260 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:18.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.303+0000 7fdce7cab700 1 --2- 172.21.15.62:0/4288626708 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdce0067120 0x7fdce00675a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:18.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.303+0000 7fdce7cab700 1 -- 172.21.15.62:0/4288626708 >> 172.21.15.62:0/4288626708 conn(0x7fdce005f730 msgr2=0x7fdce005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:18.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.303+0000 7fdce7cab700 1 -- 172.21.15.62:0/4288626708 shutdown_connections 2021-12-17T18:23:18.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.303+0000 7fdce7cab700 1 -- 172.21.15.62:0/4288626708 wait complete. 2021-12-17T18:23:18.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce7cab700 1 Processor -- start 2021-12-17T18:23:18.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce7cab700 1 -- start start 2021-12-17T18:23:18.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce7cab700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdce0067120 0x7fdce01504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:18.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce7cab700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0067a90 0x7fdce013fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:18.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce7cab700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdce0143780 0x7fdce00b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:18.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce7cab700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce0140670 con 0x7fdce0067a90 2021-12-17T18:23:18.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce7cab700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce013f6f0 con 0x7fdce0143780 2021-12-17T18:23:18.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce7cab700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce01403d0 con 0x7fdce0067120 2021-12-17T18:23:18.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce5246700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0067a90 0x7fdce013fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:18.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce5246700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0067a90 0x7fdce013fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51218/0 (socket says 172.21.15.62:51218) 2021-12-17T18:23:18.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce5246700 1 -- 172.21.15.62:0/1120336127 learned_addr learned my addr 172.21.15.62:0/1120336127 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:18.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce5a47700 1 --2- 172.21.15.62:0/1120336127 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdce0067120 0x7fdce01504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:18.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce6248700 1 --2- 172.21.15.62:0/1120336127 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdce0143780 0x7fdce00b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:18.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce5246700 1 -- 172.21.15.62:0/1120336127 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdce0067120 msgr2=0x7fdce01504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:18.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce5246700 1 --2- 172.21.15.62:0/1120336127 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdce0067120 0x7fdce01504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:18.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce5246700 1 -- 172.21.15.62:0/1120336127 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdce0143780 msgr2=0x7fdce00b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:18.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce5246700 1 --2- 172.21.15.62:0/1120336127 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdce0143780 0x7fdce00b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:18.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce5246700 1 -- 172.21.15.62:0/1120336127 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd8009470 con 0x7fdce0067a90 2021-12-17T18:23:18.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce5246700 1 --2- 172.21.15.62:0/1120336127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0067a90 0x7fdce013fd80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fdcd000c000 tx=0x7fdcd0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:18.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdcceffd700 1 -- 172.21.15.62:0/1120336127 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcd0015660 con 0x7fdce0067a90 2021-12-17T18:23:18.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdcceffd700 1 -- 172.21.15.62:0/1120336127 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd00157c0 con 0x7fdce0067a90 2021-12-17T18:23:18.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce7cab700 1 -- 172.21.15.62:0/1120336127 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce013f420 con 0x7fdce0067a90 2021-12-17T18:23:18.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdcceffd700 1 -- 172.21.15.62:0/1120336127 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcd0015b20 con 0x7fdce0067a90 2021-12-17T18:23:18.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.307+0000 7fdce7cab700 1 -- 172.21.15.62:0/1120336127 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce013e4a0 con 0x7fdce0067a90 2021-12-17T18:23:18.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.311+0000 7fdce7cab700 1 -- 172.21.15.62:0/1120336127 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce00573d0 con 0x7fdce0067a90 2021-12-17T18:23:18.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.311+0000 7fdcceffd700 1 -- 172.21.15.62:0/1120336127 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdcd001c030 con 0x7fdce0067a90 2021-12-17T18:23:18.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.311+0000 7fdcceffd700 1 --2- 172.21.15.62:0/1120336127 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdcc00535b0 0x7fdcc0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:18.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.311+0000 7fdcceffd700 1 -- 172.21.15.62:0/1120336127 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fdcd006d690 con 0x7fdce0067a90 2021-12-17T18:23:18.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.311+0000 7fdce5a47700 1 --2- 172.21.15.62:0/1120336127 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdcc00535b0 0x7fdcc0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:18.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.311+0000 7fdce5a47700 1 --2- 172.21.15.62:0/1120336127 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdcc00535b0 0x7fdcc0055a70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fdcdc00d000 tx=0x7fdcdc000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:18.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.315+0000 7fdcceffd700 1 -- 172.21.15.62:0/1120336127 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdcd0044a70 con 0x7fdce0067a90 2021-12-17T18:23:18.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.491+0000 7fdce7cab700 1 -- 172.21.15.62:0/1120336127 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7fdce006a2b0 con 0x7fdce0067a90 2021-12-17T18:23:19.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.903+0000 7fdcceffd700 1 -- 172.21.15.62:0/1120336127 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v215) v1 ==== 152+0+0 (secure 0 0 0) 0x7fdcd0048090 con 0x7fdce0067a90 2021-12-17T18:23:19.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.907+0000 7fdce7cab700 1 -- 172.21.15.62:0/1120336127 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdcc00535b0 msgr2=0x7fdcc0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:19.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.907+0000 7fdce7cab700 1 --2- 172.21.15.62:0/1120336127 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdcc00535b0 0x7fdcc0055a70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fdcdc00d000 tx=0x7fdcdc000bc0).stop 2021-12-17T18:23:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.907+0000 7fdce7cab700 1 -- 172.21.15.62:0/1120336127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0067a90 msgr2=0x7fdce013fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.907+0000 7fdce7cab700 1 --2- 172.21.15.62:0/1120336127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0067a90 0x7fdce013fd80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fdcd000c000 tx=0x7fdcd0006df0).stop 2021-12-17T18:23:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.907+0000 7fdce7cab700 1 -- 172.21.15.62:0/1120336127 shutdown_connections 2021-12-17T18:23:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.907+0000 7fdce7cab700 1 --2- 172.21.15.62:0/1120336127 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdcc00535b0 0x7fdcc0055a70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:19.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.907+0000 7fdce7cab700 1 --2- 172.21.15.62:0/1120336127 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdce0143780 0x7fdce00b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:19.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.907+0000 7fdce7cab700 1 --2- 172.21.15.62:0/1120336127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0067a90 0x7fdce013fd80 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:19.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.907+0000 7fdce7cab700 1 --2- 172.21.15.62:0/1120336127 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdce0067120 0x7fdce01504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:19.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.907+0000 7fdce7cab700 1 -- 172.21.15.62:0/1120336127 >> 172.21.15.62:0/1120336127 conn(0x7fdce005f730 msgr2=0x7fdce00ab510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:19.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.907+0000 7fdce7cab700 1 -- 172.21.15.62:0/1120336127 shutdown_connections 2021-12-17T18:23:19.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:18.907+0000 7fdce7cab700 1 -- 172.21.15.62:0/1120336127 wait complete. 2021-12-17T18:23:19.618 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-12-17T18:23:19.619 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-12-17T18:23:19.619 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-12-17T18:23:19.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f011c640700 1 Processor -- start 2021-12-17T18:23:19.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f011c640700 1 -- start start 2021-12-17T18:23:19.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f011c640700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f0114067830 0x7f0114146940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:19.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f011c640700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f01140aca60 0x7f0114146e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:19.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f011c640700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0114067c10 con 0x7f01140affc0 2021-12-17T18:23:19.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f011c640700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01140b2d40 con 0x7f01140aca60 2021-12-17T18:23:19.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f011c640700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0114060520 con 0x7f0114067830 2021-12-17T18:23:19.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f0119bdb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f01140aca60 0x7f0114146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:19.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f0119bdb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f01140aca60 0x7f0114146e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51224/0 (socket says 172.21.15.62:51224) 2021-12-17T18:23:19.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f0119bdb700 1 -- 172.21.15.62:0/567058298 learned_addr learned my addr 172.21.15.62:0/567058298 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:19.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f011a3dc700 1 --2- 172.21.15.62:0/567058298 >> v2:172.21.15.109:3300/0 conn(0x7f0114067830 0x7f0114146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:19.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f0119bdb700 1 -- 172.21.15.62:0/567058298 >> v2:172.21.15.109:3300/0 conn(0x7f0114067830 msgr2=0x7f0114146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:19.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f0119bdb700 1 --2- 172.21.15.62:0/567058298 >> v2:172.21.15.109:3300/0 conn(0x7f0114067830 0x7f0114146940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:19.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f0119bdb700 1 -- 172.21.15.62:0/567058298 >> v1:172.21.15.109:6789/0 conn(0x7f01140affc0 legacy=0x7f01141436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:19.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f0119bdb700 1 -- 172.21.15.62:0/567058298 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01140acf00 con 0x7f01140aca60 2021-12-17T18:23:19.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f011a3dc700 1 --2- 172.21.15.62:0/567058298 >> v2:172.21.15.109:3300/0 conn(0x7f0114067830 0x7f0114146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:23:19.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f0119bdb700 1 --2- 172.21.15.62:0/567058298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01140aca60 0x7f0114146e30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f0110002f70 tx=0x7f0110006eb0).ready entity=mon.0 client_cookie=cfc827047bd5fa6c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:19.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f01193da700 1 -- 172.21.15.62:0/567058298 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f011000d610 con 0x7f01140aca60 2021-12-17T18:23:19.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f01193da700 1 -- 172.21.15.62:0/567058298 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0110000e90 con 0x7f01140aca60 2021-12-17T18:23:19.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.727+0000 7f01193da700 1 -- 172.21.15.62:0/567058298 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f011000d9a0 con 0x7f01140aca60 2021-12-17T18:23:19.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011c640700 1 -- 172.21.15.62:0/567058298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01140aca60 msgr2=0x7f0114146e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:19.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011c640700 1 --2- 172.21.15.62:0/567058298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01140aca60 0x7f0114146e30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f0110002f70 tx=0x7f0110006eb0).stop 2021-12-17T18:23:19.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011c640700 1 -- 172.21.15.62:0/567058298 shutdown_connections 2021-12-17T18:23:19.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011c640700 1 --2- 172.21.15.62:0/567058298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01140aca60 0x7f0114146e30 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:19.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011c640700 1 --2- 172.21.15.62:0/567058298 >> v2:172.21.15.109:3300/0 conn(0x7f0114067830 0x7f0114146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:19.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011c640700 1 -- 172.21.15.62:0/567058298 >> 172.21.15.62:0/567058298 conn(0x7f011405f730 msgr2=0x7f011405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:19.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011c640700 1 -- 172.21.15.62:0/567058298 shutdown_connections 2021-12-17T18:23:19.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011c640700 1 -- 172.21.15.62:0/567058298 wait complete. 2021-12-17T18:23:19.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011c640700 1 Processor -- start 2021-12-17T18:23:19.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011c640700 1 -- start start 2021-12-17T18:23:19.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011c640700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0114067830 0x7f01140a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:19.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011c640700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f01140aca60 0x7f0114152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:19.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011c640700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f01140affc0 0x7f0114153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:19.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011c640700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01140a2000 con 0x7f0114067830 2021-12-17T18:23:19.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011c640700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01140ac860 con 0x7f01140affc0 2021-12-17T18:23:19.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011c640700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0114156da0 con 0x7f01140aca60 2021-12-17T18:23:19.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011a3dc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0114067830 0x7f01140a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:19.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011a3dc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0114067830 0x7f01140a1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51228/0 (socket says 172.21.15.62:51228) 2021-12-17T18:23:19.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011a3dc700 1 -- 172.21.15.62:0/2042541528 learned_addr learned my addr 172.21.15.62:0/2042541528 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:19.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f011abdd700 1 --2- 172.21.15.62:0/2042541528 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f01140affc0 0x7f0114153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:19.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.731+0000 7f0119bdb700 1 --2- 172.21.15.62:0/2042541528 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f01140aca60 0x7f0114152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:19.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.735+0000 7f011a3dc700 1 -- 172.21.15.62:0/2042541528 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f01140aca60 msgr2=0x7f0114152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:19.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.735+0000 7f011a3dc700 1 --2- 172.21.15.62:0/2042541528 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f01140aca60 0x7f0114152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:19.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.735+0000 7f011a3dc700 1 -- 172.21.15.62:0/2042541528 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f01140affc0 msgr2=0x7f0114153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:19.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.735+0000 7f011a3dc700 1 --2- 172.21.15.62:0/2042541528 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f01140affc0 0x7f0114153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:19.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.735+0000 7f011a3dc700 1 -- 172.21.15.62:0/2042541528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011000b1e0 con 0x7f0114067830 2021-12-17T18:23:19.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.735+0000 7f011a3dc700 1 --2- 172.21.15.62:0/2042541528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0114067830 0x7f01140a1b10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f0104007000 tx=0x7f0104008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:19.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.735+0000 7f01037fe700 1 -- 172.21.15.62:0/2042541528 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0104010650 con 0x7f0114067830 2021-12-17T18:23:19.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.735+0000 7f01037fe700 1 -- 172.21.15.62:0/2042541528 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01040107b0 con 0x7f0114067830 2021-12-17T18:23:19.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.735+0000 7f011c640700 1 -- 172.21.15.62:0/2042541528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0114156ad0 con 0x7f0114067830 2021-12-17T18:23:19.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.735+0000 7f01037fe700 1 -- 172.21.15.62:0/2042541528 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0104010b10 con 0x7f0114067830 2021-12-17T18:23:19.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.735+0000 7f011c640700 1 -- 172.21.15.62:0/2042541528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0114153580 con 0x7f0114067830 2021-12-17T18:23:19.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.735+0000 7f011c640700 1 -- 172.21.15.62:0/2042541528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01140b12a0 con 0x7f0114067830 2021-12-17T18:23:19.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.735+0000 7f01037fe700 1 -- 172.21.15.62:0/2042541528 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0104010c70 con 0x7f0114067830 2021-12-17T18:23:19.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.735+0000 7f01037fe700 1 --2- 172.21.15.62:0/2042541528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00f4053580 0x7f00f4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:19.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.735+0000 7f01037fe700 1 -- 172.21.15.62:0/2042541528 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f010406b8c0 con 0x7f0114067830 2021-12-17T18:23:19.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.735+0000 7f0119bdb700 1 --2- 172.21.15.62:0/2042541528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00f4053580 0x7f00f4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:19.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.739+0000 7f0119bdb700 1 --2- 172.21.15.62:0/2042541528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00f4053580 0x7f00f4055a40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f011001a000 tx=0x7f0110015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:19.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.743+0000 7f01037fe700 1 -- 172.21.15.62:0/2042541528 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0104042d00 con 0x7f0114067830 2021-12-17T18:23:19.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:19.915+0000 7f011c640700 1 -- 172.21.15.62:0/2042541528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f01140573d0 con 0x7f0114067830 2021-12-17T18:23:20.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:20.915+0000 7f01037fe700 1 -- 172.21.15.62:0/2042541528 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v217) v1 ==== 150+0+0 (secure 0 0 0) 0x7f0104046320 con 0x7f0114067830 2021-12-17T18:23:20.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:20.923+0000 7f011c640700 1 -- 172.21.15.62:0/2042541528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00f4053580 msgr2=0x7f00f4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:20.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:20.923+0000 7f011c640700 1 --2- 172.21.15.62:0/2042541528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00f4053580 0x7f00f4055a40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f011001a000 tx=0x7f0110015000).stop 2021-12-17T18:23:20.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:20.923+0000 7f011c640700 1 -- 172.21.15.62:0/2042541528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0114067830 msgr2=0x7f01140a1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:20.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:20.923+0000 7f011c640700 1 --2- 172.21.15.62:0/2042541528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0114067830 0x7f01140a1b10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f0104007000 tx=0x7f0104008040).stop 2021-12-17T18:23:20.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:20.923+0000 7f011c640700 1 -- 172.21.15.62:0/2042541528 shutdown_connections 2021-12-17T18:23:20.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:20.923+0000 7f011c640700 1 --2- 172.21.15.62:0/2042541528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00f4053580 0x7f00f4055a40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:20.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:20.923+0000 7f011c640700 1 --2- 172.21.15.62:0/2042541528 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f01140affc0 0x7f0114153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:20.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:20.923+0000 7f011c640700 1 --2- 172.21.15.62:0/2042541528 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f01140aca60 0x7f0114152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:20.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:20.923+0000 7f011c640700 1 --2- 172.21.15.62:0/2042541528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0114067830 0x7f01140a1b10 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:20.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:20.923+0000 7f011c640700 1 -- 172.21.15.62:0/2042541528 >> 172.21.15.62:0/2042541528 conn(0x7f011405f730 msgr2=0x7f01141415e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:20.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:20.923+0000 7f011c640700 1 -- 172.21.15.62:0/2042541528 shutdown_connections 2021-12-17T18:23:20.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:20.923+0000 7f011c640700 1 -- 172.21.15.62:0/2042541528 wait complete. 2021-12-17T18:23:20.942 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-12-17T18:23:21.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.051+0000 7feed55da700 1 Processor -- start 2021-12-17T18:23:21.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.051+0000 7feed55da700 1 -- start start 2021-12-17T18:23:21.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.051+0000 7feed55da700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feed005ca90 0x7feed014abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:21.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.051+0000 7feed55da700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feed00604d0 0x7feed0146510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:21.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.051+0000 7feed55da700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed00b2860 con 0x7feed00b06b0 2021-12-17T18:23:21.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.051+0000 7feed55da700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed01475c0 con 0x7feed005ca90 2021-12-17T18:23:21.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.051+0000 7feed55da700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed005fa40 con 0x7feed00604d0 2021-12-17T18:23:21.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.051+0000 7feecffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feed005ca90 0x7feed014abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:21.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.051+0000 7feecffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feed005ca90 0x7feed014abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51238/0 (socket says 172.21.15.62:51238) 2021-12-17T18:23:21.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.051+0000 7feecffff700 1 -- 172.21.15.62:0/4276657914 learned_addr learned my addr 172.21.15.62:0/4276657914 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:21.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.051+0000 7feecf7fe700 1 --1- 172.21.15.62:0/4276657914 >> v1:172.21.15.109:6789/0 conn(0x7feed00b06b0 0x7feed00ace40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:51136/0 (socket says 172.21.15.62:51136) 2021-12-17T18:23:21.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.051+0000 7feed4dd9700 1 --2- 172.21.15.62:0/4276657914 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feed00604d0 0x7feed0146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:21.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.051+0000 7feecffff700 1 -- 172.21.15.62:0/4276657914 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feed00604d0 msgr2=0x7feed0146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:21.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feecffff700 1 --2- 172.21.15.62:0/4276657914 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feed00604d0 0x7feed0146510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feeceffd700 1 -- 172.21.15.62:0/4276657914 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189282247 0 0) 0x7feed00b2860 con 0x7feed00b06b0 2021-12-17T18:23:21.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feecffff700 1 -- 172.21.15.62:0/4276657914 >> v1:172.21.15.109:6789/0 conn(0x7feed00b06b0 legacy=0x7feed00ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:21.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feecffff700 1 -- 172.21.15.62:0/4276657914 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed00ad550 con 0x7feed005ca90 2021-12-17T18:23:21.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feecffff700 1 --2- 172.21.15.62:0/4276657914 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed005ca90 0x7feed014abf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7feec4002f70 tx=0x7feec4006eb0).ready entity=mon.0 client_cookie=d814b3d10e18e7 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:21.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feeceffd700 1 -- 172.21.15.62:0/4276657914 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feec400d570 con 0x7feed005ca90 2021-12-17T18:23:21.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feeceffd700 1 -- 172.21.15.62:0/4276657914 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec4000e90 con 0x7feed005ca90 2021-12-17T18:23:21.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feeceffd700 1 -- 172.21.15.62:0/4276657914 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feec400d8c0 con 0x7feed005ca90 2021-12-17T18:23:21.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feed55da700 1 -- 172.21.15.62:0/4276657914 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed005ca90 msgr2=0x7feed014abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:21.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feed55da700 1 --2- 172.21.15.62:0/4276657914 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed005ca90 0x7feed014abf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7feec4002f70 tx=0x7feec4006eb0).stop 2021-12-17T18:23:21.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feed55da700 1 -- 172.21.15.62:0/4276657914 shutdown_connections 2021-12-17T18:23:21.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feed55da700 1 --2- 172.21.15.62:0/4276657914 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feed00604d0 0x7feed0146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feed55da700 1 --2- 172.21.15.62:0/4276657914 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed005ca90 0x7feed014abf0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feed55da700 1 -- 172.21.15.62:0/4276657914 >> 172.21.15.62:0/4276657914 conn(0x7feed005c070 msgr2=0x7feed0062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:21.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feed55da700 1 -- 172.21.15.62:0/4276657914 shutdown_connections 2021-12-17T18:23:21.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feed55da700 1 -- 172.21.15.62:0/4276657914 wait complete. 2021-12-17T18:23:21.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feed55da700 1 Processor -- start 2021-12-17T18:23:21.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.055+0000 7feed55da700 1 -- start start 2021-12-17T18:23:21.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed55da700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feed005ca90 0x7feed014c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:21.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed55da700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feed00604d0 0x7feed0159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:21.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed55da700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed00b06b0 0x7feed015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:21.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed55da700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed00a1d80 con 0x7feed00b06b0 2021-12-17T18:23:21.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed55da700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed00a2020 con 0x7feed00604d0 2021-12-17T18:23:21.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed55da700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed00a22c0 con 0x7feed005ca90 2021-12-17T18:23:21.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed4dd9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed00b06b0 0x7feed015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:21.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed4dd9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed00b06b0 0x7feed015a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51246/0 (socket says 172.21.15.62:51246) 2021-12-17T18:23:21.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed4dd9700 1 -- 172.21.15.62:0/1289281904 learned_addr learned my addr 172.21.15.62:0/1289281904 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:21.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feecf7fe700 1 --2- 172.21.15.62:0/1289281904 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feed00604d0 0x7feed0159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:21.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feecffff700 1 --2- 172.21.15.62:0/1289281904 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feed005ca90 0x7feed014c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:21.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed4dd9700 1 -- 172.21.15.62:0/1289281904 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feed005ca90 msgr2=0x7feed014c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:21.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed4dd9700 1 --2- 172.21.15.62:0/1289281904 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feed005ca90 0x7feed014c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed4dd9700 1 -- 172.21.15.62:0/1289281904 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feed00604d0 msgr2=0x7feed0159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:21.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed4dd9700 1 --2- 172.21.15.62:0/1289281904 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feed00604d0 0x7feed0159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed4dd9700 1 -- 172.21.15.62:0/1289281904 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec400b1e0 con 0x7feed00b06b0 2021-12-17T18:23:21.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feecffff700 1 --2- 172.21.15.62:0/1289281904 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feed005ca90 0x7feed014c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:21.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed4dd9700 1 --2- 172.21.15.62:0/1289281904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed00b06b0 0x7feed015a1e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7feec8006e00 tx=0x7feec80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:21.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feecd7fa700 1 -- 172.21.15.62:0/1289281904 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feec800eeb0 con 0x7feed00b06b0 2021-12-17T18:23:21.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feecd7fa700 1 -- 172.21.15.62:0/1289281904 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec800c850 con 0x7feed00b06b0 2021-12-17T18:23:21.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed55da700 1 -- 172.21.15.62:0/1289281904 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed00a2760 con 0x7feed00b06b0 2021-12-17T18:23:21.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feecd7fa700 1 -- 172.21.15.62:0/1289281904 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feec800cbb0 con 0x7feed00b06b0 2021-12-17T18:23:21.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed55da700 1 -- 172.21.15.62:0/1289281904 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed009e9d0 con 0x7feed00b06b0 2021-12-17T18:23:21.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feed55da700 1 -- 172.21.15.62:0/1289281904 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed00a2480 con 0x7feed00b06b0 2021-12-17T18:23:21.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.059+0000 7feecd7fa700 1 -- 172.21.15.62:0/1289281904 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feec800cd10 con 0x7feed00b06b0 2021-12-17T18:23:21.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.063+0000 7feecd7fa700 1 --2- 172.21.15.62:0/1289281904 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feeb00536d0 0x7feeb0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:21.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.063+0000 7feecd7fa700 1 -- 172.21.15.62:0/1289281904 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5339+0+0 (secure 0 0 0) 0x7feec806b940 con 0x7feed00b06b0 2021-12-17T18:23:21.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.063+0000 7feecffff700 1 --2- 172.21.15.62:0/1289281904 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feeb00536d0 0x7feeb0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:21.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.063+0000 7feecffff700 1 --2- 172.21.15.62:0/1289281904 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feeb00536d0 0x7feeb0055b90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7feec401a000 tx=0x7feec4015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:21.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.067+0000 7feecd7fa700 1 -- 172.21.15.62:0/1289281904 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feec8042d80 con 0x7feed00b06b0 2021-12-17T18:23:21.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.199+0000 7feed55da700 1 -- 172.21.15.62:0/1289281904 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7feed00573d0 con 0x7feed00b06b0 2021-12-17T18:23:21.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.203+0000 7feecd7fa700 1 -- 172.21.15.62:0/1289281904 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7feec80463a0 con 0x7feed00b06b0 2021-12-17T18:23:21.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.207+0000 7feed55da700 1 -- 172.21.15.62:0/1289281904 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feeb00536d0 msgr2=0x7feeb0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:21.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.207+0000 7feed55da700 1 --2- 172.21.15.62:0/1289281904 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feeb00536d0 0x7feeb0055b90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7feec401a000 tx=0x7feec4015000).stop 2021-12-17T18:23:21.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.207+0000 7feed55da700 1 -- 172.21.15.62:0/1289281904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed00b06b0 msgr2=0x7feed015a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:21.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.207+0000 7feed55da700 1 --2- 172.21.15.62:0/1289281904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed00b06b0 0x7feed015a1e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7feec8006e00 tx=0x7feec80091d0).stop 2021-12-17T18:23:21.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.207+0000 7feed55da700 1 -- 172.21.15.62:0/1289281904 shutdown_connections 2021-12-17T18:23:21.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.207+0000 7feed55da700 1 --2- 172.21.15.62:0/1289281904 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feeb00536d0 0x7feeb0055b90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.207+0000 7feed55da700 1 --2- 172.21.15.62:0/1289281904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed00b06b0 0x7feed015a1e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.207+0000 7feed55da700 1 --2- 172.21.15.62:0/1289281904 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feed00604d0 0x7feed0159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.207+0000 7feed55da700 1 --2- 172.21.15.62:0/1289281904 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feed005ca90 0x7feed014c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.207+0000 7feed55da700 1 -- 172.21.15.62:0/1289281904 >> 172.21.15.62:0/1289281904 conn(0x7feed005c070 msgr2=0x7feed0146e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:21.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.207+0000 7feed55da700 1 -- 172.21.15.62:0/1289281904 shutdown_connections 2021-12-17T18:23:21.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.207+0000 7feed55da700 1 -- 172.21.15.62:0/1289281904 wait complete. 2021-12-17T18:23:21.224 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:23:21.225 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:23:21.239 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:23:21.261 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:23:21.282 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:23:21.301 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:23:21.322 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:23:21.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:21.323 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:23:21.323 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:23:21.330 INFO:teuthology.orchestra.run.smithi125.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-12-17T18:23:21.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:23:21.332 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-12-17T18:23:21.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:21.333 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:23:21.333 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:23:21.341 INFO:teuthology.orchestra.run.smithi158.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:23:21.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:23:21.342 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-12-17T18:23:21.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:21.343 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:23:21.343 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:23:21.351 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:23:21.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:23:21.352 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:23:21.353 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:23:21.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.447+0000 7f1007fff700 1 Processor -- start 2021-12-17T18:23:21.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1007fff700 1 -- start start 2021-12-17T18:23:21.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1007fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f10080b2b60 0x7f1008143760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:21.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1007fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1008143c50 0x7f10080b1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:21.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1007fff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1008143090 con 0x7f10080b3a40 2021-12-17T18:23:21.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1007fff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10080b1600 con 0x7f10080b2b60 2021-12-17T18:23:21.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1007fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10080b3e20 con 0x7f1008143c50 2021-12-17T18:23:21.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f10067fc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f10080b2b60 0x7f1008143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:21.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1006ffd700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f10080b3a40 0x7f10080b0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:51150/0 (socket says 172.21.15.62:51150) 2021-12-17T18:23:21.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1006ffd700 1 -- 172.21.15.62:0/2233293744 learned_addr learned my addr 172.21.15.62:0/2233293744 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:21.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f10077fe700 1 --2- 172.21.15.62:0/2233293744 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1008143c50 0x7f10080b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:21.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1005ffb700 1 -- 172.21.15.62:0/2233293744 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540198322 0 0) 0x7f1008143090 con 0x7f10080b3a40 2021-12-17T18:23:21.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1005ffb700 1 -- 172.21.15.62:0/2233293744 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fec003260 con 0x7f10080b3a40 2021-12-17T18:23:21.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f10067fc700 1 -- 172.21.15.62:0/2233293744 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1008143c50 msgr2=0x7f10080b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f10067fc700 1 --2- 172.21.15.62:0/2233293744 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1008143c50 0x7f10080b1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f10067fc700 1 -- 172.21.15.62:0/2233293744 >> v1:172.21.15.109:6789/0 conn(0x7f10080b3a40 legacy=0x7f10080b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f10067fc700 1 -- 172.21.15.62:0/2233293744 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1008146550 con 0x7f10080b2b60 2021-12-17T18:23:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f10067fc700 1 --2- 172.21.15.62:0/2233293744 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10080b2b60 0x7f1008143760 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f0ffc002f70 tx=0x7f0ffc006df0).ready entity=mon.1 client_cookie=8ceebc18674544b0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:21.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1005ffb700 1 -- 172.21.15.62:0/2233293744 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ffc00d4a0 con 0x7f10080b2b60 2021-12-17T18:23:21.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1005ffb700 1 -- 172.21.15.62:0/2233293744 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc000e90 con 0x7f10080b2b60 2021-12-17T18:23:21.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1005ffb700 1 -- 172.21.15.62:0/2233293744 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ffc00d7f0 con 0x7f10080b2b60 2021-12-17T18:23:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1007fff700 1 -- 172.21.15.62:0/2233293744 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10080b2b60 msgr2=0x7f1008143760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1007fff700 1 --2- 172.21.15.62:0/2233293744 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10080b2b60 0x7f1008143760 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f0ffc002f70 tx=0x7f0ffc006df0).stop 2021-12-17T18:23:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1007fff700 1 -- 172.21.15.62:0/2233293744 shutdown_connections 2021-12-17T18:23:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1007fff700 1 --2- 172.21.15.62:0/2233293744 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1008143c50 0x7f10080b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1007fff700 1 --2- 172.21.15.62:0/2233293744 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10080b2b60 0x7f1008143760 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1007fff700 1 -- 172.21.15.62:0/2233293744 >> 172.21.15.62:0/2233293744 conn(0x7f10080b7020 msgr2=0x7f10080b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1007fff700 1 -- 172.21.15.62:0/2233293744 shutdown_connections 2021-12-17T18:23:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.451+0000 7f1007fff700 1 -- 172.21.15.62:0/2233293744 wait complete. 2021-12-17T18:23:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f1007fff700 1 Processor -- start 2021-12-17T18:23:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f1007fff700 1 -- start start 2021-12-17T18:23:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f1007fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10080b2b60 0x7f10080af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f1007fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10080b3a40 0x7f1008126c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f1007fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1008143c50 0x7f1008127100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f1007fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1008147610 con 0x7f1008143c50 2021-12-17T18:23:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f1007fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1008146990 con 0x7f10080b2b60 2021-12-17T18:23:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f1007fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1008146c30 con 0x7f10080b3a40 2021-12-17T18:23:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f10077fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1008143c50 0x7f1008127100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:21.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f10077fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1008143c50 0x7f1008127100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51258/0 (socket says 172.21.15.62:51258) 2021-12-17T18:23:21.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f10077fe700 1 -- 172.21.15.62:0/1030924041 learned_addr learned my addr 172.21.15.62:0/1030924041 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:21.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f1006ffd700 1 --2- 172.21.15.62:0/1030924041 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10080b2b60 0x7f10080af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:21.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f10067fc700 1 --2- 172.21.15.62:0/1030924041 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10080b3a40 0x7f1008126c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f10077fe700 1 -- 172.21.15.62:0/1030924041 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10080b3a40 msgr2=0x7f1008126c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f10077fe700 1 --2- 172.21.15.62:0/1030924041 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10080b3a40 0x7f1008126c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f10077fe700 1 -- 172.21.15.62:0/1030924041 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10080b2b60 msgr2=0x7f10080af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:21.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f10077fe700 1 --2- 172.21.15.62:0/1030924041 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10080b2b60 0x7f10080af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f10077fe700 1 -- 172.21.15.62:0/1030924041 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc00b180 con 0x7f1008143c50 2021-12-17T18:23:21.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f1006ffd700 1 --2- 172.21.15.62:0/1030924041 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10080b2b60 0x7f10080af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:21.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f10077fe700 1 --2- 172.21.15.62:0/1030924041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1008143c50 0x7f1008127100 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f100000c000 tx=0x7f10000091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:21.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f0ff7fff700 1 -- 172.21.15.62:0/1030924041 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f100000c670 con 0x7f1008143c50 2021-12-17T18:23:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f0ff7fff700 1 -- 172.21.15.62:0/1030924041 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100000c7d0 con 0x7f1008143c50 2021-12-17T18:23:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f1007fff700 1 -- 172.21.15.62:0/1030924041 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1008146ed0 con 0x7f1008143c50 2021-12-17T18:23:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f0ff7fff700 1 -- 172.21.15.62:0/1030924041 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f100000cb30 con 0x7f1008143c50 2021-12-17T18:23:21.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.455+0000 7f1007fff700 1 -- 172.21.15.62:0/1030924041 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10081275f0 con 0x7f1008143c50 2021-12-17T18:23:21.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.459+0000 7f1007fff700 1 -- 172.21.15.62:0/1030924041 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1008141910 con 0x7f1008143c50 2021-12-17T18:23:21.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.459+0000 7f0ff7fff700 1 -- 172.21.15.62:0/1030924041 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1000022070 con 0x7f1008143c50 2021-12-17T18:23:21.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.459+0000 7f0ff7fff700 1 --2- 172.21.15.62:0/1030924041 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0fe4053720 0x7f0fe4055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:21.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.459+0000 7f0ff7fff700 1 -- 172.21.15.62:0/1030924041 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f100006bdb0 con 0x7f1008143c50 2021-12-17T18:23:21.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.459+0000 7f1006ffd700 1 --2- 172.21.15.62:0/1030924041 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0fe4053720 0x7f0fe4055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:21.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.459+0000 7f1006ffd700 1 --2- 172.21.15.62:0/1030924041 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0fe4053720 0x7f0fe4055be0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f0ff800b000 tx=0x7f0ff8009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:21.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.463+0000 7f0ff7fff700 1 -- 172.21.15.62:0/1030924041 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1008141910 con 0x7f1008143c50 2021-12-17T18:23:21.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.591+0000 7f1007fff700 1 -- 172.21.15.62:0/1030924041 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1008141910 con 0x7f1008143c50 2021-12-17T18:23:21.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.591+0000 7f0ff7fff700 1 -- 172.21.15.62:0/1030924041 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v54) v1 ==== 81+0+28876 (secure 0 0 0) 0x7f1008141910 con 0x7f1008143c50 2021-12-17T18:23:21.598 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:21.599 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:23:21.599 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 54, 2021-12-17T18:23:21.599 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:23:21.599 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:23:21.600 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:23:17.884994+0000", 2021-12-17T18:23:21.600 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:23:21.600 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:23:21.600 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:23:21.601 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:23:21.601 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:23:21.601 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:23:21.601 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:23:21.601 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:23:21.602 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:23:21.602 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:23:21.602 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:23:21.602 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:23:21.603 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:23:21.603 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:23:21.603 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:23:21.603 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 10, 2021-12-17T18:23:21.604 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:23:21.604 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:23:21.604 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:23:21.604 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:23:21.605 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:23:21.605 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.605 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:23:21.605 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:23:21.605 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:23:21.606 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:23:21.606 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:23:21.606 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:23:21.606 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:23:21.607 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:23:21.607 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:23:21.607 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:23:21.607 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:23:21.607 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:23:21.608 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:23:21.608 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:23:21.608 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:23:21.608 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:23:21.609 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:23:21.609 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:23:21.609 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:23:21.609 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:23:21.610 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:23:21.610 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:23:21.610 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:23:21.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.611 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:23:21.611 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:23:21.611 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:23:21.611 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:23:21.612 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:23:21.612 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:23:21.612 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:23:21.612 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:23:21.612 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:23:21.613 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:23:21.613 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:23:21.613 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:23:21.613 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:23:21.614 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:23:21.614 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:23:21.614 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:23:21.614 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:23:21.615 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:23:21.615 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:23:21.615 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:23:21.615 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:23:21.615 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:23:21.616 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:23:21.616 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:23:21.616 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:23:21.616 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:23:21.617 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:23:21.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.617 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:23:21.617 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:23:21.617 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:23:21.618 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:23:21.618 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:23:21.618 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:23:21.618 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:23:21.618 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:23:21.619 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:23:21.619 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:23:21.619 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:23:21.619 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:23:21.620 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:23:21.620 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.620 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:23:21.620 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:23:21.620 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.621 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.621 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.621 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:23:21.621 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:23:21.622 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:23:21.622 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:23:21.622 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:23:21.622 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:23:21.623 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:23:21.623 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:23:21.623 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:23:21.623 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:23:21.623 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:23:21.624 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:23:21.624 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:23:21.624 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:23:21.624 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:23:21.625 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:23:21.625 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:23:21.625 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:23:21.625 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:23:21.625 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:23:21.626 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:23:21.626 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:23:21.626 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:23:21.626 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.627 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:23:21.627 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:23:21.627 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:23:21.627 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:23:21.628 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:23:21.628 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:23:21.628 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:23:21.628 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:23:21.628 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:23:21.629 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:23:21.629 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:23:21.629 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:23:21.629 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:23:21.629 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:23:21.630 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:23:21.630 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:23:21.630 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:23:21.630 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:23:21.631 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:23:21.631 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:23:21.631 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:23:21.631 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:23:21.631 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:23:21.632 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:23:21.632 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:23:21.632 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:23:21.632 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:23:21.633 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.633 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:23:21.633 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:23:21.633 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:23:21.633 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:23:21.634 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:23:21.634 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:23:21.634 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:23:21.634 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:23:21.634 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:23:21.635 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:23:21.635 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:23:21.635 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:23:21.635 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:23:21.635 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:23:21.636 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.636 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.636 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:23:21.636 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:23:21.637 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.637 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:23:21.637 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:23:21.637 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:21.637 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:21.638 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:21.638 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:21.638 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:21.638 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:21.638 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:21.639 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 49, 2021-12-17T18:23:21.639 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:21.639 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:21.639 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:21.640 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.640 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.640 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.640 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:23:21.640 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:21.641 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.641 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.641 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.641 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:23:21.642 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:21.642 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.642 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.642 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.642 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:21.643 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.643 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.643 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.643 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:23:21.644 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:21.644 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.644 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.644 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.644 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:23:21.645 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:21.645 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.645 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.645 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.645 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:21.646 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.646 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.646 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.646 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:23:21.646 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:21.647 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.647 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.647 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.647 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:23:21.648 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:21.648 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.648 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.648 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.648 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:21.649 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.649 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.649 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.649 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:23:21.650 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:21.650 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.650 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.650 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.650 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:23:21.651 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:21.651 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.651 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.651 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.652 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:23:21.652 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:23:21.652 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:23:21.652 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:23:21.652 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:21.653 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:21.653 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:21.653 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.653 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.653 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.654 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:23:21.654 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:23:21.654 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:21.654 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:21.655 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:21.655 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:21.655 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:21.655 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:21.655 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:21.656 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 49, 2021-12-17T18:23:21.656 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:21.656 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:21.656 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:21.657 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.657 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.657 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.657 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:23:21.657 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:21.658 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.658 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.658 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.658 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:23:21.659 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:21.659 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.659 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.660 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.660 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:21.660 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.661 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.661 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.661 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:23:21.661 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:21.662 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.662 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.662 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.662 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:23:21.663 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:21.663 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.663 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.663 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.664 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:21.664 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.664 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.664 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.664 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:23:21.665 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:21.665 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.665 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.665 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.666 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:23:21.666 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:21.666 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.666 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.667 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.667 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:21.667 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.668 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.668 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.668 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:23:21.668 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:21.668 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.669 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.669 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.669 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:23:21.669 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:21.670 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.670 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.670 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.670 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:23:21.671 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:23:21.671 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:23:21.671 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:23:21.671 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:21.672 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:21.672 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:21.672 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.672 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.673 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.673 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:23:21.673 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:23:21.673 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:21.674 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:21.674 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:21.674 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:21.674 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:21.675 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:21.675 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:21.675 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 49, 2021-12-17T18:23:21.675 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:21.676 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:21.676 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:21.676 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.676 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.677 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.677 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:23:21.677 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:21.677 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.677 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.678 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.678 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:23:21.678 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:21.678 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.679 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.679 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.679 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:21.679 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.680 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.680 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.680 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:23:21.680 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:21.681 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.681 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.681 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.681 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:23:21.682 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:21.682 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.682 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.682 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.683 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:21.683 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.683 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.683 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.684 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:23:21.684 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:21.684 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.684 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.685 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.685 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:23:21.685 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:21.685 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.685 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.686 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.686 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:21.686 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.686 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.687 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.687 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:23:21.687 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:21.687 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.688 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.688 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.688 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:23:21.688 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:21.689 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.689 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.689 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.689 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:23:21.690 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:23:21.690 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:23:21.690 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:23:21.690 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:21.691 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:21.691 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:21.691 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.692 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:23:21.692 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:23:21.692 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:21.692 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:21.693 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:21.693 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:21.693 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:21.693 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:21.694 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:21.694 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 48, 2021-12-17T18:23:21.694 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:21.694 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:21.695 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:21.695 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.695 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.696 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.696 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:23:21.696 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:21.696 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.697 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.697 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.697 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:23:21.697 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:21.698 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.698 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.698 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:21.699 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.699 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.699 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.699 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:23:21.700 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:21.700 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.700 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.700 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.701 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:23:21.701 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:21.701 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.701 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.702 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.702 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:21.702 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.702 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.703 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.703 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:23:21.703 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:21.703 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.704 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.704 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.704 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:23:21.704 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:21.705 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.705 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.705 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.705 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:21.706 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.706 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.706 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.706 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:23:21.707 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:21.707 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.707 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.707 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.708 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:23:21.708 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:21.708 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.708 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.709 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.709 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:23:21.709 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:23:21.709 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:23:21.710 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:23:21.710 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:21.710 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:21.710 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:21.711 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.711 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.711 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.711 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:23:21.712 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:23:21.712 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:21.712 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:21.712 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:21.712 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:21.713 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:21.713 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:21.713 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:21.713 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 49, 2021-12-17T18:23:21.714 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:21.714 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:21.714 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:21.715 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.715 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.715 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.715 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:23:21.716 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:21.716 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.716 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.716 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.717 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:23:21.717 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:21.717 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.717 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.718 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.718 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:21.718 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.719 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.719 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.719 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:23:21.720 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:21.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.720 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.720 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.721 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:23:21.721 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:21.721 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.721 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.721 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.722 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:21.722 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.722 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.722 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.723 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:23:21.723 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:21.723 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.723 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.724 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.724 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:23:21.724 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:21.724 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.725 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.725 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:21.725 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.726 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.726 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.726 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:23:21.726 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:21.727 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.727 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.727 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.727 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:23:21.727 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:21.728 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.728 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.728 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.728 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:23:21.729 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:23:21.729 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:23:21.729 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:23:21.730 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:21.730 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:21.730 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:21.730 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.731 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.731 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.731 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:23:21.732 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:23:21.732 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:21.732 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:21.732 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:21.732 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:21.733 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:21.733 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:21.733 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:21.733 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 49, 2021-12-17T18:23:21.734 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:21.734 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:21.734 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:21.734 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.735 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.735 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.735 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:23:21.735 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:21.736 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.736 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.736 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.736 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:23:21.737 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:21.737 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.737 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.737 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.738 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:21.738 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.738 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.738 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.738 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:23:21.739 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:21.739 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.739 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.739 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.740 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:23:21.740 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:21.740 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.741 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.741 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.741 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:21.742 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.743 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.743 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.743 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:23:21.743 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:21.744 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.744 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.744 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.744 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:23:21.745 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:21.745 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.745 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.745 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.745 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:21.746 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.746 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.746 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.746 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:23:21.747 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:21.747 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.747 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.747 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.748 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:23:21.748 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:21.748 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.748 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.748 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.749 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:23:21.749 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:23:21.749 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:23:21.749 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:23:21.750 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:21.750 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:21.750 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:21.750 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.751 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.751 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.751 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:23:21.751 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:23:21.751 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:21.752 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:21.752 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:21.752 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:21.752 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:21.753 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:21.753 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:21.753 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 49, 2021-12-17T18:23:21.753 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:21.753 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:21.754 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:21.754 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.754 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.754 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.755 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:23:21.755 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:21.755 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.755 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.756 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.756 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:23:21.756 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:21.756 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.756 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.757 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.757 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:21.757 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.757 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.758 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.758 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:23:21.758 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:21.758 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.759 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.759 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.759 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:23:21.759 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:21.760 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.760 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.760 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.760 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:21.760 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.761 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.761 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.761 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:23:21.761 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:21.762 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.762 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.762 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.762 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:23:21.762 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:21.763 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.763 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.763 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.763 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:21.764 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.764 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.764 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.764 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:23:21.764 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:21.765 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.765 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.765 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.765 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:23:21.766 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:21.766 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.766 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.766 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.766 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:23:21.767 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:23:21.767 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:23:21.767 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:23:21.767 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:21.768 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:21.768 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:21.768 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.768 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.768 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.769 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:23:21.769 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:23:21.769 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:21.769 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:21.770 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:21.770 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:21.770 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:21.770 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:21.770 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:21.771 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 48, 2021-12-17T18:23:21.771 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:21.771 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:21.771 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:21.772 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.772 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.772 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.772 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:23:21.772 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:21.773 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.773 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.773 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.773 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:23:21.774 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:21.774 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.774 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.774 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.774 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:21.775 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.775 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.775 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.775 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:23:21.776 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:21.776 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.776 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.776 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.776 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:23:21.777 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:21.777 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.777 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.777 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.778 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:21.778 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.778 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.778 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.779 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:23:21.779 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:21.779 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.779 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.780 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.780 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:23:21.780 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:21.780 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.780 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.781 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.781 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:21.781 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:21.781 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.781 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:21.782 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:23:21.782 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:21.782 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.782 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.783 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:21.783 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:23:21.783 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:21.783 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.783 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.784 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.784 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:23:21.784 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:23:21.784 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:23:21.785 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:23:21.785 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:21.785 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:21.785 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:21.785 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:21.786 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.786 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:23:21.786 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:23:21.786 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.787 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:23:21.787 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:21.787 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:21.787 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:21.787 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:21.788 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:21.788 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:23:21.788 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:21.788 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.789 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.789 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:23:21.789 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:21.789 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:21.789 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:21.790 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:21.790 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:21.790 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:23:21.790 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:21.791 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.791 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.791 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:23:21.791 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:21.791 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:21.792 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:21.792 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:21.792 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:21.792 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:23:21.793 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:21.793 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.793 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.793 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:23:21.793 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:21.794 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:21.794 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:21.794 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:21.794 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:21.795 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:23:21.795 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:21.795 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.795 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.795 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:23:21.796 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:21.796 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:21.796 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:21.796 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:21.797 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:21.797 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:23:21.797 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:21.797 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.797 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.798 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:23:21.798 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:21.798 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:21.798 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:21.799 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:21.799 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:21.799 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:23:21.799 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:21.799 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.800 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.800 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:23:21.800 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:21.800 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:21.800 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:21.801 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:21.801 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:21.801 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:23:21.801 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:21.802 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.802 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:21.802 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:23:21.802 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:21.802 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:21.803 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:21.803 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:21.803 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:21.803 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:23:21.804 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:21.804 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.804 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:23:21.804 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:23:21.804 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:23:21.805 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:23:21.805 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:23:21.805 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": { 2021-12-17T18:23:21.805 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6833/3358597467": "2021-12-18T18:23:13.847174+0000", 2021-12-17T18:23:21.806 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6832/3358597467": "2021-12-18T18:23:13.847174+0000" 2021-12-17T18:23:21.806 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.806 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:23:21.806 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:23:21.806 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:23:21.807 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:23:21.807 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:23:21.807 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:23:21.807 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:23:21.808 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:23:21.808 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:21.808 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:21.808 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:23:21.808 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:23:21.809 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:23:21.809 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:23:21.809 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:23:21.809 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:23:21.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.595+0000 7f1007fff700 1 -- 172.21.15.62:0/1030924041 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0fe4053720 msgr2=0x7f0fe4055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:21.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.595+0000 7f1007fff700 1 --2- 172.21.15.62:0/1030924041 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0fe4053720 0x7f0fe4055be0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f0ff800b000 tx=0x7f0ff8009040).stop 2021-12-17T18:23:21.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.595+0000 7f1007fff700 1 -- 172.21.15.62:0/1030924041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1008143c50 msgr2=0x7f1008127100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:21.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.595+0000 7f1007fff700 1 --2- 172.21.15.62:0/1030924041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1008143c50 0x7f1008127100 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f100000c000 tx=0x7f10000091d0).stop 2021-12-17T18:23:21.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.595+0000 7f1007fff700 1 -- 172.21.15.62:0/1030924041 shutdown_connections 2021-12-17T18:23:21.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.595+0000 7f1007fff700 1 --2- 172.21.15.62:0/1030924041 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0fe4053720 0x7f0fe4055be0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.595+0000 7f1007fff700 1 --2- 172.21.15.62:0/1030924041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1008143c50 0x7f1008127100 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.595+0000 7f1007fff700 1 --2- 172.21.15.62:0/1030924041 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10080b3a40 0x7f1008126c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.595+0000 7f1007fff700 1 --2- 172.21.15.62:0/1030924041 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10080b2b60 0x7f10080af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.595+0000 7f1007fff700 1 -- 172.21.15.62:0/1030924041 >> 172.21.15.62:0/1030924041 conn(0x7f10080b7020 msgr2=0x7f10080b1740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:21.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.595+0000 7f1007fff700 1 -- 172.21.15.62:0/1030924041 shutdown_connections 2021-12-17T18:23:21.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.595+0000 7f1007fff700 1 -- 172.21.15.62:0/1030924041 wait complete. 2021-12-17T18:23:21.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:23:21.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf22c18700 1 Processor -- start 2021-12-17T18:23:21.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf22c18700 1 -- start start 2021-12-17T18:23:21.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf22c18700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcf1c0b5b20 0x7fcf1c0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:21.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf22c18700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c0b5f00 con 0x7fcf1c0b3760 2021-12-17T18:23:21.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf22c18700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c0b3020 con 0x7fcf1c1458d0 2021-12-17T18:23:21.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf22c18700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c0b32c0 con 0x7fcf1c0b5b20 2021-12-17T18:23:21.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf21c16700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcf1c0b5b20 0x7fcf1c0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:21.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf21c16700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcf1c0b5b20 0x7fcf1c0b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51264/0 (socket says 172.21.15.62:51264) 2021-12-17T18:23:21.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf21c16700 1 -- 172.21.15.62:0/3073050518 learned_addr learned my addr 172.21.15.62:0/3073050518 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:21.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf21c16700 1 -- 172.21.15.62:0/3073050518 >> v1:172.21.15.109:6789/0 conn(0x7fcf1c1458d0 legacy=0x7fcf1c145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:21.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf21c16700 1 -- 172.21.15.62:0/3073050518 >> v1:172.21.15.62:6789/0 conn(0x7fcf1c0b3760 legacy=0x7fcf1c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:21.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf20c14700 1 -- 172.21.15.62:0/3073050518 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296210895 0 0) 0x7fcf1c0b5f00 con 0x7fcf1c0b3760 2021-12-17T18:23:21.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf21c16700 1 -- 172.21.15.62:0/3073050518 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c0b6e90 con 0x7fcf1c0b5b20 2021-12-17T18:23:21.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf21c16700 1 --2- 172.21.15.62:0/3073050518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c0b5b20 0x7fcf1c0b6290 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fcf18002f70 tx=0x7fcf18006eb0).ready entity=mon.0 client_cookie=4759580357de49a6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:21.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf20c14700 1 -- 172.21.15.62:0/3073050518 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf1800d660 con 0x7fcf1c0b5b20 2021-12-17T18:23:21.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf20c14700 1 -- 172.21.15.62:0/3073050518 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf18000e90 con 0x7fcf1c0b5b20 2021-12-17T18:23:21.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf20c14700 1 -- 172.21.15.62:0/3073050518 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf1800d9b0 con 0x7fcf1c0b5b20 2021-12-17T18:23:21.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf22c18700 1 -- 172.21.15.62:0/3073050518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c0b5b20 msgr2=0x7fcf1c0b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:21.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf22c18700 1 --2- 172.21.15.62:0/3073050518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c0b5b20 0x7fcf1c0b6290 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fcf18002f70 tx=0x7fcf18006eb0).stop 2021-12-17T18:23:21.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf22c18700 1 -- 172.21.15.62:0/3073050518 shutdown_connections 2021-12-17T18:23:21.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf22c18700 1 --2- 172.21.15.62:0/3073050518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c0b5b20 0x7fcf1c0b6290 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf22c18700 1 -- 172.21.15.62:0/3073050518 >> 172.21.15.62:0/3073050518 conn(0x7fcf1c05c750 msgr2=0x7fcf1c05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:21.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf22c18700 1 -- 172.21.15.62:0/3073050518 shutdown_connections 2021-12-17T18:23:21.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.923+0000 7fcf22c18700 1 -- 172.21.15.62:0/3073050518 wait complete. 2021-12-17T18:23:21.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22c18700 1 Processor -- start 2021-12-17T18:23:21.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22c18700 1 -- start start 2021-12-17T18:23:21.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22c18700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf1c0b5b20 0x7fcf1c0b9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:21.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22c18700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf1c1458d0 0x7fcf1c152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:21.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22c18700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c066be0 0x7fcf1c152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:21.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22c18700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0ba690 con 0x7fcf1c066be0 2021-12-17T18:23:21.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22c18700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c065000 con 0x7fcf1c0b5b20 2021-12-17T18:23:21.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22c18700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c064ac0 con 0x7fcf1c1458d0 2021-12-17T18:23:21.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22417700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c066be0 0x7fcf1c152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:21.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf21c16700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf1c0b5b20 0x7fcf1c0b9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:21.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf21415700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf1c1458d0 0x7fcf1c152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:21.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22417700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c066be0 0x7fcf1c152e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51274/0 (socket says 172.21.15.62:51274) 2021-12-17T18:23:21.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22417700 1 -- 172.21.15.62:0/3238808625 learned_addr learned my addr 172.21.15.62:0/3238808625 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:21.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22417700 1 -- 172.21.15.62:0/3238808625 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf1c1458d0 msgr2=0x7fcf1c152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:21.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22417700 1 --2- 172.21.15.62:0/3238808625 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf1c1458d0 0x7fcf1c152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22417700 1 -- 172.21.15.62:0/3238808625 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf1c0b5b20 msgr2=0x7fcf1c0b9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:21.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22417700 1 --2- 172.21.15.62:0/3238808625 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf1c0b5b20 0x7fcf1c0b9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:21.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22417700 1 -- 172.21.15.62:0/3238808625 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1800b1e0 con 0x7fcf1c066be0 2021-12-17T18:23:21.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22417700 1 --2- 172.21.15.62:0/3238808625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c066be0 0x7fcf1c152e80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fcf1c065190 tx=0x7fcf140013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:21.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf0affd700 1 -- 172.21.15.62:0/3238808625 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf14006aa0 con 0x7fcf1c066be0 2021-12-17T18:23:21.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22c18700 1 -- 172.21.15.62:0/3238808625 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1c064d60 con 0x7fcf1c066be0 2021-12-17T18:23:21.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf0affd700 1 -- 172.21.15.62:0/3238808625 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf14006c00 con 0x7fcf1c066be0 2021-12-17T18:23:21.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf0affd700 1 -- 172.21.15.62:0/3238808625 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf14007030 con 0x7fcf1c066be0 2021-12-17T18:23:21.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.927+0000 7fcf22c18700 1 -- 172.21.15.62:0/3238808625 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c1523b0 con 0x7fcf1c066be0 2021-12-17T18:23:21.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.931+0000 7fcf22c18700 1 -- 172.21.15.62:0/3238808625 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c065e40 con 0x7fcf1c066be0 2021-12-17T18:23:21.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.931+0000 7fcf0affd700 1 -- 172.21.15.62:0/3238808625 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcf14010030 con 0x7fcf1c066be0 2021-12-17T18:23:21.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.931+0000 7fcf0affd700 1 --2- 172.21.15.62:0/3238808625 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcefc053610 0x7fcefc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:21.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.931+0000 7fcf0affd700 1 -- 172.21.15.62:0/3238808625 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fcf1406b4e0 con 0x7fcf1c066be0 2021-12-17T18:23:21.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.931+0000 7fcf21c16700 1 --2- 172.21.15.62:0/3238808625 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcefc053610 0x7fcefc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:21.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.931+0000 7fcf21c16700 1 --2- 172.21.15.62:0/3238808625 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcefc053610 0x7fcefc055ad0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fcf1801c000 tx=0x7fcf18015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:21.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:21.935+0000 7fcf0affd700 1 -- 172.21.15.62:0/3238808625 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf1c065e40 con 0x7fcf1c066be0 2021-12-17T18:23:22.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.099+0000 7fcf22c18700 1 -- 172.21.15.62:0/3238808625 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf1c065e40 con 0x7fcf1c066be0 2021-12-17T18:23:22.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.099+0000 7fcf0affd700 1 -- 172.21.15.62:0/3238808625 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+1212 (secure 0 0 0) 0x7fcf1c065e40 con 0x7fcf1c066be0 2021-12-17T18:23:22.105 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:22.105 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3056253780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3056253780},{"type":"v1","addr":"172.21.15.109:6835","nonce":3056253780}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19},{"gid":5907,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3919966501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3919966501},{"type":"v1","addr":"172.21.15.62:6833","nonce":3919966501}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[]} 2021-12-17T18:23:22.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.099+0000 7fcf22c18700 1 -- 172.21.15.62:0/3238808625 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcefc053610 msgr2=0x7fcefc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:22.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.099+0000 7fcf22c18700 1 --2- 172.21.15.62:0/3238808625 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcefc053610 0x7fcefc055ad0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fcf1801c000 tx=0x7fcf18015000).stop 2021-12-17T18:23:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.099+0000 7fcf22c18700 1 -- 172.21.15.62:0/3238808625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c066be0 msgr2=0x7fcf1c152e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.099+0000 7fcf22c18700 1 --2- 172.21.15.62:0/3238808625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c066be0 0x7fcf1c152e80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fcf1c065190 tx=0x7fcf140013a0).stop 2021-12-17T18:23:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.099+0000 7fcf22c18700 1 -- 172.21.15.62:0/3238808625 shutdown_connections 2021-12-17T18:23:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.099+0000 7fcf22c18700 1 --2- 172.21.15.62:0/3238808625 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcefc053610 0x7fcefc055ad0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.099+0000 7fcf22c18700 1 --2- 172.21.15.62:0/3238808625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c066be0 0x7fcf1c152e80 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.099+0000 7fcf22c18700 1 --2- 172.21.15.62:0/3238808625 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf1c1458d0 0x7fcf1c152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.099+0000 7fcf22c18700 1 --2- 172.21.15.62:0/3238808625 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf1c0b5b20 0x7fcf1c0b9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.099+0000 7fcf22c18700 1 -- 172.21.15.62:0/3238808625 >> 172.21.15.62:0/3238808625 conn(0x7fcf1c05c750 msgr2=0x7fcf1c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:22.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.099+0000 7fcf22c18700 1 -- 172.21.15.62:0/3238808625 shutdown_connections 2021-12-17T18:23:22.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.099+0000 7fcf22c18700 1 -- 172.21.15.62:0/3238808625 wait complete. 2021-12-17T18:23:22.109 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 23 2021-12-17T18:23:22.118 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:23:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.215+0000 7f315880f700 1 Processor -- start 2021-12-17T18:23:22.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.215+0000 7f315880f700 1 -- start start 2021-12-17T18:23:22.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315880f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f31540b5b20 0x7f31540b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:22.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315880f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f31540b3760 0x7f31540b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315880f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f31540b6c70 0x7f3154146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315880f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31540b5f00 con 0x7f31540b6c70 2021-12-17T18:23:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315880f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31540b3020 con 0x7f31540b3760 2021-12-17T18:23:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315880f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31540b32c0 con 0x7f31540b5b20 2021-12-17T18:23:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f31540b6c70 0x7f3154146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:22.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f31540b6c70 0x7f3154146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51282/0 (socket says 172.21.15.62:51282) 2021-12-17T18:23:22.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315359e700 1 -- 172.21.15.62:0/2006879309 learned_addr learned my addr 172.21.15.62:0/2006879309 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:22.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f314a59c700 1 --2- 172.21.15.62:0/2006879309 >> v2:172.21.15.109:3300/0 conn(0x7f31540b3760 0x7f31540b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:22.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f3152d9d700 1 --2- 172.21.15.62:0/2006879309 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f31540b5b20 0x7f31540b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:22.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315359e700 1 -- 172.21.15.62:0/2006879309 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f31540b5b20 msgr2=0x7f31540b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:22.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315359e700 1 --2- 172.21.15.62:0/2006879309 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f31540b5b20 0x7f31540b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315359e700 1 -- 172.21.15.62:0/2006879309 >> v2:172.21.15.109:3300/0 conn(0x7f31540b3760 msgr2=0x7f31540b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:22.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315359e700 1 --2- 172.21.15.62:0/2006879309 >> v2:172.21.15.109:3300/0 conn(0x7f31540b3760 0x7f31540b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315359e700 1 -- 172.21.15.62:0/2006879309 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31540b5440 con 0x7f31540b6c70 2021-12-17T18:23:22.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f314a59c700 1 --2- 172.21.15.62:0/2006879309 >> v2:172.21.15.109:3300/0 conn(0x7f31540b3760 0x7f31540b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:22.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f3152d9d700 1 --2- 172.21.15.62:0/2006879309 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f31540b5b20 0x7f31540b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:22.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315359e700 1 --2- 172.21.15.62:0/2006879309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31540b6c70 0x7f3154146980 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f314c0032f0 tx=0x7f314c009290).ready entity=mon.0 client_cookie=59eaa1a78e8cd3bf server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:22.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315259c700 1 -- 172.21.15.62:0/2006879309 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f314c00b870 con 0x7f31540b6c70 2021-12-17T18:23:22.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315259c700 1 -- 172.21.15.62:0/2006879309 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c00b9d0 con 0x7f31540b6c70 2021-12-17T18:23:22.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315259c700 1 -- 172.21.15.62:0/2006879309 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f314c00bb40 con 0x7f31540b6c70 2021-12-17T18:23:22.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315880f700 1 -- 172.21.15.62:0/2006879309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31540b6c70 msgr2=0x7f3154146980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315880f700 1 --2- 172.21.15.62:0/2006879309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31540b6c70 0x7f3154146980 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f314c0032f0 tx=0x7f314c009290).stop 2021-12-17T18:23:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315880f700 1 -- 172.21.15.62:0/2006879309 shutdown_connections 2021-12-17T18:23:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315880f700 1 --2- 172.21.15.62:0/2006879309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31540b6c70 0x7f3154146980 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315880f700 1 --2- 172.21.15.62:0/2006879309 >> v2:172.21.15.109:3300/0 conn(0x7f31540b3760 0x7f31540b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315880f700 1 --2- 172.21.15.62:0/2006879309 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f31540b5b20 0x7f31540b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315880f700 1 -- 172.21.15.62:0/2006879309 >> 172.21.15.62:0/2006879309 conn(0x7f315405c750 msgr2=0x7f315405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315880f700 1 -- 172.21.15.62:0/2006879309 shutdown_connections 2021-12-17T18:23:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315880f700 1 -- 172.21.15.62:0/2006879309 wait complete. 2021-12-17T18:23:22.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315880f700 1 Processor -- start 2021-12-17T18:23:22.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.219+0000 7f315880f700 1 -- start start 2021-12-17T18:23:22.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f315880f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31540b5b20 0x7f31540af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:22.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f315880f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f31540b6c70 0x7f3154153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:22.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f315880f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3154148800 0x7f3154066040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:22.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f315880f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3154065500 con 0x7f31540b5b20 2021-12-17T18:23:22.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f315880f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3154143bd0 con 0x7f3154148800 2021-12-17T18:23:22.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f315880f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31541527a0 con 0x7f31540b6c70 2021-12-17T18:23:22.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f3152d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31540b5b20 0x7f31540af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:22.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f3152d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31540b5b20 0x7f31540af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51284/0 (socket says 172.21.15.62:51284) 2021-12-17T18:23:22.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f3152d9d700 1 -- 172.21.15.62:0/655017168 learned_addr learned my addr 172.21.15.62:0/655017168 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:22.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f315359e700 1 --2- 172.21.15.62:0/655017168 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3154148800 0x7f3154066040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:22.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f314a59c700 1 --2- 172.21.15.62:0/655017168 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f31540b6c70 0x7f3154153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:22.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f3152d9d700 1 -- 172.21.15.62:0/655017168 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f31540b6c70 msgr2=0x7f3154153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:22.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f3152d9d700 1 --2- 172.21.15.62:0/655017168 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f31540b6c70 0x7f3154153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f3152d9d700 1 -- 172.21.15.62:0/655017168 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3154148800 msgr2=0x7f3154066040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:22.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f3152d9d700 1 --2- 172.21.15.62:0/655017168 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3154148800 0x7f3154066040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f3152d9d700 1 -- 172.21.15.62:0/655017168 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c009530 con 0x7f31540b5b20 2021-12-17T18:23:22.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f314a59c700 1 --2- 172.21.15.62:0/655017168 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f31540b6c70 0x7f3154153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:22.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f3152d9d700 1 --2- 172.21.15.62:0/655017168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31540b5b20 0x7f31540af330 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f3144006940 tx=0x7f3144008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:22.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f3150d99700 1 -- 172.21.15.62:0/655017168 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3144011780 con 0x7f31540b5b20 2021-12-17T18:23:22.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f3150d99700 1 -- 172.21.15.62:0/655017168 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31440118e0 con 0x7f31540b5b20 2021-12-17T18:23:22.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f315880f700 1 -- 172.21.15.62:0/655017168 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3154152a40 con 0x7f31540b5b20 2021-12-17T18:23:22.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f3150d99700 1 -- 172.21.15.62:0/655017168 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3144011c40 con 0x7f31540b5b20 2021-12-17T18:23:22.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f315880f700 1 -- 172.21.15.62:0/655017168 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3154152550 con 0x7f31540b5b20 2021-12-17T18:23:22.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f3150d99700 1 -- 172.21.15.62:0/655017168 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f314401c460 con 0x7f31540b5b20 2021-12-17T18:23:22.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f315880f700 1 -- 172.21.15.62:0/655017168 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31540573d0 con 0x7f31540b5b20 2021-12-17T18:23:22.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f3150d99700 1 --2- 172.21.15.62:0/655017168 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3138053640 0x7f3138055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:22.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.223+0000 7f3150d99700 1 -- 172.21.15.62:0/655017168 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f314406b780 con 0x7f31540b5b20 2021-12-17T18:23:22.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.227+0000 7f314a59c700 1 --2- 172.21.15.62:0/655017168 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3138053640 0x7f3138055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:22.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.227+0000 7f314a59c700 1 --2- 172.21.15.62:0/655017168 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3138053640 0x7f3138055b00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f313c00c000 tx=0x7f313c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:22.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.231+0000 7f3150d99700 1 -- 172.21.15.62:0/655017168 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3144042b60 con 0x7f31540b5b20 2021-12-17T18:23:22.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.395+0000 7f315880f700 1 -- 172.21.15.62:0/655017168 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31540b0670 con 0x7f31540b5b20 2021-12-17T18:23:22.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.395+0000 7f3150d99700 1 -- 172.21.15.62:0/655017168 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+1212 (secure 0 0 0) 0x7f3144046180 con 0x7f31540b5b20 2021-12-17T18:23:22.402 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:22.402 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3056253780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3056253780},{"type":"v1","addr":"172.21.15.109:6835","nonce":3056253780}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19},{"gid":5907,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3919966501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3919966501},{"type":"v1","addr":"172.21.15.62:6833","nonce":3919966501}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[]} 2021-12-17T18:23:22.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.399+0000 7f315880f700 1 -- 172.21.15.62:0/655017168 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3138053640 msgr2=0x7f3138055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:22.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.399+0000 7f315880f700 1 --2- 172.21.15.62:0/655017168 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3138053640 0x7f3138055b00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f313c00c000 tx=0x7f313c008040).stop 2021-12-17T18:23:22.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.399+0000 7f315880f700 1 -- 172.21.15.62:0/655017168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31540b5b20 msgr2=0x7f31540af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:22.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.399+0000 7f315880f700 1 --2- 172.21.15.62:0/655017168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31540b5b20 0x7f31540af330 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f3144006940 tx=0x7f3144008040).stop 2021-12-17T18:23:22.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.399+0000 7f315880f700 1 -- 172.21.15.62:0/655017168 shutdown_connections 2021-12-17T18:23:22.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.399+0000 7f315880f700 1 --2- 172.21.15.62:0/655017168 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3138053640 0x7f3138055b00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.399+0000 7f315880f700 1 --2- 172.21.15.62:0/655017168 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3154148800 0x7f3154066040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.399+0000 7f315880f700 1 --2- 172.21.15.62:0/655017168 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f31540b6c70 0x7f3154153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.399+0000 7f315880f700 1 --2- 172.21.15.62:0/655017168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31540b5b20 0x7f31540af330 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.399+0000 7f315880f700 1 -- 172.21.15.62:0/655017168 >> 172.21.15.62:0/655017168 conn(0x7f315405c750 msgr2=0x7f31540b97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:22.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.399+0000 7f315880f700 1 -- 172.21.15.62:0/655017168 shutdown_connections 2021-12-17T18:23:22.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.399+0000 7f315880f700 1 -- 172.21.15.62:0/655017168 wait complete. 2021-12-17T18:23:22.408 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 23 2021-12-17T18:23:22.416 INFO:tasks.ceph.mds.a:Restarting daemon 2021-12-17T18:23:22.416 INFO:tasks.ceph.mds.a:Stopping old one... 2021-12-17T18:23:22.417 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-12-17T18:23:22.417 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:23:22.417 INFO:tasks.ceph.mds.b:Restarting daemon 2021-12-17T18:23:22.418 INFO:tasks.ceph.mds.b:Stopping old one... 2021-12-17T18:23:22.418 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-12-17T18:23:22.418 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:23:22.432 INFO:tasks.ceph.mds.a:Stopped 2021-12-17T18:23:22.432 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-12-17T18:23:22.434 INFO:tasks.ceph.mds.b:Stopped 2021-12-17T18:23:22.435 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-12-17T18:23:22.437 INFO:tasks.ceph.mds.a:Started 2021-12-17T18:23:22.438 DEBUG:teuthology.parallel:result is None 2021-12-17T18:23:22.439 INFO:tasks.ceph.mds.b:Started 2021-12-17T18:23:22.439 DEBUG:teuthology.parallel:result is None 2021-12-17T18:23:22.440 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-12-17T18:23:22.504 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:23:22.512 INFO:tasks.ceph.mds.b.smithi109.stdout:starting mds.b at 2021-12-17T18:23:22.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.539+0000 7f916925f700 1 Processor -- start 2021-12-17T18:23:22.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.539+0000 7f916925f700 1 -- start start 2021-12-17T18:23:22.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.543+0000 7f916925f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f91640b6610 0x7f91640641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:22.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.543+0000 7f916925f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f91640ad0a0 0x7f9164144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:22.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.543+0000 7f916925f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9164067c70 con 0x7f9164140bf0 2021-12-17T18:23:22.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.543+0000 7f916925f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91640b69f0 con 0x7f91640b6610 2021-12-17T18:23:22.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.543+0000 7f916925f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91641441c0 con 0x7f91640ad0a0 2021-12-17T18:23:22.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.543+0000 7f915bfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f91640ad0a0 0x7f9164144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:22.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.543+0000 7f9168a5e700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f9164140bf0 0x7f916413da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:51206/0 (socket says 172.21.15.62:51206) 2021-12-17T18:23:22.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.543+0000 7f9168a5e700 1 -- 172.21.15.62:0/2596921637 learned_addr learned my addr 172.21.15.62:0/2596921637 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:22.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.543+0000 7f9163fff700 1 --2- 172.21.15.62:0/2596921637 >> v2:172.21.15.62:3300/0 conn(0x7f91640b6610 0x7f91640641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:22.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.543+0000 7f9163fff700 1 -- 172.21.15.62:0/2596921637 >> v2:172.21.15.109:3300/0 conn(0x7f91640ad0a0 msgr2=0x7f9164144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:22.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.543+0000 7f9163fff700 1 --2- 172.21.15.62:0/2596921637 >> v2:172.21.15.109:3300/0 conn(0x7f91640ad0a0 0x7f9164144ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.543+0000 7f9163fff700 1 -- 172.21.15.62:0/2596921637 >> v1:172.21.15.109:6789/0 conn(0x7f9164140bf0 legacy=0x7f916413da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:22.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.543+0000 7f9163fff700 1 -- 172.21.15.62:0/2596921637 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9164144460 con 0x7f91640b6610 2021-12-17T18:23:22.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.543+0000 7f9163fff700 1 --2- 172.21.15.62:0/2596921637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91640b6610 0x7f91640641f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f9154002f70 tx=0x7f9154006df0).ready entity=mon.0 client_cookie=f7147ebe68cbee25 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:22.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.543+0000 7f91637fe700 1 -- 172.21.15.62:0/2596921637 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f915400d570 con 0x7f91640b6610 2021-12-17T18:23:22.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.543+0000 7f91637fe700 1 -- 172.21.15.62:0/2596921637 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9154000e90 con 0x7f91640b6610 2021-12-17T18:23:22.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.543+0000 7f91637fe700 1 -- 172.21.15.62:0/2596921637 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f915400d900 con 0x7f91640b6610 2021-12-17T18:23:22.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f916925f700 1 -- 172.21.15.62:0/2596921637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91640b6610 msgr2=0x7f91640641f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:22.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f916925f700 1 --2- 172.21.15.62:0/2596921637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91640b6610 0x7f91640641f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f9154002f70 tx=0x7f9154006df0).stop 2021-12-17T18:23:22.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f916925f700 1 -- 172.21.15.62:0/2596921637 shutdown_connections 2021-12-17T18:23:22.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f916925f700 1 --2- 172.21.15.62:0/2596921637 >> v2:172.21.15.109:3300/0 conn(0x7f91640ad0a0 0x7f9164144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f916925f700 1 --2- 172.21.15.62:0/2596921637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91640b6610 0x7f91640641f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f916925f700 1 -- 172.21.15.62:0/2596921637 >> 172.21.15.62:0/2596921637 conn(0x7f916405d1c0 msgr2=0x7f91640b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:22.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f916925f700 1 -- 172.21.15.62:0/2596921637 shutdown_connections 2021-12-17T18:23:22.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f916925f700 1 -- 172.21.15.62:0/2596921637 wait complete. 2021-12-17T18:23:22.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f916925f700 1 Processor -- start 2021-12-17T18:23:22.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f916925f700 1 -- start start 2021-12-17T18:23:22.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f916925f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91640ad0a0 0x7f9164143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:22.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f916925f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f91640b6610 0x7f91641539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:22.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f916925f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9164140bf0 0x7f9164153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:22.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f916925f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91640ac9f0 con 0x7f91640ad0a0 2021-12-17T18:23:22.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f916925f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9164066880 con 0x7f9164140bf0 2021-12-17T18:23:22.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f916925f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916409f940 con 0x7f91640b6610 2021-12-17T18:23:22.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f9163fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91640ad0a0 0x7f9164143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:22.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f9163fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91640ad0a0 0x7f9164143a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51308/0 (socket says 172.21.15.62:51308) 2021-12-17T18:23:22.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f9163fff700 1 -- 172.21.15.62:0/4094302758 learned_addr learned my addr 172.21.15.62:0/4094302758 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:22.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.547+0000 7f915bfff700 1 --2- 172.21.15.62:0/4094302758 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f91640b6610 0x7f91641539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:22.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f9168a5e700 1 --2- 172.21.15.62:0/4094302758 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9164140bf0 0x7f9164153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:22.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f9163fff700 1 -- 172.21.15.62:0/4094302758 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f91640b6610 msgr2=0x7f91641539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:22.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f9163fff700 1 --2- 172.21.15.62:0/4094302758 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f91640b6610 0x7f91641539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f9163fff700 1 -- 172.21.15.62:0/4094302758 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9164140bf0 msgr2=0x7f9164153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:22.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f9163fff700 1 --2- 172.21.15.62:0/4094302758 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9164140bf0 0x7f9164153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:22.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f9163fff700 1 -- 172.21.15.62:0/4094302758 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915400b180 con 0x7f91640ad0a0 2021-12-17T18:23:22.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f9163fff700 1 --2- 172.21.15.62:0/4094302758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91640ad0a0 0x7f9164143a90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f9154002f70 tx=0x7f9154014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:22.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f9161ffb700 1 -- 172.21.15.62:0/4094302758 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9154013e90 con 0x7f91640ad0a0 2021-12-17T18:23:22.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f9161ffb700 1 -- 172.21.15.62:0/4094302758 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915400de80 con 0x7f91640ad0a0 2021-12-17T18:23:22.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f916925f700 1 -- 172.21.15.62:0/4094302758 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9164066cf0 con 0x7f91640ad0a0 2021-12-17T18:23:22.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f9161ffb700 1 -- 172.21.15.62:0/4094302758 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f915401e5f0 con 0x7f91640ad0a0 2021-12-17T18:23:22.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f916925f700 1 -- 172.21.15.62:0/4094302758 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9164153520 con 0x7f91640ad0a0 2021-12-17T18:23:22.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f916925f700 1 -- 172.21.15.62:0/4094302758 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916409f770 con 0x7f91640ad0a0 2021-12-17T18:23:22.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f9161ffb700 1 -- 172.21.15.62:0/4094302758 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9154025030 con 0x7f91640ad0a0 2021-12-17T18:23:22.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f9161ffb700 1 --2- 172.21.15.62:0/4094302758 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9148053580 0x7f9148055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:22.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f9161ffb700 1 -- 172.21.15.62:0/4094302758 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f915406c370 con 0x7f91640ad0a0 2021-12-17T18:23:22.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f915bfff700 1 --2- 172.21.15.62:0/4094302758 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9148053580 0x7f9148055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:22.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.551+0000 7f915bfff700 1 --2- 172.21.15.62:0/4094302758 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9148053580 0x7f9148055a40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f914c00b000 tx=0x7f914c006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:22.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.559+0000 7f9161ffb700 1 -- 172.21.15.62:0/4094302758 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f91540437b0 con 0x7f91640ad0a0 2021-12-17T18:23:22.636 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2021-12-17T18:23:22.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:22.695+0000 7f916925f700 1 -- 172.21.15.62:0/4094302758 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f9164144700 con 0x7f91640ad0a0 2021-12-17T18:23:23.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.639+0000 7f9161ffb700 1 -- 172.21.15.62:0/4094302758 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v57) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9154023020 con 0x7f91640ad0a0 2021-12-17T18:23:23.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.639+0000 7f916925f700 1 -- 172.21.15.62:0/4094302758 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9148053580 msgr2=0x7f9148055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:23.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.639+0000 7f916925f700 1 --2- 172.21.15.62:0/4094302758 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9148053580 0x7f9148055a40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f914c00b000 tx=0x7f914c006df0).stop 2021-12-17T18:23:23.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.639+0000 7f916925f700 1 -- 172.21.15.62:0/4094302758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91640ad0a0 msgr2=0x7f9164143a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:23.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.639+0000 7f916925f700 1 --2- 172.21.15.62:0/4094302758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91640ad0a0 0x7f9164143a90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f9154002f70 tx=0x7f9154014000).stop 2021-12-17T18:23:23.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.643+0000 7f916925f700 1 -- 172.21.15.62:0/4094302758 shutdown_connections 2021-12-17T18:23:23.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.643+0000 7f916925f700 1 --2- 172.21.15.62:0/4094302758 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9148053580 0x7f9148055a40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:23.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.643+0000 7f916925f700 1 --2- 172.21.15.62:0/4094302758 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9164140bf0 0x7f9164153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:23.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.643+0000 7f916925f700 1 --2- 172.21.15.62:0/4094302758 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f91640b6610 0x7f91641539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:23.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.643+0000 7f916925f700 1 --2- 172.21.15.62:0/4094302758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91640ad0a0 0x7f9164143a90 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:23.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.643+0000 7f916925f700 1 -- 172.21.15.62:0/4094302758 >> 172.21.15.62:0/4094302758 conn(0x7f916405d1c0 msgr2=0x7f91640b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:23.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.643+0000 7f916925f700 1 -- 172.21.15.62:0/4094302758 shutdown_connections 2021-12-17T18:23:23.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.643+0000 7f916925f700 1 -- 172.21.15.62:0/4094302758 wait complete. 2021-12-17T18:23:23.650 INFO:teuthology.orchestra.run.smithi062.stderr: removed all blacklist entries 2021-12-17T18:23:23.662 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-12-17T18:23:23.663 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-12-17T18:23:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b871b700 1 Processor -- start 2021-12-17T18:23:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b871b700 1 -- start start 2021-12-17T18:23:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b871b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b005fa70 0x7fb2b00b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b871b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b00b10e0 con 0x7fb2b00b1510 2021-12-17T18:23:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b871b700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b005fe50 con 0x7fb2b01415c0 2021-12-17T18:23:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b871b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00b01c0 con 0x7fb2b005fa70 2021-12-17T18:23:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b5cb6700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb2b00b1510 0x7fb2b01448e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34900/0 (socket says 172.21.15.62:34900) 2021-12-17T18:23:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b5cb6700 1 -- 172.21.15.62:0/140816256 learned_addr learned my addr 172.21.15.62:0/140816256 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:23.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b64b7700 1 --2- 172.21.15.62:0/140816256 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b005fa70 0x7fb2b00b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:23.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b54b5700 1 -- 172.21.15.62:0/140816256 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109101229 0 0) 0x7fb2b00b10e0 con 0x7fb2b00b1510 2021-12-17T18:23:23.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b54b5700 1 -- 172.21.15.62:0/140816256 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb298003260 con 0x7fb2b00b1510 2021-12-17T18:23:23.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b54b5700 1 -- 172.21.15.62:0/140816256 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3644674541 0 0) 0x7fb2b005fe50 con 0x7fb2b01415c0 2021-12-17T18:23:23.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b54b5700 1 -- 172.21.15.62:0/140816256 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2b00b10e0 con 0x7fb2b01415c0 2021-12-17T18:23:23.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b54b5700 1 -- 172.21.15.62:0/140816256 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3354112012 0 0) 0x7fb298003260 con 0x7fb2b00b1510 2021-12-17T18:23:23.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b64b7700 1 -- 172.21.15.62:0/140816256 >> v1:172.21.15.109:6789/0 conn(0x7fb2b01415c0 legacy=0x7fb2b0141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:23.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b64b7700 1 -- 172.21.15.62:0/140816256 >> v1:172.21.15.62:6789/0 conn(0x7fb2b00b1510 legacy=0x7fb2b01448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:23.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b64b7700 1 -- 172.21.15.62:0/140816256 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b00b0460 con 0x7fb2b005fa70 2021-12-17T18:23:23.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b64b7700 1 --2- 172.21.15.62:0/140816256 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b005fa70 0x7fb2b00b3520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb2a0001110 tx=0x7fb2ac006df0).ready entity=mon.2 client_cookie=1b1d32554732aaae server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:23.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b54b5700 1 -- 172.21.15.62:0/140816256 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2a0001660 con 0x7fb2b005fa70 2021-12-17T18:23:23.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b54b5700 1 -- 172.21.15.62:0/140816256 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac000e90 con 0x7fb2b005fa70 2021-12-17T18:23:23.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b54b5700 1 -- 172.21.15.62:0/140816256 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2ac012460 con 0x7fb2b005fa70 2021-12-17T18:23:23.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b871b700 1 -- 172.21.15.62:0/140816256 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b005fa70 msgr2=0x7fb2b00b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:23.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.767+0000 7fb2b871b700 1 --2- 172.21.15.62:0/140816256 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b005fa70 0x7fb2b00b3520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb2a0001110 tx=0x7fb2ac006df0).stop 2021-12-17T18:23:23.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.771+0000 7fb2b871b700 1 -- 172.21.15.62:0/140816256 shutdown_connections 2021-12-17T18:23:23.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.771+0000 7fb2b871b700 1 --2- 172.21.15.62:0/140816256 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b005fa70 0x7fb2b00b3520 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:23.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.771+0000 7fb2b871b700 1 -- 172.21.15.62:0/140816256 >> 172.21.15.62:0/140816256 conn(0x7fb2b005bcd0 msgr2=0x7fb2b00638c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:23.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.771+0000 7fb2b871b700 1 -- 172.21.15.62:0/140816256 shutdown_connections 2021-12-17T18:23:23.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.771+0000 7fb2b871b700 1 -- 172.21.15.62:0/140816256 wait complete. 2021-12-17T18:23:23.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.771+0000 7fb2b871b700 1 Processor -- start 2021-12-17T18:23:23.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.771+0000 7fb2b871b700 1 -- start start 2021-12-17T18:23:23.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.771+0000 7fb2b871b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b005fa70 0x7fb2b00a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:23.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.771+0000 7fb2b871b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b00b1510 0x7fb2b00658e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:23.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.771+0000 7fb2b871b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb2b01415c0 0x7fb2b01409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:23.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb2b871b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b009f660 con 0x7fb2b00b1510 2021-12-17T18:23:23.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb2b871b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0153d20 con 0x7fb2b01415c0 2021-12-17T18:23:23.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb2b871b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b009f3c0 con 0x7fb2b005fa70 2021-12-17T18:23:23.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb2b5cb6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b00b1510 0x7fb2b00658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:23.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb2b5cb6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b00b1510 0x7fb2b00658e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51326/0 (socket says 172.21.15.62:51326) 2021-12-17T18:23:23.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb2b5cb6700 1 -- 172.21.15.62:0/3492474828 learned_addr learned my addr 172.21.15.62:0/3492474828 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:23.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb2b64b7700 1 --2- 172.21.15.62:0/3492474828 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b005fa70 0x7fb2b00a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:23.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb2b6cb8700 1 --2- 172.21.15.62:0/3492474828 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb2b01415c0 0x7fb2b01409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:23.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb2b5cb6700 1 -- 172.21.15.62:0/3492474828 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b005fa70 msgr2=0x7fb2b00a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:23.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb2b5cb6700 1 --2- 172.21.15.62:0/3492474828 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b005fa70 0x7fb2b00a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:23.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb2b5cb6700 1 -- 172.21.15.62:0/3492474828 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb2b01415c0 msgr2=0x7fb2b01409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:23.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb2b5cb6700 1 --2- 172.21.15.62:0/3492474828 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb2b01415c0 0x7fb2b01409a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:23.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb2b5cb6700 1 -- 172.21.15.62:0/3492474828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac00b180 con 0x7fb2b00b1510 2021-12-17T18:23:23.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb2b5cb6700 1 --2- 172.21.15.62:0/3492474828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b00b1510 0x7fb2b00658e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fb2a0001840 tx=0x7fb2a0001720).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:23.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb29f7fe700 1 -- 172.21.15.62:0/3492474828 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2a0007170 con 0x7fb2b00b1510 2021-12-17T18:23:23.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb29f7fe700 1 -- 172.21.15.62:0/3492474828 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a00072d0 con 0x7fb2b00b1510 2021-12-17T18:23:23.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb2b871b700 1 -- 172.21.15.62:0/3492474828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b00a03f0 con 0x7fb2b00b1510 2021-12-17T18:23:23.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb29f7fe700 1 -- 172.21.15.62:0/3492474828 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2a0004710 con 0x7fb2b00b1510 2021-12-17T18:23:23.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb2b871b700 1 -- 172.21.15.62:0/3492474828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b009ef60 con 0x7fb2b00b1510 2021-12-17T18:23:23.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.775+0000 7fb2b871b700 1 -- 172.21.15.62:0/3492474828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b00573d0 con 0x7fb2b00b1510 2021-12-17T18:23:23.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.779+0000 7fb29f7fe700 1 -- 172.21.15.62:0/3492474828 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb2a001b070 con 0x7fb2b00b1510 2021-12-17T18:23:23.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.779+0000 7fb29f7fe700 1 --2- 172.21.15.62:0/3492474828 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb290053610 0x7fb290055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:23.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.779+0000 7fb29f7fe700 1 -- 172.21.15.62:0/3492474828 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb2a006abb0 con 0x7fb2b00b1510 2021-12-17T18:23:23.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.779+0000 7fb2b64b7700 1 --2- 172.21.15.62:0/3492474828 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb290053610 0x7fb290055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:23.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.779+0000 7fb2b64b7700 1 --2- 172.21.15.62:0/3492474828 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb290053610 0x7fb290055ad0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fb2ac01a000 tx=0x7fb2ac014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:23.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.783+0000 7fb29f7fe700 1 -- 172.21.15.62:0/3492474828 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb2a0071080 con 0x7fb2b00b1510 2021-12-17T18:23:23.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.951+0000 7fb2b871b700 1 -- 172.21.15.62:0/3492474828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb2b00ad5c0 con 0x7fb2b00b1510 2021-12-17T18:23:23.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.951+0000 7fb29f7fe700 1 -- 172.21.15.62:0/3492474828 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fb2a0042040 con 0x7fb2b00b1510 2021-12-17T18:23:23.957 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:23.958 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:23:23.958 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_dump": [ 2021-12-17T18:23:23.958 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:23.958 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.a", 2021-12-17T18:23:23.959 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhxCS0LBAAtUlkgWYg4l3fQ2au7jMUDg==", 2021-12-17T18:23:23.959 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:23:23.959 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:23:23.959 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:23:23.960 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:23:23.960 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:23:23.960 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:23.960 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:23.960 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:23.961 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.b", 2021-12-17T18:23:23.961 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhoRJAMxAAP/NmDQRwJjYip2rxJsQlYg==", 2021-12-17T18:23:23.961 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:23:23.961 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:23:23.962 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:23:23.962 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:23:23.962 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:23:23.962 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:23.963 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:23.963 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:23.963 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.0", 2021-12-17T18:23:23.963 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBA1LxhJXzhKhAAUnxP3G5VuATkQLoDALFjVg==", 2021-12-17T18:23:23.963 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:23:23.964 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:23:23.964 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:23:23.964 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:23:23.964 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:23.965 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:23.965 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:23.965 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.1", 2021-12-17T18:23:23.965 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBD1LxhregUDhAABrxQ2jQ4BwXvuWh/D9SkbQ==", 2021-12-17T18:23:23.966 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:23:23.966 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:23:23.966 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:23:23.966 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:23:23.967 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:23.967 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:23.967 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:23.967 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.2", 2021-12-17T18:23:23.968 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBF1LxhOo/SLhAAhQQLW/VKFx1sgm8chnD5tw==", 2021-12-17T18:23:23.968 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:23:23.968 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:23:23.968 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:23:23.968 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:23:23.969 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:23.969 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:23.969 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:23.969 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.3", 2021-12-17T18:23:23.970 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBI1LxhT2ZQExAA999j8V5bJAJ2PuaQqSkUOw==", 2021-12-17T18:23:23.970 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:23:23.970 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:23:23.970 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:23:23.971 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:23:23.971 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:23.971 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:23.971 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:23.971 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.4", 2021-12-17T18:23:23.972 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBN1LxhKBDzFhAAKmPF0FXnnfXtweo+6z9nxg==", 2021-12-17T18:23:23.972 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:23:23.972 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:23:23.972 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:23:23.973 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:23:23.973 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:23.973 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:23.973 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:23.974 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.5", 2021-12-17T18:23:23.974 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBP1LxhtqkAORAAVaFLVNIUMs4Sytk8WRaGNA==", 2021-12-17T18:23:23.974 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:23:23.974 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:23:23.974 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:23:23.975 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:23:23.975 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:23.975 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:23.975 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:23.976 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.6", 2021-12-17T18:23:23.976 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBS1LxhNtncGhAAgG64g1ie54CDp9Y7uldKQA==", 2021-12-17T18:23:23.976 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:23:23.976 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:23:23.977 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:23:23.977 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:23:23.977 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:23.977 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:23.977 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:23.978 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.7", 2021-12-17T18:23:23.978 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBV1Lxh3DcDABAAHVskSVtoEJ8BxCCAs3ZDVA==", 2021-12-17T18:23:23.978 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:23:23.978 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:23:23.979 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:23:23.979 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:23:23.979 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:23.979 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:23.980 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:23.980 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.0", 2021-12-17T18:23:23.980 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxh9QhCNxAALkWTJorDpbt9yrikL7/NWg==", 2021-12-17T18:23:23.980 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:23:23.980 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:23:23.981 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:23:23.981 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:23:23.981 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:23.981 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:23.982 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:23.982 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.1", 2021-12-17T18:23:23.982 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxhxm52OxAAbqXVaqRDmt4Ezj9xyCEODQ==", 2021-12-17T18:23:23.982 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:23:23.982 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:23:23.983 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:23:23.983 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:23:23.983 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:23.983 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:23.984 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:23.984 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.2", 2021-12-17T18:23:23.984 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+1LxhXu08BBAATRcUAZvMNg9ou4PLszDtmA==", 2021-12-17T18:23:23.984 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:23:23.984 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:23:23.985 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:23:23.985 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:23:23.985 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:23.985 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:23.986 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:23.986 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.admin", 2021-12-17T18:23:23.986 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhyAGlDRAA2ggSG5yBBFbMgK2fCBk2mQ==", 2021-12-17T18:23:23.987 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:23:23.987 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:23:23.987 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:23:23.988 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:23:23.988 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:23:23.988 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:23.988 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:23.989 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:23.989 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.x", 2021-12-17T18:23:23.989 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhzvntKRAAFQlg69Z6d2nWX0GxSshsMw==", 2021-12-17T18:23:23.989 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:23:23.990 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:23:23.990 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:23:23.990 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:23:23.990 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:23.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:23.991 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:23.991 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.y", 2021-12-17T18:23:23.991 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhKdTGJRAArzUN3A1U5Efw0NG9Gw2Gcw==", 2021-12-17T18:23:23.991 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:23:23.992 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:23:23.992 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:23:23.992 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:23:23.992 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:23.993 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:23.993 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:23.993 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:23:23.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.955+0000 7fb2b871b700 1 -- 172.21.15.62:0/3492474828 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb290053610 msgr2=0x7fb290055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:23.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.955+0000 7fb2b871b700 1 --2- 172.21.15.62:0/3492474828 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb290053610 0x7fb290055ad0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fb2ac01a000 tx=0x7fb2ac014000).stop 2021-12-17T18:23:23.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.955+0000 7fb2b871b700 1 -- 172.21.15.62:0/3492474828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b00b1510 msgr2=0x7fb2b00658e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:23.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.955+0000 7fb2b871b700 1 --2- 172.21.15.62:0/3492474828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b00b1510 0x7fb2b00658e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fb2a0001840 tx=0x7fb2a0001720).stop 2021-12-17T18:23:23.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.955+0000 7fb2b871b700 1 -- 172.21.15.62:0/3492474828 shutdown_connections 2021-12-17T18:23:23.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.955+0000 7fb2b871b700 1 --2- 172.21.15.62:0/3492474828 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb290053610 0x7fb290055ad0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:23.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.955+0000 7fb2b871b700 1 --2- 172.21.15.62:0/3492474828 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb2b01415c0 0x7fb2b01409a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:23.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.955+0000 7fb2b871b700 1 --2- 172.21.15.62:0/3492474828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b00b1510 0x7fb2b00658e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:23.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.955+0000 7fb2b871b700 1 --2- 172.21.15.62:0/3492474828 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b005fa70 0x7fb2b00a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:23.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.955+0000 7fb2b871b700 1 -- 172.21.15.62:0/3492474828 >> 172.21.15.62:0/3492474828 conn(0x7fb2b005bcd0 msgr2=0x7fb2b00b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:23.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.955+0000 7fb2b871b700 1 -- 172.21.15.62:0/3492474828 shutdown_connections 2021-12-17T18:23:23.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:23.955+0000 7fb2b871b700 1 -- 172.21.15.62:0/3492474828 wait complete. 2021-12-17T18:23:23.998 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:23:24.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.099+0000 7fc52759e700 1 Processor -- start 2021-12-17T18:23:24.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.099+0000 7fc52759e700 1 -- start start 2021-12-17T18:23:24.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.099+0000 7fc52759e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc5280a8e10 0x7fc528147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.099+0000 7fc52759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5280a71e0 0x7fc5280a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.099+0000 7fc52759e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5280b6270 con 0x7fc528141480 2021-12-17T18:23:24.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.099+0000 7fc52759e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc528147610 con 0x7fc5280a8e10 2021-12-17T18:23:24.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.099+0000 7fc52759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5281478b0 con 0x7fc5280a71e0 2021-12-17T18:23:24.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.099+0000 7fc526d9d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5280a71e0 0x7fc5280a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.099+0000 7fc525d9b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc5280a8e10 0x7fc528147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.099+0000 7fc526d9d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5280a71e0 0x7fc5280a7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:45036/0 (socket says 172.21.15.62:45036) 2021-12-17T18:23:24.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.099+0000 7fc526d9d700 1 -- 172.21.15.62:0/2920196710 learned_addr learned my addr 172.21.15.62:0/2920196710 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:24.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.099+0000 7fc52659c700 1 --1- 172.21.15.62:0/2920196710 >> v1:172.21.15.109:6789/0 conn(0x7fc528141480 0x7fc5280b5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:51232/0 (socket says 172.21.15.62:51232) 2021-12-17T18:23:24.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc52559a700 1 -- 172.21.15.62:0/2920196710 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585736633 0 0) 0x7fc5280b6270 con 0x7fc528141480 2021-12-17T18:23:24.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc52559a700 1 -- 172.21.15.62:0/2920196710 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc50c003260 con 0x7fc528141480 2021-12-17T18:23:24.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc526d9d700 1 -- 172.21.15.62:0/2920196710 >> v2:172.21.15.109:3300/0 conn(0x7fc5280a8e10 msgr2=0x7fc528147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:24.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc526d9d700 1 --2- 172.21.15.62:0/2920196710 >> v2:172.21.15.109:3300/0 conn(0x7fc5280a8e10 0x7fc528147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc526d9d700 1 -- 172.21.15.62:0/2920196710 >> v1:172.21.15.109:6789/0 conn(0x7fc528141480 legacy=0x7fc5280b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc526d9d700 1 -- 172.21.15.62:0/2920196710 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc528147b50 con 0x7fc5280a71e0 2021-12-17T18:23:24.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc525d9b700 1 --2- 172.21.15.62:0/2920196710 >> v2:172.21.15.109:3300/0 conn(0x7fc5280a8e10 0x7fc528147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:24.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc526d9d700 1 --2- 172.21.15.62:0/2920196710 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5280a71e0 0x7fc5280a7900 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fc518002f70 tx=0x7fc518006eb0).ready entity=mon.2 client_cookie=29d31d4f1f069409 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:24.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc52559a700 1 -- 172.21.15.62:0/2920196710 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc51800d5c0 con 0x7fc5280a71e0 2021-12-17T18:23:24.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc52559a700 1 -- 172.21.15.62:0/2920196710 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc518000e90 con 0x7fc5280a71e0 2021-12-17T18:23:24.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc52559a700 1 -- 172.21.15.62:0/2920196710 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc51800d950 con 0x7fc5280a71e0 2021-12-17T18:23:24.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc52759e700 1 -- 172.21.15.62:0/2920196710 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5280a71e0 msgr2=0x7fc5280a7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc52759e700 1 --2- 172.21.15.62:0/2920196710 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5280a71e0 0x7fc5280a7900 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fc518002f70 tx=0x7fc518006eb0).stop 2021-12-17T18:23:24.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc52759e700 1 -- 172.21.15.62:0/2920196710 shutdown_connections 2021-12-17T18:23:24.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc52759e700 1 --2- 172.21.15.62:0/2920196710 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5280a71e0 0x7fc5280a7900 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc52759e700 1 --2- 172.21.15.62:0/2920196710 >> v2:172.21.15.109:3300/0 conn(0x7fc5280a8e10 0x7fc528147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc52759e700 1 -- 172.21.15.62:0/2920196710 >> 172.21.15.62:0/2920196710 conn(0x7fc52805d220 msgr2=0x7fc5280b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:24.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc52759e700 1 -- 172.21.15.62:0/2920196710 shutdown_connections 2021-12-17T18:23:24.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc52759e700 1 -- 172.21.15.62:0/2920196710 wait complete. 2021-12-17T18:23:24.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc52759e700 1 Processor -- start 2021-12-17T18:23:24.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.103+0000 7fc52759e700 1 -- start start 2021-12-17T18:23:24.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc52759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc5280a71e0 0x7fc528144b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc52759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5280a8e10 0x7fc5280b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc52759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc528141480 0x7fc5280a9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc52759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5280abcd0 con 0x7fc528141480 2021-12-17T18:23:24.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc52759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5280abf70 con 0x7fc5280a71e0 2021-12-17T18:23:24.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc52759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc528149fd0 con 0x7fc5280a8e10 2021-12-17T18:23:24.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc526d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc528141480 0x7fc5280a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc525d9b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5280a8e10 0x7fc5280b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc52659c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc5280a71e0 0x7fc528144b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc52659c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc5280a71e0 0x7fc528144b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:57886/0 (socket says 172.21.15.62:57886) 2021-12-17T18:23:24.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc52659c700 1 -- 172.21.15.62:0/1200729194 learned_addr learned my addr 172.21.15.62:0/1200729194 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:24.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc525d9b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5280a8e10 0x7fc5280b59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:45040/0 (socket says 172.21.15.62:45040) 2021-12-17T18:23:24.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc525d9b700 1 -- 172.21.15.62:0/1200729194 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc5280a71e0 msgr2=0x7fc528144b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc525d9b700 1 --2- 172.21.15.62:0/1200729194 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc5280a71e0 0x7fc528144b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc525d9b700 1 -- 172.21.15.62:0/1200729194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc528141480 msgr2=0x7fc5280a9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc525d9b700 1 --2- 172.21.15.62:0/1200729194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc528141480 0x7fc5280a9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc525d9b700 1 -- 172.21.15.62:0/1200729194 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c00b180 con 0x7fc5280a8e10 2021-12-17T18:23:24.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc52659c700 1 --2- 172.21.15.62:0/1200729194 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc5280a71e0 0x7fc528144b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:24.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc525d9b700 1 --2- 172.21.15.62:0/1200729194 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5280a8e10 0x7fc5280b59e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fc51c00c000 tx=0x7fc51c006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:24.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc5177fe700 1 -- 172.21.15.62:0/1200729194 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc51c010780 con 0x7fc5280a8e10 2021-12-17T18:23:24.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc52759e700 1 -- 172.21.15.62:0/1200729194 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51800b1e0 con 0x7fc5280a8e10 2021-12-17T18:23:24.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc5177fe700 1 -- 172.21.15.62:0/1200729194 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c0108e0 con 0x7fc5280a8e10 2021-12-17T18:23:24.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc52759e700 1 -- 172.21.15.62:0/1200729194 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5280aab40 con 0x7fc5280a8e10 2021-12-17T18:23:24.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc5177fe700 1 -- 172.21.15.62:0/1200729194 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc51c010c40 con 0x7fc5280a8e10 2021-12-17T18:23:24.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.107+0000 7fc52759e700 1 -- 172.21.15.62:0/1200729194 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5280b1b90 con 0x7fc5280a8e10 2021-12-17T18:23:24.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.111+0000 7fc5177fe700 1 -- 172.21.15.62:0/1200729194 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc51c01c460 con 0x7fc5280a8e10 2021-12-17T18:23:24.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.111+0000 7fc5177fe700 1 --2- 172.21.15.62:0/1200729194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc504053610 0x7fc504055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.111+0000 7fc5177fe700 1 -- 172.21.15.62:0/1200729194 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc51c06bc30 con 0x7fc5280a8e10 2021-12-17T18:23:24.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.111+0000 7fc52659c700 1 --2- 172.21.15.62:0/1200729194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc504053610 0x7fc504055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.111+0000 7fc52659c700 1 --2- 172.21.15.62:0/1200729194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc504053610 0x7fc504055ad0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fc52000d000 tx=0x7fc520009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:24.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.119+0000 7fc5177fe700 1 -- 172.21.15.62:0/1200729194 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc51c042ed0 con 0x7fc5280a8e10 2021-12-17T18:23:24.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.247+0000 7fc52759e700 1 -- 172.21.15.62:0/1200729194 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5280573d0 con 0x7fc5280a8e10 2021-12-17T18:23:24.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.251+0000 7fc5177fe700 1 -- 172.21.15.62:0/1200729194 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+13230 (secure 0 0 0) 0x7fc51c0464f0 con 0x7fc5280a8e10 2021-12-17T18:23:24.255 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:24.255 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":57,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:23:23.634087+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:23:24.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.251+0000 7fc52759e700 1 -- 172.21.15.62:0/1200729194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc504053610 msgr2=0x7fc504055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.251+0000 7fc52759e700 1 --2- 172.21.15.62:0/1200729194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc504053610 0x7fc504055ad0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fc52000d000 tx=0x7fc520009040).stop 2021-12-17T18:23:24.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.251+0000 7fc52759e700 1 -- 172.21.15.62:0/1200729194 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5280a8e10 msgr2=0x7fc5280b59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.251+0000 7fc52759e700 1 --2- 172.21.15.62:0/1200729194 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5280a8e10 0x7fc5280b59e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fc51c00c000 tx=0x7fc51c006df0).stop 2021-12-17T18:23:24.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.251+0000 7fc52759e700 1 -- 172.21.15.62:0/1200729194 shutdown_connections 2021-12-17T18:23:24.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.251+0000 7fc52759e700 1 --2- 172.21.15.62:0/1200729194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc504053610 0x7fc504055ad0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.251+0000 7fc52759e700 1 --2- 172.21.15.62:0/1200729194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc528141480 0x7fc5280a9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.251+0000 7fc52759e700 1 --2- 172.21.15.62:0/1200729194 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5280a8e10 0x7fc5280b59e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.251+0000 7fc52759e700 1 --2- 172.21.15.62:0/1200729194 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc5280a71e0 0x7fc528144b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.251+0000 7fc52759e700 1 -- 172.21.15.62:0/1200729194 >> 172.21.15.62:0/1200729194 conn(0x7fc52805d220 msgr2=0x7fc5281450d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:24.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.251+0000 7fc52759e700 1 -- 172.21.15.62:0/1200729194 shutdown_connections 2021-12-17T18:23:24.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.251+0000 7fc52759e700 1 -- 172.21.15.62:0/1200729194 wait complete. 2021-12-17T18:23:24.269 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-12-17T18:23:24.270 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:23:24.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.371+0000 7f3295e45700 1 Processor -- start 2021-12-17T18:23:24.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.371+0000 7f3295e45700 1 -- start start 2021-12-17T18:23:24.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.371+0000 7f3295e45700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f3290142680 0x7f3290142a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.371+0000 7f3295e45700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f32900b4480 0x7f32900b6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.371+0000 7f3295e45700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32901470a0 con 0x7f32900b6660 2021-12-17T18:23:24.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.371+0000 7f3295e45700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32900b59b0 con 0x7f32900b4480 2021-12-17T18:23:24.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.371+0000 7f3295e45700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3290147340 con 0x7f3290142680 2021-12-17T18:23:24.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.371+0000 7f328effd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f32900b4480 0x7f32900b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.371+0000 7f328effd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f32900b4480 0x7f32900b6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51346/0 (socket says 172.21.15.62:51346) 2021-12-17T18:23:24.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.371+0000 7f328effd700 1 -- 172.21.15.62:0/161374157 learned_addr learned my addr 172.21.15.62:0/161374157 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:24.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.371+0000 7f328f7fe700 1 --2- 172.21.15.62:0/161374157 >> v2:172.21.15.109:3300/0 conn(0x7f3290142680 0x7f3290142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.371+0000 7f328effd700 1 -- 172.21.15.62:0/161374157 >> v2:172.21.15.109:3300/0 conn(0x7f3290142680 msgr2=0x7f3290142a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:24.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.371+0000 7f328effd700 1 --2- 172.21.15.62:0/161374157 >> v2:172.21.15.109:3300/0 conn(0x7f3290142680 0x7f3290142a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.371+0000 7f328effd700 1 -- 172.21.15.62:0/161374157 >> v1:172.21.15.109:6789/0 conn(0x7f32900b6660 legacy=0x7f32901431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.371+0000 7f328effd700 1 -- 172.21.15.62:0/161374157 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32900b4a40 con 0x7f32900b4480 2021-12-17T18:23:24.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.371+0000 7f328effd700 1 --2- 172.21.15.62:0/161374157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32900b4480 0x7f32900b6170 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f3280002f70 tx=0x7f3280006eb0).ready entity=mon.0 client_cookie=66cce1c38ec1feb4 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:24.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.375+0000 7f328e7fc700 1 -- 172.21.15.62:0/161374157 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f328000d610 con 0x7f32900b4480 2021-12-17T18:23:24.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.375+0000 7f328e7fc700 1 -- 172.21.15.62:0/161374157 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3280000e90 con 0x7f32900b4480 2021-12-17T18:23:24.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.375+0000 7f328e7fc700 1 -- 172.21.15.62:0/161374157 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f328000d9a0 con 0x7f32900b4480 2021-12-17T18:23:24.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.375+0000 7f3295e45700 1 -- 172.21.15.62:0/161374157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32900b4480 msgr2=0x7f32900b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.375+0000 7f3295e45700 1 --2- 172.21.15.62:0/161374157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32900b4480 0x7f32900b6170 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f3280002f70 tx=0x7f3280006eb0).stop 2021-12-17T18:23:24.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.375+0000 7f3295e45700 1 -- 172.21.15.62:0/161374157 shutdown_connections 2021-12-17T18:23:24.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.375+0000 7f3295e45700 1 --2- 172.21.15.62:0/161374157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32900b4480 0x7f32900b6170 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.375+0000 7f3295e45700 1 --2- 172.21.15.62:0/161374157 >> v2:172.21.15.109:3300/0 conn(0x7f3290142680 0x7f3290142a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.375+0000 7f3295e45700 1 -- 172.21.15.62:0/161374157 >> 172.21.15.62:0/161374157 conn(0x7f329005c750 msgr2=0x7f3290062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:24.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.375+0000 7f3295e45700 1 -- 172.21.15.62:0/161374157 shutdown_connections 2021-12-17T18:23:24.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.375+0000 7f3295e45700 1 -- 172.21.15.62:0/161374157 wait complete. 2021-12-17T18:23:24.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.375+0000 7f3295e45700 1 Processor -- start 2021-12-17T18:23:24.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f3295e45700 1 -- start start 2021-12-17T18:23:24.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f3295e45700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f32900b4480 0x7f32900b9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f3295e45700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32900b6660 0x7f3290155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f3295e45700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3290142680 0x7f329013fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f3295e45700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3290065a50 con 0x7f32900b6660 2021-12-17T18:23:24.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f3295e45700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32900a5000 con 0x7f3290142680 2021-12-17T18:23:24.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f3295e45700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3290065e00 con 0x7f32900b4480 2021-12-17T18:23:24.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f328effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32900b6660 0x7f3290155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f328effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32900b6660 0x7f3290155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51352/0 (socket says 172.21.15.62:51352) 2021-12-17T18:23:24.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f328effd700 1 -- 172.21.15.62:0/2348249707 learned_addr learned my addr 172.21.15.62:0/2348249707 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:24.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f328f7fe700 1 --2- 172.21.15.62:0/2348249707 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f32900b4480 0x7f32900b9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f328ffff700 1 --2- 172.21.15.62:0/2348249707 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3290142680 0x7f329013fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f328effd700 1 -- 172.21.15.62:0/2348249707 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f32900b4480 msgr2=0x7f32900b9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f328effd700 1 --2- 172.21.15.62:0/2348249707 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f32900b4480 0x7f32900b9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f328effd700 1 -- 172.21.15.62:0/2348249707 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3290142680 msgr2=0x7f329013fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f328effd700 1 --2- 172.21.15.62:0/2348249707 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3290142680 0x7f329013fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f328effd700 1 -- 172.21.15.62:0/2348249707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328000b1e0 con 0x7f32900b6660 2021-12-17T18:23:24.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f328effd700 1 --2- 172.21.15.62:0/2348249707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32900b6660 0x7f3290155e50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f3290065b90 tx=0x7f3280015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:24.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f328cff9700 1 -- 172.21.15.62:0/2348249707 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32800116e0 con 0x7f32900b6660 2021-12-17T18:23:24.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f328cff9700 1 -- 172.21.15.62:0/2348249707 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3280011840 con 0x7f32900b6660 2021-12-17T18:23:24.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f328cff9700 1 -- 172.21.15.62:0/2348249707 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3280011ba0 con 0x7f32900b6660 2021-12-17T18:23:24.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f3295e45700 1 -- 172.21.15.62:0/2348249707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32900660a0 con 0x7f32900b6660 2021-12-17T18:23:24.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.379+0000 7f3295e45700 1 -- 172.21.15.62:0/2348249707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3290066d70 con 0x7f32900b6660 2021-12-17T18:23:24.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.383+0000 7f3295e45700 1 -- 172.21.15.62:0/2348249707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32900a3be0 con 0x7f32900b6660 2021-12-17T18:23:24.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.383+0000 7f328cff9700 1 -- 172.21.15.62:0/2348249707 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3280025030 con 0x7f32900b6660 2021-12-17T18:23:24.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.383+0000 7f328cff9700 1 --2- 172.21.15.62:0/2348249707 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f32740534f0 0x7f32740559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.383+0000 7f328cff9700 1 -- 172.21.15.62:0/2348249707 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f328006c7b0 con 0x7f32900b6660 2021-12-17T18:23:24.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.383+0000 7f328f7fe700 1 --2- 172.21.15.62:0/2348249707 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f32740534f0 0x7f32740559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.383+0000 7f328f7fe700 1 --2- 172.21.15.62:0/2348249707 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f32740534f0 0x7f32740559b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f327800c000 tx=0x7f3278008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:24.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.391+0000 7f328cff9700 1 -- 172.21.15.62:0/2348249707 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3280043be0 con 0x7f32900b6660 2021-12-17T18:23:24.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.519+0000 7f3295e45700 1 -- 172.21.15.62:0/2348249707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f32900573d0 con 0x7f32900b6660 2021-12-17T18:23:24.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.523+0000 7f328cff9700 1 -- 172.21.15.62:0/2348249707 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v57) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3280023070 con 0x7f32900b6660 2021-12-17T18:23:24.527 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:23:24.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.523+0000 7f3295e45700 1 -- 172.21.15.62:0/2348249707 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f32740534f0 msgr2=0x7f32740559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.523+0000 7f3295e45700 1 --2- 172.21.15.62:0/2348249707 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f32740534f0 0x7f32740559b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f327800c000 tx=0x7f3278008040).stop 2021-12-17T18:23:24.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.523+0000 7f3295e45700 1 -- 172.21.15.62:0/2348249707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32900b6660 msgr2=0x7f3290155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.523+0000 7f3295e45700 1 --2- 172.21.15.62:0/2348249707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32900b6660 0x7f3290155e50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f3290065b90 tx=0x7f3280015000).stop 2021-12-17T18:23:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.523+0000 7f3295e45700 1 -- 172.21.15.62:0/2348249707 shutdown_connections 2021-12-17T18:23:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.523+0000 7f3295e45700 1 --2- 172.21.15.62:0/2348249707 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f32740534f0 0x7f32740559b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.523+0000 7f3295e45700 1 --2- 172.21.15.62:0/2348249707 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3290142680 0x7f329013fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.523+0000 7f3295e45700 1 --2- 172.21.15.62:0/2348249707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32900b6660 0x7f3290155e50 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.523+0000 7f3295e45700 1 --2- 172.21.15.62:0/2348249707 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f32900b4480 0x7f32900b9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.523+0000 7f3295e45700 1 -- 172.21.15.62:0/2348249707 >> 172.21.15.62:0/2348249707 conn(0x7f329005c750 msgr2=0x7f32900b78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.523+0000 7f3295e45700 1 -- 172.21.15.62:0/2348249707 shutdown_connections 2021-12-17T18:23:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.523+0000 7f3295e45700 1 -- 172.21.15.62:0/2348249707 wait complete. 2021-12-17T18:23:24.541 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:23:24.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.643+0000 7f08e9b33700 1 Processor -- start 2021-12-17T18:23:24.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.643+0000 7f08e9b33700 1 -- start start 2021-12-17T18:23:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e9b33700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08e405ca90 0x7f08e414b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e9b33700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e4060750 con 0x7f08e405f730 2021-12-17T18:23:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e9b33700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e414ac00 con 0x7f08e40ac040 2021-12-17T18:23:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e9b33700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e414aea0 con 0x7f08e405ca90 2021-12-17T18:23:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e9332700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f08e405f730 0x7f08e4146510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34940/0 (socket says 172.21.15.62:34940) 2021-12-17T18:23:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e9332700 1 -- 172.21.15.62:0/2848442537 learned_addr learned my addr 172.21.15.62:0/2848442537 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e8b31700 1 --2- 172.21.15.62:0/2848442537 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08e405ca90 0x7f08e414b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 -- 172.21.15.62:0/2848442537 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755918126 0 0) 0x7f08e4060750 con 0x7f08e405f730 2021-12-17T18:23:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 -- 172.21.15.62:0/2848442537 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08d0003260 con 0x7f08e405f730 2021-12-17T18:23:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 -- 172.21.15.62:0/2848442537 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24081324 0 0) 0x7f08e414ac00 con 0x7f08e40ac040 2021-12-17T18:23:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 -- 172.21.15.62:0/2848442537 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08e4060750 con 0x7f08e40ac040 2021-12-17T18:23:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 -- 172.21.15.62:0/2848442537 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2062774396 0 0) 0x7f08d0003260 con 0x7f08e405f730 2021-12-17T18:23:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 -- 172.21.15.62:0/2848442537 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08e405ca90 msgr2=0x7f08e414b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 --2- 172.21.15.62:0/2848442537 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08e405ca90 0x7f08e414b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 -- 172.21.15.62:0/2848442537 >> v1:172.21.15.109:6789/0 conn(0x7f08e40ac040 legacy=0x7f08e41475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 -- 172.21.15.62:0/2848442537 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e405ce70 con 0x7f08e405f730 2021-12-17T18:23:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 -- 172.21.15.62:0/2848442537 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f08dc0019e0 con 0x7f08e405f730 2021-12-17T18:23:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 -- 172.21.15.62:0/2848442537 >> v1:172.21.15.62:6789/0 conn(0x7f08e405f730 legacy=0x7f08e4146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 --2- 172.21.15.62:0/2848442537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08d0003910 0x7f08d0003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 --2- 172.21.15.62:0/2848442537 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08e405ca90 0x7f08d0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 --2- 172.21.15.62:0/2848442537 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f08d00049f0 0x7f08d0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 -- 172.21.15.62:0/2848442537 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e414aea0 con 0x7f08d0003910 2021-12-17T18:23:24.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 -- 172.21.15.62:0/2848442537 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d000b780 con 0x7f08d00049f0 2021-12-17T18:23:24.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 -- 172.21.15.62:0/2848442537 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d000b940 con 0x7f08e405ca90 2021-12-17T18:23:24.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e8b31700 1 --2- 172.21.15.62:0/2848442537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08d0003910 0x7f08d0003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e3fff700 1 --2- 172.21.15.62:0/2848442537 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08e405ca90 0x7f08d0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e9332700 1 --2- 172.21.15.62:0/2848442537 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f08d00049f0 0x7f08d0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e8b31700 1 -- 172.21.15.62:0/2848442537 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08e405ca90 msgr2=0x7f08d0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e8b31700 1 --2- 172.21.15.62:0/2848442537 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08e405ca90 0x7f08d0004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e8b31700 1 -- 172.21.15.62:0/2848442537 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f08d00049f0 msgr2=0x7f08d0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e8b31700 1 --2- 172.21.15.62:0/2848442537 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f08d00049f0 0x7f08d0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e8b31700 1 -- 172.21.15.62:0/2848442537 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d0003260 con 0x7f08d0003910 2021-12-17T18:23:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e8b31700 1 --2- 172.21.15.62:0/2848442537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08d0003910 0x7f08d0003d10 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f08d800c000 tx=0x7f08d8006df0).ready entity=mon.0 client_cookie=60f1bc91b960a23e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 -- 172.21.15.62:0/2848442537 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08d800e830 con 0x7f08d0003910 2021-12-17T18:23:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 -- 172.21.15.62:0/2848442537 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d800e990 con 0x7f08d0003910 2021-12-17T18:23:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.647+0000 7f08e37fe700 1 -- 172.21.15.62:0/2848442537 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08d800ecf0 con 0x7f08d0003910 2021-12-17T18:23:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e9b33700 1 -- 172.21.15.62:0/2848442537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08d0003910 msgr2=0x7f08d0003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e9b33700 1 --2- 172.21.15.62:0/2848442537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08d0003910 0x7f08d0003d10 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f08d800c000 tx=0x7f08d8006df0).stop 2021-12-17T18:23:24.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e9332700 1 -- 172.21.15.62:0/2848442537 reap_dead start 2021-12-17T18:23:24.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e9b33700 1 -- 172.21.15.62:0/2848442537 shutdown_connections 2021-12-17T18:23:24.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e9b33700 1 -- 172.21.15.62:0/2848442537 >> 172.21.15.62:0/2848442537 conn(0x7f08e405be70 msgr2=0x7f08e4062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:24.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e9b33700 1 -- 172.21.15.62:0/2848442537 shutdown_connections 2021-12-17T18:23:24.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e9b33700 1 -- 172.21.15.62:0/2848442537 wait complete. 2021-12-17T18:23:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e9b33700 1 Processor -- start 2021-12-17T18:23:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e9b33700 1 -- start start 2021-12-17T18:23:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e9b33700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f08d0003910 0x7f08e4149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e9b33700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08e40a0810 0x7f08e4156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e9b33700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08e414cbc0 0x7f08e415a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e9b33700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e4159f80 con 0x7f08e40a0810 2021-12-17T18:23:24.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e9b33700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e414d500 con 0x7f08d0003910 2021-12-17T18:23:24.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e9b33700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e415a1b0 con 0x7f08e414cbc0 2021-12-17T18:23:24.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08e40a0810 0x7f08e4156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08e40a0810 0x7f08e4156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51372/0 (socket says 172.21.15.62:51372) 2021-12-17T18:23:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e3fff700 1 -- 172.21.15.62:0/2227215932 learned_addr learned my addr 172.21.15.62:0/2227215932 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e8b31700 1 --2- 172.21.15.62:0/2227215932 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f08d0003910 0x7f08e4149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.651+0000 7f08e9332700 1 --2- 172.21.15.62:0/2227215932 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08e414cbc0 0x7f08e415a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.655+0000 7f08e3fff700 1 -- 172.21.15.62:0/2227215932 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08e414cbc0 msgr2=0x7f08e415a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.655+0000 7f08e3fff700 1 --2- 172.21.15.62:0/2227215932 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08e414cbc0 0x7f08e415a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.655+0000 7f08e3fff700 1 -- 172.21.15.62:0/2227215932 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f08d0003910 msgr2=0x7f08e4149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.655+0000 7f08e3fff700 1 --2- 172.21.15.62:0/2227215932 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f08d0003910 0x7f08e4149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.655+0000 7f08e3fff700 1 -- 172.21.15.62:0/2227215932 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e414d180 con 0x7f08e40a0810 2021-12-17T18:23:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.655+0000 7f08e8b31700 1 --2- 172.21.15.62:0/2227215932 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f08d0003910 0x7f08e4149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.655+0000 7f08e3fff700 1 --2- 172.21.15.62:0/2227215932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08e40a0810 0x7f08e4156980 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f08d400d000 tx=0x7f08d4007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.655+0000 7f08e1ffb700 1 -- 172.21.15.62:0/2227215932 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08d400fac0 con 0x7f08e40a0810 2021-12-17T18:23:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.655+0000 7f08e1ffb700 1 -- 172.21.15.62:0/2227215932 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d400fc20 con 0x7f08e40a0810 2021-12-17T18:23:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.655+0000 7f08e9b33700 1 -- 172.21.15.62:0/2227215932 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e4156e70 con 0x7f08e40a0810 2021-12-17T18:23:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.655+0000 7f08e1ffb700 1 -- 172.21.15.62:0/2227215932 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08d4014450 con 0x7f08e40a0810 2021-12-17T18:23:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.655+0000 7f08e9b33700 1 -- 172.21.15.62:0/2227215932 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e415ace0 con 0x7f08e40a0810 2021-12-17T18:23:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.655+0000 7f08e1ffb700 1 -- 172.21.15.62:0/2227215932 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f08d401b030 con 0x7f08e40a0810 2021-12-17T18:23:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.655+0000 7f08e9b33700 1 -- 172.21.15.62:0/2227215932 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e415a370 con 0x7f08e40a0810 2021-12-17T18:23:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.655+0000 7f08e1ffb700 1 --2- 172.21.15.62:0/2227215932 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f08c4053610 0x7f08c4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.655+0000 7f08e1ffb700 1 -- 172.21.15.62:0/2227215932 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f08d406b8f0 con 0x7f08e40a0810 2021-12-17T18:23:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.655+0000 7f08e8b31700 1 --2- 172.21.15.62:0/2227215932 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f08c4053610 0x7f08c4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.659+0000 7f08e8b31700 1 --2- 172.21.15.62:0/2227215932 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f08c4053610 0x7f08c4055ad0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f08d801a000 tx=0x7f08d8019000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.663+0000 7f08e1ffb700 1 -- 172.21.15.62:0/2227215932 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f08d4042d80 con 0x7f08e40a0810 2021-12-17T18:23:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.791+0000 7f08e9b33700 1 -- 172.21.15.62:0/2227215932 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f08e40573d0 con 0x7f08e40a0810 2021-12-17T18:23:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.791+0000 7f08e1ffb700 1 -- 172.21.15.62:0/2227215932 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v57) v1 ==== 92+0+10 (secure 0 0 0) 0x7f08d40463a0 con 0x7f08e40a0810 2021-12-17T18:23:24.796 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:23:24.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.791+0000 7f08e9b33700 1 -- 172.21.15.62:0/2227215932 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f08c4053610 msgr2=0x7f08c4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.791+0000 7f08e9b33700 1 --2- 172.21.15.62:0/2227215932 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f08c4053610 0x7f08c4055ad0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f08d801a000 tx=0x7f08d8019000).stop 2021-12-17T18:23:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.791+0000 7f08e9b33700 1 -- 172.21.15.62:0/2227215932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08e40a0810 msgr2=0x7f08e4156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.791+0000 7f08e9b33700 1 --2- 172.21.15.62:0/2227215932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08e40a0810 0x7f08e4156980 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f08d400d000 tx=0x7f08d4007a00).stop 2021-12-17T18:23:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.791+0000 7f08e9b33700 1 -- 172.21.15.62:0/2227215932 shutdown_connections 2021-12-17T18:23:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.791+0000 7f08e9b33700 1 --2- 172.21.15.62:0/2227215932 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f08c4053610 0x7f08c4055ad0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.791+0000 7f08e9b33700 1 --2- 172.21.15.62:0/2227215932 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08e414cbc0 0x7f08e415a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.791+0000 7f08e9b33700 1 --2- 172.21.15.62:0/2227215932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08e40a0810 0x7f08e4156980 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.791+0000 7f08e9b33700 1 --2- 172.21.15.62:0/2227215932 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f08d0003910 0x7f08e4149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.791+0000 7f08e9b33700 1 -- 172.21.15.62:0/2227215932 >> 172.21.15.62:0/2227215932 conn(0x7f08e405be70 msgr2=0x7f08e40b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.791+0000 7f08e9b33700 1 -- 172.21.15.62:0/2227215932 shutdown_connections 2021-12-17T18:23:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.791+0000 7f08e9b33700 1 -- 172.21.15.62:0/2227215932 wait complete. 2021-12-17T18:23:24.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-12-17T18:23:24.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.907+0000 7fb8fcf83700 1 Processor -- start 2021-12-17T18:23:24.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.907+0000 7fb8fcf83700 1 -- start start 2021-12-17T18:23:24.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.907+0000 7fb8fcf83700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8f8065630 0x7fb8f8066bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.907+0000 7fb8fcf83700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8f8144fa0 0x7fb8f81404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.907+0000 7fb8fcf83700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f8065a10 con 0x7fb8f80b1ff0 2021-12-17T18:23:24.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.907+0000 7fb8fcf83700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f80670c0 con 0x7fb8f8065630 2021-12-17T18:23:24.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.907+0000 7fb8fcf83700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f8067330 con 0x7fb8f8144fa0 2021-12-17T18:23:24.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.907+0000 7fb8f77fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8f8065630 0x7fb8f8066bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.907+0000 7fb8f77fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8f8065630 0x7fb8f8066bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51380/0 (socket says 172.21.15.62:51380) 2021-12-17T18:23:24.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.907+0000 7fb8f77fe700 1 -- 172.21.15.62:0/2280615034 learned_addr learned my addr 172.21.15.62:0/2280615034 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:24.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.907+0000 7fb8f7fff700 1 --2- 172.21.15.62:0/2280615034 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8f8144fa0 0x7fb8f81404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8f77fe700 1 -- 172.21.15.62:0/2280615034 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8f8144fa0 msgr2=0x7fb8f81404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:24.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8f67fc700 1 -- 172.21.15.62:0/2280615034 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548338219 0 0) 0x7fb8f8065a10 con 0x7fb8f80b1ff0 2021-12-17T18:23:24.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8f77fe700 1 --2- 172.21.15.62:0/2280615034 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8f8144fa0 0x7fb8f81404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8f77fe700 1 -- 172.21.15.62:0/2280615034 >> v1:172.21.15.109:6789/0 conn(0x7fb8f80b1ff0 legacy=0x7fb8f8144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8f77fe700 1 -- 172.21.15.62:0/2280615034 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f80675d0 con 0x7fb8f8065630 2021-12-17T18:23:24.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8f77fe700 1 --2- 172.21.15.62:0/2280615034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8f8065630 0x7fb8f8066bd0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fb8f8066190 tx=0x7fb8ec006eb0).ready entity=mon.0 client_cookie=4082e8e8a307957a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:24.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8f67fc700 1 -- 172.21.15.62:0/2280615034 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ec00d5c0 con 0x7fb8f8065630 2021-12-17T18:23:24.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8f67fc700 1 -- 172.21.15.62:0/2280615034 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec000e90 con 0x7fb8f8065630 2021-12-17T18:23:24.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8f67fc700 1 -- 172.21.15.62:0/2280615034 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ec00d910 con 0x7fb8f8065630 2021-12-17T18:23:24.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8fcf83700 1 -- 172.21.15.62:0/2280615034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8f8065630 msgr2=0x7fb8f8066bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8fcf83700 1 --2- 172.21.15.62:0/2280615034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8f8065630 0x7fb8f8066bd0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fb8f8066190 tx=0x7fb8ec006eb0).stop 2021-12-17T18:23:24.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8fcf83700 1 -- 172.21.15.62:0/2280615034 shutdown_connections 2021-12-17T18:23:24.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8fcf83700 1 --2- 172.21.15.62:0/2280615034 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8f8144fa0 0x7fb8f81404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8fcf83700 1 --2- 172.21.15.62:0/2280615034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8f8065630 0x7fb8f8066bd0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8fcf83700 1 -- 172.21.15.62:0/2280615034 >> 172.21.15.62:0/2280615034 conn(0x7fb8f805c750 msgr2=0x7fb8f805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8fcf83700 1 -- 172.21.15.62:0/2280615034 shutdown_connections 2021-12-17T18:23:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8fcf83700 1 -- 172.21.15.62:0/2280615034 wait complete. 2021-12-17T18:23:24.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8fcf83700 1 Processor -- start 2021-12-17T18:23:24.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8fcf83700 1 -- start start 2021-12-17T18:23:24.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8fcf83700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8f80b1ff0 0x7fb8f80ac800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8fcf83700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8f8144fa0 0x7fb8f80b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8fcf83700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8f80afee0 0x7fb8f80ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8fcf83700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80b0b00 con 0x7fb8f80afee0 2021-12-17T18:23:24.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8fcf83700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80ad4d0 con 0x7fb8f8144fa0 2021-12-17T18:23:24.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.911+0000 7fb8fcf83700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80a08e0 con 0x7fb8f80b1ff0 2021-12-17T18:23:24.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8f80afee0 0x7fb8f80ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f77fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8f80b1ff0 0x7fb8f80ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f77fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8f80b1ff0 0x7fb8f80ac800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:45086/0 (socket says 172.21.15.62:45086) 2021-12-17T18:23:24.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f77fe700 1 -- 172.21.15.62:0/2270311162 learned_addr learned my addr 172.21.15.62:0/2270311162 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:24.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8f80afee0 0x7fb8f80ae9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51388/0 (socket says 172.21.15.62:51388) 2021-12-17T18:23:24.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f6ffd700 1 --2- 172.21.15.62:0/2270311162 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8f8144fa0 0x7fb8f80b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f77fe700 1 -- 172.21.15.62:0/2270311162 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8f8144fa0 msgr2=0x7fb8f80b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f77fe700 1 --2- 172.21.15.62:0/2270311162 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8f8144fa0 0x7fb8f80b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f77fe700 1 -- 172.21.15.62:0/2270311162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8f80afee0 msgr2=0x7fb8f80ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:24.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f77fe700 1 --2- 172.21.15.62:0/2270311162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8f80afee0 0x7fb8f80ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:24.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f77fe700 1 -- 172.21.15.62:0/2270311162 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec00b1e0 con 0x7fb8f80b1ff0 2021-12-17T18:23:24.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f7fff700 1 --2- 172.21.15.62:0/2270311162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8f80afee0 0x7fb8f80ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:24.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f77fe700 1 --2- 172.21.15.62:0/2270311162 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8f80b1ff0 0x7fb8f80ac800 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fb8f8066190 tx=0x7fb8ec015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:24.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f4ff9700 1 -- 172.21.15.62:0/2270311162 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ec011790 con 0x7fb8f80b1ff0 2021-12-17T18:23:24.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f4ff9700 1 -- 172.21.15.62:0/2270311162 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec0118f0 con 0x7fb8f80b1ff0 2021-12-17T18:23:24.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8fcf83700 1 -- 172.21.15.62:0/2270311162 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f80a0b80 con 0x7fb8f80b1ff0 2021-12-17T18:23:24.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f4ff9700 1 -- 172.21.15.62:0/2270311162 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ec011c50 con 0x7fb8f80b1ff0 2021-12-17T18:23:24.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8fcf83700 1 -- 172.21.15.62:0/2270311162 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f80ae000 con 0x7fb8f80b1ff0 2021-12-17T18:23:24.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8fcf83700 1 -- 172.21.15.62:0/2270311162 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f80573d0 con 0x7fb8f80b1ff0 2021-12-17T18:23:24.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f4ff9700 1 -- 172.21.15.62:0/2270311162 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb8ec01a040 con 0x7fb8f80b1ff0 2021-12-17T18:23:24.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f4ff9700 1 --2- 172.21.15.62:0/2270311162 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8d80536d0 0x7fb8d8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:24.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.915+0000 7fb8f4ff9700 1 -- 172.21.15.62:0/2270311162 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb8ec06c3f0 con 0x7fb8f80b1ff0 2021-12-17T18:23:24.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.919+0000 7fb8f6ffd700 1 --2- 172.21.15.62:0/2270311162 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8d80536d0 0x7fb8d8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:24.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.919+0000 7fb8f6ffd700 1 --2- 172.21.15.62:0/2270311162 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8d80536d0 0x7fb8d8055b90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fb8e800d000 tx=0x7fb8e8007a00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:24.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:24.927+0000 7fb8f4ff9700 1 -- 172.21.15.62:0/2270311162 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb8ec0438e0 con 0x7fb8f80b1ff0 2021-12-17T18:23:25.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.051+0000 7fb8fcf83700 1 -- 172.21.15.62:0/2270311162 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb8f80b1ac0 con 0x7fb8f80b1ff0 2021-12-17T18:23:25.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.051+0000 7fb8f4ff9700 1 -- 172.21.15.62:0/2270311162 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v57) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb8ec023020 con 0x7fb8f80b1ff0 2021-12-17T18:23:25.059 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:25.059 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2021-12-17T18:23:25.059 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:25.059 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2021-12-17T18:23:25.059 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "device_health_metrics" 2021-12-17T18:23:25.060 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:25.060 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:25.060 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2021-12-17T18:23:25.060 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2021-12-17T18:23:25.061 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:25.061 INFO:teuthology.orchestra.run.smithi062.stdout:] 2021-12-17T18:23:25.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.055+0000 7fb8fcf83700 1 -- 172.21.15.62:0/2270311162 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8d80536d0 msgr2=0x7fb8d8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:25.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.055+0000 7fb8fcf83700 1 --2- 172.21.15.62:0/2270311162 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8d80536d0 0x7fb8d8055b90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fb8e800d000 tx=0x7fb8e8007a00).stop 2021-12-17T18:23:25.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.055+0000 7fb8fcf83700 1 -- 172.21.15.62:0/2270311162 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8f80b1ff0 msgr2=0x7fb8f80ac800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:25.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.055+0000 7fb8fcf83700 1 --2- 172.21.15.62:0/2270311162 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8f80b1ff0 0x7fb8f80ac800 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fb8f8066190 tx=0x7fb8ec015000).stop 2021-12-17T18:23:25.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.055+0000 7fb8fcf83700 1 -- 172.21.15.62:0/2270311162 shutdown_connections 2021-12-17T18:23:25.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.055+0000 7fb8fcf83700 1 --2- 172.21.15.62:0/2270311162 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8d80536d0 0x7fb8d8055b90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:25.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.055+0000 7fb8fcf83700 1 --2- 172.21.15.62:0/2270311162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8f80afee0 0x7fb8f80ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:25.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.055+0000 7fb8fcf83700 1 --2- 172.21.15.62:0/2270311162 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8f8144fa0 0x7fb8f80b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:25.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.055+0000 7fb8fcf83700 1 --2- 172.21.15.62:0/2270311162 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8f80b1ff0 0x7fb8f80ac800 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.055+0000 7fb8fcf83700 1 -- 172.21.15.62:0/2270311162 >> 172.21.15.62:0/2270311162 conn(0x7fb8f805c750 msgr2=0x7fb8f8140fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.055+0000 7fb8fcf83700 1 -- 172.21.15.62:0/2270311162 shutdown_connections 2021-12-17T18:23:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.055+0000 7fb8fcf83700 1 -- 172.21.15.62:0/2270311162 wait complete. 2021-12-17T18:23:25.072 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-12-17T18:23:25.072 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-12-17T18:23:25.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.175+0000 7f5ff590f700 1 Processor -- start 2021-12-17T18:23:25.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.175+0000 7f5ff590f700 1 -- start start 2021-12-17T18:23:25.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5ff590f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5ff005ca90 0x7f5ff0140420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:25.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5ff590f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5ff00b05b0 0x7f5ff0140910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:25.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5ff590f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff00abcb0 con 0x7f5ff00b10d0 2021-12-17T18:23:25.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5ff590f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff0140e00 con 0x7f5ff00b05b0 2021-12-17T18:23:25.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5ff590f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff005ce70 con 0x7f5ff005ca90 2021-12-17T18:23:25.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5feffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5ff00b05b0 0x7f5ff0140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:25.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5ff510e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5ff00b10d0 0x7f5ff01433e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34976/0 (socket says 172.21.15.62:34976) 2021-12-17T18:23:25.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5ff510e700 1 -- 172.21.15.62:0/4289126768 learned_addr learned my addr 172.21.15.62:0/4289126768 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:25.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5ff490d700 1 --2- 172.21.15.62:0/4289126768 >> v2:172.21.15.109:3300/0 conn(0x7f5ff005ca90 0x7f5ff0140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:25.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5fef7fe700 1 -- 172.21.15.62:0/4289126768 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889242837 0 0) 0x7f5ff00abcb0 con 0x7f5ff00b10d0 2021-12-17T18:23:25.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5fef7fe700 1 -- 172.21.15.62:0/4289126768 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fdc003260 con 0x7f5ff00b10d0 2021-12-17T18:23:25.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5feffff700 1 -- 172.21.15.62:0/4289126768 >> v2:172.21.15.109:3300/0 conn(0x7f5ff005ca90 msgr2=0x7f5ff0140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:25.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5feffff700 1 --2- 172.21.15.62:0/4289126768 >> v2:172.21.15.109:3300/0 conn(0x7f5ff005ca90 0x7f5ff0140420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:25.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5feffff700 1 -- 172.21.15.62:0/4289126768 >> v1:172.21.15.62:6789/0 conn(0x7f5ff00b10d0 legacy=0x7f5ff01433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:25.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5feffff700 1 -- 172.21.15.62:0/4289126768 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff013fe10 con 0x7f5ff00b05b0 2021-12-17T18:23:25.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5feffff700 1 --2- 172.21.15.62:0/4289126768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ff00b05b0 0x7f5ff0140910 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f5fe0002f70 tx=0x7f5fe0006df0).ready entity=mon.0 client_cookie=6d539b40629e9a88 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:25.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5fef7fe700 1 -- 172.21.15.62:0/4289126768 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe0014070 con 0x7f5ff00b05b0 2021-12-17T18:23:25.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5fef7fe700 1 -- 172.21.15.62:0/4289126768 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe0000e90 con 0x7f5ff00b05b0 2021-12-17T18:23:25.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.179+0000 7f5fef7fe700 1 -- 172.21.15.62:0/4289126768 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe000fae0 con 0x7f5ff00b05b0 2021-12-17T18:23:25.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5ff590f700 1 -- 172.21.15.62:0/4289126768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ff00b05b0 msgr2=0x7f5ff0140910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:25.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5ff590f700 1 --2- 172.21.15.62:0/4289126768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ff00b05b0 0x7f5ff0140910 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f5fe0002f70 tx=0x7f5fe0006df0).stop 2021-12-17T18:23:25.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5ff590f700 1 -- 172.21.15.62:0/4289126768 shutdown_connections 2021-12-17T18:23:25.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5ff590f700 1 --2- 172.21.15.62:0/4289126768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ff00b05b0 0x7f5ff0140910 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:25.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5ff590f700 1 --2- 172.21.15.62:0/4289126768 >> v2:172.21.15.109:3300/0 conn(0x7f5ff005ca90 0x7f5ff0140420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:25.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5ff590f700 1 -- 172.21.15.62:0/4289126768 >> 172.21.15.62:0/4289126768 conn(0x7f5ff005c070 msgr2=0x7f5ff0062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:25.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5ff590f700 1 -- 172.21.15.62:0/4289126768 shutdown_connections 2021-12-17T18:23:25.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5ff590f700 1 -- 172.21.15.62:0/4289126768 wait complete. 2021-12-17T18:23:25.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5ff590f700 1 Processor -- start 2021-12-17T18:23:25.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5ff590f700 1 -- start start 2021-12-17T18:23:25.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5ff590f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ff005ca90 0x7f5ff00b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:25.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5ff590f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ff00b05b0 0x7f5ff00646f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:25.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5ff590f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ff00b10d0 0x7f5ff01527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:25.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5ff590f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff0137e50 con 0x7f5ff00b05b0 2021-12-17T18:23:25.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5ff590f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00b4120 con 0x7f5ff005ca90 2021-12-17T18:23:25.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5ff590f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00b43c0 con 0x7f5ff00b10d0 2021-12-17T18:23:25.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5feffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ff00b05b0 0x7f5ff00646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5feffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ff00b05b0 0x7f5ff00646f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51400/0 (socket says 172.21.15.62:51400) 2021-12-17T18:23:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.183+0000 7f5feffff700 1 -- 172.21.15.62:0/2487479679 learned_addr learned my addr 172.21.15.62:0/2487479679 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.187+0000 7f5ff490d700 1 --2- 172.21.15.62:0/2487479679 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ff005ca90 0x7f5ff00b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.187+0000 7f5ff510e700 1 --2- 172.21.15.62:0/2487479679 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ff00b10d0 0x7f5ff01527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.187+0000 7f5feffff700 1 -- 172.21.15.62:0/2487479679 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ff00b10d0 msgr2=0x7f5ff01527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:25.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.187+0000 7f5feffff700 1 --2- 172.21.15.62:0/2487479679 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ff00b10d0 0x7f5ff01527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:25.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.187+0000 7f5feffff700 1 -- 172.21.15.62:0/2487479679 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ff005ca90 msgr2=0x7f5ff00b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:25.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.187+0000 7f5feffff700 1 --2- 172.21.15.62:0/2487479679 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ff005ca90 0x7f5ff00b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:25.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.187+0000 7f5feffff700 1 -- 172.21.15.62:0/2487479679 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe000b180 con 0x7f5ff00b05b0 2021-12-17T18:23:25.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.187+0000 7f5ff490d700 1 --2- 172.21.15.62:0/2487479679 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ff005ca90 0x7f5ff00b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:25.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.187+0000 7f5feffff700 1 --2- 172.21.15.62:0/2487479679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ff00b05b0 0x7f5ff00646f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f5fe0002f70 tx=0x7f5fe0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:25.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.187+0000 7f5fedffb700 1 -- 172.21.15.62:0/2487479679 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe0006a60 con 0x7f5ff00b05b0 2021-12-17T18:23:25.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.187+0000 7f5fedffb700 1 -- 172.21.15.62:0/2487479679 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe0010ca0 con 0x7f5ff00b05b0 2021-12-17T18:23:25.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.187+0000 7f5ff590f700 1 -- 172.21.15.62:0/2487479679 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff00b3ba0 con 0x7f5ff00b05b0 2021-12-17T18:23:25.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.187+0000 7f5fedffb700 1 -- 172.21.15.62:0/2487479679 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe001c440 con 0x7f5ff00b05b0 2021-12-17T18:23:25.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.187+0000 7f5ff590f700 1 -- 172.21.15.62:0/2487479679 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff0152cd0 con 0x7f5ff00b05b0 2021-12-17T18:23:25.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.187+0000 7f5ff590f700 1 -- 172.21.15.62:0/2487479679 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff00b3f90 con 0x7f5ff00b05b0 2021-12-17T18:23:25.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.187+0000 7f5fedffb700 1 -- 172.21.15.62:0/2487479679 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5fe0022020 con 0x7f5ff00b05b0 2021-12-17T18:23:25.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.191+0000 7f5fedffb700 1 --2- 172.21.15.62:0/2487479679 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fd00534f0 0x7f5fd00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:25.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.191+0000 7f5fedffb700 1 -- 172.21.15.62:0/2487479679 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5fe006ce60 con 0x7f5ff00b05b0 2021-12-17T18:23:25.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.191+0000 7f5ff490d700 1 --2- 172.21.15.62:0/2487479679 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fd00534f0 0x7f5fd00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:25.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.191+0000 7f5ff490d700 1 --2- 172.21.15.62:0/2487479679 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fd00534f0 0x7f5fd00559b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f5fe400b000 tx=0x7f5fe4006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:25.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.195+0000 7f5fedffb700 1 -- 172.21.15.62:0/2487479679 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5fe00442f0 con 0x7f5ff00b05b0 2021-12-17T18:23:25.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:25.323+0000 7f5ff590f700 1 -- 172.21.15.62:0/2487479679 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f5ff00b4580 con 0x7f5ff00b05b0 2021-12-17T18:23:26.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.239+0000 7f5fedffb700 1 -- 172.21.15.62:0/2487479679 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v58) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5fe0047910 con 0x7f5ff00b05b0 2021-12-17T18:23:26.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.243+0000 7f5ff590f700 1 -- 172.21.15.62:0/2487479679 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fd00534f0 msgr2=0x7f5fd00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:26.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.243+0000 7f5ff590f700 1 --2- 172.21.15.62:0/2487479679 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fd00534f0 0x7f5fd00559b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f5fe400b000 tx=0x7f5fe4006df0).stop 2021-12-17T18:23:26.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.243+0000 7f5ff590f700 1 -- 172.21.15.62:0/2487479679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ff00b05b0 msgr2=0x7f5ff00646f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:26.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.243+0000 7f5ff590f700 1 --2- 172.21.15.62:0/2487479679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ff00b05b0 0x7f5ff00646f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f5fe0002f70 tx=0x7f5fe0016000).stop 2021-12-17T18:23:26.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.243+0000 7f5ff590f700 1 -- 172.21.15.62:0/2487479679 shutdown_connections 2021-12-17T18:23:26.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.243+0000 7f5ff590f700 1 --2- 172.21.15.62:0/2487479679 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fd00534f0 0x7f5fd00559b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:26.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.243+0000 7f5ff590f700 1 --2- 172.21.15.62:0/2487479679 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ff00b10d0 0x7f5ff01527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:26.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.243+0000 7f5ff590f700 1 --2- 172.21.15.62:0/2487479679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ff00b05b0 0x7f5ff00646f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:26.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.243+0000 7f5ff590f700 1 --2- 172.21.15.62:0/2487479679 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ff005ca90 0x7f5ff00b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:26.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.243+0000 7f5ff590f700 1 -- 172.21.15.62:0/2487479679 >> 172.21.15.62:0/2487479679 conn(0x7f5ff005c070 msgr2=0x7f5ff0062400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:26.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.243+0000 7f5ff590f700 1 -- 172.21.15.62:0/2487479679 shutdown_connections 2021-12-17T18:23:26.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.243+0000 7f5ff590f700 1 -- 172.21.15.62:0/2487479679 wait complete. 2021-12-17T18:23:26.252 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2021-12-17T18:23:26.262 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-12-17T18:23:26.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.367+0000 7fe0a64dd700 1 Processor -- start 2021-12-17T18:23:26.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.367+0000 7fe0a64dd700 1 -- start start 2021-12-17T18:23:26.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe0a64dd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe0a0060260 0x7fe0a005cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:26.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe0a64dd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0a0146f70 0x7fe0a00b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:26.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe0a64dd700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a0142ff0 con 0x7fe0a005c750 2021-12-17T18:23:26.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe0a64dd700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a0147420 con 0x7fe0a0060260 2021-12-17T18:23:26.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe0a64dd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a0143290 con 0x7fe0a0146f70 2021-12-17T18:23:26.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe09f7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe0a0060260 0x7fe0a005cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:26.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe09f7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe0a0060260 0x7fe0a005cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51406/0 (socket says 172.21.15.62:51406) 2021-12-17T18:23:26.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe09f7fe700 1 -- 172.21.15.62:0/1969044792 learned_addr learned my addr 172.21.15.62:0/1969044792 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:26.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe09ffff700 1 --1- 172.21.15.62:0/1969044792 >> v1:172.21.15.62:6789/0 conn(0x7fe0a005c750 0x7fe0a01439d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34986/0 (socket says 172.21.15.62:34986) 2021-12-17T18:23:26.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe0a4a7a700 1 --2- 172.21.15.62:0/1969044792 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0a0146f70 0x7fe0a00b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:26.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe09f7fe700 1 -- 172.21.15.62:0/1969044792 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0a0146f70 msgr2=0x7fe0a00b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:26.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe09effd700 1 -- 172.21.15.62:0/1969044792 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657236215 0 0) 0x7fe0a0142ff0 con 0x7fe0a005c750 2021-12-17T18:23:26.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe09f7fe700 1 --2- 172.21.15.62:0/1969044792 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0a0146f70 0x7fe0a00b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:26.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe09f7fe700 1 -- 172.21.15.62:0/1969044792 >> v1:172.21.15.62:6789/0 conn(0x7fe0a005c750 legacy=0x7fe0a01439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:26.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe09f7fe700 1 -- 172.21.15.62:0/1969044792 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0143530 con 0x7fe0a0060260 2021-12-17T18:23:26.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe09f7fe700 1 --2- 172.21.15.62:0/1969044792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0a0060260 0x7fe0a005cb30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fe090002f70 tx=0x7fe090006eb0).ready entity=mon.0 client_cookie=bf0b6cf31210ea0b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:26.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe09effd700 1 -- 172.21.15.62:0/1969044792 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe09000d570 con 0x7fe0a0060260 2021-12-17T18:23:26.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe09effd700 1 -- 172.21.15.62:0/1969044792 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe090000e90 con 0x7fe0a0060260 2021-12-17T18:23:26.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe09effd700 1 -- 172.21.15.62:0/1969044792 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe09000d8c0 con 0x7fe0a0060260 2021-12-17T18:23:26.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe0a64dd700 1 -- 172.21.15.62:0/1969044792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0a0060260 msgr2=0x7fe0a005cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:26.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe0a64dd700 1 --2- 172.21.15.62:0/1969044792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0a0060260 0x7fe0a005cb30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fe090002f70 tx=0x7fe090006eb0).stop 2021-12-17T18:23:26.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe0a64dd700 1 -- 172.21.15.62:0/1969044792 shutdown_connections 2021-12-17T18:23:26.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe0a64dd700 1 --2- 172.21.15.62:0/1969044792 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0a0146f70 0x7fe0a00b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:26.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe0a64dd700 1 --2- 172.21.15.62:0/1969044792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0a0060260 0x7fe0a005cb30 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:26.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe0a64dd700 1 -- 172.21.15.62:0/1969044792 >> 172.21.15.62:0/1969044792 conn(0x7fe0a0062430 msgr2=0x7fe0a0062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:26.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe0a64dd700 1 -- 172.21.15.62:0/1969044792 shutdown_connections 2021-12-17T18:23:26.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.371+0000 7fe0a64dd700 1 -- 172.21.15.62:0/1969044792 wait complete. 2021-12-17T18:23:26.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.375+0000 7fe0a64dd700 1 Processor -- start 2021-12-17T18:23:26.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.375+0000 7fe0a64dd700 1 -- start start 2021-12-17T18:23:26.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.375+0000 7fe0a64dd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0a005c750 0x7fe0a00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:26.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.375+0000 7fe0a64dd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0a0060260 0x7fe0a0140f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:26.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.375+0000 7fe0a64dd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0a0146f70 0x7fe0a0141470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:26.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.375+0000 7fe0a64dd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a013ec70 con 0x7fe0a0146f70 2021-12-17T18:23:26.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.375+0000 7fe0a64dd700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a013e9d0 con 0x7fe0a005c750 2021-12-17T18:23:26.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.375+0000 7fe0a64dd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00b7720 con 0x7fe0a0060260 2021-12-17T18:23:26.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.375+0000 7fe0a4a7a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0a0146f70 0x7fe0a0141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:26.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.375+0000 7fe09ffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0a005c750 0x7fe0a00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:26.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.375+0000 7fe0a4a7a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0a0146f70 0x7fe0a0141470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51416/0 (socket says 172.21.15.62:51416) 2021-12-17T18:23:26.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.375+0000 7fe0a4a7a700 1 -- 172.21.15.62:0/2451422060 learned_addr learned my addr 172.21.15.62:0/2451422060 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:26.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.375+0000 7fe09f7fe700 1 --2- 172.21.15.62:0/2451422060 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0a0060260 0x7fe0a0140f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:26.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.379+0000 7fe0a4a7a700 1 -- 172.21.15.62:0/2451422060 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0a0060260 msgr2=0x7fe0a0140f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:26.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.379+0000 7fe0a4a7a700 1 --2- 172.21.15.62:0/2451422060 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0a0060260 0x7fe0a0140f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:26.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.379+0000 7fe0a4a7a700 1 -- 172.21.15.62:0/2451422060 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0a005c750 msgr2=0x7fe0a00b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:26.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.379+0000 7fe0a4a7a700 1 --2- 172.21.15.62:0/2451422060 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0a005c750 0x7fe0a00b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:26.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.379+0000 7fe0a4a7a700 1 -- 172.21.15.62:0/2451422060 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09000b1e0 con 0x7fe0a0146f70 2021-12-17T18:23:26.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.379+0000 7fe0a4a7a700 1 --2- 172.21.15.62:0/2451422060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0a0146f70 0x7fe0a0141470 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fe098006e00 tx=0x7fe0980091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:26.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.379+0000 7fe09d7fa700 1 -- 172.21.15.62:0/2451422060 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe098012600 con 0x7fe0a0146f70 2021-12-17T18:23:26.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.379+0000 7fe09d7fa700 1 -- 172.21.15.62:0/2451422060 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe098012760 con 0x7fe0a0146f70 2021-12-17T18:23:26.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.379+0000 7fe0a64dd700 1 -- 172.21.15.62:0/2451422060 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a0139d70 con 0x7fe0a0146f70 2021-12-17T18:23:26.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.379+0000 7fe09d7fa700 1 -- 172.21.15.62:0/2451422060 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe098012ac0 con 0x7fe0a0146f70 2021-12-17T18:23:26.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.379+0000 7fe0a64dd700 1 -- 172.21.15.62:0/2451422060 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a0140400 con 0x7fe0a0146f70 2021-12-17T18:23:26.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.379+0000 7fe0a64dd700 1 -- 172.21.15.62:0/2451422060 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a013e830 con 0x7fe0a0146f70 2021-12-17T18:23:26.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.379+0000 7fe09d7fa700 1 -- 172.21.15.62:0/2451422060 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe098022070 con 0x7fe0a0146f70 2021-12-17T18:23:26.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.379+0000 7fe09d7fa700 1 --2- 172.21.15.62:0/2451422060 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe084053580 0x7fe084055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:26.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.383+0000 7fe09d7fa700 1 -- 172.21.15.62:0/2451422060 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fe09806bda0 con 0x7fe0a0146f70 2021-12-17T18:23:26.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.383+0000 7fe09ffff700 1 --2- 172.21.15.62:0/2451422060 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe084053580 0x7fe084055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:26.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.383+0000 7fe09ffff700 1 --2- 172.21.15.62:0/2451422060 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe084053580 0x7fe084055a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fe08800d000 tx=0x7fe088007a00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:26.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.387+0000 7fe09d7fa700 1 -- 172.21.15.62:0/2451422060 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe0a013e830 con 0x7fe0a0146f70 2021-12-17T18:23:26.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:26.519+0000 7fe0a64dd700 1 -- 172.21.15.62:0/2451422060 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fe0a013e830 con 0x7fe0a0146f70 2021-12-17T18:23:27.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.243+0000 7fe09d7fa700 1 -- 172.21.15.62:0/2451422060 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v59) v1 ==== 125+0+0 (secure 0 0 0) 0x7fe0a013e830 con 0x7fe0a0146f70 2021-12-17T18:23:27.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.251+0000 7fe0a64dd700 1 -- 172.21.15.62:0/2451422060 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe084053580 msgr2=0x7fe084055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.251+0000 7fe0a64dd700 1 --2- 172.21.15.62:0/2451422060 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe084053580 0x7fe084055a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fe08800d000 tx=0x7fe088007a00).stop 2021-12-17T18:23:27.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.251+0000 7fe0a64dd700 1 -- 172.21.15.62:0/2451422060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0a0146f70 msgr2=0x7fe0a0141470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.251+0000 7fe0a64dd700 1 --2- 172.21.15.62:0/2451422060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0a0146f70 0x7fe0a0141470 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fe098006e00 tx=0x7fe0980091d0).stop 2021-12-17T18:23:27.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.251+0000 7fe0a64dd700 1 -- 172.21.15.62:0/2451422060 shutdown_connections 2021-12-17T18:23:27.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.251+0000 7fe0a64dd700 1 --2- 172.21.15.62:0/2451422060 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe084053580 0x7fe084055a40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.251+0000 7fe0a64dd700 1 --2- 172.21.15.62:0/2451422060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0a0146f70 0x7fe0a0141470 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.251+0000 7fe0a64dd700 1 --2- 172.21.15.62:0/2451422060 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0a0060260 0x7fe0a0140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.251+0000 7fe0a64dd700 1 --2- 172.21.15.62:0/2451422060 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0a005c750 0x7fe0a00b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.251+0000 7fe0a64dd700 1 -- 172.21.15.62:0/2451422060 >> 172.21.15.62:0/2451422060 conn(0x7fe0a0062430 msgr2=0x7fe0a01444c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:27.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.251+0000 7fe0a64dd700 1 -- 172.21.15.62:0/2451422060 shutdown_connections 2021-12-17T18:23:27.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.251+0000 7fe0a64dd700 1 -- 172.21.15.62:0/2451422060 wait complete. 2021-12-17T18:23:27.259 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2021-12-17T18:23:27.270 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-12-17T18:23:27.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.367+0000 7f6ed1c73700 1 Processor -- start 2021-12-17T18:23:27.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.367+0000 7f6ed1c73700 1 -- start start 2021-12-17T18:23:27.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ed1c73700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc0ad150 0x7f6ecc05f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ed1c73700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ecc05ce70 con 0x7f6ecc060540 2021-12-17T18:23:27.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ed1c73700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ecc0afc70 con 0x7f6ecc05ca90 2021-12-17T18:23:27.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ed1c73700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0abf30 con 0x7f6ecc0ad150 2021-12-17T18:23:27.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ecbfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6ecc060540 0x7f6ecc144350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35002/0 (socket says 172.21.15.62:35002) 2021-12-17T18:23:27.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ecbfff700 1 -- 172.21.15.62:0/759843841 learned_addr learned my addr 172.21.15.62:0/759843841 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:27.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ed1472700 1 --2- 172.21.15.62:0/759843841 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc0ad150 0x7f6ecc05f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ecb7fe700 1 -- 172.21.15.62:0/759843841 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146585180 0 0) 0x7f6ecc05ce70 con 0x7f6ecc060540 2021-12-17T18:23:27.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ecb7fe700 1 -- 172.21.15.62:0/759843841 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eb8003260 con 0x7f6ecc060540 2021-12-17T18:23:27.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ecb7fe700 1 -- 172.21.15.62:0/759843841 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524328957 0 0) 0x7f6ecc0afc70 con 0x7f6ecc05ca90 2021-12-17T18:23:27.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ecb7fe700 1 -- 172.21.15.62:0/759843841 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ecc05ce70 con 0x7f6ecc05ca90 2021-12-17T18:23:27.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ed1472700 1 -- 172.21.15.62:0/759843841 >> v1:172.21.15.109:6789/0 conn(0x7f6ecc05ca90 legacy=0x7f6ecc0aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ed1472700 1 -- 172.21.15.62:0/759843841 >> v1:172.21.15.62:6789/0 conn(0x7f6ecc060540 legacy=0x7f6ecc144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ed1472700 1 -- 172.21.15.62:0/759843841 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc0ac1d0 con 0x7f6ecc0ad150 2021-12-17T18:23:27.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ed1472700 1 --2- 172.21.15.62:0/759843841 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc0ad150 0x7f6ecc05f730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f6ec40032f0 tx=0x7f6ec40091d0).ready entity=mon.2 client_cookie=b869ba4de8e88ee6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:27.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ecb7fe700 1 -- 172.21.15.62:0/759843841 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ec400b640 con 0x7f6ecc0ad150 2021-12-17T18:23:27.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ecb7fe700 1 -- 172.21.15.62:0/759843841 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec400b7a0 con 0x7f6ecc0ad150 2021-12-17T18:23:27.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ecb7fe700 1 -- 172.21.15.62:0/759843841 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ec400b910 con 0x7f6ecc0ad150 2021-12-17T18:23:27.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ed1c73700 1 -- 172.21.15.62:0/759843841 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc0ad150 msgr2=0x7f6ecc05f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ed1c73700 1 --2- 172.21.15.62:0/759843841 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc0ad150 0x7f6ecc05f730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f6ec40032f0 tx=0x7f6ec40091d0).stop 2021-12-17T18:23:27.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ed1c73700 1 -- 172.21.15.62:0/759843841 shutdown_connections 2021-12-17T18:23:27.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ed1c73700 1 --2- 172.21.15.62:0/759843841 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc0ad150 0x7f6ecc05f730 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ed1c73700 1 -- 172.21.15.62:0/759843841 >> 172.21.15.62:0/759843841 conn(0x7f6ecc05be70 msgr2=0x7f6ecc062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:27.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ed1c73700 1 -- 172.21.15.62:0/759843841 shutdown_connections 2021-12-17T18:23:27.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.371+0000 7f6ed1c73700 1 -- 172.21.15.62:0/759843841 wait complete. 2021-12-17T18:23:27.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.375+0000 7f6ed1c73700 1 Processor -- start 2021-12-17T18:23:27.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.375+0000 7f6ed1c73700 1 -- start start 2021-12-17T18:23:27.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.375+0000 7f6ed1c73700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ecc05ca90 0x7f6ecc14eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.375+0000 7f6ed1c73700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6ecc060540 0x7f6ecc144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.375+0000 7f6ed1c73700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc0ad150 0x7f6ecc144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.375+0000 7f6ed1c73700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc156950 con 0x7f6ecc05ca90 2021-12-17T18:23:27.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.375+0000 7f6ed1c73700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc064480 con 0x7f6ecc060540 2021-12-17T18:23:27.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.375+0000 7f6ed1c73700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc063800 con 0x7f6ecc0ad150 2021-12-17T18:23:27.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ed0c71700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ecc05ca90 0x7f6ecc14eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ed0c71700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ecc05ca90 0x7f6ecc14eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51426/0 (socket says 172.21.15.62:51426) 2021-12-17T18:23:27.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ed0c71700 1 -- 172.21.15.62:0/3834344841 learned_addr learned my addr 172.21.15.62:0/3834344841 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:27.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ed1472700 1 --2- 172.21.15.62:0/3834344841 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc0ad150 0x7f6ecc144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ecbfff700 1 --2- 172.21.15.62:0/3834344841 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6ecc060540 0x7f6ecc144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ed0c71700 1 -- 172.21.15.62:0/3834344841 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc0ad150 msgr2=0x7f6ecc144a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ed0c71700 1 --2- 172.21.15.62:0/3834344841 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc0ad150 0x7f6ecc144a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ed0c71700 1 -- 172.21.15.62:0/3834344841 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6ecc060540 msgr2=0x7f6ecc144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ed0c71700 1 --2- 172.21.15.62:0/3834344841 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6ecc060540 0x7f6ecc144510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ed0c71700 1 -- 172.21.15.62:0/3834344841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec4009470 con 0x7f6ecc05ca90 2021-12-17T18:23:27.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ed0c71700 1 --2- 172.21.15.62:0/3834344841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ecc05ca90 0x7f6ecc14eb70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f6ec0001110 tx=0x7f6ec0007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:27.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ec9ffb700 1 -- 172.21.15.62:0/3834344841 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ec0012400 con 0x7f6ecc05ca90 2021-12-17T18:23:27.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ec9ffb700 1 -- 172.21.15.62:0/3834344841 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec0012560 con 0x7f6ecc05ca90 2021-12-17T18:23:27.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ec9ffb700 1 -- 172.21.15.62:0/3834344841 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ec00128c0 con 0x7f6ecc05ca90 2021-12-17T18:23:27.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ed1c73700 1 -- 172.21.15.62:0/3834344841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc063aa0 con 0x7f6ecc05ca90 2021-12-17T18:23:27.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ed1c73700 1 -- 172.21.15.62:0/3834344841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc063fe0 con 0x7f6ecc05ca90 2021-12-17T18:23:27.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ed1c73700 1 -- 172.21.15.62:0/3834344841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ecc0673b0 con 0x7f6ecc05ca90 2021-12-17T18:23:27.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.379+0000 7f6ec9ffb700 1 -- 172.21.15.62:0/3834344841 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6ec0019030 con 0x7f6ecc05ca90 2021-12-17T18:23:27.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.383+0000 7f6ec9ffb700 1 --2- 172.21.15.62:0/3834344841 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eac053610 0x7f6eac055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.383+0000 7f6ec9ffb700 1 -- 172.21.15.62:0/3834344841 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f6ec006ac70 con 0x7f6ecc05ca90 2021-12-17T18:23:27.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.383+0000 7f6ecbfff700 1 --2- 172.21.15.62:0/3834344841 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eac053610 0x7f6eac055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.383+0000 7f6ecbfff700 1 --2- 172.21.15.62:0/3834344841 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eac053610 0x7f6eac055ad0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f6ebc00d000 tx=0x7f6ebc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:27.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.387+0000 7f6ec9ffb700 1 -- 172.21.15.62:0/3834344841 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6ec0041e40 con 0x7f6ecc05ca90 2021-12-17T18:23:27.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.555+0000 7f6ed1c73700 1 -- 172.21.15.62:0/3834344841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f6ecc0573d0 con 0x7f6ecc05ca90 2021-12-17T18:23:27.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.563+0000 7f6ec9ffb700 1 -- 172.21.15.62:0/3834344841 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 11 and data pool 12 v25) v1 ==== 189+0+0 (secure 0 0 0) 0x7f6ec0045460 con 0x7f6ecc05ca90 2021-12-17T18:23:27.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.567+0000 7f6ed1c73700 1 -- 172.21.15.62:0/3834344841 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eac053610 msgr2=0x7f6eac055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.567+0000 7f6ed1c73700 1 --2- 172.21.15.62:0/3834344841 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eac053610 0x7f6eac055ad0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f6ebc00d000 tx=0x7f6ebc009040).stop 2021-12-17T18:23:27.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.567+0000 7f6ed1c73700 1 -- 172.21.15.62:0/3834344841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ecc05ca90 msgr2=0x7f6ecc14eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.567+0000 7f6ed1c73700 1 --2- 172.21.15.62:0/3834344841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ecc05ca90 0x7f6ecc14eb70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f6ec0001110 tx=0x7f6ec0007a90).stop 2021-12-17T18:23:27.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.567+0000 7f6ed1c73700 1 -- 172.21.15.62:0/3834344841 shutdown_connections 2021-12-17T18:23:27.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.567+0000 7f6ed1c73700 1 --2- 172.21.15.62:0/3834344841 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eac053610 0x7f6eac055ad0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.567+0000 7f6ed1c73700 1 --2- 172.21.15.62:0/3834344841 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc0ad150 0x7f6ecc144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.567+0000 7f6ed1c73700 1 --2- 172.21.15.62:0/3834344841 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6ecc060540 0x7f6ecc144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.567+0000 7f6ed1c73700 1 --2- 172.21.15.62:0/3834344841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ecc05ca90 0x7f6ecc14eb70 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.567+0000 7f6ed1c73700 1 -- 172.21.15.62:0/3834344841 >> 172.21.15.62:0/3834344841 conn(0x7f6ecc05be70 msgr2=0x7f6ecc0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:27.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.567+0000 7f6ed1c73700 1 -- 172.21.15.62:0/3834344841 shutdown_connections 2021-12-17T18:23:27.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.571+0000 7f6ed1c73700 1 -- 172.21.15.62:0/3834344841 wait complete. 2021-12-17T18:23:27.580 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 11 and data pool 12 2021-12-17T18:23:27.591 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:23:27.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf3827e700 1 Processor -- start 2021-12-17T18:23:27.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf3827e700 1 -- start start 2021-12-17T18:23:27.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf3827e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbf300b6160 0x7fbf30142690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf3827e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fbf300af220 0x7fbf300b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf3827e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf300b6540 con 0x7fbf300b0830 2021-12-17T18:23:27.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf3827e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf300ae840 con 0x7fbf300b6160 2021-12-17T18:23:27.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf3827e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf300aeae0 con 0x7fbf300af220 2021-12-17T18:23:27.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf3601a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbf300b6160 0x7fbf30142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf35819700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbf300b0830 0x7fbf30142b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35028/0 (socket says 172.21.15.62:35028) 2021-12-17T18:23:27.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf35819700 1 -- 172.21.15.62:0/3141857265 learned_addr learned my addr 172.21.15.62:0/3141857265 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:27.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf3681b700 1 --2- 172.21.15.62:0/3141857265 >> v2:172.21.15.109:3300/0 conn(0x7fbf300af220 0x7fbf300b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf35018700 1 -- 172.21.15.62:0/3141857265 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662729278 0 0) 0x7fbf300b6540 con 0x7fbf300b0830 2021-12-17T18:23:27.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf35018700 1 -- 172.21.15.62:0/3141857265 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf18003260 con 0x7fbf300b0830 2021-12-17T18:23:27.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf3601a700 1 -- 172.21.15.62:0/3141857265 >> v2:172.21.15.109:3300/0 conn(0x7fbf300af220 msgr2=0x7fbf300b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:27.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf3601a700 1 --2- 172.21.15.62:0/3141857265 >> v2:172.21.15.109:3300/0 conn(0x7fbf300af220 0x7fbf300b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf3601a700 1 -- 172.21.15.62:0/3141857265 >> v1:172.21.15.62:6789/0 conn(0x7fbf300b0830 legacy=0x7fbf30142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf3601a700 1 -- 172.21.15.62:0/3141857265 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf300aed80 con 0x7fbf300b6160 2021-12-17T18:23:27.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf3681b700 1 --2- 172.21.15.62:0/3141857265 >> v2:172.21.15.109:3300/0 conn(0x7fbf300af220 0x7fbf300b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:27.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.683+0000 7fbf3601a700 1 --2- 172.21.15.62:0/3141857265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf300b6160 0x7fbf30142690 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fbf2c002f70 tx=0x7fbf2c006df0).ready entity=mon.0 client_cookie=2b18dd68ae7d2936 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:27.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.687+0000 7fbf35018700 1 -- 172.21.15.62:0/3141857265 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf2c00d570 con 0x7fbf300b6160 2021-12-17T18:23:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.687+0000 7fbf35018700 1 -- 172.21.15.62:0/3141857265 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c000e90 con 0x7fbf300b6160 2021-12-17T18:23:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.687+0000 7fbf35018700 1 -- 172.21.15.62:0/3141857265 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf2c00d8c0 con 0x7fbf300b6160 2021-12-17T18:23:27.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.687+0000 7fbf3827e700 1 -- 172.21.15.62:0/3141857265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf300b6160 msgr2=0x7fbf30142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.687+0000 7fbf3827e700 1 --2- 172.21.15.62:0/3141857265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf300b6160 0x7fbf30142690 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fbf2c002f70 tx=0x7fbf2c006df0).stop 2021-12-17T18:23:27.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.687+0000 7fbf3827e700 1 -- 172.21.15.62:0/3141857265 shutdown_connections 2021-12-17T18:23:27.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.687+0000 7fbf3827e700 1 --2- 172.21.15.62:0/3141857265 >> v2:172.21.15.109:3300/0 conn(0x7fbf300af220 0x7fbf300b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.687+0000 7fbf3827e700 1 --2- 172.21.15.62:0/3141857265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf300b6160 0x7fbf30142690 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.687+0000 7fbf3827e700 1 -- 172.21.15.62:0/3141857265 >> 172.21.15.62:0/3141857265 conn(0x7fbf3005c750 msgr2=0x7fbf300630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:27.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.687+0000 7fbf3827e700 1 -- 172.21.15.62:0/3141857265 shutdown_connections 2021-12-17T18:23:27.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.687+0000 7fbf3827e700 1 -- 172.21.15.62:0/3141857265 wait complete. 2021-12-17T18:23:27.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf3827e700 1 Processor -- start 2021-12-17T18:23:27.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf3827e700 1 -- start start 2021-12-17T18:23:27.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf3827e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbf300af220 0x7fbf30142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf3827e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf300b0830 0x7fbf3013acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf3827e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbf300b6160 0x7fbf3013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf3827e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf301535b0 con 0x7fbf300b0830 2021-12-17T18:23:27.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf3827e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30145f40 con 0x7fbf300af220 2021-12-17T18:23:27.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf3827e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3013b690 con 0x7fbf300b6160 2021-12-17T18:23:27.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf35819700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf300b0830 0x7fbf3013acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf35819700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf300b0830 0x7fbf3013acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51454/0 (socket says 172.21.15.62:51454) 2021-12-17T18:23:27.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf35819700 1 -- 172.21.15.62:0/1598404144 learned_addr learned my addr 172.21.15.62:0/1598404144 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:27.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf3681b700 1 --2- 172.21.15.62:0/1598404144 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbf300b6160 0x7fbf3013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf3601a700 1 --2- 172.21.15.62:0/1598404144 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbf300af220 0x7fbf30142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf35819700 1 -- 172.21.15.62:0/1598404144 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbf300b6160 msgr2=0x7fbf3013b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf35819700 1 --2- 172.21.15.62:0/1598404144 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbf300b6160 0x7fbf3013b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf35819700 1 -- 172.21.15.62:0/1598404144 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbf300af220 msgr2=0x7fbf30142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf35819700 1 --2- 172.21.15.62:0/1598404144 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbf300af220 0x7fbf30142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf35819700 1 -- 172.21.15.62:0/1598404144 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c00b180 con 0x7fbf300b0830 2021-12-17T18:23:27.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf35819700 1 --2- 172.21.15.62:0/1598404144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf300b0830 0x7fbf3013acb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fbf3013ff00 tx=0x7fbf20007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:27.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf1f7fe700 1 -- 172.21.15.62:0/1598404144 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf200072e0 con 0x7fbf300b0830 2021-12-17T18:23:27.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf1f7fe700 1 -- 172.21.15.62:0/1598404144 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf20007440 con 0x7fbf300b0830 2021-12-17T18:23:27.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf3827e700 1 -- 172.21.15.62:0/1598404144 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf30146170 con 0x7fbf300b0830 2021-12-17T18:23:27.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf1f7fe700 1 -- 172.21.15.62:0/1598404144 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf20005800 con 0x7fbf300b0830 2021-12-17T18:23:27.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.691+0000 7fbf3827e700 1 -- 172.21.15.62:0/1598404144 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf30146f70 con 0x7fbf300b0830 2021-12-17T18:23:27.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.695+0000 7fbf3827e700 1 -- 172.21.15.62:0/1598404144 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf30155b40 con 0x7fbf300b0830 2021-12-17T18:23:27.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.695+0000 7fbf1f7fe700 1 -- 172.21.15.62:0/1598404144 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbf20010070 con 0x7fbf300b0830 2021-12-17T18:23:27.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.695+0000 7fbf1f7fe700 1 --2- 172.21.15.62:0/1598404144 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbf10053610 0x7fbf10055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.695+0000 7fbf1f7fe700 1 -- 172.21.15.62:0/1598404144 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbf2006b150 con 0x7fbf300b0830 2021-12-17T18:23:27.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.695+0000 7fbf3601a700 1 --2- 172.21.15.62:0/1598404144 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbf10053610 0x7fbf10055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.695+0000 7fbf3601a700 1 --2- 172.21.15.62:0/1598404144 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbf10053610 0x7fbf10055ad0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fbf2c018000 tx=0x7fbf2c014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:27.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.703+0000 7fbf1f7fe700 1 -- 172.21.15.62:0/1598404144 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbf20042210 con 0x7fbf300b0830 2021-12-17T18:23:27.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.831+0000 7fbf3827e700 1 -- 172.21.15.62:0/1598404144 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf3005bed0 con 0x7fbf300b0830 2021-12-17T18:23:27.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.831+0000 7fbf1f7fe700 1 -- 172.21.15.62:0/1598404144 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16102 (secure 0 0 0) 0x7fbf20018020 con 0x7fbf300b0830 2021-12-17T18:23:27.839 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:27.839 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":60,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:23:27.562038+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:23:25.381154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-12-17T18:23:26.577198+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:23:27.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.835+0000 7fbf3827e700 1 -- 172.21.15.62:0/1598404144 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbf10053610 msgr2=0x7fbf10055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.835+0000 7fbf3827e700 1 --2- 172.21.15.62:0/1598404144 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbf10053610 0x7fbf10055ad0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fbf2c018000 tx=0x7fbf2c014000).stop 2021-12-17T18:23:27.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.835+0000 7fbf3827e700 1 -- 172.21.15.62:0/1598404144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf300b0830 msgr2=0x7fbf3013acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.835+0000 7fbf3827e700 1 --2- 172.21.15.62:0/1598404144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf300b0830 0x7fbf3013acb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fbf3013ff00 tx=0x7fbf20007ad0).stop 2021-12-17T18:23:27.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.835+0000 7fbf3827e700 1 -- 172.21.15.62:0/1598404144 shutdown_connections 2021-12-17T18:23:27.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.835+0000 7fbf3827e700 1 --2- 172.21.15.62:0/1598404144 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbf10053610 0x7fbf10055ad0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.835+0000 7fbf3827e700 1 --2- 172.21.15.62:0/1598404144 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbf300b6160 0x7fbf3013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.835+0000 7fbf3827e700 1 --2- 172.21.15.62:0/1598404144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf300b0830 0x7fbf3013acb0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.835+0000 7fbf3827e700 1 --2- 172.21.15.62:0/1598404144 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbf300af220 0x7fbf30142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.835+0000 7fbf3827e700 1 -- 172.21.15.62:0/1598404144 >> 172.21.15.62:0/1598404144 conn(0x7fbf3005c750 msgr2=0x7fbf30143e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:27.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.835+0000 7fbf3827e700 1 -- 172.21.15.62:0/1598404144 shutdown_connections 2021-12-17T18:23:27.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.835+0000 7fbf3827e700 1 -- 172.21.15.62:0/1598404144 wait complete. 2021-12-17T18:23:27.853 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:23:27.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa71bf5700 1 Processor -- start 2021-12-17T18:23:27.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa71bf5700 1 -- start start 2021-12-17T18:23:27.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa71bf5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faa6c0b21f0 0x7faa6c14aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa71bf5700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7faa6c0b1730 0x7faa6c0ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa71bf5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faa6c0a7bb0 0x7faa6c067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa71bf5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa6c147870 con 0x7faa6c0a7bb0 2021-12-17T18:23:27.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa71bf5700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa6c0b2ce0 con 0x7faa6c0b1730 2021-12-17T18:23:27.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa71bf5700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c0aca60 con 0x7faa6c0b21f0 2021-12-17T18:23:27.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa6bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faa6c0a7bb0 0x7faa6c067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa6bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faa6c0a7bb0 0x7faa6c067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51462/0 (socket says 172.21.15.62:51462) 2021-12-17T18:23:27.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa6bfff700 1 -- 172.21.15.62:0/2355621199 learned_addr learned my addr 172.21.15.62:0/2355621199 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:27.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa6affd700 1 --2- 172.21.15.62:0/2355621199 >> v2:172.21.15.109:3300/0 conn(0x7faa6c0b1730 0x7faa6c0ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa6b7fe700 1 --2- 172.21.15.62:0/2355621199 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faa6c0b21f0 0x7faa6c14aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa6bfff700 1 -- 172.21.15.62:0/2355621199 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faa6c0b21f0 msgr2=0x7faa6c14aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:27.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa6bfff700 1 --2- 172.21.15.62:0/2355621199 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faa6c0b21f0 0x7faa6c14aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa6bfff700 1 -- 172.21.15.62:0/2355621199 >> v2:172.21.15.109:3300/0 conn(0x7faa6c0b1730 msgr2=0x7faa6c0ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:27.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa6bfff700 1 --2- 172.21.15.62:0/2355621199 >> v2:172.21.15.109:3300/0 conn(0x7faa6c0b1730 0x7faa6c0ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa6bfff700 1 -- 172.21.15.62:0/2355621199 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c0b2f10 con 0x7faa6c0a7bb0 2021-12-17T18:23:27.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa6bfff700 1 --2- 172.21.15.62:0/2355621199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c0a7bb0 0x7faa6c067120 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7faa640032f0 tx=0x7faa64009290).ready entity=mon.0 client_cookie=3169a19ed63dcaf2 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:27.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa6a7fc700 1 -- 172.21.15.62:0/2355621199 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6400b870 con 0x7faa6c0a7bb0 2021-12-17T18:23:27.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa6a7fc700 1 -- 172.21.15.62:0/2355621199 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6400b9d0 con 0x7faa6c0a7bb0 2021-12-17T18:23:27.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa6a7fc700 1 -- 172.21.15.62:0/2355621199 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6400bb40 con 0x7faa6c0a7bb0 2021-12-17T18:23:27.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa71bf5700 1 -- 172.21.15.62:0/2355621199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c0a7bb0 msgr2=0x7faa6c067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa71bf5700 1 --2- 172.21.15.62:0/2355621199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c0a7bb0 0x7faa6c067120 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7faa640032f0 tx=0x7faa64009290).stop 2021-12-17T18:23:27.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa71bf5700 1 -- 172.21.15.62:0/2355621199 shutdown_connections 2021-12-17T18:23:27.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa71bf5700 1 --2- 172.21.15.62:0/2355621199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c0a7bb0 0x7faa6c067120 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa71bf5700 1 --2- 172.21.15.62:0/2355621199 >> v2:172.21.15.109:3300/0 conn(0x7faa6c0b1730 0x7faa6c0ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa71bf5700 1 --2- 172.21.15.62:0/2355621199 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faa6c0b21f0 0x7faa6c14aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa71bf5700 1 -- 172.21.15.62:0/2355621199 >> 172.21.15.62:0/2355621199 conn(0x7faa6c05f730 msgr2=0x7faa6c05fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:27.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa71bf5700 1 -- 172.21.15.62:0/2355621199 shutdown_connections 2021-12-17T18:23:27.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.947+0000 7faa71bf5700 1 -- 172.21.15.62:0/2355621199 wait complete. 2021-12-17T18:23:27.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa71bf5700 1 Processor -- start 2021-12-17T18:23:27.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa71bf5700 1 -- start start 2021-12-17T18:23:27.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa71bf5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c0a7bb0 0x7faa6c0aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa71bf5700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faa6c0b1730 0x7faa6c14bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa71bf5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faa6c0b21f0 0x7faa6c157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa71bf5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c156ca0 con 0x7faa6c0a7bb0 2021-12-17T18:23:27.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa71bf5700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c14c1c0 con 0x7faa6c0b1730 2021-12-17T18:23:27.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa71bf5700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c14c450 con 0x7faa6c0b21f0 2021-12-17T18:23:27.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa6b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c0a7bb0 0x7faa6c0aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa6b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c0a7bb0 0x7faa6c0aa7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51466/0 (socket says 172.21.15.62:51466) 2021-12-17T18:23:27.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa6b7fe700 1 -- 172.21.15.62:0/1660068250 learned_addr learned my addr 172.21.15.62:0/1660068250 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:27.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa6affd700 1 --2- 172.21.15.62:0/1660068250 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faa6c0b1730 0x7faa6c14bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa6bfff700 1 --2- 172.21.15.62:0/1660068250 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faa6c0b21f0 0x7faa6c157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa6b7fe700 1 -- 172.21.15.62:0/1660068250 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faa6c0b21f0 msgr2=0x7faa6c157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa6b7fe700 1 --2- 172.21.15.62:0/1660068250 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faa6c0b21f0 0x7faa6c157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa6b7fe700 1 -- 172.21.15.62:0/1660068250 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faa6c0b1730 msgr2=0x7faa6c14bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:27.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa6b7fe700 1 --2- 172.21.15.62:0/1660068250 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faa6c0b1730 0x7faa6c14bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:27.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa6b7fe700 1 -- 172.21.15.62:0/1660068250 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa64009530 con 0x7faa6c0a7bb0 2021-12-17T18:23:27.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa6b7fe700 1 --2- 172.21.15.62:0/1660068250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c0a7bb0 0x7faa6c0aa7d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7faa5c00a000 tx=0x7faa5c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:27.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa68ff9700 1 -- 172.21.15.62:0/1660068250 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa5c011780 con 0x7faa6c0a7bb0 2021-12-17T18:23:27.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa68ff9700 1 -- 172.21.15.62:0/1660068250 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5c0118e0 con 0x7faa6c0a7bb0 2021-12-17T18:23:27.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa68ff9700 1 -- 172.21.15.62:0/1660068250 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa5c011c40 con 0x7faa6c0a7bb0 2021-12-17T18:23:27.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa71bf5700 1 -- 172.21.15.62:0/1660068250 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6c14c6f0 con 0x7faa6c0a7bb0 2021-12-17T18:23:27.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.951+0000 7faa71bf5700 1 -- 172.21.15.62:0/1660068250 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6c063e20 con 0x7faa6c0a7bb0 2021-12-17T18:23:27.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.955+0000 7faa68ff9700 1 -- 172.21.15.62:0/1660068250 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faa5c01c460 con 0x7faa6c0a7bb0 2021-12-17T18:23:27.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.955+0000 7faa71bf5700 1 -- 172.21.15.62:0/1660068250 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6c0573d0 con 0x7faa6c0a7bb0 2021-12-17T18:23:27.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.955+0000 7faa68ff9700 1 --2- 172.21.15.62:0/1660068250 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faa4c0536d0 0x7faa4c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:27.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.955+0000 7faa68ff9700 1 -- 172.21.15.62:0/1660068250 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faa5c06bc70 con 0x7faa6c0a7bb0 2021-12-17T18:23:27.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.955+0000 7faa6affd700 1 --2- 172.21.15.62:0/1660068250 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faa4c0536d0 0x7faa4c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:27.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.955+0000 7faa6affd700 1 --2- 172.21.15.62:0/1660068250 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faa4c0536d0 0x7faa4c055b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7faa6000c000 tx=0x7faa60008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:27.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:27.959+0000 7faa68ff9700 1 -- 172.21.15.62:0/1660068250 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faa5c042d70 con 0x7faa6c0a7bb0 2021-12-17T18:23:28.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.091+0000 7faa71bf5700 1 -- 172.21.15.62:0/1660068250 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa6c0af860 con 0x7faa6c0a7bb0 2021-12-17T18:23:28.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.091+0000 7faa68ff9700 1 -- 172.21.15.62:0/1660068250 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16102 (secure 0 0 0) 0x7faa5c046390 con 0x7faa6c0a7bb0 2021-12-17T18:23:28.097 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:28.097 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":60,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:23:27.562038+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:23:25.381154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-12-17T18:23:26.577198+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:23:28.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.095+0000 7faa71bf5700 1 -- 172.21.15.62:0/1660068250 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faa4c0536d0 msgr2=0x7faa4c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:28.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.095+0000 7faa71bf5700 1 --2- 172.21.15.62:0/1660068250 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faa4c0536d0 0x7faa4c055b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7faa6000c000 tx=0x7faa60008040).stop 2021-12-17T18:23:28.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.095+0000 7faa71bf5700 1 -- 172.21.15.62:0/1660068250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c0a7bb0 msgr2=0x7faa6c0aa7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:28.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.095+0000 7faa71bf5700 1 --2- 172.21.15.62:0/1660068250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c0a7bb0 0x7faa6c0aa7d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7faa5c00a000 tx=0x7faa5c008040).stop 2021-12-17T18:23:28.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.095+0000 7faa71bf5700 1 -- 172.21.15.62:0/1660068250 shutdown_connections 2021-12-17T18:23:28.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.095+0000 7faa71bf5700 1 --2- 172.21.15.62:0/1660068250 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faa4c0536d0 0x7faa4c055b90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:28.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.095+0000 7faa71bf5700 1 --2- 172.21.15.62:0/1660068250 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faa6c0b21f0 0x7faa6c157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:28.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.095+0000 7faa71bf5700 1 --2- 172.21.15.62:0/1660068250 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faa6c0b1730 0x7faa6c14bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:28.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.095+0000 7faa71bf5700 1 --2- 172.21.15.62:0/1660068250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c0a7bb0 0x7faa6c0aa7d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:28.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.095+0000 7faa71bf5700 1 -- 172.21.15.62:0/1660068250 >> 172.21.15.62:0/1660068250 conn(0x7faa6c05f730 msgr2=0x7faa6c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:28.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.095+0000 7faa71bf5700 1 -- 172.21.15.62:0/1660068250 shutdown_connections 2021-12-17T18:23:28.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.095+0000 7faa71bf5700 1 -- 172.21.15.62:0/1660068250 wait complete. 2021-12-17T18:23:28.116 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-12-17T18:23:28.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdd0770700 1 Processor -- start 2021-12-17T18:23:28.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdd0770700 1 -- start start 2021-12-17T18:23:28.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdd0770700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbdc80b0130 0x7fbdc805fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:28.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdd0770700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc80b5ad0 con 0x7fbdc80601a0 2021-12-17T18:23:28.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdd0770700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc80b0750 con 0x7fbdc80b56f0 2021-12-17T18:23:28.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdd0770700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc8144380 con 0x7fbdc80b0130 2021-12-17T18:23:28.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdcdd0b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbdc80b0130 0x7fbdc805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:28.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdced0d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbdc80601a0 0x7fbdc81432d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35056/0 (socket says 172.21.15.62:35056) 2021-12-17T18:23:28.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdced0d700 1 -- 172.21.15.62:0/763575871 learned_addr learned my addr 172.21.15.62:0/763575871 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:28.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdcd50a700 1 -- 172.21.15.62:0/763575871 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471936429 0 0) 0x7fbdc80b5ad0 con 0x7fbdc80601a0 2021-12-17T18:23:28.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdcd50a700 1 -- 172.21.15.62:0/763575871 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdb0003260 con 0x7fbdc80601a0 2021-12-17T18:23:28.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdcd50a700 1 -- 172.21.15.62:0/763575871 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044572432 0 0) 0x7fbdc80b0750 con 0x7fbdc80b56f0 2021-12-17T18:23:28.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdcd50a700 1 -- 172.21.15.62:0/763575871 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdc80b5ad0 con 0x7fbdc80b56f0 2021-12-17T18:23:28.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdcdd0b700 1 -- 172.21.15.62:0/763575871 >> v1:172.21.15.109:6789/0 conn(0x7fbdc80b56f0 legacy=0x7fbdc8063600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:28.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdcdd0b700 1 -- 172.21.15.62:0/763575871 >> v1:172.21.15.62:6789/0 conn(0x7fbdc80601a0 legacy=0x7fbdc81432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:28.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdcdd0b700 1 -- 172.21.15.62:0/763575871 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc80b09f0 con 0x7fbdc80b0130 2021-12-17T18:23:28.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdcdd0b700 1 --2- 172.21.15.62:0/763575871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdc80b0130 0x7fbdc805fcb0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fbdc80621c0 tx=0x7fbdb8006df0).ready entity=mon.0 client_cookie=54af3d6e27186942 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:28.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdcd50a700 1 -- 172.21.15.62:0/763575871 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdb800d610 con 0x7fbdc80b0130 2021-12-17T18:23:28.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdcd50a700 1 -- 172.21.15.62:0/763575871 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb8000e90 con 0x7fbdc80b0130 2021-12-17T18:23:28.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.219+0000 7fbdcd50a700 1 -- 172.21.15.62:0/763575871 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdb800d960 con 0x7fbdc80b0130 2021-12-17T18:23:28.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdd0770700 1 -- 172.21.15.62:0/763575871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdc80b0130 msgr2=0x7fbdc805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:28.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdd0770700 1 --2- 172.21.15.62:0/763575871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdc80b0130 0x7fbdc805fcb0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fbdc80621c0 tx=0x7fbdb8006df0).stop 2021-12-17T18:23:28.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdd0770700 1 -- 172.21.15.62:0/763575871 shutdown_connections 2021-12-17T18:23:28.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdd0770700 1 --2- 172.21.15.62:0/763575871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdc80b0130 0x7fbdc805fcb0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:28.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdd0770700 1 -- 172.21.15.62:0/763575871 >> 172.21.15.62:0/763575871 conn(0x7fbdc805c750 msgr2=0x7fbdc805cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:28.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdd0770700 1 -- 172.21.15.62:0/763575871 shutdown_connections 2021-12-17T18:23:28.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdd0770700 1 -- 172.21.15.62:0/763575871 wait complete. 2021-12-17T18:23:28.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdd0770700 1 Processor -- start 2021-12-17T18:23:28.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdd0770700 1 -- start start 2021-12-17T18:23:28.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdd0770700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbdc80601a0 0x7fbdc81468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:28.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdd0770700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbdc80b0130 0x7fbdc81412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:28.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdd0770700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdc80b56f0 0x7fbdc81417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:28.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdd0770700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc8156bb0 con 0x7fbdc80b56f0 2021-12-17T18:23:28.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdd0770700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc80a58c0 con 0x7fbdc80601a0 2021-12-17T18:23:28.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdd0770700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc8155c10 con 0x7fbdc80b0130 2021-12-17T18:23:28.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdced0d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdc80b56f0 0x7fbdc81417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:28.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdced0d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdc80b56f0 0x7fbdc81417a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51484/0 (socket says 172.21.15.62:51484) 2021-12-17T18:23:28.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.223+0000 7fbdced0d700 1 -- 172.21.15.62:0/2682811640 learned_addr learned my addr 172.21.15.62:0/2682811640 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:28.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.227+0000 7fbdce50c700 1 --2- 172.21.15.62:0/2682811640 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbdc80601a0 0x7fbdc81468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:28.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.227+0000 7fbdcdd0b700 1 --2- 172.21.15.62:0/2682811640 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbdc80b0130 0x7fbdc81412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:28.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.227+0000 7fbdced0d700 1 -- 172.21.15.62:0/2682811640 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbdc80b0130 msgr2=0x7fbdc81412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:28.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.227+0000 7fbdced0d700 1 --2- 172.21.15.62:0/2682811640 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbdc80b0130 0x7fbdc81412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:28.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.227+0000 7fbdced0d700 1 -- 172.21.15.62:0/2682811640 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbdc80601a0 msgr2=0x7fbdc81468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:28.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.227+0000 7fbdced0d700 1 --2- 172.21.15.62:0/2682811640 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbdc80601a0 0x7fbdc81468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:28.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.227+0000 7fbdced0d700 1 -- 172.21.15.62:0/2682811640 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb800b180 con 0x7fbdc80b56f0 2021-12-17T18:23:28.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.227+0000 7fbdced0d700 1 --2- 172.21.15.62:0/2682811640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdc80b56f0 0x7fbdc81417a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fbdc0001490 tx=0x7fbdc0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:28.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.227+0000 7fbdb77fe700 1 -- 172.21.15.62:0/2682811640 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdc0005d40 con 0x7fbdc80b56f0 2021-12-17T18:23:28.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.227+0000 7fbdb77fe700 1 -- 172.21.15.62:0/2682811640 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc00070d0 con 0x7fbdc80b56f0 2021-12-17T18:23:28.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.227+0000 7fbdd0770700 1 -- 172.21.15.62:0/2682811640 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc80a3600 con 0x7fbdc80b56f0 2021-12-17T18:23:28.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.227+0000 7fbdb77fe700 1 -- 172.21.15.62:0/2682811640 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdc0005ea0 con 0x7fbdc80b56f0 2021-12-17T18:23:28.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.227+0000 7fbdd0770700 1 -- 172.21.15.62:0/2682811640 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc80a32f0 con 0x7fbdc80b56f0 2021-12-17T18:23:28.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.227+0000 7fbdd0770700 1 -- 172.21.15.62:0/2682811640 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc8145010 con 0x7fbdc80b56f0 2021-12-17T18:23:28.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.227+0000 7fbdb77fe700 1 -- 172.21.15.62:0/2682811640 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbdc001a060 con 0x7fbdc80b56f0 2021-12-17T18:23:28.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.231+0000 7fbdb77fe700 1 --2- 172.21.15.62:0/2682811640 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbda80534f0 0x7fbda80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:28.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.231+0000 7fbdb77fe700 1 -- 172.21.15.62:0/2682811640 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbdc006b160 con 0x7fbdc80b56f0 2021-12-17T18:23:28.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.231+0000 7fbdce50c700 1 --2- 172.21.15.62:0/2682811640 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbda80534f0 0x7fbda80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:28.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.231+0000 7fbdce50c700 1 --2- 172.21.15.62:0/2682811640 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbda80534f0 0x7fbda80559b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fbdc400d000 tx=0x7fbdc4007a20).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:28.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.235+0000 7fbdb77fe700 1 -- 172.21.15.62:0/2682811640 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbdc00421b0 con 0x7fbdc80b56f0 2021-12-17T18:23:28.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:28.395+0000 7fbdd0770700 1 -- 172.21.15.62:0/2682811640 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbdc80573d0 con 0x7fbdc80b56f0 2021-12-17T18:23:29.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2021-12-17T18:23:29.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.271+0000 7fbdb77fe700 1 -- 172.21.15.62:0/2682811640 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbdc0018020 con 0x7fbdc80b56f0 2021-12-17T18:23:29.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.275+0000 7fbdd0770700 1 -- 172.21.15.62:0/2682811640 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbda80534f0 msgr2=0x7fbda80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:29.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.275+0000 7fbdd0770700 1 --2- 172.21.15.62:0/2682811640 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbda80534f0 0x7fbda80559b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fbdc400d000 tx=0x7fbdc4007a20).stop 2021-12-17T18:23:29.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.275+0000 7fbdd0770700 1 -- 172.21.15.62:0/2682811640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdc80b56f0 msgr2=0x7fbdc81417a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:29.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.275+0000 7fbdd0770700 1 --2- 172.21.15.62:0/2682811640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdc80b56f0 0x7fbdc81417a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fbdc0001490 tx=0x7fbdc0007e00).stop 2021-12-17T18:23:29.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.275+0000 7fbdd0770700 1 -- 172.21.15.62:0/2682811640 shutdown_connections 2021-12-17T18:23:29.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.275+0000 7fbdd0770700 1 --2- 172.21.15.62:0/2682811640 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbda80534f0 0x7fbda80559b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.275+0000 7fbdd0770700 1 --2- 172.21.15.62:0/2682811640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdc80b56f0 0x7fbdc81417a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.275+0000 7fbdd0770700 1 --2- 172.21.15.62:0/2682811640 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbdc80b0130 0x7fbdc81412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.275+0000 7fbdd0770700 1 --2- 172.21.15.62:0/2682811640 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbdc80601a0 0x7fbdc81468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.275+0000 7fbdd0770700 1 -- 172.21.15.62:0/2682811640 >> 172.21.15.62:0/2682811640 conn(0x7fbdc805c750 msgr2=0x7fbdc8141dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:29.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.275+0000 7fbdd0770700 1 -- 172.21.15.62:0/2682811640 shutdown_connections 2021-12-17T18:23:29.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.275+0000 7fbdd0770700 1 -- 172.21.15.62:0/2682811640 wait complete. 2021-12-17T18:23:29.295 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:23:29.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.399+0000 7fd0e6da0700 1 Processor -- start 2021-12-17T18:23:29.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.399+0000 7fd0e6da0700 1 -- start start 2021-12-17T18:23:29.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.399+0000 7fd0e6da0700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd0e00b3760 0x7fd0e00b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:29.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.399+0000 7fd0e6da0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd0e01458d0 0x7fd0e0145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:29.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.399+0000 7fd0e6da0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e00b5f00 con 0x7fd0e00b5b20 2021-12-17T18:23:29.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.399+0000 7fd0e6da0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e00b3020 con 0x7fd0e01458d0 2021-12-17T18:23:29.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.399+0000 7fd0e6da0700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e00b32c0 con 0x7fd0e00b3760 2021-12-17T18:23:29.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.399+0000 7fd0e5d9e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd0e00b5b20 0x7fd0e00b6290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35068/0 (socket says 172.21.15.62:35068) 2021-12-17T18:23:29.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.399+0000 7fd0e5d9e700 1 -- 172.21.15.62:0/486694680 learned_addr learned my addr 172.21.15.62:0/486694680 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:29.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.399+0000 7fd0e659f700 1 --2- 172.21.15.62:0/486694680 >> v2:172.21.15.62:3300/0 conn(0x7fd0e01458d0 0x7fd0e0145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:29.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e559d700 1 --2- 172.21.15.62:0/486694680 >> v2:172.21.15.109:3300/0 conn(0x7fd0e00b3760 0x7fd0e00b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:29.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e4d9c700 1 -- 172.21.15.62:0/486694680 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190906112 0 0) 0x7fd0e00b5f00 con 0x7fd0e00b5b20 2021-12-17T18:23:29.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e4d9c700 1 -- 172.21.15.62:0/486694680 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0c8003260 con 0x7fd0e00b5b20 2021-12-17T18:23:29.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e659f700 1 -- 172.21.15.62:0/486694680 >> v2:172.21.15.109:3300/0 conn(0x7fd0e00b3760 msgr2=0x7fd0e00b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:29.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e659f700 1 --2- 172.21.15.62:0/486694680 >> v2:172.21.15.109:3300/0 conn(0x7fd0e00b3760 0x7fd0e00b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e659f700 1 -- 172.21.15.62:0/486694680 >> v1:172.21.15.62:6789/0 conn(0x7fd0e00b5b20 legacy=0x7fd0e00b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:29.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e659f700 1 -- 172.21.15.62:0/486694680 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e00b6e90 con 0x7fd0e01458d0 2021-12-17T18:23:29.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e659f700 1 --2- 172.21.15.62:0/486694680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0e01458d0 0x7fd0e0145cd0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fd0d80032f0 tx=0x7fd0d80091d0).ready entity=mon.0 client_cookie=844efb002947e142 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:29.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e4d9c700 1 -- 172.21.15.62:0/486694680 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0d800b600 con 0x7fd0e01458d0 2021-12-17T18:23:29.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e4d9c700 1 -- 172.21.15.62:0/486694680 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d800b760 con 0x7fd0e01458d0 2021-12-17T18:23:29.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e4d9c700 1 -- 172.21.15.62:0/486694680 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0d800b8d0 con 0x7fd0e01458d0 2021-12-17T18:23:29.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e6da0700 1 -- 172.21.15.62:0/486694680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0e01458d0 msgr2=0x7fd0e0145cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:29.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e6da0700 1 --2- 172.21.15.62:0/486694680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0e01458d0 0x7fd0e0145cd0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fd0d80032f0 tx=0x7fd0d80091d0).stop 2021-12-17T18:23:29.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e6da0700 1 -- 172.21.15.62:0/486694680 shutdown_connections 2021-12-17T18:23:29.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e6da0700 1 --2- 172.21.15.62:0/486694680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0e01458d0 0x7fd0e0145cd0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e6da0700 1 --2- 172.21.15.62:0/486694680 >> v2:172.21.15.109:3300/0 conn(0x7fd0e00b3760 0x7fd0e00b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e6da0700 1 -- 172.21.15.62:0/486694680 >> 172.21.15.62:0/486694680 conn(0x7fd0e005c750 msgr2=0x7fd0e005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:29.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e6da0700 1 -- 172.21.15.62:0/486694680 shutdown_connections 2021-12-17T18:23:29.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e6da0700 1 -- 172.21.15.62:0/486694680 wait complete. 2021-12-17T18:23:29.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e6da0700 1 Processor -- start 2021-12-17T18:23:29.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e6da0700 1 -- start start 2021-12-17T18:23:29.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e6da0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd0e00b5b20 0x7fd0e00b9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:29.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e6da0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0e01458d0 0x7fd0e0066650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:29.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e6da0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd0e00651d0 0x7fd0e0155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:29.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e6da0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e0065c70 con 0x7fd0e01458d0 2021-12-17T18:23:29.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e6da0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e0065f10 con 0x7fd0e00651d0 2021-12-17T18:23:29.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.403+0000 7fd0e6da0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e00661b0 con 0x7fd0e00b5b20 2021-12-17T18:23:29.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0e559d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0e01458d0 0x7fd0e0066650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:29.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0e559d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0e01458d0 0x7fd0e0066650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51496/0 (socket says 172.21.15.62:51496) 2021-12-17T18:23:29.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0e559d700 1 -- 172.21.15.62:0/4253731217 learned_addr learned my addr 172.21.15.62:0/4253731217 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:29.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0e5d9e700 1 --2- 172.21.15.62:0/4253731217 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd0e00b5b20 0x7fd0e00b9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:29.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0e659f700 1 --2- 172.21.15.62:0/4253731217 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd0e00651d0 0x7fd0e0155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:29.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0e5d9e700 1 -- 172.21.15.62:0/4253731217 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd0e00651d0 msgr2=0x7fd0e0155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:29.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0e5d9e700 1 --2- 172.21.15.62:0/4253731217 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd0e00651d0 0x7fd0e0155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0e5d9e700 1 -- 172.21.15.62:0/4253731217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0e01458d0 msgr2=0x7fd0e0066650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:29.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0e5d9e700 1 --2- 172.21.15.62:0/4253731217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0e01458d0 0x7fd0e0066650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0e5d9e700 1 -- 172.21.15.62:0/4253731217 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d8009470 con 0x7fd0e00b5b20 2021-12-17T18:23:29.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0e559d700 1 --2- 172.21.15.62:0/4253731217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0e01458d0 0x7fd0e0066650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:29.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0e5d9e700 1 --2- 172.21.15.62:0/4253731217 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd0e00b5b20 0x7fd0e00b9df0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fd0dc001110 tx=0x7fd0dc0079e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:29.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0ceffd700 1 -- 172.21.15.62:0/4253731217 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0dc00cdb0 con 0x7fd0e00b5b20 2021-12-17T18:23:29.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0ceffd700 1 -- 172.21.15.62:0/4253731217 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0dc0070d0 con 0x7fd0e00b5b20 2021-12-17T18:23:29.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0e6da0700 1 -- 172.21.15.62:0/4253731217 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e0064280 con 0x7fd0e00b5b20 2021-12-17T18:23:29.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0ceffd700 1 -- 172.21.15.62:0/4253731217 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0dc007430 con 0x7fd0e00b5b20 2021-12-17T18:23:29.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0e6da0700 1 -- 172.21.15.62:0/4253731217 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e0156300 con 0x7fd0e00b5b20 2021-12-17T18:23:29.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0e6da0700 1 -- 172.21.15.62:0/4253731217 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e0066370 con 0x7fd0e00b5b20 2021-12-17T18:23:29.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0ceffd700 1 -- 172.21.15.62:0/4253731217 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd0dc010070 con 0x7fd0e00b5b20 2021-12-17T18:23:29.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0ceffd700 1 --2- 172.21.15.62:0/4253731217 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd0c0053580 0x7fd0c0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:29.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0ceffd700 1 -- 172.21.15.62:0/4253731217 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd0dc06aed0 con 0x7fd0e00b5b20 2021-12-17T18:23:29.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.407+0000 7fd0e559d700 1 --2- 172.21.15.62:0/4253731217 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd0c0053580 0x7fd0c0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:29.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.411+0000 7fd0e559d700 1 --2- 172.21.15.62:0/4253731217 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd0c0053580 0x7fd0c0055a40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fd0d000b000 tx=0x7fd0d0006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:29.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.419+0000 7fd0ceffd700 1 -- 172.21.15.62:0/4253731217 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd0dc041f90 con 0x7fd0e00b5b20 2021-12-17T18:23:29.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.583+0000 7fd0e6da0700 1 -- 172.21.15.62:0/4253731217 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0e00b4d00 con 0x7fd0e00b5b20 2021-12-17T18:23:29.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.587+0000 7fd0ceffd700 1 -- 172.21.15.62:0/4253731217 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2143 (secure 0 0 0) 0x7fd0dc018070 con 0x7fd0e00b5b20 2021-12-17T18:23:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:29.592 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3727734226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3727734226},{"type":"v1","addr":"172.21.15.109:6835","nonce":3727734226}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:23:27.562422+0000","modified":"2021-12-17T18:23:29.262551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5991},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5991":{"gid":5991,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1885234343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1885234343},{"type":"v1","addr":"172.21.15.62:6833","nonce":1885234343}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-12-17T18:23:29.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.587+0000 7fd0e6da0700 1 -- 172.21.15.62:0/4253731217 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd0c0053580 msgr2=0x7fd0c0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:29.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.587+0000 7fd0e6da0700 1 --2- 172.21.15.62:0/4253731217 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd0c0053580 0x7fd0c0055a40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fd0d000b000 tx=0x7fd0d0006df0).stop 2021-12-17T18:23:29.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.587+0000 7fd0e6da0700 1 -- 172.21.15.62:0/4253731217 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd0e00b5b20 msgr2=0x7fd0e00b9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:29.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.587+0000 7fd0e6da0700 1 --2- 172.21.15.62:0/4253731217 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd0e00b5b20 0x7fd0e00b9df0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fd0dc001110 tx=0x7fd0dc0079e0).stop 2021-12-17T18:23:29.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.587+0000 7fd0e6da0700 1 -- 172.21.15.62:0/4253731217 shutdown_connections 2021-12-17T18:23:29.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.587+0000 7fd0e6da0700 1 --2- 172.21.15.62:0/4253731217 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd0c0053580 0x7fd0c0055a40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.587+0000 7fd0e6da0700 1 --2- 172.21.15.62:0/4253731217 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd0e00651d0 0x7fd0e0155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.587+0000 7fd0e6da0700 1 --2- 172.21.15.62:0/4253731217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0e01458d0 0x7fd0e0066650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.587+0000 7fd0e6da0700 1 --2- 172.21.15.62:0/4253731217 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd0e00b5b20 0x7fd0e00b9df0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.587+0000 7fd0e6da0700 1 -- 172.21.15.62:0/4253731217 >> 172.21.15.62:0/4253731217 conn(0x7fd0e005c750 msgr2=0x7fd0e00afae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:29.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.587+0000 7fd0e6da0700 1 -- 172.21.15.62:0/4253731217 shutdown_connections 2021-12-17T18:23:29.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.587+0000 7fd0e6da0700 1 -- 172.21.15.62:0/4253731217 wait complete. 2021-12-17T18:23:29.598 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 27 2021-12-17T18:23:29.605 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:23:29.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.703+0000 7fadfd37c700 1 Processor -- start 2021-12-17T18:23:29.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.703+0000 7fadfd37c700 1 -- start start 2021-12-17T18:23:29.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadfd37c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fadf80b5b20 0x7fadf80b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:29.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadfd37c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fadf80b3760 0x7fadf80b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:29.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadfd37c700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf80b5f00 con 0x7fadf80b6c70 2021-12-17T18:23:29.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadfd37c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf80b3020 con 0x7fadf80b5b20 2021-12-17T18:23:29.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadfd37c700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf80b32c0 con 0x7fadf80b3760 2021-12-17T18:23:29.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadf7fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fadf80b5b20 0x7fadf80b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:29.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadeffff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fadf80b3760 0x7fadf80b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:29.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadf7fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fadf80b5b20 0x7fadf80b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51504/0 (socket says 172.21.15.62:51504) 2021-12-17T18:23:29.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadf7fff700 1 -- 172.21.15.62:0/875668547 learned_addr learned my addr 172.21.15.62:0/875668547 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:29.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadf7fff700 1 -- 172.21.15.62:0/875668547 >> v2:172.21.15.109:3300/0 conn(0x7fadf80b3760 msgr2=0x7fadf80b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:29.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadf7fff700 1 --2- 172.21.15.62:0/875668547 >> v2:172.21.15.109:3300/0 conn(0x7fadf80b3760 0x7fadf80b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadf7fff700 1 -- 172.21.15.62:0/875668547 >> v1:172.21.15.109:6789/0 conn(0x7fadf80b6c70 legacy=0x7fadf8146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:29.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadf7fff700 1 -- 172.21.15.62:0/875668547 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf80b5440 con 0x7fadf80b5b20 2021-12-17T18:23:29.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadeffff700 1 --2- 172.21.15.62:0/875668547 >> v2:172.21.15.109:3300/0 conn(0x7fadf80b3760 0x7fadf80b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:29.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadf7fff700 1 --2- 172.21.15.62:0/875668547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadf80b5b20 0x7fadf80b6290 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fade8002f70 tx=0x7fade8006eb0).ready entity=mon.0 client_cookie=10104cff7c1d527c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:29.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadf77fe700 1 -- 172.21.15.62:0/875668547 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fade800d5c0 con 0x7fadf80b5b20 2021-12-17T18:23:29.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadf77fe700 1 -- 172.21.15.62:0/875668547 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade8000e90 con 0x7fadf80b5b20 2021-12-17T18:23:29.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadf77fe700 1 -- 172.21.15.62:0/875668547 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fade800d950 con 0x7fadf80b5b20 2021-12-17T18:23:29.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadfd37c700 1 -- 172.21.15.62:0/875668547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadf80b5b20 msgr2=0x7fadf80b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:29.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadfd37c700 1 --2- 172.21.15.62:0/875668547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadf80b5b20 0x7fadf80b6290 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fade8002f70 tx=0x7fade8006eb0).stop 2021-12-17T18:23:29.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadfd37c700 1 -- 172.21.15.62:0/875668547 shutdown_connections 2021-12-17T18:23:29.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadfd37c700 1 --2- 172.21.15.62:0/875668547 >> v2:172.21.15.109:3300/0 conn(0x7fadf80b3760 0x7fadf80b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadfd37c700 1 --2- 172.21.15.62:0/875668547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadf80b5b20 0x7fadf80b6290 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadfd37c700 1 -- 172.21.15.62:0/875668547 >> 172.21.15.62:0/875668547 conn(0x7fadf805c750 msgr2=0x7fadf805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:29.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadfd37c700 1 -- 172.21.15.62:0/875668547 shutdown_connections 2021-12-17T18:23:29.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.707+0000 7fadfd37c700 1 -- 172.21.15.62:0/875668547 wait complete. 2021-12-17T18:23:29.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.711+0000 7fadfd37c700 1 Processor -- start 2021-12-17T18:23:29.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.711+0000 7fadfd37c700 1 -- start start 2021-12-17T18:23:29.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.711+0000 7fadfd37c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fadf80b5b20 0x7fadf80af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:29.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.711+0000 7fadfd37c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fadf80b6c70 0x7fadf8152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:29.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.711+0000 7fadfd37c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadf8152f10 0x7fadf8155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:29.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.711+0000 7fadfd37c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf8152630 con 0x7fadf8152f10 2021-12-17T18:23:29.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.711+0000 7fadfd37c700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf8066380 con 0x7fadf80b6c70 2021-12-17T18:23:29.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.711+0000 7fadfd37c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf8066710 con 0x7fadf80b5b20 2021-12-17T18:23:29.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.711+0000 7fadfcb7b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadf8152f10 0x7fadf8155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:29.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.711+0000 7fadfcb7b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadf8152f10 0x7fadf8155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51512/0 (socket says 172.21.15.62:51512) 2021-12-17T18:23:29.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.711+0000 7fadf7fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fadf80b5b20 0x7fadf80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:29.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.715+0000 7fadfcb7b700 1 -- 172.21.15.62:0/1455279009 learned_addr learned my addr 172.21.15.62:0/1455279009 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:29.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.715+0000 7fadeffff700 1 --2- 172.21.15.62:0/1455279009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fadf80b6c70 0x7fadf8152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:29.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.715+0000 7fadfcb7b700 1 -- 172.21.15.62:0/1455279009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fadf80b5b20 msgr2=0x7fadf80af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:29.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.715+0000 7fadfcb7b700 1 --2- 172.21.15.62:0/1455279009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fadf80b5b20 0x7fadf80af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.715+0000 7fadfcb7b700 1 -- 172.21.15.62:0/1455279009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fadf80b6c70 msgr2=0x7fadf8152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:29.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.715+0000 7fadfcb7b700 1 --2- 172.21.15.62:0/1455279009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fadf80b6c70 0x7fadf8152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.715+0000 7fadfcb7b700 1 -- 172.21.15.62:0/1455279009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade000b180 con 0x7fadf8152f10 2021-12-17T18:23:29.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.715+0000 7fadfcb7b700 1 --2- 172.21.15.62:0/1455279009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadf8152f10 0x7fadf8155c00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fadf80b97b0 tx=0x7fadf0007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:29.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.715+0000 7fadf5ffb700 1 -- 172.21.15.62:0/1455279009 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadf000ce80 con 0x7fadf8152f10 2021-12-17T18:23:29.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.715+0000 7fadf5ffb700 1 -- 172.21.15.62:0/1455279009 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf000f470 con 0x7fadf8152f10 2021-12-17T18:23:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.715+0000 7fadfd37c700 1 -- 172.21.15.62:0/1455279009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade800b1e0 con 0x7fadf8152f10 2021-12-17T18:23:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.715+0000 7fadf5ffb700 1 -- 172.21.15.62:0/1455279009 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadf000f7d0 con 0x7fadf8152f10 2021-12-17T18:23:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.715+0000 7fadfd37c700 1 -- 172.21.15.62:0/1455279009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf8064490 con 0x7fadf8152f10 2021-12-17T18:23:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.715+0000 7fadfd37c700 1 -- 172.21.15.62:0/1455279009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf8066910 con 0x7fadf8152f10 2021-12-17T18:23:29.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.715+0000 7fadf5ffb700 1 -- 172.21.15.62:0/1455279009 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fadf0010070 con 0x7fadf8152f10 2021-12-17T18:23:29.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.719+0000 7fadf5ffb700 1 --2- 172.21.15.62:0/1455279009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faddc0536d0 0x7faddc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:29.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.719+0000 7fadf5ffb700 1 -- 172.21.15.62:0/1455279009 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fadf006ad40 con 0x7fadf8152f10 2021-12-17T18:23:29.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.719+0000 7fadf7fff700 1 --2- 172.21.15.62:0/1455279009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faddc0536d0 0x7faddc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:29.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.719+0000 7fadf7fff700 1 --2- 172.21.15.62:0/1455279009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faddc0536d0 0x7faddc055b90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fade801c000 tx=0x7fade8015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:29.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.723+0000 7fadf5ffb700 1 -- 172.21.15.62:0/1455279009 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fadf0041ea0 con 0x7fadf8152f10 2021-12-17T18:23:29.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.851+0000 7fadfd37c700 1 -- 172.21.15.62:0/1455279009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadf8066570 con 0x7fadf8152f10 2021-12-17T18:23:29.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.851+0000 7fadf5ffb700 1 -- 172.21.15.62:0/1455279009 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fadf8066570 con 0x7fadf8152f10 2021-12-17T18:23:29.858 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:29.858 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":62,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:23:29.574719+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:23:25.381154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-12-17T18:23:26.577198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:23:29.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.855+0000 7fadfd37c700 1 -- 172.21.15.62:0/1455279009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faddc0536d0 msgr2=0x7faddc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:29.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.855+0000 7fadfd37c700 1 --2- 172.21.15.62:0/1455279009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faddc0536d0 0x7faddc055b90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fade801c000 tx=0x7fade8015000).stop 2021-12-17T18:23:29.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.855+0000 7fadfd37c700 1 -- 172.21.15.62:0/1455279009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadf8152f10 msgr2=0x7fadf8155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:29.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.855+0000 7fadfd37c700 1 --2- 172.21.15.62:0/1455279009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadf8152f10 0x7fadf8155c00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fadf80b97b0 tx=0x7fadf0007f50).stop 2021-12-17T18:23:29.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.855+0000 7fadfd37c700 1 -- 172.21.15.62:0/1455279009 shutdown_connections 2021-12-17T18:23:29.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.855+0000 7fadfd37c700 1 --2- 172.21.15.62:0/1455279009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faddc0536d0 0x7faddc055b90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.855+0000 7fadfd37c700 1 --2- 172.21.15.62:0/1455279009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadf8152f10 0x7fadf8155c00 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.855+0000 7fadfd37c700 1 --2- 172.21.15.62:0/1455279009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fadf80b6c70 0x7fadf8152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.855+0000 7fadfd37c700 1 --2- 172.21.15.62:0/1455279009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fadf80b5b20 0x7fadf80af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.855+0000 7fadfd37c700 1 -- 172.21.15.62:0/1455279009 >> 172.21.15.62:0/1455279009 conn(0x7fadf805c750 msgr2=0x7fadf80b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:29.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.855+0000 7fadfd37c700 1 -- 172.21.15.62:0/1455279009 shutdown_connections 2021-12-17T18:23:29.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.855+0000 7fadfd37c700 1 -- 172.21.15.62:0/1455279009 wait complete. 2021-12-17T18:23:29.871 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:23:29.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.983+0000 7fdfd1b9d700 1 Processor -- start 2021-12-17T18:23:29.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.983+0000 7fdfd1b9d700 1 -- start start 2021-12-17T18:23:29.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.983+0000 7fdfd1b9d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fdfcc05ca90 0x7fdfcc0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:29.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.983+0000 7fdfd1b9d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdfcc0b34b0 0x7fdfcc145b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:29.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.983+0000 7fdfd1b9d700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfcc05ce70 con 0x7fdfcc0604b0 2021-12-17T18:23:29.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.983+0000 7fdfd1b9d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfcc0b2d70 con 0x7fdfcc05ca90 2021-12-17T18:23:29.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.983+0000 7fdfd1b9d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0b3010 con 0x7fdfcc0b34b0 2021-12-17T18:23:29.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.983+0000 7fdfcbfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdfcc0b34b0 0x7fdfcc145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:29.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.983+0000 7fdfd0b9b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fdfcc05ca90 0x7fdfcc0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:29.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.983+0000 7fdfcbfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdfcc0b34b0 0x7fdfcc145b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:45220/0 (socket says 172.21.15.62:45220) 2021-12-17T18:23:29.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.983+0000 7fdfcbfff700 1 -- 172.21.15.62:0/2633161962 learned_addr learned my addr 172.21.15.62:0/2633161962 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:29.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.983+0000 7fdfd139c700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7fdfcc0604b0 0x7fdfcc146010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:51418/0 (socket says 172.21.15.62:51418) 2021-12-17T18:23:29.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfd0b9b700 1 -- 172.21.15.62:0/2633161962 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdfcc0b34b0 msgr2=0x7fdfcc145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:29.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfd0b9b700 1 --2- 172.21.15.62:0/2633161962 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdfcc0b34b0 0x7fdfcc145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfd0b9b700 1 -- 172.21.15.62:0/2633161962 >> v1:172.21.15.109:6789/0 conn(0x7fdfcc0604b0 legacy=0x7fdfcc146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:29.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfcb7fe700 1 -- 172.21.15.62:0/2633161962 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653954542 0 0) 0x7fdfcc05ce70 con 0x7fdfcc0604b0 2021-12-17T18:23:29.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfd0b9b700 1 -- 172.21.15.62:0/2633161962 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc0b2ab0 con 0x7fdfcc05ca90 2021-12-17T18:23:29.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfcbfff700 1 --2- 172.21.15.62:0/2633161962 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdfcc0b34b0 0x7fdfcc145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:29.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfd0b9b700 1 --2- 172.21.15.62:0/2633161962 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdfcc05ca90 0x7fdfcc0b2470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fdfb4002f70 tx=0x7fdfb4006df0).ready entity=mon.1 client_cookie=a7f4587195e65ec7 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:29.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfcb7fe700 1 -- 172.21.15.62:0/2633161962 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb400d570 con 0x7fdfcc05ca90 2021-12-17T18:23:29.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfcb7fe700 1 -- 172.21.15.62:0/2633161962 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb4000e90 con 0x7fdfcc05ca90 2021-12-17T18:23:29.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfcb7fe700 1 -- 172.21.15.62:0/2633161962 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb400d8c0 con 0x7fdfcc05ca90 2021-12-17T18:23:29.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfd1b9d700 1 -- 172.21.15.62:0/2633161962 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdfcc05ca90 msgr2=0x7fdfcc0b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:29.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfd1b9d700 1 --2- 172.21.15.62:0/2633161962 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdfcc05ca90 0x7fdfcc0b2470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fdfb4002f70 tx=0x7fdfb4006df0).stop 2021-12-17T18:23:29.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfd1b9d700 1 -- 172.21.15.62:0/2633161962 shutdown_connections 2021-12-17T18:23:29.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfd1b9d700 1 --2- 172.21.15.62:0/2633161962 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdfcc0b34b0 0x7fdfcc145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfd1b9d700 1 --2- 172.21.15.62:0/2633161962 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdfcc05ca90 0x7fdfcc0b2470 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:29.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfd1b9d700 1 -- 172.21.15.62:0/2633161962 >> 172.21.15.62:0/2633161962 conn(0x7fdfcc05bcd0 msgr2=0x7fdfcc062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:29.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfd1b9d700 1 -- 172.21.15.62:0/2633161962 shutdown_connections 2021-12-17T18:23:29.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfd1b9d700 1 -- 172.21.15.62:0/2633161962 wait complete. 2021-12-17T18:23:29.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfd1b9d700 1 Processor -- start 2021-12-17T18:23:29.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.987+0000 7fdfd1b9d700 1 -- start start 2021-12-17T18:23:30.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfd1b9d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdfcc05ca90 0x7fdfcc066d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfd1b9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfcc0604b0 0x7fdfcc13c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfd1b9d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdfcc0b34b0 0x7fdfcc13ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfd1b9d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc13d310 con 0x7fdfcc0604b0 2021-12-17T18:23:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfd1b9d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc065ef0 con 0x7fdfcc05ca90 2021-12-17T18:23:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfd1b9d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc066190 con 0x7fdfcc0b34b0 2021-12-17T18:23:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfcbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfcc0604b0 0x7fdfcc13c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfcbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfcc0604b0 0x7fdfcc13c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51522/0 (socket says 172.21.15.62:51522) 2021-12-17T18:23:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfcbfff700 1 -- 172.21.15.62:0/1334557960 learned_addr learned my addr 172.21.15.62:0/1334557960 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfd0b9b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdfcc05ca90 0x7fdfcc066d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfd139c700 1 --2- 172.21.15.62:0/1334557960 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdfcc0b34b0 0x7fdfcc13ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfcbfff700 1 -- 172.21.15.62:0/1334557960 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdfcc0b34b0 msgr2=0x7fdfcc13ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfcbfff700 1 --2- 172.21.15.62:0/1334557960 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdfcc0b34b0 0x7fdfcc13ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfcbfff700 1 -- 172.21.15.62:0/1334557960 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdfcc05ca90 msgr2=0x7fdfcc066d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfcbfff700 1 --2- 172.21.15.62:0/1334557960 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdfcc05ca90 0x7fdfcc066d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfcbfff700 1 -- 172.21.15.62:0/1334557960 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc00b1e0 con 0x7fdfcc0604b0 2021-12-17T18:23:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfcbfff700 1 --2- 172.21.15.62:0/1334557960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfcc0604b0 0x7fdfcc13c930 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fdfbc00c000 tx=0x7fdfbc006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:30.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfc9ffb700 1 -- 172.21.15.62:0/1334557960 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfbc012600 con 0x7fdfcc0604b0 2021-12-17T18:23:30.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfc9ffb700 1 -- 172.21.15.62:0/1334557960 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc012760 con 0x7fdfcc0604b0 2021-12-17T18:23:30.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfd1b9d700 1 -- 172.21.15.62:0/1334557960 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb400b180 con 0x7fdfcc0604b0 2021-12-17T18:23:30.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfc9ffb700 1 -- 172.21.15.62:0/1334557960 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfbc012ac0 con 0x7fdfcc0604b0 2021-12-17T18:23:30.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfd1b9d700 1 -- 172.21.15.62:0/1334557960 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfcc065b70 con 0x7fdfcc0604b0 2021-12-17T18:23:30.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.991+0000 7fdfd1b9d700 1 -- 172.21.15.62:0/1334557960 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfcc0b4500 con 0x7fdfcc0604b0 2021-12-17T18:23:30.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.995+0000 7fdfc9ffb700 1 -- 172.21.15.62:0/1334557960 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdfbc022070 con 0x7fdfcc0604b0 2021-12-17T18:23:30.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.995+0000 7fdfc9ffb700 1 --2- 172.21.15.62:0/1334557960 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdfb00536a0 0x7fdfb0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.995+0000 7fdfc9ffb700 1 -- 172.21.15.62:0/1334557960 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdfbc06bdb0 con 0x7fdfcc0604b0 2021-12-17T18:23:30.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.995+0000 7fdfd0b9b700 1 --2- 172.21.15.62:0/1334557960 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdfb00536a0 0x7fdfb0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:29.995+0000 7fdfd0b9b700 1 --2- 172.21.15.62:0/1334557960 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdfb00536a0 0x7fdfb0055b60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fdfb401a000 tx=0x7fdfb4014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:30.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.007+0000 7fdfc9ffb700 1 -- 172.21.15.62:0/1334557960 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdfbc042e70 con 0x7fdfcc0604b0 2021-12-17T18:23:30.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.175+0000 7fdfd1b9d700 1 -- 172.21.15.62:0/1334557960 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fdfcc0573d0 con 0x7fdfcc0604b0 2021-12-17T18:23:30.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.183+0000 7fdfc9ffb700 1 -- 172.21.15.62:0/1334557960 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7fdfbc046490 con 0x7fdfcc0604b0 2021-12-17T18:23:30.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.183+0000 7fdfd1b9d700 1 -- 172.21.15.62:0/1334557960 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdfb00536a0 msgr2=0x7fdfb0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.183+0000 7fdfd1b9d700 1 --2- 172.21.15.62:0/1334557960 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdfb00536a0 0x7fdfb0055b60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fdfb401a000 tx=0x7fdfb4014000).stop 2021-12-17T18:23:30.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.183+0000 7fdfd1b9d700 1 -- 172.21.15.62:0/1334557960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfcc0604b0 msgr2=0x7fdfcc13c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.183+0000 7fdfd1b9d700 1 --2- 172.21.15.62:0/1334557960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfcc0604b0 0x7fdfcc13c930 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fdfbc00c000 tx=0x7fdfbc006eb0).stop 2021-12-17T18:23:30.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.187+0000 7fdfd1b9d700 1 -- 172.21.15.62:0/1334557960 shutdown_connections 2021-12-17T18:23:30.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.187+0000 7fdfd1b9d700 1 --2- 172.21.15.62:0/1334557960 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdfb00536a0 0x7fdfb0055b60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.187+0000 7fdfd1b9d700 1 --2- 172.21.15.62:0/1334557960 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdfcc0b34b0 0x7fdfcc13ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.187+0000 7fdfd1b9d700 1 --2- 172.21.15.62:0/1334557960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfcc0604b0 0x7fdfcc13c930 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.187+0000 7fdfd1b9d700 1 --2- 172.21.15.62:0/1334557960 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdfcc05ca90 0x7fdfcc066d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.187+0000 7fdfd1b9d700 1 -- 172.21.15.62:0/1334557960 >> 172.21.15.62:0/1334557960 conn(0x7fdfcc05bcd0 msgr2=0x7fdfcc146a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:30.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.187+0000 7fdfd1b9d700 1 -- 172.21.15.62:0/1334557960 shutdown_connections 2021-12-17T18:23:30.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.187+0000 7fdfd1b9d700 1 -- 172.21.15.62:0/1334557960 wait complete. 2021-12-17T18:23:30.194 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.0 2021-12-17T18:23:30.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:23:30.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.315+0000 7f286d721700 1 Processor -- start 2021-12-17T18:23:30.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.315+0000 7f286d721700 1 -- start start 2021-12-17T18:23:30.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.315+0000 7f286d721700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f28680604b0 0x7f28680b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.315+0000 7f286d721700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286805ce70 con 0x7f286805ca90 2021-12-17T18:23:30.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.315+0000 7f286d721700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28680b2d70 con 0x7f28680b34b0 2021-12-17T18:23:30.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.315+0000 7f286d721700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28680b3010 con 0x7f28680604b0 2021-12-17T18:23:30.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.315+0000 7f2867fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f286805ca90 0x7f2868145b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35110/0 (socket says 172.21.15.62:35110) 2021-12-17T18:23:30.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.315+0000 7f2867fff700 1 -- 172.21.15.62:0/1980976986 learned_addr learned my addr 172.21.15.62:0/1980976986 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:30.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.315+0000 7f286cf20700 1 --2- 172.21.15.62:0/1980976986 >> v2:172.21.15.109:3300/0 conn(0x7f28680604b0 0x7f28680b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.315+0000 7f28677fe700 1 -- 172.21.15.62:0/1980976986 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761035598 0 0) 0x7f286805ce70 con 0x7f286805ca90 2021-12-17T18:23:30.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.315+0000 7f28677fe700 1 -- 172.21.15.62:0/1980976986 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2848003260 con 0x7f286805ca90 2021-12-17T18:23:30.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.315+0000 7f286cf20700 1 -- 172.21.15.62:0/1980976986 >> v1:172.21.15.109:6789/0 conn(0x7f28680b34b0 legacy=0x7f28680b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.315+0000 7f286cf20700 1 -- 172.21.15.62:0/1980976986 >> v1:172.21.15.62:6789/0 conn(0x7f286805ca90 legacy=0x7f2868145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.315+0000 7f286cf20700 1 -- 172.21.15.62:0/1980976986 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28680b2ab0 con 0x7f28680604b0 2021-12-17T18:23:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.315+0000 7f286cf20700 1 --2- 172.21.15.62:0/1980976986 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28680604b0 0x7f28680b2470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f28600032f0 tx=0x7f28600091d0).ready entity=mon.1 client_cookie=4645c1b10248ded8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f28677fe700 1 -- 172.21.15.62:0/1980976986 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286000b6c0 con 0x7f28680604b0 2021-12-17T18:23:30.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f28677fe700 1 -- 172.21.15.62:0/1980976986 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286000b820 con 0x7f28680604b0 2021-12-17T18:23:30.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f28677fe700 1 -- 172.21.15.62:0/1980976986 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286000b990 con 0x7f28680604b0 2021-12-17T18:23:30.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f286d721700 1 -- 172.21.15.62:0/1980976986 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28680604b0 msgr2=0x7f28680b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f286d721700 1 --2- 172.21.15.62:0/1980976986 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28680604b0 0x7f28680b2470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f28600032f0 tx=0x7f28600091d0).stop 2021-12-17T18:23:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f286d721700 1 -- 172.21.15.62:0/1980976986 shutdown_connections 2021-12-17T18:23:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f286d721700 1 --2- 172.21.15.62:0/1980976986 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28680604b0 0x7f28680b2470 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f286d721700 1 -- 172.21.15.62:0/1980976986 >> 172.21.15.62:0/1980976986 conn(0x7f286805bcd0 msgr2=0x7f2868062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f286d721700 1 -- 172.21.15.62:0/1980976986 shutdown_connections 2021-12-17T18:23:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f286d721700 1 -- 172.21.15.62:0/1980976986 wait complete. 2021-12-17T18:23:30.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f286d721700 1 Processor -- start 2021-12-17T18:23:30.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f286d721700 1 -- start start 2021-12-17T18:23:30.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f286d721700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f286805ca90 0x7f2868066ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f286d721700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28680604b0 0x7f28680638d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f286d721700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28680b34b0 0x7f28681424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f286d721700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28680666a0 con 0x7f286805ca90 2021-12-17T18:23:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f286d721700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2868066940 con 0x7f28680b34b0 2021-12-17T18:23:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f286d721700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2868063dc0 con 0x7f28680604b0 2021-12-17T18:23:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f2867fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f286805ca90 0x7f2868066ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f2867fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f286805ca90 0x7f2868066ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51536/0 (socket says 172.21.15.62:51536) 2021-12-17T18:23:30.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f2867fff700 1 -- 172.21.15.62:0/2697808949 learned_addr learned my addr 172.21.15.62:0/2697808949 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:30.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f286cf20700 1 --2- 172.21.15.62:0/2697808949 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28680b34b0 0x7f28681424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f285f7fe700 1 --2- 172.21.15.62:0/2697808949 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28680604b0 0x7f28680638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f2867fff700 1 -- 172.21.15.62:0/2697808949 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28680604b0 msgr2=0x7f28680638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f2867fff700 1 --2- 172.21.15.62:0/2697808949 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28680604b0 0x7f28680638d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f2867fff700 1 -- 172.21.15.62:0/2697808949 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28680b34b0 msgr2=0x7f28681424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f2867fff700 1 --2- 172.21.15.62:0/2697808949 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28680b34b0 0x7f28681424d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f2867fff700 1 -- 172.21.15.62:0/2697808949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2860009470 con 0x7f286805ca90 2021-12-17T18:23:30.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.319+0000 7f2867fff700 1 --2- 172.21.15.62:0/2697808949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f286805ca90 0x7f2868066ff0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f2858001110 tx=0x7f2858007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:30.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.323+0000 7f2865ffb700 1 -- 172.21.15.62:0/2697808949 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28580070d0 con 0x7f286805ca90 2021-12-17T18:23:30.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.323+0000 7f2865ffb700 1 -- 172.21.15.62:0/2697808949 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2858007230 con 0x7f286805ca90 2021-12-17T18:23:30.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.323+0000 7f286d721700 1 -- 172.21.15.62:0/2697808949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2868066390 con 0x7f286805ca90 2021-12-17T18:23:30.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.323+0000 7f2865ffb700 1 -- 172.21.15.62:0/2697808949 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2858005610 con 0x7f286805ca90 2021-12-17T18:23:30.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.323+0000 7f286d721700 1 -- 172.21.15.62:0/2697808949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28681524c0 con 0x7f286805ca90 2021-12-17T18:23:30.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.323+0000 7f286d721700 1 -- 172.21.15.62:0/2697808949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28680a63e0 con 0x7f286805ca90 2021-12-17T18:23:30.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.323+0000 7f2865ffb700 1 -- 172.21.15.62:0/2697808949 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2858010070 con 0x7f286805ca90 2021-12-17T18:23:30.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.323+0000 7f2865ffb700 1 --2- 172.21.15.62:0/2697808949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f284c053610 0x7f284c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.323+0000 7f2865ffb700 1 -- 172.21.15.62:0/2697808949 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f285806b010 con 0x7f286805ca90 2021-12-17T18:23:30.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.323+0000 7f285f7fe700 1 --2- 172.21.15.62:0/2697808949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f284c053610 0x7f284c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.327+0000 7f285f7fe700 1 --2- 172.21.15.62:0/2697808949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f284c053610 0x7f284c055ad0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f285000d000 tx=0x7f2850007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:30.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.331+0000 7f2865ffb700 1 -- 172.21.15.62:0/2697808949 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f28680a63e0 con 0x7f286805ca90 2021-12-17T18:23:30.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.495+0000 7f286d721700 1 -- 172.21.15.62:0/2697808949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f28680a63e0 con 0x7f286805ca90 2021-12-17T18:23:30.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.503+0000 7f2865ffb700 1 -- 172.21.15.62:0/2697808949 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v21) v1 ==== 184+0+0 (secure 0 0 0) 0x7f28680a63e0 con 0x7f286805ca90 2021-12-17T18:23:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.503+0000 7f286d721700 1 -- 172.21.15.62:0/2697808949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f284c053610 msgr2=0x7f284c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.503+0000 7f286d721700 1 --2- 172.21.15.62:0/2697808949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f284c053610 0x7f284c055ad0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f285000d000 tx=0x7f2850007b90).stop 2021-12-17T18:23:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.503+0000 7f286d721700 1 -- 172.21.15.62:0/2697808949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f286805ca90 msgr2=0x7f2868066ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.503+0000 7f286d721700 1 --2- 172.21.15.62:0/2697808949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f286805ca90 0x7f2868066ff0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f2858001110 tx=0x7f2858007ad0).stop 2021-12-17T18:23:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.507+0000 7f286d721700 1 -- 172.21.15.62:0/2697808949 shutdown_connections 2021-12-17T18:23:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.507+0000 7f286d721700 1 --2- 172.21.15.62:0/2697808949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f284c053610 0x7f284c055ad0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.507+0000 7f286d721700 1 --2- 172.21.15.62:0/2697808949 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28680b34b0 0x7f28681424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.507+0000 7f286d721700 1 --2- 172.21.15.62:0/2697808949 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28680604b0 0x7f28680638d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.507+0000 7f286d721700 1 --2- 172.21.15.62:0/2697808949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f286805ca90 0x7f2868066ff0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.507+0000 7f286d721700 1 -- 172.21.15.62:0/2697808949 >> 172.21.15.62:0/2697808949 conn(0x7f286805bcd0 msgr2=0x7f2868143820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:30.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.507+0000 7f286d721700 1 -- 172.21.15.62:0/2697808949 shutdown_connections 2021-12-17T18:23:30.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.507+0000 7f286d721700 1 -- 172.21.15.62:0/2697808949 wait complete. 2021-12-17T18:23:30.514 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.1 2021-12-17T18:23:30.524 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:23:30.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.635+0000 7f2f6a0bc700 1 Processor -- start 2021-12-17T18:23:30.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.635+0000 7f2f6a0bc700 1 -- start start 2021-12-17T18:23:30.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.635+0000 7f2f6a0bc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f6405ca90 0x7f2f64065a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.635+0000 7f2f6a0bc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f2f64065f60 0x7f2f64144460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.635+0000 7f2f6a0bc700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f640ad430 con 0x7f2f64144950 2021-12-17T18:23:30.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.635+0000 7f2f6a0bc700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f640adba0 con 0x7f2f64065f60 2021-12-17T18:23:30.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.635+0000 7f2f6a0bc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f640ad660 con 0x7f2f6405ca90 2021-12-17T18:23:30.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.635+0000 7f2f698bb700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2f64144950 0x7f2f641401f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35128/0 (socket says 172.21.15.62:35128) 2021-12-17T18:23:30.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.635+0000 7f2f698bb700 1 -- 172.21.15.62:0/3986948771 learned_addr learned my addr 172.21.15.62:0/3986948771 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:30.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.635+0000 7f2f688b9700 1 --2- 172.21.15.62:0/3986948771 >> v2:172.21.15.109:3300/0 conn(0x7f2f64065f60 0x7f2f64144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.635+0000 7f2f690ba700 1 --2- 172.21.15.62:0/3986948771 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f6405ca90 0x7f2f64065a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 -- 172.21.15.62:0/3986948771 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403725616 0 0) 0x7f2f640ad430 con 0x7f2f64144950 2021-12-17T18:23:30.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 -- 172.21.15.62:0/3986948771 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f4c003260 con 0x7f2f64144950 2021-12-17T18:23:30.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 -- 172.21.15.62:0/3986948771 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4263565723 0 0) 0x7f2f4c003260 con 0x7f2f64144950 2021-12-17T18:23:30.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 -- 172.21.15.62:0/3986948771 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f6405ca90 msgr2=0x7f2f64065a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:30.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 --2- 172.21.15.62:0/3986948771 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f6405ca90 0x7f2f64065a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 -- 172.21.15.62:0/3986948771 >> v2:172.21.15.109:3300/0 conn(0x7f2f64065f60 msgr2=0x7f2f64144460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:30.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 --2- 172.21.15.62:0/3986948771 >> v2:172.21.15.109:3300/0 conn(0x7f2f64065f60 0x7f2f64144460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 -- 172.21.15.62:0/3986948771 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f640ad900 con 0x7f2f64144950 2021-12-17T18:23:30.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 -- 172.21.15.62:0/3986948771 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f2f5c0019e0 con 0x7f2f64144950 2021-12-17T18:23:30.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 -- 172.21.15.62:0/3986948771 >> v1:172.21.15.62:6789/0 conn(0x7f2f64144950 legacy=0x7f2f641401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 --2- 172.21.15.62:0/3986948771 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2f4c003750 0x7f2f4c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 --2- 172.21.15.62:0/3986948771 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f6405ca90 0x7f2f4c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 --2- 172.21.15.62:0/3986948771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f4c0049f0 0x7f2f4c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 -- 172.21.15.62:0/3986948771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f640adba0 con 0x7f2f4c0049f0 2021-12-17T18:23:30.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 -- 172.21.15.62:0/3986948771 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f640ad660 con 0x7f2f4c003750 2021-12-17T18:23:30.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 -- 172.21.15.62:0/3986948771 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c00b750 con 0x7f2f6405ca90 2021-12-17T18:23:30.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f698bb700 1 --2- 172.21.15.62:0/3986948771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f4c0049f0 0x7f2f4c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f690ba700 1 --2- 172.21.15.62:0/3986948771 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2f4c003750 0x7f2f4c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f688b9700 1 --2- 172.21.15.62:0/3986948771 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f6405ca90 0x7f2f4c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f698bb700 1 -- 172.21.15.62:0/3986948771 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f6405ca90 msgr2=0x7f2f4c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:30.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f698bb700 1 --2- 172.21.15.62:0/3986948771 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f6405ca90 0x7f2f4c004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f698bb700 1 -- 172.21.15.62:0/3986948771 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2f4c003750 msgr2=0x7f2f4c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:30.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f698bb700 1 --2- 172.21.15.62:0/3986948771 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2f4c003750 0x7f2f4c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f698bb700 1 -- 172.21.15.62:0/3986948771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c003260 con 0x7f2f4c0049f0 2021-12-17T18:23:30.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f698bb700 1 --2- 172.21.15.62:0/3986948771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f4c0049f0 0x7f2f4c004e70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f2f5c0016f0 tx=0x7f2f640b3d50).ready entity=mon.0 client_cookie=97aabfe937925d1d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:30.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 -- 172.21.15.62:0/3986948771 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f5c00cda0 con 0x7f2f4c0049f0 2021-12-17T18:23:30.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 -- 172.21.15.62:0/3986948771 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c005990 con 0x7f2f4c0049f0 2021-12-17T18:23:30.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f57fff700 1 -- 172.21.15.62:0/3986948771 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f5c005cf0 con 0x7f2f4c0049f0 2021-12-17T18:23:30.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f6a0bc700 1 -- 172.21.15.62:0/3986948771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f4c0049f0 msgr2=0x7f2f4c004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f6a0bc700 1 --2- 172.21.15.62:0/3986948771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f4c0049f0 0x7f2f4c004e70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f2f5c0016f0 tx=0x7f2f640b3d50).stop 2021-12-17T18:23:30.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f698bb700 1 -- 172.21.15.62:0/3986948771 reap_dead start 2021-12-17T18:23:30.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f6a0bc700 1 -- 172.21.15.62:0/3986948771 shutdown_connections 2021-12-17T18:23:30.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f6a0bc700 1 -- 172.21.15.62:0/3986948771 >> 172.21.15.62:0/3986948771 conn(0x7f2f64062430 msgr2=0x7f2f64062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:30.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f6a0bc700 1 -- 172.21.15.62:0/3986948771 shutdown_connections 2021-12-17T18:23:30.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.639+0000 7f2f6a0bc700 1 -- 172.21.15.62:0/3986948771 wait complete. 2021-12-17T18:23:30.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.643+0000 7f2f6a0bc700 1 Processor -- start 2021-12-17T18:23:30.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.643+0000 7f2f6a0bc700 1 -- start start 2021-12-17T18:23:30.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.643+0000 7f2f6a0bc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f4c0049f0 0x7f2f64150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.643+0000 7f2f6a0bc700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2f6413ab40 0x7f2f6413afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.643+0000 7f2f6a0bc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f640b5450 0x7f2f640b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.643+0000 7f2f6a0bc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6413d450 con 0x7f2f4c0049f0 2021-12-17T18:23:30.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.643+0000 7f2f6a0bc700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6413e9d0 con 0x7f2f6413ab40 2021-12-17T18:23:30.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.643+0000 7f2f6a0bc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6413d650 con 0x7f2f640b5450 2021-12-17T18:23:30.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.643+0000 7f2f690ba700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f4c0049f0 0x7f2f64150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.643+0000 7f2f690ba700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f4c0049f0 0x7f2f64150100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51556/0 (socket says 172.21.15.62:51556) 2021-12-17T18:23:30.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.643+0000 7f2f688b9700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2f6413ab40 0x7f2f6413afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.643+0000 7f2f690ba700 1 -- 172.21.15.62:0/280232714 learned_addr learned my addr 172.21.15.62:0/280232714 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:30.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.643+0000 7f2f698bb700 1 --2- 172.21.15.62:0/280232714 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f640b5450 0x7f2f640b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.643+0000 7f2f690ba700 1 -- 172.21.15.62:0/280232714 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f640b5450 msgr2=0x7f2f640b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.643+0000 7f2f690ba700 1 --2- 172.21.15.62:0/280232714 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f640b5450 0x7f2f640b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.643+0000 7f2f690ba700 1 -- 172.21.15.62:0/280232714 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2f6413ab40 msgr2=0x7f2f6413afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.647+0000 7f2f690ba700 1 --2- 172.21.15.62:0/280232714 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2f6413ab40 0x7f2f6413afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.647+0000 7f2f690ba700 1 -- 172.21.15.62:0/280232714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6413b490 con 0x7f2f4c0049f0 2021-12-17T18:23:30.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.647+0000 7f2f688b9700 1 --2- 172.21.15.62:0/280232714 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2f6413ab40 0x7f2f6413afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:30.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.647+0000 7f2f690ba700 1 --2- 172.21.15.62:0/280232714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f4c0049f0 0x7f2f64150100 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f2f6413d590 tx=0x7f2f58006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:30.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.647+0000 7f2f567fc700 1 -- 172.21.15.62:0/280232714 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f5800f790 con 0x7f2f4c0049f0 2021-12-17T18:23:30.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.647+0000 7f2f567fc700 1 -- 172.21.15.62:0/280232714 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5800f8f0 con 0x7f2f4c0049f0 2021-12-17T18:23:30.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.647+0000 7f2f6a0bc700 1 -- 172.21.15.62:0/280232714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f640b5dc0 con 0x7f2f4c0049f0 2021-12-17T18:23:30.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.647+0000 7f2f567fc700 1 -- 172.21.15.62:0/280232714 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f5800fc50 con 0x7f2f4c0049f0 2021-12-17T18:23:30.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.647+0000 7f2f6a0bc700 1 -- 172.21.15.62:0/280232714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6413dc70 con 0x7f2f4c0049f0 2021-12-17T18:23:30.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.647+0000 7f2f6a0bc700 1 -- 172.21.15.62:0/280232714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6413d790 con 0x7f2f4c0049f0 2021-12-17T18:23:30.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.647+0000 7f2f567fc700 1 -- 172.21.15.62:0/280232714 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2f5800fdb0 con 0x7f2f4c0049f0 2021-12-17T18:23:30.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.651+0000 7f2f567fc700 1 --2- 172.21.15.62:0/280232714 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2f44053640 0x7f2f44055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.651+0000 7f2f567fc700 1 -- 172.21.15.62:0/280232714 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2f5806c1f0 con 0x7f2f4c0049f0 2021-12-17T18:23:30.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.651+0000 7f2f688b9700 1 --2- 172.21.15.62:0/280232714 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2f44053640 0x7f2f44055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.651+0000 7f2f688b9700 1 --2- 172.21.15.62:0/280232714 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2f44053640 0x7f2f44055b00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f2f6000b000 tx=0x7f2f60006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:30.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.655+0000 7f2f567fc700 1 -- 172.21.15.62:0/280232714 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2f580432f0 con 0x7f2f4c0049f0 2021-12-17T18:23:30.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.823+0000 7f2f6a0bc700 1 -- 172.21.15.62:0/280232714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f2f640b28b0 con 0x7f2f4c0049f0 2021-12-17T18:23:30.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.827+0000 7f2f567fc700 1 -- 172.21.15.62:0/280232714 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v22) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2f580180e0 con 0x7f2f4c0049f0 2021-12-17T18:23:30.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.831+0000 7f2f6a0bc700 1 -- 172.21.15.62:0/280232714 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2f44053640 msgr2=0x7f2f44055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.831+0000 7f2f6a0bc700 1 --2- 172.21.15.62:0/280232714 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2f44053640 0x7f2f44055b00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f2f6000b000 tx=0x7f2f60006df0).stop 2021-12-17T18:23:30.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.831+0000 7f2f6a0bc700 1 -- 172.21.15.62:0/280232714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f4c0049f0 msgr2=0x7f2f64150100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.831+0000 7f2f6a0bc700 1 --2- 172.21.15.62:0/280232714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f4c0049f0 0x7f2f64150100 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f2f6413d590 tx=0x7f2f58006df0).stop 2021-12-17T18:23:30.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.831+0000 7f2f6a0bc700 1 -- 172.21.15.62:0/280232714 shutdown_connections 2021-12-17T18:23:30.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.831+0000 7f2f6a0bc700 1 --2- 172.21.15.62:0/280232714 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2f44053640 0x7f2f44055b00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.831+0000 7f2f6a0bc700 1 --2- 172.21.15.62:0/280232714 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f640b5450 0x7f2f640b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.831+0000 7f2f6a0bc700 1 --2- 172.21.15.62:0/280232714 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2f6413ab40 0x7f2f6413afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.831+0000 7f2f6a0bc700 1 --2- 172.21.15.62:0/280232714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f4c0049f0 0x7f2f64150100 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.831+0000 7f2f6a0bc700 1 -- 172.21.15.62:0/280232714 >> 172.21.15.62:0/280232714 conn(0x7f2f64062430 msgr2=0x7f2f6413ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:30.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.831+0000 7f2f6a0bc700 1 -- 172.21.15.62:0/280232714 shutdown_connections 2021-12-17T18:23:30.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.831+0000 7f2f6a0bc700 1 -- 172.21.15.62:0/280232714 wait complete. 2021-12-17T18:23:30.841 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.2 2021-12-17T18:23:30.849 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:23:30.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.947+0000 7f2cbffff700 1 Processor -- start 2021-12-17T18:23:30.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.947+0000 7f2cbffff700 1 -- start start 2021-12-17T18:23:30.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.947+0000 7f2cbffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2cc00b5b20 0x7f2cc00b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.947+0000 7f2cbffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc00b5f00 con 0x7f2cc00b3760 2021-12-17T18:23:30.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.947+0000 7f2cbffff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc00b3020 con 0x7f2cc01458d0 2021-12-17T18:23:30.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.947+0000 7f2cbffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc00b32c0 con 0x7f2cc00b5b20 2021-12-17T18:23:30.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.947+0000 7f2cbeffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2cc00b5b20 0x7f2cc00b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.947+0000 7f2cbeffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2cc00b5b20 0x7f2cc00b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51564/0 (socket says 172.21.15.62:51564) 2021-12-17T18:23:30.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.947+0000 7f2cbeffd700 1 -- 172.21.15.62:0/267274424 learned_addr learned my addr 172.21.15.62:0/267274424 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:30.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.947+0000 7f2cbe7fc700 1 --1- 172.21.15.62:0/267274424 >> v1:172.21.15.62:6789/0 conn(0x7f2cc00b3760 0x7f2cc00b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35144/0 (socket says 172.21.15.62:35144) 2021-12-17T18:23:30.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.947+0000 7f2cbeffd700 1 -- 172.21.15.62:0/267274424 >> v1:172.21.15.109:6789/0 conn(0x7f2cc01458d0 legacy=0x7f2cc0145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.947+0000 7f2cbeffd700 1 -- 172.21.15.62:0/267274424 >> v1:172.21.15.62:6789/0 conn(0x7f2cc00b3760 legacy=0x7f2cc00b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.947+0000 7f2cbeffd700 1 -- 172.21.15.62:0/267274424 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc00b6e90 con 0x7f2cc00b5b20 2021-12-17T18:23:30.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.947+0000 7f2cbeffd700 1 --2- 172.21.15.62:0/267274424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc00b5b20 0x7f2cc00b6290 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f2cb0002f70 tx=0x7f2cb0006eb0).ready entity=mon.0 client_cookie=c5b86f9d88713754 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:30.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.947+0000 7f2cbdffb700 1 -- 172.21.15.62:0/267274424 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cb000d660 con 0x7f2cc00b5b20 2021-12-17T18:23:30.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.947+0000 7f2cbdffb700 1 -- 172.21.15.62:0/267274424 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb0000e90 con 0x7f2cc00b5b20 2021-12-17T18:23:30.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.947+0000 7f2cbdffb700 1 -- 172.21.15.62:0/267274424 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cb000d9f0 con 0x7f2cc00b5b20 2021-12-17T18:23:30.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbffff700 1 -- 172.21.15.62:0/267274424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc00b5b20 msgr2=0x7f2cc00b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbffff700 1 --2- 172.21.15.62:0/267274424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc00b5b20 0x7f2cc00b6290 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f2cb0002f70 tx=0x7f2cb0006eb0).stop 2021-12-17T18:23:30.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbffff700 1 -- 172.21.15.62:0/267274424 shutdown_connections 2021-12-17T18:23:30.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbffff700 1 --2- 172.21.15.62:0/267274424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc00b5b20 0x7f2cc00b6290 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbffff700 1 -- 172.21.15.62:0/267274424 >> 172.21.15.62:0/267274424 conn(0x7f2cc005c750 msgr2=0x7f2cc005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:30.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbffff700 1 -- 172.21.15.62:0/267274424 shutdown_connections 2021-12-17T18:23:30.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbffff700 1 -- 172.21.15.62:0/267274424 wait complete. 2021-12-17T18:23:30.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbffff700 1 Processor -- start 2021-12-17T18:23:30.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbffff700 1 -- start start 2021-12-17T18:23:30.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cc00b5b20 0x7f2cc0065e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cc01458d0 0x7f2cc0065300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc00657f0 0x7f2cc0152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0147cc0 con 0x7f2cc00657f0 2021-12-17T18:23:30.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbffff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0152520 con 0x7f2cc01458d0 2021-12-17T18:23:30.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc01527c0 con 0x7f2cc00b5b20 2021-12-17T18:23:30.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbf7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc00657f0 0x7f2cc0152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbf7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc00657f0 0x7f2cc0152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51574/0 (socket says 172.21.15.62:51574) 2021-12-17T18:23:30.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.951+0000 7f2cbf7fe700 1 -- 172.21.15.62:0/4095481247 learned_addr learned my addr 172.21.15.62:0/4095481247 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:30.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.955+0000 7f2cbeffd700 1 --2- 172.21.15.62:0/4095481247 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cc00b5b20 0x7f2cc0065e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.955+0000 7f2cbe7fc700 1 --2- 172.21.15.62:0/4095481247 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cc01458d0 0x7f2cc0065300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.955+0000 7f2cbf7fe700 1 -- 172.21.15.62:0/4095481247 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cc00b5b20 msgr2=0x7f2cc0065e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.955+0000 7f2cbf7fe700 1 --2- 172.21.15.62:0/4095481247 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cc00b5b20 0x7f2cc0065e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.955+0000 7f2cbf7fe700 1 -- 172.21.15.62:0/4095481247 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cc01458d0 msgr2=0x7f2cc0065300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:30.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.955+0000 7f2cbf7fe700 1 --2- 172.21.15.62:0/4095481247 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cc01458d0 0x7f2cc0065300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:30.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.955+0000 7f2cbf7fe700 1 -- 172.21.15.62:0/4095481247 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb000b1e0 con 0x7f2cc00657f0 2021-12-17T18:23:30.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.955+0000 7f2cbe7fc700 1 --2- 172.21.15.62:0/4095481247 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cc01458d0 0x7f2cc0065300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:30.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.955+0000 7f2cbf7fe700 1 --2- 172.21.15.62:0/4095481247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc00657f0 0x7f2cc0152c60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f2cc006a750 tx=0x7f2cb80013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:30.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.955+0000 7f2caffff700 1 -- 172.21.15.62:0/4095481247 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cb8006aa0 con 0x7f2cc00657f0 2021-12-17T18:23:30.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.955+0000 7f2caffff700 1 -- 172.21.15.62:0/4095481247 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb8006c00 con 0x7f2cc00657f0 2021-12-17T18:23:30.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.955+0000 7f2caffff700 1 -- 172.21.15.62:0/4095481247 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cb8007030 con 0x7f2cc00657f0 2021-12-17T18:23:30.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.955+0000 7f2cbffff700 1 -- 172.21.15.62:0/4095481247 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc01479f0 con 0x7f2cc00657f0 2021-12-17T18:23:30.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.955+0000 7f2cbffff700 1 -- 172.21.15.62:0/4095481247 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc014a860 con 0x7f2cc00657f0 2021-12-17T18:23:30.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.955+0000 7f2cbffff700 1 -- 172.21.15.62:0/4095481247 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc0152980 con 0x7f2cc00657f0 2021-12-17T18:23:30.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.955+0000 7f2caffff700 1 -- 172.21.15.62:0/4095481247 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2cb8010030 con 0x7f2cc00657f0 2021-12-17T18:23:30.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.955+0000 7f2caffff700 1 --2- 172.21.15.62:0/4095481247 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2c9c053580 0x7f2c9c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:30.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.959+0000 7f2caffff700 1 -- 172.21.15.62:0/4095481247 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2cb806b880 con 0x7f2cc00657f0 2021-12-17T18:23:30.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.959+0000 7f2cbeffd700 1 --2- 172.21.15.62:0/4095481247 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2c9c053580 0x7f2c9c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:30.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.959+0000 7f2cbeffd700 1 --2- 172.21.15.62:0/4095481247 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2c9c053580 0x7f2c9c055a40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f2cb001c000 tx=0x7f2cb0015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:30.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:30.963+0000 7f2caffff700 1 -- 172.21.15.62:0/4095481247 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2cb8042940 con 0x7f2cc00657f0 2021-12-17T18:23:31.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.131+0000 7f2cbffff700 1 -- 172.21.15.62:0/4095481247 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2cc0147e00 con 0x7f2cc00657f0 2021-12-17T18:23:31.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.131+0000 7f2caffff700 1 -- 172.21.15.62:0/4095481247 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f2cb8045f60 con 0x7f2cc00657f0 2021-12-17T18:23:31.136 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:31.136 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3727734226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3727734226},{"type":"v1","addr":"172.21.15.109:6835","nonce":3727734226}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:23:27.562422+0000","modified":"2021-12-17T18:23:29.262551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5991},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5991":{"gid":5991,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1885234343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1885234343},{"type":"v1","addr":"172.21.15.62:6833","nonce":1885234343}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-12-17T18:23:31.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.131+0000 7f2cbffff700 1 -- 172.21.15.62:0/4095481247 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2c9c053580 msgr2=0x7f2c9c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:31.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.131+0000 7f2cbffff700 1 --2- 172.21.15.62:0/4095481247 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2c9c053580 0x7f2c9c055a40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f2cb001c000 tx=0x7f2cb0015000).stop 2021-12-17T18:23:31.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.131+0000 7f2cbffff700 1 -- 172.21.15.62:0/4095481247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc00657f0 msgr2=0x7f2cc0152c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.131+0000 7f2cbffff700 1 --2- 172.21.15.62:0/4095481247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc00657f0 0x7f2cc0152c60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f2cc006a750 tx=0x7f2cb80013a0).stop 2021-12-17T18:23:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.131+0000 7f2cbffff700 1 -- 172.21.15.62:0/4095481247 shutdown_connections 2021-12-17T18:23:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.131+0000 7f2cbffff700 1 --2- 172.21.15.62:0/4095481247 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2c9c053580 0x7f2c9c055a40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.131+0000 7f2cbffff700 1 --2- 172.21.15.62:0/4095481247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cc00657f0 0x7f2cc0152c60 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.131+0000 7f2cbffff700 1 --2- 172.21.15.62:0/4095481247 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cc01458d0 0x7f2cc0065300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.131+0000 7f2cbffff700 1 --2- 172.21.15.62:0/4095481247 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cc00b5b20 0x7f2cc0065e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.131+0000 7f2cbffff700 1 -- 172.21.15.62:0/4095481247 >> 172.21.15.62:0/4095481247 conn(0x7f2cc005c750 msgr2=0x7f2cc00afbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:31.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.131+0000 7f2cbffff700 1 -- 172.21.15.62:0/4095481247 shutdown_connections 2021-12-17T18:23:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.131+0000 7f2cbffff700 1 -- 172.21.15.62:0/4095481247 wait complete. 2021-12-17T18:23:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 27 2021-12-17T18:23:31.351 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:23:27.562422+0000', 'modified': '2021-12-17T18:23:29.262551+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5991}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5991': {'gid': 5991, 'name': 'a', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/1885234343', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 1885234343}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 1885234343}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:23:31.352 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:23:31.353 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:23:31.468 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":5991,"want_state":"up:active","state":"up:active","rank_uptime":3.8932864459999998,"mdsmap_epoch":27,"osdmap_epoch":62,"osdmap_epoch_barrier":61,"uptime":8.9535705530000005} 2021-12-17T18:23:31.469 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 5991, "mdsmap_epoch": 27, "osdmap_epoch": 62, "osdmap_epoch_barrier": 61, "rank_uptime": 3.893286446, "state": "up:active", "uptime": 8.953570553, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:23:31.470 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:23:31.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.563+0000 7f60064f4700 1 Processor -- start 2021-12-17T18:23:31.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.563+0000 7f60064f4700 1 -- start start 2021-12-17T18:23:31.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f60064f4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f60000aca60 0x7f6000147050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:31.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f60064f4700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6000147540 0x7f60000b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:31.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f60064f4700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6000067c10 con 0x7f6000067830 2021-12-17T18:23:31.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f60064f4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6000060520 con 0x7f60000aca60 2021-12-17T18:23:31.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f60064f4700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60000acf00 con 0x7f6000147540 2021-12-17T18:23:31.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f5fff7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f60000aca60 0x7f6000147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:31.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f5fff7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f60000aca60 0x7f6000147050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51578/0 (socket says 172.21.15.62:51578) 2021-12-17T18:23:31.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f5fff7fe700 1 -- 172.21.15.62:0/559896483 learned_addr learned my addr 172.21.15.62:0/559896483 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f6004a91700 1 --2- 172.21.15.62:0/559896483 >> v2:172.21.15.109:3300/0 conn(0x7f6000147540 0x7f60000b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f5fff7fe700 1 -- 172.21.15.62:0/559896483 >> v2:172.21.15.109:3300/0 conn(0x7f6000147540 msgr2=0x7f60000b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f5fff7fe700 1 --2- 172.21.15.62:0/559896483 >> v2:172.21.15.109:3300/0 conn(0x7f6000147540 0x7f60000b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f5fff7fe700 1 -- 172.21.15.62:0/559896483 >> v1:172.21.15.109:6789/0 conn(0x7f6000067830 legacy=0x7f6000146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:31.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f5fff7fe700 1 -- 172.21.15.62:0/559896483 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60000b12a0 con 0x7f60000aca60 2021-12-17T18:23:31.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f5fff7fe700 1 --2- 172.21.15.62:0/559896483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60000aca60 0x7f6000147050 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f60000b1af0 tx=0x7f5ff0006eb0).ready entity=mon.0 client_cookie=d32176e5a78737e5 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:31.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f5ffeffd700 1 -- 172.21.15.62:0/559896483 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff000d610 con 0x7f60000aca60 2021-12-17T18:23:31.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f5ffeffd700 1 -- 172.21.15.62:0/559896483 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff0000e90 con 0x7f60000aca60 2021-12-17T18:23:31.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f5ffeffd700 1 -- 172.21.15.62:0/559896483 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff000d9a0 con 0x7f60000aca60 2021-12-17T18:23:31.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f60064f4700 1 -- 172.21.15.62:0/559896483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60000aca60 msgr2=0x7f6000147050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:31.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f60064f4700 1 --2- 172.21.15.62:0/559896483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60000aca60 0x7f6000147050 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f60000b1af0 tx=0x7f5ff0006eb0).stop 2021-12-17T18:23:31.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f60064f4700 1 -- 172.21.15.62:0/559896483 shutdown_connections 2021-12-17T18:23:31.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f60064f4700 1 --2- 172.21.15.62:0/559896483 >> v2:172.21.15.109:3300/0 conn(0x7f6000147540 0x7f60000b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f60064f4700 1 --2- 172.21.15.62:0/559896483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60000aca60 0x7f6000147050 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f60064f4700 1 -- 172.21.15.62:0/559896483 >> 172.21.15.62:0/559896483 conn(0x7f600005f730 msgr2=0x7f600005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:31.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f60064f4700 1 -- 172.21.15.62:0/559896483 shutdown_connections 2021-12-17T18:23:31.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.567+0000 7f60064f4700 1 -- 172.21.15.62:0/559896483 wait complete. 2021-12-17T18:23:31.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f60064f4700 1 Processor -- start 2021-12-17T18:23:31.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f60064f4700 1 -- start start 2021-12-17T18:23:31.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f60064f4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6000067830 0x7f6000156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:31.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f60064f4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f60000aca60 0x7f60000a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:31.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f60064f4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6000147540 0x7f60000a2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:31.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f60064f4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600009ed50 con 0x7f6000067830 2021-12-17T18:23:31.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f60064f4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600009eff0 con 0x7f60000aca60 2021-12-17T18:23:31.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f60064f4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60000a1e90 con 0x7f6000147540 2021-12-17T18:23:31.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f5ffffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6000067830 0x7f6000156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:31.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f5ffffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6000067830 0x7f6000156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51584/0 (socket says 172.21.15.62:51584) 2021-12-17T18:23:31.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f5ffffff700 1 -- 172.21.15.62:0/1406718473 learned_addr learned my addr 172.21.15.62:0/1406718473 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:31.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f5fff7fe700 1 --2- 172.21.15.62:0/1406718473 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f60000aca60 0x7f60000a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:31.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f6004a91700 1 --2- 172.21.15.62:0/1406718473 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6000147540 0x7f60000a2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:31.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f5ffffff700 1 -- 172.21.15.62:0/1406718473 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6000147540 msgr2=0x7f60000a2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:31.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f5ffffff700 1 --2- 172.21.15.62:0/1406718473 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6000147540 0x7f60000a2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f5ffffff700 1 -- 172.21.15.62:0/1406718473 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f60000aca60 msgr2=0x7f60000a96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:31.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f5ffffff700 1 --2- 172.21.15.62:0/1406718473 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f60000aca60 0x7f60000a96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f5ffffff700 1 -- 172.21.15.62:0/1406718473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff000b1e0 con 0x7f6000067830 2021-12-17T18:23:31.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f5ffffff700 1 --2- 172.21.15.62:0/1406718473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6000067830 0x7f6000156150 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f60000ad820 tx=0x7f5ff4007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:31.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f5ffd7fa700 1 -- 172.21.15.62:0/1406718473 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff4012400 con 0x7f6000067830 2021-12-17T18:23:31.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f5ffd7fa700 1 -- 172.21.15.62:0/1406718473 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff4012560 con 0x7f6000067830 2021-12-17T18:23:31.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f60064f4700 1 -- 172.21.15.62:0/1406718473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60000a9b90 con 0x7f6000067830 2021-12-17T18:23:31.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f5ffd7fa700 1 -- 172.21.15.62:0/1406718473 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff40128c0 con 0x7f6000067830 2021-12-17T18:23:31.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.571+0000 7f60064f4700 1 -- 172.21.15.62:0/1406718473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60000abfc0 con 0x7f6000067830 2021-12-17T18:23:31.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.575+0000 7f60064f4700 1 -- 172.21.15.62:0/1406718473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600009eb70 con 0x7f6000067830 2021-12-17T18:23:31.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.575+0000 7f5ffd7fa700 1 -- 172.21.15.62:0/1406718473 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5ff4019030 con 0x7f6000067830 2021-12-17T18:23:31.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.575+0000 7f5ffd7fa700 1 --2- 172.21.15.62:0/1406718473 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fe0053610 0x7f5fe0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:31.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.575+0000 7f5ffd7fa700 1 -- 172.21.15.62:0/1406718473 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5ff406ac80 con 0x7f6000067830 2021-12-17T18:23:31.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.575+0000 7f5fff7fe700 1 --2- 172.21.15.62:0/1406718473 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fe0053610 0x7f5fe0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:31.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.575+0000 7f5fff7fe700 1 --2- 172.21.15.62:0/1406718473 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fe0053610 0x7f5fe0055ad0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f5ff001c000 tx=0x7f5ff0015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:31.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.579+0000 7f5ffd7fa700 1 -- 172.21.15.62:0/1406718473 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ff4041d80 con 0x7f6000067830 2021-12-17T18:23:31.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.711+0000 7f60064f4700 1 -- 172.21.15.62:0/1406718473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60000b0fb0 con 0x7f6000067830 2021-12-17T18:23:31.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.711+0000 7f5ffd7fa700 1 -- 172.21.15.62:0/1406718473 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f5ff40453a0 con 0x7f6000067830 2021-12-17T18:23:31.717 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:31.717 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":62,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:23:29.574719+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:23:25.381154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-12-17T18:23:26.577198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:23:31.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.711+0000 7f60064f4700 1 -- 172.21.15.62:0/1406718473 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fe0053610 msgr2=0x7f5fe0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:31.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.711+0000 7f60064f4700 1 --2- 172.21.15.62:0/1406718473 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fe0053610 0x7f5fe0055ad0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f5ff001c000 tx=0x7f5ff0015000).stop 2021-12-17T18:23:31.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.711+0000 7f60064f4700 1 -- 172.21.15.62:0/1406718473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6000067830 msgr2=0x7f6000156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:31.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.711+0000 7f60064f4700 1 --2- 172.21.15.62:0/1406718473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6000067830 0x7f6000156150 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f60000ad820 tx=0x7f5ff4007c50).stop 2021-12-17T18:23:31.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.715+0000 7f60064f4700 1 -- 172.21.15.62:0/1406718473 shutdown_connections 2021-12-17T18:23:31.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.715+0000 7f60064f4700 1 --2- 172.21.15.62:0/1406718473 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5fe0053610 0x7f5fe0055ad0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.715+0000 7f60064f4700 1 --2- 172.21.15.62:0/1406718473 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6000147540 0x7f60000a2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.715+0000 7f60064f4700 1 --2- 172.21.15.62:0/1406718473 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f60000aca60 0x7f60000a96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.715+0000 7f60064f4700 1 --2- 172.21.15.62:0/1406718473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6000067830 0x7f6000156150 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.715+0000 7f60064f4700 1 -- 172.21.15.62:0/1406718473 >> 172.21.15.62:0/1406718473 conn(0x7f600005f730 msgr2=0x7f60000b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:31.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.715+0000 7f60064f4700 1 -- 172.21.15.62:0/1406718473 shutdown_connections 2021-12-17T18:23:31.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.715+0000 7f60064f4700 1 -- 172.21.15.62:0/1406718473 wait complete. 2021-12-17T18:23:31.731 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:23:25.381154+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:23:26.577198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:23:31.732 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:23:31.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.839+0000 7f1c61848700 1 Processor -- start 2021-12-17T18:23:31.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.839+0000 7f1c61848700 1 -- start start 2021-12-17T18:23:31.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.839+0000 7f1c61848700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c5c0ae470 0x7f1c5c0b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:31.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.839+0000 7f1c61848700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1c5c142d00 0x7f1c5c0b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:31.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.839+0000 7f1c61848700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5c065160 con 0x7f1c5c0b7900 2021-12-17T18:23:31.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.839+0000 7f1c61848700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c5c0addb0 con 0x7f1c5c142d00 2021-12-17T18:23:31.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.839+0000 7f1c61848700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c064c60 con 0x7f1c5c0ae470 2021-12-17T18:23:31.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.839+0000 7f1c5affd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1c5c0b7900 0x7f1c5c1425f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35172/0 (socket says 172.21.15.62:35172) 2021-12-17T18:23:31.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.839+0000 7f1c5affd700 1 -- 172.21.15.62:0/3485366751 learned_addr learned my addr 172.21.15.62:0/3485366751 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:31.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.839+0000 7f1c5b7fe700 1 --2- 172.21.15.62:0/3485366751 >> v2:172.21.15.109:3300/0 conn(0x7f1c5c142d00 0x7f1c5c0b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:31.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.839+0000 7f1c5a7fc700 1 --2- 172.21.15.62:0/3485366751 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c5c0ae470 0x7f1c5c0b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:31.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.839+0000 7f1c59ffb700 1 -- 172.21.15.62:0/3485366751 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217445924 0 0) 0x7f1c5c065160 con 0x7f1c5c0b7900 2021-12-17T18:23:31.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.839+0000 7f1c59ffb700 1 -- 172.21.15.62:0/3485366751 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c3c003260 con 0x7f1c5c0b7900 2021-12-17T18:23:31.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.839+0000 7f1c5b7fe700 1 -- 172.21.15.62:0/3485366751 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c5c0ae470 msgr2=0x7f1c5c0b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:31.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.839+0000 7f1c5b7fe700 1 --2- 172.21.15.62:0/3485366751 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c5c0ae470 0x7f1c5c0b1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.843+0000 7f1c5b7fe700 1 -- 172.21.15.62:0/3485366751 >> v1:172.21.15.62:6789/0 conn(0x7f1c5c0b7900 legacy=0x7f1c5c1425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:31.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.843+0000 7f1c5b7fe700 1 -- 172.21.15.62:0/3485366751 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c0b7ce0 con 0x7f1c5c142d00 2021-12-17T18:23:31.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.843+0000 7f1c5a7fc700 1 --2- 172.21.15.62:0/3485366751 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c5c0ae470 0x7f1c5c0b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:31.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.843+0000 7f1c5b7fe700 1 --2- 172.21.15.62:0/3485366751 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c5c142d00 0x7f1c5c0b24c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f1c540032f0 tx=0x7f1c540091d0).ready entity=mon.1 client_cookie=c2225d3333a3615d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:31.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.843+0000 7f1c59ffb700 1 -- 172.21.15.62:0/3485366751 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c5400b600 con 0x7f1c5c142d00 2021-12-17T18:23:31.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.843+0000 7f1c59ffb700 1 -- 172.21.15.62:0/3485366751 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5400b760 con 0x7f1c5c142d00 2021-12-17T18:23:31.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.843+0000 7f1c59ffb700 1 -- 172.21.15.62:0/3485366751 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c5400b8d0 con 0x7f1c5c142d00 2021-12-17T18:23:31.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.843+0000 7f1c61848700 1 -- 172.21.15.62:0/3485366751 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c5c142d00 msgr2=0x7f1c5c0b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:31.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.843+0000 7f1c61848700 1 --2- 172.21.15.62:0/3485366751 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c5c142d00 0x7f1c5c0b24c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f1c540032f0 tx=0x7f1c540091d0).stop 2021-12-17T18:23:31.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.843+0000 7f1c61848700 1 -- 172.21.15.62:0/3485366751 shutdown_connections 2021-12-17T18:23:31.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.843+0000 7f1c61848700 1 --2- 172.21.15.62:0/3485366751 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c5c142d00 0x7f1c5c0b24c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.843+0000 7f1c61848700 1 --2- 172.21.15.62:0/3485366751 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c5c0ae470 0x7f1c5c0b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.843+0000 7f1c61848700 1 -- 172.21.15.62:0/3485366751 >> 172.21.15.62:0/3485366751 conn(0x7f1c5c062510 msgr2=0x7f1c5c062920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:31.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.843+0000 7f1c61848700 1 -- 172.21.15.62:0/3485366751 shutdown_connections 2021-12-17T18:23:31.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.843+0000 7f1c61848700 1 -- 172.21.15.62:0/3485366751 wait complete. 2021-12-17T18:23:31.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c61848700 1 Processor -- start 2021-12-17T18:23:31.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c61848700 1 -- start start 2021-12-17T18:23:31.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c61848700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c5c0ae470 0x7f1c5c0b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:31.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c61848700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c5c0b7900 0x7f1c5c0aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:31.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c61848700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c5c142d00 0x7f1c5c116cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:31.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c61848700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c140f30 con 0x7f1c5c0b7900 2021-12-17T18:23:31.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c61848700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c116850 con 0x7f1c5c0ae470 2021-12-17T18:23:31.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c61848700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c0b01c0 con 0x7f1c5c142d00 2021-12-17T18:23:31.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c5a7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c5c0b7900 0x7f1c5c0aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:31.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c5a7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c5c0b7900 0x7f1c5c0aead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51600/0 (socket says 172.21.15.62:51600) 2021-12-17T18:23:31.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c5a7fc700 1 -- 172.21.15.62:0/3270899593 learned_addr learned my addr 172.21.15.62:0/3270899593 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:31.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c5affd700 1 --2- 172.21.15.62:0/3270899593 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c5c0ae470 0x7f1c5c0b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:31.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c5b7fe700 1 --2- 172.21.15.62:0/3270899593 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c5c142d00 0x7f1c5c116cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:31.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c5a7fc700 1 -- 172.21.15.62:0/3270899593 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c5c142d00 msgr2=0x7f1c5c116cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:31.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c5a7fc700 1 --2- 172.21.15.62:0/3270899593 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c5c142d00 0x7f1c5c116cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c5a7fc700 1 -- 172.21.15.62:0/3270899593 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c5c0ae470 msgr2=0x7f1c5c0b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:31.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c5a7fc700 1 --2- 172.21.15.62:0/3270899593 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c5c0ae470 0x7f1c5c0b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c5a7fc700 1 -- 172.21.15.62:0/3270899593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c00b180 con 0x7f1c5c0b7900 2021-12-17T18:23:31.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c5a7fc700 1 --2- 172.21.15.62:0/3270899593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c5c0b7900 0x7f1c5c0aead0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f1c4c00c000 tx=0x7f1c4c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:31.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c53fff700 1 -- 172.21.15.62:0/3270899593 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c4c00c800 con 0x7f1c5c0b7900 2021-12-17T18:23:31.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c53fff700 1 -- 172.21.15.62:0/3270899593 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c00c960 con 0x7f1c5c0b7900 2021-12-17T18:23:31.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c61848700 1 -- 172.21.15.62:0/3270899593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c54009470 con 0x7f1c5c0b7900 2021-12-17T18:23:31.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c53fff700 1 -- 172.21.15.62:0/3270899593 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c4c00ccc0 con 0x7f1c5c0b7900 2021-12-17T18:23:31.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.847+0000 7f1c61848700 1 -- 172.21.15.62:0/3270899593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5c0b18a0 con 0x7f1c5c0b7900 2021-12-17T18:23:31.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.851+0000 7f1c61848700 1 -- 172.21.15.62:0/3270899593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c5c116a10 con 0x7f1c5c0b7900 2021-12-17T18:23:31.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.851+0000 7f1c53fff700 1 -- 172.21.15.62:0/3270899593 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1c4c01c460 con 0x7f1c5c0b7900 2021-12-17T18:23:31.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.851+0000 7f1c53fff700 1 --2- 172.21.15.62:0/3270899593 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c40053640 0x7f1c40055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:31.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.851+0000 7f1c53fff700 1 -- 172.21.15.62:0/3270899593 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1c4c06bfe0 con 0x7f1c5c0b7900 2021-12-17T18:23:31.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.851+0000 7f1c5affd700 1 --2- 172.21.15.62:0/3270899593 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c40053640 0x7f1c40055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:31.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.851+0000 7f1c5affd700 1 --2- 172.21.15.62:0/3270899593 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c40053640 0x7f1c40055b00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f1c4400d000 tx=0x7f1c44009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:31.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.859+0000 7f1c53fff700 1 -- 172.21.15.62:0/3270899593 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1c5c116a10 con 0x7f1c5c0b7900 2021-12-17T18:23:31.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.987+0000 7f1c61848700 1 -- 172.21.15.62:0/3270899593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1c5c116a10 con 0x7f1c5c0b7900 2021-12-17T18:23:31.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.987+0000 7f1c53fff700 1 -- 172.21.15.62:0/3270899593 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v62) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1c5c116a10 con 0x7f1c5c0b7900 2021-12-17T18:23:31.992 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:23:31.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.987+0000 7f1c61848700 1 -- 172.21.15.62:0/3270899593 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c40053640 msgr2=0x7f1c40055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:31.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.987+0000 7f1c61848700 1 --2- 172.21.15.62:0/3270899593 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c40053640 0x7f1c40055b00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f1c4400d000 tx=0x7f1c44009040).stop 2021-12-17T18:23:31.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.987+0000 7f1c61848700 1 -- 172.21.15.62:0/3270899593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c5c0b7900 msgr2=0x7f1c5c0aead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:31.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.987+0000 7f1c61848700 1 --2- 172.21.15.62:0/3270899593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c5c0b7900 0x7f1c5c0aead0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f1c4c00c000 tx=0x7f1c4c006df0).stop 2021-12-17T18:23:31.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.987+0000 7f1c61848700 1 -- 172.21.15.62:0/3270899593 shutdown_connections 2021-12-17T18:23:31.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.987+0000 7f1c61848700 1 --2- 172.21.15.62:0/3270899593 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c40053640 0x7f1c40055b00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.987+0000 7f1c61848700 1 --2- 172.21.15.62:0/3270899593 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c5c142d00 0x7f1c5c116cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.987+0000 7f1c61848700 1 --2- 172.21.15.62:0/3270899593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c5c0b7900 0x7f1c5c0aead0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.987+0000 7f1c61848700 1 --2- 172.21.15.62:0/3270899593 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c5c0ae470 0x7f1c5c0b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:31.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.987+0000 7f1c61848700 1 -- 172.21.15.62:0/3270899593 >> 172.21.15.62:0/3270899593 conn(0x7f1c5c062510 msgr2=0x7f1c5c141930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:31.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.987+0000 7f1c61848700 1 -- 172.21.15.62:0/3270899593 shutdown_connections 2021-12-17T18:23:31.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:31.987+0000 7f1c61848700 1 -- 172.21.15.62:0/3270899593 wait complete. 2021-12-17T18:23:32.004 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:23:32.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.111+0000 7f52f5310700 1 Processor -- start 2021-12-17T18:23:32.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.111+0000 7f52f5310700 1 -- start start 2021-12-17T18:23:32.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52f5310700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f52f005fa70 0x7f52f00b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52f5310700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f52f01439c0 0x7f52f0061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52f5310700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f005fe50 con 0x7f52f00625a0 2021-12-17T18:23:32.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52f5310700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f0062cb0 con 0x7f52f005fa70 2021-12-17T18:23:32.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52f5310700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f00b2a60 con 0x7f52f01439c0 2021-12-17T18:23:32.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52ef7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f52f00625a0 0x7f52f013fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35190/0 (socket says 172.21.15.62:35190) 2021-12-17T18:23:32.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52ef7fe700 1 -- 172.21.15.62:0/988445339 learned_addr learned my addr 172.21.15.62:0/988445339 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:32.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52e67fc700 1 --2- 172.21.15.62:0/988445339 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f52f01439c0 0x7f52f0061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52eeffd700 1 --2- 172.21.15.62:0/988445339 >> v2:172.21.15.109:3300/0 conn(0x7f52f005fa70 0x7f52f00b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52ee7fc700 1 -- 172.21.15.62:0/988445339 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242154932 0 0) 0x7f52f005fe50 con 0x7f52f00625a0 2021-12-17T18:23:32.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52ee7fc700 1 -- 172.21.15.62:0/988445339 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52d0003260 con 0x7f52f00625a0 2021-12-17T18:23:32.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52e67fc700 1 -- 172.21.15.62:0/988445339 >> v2:172.21.15.109:3300/0 conn(0x7f52f005fa70 msgr2=0x7f52f00b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:32.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52e67fc700 1 --2- 172.21.15.62:0/988445339 >> v2:172.21.15.109:3300/0 conn(0x7f52f005fa70 0x7f52f00b17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52e67fc700 1 -- 172.21.15.62:0/988445339 >> v1:172.21.15.62:6789/0 conn(0x7f52f00625a0 legacy=0x7f52f013fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52e67fc700 1 -- 172.21.15.62:0/988445339 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f0061510 con 0x7f52f01439c0 2021-12-17T18:23:32.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52e67fc700 1 --2- 172.21.15.62:0/988445339 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f52f01439c0 0x7f52f0061c50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f52d8002f70 tx=0x7f52d8006df0).ready entity=mon.2 client_cookie=a9bfc89fb51c57ea server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:32.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52ee7fc700 1 -- 172.21.15.62:0/988445339 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d800d4a0 con 0x7f52f01439c0 2021-12-17T18:23:32.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52ee7fc700 1 -- 172.21.15.62:0/988445339 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d8000e90 con 0x7f52f01439c0 2021-12-17T18:23:32.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52ee7fc700 1 -- 172.21.15.62:0/988445339 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d800d7f0 con 0x7f52f01439c0 2021-12-17T18:23:32.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52f5310700 1 -- 172.21.15.62:0/988445339 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f52f01439c0 msgr2=0x7f52f0061c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52f5310700 1 --2- 172.21.15.62:0/988445339 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f52f01439c0 0x7f52f0061c50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f52d8002f70 tx=0x7f52d8006df0).stop 2021-12-17T18:23:32.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52f5310700 1 -- 172.21.15.62:0/988445339 shutdown_connections 2021-12-17T18:23:32.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52f5310700 1 --2- 172.21.15.62:0/988445339 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f52f01439c0 0x7f52f0061c50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52f5310700 1 --2- 172.21.15.62:0/988445339 >> v2:172.21.15.109:3300/0 conn(0x7f52f005fa70 0x7f52f00b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.115+0000 7f52f5310700 1 -- 172.21.15.62:0/988445339 >> 172.21.15.62:0/988445339 conn(0x7f52f00b64d0 msgr2=0x7f52f00b68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:32.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.119+0000 7f52f5310700 1 -- 172.21.15.62:0/988445339 shutdown_connections 2021-12-17T18:23:32.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.119+0000 7f52f5310700 1 -- 172.21.15.62:0/988445339 wait complete. 2021-12-17T18:23:32.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.119+0000 7f52f5310700 1 Processor -- start 2021-12-17T18:23:32.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.119+0000 7f52f5310700 1 -- start start 2021-12-17T18:23:32.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.119+0000 7f52f5310700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f52f005fa70 0x7f52f00b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.119+0000 7f52f5310700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52f00625a0 0x7f52f0155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.119+0000 7f52f5310700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f52f01439c0 0x7f52f0156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.119+0000 7f52f5310700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f0145550 con 0x7f52f00625a0 2021-12-17T18:23:32.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.119+0000 7f52f5310700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f0064490 con 0x7f52f01439c0 2021-12-17T18:23:32.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.119+0000 7f52f5310700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f0064730 con 0x7f52f005fa70 2021-12-17T18:23:32.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.119+0000 7f52e67fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52f00625a0 0x7f52f0155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.119+0000 7f52e67fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52f00625a0 0x7f52f0155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51614/0 (socket says 172.21.15.62:51614) 2021-12-17T18:23:32.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.119+0000 7f52e67fc700 1 -- 172.21.15.62:0/1150225096 learned_addr learned my addr 172.21.15.62:0/1150225096 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:32.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.119+0000 7f52eeffd700 1 --2- 172.21.15.62:0/1150225096 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f52f005fa70 0x7f52f00b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.123+0000 7f52ef7fe700 1 --2- 172.21.15.62:0/1150225096 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f52f01439c0 0x7f52f0156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.123+0000 7f52e67fc700 1 -- 172.21.15.62:0/1150225096 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f52f005fa70 msgr2=0x7f52f00b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.123+0000 7f52e67fc700 1 --2- 172.21.15.62:0/1150225096 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f52f005fa70 0x7f52f00b5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.123+0000 7f52e67fc700 1 -- 172.21.15.62:0/1150225096 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f52f01439c0 msgr2=0x7f52f0156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.123+0000 7f52e67fc700 1 --2- 172.21.15.62:0/1150225096 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f52f01439c0 0x7f52f0156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.123+0000 7f52e67fc700 1 -- 172.21.15.62:0/1150225096 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d800b180 con 0x7f52f00625a0 2021-12-17T18:23:32.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.123+0000 7f52e67fc700 1 --2- 172.21.15.62:0/1150225096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52f00625a0 0x7f52f0155b10 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f52d8002f70 tx=0x7f52d8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:32.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.123+0000 7f52ecff9700 1 -- 172.21.15.62:0/1150225096 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d8016070 con 0x7f52f00625a0 2021-12-17T18:23:32.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.123+0000 7f52ecff9700 1 -- 172.21.15.62:0/1150225096 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d80138d0 con 0x7f52f00625a0 2021-12-17T18:23:32.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.123+0000 7f52f5310700 1 -- 172.21.15.62:0/1150225096 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f0155670 con 0x7f52f00625a0 2021-12-17T18:23:32.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.123+0000 7f52ecff9700 1 -- 172.21.15.62:0/1150225096 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d8013c30 con 0x7f52f00625a0 2021-12-17T18:23:32.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.123+0000 7f52f5310700 1 -- 172.21.15.62:0/1150225096 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f0145760 con 0x7f52f00625a0 2021-12-17T18:23:32.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.123+0000 7f52f5310700 1 -- 172.21.15.62:0/1150225096 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f0155800 con 0x7f52f00625a0 2021-12-17T18:23:32.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.123+0000 7f52ecff9700 1 -- 172.21.15.62:0/1150225096 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f52d8025030 con 0x7f52f00625a0 2021-12-17T18:23:32.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.127+0000 7f52ecff9700 1 --2- 172.21.15.62:0/1150225096 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f52d40536d0 0x7f52d4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.127+0000 7f52ecff9700 1 -- 172.21.15.62:0/1150225096 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f52d806ca90 con 0x7f52f00625a0 2021-12-17T18:23:32.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.127+0000 7f52eeffd700 1 --2- 172.21.15.62:0/1150225096 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f52d40536d0 0x7f52d4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.127+0000 7f52eeffd700 1 --2- 172.21.15.62:0/1150225096 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f52d40536d0 0x7f52d4055b90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f52e000b000 tx=0x7f52e0006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:32.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.131+0000 7f52ecff9700 1 -- 172.21.15.62:0/1150225096 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f52d8043b50 con 0x7f52f00625a0 2021-12-17T18:23:32.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.259+0000 7f52f5310700 1 -- 172.21.15.62:0/1150225096 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f52f00617b0 con 0x7f52f00625a0 2021-12-17T18:23:32.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.259+0000 7f52ecff9700 1 -- 172.21.15.62:0/1150225096 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v62) v1 ==== 92+0+10 (secure 0 0 0) 0x7f52d8023070 con 0x7f52f00625a0 2021-12-17T18:23:32.266 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:23:32.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.263+0000 7f52f5310700 1 -- 172.21.15.62:0/1150225096 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f52d40536d0 msgr2=0x7f52d4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.263+0000 7f52f5310700 1 --2- 172.21.15.62:0/1150225096 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f52d40536d0 0x7f52d4055b90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f52e000b000 tx=0x7f52e0006df0).stop 2021-12-17T18:23:32.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.263+0000 7f52f5310700 1 -- 172.21.15.62:0/1150225096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52f00625a0 msgr2=0x7f52f0155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.263+0000 7f52f5310700 1 --2- 172.21.15.62:0/1150225096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52f00625a0 0x7f52f0155b10 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f52d8002f70 tx=0x7f52d8014000).stop 2021-12-17T18:23:32.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.263+0000 7f52f5310700 1 -- 172.21.15.62:0/1150225096 shutdown_connections 2021-12-17T18:23:32.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.263+0000 7f52f5310700 1 --2- 172.21.15.62:0/1150225096 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f52d40536d0 0x7f52d4055b90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.263+0000 7f52f5310700 1 --2- 172.21.15.62:0/1150225096 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f52f01439c0 0x7f52f0156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.263+0000 7f52f5310700 1 --2- 172.21.15.62:0/1150225096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52f00625a0 0x7f52f0155b10 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.263+0000 7f52f5310700 1 --2- 172.21.15.62:0/1150225096 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f52f005fa70 0x7f52f00b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.263+0000 7f52f5310700 1 -- 172.21.15.62:0/1150225096 >> 172.21.15.62:0/1150225096 conn(0x7f52f00b64d0 msgr2=0x7f52f00af770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:32.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.263+0000 7f52f5310700 1 -- 172.21.15.62:0/1150225096 shutdown_connections 2021-12-17T18:23:32.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.263+0000 7f52f5310700 1 -- 172.21.15.62:0/1150225096 wait complete. 2021-12-17T18:23:32.284 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:23:32.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.387+0000 7f2633fff700 1 Processor -- start 2021-12-17T18:23:32.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.387+0000 7f2633fff700 1 -- start start 2021-12-17T18:23:32.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.387+0000 7f2633fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f263405ca90 0x7f263405f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.387+0000 7f2633fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263405ce70 con 0x7f26340b46d0 2021-12-17T18:23:32.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.387+0000 7f2633fff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2634145550 con 0x7f26340b4b40 2021-12-17T18:23:32.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.387+0000 7f2633fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26340b31e0 con 0x7f263405ca90 2021-12-17T18:23:32.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.387+0000 7f2632ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f263405ca90 0x7f263405f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.387+0000 7f26327fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f26340b46d0 0x7f2634144730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35202/0 (socket says 172.21.15.62:35202) 2021-12-17T18:23:32.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.387+0000 7f26327fc700 1 -- 172.21.15.62:0/2764896069 learned_addr learned my addr 172.21.15.62:0/2764896069 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:32.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2632ffd700 1 -- 172.21.15.62:0/2764896069 >> v1:172.21.15.109:6789/0 conn(0x7f26340b4b40 legacy=0x7f2634144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2632ffd700 1 -- 172.21.15.62:0/2764896069 >> v1:172.21.15.62:6789/0 conn(0x7f26340b46d0 legacy=0x7f2634144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2631ffb700 1 -- 172.21.15.62:0/2764896069 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107196887 0 0) 0x7f263405ce70 con 0x7f26340b46d0 2021-12-17T18:23:32.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2632ffd700 1 -- 172.21.15.62:0/2764896069 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263405ffd0 con 0x7f263405ca90 2021-12-17T18:23:32.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2632ffd700 1 --2- 172.21.15.62:0/2764896069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f263405ca90 0x7f263405f730 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f2628002f70 tx=0x7f2628006df0).ready entity=mon.0 client_cookie=cb5702f84daf24c0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:32.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2631ffb700 1 -- 172.21.15.62:0/2764896069 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262800d610 con 0x7f263405ca90 2021-12-17T18:23:32.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2631ffb700 1 -- 172.21.15.62:0/2764896069 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2628000e90 con 0x7f263405ca90 2021-12-17T18:23:32.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2631ffb700 1 -- 172.21.15.62:0/2764896069 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262800d960 con 0x7f263405ca90 2021-12-17T18:23:32.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2633fff700 1 -- 172.21.15.62:0/2764896069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f263405ca90 msgr2=0x7f263405f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2633fff700 1 --2- 172.21.15.62:0/2764896069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f263405ca90 0x7f263405f730 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f2628002f70 tx=0x7f2628006df0).stop 2021-12-17T18:23:32.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2633fff700 1 -- 172.21.15.62:0/2764896069 shutdown_connections 2021-12-17T18:23:32.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2633fff700 1 --2- 172.21.15.62:0/2764896069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f263405ca90 0x7f263405f730 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2633fff700 1 -- 172.21.15.62:0/2764896069 >> 172.21.15.62:0/2764896069 conn(0x7f263405bcd0 msgr2=0x7f2634062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2633fff700 1 -- 172.21.15.62:0/2764896069 shutdown_connections 2021-12-17T18:23:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2633fff700 1 -- 172.21.15.62:0/2764896069 wait complete. 2021-12-17T18:23:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2633fff700 1 Processor -- start 2021-12-17T18:23:32.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2633fff700 1 -- start start 2021-12-17T18:23:32.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2633fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f263405ca90 0x7f263413d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2633fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340b46d0 0x7f263413b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2633fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26340b4b40 0x7f26340afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2633fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263413fa20 con 0x7f26340b46d0 2021-12-17T18:23:32.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2633fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2634150f90 con 0x7f263405ca90 2021-12-17T18:23:32.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f2633fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26341511c0 con 0x7f26340b4b40 2021-12-17T18:23:32.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.391+0000 7f26327fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340b46d0 0x7f263413b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f2632ffd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f263405ca90 0x7f263413d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f26327fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340b46d0 0x7f263413b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51628/0 (socket says 172.21.15.62:51628) 2021-12-17T18:23:32.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f26327fc700 1 -- 172.21.15.62:0/745954080 learned_addr learned my addr 172.21.15.62:0/745954080 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:32.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f26337fe700 1 --2- 172.21.15.62:0/745954080 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26340b4b40 0x7f26340afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f26327fc700 1 -- 172.21.15.62:0/745954080 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26340b4b40 msgr2=0x7f26340afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f26327fc700 1 --2- 172.21.15.62:0/745954080 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26340b4b40 0x7f26340afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f26327fc700 1 -- 172.21.15.62:0/745954080 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f263405ca90 msgr2=0x7f263413d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f26327fc700 1 --2- 172.21.15.62:0/745954080 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f263405ca90 0x7f263413d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f26327fc700 1 -- 172.21.15.62:0/745954080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262800b180 con 0x7f26340b46d0 2021-12-17T18:23:32.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f26327fc700 1 --2- 172.21.15.62:0/745954080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340b46d0 0x7f263413b430 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f2624000bc0 tx=0x7f2624007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:32.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f2623fff700 1 -- 172.21.15.62:0/745954080 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26240070d0 con 0x7f26340b46d0 2021-12-17T18:23:32.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f2623fff700 1 -- 172.21.15.62:0/745954080 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2624007230 con 0x7f26340b46d0 2021-12-17T18:23:32.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f2633fff700 1 -- 172.21.15.62:0/745954080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f263413c310 con 0x7f26340b46d0 2021-12-17T18:23:32.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f2623fff700 1 -- 172.21.15.62:0/745954080 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2624005610 con 0x7f26340b46d0 2021-12-17T18:23:32.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f2633fff700 1 -- 172.21.15.62:0/745954080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263413b920 con 0x7f26340b46d0 2021-12-17T18:23:32.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f2623fff700 1 -- 172.21.15.62:0/745954080 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2624010070 con 0x7f26340b46d0 2021-12-17T18:23:32.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f2633fff700 1 -- 172.21.15.62:0/745954080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26340b4230 con 0x7f26340b46d0 2021-12-17T18:23:32.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f2623fff700 1 --2- 172.21.15.62:0/745954080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2610053580 0x7f2610055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f2623fff700 1 -- 172.21.15.62:0/745954080 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f262406b090 con 0x7f26340b46d0 2021-12-17T18:23:32.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.395+0000 7f2632ffd700 1 --2- 172.21.15.62:0/745954080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2610053580 0x7f2610055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.399+0000 7f2632ffd700 1 --2- 172.21.15.62:0/745954080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2610053580 0x7f2610055a40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f262801c000 tx=0x7f2628015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:32.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.403+0000 7f2623fff700 1 -- 172.21.15.62:0/745954080 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2624042150 con 0x7f26340b46d0 2021-12-17T18:23:32.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.531+0000 7f2633fff700 1 -- 172.21.15.62:0/745954080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f26340573d0 con 0x7f26340b46d0 2021-12-17T18:23:32.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.535+0000 7f2623fff700 1 -- 172.21.15.62:0/745954080 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v62) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2624045770 con 0x7f26340b46d0 2021-12-17T18:23:32.539 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:23:32.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.535+0000 7f2633fff700 1 -- 172.21.15.62:0/745954080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2610053580 msgr2=0x7f2610055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.535+0000 7f2633fff700 1 --2- 172.21.15.62:0/745954080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2610053580 0x7f2610055a40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f262801c000 tx=0x7f2628015000).stop 2021-12-17T18:23:32.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.535+0000 7f2633fff700 1 -- 172.21.15.62:0/745954080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340b46d0 msgr2=0x7f263413b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.535+0000 7f2633fff700 1 --2- 172.21.15.62:0/745954080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340b46d0 0x7f263413b430 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f2624000bc0 tx=0x7f2624007a60).stop 2021-12-17T18:23:32.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.535+0000 7f2633fff700 1 -- 172.21.15.62:0/745954080 shutdown_connections 2021-12-17T18:23:32.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.535+0000 7f2633fff700 1 --2- 172.21.15.62:0/745954080 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2610053580 0x7f2610055a40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.535+0000 7f2633fff700 1 --2- 172.21.15.62:0/745954080 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26340b4b40 0x7f26340afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.535+0000 7f2633fff700 1 --2- 172.21.15.62:0/745954080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26340b46d0 0x7f263413b430 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.535+0000 7f2633fff700 1 --2- 172.21.15.62:0/745954080 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f263405ca90 0x7f263413d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.535+0000 7f2633fff700 1 -- 172.21.15.62:0/745954080 >> 172.21.15.62:0/745954080 conn(0x7f263405bcd0 msgr2=0x7f26340b6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:32.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.535+0000 7f2633fff700 1 -- 172.21.15.62:0/745954080 shutdown_connections 2021-12-17T18:23:32.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.535+0000 7f2633fff700 1 -- 172.21.15.62:0/745954080 wait complete. 2021-12-17T18:23:32.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:23:32.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f83a04d4700 1 Processor -- start 2021-12-17T18:23:32.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f83a04d4700 1 -- start start 2021-12-17T18:23:32.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f83a04d4700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f83980630e0 0x7f83980b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f83a04d4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f83980b34b0 0x7f839813e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f83a04d4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8398060590 con 0x7f83980601b0 2021-12-17T18:23:32.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f83a04d4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839813f320 con 0x7f83980b34b0 2021-12-17T18:23:32.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f83a04d4700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83980b2320 con 0x7f83980630e0 2021-12-17T18:23:32.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f839ea71700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f83980b34b0 0x7f839813e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f839e270700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f83980601b0 0x7f83980ad770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35214/0 (socket says 172.21.15.62:35214) 2021-12-17T18:23:32.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f839e270700 1 -- 172.21.15.62:0/4218695485 learned_addr learned my addr 172.21.15.62:0/4218695485 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:32.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f839da6f700 1 --2- 172.21.15.62:0/4218695485 >> v2:172.21.15.109:3300/0 conn(0x7f83980630e0 0x7f83980b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f839ea71700 1 -- 172.21.15.62:0/4218695485 >> v2:172.21.15.109:3300/0 conn(0x7f83980630e0 msgr2=0x7f83980b2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:32.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f839ea71700 1 --2- 172.21.15.62:0/4218695485 >> v2:172.21.15.109:3300/0 conn(0x7f83980630e0 0x7f83980b2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f839ea71700 1 -- 172.21.15.62:0/4218695485 >> v1:172.21.15.62:6789/0 conn(0x7f83980601b0 legacy=0x7f83980ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f839d26e700 1 -- 172.21.15.62:0/4218695485 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041184958 0 0) 0x7f8398060590 con 0x7f83980601b0 2021-12-17T18:23:32.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f839ea71700 1 -- 172.21.15.62:0/4218695485 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83980b2880 con 0x7f83980b34b0 2021-12-17T18:23:32.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f839ea71700 1 --2- 172.21.15.62:0/4218695485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83980b34b0 0x7f839813e270 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f8398060720 tx=0x7f83900091d0).ready entity=mon.0 client_cookie=a965d2a3123b0711 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:32.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f839d26e700 1 -- 172.21.15.62:0/4218695485 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f839000b830 con 0x7f83980b34b0 2021-12-17T18:23:32.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f839d26e700 1 -- 172.21.15.62:0/4218695485 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839000b990 con 0x7f83980b34b0 2021-12-17T18:23:32.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f839d26e700 1 -- 172.21.15.62:0/4218695485 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f839000bb00 con 0x7f83980b34b0 2021-12-17T18:23:32.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f83a04d4700 1 -- 172.21.15.62:0/4218695485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83980b34b0 msgr2=0x7f839813e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f83a04d4700 1 --2- 172.21.15.62:0/4218695485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83980b34b0 0x7f839813e270 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f8398060720 tx=0x7f83900091d0).stop 2021-12-17T18:23:32.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f83a04d4700 1 -- 172.21.15.62:0/4218695485 shutdown_connections 2021-12-17T18:23:32.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f83a04d4700 1 --2- 172.21.15.62:0/4218695485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83980b34b0 0x7f839813e270 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f83a04d4700 1 --2- 172.21.15.62:0/4218695485 >> v2:172.21.15.109:3300/0 conn(0x7f83980630e0 0x7f83980b2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f83a04d4700 1 -- 172.21.15.62:0/4218695485 >> 172.21.15.62:0/4218695485 conn(0x7f839805cac0 msgr2=0x7f839805ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:32.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f83a04d4700 1 -- 172.21.15.62:0/4218695485 shutdown_connections 2021-12-17T18:23:32.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.663+0000 7f83a04d4700 1 -- 172.21.15.62:0/4218695485 wait complete. 2021-12-17T18:23:32.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f83a04d4700 1 Processor -- start 2021-12-17T18:23:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f83a04d4700 1 -- start start 2021-12-17T18:23:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f83a04d4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f83980601b0 0x7f839813dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f83a04d4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83980630e0 0x7f8398151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f83a04d4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83980b34b0 0x7f8398066070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f83a04d4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83981544f0 con 0x7f83980630e0 2021-12-17T18:23:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f83a04d4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83980646b0 con 0x7f83980601b0 2021-12-17T18:23:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f83a04d4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8398064950 con 0x7f83980b34b0 2021-12-17T18:23:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f839da6f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83980630e0 0x7f8398151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f839da6f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83980630e0 0x7f8398151540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51642/0 (socket says 172.21.15.62:51642) 2021-12-17T18:23:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f839da6f700 1 -- 172.21.15.62:0/303470337 learned_addr learned my addr 172.21.15.62:0/303470337 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f839e270700 1 --2- 172.21.15.62:0/303470337 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f83980601b0 0x7f839813dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f839ea71700 1 --2- 172.21.15.62:0/303470337 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83980b34b0 0x7f8398066070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f839da6f700 1 -- 172.21.15.62:0/303470337 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83980b34b0 msgr2=0x7f8398066070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f839da6f700 1 --2- 172.21.15.62:0/303470337 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83980b34b0 0x7f8398066070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f839da6f700 1 -- 172.21.15.62:0/303470337 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f83980601b0 msgr2=0x7f839813dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f839da6f700 1 --2- 172.21.15.62:0/303470337 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f83980601b0 0x7f839813dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f839da6f700 1 -- 172.21.15.62:0/303470337 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8390009470 con 0x7f83980630e0 2021-12-17T18:23:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f839e270700 1 --2- 172.21.15.62:0/303470337 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f83980601b0 0x7f839813dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f839da6f700 1 --2- 172.21.15.62:0/303470337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83980630e0 0x7f8398151540 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f838800b000 tx=0x7f8388008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f83877fe700 1 -- 172.21.15.62:0/303470337 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83880107e0 con 0x7f83980630e0 2021-12-17T18:23:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f83877fe700 1 -- 172.21.15.62:0/303470337 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8388010940 con 0x7f83980630e0 2021-12-17T18:23:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f83877fe700 1 -- 172.21.15.62:0/303470337 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8388010ca0 con 0x7f83980630e0 2021-12-17T18:23:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f83a04d4700 1 -- 172.21.15.62:0/303470337 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8398151a30 con 0x7f83980630e0 2021-12-17T18:23:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.667+0000 7f83a04d4700 1 -- 172.21.15.62:0/303470337 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8398154020 con 0x7f83980630e0 2021-12-17T18:23:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.671+0000 7f83877fe700 1 -- 172.21.15.62:0/303470337 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f838800e040 con 0x7f83980630e0 2021-12-17T18:23:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.671+0000 7f83a04d4700 1 -- 172.21.15.62:0/303470337 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8398064b10 con 0x7f83980630e0 2021-12-17T18:23:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.671+0000 7f83877fe700 1 --2- 172.21.15.62:0/303470337 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83780536a0 0x7f8378055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.671+0000 7f83877fe700 1 -- 172.21.15.62:0/303470337 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f838806ba50 con 0x7f83980630e0 2021-12-17T18:23:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.671+0000 7f839e270700 1 --2- 172.21.15.62:0/303470337 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83780536a0 0x7f8378055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.671+0000 7f839e270700 1 --2- 172.21.15.62:0/303470337 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83780536a0 0x7f8378055b60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f839400b000 tx=0x7f8394009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.679+0000 7f83877fe700 1 -- 172.21.15.62:0/303470337 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8388042a40 con 0x7f83980630e0 2021-12-17T18:23:32.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.803+0000 7f83a04d4700 1 -- 172.21.15.62:0/303470337 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83980573d0 con 0x7f83980630e0 2021-12-17T18:23:32.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.807+0000 7f83877fe700 1 -- 172.21.15.62:0/303470337 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v62) v1 ==== 100+0+10 (secure 0 0 0) 0x7f838800b040 con 0x7f83980630e0 2021-12-17T18:23:32.811 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:23:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.807+0000 7f83a04d4700 1 -- 172.21.15.62:0/303470337 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83780536a0 msgr2=0x7f8378055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.807+0000 7f83a04d4700 1 --2- 172.21.15.62:0/303470337 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83780536a0 0x7f8378055b60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f839400b000 tx=0x7f8394009040).stop 2021-12-17T18:23:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.807+0000 7f83a04d4700 1 -- 172.21.15.62:0/303470337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83980630e0 msgr2=0x7f8398151540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.807+0000 7f83a04d4700 1 --2- 172.21.15.62:0/303470337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83980630e0 0x7f8398151540 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f838800b000 tx=0x7f8388008040).stop 2021-12-17T18:23:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.807+0000 7f83a04d4700 1 -- 172.21.15.62:0/303470337 shutdown_connections 2021-12-17T18:23:32.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.807+0000 7f83a04d4700 1 --2- 172.21.15.62:0/303470337 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83780536a0 0x7f8378055b60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.807+0000 7f83a04d4700 1 --2- 172.21.15.62:0/303470337 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83980b34b0 0x7f8398066070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.807+0000 7f83a04d4700 1 --2- 172.21.15.62:0/303470337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83980630e0 0x7f8398151540 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.807+0000 7f83a04d4700 1 --2- 172.21.15.62:0/303470337 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f83980601b0 0x7f839813dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.807+0000 7f83a04d4700 1 -- 172.21.15.62:0/303470337 >> 172.21.15.62:0/303470337 conn(0x7f839805cac0 msgr2=0x7f83980adf80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:32.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.807+0000 7f83a04d4700 1 -- 172.21.15.62:0/303470337 shutdown_connections 2021-12-17T18:23:32.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.807+0000 7f83a04d4700 1 -- 172.21.15.62:0/303470337 wait complete. 2021-12-17T18:23:32.825 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:23:32.825 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:23:32.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.923+0000 7f2f06282700 1 Processor -- start 2021-12-17T18:23:32.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.923+0000 7f2f06282700 1 -- start start 2021-12-17T18:23:32.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f06282700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2f000a7bb0 0x7f2f00067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f06282700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f000b2ce0 con 0x7f2f000b1730 2021-12-17T18:23:32.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f06282700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f000aca60 con 0x7f2f000b21f0 2021-12-17T18:23:32.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f06282700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0014b5b0 con 0x7f2f000a7bb0 2021-12-17T18:23:32.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f0481f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2f000a7bb0 0x7f2f00067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f0481f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2f000a7bb0 0x7f2f00067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51652/0 (socket says 172.21.15.62:51652) 2021-12-17T18:23:32.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f0481f700 1 -- 172.21.15.62:0/2480479562 learned_addr learned my addr 172.21.15.62:0/2480479562 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:32.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2eff7fe700 1 --1- 172.21.15.62:0/2480479562 >> v1:172.21.15.62:6789/0 conn(0x7f2f000b1730 0x7f2f000ace90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35228/0 (socket says 172.21.15.62:35228) 2021-12-17T18:23:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f0481f700 1 -- 172.21.15.62:0/2480479562 >> v1:172.21.15.109:6789/0 conn(0x7f2f000b21f0 legacy=0x7f2f0014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f0481f700 1 -- 172.21.15.62:0/2480479562 >> v1:172.21.15.62:6789/0 conn(0x7f2f000b1730 legacy=0x7f2f000ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f0481f700 1 -- 172.21.15.62:0/2480479562 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f000b2f10 con 0x7f2f000a7bb0 2021-12-17T18:23:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f0481f700 1 --2- 172.21.15.62:0/2480479562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f000a7bb0 0x7f2f00067120 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f2f000b1c00 tx=0x7f2ef8009290).ready entity=mon.0 client_cookie=3220c3dcc1b36b9a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:32.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2efeffd700 1 -- 172.21.15.62:0/2480479562 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ef800b860 con 0x7f2f000a7bb0 2021-12-17T18:23:32.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2efeffd700 1 -- 172.21.15.62:0/2480479562 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef800b9c0 con 0x7f2f000a7bb0 2021-12-17T18:23:32.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2efeffd700 1 -- 172.21.15.62:0/2480479562 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ef800bb30 con 0x7f2f000a7bb0 2021-12-17T18:23:32.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f06282700 1 -- 172.21.15.62:0/2480479562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f000a7bb0 msgr2=0x7f2f00067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f06282700 1 --2- 172.21.15.62:0/2480479562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f000a7bb0 0x7f2f00067120 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f2f000b1c00 tx=0x7f2ef8009290).stop 2021-12-17T18:23:32.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f06282700 1 -- 172.21.15.62:0/2480479562 shutdown_connections 2021-12-17T18:23:32.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f06282700 1 --2- 172.21.15.62:0/2480479562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f000a7bb0 0x7f2f00067120 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f06282700 1 -- 172.21.15.62:0/2480479562 >> 172.21.15.62:0/2480479562 conn(0x7f2f0005f730 msgr2=0x7f2f0005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:32.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f06282700 1 -- 172.21.15.62:0/2480479562 shutdown_connections 2021-12-17T18:23:32.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f06282700 1 -- 172.21.15.62:0/2480479562 wait complete. 2021-12-17T18:23:32.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f06282700 1 Processor -- start 2021-12-17T18:23:32.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.927+0000 7f2f06282700 1 -- start start 2021-12-17T18:23:32.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2f06282700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2f000a7bb0 0x7f2f000633a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2f06282700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f000b1730 0x7f2f00066cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2f06282700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f000b21f0 0x7f2f000671a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2f06282700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f000ab520 con 0x7f2f000b21f0 2021-12-17T18:23:32.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2f06282700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f000ac6b0 con 0x7f2f000a7bb0 2021-12-17T18:23:32.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2f06282700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f00157b30 con 0x7f2f000b1730 2021-12-17T18:23:32.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2efffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2f000a7bb0 0x7f2f000633a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2f0481f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f000b21f0 0x7f2f000671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2efffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2f000a7bb0 0x7f2f000633a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:58204/0 (socket says 172.21.15.62:58204) 2021-12-17T18:23:32.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2efffff700 1 -- 172.21.15.62:0/711990375 learned_addr learned my addr 172.21.15.62:0/711990375 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:32.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2eff7fe700 1 --2- 172.21.15.62:0/711990375 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f000b1730 0x7f2f00066cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2f0481f700 1 -- 172.21.15.62:0/711990375 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f000b1730 msgr2=0x7f2f00066cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2f0481f700 1 --2- 172.21.15.62:0/711990375 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f000b1730 0x7f2f00066cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2f0481f700 1 -- 172.21.15.62:0/711990375 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2f000a7bb0 msgr2=0x7f2f000633a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:32.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2f0481f700 1 --2- 172.21.15.62:0/711990375 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2f000a7bb0 0x7f2f000633a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:32.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2f0481f700 1 -- 172.21.15.62:0/711990375 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef8009530 con 0x7f2f000b21f0 2021-12-17T18:23:32.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2eff7fe700 1 --2- 172.21.15.62:0/711990375 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f000b1730 0x7f2f00066cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:32.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2efffff700 1 --2- 172.21.15.62:0/711990375 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2f000a7bb0 0x7f2f000633a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:32.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2f0481f700 1 --2- 172.21.15.62:0/711990375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f000b21f0 0x7f2f000671a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f2f000b1c00 tx=0x7f2ef8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:32.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2efd7fa700 1 -- 172.21.15.62:0/711990375 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ef800bda0 con 0x7f2f000b21f0 2021-12-17T18:23:32.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2efd7fa700 1 -- 172.21.15.62:0/711990375 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef801f3f0 con 0x7f2f000b21f0 2021-12-17T18:23:32.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2efd7fa700 1 -- 172.21.15.62:0/711990375 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ef801f750 con 0x7f2f000b21f0 2021-12-17T18:23:32.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2f06282700 1 -- 172.21.15.62:0/711990375 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f000ac410 con 0x7f2f000b21f0 2021-12-17T18:23:32.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.931+0000 7f2f06282700 1 -- 172.21.15.62:0/711990375 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0014e450 con 0x7f2f000b21f0 2021-12-17T18:23:32.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.935+0000 7f2f06282700 1 -- 172.21.15.62:0/711990375 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f00157970 con 0x7f2f000b21f0 2021-12-17T18:23:32.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.935+0000 7f2efd7fa700 1 -- 172.21.15.62:0/711990375 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2ef8026030 con 0x7f2f000b21f0 2021-12-17T18:23:32.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.935+0000 7f2efd7fa700 1 --2- 172.21.15.62:0/711990375 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ee00535d0 0x7f2ee0055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:32.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.935+0000 7f2efd7fa700 1 -- 172.21.15.62:0/711990375 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2ef806c610 con 0x7f2f000b21f0 2021-12-17T18:23:32.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.935+0000 7f2efffff700 1 --2- 172.21.15.62:0/711990375 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ee00535d0 0x7f2ee0055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:32.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.935+0000 7f2efffff700 1 --2- 172.21.15.62:0/711990375 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ee00535d0 0x7f2ee0055a90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f2ef400d000 tx=0x7f2ef4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:32.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:32.939+0000 7f2efd7fa700 1 -- 172.21.15.62:0/711990375 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2ef8043750 con 0x7f2f000b21f0 2021-12-17T18:23:33.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:33.103+0000 7f2f06282700 1 -- 172.21.15.62:0/711990375 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f000ad5a0 con 0x7f2f000b21f0 2021-12-17T18:23:33.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:33.103+0000 7f2efd7fa700 1 -- 172.21.15.62:0/711990375 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f2ef8024020 con 0x7f2f000b21f0 2021-12-17T18:23:33.110 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:33.110 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3727734226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3727734226},{"type":"v1","addr":"172.21.15.109:6835","nonce":3727734226}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:23:27.562422+0000","modified":"2021-12-17T18:23:29.262551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5991},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5991":{"gid":5991,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1885234343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1885234343},{"type":"v1","addr":"172.21.15.62:6833","nonce":1885234343}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-12-17T18:23:33.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:33.107+0000 7f2f06282700 1 -- 172.21.15.62:0/711990375 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ee00535d0 msgr2=0x7f2ee0055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:33.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:33.107+0000 7f2f06282700 1 --2- 172.21.15.62:0/711990375 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ee00535d0 0x7f2ee0055a90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f2ef400d000 tx=0x7f2ef4009040).stop 2021-12-17T18:23:33.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:33.107+0000 7f2f06282700 1 -- 172.21.15.62:0/711990375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f000b21f0 msgr2=0x7f2f000671a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:33.107+0000 7f2f06282700 1 --2- 172.21.15.62:0/711990375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f000b21f0 0x7f2f000671a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f2f000b1c00 tx=0x7f2ef8016000).stop 2021-12-17T18:23:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:33.107+0000 7f2f06282700 1 -- 172.21.15.62:0/711990375 shutdown_connections 2021-12-17T18:23:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:33.107+0000 7f2f06282700 1 --2- 172.21.15.62:0/711990375 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ee00535d0 0x7f2ee0055a90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:33.107+0000 7f2f06282700 1 --2- 172.21.15.62:0/711990375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f000b21f0 0x7f2f000671a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:33.107+0000 7f2f06282700 1 --2- 172.21.15.62:0/711990375 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2f000b1730 0x7f2f00066cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:33.107+0000 7f2f06282700 1 --2- 172.21.15.62:0/711990375 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2f000a7bb0 0x7f2f000633a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:33.107+0000 7f2f06282700 1 -- 172.21.15.62:0/711990375 >> 172.21.15.62:0/711990375 conn(0x7f2f0005f730 msgr2=0x7f2f0014adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:33.107+0000 7f2f06282700 1 -- 172.21.15.62:0/711990375 shutdown_connections 2021-12-17T18:23:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:33.107+0000 7f2f06282700 1 -- 172.21.15.62:0/711990375 wait complete. 2021-12-17T18:23:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 27 2021-12-17T18:23:33.325 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:23:27.562422+0000', 'modified': '2021-12-17T18:23:29.262551+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5991}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5991': {'gid': 5991, 'name': 'a', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/1885234343', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 1885234343}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 1885234343}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:23:33.325 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:23:33.326 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:23:33.445 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":5991,"want_state":"up:active","state":"up:active","rank_uptime":5.8695009789999997,"mdsmap_epoch":27,"osdmap_epoch":62,"osdmap_epoch_barrier":61,"uptime":10.929793610000001} 2021-12-17T18:23:33.446 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 5991, "mdsmap_epoch": 27, "osdmap_epoch": 62, "osdmap_epoch_barrier": 61, "rank_uptime": 5.869500979, "state": "up:active", "uptime": 10.92979361, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:23:33.446 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:23:33.447 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-12-17T18:23:33.448 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-12-17T18:23:33.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:33.449 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:23:33.457 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:23:33.471 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:23:33.472 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:23:33.528 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:23:33.529 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:23:33.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:33.532 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:23:33.539 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:23:33.540 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:23:33.585 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:23:33.602 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:23:33.602 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:23:33.612 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:23:33.613 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:23:33.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:33.615 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:23:33.658 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2021-12-17T18:23:33.652+0000 7fbe0281b080 -1 init, newargv = 0x5582bbea9d80 newargc=9ceph-fuse[14400]: starting ceph client 2021-12-17T18:23:33.659 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr: 2021-12-17T18:23:33.668 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14400]: starting fuse 2021-12-17T18:23:34.088 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:23:34.092 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:23:34.094 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:23:34.097 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:23:34.101 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:23:34.764 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:23:34.782 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:23:34.783 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:23:34.843 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:23:34.844 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:23:34.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:34.845 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:23:34.850 INFO:teuthology.orchestra.run.smithi125.stdout:52 2021-12-17T18:23:34.851 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:23:34.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:34.851 DEBUG:teuthology.orchestra.run.smithi125:> sudo python3 -c ' 2021-12-17T18:23:34.852 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2021-12-17T18:23:34.852 DEBUG:teuthology.orchestra.run.smithi125:> import re 2021-12-17T18:23:34.853 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:23:34.853 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2021-12-17T18:23:34.854 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:23:34.854 DEBUG:teuthology.orchestra.run.smithi125:> def find_socket(client_name): 2021-12-17T18:23:34.855 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-12-17T18:23:34.855 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2021-12-17T18:23:34.855 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:23:34.856 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2021-12-17T18:23:34.856 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2021-12-17T18:23:34.857 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2021-12-17T18:23:34.857 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2021-12-17T18:23:34.857 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:23:34.858 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2021-12-17T18:23:34.858 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:23:34.859 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:23:34.859 DEBUG:teuthology.orchestra.run.smithi125:> return f 2021-12-17T18:23:34.859 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:23:34.860 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:23:34.860 DEBUG:teuthology.orchestra.run.smithi125:> print(find_socket("client.0")) 2021-12-17T18:23:34.861 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:23:34.907 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.14400.asok 2021-12-17T18:23:34.912 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14400.asok 2021-12-17T18:23:34.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:34.913 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14400.asok status 2021-12-17T18:23:34.999 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2021-12-17T18:23:34.999 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2021-12-17T18:23:35.000 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:23:35.000 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:23:35.000 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2021-12-17T18:23:35.000 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2021-12-17T18:23:35.001 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-12-17T18:23:35.001 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "14400", 2021-12-17T18:23:35.001 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2021-12-17T18:23:35.001 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:23:35.002 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2021-12-17T18:23:35.002 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2021-12-17T18:23:35.002 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 6109, 2021-12-17T18:23:35.002 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2021-12-17T18:23:35.003 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2021-12-17T18:23:35.003 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2021-12-17T18:23:35.003 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 6109 2021-12-17T18:23:35.003 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:23:35.004 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:23:35.004 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:23:35.004 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:23:35.004 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 1886626333 2021-12-17T18:23:35.004 INFO:teuthology.orchestra.run.smithi125.stdout: } 2021-12-17T18:23:35.005 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:23:35.005 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:23:35.005 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:23:35.005 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:23:35.006 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 1886626333 2021-12-17T18:23:35.006 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:23:35.006 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.6109 172.21.15.125:0/1886626333", 2021-12-17T18:23:35.007 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "172.21.15.125:0/1886626333", 2021-12-17T18:23:35.007 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2021-12-17T18:23:35.007 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 27, 2021-12-17T18:23:35.007 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 62, 2021-12-17T18:23:35.008 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:23:35.008 INFO:teuthology.orchestra.run.smithi125.stdout: "blacklisted": false, 2021-12-17T18:23:35.008 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2021-12-17T18:23:35.008 INFO:teuthology.orchestra.run.smithi125.stdout:} 2021-12-17T18:23:35.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:35.010 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:23:35.010 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:23:35.018 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:23:35.019 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:23:35.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:35.020 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:23:35.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:35.036 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:23:35.037 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:23:35.043 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:23:35.044 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:23:35.045 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-12-17T18:23:35.045 DEBUG:teuthology.orchestra.run.smithi125:> import sys 2021-12-17T18:23:35.046 DEBUG:teuthology.orchestra.run.smithi125:> import time 2021-12-17T18:23:35.046 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:23:35.047 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:23:35.047 DEBUG:teuthology.orchestra.run.smithi125:> n = 1000 2021-12-17T18:23:35.047 DEBUG:teuthology.orchestra.run.smithi125:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-12-17T18:23:35.048 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:23:35.048 DEBUG:teuthology.orchestra.run.smithi125:> if not os.path.exists(os.path.dirname(abs_path)): 2021-12-17T18:23:35.049 DEBUG:teuthology.orchestra.run.smithi125:> os.makedirs(os.path.dirname(abs_path)) 2021-12-17T18:23:35.049 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:23:35.049 DEBUG:teuthology.orchestra.run.smithi125:> for i in range(0, n): 2021-12-17T18:23:35.050 DEBUG:teuthology.orchestra.run.smithi125:> fname = "{0}_{1}".format(abs_path, i) 2021-12-17T18:23:35.050 DEBUG:teuthology.orchestra.run.smithi125:> with open(fname, '"'"'w'"'"') as f: 2021-12-17T18:23:35.051 DEBUG:teuthology.orchestra.run.smithi125:> f.write('"'"'content'"'"') 2021-12-17T18:23:35.051 DEBUG:teuthology.orchestra.run.smithi125:> if True: 2021-12-17T18:23:35.052 DEBUG:teuthology.orchestra.run.smithi125:> f.flush() 2021-12-17T18:23:35.052 DEBUG:teuthology.orchestra.run.smithi125:> os.fsync(f.fileno()) 2021-12-17T18:23:35.052 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:23:46.766 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:23:46.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3fffbcb700 1 Processor -- start 2021-12-17T18:23:46.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3fffbcb700 1 -- start start 2021-12-17T18:23:46.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3fffbcb700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f3ff80b21f0 0x7f3ff814aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:46.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3fffbcb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ff80b1730 0x7f3ff80ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:46.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3fffbcb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3ff80a7bb0 0x7f3ff8067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:46.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3fffbcb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff8147870 con 0x7f3ff80a7bb0 2021-12-17T18:23:46.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3fffbcb700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff80b2ce0 con 0x7f3ff80b21f0 2021-12-17T18:23:46.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3fffbcb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80aca60 con 0x7f3ff80b1730 2021-12-17T18:23:46.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3ffe168700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3ff80a7bb0 0x7f3ff8067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:46.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3ffe168700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3ff80a7bb0 0x7f3ff8067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51664/0 (socket says 172.21.15.62:51664) 2021-12-17T18:23:46.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3ffe168700 1 -- 172.21.15.62:0/2412819901 learned_addr learned my addr 172.21.15.62:0/2412819901 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:46.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3ffd967700 1 --2- 172.21.15.62:0/2412819901 >> v2:172.21.15.109:3300/0 conn(0x7f3ff80b21f0 0x7f3ff814aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:46.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3ffd166700 1 --2- 172.21.15.62:0/2412819901 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ff80b1730 0x7f3ff80ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:46.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3ffe168700 1 -- 172.21.15.62:0/2412819901 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ff80b1730 msgr2=0x7f3ff80ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:46.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3ffe168700 1 --2- 172.21.15.62:0/2412819901 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ff80b1730 0x7f3ff80ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:46.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3ffe168700 1 -- 172.21.15.62:0/2412819901 >> v2:172.21.15.109:3300/0 conn(0x7f3ff80b21f0 msgr2=0x7f3ff814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:46.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3ffe168700 1 --2- 172.21.15.62:0/2412819901 >> v2:172.21.15.109:3300/0 conn(0x7f3ff80b21f0 0x7f3ff814aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:46.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3ffe168700 1 -- 172.21.15.62:0/2412819901 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff80b2f10 con 0x7f3ff80a7bb0 2021-12-17T18:23:46.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3ffd967700 1 --2- 172.21.15.62:0/2412819901 >> v2:172.21.15.109:3300/0 conn(0x7f3ff80b21f0 0x7f3ff814aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:46.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3ffe168700 1 --2- 172.21.15.62:0/2412819901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ff80a7bb0 0x7f3ff8067120 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f3ff0002f70 tx=0x7f3ff0006eb0).ready entity=mon.0 client_cookie=e1b9ea09e2843ceb server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:46.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3ffc965700 1 -- 172.21.15.62:0/2412819901 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ff000d570 con 0x7f3ff80a7bb0 2021-12-17T18:23:46.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3ffc965700 1 -- 172.21.15.62:0/2412819901 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff0000e90 con 0x7f3ff80a7bb0 2021-12-17T18:23:46.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.875+0000 7f3ffc965700 1 -- 172.21.15.62:0/2412819901 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ff000d900 con 0x7f3ff80a7bb0 2021-12-17T18:23:46.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.879+0000 7f3fffbcb700 1 -- 172.21.15.62:0/2412819901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ff80a7bb0 msgr2=0x7f3ff8067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:46.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.879+0000 7f3fffbcb700 1 --2- 172.21.15.62:0/2412819901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ff80a7bb0 0x7f3ff8067120 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f3ff0002f70 tx=0x7f3ff0006eb0).stop 2021-12-17T18:23:46.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.879+0000 7f3fffbcb700 1 -- 172.21.15.62:0/2412819901 shutdown_connections 2021-12-17T18:23:46.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.879+0000 7f3fffbcb700 1 --2- 172.21.15.62:0/2412819901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ff80a7bb0 0x7f3ff8067120 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:46.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.879+0000 7f3fffbcb700 1 --2- 172.21.15.62:0/2412819901 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ff80b1730 0x7f3ff80ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:46.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.879+0000 7f3fffbcb700 1 --2- 172.21.15.62:0/2412819901 >> v2:172.21.15.109:3300/0 conn(0x7f3ff80b21f0 0x7f3ff814aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:46.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.879+0000 7f3fffbcb700 1 -- 172.21.15.62:0/2412819901 >> 172.21.15.62:0/2412819901 conn(0x7f3ff805f730 msgr2=0x7f3ff805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:46.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.879+0000 7f3fffbcb700 1 -- 172.21.15.62:0/2412819901 shutdown_connections 2021-12-17T18:23:46.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.879+0000 7f3fffbcb700 1 -- 172.21.15.62:0/2412819901 wait complete. 2021-12-17T18:23:46.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.879+0000 7f3fffbcb700 1 Processor -- start 2021-12-17T18:23:46.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.879+0000 7f3fffbcb700 1 -- start start 2021-12-17T18:23:46.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3fffbcb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ff80a7bb0 0x7f3ff814eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:46.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3fffbcb700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3ff80b1730 0x7f3ff8067470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:46.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3fffbcb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ff80b21f0 0x7f3ff815a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:46.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3fffbcb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff814be90 con 0x7f3ff80a7bb0 2021-12-17T18:23:46.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3fffbcb700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80abe10 con 0x7f3ff80b1730 2021-12-17T18:23:46.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3fffbcb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80ac0b0 con 0x7f3ff80b21f0 2021-12-17T18:23:46.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3ffd967700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ff80a7bb0 0x7f3ff814eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:46.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3ffd967700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ff80a7bb0 0x7f3ff814eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51666/0 (socket says 172.21.15.62:51666) 2021-12-17T18:23:46.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3ffd967700 1 -- 172.21.15.62:0/2394913857 learned_addr learned my addr 172.21.15.62:0/2394913857 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:46.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3ffd166700 1 --2- 172.21.15.62:0/2394913857 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3ff80b1730 0x7f3ff8067470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:46.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3ffe168700 1 --2- 172.21.15.62:0/2394913857 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ff80b21f0 0x7f3ff815a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:46.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3ffd967700 1 -- 172.21.15.62:0/2394913857 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ff80b21f0 msgr2=0x7f3ff815a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:46.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3ffd967700 1 --2- 172.21.15.62:0/2394913857 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ff80b21f0 0x7f3ff815a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:46.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3ffd967700 1 -- 172.21.15.62:0/2394913857 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3ff80b1730 msgr2=0x7f3ff8067470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:46.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3ffd967700 1 --2- 172.21.15.62:0/2394913857 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3ff80b1730 0x7f3ff8067470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:46.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3ffd967700 1 -- 172.21.15.62:0/2394913857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff000b1e0 con 0x7f3ff80a7bb0 2021-12-17T18:23:46.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3ffd967700 1 --2- 172.21.15.62:0/2394913857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ff80a7bb0 0x7f3ff814eee0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f3fe8006cc0 tx=0x7f3fe8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:46.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3ff6ffd700 1 -- 172.21.15.62:0/2394913857 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fe8011780 con 0x7f3ff80a7bb0 2021-12-17T18:23:46.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3ff6ffd700 1 -- 172.21.15.62:0/2394913857 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe80118e0 con 0x7f3ff80a7bb0 2021-12-17T18:23:46.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3ff6ffd700 1 -- 172.21.15.62:0/2394913857 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fe8011c40 con 0x7f3ff80a7bb0 2021-12-17T18:23:46.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3fffbcb700 1 -- 172.21.15.62:0/2394913857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff80ac350 con 0x7f3ff80a7bb0 2021-12-17T18:23:46.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.883+0000 7f3fffbcb700 1 -- 172.21.15.62:0/2394913857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff814b690 con 0x7f3ff80a7bb0 2021-12-17T18:23:46.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.887+0000 7f3fffbcb700 1 -- 172.21.15.62:0/2394913857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff80573d0 con 0x7f3ff80a7bb0 2021-12-17T18:23:46.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.887+0000 7f3ff6ffd700 1 -- 172.21.15.62:0/2394913857 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3fe8012420 con 0x7f3ff80a7bb0 2021-12-17T18:23:46.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.887+0000 7f3ff6ffd700 1 --2- 172.21.15.62:0/2394913857 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3fdc053580 0x7f3fdc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:46.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.887+0000 7f3ff6ffd700 1 -- 172.21.15.62:0/2394913857 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3fe806b9d0 con 0x7f3ff80a7bb0 2021-12-17T18:23:46.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.887+0000 7f3ffd166700 1 --2- 172.21.15.62:0/2394913857 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3fdc053580 0x7f3fdc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:46.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.887+0000 7f3ffd166700 1 --2- 172.21.15.62:0/2394913857 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3fdc053580 0x7f3fdc055a40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f3fe000c000 tx=0x7f3fe0008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:46.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:46.895+0000 7f3ff6ffd700 1 -- 172.21.15.62:0/2394913857 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3fe8042ad0 con 0x7f3ff80a7bb0 2021-12-17T18:23:47.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.059+0000 7f3fffbcb700 1 -- 172.21.15.62:0/2394913857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ff8067cc0 con 0x7f3ff80a7bb0 2021-12-17T18:23:47.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.059+0000 7f3ff6ffd700 1 -- 172.21.15.62:0/2394913857 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f3fe80460f0 con 0x7f3ff80a7bb0 2021-12-17T18:23:47.067 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:47.067 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3727734226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3727734226},{"type":"v1","addr":"172.21.15.109:6835","nonce":3727734226}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:23:27.562422+0000","modified":"2021-12-17T18:23:29.262551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5991},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5991":{"gid":5991,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1885234343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1885234343},{"type":"v1","addr":"172.21.15.62:6833","nonce":1885234343}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-12-17T18:23:47.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.063+0000 7f3fffbcb700 1 -- 172.21.15.62:0/2394913857 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3fdc053580 msgr2=0x7f3fdc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.063+0000 7f3fffbcb700 1 --2- 172.21.15.62:0/2394913857 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3fdc053580 0x7f3fdc055a40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f3fe000c000 tx=0x7f3fe0008040).stop 2021-12-17T18:23:47.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.063+0000 7f3fffbcb700 1 -- 172.21.15.62:0/2394913857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ff80a7bb0 msgr2=0x7f3ff814eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.063+0000 7f3fffbcb700 1 --2- 172.21.15.62:0/2394913857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ff80a7bb0 0x7f3ff814eee0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f3fe8006cc0 tx=0x7f3fe8008040).stop 2021-12-17T18:23:47.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.063+0000 7f3fffbcb700 1 -- 172.21.15.62:0/2394913857 shutdown_connections 2021-12-17T18:23:47.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.063+0000 7f3fffbcb700 1 --2- 172.21.15.62:0/2394913857 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3fdc053580 0x7f3fdc055a40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.063+0000 7f3fffbcb700 1 --2- 172.21.15.62:0/2394913857 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3ff80b21f0 0x7f3ff815a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.063+0000 7f3fffbcb700 1 --2- 172.21.15.62:0/2394913857 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3ff80b1730 0x7f3ff8067470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.063+0000 7f3fffbcb700 1 --2- 172.21.15.62:0/2394913857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ff80a7bb0 0x7f3ff814eee0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.063+0000 7f3fffbcb700 1 -- 172.21.15.62:0/2394913857 >> 172.21.15.62:0/2394913857 conn(0x7f3ff805f730 msgr2=0x7f3ff8148da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:47.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.063+0000 7f3fffbcb700 1 -- 172.21.15.62:0/2394913857 shutdown_connections 2021-12-17T18:23:47.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.063+0000 7f3fffbcb700 1 -- 172.21.15.62:0/2394913857 wait complete. 2021-12-17T18:23:47.072 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 27 2021-12-17T18:23:47.084 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-12-17T18:23:47.186 INFO:teuthology.orchestra.run.smithi062.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-12-17T18:23:47.187 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-12-17T18:23:47.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:23:47.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a40dc3700 1 Processor -- start 2021-12-17T18:23:47.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a40dc3700 1 -- start start 2021-12-17T18:23:47.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a40dc3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a3c141480 0x7f8a3c147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a40dc3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3c0b6270 con 0x7f8a3c0a8e10 2021-12-17T18:23:47.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a40dc3700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3c147610 con 0x7f8a3c0a71e0 2021-12-17T18:23:47.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a40dc3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c1478b0 con 0x7f8a3c141480 2021-12-17T18:23:47.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a3affd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8a3c0a8e10 0x7f8a3c0b5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35254/0 (socket says 172.21.15.62:35254) 2021-12-17T18:23:47.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a3affd700 1 -- 172.21.15.62:0/1126753210 learned_addr learned my addr 172.21.15.62:0/1126753210 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:47.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a3b7fe700 1 --2- 172.21.15.62:0/1126753210 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a3c141480 0x7f8a3c147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a3a7fc700 1 -- 172.21.15.62:0/1126753210 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673536054 0 0) 0x7f8a3c0b6270 con 0x7f8a3c0a8e10 2021-12-17T18:23:47.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a3a7fc700 1 -- 172.21.15.62:0/1126753210 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a28003260 con 0x7f8a3c0a8e10 2021-12-17T18:23:47.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a3a7fc700 1 -- 172.21.15.62:0/1126753210 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261767944 0 0) 0x7f8a3c147610 con 0x7f8a3c0a71e0 2021-12-17T18:23:47.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a3a7fc700 1 -- 172.21.15.62:0/1126753210 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a3c0b6270 con 0x7f8a3c0a71e0 2021-12-17T18:23:47.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a3a7fc700 1 -- 172.21.15.62:0/1126753210 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2839832183 0 0) 0x7f8a28003260 con 0x7f8a3c0a8e10 2021-12-17T18:23:47.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a3a7fc700 1 -- 172.21.15.62:0/1126753210 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a3c141480 msgr2=0x7f8a3c147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:47.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a3a7fc700 1 --2- 172.21.15.62:0/1126753210 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a3c141480 0x7f8a3c147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a3a7fc700 1 -- 172.21.15.62:0/1126753210 >> v1:172.21.15.109:6789/0 conn(0x7f8a3c0a71e0 legacy=0x7f8a3c0a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a3a7fc700 1 -- 172.21.15.62:0/1126753210 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c147b50 con 0x7f8a3c0a8e10 2021-12-17T18:23:47.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.279+0000 7f8a3a7fc700 1 -- 172.21.15.62:0/1126753210 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f8a2c0019e0 con 0x7f8a3c0a8e10 2021-12-17T18:23:47.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3a7fc700 1 -- 172.21.15.62:0/1126753210 >> v1:172.21.15.62:6789/0 conn(0x7f8a3c0a8e10 legacy=0x7f8a3c0b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3a7fc700 1 --2- 172.21.15.62:0/1126753210 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a28003910 0x7f8a28003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3a7fc700 1 --2- 172.21.15.62:0/1126753210 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a3c141480 0x7f8a28004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3a7fc700 1 --2- 172.21.15.62:0/1126753210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a280049f0 0x7f8a28004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3a7fc700 1 -- 172.21.15.62:0/1126753210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c1478b0 con 0x7f8a280049f0 2021-12-17T18:23:47.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3a7fc700 1 -- 172.21.15.62:0/1126753210 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2800b800 con 0x7f8a28003910 2021-12-17T18:23:47.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3a7fc700 1 -- 172.21.15.62:0/1126753210 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2800b970 con 0x7f8a3c141480 2021-12-17T18:23:47.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3b7fe700 1 --2- 172.21.15.62:0/1126753210 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a28003910 0x7f8a28003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3bfff700 1 --2- 172.21.15.62:0/1126753210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a280049f0 0x7f8a28004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3affd700 1 --2- 172.21.15.62:0/1126753210 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a3c141480 0x7f8a28004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3bfff700 1 -- 172.21.15.62:0/1126753210 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a3c141480 msgr2=0x7f8a28004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:47.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3bfff700 1 --2- 172.21.15.62:0/1126753210 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a3c141480 0x7f8a28004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3bfff700 1 -- 172.21.15.62:0/1126753210 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a28003910 msgr2=0x7f8a28003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:47.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3bfff700 1 --2- 172.21.15.62:0/1126753210 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a28003910 0x7f8a28003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3bfff700 1 -- 172.21.15.62:0/1126753210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a28003260 con 0x7f8a280049f0 2021-12-17T18:23:47.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3bfff700 1 --2- 172.21.15.62:0/1126753210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a280049f0 0x7f8a28004e70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f8a34001110 tx=0x7f8a34007a00).ready entity=mon.0 client_cookie=491d3ca5987d89ef server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:47.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3a7fc700 1 -- 172.21.15.62:0/1126753210 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a34007d10 con 0x7f8a280049f0 2021-12-17T18:23:47.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3a7fc700 1 -- 172.21.15.62:0/1126753210 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a34007030 con 0x7f8a280049f0 2021-12-17T18:23:47.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3a7fc700 1 -- 172.21.15.62:0/1126753210 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a34007390 con 0x7f8a280049f0 2021-12-17T18:23:47.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a40dc3700 1 -- 172.21.15.62:0/1126753210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a280049f0 msgr2=0x7f8a28004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a40dc3700 1 --2- 172.21.15.62:0/1126753210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a280049f0 0x7f8a28004e70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f8a34001110 tx=0x7f8a34007a00).stop 2021-12-17T18:23:47.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a3bfff700 1 -- 172.21.15.62:0/1126753210 reap_dead start 2021-12-17T18:23:47.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a40dc3700 1 -- 172.21.15.62:0/1126753210 shutdown_connections 2021-12-17T18:23:47.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a40dc3700 1 -- 172.21.15.62:0/1126753210 >> 172.21.15.62:0/1126753210 conn(0x7f8a3c05d220 msgr2=0x7f8a3c0b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:47.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a40dc3700 1 -- 172.21.15.62:0/1126753210 shutdown_connections 2021-12-17T18:23:47.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.283+0000 7f8a40dc3700 1 -- 172.21.15.62:0/1126753210 wait complete. 2021-12-17T18:23:47.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a40dc3700 1 Processor -- start 2021-12-17T18:23:47.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a40dc3700 1 -- start start 2021-12-17T18:23:47.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a40dc3700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a280049f0 0x7f8a3c0a7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a40dc3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a3c13d9e0 0x7f8a3c13de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a40dc3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a3c149f40 0x7f8a3c14a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a40dc3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0ac240 con 0x7f8a3c13d9e0 2021-12-17T18:23:47.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a40dc3700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c14b060 con 0x7f8a280049f0 2021-12-17T18:23:47.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a40dc3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c14b300 con 0x7f8a3c149f40 2021-12-17T18:23:47.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a3affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a3c13d9e0 0x7f8a3c13de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a3affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a3c13d9e0 0x7f8a3c13de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51688/0 (socket says 172.21.15.62:51688) 2021-12-17T18:23:47.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a3affd700 1 -- 172.21.15.62:0/3121300379 learned_addr learned my addr 172.21.15.62:0/3121300379 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:47.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a3b7fe700 1 --2- 172.21.15.62:0/3121300379 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a280049f0 0x7f8a3c0a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a3bfff700 1 --2- 172.21.15.62:0/3121300379 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a3c149f40 0x7f8a3c14a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a3affd700 1 -- 172.21.15.62:0/3121300379 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a3c149f40 msgr2=0x7f8a3c14a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a3affd700 1 --2- 172.21.15.62:0/3121300379 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a3c149f40 0x7f8a3c14a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a3affd700 1 -- 172.21.15.62:0/3121300379 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a280049f0 msgr2=0x7f8a3c0a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a3affd700 1 --2- 172.21.15.62:0/3121300379 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a280049f0 0x7f8a3c0a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a3affd700 1 -- 172.21.15.62:0/3121300379 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c0abe80 con 0x7f8a3c13d9e0 2021-12-17T18:23:47.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a3b7fe700 1 --2- 172.21.15.62:0/3121300379 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a280049f0 0x7f8a3c0a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:47.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a3bfff700 1 --2- 172.21.15.62:0/3121300379 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a3c149f40 0x7f8a3c14a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:47.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.287+0000 7f8a3affd700 1 --2- 172.21.15.62:0/3121300379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a3c13d9e0 0x7f8a3c13de60 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f8a2c00d000 tx=0x7f8a2c002060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:47.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.291+0000 7f8a38ff9700 1 -- 172.21.15.62:0/3121300379 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a2c00f7e0 con 0x7f8a3c13d9e0 2021-12-17T18:23:47.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.291+0000 7f8a38ff9700 1 -- 172.21.15.62:0/3121300379 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c00f940 con 0x7f8a3c13d9e0 2021-12-17T18:23:47.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.291+0000 7f8a38ff9700 1 -- 172.21.15.62:0/3121300379 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a2c00fca0 con 0x7f8a3c13d9e0 2021-12-17T18:23:47.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.291+0000 7f8a40dc3700 1 -- 172.21.15.62:0/3121300379 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c0aaa60 con 0x7f8a3c13d9e0 2021-12-17T18:23:47.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.291+0000 7f8a40dc3700 1 -- 172.21.15.62:0/3121300379 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c13e4f0 con 0x7f8a3c13d9e0 2021-12-17T18:23:47.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.291+0000 7f8a38ff9700 1 -- 172.21.15.62:0/3121300379 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8a2c01b030 con 0x7f8a3c13d9e0 2021-12-17T18:23:47.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.291+0000 7f8a40dc3700 1 -- 172.21.15.62:0/3121300379 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3c14b4c0 con 0x7f8a3c13d9e0 2021-12-17T18:23:47.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.291+0000 7f8a38ff9700 1 --2- 172.21.15.62:0/3121300379 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8a1c053640 0x7f8a1c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.291+0000 7f8a38ff9700 1 -- 172.21.15.62:0/3121300379 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8a2c06b7e0 con 0x7f8a3c13d9e0 2021-12-17T18:23:47.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.291+0000 7f8a3b7fe700 1 --2- 172.21.15.62:0/3121300379 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8a1c053640 0x7f8a1c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.291+0000 7f8a3b7fe700 1 --2- 172.21.15.62:0/3121300379 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8a1c053640 0x7f8a1c055b00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f8a3000b000 tx=0x7f8a30008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:47.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.295+0000 7f8a38ff9700 1 -- 172.21.15.62:0/3121300379 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8a2c0427d0 con 0x7f8a3c13d9e0 2021-12-17T18:23:47.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.459+0000 7f8a40dc3700 1 -- 172.21.15.62:0/3121300379 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a3c0ac070 con 0x7f8a3c13d9e0 2021-12-17T18:23:47.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.459+0000 7f8a38ff9700 1 -- 172.21.15.62:0/3121300379 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f8a2c019030 con 0x7f8a3c13d9e0 2021-12-17T18:23:47.466 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:47.466 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3727734226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3727734226},{"type":"v1","addr":"172.21.15.109:6835","nonce":3727734226}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:23:27.562422+0000","modified":"2021-12-17T18:23:29.262551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5991},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5991":{"gid":5991,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1885234343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1885234343},{"type":"v1","addr":"172.21.15.62:6833","nonce":1885234343}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-12-17T18:23:47.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.463+0000 7f8a40dc3700 1 -- 172.21.15.62:0/3121300379 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8a1c053640 msgr2=0x7f8a1c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.463+0000 7f8a40dc3700 1 --2- 172.21.15.62:0/3121300379 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8a1c053640 0x7f8a1c055b00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f8a3000b000 tx=0x7f8a30008040).stop 2021-12-17T18:23:47.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.463+0000 7f8a40dc3700 1 -- 172.21.15.62:0/3121300379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a3c13d9e0 msgr2=0x7f8a3c13de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.463+0000 7f8a40dc3700 1 --2- 172.21.15.62:0/3121300379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a3c13d9e0 0x7f8a3c13de60 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f8a2c00d000 tx=0x7f8a2c002060).stop 2021-12-17T18:23:47.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.463+0000 7f8a40dc3700 1 -- 172.21.15.62:0/3121300379 shutdown_connections 2021-12-17T18:23:47.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.463+0000 7f8a40dc3700 1 --2- 172.21.15.62:0/3121300379 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8a1c053640 0x7f8a1c055b00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.463+0000 7f8a40dc3700 1 --2- 172.21.15.62:0/3121300379 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8a3c149f40 0x7f8a3c14a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.463+0000 7f8a40dc3700 1 --2- 172.21.15.62:0/3121300379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a3c13d9e0 0x7f8a3c13de60 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.463+0000 7f8a40dc3700 1 --2- 172.21.15.62:0/3121300379 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8a280049f0 0x7f8a3c0a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.463+0000 7f8a40dc3700 1 -- 172.21.15.62:0/3121300379 >> 172.21.15.62:0/3121300379 conn(0x7f8a3c05d220 msgr2=0x7f8a3c0b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:47.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.463+0000 7f8a40dc3700 1 -- 172.21.15.62:0/3121300379 shutdown_connections 2021-12-17T18:23:47.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.463+0000 7f8a40dc3700 1 -- 172.21.15.62:0/3121300379 wait complete. 2021-12-17T18:23:47.472 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 27 2021-12-17T18:23:47.483 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-12-17T18:23:47.588 INFO:teuthology.orchestra.run.smithi062.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-12-17T18:23:47.589 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-12-17T18:23:47.589 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:23:47.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.679+0000 7ff7f18a0700 1 Processor -- start 2021-12-17T18:23:47.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.679+0000 7ff7f18a0700 1 -- start start 2021-12-17T18:23:47.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.679+0000 7ff7f18a0700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff7ec0b20b0 0x7ff7ec0af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.679+0000 7ff7f18a0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7ec0b0410 0x7ff7ec140a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.679+0000 7ff7f18a0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7ec0b6df0 con 0x7ff7ec0b6a10 2021-12-17T18:23:47.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.679+0000 7ff7f18a0700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7ec0ae8c0 con 0x7ff7ec0b20b0 2021-12-17T18:23:47.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.679+0000 7ff7f18a0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec0b2be0 con 0x7ff7ec0b0410 2021-12-17T18:23:47.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.679+0000 7ff7eaffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff7ec0b6a10 0x7ff7ec0b24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35274/0 (socket says 172.21.15.62:35274) 2021-12-17T18:23:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.679+0000 7ff7eaffd700 1 -- 172.21.15.62:0/1789395126 learned_addr learned my addr 172.21.15.62:0/1789395126 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.679+0000 7ff7eb7fe700 1 --2- 172.21.15.62:0/1789395126 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7ec0b0410 0x7ff7ec140a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.679+0000 7ff7ea7fc700 1 --2- 172.21.15.62:0/1789395126 >> v2:172.21.15.109:3300/0 conn(0x7ff7ec0b20b0 0x7ff7ec0af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.679+0000 7ff7e9ffb700 1 -- 172.21.15.62:0/1789395126 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488150977 0 0) 0x7ff7ec0b6df0 con 0x7ff7ec0b6a10 2021-12-17T18:23:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.679+0000 7ff7e9ffb700 1 -- 172.21.15.62:0/1789395126 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7d0003260 con 0x7ff7ec0b6a10 2021-12-17T18:23:47.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7e9ffb700 1 -- 172.21.15.62:0/1789395126 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1212176603 0 0) 0x7ff7d0003260 con 0x7ff7ec0b6a10 2021-12-17T18:23:47.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7e9ffb700 1 -- 172.21.15.62:0/1789395126 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7ec0b0410 msgr2=0x7ff7ec140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:47.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7e9ffb700 1 --2- 172.21.15.62:0/1789395126 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7ec0b0410 0x7ff7ec140a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7e9ffb700 1 -- 172.21.15.62:0/1789395126 >> v2:172.21.15.109:3300/0 conn(0x7ff7ec0b20b0 msgr2=0x7ff7ec0af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:47.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7e9ffb700 1 --2- 172.21.15.62:0/1789395126 >> v2:172.21.15.109:3300/0 conn(0x7ff7ec0b20b0 0x7ff7ec0af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7e9ffb700 1 -- 172.21.15.62:0/1789395126 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ec0aa350 con 0x7ff7ec0b6a10 2021-12-17T18:23:47.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7e9ffb700 1 -- 172.21.15.62:0/1789395126 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7ff7e4001a00 con 0x7ff7ec0b6a10 2021-12-17T18:23:47.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7e9ffb700 1 -- 172.21.15.62:0/1789395126 >> v1:172.21.15.62:6789/0 conn(0x7ff7ec0b6a10 legacy=0x7ff7ec0b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7e9ffb700 1 --2- 172.21.15.62:0/1789395126 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff7d0003780 0x7ff7d0003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7e9ffb700 1 --2- 172.21.15.62:0/1789395126 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7ec0b0410 0x7ff7d0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7e9ffb700 1 --2- 172.21.15.62:0/1789395126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d00049f0 0x7ff7d0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7e9ffb700 1 -- 172.21.15.62:0/1789395126 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec0ae8c0 con 0x7ff7d00049f0 2021-12-17T18:23:47.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7e9ffb700 1 -- 172.21.15.62:0/1789395126 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec0b2be0 con 0x7ff7d0003780 2021-12-17T18:23:47.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7e9ffb700 1 -- 172.21.15.62:0/1789395126 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d000b750 con 0x7ff7ec0b0410 2021-12-17T18:23:47.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7eb7fe700 1 --2- 172.21.15.62:0/1789395126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d00049f0 0x7ff7d0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7eaffd700 1 --2- 172.21.15.62:0/1789395126 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff7d0003780 0x7ff7d0003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7ea7fc700 1 --2- 172.21.15.62:0/1789395126 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7ec0b0410 0x7ff7d0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7eb7fe700 1 -- 172.21.15.62:0/1789395126 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7ec0b0410 msgr2=0x7ff7d0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:47.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7eb7fe700 1 --2- 172.21.15.62:0/1789395126 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7ec0b0410 0x7ff7d0004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7eb7fe700 1 -- 172.21.15.62:0/1789395126 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff7d0003780 msgr2=0x7ff7d0003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:47.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7eb7fe700 1 --2- 172.21.15.62:0/1789395126 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff7d0003780 0x7ff7d0003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7eb7fe700 1 -- 172.21.15.62:0/1789395126 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d0003260 con 0x7ff7d00049f0 2021-12-17T18:23:47.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7ea7fc700 1 --2- 172.21.15.62:0/1789395126 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7ec0b0410 0x7ff7d0004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:47.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7eb7fe700 1 --2- 172.21.15.62:0/1789395126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d00049f0 0x7ff7d0004e70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7ff7e000c000 tx=0x7ff7e0006df0).ready entity=mon.0 client_cookie=c2425f381dec85f0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:47.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7e9ffb700 1 -- 172.21.15.62:0/1789395126 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7e000e830 con 0x7ff7d00049f0 2021-12-17T18:23:47.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7e9ffb700 1 -- 172.21.15.62:0/1789395126 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e000e990 con 0x7ff7d00049f0 2021-12-17T18:23:47.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7e9ffb700 1 -- 172.21.15.62:0/1789395126 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7e000ecf0 con 0x7ff7d00049f0 2021-12-17T18:23:47.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7f18a0700 1 -- 172.21.15.62:0/1789395126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d00049f0 msgr2=0x7ff7d0004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7f18a0700 1 --2- 172.21.15.62:0/1789395126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d00049f0 0x7ff7d0004e70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7ff7e000c000 tx=0x7ff7e0006df0).stop 2021-12-17T18:23:47.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7eb7fe700 1 -- 172.21.15.62:0/1789395126 reap_dead start 2021-12-17T18:23:47.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7f18a0700 1 -- 172.21.15.62:0/1789395126 shutdown_connections 2021-12-17T18:23:47.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7f18a0700 1 -- 172.21.15.62:0/1789395126 >> 172.21.15.62:0/1789395126 conn(0x7ff7ec05bcd0 msgr2=0x7ff7ec0638c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:47.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7f18a0700 1 -- 172.21.15.62:0/1789395126 shutdown_connections 2021-12-17T18:23:47.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.683+0000 7ff7f18a0700 1 -- 172.21.15.62:0/1789395126 wait complete. 2021-12-17T18:23:47.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7f18a0700 1 Processor -- start 2021-12-17T18:23:47.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7f18a0700 1 -- start start 2021-12-17T18:23:47.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7f18a0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7ec144bd0 0x7ff7ec13ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7f18a0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7ec0ad640 0x7ff7ec143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7f18a0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff7ec144350 0x7ff7ec139540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7f18a0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec0adae0 con 0x7ff7ec144bd0 2021-12-17T18:23:47.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7f18a0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec144fb0 con 0x7ff7ec144350 2021-12-17T18:23:47.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7f18a0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec0abc20 con 0x7ff7ec0ad640 2021-12-17T18:23:47.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7eaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7ec144bd0 0x7ff7ec13ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7eaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7ec144bd0 0x7ff7ec13ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51706/0 (socket says 172.21.15.62:51706) 2021-12-17T18:23:47.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7eaffd700 1 -- 172.21.15.62:0/3977753867 learned_addr learned my addr 172.21.15.62:0/3977753867 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:47.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7ea7fc700 1 --2- 172.21.15.62:0/3977753867 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7ec0ad640 0x7ff7ec143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7eb7fe700 1 --2- 172.21.15.62:0/3977753867 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff7ec144350 0x7ff7ec139540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7eaffd700 1 -- 172.21.15.62:0/3977753867 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7ec0ad640 msgr2=0x7ff7ec143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7eaffd700 1 --2- 172.21.15.62:0/3977753867 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7ec0ad640 0x7ff7ec143e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7eaffd700 1 -- 172.21.15.62:0/3977753867 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff7ec144350 msgr2=0x7ff7ec139540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7eaffd700 1 --2- 172.21.15.62:0/3977753867 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff7ec144350 0x7ff7ec139540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7eaffd700 1 -- 172.21.15.62:0/3977753867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ec0abec0 con 0x7ff7ec144bd0 2021-12-17T18:23:47.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7eaffd700 1 --2- 172.21.15.62:0/3977753867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7ec144bd0 0x7ff7ec13ec10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7ff7e400d000 tx=0x7ff7ec0af270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:47.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7dbfff700 1 -- 172.21.15.62:0/3977753867 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7e400f7e0 con 0x7ff7ec144bd0 2021-12-17T18:23:47.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7dbfff700 1 -- 172.21.15.62:0/3977753867 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e400f940 con 0x7ff7ec144bd0 2021-12-17T18:23:47.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7f18a0700 1 -- 172.21.15.62:0/3977753867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ec0aa650 con 0x7ff7ec144bd0 2021-12-17T18:23:47.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7dbfff700 1 -- 172.21.15.62:0/3977753867 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7e400fca0 con 0x7ff7ec144bd0 2021-12-17T18:23:47.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.687+0000 7ff7f18a0700 1 -- 172.21.15.62:0/3977753867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ec0aaa00 con 0x7ff7ec144bd0 2021-12-17T18:23:47.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.691+0000 7ff7f18a0700 1 -- 172.21.15.62:0/3977753867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7ec0ac050 con 0x7ff7ec144bd0 2021-12-17T18:23:47.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.691+0000 7ff7dbfff700 1 -- 172.21.15.62:0/3977753867 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff7e401b030 con 0x7ff7ec144bd0 2021-12-17T18:23:47.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.691+0000 7ff7dbfff700 1 --2- 172.21.15.62:0/3977753867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff7c8053640 0x7ff7c8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.691+0000 7ff7dbfff700 1 -- 172.21.15.62:0/3977753867 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff7e406b6d0 con 0x7ff7ec144bd0 2021-12-17T18:23:47.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.691+0000 7ff7ea7fc700 1 --2- 172.21.15.62:0/3977753867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff7c8053640 0x7ff7c8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.691+0000 7ff7ea7fc700 1 --2- 172.21.15.62:0/3977753867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff7c8053640 0x7ff7c8055b00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7ff7dc00b000 tx=0x7ff7dc008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:47.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.695+0000 7ff7dbfff700 1 -- 172.21.15.62:0/3977753867 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff7e4042830 con 0x7ff7ec144bd0 2021-12-17T18:23:47.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.851+0000 7ff7f18a0700 1 -- 172.21.15.62:0/3977753867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7ec0573d0 con 0x7ff7ec144bd0 2021-12-17T18:23:47.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.851+0000 7ff7dbfff700 1 -- 172.21.15.62:0/3977753867 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2143 (secure 0 0 0) 0x7ff7e4019030 con 0x7ff7ec144bd0 2021-12-17T18:23:47.860 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:47.860 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3727734226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3727734226},{"type":"v1","addr":"172.21.15.109:6835","nonce":3727734226}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:23:27.562422+0000","modified":"2021-12-17T18:23:29.262551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5991},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5991":{"gid":5991,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1885234343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1885234343},{"type":"v1","addr":"172.21.15.62:6833","nonce":1885234343}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-12-17T18:23:47.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.855+0000 7ff7f18a0700 1 -- 172.21.15.62:0/3977753867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff7c8053640 msgr2=0x7ff7c8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.855+0000 7ff7f18a0700 1 --2- 172.21.15.62:0/3977753867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff7c8053640 0x7ff7c8055b00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7ff7dc00b000 tx=0x7ff7dc008040).stop 2021-12-17T18:23:47.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.855+0000 7ff7f18a0700 1 -- 172.21.15.62:0/3977753867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7ec144bd0 msgr2=0x7ff7ec13ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.855+0000 7ff7f18a0700 1 --2- 172.21.15.62:0/3977753867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7ec144bd0 0x7ff7ec13ec10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7ff7e400d000 tx=0x7ff7ec0af270).stop 2021-12-17T18:23:47.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.855+0000 7ff7f18a0700 1 -- 172.21.15.62:0/3977753867 shutdown_connections 2021-12-17T18:23:47.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.855+0000 7ff7f18a0700 1 --2- 172.21.15.62:0/3977753867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff7c8053640 0x7ff7c8055b00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.855+0000 7ff7f18a0700 1 --2- 172.21.15.62:0/3977753867 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff7ec144350 0x7ff7ec139540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.855+0000 7ff7f18a0700 1 --2- 172.21.15.62:0/3977753867 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7ec0ad640 0x7ff7ec143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.855+0000 7ff7f18a0700 1 --2- 172.21.15.62:0/3977753867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7ec144bd0 0x7ff7ec13ec10 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.855+0000 7ff7f18a0700 1 -- 172.21.15.62:0/3977753867 >> 172.21.15.62:0/3977753867 conn(0x7ff7ec05bcd0 msgr2=0x7ff7ec1407e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:47.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.855+0000 7ff7f18a0700 1 -- 172.21.15.62:0/3977753867 shutdown_connections 2021-12-17T18:23:47.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.855+0000 7ff7f18a0700 1 -- 172.21.15.62:0/3977753867 wait complete. 2021-12-17T18:23:47.868 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 27 2021-12-17T18:23:47.871 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 10 2021-12-17T18:23:47.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4f0b30c700 1 Processor -- start 2021-12-17T18:23:47.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4f0b30c700 1 -- start start 2021-12-17T18:23:47.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4f0b30c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4f04060650 0x7f4f041473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:47.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4f0b30c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f040aed90 con 0x7f4f0405ccd0 2021-12-17T18:23:47.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4f0b30c700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f040aefc0 con 0x7f4f040b1570 2021-12-17T18:23:47.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4f0b30c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0405d0b0 con 0x7f4f04060650 2021-12-17T18:23:47.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4f090a8700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4f0405ccd0 0x7f4f041479a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35294/0 (socket says 172.21.15.62:35294) 2021-12-17T18:23:47.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4f090a8700 1 -- 172.21.15.62:0/3811468283 learned_addr learned my addr 172.21.15.62:0/3811468283 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:47.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4f098a9700 1 --2- 172.21.15.62:0/3811468283 >> v2:172.21.15.62:3300/0 conn(0x7f4f04060650 0x7f4f041473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:47.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4efbfff700 1 -- 172.21.15.62:0/3811468283 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314471555 0 0) 0x7f4f040aed90 con 0x7f4f0405ccd0 2021-12-17T18:23:47.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4efbfff700 1 -- 172.21.15.62:0/3811468283 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ee8003260 con 0x7f4f0405ccd0 2021-12-17T18:23:47.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4f098a9700 1 -- 172.21.15.62:0/3811468283 >> v1:172.21.15.109:6789/0 conn(0x7f4f040b1570 legacy=0x7f4f0414ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4f098a9700 1 -- 172.21.15.62:0/3811468283 >> v1:172.21.15.62:6789/0 conn(0x7f4f0405ccd0 legacy=0x7f4f041479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4f098a9700 1 -- 172.21.15.62:0/3811468283 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0405d1f0 con 0x7f4f04060650 2021-12-17T18:23:47.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4f098a9700 1 --2- 172.21.15.62:0/3811468283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f04060650 0x7f4f041473c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f4efc0032f0 tx=0x7f4efc0091d0).ready entity=mon.0 client_cookie=490db8e52395f2ba server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:47.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4efbfff700 1 -- 172.21.15.62:0/3811468283 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4efc00b6c0 con 0x7f4f04060650 2021-12-17T18:23:47.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4efbfff700 1 -- 172.21.15.62:0/3811468283 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc00b820 con 0x7f4f04060650 2021-12-17T18:23:47.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.975+0000 7f4efbfff700 1 -- 172.21.15.62:0/3811468283 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4efc00b990 con 0x7f4f04060650 2021-12-17T18:23:47.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f0b30c700 1 -- 172.21.15.62:0/3811468283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f04060650 msgr2=0x7f4f041473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:47.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f0b30c700 1 --2- 172.21.15.62:0/3811468283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f04060650 0x7f4f041473c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f4efc0032f0 tx=0x7f4efc0091d0).stop 2021-12-17T18:23:47.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f0b30c700 1 -- 172.21.15.62:0/3811468283 shutdown_connections 2021-12-17T18:23:47.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f0b30c700 1 --2- 172.21.15.62:0/3811468283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f04060650 0x7f4f041473c0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:47.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f0b30c700 1 -- 172.21.15.62:0/3811468283 >> 172.21.15.62:0/3811468283 conn(0x7f4f0405c750 msgr2=0x7f4f04062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:47.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f0b30c700 1 -- 172.21.15.62:0/3811468283 shutdown_connections 2021-12-17T18:23:47.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f0b30c700 1 -- 172.21.15.62:0/3811468283 wait complete. 2021-12-17T18:23:48.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f0b30c700 1 Processor -- start 2021-12-17T18:23:48.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f0b30c700 1 -- start start 2021-12-17T18:23:48.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f0b30c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0405ccd0 0x7f4f0414c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f0b30c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f04060650 0x7f4f04110460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f0b30c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f040b1570 0x7f4f0415a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f0b30c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f04147490 con 0x7f4f0405ccd0 2021-12-17T18:23:48.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f0b30c700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f04111f20 con 0x7f4f04060650 2021-12-17T18:23:48.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f0b30c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f041116a0 con 0x7f4f040b1570 2021-12-17T18:23:48.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f090a8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0405ccd0 0x7f4f0414c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f090a8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0405ccd0 0x7f4f0414c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51720/0 (socket says 172.21.15.62:51720) 2021-12-17T18:23:48.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f090a8700 1 -- 172.21.15.62:0/2077738767 learned_addr learned my addr 172.21.15.62:0/2077738767 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:48.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f098a9700 1 --2- 172.21.15.62:0/2077738767 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f040b1570 0x7f4f0415a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f088a7700 1 --2- 172.21.15.62:0/2077738767 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f04060650 0x7f4f04110460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f090a8700 1 -- 172.21.15.62:0/2077738767 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f040b1570 msgr2=0x7f4f0415a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:48.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f090a8700 1 --2- 172.21.15.62:0/2077738767 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f040b1570 0x7f4f0415a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f090a8700 1 -- 172.21.15.62:0/2077738767 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f04060650 msgr2=0x7f4f04110460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:48.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f090a8700 1 --2- 172.21.15.62:0/2077738767 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f04060650 0x7f4f04110460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f090a8700 1 -- 172.21.15.62:0/2077738767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc009470 con 0x7f4f0405ccd0 2021-12-17T18:23:48.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f098a9700 1 --2- 172.21.15.62:0/2077738767 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f040b1570 0x7f4f0415a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:48.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f088a7700 1 --2- 172.21.15.62:0/2077738767 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f04060650 0x7f4f04110460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:48.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f090a8700 1 --2- 172.21.15.62:0/2077738767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0405ccd0 0x7f4f0414c5a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f4f00001290 tx=0x7f4f000028b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:48.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4efa7fc700 1 -- 172.21.15.62:0/2077738767 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f000070d0 con 0x7f4f0405ccd0 2021-12-17T18:23:48.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4efa7fc700 1 -- 172.21.15.62:0/2077738767 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f00007230 con 0x7f4f0405ccd0 2021-12-17T18:23:48.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4efa7fc700 1 -- 172.21.15.62:0/2077738767 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f000073a0 con 0x7f4f0405ccd0 2021-12-17T18:23:48.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f0b30c700 1 -- 172.21.15.62:0/2077738767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0410e8f0 con 0x7f4f0405ccd0 2021-12-17T18:23:48.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.979+0000 7f4f0b30c700 1 -- 172.21.15.62:0/2077738767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0414a260 con 0x7f4f0405ccd0 2021-12-17T18:23:48.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.983+0000 7f4efa7fc700 1 -- 172.21.15.62:0/2077738767 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4f00010070 con 0x7f4f0405ccd0 2021-12-17T18:23:48.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.983+0000 7f4efa7fc700 1 --2- 172.21.15.62:0/2077738767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4eec053580 0x7f4eec055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.983+0000 7f4efa7fc700 1 -- 172.21.15.62:0/2077738767 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4f0006b2c0 con 0x7f4f0405ccd0 2021-12-17T18:23:48.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.983+0000 7f4f088a7700 1 --2- 172.21.15.62:0/2077738767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4eec053580 0x7f4eec055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.983+0000 7f4f088a7700 1 --2- 172.21.15.62:0/2077738767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4eec053580 0x7f4eec055a40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f4ef400b000 tx=0x7f4ef4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:48.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f1554f740 1 Processor -- start 2021-12-17T18:23:48.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f1554f740 1 -- start start 2021-12-17T18:23:48.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f1554f740 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0xfbddc0 0xfc3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f1554f740 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfc1d50 0xff8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f1554f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfc4260 0xff90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f1554f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0xf33500 con 0xfc4260 2021-12-17T18:23:48.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f1554f740 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0xf13c70 con 0xfbddc0 2021-12-17T18:23:48.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f1554f740 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0xfc3570 con 0xfc1d50 2021-12-17T18:23:48.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f098a9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfc4260 0xff90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f098a9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfc4260 0xff90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51732/0 (socket says 172.21.15.62:51732) 2021-12-17T18:23:48.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f098a9700 1 -- 172.21.15.62:0/3599667964 learned_addr learned my addr 172.21.15.62:0/3599667964 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:48.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f090a8700 1 --2- 172.21.15.62:0/3599667964 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0xfbddc0 0xfc3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f088a7700 1 --2- 172.21.15.62:0/3599667964 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfc1d50 0xff8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f098a9700 1 -- 172.21.15.62:0/3599667964 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfc1d50 msgr2=0xff8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:48.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f098a9700 1 --2- 172.21.15.62:0/3599667964 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfc1d50 0xff8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f098a9700 1 -- 172.21.15.62:0/3599667964 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0xfbddc0 msgr2=0xfc3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:48.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f098a9700 1 --2- 172.21.15.62:0/3599667964 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0xfbddc0 0xfc3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f098a9700 1 -- 172.21.15.62:0/3599667964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xf6afb0 con 0xfc4260 2021-12-17T18:23:48.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f090a8700 1 --2- 172.21.15.62:0/3599667964 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0xfbddc0 0xfc3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:48.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f098a9700 1 --2- 172.21.15.62:0/3599667964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfc4260 0xff90b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0xfbf460 tx=0x7f4efc016000).ready entity=mon.0 client_cookie=6b96146965d59999 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:48.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f0b30c700 1 -- 172.21.15.62:0/3599667964 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4efc00bc00 con 0xfc4260 2021-12-17T18:23:48.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f0b30c700 1 -- 172.21.15.62:0/3599667964 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc00bd60 con 0xfc4260 2021-12-17T18:23:48.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f0b30c700 1 -- 172.21.15.62:0/3599667964 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4efc0205f0 con 0xfc4260 2021-12-17T18:23:48.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f1554f740 1 -- 172.21.15.62:0/3599667964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfc4260 msgr2=0xff90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:48.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f1554f740 1 --2- 172.21.15.62:0/3599667964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfc4260 0xff90b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0xfbf460 tx=0x7f4efc016000).stop 2021-12-17T18:23:48.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f1554f740 1 -- 172.21.15.62:0/3599667964 shutdown_connections 2021-12-17T18:23:48.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f1554f740 1 --2- 172.21.15.62:0/3599667964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfc4260 0xff90b0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f1554f740 1 --2- 172.21.15.62:0/3599667964 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfc1d50 0xff8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f1554f740 1 --2- 172.21.15.62:0/3599667964 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0xfbddc0 0xfc3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f1554f740 1 -- 172.21.15.62:0/3599667964 >> 172.21.15.62:0/3599667964 conn(0xfbf960 msgr2=0xfc1210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:48.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f1554f740 1 -- 172.21.15.62:0/3599667964 shutdown_connections 2021-12-17T18:23:48.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.987+0000 7f4f1554f740 1 -- 172.21.15.62:0/3599667964 wait complete. 2021-12-17T18:23:48.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 1 -- start start 2021-12-17T18:23:48.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 1 Processor -- start 2021-12-17T18:23:48.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfbddc0 0xff6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfc4260 0xff7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x100ba10 0x1007c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x100bee0 con 0xfbddc0 2021-12-17T18:23:48.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0xff7750 con 0x100ba10 2021-12-17T18:23:48.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0xfc9c30 con 0xfc4260 2021-12-17T18:23:48.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f090a8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfbddc0 0xff6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 10 client.0 ll_register_callbacks cb 0xf7a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-12-17T18:23:48.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f090a8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfbddc0 0xff6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51734/0 (socket says 172.21.15.62:51734) 2021-12-17T18:23:48.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f090a8700 1 -- 172.21.15.62:0/2576394835 learned_addr learned my addr 172.21.15.62:0/2576394835 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:48.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f088a7700 1 --2- 172.21.15.62:0/2576394835 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfc4260 0xff7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f098a9700 1 --2- 172.21.15.62:0/2576394835 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x100ba10 0x1007c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f090a8700 1 -- 172.21.15.62:0/2576394835 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfc4260 msgr2=0xff7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:48.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f090a8700 1 --2- 172.21.15.62:0/2576394835 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfc4260 0xff7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f090a8700 1 -- 172.21.15.62:0/2576394835 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x100ba10 msgr2=0x1007c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:48.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f090a8700 1 --2- 172.21.15.62:0/2576394835 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x100ba10 0x1007c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f090a8700 1 -- 172.21.15.62:0/2576394835 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0405d1f0 con 0xfbddc0 2021-12-17T18:23:48.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f098a9700 1 --2- 172.21.15.62:0/2576394835 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x100ba10 0x1007c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:48.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f090a8700 1 --2- 172.21.15.62:0/2576394835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfbddc0 0xff6d70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f4f0004a000 tx=0x7f4f00010000).ready entity=mon.0 client_cookie=92aae9685ada53b2 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:48.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4edffff700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2021-12-17T18:23:48.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4edffff700 1 -- 172.21.15.62:0/2576394835 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f0004f070 con 0xfbddc0 2021-12-17T18:23:48.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4edffff700 1 -- 172.21.15.62:0/2576394835 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4f00045250 con 0xfbddc0 2021-12-17T18:23:48.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 1 -- 172.21.15.62:0/2576394835 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xf295c0 con 0xfbddc0 2021-12-17T18:23:48.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4edffff700 1 -- 172.21.15.62:0/2576394835 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f00045410 con 0xfbddc0 2021-12-17T18:23:48.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 10 client.6198 fetch_fsmap learned FSMap version 27 2021-12-17T18:23:48.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 1 -- 172.21.15.62:0/2576394835 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0xf22ea0 con 0xfbddc0 2021-12-17T18:23:48.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4edffff700 1 -- 172.21.15.62:0/2576394835 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xf295c0 con 0xfbddc0 2021-12-17T18:23:48.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4edffff700 1 -- 172.21.15.62:0/2576394835 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 27) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f4f00052020 con 0xfbddc0 2021-12-17T18:23:48.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 10 client.6198 fetch_fsmap finished waiting for FSMap version 27 2021-12-17T18:23:48.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 10 client.6198 resolve_mds: resolved ID 'a' to GID 5991 2021-12-17T18:23:48.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 20 client.6198 populate_metadata read hostname 'smithi062' 2021-12-17T18:23:48.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 1 --2- 172.21.15.62:0/2576394835 >> [v2:172.21.15.62:6832/1885234343,v1:172.21.15.62:6833/1885234343] conn(0x1008120 0x1008500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 4 client.6198 mds_command: new command op to 5991 tid=0[{"prefix": "get_command_descriptions"}] 2021-12-17T18:23:48.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.991+0000 7f4f1554f740 1 -- 172.21.15.62:0/2576394835 --> [v2:172.21.15.62:6832/1885234343,v1:172.21.15.62:6833/1885234343] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xf21930 con 0x1008120 2021-12-17T18:23:48.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4f088a7700 1 --2- 172.21.15.62:0/2576394835 >> [v2:172.21.15.62:6832/1885234343,v1:172.21.15.62:6833/1885234343] conn(0x1008120 0x1008500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4f088a7700 1 --2- 172.21.15.62:0/2576394835 >> [v2:172.21.15.62:6832/1885234343,v1:172.21.15.62:6833/1885234343] conn(0x1008120 0x1008500 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3433a156827c9f59 server_cookie=898e4a9e1352c450 in_seq=0 out_seq=0 2021-12-17T18:23:48.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4edffff700 10 client.6198 ms_handle_connect on v2:172.21.15.62:6832/1885234343 2021-12-17T18:23:48.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4edffff700 1 -- 172.21.15.62:0/2576394835 <== mds.0 v2:172.21.15.62:6832/1885234343 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0xf21930 con 0x1008120 2021-12-17T18:23:48.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4edffff700 10 client.6198 handle_command_reply: tid=0 2021-12-17T18:23:48.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4f1554f740 1 client.6198 shutdown 2021-12-17T18:23:48.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4f1554f740 1 -- 172.21.15.62:0/2576394835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfbddc0 msgr2=0xff6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:48.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4f1554f740 1 --2- 172.21.15.62:0/2576394835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfbddc0 0xff6d70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f4f0004a000 tx=0x7f4f00010000).stop 2021-12-17T18:23:48.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4f1554f740 1 -- 172.21.15.62:0/2576394835 shutdown_connections 2021-12-17T18:23:48.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4f1554f740 1 --2- 172.21.15.62:0/2576394835 >> [v2:172.21.15.62:6832/1885234343,v1:172.21.15.62:6833/1885234343] conn(0x1008120 0x1008500 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4f1554f740 1 --2- 172.21.15.62:0/2576394835 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x100ba10 0x1007c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4edffff700 0 client.6198 ms_handle_reset on v2:172.21.15.62:6832/1885234343 2021-12-17T18:23:48.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4f1554f740 1 --2- 172.21.15.62:0/2576394835 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfc4260 0xff7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4f1554f740 1 --2- 172.21.15.62:0/2576394835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfbddc0 0xff6d70 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4f1554f740 1 -- 172.21.15.62:0/2576394835 >> 172.21.15.62:0/2576394835 conn(0xfbf960 msgr2=0xfc5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:48.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4f1554f740 1 -- 172.21.15.62:0/2576394835 shutdown_connections 2021-12-17T18:23:48.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4f1554f740 1 -- 172.21.15.62:0/2576394835 wait complete. 2021-12-17T18:23:48.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:47.995+0000 7f4f1554f740 20 client.6198 trim_cache size 0 max 16384 2021-12-17T18:23:48.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f1554f740 1 Processor -- start 2021-12-17T18:23:48.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f1554f740 1 -- start start 2021-12-17T18:23:48.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f1554f740 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0xfbddc0 0xfc11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f1554f740 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfc4260 0xff68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f1554f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x100ba10 0xff6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f1554f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0xfc2980 con 0x100ba10 2021-12-17T18:23:48.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f1554f740 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0xf34bb0 con 0xfbddc0 2021-12-17T18:23:48.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f1554f740 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0xfbf220 con 0xfc4260 2021-12-17T18:23:48.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f098a9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x100ba10 0xff6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f098a9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x100ba10 0xff6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51746/0 (socket says 172.21.15.62:51746) 2021-12-17T18:23:48.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f098a9700 1 -- 172.21.15.62:0/2437347777 learned_addr learned my addr 172.21.15.62:0/2437347777 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:48.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f088a7700 1 --2- 172.21.15.62:0/2437347777 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfc4260 0xff68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f090a8700 1 --2- 172.21.15.62:0/2437347777 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0xfbddc0 0xfc11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f098a9700 1 -- 172.21.15.62:0/2437347777 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfc4260 msgr2=0xff68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:48.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f098a9700 1 --2- 172.21.15.62:0/2437347777 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfc4260 0xff68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f098a9700 1 -- 172.21.15.62:0/2437347777 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0xfbddc0 msgr2=0xfc11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:48.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f098a9700 1 --2- 172.21.15.62:0/2437347777 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0xfbddc0 0xfc11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f098a9700 1 -- 172.21.15.62:0/2437347777 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xf2b7a0 con 0x100ba10 2021-12-17T18:23:48.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f098a9700 1 --2- 172.21.15.62:0/2437347777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x100ba10 0xff6da0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f4efc026000 tx=0x7f4efc01e000).ready entity=mon.0 client_cookie=e23537599eb8868a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:48.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4ee67fc700 1 -- 172.21.15.62:0/2437347777 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4efc0032e0 con 0x100ba10 2021-12-17T18:23:48.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4ee67fc700 1 -- 172.21.15.62:0/2437347777 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc00b990 con 0x100ba10 2021-12-17T18:23:48.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4ee67fc700 1 -- 172.21.15.62:0/2437347777 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4efc00bb00 con 0x100ba10 2021-12-17T18:23:48.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f1554f740 1 -- 172.21.15.62:0/2437347777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x100ba10 msgr2=0xff6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:48.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f1554f740 1 --2- 172.21.15.62:0/2437347777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x100ba10 0xff6da0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f4efc026000 tx=0x7f4efc01e000).stop 2021-12-17T18:23:48.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f1554f740 1 -- 172.21.15.62:0/2437347777 shutdown_connections 2021-12-17T18:23:48.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f1554f740 1 --2- 172.21.15.62:0/2437347777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x100ba10 0xff6da0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f1554f740 1 --2- 172.21.15.62:0/2437347777 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfc4260 0xff68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f1554f740 1 --2- 172.21.15.62:0/2437347777 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0xfbddc0 0xfc11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f1554f740 1 -- 172.21.15.62:0/2437347777 >> 172.21.15.62:0/2437347777 conn(0xfbf960 msgr2=0xfc07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:48.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f1554f740 1 -- 172.21.15.62:0/2437347777 shutdown_connections 2021-12-17T18:23:48.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.011+0000 7f4f1554f740 1 -- 172.21.15.62:0/2437347777 wait complete. 2021-12-17T18:23:48.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f1554f740 1 -- start start 2021-12-17T18:23:48.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f1554f740 1 Processor -- start 2021-12-17T18:23:48.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f1554f740 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfbddc0 0x105acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f1554f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfc4260 0x105b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f1554f740 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x100ba10 0x105ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f1554f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0xfcb580 con 0xfc4260 2021-12-17T18:23:48.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f1554f740 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0xfc0050 con 0x100ba10 2021-12-17T18:23:48.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f1554f740 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0xfc5c00 con 0xfbddc0 2021-12-17T18:23:48.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f1554f740 10 client.0 ll_register_callbacks cb 0xfcc6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-12-17T18:23:48.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f088a7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfc4260 0x105b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f088a7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfc4260 0x105b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51750/0 (socket says 172.21.15.62:51750) 2021-12-17T18:23:48.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f088a7700 1 -- 172.21.15.62:0/160238853 learned_addr learned my addr 172.21.15.62:0/160238853 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:48.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f098a9700 1 --2- 172.21.15.62:0/160238853 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x100ba10 0x105ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f090a8700 1 --2- 172.21.15.62:0/160238853 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfbddc0 0x105acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f088a7700 1 -- 172.21.15.62:0/160238853 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfbddc0 msgr2=0x105acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:48.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f088a7700 1 --2- 172.21.15.62:0/160238853 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfbddc0 0x105acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f088a7700 1 -- 172.21.15.62:0/160238853 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x100ba10 msgr2=0x105ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:48.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f088a7700 1 --2- 172.21.15.62:0/160238853 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x100ba10 0x105ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:48.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f088a7700 1 -- 172.21.15.62:0/160238853 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xf6afb0 con 0xfc4260 2021-12-17T18:23:48.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f098a9700 1 --2- 172.21.15.62:0/160238853 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x100ba10 0x105ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:48.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f088a7700 1 --2- 172.21.15.62:0/160238853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfc4260 0x105b1e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f4ef401a000 tx=0x7f4ef401a040).ready entity=mon.0 client_cookie=7b65c935416450c9 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:48.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4ee57fa700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2021-12-17T18:23:48.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4ee57fa700 1 -- 172.21.15.62:0/160238853 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ef4028030 con 0xfc4260 2021-12-17T18:23:48.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4ee57fa700 1 -- 172.21.15.62:0/160238853 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4ef4029070 con 0xfc4260 2021-12-17T18:23:48.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f1554f740 1 -- 172.21.15.62:0/160238853 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4efc00bd60 con 0xfc4260 2021-12-17T18:23:48.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4ee57fa700 1 -- 172.21.15.62:0/160238853 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ef401d070 con 0xfc4260 2021-12-17T18:23:48.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f1554f740 10 client.6204 fetch_fsmap learned FSMap version 27 2021-12-17T18:23:48.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f1554f740 1 -- 172.21.15.62:0/160238853 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0xf28190 con 0xfc4260 2021-12-17T18:23:48.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4ee57fa700 1 -- 172.21.15.62:0/160238853 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc00bd60 con 0xfc4260 2021-12-17T18:23:48.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4ee57fa700 1 -- 172.21.15.62:0/160238853 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 27) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f4ef40244d0 con 0xfc4260 2021-12-17T18:23:48.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.015+0000 7f4f1554f740 10 client.6204 fetch_fsmap finished waiting for FSMap version 27 2021-12-17T18:23:48.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.019+0000 7f4f1554f740 10 client.6204 resolve_mds: resolved ID 'a' to GID 5991 2021-12-17T18:23:48.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.019+0000 7f4f1554f740 20 client.6204 populate_metadata read hostname 'smithi062' 2021-12-17T18:23:48.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.019+0000 7f4f1554f740 1 --2- 172.21.15.62:0/160238853 >> [v2:172.21.15.62:6832/1885234343,v1:172.21.15.62:6833/1885234343] conn(0x105f370 0x105f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:48.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.019+0000 7f4f1554f740 4 client.6204 mds_command: new command op to 5991 tid=0[{"prefix": "cache drop", "timeout": 10}] 2021-12-17T18:23:48.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.019+0000 7f4f1554f740 1 -- 172.21.15.62:0/160238853 --> [v2:172.21.15.62:6832/1885234343,v1:172.21.15.62:6833/1885234343] -- command(tid 0: {"prefix": "cache drop", "timeout": 10}) v1 -- 0xe175e0 con 0x105f370 2021-12-17T18:23:48.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.019+0000 7f4f090a8700 1 --2- 172.21.15.62:0/160238853 >> [v2:172.21.15.62:6832/1885234343,v1:172.21.15.62:6833/1885234343] conn(0x105f370 0x105f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:48.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.019+0000 7f4ee57fa700 10 client.6204 ms_handle_connect on v2:172.21.15.62:6832/1885234343 2021-12-17T18:23:48.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:48.019+0000 7f4f090a8700 1 --2- 172.21.15.62:0/160238853 >> [v2:172.21.15.62:6832/1885234343,v1:172.21.15.62:6833/1885234343] conn(0x105f370 0x105f750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=53768089c409221a server_cookie=524600e19ab34f9 in_seq=0 out_seq=0 2021-12-17T18:23:58.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4ee57fa700 1 -- 172.21.15.62:0/160238853 <== mds.0 v2:172.21.15.62:6832/1885234343 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+406 (crc 0 0 0) 0xe175e0 con 0x105f370 2021-12-17T18:23:58.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4ee57fa700 10 client.6204 handle_command_reply: tid=0 2021-12-17T18:23:58.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f1554f740 1 client.6204 shutdown 2021-12-17T18:23:58.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f1554f740 1 -- 172.21.15.62:0/160238853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfc4260 msgr2=0x105b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:58.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f1554f740 1 --2- 172.21.15.62:0/160238853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfc4260 0x105b1e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f4ef401a000 tx=0x7f4ef401a040).stop 2021-12-17T18:23:58.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f1554f740 1 -- 172.21.15.62:0/160238853 shutdown_connections 2021-12-17T18:23:58.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f1554f740 1 --2- 172.21.15.62:0/160238853 >> [v2:172.21.15.62:6832/1885234343,v1:172.21.15.62:6833/1885234343] conn(0x105f370 0x105f750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:58.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f1554f740 1 --2- 172.21.15.62:0/160238853 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x100ba10 0x105ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:58.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4ee57fa700 0 client.6204 ms_handle_reset on v2:172.21.15.62:6832/1885234343 2021-12-17T18:23:58.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f1554f740 1 --2- 172.21.15.62:0/160238853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0xfc4260 0x105b1e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:58.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f1554f740 1 --2- 172.21.15.62:0/160238853 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0xfbddc0 0x105acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:58.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f1554f740 1 -- 172.21.15.62:0/160238853 >> 172.21.15.62:0/160238853 conn(0xfbf960 msgr2=0xfc11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:58.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f1554f740 1 -- 172.21.15.62:0/160238853 shutdown_connections 2021-12-17T18:23:58.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f1554f740 1 -- 172.21.15.62:0/160238853 wait complete. 2021-12-17T18:23:58.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f1554f740 20 client.6204 trim_cache size 0 max 16384 2021-12-17T18:23:58.262 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:23:58.262 INFO:teuthology.orchestra.run.smithi062.stdout: "client_recall": { 2021-12-17T18:23:58.262 INFO:teuthology.orchestra.run.smithi062.stdout: "return_code": -110, 2021-12-17T18:23:58.262 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "(110) Connection timed out", 2021-12-17T18:23:58.263 INFO:teuthology.orchestra.run.smithi062.stdout: "recalled": 240 2021-12-17T18:23:58.263 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:58.263 INFO:teuthology.orchestra.run.smithi062.stdout: "flush_journal": { 2021-12-17T18:23:58.263 INFO:teuthology.orchestra.run.smithi062.stdout: "return_code": 0, 2021-12-17T18:23:58.264 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "" 2021-12-17T18:23:58.264 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:58.264 INFO:teuthology.orchestra.run.smithi062.stdout: "trim_cache": { 2021-12-17T18:23:58.264 INFO:teuthology.orchestra.run.smithi062.stdout: "trimmed": 220 2021-12-17T18:23:58.264 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:58.265 INFO:teuthology.orchestra.run.smithi062.stdout: "cache": { 2021-12-17T18:23:58.265 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": { 2021-12-17T18:23:58.265 INFO:teuthology.orchestra.run.smithi062.stdout: "items": 15418, 2021-12-17T18:23:58.265 INFO:teuthology.orchestra.run.smithi062.stdout: "bytes": 2428224 2021-12-17T18:23:58.266 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:58.266 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:58.266 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 10.232952173999999 2021-12-17T18:23:58.266 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:23:58.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f0b30c700 1 -- 172.21.15.62:0/2077738767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4eec053580 msgr2=0x7f4eec055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:58.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f0b30c700 1 --2- 172.21.15.62:0/2077738767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4eec053580 0x7f4eec055a40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f4ef400b000 tx=0x7f4ef4009040).stop 2021-12-17T18:23:58.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f0b30c700 1 -- 172.21.15.62:0/2077738767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0405ccd0 msgr2=0x7f4f0414c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:58.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f0b30c700 1 --2- 172.21.15.62:0/2077738767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0405ccd0 0x7f4f0414c5a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f4f00001290 tx=0x7f4f000028b0).stop 2021-12-17T18:23:58.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f0b30c700 1 -- 172.21.15.62:0/2077738767 shutdown_connections 2021-12-17T18:23:58.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f0b30c700 1 --2- 172.21.15.62:0/2077738767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4eec053580 0x7f4eec055a40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:58.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f0b30c700 1 --2- 172.21.15.62:0/2077738767 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f040b1570 0x7f4f0415a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:58.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f0b30c700 1 --2- 172.21.15.62:0/2077738767 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f04060650 0x7f4f04110460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:58.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.250+0000 7f4f0b30c700 1 --2- 172.21.15.62:0/2077738767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0405ccd0 0x7f4f0414c5a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.254+0000 7f4f0b30c700 1 -- 172.21.15.62:0/2077738767 >> 172.21.15.62:0/2077738767 conn(0x7f4f0405c750 msgr2=0x7f4f0414ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.254+0000 7f4f0b30c700 1 -- 172.21.15.62:0/2077738767 shutdown_connections 2021-12-17T18:23:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.254+0000 7f4f0b30c700 1 -- 172.21.15.62:0/2077738767 wait complete. 2021-12-17T18:23:58.271 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:23:58.272 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:23:58.289 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:23:58.308 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:23:58.330 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:23:58.353 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:23:58.375 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:23:58.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:58.376 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:23:58.376 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:23:58.385 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:23:58.386 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:23:58.387 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:23:58.387 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:23:58.387 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:23:58.445 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14400]: fuse finished with error 0 and tester_r 0 2021-12-17T18:23:58.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:58.449 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:23:58.450 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:23:58.456 INFO:teuthology.orchestra.run.smithi125.stdout:ext2/ext3 2021-12-17T18:23:58.457 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:23:58.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:23:58.573 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:23:58.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:58.622 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:23:58.622 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:23:58.630 INFO:teuthology.orchestra.run.smithi158.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:23:58.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:23:58.631 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-12-17T18:23:58.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:23:58.632 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:23:58.680 INFO:teuthology.orchestra.run.smithi158.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:23:58.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:23:58.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:23:58.682 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:23:58.683 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:23:58.690 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:23:58.691 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:23:58.692 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:23:58.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:23:58.693 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:23:58.700 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:23:58.700 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:23:58.701 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:23:58.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81d2184700 1 Processor -- start 2021-12-17T18:23:58.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81d2184700 1 -- start start 2021-12-17T18:23:58.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81d2184700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f81cc05f8d0 0x7f81cc0b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:58.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81d2184700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81cc0b2ed0 0x7f81cc0aec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:58.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81d2184700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81cc0ae4e0 con 0x7f81cc0af370 2021-12-17T18:23:58.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81d2184700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81cc0ae780 con 0x7f81cc05f8d0 2021-12-17T18:23:58.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81d2184700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0af110 con 0x7f81cc0b2ed0 2021-12-17T18:23:58.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81cb7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f81cc05f8d0 0x7f81cc0b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:58.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81cb7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f81cc05f8d0 0x7f81cc0b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51758/0 (socket says 172.21.15.62:51758) 2021-12-17T18:23:58.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81cb7fe700 1 -- 172.21.15.62:0/1333248543 learned_addr learned my addr 172.21.15.62:0/1333248543 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:58.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81cbfff700 1 --1- 172.21.15.62:0/1333248543 >> v1:172.21.15.62:6789/0 conn(0x7f81cc0af370 0x7f81cc0b66d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35342/0 (socket says 172.21.15.62:35342) 2021-12-17T18:23:58.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81caffd700 1 --2- 172.21.15.62:0/1333248543 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81cc0b2ed0 0x7f81cc0aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:58.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81cb7fe700 1 -- 172.21.15.62:0/1333248543 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81cc0b2ed0 msgr2=0x7f81cc0aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:58.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81cb7fe700 1 --2- 172.21.15.62:0/1333248543 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81cc0b2ed0 0x7f81cc0aec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:58.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81cb7fe700 1 -- 172.21.15.62:0/1333248543 >> v1:172.21.15.62:6789/0 conn(0x7f81cc0af370 legacy=0x7f81cc0b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:58.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81ca7fc700 1 -- 172.21.15.62:0/1333248543 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2099235388 0 0) 0x7f81cc0ae4e0 con 0x7f81cc0af370 2021-12-17T18:23:58.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81cb7fe700 1 -- 172.21.15.62:0/1333248543 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc0b12e0 con 0x7f81cc05f8d0 2021-12-17T18:23:58.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81caffd700 1 --2- 172.21.15.62:0/1333248543 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81cc0b2ed0 0x7f81cc0aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:58.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81cb7fe700 1 --2- 172.21.15.62:0/1333248543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81cc05f8d0 0x7f81cc0b36b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f81b4002f70 tx=0x7f81b4006eb0).ready entity=mon.0 client_cookie=34a49b967333b64d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:58.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81ca7fc700 1 -- 172.21.15.62:0/1333248543 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81b400d5c0 con 0x7f81cc05f8d0 2021-12-17T18:23:58.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81ca7fc700 1 -- 172.21.15.62:0/1333248543 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b4000e90 con 0x7f81cc05f8d0 2021-12-17T18:23:58.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81ca7fc700 1 -- 172.21.15.62:0/1333248543 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81b400d910 con 0x7f81cc05f8d0 2021-12-17T18:23:58.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81d2184700 1 -- 172.21.15.62:0/1333248543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81cc05f8d0 msgr2=0x7f81cc0b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:58.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81d2184700 1 --2- 172.21.15.62:0/1333248543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81cc05f8d0 0x7f81cc0b36b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f81b4002f70 tx=0x7f81b4006eb0).stop 2021-12-17T18:23:58.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81d2184700 1 -- 172.21.15.62:0/1333248543 shutdown_connections 2021-12-17T18:23:58.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81d2184700 1 --2- 172.21.15.62:0/1333248543 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81cc0b2ed0 0x7f81cc0aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:58.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81d2184700 1 --2- 172.21.15.62:0/1333248543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81cc05f8d0 0x7f81cc0b36b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:58.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81d2184700 1 -- 172.21.15.62:0/1333248543 >> 172.21.15.62:0/1333248543 conn(0x7f81cc05bcd0 msgr2=0x7f81cc0638c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:58.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81d2184700 1 -- 172.21.15.62:0/1333248543 shutdown_connections 2021-12-17T18:23:58.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.806+0000 7f81d2184700 1 -- 172.21.15.62:0/1333248543 wait complete. 2021-12-17T18:23:58.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.810+0000 7f81d2184700 1 Processor -- start 2021-12-17T18:23:58.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.810+0000 7f81d2184700 1 -- start start 2021-12-17T18:23:58.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.810+0000 7f81d2184700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81cc05f8d0 0x7f81cc067940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:58.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.810+0000 7f81d2184700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f81cc0af370 0x7f81cc0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:58.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.810+0000 7f81d2184700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81cc0b2ed0 0x7f81cc15a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:58.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.810+0000 7f81d2184700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc066d50 con 0x7f81cc0b2ed0 2021-12-17T18:23:58.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.810+0000 7f81d2184700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc15a620 con 0x7f81cc0af370 2021-12-17T18:23:58.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.810+0000 7f81d2184700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc066ab0 con 0x7f81cc05f8d0 2021-12-17T18:23:58.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.810+0000 7f81cbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81cc0b2ed0 0x7f81cc15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:58.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.810+0000 7f81cb7fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81cc05f8d0 0x7f81cc067940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:58.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.810+0000 7f81cbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81cc0b2ed0 0x7f81cc15a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51768/0 (socket says 172.21.15.62:51768) 2021-12-17T18:23:58.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81cb7fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81cc05f8d0 0x7f81cc067940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:45466/0 (socket says 172.21.15.62:45466) 2021-12-17T18:23:58.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81cb7fe700 1 -- 172.21.15.62:0/2885188082 learned_addr learned my addr 172.21.15.62:0/2885188082 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:58.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81caffd700 1 --2- 172.21.15.62:0/2885188082 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f81cc0af370 0x7f81cc0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:58.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81cbfff700 1 -- 172.21.15.62:0/2885188082 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81cc05f8d0 msgr2=0x7f81cc067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:58.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81cbfff700 1 --2- 172.21.15.62:0/2885188082 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81cc05f8d0 0x7f81cc067940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:58.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81cbfff700 1 -- 172.21.15.62:0/2885188082 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f81cc0af370 msgr2=0x7f81cc0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:58.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81cbfff700 1 --2- 172.21.15.62:0/2885188082 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f81cc0af370 0x7f81cc0acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:58.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81cbfff700 1 -- 172.21.15.62:0/2885188082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b400b1e0 con 0x7f81cc0b2ed0 2021-12-17T18:23:58.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81cb7fe700 1 --2- 172.21.15.62:0/2885188082 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81cc05f8d0 0x7f81cc067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:58.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81cbfff700 1 --2- 172.21.15.62:0/2885188082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81cc0b2ed0 0x7f81cc15a130 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f81c4000ed0 tx=0x7f81c4007980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:58.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81c8ff9700 1 -- 172.21.15.62:0/2885188082 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81c400cdb0 con 0x7f81cc0b2ed0 2021-12-17T18:23:58.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81c8ff9700 1 -- 172.21.15.62:0/2885188082 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c40070d0 con 0x7f81cc0b2ed0 2021-12-17T18:23:58.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81d2184700 1 -- 172.21.15.62:0/2885188082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81cc09eae0 con 0x7f81cc0b2ed0 2021-12-17T18:23:58.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81c8ff9700 1 -- 172.21.15.62:0/2885188082 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81c4005550 con 0x7f81cc0b2ed0 2021-12-17T18:23:58.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81d2184700 1 -- 172.21.15.62:0/2885188082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81cc0a1870 con 0x7f81cc0b2ed0 2021-12-17T18:23:58.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81d2184700 1 -- 172.21.15.62:0/2885188082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81cc09ec70 con 0x7f81cc0b2ed0 2021-12-17T18:23:58.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81c8ff9700 1 -- 172.21.15.62:0/2885188082 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f81c401a060 con 0x7f81cc0b2ed0 2021-12-17T18:23:58.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.814+0000 7f81c8ff9700 1 --2- 172.21.15.62:0/2885188082 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f81b0053580 0x7f81b0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:58.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.818+0000 7f81c8ff9700 1 -- 172.21.15.62:0/2885188082 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f81c406af70 con 0x7f81cc0b2ed0 2021-12-17T18:23:58.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.818+0000 7f81cb7fe700 1 --2- 172.21.15.62:0/2885188082 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f81b0053580 0x7f81b0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:58.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.818+0000 7f81cb7fe700 1 --2- 172.21.15.62:0/2885188082 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f81b0053580 0x7f81b0055a40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f81b401c000 tx=0x7f81b4015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:58.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.822+0000 7f81c8ff9700 1 -- 172.21.15.62:0/2885188082 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f81c40420d0 con 0x7f81cc0b2ed0 2021-12-17T18:23:58.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.954+0000 7f81d2184700 1 -- 172.21.15.62:0/2885188082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f81cc05fcb0 con 0x7f81cc0b2ed0 2021-12-17T18:23:58.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.958+0000 7f81c8ff9700 1 -- 172.21.15.62:0/2885188082 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v62) v1 ==== 81+0+33696 (secure 0 0 0) 0x7f81c4018030 con 0x7f81cc0b2ed0 2021-12-17T18:23:58.964 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:58.964 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:23:58.964 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 62, 2021-12-17T18:23:58.965 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:23:58.965 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:23:58.965 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:23:29.574719+0000", 2021-12-17T18:23:58.965 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:23:58.966 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:23:58.966 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:23:58.966 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:23:58.966 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:23:58.967 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:23:58.967 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:23:58.967 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:23:58.967 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:23:58.968 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:23:58.968 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:23:58.968 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:23:58.968 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:23:58.969 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:23:58.969 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:23:58.969 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 12, 2021-12-17T18:23:58.969 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:23:58.969 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:23:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:23:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:23:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:23:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:23:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:23:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:23:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:23:58.972 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:23:58.972 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:23:58.972 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:23:58.972 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:23:58.973 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:23:58.973 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:23:58.973 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:23:58.973 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:23:58.974 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:23:58.974 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:23:58.974 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:23:58.974 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:23:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:23:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:23:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:23:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:23:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:23:58.976 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:23:58.976 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:23:58.976 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:58.976 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:23:58.977 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:23:58.977 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:23:58.977 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:23:58.977 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:23:58.977 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:23:58.978 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:23:58.978 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:23:58.978 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:23:58.978 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:23:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:23:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:23:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:23:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:23:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:23:58.980 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:23:58.980 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:23:58.980 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:23:58.980 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:23:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:23:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:23:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:23:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:23:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:23:58.982 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:23:58.982 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:23:58.982 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:23:58.982 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:23:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:23:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:23:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:23:58.984 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:23:58.984 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:23:58.984 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:23:58.984 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:23:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:23:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:23:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:23:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:23:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:23:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:23:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:23:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:58.987 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:58.987 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:58.987 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:23:58.987 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:23:58.988 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:23:58.988 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:23:58.988 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:23:58.989 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:23:58.989 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:23:58.989 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:23:58.990 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:23:58.990 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:23:58.990 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:23:58.990 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:23:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:23:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:23:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:23:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:23:58.992 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:23:58.992 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:23:58.992 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:23:58.992 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:23:58.992 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:23:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:23:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:23:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:23:58.994 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:23:58.994 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:23:58.994 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:23:58.994 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:23:58.995 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:23:58.995 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:23:58.995 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:23:58.996 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:23:58.996 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:23:58.996 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:23:58.996 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:23:58.996 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:23:58.997 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:23:58.997 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:23:58.997 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:23:58.998 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:23:58.998 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:23:58.998 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:23:58.999 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:23:58.999 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:23:58.999 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:23:58.999 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:23:59.000 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:23:59.000 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:23:59.000 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:23:59.000 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:23:59.001 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.001 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:23:59.001 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:23:59.001 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:23:59.002 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:23:59.002 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:23:59.002 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:23:59.002 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:23:59.002 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:23:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:23:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:23:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:23:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:23:59.004 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:23:59.004 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:23:59.004 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.004 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.005 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.005 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 11, 2021-12-17T18:23:59.005 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2021-12-17T18:23:59.005 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:23:25.381154+0000", 2021-12-17T18:23:59.006 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:23:59.006 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:23:59.006 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:23:59.006 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:23:59.007 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:23:59.007 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:23:59.007 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:23:59.007 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:23:59.007 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:23:59.008 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:23:59.008 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:23:59.008 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:23:59.008 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:23:59.009 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:23:59.009 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:23:59.009 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:23:59.009 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:23:59.010 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:23:59.010 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:23:59.010 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:23:59.010 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.011 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "60", 2021-12-17T18:23:59.011 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:23:59.011 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:23:59.011 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:23:59.011 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:23:59.012 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:23:59.012 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:23:59.012 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:23:59.012 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:23:59.013 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:23:59.013 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:23:59.013 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:23:59.013 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:23:59.014 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:23:59.014 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:23:59.014 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:23:59.014 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:23:59.015 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:23:59.015 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:23:59.015 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:23:59.015 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:23:59.015 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:23:59.016 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:23:59.016 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:23:59.016 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:23:59.016 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:23:59.017 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:23:59.017 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.017 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:23:59.017 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:23:59.017 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:23:59.018 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:23:59.018 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:23:59.018 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:23:59.019 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:23:59.019 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:23:59.019 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:23:59.019 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:23:59.019 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:23:59.020 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:23:59.020 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2021-12-17T18:23:59.020 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2021-12-17T18:23:59.020 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2021-12-17T18:23:59.021 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.021 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:23:59.021 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:23:59.021 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2021-12-17T18:23:59.022 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.022 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.022 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.022 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.023 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 12, 2021-12-17T18:23:59.023 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2021-12-17T18:23:59.023 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:23:26.577198+0000", 2021-12-17T18:23:59.023 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:23:59.023 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:23:59.024 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:23:59.024 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:23:59.024 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:23:59.024 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:23:59.025 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:23:59.025 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:23:59.025 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:23:59.025 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:23:59.025 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:23:59.026 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:23:59.026 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:23:59.026 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:23:59.026 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:23:59.027 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:23:59.027 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:23:59.027 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:23:59.027 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:23:59.028 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:23:59.028 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.028 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "62", 2021-12-17T18:23:59.029 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:23:59.029 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:23:59.029 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:23:59.029 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:23:59.029 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:23:59.030 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:23:59.030 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:23:59.030 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:23:59.030 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:23:59.031 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:23:59.031 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:23:59.031 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:23:59.031 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:23:59.032 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:23:59.032 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:23:59.032 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:23:59.032 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:23:59.033 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:23:59.033 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:23:59.033 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:23:59.033 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:23:59.033 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:23:59.034 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:23:59.034 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:23:59.034 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:23:59.035 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:23:59.035 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.035 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:23:59.035 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:23:59.036 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:23:59.036 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:23:59.036 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:23:59.036 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:23:59.036 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:23:59.037 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:23:59.037 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:23:59.037 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:23:59.037 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:23:59.038 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:23:59.038 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:23:59.038 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:23:59.038 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2021-12-17T18:23:59.039 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.039 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.039 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.039 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:23:59.039 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:23:59.040 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.040 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:23:59.040 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:23:59.041 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:59.041 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:59.041 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:59.041 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:59.042 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:59.042 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:59.042 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:59.042 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 59, 2021-12-17T18:23:59.043 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:59.043 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:59.043 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:59.043 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.043 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.044 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.044 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:23:59.044 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:59.044 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.045 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.045 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.045 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:23:59.045 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:59.045 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.046 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.046 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.046 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:59.046 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.047 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.047 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.047 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:23:59.047 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:59.047 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.048 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.048 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.048 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:23:59.048 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:59.049 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.049 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.049 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.049 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:59.049 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.050 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.050 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.050 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:23:59.050 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:59.051 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.051 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.051 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.051 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:23:59.051 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:59.052 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.052 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.052 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.052 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:59.053 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.053 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.053 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.053 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:23:59.053 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:59.054 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.054 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.054 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.054 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:23:59.055 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:23:59.055 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.055 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.055 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.055 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:23:59.056 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:23:59.056 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:23:59.056 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:23:59.056 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:59.057 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:59.057 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:59.057 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.057 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.057 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.058 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:23:59.058 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:23:59.058 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:59.058 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:59.059 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:59.059 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:59.059 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:59.059 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:59.059 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:59.060 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 59, 2021-12-17T18:23:59.060 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:59.060 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:59.060 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:59.060 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.061 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.061 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.061 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:23:59.061 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:59.062 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.062 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.062 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.062 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:23:59.062 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:59.063 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.063 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.063 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.063 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:59.063 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.064 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.064 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.064 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:23:59.064 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:59.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.065 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.065 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.065 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:23:59.065 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:59.066 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.066 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.066 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.066 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:59.067 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.067 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.067 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.067 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:23:59.068 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:59.068 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.068 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.068 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.068 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:23:59.069 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:59.069 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.069 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.069 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.070 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:59.070 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.070 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.070 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.070 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:23:59.071 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:59.071 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.071 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.071 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.072 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:23:59.072 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:23:59.072 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.072 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.072 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.073 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:23:59.073 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:23:59.073 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:23:59.073 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:23:59.073 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:59.074 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:59.074 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:59.074 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.075 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.075 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:23:59.075 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:23:59.075 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:59.075 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:59.076 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:59.076 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:59.076 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:59.076 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:59.077 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:59.077 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 58, 2021-12-17T18:23:59.077 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:59.077 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:59.077 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:59.078 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.078 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.078 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.078 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:23:59.078 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:59.079 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.079 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.079 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.079 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:23:59.080 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:59.080 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.080 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.080 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.080 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:59.081 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.081 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.081 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.081 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:23:59.082 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:59.082 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.082 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.082 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.083 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:23:59.083 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:59.083 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.083 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.083 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.084 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:59.084 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.084 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.084 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.085 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:23:59.085 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:59.085 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.085 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.086 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.086 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:23:59.086 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:59.086 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.086 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.087 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.087 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:59.087 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.087 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.088 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.088 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:23:59.088 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:59.088 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.088 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.089 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.089 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:23:59.089 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:23:59.089 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.090 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.090 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.090 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:23:59.090 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:23:59.090 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:23:59.091 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:23:59.091 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:59.091 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:59.091 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:59.092 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.092 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.092 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.092 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:23:59.092 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:23:59.093 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:59.093 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:59.093 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:59.093 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:59.094 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:59.094 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:59.094 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:59.094 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 48, 2021-12-17T18:23:59.095 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:59.095 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:59.095 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:59.095 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.095 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.096 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.096 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:23:59.096 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:59.096 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.097 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.097 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.097 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:23:59.097 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:59.098 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.098 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.098 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.098 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:59.098 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.099 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.099 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.099 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:23:59.099 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:59.100 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.100 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.100 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.100 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:23:59.100 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:59.101 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.101 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.101 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.101 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:59.102 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.102 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.102 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.102 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:23:59.102 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:59.103 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.103 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.103 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.103 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:23:59.104 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:59.104 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.104 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.104 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.104 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:59.105 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.105 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.105 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.105 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:23:59.105 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:59.106 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.106 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.106 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.106 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:23:59.107 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:23:59.107 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.107 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.107 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.108 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:23:59.108 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:23:59.108 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:23:59.108 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:23:59.108 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:59.109 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:59.109 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:59.109 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.109 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.110 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.110 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:23:59.110 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:23:59.110 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:59.111 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:59.111 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:59.111 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:59.111 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:59.111 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:59.112 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:59.112 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 60, 2021-12-17T18:23:59.112 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:59.112 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:59.112 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:59.113 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.113 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.113 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.113 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:23:59.114 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:59.114 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.114 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.114 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.115 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:23:59.115 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:59.115 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.115 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.115 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.116 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:59.116 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.116 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.116 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.116 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:23:59.117 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:59.117 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.117 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.117 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.118 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:23:59.118 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:59.118 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.118 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.119 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.119 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:59.119 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.119 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.119 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.120 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:23:59.120 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:59.120 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.120 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.121 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.121 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:23:59.121 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:59.121 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.121 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.122 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.122 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:59.122 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.122 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.123 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.123 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:23:59.123 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:59.123 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.123 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.124 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.124 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:23:59.124 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:23:59.124 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.124 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.125 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.125 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:23:59.125 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:23:59.125 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:23:59.125 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:23:59.126 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:59.126 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:59.126 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:59.126 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.127 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.127 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.127 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:23:59.127 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:23:59.128 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:59.128 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:59.128 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:59.128 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:59.128 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:59.129 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:59.129 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:59.129 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 58, 2021-12-17T18:23:59.129 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:59.130 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:59.130 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:59.130 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.130 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.130 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.131 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:23:59.131 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:59.131 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.131 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.131 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.132 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:23:59.132 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:59.132 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.132 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.133 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.133 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:59.133 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.133 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.133 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.134 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:23:59.134 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:59.134 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.134 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.134 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.135 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:23:59.135 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:59.135 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.135 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.136 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.136 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:59.136 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.136 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.136 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.137 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:23:59.137 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:59.137 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.137 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.138 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.138 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:23:59.138 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:59.138 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.138 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.139 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.139 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:59.139 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.139 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.140 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.140 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:23:59.140 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:59.140 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.140 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.141 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.141 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:23:59.141 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:23:59.141 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.141 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.142 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.142 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:23:59.142 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:23:59.142 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:23:59.143 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:23:59.143 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:59.143 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:59.143 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:59.143 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.144 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.144 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.144 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:23:59.144 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:23:59.145 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:59.145 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:59.145 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:59.145 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:59.145 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:59.146 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:59.146 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:59.146 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 59, 2021-12-17T18:23:59.146 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:59.147 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:59.147 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:59.147 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.147 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.147 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.148 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:23:59.148 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:59.148 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.148 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.149 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.149 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:23:59.149 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:59.149 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.149 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.150 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.150 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:59.150 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.150 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.151 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.151 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:23:59.151 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:59.151 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.151 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.152 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.152 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:23:59.152 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:59.152 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.152 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.153 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.153 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:59.153 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.153 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.154 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.154 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:23:59.154 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:59.154 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.154 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.155 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.155 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:23:59.155 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:59.155 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.156 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.156 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.156 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:59.156 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.156 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.157 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.157 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:23:59.157 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:59.157 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.158 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.158 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.158 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:23:59.159 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:23:59.159 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.159 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.159 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.160 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:23:59.160 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:23:59.160 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:23:59.160 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:23:59.161 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:59.161 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:59.161 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:59.161 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.161 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.162 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.162 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:23:59.162 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:23:59.162 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:23:59.163 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:23:59.163 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:23:59.163 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:23:59.163 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:23:59.164 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:23:59.164 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:23:59.164 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 58, 2021-12-17T18:23:59.164 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:23:59.164 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:23:59.165 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:23:59.165 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.165 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.165 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.166 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:23:59.166 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:59.166 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.166 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.167 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.167 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:23:59.167 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:59.167 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.167 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.168 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.168 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:23:59.168 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.168 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.169 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.169 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:23:59.169 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:59.169 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.170 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.170 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.170 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:23:59.170 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:59.171 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.171 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.171 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.171 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:23:59.171 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.172 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.172 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.172 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:23:59.172 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:59.173 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.173 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.173 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.173 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:23:59.174 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:59.174 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.174 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.174 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.174 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:23:59.175 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:23:59.175 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.175 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:23:59.175 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:23:59.176 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:59.176 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.176 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.176 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:23:59.177 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:23:59.177 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:23:59.177 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.177 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.177 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.178 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:23:59.178 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:23:59.178 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:23:59.178 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:23:59.179 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:23:59.179 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:23:59.179 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:23:59.179 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:23:59.180 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.180 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:23:59.180 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:23:59.180 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.180 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:23:59.181 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:59.181 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:59.181 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:59.181 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:59.182 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:59.182 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:23:59.182 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:59.182 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.182 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.183 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:23:59.183 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:59.183 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:59.183 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:59.184 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:59.184 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:59.184 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:23:59.184 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:59.185 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.185 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.185 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:23:59.185 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:59.185 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:59.186 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:59.186 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:59.186 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:59.186 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:23:59.187 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:59.187 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.187 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.187 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:23:59.188 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:59.188 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:59.188 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:59.188 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:59.188 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:59.189 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:23:59.189 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:59.189 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.189 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.190 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:23:59.190 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:59.190 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:59.190 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:59.190 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:59.191 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:59.191 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:23:59.191 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:59.191 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.192 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.192 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:23:59.192 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:59.192 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:59.193 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:59.193 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:59.193 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:59.193 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:23:59.193 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:59.194 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.194 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.194 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:23:59.194 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:59.195 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:59.195 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:59.195 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:59.195 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:59.196 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:23:59.196 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:59.196 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.196 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:23:59.197 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:23:59.197 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:23:59.197 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:23:59.197 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:23:59.197 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:23:59.198 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:23:59.198 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:23:59.198 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:23:59.198 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.199 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:23:59.199 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:23:59.199 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:23:59.199 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:23:59.200 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:23:59.200 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": {}, 2021-12-17T18:23:59.200 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:23:59.200 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:23:59.201 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:23:59.201 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:23:59.201 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:23:59.201 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:23:59.201 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:23:59.202 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:23:59.202 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:23:59.202 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:23:59.202 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:23:59.203 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:23:59.203 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:23:59.203 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:23:59.203 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:23:59.203 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:23:59.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.958+0000 7f81d2184700 1 -- 172.21.15.62:0/2885188082 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f81b0053580 msgr2=0x7f81b0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:59.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.958+0000 7f81d2184700 1 --2- 172.21.15.62:0/2885188082 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f81b0053580 0x7f81b0055a40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f81b401c000 tx=0x7f81b4015000).stop 2021-12-17T18:23:59.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.958+0000 7f81d2184700 1 -- 172.21.15.62:0/2885188082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81cc0b2ed0 msgr2=0x7f81cc15a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:59.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.958+0000 7f81d2184700 1 --2- 172.21.15.62:0/2885188082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81cc0b2ed0 0x7f81cc15a130 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f81c4000ed0 tx=0x7f81c4007980).stop 2021-12-17T18:23:59.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.958+0000 7f81d2184700 1 -- 172.21.15.62:0/2885188082 shutdown_connections 2021-12-17T18:23:59.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.958+0000 7f81d2184700 1 --2- 172.21.15.62:0/2885188082 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f81b0053580 0x7f81b0055a40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:59.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.958+0000 7f81d2184700 1 --2- 172.21.15.62:0/2885188082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81cc0b2ed0 0x7f81cc15a130 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:59.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.958+0000 7f81d2184700 1 --2- 172.21.15.62:0/2885188082 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f81cc0af370 0x7f81cc0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:59.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.958+0000 7f81d2184700 1 --2- 172.21.15.62:0/2885188082 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81cc05f8d0 0x7f81cc067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:59.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.958+0000 7f81d2184700 1 -- 172.21.15.62:0/2885188082 >> 172.21.15.62:0/2885188082 conn(0x7f81cc05bcd0 msgr2=0x7f81cc0af7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:59.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.958+0000 7f81d2184700 1 -- 172.21.15.62:0/2885188082 shutdown_connections 2021-12-17T18:23:59.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:58.958+0000 7f81d2184700 1 -- 172.21.15.62:0/2885188082 wait complete. 2021-12-17T18:23:59.210 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:23:59.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe95045700 1 Processor -- start 2021-12-17T18:23:59.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe95045700 1 -- start start 2021-12-17T18:23:59.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe95045700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efe900b2ed0 0x7efe900b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:59.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe95045700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe900ae4e0 con 0x7efe9005f8d0 2021-12-17T18:23:59.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe95045700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe900ae780 con 0x7efe900af370 2021-12-17T18:23:59.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe95045700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe900b12e0 con 0x7efe900b2ed0 2021-12-17T18:23:59.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe8ed9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7efe9005f8d0 0x7efe900aec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35352/0 (socket says 172.21.15.62:35352) 2021-12-17T18:23:59.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe8ed9d700 1 -- 172.21.15.62:0/303846191 learned_addr learned my addr 172.21.15.62:0/303846191 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:59.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe8e59c700 1 --2- 172.21.15.62:0/303846191 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efe900b2ed0 0x7efe900b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:59.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe8dd9b700 1 -- 172.21.15.62:0/303846191 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719180062 0 0) 0x7efe900ae4e0 con 0x7efe9005f8d0 2021-12-17T18:23:59.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe8dd9b700 1 -- 172.21.15.62:0/303846191 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe70003260 con 0x7efe9005f8d0 2021-12-17T18:23:59.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe8dd9b700 1 -- 172.21.15.62:0/303846191 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271480466 0 0) 0x7efe900ae780 con 0x7efe900af370 2021-12-17T18:23:59.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe8dd9b700 1 -- 172.21.15.62:0/303846191 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe900ae4e0 con 0x7efe900af370 2021-12-17T18:23:59.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe8e59c700 1 -- 172.21.15.62:0/303846191 >> v1:172.21.15.109:6789/0 conn(0x7efe900af370 legacy=0x7efe9014ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:59.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe8e59c700 1 -- 172.21.15.62:0/303846191 >> v1:172.21.15.62:6789/0 conn(0x7efe9005f8d0 legacy=0x7efe900aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:59.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe8e59c700 1 -- 172.21.15.62:0/303846191 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe900b1420 con 0x7efe900b2ed0 2021-12-17T18:23:59.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe8e59c700 1 --2- 172.21.15.62:0/303846191 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efe900b2ed0 0x7efe900b36b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7efe880032f0 tx=0x7efe880091d0).ready entity=mon.2 client_cookie=ee17e83e0ec4a248 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:59.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe8dd9b700 1 -- 172.21.15.62:0/303846191 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe8800b640 con 0x7efe900b2ed0 2021-12-17T18:23:59.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe8dd9b700 1 -- 172.21.15.62:0/303846191 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8800b7a0 con 0x7efe900b2ed0 2021-12-17T18:23:59.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe8dd9b700 1 -- 172.21.15.62:0/303846191 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe8800b910 con 0x7efe900b2ed0 2021-12-17T18:23:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe95045700 1 -- 172.21.15.62:0/303846191 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efe900b2ed0 msgr2=0x7efe900b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe95045700 1 --2- 172.21.15.62:0/303846191 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efe900b2ed0 0x7efe900b36b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7efe880032f0 tx=0x7efe880091d0).stop 2021-12-17T18:23:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe95045700 1 -- 172.21.15.62:0/303846191 shutdown_connections 2021-12-17T18:23:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe95045700 1 --2- 172.21.15.62:0/303846191 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efe900b2ed0 0x7efe900b36b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.314+0000 7efe95045700 1 -- 172.21.15.62:0/303846191 >> 172.21.15.62:0/303846191 conn(0x7efe9005bcd0 msgr2=0x7efe900638c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe95045700 1 -- 172.21.15.62:0/303846191 shutdown_connections 2021-12-17T18:23:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe95045700 1 -- 172.21.15.62:0/303846191 wait complete. 2021-12-17T18:23:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe95045700 1 Processor -- start 2021-12-17T18:23:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe95045700 1 -- start start 2021-12-17T18:23:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe95045700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9005f8d0 0x7efe900b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe95045700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efe900af370 0x7efe90065f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe95045700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efe900b2ed0 0x7efe90157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:59.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe95045700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe90156b80 con 0x7efe9005f8d0 2021-12-17T18:23:59.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe95045700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe90156e20 con 0x7efe900b2ed0 2021-12-17T18:23:59.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe95045700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe901570c0 con 0x7efe900af370 2021-12-17T18:23:59.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe8ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9005f8d0 0x7efe900b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:59.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe8ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9005f8d0 0x7efe900b4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51778/0 (socket says 172.21.15.62:51778) 2021-12-17T18:23:59.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe8ed9d700 1 -- 172.21.15.62:0/1057067439 learned_addr learned my addr 172.21.15.62:0/1057067439 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:59.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe8f59e700 1 --2- 172.21.15.62:0/1057067439 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efe900b2ed0 0x7efe90157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:59.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe8e59c700 1 --2- 172.21.15.62:0/1057067439 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efe900af370 0x7efe90065f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:59.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe8ed9d700 1 -- 172.21.15.62:0/1057067439 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efe900af370 msgr2=0x7efe90065f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:59.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe8ed9d700 1 --2- 172.21.15.62:0/1057067439 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efe900af370 0x7efe90065f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:59.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe8ed9d700 1 -- 172.21.15.62:0/1057067439 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efe900b2ed0 msgr2=0x7efe90157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:59.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe8ed9d700 1 --2- 172.21.15.62:0/1057067439 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efe900b2ed0 0x7efe90157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:59.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe8ed9d700 1 -- 172.21.15.62:0/1057067439 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe88009470 con 0x7efe9005f8d0 2021-12-17T18:23:59.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe8ed9d700 1 --2- 172.21.15.62:0/1057067439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9005f8d0 0x7efe900b4c40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7efe800010d0 tx=0x7efe80007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:59.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe87fff700 1 -- 172.21.15.62:0/1057067439 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe800070d0 con 0x7efe9005f8d0 2021-12-17T18:23:59.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe87fff700 1 -- 172.21.15.62:0/1057067439 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe80007230 con 0x7efe9005f8d0 2021-12-17T18:23:59.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe87fff700 1 -- 172.21.15.62:0/1057067439 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe80005610 con 0x7efe9005f8d0 2021-12-17T18:23:59.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe95045700 1 -- 172.21.15.62:0/1057067439 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe90148d30 con 0x7efe9005f8d0 2021-12-17T18:23:59.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.318+0000 7efe95045700 1 -- 172.21.15.62:0/1057067439 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe90147690 con 0x7efe9005f8d0 2021-12-17T18:23:59.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.322+0000 7efe95045700 1 -- 172.21.15.62:0/1057067439 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe900573d0 con 0x7efe9005f8d0 2021-12-17T18:23:59.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.322+0000 7efe87fff700 1 -- 172.21.15.62:0/1057067439 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efe8001a070 con 0x7efe9005f8d0 2021-12-17T18:23:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.322+0000 7efe87fff700 1 --2- 172.21.15.62:0/1057067439 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efe74053610 0x7efe74055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.322+0000 7efe87fff700 1 -- 172.21.15.62:0/1057067439 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efe8006acc0 con 0x7efe9005f8d0 2021-12-17T18:23:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.322+0000 7efe8e59c700 1 --2- 172.21.15.62:0/1057067439 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efe74053610 0x7efe74055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.326+0000 7efe8e59c700 1 --2- 172.21.15.62:0/1057067439 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efe74053610 0x7efe74055ad0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7efe8801a000 tx=0x7efe88016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.326+0000 7efe87fff700 1 -- 172.21.15.62:0/1057067439 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efe80071080 con 0x7efe9005f8d0 2021-12-17T18:23:59.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.494+0000 7efe95045700 1 -- 172.21.15.62:0/1057067439 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe90068f30 con 0x7efe9005f8d0 2021-12-17T18:23:59.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.498+0000 7efe87fff700 1 -- 172.21.15.62:0/1057067439 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2143 (secure 0 0 0) 0x7efe80018030 con 0x7efe9005f8d0 2021-12-17T18:23:59.503 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:23:59.503 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3727734226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3727734226},{"type":"v1","addr":"172.21.15.109:6835","nonce":3727734226}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:23:27.562422+0000","modified":"2021-12-17T18:23:29.262551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5991},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5991":{"gid":5991,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1885234343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1885234343},{"type":"v1","addr":"172.21.15.62:6833","nonce":1885234343}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-12-17T18:23:59.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.498+0000 7efe95045700 1 -- 172.21.15.62:0/1057067439 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efe74053610 msgr2=0x7efe74055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:59.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.498+0000 7efe95045700 1 --2- 172.21.15.62:0/1057067439 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efe74053610 0x7efe74055ad0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7efe8801a000 tx=0x7efe88016000).stop 2021-12-17T18:23:59.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.498+0000 7efe95045700 1 -- 172.21.15.62:0/1057067439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9005f8d0 msgr2=0x7efe900b4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:59.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.498+0000 7efe95045700 1 --2- 172.21.15.62:0/1057067439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9005f8d0 0x7efe900b4c40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7efe800010d0 tx=0x7efe80007b00).stop 2021-12-17T18:23:59.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.498+0000 7efe95045700 1 -- 172.21.15.62:0/1057067439 shutdown_connections 2021-12-17T18:23:59.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.498+0000 7efe95045700 1 --2- 172.21.15.62:0/1057067439 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efe74053610 0x7efe74055ad0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:59.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.498+0000 7efe95045700 1 --2- 172.21.15.62:0/1057067439 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efe900b2ed0 0x7efe90157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:59.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.498+0000 7efe95045700 1 --2- 172.21.15.62:0/1057067439 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efe900af370 0x7efe90065f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:59.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.498+0000 7efe95045700 1 --2- 172.21.15.62:0/1057067439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9005f8d0 0x7efe900b4c40 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:59.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.498+0000 7efe95045700 1 -- 172.21.15.62:0/1057067439 >> 172.21.15.62:0/1057067439 conn(0x7efe9005bcd0 msgr2=0x7efe9014abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:59.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.498+0000 7efe95045700 1 -- 172.21.15.62:0/1057067439 shutdown_connections 2021-12-17T18:23:59.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.498+0000 7efe95045700 1 -- 172.21.15.62:0/1057067439 wait complete. 2021-12-17T18:23:59.509 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 27 2021-12-17T18:23:59.516 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-12-17T18:23:59.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.618+0000 7f60e8bbd700 1 Processor -- start 2021-12-17T18:23:59.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.618+0000 7f60e8bbd700 1 -- start start 2021-12-17T18:23:59.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.618+0000 7f60e8bbd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60e40b1db0 0x7f60e40648e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:59.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.618+0000 7f60e8bbd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f60e412bdb0 0x7f60e412c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:59.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.618+0000 7f60e8bbd700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e4064dd0 con 0x7f60e4064500 2021-12-17T18:23:59.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.618+0000 7f60e8bbd700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e41470c0 con 0x7f60e412bdb0 2021-12-17T18:23:59.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.618+0000 7f60e8bbd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e4142d60 con 0x7f60e40b1db0 2021-12-17T18:23:59.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.618+0000 7f60e3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f60e412bdb0 0x7f60e412c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:59.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.618+0000 7f60e37fe700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f60e4064500 0x7f60e4144230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:51686/0 (socket says 172.21.15.62:51686) 2021-12-17T18:23:59.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.618+0000 7f60e37fe700 1 -- 172.21.15.62:0/1006297201 learned_addr learned my addr 172.21.15.62:0/1006297201 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:23:59.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.618+0000 7f60e3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f60e412bdb0 0x7f60e412c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51790/0 (socket says 172.21.15.62:51790) 2021-12-17T18:23:59.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.618+0000 7f60e2ffd700 1 --2- 172.21.15.62:0/1006297201 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60e40b1db0 0x7f60e40648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:59.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.618+0000 7f60e27fc700 1 -- 172.21.15.62:0/1006297201 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790942705 0 0) 0x7f60e4064dd0 con 0x7f60e4064500 2021-12-17T18:23:59.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.618+0000 7f60e27fc700 1 -- 172.21.15.62:0/1006297201 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60c4003260 con 0x7f60e4064500 2021-12-17T18:23:59.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e3fff700 1 -- 172.21.15.62:0/1006297201 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60e40b1db0 msgr2=0x7f60e40648e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:23:59.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e3fff700 1 --2- 172.21.15.62:0/1006297201 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60e40b1db0 0x7f60e40648e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:59.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e3fff700 1 -- 172.21.15.62:0/1006297201 >> v1:172.21.15.109:6789/0 conn(0x7f60e4064500 legacy=0x7f60e4144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:59.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e3fff700 1 -- 172.21.15.62:0/1006297201 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e4143000 con 0x7f60e412bdb0 2021-12-17T18:23:59.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e2ffd700 1 --2- 172.21.15.62:0/1006297201 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60e40b1db0 0x7f60e40648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:23:59.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e3fff700 1 --2- 172.21.15.62:0/1006297201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60e412bdb0 0x7f60e412c240 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f60e40b4d10 tx=0x7f60dc0091d0).ready entity=mon.0 client_cookie=f2b91c29e2ef6d40 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:59.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e27fc700 1 -- 172.21.15.62:0/1006297201 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60dc00b600 con 0x7f60e412bdb0 2021-12-17T18:23:59.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e27fc700 1 -- 172.21.15.62:0/1006297201 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc00b760 con 0x7f60e412bdb0 2021-12-17T18:23:59.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e27fc700 1 -- 172.21.15.62:0/1006297201 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60dc00b8d0 con 0x7f60e412bdb0 2021-12-17T18:23:59.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e8bbd700 1 -- 172.21.15.62:0/1006297201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60e412bdb0 msgr2=0x7f60e412c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:59.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e8bbd700 1 --2- 172.21.15.62:0/1006297201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60e412bdb0 0x7f60e412c240 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f60e40b4d10 tx=0x7f60dc0091d0).stop 2021-12-17T18:23:59.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e8bbd700 1 -- 172.21.15.62:0/1006297201 shutdown_connections 2021-12-17T18:23:59.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e8bbd700 1 --2- 172.21.15.62:0/1006297201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60e412bdb0 0x7f60e412c240 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:59.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e8bbd700 1 --2- 172.21.15.62:0/1006297201 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60e40b1db0 0x7f60e40648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:59.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e8bbd700 1 -- 172.21.15.62:0/1006297201 >> 172.21.15.62:0/1006297201 conn(0x7f60e40623c0 msgr2=0x7f60e40627d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:23:59.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e8bbd700 1 -- 172.21.15.62:0/1006297201 shutdown_connections 2021-12-17T18:23:59.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e8bbd700 1 -- 172.21.15.62:0/1006297201 wait complete. 2021-12-17T18:23:59.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e8bbd700 1 Processor -- start 2021-12-17T18:23:59.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.622+0000 7f60e8bbd700 1 -- start start 2021-12-17T18:23:59.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e8bbd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60e4064500 0x7f60e40b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:59.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e8bbd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f60e40b1db0 0x7f60e4155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:59.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e8bbd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60e412bdb0 0x7f60e4131c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:59.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e8bbd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e41317e0 con 0x7f60e4064500 2021-12-17T18:23:59.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e8bbd700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e412f840 con 0x7f60e40b1db0 2021-12-17T18:23:59.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e8bbd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e412f5a0 con 0x7f60e412bdb0 2021-12-17T18:23:59.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60e4064500 0x7f60e40b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:59.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60e4064500 0x7f60e40b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51792/0 (socket says 172.21.15.62:51792) 2021-12-17T18:23:59.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e37fe700 1 -- 172.21.15.62:0/2423504411 learned_addr learned my addr 172.21.15.62:0/2423504411 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:23:59.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e2ffd700 1 --2- 172.21.15.62:0/2423504411 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f60e40b1db0 0x7f60e4155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:59.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e3fff700 1 --2- 172.21.15.62:0/2423504411 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60e412bdb0 0x7f60e4131c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:59.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e37fe700 1 -- 172.21.15.62:0/2423504411 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60e412bdb0 msgr2=0x7f60e4131c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:59.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e37fe700 1 --2- 172.21.15.62:0/2423504411 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60e412bdb0 0x7f60e4131c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:59.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e37fe700 1 -- 172.21.15.62:0/2423504411 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f60e40b1db0 msgr2=0x7f60e4155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:23:59.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e37fe700 1 --2- 172.21.15.62:0/2423504411 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f60e40b1db0 0x7f60e4155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:23:59.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e37fe700 1 -- 172.21.15.62:0/2423504411 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc00b180 con 0x7f60e4064500 2021-12-17T18:23:59.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e3fff700 1 --2- 172.21.15.62:0/2423504411 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60e412bdb0 0x7f60e4131c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:23:59.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e37fe700 1 --2- 172.21.15.62:0/2423504411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60e4064500 0x7f60e40b3690 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f60d4001110 tx=0x7f60d4007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:59.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e0ff9700 1 -- 172.21.15.62:0/2423504411 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60d400ce20 con 0x7f60e4064500 2021-12-17T18:23:59.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e0ff9700 1 -- 172.21.15.62:0/2423504411 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d40072e0 con 0x7f60e4064500 2021-12-17T18:23:59.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e0ff9700 1 -- 172.21.15.62:0/2423504411 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60d4005800 con 0x7f60e4064500 2021-12-17T18:23:59.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e8bbd700 1 -- 172.21.15.62:0/2423504411 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60dc009470 con 0x7f60e4064500 2021-12-17T18:23:59.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.626+0000 7f60e8bbd700 1 -- 172.21.15.62:0/2423504411 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e412dd70 con 0x7f60e4064500 2021-12-17T18:23:59.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.630+0000 7f60e8bbd700 1 -- 172.21.15.62:0/2423504411 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e4131950 con 0x7f60e4064500 2021-12-17T18:23:59.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.630+0000 7f60e0ff9700 1 -- 172.21.15.62:0/2423504411 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f60d4010070 con 0x7f60e4064500 2021-12-17T18:23:59.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.630+0000 7f60e0ff9700 1 --2- 172.21.15.62:0/2423504411 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f60c8053640 0x7f60c8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:23:59.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.630+0000 7f60e0ff9700 1 -- 172.21.15.62:0/2423504411 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f60d406b2f0 con 0x7f60e4064500 2021-12-17T18:23:59.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.630+0000 7f60e2ffd700 1 --2- 172.21.15.62:0/2423504411 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f60c8053640 0x7f60c8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:23:59.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.630+0000 7f60e2ffd700 1 --2- 172.21.15.62:0/2423504411 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f60c8053640 0x7f60c8055b00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f60cc00b000 tx=0x7f60cc006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:23:59.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.638+0000 7f60e0ff9700 1 -- 172.21.15.62:0/2423504411 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f60d4042340 con 0x7f60e4064500 2021-12-17T18:23:59.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:23:59.802+0000 7f60e8bbd700 1 -- 172.21.15.62:0/2423504411 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f60e4146d40 con 0x7f60e4064500 2021-12-17T18:24:00.759 INFO:tasks.ceph.mon.a.smithi062.stderr:2021-12-17T18:24:00.754+0000 7f8d3b366700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-12-17T18:24:00.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.762+0000 7f60e0ff9700 1 -- 172.21.15.62:0/2423504411 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7f60d4018090 con 0x7f60e4064500 2021-12-17T18:24:00.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.766+0000 7f60e8bbd700 1 -- 172.21.15.62:0/2423504411 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f60c8053640 msgr2=0x7f60c8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:00.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.766+0000 7f60e8bbd700 1 --2- 172.21.15.62:0/2423504411 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f60c8053640 0x7f60c8055b00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f60cc00b000 tx=0x7f60cc006df0).stop 2021-12-17T18:24:00.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.766+0000 7f60e8bbd700 1 -- 172.21.15.62:0/2423504411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60e4064500 msgr2=0x7f60e40b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:00.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.766+0000 7f60e8bbd700 1 --2- 172.21.15.62:0/2423504411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60e4064500 0x7f60e40b3690 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f60d4001110 tx=0x7f60d4007ad0).stop 2021-12-17T18:24:00.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.766+0000 7f60e8bbd700 1 -- 172.21.15.62:0/2423504411 shutdown_connections 2021-12-17T18:24:00.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.766+0000 7f60e8bbd700 1 --2- 172.21.15.62:0/2423504411 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f60c8053640 0x7f60c8055b00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:00.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.766+0000 7f60e8bbd700 1 --2- 172.21.15.62:0/2423504411 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f60e412bdb0 0x7f60e4131c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:00.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.766+0000 7f60e8bbd700 1 --2- 172.21.15.62:0/2423504411 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f60e40b1db0 0x7f60e4155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:00.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.766+0000 7f60e8bbd700 1 --2- 172.21.15.62:0/2423504411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60e4064500 0x7f60e40b3690 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:00.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.766+0000 7f60e8bbd700 1 -- 172.21.15.62:0/2423504411 >> 172.21.15.62:0/2423504411 conn(0x7f60e40623c0 msgr2=0x7f60e412a100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:00.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.766+0000 7f60e8bbd700 1 -- 172.21.15.62:0/2423504411 shutdown_connections 2021-12-17T18:24:00.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.766+0000 7f60e8bbd700 1 -- 172.21.15.62:0/2423504411 wait complete. 2021-12-17T18:24:00.776 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-12-17T18:24:00.790 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:24:00.804 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:24:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.886+0000 7f6a18888700 1 Processor -- start 2021-12-17T18:24:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.886+0000 7f6a18888700 1 -- start start 2021-12-17T18:24:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a18888700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a14067870 0x7f6a1413ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a18888700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6a140628c0 0x7f6a1413f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a18888700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a140b3e20 con 0x7f6a140b3a40 2021-12-17T18:24:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a18888700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a140b09f0 con 0x7f6a140628c0 2021-12-17T18:24:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a18888700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a140af900 con 0x7f6a14067870 2021-12-17T18:24:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a1359e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6a140628c0 0x7f6a1413f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a0bfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a14067870 0x7f6a1413ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:00.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a12d9d700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f6a140b3a40 0x7f6a140b02e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:51718/0 (socket says 172.21.15.62:51718) 2021-12-17T18:24:00.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a1359e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6a140628c0 0x7f6a1413f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:58372/0 (socket says 172.21.15.62:58372) 2021-12-17T18:24:00.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a12d9d700 1 -- 172.21.15.62:0/1692268595 learned_addr learned my addr 172.21.15.62:0/1692268595 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:00.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a0bfff700 1 -- 172.21.15.62:0/1692268595 >> v2:172.21.15.109:3300/0 conn(0x7f6a140628c0 msgr2=0x7f6a1413f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:00.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a0bfff700 1 --2- 172.21.15.62:0/1692268595 >> v2:172.21.15.109:3300/0 conn(0x7f6a140628c0 0x7f6a1413f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:00.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a0bfff700 1 -- 172.21.15.62:0/1692268595 >> v1:172.21.15.109:6789/0 conn(0x7f6a140b3a40 legacy=0x7f6a140b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:00.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a0bfff700 1 -- 172.21.15.62:0/1692268595 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a140afba0 con 0x7f6a14067870 2021-12-17T18:24:00.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a0bfff700 1 --2- 172.21.15.62:0/1692268595 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a14067870 0x7f6a1413ec90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f69fc002f70 tx=0x7f69fc006df0).ready entity=mon.2 client_cookie=a213fc6413f0d459 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:00.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a1259c700 1 -- 172.21.15.62:0/1692268595 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69fc00d570 con 0x7f6a14067870 2021-12-17T18:24:00.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a1259c700 1 -- 172.21.15.62:0/1692268595 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc000e90 con 0x7f6a14067870 2021-12-17T18:24:00.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a1259c700 1 -- 172.21.15.62:0/1692268595 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69fc00d8c0 con 0x7f6a14067870 2021-12-17T18:24:00.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a18888700 1 -- 172.21.15.62:0/1692268595 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a14067870 msgr2=0x7f6a1413ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:00.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a18888700 1 --2- 172.21.15.62:0/1692268595 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a14067870 0x7f6a1413ec90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f69fc002f70 tx=0x7f69fc006df0).stop 2021-12-17T18:24:00.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a18888700 1 -- 172.21.15.62:0/1692268595 shutdown_connections 2021-12-17T18:24:00.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a18888700 1 --2- 172.21.15.62:0/1692268595 >> v2:172.21.15.109:3300/0 conn(0x7f6a140628c0 0x7f6a1413f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:00.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a18888700 1 --2- 172.21.15.62:0/1692268595 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a14067870 0x7f6a1413ec90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:00.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a18888700 1 -- 172.21.15.62:0/1692268595 >> 172.21.15.62:0/1692268595 conn(0x7f6a140b7020 msgr2=0x7f6a140b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:00.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a18888700 1 -- 172.21.15.62:0/1692268595 shutdown_connections 2021-12-17T18:24:00.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.890+0000 7f6a18888700 1 -- 172.21.15.62:0/1692268595 wait complete. 2021-12-17T18:24:00.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a18888700 1 Processor -- start 2021-12-17T18:24:00.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a18888700 1 -- start start 2021-12-17T18:24:00.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a18888700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6a140628c0 0x7f6a14133ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:00.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a18888700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a14067870 0x7f6a14136ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:00.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a18888700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a140b3a40 0x7f6a1414e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:00.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a18888700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a14133b40 con 0x7f6a14067870 2021-12-17T18:24:00.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a18888700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a14065d20 con 0x7f6a140628c0 2021-12-17T18:24:00.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a18888700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a14137550 con 0x7f6a140b3a40 2021-12-17T18:24:00.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a0bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a14067870 0x7f6a14136ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:00.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a12d9d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6a140628c0 0x7f6a14133ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:00.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a0bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a14067870 0x7f6a14136ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51824/0 (socket says 172.21.15.62:51824) 2021-12-17T18:24:00.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a0bfff700 1 -- 172.21.15.62:0/354470729 learned_addr learned my addr 172.21.15.62:0/354470729 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:00.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a1359e700 1 --2- 172.21.15.62:0/354470729 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a140b3a40 0x7f6a1414e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:00.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a0bfff700 1 -- 172.21.15.62:0/354470729 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a140b3a40 msgr2=0x7f6a1414e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:00.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a0bfff700 1 --2- 172.21.15.62:0/354470729 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a140b3a40 0x7f6a1414e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:00.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a0bfff700 1 -- 172.21.15.62:0/354470729 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6a140628c0 msgr2=0x7f6a14133ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:00.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a0bfff700 1 --2- 172.21.15.62:0/354470729 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6a140628c0 0x7f6a14133ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:00.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a0bfff700 1 -- 172.21.15.62:0/354470729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc00b180 con 0x7f6a14067870 2021-12-17T18:24:00.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a0bfff700 1 --2- 172.21.15.62:0/354470729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a14067870 0x7f6a14136ed0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f6a14133c80 tx=0x7f69fc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:00.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a10d99700 1 -- 172.21.15.62:0/354470729 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69fc00dea0 con 0x7f6a14067870 2021-12-17T18:24:00.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a10d99700 1 -- 172.21.15.62:0/354470729 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc013da0 con 0x7f6a14067870 2021-12-17T18:24:00.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a10d99700 1 -- 172.21.15.62:0/354470729 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69fc01e5f0 con 0x7f6a14067870 2021-12-17T18:24:00.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a18888700 1 -- 172.21.15.62:0/354470729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1414ed40 con 0x7f6a14067870 2021-12-17T18:24:00.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.894+0000 7f6a18888700 1 -- 172.21.15.62:0/354470729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1414efe0 con 0x7f6a14067870 2021-12-17T18:24:00.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.898+0000 7f6a18888700 1 -- 172.21.15.62:0/354470729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a14067320 con 0x7f6a14067870 2021-12-17T18:24:00.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.898+0000 7f6a10d99700 1 -- 172.21.15.62:0/354470729 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f69fc025030 con 0x7f6a14067870 2021-12-17T18:24:00.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.898+0000 7f6a10d99700 1 --2- 172.21.15.62:0/354470729 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f69f80536a0 0x7f69f8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:00.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.898+0000 7f6a10d99700 1 -- 172.21.15.62:0/354470729 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f69fc06c6b0 con 0x7f6a14067870 2021-12-17T18:24:00.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.898+0000 7f6a12d9d700 1 --2- 172.21.15.62:0/354470729 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f69f80536a0 0x7f69f8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:00.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.898+0000 7f6a12d9d700 1 --2- 172.21.15.62:0/354470729 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f69f80536a0 0x7f69f8055b60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f6a0400d000 tx=0x7f6a04009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:00.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:00.902+0000 7f6a10d99700 1 -- 172.21.15.62:0/354470729 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6a14067320 con 0x7f6a14067870 2021-12-17T18:24:01.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.070+0000 7f6a18888700 1 -- 172.21.15.62:0/354470729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a14067320 con 0x7f6a14067870 2021-12-17T18:24:01.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.070+0000 7f6a10d99700 1 -- 172.21.15.62:0/354470729 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+1782 (secure 0 0 0) 0x7f6a14067320 con 0x7f6a14067870 2021-12-17T18:24:01.076 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:01.076 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":28,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3727734226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3727734226},{"type":"v1","addr":"172.21.15.109:6835","nonce":3727734226}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:23:27.562422+0000","modified":"2021-12-17T18:24:00.758981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-12-17T18:24:01.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.074+0000 7f6a18888700 1 -- 172.21.15.62:0/354470729 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f69f80536a0 msgr2=0x7f69f8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:01.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.074+0000 7f6a18888700 1 --2- 172.21.15.62:0/354470729 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f69f80536a0 0x7f69f8055b60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f6a0400d000 tx=0x7f6a04009040).stop 2021-12-17T18:24:01.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.074+0000 7f6a18888700 1 -- 172.21.15.62:0/354470729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a14067870 msgr2=0x7f6a14136ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:01.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.074+0000 7f6a18888700 1 --2- 172.21.15.62:0/354470729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a14067870 0x7f6a14136ed0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f6a14133c80 tx=0x7f69fc014000).stop 2021-12-17T18:24:01.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.074+0000 7f6a18888700 1 -- 172.21.15.62:0/354470729 shutdown_connections 2021-12-17T18:24:01.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.074+0000 7f6a18888700 1 --2- 172.21.15.62:0/354470729 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f69f80536a0 0x7f69f8055b60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.074+0000 7f6a18888700 1 --2- 172.21.15.62:0/354470729 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a140b3a40 0x7f6a1414e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.074+0000 7f6a18888700 1 --2- 172.21.15.62:0/354470729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a14067870 0x7f6a14136ed0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.074+0000 7f6a18888700 1 --2- 172.21.15.62:0/354470729 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6a140628c0 0x7f6a14133ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.074+0000 7f6a18888700 1 -- 172.21.15.62:0/354470729 >> 172.21.15.62:0/354470729 conn(0x7f6a140b7020 msgr2=0x7f6a140b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:01.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.074+0000 7f6a18888700 1 -- 172.21.15.62:0/354470729 shutdown_connections 2021-12-17T18:24:01.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.074+0000 7f6a18888700 1 -- 172.21.15.62:0/354470729 wait complete. 2021-12-17T18:24:01.083 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 28 2021-12-17T18:24:01.095 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-12-17T18:24:01.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.198+0000 7f898b59e700 1 Processor -- start 2021-12-17T18:24:01.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.198+0000 7f898b59e700 1 -- start start 2021-12-17T18:24:01.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.198+0000 7f898b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f898c0b21a0 0x7f898c146680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:01.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.198+0000 7f898b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f898c0b1220 0x7f898c12b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:01.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.198+0000 7f898b59e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898c0b2580 con 0x7f898c0afdd0 2021-12-17T18:24:01.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.198+0000 7f898b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898c0632f0 con 0x7f898c0b1220 2021-12-17T18:24:01.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.198+0000 7f898b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c0af2d0 con 0x7f898c0b21a0 2021-12-17T18:24:01.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.198+0000 7f898ad9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f898c0b1220 0x7f898c12b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:01.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.198+0000 7f898ad9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f898c0b1220 0x7f898c12b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51834/0 (socket says 172.21.15.62:51834) 2021-12-17T18:24:01.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.198+0000 7f898ad9d700 1 -- 172.21.15.62:0/710952259 learned_addr learned my addr 172.21.15.62:0/710952259 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:01.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.198+0000 7f898a59c700 1 --2- 172.21.15.62:0/710952259 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f898c0b21a0 0x7f898c146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:01.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.198+0000 7f898ad9d700 1 -- 172.21.15.62:0/710952259 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f898c0b21a0 msgr2=0x7f898c146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:01.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.198+0000 7f898ad9d700 1 --2- 172.21.15.62:0/710952259 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f898c0b21a0 0x7f898c146680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.198+0000 7f898ad9d700 1 -- 172.21.15.62:0/710952259 >> v1:172.21.15.109:6789/0 conn(0x7f898c0afdd0 legacy=0x7f898c0b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:01.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.198+0000 7f898ad9d700 1 -- 172.21.15.62:0/710952259 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c0af570 con 0x7f898c0b1220 2021-12-17T18:24:01.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898ad9d700 1 --2- 172.21.15.62:0/710952259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c0b1220 0x7f898c12b2a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f89840032f0 tx=0x7f8984009290).ready entity=mon.0 client_cookie=f72e8c3045352734 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:01.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898959a700 1 -- 172.21.15.62:0/710952259 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f898400b8a0 con 0x7f898c0b1220 2021-12-17T18:24:01.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898959a700 1 -- 172.21.15.62:0/710952259 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898400ba00 con 0x7f898c0b1220 2021-12-17T18:24:01.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898959a700 1 -- 172.21.15.62:0/710952259 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f898400bb70 con 0x7f898c0b1220 2021-12-17T18:24:01.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898b59e700 1 -- 172.21.15.62:0/710952259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c0b1220 msgr2=0x7f898c12b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:01.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898b59e700 1 --2- 172.21.15.62:0/710952259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c0b1220 0x7f898c12b2a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f89840032f0 tx=0x7f8984009290).stop 2021-12-17T18:24:01.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898b59e700 1 -- 172.21.15.62:0/710952259 shutdown_connections 2021-12-17T18:24:01.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898b59e700 1 --2- 172.21.15.62:0/710952259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c0b1220 0x7f898c12b2a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898b59e700 1 --2- 172.21.15.62:0/710952259 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f898c0b21a0 0x7f898c146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898b59e700 1 -- 172.21.15.62:0/710952259 >> 172.21.15.62:0/710952259 conn(0x7f898c05c750 msgr2=0x7f898c05cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:01.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898b59e700 1 -- 172.21.15.62:0/710952259 shutdown_connections 2021-12-17T18:24:01.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898b59e700 1 -- 172.21.15.62:0/710952259 wait complete. 2021-12-17T18:24:01.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898b59e700 1 Processor -- start 2021-12-17T18:24:01.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898b59e700 1 -- start start 2021-12-17T18:24:01.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898b59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f898c0afdd0 0x7f898c12f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:01.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f898c0b1220 0x7f898c12d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:01.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c0b21a0 0x7f898c12b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:01.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c129dd0 con 0x7f898c0b21a0 2021-12-17T18:24:01.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898b59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c12ebc0 con 0x7f898c0afdd0 2021-12-17T18:24:01.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c12ee60 con 0x7f898c0b1220 2021-12-17T18:24:01.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898ad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c0b21a0 0x7f898c12b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:01.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898ad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c0b21a0 0x7f898c12b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51842/0 (socket says 172.21.15.62:51842) 2021-12-17T18:24:01.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898ad9d700 1 -- 172.21.15.62:0/2514549786 learned_addr learned my addr 172.21.15.62:0/2514549786 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:01.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898a59c700 1 --2- 172.21.15.62:0/2514549786 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f898c0afdd0 0x7f898c12f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:01.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f8989d9b700 1 --2- 172.21.15.62:0/2514549786 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f898c0b1220 0x7f898c12d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:01.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898ad9d700 1 -- 172.21.15.62:0/2514549786 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f898c0b1220 msgr2=0x7f898c12d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:01.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898ad9d700 1 --2- 172.21.15.62:0/2514549786 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f898c0b1220 0x7f898c12d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898ad9d700 1 -- 172.21.15.62:0/2514549786 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f898c0afdd0 msgr2=0x7f898c12f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:01.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898ad9d700 1 --2- 172.21.15.62:0/2514549786 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f898c0afdd0 0x7f898c12f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898ad9d700 1 -- 172.21.15.62:0/2514549786 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8984009530 con 0x7f898c0b21a0 2021-12-17T18:24:01.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898ad9d700 1 --2- 172.21.15.62:0/2514549786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c0b21a0 0x7f898c12b070 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f89840032f0 tx=0x7f8984016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:01.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f89837fe700 1 -- 172.21.15.62:0/2514549786 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f898400b8a0 con 0x7f898c0b21a0 2021-12-17T18:24:01.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f89837fe700 1 -- 172.21.15.62:0/2514549786 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8984021440 con 0x7f898c0b21a0 2021-12-17T18:24:01.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f898b59e700 1 -- 172.21.15.62:0/2514549786 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898c12f100 con 0x7f898c0b21a0 2021-12-17T18:24:01.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.202+0000 7f89837fe700 1 -- 172.21.15.62:0/2514549786 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89840217a0 con 0x7f898c0b21a0 2021-12-17T18:24:01.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.206+0000 7f898b59e700 1 -- 172.21.15.62:0/2514549786 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898c12b700 con 0x7f898c0b21a0 2021-12-17T18:24:01.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.206+0000 7f89837fe700 1 -- 172.21.15.62:0/2514549786 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8984029070 con 0x7f898c0b21a0 2021-12-17T18:24:01.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.206+0000 7f89837fe700 1 --2- 172.21.15.62:0/2514549786 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8970053610 0x7f8970055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:01.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.206+0000 7f898b59e700 1 -- 172.21.15.62:0/2514549786 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898c12b9b0 con 0x7f898c0b21a0 2021-12-17T18:24:01.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.206+0000 7f89837fe700 1 -- 172.21.15.62:0/2514549786 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f898406c9d0 con 0x7f898c0b21a0 2021-12-17T18:24:01.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.206+0000 7f898a59c700 1 --2- 172.21.15.62:0/2514549786 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8970053610 0x7f8970055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:01.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.206+0000 7f898a59c700 1 --2- 172.21.15.62:0/2514549786 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8970053610 0x7f8970055ad0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f897c00b000 tx=0x7f897c006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:01.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.218+0000 7f89837fe700 1 -- 172.21.15.62:0/2514549786 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8984015080 con 0x7f898c0b21a0 2021-12-17T18:24:01.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.378+0000 7f898b59e700 1 -- 172.21.15.62:0/2514549786 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f898c12f290 con 0x7f898c0b21a0 2021-12-17T18:24:01.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.782+0000 7f89837fe700 1 -- 172.21.15.62:0/2514549786 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8984043ae0 con 0x7f898c0b21a0 2021-12-17T18:24:01.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.786+0000 7f898b59e700 1 -- 172.21.15.62:0/2514549786 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8970053610 msgr2=0x7f8970055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:01.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.786+0000 7f898b59e700 1 --2- 172.21.15.62:0/2514549786 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8970053610 0x7f8970055ad0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f897c00b000 tx=0x7f897c006df0).stop 2021-12-17T18:24:01.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.786+0000 7f898b59e700 1 -- 172.21.15.62:0/2514549786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c0b21a0 msgr2=0x7f898c12b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:01.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.786+0000 7f898b59e700 1 --2- 172.21.15.62:0/2514549786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c0b21a0 0x7f898c12b070 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f89840032f0 tx=0x7f8984016000).stop 2021-12-17T18:24:01.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.786+0000 7f898b59e700 1 -- 172.21.15.62:0/2514549786 shutdown_connections 2021-12-17T18:24:01.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.786+0000 7f898b59e700 1 --2- 172.21.15.62:0/2514549786 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8970053610 0x7f8970055ad0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.786+0000 7f898b59e700 1 --2- 172.21.15.62:0/2514549786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c0b21a0 0x7f898c12b070 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.786+0000 7f898b59e700 1 --2- 172.21.15.62:0/2514549786 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f898c0b1220 0x7f898c12d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.786+0000 7f898b59e700 1 --2- 172.21.15.62:0/2514549786 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f898c0afdd0 0x7f898c12f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.786+0000 7f898b59e700 1 -- 172.21.15.62:0/2514549786 >> 172.21.15.62:0/2514549786 conn(0x7f898c05c750 msgr2=0x7f898c12a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:01.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.786+0000 7f898b59e700 1 -- 172.21.15.62:0/2514549786 shutdown_connections 2021-12-17T18:24:01.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.786+0000 7f898b59e700 1 -- 172.21.15.62:0/2514549786 wait complete. 2021-12-17T18:24:01.811 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-12-17T18:24:01.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.922+0000 7fcbaea4b700 1 Processor -- start 2021-12-17T18:24:01.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.922+0000 7fcbaea4b700 1 -- start start 2021-12-17T18:24:01.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaea4b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcba805c8f0 0x7fcba8143b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:01.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaea4b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcba81466a0 0x7fcba80afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:01.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaea4b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba81433e0 con 0x7fcba80b17a0 2021-12-17T18:24:01.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaea4b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba813d640 con 0x7fcba805c8f0 2021-12-17T18:24:01.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaea4b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba8143680 con 0x7fcba81466a0 2021-12-17T18:24:01.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbada49700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcba805c8f0 0x7fcba8143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:01.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbae24a700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcba80b17a0 0x7fcba80b09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35430/0 (socket says 172.21.15.62:35430) 2021-12-17T18:24:01.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbae24a700 1 -- 172.21.15.62:0/1897542751 learned_addr learned my addr 172.21.15.62:0/1897542751 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:01.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbad248700 1 --2- 172.21.15.62:0/1897542751 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcba81466a0 0x7fcba80afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:01.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaca47700 1 -- 172.21.15.62:0/1897542751 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225116583 0 0) 0x7fcba81433e0 con 0x7fcba80b17a0 2021-12-17T18:24:01.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaca47700 1 -- 172.21.15.62:0/1897542751 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb90003260 con 0x7fcba80b17a0 2021-12-17T18:24:01.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbada49700 1 -- 172.21.15.62:0/1897542751 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcba81466a0 msgr2=0x7fcba80afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:01.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbada49700 1 --2- 172.21.15.62:0/1897542751 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcba81466a0 0x7fcba80afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbada49700 1 -- 172.21.15.62:0/1897542751 >> v1:172.21.15.62:6789/0 conn(0x7fcba80b17a0 legacy=0x7fcba80b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:01.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbada49700 1 -- 172.21.15.62:0/1897542751 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba8060300 con 0x7fcba805c8f0 2021-12-17T18:24:01.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbada49700 1 --2- 172.21.15.62:0/1897542751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcba805c8f0 0x7fcba8143b20 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fcb98002f70 tx=0x7fcb98006df0).ready entity=mon.0 client_cookie=3fef85920c99a7a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:01.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaca47700 1 -- 172.21.15.62:0/1897542751 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb9800d4a0 con 0x7fcba805c8f0 2021-12-17T18:24:01.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaca47700 1 -- 172.21.15.62:0/1897542751 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb98000e90 con 0x7fcba805c8f0 2021-12-17T18:24:01.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaca47700 1 -- 172.21.15.62:0/1897542751 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb9800d7f0 con 0x7fcba805c8f0 2021-12-17T18:24:01.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaea4b700 1 -- 172.21.15.62:0/1897542751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcba805c8f0 msgr2=0x7fcba8143b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:01.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaea4b700 1 --2- 172.21.15.62:0/1897542751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcba805c8f0 0x7fcba8143b20 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fcb98002f70 tx=0x7fcb98006df0).stop 2021-12-17T18:24:01.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaea4b700 1 -- 172.21.15.62:0/1897542751 shutdown_connections 2021-12-17T18:24:01.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaea4b700 1 --2- 172.21.15.62:0/1897542751 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcba81466a0 0x7fcba80afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaea4b700 1 --2- 172.21.15.62:0/1897542751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcba805c8f0 0x7fcba8143b20 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaea4b700 1 -- 172.21.15.62:0/1897542751 >> 172.21.15.62:0/1897542751 conn(0x7fcba805be70 msgr2=0x7fcba8062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:01.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaea4b700 1 -- 172.21.15.62:0/1897542751 shutdown_connections 2021-12-17T18:24:01.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.926+0000 7fcbaea4b700 1 -- 172.21.15.62:0/1897542751 wait complete. 2021-12-17T18:24:01.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.930+0000 7fcbaea4b700 1 Processor -- start 2021-12-17T18:24:01.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.930+0000 7fcbaea4b700 1 -- start start 2021-12-17T18:24:01.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.930+0000 7fcbaea4b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcba805c8f0 0x7fcba8065b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:01.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.930+0000 7fcbaea4b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcba80b17a0 0x7fcba8066f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:01.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.930+0000 7fcbaea4b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcba81466a0 0x7fcba813f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:01.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.930+0000 7fcbaea4b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba813ea20 con 0x7fcba805c8f0 2021-12-17T18:24:01.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.930+0000 7fcbaea4b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba813dd60 con 0x7fcba80b17a0 2021-12-17T18:24:01.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.930+0000 7fcbaea4b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba813e000 con 0x7fcba81466a0 2021-12-17T18:24:01.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.930+0000 7fcbada49700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcba805c8f0 0x7fcba8065b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:01.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.934+0000 7fcbada49700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcba805c8f0 0x7fcba8065b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51854/0 (socket says 172.21.15.62:51854) 2021-12-17T18:24:01.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.934+0000 7fcbada49700 1 -- 172.21.15.62:0/1272141491 learned_addr learned my addr 172.21.15.62:0/1272141491 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.934+0000 7fcbad248700 1 --2- 172.21.15.62:0/1272141491 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcba80b17a0 0x7fcba8066f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.934+0000 7fcbae24a700 1 --2- 172.21.15.62:0/1272141491 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcba81466a0 0x7fcba813f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.934+0000 7fcbada49700 1 -- 172.21.15.62:0/1272141491 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcba81466a0 msgr2=0x7fcba813f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.934+0000 7fcbada49700 1 --2- 172.21.15.62:0/1272141491 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcba81466a0 0x7fcba813f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.934+0000 7fcbada49700 1 -- 172.21.15.62:0/1272141491 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcba80b17a0 msgr2=0x7fcba8066f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.934+0000 7fcbada49700 1 --2- 172.21.15.62:0/1272141491 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcba80b17a0 0x7fcba8066f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.934+0000 7fcbada49700 1 -- 172.21.15.62:0/1272141491 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9800b180 con 0x7fcba805c8f0 2021-12-17T18:24:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.934+0000 7fcbada49700 1 --2- 172.21.15.62:0/1272141491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcba805c8f0 0x7fcba8065b40 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fcb98002f70 tx=0x7fcb98014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.934+0000 7fcb96ffd700 1 -- 172.21.15.62:0/1272141491 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb98016070 con 0x7fcba805c8f0 2021-12-17T18:24:01.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.934+0000 7fcb96ffd700 1 -- 172.21.15.62:0/1272141491 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb980137d0 con 0x7fcba805c8f0 2021-12-17T18:24:01.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.934+0000 7fcbaea4b700 1 -- 172.21.15.62:0/1272141491 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba813f4f0 con 0x7fcba805c8f0 2021-12-17T18:24:01.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.934+0000 7fcb96ffd700 1 -- 172.21.15.62:0/1272141491 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb98013b30 con 0x7fcba805c8f0 2021-12-17T18:24:01.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.934+0000 7fcbaea4b700 1 -- 172.21.15.62:0/1272141491 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba813da00 con 0x7fcba805c8f0 2021-12-17T18:24:01.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.934+0000 7fcbaea4b700 1 -- 172.21.15.62:0/1272141491 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba8144010 con 0x7fcba805c8f0 2021-12-17T18:24:01.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.934+0000 7fcb96ffd700 1 -- 172.21.15.62:0/1272141491 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcb9800f030 con 0x7fcba805c8f0 2021-12-17T18:24:01.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.938+0000 7fcb96ffd700 1 --2- 172.21.15.62:0/1272141491 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcb880535b0 0x7fcb88055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:01.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.938+0000 7fcb96ffd700 1 -- 172.21.15.62:0/1272141491 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fcb9806c5a0 con 0x7fcba805c8f0 2021-12-17T18:24:01.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.938+0000 7fcbad248700 1 --2- 172.21.15.62:0/1272141491 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcb880535b0 0x7fcb88055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:01.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.938+0000 7fcbad248700 1 --2- 172.21.15.62:0/1272141491 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcb880535b0 0x7fcb88055a70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fcba400b000 tx=0x7fcba40091d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:01.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:01.942+0000 7fcb96ffd700 1 -- 172.21.15.62:0/1272141491 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcb98043610 con 0x7fcba805c8f0 2021-12-17T18:24:02.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.066+0000 7fcbaea4b700 1 -- 172.21.15.62:0/1272141491 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcba80573d0 con 0x7fcba805c8f0 2021-12-17T18:24:02.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.834+0000 7fcb96ffd700 1 -- 172.21.15.62:0/1272141491 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v64) v1 ==== 185+0+0 (secure 0 0 0) 0x7fcb98023020 con 0x7fcba805c8f0 2021-12-17T18:24:02.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.838+0000 7fcbaea4b700 1 -- 172.21.15.62:0/1272141491 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcb880535b0 msgr2=0x7fcb88055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.838+0000 7fcbaea4b700 1 --2- 172.21.15.62:0/1272141491 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcb880535b0 0x7fcb88055a70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fcba400b000 tx=0x7fcba40091d0).stop 2021-12-17T18:24:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.838+0000 7fcbaea4b700 1 -- 172.21.15.62:0/1272141491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcba805c8f0 msgr2=0x7fcba8065b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.838+0000 7fcbaea4b700 1 --2- 172.21.15.62:0/1272141491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcba805c8f0 0x7fcba8065b40 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fcb98002f70 tx=0x7fcb98014000).stop 2021-12-17T18:24:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.838+0000 7fcbaea4b700 1 -- 172.21.15.62:0/1272141491 shutdown_connections 2021-12-17T18:24:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.838+0000 7fcbaea4b700 1 --2- 172.21.15.62:0/1272141491 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcb880535b0 0x7fcb88055a70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.838+0000 7fcbaea4b700 1 --2- 172.21.15.62:0/1272141491 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcba81466a0 0x7fcba813f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.838+0000 7fcbaea4b700 1 --2- 172.21.15.62:0/1272141491 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcba80b17a0 0x7fcba8066f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.838+0000 7fcbaea4b700 1 --2- 172.21.15.62:0/1272141491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcba805c8f0 0x7fcba8065b40 secure :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0x7fcb98002f70 tx=0x7fcb98014000).stop 2021-12-17T18:24:02.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.838+0000 7fcbaea4b700 1 -- 172.21.15.62:0/1272141491 >> 172.21.15.62:0/1272141491 conn(0x7fcba805be70 msgr2=0x7fcba8149030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:02.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.838+0000 7fcbaea4b700 1 -- 172.21.15.62:0/1272141491 shutdown_connections 2021-12-17T18:24:02.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.838+0000 7fcbaea4b700 1 -- 172.21.15.62:0/1272141491 wait complete. 2021-12-17T18:24:02.848 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2021-12-17T18:24:02.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-12-17T18:24:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.974+0000 7fe76b516700 1 Processor -- start 2021-12-17T18:24:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.974+0000 7fe76b516700 1 -- start start 2021-12-17T18:24:02.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe76b516700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe7640b4340 0x7fe7641471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:02.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe76b516700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe7640b51a0 0x7fe7640b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:02.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe76b516700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7640b09e0 con 0x7fe764142660 2021-12-17T18:24:02.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe76b516700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7641467d0 con 0x7fe7640b51a0 2021-12-17T18:24:02.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe76b516700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe764146a70 con 0x7fe7640b4340 2021-12-17T18:24:02.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe768ab1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe7640b51a0 0x7fe7640b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:02.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe769ab3700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe764142660 0x7fe7640b5a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35446/0 (socket says 172.21.15.62:35446) 2021-12-17T18:24:02.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe769ab3700 1 -- 172.21.15.62:0/2793364891 learned_addr learned my addr 172.21.15.62:0/2793364891 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:02.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe7692b2700 1 --2- 172.21.15.62:0/2793364891 >> v2:172.21.15.109:3300/0 conn(0x7fe7640b4340 0x7fe7641471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:02.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe768ab1700 1 -- 172.21.15.62:0/2793364891 >> v2:172.21.15.109:3300/0 conn(0x7fe7640b4340 msgr2=0x7fe7641471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:02.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe768ab1700 1 --2- 172.21.15.62:0/2793364891 >> v2:172.21.15.109:3300/0 conn(0x7fe7640b4340 0x7fe7641471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:02.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe757fff700 1 -- 172.21.15.62:0/2793364891 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474856223 0 0) 0x7fe7640b09e0 con 0x7fe764142660 2021-12-17T18:24:02.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe768ab1700 1 -- 172.21.15.62:0/2793364891 >> v1:172.21.15.62:6789/0 conn(0x7fe764142660 legacy=0x7fe7640b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:02.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe768ab1700 1 -- 172.21.15.62:0/2793364891 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe764146d10 con 0x7fe7640b51a0 2021-12-17T18:24:02.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe7692b2700 1 --2- 172.21.15.62:0/2793364891 >> v2:172.21.15.109:3300/0 conn(0x7fe7640b4340 0x7fe7641471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:24:02.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe768ab1700 1 --2- 172.21.15.62:0/2793364891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7640b51a0 0x7fe7640b28f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fe760002f70 tx=0x7fe760006df0).ready entity=mon.0 client_cookie=8b7ca0c1184b9569 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:02.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe757fff700 1 -- 172.21.15.62:0/2793364891 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe76000d5c0 con 0x7fe7640b51a0 2021-12-17T18:24:02.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe757fff700 1 -- 172.21.15.62:0/2793364891 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe760000e90 con 0x7fe7640b51a0 2021-12-17T18:24:02.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe757fff700 1 -- 172.21.15.62:0/2793364891 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe76000d910 con 0x7fe7640b51a0 2021-12-17T18:24:02.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe76b516700 1 -- 172.21.15.62:0/2793364891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7640b51a0 msgr2=0x7fe7640b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:02.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe76b516700 1 --2- 172.21.15.62:0/2793364891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7640b51a0 0x7fe7640b28f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fe760002f70 tx=0x7fe760006df0).stop 2021-12-17T18:24:02.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe76b516700 1 -- 172.21.15.62:0/2793364891 shutdown_connections 2021-12-17T18:24:02.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe76b516700 1 --2- 172.21.15.62:0/2793364891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7640b51a0 0x7fe7640b28f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:02.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe76b516700 1 --2- 172.21.15.62:0/2793364891 >> v2:172.21.15.109:3300/0 conn(0x7fe7640b4340 0x7fe7641471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:02.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe76b516700 1 -- 172.21.15.62:0/2793364891 >> 172.21.15.62:0/2793364891 conn(0x7fe76405c750 msgr2=0x7fe76405cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:02.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe76b516700 1 -- 172.21.15.62:0/2793364891 shutdown_connections 2021-12-17T18:24:02.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe76b516700 1 -- 172.21.15.62:0/2793364891 wait complete. 2021-12-17T18:24:02.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe76b516700 1 Processor -- start 2021-12-17T18:24:02.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.978+0000 7fe76b516700 1 -- start start 2021-12-17T18:24:02.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe76b516700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7640b4340 0x7fe764140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:02.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe76b516700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe7640b51a0 0x7fe7640638a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:02.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe76b516700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe764142660 0x7fe764063d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:02.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe76b516700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640634b0 con 0x7fe7640b4340 2021-12-17T18:24:02.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe76b516700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe764156130 con 0x7fe7640b51a0 2021-12-17T18:24:02.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe76b516700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7641563d0 con 0x7fe764142660 2021-12-17T18:24:02.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe7692b2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7640b4340 0x7fe764140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:02.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe7692b2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7640b4340 0x7fe764140ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51870/0 (socket says 172.21.15.62:51870) 2021-12-17T18:24:02.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe7692b2700 1 -- 172.21.15.62:0/4211512283 learned_addr learned my addr 172.21.15.62:0/4211512283 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:02.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe768ab1700 1 --2- 172.21.15.62:0/4211512283 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe7640b51a0 0x7fe7640638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:02.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe769ab3700 1 --2- 172.21.15.62:0/4211512283 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe764142660 0x7fe764063d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:02.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe7692b2700 1 -- 172.21.15.62:0/4211512283 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe764142660 msgr2=0x7fe764063d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:02.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe7692b2700 1 --2- 172.21.15.62:0/4211512283 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe764142660 0x7fe764063d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:02.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe7692b2700 1 -- 172.21.15.62:0/4211512283 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe7640b51a0 msgr2=0x7fe7640638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:02.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe7692b2700 1 --2- 172.21.15.62:0/4211512283 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe7640b51a0 0x7fe7640638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:02.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe7692b2700 1 -- 172.21.15.62:0/4211512283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76000b180 con 0x7fe7640b4340 2021-12-17T18:24:02.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe7692b2700 1 --2- 172.21.15.62:0/4211512283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7640b4340 0x7fe764140ce0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fe758006940 tx=0x7fe758008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:02.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe7567fc700 1 -- 172.21.15.62:0/4211512283 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe758011780 con 0x7fe7640b4340 2021-12-17T18:24:02.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe7567fc700 1 -- 172.21.15.62:0/4211512283 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7580118e0 con 0x7fe7640b4340 2021-12-17T18:24:02.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe76b516700 1 -- 172.21.15.62:0/4211512283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7640b9960 con 0x7fe7640b4340 2021-12-17T18:24:02.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe7567fc700 1 -- 172.21.15.62:0/4211512283 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe758011c40 con 0x7fe7640b4340 2021-12-17T18:24:02.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.982+0000 7fe76b516700 1 -- 172.21.15.62:0/4211512283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7640ba420 con 0x7fe7640b4340 2021-12-17T18:24:02.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.986+0000 7fe76b516700 1 -- 172.21.15.62:0/4211512283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7640b4720 con 0x7fe7640b4340 2021-12-17T18:24:02.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.986+0000 7fe7567fc700 1 -- 172.21.15.62:0/4211512283 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe758012420 con 0x7fe7640b4340 2021-12-17T18:24:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.986+0000 7fe7567fc700 1 --2- 172.21.15.62:0/4211512283 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe74c053610 0x7fe74c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.986+0000 7fe7567fc700 1 -- 172.21.15.62:0/4211512283 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fe75806b600 con 0x7fe7640b4340 2021-12-17T18:24:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.986+0000 7fe768ab1700 1 --2- 172.21.15.62:0/4211512283 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe74c053610 0x7fe74c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.986+0000 7fe768ab1700 1 --2- 172.21.15.62:0/4211512283 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe74c053610 0x7fe74c055ad0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fe76001a000 tx=0x7fe760014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:02.990+0000 7fe7567fc700 1 -- 172.21.15.62:0/4211512283 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe758042860 con 0x7fe7640b4340 2021-12-17T18:24:03.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.130+0000 7fe76b516700 1 -- 172.21.15.62:0/4211512283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe7640573d0 con 0x7fe7640b4340 2021-12-17T18:24:03.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.842+0000 7fe7567fc700 1 -- 172.21.15.62:0/4211512283 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v65) v1 ==== 173+0+0 (secure 0 0 0) 0x7fe758045e80 con 0x7fe7640b4340 2021-12-17T18:24:03.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.846+0000 7fe76b516700 1 -- 172.21.15.62:0/4211512283 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe74c053610 msgr2=0x7fe74c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:03.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.846+0000 7fe76b516700 1 --2- 172.21.15.62:0/4211512283 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe74c053610 0x7fe74c055ad0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fe76001a000 tx=0x7fe760014000).stop 2021-12-17T18:24:03.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.846+0000 7fe76b516700 1 -- 172.21.15.62:0/4211512283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7640b4340 msgr2=0x7fe764140ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:03.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.846+0000 7fe76b516700 1 --2- 172.21.15.62:0/4211512283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7640b4340 0x7fe764140ce0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fe758006940 tx=0x7fe758008040).stop 2021-12-17T18:24:03.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.850+0000 7fe76b516700 1 -- 172.21.15.62:0/4211512283 shutdown_connections 2021-12-17T18:24:03.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.850+0000 7fe76b516700 1 --2- 172.21.15.62:0/4211512283 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe74c053610 0x7fe74c055ad0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:03.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.850+0000 7fe76b516700 1 --2- 172.21.15.62:0/4211512283 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe764142660 0x7fe764063d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:03.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.850+0000 7fe76b516700 1 --2- 172.21.15.62:0/4211512283 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe7640b51a0 0x7fe7640638a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:03.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.850+0000 7fe76b516700 1 --2- 172.21.15.62:0/4211512283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7640b4340 0x7fe764140ce0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:03.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.850+0000 7fe76b516700 1 -- 172.21.15.62:0/4211512283 >> 172.21.15.62:0/4211512283 conn(0x7fe76405c750 msgr2=0x7fe764142af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:03.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.850+0000 7fe76b516700 1 -- 172.21.15.62:0/4211512283 shutdown_connections 2021-12-17T18:24:03.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.850+0000 7fe76b516700 1 -- 172.21.15.62:0/4211512283 wait complete. 2021-12-17T18:24:03.856 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2021-12-17T18:24:03.868 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-12-17T18:24:03.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.974+0000 7f6a6e37a700 1 Processor -- start 2021-12-17T18:24:03.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.974+0000 7f6a6e37a700 1 -- start start 2021-12-17T18:24:03.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.974+0000 7f6a6e37a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6a6805fa70 0x7f6a680b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:03.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.974+0000 7f6a6e37a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a680b4210 0x7f6a681437b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:03.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.974+0000 7f6a6e37a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a680b3590 con 0x7f6a680b39c0 2021-12-17T18:24:03.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.974+0000 7f6a6e37a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a68143ca0 con 0x7f6a6805fa70 2021-12-17T18:24:03.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.974+0000 7f6a6e37a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a68060130 con 0x7f6a680b4210 2021-12-17T18:24:03.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.974+0000 7f6a6d378700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6a6805fa70 0x7f6a680b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:03.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.974+0000 7f6a6cb77700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6a680b39c0 0x7f6a681430a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35458/0 (socket says 172.21.15.62:35458) 2021-12-17T18:24:03.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.974+0000 7f6a6cb77700 1 -- 172.21.15.62:0/1605099960 learned_addr learned my addr 172.21.15.62:0/1605099960 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:03.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a6db79700 1 --2- 172.21.15.62:0/1605099960 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a680b4210 0x7f6a681437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:03.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a5ffff700 1 -- 172.21.15.62:0/1605099960 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434418787 0 0) 0x7f6a680b3590 con 0x7f6a680b39c0 2021-12-17T18:24:03.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a5ffff700 1 -- 172.21.15.62:0/1605099960 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a4c003260 con 0x7f6a680b39c0 2021-12-17T18:24:03.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a6d378700 1 -- 172.21.15.62:0/1605099960 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a680b4210 msgr2=0x7f6a681437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:03.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a6d378700 1 --2- 172.21.15.62:0/1605099960 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a680b4210 0x7f6a681437b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:03.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a6d378700 1 -- 172.21.15.62:0/1605099960 >> v1:172.21.15.62:6789/0 conn(0x7f6a680b39c0 legacy=0x7f6a681430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:03.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a6d378700 1 -- 172.21.15.62:0/1605099960 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a680603d0 con 0x7f6a6805fa70 2021-12-17T18:24:03.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a6db79700 1 --2- 172.21.15.62:0/1605099960 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a680b4210 0x7f6a681437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:24:03.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a6d378700 1 --2- 172.21.15.62:0/1605099960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a6805fa70 0x7f6a680b6d90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f6a64002f70 tx=0x7f6a64006df0).ready entity=mon.0 client_cookie=32547ec1c94aa101 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:03.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a5ffff700 1 -- 172.21.15.62:0/1605099960 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a6400d4a0 con 0x7f6a6805fa70 2021-12-17T18:24:03.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a5ffff700 1 -- 172.21.15.62:0/1605099960 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a64000e90 con 0x7f6a6805fa70 2021-12-17T18:24:03.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a5ffff700 1 -- 172.21.15.62:0/1605099960 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a6400d7f0 con 0x7f6a6805fa70 2021-12-17T18:24:03.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a6e37a700 1 -- 172.21.15.62:0/1605099960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a6805fa70 msgr2=0x7f6a680b6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:03.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a6e37a700 1 --2- 172.21.15.62:0/1605099960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a6805fa70 0x7f6a680b6d90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f6a64002f70 tx=0x7f6a64006df0).stop 2021-12-17T18:24:03.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a6e37a700 1 -- 172.21.15.62:0/1605099960 shutdown_connections 2021-12-17T18:24:03.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a6e37a700 1 --2- 172.21.15.62:0/1605099960 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a680b4210 0x7f6a681437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:03.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a6e37a700 1 --2- 172.21.15.62:0/1605099960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a6805fa70 0x7f6a680b6d90 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:03.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a6e37a700 1 -- 172.21.15.62:0/1605099960 >> 172.21.15.62:0/1605099960 conn(0x7f6a6805c750 msgr2=0x7f6a6805cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:03.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a6e37a700 1 -- 172.21.15.62:0/1605099960 shutdown_connections 2021-12-17T18:24:03.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a6e37a700 1 -- 172.21.15.62:0/1605099960 wait complete. 2021-12-17T18:24:03.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a6e37a700 1 Processor -- start 2021-12-17T18:24:04.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.978+0000 7f6a6e37a700 1 -- start start 2021-12-17T18:24:04.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6e37a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a6805fa70 0x7f6a681524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:04.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6e37a700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6a680b39c0 0x7f6a68063490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:04.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6e37a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a680b4210 0x7f6a6813dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:04.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6e37a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a68144b60 con 0x7f6a6805fa70 2021-12-17T18:24:04.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6e37a700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a68152ae0 con 0x7f6a680b39c0 2021-12-17T18:24:04.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6e37a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a68152d80 con 0x7f6a680b4210 2021-12-17T18:24:04.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6d378700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a6805fa70 0x7f6a681524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:04.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6d378700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a6805fa70 0x7f6a681524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51882/0 (socket says 172.21.15.62:51882) 2021-12-17T18:24:04.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6d378700 1 -- 172.21.15.62:0/2403842518 learned_addr learned my addr 172.21.15.62:0/2403842518 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:04.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6cb77700 1 --2- 172.21.15.62:0/2403842518 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6a680b39c0 0x7f6a68063490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:04.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6db79700 1 --2- 172.21.15.62:0/2403842518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a680b4210 0x7f6a6813dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:04.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6d378700 1 -- 172.21.15.62:0/2403842518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a680b4210 msgr2=0x7f6a6813dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:04.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6d378700 1 --2- 172.21.15.62:0/2403842518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a680b4210 0x7f6a6813dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6d378700 1 -- 172.21.15.62:0/2403842518 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6a680b39c0 msgr2=0x7f6a68063490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:04.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6d378700 1 --2- 172.21.15.62:0/2403842518 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6a680b39c0 0x7f6a68063490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6d378700 1 -- 172.21.15.62:0/2403842518 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a60009470 con 0x7f6a6805fa70 2021-12-17T18:24:04.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6d378700 1 --2- 172.21.15.62:0/2403842518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a6805fa70 0x7f6a681524f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f6a64002f70 tx=0x7f6a64014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:04.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a5e7fc700 1 -- 172.21.15.62:0/2403842518 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a64012930 con 0x7f6a6805fa70 2021-12-17T18:24:04.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a5e7fc700 1 -- 172.21.15.62:0/2403842518 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a64012a90 con 0x7f6a6805fa70 2021-12-17T18:24:04.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6e37a700 1 -- 172.21.15.62:0/2403842518 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6400b180 con 0x7f6a6805fa70 2021-12-17T18:24:04.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a5e7fc700 1 -- 172.21.15.62:0/2403842518 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a64012df0 con 0x7f6a6805fa70 2021-12-17T18:24:04.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6e37a700 1 -- 172.21.15.62:0/2403842518 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a68063980 con 0x7f6a6805fa70 2021-12-17T18:24:04.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.982+0000 7f6a6e37a700 1 -- 172.21.15.62:0/2403842518 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a68064ff0 con 0x7f6a6805fa70 2021-12-17T18:24:04.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.986+0000 7f6a5e7fc700 1 -- 172.21.15.62:0/2403842518 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6a6401c070 con 0x7f6a6805fa70 2021-12-17T18:24:04.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.986+0000 7f6a5e7fc700 1 --2- 172.21.15.62:0/2403842518 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6a50053610 0x7f6a50055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:04.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.986+0000 7f6a5e7fc700 1 -- 172.21.15.62:0/2403842518 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f6a6406c2c0 con 0x7f6a6805fa70 2021-12-17T18:24:04.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.986+0000 7f6a6cb77700 1 --2- 172.21.15.62:0/2403842518 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6a50053610 0x7f6a50055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:04.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.986+0000 7f6a6cb77700 1 --2- 172.21.15.62:0/2403842518 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6a50053610 0x7f6a50055ad0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f6a5800d000 tx=0x7f6a58009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:03.990+0000 7f6a5e7fc700 1 -- 172.21.15.62:0/2403842518 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6a68064ff0 con 0x7f6a6805fa70 2021-12-17T18:24:04.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.122+0000 7f6a6e37a700 1 -- 172.21.15.62:0/2403842518 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6a68064ff0 con 0x7f6a6805fa70 2021-12-17T18:24:04.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.130+0000 7f6a5e7fc700 1 -- 172.21.15.62:0/2403842518 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6a68064ff0 con 0x7f6a6805fa70 2021-12-17T18:24:04.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.130+0000 7f6a6e37a700 1 -- 172.21.15.62:0/2403842518 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6a50053610 msgr2=0x7f6a50055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:04.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.130+0000 7f6a6e37a700 1 --2- 172.21.15.62:0/2403842518 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6a50053610 0x7f6a50055ad0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f6a5800d000 tx=0x7f6a58009040).stop 2021-12-17T18:24:04.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.130+0000 7f6a6e37a700 1 -- 172.21.15.62:0/2403842518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a6805fa70 msgr2=0x7f6a681524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:04.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.130+0000 7f6a6e37a700 1 --2- 172.21.15.62:0/2403842518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a6805fa70 0x7f6a681524f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f6a64002f70 tx=0x7f6a64014000).stop 2021-12-17T18:24:04.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.130+0000 7f6a6e37a700 1 -- 172.21.15.62:0/2403842518 shutdown_connections 2021-12-17T18:24:04.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.130+0000 7f6a6e37a700 1 --2- 172.21.15.62:0/2403842518 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6a50053610 0x7f6a50055ad0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.130+0000 7f6a6e37a700 1 --2- 172.21.15.62:0/2403842518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a680b4210 0x7f6a6813dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.130+0000 7f6a6e37a700 1 --2- 172.21.15.62:0/2403842518 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6a680b39c0 0x7f6a68063490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.130+0000 7f6a6e37a700 1 --2- 172.21.15.62:0/2403842518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a6805fa70 0x7f6a681524f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.130+0000 7f6a6e37a700 1 -- 172.21.15.62:0/2403842518 >> 172.21.15.62:0/2403842518 conn(0x7f6a6805c750 msgr2=0x7f6a68143440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:04.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.130+0000 7f6a6e37a700 1 -- 172.21.15.62:0/2403842518 shutdown_connections 2021-12-17T18:24:04.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.130+0000 7f6a6e37a700 1 -- 172.21.15.62:0/2403842518 wait complete. 2021-12-17T18:24:04.147 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-12-17T18:24:04.155 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:24:04.192 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:24:04.195 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:24:04.197 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:24:04.200 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:24:04.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.246+0000 7f62de8cc700 1 Processor -- start 2021-12-17T18:24:04.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.246+0000 7f62de8cc700 1 -- start start 2021-12-17T18:24:04.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.246+0000 7f62de8cc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62d8144f30 0x7f62d80b1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:04.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.246+0000 7f62de8cc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f62d80b0990 0x7f62d80b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:04.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.246+0000 7f62de8cc700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d8064230 con 0x7f62d805fa70 2021-12-17T18:24:04.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.246+0000 7f62de8cc700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d80b2e80 con 0x7f62d80b0990 2021-12-17T18:24:04.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.246+0000 7f62de8cc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d8064460 con 0x7f62d8144f30 2021-12-17T18:24:04.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.246+0000 7f62dce69700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f62d80b0990 0x7f62d80b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:04.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.246+0000 7f62dce69700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f62d80b0990 0x7f62d80b2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51894/0 (socket says 172.21.15.62:51894) 2021-12-17T18:24:04.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.246+0000 7f62dce69700 1 -- 172.21.15.62:0/3375785990 learned_addr learned my addr 172.21.15.62:0/3375785990 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:04.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.246+0000 7f62d7fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f62d805fa70 0x7f62d8144820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35470/0 (socket says 172.21.15.62:35470) 2021-12-17T18:24:04.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.246+0000 7f62cffff700 1 --2- 172.21.15.62:0/3375785990 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62d8144f30 0x7f62d80b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:04.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.250+0000 7f62dce69700 1 -- 172.21.15.62:0/3375785990 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62d8144f30 msgr2=0x7f62d80b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:04.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.250+0000 7f62dce69700 1 --2- 172.21.15.62:0/3375785990 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62d8144f30 0x7f62d80b1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.250+0000 7f62dce69700 1 -- 172.21.15.62:0/3375785990 >> v1:172.21.15.62:6789/0 conn(0x7f62d805fa70 legacy=0x7f62d8144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:04.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.250+0000 7f62dce69700 1 -- 172.21.15.62:0/3375785990 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d80b24f0 con 0x7f62d80b0990 2021-12-17T18:24:04.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.250+0000 7f62d77fe700 1 -- 172.21.15.62:0/3375785990 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71861299 0 0) 0x7f62d8064230 con 0x7f62d805fa70 2021-12-17T18:24:04.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.250+0000 7f62dce69700 1 --2- 172.21.15.62:0/3375785990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62d80b0990 0x7f62d80b2990 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f62d00032f0 tx=0x7f62d0009290).ready entity=mon.0 client_cookie=91520c607e0f5600 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:04.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.250+0000 7f62d77fe700 1 -- 172.21.15.62:0/3375785990 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62d000b8a0 con 0x7f62d80b0990 2021-12-17T18:24:04.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.250+0000 7f62d77fe700 1 -- 172.21.15.62:0/3375785990 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d000ba00 con 0x7f62d80b0990 2021-12-17T18:24:04.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.250+0000 7f62d77fe700 1 -- 172.21.15.62:0/3375785990 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62d000bb70 con 0x7f62d80b0990 2021-12-17T18:24:04.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.250+0000 7f62de8cc700 1 -- 172.21.15.62:0/3375785990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62d80b0990 msgr2=0x7f62d80b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:04.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.250+0000 7f62de8cc700 1 --2- 172.21.15.62:0/3375785990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62d80b0990 0x7f62d80b2990 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f62d00032f0 tx=0x7f62d0009290).stop 2021-12-17T18:24:04.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.250+0000 7f62de8cc700 1 -- 172.21.15.62:0/3375785990 shutdown_connections 2021-12-17T18:24:04.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.250+0000 7f62de8cc700 1 --2- 172.21.15.62:0/3375785990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62d80b0990 0x7f62d80b2990 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.250+0000 7f62de8cc700 1 --2- 172.21.15.62:0/3375785990 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62d8144f30 0x7f62d80b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.250+0000 7f62de8cc700 1 -- 172.21.15.62:0/3375785990 >> 172.21.15.62:0/3375785990 conn(0x7f62d805c960 msgr2=0x7f62d805cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:04.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.250+0000 7f62de8cc700 1 -- 172.21.15.62:0/3375785990 shutdown_connections 2021-12-17T18:24:04.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.250+0000 7f62de8cc700 1 -- 172.21.15.62:0/3375785990 wait complete. 2021-12-17T18:24:04.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62de8cc700 1 Processor -- start 2021-12-17T18:24:04.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62de8cc700 1 -- start start 2021-12-17T18:24:04.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62de8cc700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f62d805fa70 0x7f62d813ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:04.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62de8cc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62d80b0990 0x7f62d80ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:04.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62de8cc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62d8144f30 0x7f62d8152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:04.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62de8cc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d8143fd0 con 0x7f62d80b0990 2021-12-17T18:24:04.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62de8cc700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80ada30 con 0x7f62d805fa70 2021-12-17T18:24:04.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62de8cc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80acb60 con 0x7f62d8144f30 2021-12-17T18:24:04.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62cffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62d80b0990 0x7f62d80ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:04.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62cffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62d80b0990 0x7f62d80ad540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51898/0 (socket says 172.21.15.62:51898) 2021-12-17T18:24:04.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62cffff700 1 -- 172.21.15.62:0/1484219414 learned_addr learned my addr 172.21.15.62:0/1484219414 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:04.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62d7fff700 1 --2- 172.21.15.62:0/1484219414 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f62d805fa70 0x7f62d813ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:04.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62dce69700 1 --2- 172.21.15.62:0/1484219414 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62d8144f30 0x7f62d8152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:04.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62cffff700 1 -- 172.21.15.62:0/1484219414 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62d8144f30 msgr2=0x7f62d8152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:04.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62cffff700 1 --2- 172.21.15.62:0/1484219414 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62d8144f30 0x7f62d8152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62cffff700 1 -- 172.21.15.62:0/1484219414 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f62d805fa70 msgr2=0x7f62d813ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:04.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62cffff700 1 --2- 172.21.15.62:0/1484219414 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f62d805fa70 0x7f62d813ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62cffff700 1 -- 172.21.15.62:0/1484219414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d0009530 con 0x7f62d80b0990 2021-12-17T18:24:04.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62dce69700 1 --2- 172.21.15.62:0/1484219414 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62d8144f30 0x7f62d8152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:24:04.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62cffff700 1 --2- 172.21.15.62:0/1484219414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62d80b0990 0x7f62d80ad540 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f62d8144110 tx=0x7f62c8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:04.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62d5ffb700 1 -- 172.21.15.62:0/1484219414 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62c8010780 con 0x7f62d80b0990 2021-12-17T18:24:04.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62d5ffb700 1 -- 172.21.15.62:0/1484219414 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c80108e0 con 0x7f62d80b0990 2021-12-17T18:24:04.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62de8cc700 1 -- 172.21.15.62:0/1484219414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d80ace00 con 0x7f62d80b0990 2021-12-17T18:24:04.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62d5ffb700 1 -- 172.21.15.62:0/1484219414 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62c8010c40 con 0x7f62d80b0990 2021-12-17T18:24:04.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.254+0000 7f62de8cc700 1 -- 172.21.15.62:0/1484219414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d80ae0f0 con 0x7f62d80b0990 2021-12-17T18:24:04.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.258+0000 7f62de8cc700 1 -- 172.21.15.62:0/1484219414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d805fe50 con 0x7f62d80b0990 2021-12-17T18:24:04.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.258+0000 7f62d5ffb700 1 -- 172.21.15.62:0/1484219414 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f62c801c460 con 0x7f62d80b0990 2021-12-17T18:24:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.258+0000 7f62d5ffb700 1 --2- 172.21.15.62:0/1484219414 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f62bc053580 0x7f62bc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.258+0000 7f62d5ffb700 1 -- 172.21.15.62:0/1484219414 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f62c806ba20 con 0x7f62d80b0990 2021-12-17T18:24:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.258+0000 7f62d7fff700 1 --2- 172.21.15.62:0/1484219414 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f62bc053580 0x7f62bc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:04.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.262+0000 7f62d7fff700 1 --2- 172.21.15.62:0/1484219414 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f62bc053580 0x7f62bc055a40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f62c000d000 tx=0x7f62c0007a00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:04.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.266+0000 7f62d5ffb700 1 -- 172.21.15.62:0/1484219414 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f62c8042e00 con 0x7f62d80b0990 2021-12-17T18:24:04.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.430+0000 7f62de8cc700 1 -- 172.21.15.62:0/1484219414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f62d80573d0 con 0x7f62d80b0990 2021-12-17T18:24:04.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.854+0000 7f62d5ffb700 1 -- 172.21.15.62:0/1484219414 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v249) v1 ==== 147+0+0 (secure 0 0 0) 0x7f62c8046420 con 0x7f62d80b0990 2021-12-17T18:24:04.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.862+0000 7f62de8cc700 1 -- 172.21.15.62:0/1484219414 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f62bc053580 msgr2=0x7f62bc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:04.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.862+0000 7f62de8cc700 1 --2- 172.21.15.62:0/1484219414 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f62bc053580 0x7f62bc055a40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f62c000d000 tx=0x7f62c0007a00).stop 2021-12-17T18:24:04.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.862+0000 7f62de8cc700 1 -- 172.21.15.62:0/1484219414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62d80b0990 msgr2=0x7f62d80ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:04.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.862+0000 7f62de8cc700 1 --2- 172.21.15.62:0/1484219414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62d80b0990 0x7f62d80ad540 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f62d8144110 tx=0x7f62c8006df0).stop 2021-12-17T18:24:04.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.862+0000 7f62de8cc700 1 -- 172.21.15.62:0/1484219414 shutdown_connections 2021-12-17T18:24:04.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.862+0000 7f62de8cc700 1 --2- 172.21.15.62:0/1484219414 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f62bc053580 0x7f62bc055a40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.862+0000 7f62de8cc700 1 --2- 172.21.15.62:0/1484219414 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62d8144f30 0x7f62d8152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.862+0000 7f62de8cc700 1 --2- 172.21.15.62:0/1484219414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62d80b0990 0x7f62d80ad540 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.862+0000 7f62de8cc700 1 --2- 172.21.15.62:0/1484219414 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f62d805fa70 0x7f62d813ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.862+0000 7f62de8cc700 1 -- 172.21.15.62:0/1484219414 >> 172.21.15.62:0/1484219414 conn(0x7f62d805c960 msgr2=0x7f62d8065ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:04.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.862+0000 7f62de8cc700 1 -- 172.21.15.62:0/1484219414 shutdown_connections 2021-12-17T18:24:04.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.862+0000 7f62de8cc700 1 -- 172.21.15.62:0/1484219414 wait complete. 2021-12-17T18:24:04.877 INFO:tasks.cephfs_test_runner:test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-12-17T18:24:04.878 INFO:tasks.cephfs_test_runner:Starting test: test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) 2021-12-17T18:24:04.878 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-12-17T18:24:04.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.982+0000 7f4577fff700 1 Processor -- start 2021-12-17T18:24:04.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.982+0000 7f4577fff700 1 -- start start 2021-12-17T18:24:04.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4577fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f45780b5c80 0x7f45780b6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:04.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4577fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f457813fb60 0x7f4578143280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:04.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4577fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45780b1540 con 0x7f45780afcf0 2021-12-17T18:24:04.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4577fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f457813ffd0 con 0x7f45780b5c80 2021-12-17T18:24:04.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4577fff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45780b0140 con 0x7f457813fb60 2021-12-17T18:24:04.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f45767fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f45780afcf0 0x7f4578142b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35484/0 (socket says 172.21.15.62:35484) 2021-12-17T18:24:04.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f45767fc700 1 -- 172.21.15.62:0/2044008008 learned_addr learned my addr 172.21.15.62:0/2044008008 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:04.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4576ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f45780b5c80 0x7f45780b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:04.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f45777fe700 1 --2- 172.21.15.62:0/2044008008 >> v2:172.21.15.109:3300/0 conn(0x7f457813fb60 0x7f4578143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:04.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4575ffb700 1 -- 172.21.15.62:0/2044008008 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667041175 0 0) 0x7f45780b1540 con 0x7f45780afcf0 2021-12-17T18:24:04.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4575ffb700 1 -- 172.21.15.62:0/2044008008 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f455c003260 con 0x7f45780afcf0 2021-12-17T18:24:04.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4576ffd700 1 -- 172.21.15.62:0/2044008008 >> v2:172.21.15.109:3300/0 conn(0x7f457813fb60 msgr2=0x7f4578143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:04.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4576ffd700 1 --2- 172.21.15.62:0/2044008008 >> v2:172.21.15.109:3300/0 conn(0x7f457813fb60 0x7f4578143280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4576ffd700 1 -- 172.21.15.62:0/2044008008 >> v1:172.21.15.62:6789/0 conn(0x7f45780afcf0 legacy=0x7f4578142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:04.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4576ffd700 1 -- 172.21.15.62:0/2044008008 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45780af5b0 con 0x7f45780b5c80 2021-12-17T18:24:04.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4576ffd700 1 --2- 172.21.15.62:0/2044008008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780b5c80 0x7f45780b6060 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f456c002f70 tx=0x7f456c006df0).ready entity=mon.0 client_cookie=50edef5b26441aea server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:04.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4575ffb700 1 -- 172.21.15.62:0/2044008008 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f456c00d4f0 con 0x7f45780b5c80 2021-12-17T18:24:04.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4575ffb700 1 -- 172.21.15.62:0/2044008008 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c000e90 con 0x7f45780b5c80 2021-12-17T18:24:04.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4575ffb700 1 -- 172.21.15.62:0/2044008008 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f456c00d840 con 0x7f45780b5c80 2021-12-17T18:24:04.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4577fff700 1 -- 172.21.15.62:0/2044008008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780b5c80 msgr2=0x7f45780b6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:04.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4577fff700 1 --2- 172.21.15.62:0/2044008008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780b5c80 0x7f45780b6060 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f456c002f70 tx=0x7f456c006df0).stop 2021-12-17T18:24:04.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4577fff700 1 -- 172.21.15.62:0/2044008008 shutdown_connections 2021-12-17T18:24:04.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4577fff700 1 --2- 172.21.15.62:0/2044008008 >> v2:172.21.15.109:3300/0 conn(0x7f457813fb60 0x7f4578143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4577fff700 1 --2- 172.21.15.62:0/2044008008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780b5c80 0x7f45780b6060 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:04.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4577fff700 1 -- 172.21.15.62:0/2044008008 >> 172.21.15.62:0/2044008008 conn(0x7f457805c750 msgr2=0x7f457805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:04.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4577fff700 1 -- 172.21.15.62:0/2044008008 shutdown_connections 2021-12-17T18:24:04.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.986+0000 7f4577fff700 1 -- 172.21.15.62:0/2044008008 wait complete. 2021-12-17T18:24:04.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.990+0000 7f4577fff700 1 Processor -- start 2021-12-17T18:24:04.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.990+0000 7f4577fff700 1 -- start start 2021-12-17T18:24:05.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.990+0000 7f4577fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45780afcf0 0x7f4578145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:05.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.990+0000 7f4577fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780b5c80 0x7f457813db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:05.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.990+0000 7f4577fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f457813fb60 0x7f457813e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:05.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.990+0000 7f4577fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4578148540 con 0x7f45780b5c80 2021-12-17T18:24:05.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.990+0000 7f4577fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4578148220 con 0x7f45780afcf0 2021-12-17T18:24:05.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.990+0000 7f4577fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45781487a0 con 0x7f457813fb60 2021-12-17T18:24:05.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.990+0000 7f45767fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780b5c80 0x7f457813db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:05.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.990+0000 7f45767fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780b5c80 0x7f457813db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51912/0 (socket says 172.21.15.62:51912) 2021-12-17T18:24:05.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.990+0000 7f45767fc700 1 -- 172.21.15.62:0/4124105181 learned_addr learned my addr 172.21.15.62:0/4124105181 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:05.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.990+0000 7f45777fe700 1 --2- 172.21.15.62:0/4124105181 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f457813fb60 0x7f457813e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:05.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.990+0000 7f4576ffd700 1 --2- 172.21.15.62:0/4124105181 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45780afcf0 0x7f4578145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:05.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.994+0000 7f45767fc700 1 -- 172.21.15.62:0/4124105181 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f457813fb60 msgr2=0x7f457813e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:05.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.994+0000 7f45767fc700 1 --2- 172.21.15.62:0/4124105181 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f457813fb60 0x7f457813e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:05.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.994+0000 7f45767fc700 1 -- 172.21.15.62:0/4124105181 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45780afcf0 msgr2=0x7f4578145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:05.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.994+0000 7f45767fc700 1 --2- 172.21.15.62:0/4124105181 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45780afcf0 0x7f4578145930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:05.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.994+0000 7f45767fc700 1 -- 172.21.15.62:0/4124105181 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c00b180 con 0x7f45780b5c80 2021-12-17T18:24:05.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.994+0000 7f4576ffd700 1 --2- 172.21.15.62:0/4124105181 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45780afcf0 0x7f4578145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:24:05.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.994+0000 7f45767fc700 1 --2- 172.21.15.62:0/4124105181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780b5c80 0x7f457813db40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f4568001110 tx=0x7f4568007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:05.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.994+0000 7f4567fff700 1 -- 172.21.15.62:0/4124105181 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f456800ce20 con 0x7f45780b5c80 2021-12-17T18:24:05.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.994+0000 7f4567fff700 1 -- 172.21.15.62:0/4124105181 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45680072e0 con 0x7f45780b5c80 2021-12-17T18:24:05.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.994+0000 7f4577fff700 1 -- 172.21.15.62:0/4124105181 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4578148a40 con 0x7f45780b5c80 2021-12-17T18:24:05.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.994+0000 7f4567fff700 1 -- 172.21.15.62:0/4124105181 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4568005800 con 0x7f45780b5c80 2021-12-17T18:24:05.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.994+0000 7f4577fff700 1 -- 172.21.15.62:0/4124105181 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4578155920 con 0x7f45780b5c80 2021-12-17T18:24:05.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.994+0000 7f4577fff700 1 -- 172.21.15.62:0/4124105181 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f457809f8f0 con 0x7f45780b5c80 2021-12-17T18:24:05.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.994+0000 7f4567fff700 1 -- 172.21.15.62:0/4124105181 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4568010070 con 0x7f45780b5c80 2021-12-17T18:24:05.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.994+0000 7f4567fff700 1 --2- 172.21.15.62:0/4124105181 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4554053520 0x7f45540559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:05.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.994+0000 7f4567fff700 1 -- 172.21.15.62:0/4124105181 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f456806acd0 con 0x7f45780b5c80 2021-12-17T18:24:05.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.994+0000 7f4576ffd700 1 --2- 172.21.15.62:0/4124105181 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4554053520 0x7f45540559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:05.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.998+0000 7f4576ffd700 1 --2- 172.21.15.62:0/4124105181 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4554053520 0x7f45540559e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f456c018000 tx=0x7f456c014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:05.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:04.998+0000 7f4567fff700 1 -- 172.21.15.62:0/4124105181 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4568042110 con 0x7f45780b5c80 2021-12-17T18:24:05.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.166+0000 7f4577fff700 1 -- 172.21.15.62:0/4124105181 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7f45780af850 con 0x7f45780b5c80 2021-12-17T18:24:05.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.870+0000 7f4567fff700 1 -- 172.21.15.62:0/4124105181 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v250) v1 ==== 142+0+0 (secure 0 0 0) 0x7f4568045730 con 0x7f45780b5c80 2021-12-17T18:24:05.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.870+0000 7f4577fff700 1 -- 172.21.15.62:0/4124105181 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4554053520 msgr2=0x7f45540559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:05.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.870+0000 7f4577fff700 1 --2- 172.21.15.62:0/4124105181 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4554053520 0x7f45540559e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f456c018000 tx=0x7f456c014000).stop 2021-12-17T18:24:05.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.870+0000 7f4577fff700 1 -- 172.21.15.62:0/4124105181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780b5c80 msgr2=0x7f457813db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:05.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.870+0000 7f4577fff700 1 --2- 172.21.15.62:0/4124105181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780b5c80 0x7f457813db40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f4568001110 tx=0x7f4568007ad0).stop 2021-12-17T18:24:05.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.870+0000 7f4577fff700 1 -- 172.21.15.62:0/4124105181 shutdown_connections 2021-12-17T18:24:05.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.870+0000 7f4577fff700 1 --2- 172.21.15.62:0/4124105181 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4554053520 0x7f45540559e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:05.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.870+0000 7f4577fff700 1 --2- 172.21.15.62:0/4124105181 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f457813fb60 0x7f457813e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:05.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.870+0000 7f4577fff700 1 --2- 172.21.15.62:0/4124105181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780b5c80 0x7f457813db40 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:05.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.870+0000 7f4577fff700 1 --2- 172.21.15.62:0/4124105181 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45780afcf0 0x7f4578145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:05.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.870+0000 7f4577fff700 1 -- 172.21.15.62:0/4124105181 >> 172.21.15.62:0/4124105181 conn(0x7f457805c750 msgr2=0x7f45780ad4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:05.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.874+0000 7f4577fff700 1 -- 172.21.15.62:0/4124105181 shutdown_connections 2021-12-17T18:24:05.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.874+0000 7f4577fff700 1 -- 172.21.15.62:0/4124105181 wait complete. 2021-12-17T18:24:05.887 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-12-17T18:24:05.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd93d8fc700 1 Processor -- start 2021-12-17T18:24:05.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd93d8fc700 1 -- start start 2021-12-17T18:24:06.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd93d8fc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd9380679e0 0x7fd9380667f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd93d8fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd9380b1ec0 0x7fd9380630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd93d8fc700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9380b6ae0 con 0x7fd9380b6700 2021-12-17T18:24:06.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd93d8fc700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9380635d0 con 0x7fd9380b1ec0 2021-12-17T18:24:06.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd93d8fc700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9380672a0 con 0x7fd9380679e0 2021-12-17T18:24:06.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd93c8fa700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd9380b6700 0x7fd9380660e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35498/0 (socket says 172.21.15.62:35498) 2021-12-17T18:24:06.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd93c8fa700 1 -- 172.21.15.62:0/1725053455 learned_addr learned my addr 172.21.15.62:0/1725053455 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:06.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd93d0fb700 1 --2- 172.21.15.62:0/1725053455 >> v2:172.21.15.62:3300/0 conn(0x7fd9380b1ec0 0x7fd9380630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd937fff700 1 --2- 172.21.15.62:0/1725053455 >> v2:172.21.15.109:3300/0 conn(0x7fd9380679e0 0x7fd9380667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd9377fe700 1 -- 172.21.15.62:0/1725053455 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676019958 0 0) 0x7fd9380b6ae0 con 0x7fd9380b6700 2021-12-17T18:24:06.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd9377fe700 1 -- 172.21.15.62:0/1725053455 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd91c003260 con 0x7fd9380b6700 2021-12-17T18:24:06.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd93d0fb700 1 -- 172.21.15.62:0/1725053455 >> v2:172.21.15.109:3300/0 conn(0x7fd9380679e0 msgr2=0x7fd9380667f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:06.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd93d0fb700 1 --2- 172.21.15.62:0/1725053455 >> v2:172.21.15.109:3300/0 conn(0x7fd9380679e0 0x7fd9380667f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd93d0fb700 1 -- 172.21.15.62:0/1725053455 >> v1:172.21.15.62:6789/0 conn(0x7fd9380b6700 legacy=0x7fd9380660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:06.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd93d0fb700 1 -- 172.21.15.62:0/1725053455 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd938067540 con 0x7fd9380b1ec0 2021-12-17T18:24:06.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:05.998+0000 7fd93d0fb700 1 --2- 172.21.15.62:0/1725053455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9380b1ec0 0x7fd9380630e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fd9300032f0 tx=0x7fd9300091d0).ready entity=mon.0 client_cookie=d765a99d49320d76 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:06.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.002+0000 7fd9377fe700 1 -- 172.21.15.62:0/1725053455 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd93000b600 con 0x7fd9380b1ec0 2021-12-17T18:24:06.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.002+0000 7fd9377fe700 1 -- 172.21.15.62:0/1725053455 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93000b760 con 0x7fd9380b1ec0 2021-12-17T18:24:06.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.002+0000 7fd9377fe700 1 -- 172.21.15.62:0/1725053455 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd93000b8d0 con 0x7fd9380b1ec0 2021-12-17T18:24:06.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.002+0000 7fd93d8fc700 1 -- 172.21.15.62:0/1725053455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9380b1ec0 msgr2=0x7fd9380630e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:06.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.002+0000 7fd93d8fc700 1 --2- 172.21.15.62:0/1725053455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9380b1ec0 0x7fd9380630e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fd9300032f0 tx=0x7fd9300091d0).stop 2021-12-17T18:24:06.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.002+0000 7fd93d8fc700 1 -- 172.21.15.62:0/1725053455 shutdown_connections 2021-12-17T18:24:06.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.002+0000 7fd93d8fc700 1 --2- 172.21.15.62:0/1725053455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9380b1ec0 0x7fd9380630e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.002+0000 7fd93d8fc700 1 --2- 172.21.15.62:0/1725053455 >> v2:172.21.15.109:3300/0 conn(0x7fd9380679e0 0x7fd9380667f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.002+0000 7fd93d8fc700 1 -- 172.21.15.62:0/1725053455 >> 172.21.15.62:0/1725053455 conn(0x7fd93805c750 msgr2=0x7fd9380b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:06.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.002+0000 7fd93d8fc700 1 -- 172.21.15.62:0/1725053455 shutdown_connections 2021-12-17T18:24:06.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.002+0000 7fd93d8fc700 1 -- 172.21.15.62:0/1725053455 wait complete. 2021-12-17T18:24:06.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.002+0000 7fd93d8fc700 1 Processor -- start 2021-12-17T18:24:06.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.002+0000 7fd93d8fc700 1 -- start start 2021-12-17T18:24:06.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd93d8fc700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd9380679e0 0x7fd938152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd93d8fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9380b1ec0 0x7fd9381526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd93d8fc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd9380b6700 0x7fd938144320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd93d8fc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd938152be0 con 0x7fd9380b1ec0 2021-12-17T18:24:06.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd93d8fc700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd938152dc0 con 0x7fd9380679e0 2021-12-17T18:24:06.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd93d8fc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9381427c0 con 0x7fd9380b6700 2021-12-17T18:24:06.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd937fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9380b1ec0 0x7fd9381526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd93c8fa700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd9380679e0 0x7fd938152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd937fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9380b1ec0 0x7fd9381526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51926/0 (socket says 172.21.15.62:51926) 2021-12-17T18:24:06.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd937fff700 1 -- 172.21.15.62:0/1325339318 learned_addr learned my addr 172.21.15.62:0/1325339318 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:06.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd93d0fb700 1 --2- 172.21.15.62:0/1325339318 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd9380b6700 0x7fd938144320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd937fff700 1 -- 172.21.15.62:0/1325339318 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd9380b6700 msgr2=0x7fd938144320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:06.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd937fff700 1 --2- 172.21.15.62:0/1325339318 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd9380b6700 0x7fd938144320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd937fff700 1 -- 172.21.15.62:0/1325339318 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd9380679e0 msgr2=0x7fd938152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:06.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd937fff700 1 --2- 172.21.15.62:0/1325339318 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd9380679e0 0x7fd938152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd937fff700 1 -- 172.21.15.62:0/1325339318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd930009470 con 0x7fd9380b1ec0 2021-12-17T18:24:06.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd937fff700 1 --2- 172.21.15.62:0/1325339318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9380b1ec0 0x7fd9381526f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fd938142950 tx=0x7fd924006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:06.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd935ffb700 1 -- 172.21.15.62:0/1325339318 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd924010780 con 0x7fd9380b1ec0 2021-12-17T18:24:06.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd935ffb700 1 -- 172.21.15.62:0/1325339318 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9240108e0 con 0x7fd9380b1ec0 2021-12-17T18:24:06.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd935ffb700 1 -- 172.21.15.62:0/1325339318 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd924010c40 con 0x7fd9380b1ec0 2021-12-17T18:24:06.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd93d8fc700 1 -- 172.21.15.62:0/1325339318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd938142520 con 0x7fd9380b1ec0 2021-12-17T18:24:06.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.006+0000 7fd93d8fc700 1 -- 172.21.15.62:0/1325339318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd938153220 con 0x7fd9380b1ec0 2021-12-17T18:24:06.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.010+0000 7fd935ffb700 1 -- 172.21.15.62:0/1325339318 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd92401c460 con 0x7fd9380b1ec0 2021-12-17T18:24:06.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.010+0000 7fd93d8fc700 1 -- 172.21.15.62:0/1325339318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9380573d0 con 0x7fd9380b1ec0 2021-12-17T18:24:06.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.010+0000 7fd935ffb700 1 --2- 172.21.15.62:0/1325339318 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd918053610 0x7fd918055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.010+0000 7fd935ffb700 1 -- 172.21.15.62:0/1325339318 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fd92406b9f0 con 0x7fd9380b1ec0 2021-12-17T18:24:06.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.010+0000 7fd93c8fa700 1 --2- 172.21.15.62:0/1325339318 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd918053610 0x7fd918055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.010+0000 7fd93c8fa700 1 --2- 172.21.15.62:0/1325339318 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd918053610 0x7fd918055ad0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fd92c00d000 tx=0x7fd92c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:06.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.014+0000 7fd935ffb700 1 -- 172.21.15.62:0/1325339318 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd92406de60 con 0x7fd9380b1ec0 2021-12-17T18:24:06.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.142+0000 7fd93d8fc700 1 -- 172.21.15.62:0/1325339318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd938152f80 con 0x7fd9380b1ec0 2021-12-17T18:24:06.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.150+0000 7fd935ffb700 1 -- 172.21.15.62:0/1325339318 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd924042dd0 con 0x7fd9380b1ec0 2021-12-17T18:24:06.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.154+0000 7fd93d8fc700 1 -- 172.21.15.62:0/1325339318 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd918053610 msgr2=0x7fd918055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:06.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.154+0000 7fd93d8fc700 1 --2- 172.21.15.62:0/1325339318 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd918053610 0x7fd918055ad0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fd92c00d000 tx=0x7fd92c009040).stop 2021-12-17T18:24:06.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.154+0000 7fd93d8fc700 1 -- 172.21.15.62:0/1325339318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9380b1ec0 msgr2=0x7fd9381526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:06.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.154+0000 7fd93d8fc700 1 --2- 172.21.15.62:0/1325339318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9380b1ec0 0x7fd9381526f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fd938142950 tx=0x7fd924006df0).stop 2021-12-17T18:24:06.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.154+0000 7fd93d8fc700 1 -- 172.21.15.62:0/1325339318 shutdown_connections 2021-12-17T18:24:06.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.154+0000 7fd93d8fc700 1 --2- 172.21.15.62:0/1325339318 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd918053610 0x7fd918055ad0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.154+0000 7fd93d8fc700 1 --2- 172.21.15.62:0/1325339318 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd9380b6700 0x7fd938144320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.154+0000 7fd93d8fc700 1 --2- 172.21.15.62:0/1325339318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9380b1ec0 0x7fd9381526f0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.154+0000 7fd93d8fc700 1 --2- 172.21.15.62:0/1325339318 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd9380679e0 0x7fd938152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.154+0000 7fd93d8fc700 1 -- 172.21.15.62:0/1325339318 >> 172.21.15.62:0/1325339318 conn(0x7fd93805c750 msgr2=0x7fd9380b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:06.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.154+0000 7fd93d8fc700 1 -- 172.21.15.62:0/1325339318 shutdown_connections 2021-12-17T18:24:06.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.154+0000 7fd93d8fc700 1 -- 172.21.15.62:0/1325339318 wait complete. 2021-12-17T18:24:06.170 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:24:06.170 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:24:06.190 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:24:06.211 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:24:06.232 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:24:06.253 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:24:06.274 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:24:06.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:06.275 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:24:06.276 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:24:06.283 INFO:teuthology.orchestra.run.smithi125.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-12-17T18:24:06.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:24:06.285 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-12-17T18:24:06.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:06.286 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:24:06.286 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:24:06.301 INFO:teuthology.orchestra.run.smithi158.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:24:06.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:24:06.302 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-12-17T18:24:06.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:06.303 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:24:06.303 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:24:06.311 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:24:06.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:24:06.312 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:24:06.314 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:24:06.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa5035cb700 1 Processor -- start 2021-12-17T18:24:06.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa5035cb700 1 -- start start 2021-12-17T18:24:06.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa5035cb700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa4fc0b3eb0 0x7fa4fc145110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa5035cb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4fc067770 0x7fa4fc0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa5035cb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa4fc0b4780 0x7fa4fc05f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa5035cb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4fc0b27c0 con 0x7fa4fc0b4780 2021-12-17T18:24:06.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa5035cb700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4fc144730 con 0x7fa4fc0b3eb0 2021-12-17T18:24:06.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa5035cb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc1449d0 con 0x7fa4fc067770 2021-12-17T18:24:06.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa501b68700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa4fc0b4780 0x7fa4fc05f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa501b68700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa4fc0b4780 0x7fa4fc05f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51936/0 (socket says 172.21.15.62:51936) 2021-12-17T18:24:06.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa501b68700 1 -- 172.21.15.62:0/2020879293 learned_addr learned my addr 172.21.15.62:0/2020879293 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:06.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa500b66700 1 --2- 172.21.15.62:0/2020879293 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4fc067770 0x7fa4fc0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa501367700 1 --2- 172.21.15.62:0/2020879293 >> v2:172.21.15.109:3300/0 conn(0x7fa4fc0b3eb0 0x7fa4fc145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa501b68700 1 -- 172.21.15.62:0/2020879293 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4fc067770 msgr2=0x7fa4fc0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:06.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa501b68700 1 --2- 172.21.15.62:0/2020879293 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4fc067770 0x7fa4fc0b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa501b68700 1 -- 172.21.15.62:0/2020879293 >> v2:172.21.15.109:3300/0 conn(0x7fa4fc0b3eb0 msgr2=0x7fa4fc145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:06.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa501b68700 1 --2- 172.21.15.62:0/2020879293 >> v2:172.21.15.109:3300/0 conn(0x7fa4fc0b3eb0 0x7fa4fc145110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa501b68700 1 -- 172.21.15.62:0/2020879293 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc144c70 con 0x7fa4fc0b4780 2021-12-17T18:24:06.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa501367700 1 --2- 172.21.15.62:0/2020879293 >> v2:172.21.15.109:3300/0 conn(0x7fa4fc0b3eb0 0x7fa4fc145110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:24:06.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa501b68700 1 --2- 172.21.15.62:0/2020879293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4fc0b4780 0x7fa4fc05f730 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fa4fc0b4dc0 tx=0x7fa4f4009290).ready entity=mon.0 client_cookie=364b76bccf93c4a0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:06.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa4f3fff700 1 -- 172.21.15.62:0/2020879293 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f400b860 con 0x7fa4fc0b4780 2021-12-17T18:24:06.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa4f3fff700 1 -- 172.21.15.62:0/2020879293 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f400b9c0 con 0x7fa4fc0b4780 2021-12-17T18:24:06.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa4f3fff700 1 -- 172.21.15.62:0/2020879293 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f400bb30 con 0x7fa4fc0b4780 2021-12-17T18:24:06.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa5035cb700 1 -- 172.21.15.62:0/2020879293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4fc0b4780 msgr2=0x7fa4fc05f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:06.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa5035cb700 1 --2- 172.21.15.62:0/2020879293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4fc0b4780 0x7fa4fc05f730 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fa4fc0b4dc0 tx=0x7fa4f4009290).stop 2021-12-17T18:24:06.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa5035cb700 1 -- 172.21.15.62:0/2020879293 shutdown_connections 2021-12-17T18:24:06.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa5035cb700 1 --2- 172.21.15.62:0/2020879293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4fc0b4780 0x7fa4fc05f730 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa5035cb700 1 --2- 172.21.15.62:0/2020879293 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4fc067770 0x7fa4fc0b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa5035cb700 1 --2- 172.21.15.62:0/2020879293 >> v2:172.21.15.109:3300/0 conn(0x7fa4fc0b3eb0 0x7fa4fc145110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.426+0000 7fa5035cb700 1 -- 172.21.15.62:0/2020879293 >> 172.21.15.62:0/2020879293 conn(0x7fa4fc05cb40 msgr2=0x7fa4fc05cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:06.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa5035cb700 1 -- 172.21.15.62:0/2020879293 shutdown_connections 2021-12-17T18:24:06.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa5035cb700 1 -- 172.21.15.62:0/2020879293 wait complete. 2021-12-17T18:24:06.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa5035cb700 1 Processor -- start 2021-12-17T18:24:06.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa5035cb700 1 -- start start 2021-12-17T18:24:06.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa5035cb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4fc067770 0x7fa4fc05ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa5035cb700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa4fc0b3eb0 0x7fa4fc0a3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa5035cb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4fc0b4780 0x7fa4fc0a3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa5035cb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc140350 con 0x7fa4fc067770 2021-12-17T18:24:06.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa5035cb700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc0aef30 con 0x7fa4fc0b3eb0 2021-12-17T18:24:06.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa5035cb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc0b03a0 con 0x7fa4fc0b4780 2021-12-17T18:24:06.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa501367700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4fc067770 0x7fa4fc05ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa501367700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4fc067770 0x7fa4fc05ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51938/0 (socket says 172.21.15.62:51938) 2021-12-17T18:24:06.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa501367700 1 -- 172.21.15.62:0/81003070 learned_addr learned my addr 172.21.15.62:0/81003070 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:06.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa501b68700 1 --2- 172.21.15.62:0/81003070 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4fc0b4780 0x7fa4fc0a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa500b66700 1 --2- 172.21.15.62:0/81003070 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa4fc0b3eb0 0x7fa4fc0a3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa501367700 1 -- 172.21.15.62:0/81003070 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4fc0b4780 msgr2=0x7fa4fc0a3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:06.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa501367700 1 --2- 172.21.15.62:0/81003070 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4fc0b4780 0x7fa4fc0a3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa501367700 1 -- 172.21.15.62:0/81003070 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa4fc0b3eb0 msgr2=0x7fa4fc0a3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:06.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa501367700 1 --2- 172.21.15.62:0/81003070 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa4fc0b3eb0 0x7fa4fc0a3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.430+0000 7fa501367700 1 -- 172.21.15.62:0/81003070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f4009530 con 0x7fa4fc067770 2021-12-17T18:24:06.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.434+0000 7fa501367700 1 --2- 172.21.15.62:0/81003070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4fc067770 0x7fa4fc05ffe0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fa4f8006940 tx=0x7fa4f8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:06.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.434+0000 7fa4f27fc700 1 -- 172.21.15.62:0/81003070 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f8011780 con 0x7fa4fc067770 2021-12-17T18:24:06.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.434+0000 7fa4f27fc700 1 -- 172.21.15.62:0/81003070 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f80118e0 con 0x7fa4fc067770 2021-12-17T18:24:06.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.434+0000 7fa5035cb700 1 -- 172.21.15.62:0/81003070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4fc0b0640 con 0x7fa4fc067770 2021-12-17T18:24:06.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.434+0000 7fa4f27fc700 1 -- 172.21.15.62:0/81003070 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f8011c40 con 0x7fa4fc067770 2021-12-17T18:24:06.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.434+0000 7fa5035cb700 1 -- 172.21.15.62:0/81003070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4fc0aebb0 con 0x7fa4fc067770 2021-12-17T18:24:06.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.434+0000 7fa4f27fc700 1 -- 172.21.15.62:0/81003070 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa4f801c460 con 0x7fa4fc067770 2021-12-17T18:24:06.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.434+0000 7fa5035cb700 1 -- 172.21.15.62:0/81003070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4fc0573d0 con 0x7fa4fc067770 2021-12-17T18:24:06.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.434+0000 7fa4f27fc700 1 --2- 172.21.15.62:0/81003070 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa4e40535b0 0x7fa4e4055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.434+0000 7fa4f27fc700 1 -- 172.21.15.62:0/81003070 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fa4f806b5e0 con 0x7fa4fc067770 2021-12-17T18:24:06.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.434+0000 7fa500b66700 1 --2- 172.21.15.62:0/81003070 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa4e40535b0 0x7fa4e4055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.438+0000 7fa500b66700 1 --2- 172.21.15.62:0/81003070 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa4e40535b0 0x7fa4e4055a70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fa4ec00c000 tx=0x7fa4ec008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:06.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.442+0000 7fa4f27fc700 1 -- 172.21.15.62:0/81003070 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa4f80429c0 con 0x7fa4fc067770 2021-12-17T18:24:06.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.570+0000 7fa5035cb700 1 -- 172.21.15.62:0/81003070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa4fc06a2b0 con 0x7fa4fc067770 2021-12-17T18:24:06.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.570+0000 7fa4f27fc700 1 -- 172.21.15.62:0/81003070 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v65) v1 ==== 81+0+28876 (secure 0 0 0) 0x7fa4f8045fe0 con 0x7fa4fc067770 2021-12-17T18:24:06.575 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:06.575 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:24:06.575 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 65, 2021-12-17T18:24:06.576 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:24:06.576 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:24:06.576 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:24:03.834823+0000", 2021-12-17T18:24:06.576 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:24:06.576 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:24:06.577 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:24:06.577 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:24:06.577 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:24:06.577 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:24:06.578 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:24:06.578 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:24:06.578 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:24:06.578 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:24:06.579 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:24:06.579 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:24:06.579 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:24:06.579 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:24:06.579 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:24:06.580 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 12, 2021-12-17T18:24:06.580 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:24:06.580 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:24:06.580 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:24:06.581 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:24:06.581 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:24:06.581 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.581 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:24:06.582 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:24:06.582 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:24:06.582 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:24:06.582 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:24:06.583 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:24:06.583 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:24:06.583 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:24:06.583 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:24:06.584 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:24:06.584 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:24:06.584 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:24:06.584 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:24:06.584 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:24:06.585 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:24:06.585 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:24:06.585 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:24:06.585 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:24:06.585 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:24:06.586 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:24:06.586 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:24:06.586 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:24:06.586 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:24:06.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.587 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:24:06.587 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:24:06.587 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:24:06.588 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:24:06.588 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:24:06.588 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:24:06.588 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:24:06.588 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:24:06.589 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:24:06.589 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:24:06.589 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:24:06.589 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:24:06.590 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:24:06.590 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:24:06.590 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:24:06.590 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:24:06.590 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:24:06.591 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:24:06.591 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:24:06.591 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:24:06.591 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:24:06.592 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:24:06.592 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:24:06.592 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:24:06.593 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:24:06.593 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:24:06.594 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:24:06.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.594 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:24:06.595 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:24:06.595 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:24:06.595 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:24:06.595 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:24:06.596 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:24:06.596 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:24:06.596 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:24:06.597 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:24:06.597 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:24:06.597 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:24:06.597 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:24:06.598 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:24:06.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.598 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:24:06.599 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:24:06.599 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.599 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.600 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.600 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:24:06.600 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:24:06.600 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:24:06.600 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:24:06.601 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:24:06.601 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:24:06.601 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:24:06.601 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:24:06.602 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:24:06.602 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:24:06.602 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:24:06.602 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:24:06.602 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:24:06.603 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:24:06.603 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:24:06.603 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:24:06.603 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:24:06.604 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:24:06.604 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:24:06.604 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:24:06.604 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:24:06.604 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:24:06.605 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:24:06.605 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.605 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:24:06.605 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:24:06.606 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:24:06.606 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:24:06.606 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:24:06.606 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:24:06.606 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:24:06.607 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:24:06.607 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:24:06.607 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:24:06.607 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:24:06.608 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:24:06.608 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:24:06.608 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:24:06.608 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:24:06.609 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:24:06.609 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:24:06.609 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:24:06.609 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:24:06.609 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:24:06.610 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:24:06.610 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:24:06.610 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:24:06.610 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:24:06.611 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:24:06.611 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:24:06.611 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:24:06.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.611 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:24:06.612 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:24:06.612 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:24:06.612 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:24:06.612 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:24:06.612 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:24:06.613 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:24:06.613 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:24:06.613 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:24:06.613 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:24:06.614 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:24:06.614 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:24:06.614 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:24:06.614 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:24:06.614 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.615 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.615 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:24:06.615 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:24:06.615 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.616 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:24:06.616 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:24:06.616 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:24:06.616 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:24:06.616 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:24:06.617 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:24:06.617 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:24:06.617 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:24:06.617 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:24:06.618 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 59, 2021-12-17T18:24:06.618 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:24:06.618 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:24:06.618 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:24:06.618 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:24:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:24:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.620 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.620 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.620 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:24:06.620 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:24:06.621 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.621 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.621 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.621 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:24:06.621 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.622 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.622 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.622 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:24:06.622 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:24:06.623 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.623 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.623 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.623 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:24:06.624 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:24:06.624 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.624 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.624 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.624 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:24:06.625 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.625 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.625 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.625 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:24:06.626 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:24:06.626 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.626 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.626 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.626 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:24:06.627 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:24:06.627 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.627 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.627 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.628 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:24:06.628 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.628 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.628 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.629 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:24:06.629 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:24:06.629 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.629 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.629 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.630 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:24:06.630 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:24:06.630 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.630 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.631 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.631 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:24:06.631 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:24:06.631 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:24:06.632 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:24:06.632 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:24:06.632 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:24:06.632 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:24:06.632 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.633 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.633 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.633 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:24:06.633 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:24:06.634 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:24:06.634 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:24:06.634 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:24:06.634 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:24:06.634 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:24:06.635 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:24:06.635 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:24:06.635 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 59, 2021-12-17T18:24:06.635 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:24:06.636 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:24:06.636 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:24:06.636 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.636 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.636 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.637 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:24:06.637 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:24:06.637 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.637 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.638 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.638 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:24:06.638 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:24:06.638 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.638 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.639 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.639 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:24:06.639 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.639 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.640 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.640 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:24:06.640 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:24:06.640 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.640 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.641 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.641 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:24:06.641 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:24:06.641 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.641 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.642 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.642 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:24:06.642 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.642 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.643 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.643 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:24:06.643 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:24:06.643 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.644 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.644 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.644 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:24:06.644 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:24:06.644 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.645 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.645 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.645 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:24:06.645 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.646 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.646 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.646 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:24:06.646 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:24:06.646 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.647 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.647 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.647 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:24:06.647 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:24:06.648 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.648 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.648 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.648 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:24:06.648 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:24:06.649 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:24:06.649 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:24:06.649 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:24:06.649 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:24:06.650 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:24:06.650 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.650 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.650 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.650 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:24:06.651 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:24:06.651 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:24:06.651 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:24:06.651 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:24:06.652 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:24:06.652 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:24:06.652 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:24:06.652 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:24:06.652 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 58, 2021-12-17T18:24:06.653 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:24:06.653 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:24:06.653 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:24:06.653 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.654 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.654 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.654 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:24:06.654 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:24:06.654 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.655 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.655 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.655 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:24:06.655 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:24:06.655 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.656 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.656 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.656 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:24:06.656 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.657 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.657 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.657 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:24:06.657 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:24:06.657 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.658 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.658 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.658 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:24:06.658 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:24:06.659 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.659 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.659 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.659 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:24:06.660 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.660 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.660 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.660 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:24:06.661 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:24:06.661 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.661 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.661 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.661 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:24:06.662 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:24:06.662 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.662 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.662 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.663 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:24:06.663 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.663 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.663 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.663 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:24:06.664 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:24:06.664 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.664 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.664 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.665 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:24:06.665 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:24:06.665 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.665 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.666 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.666 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:24:06.666 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:24:06.666 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:24:06.667 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:24:06.667 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:24:06.667 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:24:06.667 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:24:06.668 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.668 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.668 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.668 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:24:06.668 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:24:06.669 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:24:06.669 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:24:06.669 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:24:06.669 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:24:06.669 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:24:06.670 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:24:06.670 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:24:06.670 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 48, 2021-12-17T18:24:06.670 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:24:06.671 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:24:06.671 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:24:06.671 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.671 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.672 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.672 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:24:06.672 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:24:06.672 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.672 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.673 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.673 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:24:06.673 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:24:06.673 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.674 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.674 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.674 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:24:06.674 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.675 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.675 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.675 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:24:06.675 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:24:06.675 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.676 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.676 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.676 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:24:06.676 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:24:06.677 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.677 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.677 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.677 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:24:06.677 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.678 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.678 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.678 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:24:06.678 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:24:06.679 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.679 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.679 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.679 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:24:06.680 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:24:06.680 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.680 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.680 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.680 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:24:06.681 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.681 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.681 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.681 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:24:06.682 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:24:06.682 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.682 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.682 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.682 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:24:06.683 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:24:06.683 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.683 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.683 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.684 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:24:06.684 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:24:06.684 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:24:06.684 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:24:06.684 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:24:06.685 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:24:06.685 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:24:06.685 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.685 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.686 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.686 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:24:06.686 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:24:06.686 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:24:06.686 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:24:06.687 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:24:06.687 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:24:06.687 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:24:06.687 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:24:06.688 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:24:06.688 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 60, 2021-12-17T18:24:06.688 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:24:06.688 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:24:06.688 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:24:06.689 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.689 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.689 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.689 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:24:06.690 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:24:06.690 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.690 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.690 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.690 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:24:06.691 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:24:06.691 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.691 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.692 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:24:06.692 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.692 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.692 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.693 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:24:06.693 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:24:06.693 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.693 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.693 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.694 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:24:06.694 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:24:06.694 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.694 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.695 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.695 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:24:06.695 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.695 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.696 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.696 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:24:06.696 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:24:06.696 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.696 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.697 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.697 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:24:06.697 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:24:06.697 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.698 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.698 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:24:06.698 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.699 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.699 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.699 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:24:06.699 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:24:06.699 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.700 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.700 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.700 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:24:06.700 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:24:06.700 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.701 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.701 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.701 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:24:06.701 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:24:06.702 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:24:06.702 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:24:06.702 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:24:06.702 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:24:06.703 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:24:06.703 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.703 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.703 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.703 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:24:06.704 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:24:06.704 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:24:06.704 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:24:06.704 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:24:06.705 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:24:06.705 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:24:06.705 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:24:06.705 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:24:06.705 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 58, 2021-12-17T18:24:06.706 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:24:06.706 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:24:06.706 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:24:06.706 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:24:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:24:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:24:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:24:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.709 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.709 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.709 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:24:06.709 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.710 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.710 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.710 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:24:06.710 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:24:06.710 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.711 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.711 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.711 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:24:06.711 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:24:06.712 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.712 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.712 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.712 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:24:06.712 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.713 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.713 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.713 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:24:06.713 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:24:06.714 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.714 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.714 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.714 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:24:06.714 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:24:06.715 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.715 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.715 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.715 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:24:06.716 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.716 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.716 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.716 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:24:06.716 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:24:06.717 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.717 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.717 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.717 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:24:06.718 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:24:06.718 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.718 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.718 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.718 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:24:06.719 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:24:06.719 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:24:06.719 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:24:06.719 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:24:06.720 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:24:06.720 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:24:06.720 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.720 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.721 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:24:06.721 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:24:06.721 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:24:06.721 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:24:06.721 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:24:06.722 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:24:06.722 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:24:06.722 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:24:06.722 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:24:06.723 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 59, 2021-12-17T18:24:06.723 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:24:06.723 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:24:06.723 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:24:06.723 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.724 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.724 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.724 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:24:06.724 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:24:06.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.725 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.725 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.725 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:24:06.725 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:24:06.726 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.726 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.726 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.726 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:24:06.727 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.727 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.727 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.727 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:24:06.727 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:24:06.728 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.728 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.728 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.728 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:24:06.728 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:24:06.729 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.729 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.729 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.729 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:24:06.730 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.730 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.730 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.730 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:24:06.730 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:24:06.731 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.731 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.731 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.731 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:24:06.732 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:24:06.732 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.732 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.732 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.732 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:24:06.733 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.733 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.733 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.733 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:24:06.734 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:24:06.734 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.734 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.734 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.735 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:24:06.735 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:24:06.735 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.735 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.735 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.736 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:24:06.736 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:24:06.736 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:24:06.736 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:24:06.736 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:24:06.737 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:24:06.737 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:24:06.737 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.737 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.738 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.738 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:24:06.738 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:24:06.738 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:24:06.738 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:24:06.739 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:24:06.739 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:24:06.739 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:24:06.739 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:24:06.740 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:24:06.740 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 58, 2021-12-17T18:24:06.740 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:24:06.740 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:24:06.740 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:24:06.741 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.741 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.741 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.741 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:24:06.742 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:24:06.742 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.742 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.742 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.742 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:24:06.743 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:24:06.743 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.743 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.743 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.744 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:24:06.744 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.744 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.744 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.744 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:24:06.745 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:24:06.745 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.745 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.745 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.745 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:24:06.746 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:24:06.746 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.746 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.746 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.747 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:24:06.747 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.747 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.747 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.747 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:24:06.748 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:24:06.748 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.748 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.748 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.749 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:24:06.749 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:24:06.749 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.749 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.749 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.750 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:24:06.750 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:24:06.750 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.750 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:24:06.751 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:24:06.751 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:24:06.751 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.751 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.752 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:24:06.752 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:24:06.752 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:24:06.752 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.752 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.753 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.753 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:24:06.753 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:24:06.753 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:24:06.754 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:24:06.754 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:24:06.754 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:24:06.754 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:24:06.754 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:06.755 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.755 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:24:06.755 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:24:06.755 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.756 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:24:06.756 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:24:06.756 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:24:06.756 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:24:06.756 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:24:06.757 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:24:06.757 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:24:06.757 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:24:06.757 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.757 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.758 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:24:06.758 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:24:06.758 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:24:06.758 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:24:06.759 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:24:06.759 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:24:06.759 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:24:06.759 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:24:06.760 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.760 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.760 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:24:06.760 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:24:06.760 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:24:06.761 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:24:06.761 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:24:06.761 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:24:06.761 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:24:06.762 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:24:06.762 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.762 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.762 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:24:06.762 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:24:06.763 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:24:06.763 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:24:06.763 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:24:06.763 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:24:06.764 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:24:06.764 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:24:06.764 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.764 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.764 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:24:06.765 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:24:06.765 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:24:06.765 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:24:06.765 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:24:06.766 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:24:06.766 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:24:06.766 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:24:06.766 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.766 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.767 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:24:06.767 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:24:06.767 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:24:06.767 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:24:06.768 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:24:06.768 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:24:06.768 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:24:06.768 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:24:06.768 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.769 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.769 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:24:06.769 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:24:06.769 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:24:06.770 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:24:06.770 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:24:06.770 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:24:06.770 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:24:06.770 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:24:06.771 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.771 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:06.771 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:24:06.771 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:24:06.772 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:24:06.772 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:24:06.772 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:24:06.772 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:24:06.772 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:24:06.773 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:24:06.773 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.773 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:24:06.773 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:24:06.773 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:24:06.774 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:24:06.774 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:24:06.774 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": { 2021-12-17T18:24:06.774 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6833/1885234343": "2021-12-18T18:23:59.809336+0000", 2021-12-17T18:24:06.775 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6832/1885234343": "2021-12-18T18:23:59.809336+0000" 2021-12-17T18:24:06.775 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.775 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:24:06.775 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:24:06.775 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:24:06.776 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:24:06.776 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:24:06.776 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:24:06.776 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:24:06.777 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:24:06.777 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:06.777 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:06.777 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:24:06.777 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:24:06.778 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:24:06.778 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:24:06.778 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:24:06.778 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:24:06.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.574+0000 7fa5035cb700 1 -- 172.21.15.62:0/81003070 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa4e40535b0 msgr2=0x7fa4e4055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:06.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.574+0000 7fa5035cb700 1 --2- 172.21.15.62:0/81003070 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa4e40535b0 0x7fa4e4055a70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fa4ec00c000 tx=0x7fa4ec008040).stop 2021-12-17T18:24:06.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.574+0000 7fa5035cb700 1 -- 172.21.15.62:0/81003070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4fc067770 msgr2=0x7fa4fc05ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:06.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.574+0000 7fa5035cb700 1 --2- 172.21.15.62:0/81003070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4fc067770 0x7fa4fc05ffe0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fa4f8006940 tx=0x7fa4f8008040).stop 2021-12-17T18:24:06.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.574+0000 7fa5035cb700 1 -- 172.21.15.62:0/81003070 shutdown_connections 2021-12-17T18:24:06.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.574+0000 7fa5035cb700 1 --2- 172.21.15.62:0/81003070 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa4e40535b0 0x7fa4e4055a70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.574+0000 7fa5035cb700 1 --2- 172.21.15.62:0/81003070 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4fc0b4780 0x7fa4fc0a3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.574+0000 7fa5035cb700 1 --2- 172.21.15.62:0/81003070 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa4fc0b3eb0 0x7fa4fc0a3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.574+0000 7fa5035cb700 1 --2- 172.21.15.62:0/81003070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4fc067770 0x7fa4fc05ffe0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.574+0000 7fa5035cb700 1 -- 172.21.15.62:0/81003070 >> 172.21.15.62:0/81003070 conn(0x7fa4fc05cb40 msgr2=0x7fa4fc140f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:06.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.574+0000 7fa5035cb700 1 -- 172.21.15.62:0/81003070 shutdown_connections 2021-12-17T18:24:06.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.574+0000 7fa5035cb700 1 -- 172.21.15.62:0/81003070 wait complete. 2021-12-17T18:24:06.784 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:24:06.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdccb631700 1 Processor -- start 2021-12-17T18:24:06.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdccb631700 1 -- start start 2021-12-17T18:24:06.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdccb631700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fdcc4139ef0 0x7fdcc40af560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdccb631700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc413a340 con 0x7fdcc405fa70 2021-12-17T18:24:06.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdccb631700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc405fe50 con 0x7fdcc4060980 2021-12-17T18:24:06.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdccb631700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc40afa50 con 0x7fdcc4139ef0 2021-12-17T18:24:06.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdcc93cd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdcc405fa70 0x7fdcc41397e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35526/0 (socket says 172.21.15.62:35526) 2021-12-17T18:24:06.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdcc93cd700 1 -- 172.21.15.62:0/1500583242 learned_addr learned my addr 172.21.15.62:0/1500583242 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:06.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdcc9bce700 1 --2- 172.21.15.62:0/1500583242 >> v2:172.21.15.109:3300/0 conn(0x7fdcc4139ef0 0x7fdcc40af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdcb3fff700 1 -- 172.21.15.62:0/1500583242 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203751653 0 0) 0x7fdcc413a340 con 0x7fdcc405fa70 2021-12-17T18:24:06.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdcb3fff700 1 -- 172.21.15.62:0/1500583242 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcac003260 con 0x7fdcc405fa70 2021-12-17T18:24:06.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdcb3fff700 1 -- 172.21.15.62:0/1500583242 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 174261215 0 0) 0x7fdcac003260 con 0x7fdcc405fa70 2021-12-17T18:24:06.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdcb3fff700 1 -- 172.21.15.62:0/1500583242 >> v2:172.21.15.109:3300/0 conn(0x7fdcc4139ef0 msgr2=0x7fdcc40af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:06.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdcb3fff700 1 --2- 172.21.15.62:0/1500583242 >> v2:172.21.15.109:3300/0 conn(0x7fdcc4139ef0 0x7fdcc40af560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdcb3fff700 1 -- 172.21.15.62:0/1500583242 >> v1:172.21.15.109:6789/0 conn(0x7fdcc4060980 legacy=0x7fdcc413ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:06.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdcb3fff700 1 -- 172.21.15.62:0/1500583242 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc40afc30 con 0x7fdcc405fa70 2021-12-17T18:24:06.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdcb3fff700 1 -- 172.21.15.62:0/1500583242 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fdcc0001660 con 0x7fdcc405fa70 2021-12-17T18:24:06.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdcc9bce700 1 --2- 172.21.15.62:0/1500583242 >> v2:172.21.15.109:3300/0 conn(0x7fdcc4139ef0 0x7fdcc40af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:24:06.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.890+0000 7fdcb3fff700 1 -- 172.21.15.62:0/1500583242 >> v1:172.21.15.62:6789/0 conn(0x7fdcc405fa70 legacy=0x7fdcc41397e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:06.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcb3fff700 1 --2- 172.21.15.62:0/1500583242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcac003750 0x7fdcac003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcb3fff700 1 --2- 172.21.15.62:0/1500583242 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdcac004500 0x7fdcac004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcb3fff700 1 --2- 172.21.15.62:0/1500583242 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdcac004e70 0x7fdcac00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcb3fff700 1 -- 172.21.15.62:0/1500583242 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40afa50 con 0x7fdcac003750 2021-12-17T18:24:06.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcb3fff700 1 -- 172.21.15.62:0/1500583242 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac00bd20 con 0x7fdcac004e70 2021-12-17T18:24:06.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcb3fff700 1 -- 172.21.15.62:0/1500583242 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac00bee0 con 0x7fdcac004500 2021-12-17T18:24:06.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcc93cd700 1 --2- 172.21.15.62:0/1500583242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcac003750 0x7fdcac003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcc8bcc700 1 --2- 172.21.15.62:0/1500583242 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdcac004500 0x7fdcac004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcc9bce700 1 --2- 172.21.15.62:0/1500583242 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdcac004e70 0x7fdcac00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcc93cd700 1 -- 172.21.15.62:0/1500583242 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdcac004500 msgr2=0x7fdcac004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:06.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcc93cd700 1 --2- 172.21.15.62:0/1500583242 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdcac004500 0x7fdcac004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcc93cd700 1 -- 172.21.15.62:0/1500583242 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdcac004e70 msgr2=0x7fdcac00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:06.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcc93cd700 1 --2- 172.21.15.62:0/1500583242 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdcac004e70 0x7fdcac00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcc9bce700 1 -- 172.21.15.62:0/1500583242 reap_dead start 2021-12-17T18:24:06.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcc93cd700 1 -- 172.21.15.62:0/1500583242 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac003260 con 0x7fdcac003750 2021-12-17T18:24:06.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcc93cd700 1 --2- 172.21.15.62:0/1500583242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcac003750 0x7fdcac003b70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fdcc0001370 tx=0x7fdcc0001e10).ready entity=mon.0 client_cookie=3d235edc45c50340 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:06.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcb3fff700 1 -- 172.21.15.62:0/1500583242 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcc00071a0 con 0x7fdcac003750 2021-12-17T18:24:06.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcb3fff700 1 -- 172.21.15.62:0/1500583242 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc0007300 con 0x7fdcac003750 2021-12-17T18:24:06.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdcb3fff700 1 -- 172.21.15.62:0/1500583242 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcc000c8b0 con 0x7fdcac003750 2021-12-17T18:24:06.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdccb631700 1 -- 172.21.15.62:0/1500583242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcac003750 msgr2=0x7fdcac003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:06.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdccb631700 1 --2- 172.21.15.62:0/1500583242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcac003750 0x7fdcac003b70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fdcc0001370 tx=0x7fdcc0001e10).stop 2021-12-17T18:24:06.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdccb631700 1 -- 172.21.15.62:0/1500583242 shutdown_connections 2021-12-17T18:24:06.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdccb631700 1 --2- 172.21.15.62:0/1500583242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcac003750 0x7fdcac003b70 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdccb631700 1 -- 172.21.15.62:0/1500583242 >> 172.21.15.62:0/1500583242 conn(0x7fdcc405c8f0 msgr2=0x7fdcc40630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:06.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdccb631700 1 -- 172.21.15.62:0/1500583242 shutdown_connections 2021-12-17T18:24:06.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdccb631700 1 -- 172.21.15.62:0/1500583242 wait complete. 2021-12-17T18:24:06.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdccb631700 1 Processor -- start 2021-12-17T18:24:06.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.894+0000 7fdccb631700 1 -- start start 2021-12-17T18:24:06.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdccb631700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdcac003750 0x7fdcc40b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdccb631700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdcc413aad0 0x7fdcc4066090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdccb631700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcc413c8d0 0x7fdcc4153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdccb631700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc413c190 con 0x7fdcc413c8d0 2021-12-17T18:24:06.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdccb631700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc413c430 con 0x7fdcac003750 2021-12-17T18:24:06.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdccb631700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4066730 con 0x7fdcc413aad0 2021-12-17T18:24:06.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcc9bce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcc413c8d0 0x7fdcc4153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcc9bce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcc413c8d0 0x7fdcc4153790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51962/0 (socket says 172.21.15.62:51962) 2021-12-17T18:24:06.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcc9bce700 1 -- 172.21.15.62:0/1589608153 learned_addr learned my addr 172.21.15.62:0/1589608153 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:06.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcc93cd700 1 --2- 172.21.15.62:0/1589608153 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdcac003750 0x7fdcc40b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcc8bcc700 1 --2- 172.21.15.62:0/1589608153 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdcc413aad0 0x7fdcc4066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcc9bce700 1 -- 172.21.15.62:0/1589608153 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdcc413aad0 msgr2=0x7fdcc4066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:06.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcc9bce700 1 --2- 172.21.15.62:0/1589608153 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdcc413aad0 0x7fdcc4066090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcc9bce700 1 -- 172.21.15.62:0/1589608153 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdcac003750 msgr2=0x7fdcc40b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:06.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcc9bce700 1 --2- 172.21.15.62:0/1589608153 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdcac003750 0x7fdcc40b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:06.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcc9bce700 1 -- 172.21.15.62:0/1589608153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc413cd50 con 0x7fdcc413c8d0 2021-12-17T18:24:06.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcc93cd700 1 --2- 172.21.15.62:0/1589608153 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdcac003750 0x7fdcc40b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:24:06.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcc9bce700 1 --2- 172.21.15.62:0/1589608153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcc413c8d0 0x7fdcc4153790 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fdcbc00b000 tx=0x7fdcbc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:06.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcb27fc700 1 -- 172.21.15.62:0/1589608153 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcbc013620 con 0x7fdcc413c8d0 2021-12-17T18:24:06.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcb27fc700 1 -- 172.21.15.62:0/1589608153 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc013780 con 0x7fdcc413c8d0 2021-12-17T18:24:06.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcb27fc700 1 -- 172.21.15.62:0/1589608153 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcbc013ae0 con 0x7fdcc413c8d0 2021-12-17T18:24:06.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdccb631700 1 -- 172.21.15.62:0/1589608153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc413cee0 con 0x7fdcc413c8d0 2021-12-17T18:24:06.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdccb631700 1 -- 172.21.15.62:0/1589608153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc4153e20 con 0x7fdcc413c8d0 2021-12-17T18:24:06.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdccb631700 1 -- 172.21.15.62:0/1589608153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc4066580 con 0x7fdcc413c8d0 2021-12-17T18:24:06.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcb27fc700 1 -- 172.21.15.62:0/1589608153 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdcbc00f070 con 0x7fdcc413c8d0 2021-12-17T18:24:06.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcb27fc700 1 --2- 172.21.15.62:0/1589608153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdca40536d0 0x7fdca4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:06.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcb27fc700 1 -- 172.21.15.62:0/1589608153 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fdcbc06b810 con 0x7fdcc413c8d0 2021-12-17T18:24:06.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.898+0000 7fdcc93cd700 1 --2- 172.21.15.62:0/1589608153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdca40536d0 0x7fdca4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:06.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.902+0000 7fdcc93cd700 1 --2- 172.21.15.62:0/1589608153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdca40536d0 0x7fdca4055b90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fdcc0018000 tx=0x7fdcc0015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:06.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:06.906+0000 7fdcb27fc700 1 -- 172.21.15.62:0/1589608153 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdcbc042c50 con 0x7fdcc413c8d0 2021-12-17T18:24:07.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.070+0000 7fdccb631700 1 -- 172.21.15.62:0/1589608153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcc40afed0 con 0x7fdcc413c8d0 2021-12-17T18:24:07.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.070+0000 7fdcb27fc700 1 -- 172.21.15.62:0/1589608153 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+1212 (secure 0 0 0) 0x7fdcbc046270 con 0x7fdcc413c8d0 2021-12-17T18:24:07.074 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:07.075 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3727734226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3727734226},{"type":"v1","addr":"172.21.15.109:6835","nonce":3727734226}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24},{"gid":6231,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3324204722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3324204722},{"type":"v1","addr":"172.21.15.62:6833","nonce":3324204722}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[]} 2021-12-17T18:24:07.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.074+0000 7fdccb631700 1 -- 172.21.15.62:0/1589608153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdca40536d0 msgr2=0x7fdca4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:07.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.074+0000 7fdccb631700 1 --2- 172.21.15.62:0/1589608153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdca40536d0 0x7fdca4055b90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fdcc0018000 tx=0x7fdcc0015000).stop 2021-12-17T18:24:07.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.074+0000 7fdccb631700 1 -- 172.21.15.62:0/1589608153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcc413c8d0 msgr2=0x7fdcc4153790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:07.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.074+0000 7fdccb631700 1 --2- 172.21.15.62:0/1589608153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcc413c8d0 0x7fdcc4153790 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fdcbc00b000 tx=0x7fdcbc008040).stop 2021-12-17T18:24:07.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.074+0000 7fdccb631700 1 -- 172.21.15.62:0/1589608153 shutdown_connections 2021-12-17T18:24:07.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.074+0000 7fdccb631700 1 --2- 172.21.15.62:0/1589608153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdca40536d0 0x7fdca4055b90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:07.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.074+0000 7fdccb631700 1 --2- 172.21.15.62:0/1589608153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcc413c8d0 0x7fdcc4153790 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:07.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.074+0000 7fdccb631700 1 --2- 172.21.15.62:0/1589608153 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdcc413aad0 0x7fdcc4066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:07.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.074+0000 7fdccb631700 1 --2- 172.21.15.62:0/1589608153 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdcac003750 0x7fdcc40b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:07.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.074+0000 7fdccb631700 1 -- 172.21.15.62:0/1589608153 >> 172.21.15.62:0/1589608153 conn(0x7fdcc405c8f0 msgr2=0x7fdcc4138880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:07.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.074+0000 7fdccb631700 1 -- 172.21.15.62:0/1589608153 shutdown_connections 2021-12-17T18:24:07.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.074+0000 7fdccb631700 1 -- 172.21.15.62:0/1589608153 wait complete. 2021-12-17T18:24:07.081 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 29 2021-12-17T18:24:07.093 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:24:07.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.190+0000 7fc346ce8700 1 Processor -- start 2021-12-17T18:24:07.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.190+0000 7fc346ce8700 1 -- start start 2021-12-17T18:24:07.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.190+0000 7fc346ce8700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc3400b21f0 0x7fc34014aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:07.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.190+0000 7fc346ce8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3400b2ce0 con 0x7fc3400a7bb0 2021-12-17T18:24:07.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc346ce8700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3400aca60 con 0x7fc3400b1730 2021-12-17T18:24:07.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc346ce8700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc340147870 con 0x7fc3400b21f0 2021-12-17T18:24:07.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc345285700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc3400a7bb0 0x7fc340067120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35550/0 (socket says 172.21.15.62:35550) 2021-12-17T18:24:07.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc345285700 1 -- 172.21.15.62:0/3955581863 learned_addr learned my addr 172.21.15.62:0/3955581863 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:07.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc344a84700 1 --2- 172.21.15.62:0/3955581863 >> v2:172.21.15.109:3300/0 conn(0x7fc3400b21f0 0x7fc34014aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:07.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc33f7fe700 1 -- 172.21.15.62:0/3955581863 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937374305 0 0) 0x7fc3400b2ce0 con 0x7fc3400a7bb0 2021-12-17T18:24:07.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc33f7fe700 1 -- 172.21.15.62:0/3955581863 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc32c003260 con 0x7fc3400a7bb0 2021-12-17T18:24:07.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc33f7fe700 1 -- 172.21.15.62:0/3955581863 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069022421 0 0) 0x7fc3400aca60 con 0x7fc3400b1730 2021-12-17T18:24:07.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc33f7fe700 1 -- 172.21.15.62:0/3955581863 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3400b2ce0 con 0x7fc3400b1730 2021-12-17T18:24:07.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc344a84700 1 -- 172.21.15.62:0/3955581863 >> v1:172.21.15.109:6789/0 conn(0x7fc3400b1730 legacy=0x7fc3400ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:07.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc344a84700 1 -- 172.21.15.62:0/3955581863 >> v1:172.21.15.62:6789/0 conn(0x7fc3400a7bb0 legacy=0x7fc340067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:07.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc33f7fe700 1 -- 172.21.15.62:0/3955581863 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2943143535 0 0) 0x7fc32c003260 con 0x7fc3400a7bb0 2021-12-17T18:24:07.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc344a84700 1 -- 172.21.15.62:0/3955581863 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3400b2f10 con 0x7fc3400b21f0 2021-12-17T18:24:07.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc344a84700 1 --2- 172.21.15.62:0/3955581863 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc3400b21f0 0x7fc34014aea0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fc3400b1c00 tx=0x7fc334006df0).ready entity=mon.1 client_cookie=5ea3941d101550b4 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:07.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc33f7fe700 1 -- 172.21.15.62:0/3955581863 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3380019e0 con 0x7fc3400b21f0 2021-12-17T18:24:07.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc33f7fe700 1 -- 172.21.15.62:0/3955581863 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc334000e90 con 0x7fc3400b21f0 2021-12-17T18:24:07.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc33f7fe700 1 -- 172.21.15.62:0/3955581863 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc334012460 con 0x7fc3400b21f0 2021-12-17T18:24:07.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc346ce8700 1 -- 172.21.15.62:0/3955581863 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc3400b21f0 msgr2=0x7fc34014aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:07.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc346ce8700 1 --2- 172.21.15.62:0/3955581863 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc3400b21f0 0x7fc34014aea0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fc3400b1c00 tx=0x7fc334006df0).stop 2021-12-17T18:24:07.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc346ce8700 1 -- 172.21.15.62:0/3955581863 shutdown_connections 2021-12-17T18:24:07.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc346ce8700 1 --2- 172.21.15.62:0/3955581863 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc3400b21f0 0x7fc34014aea0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:07.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc346ce8700 1 -- 172.21.15.62:0/3955581863 >> 172.21.15.62:0/3955581863 conn(0x7fc34005f730 msgr2=0x7fc34005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:07.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc346ce8700 1 -- 172.21.15.62:0/3955581863 shutdown_connections 2021-12-17T18:24:07.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.194+0000 7fc346ce8700 1 -- 172.21.15.62:0/3955581863 wait complete. 2021-12-17T18:24:07.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc346ce8700 1 Processor -- start 2021-12-17T18:24:07.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc346ce8700 1 -- start start 2021-12-17T18:24:07.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc346ce8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc3400a7bb0 0x7fc3400abc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:07.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc346ce8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3400b1730 0x7fc340066d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:07.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc346ce8700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc340065f50 0x7fc3400aa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:07.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc346ce8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3401578b0 con 0x7fc3400b1730 2021-12-17T18:24:07.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc346ce8700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400667e0 con 0x7fc340065f50 2021-12-17T18:24:07.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc346ce8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc340066a80 con 0x7fc3400a7bb0 2021-12-17T18:24:07.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc33ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3400b1730 0x7fc340066d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:07.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc33ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3400b1730 0x7fc340066d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51972/0 (socket says 172.21.15.62:51972) 2021-12-17T18:24:07.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc33ffff700 1 -- 172.21.15.62:0/2133913528 learned_addr learned my addr 172.21.15.62:0/2133913528 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:07.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc344a84700 1 --2- 172.21.15.62:0/2133913528 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc3400a7bb0 0x7fc3400abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:07.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc345285700 1 --2- 172.21.15.62:0/2133913528 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc340065f50 0x7fc3400aa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:07.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc33ffff700 1 -- 172.21.15.62:0/2133913528 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc3400a7bb0 msgr2=0x7fc3400abc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:07.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc33ffff700 1 --2- 172.21.15.62:0/2133913528 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc3400a7bb0 0x7fc3400abc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:07.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc33ffff700 1 -- 172.21.15.62:0/2133913528 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc340065f50 msgr2=0x7fc3400aa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:07.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc33ffff700 1 --2- 172.21.15.62:0/2133913528 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc340065f50 0x7fc3400aa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:07.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc33ffff700 1 -- 172.21.15.62:0/2133913528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33400b180 con 0x7fc3400b1730 2021-12-17T18:24:07.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc33ffff700 1 --2- 172.21.15.62:0/2133913528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3400b1730 0x7fc340066d20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fc330001110 tx=0x7fc330007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:07.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc33dffb700 1 -- 172.21.15.62:0/2133913528 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc33000ce10 con 0x7fc3400b1730 2021-12-17T18:24:07.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc33dffb700 1 -- 172.21.15.62:0/2133913528 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33000f470 con 0x7fc3400b1730 2021-12-17T18:24:07.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc346ce8700 1 -- 172.21.15.62:0/2133913528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc340157ca0 con 0x7fc3400b1730 2021-12-17T18:24:07.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc33dffb700 1 -- 172.21.15.62:0/2133913528 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc33000f7d0 con 0x7fc3400b1730 2021-12-17T18:24:07.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc346ce8700 1 -- 172.21.15.62:0/2133913528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3400aab60 con 0x7fc3400b1730 2021-12-17T18:24:07.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.198+0000 7fc346ce8700 1 -- 172.21.15.62:0/2133913528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc340066600 con 0x7fc3400b1730 2021-12-17T18:24:07.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.202+0000 7fc33dffb700 1 -- 172.21.15.62:0/2133913528 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc330019030 con 0x7fc3400b1730 2021-12-17T18:24:07.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.202+0000 7fc33dffb700 1 --2- 172.21.15.62:0/2133913528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc3200536d0 0x7fc320055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:07.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.202+0000 7fc33dffb700 1 -- 172.21.15.62:0/2133913528 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fc33006aaa0 con 0x7fc3400b1730 2021-12-17T18:24:07.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.202+0000 7fc344a84700 1 --2- 172.21.15.62:0/2133913528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc3200536d0 0x7fc320055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:07.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.202+0000 7fc344a84700 1 --2- 172.21.15.62:0/2133913528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc3200536d0 0x7fc320055b90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fc334018000 tx=0x7fc334014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:07.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.206+0000 7fc33dffb700 1 -- 172.21.15.62:0/2133913528 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc330041ee0 con 0x7fc3400b1730 2021-12-17T18:24:07.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.370+0000 7fc346ce8700 1 -- 172.21.15.62:0/2133913528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc34014b390 con 0x7fc3400b1730 2021-12-17T18:24:07.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.370+0000 7fc33dffb700 1 -- 172.21.15.62:0/2133913528 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+1212 (secure 0 0 0) 0x7fc330045500 con 0x7fc3400b1730 2021-12-17T18:24:07.374 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:07.374 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3727734226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3727734226},{"type":"v1","addr":"172.21.15.109:6835","nonce":3727734226}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24},{"gid":6231,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3324204722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3324204722},{"type":"v1","addr":"172.21.15.62:6833","nonce":3324204722}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[]} 2021-12-17T18:24:07.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.374+0000 7fc346ce8700 1 -- 172.21.15.62:0/2133913528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc3200536d0 msgr2=0x7fc320055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:07.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.374+0000 7fc346ce8700 1 --2- 172.21.15.62:0/2133913528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc3200536d0 0x7fc320055b90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fc334018000 tx=0x7fc334014000).stop 2021-12-17T18:24:07.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.374+0000 7fc346ce8700 1 -- 172.21.15.62:0/2133913528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3400b1730 msgr2=0x7fc340066d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:07.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.374+0000 7fc346ce8700 1 --2- 172.21.15.62:0/2133913528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3400b1730 0x7fc340066d20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fc330001110 tx=0x7fc330007ae0).stop 2021-12-17T18:24:07.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.374+0000 7fc346ce8700 1 -- 172.21.15.62:0/2133913528 shutdown_connections 2021-12-17T18:24:07.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.374+0000 7fc346ce8700 1 --2- 172.21.15.62:0/2133913528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc3200536d0 0x7fc320055b90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.374+0000 7fc346ce8700 1 --2- 172.21.15.62:0/2133913528 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc340065f50 0x7fc3400aa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.374+0000 7fc346ce8700 1 --2- 172.21.15.62:0/2133913528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3400b1730 0x7fc340066d20 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.374+0000 7fc346ce8700 1 --2- 172.21.15.62:0/2133913528 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc3400a7bb0 0x7fc3400abc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.374+0000 7fc346ce8700 1 -- 172.21.15.62:0/2133913528 >> 172.21.15.62:0/2133913528 conn(0x7fc34005f730 msgr2=0x7fc3400ad6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:07.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.374+0000 7fc346ce8700 1 -- 172.21.15.62:0/2133913528 shutdown_connections 2021-12-17T18:24:07.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.374+0000 7fc346ce8700 1 -- 172.21.15.62:0/2133913528 wait complete. 2021-12-17T18:24:07.379 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 29 2021-12-17T18:24:07.387 INFO:tasks.ceph.mds.a:Restarting daemon 2021-12-17T18:24:07.387 INFO:tasks.ceph.mds.a:Stopping old one... 2021-12-17T18:24:07.387 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-12-17T18:24:07.388 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:24:07.388 INFO:tasks.ceph.mds.b:Restarting daemon 2021-12-17T18:24:07.388 INFO:tasks.ceph.mds.b:Stopping old one... 2021-12-17T18:24:07.389 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-12-17T18:24:07.389 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:24:07.402 INFO:tasks.ceph.mds.a:Stopped 2021-12-17T18:24:07.402 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-12-17T18:24:07.404 INFO:tasks.ceph.mds.b:Stopped 2021-12-17T18:24:07.404 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-12-17T18:24:07.406 INFO:tasks.ceph.mds.a:Started 2021-12-17T18:24:07.407 DEBUG:teuthology.parallel:result is None 2021-12-17T18:24:07.408 INFO:tasks.ceph.mds.b:Started 2021-12-17T18:24:07.408 DEBUG:teuthology.parallel:result is None 2021-12-17T18:24:07.408 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-12-17T18:24:07.475 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:24:07.481 INFO:tasks.ceph.mds.b.smithi109.stdout:starting mds.b at 2021-12-17T18:24:07.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.502+0000 7f17adf7a700 1 Processor -- start 2021-12-17T18:24:07.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.502+0000 7f17adf7a700 1 -- start start 2021-12-17T18:24:07.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17adf7a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17a813ce80 0x7f17a8142f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:07.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17adf7a700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f17a81433f0 0x7f17a8143840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:07.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17adf7a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a8146e30 con 0x7f17a8062620 2021-12-17T18:24:07.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17adf7a700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a8062a00 con 0x7f17a81433f0 2021-12-17T18:24:07.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17adf7a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a80b59e0 con 0x7f17a813ce80 2021-12-17T18:24:07.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17acf78700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f17a8062620 0x7f17a813c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35572/0 (socket says 172.21.15.62:35572) 2021-12-17T18:24:07.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17acf78700 1 -- 172.21.15.62:0/3447511287 learned_addr learned my addr 172.21.15.62:0/3447511287 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:07.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17ad779700 1 --2- 172.21.15.62:0/3447511287 >> v2:172.21.15.109:3300/0 conn(0x7f17a81433f0 0x7f17a8143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:07.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f179ffff700 1 --2- 172.21.15.62:0/3447511287 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17a813ce80 0x7f17a8142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:07.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f179f7fe700 1 -- 172.21.15.62:0/3447511287 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063117056 0 0) 0x7f17a8146e30 con 0x7f17a8062620 2021-12-17T18:24:07.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f179f7fe700 1 -- 172.21.15.62:0/3447511287 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1794003260 con 0x7f17a8062620 2021-12-17T18:24:07.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17ad779700 1 -- 172.21.15.62:0/3447511287 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17a813ce80 msgr2=0x7f17a8142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:07.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17ad779700 1 --2- 172.21.15.62:0/3447511287 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17a813ce80 0x7f17a8142f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:07.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17ad779700 1 -- 172.21.15.62:0/3447511287 >> v1:172.21.15.62:6789/0 conn(0x7f17a8062620 legacy=0x7f17a813c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:07.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f179f7fe700 1 -- 172.21.15.62:0/3447511287 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1689781987 0 0) 0x7f1794003260 con 0x7f17a8062620 2021-12-17T18:24:07.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17ad779700 1 -- 172.21.15.62:0/3447511287 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a8143d30 con 0x7f17a81433f0 2021-12-17T18:24:07.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17ad779700 1 --2- 172.21.15.62:0/3447511287 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17a81433f0 0x7f17a8143840 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f17a4001800 tx=0x7f17a00091d0).ready entity=mon.1 client_cookie=cf64b944fdef422b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:07.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f179f7fe700 1 -- 172.21.15.62:0/3447511287 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17a4001660 con 0x7f17a81433f0 2021-12-17T18:24:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f179f7fe700 1 -- 172.21.15.62:0/3447511287 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a000f510 con 0x7f17a81433f0 2021-12-17T18:24:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f179f7fe700 1 -- 172.21.15.62:0/3447511287 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17a000f680 con 0x7f17a81433f0 2021-12-17T18:24:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17adf7a700 1 -- 172.21.15.62:0/3447511287 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17a81433f0 msgr2=0x7f17a8143840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17adf7a700 1 --2- 172.21.15.62:0/3447511287 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17a81433f0 0x7f17a8143840 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f17a4001800 tx=0x7f17a00091d0).stop 2021-12-17T18:24:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17adf7a700 1 -- 172.21.15.62:0/3447511287 shutdown_connections 2021-12-17T18:24:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17adf7a700 1 --2- 172.21.15.62:0/3447511287 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17a81433f0 0x7f17a8143840 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17adf7a700 1 --2- 172.21.15.62:0/3447511287 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17a813ce80 0x7f17a8142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17adf7a700 1 -- 172.21.15.62:0/3447511287 >> 172.21.15.62:0/3447511287 conn(0x7f17a805c750 msgr2=0x7f17a805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:07.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17adf7a700 1 -- 172.21.15.62:0/3447511287 shutdown_connections 2021-12-17T18:24:07.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.506+0000 7f17adf7a700 1 -- 172.21.15.62:0/3447511287 wait complete. 2021-12-17T18:24:07.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17adf7a700 1 Processor -- start 2021-12-17T18:24:07.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17adf7a700 1 -- start start 2021-12-17T18:24:07.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17adf7a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17a8062620 0x7f17a81418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:07.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17adf7a700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17a813ce80 0x7f17a8140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17adf7a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17a81433f0 0x7f17a813ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17adf7a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a8066cd0 con 0x7f17a81433f0 2021-12-17T18:24:07.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17adf7a700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a8141340 con 0x7f17a813ce80 2021-12-17T18:24:07.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17adf7a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a80666f0 con 0x7f17a8062620 2021-12-17T18:24:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17ad779700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17a81433f0 0x7f17a813ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17ad779700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17a81433f0 0x7f17a813ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52002/0 (socket says 172.21.15.62:52002) 2021-12-17T18:24:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17ad779700 1 -- 172.21.15.62:0/1015738555 learned_addr learned my addr 172.21.15.62:0/1015738555 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:07.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17acf78700 1 --2- 172.21.15.62:0/1015738555 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17a8062620 0x7f17a81418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:07.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f179ffff700 1 --2- 172.21.15.62:0/1015738555 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17a813ce80 0x7f17a8140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:07.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17ad779700 1 -- 172.21.15.62:0/1015738555 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17a8062620 msgr2=0x7f17a81418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:07.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17ad779700 1 --2- 172.21.15.62:0/1015738555 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17a8062620 0x7f17a81418a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:07.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17ad779700 1 -- 172.21.15.62:0/1015738555 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17a813ce80 msgr2=0x7f17a8140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:07.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17ad779700 1 --2- 172.21.15.62:0/1015738555 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17a813ce80 0x7f17a8140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:07.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17ad779700 1 -- 172.21.15.62:0/1015738555 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a0009470 con 0x7f17a81433f0 2021-12-17T18:24:07.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17acf78700 1 --2- 172.21.15.62:0/1015738555 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17a8062620 0x7f17a81418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:24:07.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17ad779700 1 --2- 172.21.15.62:0/1015738555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17a81433f0 0x7f17a813ddf0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f17a81414d0 tx=0x7f17a0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:07.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f179dffb700 1 -- 172.21.15.62:0/1015738555 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17a00032f0 con 0x7f17a81433f0 2021-12-17T18:24:07.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f179dffb700 1 -- 172.21.15.62:0/1015738555 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a0011ca0 con 0x7f17a81433f0 2021-12-17T18:24:07.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17adf7a700 1 -- 172.21.15.62:0/1015738555 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a8141ef0 con 0x7f17a81433f0 2021-12-17T18:24:07.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f179dffb700 1 -- 172.21.15.62:0/1015738555 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17a0021480 con 0x7f17a81433f0 2021-12-17T18:24:07.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.510+0000 7f17adf7a700 1 -- 172.21.15.62:0/1015738555 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a813d940 con 0x7f17a81433f0 2021-12-17T18:24:07.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.514+0000 7f17adf7a700 1 -- 172.21.15.62:0/1015738555 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a8142080 con 0x7f17a81433f0 2021-12-17T18:24:07.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.514+0000 7f179dffb700 1 -- 172.21.15.62:0/1015738555 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f17a000f070 con 0x7f17a81433f0 2021-12-17T18:24:07.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.514+0000 7f179dffb700 1 --2- 172.21.15.62:0/1015738555 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1788053610 0x7f1788055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:07.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.514+0000 7f179dffb700 1 -- 172.21.15.62:0/1015738555 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f17a006c9e0 con 0x7f17a81433f0 2021-12-17T18:24:07.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.514+0000 7f17acf78700 1 --2- 172.21.15.62:0/1015738555 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1788053610 0x7f1788055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:07.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.514+0000 7f17acf78700 1 --2- 172.21.15.62:0/1015738555 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1788053610 0x7f1788055ad0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f17a400b000 tx=0x7f17a4001140).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:07.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.522+0000 7f179dffb700 1 -- 172.21.15.62:0/1015738555 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f17a0043c90 con 0x7f17a81433f0 2021-12-17T18:24:07.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:07.654+0000 7f17adf7a700 1 -- 172.21.15.62:0/1015738555 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f17a80573d0 con 0x7f17a81433f0 2021-12-17T18:24:08.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.654+0000 7f179dffb700 1 -- 172.21.15.62:0/1015738555 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v67) v1 ==== 97+0+0 (secure 0 0 0) 0x7f17a0015020 con 0x7f17a81433f0 2021-12-17T18:24:08.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.658+0000 7f17adf7a700 1 -- 172.21.15.62:0/1015738555 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1788053610 msgr2=0x7f1788055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:08.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.658+0000 7f17adf7a700 1 --2- 172.21.15.62:0/1015738555 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1788053610 0x7f1788055ad0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f17a400b000 tx=0x7f17a4001140).stop 2021-12-17T18:24:08.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.658+0000 7f17adf7a700 1 -- 172.21.15.62:0/1015738555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17a81433f0 msgr2=0x7f17a813ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:08.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.658+0000 7f17adf7a700 1 --2- 172.21.15.62:0/1015738555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17a81433f0 0x7f17a813ddf0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f17a81414d0 tx=0x7f17a0016000).stop 2021-12-17T18:24:08.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.658+0000 7f17adf7a700 1 -- 172.21.15.62:0/1015738555 shutdown_connections 2021-12-17T18:24:08.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.658+0000 7f17adf7a700 1 --2- 172.21.15.62:0/1015738555 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1788053610 0x7f1788055ad0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:08.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.658+0000 7f17adf7a700 1 --2- 172.21.15.62:0/1015738555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17a81433f0 0x7f17a813ddf0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:08.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.658+0000 7f17adf7a700 1 --2- 172.21.15.62:0/1015738555 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17a813ce80 0x7f17a8140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:08.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.658+0000 7f17adf7a700 1 --2- 172.21.15.62:0/1015738555 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17a8062620 0x7f17a81418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:08.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.658+0000 7f17adf7a700 1 -- 172.21.15.62:0/1015738555 >> 172.21.15.62:0/1015738555 conn(0x7f17a805c750 msgr2=0x7f17a8142b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:08.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.658+0000 7f17adf7a700 1 -- 172.21.15.62:0/1015738555 shutdown_connections 2021-12-17T18:24:08.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.658+0000 7f17adf7a700 1 -- 172.21.15.62:0/1015738555 wait complete. 2021-12-17T18:24:08.665 INFO:teuthology.orchestra.run.smithi062.stderr: removed all blacklist entries 2021-12-17T18:24:08.676 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-12-17T18:24:08.677 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-12-17T18:24:08.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.778+0000 7f2fee160700 1 Processor -- start 2021-12-17T18:24:08.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.778+0000 7f2fee160700 1 -- start start 2021-12-17T18:24:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.778+0000 7f2fee160700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2fe80b1730 0x7f2fe80ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.778+0000 7f2fee160700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2fe80a7bb0 0x7f2fe8067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.778+0000 7f2fee160700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe80b2ce0 con 0x7f2fe80b21f0 2021-12-17T18:24:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.778+0000 7f2fee160700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe814b5b0 con 0x7f2fe80b1730 2021-12-17T18:24:08.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.778+0000 7f2fee160700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe8147870 con 0x7f2fe80a7bb0 2021-12-17T18:24:08.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fe6ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2fe80b1730 0x7f2fe80ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:08.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fe6ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2fe80b1730 0x7f2fe80ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52006/0 (socket says 172.21.15.62:52006) 2021-12-17T18:24:08.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fe6ffd700 1 -- 172.21.15.62:0/50686162 learned_addr learned my addr 172.21.15.62:0/50686162 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:08.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fe7fff700 1 --2- 172.21.15.62:0/50686162 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2fe80a7bb0 0x7f2fe8067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:08.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fe6ffd700 1 -- 172.21.15.62:0/50686162 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2fe80a7bb0 msgr2=0x7f2fe8067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:08.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fe6ffd700 1 --2- 172.21.15.62:0/50686162 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2fe80a7bb0 0x7f2fe8067120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:08.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fe6ffd700 1 -- 172.21.15.62:0/50686162 >> v1:172.21.15.109:6789/0 conn(0x7f2fe80b21f0 legacy=0x7f2fe814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:08.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fe6ffd700 1 -- 172.21.15.62:0/50686162 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe80aca60 con 0x7f2fe80b1730 2021-12-17T18:24:08.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fe6ffd700 1 --2- 172.21.15.62:0/50686162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fe80b1730 0x7f2fe80ace90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f2fd8002f70 tx=0x7f2fd8006eb0).ready entity=mon.0 client_cookie=6576cc019ebd6d41 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:08.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fe67fc700 1 -- 172.21.15.62:0/50686162 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd800d570 con 0x7f2fe80b1730 2021-12-17T18:24:08.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fe67fc700 1 -- 172.21.15.62:0/50686162 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd8000e90 con 0x7f2fe80b1730 2021-12-17T18:24:08.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fe67fc700 1 -- 172.21.15.62:0/50686162 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd800d900 con 0x7f2fe80b1730 2021-12-17T18:24:08.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fee160700 1 -- 172.21.15.62:0/50686162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fe80b1730 msgr2=0x7f2fe80ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:08.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fee160700 1 --2- 172.21.15.62:0/50686162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fe80b1730 0x7f2fe80ace90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f2fd8002f70 tx=0x7f2fd8006eb0).stop 2021-12-17T18:24:08.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fee160700 1 -- 172.21.15.62:0/50686162 shutdown_connections 2021-12-17T18:24:08.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fee160700 1 --2- 172.21.15.62:0/50686162 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2fe80a7bb0 0x7f2fe8067120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:08.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fee160700 1 --2- 172.21.15.62:0/50686162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fe80b1730 0x7f2fe80ace90 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:08.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fee160700 1 -- 172.21.15.62:0/50686162 >> 172.21.15.62:0/50686162 conn(0x7f2fe805f730 msgr2=0x7f2fe805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:08.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fee160700 1 -- 172.21.15.62:0/50686162 shutdown_connections 2021-12-17T18:24:08.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fee160700 1 -- 172.21.15.62:0/50686162 wait complete. 2021-12-17T18:24:08.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fee160700 1 Processor -- start 2021-12-17T18:24:08.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fee160700 1 -- start start 2021-12-17T18:24:08.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fee160700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fe80a7bb0 0x7f2fe8157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:08.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fee160700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2fe80b1730 0x7f2fe8066010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:08.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fee160700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2fe80b21f0 0x7f2fe815a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:08.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fee160700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe8066500 con 0x7f2fe80a7bb0 2021-12-17T18:24:08.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fee160700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe80abf80 con 0x7f2fe80b21f0 2021-12-17T18:24:08.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.782+0000 7f2fee160700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe80aaf90 con 0x7f2fe80b1730 2021-12-17T18:24:08.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fe77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fe80a7bb0 0x7f2fe8157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:08.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fe77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fe80a7bb0 0x7f2fe8157ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52016/0 (socket says 172.21.15.62:52016) 2021-12-17T18:24:08.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fe6ffd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2fe80b1730 0x7f2fe8066010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:08.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fe77fe700 1 -- 172.21.15.62:0/3872884100 learned_addr learned my addr 172.21.15.62:0/3872884100 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:08.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fe7fff700 1 --2- 172.21.15.62:0/3872884100 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2fe80b21f0 0x7f2fe815a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:08.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fe6ffd700 1 -- 172.21.15.62:0/3872884100 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2fe80b21f0 msgr2=0x7f2fe815a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:08.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fe6ffd700 1 --2- 172.21.15.62:0/3872884100 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2fe80b21f0 0x7f2fe815a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:08.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fe6ffd700 1 -- 172.21.15.62:0/3872884100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fe80a7bb0 msgr2=0x7f2fe8157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:08.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fe6ffd700 1 --2- 172.21.15.62:0/3872884100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fe80a7bb0 0x7f2fe8157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:08.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fe6ffd700 1 -- 172.21.15.62:0/3872884100 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd800b1e0 con 0x7f2fe80b1730 2021-12-17T18:24:08.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fe77fe700 1 --2- 172.21.15.62:0/3872884100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fe80a7bb0 0x7f2fe8157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:24:08.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fe6ffd700 1 --2- 172.21.15.62:0/3872884100 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2fe80b1730 0x7f2fe8066010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f2fd8002f70 tx=0x7f2fd8015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:08.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fe4ff9700 1 -- 172.21.15.62:0/3872884100 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd8011760 con 0x7f2fe80b1730 2021-12-17T18:24:08.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fe4ff9700 1 -- 172.21.15.62:0/3872884100 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd80118c0 con 0x7f2fe80b1730 2021-12-17T18:24:08.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fee160700 1 -- 172.21.15.62:0/3872884100 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe80abae0 con 0x7f2fe80b1730 2021-12-17T18:24:08.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fe4ff9700 1 -- 172.21.15.62:0/3872884100 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd8011c20 con 0x7f2fe80b1730 2021-12-17T18:24:08.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fee160700 1 -- 172.21.15.62:0/3872884100 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe8066e80 con 0x7f2fe80b1730 2021-12-17T18:24:08.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.786+0000 7f2fee160700 1 -- 172.21.15.62:0/3872884100 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe8157950 con 0x7f2fe80b1730 2021-12-17T18:24:08.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.790+0000 7f2fe4ff9700 1 -- 172.21.15.62:0/3872884100 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2fd8025030 con 0x7f2fe80b1730 2021-12-17T18:24:08.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.790+0000 7f2fe4ff9700 1 --2- 172.21.15.62:0/3872884100 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2fc80536d0 0x7f2fc8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:08.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.790+0000 7f2fe4ff9700 1 -- 172.21.15.62:0/3872884100 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f2fd806c590 con 0x7f2fe80b1730 2021-12-17T18:24:08.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.790+0000 7f2fe77fe700 1 --2- 172.21.15.62:0/3872884100 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2fc80536d0 0x7f2fc8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:08.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.790+0000 7f2fe77fe700 1 --2- 172.21.15.62:0/3872884100 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2fc80536d0 0x7f2fc8055b90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f2fdc00d000 tx=0x7f2fdc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:08.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.798+0000 7f2fe4ff9700 1 -- 172.21.15.62:0/3872884100 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2fd8043a20 con 0x7f2fe80b1730 2021-12-17T18:24:08.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.974+0000 7f2fee160700 1 -- 172.21.15.62:0/3872884100 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2fe80b2f10 con 0x7f2fe80b1730 2021-12-17T18:24:08.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.974+0000 7f2fe4ff9700 1 -- 172.21.15.62:0/3872884100 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f2fd8047040 con 0x7f2fe80b1730 2021-12-17T18:24:08.979 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:08.979 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:24:08.979 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_dump": [ 2021-12-17T18:24:08.980 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:08.980 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.a", 2021-12-17T18:24:08.980 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhxCS0LBAAtUlkgWYg4l3fQ2au7jMUDg==", 2021-12-17T18:24:08.980 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:24:08.981 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:24:08.981 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:24:08.981 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:24:08.981 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:24:08.982 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:08.982 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:08.982 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:08.982 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.b", 2021-12-17T18:24:08.982 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhoRJAMxAAP/NmDQRwJjYip2rxJsQlYg==", 2021-12-17T18:24:08.983 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:24:08.983 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:24:08.983 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:24:08.983 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:24:08.984 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:24:08.984 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:08.984 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:08.984 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:08.984 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.0", 2021-12-17T18:24:08.985 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBA1LxhJXzhKhAAUnxP3G5VuATkQLoDALFjVg==", 2021-12-17T18:24:08.985 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:24:08.985 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:24:08.985 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:24:08.986 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:24:08.986 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:08.986 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:08.986 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:08.987 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.1", 2021-12-17T18:24:08.987 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBD1LxhregUDhAABrxQ2jQ4BwXvuWh/D9SkbQ==", 2021-12-17T18:24:08.987 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:24:08.987 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:24:08.988 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:24:08.988 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:24:08.988 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:08.988 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:08.988 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:08.989 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.2", 2021-12-17T18:24:08.989 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBF1LxhOo/SLhAAhQQLW/VKFx1sgm8chnD5tw==", 2021-12-17T18:24:08.989 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:24:08.989 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:24:08.990 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:24:08.990 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:24:08.990 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:08.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:08.990 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:08.991 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.3", 2021-12-17T18:24:08.991 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBI1LxhT2ZQExAA999j8V5bJAJ2PuaQqSkUOw==", 2021-12-17T18:24:08.991 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:24:08.991 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:24:08.992 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:24:08.992 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:24:08.992 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:08.992 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:08.992 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:08.993 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.4", 2021-12-17T18:24:08.993 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBN1LxhKBDzFhAAKmPF0FXnnfXtweo+6z9nxg==", 2021-12-17T18:24:08.993 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:24:08.993 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:24:08.994 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:24:08.994 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:24:08.994 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:08.994 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:08.994 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:08.995 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.5", 2021-12-17T18:24:08.995 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBP1LxhtqkAORAAVaFLVNIUMs4Sytk8WRaGNA==", 2021-12-17T18:24:08.995 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:24:08.995 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:24:08.996 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:24:08.996 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:24:08.996 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:08.996 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:08.996 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:08.997 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.6", 2021-12-17T18:24:08.997 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBS1LxhNtncGhAAgG64g1ie54CDp9Y7uldKQA==", 2021-12-17T18:24:08.997 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:24:08.997 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:24:08.998 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:24:08.998 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:24:08.998 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:08.998 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:08.998 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:08.999 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.7", 2021-12-17T18:24:08.999 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBV1Lxh3DcDABAAHVskSVtoEJ8BxCCAs3ZDVA==", 2021-12-17T18:24:08.999 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:24:08.999 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:24:09.000 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:24:09.000 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:24:09.000 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:09.000 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:09.000 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:09.001 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.0", 2021-12-17T18:24:09.001 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxh9QhCNxAALkWTJorDpbt9yrikL7/NWg==", 2021-12-17T18:24:09.001 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:24:09.001 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:24:09.002 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:24:09.002 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:24:09.002 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:09.002 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:09.002 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:09.003 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.1", 2021-12-17T18:24:09.003 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxhxm52OxAAbqXVaqRDmt4Ezj9xyCEODQ==", 2021-12-17T18:24:09.003 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:24:09.003 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:24:09.004 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:24:09.004 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:24:09.004 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:09.004 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:09.004 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:09.005 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.2", 2021-12-17T18:24:09.005 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+1LxhXu08BBAATRcUAZvMNg9ou4PLszDtmA==", 2021-12-17T18:24:09.005 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:24:09.005 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:24:09.006 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:24:09.006 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:24:09.006 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:09.006 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:09.006 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:09.007 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.admin", 2021-12-17T18:24:09.007 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhyAGlDRAA2ggSG5yBBFbMgK2fCBk2mQ==", 2021-12-17T18:24:09.007 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:24:09.007 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:24:09.008 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:24:09.008 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:24:09.008 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:24:09.008 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:09.008 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:09.009 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:09.009 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.x", 2021-12-17T18:24:09.009 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhzvntKRAAFQlg69Z6d2nWX0GxSshsMw==", 2021-12-17T18:24:09.009 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:24:09.010 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:24:09.010 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:24:09.010 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:24:09.010 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:09.010 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:09.011 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:09.011 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.y", 2021-12-17T18:24:09.011 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhKdTGJRAArzUN3A1U5Efw0NG9Gw2Gcw==", 2021-12-17T18:24:09.011 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:24:09.011 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:24:09.012 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:24:09.012 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:24:09.012 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:09.012 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:09.013 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:24:09.013 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:24:09.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.978+0000 7f2fee160700 1 -- 172.21.15.62:0/3872884100 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2fc80536d0 msgr2=0x7f2fc8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.978+0000 7f2fee160700 1 --2- 172.21.15.62:0/3872884100 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2fc80536d0 0x7f2fc8055b90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f2fdc00d000 tx=0x7f2fdc009040).stop 2021-12-17T18:24:09.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.978+0000 7f2fee160700 1 -- 172.21.15.62:0/3872884100 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2fe80b1730 msgr2=0x7f2fe8066010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.978+0000 7f2fee160700 1 --2- 172.21.15.62:0/3872884100 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2fe80b1730 0x7f2fe8066010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f2fd8002f70 tx=0x7f2fd8015000).stop 2021-12-17T18:24:09.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.978+0000 7f2fee160700 1 -- 172.21.15.62:0/3872884100 shutdown_connections 2021-12-17T18:24:09.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.978+0000 7f2fee160700 1 --2- 172.21.15.62:0/3872884100 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2fc80536d0 0x7f2fc8055b90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.978+0000 7f2fee160700 1 --2- 172.21.15.62:0/3872884100 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2fe80b21f0 0x7f2fe815a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.978+0000 7f2fee160700 1 --2- 172.21.15.62:0/3872884100 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2fe80b1730 0x7f2fe8066010 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.978+0000 7f2fee160700 1 --2- 172.21.15.62:0/3872884100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fe80a7bb0 0x7f2fe8157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.978+0000 7f2fee160700 1 -- 172.21.15.62:0/3872884100 >> 172.21.15.62:0/3872884100 conn(0x7f2fe805f730 msgr2=0x7f2fe80ae620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:09.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.978+0000 7f2fee160700 1 -- 172.21.15.62:0/3872884100 shutdown_connections 2021-12-17T18:24:09.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:08.978+0000 7f2fee160700 1 -- 172.21.15.62:0/3872884100 wait complete. 2021-12-17T18:24:09.018 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:24:09.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d02cd2700 1 Processor -- start 2021-12-17T18:24:09.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d02cd2700 1 -- start start 2021-12-17T18:24:09.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d02cd2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9cfc0b21f0 0x7f9cfc14aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d02cd2700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f9cfc0b1730 0x7f9cfc0ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d02cd2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9cfc0a7bb0 0x7f9cfc067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d02cd2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc147870 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d02cd2700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc0b2ce0 con 0x7f9cfc0b1730 2021-12-17T18:24:09.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d02cd2700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0aca60 con 0x7f9cfc0a7bb0 2021-12-17T18:24:09.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d00a6e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9cfc0b21f0 0x7f9cfc14aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d00a6e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9cfc0b21f0 0x7f9cfc14aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52020/0 (socket says 172.21.15.62:52020) 2021-12-17T18:24:09.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d00a6e700 1 -- 172.21.15.62:0/867805864 learned_addr learned my addr 172.21.15.62:0/867805864 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:09.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9cfbfff700 1 --2- 172.21.15.62:0/867805864 >> v2:172.21.15.109:3300/0 conn(0x7f9cfc0b1730 0x7f9cfc0ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d0126f700 1 --2- 172.21.15.62:0/867805864 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9cfc0a7bb0 0x7f9cfc067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d00a6e700 1 -- 172.21.15.62:0/867805864 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9cfc0a7bb0 msgr2=0x7f9cfc067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:09.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d00a6e700 1 --2- 172.21.15.62:0/867805864 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9cfc0a7bb0 0x7f9cfc067120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d00a6e700 1 -- 172.21.15.62:0/867805864 >> v2:172.21.15.109:3300/0 conn(0x7f9cfc0b1730 msgr2=0x7f9cfc0ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:09.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d00a6e700 1 --2- 172.21.15.62:0/867805864 >> v2:172.21.15.109:3300/0 conn(0x7f9cfc0b1730 0x7f9cfc0ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d00a6e700 1 -- 172.21.15.62:0/867805864 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc0b2f10 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9cfbfff700 1 --2- 172.21.15.62:0/867805864 >> v2:172.21.15.109:3300/0 conn(0x7f9cfc0b1730 0x7f9cfc0ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:24:09.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d00a6e700 1 --2- 172.21.15.62:0/867805864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cfc0b21f0 0x7f9cfc14aea0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f9ce4002f70 tx=0x7f9ce4006eb0).ready entity=mon.0 client_cookie=3bab49ebe657e2b9 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:09.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9cfb7fe700 1 -- 172.21.15.62:0/867805864 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ce400d570 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9cfb7fe700 1 -- 172.21.15.62:0/867805864 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce4000e90 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9cfb7fe700 1 -- 172.21.15.62:0/867805864 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ce400d900 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d02cd2700 1 -- 172.21.15.62:0/867805864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cfc0b21f0 msgr2=0x7f9cfc14aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d02cd2700 1 --2- 172.21.15.62:0/867805864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cfc0b21f0 0x7f9cfc14aea0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f9ce4002f70 tx=0x7f9ce4006eb0).stop 2021-12-17T18:24:09.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d02cd2700 1 -- 172.21.15.62:0/867805864 shutdown_connections 2021-12-17T18:24:09.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d02cd2700 1 --2- 172.21.15.62:0/867805864 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9cfc0a7bb0 0x7f9cfc067120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d02cd2700 1 --2- 172.21.15.62:0/867805864 >> v2:172.21.15.109:3300/0 conn(0x7f9cfc0b1730 0x7f9cfc0ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d02cd2700 1 --2- 172.21.15.62:0/867805864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cfc0b21f0 0x7f9cfc14aea0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d02cd2700 1 -- 172.21.15.62:0/867805864 >> 172.21.15.62:0/867805864 conn(0x7f9cfc05f730 msgr2=0x7f9cfc05fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:09.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d02cd2700 1 -- 172.21.15.62:0/867805864 shutdown_connections 2021-12-17T18:24:09.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.122+0000 7f9d02cd2700 1 -- 172.21.15.62:0/867805864 wait complete. 2021-12-17T18:24:09.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d02cd2700 1 Processor -- start 2021-12-17T18:24:09.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d02cd2700 1 -- start start 2021-12-17T18:24:09.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d02cd2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9cfc0a7bb0 0x7f9cfc0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d02cd2700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9cfc0b1730 0x7f9cfc156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d02cd2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cfc0b21f0 0x7f9cfc1573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d02cd2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc156ae0 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d02cd2700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0abde0 con 0x7f9cfc0b1730 2021-12-17T18:24:09.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d02cd2700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0a9af0 con 0x7f9cfc0a7bb0 2021-12-17T18:24:09.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d0126f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cfc0b21f0 0x7f9cfc1573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d00a6e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9cfc0a7bb0 0x7f9cfc0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d0126f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cfc0b21f0 0x7f9cfc1573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52030/0 (socket says 172.21.15.62:52030) 2021-12-17T18:24:09.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d0126f700 1 -- 172.21.15.62:0/4207454219 learned_addr learned my addr 172.21.15.62:0/4207454219 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:09.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9cfbfff700 1 --2- 172.21.15.62:0/4207454219 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9cfc0b1730 0x7f9cfc156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d0126f700 1 -- 172.21.15.62:0/4207454219 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9cfc0a7bb0 msgr2=0x7f9cfc0b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d0126f700 1 --2- 172.21.15.62:0/4207454219 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9cfc0a7bb0 0x7f9cfc0b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d0126f700 1 -- 172.21.15.62:0/4207454219 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9cfc0b1730 msgr2=0x7f9cfc156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d0126f700 1 --2- 172.21.15.62:0/4207454219 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9cfc0b1730 0x7f9cfc156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d0126f700 1 -- 172.21.15.62:0/4207454219 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce400b1e0 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d0126f700 1 --2- 172.21.15.62:0/4207454219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cfc0b21f0 0x7f9cfc1573c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f9cf400a000 tx=0x7f9cf4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9cf9ffb700 1 -- 172.21.15.62:0/4207454219 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cf400c070 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9cf9ffb700 1 -- 172.21.15.62:0/4207454219 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf40133f0 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d02cd2700 1 -- 172.21.15.62:0/4207454219 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cfc15aa80 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9cf9ffb700 1 -- 172.21.15.62:0/4207454219 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cf4013750 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.126+0000 7f9d02cd2700 1 -- 172.21.15.62:0/4207454219 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cfc157a50 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.130+0000 7f9d02cd2700 1 -- 172.21.15.62:0/4207454219 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cfc15af00 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.130+0000 7f9cf9ffb700 1 -- 172.21.15.62:0/4207454219 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9cf40138b0 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.130+0000 7f9cf9ffb700 1 --2- 172.21.15.62:0/4207454219 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ce00536a0 0x7f9ce0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.130+0000 7f9cf9ffb700 1 -- 172.21.15.62:0/4207454219 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9cf406b280 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.130+0000 7f9d00a6e700 1 --2- 172.21.15.62:0/4207454219 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ce00536a0 0x7f9ce0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.130+0000 7f9d00a6e700 1 --2- 172.21.15.62:0/4207454219 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ce00536a0 0x7f9ce0055b60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f9ce401c000 tx=0x7f9ce4015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:09.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.138+0000 7f9cf9ffb700 1 -- 172.21.15.62:0/4207454219 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9cf4042600 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.262+0000 7f9d02cd2700 1 -- 172.21.15.62:0/4207454219 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cfc0573d0 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.266+0000 7f9cf9ffb700 1 -- 172.21.15.62:0/4207454219 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+13230 (secure 0 0 0) 0x7f9cf400f040 con 0x7f9cfc0b21f0 2021-12-17T18:24:09.268 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:09.269 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":67,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:24:08.648260+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:24:09.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.270+0000 7f9d02cd2700 1 -- 172.21.15.62:0/4207454219 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ce00536a0 msgr2=0x7f9ce0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.270+0000 7f9d02cd2700 1 --2- 172.21.15.62:0/4207454219 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ce00536a0 0x7f9ce0055b60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f9ce401c000 tx=0x7f9ce4015000).stop 2021-12-17T18:24:09.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.270+0000 7f9d02cd2700 1 -- 172.21.15.62:0/4207454219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cfc0b21f0 msgr2=0x7f9cfc1573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.270+0000 7f9d02cd2700 1 --2- 172.21.15.62:0/4207454219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cfc0b21f0 0x7f9cfc1573c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f9cf400a000 tx=0x7f9cf4008040).stop 2021-12-17T18:24:09.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.270+0000 7f9d02cd2700 1 -- 172.21.15.62:0/4207454219 shutdown_connections 2021-12-17T18:24:09.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.270+0000 7f9d02cd2700 1 --2- 172.21.15.62:0/4207454219 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ce00536a0 0x7f9ce0055b60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.270+0000 7f9d02cd2700 1 --2- 172.21.15.62:0/4207454219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cfc0b21f0 0x7f9cfc1573c0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.270+0000 7f9d02cd2700 1 --2- 172.21.15.62:0/4207454219 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9cfc0b1730 0x7f9cfc156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.270+0000 7f9d02cd2700 1 --2- 172.21.15.62:0/4207454219 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9cfc0a7bb0 0x7f9cfc0b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.270+0000 7f9d02cd2700 1 -- 172.21.15.62:0/4207454219 >> 172.21.15.62:0/4207454219 conn(0x7f9cfc05f730 msgr2=0x7f9cfc1479c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:09.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.270+0000 7f9d02cd2700 1 -- 172.21.15.62:0/4207454219 shutdown_connections 2021-12-17T18:24:09.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.270+0000 7f9d02cd2700 1 -- 172.21.15.62:0/4207454219 wait complete. 2021-12-17T18:24:09.287 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-12-17T18:24:09.288 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:24:09.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1f09fd3700 1 Processor -- start 2021-12-17T18:24:09.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1f09fd3700 1 -- start start 2021-12-17T18:24:09.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1f09fd3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1f040b1ab0 0x7f1f04143d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1f09fd3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f040b1f10 con 0x7f1f040b0f20 2021-12-17T18:24:09.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1f09fd3700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f04063c60 con 0x7f1f04063880 2021-12-17T18:24:09.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1f09fd3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f040b3e90 con 0x7f1f040b1ab0 2021-12-17T18:24:09.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1efaffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1f040b0f20 0x7f1f04143610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35616/0 (socket says 172.21.15.62:35616) 2021-12-17T18:24:09.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1efaffd700 1 -- 172.21.15.62:0/3060223518 learned_addr learned my addr 172.21.15.62:0/3060223518 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:09.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1f03fff700 1 --2- 172.21.15.62:0/3060223518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1f040b1ab0 0x7f1f04143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1f02ffd700 1 -- 172.21.15.62:0/3060223518 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672345558 0 0) 0x7f1f040b1f10 con 0x7f1f040b0f20 2021-12-17T18:24:09.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1f02ffd700 1 -- 172.21.15.62:0/3060223518 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ee4003260 con 0x7f1f040b0f20 2021-12-17T18:24:09.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1f03fff700 1 -- 172.21.15.62:0/3060223518 >> v1:172.21.15.109:6789/0 conn(0x7f1f04063880 legacy=0x7f1f040aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1f03fff700 1 -- 172.21.15.62:0/3060223518 >> v1:172.21.15.62:6789/0 conn(0x7f1f040b0f20 legacy=0x7f1f04143610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1f03fff700 1 -- 172.21.15.62:0/3060223518 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f040b1430 con 0x7f1f040b1ab0 2021-12-17T18:24:09.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1f03fff700 1 --2- 172.21.15.62:0/3060223518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1f040b1ab0 0x7f1f04143d20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f1efc0032f0 tx=0x7f1efc0091d0).ready entity=mon.2 client_cookie=a52f247d5f4f39c2 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:09.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1f02ffd700 1 -- 172.21.15.62:0/3060223518 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1efc00b6c0 con 0x7f1f040b1ab0 2021-12-17T18:24:09.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1f02ffd700 1 -- 172.21.15.62:0/3060223518 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc00b820 con 0x7f1f040b1ab0 2021-12-17T18:24:09.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.398+0000 7f1f02ffd700 1 -- 172.21.15.62:0/3060223518 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1efc00b990 con 0x7f1f040b1ab0 2021-12-17T18:24:09.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.402+0000 7f1f09fd3700 1 -- 172.21.15.62:0/3060223518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1f040b1ab0 msgr2=0x7f1f04143d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.402+0000 7f1f09fd3700 1 --2- 172.21.15.62:0/3060223518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1f040b1ab0 0x7f1f04143d20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f1efc0032f0 tx=0x7f1efc0091d0).stop 2021-12-17T18:24:09.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.402+0000 7f1f09fd3700 1 -- 172.21.15.62:0/3060223518 shutdown_connections 2021-12-17T18:24:09.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.402+0000 7f1f09fd3700 1 --2- 172.21.15.62:0/3060223518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1f040b1ab0 0x7f1f04143d20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.402+0000 7f1f09fd3700 1 -- 172.21.15.62:0/3060223518 >> 172.21.15.62:0/3060223518 conn(0x7f1f040625b0 msgr2=0x7f1f04062990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:09.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.402+0000 7f1f09fd3700 1 -- 172.21.15.62:0/3060223518 shutdown_connections 2021-12-17T18:24:09.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.402+0000 7f1f09fd3700 1 -- 172.21.15.62:0/3060223518 wait complete. 2021-12-17T18:24:09.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.402+0000 7f1f09fd3700 1 Processor -- start 2021-12-17T18:24:09.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.402+0000 7f1f09fd3700 1 -- start start 2021-12-17T18:24:09.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1f09fd3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1f04063880 0x7f1f040ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1f09fd3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f040b0f20 0x7f1f040b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1f09fd3700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1f040b1ab0 0x7f1f040b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1f09fd3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f040671d0 con 0x7f1f040b0f20 2021-12-17T18:24:09.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1f09fd3700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f040b5010 con 0x7f1f040b1ab0 2021-12-17T18:24:09.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1f09fd3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f040b51d0 con 0x7f1f04063880 2021-12-17T18:24:09.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1efaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f040b0f20 0x7f1f040b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1f037fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1f04063880 0x7f1f040ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1efaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f040b0f20 0x7f1f040b4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52042/0 (socket says 172.21.15.62:52042) 2021-12-17T18:24:09.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1efaffd700 1 -- 172.21.15.62:0/467126893 learned_addr learned my addr 172.21.15.62:0/467126893 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:09.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1f03fff700 1 --2- 172.21.15.62:0/467126893 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1f040b1ab0 0x7f1f040b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1efaffd700 1 -- 172.21.15.62:0/467126893 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1f04063880 msgr2=0x7f1f040ac1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1efaffd700 1 --2- 172.21.15.62:0/467126893 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1f04063880 0x7f1f040ac1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1efaffd700 1 -- 172.21.15.62:0/467126893 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1f040b1ab0 msgr2=0x7f1f040b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1efaffd700 1 --2- 172.21.15.62:0/467126893 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1f040b1ab0 0x7f1f040b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1efaffd700 1 -- 172.21.15.62:0/467126893 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc009470 con 0x7f1f040b0f20 2021-12-17T18:24:09.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1efaffd700 1 --2- 172.21.15.62:0/467126893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f040b0f20 0x7f1f040b4630 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f1eec001110 tx=0x7f1eec007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:09.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1f017fa700 1 -- 172.21.15.62:0/467126893 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eec00ce80 con 0x7f1f040b0f20 2021-12-17T18:24:09.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1f017fa700 1 -- 172.21.15.62:0/467126893 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eec0070d0 con 0x7f1f040b0f20 2021-12-17T18:24:09.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1f09fd3700 1 -- 172.21.15.62:0/467126893 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f040b6820 con 0x7f1f040b0f20 2021-12-17T18:24:09.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1f017fa700 1 -- 172.21.15.62:0/467126893 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eec007430 con 0x7f1f040b0f20 2021-12-17T18:24:09.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.406+0000 7f1f09fd3700 1 -- 172.21.15.62:0/467126893 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f040b71d0 con 0x7f1f040b0f20 2021-12-17T18:24:09.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.410+0000 7f1f09fd3700 1 -- 172.21.15.62:0/467126893 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f040b4370 con 0x7f1f040b0f20 2021-12-17T18:24:09.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.410+0000 7f1f017fa700 1 -- 172.21.15.62:0/467126893 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1eec010070 con 0x7f1f040b0f20 2021-12-17T18:24:09.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.410+0000 7f1f017fa700 1 --2- 172.21.15.62:0/467126893 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1ee80536d0 0x7f1ee8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.410+0000 7f1f017fa700 1 -- 172.21.15.62:0/467126893 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1eec06ab30 con 0x7f1f040b0f20 2021-12-17T18:24:09.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.410+0000 7f1f037fe700 1 --2- 172.21.15.62:0/467126893 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1ee80536d0 0x7f1ee8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.410+0000 7f1f037fe700 1 --2- 172.21.15.62:0/467126893 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1ee80536d0 0x7f1ee8055b90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f1ef400d000 tx=0x7f1ef4000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:09.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.418+0000 7f1f017fa700 1 -- 172.21.15.62:0/467126893 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1f040b4370 con 0x7f1f040b0f20 2021-12-17T18:24:09.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.546+0000 7f1f09fd3700 1 -- 172.21.15.62:0/467126893 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1f040b4370 con 0x7f1f040b0f20 2021-12-17T18:24:09.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.546+0000 7f1f017fa700 1 -- 172.21.15.62:0/467126893 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v67) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1f040b4370 con 0x7f1f040b0f20 2021-12-17T18:24:09.550 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:24:09.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.550+0000 7f1f09fd3700 1 -- 172.21.15.62:0/467126893 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1ee80536d0 msgr2=0x7f1ee8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.550+0000 7f1f09fd3700 1 --2- 172.21.15.62:0/467126893 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1ee80536d0 0x7f1ee8055b90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f1ef400d000 tx=0x7f1ef4000bc0).stop 2021-12-17T18:24:09.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.550+0000 7f1f09fd3700 1 -- 172.21.15.62:0/467126893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f040b0f20 msgr2=0x7f1f040b4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.550+0000 7f1f09fd3700 1 --2- 172.21.15.62:0/467126893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f040b0f20 0x7f1f040b4630 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f1eec001110 tx=0x7f1eec007aa0).stop 2021-12-17T18:24:09.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.550+0000 7f1f09fd3700 1 -- 172.21.15.62:0/467126893 shutdown_connections 2021-12-17T18:24:09.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.550+0000 7f1f09fd3700 1 --2- 172.21.15.62:0/467126893 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1ee80536d0 0x7f1ee8055b90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.550+0000 7f1f09fd3700 1 --2- 172.21.15.62:0/467126893 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1f040b1ab0 0x7f1f040b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.550+0000 7f1f09fd3700 1 --2- 172.21.15.62:0/467126893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f040b0f20 0x7f1f040b4630 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.550+0000 7f1f09fd3700 1 --2- 172.21.15.62:0/467126893 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1f04063880 0x7f1f040ac1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.550+0000 7f1f09fd3700 1 -- 172.21.15.62:0/467126893 >> 172.21.15.62:0/467126893 conn(0x7f1f040625b0 msgr2=0x7f1f040ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:09.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.550+0000 7f1f09fd3700 1 -- 172.21.15.62:0/467126893 shutdown_connections 2021-12-17T18:24:09.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.550+0000 7f1f09fd3700 1 -- 172.21.15.62:0/467126893 wait complete. 2021-12-17T18:24:09.563 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:24:09.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.670+0000 7f7a82f54700 1 Processor -- start 2021-12-17T18:24:09.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.670+0000 7f7a82f54700 1 -- start start 2021-12-17T18:24:09.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.670+0000 7f7a82f54700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7a7c05ca90 0x7f7a7c14b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.670+0000 7f7a82f54700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7a7c05f730 0x7f7a7c146510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.670+0000 7f7a82f54700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c060750 con 0x7f7a7c0ac040 2021-12-17T18:24:09.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.670+0000 7f7a82f54700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7c14ac00 con 0x7f7a7c05f730 2021-12-17T18:24:09.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.670+0000 7f7a82f54700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7c14aea0 con 0x7f7a7c05ca90 2021-12-17T18:24:09.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.670+0000 7f7a82753700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7a7c05f730 0x7f7a7c146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.670+0000 7f7a82753700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7a7c05f730 0x7f7a7c146510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52052/0 (socket says 172.21.15.62:52052) 2021-12-17T18:24:09.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.670+0000 7f7a82753700 1 -- 172.21.15.62:0/2543848377 learned_addr learned my addr 172.21.15.62:0/2543848377 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:09.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.670+0000 7f7a81f52700 1 --2- 172.21.15.62:0/2543848377 >> v2:172.21.15.109:3300/0 conn(0x7f7a7c05ca90 0x7f7a7c14b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.670+0000 7f7a82753700 1 -- 172.21.15.62:0/2543848377 >> v2:172.21.15.109:3300/0 conn(0x7f7a7c05ca90 msgr2=0x7f7a7c14b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:09.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.670+0000 7f7a82753700 1 --2- 172.21.15.62:0/2543848377 >> v2:172.21.15.109:3300/0 conn(0x7f7a7c05ca90 0x7f7a7c14b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.670+0000 7f7a82753700 1 -- 172.21.15.62:0/2543848377 >> v1:172.21.15.109:6789/0 conn(0x7f7a7c0ac040 legacy=0x7f7a7c1475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.670+0000 7f7a82753700 1 -- 172.21.15.62:0/2543848377 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c05ce70 con 0x7f7a7c05f730 2021-12-17T18:24:09.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.670+0000 7f7a80f50700 1 -- 172.21.15.62:0/2543848377 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602677464 0 0) 0x7f7a7c060750 con 0x7f7a7c0ac040 2021-12-17T18:24:09.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.674+0000 7f7a82753700 1 --2- 172.21.15.62:0/2543848377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a7c05f730 0x7f7a7c146510 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f7a740032f0 tx=0x7f7a74009290).ready entity=mon.0 client_cookie=bf89af3fd27d3a29 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:09.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.674+0000 7f7a80f50700 1 -- 172.21.15.62:0/2543848377 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a7400b870 con 0x7f7a7c05f730 2021-12-17T18:24:09.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.674+0000 7f7a80f50700 1 -- 172.21.15.62:0/2543848377 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7400b9d0 con 0x7f7a7c05f730 2021-12-17T18:24:09.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.674+0000 7f7a80f50700 1 -- 172.21.15.62:0/2543848377 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a7400bb40 con 0x7f7a7c05f730 2021-12-17T18:24:09.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.674+0000 7f7a82f54700 1 -- 172.21.15.62:0/2543848377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a7c05f730 msgr2=0x7f7a7c146510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.674+0000 7f7a82f54700 1 --2- 172.21.15.62:0/2543848377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a7c05f730 0x7f7a7c146510 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f7a740032f0 tx=0x7f7a74009290).stop 2021-12-17T18:24:09.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.674+0000 7f7a82f54700 1 -- 172.21.15.62:0/2543848377 shutdown_connections 2021-12-17T18:24:09.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.674+0000 7f7a82f54700 1 --2- 172.21.15.62:0/2543848377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a7c05f730 0x7f7a7c146510 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.674+0000 7f7a82f54700 1 --2- 172.21.15.62:0/2543848377 >> v2:172.21.15.109:3300/0 conn(0x7f7a7c05ca90 0x7f7a7c14b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.674+0000 7f7a82f54700 1 -- 172.21.15.62:0/2543848377 >> 172.21.15.62:0/2543848377 conn(0x7f7a7c05be70 msgr2=0x7f7a7c062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:09.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.674+0000 7f7a82f54700 1 -- 172.21.15.62:0/2543848377 shutdown_connections 2021-12-17T18:24:09.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.674+0000 7f7a82f54700 1 -- 172.21.15.62:0/2543848377 wait complete. 2021-12-17T18:24:09.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a82f54700 1 Processor -- start 2021-12-17T18:24:09.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a82f54700 1 -- start start 2021-12-17T18:24:09.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a82f54700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a7c05ca90 0x7f7a7c0b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a82f54700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7a7c05f730 0x7f7a7c09e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a82f54700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7a7c0ac040 0x7f7a7c0a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a82f54700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0a2210 con 0x7f7a7c05ca90 2021-12-17T18:24:09.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a82f54700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0646a0 con 0x7f7a7c05f730 2021-12-17T18:24:09.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a82f54700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0a2430 con 0x7f7a7c0ac040 2021-12-17T18:24:09.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a81f52700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a7c05ca90 0x7f7a7c0b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a81f52700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a7c05ca90 0x7f7a7c0b38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52054/0 (socket says 172.21.15.62:52054) 2021-12-17T18:24:09.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a81f52700 1 -- 172.21.15.62:0/2066618297 learned_addr learned my addr 172.21.15.62:0/2066618297 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:09.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a81751700 1 --2- 172.21.15.62:0/2066618297 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7a7c05f730 0x7f7a7c09e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a82753700 1 --2- 172.21.15.62:0/2066618297 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7a7c0ac040 0x7f7a7c0a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a81751700 1 -- 172.21.15.62:0/2066618297 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7a7c0ac040 msgr2=0x7f7a7c0a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a81751700 1 --2- 172.21.15.62:0/2066618297 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7a7c0ac040 0x7f7a7c0a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a81751700 1 -- 172.21.15.62:0/2066618297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a7c05ca90 msgr2=0x7f7a7c0b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a81751700 1 --2- 172.21.15.62:0/2066618297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a7c05ca90 0x7f7a7c0b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a81751700 1 -- 172.21.15.62:0/2066618297 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a74009530 con 0x7f7a7c05f730 2021-12-17T18:24:09.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a81f52700 1 --2- 172.21.15.62:0/2066618297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a7c05ca90 0x7f7a7c0b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:24:09.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a81751700 1 --2- 172.21.15.62:0/2066618297 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7a7c05f730 0x7f7a7c09e9d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f7a7c0a29a0 tx=0x7f7a78007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:09.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a6affd700 1 -- 172.21.15.62:0/2066618297 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a78013450 con 0x7f7a7c05f730 2021-12-17T18:24:09.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a6affd700 1 -- 172.21.15.62:0/2066618297 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a780135b0 con 0x7f7a7c05f730 2021-12-17T18:24:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a82f54700 1 -- 172.21.15.62:0/2066618297 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7c0a26d0 con 0x7f7a7c05f730 2021-12-17T18:24:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a6affd700 1 -- 172.21.15.62:0/2066618297 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a78013910 con 0x7f7a7c05f730 2021-12-17T18:24:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.678+0000 7f7a82f54700 1 -- 172.21.15.62:0/2066618297 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c0a18f0 con 0x7f7a7c05f730 2021-12-17T18:24:09.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.682+0000 7f7a82f54700 1 -- 172.21.15.62:0/2066618297 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7c05fcb0 con 0x7f7a7c05f730 2021-12-17T18:24:09.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.682+0000 7f7a6affd700 1 -- 172.21.15.62:0/2066618297 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7a7801a060 con 0x7f7a7c05f730 2021-12-17T18:24:09.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.682+0000 7f7a6affd700 1 --2- 172.21.15.62:0/2066618297 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7a5c053580 0x7f7a5c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.682+0000 7f7a6affd700 1 -- 172.21.15.62:0/2066618297 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7a7806a9b0 con 0x7f7a7c05f730 2021-12-17T18:24:09.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.682+0000 7f7a81f52700 1 --2- 172.21.15.62:0/2066618297 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7a5c053580 0x7f7a5c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.682+0000 7f7a81f52700 1 --2- 172.21.15.62:0/2066618297 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7a5c053580 0x7f7a5c055a40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f7a6c00b000 tx=0x7f7a6c006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:09.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.690+0000 7f7a6affd700 1 -- 172.21.15.62:0/2066618297 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7a78041d30 con 0x7f7a7c05f730 2021-12-17T18:24:09.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.818+0000 7f7a82f54700 1 -- 172.21.15.62:0/2066618297 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7a7c0573d0 con 0x7f7a7c05f730 2021-12-17T18:24:09.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.818+0000 7f7a6affd700 1 -- 172.21.15.62:0/2066618297 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v67) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7a78018070 con 0x7f7a7c05f730 2021-12-17T18:24:09.823 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:24:09.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.822+0000 7f7a82f54700 1 -- 172.21.15.62:0/2066618297 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7a5c053580 msgr2=0x7f7a5c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.822+0000 7f7a82f54700 1 --2- 172.21.15.62:0/2066618297 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7a5c053580 0x7f7a5c055a40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f7a6c00b000 tx=0x7f7a6c006df0).stop 2021-12-17T18:24:09.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.822+0000 7f7a82f54700 1 -- 172.21.15.62:0/2066618297 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7a7c05f730 msgr2=0x7f7a7c09e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.822+0000 7f7a82f54700 1 --2- 172.21.15.62:0/2066618297 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7a7c05f730 0x7f7a7c09e9d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f7a7c0a29a0 tx=0x7f7a78007b90).stop 2021-12-17T18:24:09.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.822+0000 7f7a82f54700 1 -- 172.21.15.62:0/2066618297 shutdown_connections 2021-12-17T18:24:09.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.822+0000 7f7a82f54700 1 --2- 172.21.15.62:0/2066618297 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7a5c053580 0x7f7a5c055a40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.822+0000 7f7a82f54700 1 --2- 172.21.15.62:0/2066618297 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7a7c0ac040 0x7f7a7c0a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.822+0000 7f7a82f54700 1 --2- 172.21.15.62:0/2066618297 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7a7c05f730 0x7f7a7c09e9d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.822+0000 7f7a82f54700 1 --2- 172.21.15.62:0/2066618297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a7c05ca90 0x7f7a7c0b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.822+0000 7f7a82f54700 1 -- 172.21.15.62:0/2066618297 >> 172.21.15.62:0/2066618297 conn(0x7f7a7c05be70 msgr2=0x7f7a7c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:09.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.822+0000 7f7a82f54700 1 -- 172.21.15.62:0/2066618297 shutdown_connections 2021-12-17T18:24:09.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.822+0000 7f7a82f54700 1 -- 172.21.15.62:0/2066618297 wait complete. 2021-12-17T18:24:09.836 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-12-17T18:24:09.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13ff4e0700 1 Processor -- start 2021-12-17T18:24:09.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13ff4e0700 1 -- start start 2021-12-17T18:24:09.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13ff4e0700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f13f80aaca0 0x7f13f80b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13ff4e0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13f8144fa0 0x7f13f81406d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13ff4e0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f80a8e00 con 0x7f13f80aee10 2021-12-17T18:24:09.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13ff4e0700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f80a90a0 con 0x7f13f80aaca0 2021-12-17T18:24:09.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13ff4e0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f80af8b0 con 0x7f13f8144fa0 2021-12-17T18:24:09.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13fd27c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f13f80aee10 0x7f13f8144890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35644/0 (socket says 172.21.15.62:35644) 2021-12-17T18:24:09.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13fd27c700 1 -- 172.21.15.62:0/3494736467 learned_addr learned my addr 172.21.15.62:0/3494736467 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:09.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13fca7b700 1 --2- 172.21.15.62:0/3494736467 >> v2:172.21.15.109:3300/0 conn(0x7f13f80aaca0 0x7f13f80b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13fda7d700 1 --2- 172.21.15.62:0/3494736467 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13f8144fa0 0x7f13f81406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13e7fff700 1 -- 172.21.15.62:0/3494736467 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421757375 0 0) 0x7f13f80a8e00 con 0x7f13f80aee10 2021-12-17T18:24:09.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13e7fff700 1 -- 172.21.15.62:0/3494736467 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13e0003260 con 0x7f13f80aee10 2021-12-17T18:24:09.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13fca7b700 1 -- 172.21.15.62:0/3494736467 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13f8144fa0 msgr2=0x7f13f81406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:09.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13fca7b700 1 --2- 172.21.15.62:0/3494736467 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13f8144fa0 0x7f13f81406d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13fca7b700 1 -- 172.21.15.62:0/3494736467 >> v1:172.21.15.62:6789/0 conn(0x7f13f80aee10 legacy=0x7f13f8144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13fca7b700 1 -- 172.21.15.62:0/3494736467 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f80b2da0 con 0x7f13f80aaca0 2021-12-17T18:24:09.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13fca7b700 1 --2- 172.21.15.62:0/3494736467 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13f80aaca0 0x7f13f80b1610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f13e8002f70 tx=0x7f13e8006df0).ready entity=mon.1 client_cookie=7470b336d44ab295 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:09.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13e7fff700 1 -- 172.21.15.62:0/3494736467 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13e800d4a0 con 0x7f13f80aaca0 2021-12-17T18:24:09.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13e7fff700 1 -- 172.21.15.62:0/3494736467 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e8000e90 con 0x7f13f80aaca0 2021-12-17T18:24:09.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.934+0000 7f13e7fff700 1 -- 172.21.15.62:0/3494736467 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13e800d7f0 con 0x7f13f80aaca0 2021-12-17T18:24:09.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.938+0000 7f13ff4e0700 1 -- 172.21.15.62:0/3494736467 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13f80aaca0 msgr2=0x7f13f80b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.938+0000 7f13ff4e0700 1 --2- 172.21.15.62:0/3494736467 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13f80aaca0 0x7f13f80b1610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f13e8002f70 tx=0x7f13e8006df0).stop 2021-12-17T18:24:09.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.938+0000 7f13ff4e0700 1 -- 172.21.15.62:0/3494736467 shutdown_connections 2021-12-17T18:24:09.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.938+0000 7f13ff4e0700 1 --2- 172.21.15.62:0/3494736467 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13f8144fa0 0x7f13f81406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.938+0000 7f13ff4e0700 1 --2- 172.21.15.62:0/3494736467 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13f80aaca0 0x7f13f80b1610 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.938+0000 7f13ff4e0700 1 -- 172.21.15.62:0/3494736467 >> 172.21.15.62:0/3494736467 conn(0x7f13f805f730 msgr2=0x7f13f805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:09.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.938+0000 7f13ff4e0700 1 -- 172.21.15.62:0/3494736467 shutdown_connections 2021-12-17T18:24:09.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.938+0000 7f13ff4e0700 1 -- 172.21.15.62:0/3494736467 wait complete. 2021-12-17T18:24:09.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.938+0000 7f13ff4e0700 1 Processor -- start 2021-12-17T18:24:09.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.938+0000 7f13ff4e0700 1 -- start start 2021-12-17T18:24:09.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13ff4e0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13f80aaca0 0x7f13f80b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13ff4e0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13f80aee10 0x7f13f8139090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13ff4e0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13f8144fa0 0x7f13f8065360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13ff4e0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f8063750 con 0x7f13f80aaca0 2021-12-17T18:24:09.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13ff4e0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f8064f00 con 0x7f13f8144fa0 2021-12-17T18:24:09.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13ff4e0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f8063980 con 0x7f13f80aee10 2021-12-17T18:24:09.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13fd27c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13f80aaca0 0x7f13f80b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13fd27c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13f80aaca0 0x7f13f80b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52068/0 (socket says 172.21.15.62:52068) 2021-12-17T18:24:09.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13fd27c700 1 -- 172.21.15.62:0/2339521372 learned_addr learned my addr 172.21.15.62:0/2339521372 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:09.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13fca7b700 1 --2- 172.21.15.62:0/2339521372 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13f80aee10 0x7f13f8139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13fda7d700 1 --2- 172.21.15.62:0/2339521372 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13f8144fa0 0x7f13f8065360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13fd27c700 1 -- 172.21.15.62:0/2339521372 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13f80aee10 msgr2=0x7f13f8139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13fd27c700 1 --2- 172.21.15.62:0/2339521372 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13f80aee10 0x7f13f8139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13fd27c700 1 -- 172.21.15.62:0/2339521372 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13f8144fa0 msgr2=0x7f13f8065360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:09.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13fd27c700 1 --2- 172.21.15.62:0/2339521372 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13f8144fa0 0x7f13f8065360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:09.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13fd27c700 1 -- 172.21.15.62:0/2339521372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e800b180 con 0x7f13f80aaca0 2021-12-17T18:24:09.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13fda7d700 1 --2- 172.21.15.62:0/2339521372 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13f8144fa0 0x7f13f8065360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:24:09.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13fd27c700 1 --2- 172.21.15.62:0/2339521372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13f80aaca0 0x7f13f80b3bf0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f13f4001110 tx=0x7f13f4007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:09.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13e67fc700 1 -- 172.21.15.62:0/2339521372 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13f40070d0 con 0x7f13f80aaca0 2021-12-17T18:24:09.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13e67fc700 1 -- 172.21.15.62:0/2339521372 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f4007230 con 0x7f13f80aaca0 2021-12-17T18:24:09.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13ff4e0700 1 -- 172.21.15.62:0/2339521372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f80632e0 con 0x7f13f80aaca0 2021-12-17T18:24:09.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13e67fc700 1 -- 172.21.15.62:0/2339521372 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13f4005610 con 0x7f13f80aaca0 2021-12-17T18:24:09.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13ff4e0700 1 -- 172.21.15.62:0/2339521372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f8065850 con 0x7f13f80aaca0 2021-12-17T18:24:09.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13ff4e0700 1 -- 172.21.15.62:0/2339521372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f8065070 con 0x7f13f80aaca0 2021-12-17T18:24:09.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.942+0000 7f13e67fc700 1 -- 172.21.15.62:0/2339521372 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f13f4010070 con 0x7f13f80aaca0 2021-12-17T18:24:09.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.946+0000 7f13e67fc700 1 --2- 172.21.15.62:0/2339521372 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f13d8053610 0x7f13d8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:09.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.946+0000 7f13e67fc700 1 -- 172.21.15.62:0/2339521372 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f13f406ad60 con 0x7f13f80aaca0 2021-12-17T18:24:09.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.946+0000 7f13fca7b700 1 --2- 172.21.15.62:0/2339521372 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f13d8053610 0x7f13d8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:09.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.946+0000 7f13fca7b700 1 --2- 172.21.15.62:0/2339521372 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f13d8053610 0x7f13d8055ad0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f13e8018000 tx=0x7f13e8014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:09.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:09.950+0000 7f13e67fc700 1 -- 172.21.15.62:0/2339521372 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f13f4042150 con 0x7f13f80aaca0 2021-12-17T18:24:10.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.082+0000 7f13ff4e0700 1 -- 172.21.15.62:0/2339521372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f13f8145410 con 0x7f13f80aaca0 2021-12-17T18:24:10.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.082+0000 7f13e67fc700 1 -- 172.21.15.62:0/2339521372 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v67) v1 ==== 84+0+143 (secure 0 0 0) 0x7f13f4018030 con 0x7f13f80aaca0 2021-12-17T18:24:10.086 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:10.086 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2021-12-17T18:24:10.086 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:10.087 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2021-12-17T18:24:10.087 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "device_health_metrics" 2021-12-17T18:24:10.087 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:24:10.087 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:24:10.087 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2021-12-17T18:24:10.088 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2021-12-17T18:24:10.088 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:24:10.088 INFO:teuthology.orchestra.run.smithi062.stdout:] 2021-12-17T18:24:10.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.086+0000 7f13ff4e0700 1 -- 172.21.15.62:0/2339521372 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f13d8053610 msgr2=0x7f13d8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.086+0000 7f13ff4e0700 1 --2- 172.21.15.62:0/2339521372 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f13d8053610 0x7f13d8055ad0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f13e8018000 tx=0x7f13e8014000).stop 2021-12-17T18:24:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.086+0000 7f13ff4e0700 1 -- 172.21.15.62:0/2339521372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13f80aaca0 msgr2=0x7f13f80b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.086+0000 7f13ff4e0700 1 --2- 172.21.15.62:0/2339521372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13f80aaca0 0x7f13f80b3bf0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f13f4001110 tx=0x7f13f4007aa0).stop 2021-12-17T18:24:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.086+0000 7f13ff4e0700 1 -- 172.21.15.62:0/2339521372 shutdown_connections 2021-12-17T18:24:10.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.086+0000 7f13ff4e0700 1 --2- 172.21.15.62:0/2339521372 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f13d8053610 0x7f13d8055ad0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:10.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.086+0000 7f13ff4e0700 1 --2- 172.21.15.62:0/2339521372 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13f8144fa0 0x7f13f8065360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:10.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.086+0000 7f13ff4e0700 1 --2- 172.21.15.62:0/2339521372 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13f80aee10 0x7f13f8139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:10.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.086+0000 7f13ff4e0700 1 --2- 172.21.15.62:0/2339521372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13f80aaca0 0x7f13f80b3bf0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:10.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.086+0000 7f13ff4e0700 1 -- 172.21.15.62:0/2339521372 >> 172.21.15.62:0/2339521372 conn(0x7f13f805f730 msgr2=0x7f13f80aa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:10.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.086+0000 7f13ff4e0700 1 -- 172.21.15.62:0/2339521372 shutdown_connections 2021-12-17T18:24:10.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.086+0000 7f13ff4e0700 1 -- 172.21.15.62:0/2339521372 wait complete. 2021-12-17T18:24:10.099 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-12-17T18:24:10.100 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-12-17T18:24:10.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.210+0000 7f3740aeb700 1 Processor -- start 2021-12-17T18:24:10.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.210+0000 7f3740aeb700 1 -- start start 2021-12-17T18:24:10.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.210+0000 7f3740aeb700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f373c0b6700 0x7f373c064190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:10.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.210+0000 7f3740aeb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f373c0637a0 0x7f373c067890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:10.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.210+0000 7f3740aeb700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373c0b6ae0 con 0x7f373c14a820 2021-12-17T18:24:10.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.210+0000 7f3740aeb700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f373c065fe0 con 0x7f373c0b6700 2021-12-17T18:24:10.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.210+0000 7f3740aeb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c064680 con 0x7f373c0637a0 2021-12-17T18:24:10.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.210+0000 7f373b7fe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f373c0b6700 0x7f373c064190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:10.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.210+0000 7f373affd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f373c0637a0 0x7f373c067890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:10.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.210+0000 7f373b7fe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f373c0b6700 0x7f373c064190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:58626/0 (socket says 172.21.15.62:58626) 2021-12-17T18:24:10.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.210+0000 7f373b7fe700 1 -- 172.21.15.62:0/299522726 learned_addr learned my addr 172.21.15.62:0/299522726 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f373b7fe700 1 -- 172.21.15.62:0/299522726 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f373c0637a0 msgr2=0x7f373c067890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f373b7fe700 1 --2- 172.21.15.62:0/299522726 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f373c0637a0 0x7f373c067890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f373b7fe700 1 -- 172.21.15.62:0/299522726 >> v1:172.21.15.109:6789/0 conn(0x7f373c14a820 legacy=0x7f373c140ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f373b7fe700 1 -- 172.21.15.62:0/299522726 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c067d80 con 0x7f373c0b6700 2021-12-17T18:24:10.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f373b7fe700 1 --2- 172.21.15.62:0/299522726 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f373c0b6700 0x7f373c064190 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f373c0647c0 tx=0x7f372c006eb0).ready entity=mon.1 client_cookie=1131a076dd759ab0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:10.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f373a7fc700 1 -- 172.21.15.62:0/299522726 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f372c00d5c0 con 0x7f373c0b6700 2021-12-17T18:24:10.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f373a7fc700 1 -- 172.21.15.62:0/299522726 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c000e90 con 0x7f373c0b6700 2021-12-17T18:24:10.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f373a7fc700 1 -- 172.21.15.62:0/299522726 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f372c00d950 con 0x7f373c0b6700 2021-12-17T18:24:10.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f3740aeb700 1 -- 172.21.15.62:0/299522726 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f373c0b6700 msgr2=0x7f373c064190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:10.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f3740aeb700 1 --2- 172.21.15.62:0/299522726 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f373c0b6700 0x7f373c064190 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f373c0647c0 tx=0x7f372c006eb0).stop 2021-12-17T18:24:10.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f3740aeb700 1 -- 172.21.15.62:0/299522726 shutdown_connections 2021-12-17T18:24:10.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f3740aeb700 1 --2- 172.21.15.62:0/299522726 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f373c0637a0 0x7f373c067890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:10.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f3740aeb700 1 --2- 172.21.15.62:0/299522726 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f373c0b6700 0x7f373c064190 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:10.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f3740aeb700 1 -- 172.21.15.62:0/299522726 >> 172.21.15.62:0/299522726 conn(0x7f373c05c750 msgr2=0x7f373c0b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:10.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f3740aeb700 1 -- 172.21.15.62:0/299522726 shutdown_connections 2021-12-17T18:24:10.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f3740aeb700 1 -- 172.21.15.62:0/299522726 wait complete. 2021-12-17T18:24:10.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f3740aeb700 1 Processor -- start 2021-12-17T18:24:10.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.214+0000 7f3740aeb700 1 -- start start 2021-12-17T18:24:10.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f3740aeb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f373c0637a0 0x7f373c141b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:10.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f3740aeb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f373c0b6700 0x7f373c0b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:10.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f3740aeb700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f373c14a820 0x7f373c159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:10.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f3740aeb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c14b0e0 con 0x7f373c0637a0 2021-12-17T18:24:10.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f3740aeb700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c142080 con 0x7f373c14a820 2021-12-17T18:24:10.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f3740aeb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c14b310 con 0x7f373c0b6700 2021-12-17T18:24:10.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f373b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f373c0637a0 0x7f373c141b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:10.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f373b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f373c0637a0 0x7f373c141b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52082/0 (socket says 172.21.15.62:52082) 2021-12-17T18:24:10.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f373b7fe700 1 -- 172.21.15.62:0/227500233 learned_addr learned my addr 172.21.15.62:0/227500233 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:10.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f373bfff700 1 --2- 172.21.15.62:0/227500233 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f373c14a820 0x7f373c159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:10.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f373affd700 1 --2- 172.21.15.62:0/227500233 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f373c0b6700 0x7f373c0b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:10.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f373b7fe700 1 -- 172.21.15.62:0/227500233 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f373c0b6700 msgr2=0x7f373c0b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:10.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f373b7fe700 1 --2- 172.21.15.62:0/227500233 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f373c0b6700 0x7f373c0b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:10.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f373b7fe700 1 -- 172.21.15.62:0/227500233 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f373c14a820 msgr2=0x7f373c159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:10.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f373b7fe700 1 --2- 172.21.15.62:0/227500233 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f373c14a820 0x7f373c159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:10.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f373b7fe700 1 -- 172.21.15.62:0/227500233 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c00b1e0 con 0x7f373c0637a0 2021-12-17T18:24:10.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f373bfff700 1 --2- 172.21.15.62:0/227500233 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f373c14a820 0x7f373c159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:24:10.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f373affd700 1 --2- 172.21.15.62:0/227500233 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f373c0b6700 0x7f373c0b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:24:10.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f373b7fe700 1 --2- 172.21.15.62:0/227500233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f373c0637a0 0x7f373c141b90 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f373c0647c0 tx=0x7f372c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:10.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f3738ff9700 1 -- 172.21.15.62:0/227500233 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f372c011860 con 0x7f373c0637a0 2021-12-17T18:24:10.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f3738ff9700 1 -- 172.21.15.62:0/227500233 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c0119c0 con 0x7f373c0637a0 2021-12-17T18:24:10.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f3738ff9700 1 -- 172.21.15.62:0/227500233 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f372c011d20 con 0x7f373c0637a0 2021-12-17T18:24:10.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f3740aeb700 1 -- 172.21.15.62:0/227500233 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373c14d5e0 con 0x7f373c0637a0 2021-12-17T18:24:10.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.218+0000 7f3740aeb700 1 -- 172.21.15.62:0/227500233 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373c0b4540 con 0x7f373c0637a0 2021-12-17T18:24:10.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.222+0000 7f3740aeb700 1 -- 172.21.15.62:0/227500233 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373c141960 con 0x7f373c0637a0 2021-12-17T18:24:10.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.222+0000 7f3738ff9700 1 -- 172.21.15.62:0/227500233 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f372c00f070 con 0x7f373c0637a0 2021-12-17T18:24:10.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.222+0000 7f3738ff9700 1 --2- 172.21.15.62:0/227500233 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f371c053640 0x7f371c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:10.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.222+0000 7f3738ff9700 1 -- 172.21.15.62:0/227500233 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f372c06cf90 con 0x7f373c0637a0 2021-12-17T18:24:10.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.222+0000 7f373affd700 1 --2- 172.21.15.62:0/227500233 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f371c053640 0x7f371c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:10.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.222+0000 7f373affd700 1 --2- 172.21.15.62:0/227500233 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f371c053640 0x7f371c055b00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f373000b000 tx=0x7f3730008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:10.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.226+0000 7f3738ff9700 1 -- 172.21.15.62:0/227500233 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f372c044380 con 0x7f373c0637a0 2021-12-17T18:24:10.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.354+0000 7f3740aeb700 1 -- 172.21.15.62:0/227500233 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f373c0573d0 con 0x7f373c0637a0 2021-12-17T18:24:10.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.894+0000 7f3738ff9700 1 -- 172.21.15.62:0/227500233 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v68) v1 ==== 133+0+0 (secure 0 0 0) 0x7f372c0479a0 con 0x7f373c0637a0 2021-12-17T18:24:10.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.898+0000 7f3740aeb700 1 -- 172.21.15.62:0/227500233 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f371c053640 msgr2=0x7f371c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:10.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.898+0000 7f3740aeb700 1 --2- 172.21.15.62:0/227500233 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f371c053640 0x7f371c055b00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f373000b000 tx=0x7f3730008040).stop 2021-12-17T18:24:10.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.898+0000 7f3740aeb700 1 -- 172.21.15.62:0/227500233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f373c0637a0 msgr2=0x7f373c141b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:10.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.898+0000 7f3740aeb700 1 --2- 172.21.15.62:0/227500233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f373c0637a0 0x7f373c141b90 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f373c0647c0 tx=0x7f372c015000).stop 2021-12-17T18:24:10.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.898+0000 7f3740aeb700 1 -- 172.21.15.62:0/227500233 shutdown_connections 2021-12-17T18:24:10.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.898+0000 7f3740aeb700 1 --2- 172.21.15.62:0/227500233 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f371c053640 0x7f371c055b00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:10.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.898+0000 7f3740aeb700 1 --2- 172.21.15.62:0/227500233 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f373c14a820 0x7f373c159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:10.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.898+0000 7f3740aeb700 1 --2- 172.21.15.62:0/227500233 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f373c0b6700 0x7f373c0b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:10.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.898+0000 7f3740aeb700 1 --2- 172.21.15.62:0/227500233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f373c0637a0 0x7f373c141b90 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:10.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.898+0000 7f3740aeb700 1 -- 172.21.15.62:0/227500233 >> 172.21.15.62:0/227500233 conn(0x7f373c05c750 msgr2=0x7f373c149090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:10.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.898+0000 7f3740aeb700 1 -- 172.21.15.62:0/227500233 shutdown_connections 2021-12-17T18:24:10.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:10.898+0000 7f3740aeb700 1 -- 172.21.15.62:0/227500233 wait complete. 2021-12-17T18:24:10.905 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2021-12-17T18:24:10.916 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-12-17T18:24:11.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.026+0000 7f8b3b59e700 1 Processor -- start 2021-12-17T18:24:11.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.026+0000 7f8b3b59e700 1 -- start start 2021-12-17T18:24:11.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b3b59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f8b3c05ca90 0x7f8b3c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b3b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b3c0b3540 0x7f8b3c0b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b3b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b3c05ce70 con 0x7f8b3c0b4230 2021-12-17T18:24:11.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b3b59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3c0b1bc0 con 0x7f8b3c05ca90 2021-12-17T18:24:11.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b3b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c0b1e60 con 0x7f8b3c0b3540 2021-12-17T18:24:11.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b3ad9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8b3c0b4230 0x7f8b3c0b5460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35674/0 (socket says 172.21.15.62:35674) 2021-12-17T18:24:11.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b3ad9d700 1 -- 172.21.15.62:0/525087986 learned_addr learned my addr 172.21.15.62:0/525087986 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:11.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b33fff700 1 --2- 172.21.15.62:0/525087986 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b3c0b3540 0x7f8b3c0b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b3a59c700 1 --2- 172.21.15.62:0/525087986 >> v2:172.21.15.109:3300/0 conn(0x7f8b3c05ca90 0x7f8b3c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b39d9b700 1 -- 172.21.15.62:0/525087986 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415114791 0 0) 0x7f8b3c05ce70 con 0x7f8b3c0b4230 2021-12-17T18:24:11.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b39d9b700 1 -- 172.21.15.62:0/525087986 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b1c003260 con 0x7f8b3c0b4230 2021-12-17T18:24:11.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b33fff700 1 -- 172.21.15.62:0/525087986 >> v2:172.21.15.109:3300/0 conn(0x7f8b3c05ca90 msgr2=0x7f8b3c0b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:11.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b33fff700 1 --2- 172.21.15.62:0/525087986 >> v2:172.21.15.109:3300/0 conn(0x7f8b3c05ca90 0x7f8b3c0b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b33fff700 1 -- 172.21.15.62:0/525087986 >> v1:172.21.15.62:6789/0 conn(0x7f8b3c0b4230 legacy=0x7f8b3c0b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:11.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b33fff700 1 -- 172.21.15.62:0/525087986 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c0b2100 con 0x7f8b3c0b3540 2021-12-17T18:24:11.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b3a59c700 1 --2- 172.21.15.62:0/525087986 >> v2:172.21.15.109:3300/0 conn(0x7f8b3c05ca90 0x7f8b3c0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:24:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b33fff700 1 --2- 172.21.15.62:0/525087986 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b3c0b3540 0x7f8b3c0b4f70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f8b24002f70 tx=0x7f8b24006d90).ready entity=mon.2 client_cookie=d3e69a8b41c178ac server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b39d9b700 1 -- 172.21.15.62:0/525087986 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b2400e590 con 0x7f8b3c0b3540 2021-12-17T18:24:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b39d9b700 1 -- 172.21.15.62:0/525087986 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b24000e90 con 0x7f8b3c0b3540 2021-12-17T18:24:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.030+0000 7f8b39d9b700 1 -- 172.21.15.62:0/525087986 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b2400e8e0 con 0x7f8b3c0b3540 2021-12-17T18:24:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b3b59e700 1 -- 172.21.15.62:0/525087986 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b3c0b3540 msgr2=0x7f8b3c0b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:11.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b3b59e700 1 --2- 172.21.15.62:0/525087986 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b3c0b3540 0x7f8b3c0b4f70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f8b24002f70 tx=0x7f8b24006d90).stop 2021-12-17T18:24:11.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b3b59e700 1 -- 172.21.15.62:0/525087986 shutdown_connections 2021-12-17T18:24:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b3b59e700 1 --2- 172.21.15.62:0/525087986 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b3c0b3540 0x7f8b3c0b4f70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b3b59e700 1 --2- 172.21.15.62:0/525087986 >> v2:172.21.15.109:3300/0 conn(0x7f8b3c05ca90 0x7f8b3c0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b3b59e700 1 -- 172.21.15.62:0/525087986 >> 172.21.15.62:0/525087986 conn(0x7f8b3c05bcd0 msgr2=0x7f8b3c062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b3b59e700 1 -- 172.21.15.62:0/525087986 shutdown_connections 2021-12-17T18:24:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b3b59e700 1 -- 172.21.15.62:0/525087986 wait complete. 2021-12-17T18:24:11.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b3b59e700 1 Processor -- start 2021-12-17T18:24:11.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b3b59e700 1 -- start start 2021-12-17T18:24:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b3b59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8b3c05ca90 0x7f8b3c0aa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b3b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b3c0b3540 0x7f8b3c0a7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b3b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b3c0b4230 0x7f8b3c0a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b3b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c0a6390 con 0x7f8b3c0b3540 2021-12-17T18:24:11.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b3b59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c0a6630 con 0x7f8b3c05ca90 2021-12-17T18:24:11.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b3b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c1557f0 con 0x7f8b3c0b4230 2021-12-17T18:24:11.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b33fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b3c0b3540 0x7f8b3c0a7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b33fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b3c0b3540 0x7f8b3c0a7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52098/0 (socket says 172.21.15.62:52098) 2021-12-17T18:24:11.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.034+0000 7f8b33fff700 1 -- 172.21.15.62:0/89814637 learned_addr learned my addr 172.21.15.62:0/89814637 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:11.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.038+0000 7f8b3a59c700 1 --2- 172.21.15.62:0/89814637 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8b3c05ca90 0x7f8b3c0aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.038+0000 7f8b3ad9d700 1 --2- 172.21.15.62:0/89814637 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b3c0b4230 0x7f8b3c0a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.038+0000 7f8b33fff700 1 -- 172.21.15.62:0/89814637 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b3c0b4230 msgr2=0x7f8b3c0a37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:11.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.038+0000 7f8b33fff700 1 --2- 172.21.15.62:0/89814637 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b3c0b4230 0x7f8b3c0a37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.038+0000 7f8b33fff700 1 -- 172.21.15.62:0/89814637 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8b3c05ca90 msgr2=0x7f8b3c0aa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:11.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.038+0000 7f8b33fff700 1 --2- 172.21.15.62:0/89814637 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8b3c05ca90 0x7f8b3c0aa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.038+0000 7f8b33fff700 1 -- 172.21.15.62:0/89814637 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c00b180 con 0x7f8b3c0b3540 2021-12-17T18:24:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.038+0000 7f8b33fff700 1 --2- 172.21.15.62:0/89814637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b3c0b3540 0x7f8b3c0a7640 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f8b24002f70 tx=0x7f8b24014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.038+0000 7f8b337fe700 1 -- 172.21.15.62:0/89814637 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b240116c0 con 0x7f8b3c0b3540 2021-12-17T18:24:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.038+0000 7f8b337fe700 1 -- 172.21.15.62:0/89814637 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b24011820 con 0x7f8b3c0b3540 2021-12-17T18:24:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.038+0000 7f8b3b59e700 1 -- 172.21.15.62:0/89814637 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2400b120 con 0x7f8b3c0b3540 2021-12-17T18:24:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.038+0000 7f8b337fe700 1 -- 172.21.15.62:0/89814637 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b24011b80 con 0x7f8b3c0b3540 2021-12-17T18:24:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.038+0000 7f8b3b59e700 1 -- 172.21.15.62:0/89814637 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3c0a70f0 con 0x7f8b3c0b3540 2021-12-17T18:24:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.038+0000 7f8b3b59e700 1 -- 172.21.15.62:0/89814637 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3c0603f0 con 0x7f8b3c0b3540 2021-12-17T18:24:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.038+0000 7f8b337fe700 1 -- 172.21.15.62:0/89814637 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8b2400f070 con 0x7f8b3c0b3540 2021-12-17T18:24:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.042+0000 7f8b337fe700 1 --2- 172.21.15.62:0/89814637 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8b200534f0 0x7f8b200559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.042+0000 7f8b337fe700 1 -- 172.21.15.62:0/89814637 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f8b2406cb20 con 0x7f8b3c0b3540 2021-12-17T18:24:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.042+0000 7f8b3a59c700 1 --2- 172.21.15.62:0/89814637 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8b200534f0 0x7f8b200559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.042+0000 7f8b3a59c700 1 --2- 172.21.15.62:0/89814637 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8b200534f0 0x7f8b200559b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f8b2c00b000 tx=0x7f8b2c006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:11.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.046+0000 7f8b337fe700 1 -- 172.21.15.62:0/89814637 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8b24043df0 con 0x7f8b3c0b3540 2021-12-17T18:24:11.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.170+0000 7f8b3b59e700 1 -- 172.21.15.62:0/89814637 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f8b3c0573d0 con 0x7f8b3c0b3540 2021-12-17T18:24:11.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.490+0000 7f8b337fe700 1 -- 172.21.15.62:0/89814637 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v69) v1 ==== 125+0+0 (secure 0 0 0) 0x7f8b24017320 con 0x7f8b3c0b3540 2021-12-17T18:24:11.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.494+0000 7f8b3b59e700 1 -- 172.21.15.62:0/89814637 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8b200534f0 msgr2=0x7f8b200559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:11.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.494+0000 7f8b3b59e700 1 --2- 172.21.15.62:0/89814637 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8b200534f0 0x7f8b200559b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f8b2c00b000 tx=0x7f8b2c006df0).stop 2021-12-17T18:24:11.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.494+0000 7f8b3b59e700 1 -- 172.21.15.62:0/89814637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b3c0b3540 msgr2=0x7f8b3c0a7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:11.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.494+0000 7f8b3b59e700 1 --2- 172.21.15.62:0/89814637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b3c0b3540 0x7f8b3c0a7640 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f8b24002f70 tx=0x7f8b24014000).stop 2021-12-17T18:24:11.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.494+0000 7f8b3b59e700 1 -- 172.21.15.62:0/89814637 shutdown_connections 2021-12-17T18:24:11.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.494+0000 7f8b3b59e700 1 --2- 172.21.15.62:0/89814637 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8b200534f0 0x7f8b200559b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.494+0000 7f8b3b59e700 1 --2- 172.21.15.62:0/89814637 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b3c0b4230 0x7f8b3c0a37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.494+0000 7f8b3b59e700 1 --2- 172.21.15.62:0/89814637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b3c0b3540 0x7f8b3c0a7640 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.494+0000 7f8b3b59e700 1 --2- 172.21.15.62:0/89814637 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8b3c05ca90 0x7f8b3c0aa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.494+0000 7f8b3b59e700 1 -- 172.21.15.62:0/89814637 >> 172.21.15.62:0/89814637 conn(0x7f8b3c05bcd0 msgr2=0x7f8b3c062410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:11.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.494+0000 7f8b3b59e700 1 -- 172.21.15.62:0/89814637 shutdown_connections 2021-12-17T18:24:11.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.494+0000 7f8b3b59e700 1 -- 172.21.15.62:0/89814637 wait complete. 2021-12-17T18:24:11.501 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2021-12-17T18:24:11.514 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-12-17T18:24:11.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.618+0000 7f7b2e39f700 1 Processor -- start 2021-12-17T18:24:11.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.618+0000 7f7b2e39f700 1 -- start start 2021-12-17T18:24:11.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2e39f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7b2805ca90 0x7f7b280b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2e39f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7b280604b0 0x7f7b28146230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2e39f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2805ce70 con 0x7f7b280b34b0 2021-12-17T18:24:11.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2e39f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b280b2d70 con 0x7f7b280604b0 2021-12-17T18:24:11.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2e39f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b280b3010 con 0x7f7b2805ca90 2021-12-17T18:24:11.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2db9e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7b280604b0 0x7f7b28146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2cb9c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7b280b34b0 0x7f7b28145b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35686/0 (socket says 172.21.15.62:35686) 2021-12-17T18:24:11.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2cb9c700 1 -- 172.21.15.62:0/3539399469 learned_addr learned my addr 172.21.15.62:0/3539399469 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:11.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2d39d700 1 --2- 172.21.15.62:0/3539399469 >> v2:172.21.15.109:3300/0 conn(0x7f7b2805ca90 0x7f7b280b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2db9e700 1 -- 172.21.15.62:0/3539399469 >> v2:172.21.15.109:3300/0 conn(0x7f7b2805ca90 msgr2=0x7f7b280b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:11.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2db9e700 1 --2- 172.21.15.62:0/3539399469 >> v2:172.21.15.109:3300/0 conn(0x7f7b2805ca90 0x7f7b280b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2db9e700 1 -- 172.21.15.62:0/3539399469 >> v1:172.21.15.62:6789/0 conn(0x7f7b280b34b0 legacy=0x7f7b28145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:11.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2db9e700 1 -- 172.21.15.62:0/3539399469 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b280b2ab0 con 0x7f7b280604b0 2021-12-17T18:24:11.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2db9e700 1 --2- 172.21.15.62:0/3539399469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b280604b0 0x7f7b28146230 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f7b200032f0 tx=0x7f7b200091d0).ready entity=mon.0 client_cookie=356a1489b92d47fb server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:11.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b17fff700 1 -- 172.21.15.62:0/3539399469 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b20009ea0 con 0x7f7b280604b0 2021-12-17T18:24:11.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b17fff700 1 -- 172.21.15.62:0/3539399469 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2000b870 con 0x7f7b280604b0 2021-12-17T18:24:11.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b17fff700 1 -- 172.21.15.62:0/3539399469 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b2000b9e0 con 0x7f7b280604b0 2021-12-17T18:24:11.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2e39f700 1 -- 172.21.15.62:0/3539399469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b280604b0 msgr2=0x7f7b28146230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:11.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2e39f700 1 --2- 172.21.15.62:0/3539399469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b280604b0 0x7f7b28146230 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f7b200032f0 tx=0x7f7b200091d0).stop 2021-12-17T18:24:11.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2e39f700 1 -- 172.21.15.62:0/3539399469 shutdown_connections 2021-12-17T18:24:11.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2e39f700 1 --2- 172.21.15.62:0/3539399469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b280604b0 0x7f7b28146230 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2e39f700 1 --2- 172.21.15.62:0/3539399469 >> v2:172.21.15.109:3300/0 conn(0x7f7b2805ca90 0x7f7b280b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2e39f700 1 -- 172.21.15.62:0/3539399469 >> 172.21.15.62:0/3539399469 conn(0x7f7b2805bcd0 msgr2=0x7f7b28062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:11.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2e39f700 1 -- 172.21.15.62:0/3539399469 shutdown_connections 2021-12-17T18:24:11.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.622+0000 7f7b2e39f700 1 -- 172.21.15.62:0/3539399469 wait complete. 2021-12-17T18:24:11.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2e39f700 1 Processor -- start 2021-12-17T18:24:11.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2e39f700 1 -- start start 2021-12-17T18:24:11.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2e39f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7b2805ca90 0x7f7b28148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2e39f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b280604b0 0x7f7b28155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2e39f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7b280b34b0 0x7f7b281562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2e39f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28066950 con 0x7f7b280604b0 2021-12-17T18:24:11.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2e39f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28066b80 con 0x7f7b280b34b0 2021-12-17T18:24:11.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2e39f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28066e20 con 0x7f7b2805ca90 2021-12-17T18:24:11.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2cb9c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b280604b0 0x7f7b28155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2cb9c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b280604b0 0x7f7b28155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52112/0 (socket says 172.21.15.62:52112) 2021-12-17T18:24:11.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2cb9c700 1 -- 172.21.15.62:0/179123013 learned_addr learned my addr 172.21.15.62:0/179123013 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:11.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2db9e700 1 --2- 172.21.15.62:0/179123013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7b280b34b0 0x7f7b281562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2d39d700 1 --2- 172.21.15.62:0/179123013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7b2805ca90 0x7f7b28148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2cb9c700 1 -- 172.21.15.62:0/179123013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7b2805ca90 msgr2=0x7f7b28148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:11.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2cb9c700 1 --2- 172.21.15.62:0/179123013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7b2805ca90 0x7f7b28148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2cb9c700 1 -- 172.21.15.62:0/179123013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7b280b34b0 msgr2=0x7f7b281562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:11.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2cb9c700 1 --2- 172.21.15.62:0/179123013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7b280b34b0 0x7f7b281562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2cb9c700 1 -- 172.21.15.62:0/179123013 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b20009470 con 0x7f7b280604b0 2021-12-17T18:24:11.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2cb9c700 1 --2- 172.21.15.62:0/179123013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b280604b0 0x7f7b28155dc0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f7b280b3390 tx=0x7f7b18007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:11.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b167fc700 1 -- 172.21.15.62:0/179123013 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b180070d0 con 0x7f7b280604b0 2021-12-17T18:24:11.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b167fc700 1 -- 172.21.15.62:0/179123013 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b18007230 con 0x7f7b280604b0 2021-12-17T18:24:11.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2e39f700 1 -- 172.21.15.62:0/179123013 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b280a3d70 con 0x7f7b280604b0 2021-12-17T18:24:11.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b167fc700 1 -- 172.21.15.62:0/179123013 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b18005610 con 0x7f7b280604b0 2021-12-17T18:24:11.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.626+0000 7f7b2e39f700 1 -- 172.21.15.62:0/179123013 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b28067110 con 0x7f7b280604b0 2021-12-17T18:24:11.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.630+0000 7f7b2e39f700 1 -- 172.21.15.62:0/179123013 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b280b4500 con 0x7f7b280604b0 2021-12-17T18:24:11.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.630+0000 7f7b167fc700 1 -- 172.21.15.62:0/179123013 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7b18010070 con 0x7f7b280604b0 2021-12-17T18:24:11.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.630+0000 7f7b167fc700 1 --2- 172.21.15.62:0/179123013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b080536a0 0x7f7b08055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.630+0000 7f7b167fc700 1 -- 172.21.15.62:0/179123013 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f7b1806ad90 con 0x7f7b280604b0 2021-12-17T18:24:11.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.630+0000 7f7b2d39d700 1 --2- 172.21.15.62:0/179123013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b080536a0 0x7f7b08055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.630+0000 7f7b2d39d700 1 --2- 172.21.15.62:0/179123013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b080536a0 0x7f7b08055b60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f7b2400c000 tx=0x7f7b24008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:11.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.638+0000 7f7b167fc700 1 -- 172.21.15.62:0/179123013 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7b18041f60 con 0x7f7b280604b0 2021-12-17T18:24:11.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.802+0000 7f7b2e39f700 1 -- 172.21.15.62:0/179123013 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f7b280573d0 con 0x7f7b280604b0 2021-12-17T18:24:11.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.814+0000 7f7b167fc700 1 -- 172.21.15.62:0/179123013 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 13 and data pool 14 v31) v1 ==== 189+0+0 (secure 0 0 0) 0x7f7b18018070 con 0x7f7b280604b0 2021-12-17T18:24:11.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.818+0000 7f7b2e39f700 1 -- 172.21.15.62:0/179123013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b080536a0 msgr2=0x7f7b08055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:11.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.818+0000 7f7b2e39f700 1 --2- 172.21.15.62:0/179123013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b080536a0 0x7f7b08055b60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f7b2400c000 tx=0x7f7b24008040).stop 2021-12-17T18:24:11.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.818+0000 7f7b2e39f700 1 -- 172.21.15.62:0/179123013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b280604b0 msgr2=0x7f7b28155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:11.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.818+0000 7f7b2e39f700 1 --2- 172.21.15.62:0/179123013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b280604b0 0x7f7b28155dc0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f7b280b3390 tx=0x7f7b18007c70).stop 2021-12-17T18:24:11.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.818+0000 7f7b2e39f700 1 -- 172.21.15.62:0/179123013 shutdown_connections 2021-12-17T18:24:11.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.818+0000 7f7b2e39f700 1 --2- 172.21.15.62:0/179123013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b080536a0 0x7f7b08055b60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.818+0000 7f7b2e39f700 1 --2- 172.21.15.62:0/179123013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7b280b34b0 0x7f7b281562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.818+0000 7f7b2e39f700 1 --2- 172.21.15.62:0/179123013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b280604b0 0x7f7b28155dc0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.818+0000 7f7b2e39f700 1 --2- 172.21.15.62:0/179123013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7b2805ca90 0x7f7b28148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.818+0000 7f7b2e39f700 1 -- 172.21.15.62:0/179123013 >> 172.21.15.62:0/179123013 conn(0x7f7b2805bcd0 msgr2=0x7f7b28143240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:11.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.818+0000 7f7b2e39f700 1 -- 172.21.15.62:0/179123013 shutdown_connections 2021-12-17T18:24:11.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.818+0000 7f7b2e39f700 1 -- 172.21.15.62:0/179123013 wait complete. 2021-12-17T18:24:11.825 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 13 and data pool 14 2021-12-17T18:24:11.837 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:24:11.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261f0ee700 1 Processor -- start 2021-12-17T18:24:11.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261f0ee700 1 -- start start 2021-12-17T18:24:11.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261f0ee700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26180a8e10 0x7f2618147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261f0ee700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26180b6270 con 0x7f26180a71e0 2021-12-17T18:24:11.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261f0ee700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2618147610 con 0x7f2618141480 2021-12-17T18:24:11.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261f0ee700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26181478b0 con 0x7f26180a8e10 2021-12-17T18:24:11.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261e8ed700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f26180a71e0 0x7f26180a7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35714/0 (socket says 172.21.15.62:35714) 2021-12-17T18:24:11.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261e8ed700 1 -- 172.21.15.62:0/948801762 learned_addr learned my addr 172.21.15.62:0/948801762 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:11.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d8eb700 1 --2- 172.21.15.62:0/948801762 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26180a8e10 0x7f2618147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d0ea700 1 -- 172.21.15.62:0/948801762 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120435656 0 0) 0x7f26180b6270 con 0x7f26180a71e0 2021-12-17T18:24:11.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d0ea700 1 -- 172.21.15.62:0/948801762 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2600003260 con 0x7f26180a71e0 2021-12-17T18:24:11.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d0ea700 1 -- 172.21.15.62:0/948801762 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926814730 0 0) 0x7f2618147610 con 0x7f2618141480 2021-12-17T18:24:11.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d0ea700 1 -- 172.21.15.62:0/948801762 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26180b6270 con 0x7f2618141480 2021-12-17T18:24:11.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d0ea700 1 -- 172.21.15.62:0/948801762 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1003891483 0 0) 0x7f2600003260 con 0x7f26180a71e0 2021-12-17T18:24:11.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d0ea700 1 -- 172.21.15.62:0/948801762 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26180a8e10 msgr2=0x7f2618147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:11.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d0ea700 1 --2- 172.21.15.62:0/948801762 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26180a8e10 0x7f2618147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d0ea700 1 -- 172.21.15.62:0/948801762 >> v1:172.21.15.109:6789/0 conn(0x7f2618141480 legacy=0x7f26180b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:11.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d0ea700 1 -- 172.21.15.62:0/948801762 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2618147b50 con 0x7f26180a71e0 2021-12-17T18:24:11.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d0ea700 1 -- 172.21.15.62:0/948801762 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f26140019e0 con 0x7f26180a71e0 2021-12-17T18:24:11.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d0ea700 1 -- 172.21.15.62:0/948801762 >> v1:172.21.15.62:6789/0 conn(0x7f26180a71e0 legacy=0x7f26180a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:11.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d0ea700 1 --2- 172.21.15.62:0/948801762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2600003910 0x7f2600003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d0ea700 1 --2- 172.21.15.62:0/948801762 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26180a8e10 0x7f2600004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d0ea700 1 --2- 172.21.15.62:0/948801762 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26000049f0 0x7f2600004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d0ea700 1 -- 172.21.15.62:0/948801762 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26181478b0 con 0x7f2600003910 2021-12-17T18:24:11.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d0ea700 1 -- 172.21.15.62:0/948801762 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260000b7b0 con 0x7f26000049f0 2021-12-17T18:24:11.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261d0ea700 1 -- 172.21.15.62:0/948801762 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260000b970 con 0x7f26180a8e10 2021-12-17T18:24:11.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.922+0000 7f261e0ec700 1 --2- 172.21.15.62:0/948801762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2600003910 0x7f2600003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261e8ed700 1 --2- 172.21.15.62:0/948801762 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26000049f0 0x7f2600004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261d8eb700 1 --2- 172.21.15.62:0/948801762 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26180a8e10 0x7f2600004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261e0ec700 1 -- 172.21.15.62:0/948801762 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26180a8e10 msgr2=0x7f2600004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:11.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261e0ec700 1 --2- 172.21.15.62:0/948801762 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26180a8e10 0x7f2600004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261e0ec700 1 -- 172.21.15.62:0/948801762 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26000049f0 msgr2=0x7f2600004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:11.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261e0ec700 1 --2- 172.21.15.62:0/948801762 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26000049f0 0x7f2600004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261e0ec700 1 -- 172.21.15.62:0/948801762 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2600003260 con 0x7f2600003910 2021-12-17T18:24:11.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261e0ec700 1 --2- 172.21.15.62:0/948801762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2600003910 0x7f2600003d10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f2610001110 tx=0x7f2610007a00).ready entity=mon.0 client_cookie=dc4f68cad1979e27 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:11.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261d0ea700 1 -- 172.21.15.62:0/948801762 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2610007d10 con 0x7f2600003910 2021-12-17T18:24:11.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261d0ea700 1 -- 172.21.15.62:0/948801762 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2610007030 con 0x7f2600003910 2021-12-17T18:24:11.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261d0ea700 1 -- 172.21.15.62:0/948801762 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2610007390 con 0x7f2600003910 2021-12-17T18:24:11.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261f0ee700 1 -- 172.21.15.62:0/948801762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2600003910 msgr2=0x7f2600003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:11.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261f0ee700 1 --2- 172.21.15.62:0/948801762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2600003910 0x7f2600003d10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f2610001110 tx=0x7f2610007a00).stop 2021-12-17T18:24:11.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261e8ed700 1 -- 172.21.15.62:0/948801762 reap_dead start 2021-12-17T18:24:11.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261f0ee700 1 -- 172.21.15.62:0/948801762 shutdown_connections 2021-12-17T18:24:11.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261f0ee700 1 -- 172.21.15.62:0/948801762 >> 172.21.15.62:0/948801762 conn(0x7f261805d220 msgr2=0x7f26180b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:11.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261f0ee700 1 -- 172.21.15.62:0/948801762 shutdown_connections 2021-12-17T18:24:11.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261f0ee700 1 -- 172.21.15.62:0/948801762 wait complete. 2021-12-17T18:24:11.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261f0ee700 1 Processor -- start 2021-12-17T18:24:11.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.926+0000 7f261f0ee700 1 -- start start 2021-12-17T18:24:11.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261f0ee700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2600003910 0x7f261814b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261f0ee700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618146bf0 0x7f26180661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261f0ee700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f261815a2e0 0x7f261815a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261f0ee700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2618065ac0 con 0x7f2618146bf0 2021-12-17T18:24:11.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261f0ee700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2618147300 con 0x7f2600003910 2021-12-17T18:24:11.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261f0ee700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2618147070 con 0x7f261815a2e0 2021-12-17T18:24:11.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261d8eb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618146bf0 0x7f26180661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261d8eb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618146bf0 0x7f26180661c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52142/0 (socket says 172.21.15.62:52142) 2021-12-17T18:24:11.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261d8eb700 1 -- 172.21.15.62:0/541930485 learned_addr learned my addr 172.21.15.62:0/541930485 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:11.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261e8ed700 1 --2- 172.21.15.62:0/541930485 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f261815a2e0 0x7f261815a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261e0ec700 1 --2- 172.21.15.62:0/541930485 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2600003910 0x7f261814b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261d8eb700 1 -- 172.21.15.62:0/541930485 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f261815a2e0 msgr2=0x7f261815a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:11.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261d8eb700 1 --2- 172.21.15.62:0/541930485 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f261815a2e0 0x7f261815a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261d8eb700 1 -- 172.21.15.62:0/541930485 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2600003910 msgr2=0x7f261814b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:11.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261d8eb700 1 --2- 172.21.15.62:0/541930485 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2600003910 0x7f261814b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:11.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261d8eb700 1 -- 172.21.15.62:0/541930485 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2618065d20 con 0x7f2618146bf0 2021-12-17T18:24:11.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261d8eb700 1 --2- 172.21.15.62:0/541930485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618146bf0 0x7f26180661c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f260800b000 tx=0x7f2608006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:11.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f26077fe700 1 -- 172.21.15.62:0/541930485 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f260800f940 con 0x7f2618146bf0 2021-12-17T18:24:11.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f26077fe700 1 -- 172.21.15.62:0/541930485 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260800faa0 con 0x7f2618146bf0 2021-12-17T18:24:11.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261f0ee700 1 -- 172.21.15.62:0/541930485 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26180666b0 con 0x7f2618146bf0 2021-12-17T18:24:11.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f26077fe700 1 -- 172.21.15.62:0/541930485 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f260800fe40 con 0x7f2618146bf0 2021-12-17T18:24:11.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261f0ee700 1 -- 172.21.15.62:0/541930485 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26180ac280 con 0x7f2618146bf0 2021-12-17T18:24:11.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f26077fe700 1 -- 172.21.15.62:0/541930485 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2608014440 con 0x7f2618146bf0 2021-12-17T18:24:11.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f261f0ee700 1 -- 172.21.15.62:0/541930485 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26180b1b90 con 0x7f2618146bf0 2021-12-17T18:24:11.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f26077fe700 1 --2- 172.21.15.62:0/541930485 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25f80536d0 0x7f25f8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:11.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.930+0000 7f26077fe700 1 -- 172.21.15.62:0/541930485 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f260806c2f0 con 0x7f2618146bf0 2021-12-17T18:24:11.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.934+0000 7f261e0ec700 1 --2- 172.21.15.62:0/541930485 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25f80536d0 0x7f25f8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:11.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.934+0000 7f261e0ec700 1 --2- 172.21.15.62:0/541930485 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25f80536d0 0x7f25f8055b90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f2610018000 tx=0x7f2610016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:11.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:11.942+0000 7f26077fe700 1 -- 172.21.15.62:0/541930485 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f26080434a0 con 0x7f2618146bf0 2021-12-17T18:24:12.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.062+0000 7f261f0ee700 1 -- 172.21.15.62:0/541930485 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26180ac280 con 0x7f2618146bf0 2021-12-17T18:24:12.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.062+0000 7f26077fe700 1 -- 172.21.15.62:0/541930485 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+16115 (secure 0 0 0) 0x7f26180ac280 con 0x7f2618146bf0 2021-12-17T18:24:12.067 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:12.068 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":70,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:24:11.805394+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:24:10.413185+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-12-17T18:24:11.229328+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:24:12.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.066+0000 7f261f0ee700 1 -- 172.21.15.62:0/541930485 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25f80536d0 msgr2=0x7f25f8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.066+0000 7f261f0ee700 1 --2- 172.21.15.62:0/541930485 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25f80536d0 0x7f25f8055b90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f2610018000 tx=0x7f2610016000).stop 2021-12-17T18:24:12.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.066+0000 7f261f0ee700 1 -- 172.21.15.62:0/541930485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618146bf0 msgr2=0x7f26180661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.066+0000 7f261f0ee700 1 --2- 172.21.15.62:0/541930485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618146bf0 0x7f26180661c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f260800b000 tx=0x7f2608006df0).stop 2021-12-17T18:24:12.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.066+0000 7f261f0ee700 1 -- 172.21.15.62:0/541930485 shutdown_connections 2021-12-17T18:24:12.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.066+0000 7f261f0ee700 1 --2- 172.21.15.62:0/541930485 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25f80536d0 0x7f25f8055b90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.066+0000 7f261f0ee700 1 --2- 172.21.15.62:0/541930485 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f261815a2e0 0x7f261815a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.066+0000 7f261f0ee700 1 --2- 172.21.15.62:0/541930485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618146bf0 0x7f26180661c0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.066+0000 7f261f0ee700 1 --2- 172.21.15.62:0/541930485 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2600003910 0x7f261814b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.066+0000 7f261f0ee700 1 -- 172.21.15.62:0/541930485 >> 172.21.15.62:0/541930485 conn(0x7f261805d220 msgr2=0x7f261805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:12.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.066+0000 7f261f0ee700 1 -- 172.21.15.62:0/541930485 shutdown_connections 2021-12-17T18:24:12.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.066+0000 7f261f0ee700 1 -- 172.21.15.62:0/541930485 wait complete. 2021-12-17T18:24:12.087 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:24:12.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.186+0000 7f45fbfff700 1 Processor -- start 2021-12-17T18:24:12.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.186+0000 7f45fbfff700 1 -- start start 2021-12-17T18:24:12.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.186+0000 7f45fbfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f45fc141480 0x7f45fc147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:12.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.186+0000 7f45fbfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0a8e10 0x7f45fc0b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:12.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.186+0000 7f45fbfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45fc147610 con 0x7f45fc0b6050 2021-12-17T18:24:12.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.186+0000 7f45fbfff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45fc1478b0 con 0x7f45fc141480 2021-12-17T18:24:12.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.186+0000 7f45fbfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc147b50 con 0x7f45fc0a8e10 2021-12-17T18:24:12.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.186+0000 7f45fa7fc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0a8e10 0x7f45fc0b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:12.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.186+0000 7f45fb7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f45fc0b6050 0x7f45fc0a7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35734/0 (socket says 172.21.15.62:35734) 2021-12-17T18:24:12.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.186+0000 7f45fb7fe700 1 -- 172.21.15.62:0/4245782325 learned_addr learned my addr 172.21.15.62:0/4245782325 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:12.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.186+0000 7f45faffd700 1 --2- 172.21.15.62:0/4245782325 >> v2:172.21.15.109:3300/0 conn(0x7f45fc141480 0x7f45fc147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:12.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fa7fc700 1 -- 172.21.15.62:0/4245782325 >> v2:172.21.15.109:3300/0 conn(0x7f45fc141480 msgr2=0x7f45fc147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:12.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fa7fc700 1 --2- 172.21.15.62:0/4245782325 >> v2:172.21.15.109:3300/0 conn(0x7f45fc141480 0x7f45fc147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fa7fc700 1 -- 172.21.15.62:0/4245782325 >> v1:172.21.15.62:6789/0 conn(0x7f45fc0b6050 legacy=0x7f45fc0a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45f9ffb700 1 -- 172.21.15.62:0/4245782325 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523297484 0 0) 0x7f45fc147610 con 0x7f45fc0b6050 2021-12-17T18:24:12.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fa7fc700 1 -- 172.21.15.62:0/4245782325 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc0b1b90 con 0x7f45fc0a8e10 2021-12-17T18:24:12.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fa7fc700 1 --2- 172.21.15.62:0/4245782325 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0a8e10 0x7f45fc0b5b60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f45ec0032f0 tx=0x7f45ec0091d0).ready entity=mon.2 client_cookie=f150c08213de36f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:12.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45f9ffb700 1 -- 172.21.15.62:0/4245782325 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45ec00b6c0 con 0x7f45fc0a8e10 2021-12-17T18:24:12.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45f9ffb700 1 -- 172.21.15.62:0/4245782325 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec00b820 con 0x7f45fc0a8e10 2021-12-17T18:24:12.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45f9ffb700 1 -- 172.21.15.62:0/4245782325 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45ec00b990 con 0x7f45fc0a8e10 2021-12-17T18:24:12.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fbfff700 1 -- 172.21.15.62:0/4245782325 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0a8e10 msgr2=0x7f45fc0b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fbfff700 1 --2- 172.21.15.62:0/4245782325 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0a8e10 0x7f45fc0b5b60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f45ec0032f0 tx=0x7f45ec0091d0).stop 2021-12-17T18:24:12.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fbfff700 1 -- 172.21.15.62:0/4245782325 shutdown_connections 2021-12-17T18:24:12.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fbfff700 1 --2- 172.21.15.62:0/4245782325 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0a8e10 0x7f45fc0b5b60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fbfff700 1 --2- 172.21.15.62:0/4245782325 >> v2:172.21.15.109:3300/0 conn(0x7f45fc141480 0x7f45fc147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fbfff700 1 -- 172.21.15.62:0/4245782325 >> 172.21.15.62:0/4245782325 conn(0x7f45fc05d220 msgr2=0x7f45fc0b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:12.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fbfff700 1 -- 172.21.15.62:0/4245782325 shutdown_connections 2021-12-17T18:24:12.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fbfff700 1 -- 172.21.15.62:0/4245782325 wait complete. 2021-12-17T18:24:12.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fbfff700 1 Processor -- start 2021-12-17T18:24:12.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fbfff700 1 -- start start 2021-12-17T18:24:12.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fbfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45fc0a8e10 0x7f45fc0aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:12.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fbfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0b6050 0x7f45fc13db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:12.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc141480 0x7f45fc13e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:12.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fbfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0ac290 con 0x7f45fc141480 2021-12-17T18:24:12.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fbfff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0aa070 con 0x7f45fc0a8e10 2021-12-17T18:24:12.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.190+0000 7f45fbfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0abe20 con 0x7f45fc0b6050 2021-12-17T18:24:12.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.194+0000 7f45fb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc141480 0x7f45fc13e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:12.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.194+0000 7f45fb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc141480 0x7f45fc13e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52160/0 (socket says 172.21.15.62:52160) 2021-12-17T18:24:12.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.194+0000 7f45fb7fe700 1 -- 172.21.15.62:0/3498639545 learned_addr learned my addr 172.21.15.62:0/3498639545 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:12.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.194+0000 7f45faffd700 1 --2- 172.21.15.62:0/3498639545 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45fc0a8e10 0x7f45fc0aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:12.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.194+0000 7f45fa7fc700 1 --2- 172.21.15.62:0/3498639545 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0b6050 0x7f45fc13db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:12.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.194+0000 7f45fb7fe700 1 -- 172.21.15.62:0/3498639545 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0b6050 msgr2=0x7f45fc13db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.194+0000 7f45fb7fe700 1 --2- 172.21.15.62:0/3498639545 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0b6050 0x7f45fc13db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.194+0000 7f45fb7fe700 1 -- 172.21.15.62:0/3498639545 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45fc0a8e10 msgr2=0x7f45fc0aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.194+0000 7f45fb7fe700 1 --2- 172.21.15.62:0/3498639545 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45fc0a8e10 0x7f45fc0aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.194+0000 7f45fb7fe700 1 -- 172.21.15.62:0/3498639545 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec009470 con 0x7f45fc141480 2021-12-17T18:24:12.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.194+0000 7f45fb7fe700 1 --2- 172.21.15.62:0/3498639545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc141480 0x7f45fc13e020 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f45fc0abfb0 tx=0x7f45f4007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:12.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.194+0000 7f45ebfff700 1 -- 172.21.15.62:0/3498639545 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f40070d0 con 0x7f45fc141480 2021-12-17T18:24:12.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.194+0000 7f45ebfff700 1 -- 172.21.15.62:0/3498639545 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f4007230 con 0x7f45fc141480 2021-12-17T18:24:12.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.194+0000 7f45fbfff700 1 -- 172.21.15.62:0/3498639545 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45fc0aa2a0 con 0x7f45fc141480 2021-12-17T18:24:12.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.194+0000 7f45ebfff700 1 -- 172.21.15.62:0/3498639545 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f4005610 con 0x7f45fc141480 2021-12-17T18:24:12.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.194+0000 7f45fbfff700 1 -- 172.21.15.62:0/3498639545 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc13e510 con 0x7f45fc141480 2021-12-17T18:24:12.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.194+0000 7f45fbfff700 1 -- 172.21.15.62:0/3498639545 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc0a9ed0 con 0x7f45fc141480 2021-12-17T18:24:12.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.198+0000 7f45ebfff700 1 -- 172.21.15.62:0/3498639545 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f45f401a060 con 0x7f45fc141480 2021-12-17T18:24:12.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.198+0000 7f45ebfff700 1 --2- 172.21.15.62:0/3498639545 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45d8053610 0x7f45d8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:12.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.198+0000 7f45ebfff700 1 -- 172.21.15.62:0/3498639545 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f45f406afb0 con 0x7f45fc141480 2021-12-17T18:24:12.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.198+0000 7f45faffd700 1 --2- 172.21.15.62:0/3498639545 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45d8053610 0x7f45d8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:12.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.198+0000 7f45faffd700 1 --2- 172.21.15.62:0/3498639545 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45d8053610 0x7f45d8055ad0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f45f000b000 tx=0x7f45f0006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:12.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.202+0000 7f45ebfff700 1 -- 172.21.15.62:0/3498639545 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f45fc0a9ed0 con 0x7f45fc141480 2021-12-17T18:24:12.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.330+0000 7f45fbfff700 1 -- 172.21.15.62:0/3498639545 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45fc0abff0 con 0x7f45fc141480 2021-12-17T18:24:12.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.330+0000 7f45ebfff700 1 -- 172.21.15.62:0/3498639545 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+16115 (secure 0 0 0) 0x7f45fc0abff0 con 0x7f45fc141480 2021-12-17T18:24:12.333 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:12.333 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":70,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:24:11.805394+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:24:10.413185+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-12-17T18:24:11.229328+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:24:12.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.330+0000 7f45fbfff700 1 -- 172.21.15.62:0/3498639545 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45d8053610 msgr2=0x7f45d8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.330+0000 7f45fbfff700 1 --2- 172.21.15.62:0/3498639545 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45d8053610 0x7f45d8055ad0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f45f000b000 tx=0x7f45f0006df0).stop 2021-12-17T18:24:12.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.330+0000 7f45fbfff700 1 -- 172.21.15.62:0/3498639545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc141480 msgr2=0x7f45fc13e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.330+0000 7f45fbfff700 1 --2- 172.21.15.62:0/3498639545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc141480 0x7f45fc13e020 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f45fc0abfb0 tx=0x7f45f4007a00).stop 2021-12-17T18:24:12.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.330+0000 7f45fbfff700 1 -- 172.21.15.62:0/3498639545 shutdown_connections 2021-12-17T18:24:12.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.330+0000 7f45fbfff700 1 --2- 172.21.15.62:0/3498639545 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45d8053610 0x7f45d8055ad0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.330+0000 7f45fbfff700 1 --2- 172.21.15.62:0/3498639545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc141480 0x7f45fc13e020 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.330+0000 7f45fbfff700 1 --2- 172.21.15.62:0/3498639545 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0b6050 0x7f45fc13db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.330+0000 7f45fbfff700 1 --2- 172.21.15.62:0/3498639545 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45fc0a8e10 0x7f45fc0aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.330+0000 7f45fbfff700 1 -- 172.21.15.62:0/3498639545 >> 172.21.15.62:0/3498639545 conn(0x7f45fc05d220 msgr2=0x7f45fc0b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:12.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.330+0000 7f45fbfff700 1 -- 172.21.15.62:0/3498639545 shutdown_connections 2021-12-17T18:24:12.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.330+0000 7f45fbfff700 1 -- 172.21.15.62:0/3498639545 wait complete. 2021-12-17T18:24:12.346 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-12-17T18:24:12.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.450+0000 7fd577390700 1 Processor -- start 2021-12-17T18:24:12.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.450+0000 7fd577390700 1 -- start start 2021-12-17T18:24:12.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd577390700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd5700b41f0 0x7fd570146da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:12.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd577390700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5700b2010 con 0x7fd5700b05b0 2021-12-17T18:24:12.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd577390700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5700b0990 con 0x7fd5700b5dd0 2021-12-17T18:24:12.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd577390700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd570147290 con 0x7fd5700b41f0 2021-12-17T18:24:12.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd57512c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd5700b05b0 0x7fd570146690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35744/0 (socket says 172.21.15.62:35744) 2021-12-17T18:24:12.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd57512c700 1 -- 172.21.15.62:0/888615606 learned_addr learned my addr 172.21.15.62:0/888615606 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:12.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd57592d700 1 --2- 172.21.15.62:0/888615606 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd5700b41f0 0x7fd570146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:12.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd55bfff700 1 -- 172.21.15.62:0/888615606 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291686539 0 0) 0x7fd5700b2010 con 0x7fd5700b05b0 2021-12-17T18:24:12.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd55bfff700 1 -- 172.21.15.62:0/888615606 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd554003260 con 0x7fd5700b05b0 2021-12-17T18:24:12.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd55bfff700 1 -- 172.21.15.62:0/888615606 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570873712 0 0) 0x7fd5700b0990 con 0x7fd5700b5dd0 2021-12-17T18:24:12.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd55bfff700 1 -- 172.21.15.62:0/888615606 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5700b2010 con 0x7fd5700b5dd0 2021-12-17T18:24:12.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd57592d700 1 -- 172.21.15.62:0/888615606 >> v1:172.21.15.109:6789/0 conn(0x7fd5700b5dd0 legacy=0x7fd570141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd57592d700 1 -- 172.21.15.62:0/888615606 >> v1:172.21.15.62:6789/0 conn(0x7fd5700b05b0 legacy=0x7fd570146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd57592d700 1 -- 172.21.15.62:0/888615606 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5700b2240 con 0x7fd5700b41f0 2021-12-17T18:24:12.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd57592d700 1 --2- 172.21.15.62:0/888615606 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd5700b41f0 0x7fd570146da0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fd5680032f0 tx=0x7fd5680091d0).ready entity=mon.2 client_cookie=331a92a8debb9792 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:12.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd55bfff700 1 -- 172.21.15.62:0/888615606 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd56800b640 con 0x7fd5700b41f0 2021-12-17T18:24:12.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd55bfff700 1 -- 172.21.15.62:0/888615606 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56800b7a0 con 0x7fd5700b41f0 2021-12-17T18:24:12.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd55bfff700 1 -- 172.21.15.62:0/888615606 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd56800b910 con 0x7fd5700b41f0 2021-12-17T18:24:12.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd577390700 1 -- 172.21.15.62:0/888615606 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd5700b41f0 msgr2=0x7fd570146da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd577390700 1 --2- 172.21.15.62:0/888615606 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd5700b41f0 0x7fd570146da0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fd5680032f0 tx=0x7fd5680091d0).stop 2021-12-17T18:24:12.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd577390700 1 -- 172.21.15.62:0/888615606 shutdown_connections 2021-12-17T18:24:12.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd577390700 1 --2- 172.21.15.62:0/888615606 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd5700b41f0 0x7fd570146da0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd577390700 1 -- 172.21.15.62:0/888615606 >> 172.21.15.62:0/888615606 conn(0x7fd570062510 msgr2=0x7fd5700628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:12.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd577390700 1 -- 172.21.15.62:0/888615606 shutdown_connections 2021-12-17T18:24:12.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.454+0000 7fd577390700 1 -- 172.21.15.62:0/888615606 wait complete. 2021-12-17T18:24:12.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.458+0000 7fd577390700 1 Processor -- start 2021-12-17T18:24:12.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.458+0000 7fd577390700 1 -- start start 2021-12-17T18:24:12.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.458+0000 7fd577390700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd5700b05b0 0x7fd5700602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:12.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.458+0000 7fd577390700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5700b41f0 0x7fd570140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:12.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.458+0000 7fd577390700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd5700b5dd0 0x7fd570141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:12.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.458+0000 7fd577390700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd570152390 con 0x7fd5700b41f0 2021-12-17T18:24:12.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.458+0000 7fd577390700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5700a34e0 con 0x7fd5700b5dd0 2021-12-17T18:24:12.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.458+0000 7fd577390700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd570141510 con 0x7fd5700b05b0 2021-12-17T18:24:12.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd57492b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5700b41f0 0x7fd570140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:12.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd57492b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5700b41f0 0x7fd570140b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52172/0 (socket says 172.21.15.62:52172) 2021-12-17T18:24:12.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd57492b700 1 -- 172.21.15.62:0/1124335211 learned_addr learned my addr 172.21.15.62:0/1124335211 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:12.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd57592d700 1 --2- 172.21.15.62:0/1124335211 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd5700b5dd0 0x7fd570141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:12.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd57512c700 1 --2- 172.21.15.62:0/1124335211 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd5700b05b0 0x7fd5700602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:12.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd57492b700 1 -- 172.21.15.62:0/1124335211 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd5700b05b0 msgr2=0x7fd5700602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd57492b700 1 --2- 172.21.15.62:0/1124335211 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd5700b05b0 0x7fd5700602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd57492b700 1 -- 172.21.15.62:0/1124335211 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd5700b5dd0 msgr2=0x7fd570141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd57492b700 1 --2- 172.21.15.62:0/1124335211 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd5700b5dd0 0x7fd570141020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd57492b700 1 -- 172.21.15.62:0/1124335211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd568009470 con 0x7fd5700b41f0 2021-12-17T18:24:12.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd57592d700 1 --2- 172.21.15.62:0/1124335211 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd5700b5dd0 0x7fd570141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:24:12.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd57492b700 1 --2- 172.21.15.62:0/1124335211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5700b41f0 0x7fd570140b30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7fd564001110 tx=0x7fd564007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:12.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd562ffd700 1 -- 172.21.15.62:0/1124335211 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd564012400 con 0x7fd5700b41f0 2021-12-17T18:24:12.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd562ffd700 1 -- 172.21.15.62:0/1124335211 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd564012560 con 0x7fd5700b41f0 2021-12-17T18:24:12.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd577390700 1 -- 172.21.15.62:0/1124335211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5700664e0 con 0x7fd5700b41f0 2021-12-17T18:24:12.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd562ffd700 1 -- 172.21.15.62:0/1124335211 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5640128c0 con 0x7fd5700b41f0 2021-12-17T18:24:12.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd577390700 1 -- 172.21.15.62:0/1124335211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5700a31b0 con 0x7fd5700b41f0 2021-12-17T18:24:12.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd577390700 1 -- 172.21.15.62:0/1124335211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5700a4270 con 0x7fd5700b41f0 2021-12-17T18:24:12.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.462+0000 7fd562ffd700 1 -- 172.21.15.62:0/1124335211 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd564019030 con 0x7fd5700b41f0 2021-12-17T18:24:12.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.466+0000 7fd562ffd700 1 --2- 172.21.15.62:0/1124335211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd54c0536d0 0x7fd54c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:12.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.466+0000 7fd562ffd700 1 -- 172.21.15.62:0/1124335211 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd56406abe0 con 0x7fd5700b41f0 2021-12-17T18:24:12.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.466+0000 7fd57512c700 1 --2- 172.21.15.62:0/1124335211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd54c0536d0 0x7fd54c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:12.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.466+0000 7fd57512c700 1 --2- 172.21.15.62:0/1124335211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd54c0536d0 0x7fd54c055b90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fd56c00d000 tx=0x7fd56c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:12.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.470+0000 7fd562ffd700 1 -- 172.21.15.62:0/1124335211 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd564041d40 con 0x7fd5700b41f0 2021-12-17T18:24:12.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.634+0000 7fd577390700 1 -- 172.21.15.62:0/1124335211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd5700b24e0 con 0x7fd5700b41f0 2021-12-17T18:24:12.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.814+0000 7fd562ffd700 1 -- 172.21.15.62:0/1124335211 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd564007b80 con 0x7fd5700b41f0 2021-12-17T18:24:12.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.814+0000 7fd577390700 1 -- 172.21.15.62:0/1124335211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd54c0536d0 msgr2=0x7fd54c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.814+0000 7fd577390700 1 --2- 172.21.15.62:0/1124335211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd54c0536d0 0x7fd54c055b90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fd56c00d000 tx=0x7fd56c009040).stop 2021-12-17T18:24:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.818+0000 7fd577390700 1 -- 172.21.15.62:0/1124335211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5700b41f0 msgr2=0x7fd570140b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.818+0000 7fd577390700 1 --2- 172.21.15.62:0/1124335211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5700b41f0 0x7fd570140b30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7fd564001110 tx=0x7fd564007a60).stop 2021-12-17T18:24:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.818+0000 7fd577390700 1 -- 172.21.15.62:0/1124335211 shutdown_connections 2021-12-17T18:24:12.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.818+0000 7fd577390700 1 --2- 172.21.15.62:0/1124335211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd54c0536d0 0x7fd54c055b90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.818+0000 7fd577390700 1 --2- 172.21.15.62:0/1124335211 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd5700b5dd0 0x7fd570141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.818+0000 7fd577390700 1 --2- 172.21.15.62:0/1124335211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5700b41f0 0x7fd570140b30 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.818+0000 7fd577390700 1 --2- 172.21.15.62:0/1124335211 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd5700b05b0 0x7fd5700602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.818+0000 7fd577390700 1 -- 172.21.15.62:0/1124335211 >> 172.21.15.62:0/1124335211 conn(0x7fd570062510 msgr2=0x7fd5701465a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:12.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.818+0000 7fd577390700 1 -- 172.21.15.62:0/1124335211 shutdown_connections 2021-12-17T18:24:12.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.818+0000 7fd577390700 1 -- 172.21.15.62:0/1124335211 wait complete. 2021-12-17T18:24:12.837 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:24:12.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.950+0000 7f21e3bd5700 1 Processor -- start 2021-12-17T18:24:12.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.950+0000 7f21e3bd5700 1 -- start start 2021-12-17T18:24:12.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.950+0000 7f21e3bd5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f21dc0ad610 0x7f21dc0b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:12.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.950+0000 7f21e3bd5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f21dc13f470 0x7f21dc143000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:12.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.950+0000 7f21e3bd5700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21dc0ad9f0 con 0x7f21dc0b0e00 2021-12-17T18:24:12.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.950+0000 7f21e3bd5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21dc0ad010 con 0x7f21dc0ad610 2021-12-17T18:24:12.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.950+0000 7f21e3bd5700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc0b19e0 con 0x7f21dc13f470 2021-12-17T18:24:12.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.950+0000 7f21e1971700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f21dc0ad610 0x7f21dc0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:12.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.950+0000 7f21e1971700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f21dc0ad610 0x7f21dc0b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52178/0 (socket says 172.21.15.62:52178) 2021-12-17T18:24:12.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.950+0000 7f21e1971700 1 -- 172.21.15.62:0/3922179167 learned_addr learned my addr 172.21.15.62:0/3922179167 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:12.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.950+0000 7f21e2172700 1 --2- 172.21.15.62:0/3922179167 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f21dc13f470 0x7f21dc143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:12.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.950+0000 7f21e1971700 1 -- 172.21.15.62:0/3922179167 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f21dc13f470 msgr2=0x7f21dc143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:12.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.950+0000 7f21e1971700 1 --2- 172.21.15.62:0/3922179167 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f21dc13f470 0x7f21dc143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.950+0000 7f21e1971700 1 -- 172.21.15.62:0/3922179167 >> v1:172.21.15.109:6789/0 conn(0x7f21dc0b0e00 legacy=0x7f21dc13ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:12.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.950+0000 7f21e1971700 1 -- 172.21.15.62:0/3922179167 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc0b1c80 con 0x7f21dc0ad610 2021-12-17T18:24:12.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.950+0000 7f21e2172700 1 --2- 172.21.15.62:0/3922179167 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f21dc13f470 0x7f21dc143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:24:12.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.954+0000 7f21e1971700 1 --2- 172.21.15.62:0/3922179167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21dc0ad610 0x7f21dc0b2370 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f21dc0b3a30 tx=0x7f21d8006eb0).ready entity=mon.0 client_cookie=f4b66f1d179bc288 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:12.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.954+0000 7f21e096f700 1 -- 172.21.15.62:0/3922179167 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21d800d570 con 0x7f21dc0ad610 2021-12-17T18:24:12.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.954+0000 7f21e096f700 1 -- 172.21.15.62:0/3922179167 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d8000e90 con 0x7f21dc0ad610 2021-12-17T18:24:12.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.954+0000 7f21e096f700 1 -- 172.21.15.62:0/3922179167 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21d800d8c0 con 0x7f21dc0ad610 2021-12-17T18:24:12.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.954+0000 7f21e3bd5700 1 -- 172.21.15.62:0/3922179167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21dc0ad610 msgr2=0x7f21dc0b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.954+0000 7f21e3bd5700 1 --2- 172.21.15.62:0/3922179167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21dc0ad610 0x7f21dc0b2370 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f21dc0b3a30 tx=0x7f21d8006eb0).stop 2021-12-17T18:24:12.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.954+0000 7f21e3bd5700 1 -- 172.21.15.62:0/3922179167 shutdown_connections 2021-12-17T18:24:12.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.954+0000 7f21e3bd5700 1 --2- 172.21.15.62:0/3922179167 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f21dc13f470 0x7f21dc143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.954+0000 7f21e3bd5700 1 --2- 172.21.15.62:0/3922179167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21dc0ad610 0x7f21dc0b2370 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.954+0000 7f21e3bd5700 1 -- 172.21.15.62:0/3922179167 >> 172.21.15.62:0/3922179167 conn(0x7f21dc05c750 msgr2=0x7f21dc0630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:12.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.954+0000 7f21e3bd5700 1 -- 172.21.15.62:0/3922179167 shutdown_connections 2021-12-17T18:24:12.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.954+0000 7f21e3bd5700 1 -- 172.21.15.62:0/3922179167 wait complete. 2021-12-17T18:24:12.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e3bd5700 1 Processor -- start 2021-12-17T18:24:12.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e3bd5700 1 -- start start 2021-12-17T18:24:12.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e3bd5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f21dc0ad610 0x7f21dc141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:12.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e3bd5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21dc0b0e00 0x7f21dc0653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:12.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e3bd5700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f21dc13f470 0x7f21dc0658d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:12.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e3bd5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc13e5d0 con 0x7f21dc0b0e00 2021-12-17T18:24:12.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e3bd5700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc142280 con 0x7f21dc13f470 2021-12-17T18:24:12.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e3bd5700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc0ac8c0 con 0x7f21dc0ad610 2021-12-17T18:24:12.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e1170700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21dc0b0e00 0x7f21dc0653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:12.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e1170700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21dc0b0e00 0x7f21dc0653e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52186/0 (socket says 172.21.15.62:52186) 2021-12-17T18:24:12.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e1170700 1 -- 172.21.15.62:0/258596057 learned_addr learned my addr 172.21.15.62:0/258596057 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:12.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e1971700 1 --2- 172.21.15.62:0/258596057 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f21dc0ad610 0x7f21dc141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:12.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e2172700 1 --2- 172.21.15.62:0/258596057 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f21dc13f470 0x7f21dc0658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:12.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e1170700 1 -- 172.21.15.62:0/258596057 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f21dc0ad610 msgr2=0x7f21dc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e1170700 1 --2- 172.21.15.62:0/258596057 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f21dc0ad610 0x7f21dc141d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e1170700 1 -- 172.21.15.62:0/258596057 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f21dc13f470 msgr2=0x7f21dc0658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:12.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e1170700 1 --2- 172.21.15.62:0/258596057 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f21dc13f470 0x7f21dc0658d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:12.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e1170700 1 -- 172.21.15.62:0/258596057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d800b1e0 con 0x7f21dc0b0e00 2021-12-17T18:24:12.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21e1170700 1 --2- 172.21.15.62:0/258596057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21dc0b0e00 0x7f21dc0653e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f21cc001fa0 tx=0x7f21cc007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:12.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21caffd700 1 -- 172.21.15.62:0/258596057 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21cc00ce80 con 0x7f21dc0b0e00 2021-12-17T18:24:12.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.958+0000 7f21caffd700 1 -- 172.21.15.62:0/258596057 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21cc007240 con 0x7f21dc0b0e00 2021-12-17T18:24:12.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.962+0000 7f21e3bd5700 1 -- 172.21.15.62:0/258596057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21dc0b6390 con 0x7f21dc0b0e00 2021-12-17T18:24:12.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.962+0000 7f21caffd700 1 -- 172.21.15.62:0/258596057 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21cc006510 con 0x7f21dc0b0e00 2021-12-17T18:24:12.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.962+0000 7f21e3bd5700 1 -- 172.21.15.62:0/258596057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21dc0ac160 con 0x7f21dc0b0e00 2021-12-17T18:24:12.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.962+0000 7f21e3bd5700 1 -- 172.21.15.62:0/258596057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21dc0b1f20 con 0x7f21dc0b0e00 2021-12-17T18:24:12.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.962+0000 7f21caffd700 1 -- 172.21.15.62:0/258596057 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f21cc010030 con 0x7f21dc0b0e00 2021-12-17T18:24:12.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.962+0000 7f21caffd700 1 --2- 172.21.15.62:0/258596057 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f21bc0534f0 0x7f21bc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:12.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.962+0000 7f21caffd700 1 -- 172.21.15.62:0/258596057 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f21cc06b750 con 0x7f21dc0b0e00 2021-12-17T18:24:12.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.962+0000 7f21e1971700 1 --2- 172.21.15.62:0/258596057 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f21bc0534f0 0x7f21bc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:12.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.966+0000 7f21e1971700 1 --2- 172.21.15.62:0/258596057 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f21bc0534f0 0x7f21bc0559b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f21d801a000 tx=0x7f21d8015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:12.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:12.970+0000 7f21caffd700 1 -- 172.21.15.62:0/258596057 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f21cc042810 con 0x7f21dc0b0e00 2021-12-17T18:24:13.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.138+0000 7f21e3bd5700 1 -- 172.21.15.62:0/258596057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21dc0573d0 con 0x7f21dc0b0e00 2021-12-17T18:24:13.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.138+0000 7f21caffd700 1 -- 172.21.15.62:0/258596057 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f21cc045e30 con 0x7f21dc0b0e00 2021-12-17T18:24:13.140 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:13.141 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":32,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5672,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/2267359903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":2267359903},{"type":"v1","addr":"172.21.15.109:6835","nonce":2267359903}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:24:11.805782+0000","modified":"2021-12-17T18:24:12.808883+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6318":{"gid":6318,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/414220193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":414220193},{"type":"v1","addr":"172.21.15.62:6833","nonce":414220193}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-12-17T18:24:13.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.138+0000 7f21e3bd5700 1 -- 172.21.15.62:0/258596057 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f21bc0534f0 msgr2=0x7f21bc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.138+0000 7f21e3bd5700 1 --2- 172.21.15.62:0/258596057 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f21bc0534f0 0x7f21bc0559b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f21d801a000 tx=0x7f21d8015000).stop 2021-12-17T18:24:13.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.138+0000 7f21e3bd5700 1 -- 172.21.15.62:0/258596057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21dc0b0e00 msgr2=0x7f21dc0653e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.138+0000 7f21e3bd5700 1 --2- 172.21.15.62:0/258596057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21dc0b0e00 0x7f21dc0653e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f21cc001fa0 tx=0x7f21cc007c30).stop 2021-12-17T18:24:13.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.138+0000 7f21e3bd5700 1 -- 172.21.15.62:0/258596057 shutdown_connections 2021-12-17T18:24:13.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.138+0000 7f21e3bd5700 1 --2- 172.21.15.62:0/258596057 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f21bc0534f0 0x7f21bc0559b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.138+0000 7f21e3bd5700 1 --2- 172.21.15.62:0/258596057 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f21dc13f470 0x7f21dc0658d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.138+0000 7f21e3bd5700 1 --2- 172.21.15.62:0/258596057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21dc0b0e00 0x7f21dc0653e0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.138+0000 7f21e3bd5700 1 --2- 172.21.15.62:0/258596057 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f21dc0ad610 0x7f21dc141d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.138+0000 7f21e3bd5700 1 -- 172.21.15.62:0/258596057 >> 172.21.15.62:0/258596057 conn(0x7f21dc05c750 msgr2=0x7f21dc0aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:13.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.138+0000 7f21e3bd5700 1 -- 172.21.15.62:0/258596057 shutdown_connections 2021-12-17T18:24:13.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.138+0000 7f21e3bd5700 1 -- 172.21.15.62:0/258596057 wait complete. 2021-12-17T18:24:13.147 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 32 2021-12-17T18:24:13.154 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:24:13.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.258+0000 7fb942bdf700 1 Processor -- start 2021-12-17T18:24:13.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.258+0000 7fb942bdf700 1 -- start start 2021-12-17T18:24:13.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.258+0000 7fb942bdf700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb93c0b0690 0x7fb93c1438c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.258+0000 7fb942bdf700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fb93c143db0 0x7fb93c13cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.258+0000 7fb942bdf700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c0b2570 con 0x7fb93c067830 2021-12-17T18:24:13.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.258+0000 7fb942bdf700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93c067c10 con 0x7fb93c0b0690 2021-12-17T18:24:13.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.258+0000 7fb942bdf700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93c147520 con 0x7fb93c143db0 2021-12-17T18:24:13.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.258+0000 7fb941bdd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb93c067830 0x7fb93c0b1360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35772/0 (socket says 172.21.15.62:35772) 2021-12-17T18:24:13.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.258+0000 7fb941bdd700 1 -- 172.21.15.62:0/2237350476 learned_addr learned my addr 172.21.15.62:0/2237350476 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:13.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.258+0000 7fb9413dc700 1 --2- 172.21.15.62:0/2237350476 >> v2:172.21.15.62:3300/0 conn(0x7fb93c0b0690 0x7fb93c1438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.258+0000 7fb9423de700 1 --2- 172.21.15.62:0/2237350476 >> v2:172.21.15.109:3300/0 conn(0x7fb93c143db0 0x7fb93c13cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.258+0000 7fb940bdb700 1 -- 172.21.15.62:0/2237350476 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730206482 0 0) 0x7fb93c0b2570 con 0x7fb93c067830 2021-12-17T18:24:13.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.258+0000 7fb940bdb700 1 -- 172.21.15.62:0/2237350476 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb924003260 con 0x7fb93c067830 2021-12-17T18:24:13.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb9413dc700 1 -- 172.21.15.62:0/2237350476 >> v2:172.21.15.109:3300/0 conn(0x7fb93c143db0 msgr2=0x7fb93c13cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:13.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb9413dc700 1 --2- 172.21.15.62:0/2237350476 >> v2:172.21.15.109:3300/0 conn(0x7fb93c143db0 0x7fb93c13cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb9413dc700 1 -- 172.21.15.62:0/2237350476 >> v1:172.21.15.62:6789/0 conn(0x7fb93c067830 legacy=0x7fb93c0b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb9413dc700 1 -- 172.21.15.62:0/2237350476 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c143420 con 0x7fb93c0b0690 2021-12-17T18:24:13.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb9413dc700 1 --2- 172.21.15.62:0/2237350476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb93c0b0690 0x7fb93c1438c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7fb92c002f70 tx=0x7fb92c006df0).ready entity=mon.0 client_cookie=20619cb14f6682ad server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:13.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb940bdb700 1 -- 172.21.15.62:0/2237350476 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb92c00d4f0 con 0x7fb93c0b0690 2021-12-17T18:24:13.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb940bdb700 1 -- 172.21.15.62:0/2237350476 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c000e90 con 0x7fb93c0b0690 2021-12-17T18:24:13.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb940bdb700 1 -- 172.21.15.62:0/2237350476 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb92c00d840 con 0x7fb93c0b0690 2021-12-17T18:24:13.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb942bdf700 1 -- 172.21.15.62:0/2237350476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb93c0b0690 msgr2=0x7fb93c1438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb942bdf700 1 --2- 172.21.15.62:0/2237350476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb93c0b0690 0x7fb93c1438c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7fb92c002f70 tx=0x7fb92c006df0).stop 2021-12-17T18:24:13.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb942bdf700 1 -- 172.21.15.62:0/2237350476 shutdown_connections 2021-12-17T18:24:13.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb942bdf700 1 --2- 172.21.15.62:0/2237350476 >> v2:172.21.15.109:3300/0 conn(0x7fb93c143db0 0x7fb93c13cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb942bdf700 1 --2- 172.21.15.62:0/2237350476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb93c0b0690 0x7fb93c1438c0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb942bdf700 1 -- 172.21.15.62:0/2237350476 >> 172.21.15.62:0/2237350476 conn(0x7fb93c05c750 msgr2=0x7fb93c05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:13.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb942bdf700 1 -- 172.21.15.62:0/2237350476 shutdown_connections 2021-12-17T18:24:13.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb942bdf700 1 -- 172.21.15.62:0/2237350476 wait complete. 2021-12-17T18:24:13.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb942bdf700 1 Processor -- start 2021-12-17T18:24:13.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb942bdf700 1 -- start start 2021-12-17T18:24:13.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb942bdf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb93c067830 0x7fb93c140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb942bdf700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb93c0b0690 0x7fb93c0abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb942bdf700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb93c143db0 0x7fb93c0ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb942bdf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c141430 con 0x7fb93c067830 2021-12-17T18:24:13.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb942bdf700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c13f180 con 0x7fb93c143db0 2021-12-17T18:24:13.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb942bdf700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c13ec30 con 0x7fb93c0b0690 2021-12-17T18:24:13.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb941bdd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb93c067830 0x7fb93c140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb941bdd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb93c067830 0x7fb93c140730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52198/0 (socket says 172.21.15.62:52198) 2021-12-17T18:24:13.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb941bdd700 1 -- 172.21.15.62:0/426168464 learned_addr learned my addr 172.21.15.62:0/426168464 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:13.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb9413dc700 1 --2- 172.21.15.62:0/426168464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb93c0b0690 0x7fb93c0abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb9423de700 1 --2- 172.21.15.62:0/426168464 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb93c143db0 0x7fb93c0ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb941bdd700 1 -- 172.21.15.62:0/426168464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb93c0b0690 msgr2=0x7fb93c0abee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb941bdd700 1 --2- 172.21.15.62:0/426168464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb93c0b0690 0x7fb93c0abee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb941bdd700 1 -- 172.21.15.62:0/426168464 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb93c143db0 msgr2=0x7fb93c0ac3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb941bdd700 1 --2- 172.21.15.62:0/426168464 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb93c143db0 0x7fb93c0ac3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb941bdd700 1 -- 172.21.15.62:0/426168464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92c00b180 con 0x7fb93c067830 2021-12-17T18:24:13.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb9413dc700 1 --2- 172.21.15.62:0/426168464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb93c0b0690 0x7fb93c0abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:24:13.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.262+0000 7fb941bdd700 1 --2- 172.21.15.62:0/426168464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb93c067830 0x7fb93c140730 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fb938001110 tx=0x7fb938007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:13.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.266+0000 7fb92affd700 1 -- 172.21.15.62:0/426168464 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9380072e0 con 0x7fb93c067830 2021-12-17T18:24:13.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.266+0000 7fb92affd700 1 -- 172.21.15.62:0/426168464 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb938007440 con 0x7fb93c067830 2021-12-17T18:24:13.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.266+0000 7fb942bdf700 1 -- 172.21.15.62:0/426168464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93c13fc90 con 0x7fb93c067830 2021-12-17T18:24:13.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.266+0000 7fb92affd700 1 -- 172.21.15.62:0/426168464 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb938005800 con 0x7fb93c067830 2021-12-17T18:24:13.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.266+0000 7fb942bdf700 1 -- 172.21.15.62:0/426168464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93c140130 con 0x7fb93c067830 2021-12-17T18:24:13.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.266+0000 7fb942bdf700 1 -- 172.21.15.62:0/426168464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93c13e930 con 0x7fb93c067830 2021-12-17T18:24:13.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.266+0000 7fb92affd700 1 -- 172.21.15.62:0/426168464 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb938010070 con 0x7fb93c067830 2021-12-17T18:24:13.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.266+0000 7fb92affd700 1 --2- 172.21.15.62:0/426168464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb91c053610 0x7fb91c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.266+0000 7fb92affd700 1 -- 172.21.15.62:0/426168464 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb93806b010 con 0x7fb93c067830 2021-12-17T18:24:13.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.266+0000 7fb9413dc700 1 --2- 172.21.15.62:0/426168464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb91c053610 0x7fb91c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.266+0000 7fb9413dc700 1 --2- 172.21.15.62:0/426168464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb91c053610 0x7fb91c055ad0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fb92c018000 tx=0x7fb92c014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:13.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.274+0000 7fb92affd700 1 -- 172.21.15.62:0/426168464 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb938042170 con 0x7fb93c067830 2021-12-17T18:24:13.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.398+0000 7fb942bdf700 1 -- 172.21.15.62:0/426168464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb93c13edf0 con 0x7fb93c067830 2021-12-17T18:24:13.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.398+0000 7fb92affd700 1 -- 172.21.15.62:0/426168464 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fb93804cef0 con 0x7fb93c067830 2021-12-17T18:24:13.403 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:13.403 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":71,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:24:12.809524+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:24:10.413185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-12-17T18:24:11.229328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:24:13.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.402+0000 7fb942bdf700 1 -- 172.21.15.62:0/426168464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb91c053610 msgr2=0x7fb91c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.402+0000 7fb942bdf700 1 --2- 172.21.15.62:0/426168464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb91c053610 0x7fb91c055ad0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fb92c018000 tx=0x7fb92c014000).stop 2021-12-17T18:24:13.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.402+0000 7fb942bdf700 1 -- 172.21.15.62:0/426168464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb93c067830 msgr2=0x7fb93c140730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.402+0000 7fb942bdf700 1 --2- 172.21.15.62:0/426168464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb93c067830 0x7fb93c140730 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fb938001110 tx=0x7fb938007ad0).stop 2021-12-17T18:24:13.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.402+0000 7fb942bdf700 1 -- 172.21.15.62:0/426168464 shutdown_connections 2021-12-17T18:24:13.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.402+0000 7fb942bdf700 1 --2- 172.21.15.62:0/426168464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb91c053610 0x7fb91c055ad0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.402+0000 7fb942bdf700 1 --2- 172.21.15.62:0/426168464 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb93c143db0 0x7fb93c0ac3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.402+0000 7fb942bdf700 1 --2- 172.21.15.62:0/426168464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb93c0b0690 0x7fb93c0abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.402+0000 7fb942bdf700 1 --2- 172.21.15.62:0/426168464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb93c067830 0x7fb93c140730 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.402+0000 7fb942bdf700 1 -- 172.21.15.62:0/426168464 >> 172.21.15.62:0/426168464 conn(0x7fb93c05c750 msgr2=0x7fb93c0af870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:13.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.402+0000 7fb942bdf700 1 -- 172.21.15.62:0/426168464 shutdown_connections 2021-12-17T18:24:13.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.402+0000 7fb942bdf700 1 -- 172.21.15.62:0/426168464 wait complete. 2021-12-17T18:24:13.416 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:24:13.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.526+0000 7f99409e8700 1 Processor -- start 2021-12-17T18:24:13.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.526+0000 7f99409e8700 1 -- start start 2021-12-17T18:24:13.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.526+0000 7f99409e8700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f993c05fa70 0x7f993c142c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.526+0000 7f99409e8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f993c0ad130 0x7f993c143120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.526+0000 7f99409e8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993c0b6600 con 0x7f993c143610 2021-12-17T18:24:13.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.526+0000 7f99409e8700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f993c0adba0 con 0x7f993c05fa70 2021-12-17T18:24:13.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.526+0000 7f99409e8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993c143aa0 con 0x7f993c0ad130 2021-12-17T18:24:13.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.526+0000 7f993b59e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f993c143610 0x7f993c13ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35788/0 (socket says 172.21.15.62:35788) 2021-12-17T18:24:13.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.526+0000 7f993b59e700 1 -- 172.21.15.62:0/2084641970 learned_addr learned my addr 172.21.15.62:0/2084641970 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:13.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.526+0000 7f993ad9d700 1 --2- 172.21.15.62:0/2084641970 >> v2:172.21.15.109:3300/0 conn(0x7f993c05fa70 0x7f993c142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.526+0000 7f993a59c700 1 --2- 172.21.15.62:0/2084641970 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f993c0ad130 0x7f993c143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.526+0000 7f9939d9b700 1 -- 172.21.15.62:0/2084641970 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848028187 0 0) 0x7f993c0b6600 con 0x7f993c143610 2021-12-17T18:24:13.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.526+0000 7f9939d9b700 1 -- 172.21.15.62:0/2084641970 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9920003260 con 0x7f993c143610 2021-12-17T18:24:13.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.526+0000 7f993ad9d700 1 -- 172.21.15.62:0/2084641970 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f993c0ad130 msgr2=0x7f993c143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:13.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.526+0000 7f993ad9d700 1 --2- 172.21.15.62:0/2084641970 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f993c0ad130 0x7f993c143120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.526+0000 7f993ad9d700 1 -- 172.21.15.62:0/2084641970 >> v1:172.21.15.62:6789/0 conn(0x7f993c143610 legacy=0x7f993c13ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.526+0000 7f993ad9d700 1 -- 172.21.15.62:0/2084641970 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c05fe50 con 0x7f993c05fa70 2021-12-17T18:24:13.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.530+0000 7f993ad9d700 1 --2- 172.21.15.62:0/2084641970 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f993c05fa70 0x7f993c142c30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f992c0032f0 tx=0x7f992c0091d0).ready entity=mon.1 client_cookie=bf33b82b3c345064 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:13.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.530+0000 7f9939d9b700 1 -- 172.21.15.62:0/2084641970 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f992c00b600 con 0x7f993c05fa70 2021-12-17T18:24:13.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.530+0000 7f9939d9b700 1 -- 172.21.15.62:0/2084641970 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c00b760 con 0x7f993c05fa70 2021-12-17T18:24:13.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.530+0000 7f9939d9b700 1 -- 172.21.15.62:0/2084641970 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f992c00b8d0 con 0x7f993c05fa70 2021-12-17T18:24:13.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.530+0000 7f99409e8700 1 -- 172.21.15.62:0/2084641970 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f993c05fa70 msgr2=0x7f993c142c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.530+0000 7f99409e8700 1 --2- 172.21.15.62:0/2084641970 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f993c05fa70 0x7f993c142c30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f992c0032f0 tx=0x7f992c0091d0).stop 2021-12-17T18:24:13.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.530+0000 7f99409e8700 1 -- 172.21.15.62:0/2084641970 shutdown_connections 2021-12-17T18:24:13.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.530+0000 7f99409e8700 1 --2- 172.21.15.62:0/2084641970 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f993c0ad130 0x7f993c143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.530+0000 7f99409e8700 1 --2- 172.21.15.62:0/2084641970 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f993c05fa70 0x7f993c142c30 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.530+0000 7f99409e8700 1 -- 172.21.15.62:0/2084641970 >> 172.21.15.62:0/2084641970 conn(0x7f993c0b5ae0 msgr2=0x7f993c0b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:13.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.530+0000 7f99409e8700 1 -- 172.21.15.62:0/2084641970 shutdown_connections 2021-12-17T18:24:13.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.530+0000 7f99409e8700 1 -- 172.21.15.62:0/2084641970 wait complete. 2021-12-17T18:24:13.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.530+0000 7f99409e8700 1 Processor -- start 2021-12-17T18:24:13.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.530+0000 7f99409e8700 1 -- start start 2021-12-17T18:24:13.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.530+0000 7f99409e8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f993c05fa70 0x7f993c1463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f99409e8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f993c0ad130 0x7f993c13d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f99409e8700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f993c143610 0x7f993c144400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f99409e8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c147410 con 0x7f993c0ad130 2021-12-17T18:24:13.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f99409e8700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c143d30 con 0x7f993c143610 2021-12-17T18:24:13.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f99409e8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993c146890 con 0x7f993c05fa70 2021-12-17T18:24:13.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f993a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f993c0ad130 0x7f993c13d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f993a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f993c0ad130 0x7f993c13d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52214/0 (socket says 172.21.15.62:52214) 2021-12-17T18:24:13.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f993a59c700 1 -- 172.21.15.62:0/244601698 learned_addr learned my addr 172.21.15.62:0/244601698 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:13.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f993ad9d700 1 --2- 172.21.15.62:0/244601698 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f993c05fa70 0x7f993c1463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f993b59e700 1 --2- 172.21.15.62:0/244601698 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f993c143610 0x7f993c144400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f993a59c700 1 -- 172.21.15.62:0/244601698 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f993c05fa70 msgr2=0x7f993c1463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f993a59c700 1 --2- 172.21.15.62:0/244601698 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f993c05fa70 0x7f993c1463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f993a59c700 1 -- 172.21.15.62:0/244601698 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f993c143610 msgr2=0x7f993c144400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f993a59c700 1 --2- 172.21.15.62:0/244601698 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f993c143610 0x7f993c144400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f993a59c700 1 -- 172.21.15.62:0/244601698 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c009470 con 0x7f993c0ad130 2021-12-17T18:24:13.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f993b59e700 1 --2- 172.21.15.62:0/244601698 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f993c143610 0x7f993c144400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:24:13.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f993a59c700 1 --2- 172.21.15.62:0/244601698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f993c0ad130 0x7f993c13d390 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f993000c000 tx=0x7f9930006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:13.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f992bfff700 1 -- 172.21.15.62:0/244601698 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9930010780 con 0x7f993c0ad130 2021-12-17T18:24:13.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f992bfff700 1 -- 172.21.15.62:0/244601698 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99300108e0 con 0x7f993c0ad130 2021-12-17T18:24:13.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f99409e8700 1 -- 172.21.15.62:0/244601698 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993c065200 con 0x7f993c0ad130 2021-12-17T18:24:13.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f992bfff700 1 -- 172.21.15.62:0/244601698 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9930010c40 con 0x7f993c0ad130 2021-12-17T18:24:13.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f99409e8700 1 -- 172.21.15.62:0/244601698 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993c13d880 con 0x7f993c0ad130 2021-12-17T18:24:13.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f99409e8700 1 -- 172.21.15.62:0/244601698 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f993c0b6830 con 0x7f993c0ad130 2021-12-17T18:24:13.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.534+0000 7f992bfff700 1 -- 172.21.15.62:0/244601698 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f993001c460 con 0x7f993c0ad130 2021-12-17T18:24:13.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.538+0000 7f992bfff700 1 --2- 172.21.15.62:0/244601698 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f99180536a0 0x7f9918055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.538+0000 7f992bfff700 1 -- 172.21.15.62:0/244601698 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f993006bef0 con 0x7f993c0ad130 2021-12-17T18:24:13.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.538+0000 7f993ad9d700 1 --2- 172.21.15.62:0/244601698 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f99180536a0 0x7f9918055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.538+0000 7f993ad9d700 1 --2- 172.21.15.62:0/244601698 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f99180536a0 0x7f9918055b60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f992c019000 tx=0x7f992c016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:13.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.542+0000 7f992bfff700 1 -- 172.21.15.62:0/244601698 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9930042ee0 con 0x7f993c0ad130 2021-12-17T18:24:13.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.710+0000 7f99409e8700 1 -- 172.21.15.62:0/244601698 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f993c0573d0 con 0x7f993c0ad130 2021-12-17T18:24:13.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.718+0000 7f992bfff700 1 -- 172.21.15.62:0/244601698 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v23) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9930046500 con 0x7f993c0ad130 2021-12-17T18:24:13.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.718+0000 7f99409e8700 1 -- 172.21.15.62:0/244601698 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f99180536a0 msgr2=0x7f9918055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.718+0000 7f99409e8700 1 --2- 172.21.15.62:0/244601698 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f99180536a0 0x7f9918055b60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f992c019000 tx=0x7f992c016000).stop 2021-12-17T18:24:13.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.718+0000 7f99409e8700 1 -- 172.21.15.62:0/244601698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f993c0ad130 msgr2=0x7f993c13d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.718+0000 7f99409e8700 1 --2- 172.21.15.62:0/244601698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f993c0ad130 0x7f993c13d390 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f993000c000 tx=0x7f9930006df0).stop 2021-12-17T18:24:13.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.718+0000 7f99409e8700 1 -- 172.21.15.62:0/244601698 shutdown_connections 2021-12-17T18:24:13.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.718+0000 7f99409e8700 1 --2- 172.21.15.62:0/244601698 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f99180536a0 0x7f9918055b60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.718+0000 7f99409e8700 1 --2- 172.21.15.62:0/244601698 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f993c143610 0x7f993c144400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.718+0000 7f99409e8700 1 --2- 172.21.15.62:0/244601698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f993c0ad130 0x7f993c13d390 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.718+0000 7f99409e8700 1 --2- 172.21.15.62:0/244601698 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f993c05fa70 0x7f993c1463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.718+0000 7f99409e8700 1 -- 172.21.15.62:0/244601698 >> 172.21.15.62:0/244601698 conn(0x7f993c0b5ae0 msgr2=0x7f993c05bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:13.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.718+0000 7f99409e8700 1 -- 172.21.15.62:0/244601698 shutdown_connections 2021-12-17T18:24:13.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.722+0000 7f99409e8700 1 -- 172.21.15.62:0/244601698 wait complete. 2021-12-17T18:24:13.726 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.0 2021-12-17T18:24:13.735 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:24:13.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1d59700 1 Processor -- start 2021-12-17T18:24:13.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1d59700 1 -- start start 2021-12-17T18:24:13.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1d59700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8dc05ca90 0x7fb8dc0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1d59700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8dc0604b0 0x7fb8dc146230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1d59700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8dc05ce70 con 0x7fb8dc0b34b0 2021-12-17T18:24:13.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1d59700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8dc0b2d70 con 0x7fb8dc0604b0 2021-12-17T18:24:13.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1d59700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0b3010 con 0x7fb8dc05ca90 2021-12-17T18:24:13.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1558700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8dc0604b0 0x7fb8dc146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1558700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8dc0604b0 0x7fb8dc146230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52224/0 (socket says 172.21.15.62:52224) 2021-12-17T18:24:13.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1558700 1 -- 172.21.15.62:0/2175395688 learned_addr learned my addr 172.21.15.62:0/2175395688 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:13.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e0d57700 1 --2- 172.21.15.62:0/2175395688 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8dc05ca90 0x7fb8dc0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1558700 1 -- 172.21.15.62:0/2175395688 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8dc05ca90 msgr2=0x7fb8dc0b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:13.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1558700 1 --2- 172.21.15.62:0/2175395688 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8dc05ca90 0x7fb8dc0b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1558700 1 -- 172.21.15.62:0/2175395688 >> v1:172.21.15.62:6789/0 conn(0x7fb8dc0b34b0 legacy=0x7fb8dc145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1558700 1 -- 172.21.15.62:0/2175395688 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc0b2ab0 con 0x7fb8dc0604b0 2021-12-17T18:24:13.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1558700 1 --2- 172.21.15.62:0/2175395688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc0604b0 0x7fb8dc146230 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fb8d40032f0 tx=0x7fb8d4009290).ready entity=mon.0 client_cookie=3f780e5c480e40a4 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:13.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8d37fe700 1 -- 172.21.15.62:0/2175395688 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8d400b8a0 con 0x7fb8dc0604b0 2021-12-17T18:24:13.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8d37fe700 1 -- 172.21.15.62:0/2175395688 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d400ba00 con 0x7fb8dc0604b0 2021-12-17T18:24:13.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8d37fe700 1 -- 172.21.15.62:0/2175395688 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8d400bb70 con 0x7fb8dc0604b0 2021-12-17T18:24:13.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1d59700 1 -- 172.21.15.62:0/2175395688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc0604b0 msgr2=0x7fb8dc146230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1d59700 1 --2- 172.21.15.62:0/2175395688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc0604b0 0x7fb8dc146230 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fb8d40032f0 tx=0x7fb8d4009290).stop 2021-12-17T18:24:13.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1d59700 1 -- 172.21.15.62:0/2175395688 shutdown_connections 2021-12-17T18:24:13.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1d59700 1 --2- 172.21.15.62:0/2175395688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc0604b0 0x7fb8dc146230 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1d59700 1 --2- 172.21.15.62:0/2175395688 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8dc05ca90 0x7fb8dc0b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1d59700 1 -- 172.21.15.62:0/2175395688 >> 172.21.15.62:0/2175395688 conn(0x7fb8dc05bcd0 msgr2=0x7fb8dc062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:13.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.850+0000 7fb8e1d59700 1 -- 172.21.15.62:0/2175395688 shutdown_connections 2021-12-17T18:24:13.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.854+0000 7fb8e1d59700 1 -- 172.21.15.62:0/2175395688 wait complete. 2021-12-17T18:24:13.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.854+0000 7fb8e1d59700 1 Processor -- start 2021-12-17T18:24:13.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.854+0000 7fb8e1d59700 1 -- start start 2021-12-17T18:24:13.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8e1d59700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8dc05ca90 0x7fb8dc0665b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8e1d59700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc0604b0 0x7fb8dc1523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8e1d59700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8dc0b34b0 0x7fb8dc1424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8e1d59700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc1528d0 con 0x7fb8dc0604b0 2021-12-17T18:24:13.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8e1d59700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc152ad0 con 0x7fb8dc0b34b0 2021-12-17T18:24:13.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8e1d59700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc152d70 con 0x7fb8dc05ca90 2021-12-17T18:24:13.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8d3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc0604b0 0x7fb8dc1523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8d3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc0604b0 0x7fb8dc1523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52228/0 (socket says 172.21.15.62:52228) 2021-12-17T18:24:13.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8d3fff700 1 -- 172.21.15.62:0/331682009 learned_addr learned my addr 172.21.15.62:0/331682009 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:13.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8e0d57700 1 --2- 172.21.15.62:0/331682009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8dc05ca90 0x7fb8dc0665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8e1558700 1 --2- 172.21.15.62:0/331682009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8dc0b34b0 0x7fb8dc1424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8d3fff700 1 -- 172.21.15.62:0/331682009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8dc05ca90 msgr2=0x7fb8dc0665b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8d3fff700 1 --2- 172.21.15.62:0/331682009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8dc05ca90 0x7fb8dc0665b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8d3fff700 1 -- 172.21.15.62:0/331682009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8dc0b34b0 msgr2=0x7fb8dc1424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:13.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8d3fff700 1 --2- 172.21.15.62:0/331682009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8dc0b34b0 0x7fb8dc1424d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:13.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8d3fff700 1 -- 172.21.15.62:0/331682009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d4009530 con 0x7fb8dc0604b0 2021-12-17T18:24:13.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8d3fff700 1 --2- 172.21.15.62:0/331682009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc0604b0 0x7fb8dc1523e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fb8dc05d2a0 tx=0x7fb8cc007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:13.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8d1ffb700 1 -- 172.21.15.62:0/331682009 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8cc00ce30 con 0x7fb8dc0604b0 2021-12-17T18:24:13.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8d1ffb700 1 -- 172.21.15.62:0/331682009 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc012400 con 0x7fb8dc0604b0 2021-12-17T18:24:13.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8e1d59700 1 -- 172.21.15.62:0/331682009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8dc153010 con 0x7fb8dc0604b0 2021-12-17T18:24:13.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8d1ffb700 1 -- 172.21.15.62:0/331682009 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8cc012760 con 0x7fb8dc0604b0 2021-12-17T18:24:13.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8e1d59700 1 -- 172.21.15.62:0/331682009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8dc0a5710 con 0x7fb8dc0604b0 2021-12-17T18:24:13.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8e1d59700 1 -- 172.21.15.62:0/331682009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8dc1531a0 con 0x7fb8dc0604b0 2021-12-17T18:24:13.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.858+0000 7fb8d1ffb700 1 -- 172.21.15.62:0/331682009 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb8cc019030 con 0x7fb8dc0604b0 2021-12-17T18:24:13.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.862+0000 7fb8d1ffb700 1 --2- 172.21.15.62:0/331682009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8bc0536a0 0x7fb8bc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:13.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.862+0000 7fb8d1ffb700 1 -- 172.21.15.62:0/331682009 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb8cc06ae10 con 0x7fb8dc0604b0 2021-12-17T18:24:13.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.862+0000 7fb8e0d57700 1 --2- 172.21.15.62:0/331682009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8bc0536a0 0x7fb8bc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:13.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.862+0000 7fb8e0d57700 1 --2- 172.21.15.62:0/331682009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8bc0536a0 0x7fb8bc055b60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fb8d800c000 tx=0x7fb8d8008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:13.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:13.866+0000 7fb8d1ffb700 1 -- 172.21.15.62:0/331682009 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb8cc06e030 con 0x7fb8dc0604b0 2021-12-17T18:24:14.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.034+0000 7fb8e1d59700 1 -- 172.21.15.62:0/331682009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fb8dc0b4500 con 0x7fb8dc0604b0 2021-12-17T18:24:14.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.042+0000 7fb8d1ffb700 1 -- 172.21.15.62:0/331682009 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v24) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb8cc041e60 con 0x7fb8dc0604b0 2021-12-17T18:24:14.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.046+0000 7fb8e1d59700 1 -- 172.21.15.62:0/331682009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8bc0536a0 msgr2=0x7fb8bc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:14.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.046+0000 7fb8e1d59700 1 --2- 172.21.15.62:0/331682009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8bc0536a0 0x7fb8bc055b60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fb8d800c000 tx=0x7fb8d8008040).stop 2021-12-17T18:24:14.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.046+0000 7fb8e1d59700 1 -- 172.21.15.62:0/331682009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc0604b0 msgr2=0x7fb8dc1523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:14.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.046+0000 7fb8e1d59700 1 --2- 172.21.15.62:0/331682009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc0604b0 0x7fb8dc1523e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fb8dc05d2a0 tx=0x7fb8cc007c20).stop 2021-12-17T18:24:14.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.046+0000 7fb8e1d59700 1 -- 172.21.15.62:0/331682009 shutdown_connections 2021-12-17T18:24:14.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.046+0000 7fb8e1d59700 1 --2- 172.21.15.62:0/331682009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8bc0536a0 0x7fb8bc055b60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.046+0000 7fb8e1d59700 1 --2- 172.21.15.62:0/331682009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb8dc0b34b0 0x7fb8dc1424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.046+0000 7fb8e1d59700 1 --2- 172.21.15.62:0/331682009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc0604b0 0x7fb8dc1523e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.046+0000 7fb8e1d59700 1 --2- 172.21.15.62:0/331682009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb8dc05ca90 0x7fb8dc0665b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.046+0000 7fb8e1d59700 1 -- 172.21.15.62:0/331682009 >> 172.21.15.62:0/331682009 conn(0x7fb8dc05bcd0 msgr2=0x7fb8dc1469a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:14.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.046+0000 7fb8e1d59700 1 -- 172.21.15.62:0/331682009 shutdown_connections 2021-12-17T18:24:14.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.046+0000 7fb8e1d59700 1 -- 172.21.15.62:0/331682009 wait complete. 2021-12-17T18:24:14.053 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.1 2021-12-17T18:24:14.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:24:14.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.174+0000 7fbe0ffff700 1 Processor -- start 2021-12-17T18:24:14.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.174+0000 7fbe0ffff700 1 -- start start 2021-12-17T18:24:14.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.174+0000 7fbe0ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbe1005fa70 0x7fbe10061390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:14.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.174+0000 7fbe0ffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1005fe50 con 0x7fbe101405f0 2021-12-17T18:24:14.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.174+0000 7fbe0ffff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe100646a0 con 0x7fbe10064de0 2021-12-17T18:24:14.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.174+0000 7fbe0ffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe10064940 con 0x7fbe1005fa70 2021-12-17T18:24:14.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.174+0000 7fbe0effd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbe1005fa70 0x7fbe10061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:14.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.174+0000 7fbe0f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbe101405f0 0x7fbe10142e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35818/0 (socket says 172.21.15.62:35818) 2021-12-17T18:24:14.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.174+0000 7fbe0f7fe700 1 -- 172.21.15.62:0/815829806 learned_addr learned my addr 172.21.15.62:0/815829806 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:14.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.174+0000 7fbe0dffb700 1 -- 172.21.15.62:0/815829806 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510123497 0 0) 0x7fbe1005fe50 con 0x7fbe101405f0 2021-12-17T18:24:14.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.174+0000 7fbe0dffb700 1 -- 172.21.15.62:0/815829806 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf0003260 con 0x7fbe101405f0 2021-12-17T18:24:14.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.174+0000 7fbe0effd700 1 -- 172.21.15.62:0/815829806 >> v1:172.21.15.109:6789/0 conn(0x7fbe10064de0 legacy=0x7fbe1013fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:14.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.174+0000 7fbe0effd700 1 -- 172.21.15.62:0/815829806 >> v1:172.21.15.62:6789/0 conn(0x7fbe101405f0 legacy=0x7fbe10142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:14.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.174+0000 7fbe0effd700 1 -- 172.21.15.62:0/815829806 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe10062450 con 0x7fbe1005fa70 2021-12-17T18:24:14.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.178+0000 7fbe0effd700 1 --2- 172.21.15.62:0/815829806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe1005fa70 0x7fbe10061390 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fbdf8002f70 tx=0x7fbdf8006df0).ready entity=mon.0 client_cookie=147f48e78f19e018 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:14.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.178+0000 7fbe0dffb700 1 -- 172.21.15.62:0/815829806 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf800d610 con 0x7fbe1005fa70 2021-12-17T18:24:14.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.178+0000 7fbe0dffb700 1 -- 172.21.15.62:0/815829806 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf8000e90 con 0x7fbe1005fa70 2021-12-17T18:24:14.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.178+0000 7fbe0dffb700 1 -- 172.21.15.62:0/815829806 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf800d960 con 0x7fbe1005fa70 2021-12-17T18:24:14.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.178+0000 7fbe0ffff700 1 -- 172.21.15.62:0/815829806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe1005fa70 msgr2=0x7fbe10061390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:14.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.178+0000 7fbe0ffff700 1 --2- 172.21.15.62:0/815829806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe1005fa70 0x7fbe10061390 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fbdf8002f70 tx=0x7fbdf8006df0).stop 2021-12-17T18:24:14.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.178+0000 7fbe0ffff700 1 -- 172.21.15.62:0/815829806 shutdown_connections 2021-12-17T18:24:14.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.178+0000 7fbe0ffff700 1 --2- 172.21.15.62:0/815829806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe1005fa70 0x7fbe10061390 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.178+0000 7fbe0ffff700 1 -- 172.21.15.62:0/815829806 >> 172.21.15.62:0/815829806 conn(0x7fbe1005bcd0 msgr2=0x7fbe10063510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:14.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.178+0000 7fbe0ffff700 1 -- 172.21.15.62:0/815829806 shutdown_connections 2021-12-17T18:24:14.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.178+0000 7fbe0ffff700 1 -- 172.21.15.62:0/815829806 wait complete. 2021-12-17T18:24:14.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.178+0000 7fbe0ffff700 1 Processor -- start 2021-12-17T18:24:14.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.178+0000 7fbe0ffff700 1 -- start start 2021-12-17T18:24:14.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbe1005fa70 0x7fbe100addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:14.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0ffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbe10064de0 0x7fbe100af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:14.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe101405f0 0x7fbe100b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:14.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe10141b00 con 0x7fbe101405f0 2021-12-17T18:24:14.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0ffff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe10152710 con 0x7fbe10064de0 2021-12-17T18:24:14.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0ffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100af670 con 0x7fbe1005fa70 2021-12-17T18:24:14.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe101405f0 0x7fbe100b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:14.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe101405f0 0x7fbe100b0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52242/0 (socket says 172.21.15.62:52242) 2021-12-17T18:24:14.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0f7fe700 1 -- 172.21.15.62:0/1090983245 learned_addr learned my addr 172.21.15.62:0/1090983245 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:14.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0e7fc700 1 --2- 172.21.15.62:0/1090983245 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbe10064de0 0x7fbe100af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:14.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0effd700 1 --2- 172.21.15.62:0/1090983245 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbe1005fa70 0x7fbe100addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:14.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0f7fe700 1 -- 172.21.15.62:0/1090983245 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbe1005fa70 msgr2=0x7fbe100addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:14.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0f7fe700 1 --2- 172.21.15.62:0/1090983245 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbe1005fa70 0x7fbe100addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0f7fe700 1 -- 172.21.15.62:0/1090983245 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbe10064de0 msgr2=0x7fbe100af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:14.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0f7fe700 1 --2- 172.21.15.62:0/1090983245 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbe10064de0 0x7fbe100af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0f7fe700 1 -- 172.21.15.62:0/1090983245 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf800b180 con 0x7fbe101405f0 2021-12-17T18:24:14.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0effd700 1 --2- 172.21.15.62:0/1090983245 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbe1005fa70 0x7fbe100addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:24:14.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0f7fe700 1 --2- 172.21.15.62:0/1090983245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe101405f0 0x7fbe100b0650 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fbe08001490 tx=0x7fbe08007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:14.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe07fff700 1 -- 172.21.15.62:0/1090983245 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe08005c70 con 0x7fbe101405f0 2021-12-17T18:24:14.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe07fff700 1 -- 172.21.15.62:0/1090983245 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe08005dd0 con 0x7fbe101405f0 2021-12-17T18:24:14.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0ffff700 1 -- 172.21.15.62:0/1090983245 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe100af910 con 0x7fbe101405f0 2021-12-17T18:24:14.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe07fff700 1 -- 172.21.15.62:0/1090983245 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe080072c0 con 0x7fbe101405f0 2021-12-17T18:24:14.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0ffff700 1 -- 172.21.15.62:0/1090983245 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe10155ef0 con 0x7fbe101405f0 2021-12-17T18:24:14.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.182+0000 7fbe0ffff700 1 -- 172.21.15.62:0/1090983245 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe100afad0 con 0x7fbe101405f0 2021-12-17T18:24:14.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.186+0000 7fbe07fff700 1 -- 172.21.15.62:0/1090983245 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbe0801a060 con 0x7fbe101405f0 2021-12-17T18:24:14.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.186+0000 7fbe07fff700 1 --2- 172.21.15.62:0/1090983245 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbdf40535b0 0x7fbdf4055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:14.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.186+0000 7fbe07fff700 1 -- 172.21.15.62:0/1090983245 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbe0806af70 con 0x7fbe101405f0 2021-12-17T18:24:14.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.186+0000 7fbe0effd700 1 --2- 172.21.15.62:0/1090983245 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbdf40535b0 0x7fbdf4055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:14.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.186+0000 7fbe0effd700 1 --2- 172.21.15.62:0/1090983245 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbdf40535b0 0x7fbdf4055a70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fbdf8018000 tx=0x7fbdf8014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:14.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.190+0000 7fbe07fff700 1 -- 172.21.15.62:0/1090983245 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbe100afad0 con 0x7fbe101405f0 2021-12-17T18:24:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.358+0000 7fbe0ffff700 1 -- 172.21.15.62:0/1090983245 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fbe100afaa0 con 0x7fbe101405f0 2021-12-17T18:24:14.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.366+0000 7fbe07fff700 1 -- 172.21.15.62:0/1090983245 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v25) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbe08018070 con 0x7fbe101405f0 2021-12-17T18:24:14.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.370+0000 7fbe0ffff700 1 -- 172.21.15.62:0/1090983245 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbdf40535b0 msgr2=0x7fbdf4055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:14.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.370+0000 7fbe0ffff700 1 --2- 172.21.15.62:0/1090983245 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbdf40535b0 0x7fbdf4055a70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fbdf8018000 tx=0x7fbdf8014000).stop 2021-12-17T18:24:14.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.370+0000 7fbe0ffff700 1 -- 172.21.15.62:0/1090983245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe101405f0 msgr2=0x7fbe100b0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:14.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.370+0000 7fbe0ffff700 1 --2- 172.21.15.62:0/1090983245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe101405f0 0x7fbe100b0650 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fbe08001490 tx=0x7fbe08007dc0).stop 2021-12-17T18:24:14.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.370+0000 7fbe0ffff700 1 -- 172.21.15.62:0/1090983245 shutdown_connections 2021-12-17T18:24:14.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.370+0000 7fbe0ffff700 1 --2- 172.21.15.62:0/1090983245 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbdf40535b0 0x7fbdf4055a70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.370+0000 7fbe0ffff700 1 --2- 172.21.15.62:0/1090983245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe101405f0 0x7fbe100b0650 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.370+0000 7fbe0ffff700 1 --2- 172.21.15.62:0/1090983245 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbe10064de0 0x7fbe100af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.370+0000 7fbe0ffff700 1 --2- 172.21.15.62:0/1090983245 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbe1005fa70 0x7fbe100addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.370+0000 7fbe0ffff700 1 -- 172.21.15.62:0/1090983245 >> 172.21.15.62:0/1090983245 conn(0x7fbe1005bcd0 msgr2=0x7fbe100b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:14.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.370+0000 7fbe0ffff700 1 -- 172.21.15.62:0/1090983245 shutdown_connections 2021-12-17T18:24:14.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.370+0000 7fbe0ffff700 1 -- 172.21.15.62:0/1090983245 wait complete. 2021-12-17T18:24:14.376 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.2 2021-12-17T18:24:14.386 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:24:14.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be863a700 1 Processor -- start 2021-12-17T18:24:14.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be863a700 1 -- start start 2021-12-17T18:24:14.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be863a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3be00b2270 0x7f3be00b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:14.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be863a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be00ad7f0 con 0x7f3be0067120 2021-12-17T18:24:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be863a700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be00ada90 con 0x7f3be0143780 2021-12-17T18:24:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be863a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be00add30 con 0x7f3be00b2270 2021-12-17T18:24:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be5bd5700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3be0067120 0x7f3be00675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35828/0 (socket says 172.21.15.62:35828) 2021-12-17T18:24:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be5bd5700 1 -- 172.21.15.62:0/1890558881 learned_addr learned my addr 172.21.15.62:0/1890558881 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be6bd7700 1 --2- 172.21.15.62:0/1890558881 >> v2:172.21.15.62:3300/0 conn(0x7f3be00b2270 0x7f3be00b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 -- 172.21.15.62:0/1890558881 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641717225 0 0) 0x7f3be00ad7f0 con 0x7f3be0067120 2021-12-17T18:24:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 -- 172.21.15.62:0/1890558881 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bc8003260 con 0x7f3be0067120 2021-12-17T18:24:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 -- 172.21.15.62:0/1890558881 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 350663847 0 0) 0x7f3bc8003260 con 0x7f3be0067120 2021-12-17T18:24:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 -- 172.21.15.62:0/1890558881 >> v2:172.21.15.62:3300/0 conn(0x7f3be00b2270 msgr2=0x7f3be00b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 --2- 172.21.15.62:0/1890558881 >> v2:172.21.15.62:3300/0 conn(0x7f3be00b2270 0x7f3be00b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 -- 172.21.15.62:0/1890558881 >> v1:172.21.15.109:6789/0 conn(0x7f3be0143780 legacy=0x7f3be0143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 -- 172.21.15.62:0/1890558881 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be0067cb0 con 0x7f3be0067120 2021-12-17T18:24:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 -- 172.21.15.62:0/1890558881 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f3bd0001660 con 0x7f3be0067120 2021-12-17T18:24:14.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 -- 172.21.15.62:0/1890558881 >> v1:172.21.15.62:6789/0 conn(0x7f3be0067120 legacy=0x7f3be00675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:14.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 --2- 172.21.15.62:0/1890558881 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3bc8003750 0x7f3bc8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:14.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 --2- 172.21.15.62:0/1890558881 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3bc8004500 0x7f3bc8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:14.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 --2- 172.21.15.62:0/1890558881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bc8004e70 0x7f3bc800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:14.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 -- 172.21.15.62:0/1890558881 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be00add30 con 0x7f3bc8004e70 2021-12-17T18:24:14.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 -- 172.21.15.62:0/1890558881 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc800bd20 con 0x7f3bc8003750 2021-12-17T18:24:14.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 -- 172.21.15.62:0/1890558881 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc800bee0 con 0x7f3bc8004500 2021-12-17T18:24:14.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be6bd7700 1 --2- 172.21.15.62:0/1890558881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bc8004e70 0x7f3bc800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:14.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be5bd5700 1 --2- 172.21.15.62:0/1890558881 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3bc8004500 0x7f3bc8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:14.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be63d6700 1 --2- 172.21.15.62:0/1890558881 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3bc8003750 0x7f3bc8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:14.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be6bd7700 1 -- 172.21.15.62:0/1890558881 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3bc8004500 msgr2=0x7f3bc8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:14.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be6bd7700 1 --2- 172.21.15.62:0/1890558881 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3bc8004500 0x7f3bc8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be6bd7700 1 -- 172.21.15.62:0/1890558881 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3bc8003750 msgr2=0x7f3bc8003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:14.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be6bd7700 1 --2- 172.21.15.62:0/1890558881 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3bc8003750 0x7f3bc8003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be6bd7700 1 -- 172.21.15.62:0/1890558881 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc8003260 con 0x7f3bc8004e70 2021-12-17T18:24:14.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be63d6700 1 --2- 172.21.15.62:0/1890558881 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3bc8003750 0x7f3bc8003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:24:14.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be6bd7700 1 -- 172.21.15.62:0/1890558881 reap_dead start 2021-12-17T18:24:14.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be6bd7700 1 --2- 172.21.15.62:0/1890558881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bc8004e70 0x7f3bc800b750 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f3bd800c000 tx=0x7f3bd80091d0).ready entity=mon.0 client_cookie=f1288419f1534705 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:14.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 -- 172.21.15.62:0/1890558881 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bd800e7e0 con 0x7f3bc8004e70 2021-12-17T18:24:14.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 -- 172.21.15.62:0/1890558881 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd800e940 con 0x7f3bc8004e70 2021-12-17T18:24:14.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.490+0000 7f3be53d4700 1 -- 172.21.15.62:0/1890558881 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bd800eca0 con 0x7f3bc8004e70 2021-12-17T18:24:14.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be863a700 1 -- 172.21.15.62:0/1890558881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bc8004e70 msgr2=0x7f3bc800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:14.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be863a700 1 --2- 172.21.15.62:0/1890558881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bc8004e70 0x7f3bc800b750 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f3bd800c000 tx=0x7f3bd80091d0).stop 2021-12-17T18:24:14.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be863a700 1 -- 172.21.15.62:0/1890558881 shutdown_connections 2021-12-17T18:24:14.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be863a700 1 --2- 172.21.15.62:0/1890558881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bc8004e70 0x7f3bc800b750 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be863a700 1 -- 172.21.15.62:0/1890558881 >> 172.21.15.62:0/1890558881 conn(0x7f3be005f730 msgr2=0x7f3be005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:14.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be863a700 1 -- 172.21.15.62:0/1890558881 shutdown_connections 2021-12-17T18:24:14.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be863a700 1 -- 172.21.15.62:0/1890558881 wait complete. 2021-12-17T18:24:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be863a700 1 Processor -- start 2021-12-17T18:24:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be863a700 1 -- start start 2021-12-17T18:24:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be863a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3bc8004e70 0x7f3be01424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be863a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3be013f930 0x7f3be0153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be863a700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3be013c000 0x7f3be0154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be863a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be0133280 con 0x7f3be013f930 2021-12-17T18:24:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be863a700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be013ff30 con 0x7f3be013c000 2021-12-17T18:24:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be863a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be013b450 con 0x7f3bc8004e70 2021-12-17T18:24:14.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be5bd5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3be013f930 0x7f3be0153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:14.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be5bd5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3be013f930 0x7f3be0153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52260/0 (socket says 172.21.15.62:52260) 2021-12-17T18:24:14.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.498+0000 7f3be5bd5700 1 -- 172.21.15.62:0/2351554604 learned_addr learned my addr 172.21.15.62:0/2351554604 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:14.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.494+0000 7f3be63d6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3bc8004e70 0x7f3be01424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:14.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.498+0000 7f3be6bd7700 1 --2- 172.21.15.62:0/2351554604 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3be013c000 0x7f3be0154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:14.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.498+0000 7f3be5bd5700 1 -- 172.21.15.62:0/2351554604 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3bc8004e70 msgr2=0x7f3be01424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:14.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.498+0000 7f3be5bd5700 1 --2- 172.21.15.62:0/2351554604 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3bc8004e70 0x7f3be01424d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.498+0000 7f3be5bd5700 1 -- 172.21.15.62:0/2351554604 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3be013c000 msgr2=0x7f3be0154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:14.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.498+0000 7f3be5bd5700 1 --2- 172.21.15.62:0/2351554604 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3be013c000 0x7f3be0154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.498+0000 7f3be5bd5700 1 -- 172.21.15.62:0/2351554604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be013b6f0 con 0x7f3be013f930 2021-12-17T18:24:14.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.498+0000 7f3be5bd5700 1 --2- 172.21.15.62:0/2351554604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3be013f930 0x7f3be0153e90 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f3bd0001110 tx=0x7f3be0062370).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:14.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.498+0000 7f3bcf7fe700 1 -- 172.21.15.62:0/2351554604 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bd00116b0 con 0x7f3be013f930 2021-12-17T18:24:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.498+0000 7f3bcf7fe700 1 -- 172.21.15.62:0/2351554604 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd0011810 con 0x7f3be013f930 2021-12-17T18:24:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.498+0000 7f3bcf7fe700 1 -- 172.21.15.62:0/2351554604 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bd0011b70 con 0x7f3be013f930 2021-12-17T18:24:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.498+0000 7f3be863a700 1 -- 172.21.15.62:0/2351554604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be013b990 con 0x7f3be013f930 2021-12-17T18:24:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.498+0000 7f3be863a700 1 -- 172.21.15.62:0/2351554604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be0154a90 con 0x7f3be013f930 2021-12-17T18:24:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.498+0000 7f3be863a700 1 -- 172.21.15.62:0/2351554604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be00573d0 con 0x7f3be013f930 2021-12-17T18:24:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.498+0000 7f3bcf7fe700 1 -- 172.21.15.62:0/2351554604 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3bd001b030 con 0x7f3be013f930 2021-12-17T18:24:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.498+0000 7f3bcf7fe700 1 --2- 172.21.15.62:0/2351554604 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3bc00579c0 0x7f3bc0059e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.498+0000 7f3bcf7fe700 1 -- 172.21.15.62:0/2351554604 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3bd006b410 con 0x7f3be013f930 2021-12-17T18:24:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.502+0000 7f3be63d6700 1 --2- 172.21.15.62:0/2351554604 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3bc00579c0 0x7f3bc0059e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:14.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.502+0000 7f3be63d6700 1 --2- 172.21.15.62:0/2351554604 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3bc00579c0 0x7f3bc0059e80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f3bdc00d000 tx=0x7f3bdc00c040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:14.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.506+0000 7f3bcf7fe700 1 -- 172.21.15.62:0/2351554604 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3bd00424d0 con 0x7f3be013f930 2021-12-17T18:24:14.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.674+0000 7f3be863a700 1 -- 172.21.15.62:0/2351554604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3be006a2b0 con 0x7f3be013f930 2021-12-17T18:24:14.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.674+0000 7f3bcf7fe700 1 -- 172.21.15.62:0/2351554604 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f3bd0019030 con 0x7f3be013f930 2021-12-17T18:24:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:14.677 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":32,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5672,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/2267359903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":2267359903},{"type":"v1","addr":"172.21.15.109:6835","nonce":2267359903}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:24:11.805782+0000","modified":"2021-12-17T18:24:12.808883+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6318":{"gid":6318,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/414220193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":414220193},{"type":"v1","addr":"172.21.15.62:6833","nonce":414220193}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-12-17T18:24:14.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.674+0000 7f3be863a700 1 -- 172.21.15.62:0/2351554604 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3bc00579c0 msgr2=0x7f3bc0059e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:14.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.674+0000 7f3be863a700 1 --2- 172.21.15.62:0/2351554604 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3bc00579c0 0x7f3bc0059e80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f3bdc00d000 tx=0x7f3bdc00c040).stop 2021-12-17T18:24:14.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.674+0000 7f3be863a700 1 -- 172.21.15.62:0/2351554604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3be013f930 msgr2=0x7f3be0153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:14.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.674+0000 7f3be863a700 1 --2- 172.21.15.62:0/2351554604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3be013f930 0x7f3be0153e90 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f3bd0001110 tx=0x7f3be0062370).stop 2021-12-17T18:24:14.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.674+0000 7f3be863a700 1 -- 172.21.15.62:0/2351554604 shutdown_connections 2021-12-17T18:24:14.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.674+0000 7f3be863a700 1 --2- 172.21.15.62:0/2351554604 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3bc00579c0 0x7f3bc0059e80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.674+0000 7f3be863a700 1 --2- 172.21.15.62:0/2351554604 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3be013c000 0x7f3be0154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.674+0000 7f3be863a700 1 --2- 172.21.15.62:0/2351554604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3be013f930 0x7f3be0153e90 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.674+0000 7f3be863a700 1 --2- 172.21.15.62:0/2351554604 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3bc8004e70 0x7f3be01424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:14.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.674+0000 7f3be863a700 1 -- 172.21.15.62:0/2351554604 >> 172.21.15.62:0/2351554604 conn(0x7f3be005f730 msgr2=0x7f3be0142d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:14.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.678+0000 7f3be863a700 1 -- 172.21.15.62:0/2351554604 shutdown_connections 2021-12-17T18:24:14.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:14.678+0000 7f3be863a700 1 -- 172.21.15.62:0/2351554604 wait complete. 2021-12-17T18:24:14.682 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 32 2021-12-17T18:24:14.892 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:24:11.805782+0000', 'modified': '2021-12-17T18:24:12.808883+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6318}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6318': {'gid': 6318, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/414220193', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 414220193}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 414220193}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:24:14.892 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:24:14.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:24:15.007 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":6318,"want_state":"up:active","state":"up:active","rank_uptime":3.188659489,"mdsmap_epoch":32,"osdmap_epoch":71,"osdmap_epoch_barrier":70,"uptime":7.5204421359999998} 2021-12-17T18:24:15.008 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 6318, "mdsmap_epoch": 32, "osdmap_epoch": 71, "osdmap_epoch_barrier": 70, "rank_uptime": 3.188659489, "state": "up:active", "uptime": 7.520442136, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:24:15.009 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:24:15.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63b667e700 1 Processor -- start 2021-12-17T18:24:15.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63b667e700 1 -- start start 2021-12-17T18:24:15.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63b667e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63b00b5fc0 0x7f63b0148180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63b667e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f63b014acb0 0x7f63b014b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63b667e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b00ad450 con 0x7f63b005bed0 2021-12-17T18:24:15.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63b667e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b00ab8d0 con 0x7f63b014acb0 2021-12-17T18:24:15.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63b667e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b0148740 con 0x7f63b00b5fc0 2021-12-17T18:24:15.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63af7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f63b005bed0 0x7f63b00b2120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35846/0 (socket says 172.21.15.62:35846) 2021-12-17T18:24:15.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63af7fe700 1 -- 172.21.15.62:0/3373778048 learned_addr learned my addr 172.21.15.62:0/3373778048 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:15.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63b4c1b700 1 --2- 172.21.15.62:0/3373778048 >> v2:172.21.15.62:3300/0 conn(0x7f63b014acb0 0x7f63b014b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63affff700 1 --2- 172.21.15.62:0/3373778048 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63b00b5fc0 0x7f63b0148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63aeffd700 1 -- 172.21.15.62:0/3373778048 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637424022 0 0) 0x7f63b00ad450 con 0x7f63b005bed0 2021-12-17T18:24:15.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63aeffd700 1 -- 172.21.15.62:0/3373778048 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6394003260 con 0x7f63b005bed0 2021-12-17T18:24:15.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63b4c1b700 1 -- 172.21.15.62:0/3373778048 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63b00b5fc0 msgr2=0x7f63b0148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:15.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63b4c1b700 1 --2- 172.21.15.62:0/3373778048 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63b00b5fc0 0x7f63b0148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63b4c1b700 1 -- 172.21.15.62:0/3373778048 >> v1:172.21.15.62:6789/0 conn(0x7f63b005bed0 legacy=0x7f63b00b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63b4c1b700 1 -- 172.21.15.62:0/3373778048 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b00ad6f0 con 0x7f63b014acb0 2021-12-17T18:24:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63b4c1b700 1 --2- 172.21.15.62:0/3373778048 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b014acb0 0x7f63b014b140 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f63a8002f70 tx=0x7f63a8006df0).ready entity=mon.0 client_cookie=aae461a0c3fc1660 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63aeffd700 1 -- 172.21.15.62:0/3373778048 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63a800d4a0 con 0x7f63b014acb0 2021-12-17T18:24:15.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63aeffd700 1 -- 172.21.15.62:0/3373778048 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a8000e90 con 0x7f63b014acb0 2021-12-17T18:24:15.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.114+0000 7f63aeffd700 1 -- 172.21.15.62:0/3373778048 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63a800d7f0 con 0x7f63b014acb0 2021-12-17T18:24:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b667e700 1 -- 172.21.15.62:0/3373778048 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b014acb0 msgr2=0x7f63b014b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b667e700 1 --2- 172.21.15.62:0/3373778048 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b014acb0 0x7f63b014b140 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f63a8002f70 tx=0x7f63a8006df0).stop 2021-12-17T18:24:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b667e700 1 -- 172.21.15.62:0/3373778048 shutdown_connections 2021-12-17T18:24:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b667e700 1 --2- 172.21.15.62:0/3373778048 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b014acb0 0x7f63b014b140 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b667e700 1 --2- 172.21.15.62:0/3373778048 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63b00b5fc0 0x7f63b0148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b667e700 1 -- 172.21.15.62:0/3373778048 >> 172.21.15.62:0/3373778048 conn(0x7f63b005c750 msgr2=0x7f63b00630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b667e700 1 -- 172.21.15.62:0/3373778048 shutdown_connections 2021-12-17T18:24:15.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b667e700 1 -- 172.21.15.62:0/3373778048 wait complete. 2021-12-17T18:24:15.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b667e700 1 Processor -- start 2021-12-17T18:24:15.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b667e700 1 -- start start 2021-12-17T18:24:15.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b667e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f63b005bed0 0x7f63b00b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b667e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63b00b5fc0 0x7f63b014c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b667e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b014acb0 0x7f63b014cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b667e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b014f540 con 0x7f63b014acb0 2021-12-17T18:24:15.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b667e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b0064440 con 0x7f63b005bed0 2021-12-17T18:24:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b667e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b00646e0 con 0x7f63b00b5fc0 2021-12-17T18:24:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b4c1b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b014acb0 0x7f63b014cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b4c1b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b014acb0 0x7f63b014cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52276/0 (socket says 172.21.15.62:52276) 2021-12-17T18:24:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b4c1b700 1 -- 172.21.15.62:0/3665226981 learned_addr learned my addr 172.21.15.62:0/3665226981 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63af7fe700 1 --2- 172.21.15.62:0/3665226981 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63b00b5fc0 0x7f63b014c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63affff700 1 --2- 172.21.15.62:0/3665226981 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f63b005bed0 0x7f63b00b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b4c1b700 1 -- 172.21.15.62:0/3665226981 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63b00b5fc0 msgr2=0x7f63b014c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b4c1b700 1 --2- 172.21.15.62:0/3665226981 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63b00b5fc0 0x7f63b014c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b4c1b700 1 -- 172.21.15.62:0/3665226981 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f63b005bed0 msgr2=0x7f63b00b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b4c1b700 1 --2- 172.21.15.62:0/3665226981 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f63b005bed0 0x7f63b00b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.118+0000 7f63b4c1b700 1 -- 172.21.15.62:0/3665226981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a800b180 con 0x7f63b014acb0 2021-12-17T18:24:15.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.122+0000 7f63affff700 1 --2- 172.21.15.62:0/3665226981 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f63b005bed0 0x7f63b00b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:24:15.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.122+0000 7f63b4c1b700 1 --2- 172.21.15.62:0/3665226981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b014acb0 0x7f63b014cb40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f63a8002f70 tx=0x7f63a8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.122+0000 7f63ad7fa700 1 -- 172.21.15.62:0/3665226981 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63a8013a40 con 0x7f63b014acb0 2021-12-17T18:24:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.122+0000 7f63ad7fa700 1 -- 172.21.15.62:0/3665226981 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a8013ba0 con 0x7f63b014acb0 2021-12-17T18:24:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.122+0000 7f63b667e700 1 -- 172.21.15.62:0/3665226981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b0064980 con 0x7f63b014acb0 2021-12-17T18:24:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.122+0000 7f63ad7fa700 1 -- 172.21.15.62:0/3665226981 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63a801e400 con 0x7f63b014acb0 2021-12-17T18:24:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.122+0000 7f63b667e700 1 -- 172.21.15.62:0/3665226981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b00677f0 con 0x7f63b014acb0 2021-12-17T18:24:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.122+0000 7f63b667e700 1 -- 172.21.15.62:0/3665226981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b0146040 con 0x7f63b014acb0 2021-12-17T18:24:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.122+0000 7f63ad7fa700 1 -- 172.21.15.62:0/3665226981 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f63a8025030 con 0x7f63b014acb0 2021-12-17T18:24:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.122+0000 7f63ad7fa700 1 --2- 172.21.15.62:0/3665226981 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6388053610 0x7f6388055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.122+0000 7f63ad7fa700 1 -- 172.21.15.62:0/3665226981 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f63a806c840 con 0x7f63b014acb0 2021-12-17T18:24:15.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.122+0000 7f63affff700 1 --2- 172.21.15.62:0/3665226981 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6388053610 0x7f6388055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.126+0000 7f63affff700 1 --2- 172.21.15.62:0/3665226981 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6388053610 0x7f6388055ad0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f639800b000 tx=0x7f6398008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.130+0000 7f63ad7fa700 1 -- 172.21.15.62:0/3665226981 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f63b0146040 con 0x7f63b014acb0 2021-12-17T18:24:15.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.258+0000 7f63b667e700 1 -- 172.21.15.62:0/3665226981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63b0146040 con 0x7f63b014acb0 2021-12-17T18:24:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.258+0000 7f63ad7fa700 1 -- 172.21.15.62:0/3665226981 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f63b0146040 con 0x7f63b014acb0 2021-12-17T18:24:15.262 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:15.262 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":71,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:24:12.809524+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:24:10.413185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-12-17T18:24:11.229328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:24:15.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.262+0000 7f63b667e700 1 -- 172.21.15.62:0/3665226981 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6388053610 msgr2=0x7f6388055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.262+0000 7f63b667e700 1 --2- 172.21.15.62:0/3665226981 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6388053610 0x7f6388055ad0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f639800b000 tx=0x7f6398008040).stop 2021-12-17T18:24:15.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.262+0000 7f63b667e700 1 -- 172.21.15.62:0/3665226981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b014acb0 msgr2=0x7f63b014cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.262+0000 7f63b667e700 1 --2- 172.21.15.62:0/3665226981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b014acb0 0x7f63b014cb40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f63a8002f70 tx=0x7f63a8014000).stop 2021-12-17T18:24:15.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.262+0000 7f63b667e700 1 -- 172.21.15.62:0/3665226981 shutdown_connections 2021-12-17T18:24:15.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.262+0000 7f63b667e700 1 --2- 172.21.15.62:0/3665226981 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6388053610 0x7f6388055ad0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.262+0000 7f63b667e700 1 --2- 172.21.15.62:0/3665226981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b014acb0 0x7f63b014cb40 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.262+0000 7f63b667e700 1 --2- 172.21.15.62:0/3665226981 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f63b00b5fc0 0x7f63b014c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.262+0000 7f63b667e700 1 --2- 172.21.15.62:0/3665226981 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f63b005bed0 0x7f63b00b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.262+0000 7f63b667e700 1 -- 172.21.15.62:0/3665226981 >> 172.21.15.62:0/3665226981 conn(0x7f63b005c750 msgr2=0x7f63b00b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:15.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.262+0000 7f63b667e700 1 -- 172.21.15.62:0/3665226981 shutdown_connections 2021-12-17T18:24:15.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.262+0000 7f63b667e700 1 -- 172.21.15.62:0/3665226981 wait complete. 2021-12-17T18:24:15.275 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:24:10.413185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:24:11.229328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:24:15.276 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:24:15.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.386+0000 7fe9b2f6f700 1 Processor -- start 2021-12-17T18:24:15.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.386+0000 7fe9b2f6f700 1 -- start start 2021-12-17T18:24:15.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b2f6f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe9ac063b00 0x7fe9ac063ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b2f6f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9ac061670 0x7fe9ac0621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b2f6f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ac143dc0 con 0x7fe9ac0b1260 2021-12-17T18:24:15.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b2f6f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ac061b00 con 0x7fe9ac063b00 2021-12-17T18:24:15.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b2f6f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac0b1b90 con 0x7fe9ac061670 2021-12-17T18:24:15.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b1f6d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe9ac063b00 0x7fe9ac063ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b1f6d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe9ac063b00 0x7fe9ac063ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52280/0 (socket says 172.21.15.62:52280) 2021-12-17T18:24:15.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b1f6d700 1 -- 172.21.15.62:0/3334799572 learned_addr learned my addr 172.21.15.62:0/3334799572 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:15.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b276e700 1 --2- 172.21.15.62:0/3334799572 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9ac061670 0x7fe9ac0621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b1f6d700 1 -- 172.21.15.62:0/3334799572 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9ac061670 msgr2=0x7fe9ac0621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:15.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b1f6d700 1 --2- 172.21.15.62:0/3334799572 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9ac061670 0x7fe9ac0621a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b1f6d700 1 -- 172.21.15.62:0/3334799572 >> v1:172.21.15.109:6789/0 conn(0x7fe9ac0b1260 legacy=0x7fe9ac13cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b1f6d700 1 -- 172.21.15.62:0/3334799572 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac061d00 con 0x7fe9ac063b00 2021-12-17T18:24:15.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b276e700 1 --2- 172.21.15.62:0/3334799572 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9ac061670 0x7fe9ac0621a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:24:15.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b1f6d700 1 --2- 172.21.15.62:0/3334799572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9ac063b00 0x7fe9ac063ee0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7fe9a8002f70 tx=0x7fe9a8006eb0).ready entity=mon.0 client_cookie=7616ee0e5e73fd11 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:15.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b0f6b700 1 -- 172.21.15.62:0/3334799572 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9a800d5c0 con 0x7fe9ac063b00 2021-12-17T18:24:15.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b0f6b700 1 -- 172.21.15.62:0/3334799572 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a8000e90 con 0x7fe9ac063b00 2021-12-17T18:24:15.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b0f6b700 1 -- 172.21.15.62:0/3334799572 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9a800d950 con 0x7fe9ac063b00 2021-12-17T18:24:15.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b2f6f700 1 -- 172.21.15.62:0/3334799572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9ac063b00 msgr2=0x7fe9ac063ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b2f6f700 1 --2- 172.21.15.62:0/3334799572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9ac063b00 0x7fe9ac063ee0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7fe9a8002f70 tx=0x7fe9a8006eb0).stop 2021-12-17T18:24:15.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b2f6f700 1 -- 172.21.15.62:0/3334799572 shutdown_connections 2021-12-17T18:24:15.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b2f6f700 1 --2- 172.21.15.62:0/3334799572 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9ac061670 0x7fe9ac0621a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b2f6f700 1 --2- 172.21.15.62:0/3334799572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9ac063b00 0x7fe9ac063ee0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b2f6f700 1 -- 172.21.15.62:0/3334799572 >> 172.21.15.62:0/3334799572 conn(0x7fe9ac060a50 msgr2=0x7fe9ac05bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:15.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b2f6f700 1 -- 172.21.15.62:0/3334799572 shutdown_connections 2021-12-17T18:24:15.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.390+0000 7fe9b2f6f700 1 -- 172.21.15.62:0/3334799572 wait complete. 2021-12-17T18:24:15.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b2f6f700 1 Processor -- start 2021-12-17T18:24:15.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b2f6f700 1 -- start start 2021-12-17T18:24:15.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b2f6f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9ac061670 0x7fe9ac0b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b2f6f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9ac063b00 0x7fe9ac152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b2f6f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9ac0b1260 0x7fe9ac152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b2f6f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac139e00 con 0x7fe9ac0b1260 2021-12-17T18:24:15.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b2f6f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac152170 con 0x7fe9ac061670 2021-12-17T18:24:15.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b2f6f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac153130 con 0x7fe9ac063b00 2021-12-17T18:24:15.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b276e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9ac0b1260 0x7fe9ac152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b276e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9ac0b1260 0x7fe9ac152c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52290/0 (socket says 172.21.15.62:52290) 2021-12-17T18:24:15.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b276e700 1 -- 172.21.15.62:0/1171899579 learned_addr learned my addr 172.21.15.62:0/1171899579 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:15.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b1f6d700 1 --2- 172.21.15.62:0/1171899579 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9ac061670 0x7fe9ac0b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b176c700 1 --2- 172.21.15.62:0/1171899579 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9ac063b00 0x7fe9ac152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b276e700 1 -- 172.21.15.62:0/1171899579 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9ac063b00 msgr2=0x7fe9ac152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b276e700 1 --2- 172.21.15.62:0/1171899579 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9ac063b00 0x7fe9ac152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b276e700 1 -- 172.21.15.62:0/1171899579 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9ac061670 msgr2=0x7fe9ac0b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b276e700 1 --2- 172.21.15.62:0/1171899579 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9ac061670 0x7fe9ac0b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b276e700 1 -- 172.21.15.62:0/1171899579 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a800b1e0 con 0x7fe9ac0b1260 2021-12-17T18:24:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.394+0000 7fe9b276e700 1 --2- 172.21.15.62:0/1171899579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9ac0b1260 0x7fe9ac152c40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7fe9a4006cc0 tx=0x7fe9a4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.398+0000 7fe99effd700 1 -- 172.21.15.62:0/1171899579 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9a4013620 con 0x7fe9ac0b1260 2021-12-17T18:24:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.398+0000 7fe9b2f6f700 1 -- 172.21.15.62:0/1171899579 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ac066be0 con 0x7fe9ac0b1260 2021-12-17T18:24:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.398+0000 7fe99effd700 1 -- 172.21.15.62:0/1171899579 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a4013780 con 0x7fe9ac0b1260 2021-12-17T18:24:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.398+0000 7fe99effd700 1 -- 172.21.15.62:0/1171899579 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9a4013ae0 con 0x7fe9ac0b1260 2021-12-17T18:24:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.398+0000 7fe9b2f6f700 1 -- 172.21.15.62:0/1171899579 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ac065e30 con 0x7fe9ac0b1260 2021-12-17T18:24:15.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.398+0000 7fe99effd700 1 -- 172.21.15.62:0/1171899579 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe9a4013c40 con 0x7fe9ac0b1260 2021-12-17T18:24:15.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.398+0000 7fe99effd700 1 --2- 172.21.15.62:0/1171899579 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe98c0536a0 0x7fe98c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.398+0000 7fe99effd700 1 -- 172.21.15.62:0/1171899579 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe9a406b7c0 con 0x7fe9ac0b1260 2021-12-17T18:24:15.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.398+0000 7fe9b2f6f700 1 -- 172.21.15.62:0/1171899579 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ac066a10 con 0x7fe9ac0b1260 2021-12-17T18:24:15.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.398+0000 7fe9b1f6d700 1 --2- 172.21.15.62:0/1171899579 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe98c0536a0 0x7fe98c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.398+0000 7fe9b1f6d700 1 --2- 172.21.15.62:0/1171899579 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe98c0536a0 0x7fe98c055b60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fe9a801c000 tx=0x7fe9a8015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:15.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.406+0000 7fe99effd700 1 -- 172.21.15.62:0/1171899579 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe9a4042880 con 0x7fe9ac0b1260 2021-12-17T18:24:15.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.526+0000 7fe9b2f6f700 1 -- 172.21.15.62:0/1171899579 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe9ac1439c0 con 0x7fe9ac0b1260 2021-12-17T18:24:15.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.530+0000 7fe99effd700 1 -- 172.21.15.62:0/1171899579 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v71) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe9a400f040 con 0x7fe9ac0b1260 2021-12-17T18:24:15.532 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:24:15.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.530+0000 7fe9b2f6f700 1 -- 172.21.15.62:0/1171899579 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe98c0536a0 msgr2=0x7fe98c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.530+0000 7fe9b2f6f700 1 --2- 172.21.15.62:0/1171899579 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe98c0536a0 0x7fe98c055b60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fe9a801c000 tx=0x7fe9a8015000).stop 2021-12-17T18:24:15.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.530+0000 7fe9b2f6f700 1 -- 172.21.15.62:0/1171899579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9ac0b1260 msgr2=0x7fe9ac152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.530+0000 7fe9b2f6f700 1 --2- 172.21.15.62:0/1171899579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9ac0b1260 0x7fe9ac152c40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7fe9a4006cc0 tx=0x7fe9a4008040).stop 2021-12-17T18:24:15.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.530+0000 7fe9b2f6f700 1 -- 172.21.15.62:0/1171899579 shutdown_connections 2021-12-17T18:24:15.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.530+0000 7fe9b2f6f700 1 --2- 172.21.15.62:0/1171899579 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe98c0536a0 0x7fe98c055b60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.530+0000 7fe9b2f6f700 1 --2- 172.21.15.62:0/1171899579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9ac0b1260 0x7fe9ac152c40 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.530+0000 7fe9b2f6f700 1 --2- 172.21.15.62:0/1171899579 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9ac063b00 0x7fe9ac152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.530+0000 7fe9b2f6f700 1 --2- 172.21.15.62:0/1171899579 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9ac061670 0x7fe9ac0b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.530+0000 7fe9b2f6f700 1 -- 172.21.15.62:0/1171899579 >> 172.21.15.62:0/1171899579 conn(0x7fe9ac060a50 msgr2=0x7fe9ac0b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:15.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.530+0000 7fe9b2f6f700 1 -- 172.21.15.62:0/1171899579 shutdown_connections 2021-12-17T18:24:15.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.530+0000 7fe9b2f6f700 1 -- 172.21.15.62:0/1171899579 wait complete. 2021-12-17T18:24:15.548 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:24:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b1ef8f700 1 Processor -- start 2021-12-17T18:24:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b1ef8f700 1 -- start start 2021-12-17T18:24:15.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b1ef8f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2b18060260 0x7f2b1805cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b1ef8f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f2b18146f70 0x7f2b180b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b1ef8f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b18142ff0 con 0x7f2b1805c750 2021-12-17T18:24:15.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b1ef8f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b181473e0 con 0x7f2b18060260 2021-12-17T18:24:15.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b1ef8f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b18143290 con 0x7f2b18146f70 2021-12-17T18:24:15.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b17fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2b18060260 0x7f2b1805cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b17fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2b18060260 0x7f2b1805cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52296/0 (socket says 172.21.15.62:52296) 2021-12-17T18:24:15.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b17fff700 1 -- 172.21.15.62:0/3583807965 learned_addr learned my addr 172.21.15.62:0/3583807965 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:15.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b1d52c700 1 --2- 172.21.15.62:0/3583807965 >> v2:172.21.15.109:3300/0 conn(0x7f2b18146f70 0x7f2b180b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b17fff700 1 -- 172.21.15.62:0/3583807965 >> v2:172.21.15.109:3300/0 conn(0x7f2b18146f70 msgr2=0x7f2b180b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:15.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b17fff700 1 --2- 172.21.15.62:0/3583807965 >> v2:172.21.15.109:3300/0 conn(0x7f2b18146f70 0x7f2b180b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b17fff700 1 -- 172.21.15.62:0/3583807965 >> v1:172.21.15.109:6789/0 conn(0x7f2b1805c750 legacy=0x7f2b181439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b17fff700 1 -- 172.21.15.62:0/3583807965 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b18143530 con 0x7f2b18060260 2021-12-17T18:24:15.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b17fff700 1 --2- 172.21.15.62:0/3583807965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b18060260 0x7f2b1805cb30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f2b04002f70 tx=0x7f2b04006eb0).ready entity=mon.0 client_cookie=6442e39335cbb094 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:15.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b177fe700 1 -- 172.21.15.62:0/3583807965 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b0400d5c0 con 0x7f2b18060260 2021-12-17T18:24:15.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b177fe700 1 -- 172.21.15.62:0/3583807965 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b04000e90 con 0x7f2b18060260 2021-12-17T18:24:15.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b177fe700 1 -- 172.21.15.62:0/3583807965 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b0400d950 con 0x7f2b18060260 2021-12-17T18:24:15.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b1ef8f700 1 -- 172.21.15.62:0/3583807965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b18060260 msgr2=0x7f2b1805cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b1ef8f700 1 --2- 172.21.15.62:0/3583807965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b18060260 0x7f2b1805cb30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f2b04002f70 tx=0x7f2b04006eb0).stop 2021-12-17T18:24:15.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b1ef8f700 1 -- 172.21.15.62:0/3583807965 shutdown_connections 2021-12-17T18:24:15.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b1ef8f700 1 --2- 172.21.15.62:0/3583807965 >> v2:172.21.15.109:3300/0 conn(0x7f2b18146f70 0x7f2b180b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b1ef8f700 1 --2- 172.21.15.62:0/3583807965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b18060260 0x7f2b1805cb30 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b1ef8f700 1 -- 172.21.15.62:0/3583807965 >> 172.21.15.62:0/3583807965 conn(0x7f2b18062430 msgr2=0x7f2b18062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:15.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b1ef8f700 1 -- 172.21.15.62:0/3583807965 shutdown_connections 2021-12-17T18:24:15.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.654+0000 7f2b1ef8f700 1 -- 172.21.15.62:0/3583807965 wait complete. 2021-12-17T18:24:15.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1ef8f700 1 Processor -- start 2021-12-17T18:24:15.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1ef8f700 1 -- start start 2021-12-17T18:24:15.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1ef8f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b1805c750 0x7f2b18155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1ef8f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2b18060260 0x7f2b181562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1ef8f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2b18146f70 0x7f2b1813e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1ef8f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b18064f80 con 0x7f2b1805c750 2021-12-17T18:24:15.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1ef8f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b18066860 con 0x7f2b18146f70 2021-12-17T18:24:15.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1ef8f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b181400d0 con 0x7f2b18060260 2021-12-17T18:24:15.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1cd2b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b1805c750 0x7f2b18155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b17fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2b18060260 0x7f2b181562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1cd2b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b1805c750 0x7f2b18155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52300/0 (socket says 172.21.15.62:52300) 2021-12-17T18:24:15.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b17fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2b18060260 0x7f2b181562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:46004/0 (socket says 172.21.15.62:46004) 2021-12-17T18:24:15.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1cd2b700 1 -- 172.21.15.62:0/2857176162 learned_addr learned my addr 172.21.15.62:0/2857176162 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:15.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1d52c700 1 --2- 172.21.15.62:0/2857176162 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2b18146f70 0x7f2b1813e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1cd2b700 1 -- 172.21.15.62:0/2857176162 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2b18060260 msgr2=0x7f2b181562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1cd2b700 1 --2- 172.21.15.62:0/2857176162 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2b18060260 0x7f2b181562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1cd2b700 1 -- 172.21.15.62:0/2857176162 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2b18146f70 msgr2=0x7f2b1813e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1cd2b700 1 --2- 172.21.15.62:0/2857176162 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2b18146f70 0x7f2b1813e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1cd2b700 1 -- 172.21.15.62:0/2857176162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0400b1e0 con 0x7f2b1805c750 2021-12-17T18:24:15.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b1cd2b700 1 --2- 172.21.15.62:0/2857176162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b1805c750 0x7f2b18155dc0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f2b1805d070 tx=0x7f2b0c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:15.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.658+0000 7f2b15ffb700 1 -- 172.21.15.62:0/2857176162 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b0c012400 con 0x7f2b1805c750 2021-12-17T18:24:15.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.662+0000 7f2b15ffb700 1 -- 172.21.15.62:0/2857176162 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c012560 con 0x7f2b1805c750 2021-12-17T18:24:15.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.662+0000 7f2b1ef8f700 1 -- 172.21.15.62:0/2857176162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1813fe30 con 0x7f2b1805c750 2021-12-17T18:24:15.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.662+0000 7f2b15ffb700 1 -- 172.21.15.62:0/2857176162 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b0c0128c0 con 0x7f2b1805c750 2021-12-17T18:24:15.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.662+0000 7f2b1ef8f700 1 -- 172.21.15.62:0/2857176162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1813fa00 con 0x7f2b1805c750 2021-12-17T18:24:15.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.662+0000 7f2b1ef8f700 1 -- 172.21.15.62:0/2857176162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b180573d0 con 0x7f2b1805c750 2021-12-17T18:24:15.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.662+0000 7f2b15ffb700 1 -- 172.21.15.62:0/2857176162 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2b0c019030 con 0x7f2b1805c750 2021-12-17T18:24:15.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.662+0000 7f2b15ffb700 1 --2- 172.21.15.62:0/2857176162 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2af8053610 0x7f2af8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.662+0000 7f2b15ffb700 1 -- 172.21.15.62:0/2857176162 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2b0c06ac30 con 0x7f2b1805c750 2021-12-17T18:24:15.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.662+0000 7f2b17fff700 1 --2- 172.21.15.62:0/2857176162 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2af8053610 0x7f2af8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.666+0000 7f2b17fff700 1 --2- 172.21.15.62:0/2857176162 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2af8053610 0x7f2af8055ad0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f2b0401c000 tx=0x7f2b04015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:15.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.670+0000 7f2b15ffb700 1 -- 172.21.15.62:0/2857176162 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2b0c041d90 con 0x7f2b1805c750 2021-12-17T18:24:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.794+0000 7f2b1ef8f700 1 -- 172.21.15.62:0/2857176162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2b180b4390 con 0x7f2b1805c750 2021-12-17T18:24:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.794+0000 7f2b15ffb700 1 -- 172.21.15.62:0/2857176162 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v71) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2b0c0453b0 con 0x7f2b1805c750 2021-12-17T18:24:15.797 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:24:15.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.794+0000 7f2b1ef8f700 1 -- 172.21.15.62:0/2857176162 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2af8053610 msgr2=0x7f2af8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.794+0000 7f2b1ef8f700 1 --2- 172.21.15.62:0/2857176162 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2af8053610 0x7f2af8055ad0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f2b0401c000 tx=0x7f2b04015000).stop 2021-12-17T18:24:15.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.794+0000 7f2b1ef8f700 1 -- 172.21.15.62:0/2857176162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b1805c750 msgr2=0x7f2b18155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.794+0000 7f2b1ef8f700 1 --2- 172.21.15.62:0/2857176162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b1805c750 0x7f2b18155dc0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f2b1805d070 tx=0x7f2b0c007c50).stop 2021-12-17T18:24:15.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.794+0000 7f2b1ef8f700 1 -- 172.21.15.62:0/2857176162 shutdown_connections 2021-12-17T18:24:15.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.794+0000 7f2b1ef8f700 1 --2- 172.21.15.62:0/2857176162 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2af8053610 0x7f2af8055ad0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.794+0000 7f2b1ef8f700 1 --2- 172.21.15.62:0/2857176162 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2b18146f70 0x7f2b1813e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.794+0000 7f2b1ef8f700 1 --2- 172.21.15.62:0/2857176162 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2b18060260 0x7f2b181562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.794+0000 7f2b1ef8f700 1 --2- 172.21.15.62:0/2857176162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b1805c750 0x7f2b18155dc0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.794+0000 7f2b1ef8f700 1 -- 172.21.15.62:0/2857176162 >> 172.21.15.62:0/2857176162 conn(0x7f2b18062430 msgr2=0x7f2b180b96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:15.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.794+0000 7f2b1ef8f700 1 -- 172.21.15.62:0/2857176162 shutdown_connections 2021-12-17T18:24:15.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.794+0000 7f2b1ef8f700 1 -- 172.21.15.62:0/2857176162 wait complete. 2021-12-17T18:24:15.813 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:24:15.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca650a700 1 Processor -- start 2021-12-17T18:24:15.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca650a700 1 -- start start 2021-12-17T18:24:15.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca650a700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5ca0063e00 0x7f5ca00b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca650a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ca0140d00 0x7f5ca013dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca650a700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca00641e0 con 0x7f5ca013e190 2021-12-17T18:24:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca650a700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca005fdf0 con 0x7f5ca0063e00 2021-12-17T18:24:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca650a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca0141ee0 con 0x7f5ca0140d00 2021-12-17T18:24:15.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca5508700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5ca0063e00 0x7f5ca00b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca4d07700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ca0140d00 0x7f5ca013dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca5508700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5ca0063e00 0x7f5ca00b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:58858/0 (socket says 172.21.15.62:58858) 2021-12-17T18:24:15.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca4d07700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ca0140d00 0x7f5ca013dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:46012/0 (socket says 172.21.15.62:46012) 2021-12-17T18:24:15.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca5d09700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f5ca013e190 0x7f5ca0144610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:52212/0 (socket says 172.21.15.62:52212) 2021-12-17T18:24:15.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca5508700 1 -- 172.21.15.62:0/2867860267 learned_addr learned my addr 172.21.15.62:0/2867860267 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:15.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca4d07700 1 -- 172.21.15.62:0/2867860267 >> v2:172.21.15.109:3300/0 conn(0x7f5ca0063e00 msgr2=0x7f5ca00b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:15.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca4d07700 1 --2- 172.21.15.62:0/2867860267 >> v2:172.21.15.109:3300/0 conn(0x7f5ca0063e00 0x7f5ca00b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca4d07700 1 -- 172.21.15.62:0/2867860267 >> v1:172.21.15.109:6789/0 conn(0x7f5ca013e190 legacy=0x7f5ca0144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca4d07700 1 -- 172.21.15.62:0/2867860267 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca005f8b0 con 0x7f5ca0140d00 2021-12-17T18:24:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca5508700 1 --2- 172.21.15.62:0/2867860267 >> v2:172.21.15.109:3300/0 conn(0x7f5ca0063e00 0x7f5ca00b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:24:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.918+0000 7f5ca4d07700 1 --2- 172.21.15.62:0/2867860267 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ca0140d00 0x7f5ca013dca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f5c90002f70 tx=0x7f5c90006df0).ready entity=mon.2 client_cookie=3010633e4786a1e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:15.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.922+0000 7f5c8ffff700 1 -- 172.21.15.62:0/2867860267 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c9000d570 con 0x7f5ca0140d00 2021-12-17T18:24:15.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.922+0000 7f5c8ffff700 1 -- 172.21.15.62:0/2867860267 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c90000e90 con 0x7f5ca0140d00 2021-12-17T18:24:15.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.922+0000 7f5c8ffff700 1 -- 172.21.15.62:0/2867860267 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c9000d8c0 con 0x7f5ca0140d00 2021-12-17T18:24:15.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.922+0000 7f5ca650a700 1 -- 172.21.15.62:0/2867860267 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ca0140d00 msgr2=0x7f5ca013dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.922+0000 7f5ca650a700 1 --2- 172.21.15.62:0/2867860267 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ca0140d00 0x7f5ca013dca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f5c90002f70 tx=0x7f5c90006df0).stop 2021-12-17T18:24:15.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.922+0000 7f5ca650a700 1 -- 172.21.15.62:0/2867860267 shutdown_connections 2021-12-17T18:24:15.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.922+0000 7f5ca650a700 1 --2- 172.21.15.62:0/2867860267 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ca0140d00 0x7f5ca013dca0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.922+0000 7f5ca650a700 1 --2- 172.21.15.62:0/2867860267 >> v2:172.21.15.109:3300/0 conn(0x7f5ca0063e00 0x7f5ca00b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.922+0000 7f5ca650a700 1 -- 172.21.15.62:0/2867860267 >> 172.21.15.62:0/2867860267 conn(0x7f5ca0060a50 msgr2=0x7f5ca005bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:15.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.922+0000 7f5ca650a700 1 -- 172.21.15.62:0/2867860267 shutdown_connections 2021-12-17T18:24:15.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.922+0000 7f5ca650a700 1 -- 172.21.15.62:0/2867860267 wait complete. 2021-12-17T18:24:15.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca650a700 1 Processor -- start 2021-12-17T18:24:15.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca650a700 1 -- start start 2021-12-17T18:24:15.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca650a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ca0063e00 0x7f5ca013fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca650a700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ca013e190 0x7f5ca0066b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca650a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ca0140d00 0x7f5ca013be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca650a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca013ff80 con 0x7f5ca0063e00 2021-12-17T18:24:15.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca650a700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca0065020 con 0x7f5ca013e190 2021-12-17T18:24:15.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca650a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca013ea60 con 0x7f5ca0140d00 2021-12-17T18:24:15.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca5508700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ca0063e00 0x7f5ca013fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca5508700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ca0063e00 0x7f5ca013fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52314/0 (socket says 172.21.15.62:52314) 2021-12-17T18:24:15.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca5508700 1 -- 172.21.15.62:0/1123643096 learned_addr learned my addr 172.21.15.62:0/1123643096 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:15.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca4d07700 1 --2- 172.21.15.62:0/1123643096 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ca013e190 0x7f5ca0066b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca5d09700 1 --2- 172.21.15.62:0/1123643096 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ca0140d00 0x7f5ca013be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca4d07700 1 -- 172.21.15.62:0/1123643096 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ca0140d00 msgr2=0x7f5ca013be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca4d07700 1 --2- 172.21.15.62:0/1123643096 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ca0140d00 0x7f5ca013be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca4d07700 1 -- 172.21.15.62:0/1123643096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ca0063e00 msgr2=0x7f5ca013fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca4d07700 1 --2- 172.21.15.62:0/1123643096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ca0063e00 0x7f5ca013fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:15.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca4d07700 1 -- 172.21.15.62:0/1123643096 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c98009530 con 0x7f5ca013e190 2021-12-17T18:24:15.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca5508700 1 --2- 172.21.15.62:0/1123643096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ca0063e00 0x7f5ca013fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:24:15.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca4d07700 1 --2- 172.21.15.62:0/1123643096 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ca013e190 0x7f5ca0066b20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f5c90002f70 tx=0x7f5c90014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:15.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5c8e7fc700 1 -- 172.21.15.62:0/1123643096 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c9000dea0 con 0x7f5ca013e190 2021-12-17T18:24:15.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5c8e7fc700 1 -- 172.21.15.62:0/1123643096 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c90013de0 con 0x7f5ca013e190 2021-12-17T18:24:15.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca650a700 1 -- 172.21.15.62:0/1123643096 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9000b180 con 0x7f5ca013e190 2021-12-17T18:24:15.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5c8e7fc700 1 -- 172.21.15.62:0/1123643096 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c9001e5f0 con 0x7f5ca013e190 2021-12-17T18:24:15.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.926+0000 7f5ca650a700 1 -- 172.21.15.62:0/1123643096 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca010f770 con 0x7f5ca013e190 2021-12-17T18:24:15.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.930+0000 7f5ca650a700 1 -- 172.21.15.62:0/1123643096 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca0064e70 con 0x7f5ca013e190 2021-12-17T18:24:15.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.930+0000 7f5c8e7fc700 1 -- 172.21.15.62:0/1123643096 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5c9001c070 con 0x7f5ca013e190 2021-12-17T18:24:15.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.930+0000 7f5c8e7fc700 1 --2- 172.21.15.62:0/1123643096 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c80053640 0x7f5c80055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:15.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.930+0000 7f5c8e7fc700 1 -- 172.21.15.62:0/1123643096 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5c9006c440 con 0x7f5ca013e190 2021-12-17T18:24:15.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.930+0000 7f5ca5508700 1 --2- 172.21.15.62:0/1123643096 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c80053640 0x7f5c80055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:15.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.930+0000 7f5ca5508700 1 --2- 172.21.15.62:0/1123643096 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c80053640 0x7f5c80055b00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f5c98006b60 tx=0x7f5c98009290).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:15.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:15.938+0000 7f5c8e7fc700 1 -- 172.21.15.62:0/1123643096 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5c90043490 con 0x7f5ca013e190 2021-12-17T18:24:16.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.066+0000 7f5ca650a700 1 -- 172.21.15.62:0/1123643096 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ca0140760 con 0x7f5ca013e190 2021-12-17T18:24:16.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.066+0000 7f5c8e7fc700 1 -- 172.21.15.62:0/1123643096 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5c900230a0 con 0x7f5ca013e190 2021-12-17T18:24:16.070 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:24:16.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.070+0000 7f5ca650a700 1 -- 172.21.15.62:0/1123643096 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c80053640 msgr2=0x7f5c80055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:16.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.070+0000 7f5ca650a700 1 --2- 172.21.15.62:0/1123643096 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c80053640 0x7f5c80055b00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f5c98006b60 tx=0x7f5c98009290).stop 2021-12-17T18:24:16.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.070+0000 7f5ca650a700 1 -- 172.21.15.62:0/1123643096 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ca013e190 msgr2=0x7f5ca0066b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:16.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.070+0000 7f5ca650a700 1 --2- 172.21.15.62:0/1123643096 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ca013e190 0x7f5ca0066b20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f5c90002f70 tx=0x7f5c90014000).stop 2021-12-17T18:24:16.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.070+0000 7f5ca650a700 1 -- 172.21.15.62:0/1123643096 shutdown_connections 2021-12-17T18:24:16.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.070+0000 7f5ca650a700 1 --2- 172.21.15.62:0/1123643096 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c80053640 0x7f5c80055b00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.070+0000 7f5ca650a700 1 --2- 172.21.15.62:0/1123643096 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ca0140d00 0x7f5ca013be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.070+0000 7f5ca650a700 1 --2- 172.21.15.62:0/1123643096 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ca013e190 0x7f5ca0066b20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.070+0000 7f5ca650a700 1 --2- 172.21.15.62:0/1123643096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ca0063e00 0x7f5ca013fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.070+0000 7f5ca650a700 1 -- 172.21.15.62:0/1123643096 >> 172.21.15.62:0/1123643096 conn(0x7f5ca0060a50 msgr2=0x7f5ca00b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:16.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.070+0000 7f5ca650a700 1 -- 172.21.15.62:0/1123643096 shutdown_connections 2021-12-17T18:24:16.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.070+0000 7f5ca650a700 1 -- 172.21.15.62:0/1123643096 wait complete. 2021-12-17T18:24:16.084 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:24:16.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.198+0000 7f3c91fb0700 1 Processor -- start 2021-12-17T18:24:16.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.198+0000 7f3c91fb0700 1 -- start start 2021-12-17T18:24:16.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.198+0000 7f3c91fb0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3c8c066150 0x7f3c8c144520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:16.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.198+0000 7f3c91fb0700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f3c8c13a910 0x7f3c8c13ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:16.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c91fb0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8c05ce70 con 0x7f3c8c05ca90 2021-12-17T18:24:16.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c91fb0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8c0604c0 con 0x7f3c8c066150 2021-12-17T18:24:16.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c91fb0700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8c142080 con 0x7f3c8c13a910 2021-12-17T18:24:16.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c8bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3c8c066150 0x7f3c8c144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c8bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3c8c066150 0x7f3c8c144520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52324/0 (socket says 172.21.15.62:52324) 2021-12-17T18:24:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c8bfff700 1 -- 172.21.15.62:0/3073678783 learned_addr learned my addr 172.21.15.62:0/3073678783 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c917af700 1 --2- 172.21.15.62:0/3073678783 >> v2:172.21.15.109:3300/0 conn(0x7f3c8c13a910 0x7f3c8c13ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c8bfff700 1 -- 172.21.15.62:0/3073678783 >> v2:172.21.15.109:3300/0 conn(0x7f3c8c13a910 msgr2=0x7f3c8c13ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:16.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c8bfff700 1 --2- 172.21.15.62:0/3073678783 >> v2:172.21.15.109:3300/0 conn(0x7f3c8c13a910 0x7f3c8c13ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c8bfff700 1 -- 172.21.15.62:0/3073678783 >> v1:172.21.15.62:6789/0 conn(0x7f3c8c05ca90 legacy=0x7f3c8c065a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:16.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c8bfff700 1 -- 172.21.15.62:0/3073678783 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c0adb50 con 0x7f3c8c066150 2021-12-17T18:24:16.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c917af700 1 --2- 172.21.15.62:0/3073678783 >> v2:172.21.15.109:3300/0 conn(0x7f3c8c13a910 0x7f3c8c13ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:24:16.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c8bfff700 1 --2- 172.21.15.62:0/3073678783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c066150 0x7f3c8c144520 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f3c8c065920 tx=0x7f3c74006eb0).ready entity=mon.0 client_cookie=9bf0ccce4c6b4ab1 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:16.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c8b7fe700 1 -- 172.21.15.62:0/3073678783 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c7400d610 con 0x7f3c8c066150 2021-12-17T18:24:16.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c8b7fe700 1 -- 172.21.15.62:0/3073678783 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c74000e90 con 0x7f3c8c066150 2021-12-17T18:24:16.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c8b7fe700 1 -- 172.21.15.62:0/3073678783 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c7400d960 con 0x7f3c8c066150 2021-12-17T18:24:16.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c91fb0700 1 -- 172.21.15.62:0/3073678783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c066150 msgr2=0x7f3c8c144520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c91fb0700 1 --2- 172.21.15.62:0/3073678783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c066150 0x7f3c8c144520 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f3c8c065920 tx=0x7f3c74006eb0).stop 2021-12-17T18:24:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c91fb0700 1 -- 172.21.15.62:0/3073678783 shutdown_connections 2021-12-17T18:24:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c91fb0700 1 --2- 172.21.15.62:0/3073678783 >> v2:172.21.15.109:3300/0 conn(0x7f3c8c13a910 0x7f3c8c13ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c91fb0700 1 --2- 172.21.15.62:0/3073678783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c066150 0x7f3c8c144520 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c91fb0700 1 -- 172.21.15.62:0/3073678783 >> 172.21.15.62:0/3073678783 conn(0x7f3c8c05be70 msgr2=0x7f3c8c062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c91fb0700 1 -- 172.21.15.62:0/3073678783 shutdown_connections 2021-12-17T18:24:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c91fb0700 1 -- 172.21.15.62:0/3073678783 wait complete. 2021-12-17T18:24:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.202+0000 7f3c91fb0700 1 Processor -- start 2021-12-17T18:24:16.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c91fb0700 1 -- start start 2021-12-17T18:24:16.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c91fb0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c8c05ca90 0x7f3c8c146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:16.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c91fb0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3c8c066150 0x7f3c8c0afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:16.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c91fb0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c13a910 0x7f3c8c0aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:16.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c91fb0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c0b0b70 con 0x7f3c8c13a910 2021-12-17T18:24:16.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c91fb0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c0b0da0 con 0x7f3c8c066150 2021-12-17T18:24:16.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c91fb0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c0b1040 con 0x7f3c8c05ca90 2021-12-17T18:24:16.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c917af700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c13a910 0x7f3c8c0aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:16.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c917af700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c13a910 0x7f3c8c0aff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52332/0 (socket says 172.21.15.62:52332) 2021-12-17T18:24:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c917af700 1 -- 172.21.15.62:0/4050018130 learned_addr learned my addr 172.21.15.62:0/4050018130 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c8bfff700 1 --2- 172.21.15.62:0/4050018130 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3c8c066150 0x7f3c8c0afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c90fae700 1 --2- 172.21.15.62:0/4050018130 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c8c05ca90 0x7f3c8c146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c917af700 1 -- 172.21.15.62:0/4050018130 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c8c05ca90 msgr2=0x7f3c8c146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c917af700 1 --2- 172.21.15.62:0/4050018130 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c8c05ca90 0x7f3c8c146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c917af700 1 -- 172.21.15.62:0/4050018130 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3c8c066150 msgr2=0x7f3c8c0afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c917af700 1 --2- 172.21.15.62:0/4050018130 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3c8c066150 0x7f3c8c0afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c917af700 1 -- 172.21.15.62:0/4050018130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7400b1e0 con 0x7f3c8c13a910 2021-12-17T18:24:16.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c917af700 1 --2- 172.21.15.62:0/4050018130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c13a910 0x7f3c8c0aff30 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f3c84006cc0 tx=0x7f3c84008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:16.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c89ffb700 1 -- 172.21.15.62:0/4050018130 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c84011780 con 0x7f3c8c13a910 2021-12-17T18:24:16.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c89ffb700 1 -- 172.21.15.62:0/4050018130 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c840118e0 con 0x7f3c8c13a910 2021-12-17T18:24:16.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c91fb0700 1 -- 172.21.15.62:0/4050018130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8c0b1480 con 0x7f3c8c13a910 2021-12-17T18:24:16.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c89ffb700 1 -- 172.21.15.62:0/4050018130 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c84011c40 con 0x7f3c8c13a910 2021-12-17T18:24:16.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c91fb0700 1 -- 172.21.15.62:0/4050018130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8c0b6920 con 0x7f3c8c13a910 2021-12-17T18:24:16.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.206+0000 7f3c91fb0700 1 -- 172.21.15.62:0/4050018130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8c0b1610 con 0x7f3c8c13a910 2021-12-17T18:24:16.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.210+0000 7f3c89ffb700 1 -- 172.21.15.62:0/4050018130 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3c8401c460 con 0x7f3c8c13a910 2021-12-17T18:24:16.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.210+0000 7f3c89ffb700 1 --2- 172.21.15.62:0/4050018130 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c70053610 0x7f3c70055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:16.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.210+0000 7f3c89ffb700 1 -- 172.21.15.62:0/4050018130 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3c8406bf70 con 0x7f3c8c13a910 2021-12-17T18:24:16.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.210+0000 7f3c90fae700 1 --2- 172.21.15.62:0/4050018130 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c70053610 0x7f3c70055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:16.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.210+0000 7f3c90fae700 1 --2- 172.21.15.62:0/4050018130 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c70053610 0x7f3c70055ad0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f3c7c008000 tx=0x7f3c7c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:16.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.218+0000 7f3c89ffb700 1 -- 172.21.15.62:0/4050018130 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3c84042fd0 con 0x7f3c8c13a910 2021-12-17T18:24:16.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.346+0000 7f3c91fb0700 1 -- 172.21.15.62:0/4050018130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3c8c0b1200 con 0x7f3c8c13a910 2021-12-17T18:24:16.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.346+0000 7f3c89ffb700 1 -- 172.21.15.62:0/4050018130 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3c840465f0 con 0x7f3c8c13a910 2021-12-17T18:24:16.348 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:24:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.346+0000 7f3c91fb0700 1 -- 172.21.15.62:0/4050018130 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c70053610 msgr2=0x7f3c70055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.346+0000 7f3c91fb0700 1 --2- 172.21.15.62:0/4050018130 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c70053610 0x7f3c70055ad0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f3c7c008000 tx=0x7f3c7c009040).stop 2021-12-17T18:24:16.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.346+0000 7f3c91fb0700 1 -- 172.21.15.62:0/4050018130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c13a910 msgr2=0x7f3c8c0aff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:16.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.346+0000 7f3c91fb0700 1 --2- 172.21.15.62:0/4050018130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c13a910 0x7f3c8c0aff30 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f3c84006cc0 tx=0x7f3c84008040).stop 2021-12-17T18:24:16.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.346+0000 7f3c91fb0700 1 -- 172.21.15.62:0/4050018130 shutdown_connections 2021-12-17T18:24:16.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.346+0000 7f3c91fb0700 1 --2- 172.21.15.62:0/4050018130 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c70053610 0x7f3c70055ad0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.346+0000 7f3c91fb0700 1 --2- 172.21.15.62:0/4050018130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c13a910 0x7f3c8c0aff30 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.346+0000 7f3c91fb0700 1 --2- 172.21.15.62:0/4050018130 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3c8c066150 0x7f3c8c0afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.346+0000 7f3c91fb0700 1 --2- 172.21.15.62:0/4050018130 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c8c05ca90 0x7f3c8c146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.350+0000 7f3c91fb0700 1 -- 172.21.15.62:0/4050018130 >> 172.21.15.62:0/4050018130 conn(0x7f3c8c05be70 msgr2=0x7f3c8c140590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:16.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.350+0000 7f3c91fb0700 1 -- 172.21.15.62:0/4050018130 shutdown_connections 2021-12-17T18:24:16.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.350+0000 7f3c91fb0700 1 -- 172.21.15.62:0/4050018130 wait complete. 2021-12-17T18:24:16.368 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:24:16.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:24:16.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.470+0000 7f6fb12eb700 1 Processor -- start 2021-12-17T18:24:16.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.470+0000 7f6fb12eb700 1 -- start start 2021-12-17T18:24:16.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.470+0000 7f6fb12eb700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6fac0b6160 0x7f6fac142690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.470+0000 7f6fb12eb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6fac0b0830 0x7f6fac142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.470+0000 7f6fb12eb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fac0b6540 con 0x7f6fac0af220 2021-12-17T18:24:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.470+0000 7f6fb12eb700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fac0ae840 con 0x7f6fac0b6160 2021-12-17T18:24:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.470+0000 7f6fb12eb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac0aeae0 con 0x7f6fac0b0830 2021-12-17T18:24:16.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.470+0000 7f6fab7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6fac0af220 0x7f6fac0b2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35920/0 (socket says 172.21.15.62:35920) 2021-12-17T18:24:16.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.470+0000 7f6fab7fe700 1 -- 172.21.15.62:0/3366859868 learned_addr learned my addr 172.21.15.62:0/3366859868 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:16.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.470+0000 7f6faa7fc700 1 --2- 172.21.15.62:0/3366859868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6fac0b0830 0x7f6fac142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:16.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.470+0000 7f6faaffd700 1 --2- 172.21.15.62:0/3366859868 >> v2:172.21.15.109:3300/0 conn(0x7f6fac0b6160 0x7f6fac142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:16.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.470+0000 7f6fa9ffb700 1 -- 172.21.15.62:0/3366859868 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666453025 0 0) 0x7f6fac0b6540 con 0x7f6fac0af220 2021-12-17T18:24:16.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.470+0000 7f6fa9ffb700 1 -- 172.21.15.62:0/3366859868 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f8c003260 con 0x7f6fac0af220 2021-12-17T18:24:16.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.470+0000 7f6faa7fc700 1 -- 172.21.15.62:0/3366859868 >> v2:172.21.15.109:3300/0 conn(0x7f6fac0b6160 msgr2=0x7f6fac142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:16.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.470+0000 7f6faa7fc700 1 --2- 172.21.15.62:0/3366859868 >> v2:172.21.15.109:3300/0 conn(0x7f6fac0b6160 0x7f6fac142690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.474+0000 7f6faa7fc700 1 -- 172.21.15.62:0/3366859868 >> v1:172.21.15.62:6789/0 conn(0x7f6fac0af220 legacy=0x7f6fac0b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:16.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.474+0000 7f6faa7fc700 1 -- 172.21.15.62:0/3366859868 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac0aed80 con 0x7f6fac0b0830 2021-12-17T18:24:16.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.474+0000 7f6faa7fc700 1 --2- 172.21.15.62:0/3366859868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6fac0b0830 0x7f6fac142b80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f6fac062ce0 tx=0x7f6f94006df0).ready entity=mon.2 client_cookie=5a0adcff963c0350 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:16.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.474+0000 7f6fa9ffb700 1 -- 172.21.15.62:0/3366859868 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f9400d570 con 0x7f6fac0b0830 2021-12-17T18:24:16.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.474+0000 7f6fa9ffb700 1 -- 172.21.15.62:0/3366859868 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f94000e90 con 0x7f6fac0b0830 2021-12-17T18:24:16.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.474+0000 7f6fa9ffb700 1 -- 172.21.15.62:0/3366859868 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f9400d8c0 con 0x7f6fac0b0830 2021-12-17T18:24:16.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.474+0000 7f6fb12eb700 1 -- 172.21.15.62:0/3366859868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6fac0b0830 msgr2=0x7f6fac142b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:16.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.474+0000 7f6fb12eb700 1 --2- 172.21.15.62:0/3366859868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6fac0b0830 0x7f6fac142b80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f6fac062ce0 tx=0x7f6f94006df0).stop 2021-12-17T18:24:16.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.474+0000 7f6fb12eb700 1 -- 172.21.15.62:0/3366859868 shutdown_connections 2021-12-17T18:24:16.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.474+0000 7f6fb12eb700 1 --2- 172.21.15.62:0/3366859868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6fac0b0830 0x7f6fac142b80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.474+0000 7f6fb12eb700 1 --2- 172.21.15.62:0/3366859868 >> v2:172.21.15.109:3300/0 conn(0x7f6fac0b6160 0x7f6fac142690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.474+0000 7f6fb12eb700 1 -- 172.21.15.62:0/3366859868 >> 172.21.15.62:0/3366859868 conn(0x7f6fac05c750 msgr2=0x7f6fac0630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:16.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.474+0000 7f6fb12eb700 1 -- 172.21.15.62:0/3366859868 shutdown_connections 2021-12-17T18:24:16.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.474+0000 7f6fb12eb700 1 -- 172.21.15.62:0/3366859868 wait complete. 2021-12-17T18:24:16.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.474+0000 7f6fb12eb700 1 Processor -- start 2021-12-17T18:24:16.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6fb12eb700 1 -- start start 2021-12-17T18:24:16.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6fb12eb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fac0af220 0x7f6fac152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:16.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6fb12eb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6fac0b0830 0x7f6fac13eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:16.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6fb12eb700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6fac0b6160 0x7f6fac140610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:16.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6fb12eb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac141290 con 0x7f6fac0af220 2021-12-17T18:24:16.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6fb12eb700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac067de0 con 0x7f6fac0b6160 2021-12-17T18:24:16.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6fb12eb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac13fc30 con 0x7f6fac0b0830 2021-12-17T18:24:16.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6faaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fac0af220 0x7f6fac152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:16.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6faaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fac0af220 0x7f6fac152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52342/0 (socket says 172.21.15.62:52342) 2021-12-17T18:24:16.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6faaffd700 1 -- 172.21.15.62:0/2841648621 learned_addr learned my addr 172.21.15.62:0/2841648621 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:16.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6faa7fc700 1 --2- 172.21.15.62:0/2841648621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6fac0b0830 0x7f6fac13eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:16.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6fab7fe700 1 --2- 172.21.15.62:0/2841648621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6fac0b6160 0x7f6fac140610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:16.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6faaffd700 1 -- 172.21.15.62:0/2841648621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6fac0b0830 msgr2=0x7f6fac13eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:16.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6faaffd700 1 --2- 172.21.15.62:0/2841648621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6fac0b0830 0x7f6fac13eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6faaffd700 1 -- 172.21.15.62:0/2841648621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6fac0b6160 msgr2=0x7f6fac140610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:16.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6faaffd700 1 --2- 172.21.15.62:0/2841648621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6fac0b6160 0x7f6fac140610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6faaffd700 1 -- 172.21.15.62:0/2841648621 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9400b180 con 0x7f6fac0af220 2021-12-17T18:24:16.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6faa7fc700 1 --2- 172.21.15.62:0/2841648621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6fac0b0830 0x7f6fac13eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:24:16.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6faaffd700 1 --2- 172.21.15.62:0/2841648621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fac0af220 0x7f6fac152610 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f6fac067f70 tx=0x7f6f9c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:16.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6fa3fff700 1 -- 172.21.15.62:0/2841648621 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f9c011750 con 0x7f6fac0af220 2021-12-17T18:24:16.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6fa3fff700 1 -- 172.21.15.62:0/2841648621 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c0118b0 con 0x7f6fac0af220 2021-12-17T18:24:16.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6fb12eb700 1 -- 172.21.15.62:0/2841648621 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fac13fed0 con 0x7f6fac0af220 2021-12-17T18:24:16.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6fa3fff700 1 -- 172.21.15.62:0/2841648621 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f9c011c10 con 0x7f6fac0af220 2021-12-17T18:24:16.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.478+0000 7f6fb12eb700 1 -- 172.21.15.62:0/2841648621 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fac140b00 con 0x7f6fac0af220 2021-12-17T18:24:16.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.482+0000 7f6fb12eb700 1 -- 172.21.15.62:0/2841648621 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fac143070 con 0x7f6fac0af220 2021-12-17T18:24:16.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.482+0000 7f6fa3fff700 1 -- 172.21.15.62:0/2841648621 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6f9c011d70 con 0x7f6fac0af220 2021-12-17T18:24:16.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.482+0000 7f6fa3fff700 1 --2- 172.21.15.62:0/2841648621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6f90053580 0x7f6f90055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:16.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.482+0000 7f6fa3fff700 1 -- 172.21.15.62:0/2841648621 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6f9c06bd60 con 0x7f6fac0af220 2021-12-17T18:24:16.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.482+0000 7f6faa7fc700 1 --2- 172.21.15.62:0/2841648621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6f90053580 0x7f6f90055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:16.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.482+0000 7f6faa7fc700 1 --2- 172.21.15.62:0/2841648621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6f90053580 0x7f6f90055a40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f6f94018000 tx=0x7f6f94014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:16.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.490+0000 7f6fa3fff700 1 -- 172.21.15.62:0/2841648621 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6f9c042dc0 con 0x7f6fac0af220 2021-12-17T18:24:16.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.650+0000 7f6fb12eb700 1 -- 172.21.15.62:0/2841648621 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fac0573d0 con 0x7f6fac0af220 2021-12-17T18:24:16.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.650+0000 7f6fa3fff700 1 -- 172.21.15.62:0/2841648621 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f6f9c0463e0 con 0x7f6fac0af220 2021-12-17T18:24:16.653 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:16.654 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":32,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5672,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/2267359903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":2267359903},{"type":"v1","addr":"172.21.15.109:6835","nonce":2267359903}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:24:11.805782+0000","modified":"2021-12-17T18:24:12.808883+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6318":{"gid":6318,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/414220193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":414220193},{"type":"v1","addr":"172.21.15.62:6833","nonce":414220193}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-12-17T18:24:16.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.650+0000 7f6fb12eb700 1 -- 172.21.15.62:0/2841648621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6f90053580 msgr2=0x7f6f90055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:16.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.650+0000 7f6fb12eb700 1 --2- 172.21.15.62:0/2841648621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6f90053580 0x7f6f90055a40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f6f94018000 tx=0x7f6f94014000).stop 2021-12-17T18:24:16.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.650+0000 7f6fb12eb700 1 -- 172.21.15.62:0/2841648621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fac0af220 msgr2=0x7f6fac152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:16.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.650+0000 7f6fb12eb700 1 --2- 172.21.15.62:0/2841648621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fac0af220 0x7f6fac152610 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f6fac067f70 tx=0x7f6f9c006df0).stop 2021-12-17T18:24:16.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.654+0000 7f6fb12eb700 1 -- 172.21.15.62:0/2841648621 shutdown_connections 2021-12-17T18:24:16.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.654+0000 7f6fb12eb700 1 --2- 172.21.15.62:0/2841648621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6f90053580 0x7f6f90055a40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.654+0000 7f6fb12eb700 1 --2- 172.21.15.62:0/2841648621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6fac0b6160 0x7f6fac140610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.654+0000 7f6fb12eb700 1 --2- 172.21.15.62:0/2841648621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6fac0b0830 0x7f6fac13eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.654+0000 7f6fb12eb700 1 --2- 172.21.15.62:0/2841648621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fac0af220 0x7f6fac152610 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:16.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.654+0000 7f6fb12eb700 1 -- 172.21.15.62:0/2841648621 >> 172.21.15.62:0/2841648621 conn(0x7f6fac05c750 msgr2=0x7f6fac142460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:16.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.654+0000 7f6fb12eb700 1 -- 172.21.15.62:0/2841648621 shutdown_connections 2021-12-17T18:24:16.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:16.654+0000 7f6fb12eb700 1 -- 172.21.15.62:0/2841648621 wait complete. 2021-12-17T18:24:16.660 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 32 2021-12-17T18:24:16.869 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:24:11.805782+0000', 'modified': '2021-12-17T18:24:12.808883+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6318}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6318': {'gid': 6318, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/414220193', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 414220193}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 414220193}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:24:16.870 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:24:16.871 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:24:17.002 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":6318,"want_state":"up:active","state":"up:active","rank_uptime":5.1827377170000002,"mdsmap_epoch":32,"osdmap_epoch":71,"osdmap_epoch_barrier":70,"uptime":9.5145208350000008} 2021-12-17T18:24:17.003 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 6318, "mdsmap_epoch": 32, "osdmap_epoch": 71, "osdmap_epoch_barrier": 70, "rank_uptime": 5.182737717, "state": "up:active", "uptime": 9.514520835, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:24:17.006 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:24:17.007 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-12-17T18:24:17.007 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-12-17T18:24:17.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:17.009 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:24:17.023 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:24:17.084 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:24:17.085 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:24:17.098 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:24:17.099 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:24:17.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:17.100 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:24:17.151 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:24:17.151 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:24:17.156 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:24:17.173 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:24:17.173 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:24:17.229 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:24:17.230 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:24:17.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:17.231 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:24:17.232 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2021-12-17T18:24:17.223+0000 7f2ee80f9080 -1 init, newargv = 0x562800410050 newargc=9 2021-12-17T18:24:17.232 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14497]: starting ceph client 2021-12-17T18:24:17.241 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14497]: starting fuse 2021-12-17T18:24:18.340 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:24:18.358 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:24:18.358 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:24:18.414 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:24:18.415 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:24:18.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:18.416 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:24:18.423 INFO:teuthology.orchestra.run.smithi125.stdout:52 2021-12-17T18:24:18.424 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:24:18.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:18.425 DEBUG:teuthology.orchestra.run.smithi125:> sudo python3 -c ' 2021-12-17T18:24:18.425 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2021-12-17T18:24:18.426 DEBUG:teuthology.orchestra.run.smithi125:> import re 2021-12-17T18:24:18.426 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:24:18.426 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2021-12-17T18:24:18.427 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:24:18.427 DEBUG:teuthology.orchestra.run.smithi125:> def find_socket(client_name): 2021-12-17T18:24:18.428 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-12-17T18:24:18.428 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2021-12-17T18:24:18.429 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:24:18.429 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2021-12-17T18:24:18.429 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2021-12-17T18:24:18.430 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2021-12-17T18:24:18.430 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2021-12-17T18:24:18.430 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:24:18.431 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2021-12-17T18:24:18.431 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:24:18.432 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:24:18.432 DEBUG:teuthology.orchestra.run.smithi125:> return f 2021-12-17T18:24:18.432 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:24:18.433 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:24:18.433 DEBUG:teuthology.orchestra.run.smithi125:> print(find_socket("client.0")) 2021-12-17T18:24:18.434 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:24:18.478 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.14497.asok 2021-12-17T18:24:18.483 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14497.asok 2021-12-17T18:24:18.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:18.484 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14497.asok status 2021-12-17T18:24:18.574 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2021-12-17T18:24:18.575 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2021-12-17T18:24:18.575 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:24:18.575 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:24:18.576 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2021-12-17T18:24:18.576 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2021-12-17T18:24:18.576 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-12-17T18:24:18.577 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "14497", 2021-12-17T18:24:18.577 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2021-12-17T18:24:18.577 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:24:18.577 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2021-12-17T18:24:18.578 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2021-12-17T18:24:18.578 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 6492, 2021-12-17T18:24:18.578 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2021-12-17T18:24:18.578 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2021-12-17T18:24:18.579 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2021-12-17T18:24:18.579 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 6492 2021-12-17T18:24:18.579 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:24:18.579 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:24:18.580 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:24:18.580 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:24:18.580 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 479948347 2021-12-17T18:24:18.580 INFO:teuthology.orchestra.run.smithi125.stdout: } 2021-12-17T18:24:18.581 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:24:18.581 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:24:18.581 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:24:18.581 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:24:18.582 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 479948347 2021-12-17T18:24:18.582 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:24:18.582 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.6492 172.21.15.125:0/479948347", 2021-12-17T18:24:18.582 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "172.21.15.125:0/479948347", 2021-12-17T18:24:18.583 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2021-12-17T18:24:18.583 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 32, 2021-12-17T18:24:18.583 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 71, 2021-12-17T18:24:18.583 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:24:18.584 INFO:teuthology.orchestra.run.smithi125.stdout: "blacklisted": false, 2021-12-17T18:24:18.584 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2021-12-17T18:24:18.584 INFO:teuthology.orchestra.run.smithi125.stdout:} 2021-12-17T18:24:18.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:18.586 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:24:18.586 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:24:18.594 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:24:18.595 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:24:18.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:18.596 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:24:18.611 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:24:18.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbff025d700 1 Processor -- start 2021-12-17T18:24:18.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbff025d700 1 -- start start 2021-12-17T18:24:18.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbff025d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbfe80b21f0 0x7fbfe814aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:18.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbff025d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbfe80b1730 0x7fbfe80ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:18.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbff025d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fbfe80a7bb0 0x7fbfe8067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:18.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbff025d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe8147870 con 0x7fbfe80b1730 2021-12-17T18:24:18.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbff025d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe80b2ce0 con 0x7fbfe80a7bb0 2021-12-17T18:24:18.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbff025d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe80aca60 con 0x7fbfe80b21f0 2021-12-17T18:24:18.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbfed7f8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbfe80b1730 0x7fbfe80ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:18.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbfed7f8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbfe80b1730 0x7fbfe80ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52350/0 (socket says 172.21.15.62:52350) 2021-12-17T18:24:18.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbfed7f8700 1 -- 172.21.15.62:0/3642401195 learned_addr learned my addr 172.21.15.62:0/3642401195 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:18.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbfedff9700 1 --2- 172.21.15.62:0/3642401195 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbfe80b21f0 0x7fbfe814aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:18.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbfee7fa700 1 --2- 172.21.15.62:0/3642401195 >> v2:172.21.15.109:3300/0 conn(0x7fbfe80a7bb0 0x7fbfe8067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:18.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbfed7f8700 1 -- 172.21.15.62:0/3642401195 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbfe80b21f0 msgr2=0x7fbfe814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:18.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbfed7f8700 1 --2- 172.21.15.62:0/3642401195 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbfe80b21f0 0x7fbfe814aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:18.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbfed7f8700 1 -- 172.21.15.62:0/3642401195 >> v2:172.21.15.109:3300/0 conn(0x7fbfe80a7bb0 msgr2=0x7fbfe8067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:18.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbfed7f8700 1 --2- 172.21.15.62:0/3642401195 >> v2:172.21.15.109:3300/0 conn(0x7fbfe80a7bb0 0x7fbfe8067120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:18.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbfed7f8700 1 -- 172.21.15.62:0/3642401195 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe80b2f10 con 0x7fbfe80b1730 2021-12-17T18:24:18.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbfed7f8700 1 --2- 172.21.15.62:0/3642401195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfe80b1730 0x7fbfe80ace90 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fbfe00032f0 tx=0x7fbfe0009290).ready entity=mon.0 client_cookie=c8b56709d82d039c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:18.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbfecff7700 1 -- 172.21.15.62:0/3642401195 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfe000b870 con 0x7fbfe80b1730 2021-12-17T18:24:18.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbfecff7700 1 -- 172.21.15.62:0/3642401195 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe000b9d0 con 0x7fbfe80b1730 2021-12-17T18:24:18.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbfecff7700 1 -- 172.21.15.62:0/3642401195 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfe000bb40 con 0x7fbfe80b1730 2021-12-17T18:24:18.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbff025d700 1 -- 172.21.15.62:0/3642401195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfe80b1730 msgr2=0x7fbfe80ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:18.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbff025d700 1 --2- 172.21.15.62:0/3642401195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfe80b1730 0x7fbfe80ace90 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fbfe00032f0 tx=0x7fbfe0009290).stop 2021-12-17T18:24:18.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbff025d700 1 -- 172.21.15.62:0/3642401195 shutdown_connections 2021-12-17T18:24:18.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbff025d700 1 --2- 172.21.15.62:0/3642401195 >> v2:172.21.15.109:3300/0 conn(0x7fbfe80a7bb0 0x7fbfe8067120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:18.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbff025d700 1 --2- 172.21.15.62:0/3642401195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfe80b1730 0x7fbfe80ace90 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:18.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbff025d700 1 --2- 172.21.15.62:0/3642401195 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbfe80b21f0 0x7fbfe814aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:18.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbff025d700 1 -- 172.21.15.62:0/3642401195 >> 172.21.15.62:0/3642401195 conn(0x7fbfe805f730 msgr2=0x7fbfe805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:18.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbff025d700 1 -- 172.21.15.62:0/3642401195 shutdown_connections 2021-12-17T18:24:18.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.722+0000 7fbff025d700 1 -- 172.21.15.62:0/3642401195 wait complete. 2021-12-17T18:24:18.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbff025d700 1 Processor -- start 2021-12-17T18:24:18.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbff025d700 1 -- start start 2021-12-17T18:24:18.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbff025d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfe80a7bb0 0x7fbfe8156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:18.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbff025d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbfe80b1730 0x7fbfe80aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:18.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbff025d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbfe80b21f0 0x7fbfe8065e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:18.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbff025d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe8065420 con 0x7fbfe80a7bb0 2021-12-17T18:24:18.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbff025d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe80656c0 con 0x7fbfe80b21f0 2021-12-17T18:24:18.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbff025d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe8065960 con 0x7fbfe80b1730 2021-12-17T18:24:18.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbfedff9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfe80a7bb0 0x7fbfe8156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:18.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbfedff9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfe80a7bb0 0x7fbfe8156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52360/0 (socket says 172.21.15.62:52360) 2021-12-17T18:24:18.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbfedff9700 1 -- 172.21.15.62:0/744090778 learned_addr learned my addr 172.21.15.62:0/744090778 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:18.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbfee7fa700 1 --2- 172.21.15.62:0/744090778 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbfe80b21f0 0x7fbfe8065e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:18.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbfed7f8700 1 --2- 172.21.15.62:0/744090778 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbfe80b1730 0x7fbfe80aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:18.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbfedff9700 1 -- 172.21.15.62:0/744090778 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbfe80b1730 msgr2=0x7fbfe80aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:18.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbfedff9700 1 --2- 172.21.15.62:0/744090778 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbfe80b1730 0x7fbfe80aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:18.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbfedff9700 1 -- 172.21.15.62:0/744090778 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbfe80b21f0 msgr2=0x7fbfe8065e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:18.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbfedff9700 1 --2- 172.21.15.62:0/744090778 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbfe80b21f0 0x7fbfe8065e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:18.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbfedff9700 1 -- 172.21.15.62:0/744090778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe0009530 con 0x7fbfe80a7bb0 2021-12-17T18:24:18.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbfedff9700 1 --2- 172.21.15.62:0/744090778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfe80a7bb0 0x7fbfe8156c60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fbfe40030b0 tx=0x7fbfe4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:18.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbfdeffd700 1 -- 172.21.15.62:0/744090778 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfe4011780 con 0x7fbfe80a7bb0 2021-12-17T18:24:18.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbfdeffd700 1 -- 172.21.15.62:0/744090778 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe40118e0 con 0x7fbfe80a7bb0 2021-12-17T18:24:18.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.726+0000 7fbff025d700 1 -- 172.21.15.62:0/744090778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe80662f0 con 0x7fbfe80a7bb0 2021-12-17T18:24:18.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.730+0000 7fbfdeffd700 1 -- 172.21.15.62:0/744090778 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfe4011c40 con 0x7fbfe80a7bb0 2021-12-17T18:24:18.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.730+0000 7fbff025d700 1 -- 172.21.15.62:0/744090778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe80ac410 con 0x7fbfe80a7bb0 2021-12-17T18:24:18.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.730+0000 7fbff025d700 1 -- 172.21.15.62:0/744090778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe8065b20 con 0x7fbfe80a7bb0 2021-12-17T18:24:18.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.730+0000 7fbfdeffd700 1 -- 172.21.15.62:0/744090778 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbfe4012420 con 0x7fbfe80a7bb0 2021-12-17T18:24:18.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.730+0000 7fbfdeffd700 1 --2- 172.21.15.62:0/744090778 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbfc80536a0 0x7fbfc8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:18.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.730+0000 7fbfdeffd700 1 -- 172.21.15.62:0/744090778 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbfe406b680 con 0x7fbfe80a7bb0 2021-12-17T18:24:18.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.730+0000 7fbfed7f8700 1 --2- 172.21.15.62:0/744090778 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbfc80536a0 0x7fbfc8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:18.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.730+0000 7fbfed7f8700 1 --2- 172.21.15.62:0/744090778 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbfc80536a0 0x7fbfc8055b60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fbfe001b000 tx=0x7fbfe0016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:18.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.738+0000 7fbfdeffd700 1 -- 172.21.15.62:0/744090778 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbfe4042780 con 0x7fbfe80a7bb0 2021-12-17T18:24:18.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.862+0000 7fbff025d700 1 -- 172.21.15.62:0/744090778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfe80573d0 con 0x7fbfe80a7bb0 2021-12-17T18:24:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.866+0000 7fbfdeffd700 1 -- 172.21.15.62:0/744090778 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fbfe4045da0 con 0x7fbfe80a7bb0 2021-12-17T18:24:18.868 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:18.868 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":71,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:24:12.809524+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:24:10.413185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-12-17T18:24:11.229328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:24:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.866+0000 7fbff025d700 1 -- 172.21.15.62:0/744090778 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbfc80536a0 msgr2=0x7fbfc8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.866+0000 7fbff025d700 1 --2- 172.21.15.62:0/744090778 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbfc80536a0 0x7fbfc8055b60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fbfe001b000 tx=0x7fbfe0016000).stop 2021-12-17T18:24:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.866+0000 7fbff025d700 1 -- 172.21.15.62:0/744090778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfe80a7bb0 msgr2=0x7fbfe8156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:18.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.866+0000 7fbff025d700 1 --2- 172.21.15.62:0/744090778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfe80a7bb0 0x7fbfe8156c60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fbfe40030b0 tx=0x7fbfe4008040).stop 2021-12-17T18:24:18.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.866+0000 7fbff025d700 1 -- 172.21.15.62:0/744090778 shutdown_connections 2021-12-17T18:24:18.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.866+0000 7fbff025d700 1 --2- 172.21.15.62:0/744090778 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbfc80536a0 0x7fbfc8055b60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:18.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.866+0000 7fbff025d700 1 --2- 172.21.15.62:0/744090778 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbfe80b21f0 0x7fbfe8065e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:18.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.866+0000 7fbff025d700 1 --2- 172.21.15.62:0/744090778 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbfe80b1730 0x7fbfe80aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:18.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.866+0000 7fbff025d700 1 --2- 172.21.15.62:0/744090778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfe80a7bb0 0x7fbfe8156c60 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:18.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.866+0000 7fbff025d700 1 -- 172.21.15.62:0/744090778 >> 172.21.15.62:0/744090778 conn(0x7fbfe805f730 msgr2=0x7fbfe80afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:18.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.866+0000 7fbff025d700 1 -- 172.21.15.62:0/744090778 shutdown_connections 2021-12-17T18:24:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.866+0000 7fbff025d700 1 -- 172.21.15.62:0/744090778 wait complete. 2021-12-17T18:24:18.881 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:24:10.413185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:24:11.229328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:24:18.882 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:24:18.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691c3e4700 1 Processor -- start 2021-12-17T18:24:18.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691c3e4700 1 -- start start 2021-12-17T18:24:18.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691c3e4700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6914143720 0x7f6914149e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:18.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691c3e4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69140b2110 con 0x7f69140b67e0 2021-12-17T18:24:19.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691c3e4700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69140b00f0 con 0x7f69140b6400 2021-12-17T18:24:19.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691c3e4700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69140ae980 con 0x7f6914143720 2021-12-17T18:24:19.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691997f700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f69140b67e0 0x7f6914143010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35946/0 (socket says 172.21.15.62:35946) 2021-12-17T18:24:19.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691997f700 1 -- 172.21.15.62:0/3441303644 learned_addr learned my addr 172.21.15.62:0/3441303644 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:19.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691a981700 1 --2- 172.21.15.62:0/3441303644 >> v2:172.21.15.109:3300/0 conn(0x7f6914143720 0x7f6914149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691917e700 1 -- 172.21.15.62:0/3441303644 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866524404 0 0) 0x7f69140b2110 con 0x7f69140b67e0 2021-12-17T18:24:19.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691917e700 1 -- 172.21.15.62:0/3441303644 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68fc003260 con 0x7f69140b67e0 2021-12-17T18:24:19.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691917e700 1 -- 172.21.15.62:0/3441303644 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173185525 0 0) 0x7f69140b00f0 con 0x7f69140b6400 2021-12-17T18:24:19.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691917e700 1 -- 172.21.15.62:0/3441303644 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69140b2110 con 0x7f69140b6400 2021-12-17T18:24:19.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691917e700 1 -- 172.21.15.62:0/3441303644 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3417123857 0 0) 0x7f68fc003260 con 0x7f69140b67e0 2021-12-17T18:24:19.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691a981700 1 -- 172.21.15.62:0/3441303644 >> v1:172.21.15.109:6789/0 conn(0x7f69140b6400 legacy=0x7f69140af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691a981700 1 -- 172.21.15.62:0/3441303644 >> v1:172.21.15.62:6789/0 conn(0x7f69140b67e0 legacy=0x7f6914143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691a981700 1 -- 172.21.15.62:0/3441303644 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69140b0390 con 0x7f6914143720 2021-12-17T18:24:19.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691a981700 1 --2- 172.21.15.62:0/3441303644 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6914143720 0x7f6914149e70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f6904001110 tx=0x7f690c00a370).ready entity=mon.1 client_cookie=22a554f59e44d64d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:19.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691917e700 1 -- 172.21.15.62:0/3441303644 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6904001660 con 0x7f6914143720 2021-12-17T18:24:19.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691917e700 1 -- 172.21.15.62:0/3441303644 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690c00c870 con 0x7f6914143720 2021-12-17T18:24:19.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691917e700 1 -- 172.21.15.62:0/3441303644 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f690c00cbd0 con 0x7f6914143720 2021-12-17T18:24:19.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691c3e4700 1 -- 172.21.15.62:0/3441303644 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6914143720 msgr2=0x7f6914149e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.994+0000 7f691c3e4700 1 --2- 172.21.15.62:0/3441303644 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6914143720 0x7f6914149e70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f6904001110 tx=0x7f690c00a370).stop 2021-12-17T18:24:19.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691c3e4700 1 -- 172.21.15.62:0/3441303644 shutdown_connections 2021-12-17T18:24:19.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691c3e4700 1 --2- 172.21.15.62:0/3441303644 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6914143720 0x7f6914149e70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691c3e4700 1 -- 172.21.15.62:0/3441303644 >> 172.21.15.62:0/3441303644 conn(0x7f691405c8f0 msgr2=0x7f69140b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:19.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691c3e4700 1 -- 172.21.15.62:0/3441303644 shutdown_connections 2021-12-17T18:24:19.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691c3e4700 1 -- 172.21.15.62:0/3441303644 wait complete. 2021-12-17T18:24:19.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691c3e4700 1 Processor -- start 2021-12-17T18:24:19.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691c3e4700 1 -- start start 2021-12-17T18:24:19.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691c3e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69140b6400 0x7f69140663d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691c3e4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69140b67e0 0x7f6914064ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691c3e4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6914143720 0x7f69140634b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691c3e4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6914147e10 con 0x7f69140b6400 2021-12-17T18:24:19.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691c3e4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6914144cb0 con 0x7f6914143720 2021-12-17T18:24:19.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691c3e4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6914144f50 con 0x7f69140b67e0 2021-12-17T18:24:19.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691a180700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69140b6400 0x7f69140663d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691a180700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69140b6400 0x7f69140663d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52370/0 (socket says 172.21.15.62:52370) 2021-12-17T18:24:19.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691a180700 1 -- 172.21.15.62:0/1397409155 learned_addr learned my addr 172.21.15.62:0/1397409155 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:19.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691a981700 1 --2- 172.21.15.62:0/1397409155 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6914143720 0x7f69140634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691997f700 1 --2- 172.21.15.62:0/1397409155 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69140b67e0 0x7f6914064ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691a180700 1 -- 172.21.15.62:0/1397409155 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69140b67e0 msgr2=0x7f6914064ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691a180700 1 --2- 172.21.15.62:0/1397409155 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69140b67e0 0x7f6914064ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691a180700 1 -- 172.21.15.62:0/1397409155 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6914143720 msgr2=0x7f69140634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691a180700 1 --2- 172.21.15.62:0/1397409155 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6914143720 0x7f69140634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691a180700 1 -- 172.21.15.62:0/1397409155 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c00a610 con 0x7f69140b6400 2021-12-17T18:24:19.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691997f700 1 --2- 172.21.15.62:0/1397409155 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69140b67e0 0x7f6914064ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:24:19.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691a180700 1 --2- 172.21.15.62:0/1397409155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69140b6400 0x7f69140663d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f6910001110 tx=0x7f6910007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:19.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f69037fe700 1 -- 172.21.15.62:0/1397409155 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f691000f470 con 0x7f69140b6400 2021-12-17T18:24:19.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f69037fe700 1 -- 172.21.15.62:0/1397409155 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691000f5d0 con 0x7f69140b6400 2021-12-17T18:24:19.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691c3e4700 1 -- 172.21.15.62:0/1397409155 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69140639a0 con 0x7f69140b6400 2021-12-17T18:24:19.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f69037fe700 1 -- 172.21.15.62:0/1397409155 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f691000f930 con 0x7f69140b6400 2021-12-17T18:24:19.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:18.998+0000 7f691c3e4700 1 -- 172.21.15.62:0/1397409155 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6914145ab0 con 0x7f69140b6400 2021-12-17T18:24:19.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.002+0000 7f691c3e4700 1 -- 172.21.15.62:0/1397409155 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69140573d0 con 0x7f69140b6400 2021-12-17T18:24:19.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.002+0000 7f69037fe700 1 -- 172.21.15.62:0/1397409155 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6910019030 con 0x7f69140b6400 2021-12-17T18:24:19.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.002+0000 7f69037fe700 1 --2- 172.21.15.62:0/1397409155 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68f4053580 0x7f68f4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.002+0000 7f69037fe700 1 -- 172.21.15.62:0/1397409155 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f691006af70 con 0x7f69140b6400 2021-12-17T18:24:19.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.002+0000 7f691997f700 1 --2- 172.21.15.62:0/1397409155 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68f4053580 0x7f68f4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.002+0000 7f691997f700 1 --2- 172.21.15.62:0/1397409155 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68f4053580 0x7f68f4055a40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f6904008000 tx=0x7f6904009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:19.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.006+0000 7f69037fe700 1 -- 172.21.15.62:0/1397409155 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6910041fc0 con 0x7f69140b6400 2021-12-17T18:24:19.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.134+0000 7f691c3e4700 1 -- 172.21.15.62:0/1397409155 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f69140630c0 con 0x7f69140b6400 2021-12-17T18:24:19.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.134+0000 7f69037fe700 1 -- 172.21.15.62:0/1397409155 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v71) v1 ==== 110+0+10 (secure 0 0 0) 0x7f69100455e0 con 0x7f69140b6400 2021-12-17T18:24:19.139 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:24:19.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.138+0000 7f691c3e4700 1 -- 172.21.15.62:0/1397409155 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68f4053580 msgr2=0x7f68f4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.138+0000 7f691c3e4700 1 --2- 172.21.15.62:0/1397409155 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68f4053580 0x7f68f4055a40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f6904008000 tx=0x7f6904009040).stop 2021-12-17T18:24:19.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.138+0000 7f691c3e4700 1 -- 172.21.15.62:0/1397409155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69140b6400 msgr2=0x7f69140663d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.138+0000 7f691c3e4700 1 --2- 172.21.15.62:0/1397409155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69140b6400 0x7f69140663d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f6910001110 tx=0x7f6910007ae0).stop 2021-12-17T18:24:19.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.138+0000 7f691c3e4700 1 -- 172.21.15.62:0/1397409155 shutdown_connections 2021-12-17T18:24:19.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.138+0000 7f691c3e4700 1 --2- 172.21.15.62:0/1397409155 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68f4053580 0x7f68f4055a40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.138+0000 7f691c3e4700 1 --2- 172.21.15.62:0/1397409155 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6914143720 0x7f69140634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.138+0000 7f691c3e4700 1 --2- 172.21.15.62:0/1397409155 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69140b67e0 0x7f6914064ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.138+0000 7f691c3e4700 1 --2- 172.21.15.62:0/1397409155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69140b6400 0x7f69140663d0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.138+0000 7f691c3e4700 1 -- 172.21.15.62:0/1397409155 >> 172.21.15.62:0/1397409155 conn(0x7f691405c8f0 msgr2=0x7f6914066c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:19.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.138+0000 7f691c3e4700 1 -- 172.21.15.62:0/1397409155 shutdown_connections 2021-12-17T18:24:19.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.138+0000 7f691c3e4700 1 -- 172.21.15.62:0/1397409155 wait complete. 2021-12-17T18:24:19.152 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:24:19.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.262+0000 7f1fb7031700 1 Processor -- start 2021-12-17T18:24:19.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.262+0000 7f1fb7031700 1 -- start start 2021-12-17T18:24:19.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb7031700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1fb00b1160 0x7f1fb0142190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb7031700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1fb0142680 0x7f1fb0142af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb7031700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb005fe50 con 0x7f1fb005fa70 2021-12-17T18:24:19.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb7031700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb0061df0 con 0x7f1fb00b1160 2021-12-17T18:24:19.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb7031700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb0064520 con 0x7f1fb0142680 2021-12-17T18:24:19.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb582e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1fb00b1160 0x7f1fb0142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb582e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1fb00b1160 0x7f1fb0142190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52378/0 (socket says 172.21.15.62:52378) 2021-12-17T18:24:19.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb582e700 1 -- 172.21.15.62:0/3092816197 learned_addr learned my addr 172.21.15.62:0/3092816197 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:19.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb6830700 1 --2- 172.21.15.62:0/3092816197 >> v2:172.21.15.109:3300/0 conn(0x7f1fb0142680 0x7f1fb0142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb582e700 1 -- 172.21.15.62:0/3092816197 >> v2:172.21.15.109:3300/0 conn(0x7f1fb0142680 msgr2=0x7f1fb0142af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:19.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb582e700 1 --2- 172.21.15.62:0/3092816197 >> v2:172.21.15.109:3300/0 conn(0x7f1fb0142680 0x7f1fb0142af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb582e700 1 -- 172.21.15.62:0/3092816197 >> v1:172.21.15.109:6789/0 conn(0x7f1fb005fa70 legacy=0x7f1fb0064910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:19.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb582e700 1 -- 172.21.15.62:0/3092816197 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb0061390 con 0x7f1fb00b1160 2021-12-17T18:24:19.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb6830700 1 --2- 172.21.15.62:0/3092816197 >> v2:172.21.15.109:3300/0 conn(0x7f1fb0142680 0x7f1fb0142af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:24:19.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb582e700 1 --2- 172.21.15.62:0/3092816197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fb00b1160 0x7f1fb0142190 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f1fb00685f0 tx=0x7f1fa0006eb0).ready entity=mon.0 client_cookie=56dd07b236d5f0cc server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:19.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb502d700 1 -- 172.21.15.62:0/3092816197 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fa000d5c0 con 0x7f1fb00b1160 2021-12-17T18:24:19.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb502d700 1 -- 172.21.15.62:0/3092816197 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa0000e90 con 0x7f1fb00b1160 2021-12-17T18:24:19.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb502d700 1 -- 172.21.15.62:0/3092816197 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fa000d910 con 0x7f1fb00b1160 2021-12-17T18:24:19.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb7031700 1 -- 172.21.15.62:0/3092816197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fb00b1160 msgr2=0x7f1fb0142190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb7031700 1 --2- 172.21.15.62:0/3092816197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fb00b1160 0x7f1fb0142190 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f1fb00685f0 tx=0x7f1fa0006eb0).stop 2021-12-17T18:24:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb7031700 1 -- 172.21.15.62:0/3092816197 shutdown_connections 2021-12-17T18:24:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb7031700 1 --2- 172.21.15.62:0/3092816197 >> v2:172.21.15.109:3300/0 conn(0x7f1fb0142680 0x7f1fb0142af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb7031700 1 --2- 172.21.15.62:0/3092816197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fb00b1160 0x7f1fb0142190 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb7031700 1 -- 172.21.15.62:0/3092816197 >> 172.21.15.62:0/3092816197 conn(0x7f1fb0063510 msgr2=0x7f1fb00638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:19.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb7031700 1 -- 172.21.15.62:0/3092816197 shutdown_connections 2021-12-17T18:24:19.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb7031700 1 -- 172.21.15.62:0/3092816197 wait complete. 2021-12-17T18:24:19.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb7031700 1 Processor -- start 2021-12-17T18:24:19.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.266+0000 7f1fb7031700 1 -- start start 2021-12-17T18:24:19.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb7031700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fb005fa70 0x7f1fb00b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb7031700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fb00b1160 0x7f1fb0155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb7031700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fb0142680 0x7f1fb0116020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb7031700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb0115bf0 con 0x7f1fb0142680 2021-12-17T18:24:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb7031700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00af900 con 0x7f1fb005fa70 2021-12-17T18:24:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb7031700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00afba0 con 0x7f1fb00b1160 2021-12-17T18:24:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb6830700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fb0142680 0x7f1fb0116020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb6830700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fb0142680 0x7f1fb0116020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52388/0 (socket says 172.21.15.62:52388) 2021-12-17T18:24:19.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb6830700 1 -- 172.21.15.62:0/3200975627 learned_addr learned my addr 172.21.15.62:0/3200975627 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:19.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb582e700 1 --2- 172.21.15.62:0/3200975627 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fb00b1160 0x7f1fb0155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb602f700 1 --2- 172.21.15.62:0/3200975627 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fb005fa70 0x7f1fb00b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb6830700 1 -- 172.21.15.62:0/3200975627 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fb00b1160 msgr2=0x7f1fb0155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb6830700 1 --2- 172.21.15.62:0/3200975627 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fb00b1160 0x7f1fb0155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb6830700 1 -- 172.21.15.62:0/3200975627 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fb005fa70 msgr2=0x7f1fb00b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb6830700 1 --2- 172.21.15.62:0/3200975627 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fb005fa70 0x7f1fb00b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb6830700 1 -- 172.21.15.62:0/3200975627 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa000b1e0 con 0x7f1fb0142680 2021-12-17T18:24:19.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb6830700 1 --2- 172.21.15.62:0/3200975627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fb0142680 0x7f1fb0116020 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f1fa8007000 tx=0x7f1fa8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:19.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1f9f7fe700 1 -- 172.21.15.62:0/3200975627 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fa800e510 con 0x7f1fb0142680 2021-12-17T18:24:19.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1f9f7fe700 1 -- 172.21.15.62:0/3200975627 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa800e670 con 0x7f1fb0142680 2021-12-17T18:24:19.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb7031700 1 -- 172.21.15.62:0/3200975627 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb0114710 con 0x7f1fb0142680 2021-12-17T18:24:19.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1f9f7fe700 1 -- 172.21.15.62:0/3200975627 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fa800e9d0 con 0x7f1fb0142680 2021-12-17T18:24:19.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1fb7031700 1 -- 172.21.15.62:0/3200975627 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb00af520 con 0x7f1fb0142680 2021-12-17T18:24:19.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.270+0000 7f1f9f7fe700 1 -- 172.21.15.62:0/3200975627 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1fa8019030 con 0x7f1fb0142680 2021-12-17T18:24:19.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.274+0000 7f1fb7031700 1 -- 172.21.15.62:0/3200975627 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb0061630 con 0x7f1fb0142680 2021-12-17T18:24:19.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.274+0000 7f1f9f7fe700 1 --2- 172.21.15.62:0/3200975627 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1f90053610 0x7f1f90055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.274+0000 7f1f9f7fe700 1 -- 172.21.15.62:0/3200975627 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1fa806b780 con 0x7f1fb0142680 2021-12-17T18:24:19.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.274+0000 7f1fb602f700 1 --2- 172.21.15.62:0/3200975627 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1f90053610 0x7f1f90055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.274+0000 7f1fb602f700 1 --2- 172.21.15.62:0/3200975627 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1f90053610 0x7f1f90055ad0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f1fac00d000 tx=0x7f1fac007b70).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:19.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.278+0000 7f1f9f7fe700 1 -- 172.21.15.62:0/3200975627 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1fa8042840 con 0x7f1fb0142680 2021-12-17T18:24:19.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.406+0000 7f1fb7031700 1 -- 172.21.15.62:0/3200975627 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1fb00573d0 con 0x7f1fb0142680 2021-12-17T18:24:19.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.410+0000 7f1f9f7fe700 1 -- 172.21.15.62:0/3200975627 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v71) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1fa8045e60 con 0x7f1fb0142680 2021-12-17T18:24:19.412 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:24:19.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.410+0000 7f1fb7031700 1 -- 172.21.15.62:0/3200975627 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1f90053610 msgr2=0x7f1f90055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.410+0000 7f1fb7031700 1 --2- 172.21.15.62:0/3200975627 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1f90053610 0x7f1f90055ad0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f1fac00d000 tx=0x7f1fac007b70).stop 2021-12-17T18:24:19.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.410+0000 7f1fb7031700 1 -- 172.21.15.62:0/3200975627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fb0142680 msgr2=0x7f1fb0116020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.410+0000 7f1fb7031700 1 --2- 172.21.15.62:0/3200975627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fb0142680 0x7f1fb0116020 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f1fa8007000 tx=0x7f1fa8008040).stop 2021-12-17T18:24:19.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.410+0000 7f1fb7031700 1 -- 172.21.15.62:0/3200975627 shutdown_connections 2021-12-17T18:24:19.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.410+0000 7f1fb7031700 1 --2- 172.21.15.62:0/3200975627 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1f90053610 0x7f1f90055ad0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.410+0000 7f1fb7031700 1 --2- 172.21.15.62:0/3200975627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fb0142680 0x7f1fb0116020 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.410+0000 7f1fb7031700 1 --2- 172.21.15.62:0/3200975627 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fb00b1160 0x7f1fb0155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.410+0000 7f1fb7031700 1 --2- 172.21.15.62:0/3200975627 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fb005fa70 0x7f1fb00b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.410+0000 7f1fb7031700 1 -- 172.21.15.62:0/3200975627 >> 172.21.15.62:0/3200975627 conn(0x7f1fb0063510 msgr2=0x7f1fb01432e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:19.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.410+0000 7f1fb7031700 1 -- 172.21.15.62:0/3200975627 shutdown_connections 2021-12-17T18:24:19.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.410+0000 7f1fb7031700 1 -- 172.21.15.62:0/3200975627 wait complete. 2021-12-17T18:24:19.425 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:24:19.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f2797093700 1 Processor -- start 2021-12-17T18:24:19.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f2797093700 1 -- start start 2021-12-17T18:24:19.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f2797093700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f279005ca90 0x7f27900b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f2797093700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27900b40b0 0x7f2790143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f2797093700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27900b0870 con 0x7f27900b47c0 2021-12-17T18:24:19.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f2797093700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279005ce70 con 0x7f279005ca90 2021-12-17T18:24:19.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f2797093700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27900b05d0 con 0x7f27900b40b0 2021-12-17T18:24:19.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f2796091700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f279005ca90 0x7f27900b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f2796091700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f279005ca90 0x7f27900b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52392/0 (socket says 172.21.15.62:52392) 2021-12-17T18:24:19.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f2796091700 1 -- 172.21.15.62:0/3101249601 learned_addr learned my addr 172.21.15.62:0/3101249601 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:19.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f2796892700 1 --2- 172.21.15.62:0/3101249601 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27900b40b0 0x7f2790143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f2796091700 1 -- 172.21.15.62:0/3101249601 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27900b40b0 msgr2=0x7f2790143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:19.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f2796091700 1 --2- 172.21.15.62:0/3101249601 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27900b40b0 0x7f2790143ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f2796091700 1 -- 172.21.15.62:0/3101249601 >> v1:172.21.15.109:6789/0 conn(0x7f27900b47c0 legacy=0x7f27900b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f2796091700 1 -- 172.21.15.62:0/3101249601 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27900b5250 con 0x7f279005ca90 2021-12-17T18:24:19.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f2796091700 1 --2- 172.21.15.62:0/3101249601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f279005ca90 0x7f27900b1d60 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f278c002f70 tx=0x7f278c006eb0).ready entity=mon.0 client_cookie=e4801dc39c476188 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:19.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f279508f700 1 -- 172.21.15.62:0/3101249601 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f278c00d5c0 con 0x7f279005ca90 2021-12-17T18:24:19.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f279508f700 1 -- 172.21.15.62:0/3101249601 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c000e90 con 0x7f279005ca90 2021-12-17T18:24:19.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.530+0000 7f279508f700 1 -- 172.21.15.62:0/3101249601 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f278c00d950 con 0x7f279005ca90 2021-12-17T18:24:19.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2797093700 1 -- 172.21.15.62:0/3101249601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f279005ca90 msgr2=0x7f27900b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2797093700 1 --2- 172.21.15.62:0/3101249601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f279005ca90 0x7f27900b1d60 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f278c002f70 tx=0x7f278c006eb0).stop 2021-12-17T18:24:19.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2797093700 1 -- 172.21.15.62:0/3101249601 shutdown_connections 2021-12-17T18:24:19.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2797093700 1 --2- 172.21.15.62:0/3101249601 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27900b40b0 0x7f2790143ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2797093700 1 --2- 172.21.15.62:0/3101249601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f279005ca90 0x7f27900b1d60 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2797093700 1 -- 172.21.15.62:0/3101249601 >> 172.21.15.62:0/3101249601 conn(0x7f279005bcd0 msgr2=0x7f2790062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:19.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2797093700 1 -- 172.21.15.62:0/3101249601 shutdown_connections 2021-12-17T18:24:19.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2797093700 1 -- 172.21.15.62:0/3101249601 wait complete. 2021-12-17T18:24:19.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2797093700 1 Processor -- start 2021-12-17T18:24:19.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2797093700 1 -- start start 2021-12-17T18:24:19.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2797093700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f279005ca90 0x7f2790155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2797093700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27900b40b0 0x7f2790144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2797093700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27900b47c0 0x7f27900af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2797093700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27900637d0 con 0x7f27900b40b0 2021-12-17T18:24:19.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2797093700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2790063530 con 0x7f279005ca90 2021-12-17T18:24:19.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2797093700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2790064590 con 0x7f27900b47c0 2021-12-17T18:24:19.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2795890700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27900b40b0 0x7f2790144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2795890700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27900b40b0 0x7f2790144a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52400/0 (socket says 172.21.15.62:52400) 2021-12-17T18:24:19.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2795890700 1 -- 172.21.15.62:0/1988528341 learned_addr learned my addr 172.21.15.62:0/1988528341 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:19.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2796892700 1 --2- 172.21.15.62:0/1988528341 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27900b47c0 0x7f27900af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2796091700 1 --2- 172.21.15.62:0/1988528341 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f279005ca90 0x7f2790155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2795890700 1 -- 172.21.15.62:0/1988528341 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27900b47c0 msgr2=0x7f27900af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2795890700 1 --2- 172.21.15.62:0/1988528341 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27900b47c0 0x7f27900af4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2795890700 1 -- 172.21.15.62:0/1988528341 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f279005ca90 msgr2=0x7f2790155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2795890700 1 --2- 172.21.15.62:0/1988528341 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f279005ca90 0x7f2790155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2795890700 1 -- 172.21.15.62:0/1988528341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c00b1e0 con 0x7f27900b40b0 2021-12-17T18:24:19.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.534+0000 7f2796892700 1 --2- 172.21.15.62:0/1988528341 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27900b47c0 0x7f27900af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:24:19.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.538+0000 7f2795890700 1 --2- 172.21.15.62:0/1988528341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27900b40b0 0x7f2790144a90 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f27900b55d0 tx=0x7f2780007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:19.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.538+0000 7f277f7fe700 1 -- 172.21.15.62:0/1988528341 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2780013450 con 0x7f27900b40b0 2021-12-17T18:24:19.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.538+0000 7f277f7fe700 1 -- 172.21.15.62:0/1988528341 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27800135b0 con 0x7f27900b40b0 2021-12-17T18:24:19.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.538+0000 7f2797093700 1 -- 172.21.15.62:0/1988528341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2790144f80 con 0x7f27900b40b0 2021-12-17T18:24:19.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.538+0000 7f277f7fe700 1 -- 172.21.15.62:0/1988528341 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2780013910 con 0x7f27900b40b0 2021-12-17T18:24:19.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.538+0000 7f2797093700 1 -- 172.21.15.62:0/1988528341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27900655e0 con 0x7f27900b40b0 2021-12-17T18:24:19.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.538+0000 7f2797093700 1 -- 172.21.15.62:0/1988528341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27900b3980 con 0x7f27900b40b0 2021-12-17T18:24:19.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.538+0000 7f277f7fe700 1 -- 172.21.15.62:0/1988528341 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f278001a060 con 0x7f27900b40b0 2021-12-17T18:24:19.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.538+0000 7f277f7fe700 1 --2- 172.21.15.62:0/1988528341 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f27700536d0 0x7f2770055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.538+0000 7f277f7fe700 1 -- 172.21.15.62:0/1988528341 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f278006aee0 con 0x7f27900b40b0 2021-12-17T18:24:19.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.538+0000 7f2796091700 1 --2- 172.21.15.62:0/1988528341 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f27700536d0 0x7f2770055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.538+0000 7f2796091700 1 --2- 172.21.15.62:0/1988528341 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f27700536d0 0x7f2770055b90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f278c01c000 tx=0x7f278c015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:19.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.542+0000 7f277f7fe700 1 -- 172.21.15.62:0/1988528341 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2780042040 con 0x7f27900b40b0 2021-12-17T18:24:19.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.674+0000 7f2797093700 1 -- 172.21.15.62:0/1988528341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f27900655e0 con 0x7f27900b40b0 2021-12-17T18:24:19.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.674+0000 7f277f7fe700 1 -- 172.21.15.62:0/1988528341 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+10 (secure 0 0 0) 0x7f27900655e0 con 0x7f27900b40b0 2021-12-17T18:24:19.676 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:24:19.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.674+0000 7f2797093700 1 -- 172.21.15.62:0/1988528341 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f27700536d0 msgr2=0x7f2770055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.674+0000 7f2797093700 1 --2- 172.21.15.62:0/1988528341 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f27700536d0 0x7f2770055b90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f278c01c000 tx=0x7f278c015000).stop 2021-12-17T18:24:19.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.674+0000 7f2797093700 1 -- 172.21.15.62:0/1988528341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27900b40b0 msgr2=0x7f2790144a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.674+0000 7f2797093700 1 --2- 172.21.15.62:0/1988528341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27900b40b0 0x7f2790144a90 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f27900b55d0 tx=0x7f2780007c20).stop 2021-12-17T18:24:19.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.674+0000 7f2797093700 1 -- 172.21.15.62:0/1988528341 shutdown_connections 2021-12-17T18:24:19.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.674+0000 7f2797093700 1 --2- 172.21.15.62:0/1988528341 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f27700536d0 0x7f2770055b90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.674+0000 7f2797093700 1 --2- 172.21.15.62:0/1988528341 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27900b47c0 0x7f27900af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.674+0000 7f2797093700 1 --2- 172.21.15.62:0/1988528341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27900b40b0 0x7f2790144a90 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.674+0000 7f2797093700 1 --2- 172.21.15.62:0/1988528341 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f279005ca90 0x7f2790155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.674+0000 7f2797093700 1 -- 172.21.15.62:0/1988528341 >> 172.21.15.62:0/1988528341 conn(0x7f279005bcd0 msgr2=0x7f27900b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:19.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.674+0000 7f2797093700 1 -- 172.21.15.62:0/1988528341 shutdown_connections 2021-12-17T18:24:19.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.674+0000 7f2797093700 1 -- 172.21.15.62:0/1988528341 wait complete. 2021-12-17T18:24:19.689 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:24:19.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.794+0000 7fac2a605700 1 Processor -- start 2021-12-17T18:24:19.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.794+0000 7fac2a605700 1 -- start start 2021-12-17T18:24:19.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac2a605700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fac240b1160 0x7fac24142190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac2a605700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fac24142680 0x7fac24142b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac2a605700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2405fe50 con 0x7fac2405fa70 2021-12-17T18:24:19.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac2a605700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac24061df0 con 0x7fac24142680 2021-12-17T18:24:19.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac2a605700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac24064520 con 0x7fac240b1160 2021-12-17T18:24:19.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac29603700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fac2405fa70 0x7fac24064910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35986/0 (socket says 172.21.15.62:35986) 2021-12-17T18:24:19.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac29603700 1 -- 172.21.15.62:0/2476473521 learned_addr learned my addr 172.21.15.62:0/2476473521 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:19.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac29e04700 1 --2- 172.21.15.62:0/2476473521 >> v2:172.21.15.62:3300/0 conn(0x7fac24142680 0x7fac24142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac28e02700 1 --2- 172.21.15.62:0/2476473521 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fac240b1160 0x7fac24142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac13fff700 1 -- 172.21.15.62:0/2476473521 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4004604719 0 0) 0x7fac2405fe50 con 0x7fac2405fa70 2021-12-17T18:24:19.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac13fff700 1 -- 172.21.15.62:0/2476473521 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac0c003260 con 0x7fac2405fa70 2021-12-17T18:24:19.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac29e04700 1 -- 172.21.15.62:0/2476473521 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fac240b1160 msgr2=0x7fac24142190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:19.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac29e04700 1 --2- 172.21.15.62:0/2476473521 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fac240b1160 0x7fac24142190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac29e04700 1 -- 172.21.15.62:0/2476473521 >> v1:172.21.15.62:6789/0 conn(0x7fac2405fa70 legacy=0x7fac24064910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac29e04700 1 -- 172.21.15.62:0/2476473521 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac24061390 con 0x7fac24142680 2021-12-17T18:24:19.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac28e02700 1 --2- 172.21.15.62:0/2476473521 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fac240b1160 0x7fac24142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:24:19.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac29e04700 1 --2- 172.21.15.62:0/2476473521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac24142680 0x7fac24142b10 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7fac1c0032f0 tx=0x7fac1c0091d0).ready entity=mon.0 client_cookie=bd7c6aa9f08ea2b2 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:19.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac13fff700 1 -- 172.21.15.62:0/2476473521 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac1c00b600 con 0x7fac24142680 2021-12-17T18:24:19.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac13fff700 1 -- 172.21.15.62:0/2476473521 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c00b760 con 0x7fac24142680 2021-12-17T18:24:19.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.798+0000 7fac13fff700 1 -- 172.21.15.62:0/2476473521 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac1c00b8d0 con 0x7fac24142680 2021-12-17T18:24:19.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.802+0000 7fac2a605700 1 -- 172.21.15.62:0/2476473521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac24142680 msgr2=0x7fac24142b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.802+0000 7fac2a605700 1 --2- 172.21.15.62:0/2476473521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac24142680 0x7fac24142b10 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7fac1c0032f0 tx=0x7fac1c0091d0).stop 2021-12-17T18:24:19.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.802+0000 7fac2a605700 1 -- 172.21.15.62:0/2476473521 shutdown_connections 2021-12-17T18:24:19.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.802+0000 7fac2a605700 1 --2- 172.21.15.62:0/2476473521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac24142680 0x7fac24142b10 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.802+0000 7fac2a605700 1 --2- 172.21.15.62:0/2476473521 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fac240b1160 0x7fac24142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.802+0000 7fac2a605700 1 -- 172.21.15.62:0/2476473521 >> 172.21.15.62:0/2476473521 conn(0x7fac24063510 msgr2=0x7fac240638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:19.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.802+0000 7fac2a605700 1 -- 172.21.15.62:0/2476473521 shutdown_connections 2021-12-17T18:24:19.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.802+0000 7fac2a605700 1 -- 172.21.15.62:0/2476473521 wait complete. 2021-12-17T18:24:19.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.802+0000 7fac2a605700 1 Processor -- start 2021-12-17T18:24:19.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.802+0000 7fac2a605700 1 -- start start 2021-12-17T18:24:19.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac2a605700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fac2405fa70 0x7fac240b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac2a605700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac240b1160 0x7fac240afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac2a605700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fac24142680 0x7fac240b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac2a605700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac240ae920 con 0x7fac240b1160 2021-12-17T18:24:19.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac2a605700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac241454a0 con 0x7fac24142680 2021-12-17T18:24:19.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac2a605700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac240b08c0 con 0x7fac2405fa70 2021-12-17T18:24:19.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac28e02700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac240b1160 0x7fac240afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac28e02700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac240b1160 0x7fac240afee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52412/0 (socket says 172.21.15.62:52412) 2021-12-17T18:24:19.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac28e02700 1 -- 172.21.15.62:0/1021896035 learned_addr learned my addr 172.21.15.62:0/1021896035 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:19.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac29603700 1 --2- 172.21.15.62:0/1021896035 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fac2405fa70 0x7fac240b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac29e04700 1 --2- 172.21.15.62:0/1021896035 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fac24142680 0x7fac240b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac28e02700 1 -- 172.21.15.62:0/1021896035 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fac2405fa70 msgr2=0x7fac240b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac28e02700 1 --2- 172.21.15.62:0/1021896035 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fac2405fa70 0x7fac240b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac28e02700 1 -- 172.21.15.62:0/1021896035 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fac24142680 msgr2=0x7fac240b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac28e02700 1 --2- 172.21.15.62:0/1021896035 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fac24142680 0x7fac240b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac28e02700 1 -- 172.21.15.62:0/1021896035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1400b180 con 0x7fac240b1160 2021-12-17T18:24:19.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac28e02700 1 --2- 172.21.15.62:0/1021896035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac240b1160 0x7fac240afee0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7fac1400c000 tx=0x7fac14006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:19.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac127fc700 1 -- 172.21.15.62:0/1021896035 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac1400ca40 con 0x7fac240b1160 2021-12-17T18:24:19.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac127fc700 1 -- 172.21.15.62:0/1021896035 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1400cba0 con 0x7fac240b1160 2021-12-17T18:24:19.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac2a605700 1 -- 172.21.15.62:0/1021896035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1c009470 con 0x7fac240b1160 2021-12-17T18:24:19.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac127fc700 1 -- 172.21.15.62:0/1021896035 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac140123f0 con 0x7fac240b1160 2021-12-17T18:24:19.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac2a605700 1 -- 172.21.15.62:0/1021896035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac240ae5a0 con 0x7fac240b1160 2021-12-17T18:24:19.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.806+0000 7fac2a605700 1 -- 172.21.15.62:0/1021896035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac24113b90 con 0x7fac240b1160 2021-12-17T18:24:19.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.810+0000 7fac127fc700 1 -- 172.21.15.62:0/1021896035 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fac14012550 con 0x7fac240b1160 2021-12-17T18:24:19.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.810+0000 7fac127fc700 1 --2- 172.21.15.62:0/1021896035 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fac040536d0 0x7fac04055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:19.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.810+0000 7fac127fc700 1 -- 172.21.15.62:0/1021896035 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fac1406c0c0 con 0x7fac240b1160 2021-12-17T18:24:19.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.810+0000 7fac29603700 1 --2- 172.21.15.62:0/1021896035 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fac040536d0 0x7fac04055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:19.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.810+0000 7fac29603700 1 --2- 172.21.15.62:0/1021896035 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fac040536d0 0x7fac04055b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fac2000b000 tx=0x7fac20009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:19.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.814+0000 7fac127fc700 1 -- 172.21.15.62:0/1021896035 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fac14043120 con 0x7fac240b1160 2021-12-17T18:24:19.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.942+0000 7fac2a605700 1 -- 172.21.15.62:0/1021896035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac24061630 con 0x7fac240b1160 2021-12-17T18:24:19.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.942+0000 7fac127fc700 1 -- 172.21.15.62:0/1021896035 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+10 (secure 0 0 0) 0x7fac14046740 con 0x7fac240b1160 2021-12-17T18:24:19.947 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:24:19.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.946+0000 7fac2a605700 1 -- 172.21.15.62:0/1021896035 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fac040536d0 msgr2=0x7fac04055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.946+0000 7fac2a605700 1 --2- 172.21.15.62:0/1021896035 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fac040536d0 0x7fac04055b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fac2000b000 tx=0x7fac20009040).stop 2021-12-17T18:24:19.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.946+0000 7fac2a605700 1 -- 172.21.15.62:0/1021896035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac240b1160 msgr2=0x7fac240afee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:19.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.946+0000 7fac2a605700 1 --2- 172.21.15.62:0/1021896035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac240b1160 0x7fac240afee0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7fac1400c000 tx=0x7fac14006df0).stop 2021-12-17T18:24:19.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.946+0000 7fac2a605700 1 -- 172.21.15.62:0/1021896035 shutdown_connections 2021-12-17T18:24:19.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.946+0000 7fac2a605700 1 --2- 172.21.15.62:0/1021896035 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fac040536d0 0x7fac04055b90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.946+0000 7fac2a605700 1 --2- 172.21.15.62:0/1021896035 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fac24142680 0x7fac240b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.946+0000 7fac2a605700 1 --2- 172.21.15.62:0/1021896035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac240b1160 0x7fac240afee0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.946+0000 7fac2a605700 1 --2- 172.21.15.62:0/1021896035 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fac2405fa70 0x7fac240b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:19.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.946+0000 7fac2a605700 1 -- 172.21.15.62:0/1021896035 >> 172.21.15.62:0/1021896035 conn(0x7fac24063510 msgr2=0x7fac24143280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:19.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.946+0000 7fac2a605700 1 -- 172.21.15.62:0/1021896035 shutdown_connections 2021-12-17T18:24:19.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:19.946+0000 7fac2a605700 1 -- 172.21.15.62:0/1021896035 wait complete. 2021-12-17T18:24:19.960 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:24:19.960 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:24:20.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.054+0000 7f2ba759e700 1 Processor -- start 2021-12-17T18:24:20.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.054+0000 7f2ba759e700 1 -- start start 2021-12-17T18:24:20.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba759e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f2ba80b3760 0x7f2ba80b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:20.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ba81458d0 0x7f2ba8145d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:20.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba759e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba80b5f00 con 0x7f2ba80b5b20 2021-12-17T18:24:20.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba759e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba80b3020 con 0x7f2ba80b3760 2021-12-17T18:24:20.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba80b32c0 con 0x7f2ba81458d0 2021-12-17T18:24:20.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba6d9d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ba81458d0 0x7f2ba8145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:20.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba659c700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f2ba80b5b20 0x7f2ba80b6290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:52320/0 (socket says 172.21.15.62:52320) 2021-12-17T18:24:20.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba659c700 1 -- 172.21.15.62:0/797692638 learned_addr learned my addr 172.21.15.62:0/797692638 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:20.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba5d9b700 1 --2- 172.21.15.62:0/797692638 >> v2:172.21.15.109:3300/0 conn(0x7f2ba80b3760 0x7f2ba80b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:20.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba559a700 1 -- 172.21.15.62:0/797692638 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481797158 0 0) 0x7f2ba80b5f00 con 0x7f2ba80b5b20 2021-12-17T18:24:20.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba559a700 1 -- 172.21.15.62:0/797692638 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b8c003260 con 0x7f2ba80b5b20 2021-12-17T18:24:20.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba6d9d700 1 -- 172.21.15.62:0/797692638 >> v2:172.21.15.109:3300/0 conn(0x7f2ba80b3760 msgr2=0x7f2ba80b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:20.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba6d9d700 1 --2- 172.21.15.62:0/797692638 >> v2:172.21.15.109:3300/0 conn(0x7f2ba80b3760 0x7f2ba80b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:20.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba6d9d700 1 -- 172.21.15.62:0/797692638 >> v1:172.21.15.109:6789/0 conn(0x7f2ba80b5b20 legacy=0x7f2ba80b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:20.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba6d9d700 1 -- 172.21.15.62:0/797692638 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba80b6e90 con 0x7f2ba81458d0 2021-12-17T18:24:20.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba6d9d700 1 --2- 172.21.15.62:0/797692638 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ba81458d0 0x7f2ba8145d20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f2ba00032f0 tx=0x7f2ba00091d0).ready entity=mon.2 client_cookie=41669eeaeafd38f7 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:20.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba559a700 1 -- 172.21.15.62:0/797692638 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ba000b600 con 0x7f2ba81458d0 2021-12-17T18:24:20.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba559a700 1 -- 172.21.15.62:0/797692638 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba000b760 con 0x7f2ba81458d0 2021-12-17T18:24:20.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba559a700 1 -- 172.21.15.62:0/797692638 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ba000b8d0 con 0x7f2ba81458d0 2021-12-17T18:24:20.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba759e700 1 -- 172.21.15.62:0/797692638 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ba81458d0 msgr2=0x7f2ba8145d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:20.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba759e700 1 --2- 172.21.15.62:0/797692638 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ba81458d0 0x7f2ba8145d20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f2ba00032f0 tx=0x7f2ba00091d0).stop 2021-12-17T18:24:20.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba759e700 1 -- 172.21.15.62:0/797692638 shutdown_connections 2021-12-17T18:24:20.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba759e700 1 --2- 172.21.15.62:0/797692638 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ba81458d0 0x7f2ba8145d20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:20.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba759e700 1 --2- 172.21.15.62:0/797692638 >> v2:172.21.15.109:3300/0 conn(0x7f2ba80b3760 0x7f2ba80b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:20.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba759e700 1 -- 172.21.15.62:0/797692638 >> 172.21.15.62:0/797692638 conn(0x7f2ba805c750 msgr2=0x7f2ba805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:20.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba759e700 1 -- 172.21.15.62:0/797692638 shutdown_connections 2021-12-17T18:24:20.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.058+0000 7f2ba759e700 1 -- 172.21.15.62:0/797692638 wait complete. 2021-12-17T18:24:20.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba759e700 1 Processor -- start 2021-12-17T18:24:20.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba759e700 1 -- start start 2021-12-17T18:24:20.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ba80b5b20 0x7f2ba80b9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:20.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2ba81458d0 0x7f2ba8152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:20.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ba8147650 0x7f2ba8063750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:20.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba8063080 con 0x7f2ba8147650 2021-12-17T18:24:20.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba80651a0 con 0x7f2ba81458d0 2021-12-17T18:24:20.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba80632b0 con 0x7f2ba80b5b20 2021-12-17T18:24:20.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba6d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ba8147650 0x7f2ba8063750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:20.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba6d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ba8147650 0x7f2ba8063750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52430/0 (socket says 172.21.15.62:52430) 2021-12-17T18:24:20.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba6d9d700 1 -- 172.21.15.62:0/413482489 learned_addr learned my addr 172.21.15.62:0/413482489 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:20.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba659c700 1 --2- 172.21.15.62:0/413482489 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ba80b5b20 0x7f2ba80b9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:20.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba5d9b700 1 --2- 172.21.15.62:0/413482489 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2ba81458d0 0x7f2ba8152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:20.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba6d9d700 1 -- 172.21.15.62:0/413482489 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ba80b5b20 msgr2=0x7f2ba80b9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:20.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba6d9d700 1 --2- 172.21.15.62:0/413482489 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ba80b5b20 0x7f2ba80b9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:20.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba6d9d700 1 -- 172.21.15.62:0/413482489 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2ba81458d0 msgr2=0x7f2ba8152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:20.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba6d9d700 1 --2- 172.21.15.62:0/413482489 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2ba81458d0 0x7f2ba8152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:20.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba6d9d700 1 -- 172.21.15.62:0/413482489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba0009470 con 0x7f2ba8147650 2021-12-17T18:24:20.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba6d9d700 1 --2- 172.21.15.62:0/413482489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ba8147650 0x7f2ba8063750 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f2ba00032f0 tx=0x7f2ba0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:20.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2b977fe700 1 -- 172.21.15.62:0/413482489 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ba000b8d0 con 0x7f2ba8147650 2021-12-17T18:24:20.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2b977fe700 1 -- 172.21.15.62:0/413482489 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba0021630 con 0x7f2ba8147650 2021-12-17T18:24:20.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba759e700 1 -- 172.21.15.62:0/413482489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba8064e20 con 0x7f2ba8147650 2021-12-17T18:24:20.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2b977fe700 1 -- 172.21.15.62:0/413482489 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ba000b600 con 0x7f2ba8147650 2021-12-17T18:24:20.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.062+0000 7f2ba759e700 1 -- 172.21.15.62:0/413482489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba8064740 con 0x7f2ba8147650 2021-12-17T18:24:20.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.066+0000 7f2ba759e700 1 -- 172.21.15.62:0/413482489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba8063470 con 0x7f2ba8147650 2021-12-17T18:24:20.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.066+0000 7f2b977fe700 1 -- 172.21.15.62:0/413482489 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2ba0027020 con 0x7f2ba8147650 2021-12-17T18:24:20.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.066+0000 7f2b977fe700 1 --2- 172.21.15.62:0/413482489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2b840534f0 0x7f2b840559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:20.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.066+0000 7f2b977fe700 1 -- 172.21.15.62:0/413482489 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2ba006cfe0 con 0x7f2ba8147650 2021-12-17T18:24:20.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.066+0000 7f2ba659c700 1 --2- 172.21.15.62:0/413482489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2b840534f0 0x7f2b840559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:20.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.066+0000 7f2ba659c700 1 --2- 172.21.15.62:0/413482489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2b840534f0 0x7f2b840559b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f2b9800d000 tx=0x7f2b98009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:20.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.074+0000 7f2b977fe700 1 -- 172.21.15.62:0/413482489 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2ba0044070 con 0x7f2ba8147650 2021-12-17T18:24:20.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.238+0000 7f2ba759e700 1 -- 172.21.15.62:0/413482489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ba8065010 con 0x7f2ba8147650 2021-12-17T18:24:20.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.238+0000 7f2b977fe700 1 -- 172.21.15.62:0/413482489 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f2ba0015090 con 0x7f2ba8147650 2021-12-17T18:24:20.241 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:20.241 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":32,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5672,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/2267359903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":2267359903},{"type":"v1","addr":"172.21.15.109:6835","nonce":2267359903}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:24:11.805782+0000","modified":"2021-12-17T18:24:12.808883+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6318":{"gid":6318,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/414220193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":414220193},{"type":"v1","addr":"172.21.15.62:6833","nonce":414220193}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-12-17T18:24:20.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.238+0000 7f2ba759e700 1 -- 172.21.15.62:0/413482489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2b840534f0 msgr2=0x7f2b840559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:20.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.238+0000 7f2ba759e700 1 --2- 172.21.15.62:0/413482489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2b840534f0 0x7f2b840559b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f2b9800d000 tx=0x7f2b98009040).stop 2021-12-17T18:24:20.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.238+0000 7f2ba759e700 1 -- 172.21.15.62:0/413482489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ba8147650 msgr2=0x7f2ba8063750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:20.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.238+0000 7f2ba759e700 1 --2- 172.21.15.62:0/413482489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ba8147650 0x7f2ba8063750 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f2ba00032f0 tx=0x7f2ba0016000).stop 2021-12-17T18:24:20.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.238+0000 7f2ba759e700 1 -- 172.21.15.62:0/413482489 shutdown_connections 2021-12-17T18:24:20.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.238+0000 7f2ba759e700 1 --2- 172.21.15.62:0/413482489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2b840534f0 0x7f2b840559b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:20.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.238+0000 7f2ba759e700 1 --2- 172.21.15.62:0/413482489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ba8147650 0x7f2ba8063750 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:20.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.238+0000 7f2ba759e700 1 --2- 172.21.15.62:0/413482489 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2ba81458d0 0x7f2ba8152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:20.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.238+0000 7f2ba759e700 1 --2- 172.21.15.62:0/413482489 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2ba80b5b20 0x7f2ba80b9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:20.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.238+0000 7f2ba759e700 1 -- 172.21.15.62:0/413482489 >> 172.21.15.62:0/413482489 conn(0x7f2ba805c750 msgr2=0x7f2ba80b6290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:20.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.238+0000 7f2ba759e700 1 -- 172.21.15.62:0/413482489 shutdown_connections 2021-12-17T18:24:20.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:20.238+0000 7f2ba759e700 1 -- 172.21.15.62:0/413482489 wait complete. 2021-12-17T18:24:20.246 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 32 2021-12-17T18:24:20.456 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:24:11.805782+0000', 'modified': '2021-12-17T18:24:12.808883+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6318}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6318': {'gid': 6318, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/414220193', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 414220193}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 414220193}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:24:20.457 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:24:20.457 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:24:20.573 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":6318,"want_state":"up:active","state":"up:active","rank_uptime":8.7538682770000005,"mdsmap_epoch":32,"osdmap_epoch":71,"osdmap_epoch_barrier":70,"uptime":13.085649798} 2021-12-17T18:24:20.573 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 6318, "mdsmap_epoch": 32, "osdmap_epoch": 71, "osdmap_epoch_barrier": 70, "rank_uptime": 8.753868277, "state": "up:active", "uptime": 13.085649798, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:24:20.574 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:24:20.575 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-12-17T18:24:20.575 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi158.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-12-17T18:24:20.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:20.576 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:24:20.585 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:24:20.644 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:24:20.645 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:24:20.659 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:24:20.660 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:24:20.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:20.662 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:24:20.667 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:24:20.668 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:24:20.712 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:24:20.728 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:24:20.729 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:24:20.738 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:24:20.739 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:24:20.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:20.740 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:24:20.787 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:2021-12-17T18:24:20.783+0000 7f1cce6e2080 -1 init, newargv = 0x55941798fa90 newargc=9 2021-12-17T18:24:20.787 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14028]: starting ceph client 2021-12-17T18:24:20.797 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14028]: starting fuse 2021-12-17T18:24:21.890 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:24:21.909 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:24:21.909 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:24:21.919 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:24:21.920 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:24:21.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:21.922 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:24:21.927 INFO:teuthology.orchestra.run.smithi158.stdout:52 2021-12-17T18:24:21.927 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:24:21.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:21.928 DEBUG:teuthology.orchestra.run.smithi158:> sudo python3 -c ' 2021-12-17T18:24:21.928 DEBUG:teuthology.orchestra.run.smithi158:> import glob 2021-12-17T18:24:21.929 DEBUG:teuthology.orchestra.run.smithi158:> import re 2021-12-17T18:24:21.929 DEBUG:teuthology.orchestra.run.smithi158:> import os 2021-12-17T18:24:21.930 DEBUG:teuthology.orchestra.run.smithi158:> import subprocess 2021-12-17T18:24:21.930 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:24:21.930 DEBUG:teuthology.orchestra.run.smithi158:> def find_socket(client_name): 2021-12-17T18:24:21.931 DEBUG:teuthology.orchestra.run.smithi158:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-12-17T18:24:21.931 DEBUG:teuthology.orchestra.run.smithi158:> files = glob.glob(asok_path) 2021-12-17T18:24:21.932 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:24:21.932 DEBUG:teuthology.orchestra.run.smithi158:> # Given a non-glob path, it better be there 2021-12-17T18:24:21.933 DEBUG:teuthology.orchestra.run.smithi158:> if "*" not in asok_path: 2021-12-17T18:24:21.933 DEBUG:teuthology.orchestra.run.smithi158:> assert(len(files) == 1) 2021-12-17T18:24:21.934 DEBUG:teuthology.orchestra.run.smithi158:> return files[0] 2021-12-17T18:24:21.934 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:24:21.934 DEBUG:teuthology.orchestra.run.smithi158:> for f in files: 2021-12-17T18:24:21.935 DEBUG:teuthology.orchestra.run.smithi158:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:24:21.935 DEBUG:teuthology.orchestra.run.smithi158:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:24:21.936 DEBUG:teuthology.orchestra.run.smithi158:> return f 2021-12-17T18:24:21.936 DEBUG:teuthology.orchestra.run.smithi158:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:24:21.936 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:24:21.937 DEBUG:teuthology.orchestra.run.smithi158:> print(find_socket("client.1")) 2021-12-17T18:24:21.937 DEBUG:teuthology.orchestra.run.smithi158:> ' 2021-12-17T18:24:22.014 INFO:teuthology.orchestra.run.smithi158.stdout:/var/run/ceph/ceph-client.1.14028.asok 2021-12-17T18:24:22.019 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14028.asok 2021-12-17T18:24:22.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:22.020 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14028.asok status 2021-12-17T18:24:22.113 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2021-12-17T18:24:22.114 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": { 2021-12-17T18:24:22.114 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:24:22.114 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:24:22.115 INFO:teuthology.orchestra.run.smithi158.stdout: "entity_id": "1", 2021-12-17T18:24:22.115 INFO:teuthology.orchestra.run.smithi158.stdout: "hostname": "smithi158", 2021-12-17T18:24:22.115 INFO:teuthology.orchestra.run.smithi158.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-12-17T18:24:22.115 INFO:teuthology.orchestra.run.smithi158.stdout: "pid": "14028", 2021-12-17T18:24:22.116 INFO:teuthology.orchestra.run.smithi158.stdout: "root": "/" 2021-12-17T18:24:22.116 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:24:22.116 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_count": 0, 2021-12-17T18:24:22.116 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_pinned_count": 0, 2021-12-17T18:24:22.117 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 5825, 2021-12-17T18:24:22.117 INFO:teuthology.orchestra.run.smithi158.stdout: "inst": { 2021-12-17T18:24:22.117 INFO:teuthology.orchestra.run.smithi158.stdout: "name": { 2021-12-17T18:24:22.117 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "client", 2021-12-17T18:24:22.118 INFO:teuthology.orchestra.run.smithi158.stdout: "num": 5825 2021-12-17T18:24:22.118 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:24:22.118 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:24:22.118 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:24:22.119 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:24:22.119 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 780004879 2021-12-17T18:24:22.119 INFO:teuthology.orchestra.run.smithi158.stdout: } 2021-12-17T18:24:22.119 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:24:22.120 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:24:22.120 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:24:22.120 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:24:22.121 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 780004879 2021-12-17T18:24:22.121 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:24:22.121 INFO:teuthology.orchestra.run.smithi158.stdout: "inst_str": "client.5825 172.21.15.158:0/780004879", 2021-12-17T18:24:22.122 INFO:teuthology.orchestra.run.smithi158.stdout: "addr_str": "172.21.15.158:0/780004879", 2021-12-17T18:24:22.122 INFO:teuthology.orchestra.run.smithi158.stdout: "inode_count": 1, 2021-12-17T18:24:22.122 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_epoch": 32, 2021-12-17T18:24:22.122 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch": 71, 2021-12-17T18:24:22.123 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:24:22.123 INFO:teuthology.orchestra.run.smithi158.stdout: "blacklisted": false, 2021-12-17T18:24:22.123 INFO:teuthology.orchestra.run.smithi158.stdout: "fs_name": "cephfs" 2021-12-17T18:24:22.123 INFO:teuthology.orchestra.run.smithi158.stdout:} 2021-12-17T18:24:22.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:22.125 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:24:22.126 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:24:22.133 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:24:22.135 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:24:22.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:22.136 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:24:22.153 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:24:22.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc044acf700 1 Processor -- start 2021-12-17T18:24:22.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc044acf700 1 -- start start 2021-12-17T18:24:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc044acf700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0400b0970 0x7fc0400b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc044acf700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc0400b5730 0x7fc0400ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc044acf700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0400b0d50 con 0x7fc0400aede0 2021-12-17T18:24:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc044acf700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0400afec0 con 0x7fc0400b5730 2021-12-17T18:24:22.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc044acf700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400b5cb0 con 0x7fc0400b0970 2021-12-17T18:24:22.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc03ed9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc0400aede0 0x7fc04014ad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36018/0 (socket says 172.21.15.62:36018) 2021-12-17T18:24:22.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc03ed9d700 1 -- 172.21.15.62:0/707134523 learned_addr learned my addr 172.21.15.62:0/707134523 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:22.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc03dd9b700 1 --2- 172.21.15.62:0/707134523 >> v2:172.21.15.109:3300/0 conn(0x7fc0400b5730 0x7fc0400ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:22.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc03e59c700 1 --2- 172.21.15.62:0/707134523 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0400b0970 0x7fc0400b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:22.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc03d59a700 1 -- 172.21.15.62:0/707134523 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762643593 0 0) 0x7fc0400b0d50 con 0x7fc0400aede0 2021-12-17T18:24:22.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc03d59a700 1 -- 172.21.15.62:0/707134523 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc024003260 con 0x7fc0400aede0 2021-12-17T18:24:22.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc03dd9b700 1 -- 172.21.15.62:0/707134523 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0400b0970 msgr2=0x7fc0400b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:22.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc03dd9b700 1 --2- 172.21.15.62:0/707134523 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0400b0970 0x7fc0400b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc03dd9b700 1 -- 172.21.15.62:0/707134523 >> v1:172.21.15.62:6789/0 conn(0x7fc0400aede0 legacy=0x7fc04014ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:22.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc03dd9b700 1 -- 172.21.15.62:0/707134523 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0400b13e0 con 0x7fc0400b5730 2021-12-17T18:24:22.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc03dd9b700 1 --2- 172.21.15.62:0/707134523 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc0400b5730 0x7fc0400ae8f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fc0300032f0 tx=0x7fc0300091d0).ready entity=mon.1 client_cookie=ee05f01957983a29 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc03d59a700 1 -- 172.21.15.62:0/707134523 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc03000b600 con 0x7fc0400b5730 2021-12-17T18:24:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc03d59a700 1 -- 172.21.15.62:0/707134523 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03000b760 con 0x7fc0400b5730 2021-12-17T18:24:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc03d59a700 1 -- 172.21.15.62:0/707134523 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc03000b8d0 con 0x7fc0400b5730 2021-12-17T18:24:22.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc044acf700 1 -- 172.21.15.62:0/707134523 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc0400b5730 msgr2=0x7fc0400ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:22.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc044acf700 1 --2- 172.21.15.62:0/707134523 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc0400b5730 0x7fc0400ae8f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fc0300032f0 tx=0x7fc0300091d0).stop 2021-12-17T18:24:22.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.266+0000 7fc044acf700 1 -- 172.21.15.62:0/707134523 shutdown_connections 2021-12-17T18:24:22.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc044acf700 1 --2- 172.21.15.62:0/707134523 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc0400b5730 0x7fc0400ae8f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc044acf700 1 --2- 172.21.15.62:0/707134523 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0400b0970 0x7fc0400b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc044acf700 1 -- 172.21.15.62:0/707134523 >> 172.21.15.62:0/707134523 conn(0x7fc04005cb40 msgr2=0x7fc04005cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:22.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc044acf700 1 -- 172.21.15.62:0/707134523 shutdown_connections 2021-12-17T18:24:22.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc044acf700 1 -- 172.21.15.62:0/707134523 wait complete. 2021-12-17T18:24:22.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc044acf700 1 Processor -- start 2021-12-17T18:24:22.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc044acf700 1 -- start start 2021-12-17T18:24:22.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc044acf700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0400aede0 0x7fc04014ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:22.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc044acf700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc0400b0970 0x7fc040063060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:22.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc044acf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0400b5730 0x7fc040063550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:22.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc044acf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400abfc0 con 0x7fc0400b5730 2021-12-17T18:24:22.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc044acf700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04014b020 con 0x7fc0400b0970 2021-12-17T18:24:22.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc044acf700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04014b1e0 con 0x7fc0400aede0 2021-12-17T18:24:22.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc03ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0400b5730 0x7fc040063550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:22.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc03e59c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0400aede0 0x7fc04014ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:22.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc03dd9b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc0400b0970 0x7fc040063060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:22.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc03e59c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0400aede0 0x7fc04014ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:46144/0 (socket says 172.21.15.62:46144) 2021-12-17T18:24:22.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc03ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0400b5730 0x7fc040063550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52444/0 (socket says 172.21.15.62:52444) 2021-12-17T18:24:22.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc03dd9b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc0400b0970 0x7fc040063060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:58990/0 (socket says 172.21.15.62:58990) 2021-12-17T18:24:22.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc03e59c700 1 -- 172.21.15.62:0/2858388387 learned_addr learned my addr 172.21.15.62:0/2858388387 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:22.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc03ed9d700 1 -- 172.21.15.62:0/2858388387 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0400aede0 msgr2=0x7fc04014ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:22.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc03ed9d700 1 --2- 172.21.15.62:0/2858388387 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0400aede0 0x7fc04014ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc03ed9d700 1 -- 172.21.15.62:0/2858388387 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc0400b0970 msgr2=0x7fc040063060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:22.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc03ed9d700 1 --2- 172.21.15.62:0/2858388387 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc0400b0970 0x7fc040063060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.270+0000 7fc03ed9d700 1 -- 172.21.15.62:0/2858388387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc030009470 con 0x7fc0400b5730 2021-12-17T18:24:22.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.274+0000 7fc03ed9d700 1 --2- 172.21.15.62:0/2858388387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0400b5730 0x7fc040063550 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7fc038001110 tx=0x7fc0380079c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:22.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.274+0000 7fc0377fe700 1 -- 172.21.15.62:0/2858388387 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc03800cdb0 con 0x7fc0400b5730 2021-12-17T18:24:22.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.274+0000 7fc0377fe700 1 -- 172.21.15.62:0/2858388387 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0380070d0 con 0x7fc0400b5730 2021-12-17T18:24:22.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.274+0000 7fc044acf700 1 -- 172.21.15.62:0/2858388387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc040064390 con 0x7fc0400b5730 2021-12-17T18:24:22.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.274+0000 7fc0377fe700 1 -- 172.21.15.62:0/2858388387 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc038007430 con 0x7fc0400b5730 2021-12-17T18:24:22.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.274+0000 7fc044acf700 1 -- 172.21.15.62:0/2858388387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc040064930 con 0x7fc0400b5730 2021-12-17T18:24:22.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.274+0000 7fc044acf700 1 -- 172.21.15.62:0/2858388387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0400ac1c0 con 0x7fc0400b5730 2021-12-17T18:24:22.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.274+0000 7fc0377fe700 1 -- 172.21.15.62:0/2858388387 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc03801a060 con 0x7fc0400b5730 2021-12-17T18:24:22.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.274+0000 7fc0377fe700 1 --2- 172.21.15.62:0/2858388387 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc018053580 0x7fc018055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:22.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.274+0000 7fc0377fe700 1 -- 172.21.15.62:0/2858388387 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc03806af60 con 0x7fc0400b5730 2021-12-17T18:24:22.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.278+0000 7fc03e59c700 1 --2- 172.21.15.62:0/2858388387 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc018053580 0x7fc018055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:22.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.278+0000 7fc03e59c700 1 --2- 172.21.15.62:0/2858388387 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc018053580 0x7fc018055a40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fc02800b000 tx=0x7fc028006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:22.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.282+0000 7fc0377fe700 1 -- 172.21.15.62:0/2858388387 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc0380420c0 con 0x7fc0400b5730 2021-12-17T18:24:22.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.446+0000 7fc044acf700 1 -- 172.21.15.62:0/2858388387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc040064580 con 0x7fc0400b5730 2021-12-17T18:24:22.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.446+0000 7fc0377fe700 1 -- 172.21.15.62:0/2858388387 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fc038018070 con 0x7fc0400b5730 2021-12-17T18:24:22.450 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:22.451 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":32,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5672,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/2267359903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":2267359903},{"type":"v1","addr":"172.21.15.109:6835","nonce":2267359903}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:24:11.805782+0000","modified":"2021-12-17T18:24:12.808883+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6318":{"gid":6318,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/414220193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":414220193},{"type":"v1","addr":"172.21.15.62:6833","nonce":414220193}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-12-17T18:24:22.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.450+0000 7fc044acf700 1 -- 172.21.15.62:0/2858388387 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc018053580 msgr2=0x7fc018055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.450+0000 7fc044acf700 1 --2- 172.21.15.62:0/2858388387 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc018053580 0x7fc018055a40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fc02800b000 tx=0x7fc028006df0).stop 2021-12-17T18:24:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.450+0000 7fc044acf700 1 -- 172.21.15.62:0/2858388387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0400b5730 msgr2=0x7fc040063550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.450+0000 7fc044acf700 1 --2- 172.21.15.62:0/2858388387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0400b5730 0x7fc040063550 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7fc038001110 tx=0x7fc0380079c0).stop 2021-12-17T18:24:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.450+0000 7fc044acf700 1 -- 172.21.15.62:0/2858388387 shutdown_connections 2021-12-17T18:24:22.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.450+0000 7fc044acf700 1 --2- 172.21.15.62:0/2858388387 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc018053580 0x7fc018055a40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.450+0000 7fc044acf700 1 --2- 172.21.15.62:0/2858388387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0400b5730 0x7fc040063550 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.450+0000 7fc044acf700 1 --2- 172.21.15.62:0/2858388387 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc0400b0970 0x7fc040063060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.450+0000 7fc044acf700 1 --2- 172.21.15.62:0/2858388387 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0400aede0 0x7fc04014ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.450+0000 7fc044acf700 1 -- 172.21.15.62:0/2858388387 >> 172.21.15.62:0/2858388387 conn(0x7fc04005cb40 msgr2=0x7fc0400b4190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:22.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.450+0000 7fc044acf700 1 -- 172.21.15.62:0/2858388387 shutdown_connections 2021-12-17T18:24:22.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.450+0000 7fc044acf700 1 -- 172.21.15.62:0/2858388387 wait complete. 2021-12-17T18:24:22.455 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 32 2021-12-17T18:24:22.464 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:24:22.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.562+0000 7fb6dca67700 1 Processor -- start 2021-12-17T18:24:22.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.562+0000 7fb6dca67700 1 -- start start 2021-12-17T18:24:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.562+0000 7fb6dca67700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fb6d80b6160 0x7fb6d805c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.562+0000 7fb6dca67700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d80ad2d0 0x7fb6d8140780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.562+0000 7fb6dca67700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d80b6540 con 0x7fb6d8140c70 2021-12-17T18:24:22.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.562+0000 7fb6dca67700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d80b2420 con 0x7fb6d80b6160 2021-12-17T18:24:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.562+0000 7fb6dca67700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d81402e0 con 0x7fb6d80ad2d0 2021-12-17T18:24:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.562+0000 7fb6d6d9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb6d8140c70 0x7fb6d81435a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36032/0 (socket says 172.21.15.62:36032) 2021-12-17T18:24:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.562+0000 7fb6d6d9d700 1 -- 172.21.15.62:0/524089918 learned_addr learned my addr 172.21.15.62:0/524089918 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:24:22.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.562+0000 7fb6d659c700 1 --2- 172.21.15.62:0/524089918 >> v2:172.21.15.109:3300/0 conn(0x7fb6d80b6160 0x7fb6d805c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:22.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.562+0000 7fb6cffff700 1 --2- 172.21.15.62:0/524089918 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d80ad2d0 0x7fb6d8140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:22.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.562+0000 7fb6d5d9b700 1 -- 172.21.15.62:0/524089918 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916798427 0 0) 0x7fb6d80b6540 con 0x7fb6d8140c70 2021-12-17T18:24:22.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.562+0000 7fb6d5d9b700 1 -- 172.21.15.62:0/524089918 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6b8003260 con 0x7fb6d8140c70 2021-12-17T18:24:22.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.566+0000 7fb6d659c700 1 -- 172.21.15.62:0/524089918 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d80ad2d0 msgr2=0x7fb6d8140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:24:22.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.566+0000 7fb6d659c700 1 --2- 172.21.15.62:0/524089918 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d80ad2d0 0x7fb6d8140780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.566+0000 7fb6d659c700 1 -- 172.21.15.62:0/524089918 >> v1:172.21.15.62:6789/0 conn(0x7fb6d8140c70 legacy=0x7fb6d81435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:22.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.566+0000 7fb6d659c700 1 -- 172.21.15.62:0/524089918 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d80b2110 con 0x7fb6d80b6160 2021-12-17T18:24:22.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.566+0000 7fb6d659c700 1 --2- 172.21.15.62:0/524089918 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb6d80b6160 0x7fb6d805c020 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fb6c8002f70 tx=0x7fb6c8006df0).ready entity=mon.1 client_cookie=1608313a0f8f4104 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:22.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.566+0000 7fb6d5d9b700 1 -- 172.21.15.62:0/524089918 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c800d4a0 con 0x7fb6d80b6160 2021-12-17T18:24:22.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.566+0000 7fb6d5d9b700 1 -- 172.21.15.62:0/524089918 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c8000e90 con 0x7fb6d80b6160 2021-12-17T18:24:22.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.566+0000 7fb6d5d9b700 1 -- 172.21.15.62:0/524089918 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c800d7f0 con 0x7fb6d80b6160 2021-12-17T18:24:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.566+0000 7fb6dca67700 1 -- 172.21.15.62:0/524089918 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb6d80b6160 msgr2=0x7fb6d805c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.566+0000 7fb6dca67700 1 --2- 172.21.15.62:0/524089918 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb6d80b6160 0x7fb6d805c020 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fb6c8002f70 tx=0x7fb6c8006df0).stop 2021-12-17T18:24:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.566+0000 7fb6dca67700 1 -- 172.21.15.62:0/524089918 shutdown_connections 2021-12-17T18:24:22.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.566+0000 7fb6dca67700 1 --2- 172.21.15.62:0/524089918 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d80ad2d0 0x7fb6d8140780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.566+0000 7fb6dca67700 1 --2- 172.21.15.62:0/524089918 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb6d80b6160 0x7fb6d805c020 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.566+0000 7fb6dca67700 1 -- 172.21.15.62:0/524089918 >> 172.21.15.62:0/524089918 conn(0x7fb6d805c750 msgr2=0x7fb6d80630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.566+0000 7fb6dca67700 1 -- 172.21.15.62:0/524089918 shutdown_connections 2021-12-17T18:24:22.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.566+0000 7fb6dca67700 1 -- 172.21.15.62:0/524089918 wait complete. 2021-12-17T18:24:22.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6dca67700 1 Processor -- start 2021-12-17T18:24:22.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6dca67700 1 -- start start 2021-12-17T18:24:22.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6dca67700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb6d80ad2d0 0x7fb6d813edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:22.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6dca67700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d80b6160 0x7fb6d814f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:22.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6dca67700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6d8140c70 0x7fb6d814fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:22.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6d659c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb6d80ad2d0 0x7fb6d813edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:22.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6dca67700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d81436a0 con 0x7fb6d8140c70 2021-12-17T18:24:22.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6dca67700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d8143940 con 0x7fb6d80ad2d0 2021-12-17T18:24:22.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6dca67700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d814f490 con 0x7fb6d80b6160 2021-12-17T18:24:22.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6d659c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb6d80ad2d0 0x7fb6d813edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:59004/0 (socket says 172.21.15.62:59004) 2021-12-17T18:24:22.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6d659c700 1 -- 172.21.15.62:0/3326689787 learned_addr learned my addr 172.21.15.62:0/3326689787 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:24:22.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6d6d9d700 1 --2- 172.21.15.62:0/3326689787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6d8140c70 0x7fb6d814fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:22.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6cffff700 1 --2- 172.21.15.62:0/3326689787 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d80b6160 0x7fb6d814f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:22.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6d659c700 1 -- 172.21.15.62:0/3326689787 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d80b6160 msgr2=0x7fb6d814f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:22.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6d659c700 1 --2- 172.21.15.62:0/3326689787 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d80b6160 0x7fb6d814f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6d659c700 1 -- 172.21.15.62:0/3326689787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6d8140c70 msgr2=0x7fb6d814fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:22.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6d659c700 1 --2- 172.21.15.62:0/3326689787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6d8140c70 0x7fb6d814fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6d659c700 1 -- 172.21.15.62:0/3326689787 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c800b180 con 0x7fb6d80ad2d0 2021-12-17T18:24:22.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.570+0000 7fb6d6d9d700 1 --2- 172.21.15.62:0/3326689787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6d8140c70 0x7fb6d814fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:24:22.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.574+0000 7fb6d659c700 1 --2- 172.21.15.62:0/3326689787 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb6d80ad2d0 0x7fb6d813edb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fb6c8002f70 tx=0x7fb6c8014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.574+0000 7fb6cf7fe700 1 -- 172.21.15.62:0/3326689787 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c8016070 con 0x7fb6d80ad2d0 2021-12-17T18:24:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.574+0000 7fb6cf7fe700 1 -- 172.21.15.62:0/3326689787 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c8013800 con 0x7fb6d80ad2d0 2021-12-17T18:24:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.574+0000 7fb6dca67700 1 -- 172.21.15.62:0/3326689787 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d8143320 con 0x7fb6d80ad2d0 2021-12-17T18:24:22.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.574+0000 7fb6cf7fe700 1 -- 172.21.15.62:0/3326689787 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c8013b60 con 0x7fb6d80ad2d0 2021-12-17T18:24:22.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.574+0000 7fb6dca67700 1 -- 172.21.15.62:0/3326689787 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d81504b0 con 0x7fb6d80ad2d0 2021-12-17T18:24:22.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.574+0000 7fb6dca67700 1 -- 172.21.15.62:0/3326689787 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d80573d0 con 0x7fb6d80ad2d0 2021-12-17T18:24:22.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.574+0000 7fb6cf7fe700 1 -- 172.21.15.62:0/3326689787 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb6c8024030 con 0x7fb6d80ad2d0 2021-12-17T18:24:22.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.574+0000 7fb6cf7fe700 1 --2- 172.21.15.62:0/3326689787 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb6bc0536a0 0x7fb6bc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:24:22.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.574+0000 7fb6cf7fe700 1 -- 172.21.15.62:0/3326689787 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb6c806c6f0 con 0x7fb6d80ad2d0 2021-12-17T18:24:22.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.574+0000 7fb6cffff700 1 --2- 172.21.15.62:0/3326689787 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb6bc0536a0 0x7fb6bc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:24:22.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.578+0000 7fb6cffff700 1 --2- 172.21.15.62:0/3326689787 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb6bc0536a0 0x7fb6bc055b60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fb6c000b000 tx=0x7fb6c0006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:24:22.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.582+0000 7fb6cf7fe700 1 -- 172.21.15.62:0/3326689787 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb6c80437b0 con 0x7fb6d80ad2d0 2021-12-17T18:24:22.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.754+0000 7fb6dca67700 1 -- 172.21.15.62:0/3326689787 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6d8068f30 con 0x7fb6d80ad2d0 2021-12-17T18:24:22.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.758+0000 7fb6cf7fe700 1 -- 172.21.15.62:0/3326689787 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fb6c8022020 con 0x7fb6d80ad2d0 2021-12-17T18:24:22.760 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:24:22.760 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":32,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5672,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/2267359903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":2267359903},{"type":"v1","addr":"172.21.15.109:6835","nonce":2267359903}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:24:11.805782+0000","modified":"2021-12-17T18:24:12.808883+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6318":{"gid":6318,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/414220193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":414220193},{"type":"v1","addr":"172.21.15.62:6833","nonce":414220193}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-12-17T18:24:22.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.758+0000 7fb6dca67700 1 -- 172.21.15.62:0/3326689787 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb6bc0536a0 msgr2=0x7fb6bc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:22.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.758+0000 7fb6dca67700 1 --2- 172.21.15.62:0/3326689787 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb6bc0536a0 0x7fb6bc055b60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fb6c000b000 tx=0x7fb6c0006df0).stop 2021-12-17T18:24:22.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.758+0000 7fb6dca67700 1 -- 172.21.15.62:0/3326689787 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb6d80ad2d0 msgr2=0x7fb6d813edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:24:22.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.758+0000 7fb6dca67700 1 --2- 172.21.15.62:0/3326689787 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb6d80ad2d0 0x7fb6d813edb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fb6c8002f70 tx=0x7fb6c8014000).stop 2021-12-17T18:24:22.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.758+0000 7fb6dca67700 1 -- 172.21.15.62:0/3326689787 shutdown_connections 2021-12-17T18:24:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.758+0000 7fb6dca67700 1 --2- 172.21.15.62:0/3326689787 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb6bc0536a0 0x7fb6bc055b60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.758+0000 7fb6dca67700 1 --2- 172.21.15.62:0/3326689787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6d8140c70 0x7fb6d814fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.758+0000 7fb6dca67700 1 --2- 172.21.15.62:0/3326689787 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d80b6160 0x7fb6d814f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.758+0000 7fb6dca67700 1 --2- 172.21.15.62:0/3326689787 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb6d80ad2d0 0x7fb6d813edb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:24:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.758+0000 7fb6dca67700 1 -- 172.21.15.62:0/3326689787 >> 172.21.15.62:0/3326689787 conn(0x7fb6d805c750 msgr2=0x7fb6d8145dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:24:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.762+0000 7fb6dca67700 1 -- 172.21.15.62:0/3326689787 shutdown_connections 2021-12-17T18:24:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:24:22.762+0000 7fb6dca67700 1 -- 172.21.15.62:0/3326689787 wait complete. 2021-12-17T18:24:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 32 2021-12-17T18:24:22.778 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_cap_revoke_eviction_timeout 30.0 2021-12-17T18:24:22.879 INFO:teuthology.orchestra.run.smithi062.stdout:{"success":"mds_cap_revoke_eviction_timeout = '30.000000' "} 2021-12-17T18:24:22.880 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_cap_revoke_eviction_timeout = '30.000000' " } 2021-12-17T18:24:22.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:22.881 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:24:22.881 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:24:22.890 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:24:22.891 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:24:22.892 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-12-17T18:24:22.892 DEBUG:teuthology.orchestra.run.smithi125:> import time 2021-12-17T18:24:22.893 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:24:22.893 DEBUG:teuthology.orchestra.run.smithi125:> with open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'w'"'"') as f: 2021-12-17T18:24:22.894 DEBUG:teuthology.orchestra.run.smithi125:> f.write('"'"'content'"'"') 2021-12-17T18:24:22.894 DEBUG:teuthology.orchestra.run.smithi125:> f.flush() 2021-12-17T18:24:22.894 DEBUG:teuthology.orchestra.run.smithi125:> f.write('"'"'content2'"'"') 2021-12-17T18:24:22.895 DEBUG:teuthology.orchestra.run.smithi125:> while True: 2021-12-17T18:24:22.895 DEBUG:teuthology.orchestra.run.smithi125:> time.sleep(1) 2021-12-17T18:24:22.896 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:24:22.898 DEBUG:teuthology.orchestra.run.smithi125:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-12-17T18:24:22.914 INFO:teuthology.orchestra.run.smithi125.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/background_file': No such file or directory 2021-12-17T18:24:22.915 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-12-17T18:24:23.917 DEBUG:teuthology.orchestra.run.smithi125:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-12-17T18:24:23.933 INFO:teuthology.orchestra.run.smithi125.stdout:/home/ubuntu/cephtest/mnt.0/background_file 2021-12-17T18:24:23.935 DEBUG:tasks.cephfs.mount:File background_file became visible from 0 after 1s 2021-12-17T18:24:23.936 DEBUG:teuthology.orchestra.run.smithi158:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file 2021-12-17T18:24:23.977 INFO:teuthology.orchestra.run.smithi158.stdout:/home/ubuntu/cephtest/mnt.1/background_file 2021-12-17T18:24:23.978 DEBUG:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2021-12-17T18:24:23.979 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:24:23.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:24:23.996 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:24:23.996 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:24:24.005 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:24:24.006 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:24:24.006 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-12-17T18:24:24.007 DEBUG:teuthology.orchestra.run.smithi158:> import os 2021-12-17T18:24:24.007 DEBUG:teuthology.orchestra.run.smithi158:> import time 2021-12-17T18:24:24.008 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:24:24.008 DEBUG:teuthology.orchestra.run.smithi158:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0o644) 2021-12-17T18:24:24.008 DEBUG:teuthology.orchestra.run.smithi158:> try: 2021-12-17T18:24:24.009 DEBUG:teuthology.orchestra.run.smithi158:> while True: 2021-12-17T18:24:24.009 DEBUG:teuthology.orchestra.run.smithi158:> os.write(fd, b'"'"'content'"'"') 2021-12-17T18:24:24.010 DEBUG:teuthology.orchestra.run.smithi158:> time.sleep(1) 2021-12-17T18:24:24.010 DEBUG:teuthology.orchestra.run.smithi158:> if not False: 2021-12-17T18:24:24.011 DEBUG:teuthology.orchestra.run.smithi158:> break 2021-12-17T18:24:24.011 DEBUG:teuthology.orchestra.run.smithi158:> except IOError as e: 2021-12-17T18:24:24.012 DEBUG:teuthology.orchestra.run.smithi158:> pass 2021-12-17T18:24:24.012 DEBUG:teuthology.orchestra.run.smithi158:> os.close(fd) 2021-12-17T18:24:24.012 DEBUG:teuthology.orchestra.run.smithi158:> ' 2021-12-17T18:24:34.258 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:24:34.261 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:24:34.263 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:24:34.266 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:24:34.269 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:25:03.577 INFO:tasks.cephfs.test_misc:cap_waiter waited 39.528199911117554s 2021-12-17T18:25:03.578 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls --format=json 2021-12-17T18:25:03.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.689+0000 7f49231e1700 1 Processor -- start 2021-12-17T18:25:03.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.689+0000 7f49231e1700 1 -- start start 2021-12-17T18:25:03.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.689+0000 7f49231e1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f491c0b6160 0x7f491c144c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:03.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.689+0000 7f49231e1700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f491c0af4e0 0x7f491c145160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:03.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.689+0000 7f49231e1700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491c144810 con 0x7f491c05c0e0 2021-12-17T18:25:03.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.689+0000 7f49231e1700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491c0b0be0 con 0x7f491c0af4e0 2021-12-17T18:25:03.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.689+0000 7f49231e1700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0b6540 con 0x7f491c0b6160 2021-12-17T18:25:03.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f491bfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f491c0af4e0 0x7f491c145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:03.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f492177e700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f491c05c0e0 0x7f491c0b28c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:52366/0 (socket says 172.21.15.62:52366) 2021-12-17T18:25:03.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f491bfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f491c0af4e0 0x7f491c145160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:59014/0 (socket says 172.21.15.62:59014) 2021-12-17T18:25:03.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f4920f7d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f491c0b6160 0x7f491c144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:03.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f492177e700 1 -- 172.21.15.62:0/1391944549 learned_addr learned my addr 172.21.15.62:0/1391944549 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:03.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f491bfff700 1 -- 172.21.15.62:0/1391944549 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f491c0b6160 msgr2=0x7f491c144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:03.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f491bfff700 1 --2- 172.21.15.62:0/1391944549 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f491c0b6160 0x7f491c144c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:03.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f491bfff700 1 -- 172.21.15.62:0/1391944549 >> v1:172.21.15.109:6789/0 conn(0x7f491c05c0e0 legacy=0x7f491c0b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:03.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f491bfff700 1 -- 172.21.15.62:0/1391944549 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c0afbf0 con 0x7f491c0af4e0 2021-12-17T18:25:03.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f491b7fe700 1 -- 172.21.15.62:0/1391944549 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771322366 0 0) 0x7f491c144810 con 0x7f491c05c0e0 2021-12-17T18:25:03.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f491bfff700 1 --2- 172.21.15.62:0/1391944549 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f491c0af4e0 0x7f491c145160 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f49040032f0 tx=0x7f49040091d0).ready entity=mon.1 client_cookie=ea6492b3b82804f3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:03.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f491b7fe700 1 -- 172.21.15.62:0/1391944549 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f490400b6c0 con 0x7f491c0af4e0 2021-12-17T18:25:03.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f491b7fe700 1 -- 172.21.15.62:0/1391944549 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490400b820 con 0x7f491c0af4e0 2021-12-17T18:25:03.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f491b7fe700 1 -- 172.21.15.62:0/1391944549 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f490400b990 con 0x7f491c0af4e0 2021-12-17T18:25:03.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f49231e1700 1 -- 172.21.15.62:0/1391944549 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f491c0af4e0 msgr2=0x7f491c145160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:03.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f49231e1700 1 --2- 172.21.15.62:0/1391944549 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f491c0af4e0 0x7f491c145160 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f49040032f0 tx=0x7f49040091d0).stop 2021-12-17T18:25:03.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f49231e1700 1 -- 172.21.15.62:0/1391944549 shutdown_connections 2021-12-17T18:25:03.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f49231e1700 1 --2- 172.21.15.62:0/1391944549 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f491c0af4e0 0x7f491c145160 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:03.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f49231e1700 1 --2- 172.21.15.62:0/1391944549 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f491c0b6160 0x7f491c144c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:03.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f49231e1700 1 -- 172.21.15.62:0/1391944549 >> 172.21.15.62:0/1391944549 conn(0x7f491c05c750 msgr2=0x7f491c0630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:03.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f49231e1700 1 -- 172.21.15.62:0/1391944549 shutdown_connections 2021-12-17T18:25:03.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f49231e1700 1 -- 172.21.15.62:0/1391944549 wait complete. 2021-12-17T18:25:03.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.693+0000 7f49231e1700 1 Processor -- start 2021-12-17T18:25:03.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f49231e1700 1 -- start start 2021-12-17T18:25:03.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f49231e1700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f491c05c0e0 0x7f491c13cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:03.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f49231e1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f491c0af4e0 0x7f491c0662d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:03.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f49231e1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f491c0b6160 0x7f491c0667c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:03.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f49231e1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c13d4d0 con 0x7f491c0af4e0 2021-12-17T18:25:03.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f49231e1700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c064340 con 0x7f491c05c0e0 2021-12-17T18:25:03.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f49231e1700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0645e0 con 0x7f491c0b6160 2021-12-17T18:25:03.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f491bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f491c0af4e0 0x7f491c0662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:03.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f491bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f491c0af4e0 0x7f491c0662d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52472/0 (socket says 172.21.15.62:52472) 2021-12-17T18:25:03.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f491bfff700 1 -- 172.21.15.62:0/3440045528 learned_addr learned my addr 172.21.15.62:0/3440045528 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:03.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f4920f7d700 1 --2- 172.21.15.62:0/3440045528 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f491c05c0e0 0x7f491c13cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:03.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f492177e700 1 --2- 172.21.15.62:0/3440045528 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f491c0b6160 0x7f491c0667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:03.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f491bfff700 1 -- 172.21.15.62:0/3440045528 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f491c0b6160 msgr2=0x7f491c0667c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:03.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f491bfff700 1 --2- 172.21.15.62:0/3440045528 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f491c0b6160 0x7f491c0667c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:03.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f491bfff700 1 -- 172.21.15.62:0/3440045528 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f491c05c0e0 msgr2=0x7f491c13cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:03.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f491bfff700 1 --2- 172.21.15.62:0/3440045528 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f491c05c0e0 0x7f491c13cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:03.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f491bfff700 1 -- 172.21.15.62:0/3440045528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4904009470 con 0x7f491c0af4e0 2021-12-17T18:25:03.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f492177e700 1 --2- 172.21.15.62:0/3440045528 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f491c0b6160 0x7f491c0667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:03.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f491bfff700 1 --2- 172.21.15.62:0/3440045528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f491c0af4e0 0x7f491c0662d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f49040032f0 tx=0x7f4904016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:03.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f4919ffb700 1 -- 172.21.15.62:0/3440045528 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f490400b990 con 0x7f491c0af4e0 2021-12-17T18:25:03.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f4919ffb700 1 -- 172.21.15.62:0/3440045528 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4904021630 con 0x7f491c0af4e0 2021-12-17T18:25:03.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f49231e1700 1 -- 172.21.15.62:0/3440045528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c064880 con 0x7f491c0af4e0 2021-12-17T18:25:03.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f4919ffb700 1 -- 172.21.15.62:0/3440045528 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f490400b6c0 con 0x7f491c0af4e0 2021-12-17T18:25:03.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f49231e1700 1 -- 172.21.15.62:0/3440045528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491c064060 con 0x7f491c0af4e0 2021-12-17T18:25:03.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.697+0000 7f49231e1700 1 -- 172.21.15.62:0/3440045528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491c0b0940 con 0x7f491c0af4e0 2021-12-17T18:25:03.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.701+0000 7f4919ffb700 1 -- 172.21.15.62:0/3440045528 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f490400f070 con 0x7f491c0af4e0 2021-12-17T18:25:03.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.701+0000 7f4919ffb700 1 --2- 172.21.15.62:0/3440045528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4900053580 0x7f4900055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:03.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.701+0000 7f4919ffb700 1 -- 172.21.15.62:0/3440045528 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f490406cde0 con 0x7f491c0af4e0 2021-12-17T18:25:03.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.701+0000 7f4920f7d700 1 --2- 172.21.15.62:0/3440045528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4900053580 0x7f4900055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:03.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.701+0000 7f4920f7d700 1 --2- 172.21.15.62:0/3440045528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4900053580 0x7f4900055a40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f491400b000 tx=0x7f4914006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:03.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.705+0000 7f4919ffb700 1 -- 172.21.15.62:0/3440045528 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4904043f10 con 0x7f491c0af4e0 2021-12-17T18:25:03.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.841+0000 7f49231e1700 1 -- 172.21.15.62:0/3440045528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blacklist ls", "format": "json"} v 0) v1 -- 0x7f491c0573d0 con 0x7f491c0af4e0 2021-12-17T18:25:03.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.841+0000 7f4919ffb700 1 -- 172.21.15.62:0/3440045528 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls", "format": "json"}]=0 listed 1 entries v72) v1 ==== 98+0+80 (secure 0 0 0) 0x7f4904015020 con 0x7f491c0af4e0 2021-12-17T18:25:03.847 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:03.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.845+0000 7f49231e1700 1 -- 172.21.15.62:0/3440045528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4900053580 msgr2=0x7f4900055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:03.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.845+0000 7f49231e1700 1 --2- 172.21.15.62:0/3440045528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4900053580 0x7f4900055a40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f491400b000 tx=0x7f4914006df0).stop 2021-12-17T18:25:03.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.845+0000 7f49231e1700 1 -- 172.21.15.62:0/3440045528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f491c0af4e0 msgr2=0x7f491c0662d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:03.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.845+0000 7f49231e1700 1 --2- 172.21.15.62:0/3440045528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f491c0af4e0 0x7f491c0662d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f49040032f0 tx=0x7f4904016000).stop 2021-12-17T18:25:03.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.845+0000 7f49231e1700 1 -- 172.21.15.62:0/3440045528 shutdown_connections 2021-12-17T18:25:03.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.845+0000 7f49231e1700 1 --2- 172.21.15.62:0/3440045528 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4900053580 0x7f4900055a40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:03.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.845+0000 7f49231e1700 1 --2- 172.21.15.62:0/3440045528 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f491c0b6160 0x7f491c0667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:03.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.845+0000 7f49231e1700 1 --2- 172.21.15.62:0/3440045528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f491c0af4e0 0x7f491c0662d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:03.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.845+0000 7f49231e1700 1 --2- 172.21.15.62:0/3440045528 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f491c05c0e0 0x7f491c13cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:03.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.845+0000 7f49231e1700 1 -- 172.21.15.62:0/3440045528 >> 172.21.15.62:0/3440045528 conn(0x7f491c05c750 msgr2=0x7f491c1418c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:03.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.845+0000 7f49231e1700 1 -- 172.21.15.62:0/3440045528 shutdown_connections 2021-12-17T18:25:03.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:03.845+0000 7f49231e1700 1 -- 172.21.15.62:0/3440045528 wait complete. 2021-12-17T18:25:03.853 INFO:teuthology.orchestra.run.smithi062.stderr:listed 1 entries 2021-12-17T18:25:03.859 INFO:teuthology.orchestra.run.smithi062.stdout:[{"addr":"172.21.15.125:0/479948347","until":"2021-12-17T19:24:57.482027+0000"}] 2021-12-17T18:25:03.875 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-12-17T18:25:03.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:03.877 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:03.877 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:03.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:25:03.886 INFO:teuthology.orchestra.run.smithi125.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-12-17T18:25:03.887 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-12-17T18:25:03.887 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:25:03.888 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:25:03.888 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:03.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:03.904 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:03.905 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:03.953 INFO:teuthology.orchestra.run.smithi125.stdout:ext2/ext3 2021-12-17T18:25:03.955 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:25:03.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:25:03.956 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:03.963 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:25:04.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.073+0000 7fc92aeba700 1 Processor -- start 2021-12-17T18:25:04.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.073+0000 7fc92aeba700 1 -- start start 2021-12-17T18:25:04.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.073+0000 7fc92aeba700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc924065630 0x7fc924066bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.073+0000 7fc92aeba700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc924065a10 con 0x7fc9240b1ff0 2021-12-17T18:25:04.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.073+0000 7fc92aeba700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9240670c0 con 0x7fc924144fa0 2021-12-17T18:25:04.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.073+0000 7fc92aeba700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc924067330 con 0x7fc924065630 2021-12-17T18:25:04.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.073+0000 7fc929eb8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc924065630 0x7fc924066bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc9296b7700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc9240b1ff0 0x7fc924144890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36058/0 (socket says 172.21.15.62:36058) 2021-12-17T18:25:04.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc9296b7700 1 -- 172.21.15.62:0/2773431167 learned_addr learned my addr 172.21.15.62:0/2773431167 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:04.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc928eb6700 1 -- 172.21.15.62:0/2773431167 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534029034 0 0) 0x7fc924065a10 con 0x7fc9240b1ff0 2021-12-17T18:25:04.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc928eb6700 1 -- 172.21.15.62:0/2773431167 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc90c003260 con 0x7fc9240b1ff0 2021-12-17T18:25:04.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc929eb8700 1 -- 172.21.15.62:0/2773431167 >> v1:172.21.15.109:6789/0 conn(0x7fc924144fa0 legacy=0x7fc9241404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc928eb6700 1 -- 172.21.15.62:0/2773431167 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032173543 0 0) 0x7fc9240670c0 con 0x7fc924144fa0 2021-12-17T18:25:04.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc929eb8700 1 -- 172.21.15.62:0/2773431167 >> v1:172.21.15.62:6789/0 conn(0x7fc9240b1ff0 legacy=0x7fc924144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc929eb8700 1 -- 172.21.15.62:0/2773431167 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9240675d0 con 0x7fc924065630 2021-12-17T18:25:04.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc929eb8700 1 --2- 172.21.15.62:0/2773431167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc924065630 0x7fc924066bd0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7fc924066190 tx=0x7fc914006df0).ready entity=mon.0 client_cookie=990e106af079e878 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:04.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc928eb6700 1 -- 172.21.15.62:0/2773431167 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc91400d610 con 0x7fc924065630 2021-12-17T18:25:04.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc928eb6700 1 -- 172.21.15.62:0/2773431167 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc914000e90 con 0x7fc924065630 2021-12-17T18:25:04.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc928eb6700 1 -- 172.21.15.62:0/2773431167 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc91400d960 con 0x7fc924065630 2021-12-17T18:25:04.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc92aeba700 1 -- 172.21.15.62:0/2773431167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc924065630 msgr2=0x7fc924066bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc92aeba700 1 --2- 172.21.15.62:0/2773431167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc924065630 0x7fc924066bd0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7fc924066190 tx=0x7fc914006df0).stop 2021-12-17T18:25:04.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc92aeba700 1 -- 172.21.15.62:0/2773431167 shutdown_connections 2021-12-17T18:25:04.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc92aeba700 1 --2- 172.21.15.62:0/2773431167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc924065630 0x7fc924066bd0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc92aeba700 1 -- 172.21.15.62:0/2773431167 >> 172.21.15.62:0/2773431167 conn(0x7fc92405c750 msgr2=0x7fc92405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:04.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc92aeba700 1 -- 172.21.15.62:0/2773431167 shutdown_connections 2021-12-17T18:25:04.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc92aeba700 1 -- 172.21.15.62:0/2773431167 wait complete. 2021-12-17T18:25:04.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc92aeba700 1 Processor -- start 2021-12-17T18:25:04.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.077+0000 7fc92aeba700 1 -- start start 2021-12-17T18:25:04.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc92aeba700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc924065630 0x7fc9240ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc92aeba700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240b1ff0 0x7fc9240b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc92aeba700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc924144fa0 0x7fc9240af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc92aeba700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240afdc0 con 0x7fc9240b1ff0 2021-12-17T18:25:04.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc92aeba700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92413c510 con 0x7fc924144fa0 2021-12-17T18:25:04.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc92aeba700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240b1960 con 0x7fc924065630 2021-12-17T18:25:04.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc9296b7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240b1ff0 0x7fc9240b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc9296b7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240b1ff0 0x7fc9240b6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52484/0 (socket says 172.21.15.62:52484) 2021-12-17T18:25:04.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc9296b7700 1 -- 172.21.15.62:0/2084624198 learned_addr learned my addr 172.21.15.62:0/2084624198 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:04.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc92a6b9700 1 --2- 172.21.15.62:0/2084624198 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc924144fa0 0x7fc9240af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc929eb8700 1 --2- 172.21.15.62:0/2084624198 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc924065630 0x7fc9240ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc9296b7700 1 -- 172.21.15.62:0/2084624198 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc924065630 msgr2=0x7fc9240ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc9296b7700 1 --2- 172.21.15.62:0/2084624198 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc924065630 0x7fc9240ade90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc9296b7700 1 -- 172.21.15.62:0/2084624198 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc924144fa0 msgr2=0x7fc9240af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc9296b7700 1 --2- 172.21.15.62:0/2084624198 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc924144fa0 0x7fc9240af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc9296b7700 1 -- 172.21.15.62:0/2084624198 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91400b180 con 0x7fc9240b1ff0 2021-12-17T18:25:04.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc92a6b9700 1 --2- 172.21.15.62:0/2084624198 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc924144fa0 0x7fc9240af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:04.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc9296b7700 1 --2- 172.21.15.62:0/2084624198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240b1ff0 0x7fc9240b6bd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fc9240afbc0 tx=0x7fc920007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:04.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc912ffd700 1 -- 172.21.15.62:0/2084624198 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc920005ba0 con 0x7fc9240b1ff0 2021-12-17T18:25:04.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc912ffd700 1 -- 172.21.15.62:0/2084624198 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc920005d00 con 0x7fc9240b1ff0 2021-12-17T18:25:04.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc92aeba700 1 -- 172.21.15.62:0/2084624198 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9240aead0 con 0x7fc9240b1ff0 2021-12-17T18:25:04.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc912ffd700 1 -- 172.21.15.62:0/2084624198 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9200072c0 con 0x7fc9240b1ff0 2021-12-17T18:25:04.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.081+0000 7fc92aeba700 1 -- 172.21.15.62:0/2084624198 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc924153bb0 con 0x7fc9240b1ff0 2021-12-17T18:25:04.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.085+0000 7fc92aeba700 1 -- 172.21.15.62:0/2084624198 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9240573d0 con 0x7fc9240b1ff0 2021-12-17T18:25:04.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.085+0000 7fc912ffd700 1 -- 172.21.15.62:0/2084624198 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc92001a070 con 0x7fc9240b1ff0 2021-12-17T18:25:04.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.085+0000 7fc912ffd700 1 --2- 172.21.15.62:0/2084624198 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9040536a0 0x7fc904055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.085+0000 7fc912ffd700 1 -- 172.21.15.62:0/2084624198 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fc92006aee0 con 0x7fc9240b1ff0 2021-12-17T18:25:04.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.085+0000 7fc929eb8700 1 --2- 172.21.15.62:0/2084624198 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9040536a0 0x7fc904055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.085+0000 7fc929eb8700 1 --2- 172.21.15.62:0/2084624198 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9040536a0 0x7fc904055b60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fc91401a000 tx=0x7fc914014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:04.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.093+0000 7fc912ffd700 1 -- 172.21.15.62:0/2084624198 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc920042010 con 0x7fc9240b1ff0 2021-12-17T18:25:04.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.221+0000 7fc92aeba700 1 -- 172.21.15.62:0/2084624198 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9240b3e20 con 0x7fc9240b1ff0 2021-12-17T18:25:04.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.221+0000 7fc912ffd700 1 -- 172.21.15.62:0/2084624198 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16150 (secure 0 0 0) 0x7fc920045630 con 0x7fc9240b1ff0 2021-12-17T18:25:04.227 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:04.228 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":72,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:24:57.781371+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:24:10.413185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-12-17T18:24:11.229328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.125:0/479948347":"2021-12-17T19:24:57.482027+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:25:04.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.225+0000 7fc92aeba700 1 -- 172.21.15.62:0/2084624198 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9040536a0 msgr2=0x7fc904055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.225+0000 7fc92aeba700 1 --2- 172.21.15.62:0/2084624198 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9040536a0 0x7fc904055b60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fc91401a000 tx=0x7fc914014000).stop 2021-12-17T18:25:04.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.225+0000 7fc92aeba700 1 -- 172.21.15.62:0/2084624198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240b1ff0 msgr2=0x7fc9240b6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.225+0000 7fc92aeba700 1 --2- 172.21.15.62:0/2084624198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240b1ff0 0x7fc9240b6bd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fc9240afbc0 tx=0x7fc920007e20).stop 2021-12-17T18:25:04.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.225+0000 7fc92aeba700 1 -- 172.21.15.62:0/2084624198 shutdown_connections 2021-12-17T18:25:04.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.225+0000 7fc92aeba700 1 --2- 172.21.15.62:0/2084624198 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9040536a0 0x7fc904055b60 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.225+0000 7fc92aeba700 1 --2- 172.21.15.62:0/2084624198 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc924144fa0 0x7fc9240af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.225+0000 7fc92aeba700 1 --2- 172.21.15.62:0/2084624198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240b1ff0 0x7fc9240b6bd0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.225+0000 7fc92aeba700 1 --2- 172.21.15.62:0/2084624198 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc924065630 0x7fc9240ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.225+0000 7fc92aeba700 1 -- 172.21.15.62:0/2084624198 >> 172.21.15.62:0/2084624198 conn(0x7fc92405c750 msgr2=0x7fc92413f510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:04.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.225+0000 7fc92aeba700 1 -- 172.21.15.62:0/2084624198 shutdown_connections 2021-12-17T18:25:04.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.225+0000 7fc92aeba700 1 -- 172.21.15.62:0/2084624198 wait complete. 2021-12-17T18:25:04.241 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:24:10.413185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:24:11.229328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:25:04.242 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:25:04.323 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:25:04.326 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:25:04.328 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:25:04.331 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:25:04.333 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:25:04.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2cdd3700 1 Processor -- start 2021-12-17T18:25:04.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2cdd3700 1 -- start start 2021-12-17T18:25:04.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2cdd3700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f0f28142680 0x7f0f28142a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2cdd3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0f280b4480 0x7f0f280b6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2cdd3700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f281470a0 con 0x7f0f280b6660 2021-12-17T18:25:04.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2cdd3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f280b59b0 con 0x7f0f280b4480 2021-12-17T18:25:04.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2cdd3700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f28147340 con 0x7f0f28142680 2021-12-17T18:25:04.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f25d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0f280b4480 0x7f0f280b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2659c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f0f28142680 0x7f0f28142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f26d9d700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f0f280b6660 0x7f0f281431e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:52394/0 (socket says 172.21.15.62:52394) 2021-12-17T18:25:04.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2659c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f0f28142680 0x7f0f28142a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:59042/0 (socket says 172.21.15.62:59042) 2021-12-17T18:25:04.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f25d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0f280b4480 0x7f0f280b6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52496/0 (socket says 172.21.15.62:52496) 2021-12-17T18:25:04.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f26d9d700 1 -- 172.21.15.62:0/2420418605 learned_addr learned my addr 172.21.15.62:0/2420418605 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:04.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f25d9b700 1 -- 172.21.15.62:0/2420418605 >> v2:172.21.15.109:3300/0 conn(0x7f0f28142680 msgr2=0x7f0f28142a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:04.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f25d9b700 1 --2- 172.21.15.62:0/2420418605 >> v2:172.21.15.109:3300/0 conn(0x7f0f28142680 0x7f0f28142a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f25d9b700 1 -- 172.21.15.62:0/2420418605 >> v1:172.21.15.109:6789/0 conn(0x7f0f280b6660 legacy=0x7f0f281431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2559a700 1 -- 172.21.15.62:0/2420418605 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527644639 0 0) 0x7f0f281470a0 con 0x7f0f280b6660 2021-12-17T18:25:04.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f25d9b700 1 -- 172.21.15.62:0/2420418605 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f280b4a40 con 0x7f0f280b4480 2021-12-17T18:25:04.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2659c700 1 --2- 172.21.15.62:0/2420418605 >> v2:172.21.15.109:3300/0 conn(0x7f0f28142680 0x7f0f28142a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:04.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f25d9b700 1 --2- 172.21.15.62:0/2420418605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f280b4480 0x7f0f280b6170 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f0f1c002f70 tx=0x7f0f1c006df0).ready entity=mon.0 client_cookie=4d3e5ac9bc7cb093 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:04.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2559a700 1 -- 172.21.15.62:0/2420418605 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f1c00d570 con 0x7f0f280b4480 2021-12-17T18:25:04.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2559a700 1 -- 172.21.15.62:0/2420418605 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1c000e90 con 0x7f0f280b4480 2021-12-17T18:25:04.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2559a700 1 -- 172.21.15.62:0/2420418605 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f1c00d8c0 con 0x7f0f280b4480 2021-12-17T18:25:04.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2cdd3700 1 -- 172.21.15.62:0/2420418605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f280b4480 msgr2=0x7f0f280b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2cdd3700 1 --2- 172.21.15.62:0/2420418605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f280b4480 0x7f0f280b6170 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f0f1c002f70 tx=0x7f0f1c006df0).stop 2021-12-17T18:25:04.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2cdd3700 1 -- 172.21.15.62:0/2420418605 shutdown_connections 2021-12-17T18:25:04.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2cdd3700 1 --2- 172.21.15.62:0/2420418605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f280b4480 0x7f0f280b6170 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2cdd3700 1 --2- 172.21.15.62:0/2420418605 >> v2:172.21.15.109:3300/0 conn(0x7f0f28142680 0x7f0f28142a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2cdd3700 1 -- 172.21.15.62:0/2420418605 >> 172.21.15.62:0/2420418605 conn(0x7f0f2805c750 msgr2=0x7f0f28062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:04.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2cdd3700 1 -- 172.21.15.62:0/2420418605 shutdown_connections 2021-12-17T18:25:04.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.341+0000 7f0f2cdd3700 1 -- 172.21.15.62:0/2420418605 wait complete. 2021-12-17T18:25:04.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f2cdd3700 1 Processor -- start 2021-12-17T18:25:04.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f2cdd3700 1 -- start start 2021-12-17T18:25:04.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f2cdd3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0f280b4480 0x7f0f280a5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f2cdd3700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0f280b6660 0x7f0f280b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f2cdd3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f28142680 0x7f0f281560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f2cdd3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f280a5920 con 0x7f0f28142680 2021-12-17T18:25:04.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f2cdd3700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f280a5b70 con 0x7f0f280b6660 2021-12-17T18:25:04.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f2cdd3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f280a5e10 con 0x7f0f280b4480 2021-12-17T18:25:04.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f26d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f28142680 0x7f0f281560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f26d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f28142680 0x7f0f281560b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52502/0 (socket says 172.21.15.62:52502) 2021-12-17T18:25:04.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f26d9d700 1 -- 172.21.15.62:0/3936413303 learned_addr learned my addr 172.21.15.62:0/3936413303 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:04.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f25d9b700 1 --2- 172.21.15.62:0/3936413303 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0f280b6660 0x7f0f280b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f2659c700 1 --2- 172.21.15.62:0/3936413303 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0f280b4480 0x7f0f280a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f26d9d700 1 -- 172.21.15.62:0/3936413303 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0f280b4480 msgr2=0x7f0f280a5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f26d9d700 1 --2- 172.21.15.62:0/3936413303 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0f280b4480 0x7f0f280a5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f26d9d700 1 -- 172.21.15.62:0/3936413303 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0f280b6660 msgr2=0x7f0f280b8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f26d9d700 1 --2- 172.21.15.62:0/3936413303 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0f280b6660 0x7f0f280b8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f26d9d700 1 -- 172.21.15.62:0/3936413303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1800b180 con 0x7f0f28142680 2021-12-17T18:25:04.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f26d9d700 1 --2- 172.21.15.62:0/3936413303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f28142680 0x7f0f281560b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f0f20001250 tx=0x7f0f20007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:04.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f177fe700 1 -- 172.21.15.62:0/3936413303 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f20005c70 con 0x7f0f28142680 2021-12-17T18:25:04.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f177fe700 1 -- 172.21.15.62:0/3936413303 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f20005dd0 con 0x7f0f28142680 2021-12-17T18:25:04.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f2cdd3700 1 -- 172.21.15.62:0/3936413303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1c00b180 con 0x7f0f28142680 2021-12-17T18:25:04.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f177fe700 1 -- 172.21.15.62:0/3936413303 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f20004a90 con 0x7f0f28142680 2021-12-17T18:25:04.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.345+0000 7f0f2cdd3700 1 -- 172.21.15.62:0/3936413303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f280b8f90 con 0x7f0f28142680 2021-12-17T18:25:04.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.349+0000 7f0f2cdd3700 1 -- 172.21.15.62:0/3936413303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f280573d0 con 0x7f0f28142680 2021-12-17T18:25:04.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.349+0000 7f0f177fe700 1 -- 172.21.15.62:0/3936413303 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0f20004bf0 con 0x7f0f28142680 2021-12-17T18:25:04.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.349+0000 7f0f177fe700 1 --2- 172.21.15.62:0/3936413303 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0f040535b0 0x7f0f04055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.349+0000 7f0f177fe700 1 -- 172.21.15.62:0/3936413303 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f0f2006b5c0 con 0x7f0f28142680 2021-12-17T18:25:04.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.349+0000 7f0f2659c700 1 --2- 172.21.15.62:0/3936413303 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0f040535b0 0x7f0f04055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.349+0000 7f0f2659c700 1 --2- 172.21.15.62:0/3936413303 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0f040535b0 0x7f0f04055a70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f0f1800b000 tx=0x7f0f18008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:04.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.357+0000 7f0f177fe700 1 -- 172.21.15.62:0/3936413303 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0f200426f0 con 0x7f0f28142680 2021-12-17T18:25:04.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.481+0000 7f0f2cdd3700 1 -- 172.21.15.62:0/3936413303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0f280609a0 con 0x7f0f28142680 2021-12-17T18:25:04.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.485+0000 7f0f177fe700 1 -- 172.21.15.62:0/3936413303 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v72) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0f20045d10 con 0x7f0f28142680 2021-12-17T18:25:04.488 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:25:04.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.485+0000 7f0f2cdd3700 1 -- 172.21.15.62:0/3936413303 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0f040535b0 msgr2=0x7f0f04055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.485+0000 7f0f2cdd3700 1 --2- 172.21.15.62:0/3936413303 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0f040535b0 0x7f0f04055a70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f0f1800b000 tx=0x7f0f18008040).stop 2021-12-17T18:25:04.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.485+0000 7f0f2cdd3700 1 -- 172.21.15.62:0/3936413303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f28142680 msgr2=0x7f0f281560b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.485+0000 7f0f2cdd3700 1 --2- 172.21.15.62:0/3936413303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f28142680 0x7f0f281560b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f0f20001250 tx=0x7f0f20007dc0).stop 2021-12-17T18:25:04.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.485+0000 7f0f2cdd3700 1 -- 172.21.15.62:0/3936413303 shutdown_connections 2021-12-17T18:25:04.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.485+0000 7f0f2cdd3700 1 --2- 172.21.15.62:0/3936413303 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0f040535b0 0x7f0f04055a70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.485+0000 7f0f2cdd3700 1 --2- 172.21.15.62:0/3936413303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f28142680 0x7f0f281560b0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.485+0000 7f0f2cdd3700 1 --2- 172.21.15.62:0/3936413303 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0f280b6660 0x7f0f280b8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.485+0000 7f0f2cdd3700 1 --2- 172.21.15.62:0/3936413303 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0f280b4480 0x7f0f280a5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.485+0000 7f0f2cdd3700 1 -- 172.21.15.62:0/3936413303 >> 172.21.15.62:0/3936413303 conn(0x7f0f2805c750 msgr2=0x7f0f280b9790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:04.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.485+0000 7f0f2cdd3700 1 -- 172.21.15.62:0/3936413303 shutdown_connections 2021-12-17T18:25:04.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.485+0000 7f0f2cdd3700 1 -- 172.21.15.62:0/3936413303 wait complete. 2021-12-17T18:25:04.507 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:25:04.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.617+0000 7f155ffff700 1 Processor -- start 2021-12-17T18:25:04.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.617+0000 7f155ffff700 1 -- start start 2021-12-17T18:25:04.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.617+0000 7f155ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f15600b4230 0x7f15600b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.617+0000 7f155ffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156005ce70 con 0x7f156005ca90 2021-12-17T18:25:04.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.617+0000 7f155ffff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15600b1bc0 con 0x7f15600b3540 2021-12-17T18:25:04.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.617+0000 7f155ffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15600b1e60 con 0x7f15600b4230 2021-12-17T18:25:04.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.617+0000 7f155f7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f15600b4230 0x7f15600b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.617+0000 7f155f7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f15600b4230 0x7f15600b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52510/0 (socket says 172.21.15.62:52510) 2021-12-17T18:25:04.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.617+0000 7f155effd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f156005ca90 0x7f15600b4f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36086/0 (socket says 172.21.15.62:36086) 2021-12-17T18:25:04.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.617+0000 7f155f7fe700 1 -- 172.21.15.62:0/3045251259 learned_addr learned my addr 172.21.15.62:0/3045251259 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:04.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.621+0000 7f155f7fe700 1 -- 172.21.15.62:0/3045251259 >> v1:172.21.15.109:6789/0 conn(0x7f15600b3540 legacy=0x7f1560145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:04.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.621+0000 7f155f7fe700 1 -- 172.21.15.62:0/3045251259 >> v1:172.21.15.62:6789/0 conn(0x7f156005ca90 legacy=0x7f15600b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.621+0000 7f155f7fe700 1 -- 172.21.15.62:0/3045251259 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15600b2100 con 0x7f15600b4230 2021-12-17T18:25:04.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.621+0000 7f155f7fe700 1 --2- 172.21.15.62:0/3045251259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15600b4230 0x7f15600b25a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f1560068710 tx=0x7f1558009290).ready entity=mon.0 client_cookie=2472b547bbeca5da server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:04.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.621+0000 7f155dffb700 1 -- 172.21.15.62:0/3045251259 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f155800b860 con 0x7f15600b4230 2021-12-17T18:25:04.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.621+0000 7f155dffb700 1 -- 172.21.15.62:0/3045251259 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155800b9c0 con 0x7f15600b4230 2021-12-17T18:25:04.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.621+0000 7f155dffb700 1 -- 172.21.15.62:0/3045251259 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f155800bb30 con 0x7f15600b4230 2021-12-17T18:25:04.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.621+0000 7f155ffff700 1 -- 172.21.15.62:0/3045251259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15600b4230 msgr2=0x7f15600b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.621+0000 7f155ffff700 1 --2- 172.21.15.62:0/3045251259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15600b4230 0x7f15600b25a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f1560068710 tx=0x7f1558009290).stop 2021-12-17T18:25:04.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.621+0000 7f155ffff700 1 -- 172.21.15.62:0/3045251259 shutdown_connections 2021-12-17T18:25:04.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.621+0000 7f155ffff700 1 --2- 172.21.15.62:0/3045251259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15600b4230 0x7f15600b25a0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.621+0000 7f155ffff700 1 -- 172.21.15.62:0/3045251259 >> 172.21.15.62:0/3045251259 conn(0x7f156005bcd0 msgr2=0x7f1560062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:04.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.621+0000 7f155ffff700 1 -- 172.21.15.62:0/3045251259 shutdown_connections 2021-12-17T18:25:04.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.621+0000 7f155ffff700 1 -- 172.21.15.62:0/3045251259 wait complete. 2021-12-17T18:25:04.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.621+0000 7f155ffff700 1 Processor -- start 2021-12-17T18:25:04.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.621+0000 7f155ffff700 1 -- start start 2021-12-17T18:25:04.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f156005ca90 0x7f1560063f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15600b3540 0x7f1560152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155ffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f15600b4230 0x7f1560152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1560066980 con 0x7f15600b3540 2021-12-17T18:25:04.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155ffff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15600a4a10 con 0x7f15600b4230 2021-12-17T18:25:04.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155ffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15600a32f0 con 0x7f156005ca90 2021-12-17T18:25:04.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15600b3540 0x7f1560152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15600b3540 0x7f1560152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52514/0 (socket says 172.21.15.62:52514) 2021-12-17T18:25:04.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155e7fc700 1 -- 172.21.15.62:0/1405016343 learned_addr learned my addr 172.21.15.62:0/1405016343 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:04.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155effd700 1 --2- 172.21.15.62:0/1405016343 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f156005ca90 0x7f1560063f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155f7fe700 1 --2- 172.21.15.62:0/1405016343 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f15600b4230 0x7f1560152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155e7fc700 1 -- 172.21.15.62:0/1405016343 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f156005ca90 msgr2=0x7f1560063f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155e7fc700 1 --2- 172.21.15.62:0/1405016343 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f156005ca90 0x7f1560063f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155e7fc700 1 -- 172.21.15.62:0/1405016343 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f15600b4230 msgr2=0x7f1560152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155e7fc700 1 --2- 172.21.15.62:0/1405016343 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f15600b4230 0x7f1560152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155e7fc700 1 -- 172.21.15.62:0/1405016343 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1558009530 con 0x7f15600b3540 2021-12-17T18:25:04.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155effd700 1 --2- 172.21.15.62:0/1405016343 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f156005ca90 0x7f1560063f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:04.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155e7fc700 1 --2- 172.21.15.62:0/1405016343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15600b3540 0x7f1560152ab0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f15600a6150 tx=0x7f1554007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:04.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f154ffff700 1 -- 172.21.15.62:0/1405016343 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f155400ce70 con 0x7f15600b3540 2021-12-17T18:25:04.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f154ffff700 1 -- 172.21.15.62:0/1405016343 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1554007240 con 0x7f15600b3540 2021-12-17T18:25:04.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155ffff700 1 -- 172.21.15.62:0/1405016343 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15600a4c40 con 0x7f15600b3540 2021-12-17T18:25:04.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f154ffff700 1 -- 172.21.15.62:0/1405016343 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1554006560 con 0x7f15600b3540 2021-12-17T18:25:04.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155ffff700 1 -- 172.21.15.62:0/1405016343 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1560152410 con 0x7f15600b3540 2021-12-17T18:25:04.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f155ffff700 1 -- 172.21.15.62:0/1405016343 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15600a4dd0 con 0x7f15600b3540 2021-12-17T18:25:04.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.625+0000 7f154ffff700 1 -- 172.21.15.62:0/1405016343 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1554010030 con 0x7f15600b3540 2021-12-17T18:25:04.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.629+0000 7f154ffff700 1 --2- 172.21.15.62:0/1405016343 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f153c053610 0x7f153c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.629+0000 7f154ffff700 1 -- 172.21.15.62:0/1405016343 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f155406b6e0 con 0x7f15600b3540 2021-12-17T18:25:04.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.629+0000 7f155effd700 1 --2- 172.21.15.62:0/1405016343 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f153c053610 0x7f153c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.629+0000 7f155effd700 1 --2- 172.21.15.62:0/1405016343 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f153c053610 0x7f153c055ad0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f155000b000 tx=0x7f15500070e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:04.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.633+0000 7f154ffff700 1 -- 172.21.15.62:0/1405016343 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1554042770 con 0x7f15600b3540 2021-12-17T18:25:04.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.761+0000 7f155ffff700 1 -- 172.21.15.62:0/1405016343 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f15600603f0 con 0x7f15600b3540 2021-12-17T18:25:04.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.761+0000 7f154ffff700 1 -- 172.21.15.62:0/1405016343 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v72) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1554045d90 con 0x7f15600b3540 2021-12-17T18:25:04.766 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:25:04.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.761+0000 7f155ffff700 1 -- 172.21.15.62:0/1405016343 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f153c053610 msgr2=0x7f153c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.761+0000 7f155ffff700 1 --2- 172.21.15.62:0/1405016343 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f153c053610 0x7f153c055ad0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f155000b000 tx=0x7f15500070e0).stop 2021-12-17T18:25:04.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.761+0000 7f155ffff700 1 -- 172.21.15.62:0/1405016343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15600b3540 msgr2=0x7f1560152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.761+0000 7f155ffff700 1 --2- 172.21.15.62:0/1405016343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15600b3540 0x7f1560152ab0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f15600a6150 tx=0x7f1554007c50).stop 2021-12-17T18:25:04.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.765+0000 7f155ffff700 1 -- 172.21.15.62:0/1405016343 shutdown_connections 2021-12-17T18:25:04.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.765+0000 7f155ffff700 1 --2- 172.21.15.62:0/1405016343 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f153c053610 0x7f153c055ad0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.765+0000 7f155ffff700 1 --2- 172.21.15.62:0/1405016343 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f15600b4230 0x7f1560152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.765+0000 7f155ffff700 1 --2- 172.21.15.62:0/1405016343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15600b3540 0x7f1560152ab0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.765+0000 7f155ffff700 1 --2- 172.21.15.62:0/1405016343 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f156005ca90 0x7f1560063f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.765+0000 7f155ffff700 1 -- 172.21.15.62:0/1405016343 >> 172.21.15.62:0/1405016343 conn(0x7f156005bcd0 msgr2=0x7f1560145810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:04.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.765+0000 7f155ffff700 1 -- 172.21.15.62:0/1405016343 shutdown_connections 2021-12-17T18:25:04.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.765+0000 7f155ffff700 1 -- 172.21.15.62:0/1405016343 wait complete. 2021-12-17T18:25:04.779 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:25:04.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe93359e700 1 Processor -- start 2021-12-17T18:25:04.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe93359e700 1 -- start start 2021-12-17T18:25:04.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe93359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe93405ca90 0x7fe93414abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe93359e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe9340604d0 0x7fe934146510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe93359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9340b2860 con 0x7fe9340b06b0 2021-12-17T18:25:04.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe93359e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9341475c0 con 0x7fe9340604d0 2021-12-17T18:25:04.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe93359e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93405fa40 con 0x7fe93405ca90 2021-12-17T18:25:04.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe929d9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe9340b06b0 0x7fe9340ace40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36100/0 (socket says 172.21.15.62:36100) 2021-12-17T18:25:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe929d9b700 1 -- 172.21.15.62:0/3580398599 learned_addr learned my addr 172.21.15.62:0/3580398599 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe932d9d700 1 --2- 172.21.15.62:0/3580398599 >> v2:172.21.15.109:3300/0 conn(0x7fe9340604d0 0x7fe934146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe93259c700 1 --2- 172.21.15.62:0/3580398599 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe93405ca90 0x7fe93414abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe931d9b700 1 -- 172.21.15.62:0/3580398599 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429865367 0 0) 0x7fe9340b2860 con 0x7fe9340b06b0 2021-12-17T18:25:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe931d9b700 1 -- 172.21.15.62:0/3580398599 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe914003260 con 0x7fe9340b06b0 2021-12-17T18:25:04.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe932d9d700 1 -- 172.21.15.62:0/3580398599 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe93405ca90 msgr2=0x7fe93414abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:04.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe932d9d700 1 --2- 172.21.15.62:0/3580398599 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe93405ca90 0x7fe93414abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe931d9b700 1 -- 172.21.15.62:0/3580398599 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1065428126 0 0) 0x7fe914003260 con 0x7fe9340b06b0 2021-12-17T18:25:04.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe932d9d700 1 -- 172.21.15.62:0/3580398599 >> v1:172.21.15.62:6789/0 conn(0x7fe9340b06b0 legacy=0x7fe9340ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe932d9d700 1 -- 172.21.15.62:0/3580398599 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9340ad550 con 0x7fe9340604d0 2021-12-17T18:25:04.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe93259c700 1 --2- 172.21.15.62:0/3580398599 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe93405ca90 0x7fe93414abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:04.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe932d9d700 1 --2- 172.21.15.62:0/3580398599 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9340604d0 0x7fe934146510 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fe924001800 tx=0x7fe92c0091d0).ready entity=mon.1 client_cookie=d0f46d5f7aa2e2ee server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:04.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe931d9b700 1 -- 172.21.15.62:0/3580398599 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe924001660 con 0x7fe9340604d0 2021-12-17T18:25:04.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe931d9b700 1 -- 172.21.15.62:0/3580398599 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92c00f510 con 0x7fe9340604d0 2021-12-17T18:25:04.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe931d9b700 1 -- 172.21.15.62:0/3580398599 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe92c00f680 con 0x7fe9340604d0 2021-12-17T18:25:04.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe93359e700 1 -- 172.21.15.62:0/3580398599 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9340604d0 msgr2=0x7fe934146510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe93359e700 1 --2- 172.21.15.62:0/3580398599 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9340604d0 0x7fe934146510 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fe924001800 tx=0x7fe92c0091d0).stop 2021-12-17T18:25:04.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe93359e700 1 -- 172.21.15.62:0/3580398599 shutdown_connections 2021-12-17T18:25:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe93359e700 1 --2- 172.21.15.62:0/3580398599 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9340604d0 0x7fe934146510 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe93359e700 1 --2- 172.21.15.62:0/3580398599 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe93405ca90 0x7fe93414abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe93359e700 1 -- 172.21.15.62:0/3580398599 >> 172.21.15.62:0/3580398599 conn(0x7fe93405c070 msgr2=0x7fe934062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe93359e700 1 -- 172.21.15.62:0/3580398599 shutdown_connections 2021-12-17T18:25:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.889+0000 7fe93359e700 1 -- 172.21.15.62:0/3580398599 wait complete. 2021-12-17T18:25:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93359e700 1 Processor -- start 2021-12-17T18:25:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93359e700 1 -- start start 2021-12-17T18:25:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe93405ca90 0x7fe93409e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9340604d0 0x7fe9340b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93359e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9340b06b0 0x7fe93414a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9340a1f90 con 0x7fe93405ca90 2021-12-17T18:25:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93359e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93414b370 con 0x7fe9340b06b0 2021-12-17T18:25:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93359e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9340a1ce0 con 0x7fe9340604d0 2021-12-17T18:25:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe93405ca90 0x7fe93409e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe93405ca90 0x7fe93409e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52526/0 (socket says 172.21.15.62:52526) 2021-12-17T18:25:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93259c700 1 -- 172.21.15.62:0/3638396509 learned_addr learned my addr 172.21.15.62:0/3638396509 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe929d9b700 1 --2- 172.21.15.62:0/3638396509 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9340604d0 0x7fe9340b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe932d9d700 1 --2- 172.21.15.62:0/3638396509 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9340b06b0 0x7fe93414a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93259c700 1 -- 172.21.15.62:0/3638396509 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9340604d0 msgr2=0x7fe9340b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93259c700 1 --2- 172.21.15.62:0/3638396509 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9340604d0 0x7fe9340b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93259c700 1 -- 172.21.15.62:0/3638396509 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9340b06b0 msgr2=0x7fe93414a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:04.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93259c700 1 --2- 172.21.15.62:0/3638396509 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9340b06b0 0x7fe93414a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:04.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93259c700 1 -- 172.21.15.62:0/3638396509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c00b180 con 0x7fe93405ca90 2021-12-17T18:25:04.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe932d9d700 1 --2- 172.21.15.62:0/3638396509 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9340b06b0 0x7fe93414a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:04.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93259c700 1 --2- 172.21.15.62:0/3638396509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe93405ca90 0x7fe93409e9d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7fe93409fcd0 tx=0x7fe91c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:04.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe92bfff700 1 -- 172.21.15.62:0/3638396509 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91c00c890 con 0x7fe93405ca90 2021-12-17T18:25:04.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe92bfff700 1 -- 172.21.15.62:0/3638396509 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c00c9f0 con 0x7fe93405ca90 2021-12-17T18:25:04.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93359e700 1 -- 172.21.15.62:0/3638396509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92c009470 con 0x7fe93405ca90 2021-12-17T18:25:04.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe92bfff700 1 -- 172.21.15.62:0/3638396509 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91c00cd50 con 0x7fe93405ca90 2021-12-17T18:25:04.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.893+0000 7fe93359e700 1 -- 172.21.15.62:0/3638396509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93414b5a0 con 0x7fe93405ca90 2021-12-17T18:25:04.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.897+0000 7fe93359e700 1 -- 172.21.15.62:0/3638396509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9340a1b30 con 0x7fe93405ca90 2021-12-17T18:25:04.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.897+0000 7fe92bfff700 1 -- 172.21.15.62:0/3638396509 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe91c01c460 con 0x7fe93405ca90 2021-12-17T18:25:04.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.897+0000 7fe92bfff700 1 --2- 172.21.15.62:0/3638396509 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe918053610 0x7fe918055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:04.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.897+0000 7fe92bfff700 1 -- 172.21.15.62:0/3638396509 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fe91c06bf40 con 0x7fe93405ca90 2021-12-17T18:25:04.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.897+0000 7fe929d9b700 1 --2- 172.21.15.62:0/3638396509 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe918053610 0x7fe918055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:04.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.897+0000 7fe929d9b700 1 --2- 172.21.15.62:0/3638396509 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe918053610 0x7fe918055ad0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fe92400d000 tx=0x7fe9240019e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:04.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:04.905+0000 7fe92bfff700 1 -- 172.21.15.62:0/3638396509 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe91c043010 con 0x7fe93405ca90 2021-12-17T18:25:05.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.025+0000 7fe93359e700 1 -- 172.21.15.62:0/3638396509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe9340a17a0 con 0x7fe93405ca90 2021-12-17T18:25:05.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.029+0000 7fe92bfff700 1 -- 172.21.15.62:0/3638396509 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe91c046630 con 0x7fe93405ca90 2021-12-17T18:25:05.032 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:25:05.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.029+0000 7fe93359e700 1 -- 172.21.15.62:0/3638396509 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe918053610 msgr2=0x7fe918055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:05.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.029+0000 7fe93359e700 1 --2- 172.21.15.62:0/3638396509 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe918053610 0x7fe918055ad0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fe92400d000 tx=0x7fe9240019e0).stop 2021-12-17T18:25:05.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.029+0000 7fe93359e700 1 -- 172.21.15.62:0/3638396509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe93405ca90 msgr2=0x7fe93409e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:05.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.029+0000 7fe93359e700 1 --2- 172.21.15.62:0/3638396509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe93405ca90 0x7fe93409e9d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7fe93409fcd0 tx=0x7fe91c006df0).stop 2021-12-17T18:25:05.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.029+0000 7fe93359e700 1 -- 172.21.15.62:0/3638396509 shutdown_connections 2021-12-17T18:25:05.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.029+0000 7fe93359e700 1 --2- 172.21.15.62:0/3638396509 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe918053610 0x7fe918055ad0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.029+0000 7fe93359e700 1 --2- 172.21.15.62:0/3638396509 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9340b06b0 0x7fe93414a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.029+0000 7fe93359e700 1 --2- 172.21.15.62:0/3638396509 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9340604d0 0x7fe9340b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.029+0000 7fe93359e700 1 --2- 172.21.15.62:0/3638396509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe93405ca90 0x7fe93409e9d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.029+0000 7fe93359e700 1 -- 172.21.15.62:0/3638396509 >> 172.21.15.62:0/3638396509 conn(0x7fe93405c070 msgr2=0x7fe9340ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:05.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.029+0000 7fe93359e700 1 -- 172.21.15.62:0/3638396509 shutdown_connections 2021-12-17T18:25:05.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.029+0000 7fe93359e700 1 -- 172.21.15.62:0/3638396509 wait complete. 2021-12-17T18:25:05.044 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:25:05.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f428f6cb700 1 Processor -- start 2021-12-17T18:25:05.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f428f6cb700 1 -- start start 2021-12-17T18:25:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f428f6cb700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f428805ce70 0x7f4288142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f428f6cb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42880af370 0x7f42881470c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f428f6cb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4288146580 con 0x7f42880b1910 2021-12-17T18:25:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f428f6cb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42880ad8c0 con 0x7f42880af370 2021-12-17T18:25:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f428f6cb700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4288143fe0 con 0x7f428805ce70 2021-12-17T18:25:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f428cc66700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f42880b1910 0x7f42881469b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36116/0 (socket says 172.21.15.62:36116) 2021-12-17T18:25:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f428cc66700 1 -- 172.21.15.62:0/2647410567 learned_addr learned my addr 172.21.15.62:0/2647410567 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f428dc68700 1 --2- 172.21.15.62:0/2647410567 >> v2:172.21.15.62:3300/0 conn(0x7f42880af370 0x7f42881470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f428d467700 1 --2- 172.21.15.62:0/2647410567 >> v2:172.21.15.109:3300/0 conn(0x7f428805ce70 0x7f4288142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f4277fff700 1 -- 172.21.15.62:0/2647410567 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249041609 0 0) 0x7f4288146580 con 0x7f42880b1910 2021-12-17T18:25:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f4277fff700 1 -- 172.21.15.62:0/2647410567 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4270003260 con 0x7f42880b1910 2021-12-17T18:25:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f428dc68700 1 -- 172.21.15.62:0/2647410567 >> v2:172.21.15.109:3300/0 conn(0x7f428805ce70 msgr2=0x7f4288142fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f428dc68700 1 --2- 172.21.15.62:0/2647410567 >> v2:172.21.15.109:3300/0 conn(0x7f428805ce70 0x7f4288142fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f428dc68700 1 -- 172.21.15.62:0/2647410567 >> v1:172.21.15.62:6789/0 conn(0x7f42880b1910 legacy=0x7f42881469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f428dc68700 1 -- 172.21.15.62:0/2647410567 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428805d250 con 0x7f42880af370 2021-12-17T18:25:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f428dc68700 1 --2- 172.21.15.62:0/2647410567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880af370 0x7f42881470c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f42880ad490 tx=0x7f42800091d0).ready entity=mon.0 client_cookie=f19357fb3aa0eb22 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:05.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f4277fff700 1 -- 172.21.15.62:0/2647410567 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f428000b5a0 con 0x7f42880af370 2021-12-17T18:25:05.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f4277fff700 1 -- 172.21.15.62:0/2647410567 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428000b700 con 0x7f42880af370 2021-12-17T18:25:05.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.149+0000 7f4277fff700 1 -- 172.21.15.62:0/2647410567 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f428000b870 con 0x7f42880af370 2021-12-17T18:25:05.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.153+0000 7f428f6cb700 1 -- 172.21.15.62:0/2647410567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880af370 msgr2=0x7f42881470c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:05.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.153+0000 7f428f6cb700 1 --2- 172.21.15.62:0/2647410567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880af370 0x7f42881470c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f42880ad490 tx=0x7f42800091d0).stop 2021-12-17T18:25:05.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.153+0000 7f428f6cb700 1 -- 172.21.15.62:0/2647410567 shutdown_connections 2021-12-17T18:25:05.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.153+0000 7f428f6cb700 1 --2- 172.21.15.62:0/2647410567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880af370 0x7f42881470c0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.153+0000 7f428f6cb700 1 --2- 172.21.15.62:0/2647410567 >> v2:172.21.15.109:3300/0 conn(0x7f428805ce70 0x7f4288142fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.153+0000 7f428f6cb700 1 -- 172.21.15.62:0/2647410567 >> 172.21.15.62:0/2647410567 conn(0x7f428805c750 msgr2=0x7f4288062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:05.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.153+0000 7f428f6cb700 1 -- 172.21.15.62:0/2647410567 shutdown_connections 2021-12-17T18:25:05.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.153+0000 7f428f6cb700 1 -- 172.21.15.62:0/2647410567 wait complete. 2021-12-17T18:25:05.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.153+0000 7f428f6cb700 1 Processor -- start 2021-12-17T18:25:05.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.153+0000 7f428f6cb700 1 -- start start 2021-12-17T18:25:05.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428f6cb700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f428805ce70 0x7f42880b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:05.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428f6cb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880af370 0x7f428813fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:05.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428f6cb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42880b1910 0x7f4288140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:05.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428f6cb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4288112b30 con 0x7f42880af370 2021-12-17T18:25:05.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428f6cb700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42880b5be0 con 0x7f428805ce70 2021-12-17T18:25:05.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428f6cb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4288064ff0 con 0x7f42880b1910 2021-12-17T18:25:05.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428cc66700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880af370 0x7f428813fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:05.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428cc66700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880af370 0x7f428813fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52542/0 (socket says 172.21.15.62:52542) 2021-12-17T18:25:05.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428cc66700 1 -- 172.21.15.62:0/2419120504 learned_addr learned my addr 172.21.15.62:0/2419120504 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:05.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428d467700 1 --2- 172.21.15.62:0/2419120504 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f428805ce70 0x7f42880b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:05.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428dc68700 1 --2- 172.21.15.62:0/2419120504 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42880b1910 0x7f4288140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:05.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428cc66700 1 -- 172.21.15.62:0/2419120504 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42880b1910 msgr2=0x7f4288140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:05.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428cc66700 1 --2- 172.21.15.62:0/2419120504 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42880b1910 0x7f4288140260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428cc66700 1 -- 172.21.15.62:0/2419120504 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f428805ce70 msgr2=0x7f42880b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:05.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428cc66700 1 --2- 172.21.15.62:0/2419120504 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f428805ce70 0x7f42880b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428cc66700 1 -- 172.21.15.62:0/2419120504 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4280009470 con 0x7f42880af370 2021-12-17T18:25:05.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428cc66700 1 --2- 172.21.15.62:0/2419120504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880af370 0x7f428813fd70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f4278001110 tx=0x7f4278007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:05.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f42767fc700 1 -- 172.21.15.62:0/2419120504 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f427800cdd0 con 0x7f42880af370 2021-12-17T18:25:05.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f42767fc700 1 -- 172.21.15.62:0/2419120504 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42780070d0 con 0x7f42880af370 2021-12-17T18:25:05.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428f6cb700 1 -- 172.21.15.62:0/2419120504 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4288065290 con 0x7f42880af370 2021-12-17T18:25:05.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f42767fc700 1 -- 172.21.15.62:0/2419120504 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4278007430 con 0x7f42880af370 2021-12-17T18:25:05.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428f6cb700 1 -- 172.21.15.62:0/2419120504 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4288140750 con 0x7f42880af370 2021-12-17T18:25:05.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f42767fc700 1 -- 172.21.15.62:0/2419120504 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4278010070 con 0x7f42880af370 2021-12-17T18:25:05.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.157+0000 7f428f6cb700 1 -- 172.21.15.62:0/2419120504 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42880af030 con 0x7f42880af370 2021-12-17T18:25:05.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.161+0000 7f42767fc700 1 --2- 172.21.15.62:0/2419120504 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4268053580 0x7f4268055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:05.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.161+0000 7f42767fc700 1 -- 172.21.15.62:0/2419120504 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f427806afa0 con 0x7f42880af370 2021-12-17T18:25:05.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.161+0000 7f428d467700 1 --2- 172.21.15.62:0/2419120504 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4268053580 0x7f4268055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:05.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.161+0000 7f428d467700 1 --2- 172.21.15.62:0/2419120504 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4268053580 0x7f4268055a40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f4284006000 tx=0x7f4284006d90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:05.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.165+0000 7f42767fc700 1 -- 172.21.15.62:0/2419120504 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4278041fc0 con 0x7f42880af370 2021-12-17T18:25:05.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.293+0000 7f428f6cb700 1 -- 172.21.15.62:0/2419120504 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42880573d0 con 0x7f42880af370 2021-12-17T18:25:05.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.293+0000 7f42767fc700 1 -- 172.21.15.62:0/2419120504 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+10 (secure 0 0 0) 0x7f42780455e0 con 0x7f42880af370 2021-12-17T18:25:05.302 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:25:05.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.297+0000 7f428f6cb700 1 -- 172.21.15.62:0/2419120504 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4268053580 msgr2=0x7f4268055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:05.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.297+0000 7f428f6cb700 1 --2- 172.21.15.62:0/2419120504 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4268053580 0x7f4268055a40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f4284006000 tx=0x7f4284006d90).stop 2021-12-17T18:25:05.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.297+0000 7f428f6cb700 1 -- 172.21.15.62:0/2419120504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880af370 msgr2=0x7f428813fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:05.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.297+0000 7f428f6cb700 1 --2- 172.21.15.62:0/2419120504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880af370 0x7f428813fd70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f4278001110 tx=0x7f4278007aa0).stop 2021-12-17T18:25:05.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.297+0000 7f428f6cb700 1 -- 172.21.15.62:0/2419120504 shutdown_connections 2021-12-17T18:25:05.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.297+0000 7f428f6cb700 1 --2- 172.21.15.62:0/2419120504 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4268053580 0x7f4268055a40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.297+0000 7f428f6cb700 1 --2- 172.21.15.62:0/2419120504 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42880b1910 0x7f4288140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.297+0000 7f428f6cb700 1 --2- 172.21.15.62:0/2419120504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880af370 0x7f428813fd70 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.297+0000 7f428f6cb700 1 --2- 172.21.15.62:0/2419120504 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f428805ce70 0x7f42880b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.297+0000 7f428f6cb700 1 -- 172.21.15.62:0/2419120504 >> 172.21.15.62:0/2419120504 conn(0x7f428805c750 msgr2=0x7f4288148e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:05.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.297+0000 7f428f6cb700 1 -- 172.21.15.62:0/2419120504 shutdown_connections 2021-12-17T18:25:05.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.297+0000 7f428f6cb700 1 -- 172.21.15.62:0/2419120504 wait complete. 2021-12-17T18:25:05.312 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:25:05.313 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:05.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.412+0000 7f991ed22700 1 Processor -- start 2021-12-17T18:25:05.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.412+0000 7f991ed22700 1 -- start start 2021-12-17T18:25:05.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.412+0000 7f991ed22700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f99180a8e10 0x7f9918147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:05.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.412+0000 7f991ed22700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99180b6270 con 0x7f9918141480 2021-12-17T18:25:05.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.412+0000 7f991ed22700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9918147610 con 0x7f99180a71e0 2021-12-17T18:25:05.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.412+0000 7f991ed22700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99181478b0 con 0x7f99180a8e10 2021-12-17T18:25:05.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.412+0000 7f991dd20700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9918141480 0x7f99180b5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36128/0 (socket says 172.21.15.62:36128) 2021-12-17T18:25:05.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.412+0000 7f991dd20700 1 -- 172.21.15.62:0/1998420986 learned_addr learned my addr 172.21.15.62:0/1998420986 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:05.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.412+0000 7f991d51f700 1 --2- 172.21.15.62:0/1998420986 >> v2:172.21.15.109:3300/0 conn(0x7f99180a8e10 0x7f9918147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:05.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991cd1e700 1 -- 172.21.15.62:0/1998420986 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209341867 0 0) 0x7f99180b6270 con 0x7f9918141480 2021-12-17T18:25:05.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991cd1e700 1 -- 172.21.15.62:0/1998420986 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98fc003260 con 0x7f9918141480 2021-12-17T18:25:05.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991d51f700 1 -- 172.21.15.62:0/1998420986 >> v1:172.21.15.109:6789/0 conn(0x7f99180a71e0 legacy=0x7f99180a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:05.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991d51f700 1 -- 172.21.15.62:0/1998420986 >> v1:172.21.15.62:6789/0 conn(0x7f9918141480 legacy=0x7f99180b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:05.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991d51f700 1 -- 172.21.15.62:0/1998420986 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9918147b50 con 0x7f99180a8e10 2021-12-17T18:25:05.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991d51f700 1 --2- 172.21.15.62:0/1998420986 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f99180a8e10 0x7f9918147ff0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f9908002f70 tx=0x7f9908006df0).ready entity=mon.1 client_cookie=f795852e94631b09 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:05.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991cd1e700 1 -- 172.21.15.62:0/1998420986 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f990800d610 con 0x7f99180a8e10 2021-12-17T18:25:05.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991cd1e700 1 -- 172.21.15.62:0/1998420986 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9908000e90 con 0x7f99180a8e10 2021-12-17T18:25:05.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991cd1e700 1 -- 172.21.15.62:0/1998420986 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f990800d960 con 0x7f99180a8e10 2021-12-17T18:25:05.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991ed22700 1 -- 172.21.15.62:0/1998420986 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f99180a8e10 msgr2=0x7f9918147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:05.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991ed22700 1 --2- 172.21.15.62:0/1998420986 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f99180a8e10 0x7f9918147ff0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f9908002f70 tx=0x7f9908006df0).stop 2021-12-17T18:25:05.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991ed22700 1 -- 172.21.15.62:0/1998420986 shutdown_connections 2021-12-17T18:25:05.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991ed22700 1 --2- 172.21.15.62:0/1998420986 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f99180a8e10 0x7f9918147ff0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991ed22700 1 -- 172.21.15.62:0/1998420986 >> 172.21.15.62:0/1998420986 conn(0x7f991805d220 msgr2=0x7f99180b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:05.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991ed22700 1 -- 172.21.15.62:0/1998420986 shutdown_connections 2021-12-17T18:25:05.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991ed22700 1 -- 172.21.15.62:0/1998420986 wait complete. 2021-12-17T18:25:05.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991ed22700 1 Processor -- start 2021-12-17T18:25:05.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.416+0000 7f991ed22700 1 -- start start 2021-12-17T18:25:05.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991ed22700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f99180a71e0 0x7f99180b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:05.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991ed22700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f99180a8e10 0x7f991813e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:05.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991ed22700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9918141480 0x7f9918148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:05.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991ed22700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99180b5ef0 con 0x7f9918141480 2021-12-17T18:25:05.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991ed22700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99180b3280 con 0x7f99180a71e0 2021-12-17T18:25:05.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991ed22700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991814b410 con 0x7f99180a8e10 2021-12-17T18:25:05.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991e521700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9918141480 0x7f9918148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:05.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991e521700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9918141480 0x7f9918148fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52558/0 (socket says 172.21.15.62:52558) 2021-12-17T18:25:05.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991e521700 1 -- 172.21.15.62:0/2790486621 learned_addr learned my addr 172.21.15.62:0/2790486621 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:05.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991dd20700 1 --2- 172.21.15.62:0/2790486621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f99180a71e0 0x7f99180b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:05.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991d51f700 1 --2- 172.21.15.62:0/2790486621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f99180a8e10 0x7f991813e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:05.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991dd20700 1 -- 172.21.15.62:0/2790486621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f99180a8e10 msgr2=0x7f991813e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:05.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991dd20700 1 --2- 172.21.15.62:0/2790486621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f99180a8e10 0x7f991813e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991dd20700 1 -- 172.21.15.62:0/2790486621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9918141480 msgr2=0x7f9918148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:05.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991dd20700 1 --2- 172.21.15.62:0/2790486621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9918141480 0x7f9918148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991dd20700 1 -- 172.21.15.62:0/2790486621 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990800b180 con 0x7f99180a71e0 2021-12-17T18:25:05.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991e521700 1 --2- 172.21.15.62:0/2790486621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9918141480 0x7f9918148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:05.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991dd20700 1 --2- 172.21.15.62:0/2790486621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f99180a71e0 0x7f99180b5250 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f9910001490 tx=0x7f9910007da0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:05.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f990effd700 1 -- 172.21.15.62:0/2790486621 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9910005ba0 con 0x7f99180a71e0 2021-12-17T18:25:05.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f990effd700 1 -- 172.21.15.62:0/2790486621 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910005d00 con 0x7f99180a71e0 2021-12-17T18:25:05.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991ed22700 1 -- 172.21.15.62:0/2790486621 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99180b34b0 con 0x7f99180a71e0 2021-12-17T18:25:05.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f990effd700 1 -- 172.21.15.62:0/2790486621 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99100072c0 con 0x7f99180a71e0 2021-12-17T18:25:05.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991ed22700 1 -- 172.21.15.62:0/2790486621 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9918149490 con 0x7f99180a71e0 2021-12-17T18:25:05.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.420+0000 7f991ed22700 1 -- 172.21.15.62:0/2790486621 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991814b890 con 0x7f99180a71e0 2021-12-17T18:25:05.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.424+0000 7f990effd700 1 -- 172.21.15.62:0/2790486621 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9910010070 con 0x7f99180a71e0 2021-12-17T18:25:05.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.424+0000 7f990effd700 1 --2- 172.21.15.62:0/2790486621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9900053640 0x7f9900055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:05.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.424+0000 7f990effd700 1 -- 172.21.15.62:0/2790486621 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f991006b140 con 0x7f99180a71e0 2021-12-17T18:25:05.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.424+0000 7f991d51f700 1 --2- 172.21.15.62:0/2790486621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9900053640 0x7f9900055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:05.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.424+0000 7f991d51f700 1 --2- 172.21.15.62:0/2790486621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9900053640 0x7f9900055b00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f990801a000 tx=0x7f9908014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:05.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.432+0000 7f990effd700 1 -- 172.21.15.62:0/2790486621 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f991814b890 con 0x7f99180a71e0 2021-12-17T18:25:05.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.596+0000 7f991ed22700 1 -- 172.21.15.62:0/2790486621 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f991814b890 con 0x7f99180a71e0 2021-12-17T18:25:05.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.600+0000 7f990effd700 1 -- 172.21.15.62:0/2790486621 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f991814b890 con 0x7f99180a71e0 2021-12-17T18:25:05.604 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:05.605 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":32,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5672,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/2267359903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":2267359903},{"type":"v1","addr":"172.21.15.109:6835","nonce":2267359903}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:24:11.805782+0000","modified":"2021-12-17T18:24:12.808883+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6318":{"gid":6318,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/414220193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":414220193},{"type":"v1","addr":"172.21.15.62:6833","nonce":414220193}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-12-17T18:25:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.600+0000 7f991ed22700 1 -- 172.21.15.62:0/2790486621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9900053640 msgr2=0x7f9900055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:05.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.600+0000 7f991ed22700 1 --2- 172.21.15.62:0/2790486621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9900053640 0x7f9900055b00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f990801a000 tx=0x7f9908014000).stop 2021-12-17T18:25:05.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.600+0000 7f991ed22700 1 -- 172.21.15.62:0/2790486621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f99180a71e0 msgr2=0x7f99180b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:05.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.600+0000 7f991ed22700 1 --2- 172.21.15.62:0/2790486621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f99180a71e0 0x7f99180b5250 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f9910001490 tx=0x7f9910007da0).stop 2021-12-17T18:25:05.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.600+0000 7f991ed22700 1 -- 172.21.15.62:0/2790486621 shutdown_connections 2021-12-17T18:25:05.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.600+0000 7f991ed22700 1 --2- 172.21.15.62:0/2790486621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9900053640 0x7f9900055b00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.600+0000 7f991ed22700 1 --2- 172.21.15.62:0/2790486621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9918141480 0x7f9918148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.600+0000 7f991ed22700 1 --2- 172.21.15.62:0/2790486621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f99180a8e10 0x7f991813e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.600+0000 7f991ed22700 1 --2- 172.21.15.62:0/2790486621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f99180a71e0 0x7f99180b5250 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:05.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.600+0000 7f991ed22700 1 -- 172.21.15.62:0/2790486621 >> 172.21.15.62:0/2790486621 conn(0x7f991805d220 msgr2=0x7f991805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:05.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.600+0000 7f991ed22700 1 -- 172.21.15.62:0/2790486621 shutdown_connections 2021-12-17T18:25:05.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:05.600+0000 7f991ed22700 1 -- 172.21.15.62:0/2790486621 wait complete. 2021-12-17T18:25:05.610 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 32 2021-12-17T18:25:05.817 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:24:11.805782+0000', 'modified': '2021-12-17T18:24:12.808883+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6318}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6318': {'gid': 6318, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/414220193', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 414220193}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 414220193}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:25:05.818 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:25:05.819 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:25:05.940 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":6318,"want_state":"up:active","state":"up:active","rank_uptime":54.119994204000001,"mdsmap_epoch":32,"osdmap_epoch":72,"osdmap_epoch_barrier":72,"uptime":58.451780421999999} 2021-12-17T18:25:05.941 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 6318, "mdsmap_epoch": 32, "osdmap_epoch": 72, "osdmap_epoch_barrier": 72, "rank_uptime": 54.119994204, "state": "up:active", "uptime": 58.451780422, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:25:05.941 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:25:05.942 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-12-17T18:25:05.942 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-12-17T18:25:05.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:05.943 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:05.951 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:25:05.968 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:25:05.969 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:25:06.026 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:25:06.027 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:25:06.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:06.028 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:25:06.033 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:25:06.034 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:06.036 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:25:06.054 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:25:06.054 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:25:06.115 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:25:06.116 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2021-12-17T18:25:06.109+0000 7f661bea0080 -1 init, newargv = 0x5619f1e2ce90 newargc=9 2021-12-17T18:25:06.116 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14586]: starting ceph client 2021-12-17T18:25:06.117 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:25:06.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:06.118 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:25:06.125 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14586]: starting fuse 2021-12-17T18:25:07.224 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:25:07.243 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:25:07.244 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:25:07.302 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:25:07.302 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:25:07.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:07.304 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:25:07.309 INFO:teuthology.orchestra.run.smithi125.stdout:52 2021-12-17T18:25:07.309 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:25:07.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:07.310 DEBUG:teuthology.orchestra.run.smithi125:> sudo python3 -c ' 2021-12-17T18:25:07.311 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2021-12-17T18:25:07.311 DEBUG:teuthology.orchestra.run.smithi125:> import re 2021-12-17T18:25:07.311 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:25:07.312 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2021-12-17T18:25:07.312 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:25:07.313 DEBUG:teuthology.orchestra.run.smithi125:> def find_socket(client_name): 2021-12-17T18:25:07.313 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-12-17T18:25:07.313 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2021-12-17T18:25:07.314 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:25:07.314 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2021-12-17T18:25:07.315 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2021-12-17T18:25:07.315 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2021-12-17T18:25:07.316 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2021-12-17T18:25:07.316 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:25:07.316 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2021-12-17T18:25:07.317 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:25:07.317 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:25:07.318 DEBUG:teuthology.orchestra.run.smithi125:> return f 2021-12-17T18:25:07.318 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:25:07.318 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:25:07.319 DEBUG:teuthology.orchestra.run.smithi125:> print(find_socket("client.0")) 2021-12-17T18:25:07.319 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:25:07.393 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.14586.asok 2021-12-17T18:25:07.398 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14586.asok 2021-12-17T18:25:07.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:07.399 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14586.asok status 2021-12-17T18:25:07.486 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2021-12-17T18:25:07.486 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2021-12-17T18:25:07.487 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:25:07.487 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:25:07.487 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2021-12-17T18:25:07.487 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2021-12-17T18:25:07.488 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-12-17T18:25:07.488 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "14586", 2021-12-17T18:25:07.488 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2021-12-17T18:25:07.488 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:25:07.489 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2021-12-17T18:25:07.489 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2021-12-17T18:25:07.489 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5867, 2021-12-17T18:25:07.489 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2021-12-17T18:25:07.490 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2021-12-17T18:25:07.490 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2021-12-17T18:25:07.490 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 5867 2021-12-17T18:25:07.490 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:25:07.491 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:25:07.491 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:25:07.491 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:25:07.491 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 3011339763 2021-12-17T18:25:07.491 INFO:teuthology.orchestra.run.smithi125.stdout: } 2021-12-17T18:25:07.492 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:25:07.492 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:25:07.492 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:25:07.493 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:25:07.493 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 3011339763 2021-12-17T18:25:07.493 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:25:07.493 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.5867 172.21.15.125:0/3011339763", 2021-12-17T18:25:07.494 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "172.21.15.125:0/3011339763", 2021-12-17T18:25:07.494 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2021-12-17T18:25:07.494 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 32, 2021-12-17T18:25:07.494 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 72, 2021-12-17T18:25:07.495 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:25:07.495 INFO:teuthology.orchestra.run.smithi125.stdout: "blacklisted": false, 2021-12-17T18:25:07.495 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2021-12-17T18:25:07.495 INFO:teuthology.orchestra.run.smithi125.stdout:} 2021-12-17T18:25:07.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:07.497 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:07.498 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:07.504 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:25:07.505 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:25:07.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:07.506 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:07.566 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:25:07.566 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:07.589 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:07.612 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:07.632 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:07.654 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:07.675 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:25:07.676 INFO:tasks.cephfs.mount:Terminating background process 2021-12-17T18:25:07.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:07.677 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:07.677 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:07.686 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:25:07.687 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:25:07.687 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:25:07.688 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:25:07.688 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:07.703 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14586]: fuse finished with error 0 and tester_r 0 2021-12-17T18:25:07.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:07.705 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:07.706 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:07.753 INFO:teuthology.orchestra.run.smithi125.stdout:ext2/ext3 2021-12-17T18:25:07.755 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:25:07.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:25:07.871 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:07.879 INFO:tasks.cephfs.mount:Terminating background process 2021-12-17T18:25:07.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:07.880 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:07.881 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:07.889 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:25:07.890 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:25:07.890 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi158.front.sepia.ceph.com... 2021-12-17T18:25:07.891 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:25:07.891 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:07.945 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14028]: fuse finished with error 0 and tester_r 0 2021-12-17T18:25:07.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:07.947 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:07.948 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:07.954 INFO:teuthology.orchestra.run.smithi158.stdout:ext2/ext3 2021-12-17T18:25:07.955 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:25:08.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:25:08.072 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:08.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:08.123 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:08.123 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:25:08.130 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:25:08.131 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:25:08.132 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:25:08.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:25:08.133 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:25:08.140 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:25:08.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:25:08.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:25:08.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.244+0000 7f10d4c8c700 1 Processor -- start 2021-12-17T18:25:08.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.244+0000 7f10d4c8c700 1 -- start start 2021-12-17T18:25:08.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10d4c8c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f10d0067830 0x7f10d0146940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:08.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10d4c8c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10d0147540 0x7f10d00b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:08.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10d4c8c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d0067c10 con 0x7f10d00aca60 2021-12-17T18:25:08.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10d4c8c700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d0060520 con 0x7f10d0067830 2021-12-17T18:25:08.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10d4c8c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d00acf00 con 0x7f10d0147540 2021-12-17T18:25:08.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10cdd9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f10d00aca60 0x7f10d0146e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36142/0 (socket says 172.21.15.62:36142) 2021-12-17T18:25:08.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10cdd9b700 1 -- 172.21.15.62:0/2739210400 learned_addr learned my addr 172.21.15.62:0/2739210400 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:08.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10ce59c700 1 --2- 172.21.15.62:0/2739210400 >> v2:172.21.15.109:3300/0 conn(0x7f10d0067830 0x7f10d0146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:08.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10ced9d700 1 --2- 172.21.15.62:0/2739210400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10d0147540 0x7f10d00b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:08.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10cd59a700 1 -- 172.21.15.62:0/2739210400 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312219244 0 0) 0x7f10d0067c10 con 0x7f10d00aca60 2021-12-17T18:25:08.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10cd59a700 1 -- 172.21.15.62:0/2739210400 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10b0003260 con 0x7f10d00aca60 2021-12-17T18:25:08.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10ce59c700 1 -- 172.21.15.62:0/2739210400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10d0147540 msgr2=0x7f10d00b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:08.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10ce59c700 1 --2- 172.21.15.62:0/2739210400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10d0147540 0x7f10d00b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10ce59c700 1 -- 172.21.15.62:0/2739210400 >> v1:172.21.15.62:6789/0 conn(0x7f10d00aca60 legacy=0x7f10d0146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:08.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10ce59c700 1 -- 172.21.15.62:0/2739210400 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d00b12a0 con 0x7f10d0067830 2021-12-17T18:25:08.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10ce59c700 1 --2- 172.21.15.62:0/2739210400 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10d0067830 0x7f10d0146940 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f10c0002f70 tx=0x7f10c0006df0).ready entity=mon.1 client_cookie=1ccafa1430a6b09 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:08.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10cd59a700 1 -- 172.21.15.62:0/2739210400 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10c000d4a0 con 0x7f10d0067830 2021-12-17T18:25:08.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10cd59a700 1 -- 172.21.15.62:0/2739210400 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c0000e90 con 0x7f10d0067830 2021-12-17T18:25:08.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10cd59a700 1 -- 172.21.15.62:0/2739210400 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10c000d7f0 con 0x7f10d0067830 2021-12-17T18:25:08.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10d4c8c700 1 -- 172.21.15.62:0/2739210400 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10d0067830 msgr2=0x7f10d0146940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:08.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10d4c8c700 1 --2- 172.21.15.62:0/2739210400 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10d0067830 0x7f10d0146940 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f10c0002f70 tx=0x7f10c0006df0).stop 2021-12-17T18:25:08.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10d4c8c700 1 -- 172.21.15.62:0/2739210400 shutdown_connections 2021-12-17T18:25:08.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10d4c8c700 1 --2- 172.21.15.62:0/2739210400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10d0147540 0x7f10d00b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10d4c8c700 1 --2- 172.21.15.62:0/2739210400 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10d0067830 0x7f10d0146940 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10d4c8c700 1 -- 172.21.15.62:0/2739210400 >> 172.21.15.62:0/2739210400 conn(0x7f10d005f730 msgr2=0x7f10d005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:08.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10d4c8c700 1 -- 172.21.15.62:0/2739210400 shutdown_connections 2021-12-17T18:25:08.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.248+0000 7f10d4c8c700 1 -- 172.21.15.62:0/2739210400 wait complete. 2021-12-17T18:25:08.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10d4c8c700 1 Processor -- start 2021-12-17T18:25:08.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10d4c8c700 1 -- start start 2021-12-17T18:25:08.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10d4c8c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10d0067830 0x7f10d00a2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:08.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10d4c8c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10d00aca60 0x7f10d00a33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:08.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10d4c8c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10d0147540 0x7f10d00a8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:08.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10d4c8c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d00b64d0 con 0x7f10d0147540 2021-12-17T18:25:08.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10d4c8c700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d009f6b0 con 0x7f10d00aca60 2021-12-17T18:25:08.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10d4c8c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d009f950 con 0x7f10d0067830 2021-12-17T18:25:08.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10ced9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10d0147540 0x7f10d00a8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:08.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10ced9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10d0147540 0x7f10d00a8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52572/0 (socket says 172.21.15.62:52572) 2021-12-17T18:25:08.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10ced9d700 1 -- 172.21.15.62:0/3355977042 learned_addr learned my addr 172.21.15.62:0/3355977042 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:08.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10cdd9b700 1 --2- 172.21.15.62:0/3355977042 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10d00aca60 0x7f10d00a33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:08.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10ce59c700 1 --2- 172.21.15.62:0/3355977042 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10d0067830 0x7f10d00a2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:08.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10ced9d700 1 -- 172.21.15.62:0/3355977042 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10d0067830 msgr2=0x7f10d00a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:08.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10ced9d700 1 --2- 172.21.15.62:0/3355977042 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10d0067830 0x7f10d00a2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10ced9d700 1 -- 172.21.15.62:0/3355977042 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10d00aca60 msgr2=0x7f10d00a33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:08.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10ced9d700 1 --2- 172.21.15.62:0/3355977042 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10d00aca60 0x7f10d00a33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10ced9d700 1 -- 172.21.15.62:0/3355977042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c000b180 con 0x7f10d0147540 2021-12-17T18:25:08.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10cdd9b700 1 --2- 172.21.15.62:0/3355977042 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10d00aca60 0x7f10d00a33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:08.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10ced9d700 1 --2- 172.21.15.62:0/3355977042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10d0147540 0x7f10d00a8030 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f10c800c000 tx=0x7f10c8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:08.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10c77fe700 1 -- 172.21.15.62:0/3355977042 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10c8010780 con 0x7f10d0147540 2021-12-17T18:25:08.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10c77fe700 1 -- 172.21.15.62:0/3355977042 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c80108e0 con 0x7f10d0147540 2021-12-17T18:25:08.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10d4c8c700 1 -- 172.21.15.62:0/3355977042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d009fbf0 con 0x7f10d0147540 2021-12-17T18:25:08.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10c77fe700 1 -- 172.21.15.62:0/3355977042 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10c8010c40 con 0x7f10d0147540 2021-12-17T18:25:08.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.252+0000 7f10d4c8c700 1 -- 172.21.15.62:0/3355977042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d00a3940 con 0x7f10d0147540 2021-12-17T18:25:08.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.256+0000 7f10d4c8c700 1 -- 172.21.15.62:0/3355977042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d0153d30 con 0x7f10d0147540 2021-12-17T18:25:08.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.256+0000 7f10c77fe700 1 -- 172.21.15.62:0/3355977042 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f10c801c460 con 0x7f10d0147540 2021-12-17T18:25:08.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.256+0000 7f10c77fe700 1 --2- 172.21.15.62:0/3355977042 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f10b4053610 0x7f10b4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:08.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.256+0000 7f10c77fe700 1 -- 172.21.15.62:0/3355977042 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f10c806bc20 con 0x7f10d0147540 2021-12-17T18:25:08.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.256+0000 7f10ce59c700 1 --2- 172.21.15.62:0/3355977042 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f10b4053610 0x7f10b4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:08.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.256+0000 7f10ce59c700 1 --2- 172.21.15.62:0/3355977042 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f10b4053610 0x7f10b4055ad0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f10c0018000 tx=0x7f10c0014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:08.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.264+0000 7f10c77fe700 1 -- 172.21.15.62:0/3355977042 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f10c8042cf0 con 0x7f10d0147540 2021-12-17T18:25:08.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.388+0000 7f10d4c8c700 1 -- 172.21.15.62:0/3355977042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f10d00b0fb0 con 0x7f10d0147540 2021-12-17T18:25:08.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.392+0000 7f10c77fe700 1 -- 172.21.15.62:0/3355977042 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v72) v1 ==== 81+0+33772 (secure 0 0 0) 0x7f10c8046310 con 0x7f10d0147540 2021-12-17T18:25:08.399 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:08.399 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:25:08.399 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 72, 2021-12-17T18:25:08.400 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:25:08.400 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:25:08.400 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:24:57.781371+0000", 2021-12-17T18:25:08.400 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:25:08.401 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:25:08.401 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:25:08.401 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:25:08.401 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:25:08.402 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:25:08.402 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:25:08.402 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:25:08.402 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:25:08.403 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:08.403 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:25:08.403 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:25:08.403 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:25:08.403 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:25:08.404 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:25:08.404 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 14, 2021-12-17T18:25:08.404 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:25:08.404 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:25:08.405 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:25:08.405 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:25:08.405 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:25:08.405 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.406 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:25:08.406 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:25:08.406 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:25:08.407 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:25:08.407 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:25:08.407 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:25:08.408 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:25:08.408 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:25:08.408 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:25:08.408 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:25:08.409 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:25:08.409 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:25:08.409 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:25:08.409 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:25:08.410 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:25:08.410 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:25:08.410 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:25:08.410 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:25:08.411 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:25:08.411 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:25:08.411 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:25:08.411 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:25:08.412 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:25:08.412 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.412 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:25:08.412 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:25:08.412 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:25:08.413 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:25:08.413 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:25:08.413 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:25:08.413 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:25:08.414 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:25:08.414 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:25:08.414 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:25:08.414 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:25:08.415 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:25:08.415 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:25:08.415 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:25:08.415 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:25:08.416 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:25:08.416 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:25:08.416 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:25:08.416 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:25:08.417 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:25:08.417 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:25:08.417 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:25:08.417 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:25:08.418 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:25:08.418 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:25:08.418 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:25:08.418 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:25:08.418 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.419 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:25:08.419 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:25:08.419 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:25:08.419 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:25:08.420 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:25:08.420 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:25:08.420 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:25:08.420 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:25:08.420 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:25:08.421 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:25:08.421 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:25:08.421 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:25:08.421 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:25:08.422 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.422 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:25:08.422 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:25:08.422 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.423 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.423 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.423 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:25:08.423 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:25:08.423 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:25:08.424 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:25:08.424 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:25:08.424 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:25:08.424 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:25:08.425 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:25:08.425 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:25:08.425 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:25:08.426 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:25:08.426 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:25:08.426 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:25:08.426 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:25:08.427 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:25:08.427 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:25:08.427 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:25:08.428 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:25:08.428 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:25:08.428 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:25:08.428 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:25:08.428 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:25:08.429 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:25:08.429 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.429 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:25:08.429 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:25:08.430 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:25:08.430 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:25:08.430 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:25:08.430 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:25:08.431 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:25:08.431 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:25:08.431 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:25:08.431 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:25:08.432 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:25:08.432 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:25:08.432 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:25:08.433 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:25:08.433 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:25:08.433 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:25:08.434 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:25:08.434 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:25:08.434 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:25:08.434 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:25:08.435 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:25:08.435 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:25:08.435 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:25:08.435 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:25:08.436 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:25:08.436 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:25:08.436 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:25:08.436 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.437 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:25:08.437 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:25:08.437 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:25:08.437 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:25:08.437 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:25:08.438 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:25:08.438 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:25:08.438 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:25:08.438 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:25:08.439 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:25:08.439 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:25:08.439 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:25:08.439 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:25:08.440 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:25:08.440 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.440 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.440 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.440 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 13, 2021-12-17T18:25:08.441 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2021-12-17T18:25:08.441 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:24:10.413185+0000", 2021-12-17T18:25:08.441 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:25:08.441 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:25:08.442 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:25:08.442 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:25:08.442 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:25:08.442 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:25:08.443 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:25:08.443 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:25:08.443 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:25:08.443 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:25:08.444 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:25:08.444 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:25:08.444 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:25:08.444 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:25:08.444 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:25:08.445 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:25:08.445 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:25:08.445 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:25:08.446 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:25:08.446 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:25:08.446 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.446 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "71", 2021-12-17T18:25:08.447 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:25:08.447 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:25:08.447 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:25:08.447 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:25:08.448 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:25:08.448 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:25:08.448 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:25:08.448 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:25:08.449 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:25:08.449 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:25:08.449 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:25:08.449 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:25:08.449 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:25:08.450 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:25:08.450 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:25:08.450 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:25:08.450 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:25:08.451 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:25:08.451 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:25:08.451 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:25:08.451 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:25:08.452 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:25:08.452 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:25:08.452 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:25:08.452 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:25:08.452 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:25:08.453 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.453 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:25:08.453 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:25:08.453 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:25:08.454 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:25:08.454 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:25:08.454 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:25:08.455 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:25:08.455 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:25:08.455 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:25:08.455 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:25:08.456 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:25:08.456 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:25:08.456 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2021-12-17T18:25:08.456 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2021-12-17T18:25:08.456 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2021-12-17T18:25:08.457 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.457 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:25:08.457 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:25:08.457 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2021-12-17T18:25:08.458 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.458 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.458 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.458 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.459 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 14, 2021-12-17T18:25:08.459 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2021-12-17T18:25:08.459 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:24:11.229328+0000", 2021-12-17T18:25:08.459 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:25:08.460 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:25:08.460 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:25:08.460 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:25:08.460 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:25:08.461 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:25:08.461 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:25:08.461 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:25:08.461 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:25:08.462 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:25:08.462 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:25:08.462 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:25:08.462 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:25:08.463 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:25:08.463 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:25:08.463 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:25:08.463 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:25:08.464 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:25:08.464 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:25:08.464 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:25:08.464 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.465 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "71", 2021-12-17T18:25:08.465 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:25:08.465 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:25:08.465 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:25:08.466 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:25:08.466 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:25:08.466 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:25:08.466 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:25:08.467 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:25:08.467 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:25:08.467 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:25:08.467 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:25:08.467 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:25:08.468 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:25:08.468 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:25:08.468 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:25:08.468 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:25:08.469 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:25:08.469 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:25:08.469 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:25:08.469 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:25:08.470 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:25:08.470 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:25:08.470 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:25:08.470 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:25:08.471 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:25:08.471 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:25:08.471 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.471 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:25:08.472 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:25:08.472 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:25:08.472 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:25:08.472 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:25:08.473 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:25:08.473 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:25:08.473 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:25:08.474 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:25:08.474 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:25:08.474 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:25:08.475 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:25:08.475 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:25:08.475 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:25:08.475 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2021-12-17T18:25:08.475 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.476 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.476 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.476 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:08.476 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:25:08.477 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.477 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:25:08.477 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:25:08.477 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:08.478 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:08.478 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:08.478 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:08.478 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:08.478 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:08.479 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:08.479 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 69, 2021-12-17T18:25:08.479 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:08.479 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:08.480 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:08.480 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.480 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.481 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.481 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:25:08.481 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:08.482 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.482 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.482 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.483 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:25:08.483 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:08.483 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.484 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.484 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.484 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:08.484 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.485 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.485 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.485 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:25:08.486 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:08.486 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.486 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.486 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.487 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:25:08.487 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:08.487 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.487 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.488 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.488 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:08.488 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.488 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.489 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.489 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:25:08.489 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:08.490 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.490 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.490 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.491 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:25:08.491 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:08.491 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.491 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.492 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.492 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:08.492 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.492 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.493 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.493 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:25:08.493 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:08.493 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.493 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.494 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.494 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:25:08.494 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:08.494 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.495 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.495 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.495 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:25:08.495 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:25:08.496 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:25:08.496 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:25:08.496 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:08.496 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:08.497 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:08.497 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.497 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.497 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.498 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:25:08.498 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:25:08.498 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:08.498 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:08.499 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:08.499 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:08.499 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:08.499 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:08.499 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:08.500 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 59, 2021-12-17T18:25:08.500 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:08.500 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:08.500 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:08.501 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.501 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.501 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.501 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:25:08.502 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:08.502 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.502 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.502 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.503 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:25:08.503 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:08.503 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.503 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.503 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.504 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:08.504 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.504 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.504 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.505 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:25:08.505 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:08.505 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.505 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.506 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.506 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:25:08.506 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:08.506 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.506 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.507 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.507 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:08.507 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.507 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.508 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.508 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:25:08.508 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:08.508 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.508 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.509 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.509 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:25:08.509 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:08.509 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.510 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.510 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.510 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:08.510 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.511 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.511 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.511 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:25:08.511 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:08.512 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.512 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.512 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.512 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:25:08.512 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:08.513 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.513 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.513 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.513 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:25:08.514 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:25:08.514 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:25:08.514 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:25:08.514 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:08.515 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:08.515 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:08.515 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.515 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.515 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.516 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:25:08.516 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:25:08.516 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:08.516 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:08.517 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:08.517 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:08.517 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:08.517 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:08.518 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:08.518 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 69, 2021-12-17T18:25:08.518 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:08.518 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:08.518 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:08.519 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.519 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.519 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.519 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:25:08.520 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:08.520 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.520 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.520 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.521 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:25:08.521 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:08.521 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.521 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.521 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.522 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:08.522 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.522 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.523 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.523 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:25:08.523 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:08.523 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.524 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.524 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.524 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:25:08.524 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:08.525 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.525 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.525 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.525 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:08.525 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.526 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.526 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.526 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:25:08.526 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:08.527 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.527 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.527 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.527 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:25:08.528 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:08.528 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.528 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.528 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.528 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:08.529 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.529 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.529 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.529 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:25:08.530 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:08.530 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.530 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.530 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.531 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:25:08.531 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:08.531 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.531 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.531 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.532 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:25:08.532 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:25:08.532 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:25:08.532 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:25:08.533 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:08.533 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:08.533 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:08.533 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.534 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.534 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.534 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:25:08.534 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:25:08.534 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:08.535 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:08.535 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:08.535 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:08.535 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:08.536 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:08.536 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:08.536 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 69, 2021-12-17T18:25:08.536 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:08.537 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:08.537 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:08.537 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.537 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.537 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.538 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:25:08.538 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:08.538 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.538 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.539 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.539 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:25:08.539 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:08.539 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.540 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.540 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.540 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:08.540 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.540 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.541 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.541 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:25:08.541 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:08.541 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.542 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.542 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.542 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:25:08.542 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:08.543 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.543 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.543 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.543 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:08.543 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.544 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.544 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.544 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:25:08.544 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:08.545 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.545 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.545 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:25:08.546 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:08.546 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.546 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.546 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.546 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:08.547 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.547 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.547 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.547 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:25:08.548 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:08.548 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.548 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.548 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.548 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:25:08.549 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:08.549 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.549 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.549 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.550 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:25:08.550 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:25:08.550 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:25:08.550 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:25:08.551 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:08.551 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:08.551 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:08.551 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.552 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.552 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.552 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:25:08.552 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:25:08.553 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:08.553 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:08.553 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:08.553 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:08.554 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:08.554 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:08.554 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:08.554 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 68, 2021-12-17T18:25:08.555 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:08.555 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:08.555 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:08.555 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.556 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.556 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.556 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:25:08.556 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:08.556 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.557 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.557 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.557 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:25:08.557 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:08.558 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.558 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.558 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.558 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:08.559 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.559 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.559 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.559 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:25:08.559 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:08.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.560 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.560 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.560 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:25:08.561 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:08.561 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.561 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.562 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:08.562 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.562 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.562 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.562 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:25:08.563 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:08.563 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.563 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.563 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.564 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:25:08.564 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:08.564 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.564 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.565 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.565 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:08.565 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.566 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.566 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:25:08.566 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:08.566 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.566 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.567 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.567 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:25:08.567 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:08.567 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.568 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.568 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.568 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:25:08.568 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:25:08.569 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:25:08.569 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:25:08.569 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:08.569 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:08.569 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:08.570 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.570 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.570 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:25:08.571 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:25:08.571 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:08.571 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:08.571 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:08.572 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:08.572 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:08.572 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:08.572 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:08.572 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 69, 2021-12-17T18:25:08.573 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:08.573 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:08.573 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:08.573 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.574 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.574 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.574 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:25:08.574 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:08.574 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.575 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.575 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.575 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:25:08.575 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:08.576 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.576 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.576 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:08.576 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.577 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.577 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.577 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:25:08.577 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:08.578 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.578 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.578 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.578 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:25:08.579 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:08.579 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.579 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.579 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.580 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:08.580 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.580 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.580 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.581 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:25:08.581 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:08.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.581 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.582 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.582 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:25:08.582 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:08.582 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.582 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.583 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.583 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:08.583 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.583 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.584 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.584 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:25:08.584 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:08.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.585 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.585 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.585 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:25:08.585 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:08.585 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.586 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.586 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:25:08.586 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:25:08.587 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:25:08.587 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:25:08.587 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:08.587 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:08.588 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:08.588 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.588 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.588 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:25:08.589 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:25:08.589 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:08.589 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:08.589 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:08.590 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:08.590 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:08.590 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:08.590 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:08.591 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 69, 2021-12-17T18:25:08.591 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:08.591 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:08.591 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:08.591 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.592 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.592 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.592 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:25:08.592 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:08.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.593 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.593 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.593 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:25:08.593 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:08.594 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.594 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.594 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:08.595 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.595 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.595 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.595 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:25:08.596 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:08.596 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.596 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.596 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.597 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:25:08.597 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:08.597 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.597 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.598 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:08.598 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.598 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.598 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.599 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:25:08.599 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:08.599 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.599 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.600 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.600 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:25:08.600 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:08.600 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.601 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.601 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.601 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:08.601 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.601 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.602 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.602 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:25:08.602 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:08.602 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.603 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.603 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.603 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:25:08.603 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:08.604 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.604 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.604 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.604 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:25:08.605 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:25:08.605 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:25:08.605 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:25:08.605 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:08.605 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:08.606 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:08.606 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.606 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.606 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.607 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:25:08.607 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:25:08.607 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:08.607 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:08.608 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:08.608 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:08.608 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:08.608 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:08.609 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:08.609 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 69, 2021-12-17T18:25:08.609 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:08.610 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:08.610 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:08.610 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.610 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.610 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.611 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:25:08.611 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:08.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.611 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.612 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.612 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:25:08.612 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:08.612 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.613 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.613 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.613 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:08.613 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.614 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.614 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.614 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:25:08.614 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:08.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.615 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.615 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.615 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:25:08.615 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:08.616 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.616 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.617 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:08.617 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.617 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.618 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:25:08.618 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:08.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.618 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.619 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.619 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:25:08.619 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:08.619 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.619 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.620 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.620 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:08.620 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:08.620 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.621 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:08.621 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:25:08.621 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:08.621 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.622 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.622 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:08.622 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:25:08.622 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:08.622 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.623 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.623 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.623 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:25:08.623 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:25:08.624 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:25:08.624 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:25:08.624 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:08.624 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:08.624 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:08.625 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:08.625 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.625 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:08.625 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:25:08.626 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.626 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:25:08.626 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:08.626 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:08.627 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:08.627 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:08.627 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:08.627 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:25:08.628 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:08.628 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.628 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.628 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:25:08.628 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:08.629 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:08.629 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:08.629 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:08.629 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:08.630 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:25:08.630 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:08.630 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.630 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.631 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:25:08.631 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:08.631 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:08.631 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:08.632 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:08.632 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:08.632 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:25:08.632 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:08.632 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.633 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.633 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:25:08.633 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:08.633 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:08.634 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:08.634 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:08.634 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:08.634 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:25:08.635 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:08.635 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.635 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.635 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:25:08.635 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:08.636 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:08.636 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:08.636 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:08.636 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:08.637 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:25:08.637 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:08.637 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.637 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.638 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:25:08.638 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:08.638 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:08.638 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:08.638 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:08.639 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:08.639 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:25:08.639 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:08.639 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.640 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.640 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:25:08.640 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:08.640 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:08.640 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:08.641 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:08.641 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:08.641 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:25:08.641 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:08.642 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.642 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:08.642 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:25:08.642 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:08.643 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:08.643 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:08.643 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:08.643 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:08.643 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:25:08.644 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:08.644 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.644 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:08.644 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:25:08.645 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:25:08.645 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:25:08.645 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:25:08.645 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": { 2021-12-17T18:25:08.646 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.125:0/479948347": "2021-12-17T19:24:57.482027+0000" 2021-12-17T18:25:08.646 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.646 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:25:08.646 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:25:08.647 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:25:08.647 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:25:08.647 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:25:08.647 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:25:08.648 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:25:08.648 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:25:08.648 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:08.648 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:08.648 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:25:08.649 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:25:08.649 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:25:08.649 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:25:08.649 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:25:08.650 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:25:08.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.392+0000 7f10d4c8c700 1 -- 172.21.15.62:0/3355977042 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f10b4053610 msgr2=0x7f10b4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:08.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.392+0000 7f10d4c8c700 1 --2- 172.21.15.62:0/3355977042 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f10b4053610 0x7f10b4055ad0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f10c0018000 tx=0x7f10c0014000).stop 2021-12-17T18:25:08.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.392+0000 7f10d4c8c700 1 -- 172.21.15.62:0/3355977042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10d0147540 msgr2=0x7f10d00a8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:08.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.392+0000 7f10d4c8c700 1 --2- 172.21.15.62:0/3355977042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10d0147540 0x7f10d00a8030 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f10c800c000 tx=0x7f10c8006df0).stop 2021-12-17T18:25:08.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.396+0000 7f10d4c8c700 1 -- 172.21.15.62:0/3355977042 shutdown_connections 2021-12-17T18:25:08.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.396+0000 7f10d4c8c700 1 --2- 172.21.15.62:0/3355977042 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f10b4053610 0x7f10b4055ad0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.396+0000 7f10d4c8c700 1 --2- 172.21.15.62:0/3355977042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10d0147540 0x7f10d00a8030 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.396+0000 7f10d4c8c700 1 --2- 172.21.15.62:0/3355977042 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10d00aca60 0x7f10d00a33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.396+0000 7f10d4c8c700 1 --2- 172.21.15.62:0/3355977042 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10d0067830 0x7f10d00a2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.396+0000 7f10d4c8c700 1 -- 172.21.15.62:0/3355977042 >> 172.21.15.62:0/3355977042 conn(0x7f10d005f730 msgr2=0x7f10d0145310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:08.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.396+0000 7f10d4c8c700 1 -- 172.21.15.62:0/3355977042 shutdown_connections 2021-12-17T18:25:08.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.396+0000 7f10d4c8c700 1 -- 172.21.15.62:0/3355977042 wait complete. 2021-12-17T18:25:08.655 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:08.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5023fff700 1 Processor -- start 2021-12-17T18:25:08.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5023fff700 1 -- start start 2021-12-17T18:25:08.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5023fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f50240b5fc0 0x7f502414ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:08.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5023fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f50240b10f0 0x7f502414b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:08.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5023fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f50240ad7a0 0x7f502414b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:08.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5023fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502414bb50 con 0x7f50240b10f0 2021-12-17T18:25:08.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5023fff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50240af6d0 con 0x7f50240ad7a0 2021-12-17T18:25:08.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5023fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50240b63a0 con 0x7f50240b5fc0 2021-12-17T18:25:08.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f50227fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f50240b10f0 0x7f502414b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:08.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f50227fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f50240b10f0 0x7f502414b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52578/0 (socket says 172.21.15.62:52578) 2021-12-17T18:25:08.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f50227fc700 1 -- 172.21.15.62:0/3428595920 learned_addr learned my addr 172.21.15.62:0/3428595920 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:08.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5022ffd700 1 --2- 172.21.15.62:0/3428595920 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f50240b5fc0 0x7f502414ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:08.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f50237fe700 1 --2- 172.21.15.62:0/3428595920 >> v2:172.21.15.109:3300/0 conn(0x7f50240ad7a0 0x7f502414b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:08.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f50227fc700 1 -- 172.21.15.62:0/3428595920 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f50240b5fc0 msgr2=0x7f502414ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:08.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f50227fc700 1 --2- 172.21.15.62:0/3428595920 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f50240b5fc0 0x7f502414ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f50227fc700 1 -- 172.21.15.62:0/3428595920 >> v2:172.21.15.109:3300/0 conn(0x7f50240ad7a0 msgr2=0x7f502414b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f50227fc700 1 --2- 172.21.15.62:0/3428595920 >> v2:172.21.15.109:3300/0 conn(0x7f50240ad7a0 0x7f502414b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f50227fc700 1 -- 172.21.15.62:0/3428595920 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50240af900 con 0x7f50240b10f0 2021-12-17T18:25:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f50237fe700 1 --2- 172.21.15.62:0/3428595920 >> v2:172.21.15.109:3300/0 conn(0x7f50240ad7a0 0x7f502414b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:25:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f50227fc700 1 --2- 172.21.15.62:0/3428595920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50240b10f0 0x7f502414b170 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f50140032f0 tx=0x7f5014009290).ready entity=mon.0 client_cookie=9f70dcce579fee48 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5021ffb700 1 -- 172.21.15.62:0/3428595920 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f501400b870 con 0x7f50240b10f0 2021-12-17T18:25:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5021ffb700 1 -- 172.21.15.62:0/3428595920 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501400b9d0 con 0x7f50240b10f0 2021-12-17T18:25:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5021ffb700 1 -- 172.21.15.62:0/3428595920 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f501400bb40 con 0x7f50240b10f0 2021-12-17T18:25:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5023fff700 1 -- 172.21.15.62:0/3428595920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50240b10f0 msgr2=0x7f502414b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:08.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5023fff700 1 --2- 172.21.15.62:0/3428595920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50240b10f0 0x7f502414b170 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f50140032f0 tx=0x7f5014009290).stop 2021-12-17T18:25:08.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5023fff700 1 -- 172.21.15.62:0/3428595920 shutdown_connections 2021-12-17T18:25:08.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5023fff700 1 --2- 172.21.15.62:0/3428595920 >> v2:172.21.15.109:3300/0 conn(0x7f50240ad7a0 0x7f502414b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5023fff700 1 --2- 172.21.15.62:0/3428595920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50240b10f0 0x7f502414b170 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5023fff700 1 --2- 172.21.15.62:0/3428595920 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f50240b5fc0 0x7f502414ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5023fff700 1 -- 172.21.15.62:0/3428595920 >> 172.21.15.62:0/3428595920 conn(0x7f502405c750 msgr2=0x7f502405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:08.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5023fff700 1 -- 172.21.15.62:0/3428595920 shutdown_connections 2021-12-17T18:25:08.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.768+0000 7f5023fff700 1 -- 172.21.15.62:0/3428595920 wait complete. 2021-12-17T18:25:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5023fff700 1 Processor -- start 2021-12-17T18:25:08.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5023fff700 1 -- start start 2021-12-17T18:25:08.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5023fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50240ad7a0 0x7f50240ac330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:08.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5023fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f50240b10f0 0x7f50240a7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:08.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5023fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f50240b5fc0 0x7f502415a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:08.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5023fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502415a030 con 0x7f50240ad7a0 2021-12-17T18:25:08.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5023fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50240659d0 con 0x7f50240b5fc0 2021-12-17T18:25:08.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5023fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5024065c70 con 0x7f50240b10f0 2021-12-17T18:25:08.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5022ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50240ad7a0 0x7f50240ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:08.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5022ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50240ad7a0 0x7f50240ac330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52586/0 (socket says 172.21.15.62:52586) 2021-12-17T18:25:08.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5022ffd700 1 -- 172.21.15.62:0/1591097481 learned_addr learned my addr 172.21.15.62:0/1591097481 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:08.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f50237fe700 1 --2- 172.21.15.62:0/1591097481 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f50240b5fc0 0x7f502415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:08.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f50227fc700 1 --2- 172.21.15.62:0/1591097481 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f50240b10f0 0x7f50240a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:08.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5022ffd700 1 -- 172.21.15.62:0/1591097481 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f50240b10f0 msgr2=0x7f50240a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:08.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5022ffd700 1 --2- 172.21.15.62:0/1591097481 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f50240b10f0 0x7f50240a7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5022ffd700 1 -- 172.21.15.62:0/1591097481 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f50240b5fc0 msgr2=0x7f502415a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:08.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5022ffd700 1 --2- 172.21.15.62:0/1591097481 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f50240b5fc0 0x7f502415a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5022ffd700 1 -- 172.21.15.62:0/1591097481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5014009530 con 0x7f50240ad7a0 2021-12-17T18:25:08.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f50227fc700 1 --2- 172.21.15.62:0/1591097481 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f50240b10f0 0x7f50240a7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:08.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5022ffd700 1 --2- 172.21.15.62:0/1591097481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50240ad7a0 0x7f50240ac330 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f500c00a000 tx=0x7f500c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:08.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f501bfff700 1 -- 172.21.15.62:0/1591097481 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f500c011780 con 0x7f50240ad7a0 2021-12-17T18:25:08.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f501bfff700 1 -- 172.21.15.62:0/1591097481 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500c0118e0 con 0x7f50240ad7a0 2021-12-17T18:25:08.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5023fff700 1 -- 172.21.15.62:0/1591097481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5024065650 con 0x7f50240ad7a0 2021-12-17T18:25:08.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f501bfff700 1 -- 172.21.15.62:0/1591097481 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f500c011c40 con 0x7f50240ad7a0 2021-12-17T18:25:08.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.772+0000 7f5023fff700 1 -- 172.21.15.62:0/1591097481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50240a9c70 con 0x7f50240ad7a0 2021-12-17T18:25:08.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.776+0000 7f501bfff700 1 -- 172.21.15.62:0/1591097481 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f500c012420 con 0x7f50240ad7a0 2021-12-17T18:25:08.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.776+0000 7f5023fff700 1 -- 172.21.15.62:0/1591097481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5024065840 con 0x7f50240ad7a0 2021-12-17T18:25:08.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.776+0000 7f501bfff700 1 --2- 172.21.15.62:0/1591097481 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f50080534f0 0x7f50080559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:08.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.776+0000 7f501bfff700 1 -- 172.21.15.62:0/1591097481 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f500c06b7c0 con 0x7f50240ad7a0 2021-12-17T18:25:08.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.776+0000 7f50227fc700 1 --2- 172.21.15.62:0/1591097481 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f50080534f0 0x7f50080559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:08.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.776+0000 7f50227fc700 1 --2- 172.21.15.62:0/1591097481 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f50080534f0 0x7f50080559b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f5014019000 tx=0x7f5014016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:08.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.780+0000 7f501bfff700 1 -- 172.21.15.62:0/1591097481 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f500c042890 con 0x7f50240ad7a0 2021-12-17T18:25:08.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.944+0000 7f5023fff700 1 -- 172.21.15.62:0/1591097481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50240b0b40 con 0x7f50240ad7a0 2021-12-17T18:25:08.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.944+0000 7f501bfff700 1 -- 172.21.15.62:0/1591097481 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f500c045eb0 con 0x7f50240ad7a0 2021-12-17T18:25:08.951 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:08.951 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":32,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5672,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/2267359903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":2267359903},{"type":"v1","addr":"172.21.15.109:6835","nonce":2267359903}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:24:11.805782+0000","modified":"2021-12-17T18:24:12.808883+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6318":{"gid":6318,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/414220193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":414220193},{"type":"v1","addr":"172.21.15.62:6833","nonce":414220193}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-12-17T18:25:08.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.948+0000 7f5023fff700 1 -- 172.21.15.62:0/1591097481 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f50080534f0 msgr2=0x7f50080559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:08.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.948+0000 7f5023fff700 1 --2- 172.21.15.62:0/1591097481 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f50080534f0 0x7f50080559b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f5014019000 tx=0x7f5014016000).stop 2021-12-17T18:25:08.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.948+0000 7f5023fff700 1 -- 172.21.15.62:0/1591097481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50240ad7a0 msgr2=0x7f50240ac330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:08.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.948+0000 7f5023fff700 1 --2- 172.21.15.62:0/1591097481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50240ad7a0 0x7f50240ac330 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f500c00a000 tx=0x7f500c008040).stop 2021-12-17T18:25:08.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.948+0000 7f5023fff700 1 -- 172.21.15.62:0/1591097481 shutdown_connections 2021-12-17T18:25:08.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.948+0000 7f5023fff700 1 --2- 172.21.15.62:0/1591097481 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f50080534f0 0x7f50080559b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.948+0000 7f5023fff700 1 --2- 172.21.15.62:0/1591097481 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f50240b5fc0 0x7f502415a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.948+0000 7f5023fff700 1 --2- 172.21.15.62:0/1591097481 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f50240b10f0 0x7f50240a7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.948+0000 7f5023fff700 1 --2- 172.21.15.62:0/1591097481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50240ad7a0 0x7f50240ac330 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:08.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.948+0000 7f5023fff700 1 -- 172.21.15.62:0/1591097481 >> 172.21.15.62:0/1591097481 conn(0x7f502405c750 msgr2=0x7f50240b2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:08.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.948+0000 7f5023fff700 1 -- 172.21.15.62:0/1591097481 shutdown_connections 2021-12-17T18:25:08.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:08.948+0000 7f5023fff700 1 -- 172.21.15.62:0/1591097481 wait complete. 2021-12-17T18:25:08.956 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 32 2021-12-17T18:25:08.964 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-12-17T18:25:09.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.064+0000 7f2e636fe700 1 Processor -- start 2021-12-17T18:25:09.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.064+0000 7f2e636fe700 1 -- start start 2021-12-17T18:25:09.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.064+0000 7f2e636fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e5c143780 0x7f2e5c143b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:09.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.064+0000 7f2e636fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2e5c0b1260 0x7f2e5c0b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:09.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.064+0000 7f2e636fe700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5c0ad7f0 con 0x7f2e5c067120 2021-12-17T18:25:09.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.064+0000 7f2e636fe700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5c0ada90 con 0x7f2e5c0b1260 2021-12-17T18:25:09.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.064+0000 7f2e636fe700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c0add30 con 0x7f2e5c143780 2021-12-17T18:25:09.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e61c9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2e5c0b1260 0x7f2e5c0b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:09.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e60c99700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2e5c067120 0x7f2e5c0675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36170/0 (socket says 172.21.15.62:36170) 2021-12-17T18:25:09.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e60c99700 1 -- 172.21.15.62:0/288530466 learned_addr learned my addr 172.21.15.62:0/288530466 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:09.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e6149a700 1 --2- 172.21.15.62:0/288530466 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e5c143780 0x7f2e5c143b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:09.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e61c9b700 1 -- 172.21.15.62:0/288530466 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e5c143780 msgr2=0x7f2e5c143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:09.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e61c9b700 1 --2- 172.21.15.62:0/288530466 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e5c143780 0x7f2e5c143b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:09.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e61c9b700 1 -- 172.21.15.62:0/288530466 >> v1:172.21.15.62:6789/0 conn(0x7f2e5c067120 legacy=0x7f2e5c0675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:09.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e61c9b700 1 -- 172.21.15.62:0/288530466 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c067cb0 con 0x7f2e5c0b1260 2021-12-17T18:25:09.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e47fff700 1 -- 172.21.15.62:0/288530466 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730528553 0 0) 0x7f2e5c0ad7f0 con 0x7f2e5c067120 2021-12-17T18:25:09.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e61c9b700 1 --2- 172.21.15.62:0/288530466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e5c0b1260 0x7f2e5c0b16f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f2e5c13dba0 tx=0x7f2e540091d0).ready entity=mon.0 client_cookie=41a14d500331930b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:09.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e47fff700 1 -- 172.21.15.62:0/288530466 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e5400b680 con 0x7f2e5c0b1260 2021-12-17T18:25:09.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e47fff700 1 -- 172.21.15.62:0/288530466 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5400b7e0 con 0x7f2e5c0b1260 2021-12-17T18:25:09.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e47fff700 1 -- 172.21.15.62:0/288530466 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e5400b950 con 0x7f2e5c0b1260 2021-12-17T18:25:09.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e636fe700 1 -- 172.21.15.62:0/288530466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e5c0b1260 msgr2=0x7f2e5c0b16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:09.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e636fe700 1 --2- 172.21.15.62:0/288530466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e5c0b1260 0x7f2e5c0b16f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f2e5c13dba0 tx=0x7f2e540091d0).stop 2021-12-17T18:25:09.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e636fe700 1 -- 172.21.15.62:0/288530466 shutdown_connections 2021-12-17T18:25:09.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e636fe700 1 --2- 172.21.15.62:0/288530466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e5c0b1260 0x7f2e5c0b16f0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:09.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e636fe700 1 --2- 172.21.15.62:0/288530466 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e5c143780 0x7f2e5c143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:09.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e636fe700 1 -- 172.21.15.62:0/288530466 >> 172.21.15.62:0/288530466 conn(0x7f2e5c05f730 msgr2=0x7f2e5c05fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:09.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e636fe700 1 -- 172.21.15.62:0/288530466 shutdown_connections 2021-12-17T18:25:09.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.068+0000 7f2e636fe700 1 -- 172.21.15.62:0/288530466 wait complete. 2021-12-17T18:25:09.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e636fe700 1 Processor -- start 2021-12-17T18:25:09.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e636fe700 1 -- start start 2021-12-17T18:25:09.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e636fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e5c067120 0x7f2e5c142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:09.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e636fe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2e5c0b1260 0x7f2e5c13e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:09.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e636fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e5c143780 0x7f2e5c13fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:09.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e636fe700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c13dbe0 con 0x7f2e5c067120 2021-12-17T18:25:09.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e636fe700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c13e7a0 con 0x7f2e5c0b1260 2021-12-17T18:25:09.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e636fe700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c0ac100 con 0x7f2e5c143780 2021-12-17T18:25:09.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e6149a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e5c067120 0x7f2e5c142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:09.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e6149a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e5c067120 0x7f2e5c142780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52596/0 (socket says 172.21.15.62:52596) 2021-12-17T18:25:09.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e6149a700 1 -- 172.21.15.62:0/2033637959 learned_addr learned my addr 172.21.15.62:0/2033637959 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:09.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e60c99700 1 --2- 172.21.15.62:0/2033637959 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2e5c0b1260 0x7f2e5c13e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:09.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e61c9b700 1 --2- 172.21.15.62:0/2033637959 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e5c143780 0x7f2e5c13fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:09.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e6149a700 1 -- 172.21.15.62:0/2033637959 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e5c143780 msgr2=0x7f2e5c13fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:09.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e6149a700 1 --2- 172.21.15.62:0/2033637959 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e5c143780 0x7f2e5c13fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:09.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e6149a700 1 -- 172.21.15.62:0/2033637959 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2e5c0b1260 msgr2=0x7f2e5c13e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:09.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e6149a700 1 --2- 172.21.15.62:0/2033637959 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2e5c0b1260 0x7f2e5c13e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:09.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e6149a700 1 -- 172.21.15.62:0/2033637959 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e54009470 con 0x7f2e5c067120 2021-12-17T18:25:09.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e60c99700 1 --2- 172.21.15.62:0/2033637959 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2e5c0b1260 0x7f2e5c13e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:25:09.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e61c9b700 1 --2- 172.21.15.62:0/2033637959 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e5c143780 0x7f2e5c13fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:25:09.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e6149a700 1 --2- 172.21.15.62:0/2033637959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e5c067120 0x7f2e5c142780 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f2e5800c000 tx=0x7f2e58006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:09.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e4effd700 1 -- 172.21.15.62:0/2033637959 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e58010780 con 0x7f2e5c067120 2021-12-17T18:25:09.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e4effd700 1 -- 172.21.15.62:0/2033637959 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e580108e0 con 0x7f2e5c067120 2021-12-17T18:25:09.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e636fe700 1 -- 172.21.15.62:0/2033637959 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5c0aafa0 con 0x7f2e5c067120 2021-12-17T18:25:09.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e4effd700 1 -- 172.21.15.62:0/2033637959 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e58010c40 con 0x7f2e5c067120 2021-12-17T18:25:09.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.072+0000 7f2e636fe700 1 -- 172.21.15.62:0/2033637959 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5c0a9050 con 0x7f2e5c067120 2021-12-17T18:25:09.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.076+0000 7f2e4effd700 1 -- 172.21.15.62:0/2033637959 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2e5801c460 con 0x7f2e5c067120 2021-12-17T18:25:09.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.076+0000 7f2e636fe700 1 -- 172.21.15.62:0/2033637959 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5c0573d0 con 0x7f2e5c067120 2021-12-17T18:25:09.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.076+0000 7f2e4effd700 1 --2- 172.21.15.62:0/2033637959 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2e38053610 0x7f2e38055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:09.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.076+0000 7f2e4effd700 1 -- 172.21.15.62:0/2033637959 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f2e5806be70 con 0x7f2e5c067120 2021-12-17T18:25:09.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.076+0000 7f2e60c99700 1 --2- 172.21.15.62:0/2033637959 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2e38053610 0x7f2e38055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:09.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.076+0000 7f2e60c99700 1 --2- 172.21.15.62:0/2033637959 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2e38053610 0x7f2e38055ad0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f2e50008000 tx=0x7f2e50009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:09.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.084+0000 7f2e4effd700 1 -- 172.21.15.62:0/2033637959 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2e58042f40 con 0x7f2e5c067120 2021-12-17T18:25:09.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.248+0000 7f2e636fe700 1 -- 172.21.15.62:0/2033637959 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2e5c06a2b0 con 0x7f2e5c067120 2021-12-17T18:25:09.834 INFO:tasks.ceph.mon.a.smithi062.stderr:2021-12-17T18:25:09.828+0000 7f8d3b366700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-12-17T18:25:09.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.840+0000 7f2e4effd700 1 -- 172.21.15.62:0/2033637959 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2e58046560 con 0x7f2e5c067120 2021-12-17T18:25:09.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.844+0000 7f2e636fe700 1 -- 172.21.15.62:0/2033637959 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2e38053610 msgr2=0x7f2e38055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:09.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.844+0000 7f2e636fe700 1 --2- 172.21.15.62:0/2033637959 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2e38053610 0x7f2e38055ad0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f2e50008000 tx=0x7f2e50009040).stop 2021-12-17T18:25:09.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.844+0000 7f2e636fe700 1 -- 172.21.15.62:0/2033637959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e5c067120 msgr2=0x7f2e5c142780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:09.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.844+0000 7f2e636fe700 1 --2- 172.21.15.62:0/2033637959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e5c067120 0x7f2e5c142780 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f2e5800c000 tx=0x7f2e58006df0).stop 2021-12-17T18:25:09.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.844+0000 7f2e636fe700 1 -- 172.21.15.62:0/2033637959 shutdown_connections 2021-12-17T18:25:09.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.844+0000 7f2e636fe700 1 --2- 172.21.15.62:0/2033637959 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2e38053610 0x7f2e38055ad0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:09.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.844+0000 7f2e636fe700 1 --2- 172.21.15.62:0/2033637959 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e5c143780 0x7f2e5c13fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:09.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.844+0000 7f2e636fe700 1 --2- 172.21.15.62:0/2033637959 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2e5c0b1260 0x7f2e5c13e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:09.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.844+0000 7f2e636fe700 1 --2- 172.21.15.62:0/2033637959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e5c067120 0x7f2e5c142780 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:09.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.844+0000 7f2e636fe700 1 -- 172.21.15.62:0/2033637959 >> 172.21.15.62:0/2033637959 conn(0x7f2e5c05f730 msgr2=0x7f2e5c0b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:09.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.844+0000 7f2e636fe700 1 -- 172.21.15.62:0/2033637959 shutdown_connections 2021-12-17T18:25:09.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.844+0000 7f2e636fe700 1 -- 172.21.15.62:0/2033637959 wait complete. 2021-12-17T18:25:09.853 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-12-17T18:25:09.865 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:09.879 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:25:09.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8c4bf1700 1 Processor -- start 2021-12-17T18:25:09.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8c4bf1700 1 -- start start 2021-12-17T18:25:09.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8c4bf1700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc8c00b3a10 0x7fc8c0152010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:09.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8c4bf1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c00acf90 con 0x7fc8c00abf10 2021-12-17T18:25:09.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8c4bf1700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c00ad1f0 con 0x7fc8c014b010 2021-12-17T18:25:09.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8c4bf1700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c014bbf0 con 0x7fc8c00b3a10 2021-12-17T18:25:09.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8beffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc8c00abf10 0x7fc8c00b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36198/0 (socket says 172.21.15.62:36198) 2021-12-17T18:25:09.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8beffd700 1 -- 172.21.15.62:0/975582183 learned_addr learned my addr 172.21.15.62:0/975582183 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:09.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8bffff700 1 --2- 172.21.15.62:0/975582183 >> v2:172.21.15.109:3300/0 conn(0x7fc8c00b3a10 0x7fc8c0152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:09.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8be7fc700 1 -- 172.21.15.62:0/975582183 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216112904 0 0) 0x7fc8c00acf90 con 0x7fc8c00abf10 2021-12-17T18:25:09.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8be7fc700 1 -- 172.21.15.62:0/975582183 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8a4003260 con 0x7fc8c00abf10 2021-12-17T18:25:09.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8be7fc700 1 -- 172.21.15.62:0/975582183 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153029081 0 0) 0x7fc8c00ad1f0 con 0x7fc8c014b010 2021-12-17T18:25:09.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8be7fc700 1 -- 172.21.15.62:0/975582183 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8c00acf90 con 0x7fc8c014b010 2021-12-17T18:25:09.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8bffff700 1 -- 172.21.15.62:0/975582183 >> v1:172.21.15.109:6789/0 conn(0x7fc8c014b010 legacy=0x7fc8c014b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:09.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8bffff700 1 -- 172.21.15.62:0/975582183 >> v1:172.21.15.62:6789/0 conn(0x7fc8c00abf10 legacy=0x7fc8c00b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:09.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8bffff700 1 -- 172.21.15.62:0/975582183 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c0154520 con 0x7fc8c00b3a10 2021-12-17T18:25:09.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8bffff700 1 --2- 172.21.15.62:0/975582183 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8c00b3a10 0x7fc8c0152010 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fc8b8002f70 tx=0x7fc8b8006df0).ready entity=mon.1 client_cookie=17a71a3558b74de1 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:09.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8be7fc700 1 -- 172.21.15.62:0/975582183 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8b800d540 con 0x7fc8c00b3a10 2021-12-17T18:25:09.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8be7fc700 1 -- 172.21.15.62:0/975582183 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b8000e90 con 0x7fc8c00b3a10 2021-12-17T18:25:09.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.960+0000 7fc8be7fc700 1 -- 172.21.15.62:0/975582183 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8b800d890 con 0x7fc8c00b3a10 2021-12-17T18:25:09.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.964+0000 7fc8c4bf1700 1 -- 172.21.15.62:0/975582183 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8c00b3a10 msgr2=0x7fc8c0152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:09.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.964+0000 7fc8c4bf1700 1 --2- 172.21.15.62:0/975582183 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8c00b3a10 0x7fc8c0152010 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fc8b8002f70 tx=0x7fc8b8006df0).stop 2021-12-17T18:25:09.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.964+0000 7fc8c4bf1700 1 -- 172.21.15.62:0/975582183 shutdown_connections 2021-12-17T18:25:09.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.964+0000 7fc8c4bf1700 1 --2- 172.21.15.62:0/975582183 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8c00b3a10 0x7fc8c0152010 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:09.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.964+0000 7fc8c4bf1700 1 -- 172.21.15.62:0/975582183 >> 172.21.15.62:0/975582183 conn(0x7fc8c005c750 msgr2=0x7fc8c005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:09.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.964+0000 7fc8c4bf1700 1 -- 172.21.15.62:0/975582183 shutdown_connections 2021-12-17T18:25:09.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.964+0000 7fc8c4bf1700 1 -- 172.21.15.62:0/975582183 wait complete. 2021-12-17T18:25:09.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.964+0000 7fc8c4bf1700 1 Processor -- start 2021-12-17T18:25:09.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.964+0000 7fc8c4bf1700 1 -- start start 2021-12-17T18:25:09.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8c4bf1700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8c00abf10 0x7fc8c00af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:09.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8c4bf1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c00b3a10 0x7fc8c0082890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:09.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8c4bf1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8c014b010 0x7fc8c0147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:09.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8c4bf1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c00844c0 con 0x7fc8c00b3a10 2021-12-17T18:25:09.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8c4bf1700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c0084760 con 0x7fc8c00abf10 2021-12-17T18:25:09.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8c4bf1700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c0084a00 con 0x7fc8c014b010 2021-12-17T18:25:09.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8beffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c00b3a10 0x7fc8c0082890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:09.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8beffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c00b3a10 0x7fc8c0082890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52624/0 (socket says 172.21.15.62:52624) 2021-12-17T18:25:09.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8beffd700 1 -- 172.21.15.62:0/100291773 learned_addr learned my addr 172.21.15.62:0/100291773 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:09.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8bffff700 1 --2- 172.21.15.62:0/100291773 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8c014b010 0x7fc8c0147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:09.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8bf7fe700 1 --2- 172.21.15.62:0/100291773 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8c00abf10 0x7fc8c00af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:09.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8beffd700 1 -- 172.21.15.62:0/100291773 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8c014b010 msgr2=0x7fc8c0147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:09.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8beffd700 1 --2- 172.21.15.62:0/100291773 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8c014b010 0x7fc8c0147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:09.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8beffd700 1 -- 172.21.15.62:0/100291773 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8c00abf10 msgr2=0x7fc8c00af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:09.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8beffd700 1 --2- 172.21.15.62:0/100291773 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8c00abf10 0x7fc8c00af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:09.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8beffd700 1 -- 172.21.15.62:0/100291773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b800b180 con 0x7fc8c00b3a10 2021-12-17T18:25:09.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8beffd700 1 --2- 172.21.15.62:0/100291773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c00b3a10 0x7fc8c0082890 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7fc8a8001490 tx=0x7fc8a8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:09.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8bcff9700 1 -- 172.21.15.62:0/100291773 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8a8005ba0 con 0x7fc8c00b3a10 2021-12-17T18:25:09.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8bcff9700 1 -- 172.21.15.62:0/100291773 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a8005d00 con 0x7fc8c00b3a10 2021-12-17T18:25:09.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8c4bf1700 1 -- 172.21.15.62:0/100291773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c0084ea0 con 0x7fc8c00b3a10 2021-12-17T18:25:09.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8bcff9700 1 -- 172.21.15.62:0/100291773 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8a80072c0 con 0x7fc8c00b3a10 2021-12-17T18:25:09.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8c4bf1700 1 -- 172.21.15.62:0/100291773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c0082d80 con 0x7fc8c00b3a10 2021-12-17T18:25:09.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.968+0000 7fc8c4bf1700 1 -- 172.21.15.62:0/100291773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c00842e0 con 0x7fc8c00b3a10 2021-12-17T18:25:09.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.972+0000 7fc8bcff9700 1 -- 172.21.15.62:0/100291773 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc8a801a060 con 0x7fc8c00b3a10 2021-12-17T18:25:09.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.972+0000 7fc8bcff9700 1 --2- 172.21.15.62:0/100291773 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc898053610 0x7fc898055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:09.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.972+0000 7fc8bcff9700 1 -- 172.21.15.62:0/100291773 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fc8a806b4a0 con 0x7fc8c00b3a10 2021-12-17T18:25:09.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.972+0000 7fc8bf7fe700 1 --2- 172.21.15.62:0/100291773 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc898053610 0x7fc898055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:09.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.972+0000 7fc8bf7fe700 1 --2- 172.21.15.62:0/100291773 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc898053610 0x7fc898055ad0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fc8b000d000 tx=0x7fc8b0007a00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:09.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:09.976+0000 7fc8bcff9700 1 -- 172.21.15.62:0/100291773 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc8a8042480 con 0x7fc8c00b3a10 2021-12-17T18:25:10.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.144+0000 7fc8c4bf1700 1 -- 172.21.15.62:0/100291773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8c0084bc0 con 0x7fc8c00b3a10 2021-12-17T18:25:10.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.144+0000 7fc8bcff9700 1 -- 172.21.15.62:0/100291773 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+1782 (secure 0 0 0) 0x7fc8a8018020 con 0x7fc8c00b3a10 2021-12-17T18:25:10.150 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:10.150 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5672,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/2267359903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":2267359903},{"type":"v1","addr":"172.21.15.109:6835","nonce":2267359903}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:24:11.805782+0000","modified":"2021-12-17T18:25:09.832815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-12-17T18:25:10.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.144+0000 7fc8c4bf1700 1 -- 172.21.15.62:0/100291773 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc898053610 msgr2=0x7fc898055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:10.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.144+0000 7fc8c4bf1700 1 --2- 172.21.15.62:0/100291773 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc898053610 0x7fc898055ad0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fc8b000d000 tx=0x7fc8b0007a00).stop 2021-12-17T18:25:10.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.144+0000 7fc8c4bf1700 1 -- 172.21.15.62:0/100291773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c00b3a10 msgr2=0x7fc8c0082890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:10.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.144+0000 7fc8c4bf1700 1 --2- 172.21.15.62:0/100291773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c00b3a10 0x7fc8c0082890 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7fc8a8001490 tx=0x7fc8a8007e20).stop 2021-12-17T18:25:10.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.148+0000 7fc8c4bf1700 1 -- 172.21.15.62:0/100291773 shutdown_connections 2021-12-17T18:25:10.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.148+0000 7fc8c4bf1700 1 --2- 172.21.15.62:0/100291773 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc898053610 0x7fc898055ad0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:10.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.148+0000 7fc8c4bf1700 1 --2- 172.21.15.62:0/100291773 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8c014b010 0x7fc8c0147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:10.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.148+0000 7fc8c4bf1700 1 --2- 172.21.15.62:0/100291773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c00b3a10 0x7fc8c0082890 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:10.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.148+0000 7fc8c4bf1700 1 --2- 172.21.15.62:0/100291773 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8c00abf10 0x7fc8c00af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:10.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.148+0000 7fc8c4bf1700 1 -- 172.21.15.62:0/100291773 >> 172.21.15.62:0/100291773 conn(0x7fc8c005c750 msgr2=0x7fc8c00b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:10.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.148+0000 7fc8c4bf1700 1 -- 172.21.15.62:0/100291773 shutdown_connections 2021-12-17T18:25:10.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.148+0000 7fc8c4bf1700 1 -- 172.21.15.62:0/100291773 wait complete. 2021-12-17T18:25:10.155 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 33 2021-12-17T18:25:10.163 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-12-17T18:25:10.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.264+0000 7fb9168e4700 1 Processor -- start 2021-12-17T18:25:10.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.264+0000 7fb9168e4700 1 -- start start 2021-12-17T18:25:10.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.264+0000 7fb9168e4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb91005f8d0 0x7fb9101470e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:10.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.264+0000 7fb9168e4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9100af190 con 0x7fb9100b36e0 2021-12-17T18:25:10.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.264+0000 7fb9168e4700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9100b74f0 con 0x7fb9100b0870 2021-12-17T18:25:10.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.264+0000 7fb9168e4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9100b3180 con 0x7fb91005f8d0 2021-12-17T18:25:10.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.264+0000 7fb90ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb91005f8d0 0x7fb9101470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:10.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.264+0000 7fb90f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb9100b36e0 0x7fb9100b66d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36212/0 (socket says 172.21.15.62:36212) 2021-12-17T18:25:10.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.264+0000 7fb90f7fe700 1 -- 172.21.15.62:0/3828223259 learned_addr learned my addr 172.21.15.62:0/3828223259 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:10.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.264+0000 7fb90ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb91005f8d0 0x7fb9101470e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52630/0 (socket says 172.21.15.62:52630) 2021-12-17T18:25:10.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.264+0000 7fb90ffff700 1 -- 172.21.15.62:0/3828223259 >> v1:172.21.15.109:6789/0 conn(0x7fb9100b0870 legacy=0x7fb9100b6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:10.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.264+0000 7fb90ffff700 1 -- 172.21.15.62:0/3828223259 >> v1:172.21.15.62:6789/0 conn(0x7fb9100b36e0 legacy=0x7fb9100b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:10.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.264+0000 7fb90effd700 1 -- 172.21.15.62:0/3828223259 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473749299 0 0) 0x7fb9100b74f0 con 0x7fb9100b0870 2021-12-17T18:25:10.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.264+0000 7fb90ffff700 1 -- 172.21.15.62:0/3828223259 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9100aeef0 con 0x7fb91005f8d0 2021-12-17T18:25:10.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.264+0000 7fb90ffff700 1 --2- 172.21.15.62:0/3828223259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb91005f8d0 0x7fb9101470e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7fb904001110 tx=0x7fb900006df0).ready entity=mon.0 client_cookie=649a8377a5f1d67b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:10.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.264+0000 7fb90effd700 1 -- 172.21.15.62:0/3828223259 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb90000d5c0 con 0x7fb91005f8d0 2021-12-17T18:25:10.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb90effd700 1 -- 172.21.15.62:0/3828223259 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb900000e90 con 0x7fb91005f8d0 2021-12-17T18:25:10.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb90effd700 1 -- 172.21.15.62:0/3828223259 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb90000d910 con 0x7fb91005f8d0 2021-12-17T18:25:10.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb9168e4700 1 -- 172.21.15.62:0/3828223259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb91005f8d0 msgr2=0x7fb9101470e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:10.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb9168e4700 1 --2- 172.21.15.62:0/3828223259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb91005f8d0 0x7fb9101470e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7fb904001110 tx=0x7fb900006df0).stop 2021-12-17T18:25:10.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb9168e4700 1 -- 172.21.15.62:0/3828223259 shutdown_connections 2021-12-17T18:25:10.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb9168e4700 1 --2- 172.21.15.62:0/3828223259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb91005f8d0 0x7fb9101470e0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:10.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb9168e4700 1 -- 172.21.15.62:0/3828223259 >> 172.21.15.62:0/3828223259 conn(0x7fb91005bcd0 msgr2=0x7fb9100638c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:10.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb9168e4700 1 -- 172.21.15.62:0/3828223259 shutdown_connections 2021-12-17T18:25:10.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb9168e4700 1 -- 172.21.15.62:0/3828223259 wait complete. 2021-12-17T18:25:10.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb9168e4700 1 Processor -- start 2021-12-17T18:25:10.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb9168e4700 1 -- start start 2021-12-17T18:25:10.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb9168e4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb91005f8d0 0x7fb9100ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:10.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb9168e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9100b0870 0x7fb9100a9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:10.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb9168e4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9100b36e0 0x7fb9100a9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:10.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb9168e4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb910067e20 con 0x7fb9100b0870 2021-12-17T18:25:10.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb9168e4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb910067b80 con 0x7fb9100b36e0 2021-12-17T18:25:10.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb9168e4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9100a2ef0 con 0x7fb91005f8d0 2021-12-17T18:25:10.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb90f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9100b0870 0x7fb9100a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:10.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb90f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9100b0870 0x7fb9100a9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52638/0 (socket says 172.21.15.62:52638) 2021-12-17T18:25:10.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb90f7fe700 1 -- 172.21.15.62:0/4086516682 learned_addr learned my addr 172.21.15.62:0/4086516682 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:10.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb90ffff700 1 --2- 172.21.15.62:0/4086516682 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb91005f8d0 0x7fb9100ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:10.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb914e81700 1 --2- 172.21.15.62:0/4086516682 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9100b36e0 0x7fb9100a9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:10.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb90f7fe700 1 -- 172.21.15.62:0/4086516682 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb91005f8d0 msgr2=0x7fb9100ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:10.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb90f7fe700 1 --2- 172.21.15.62:0/4086516682 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb91005f8d0 0x7fb9100ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:10.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb90f7fe700 1 -- 172.21.15.62:0/4086516682 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9100b36e0 msgr2=0x7fb9100a9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:10.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb90f7fe700 1 --2- 172.21.15.62:0/4086516682 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9100b36e0 0x7fb9100a9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:10.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb90f7fe700 1 -- 172.21.15.62:0/4086516682 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90000b180 con 0x7fb9100b0870 2021-12-17T18:25:10.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.268+0000 7fb90f7fe700 1 --2- 172.21.15.62:0/4086516682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9100b0870 0x7fb9100a9720 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fb9040011d0 tx=0x7fb904007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:10.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.272+0000 7fb90d7fa700 1 -- 172.21.15.62:0/4086516682 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9040070d0 con 0x7fb9100b0870 2021-12-17T18:25:10.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.272+0000 7fb90d7fa700 1 -- 172.21.15.62:0/4086516682 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb904007230 con 0x7fb9100b0870 2021-12-17T18:25:10.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.272+0000 7fb9168e4700 1 -- 172.21.15.62:0/4086516682 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9100aa100 con 0x7fb9100b0870 2021-12-17T18:25:10.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.272+0000 7fb90d7fa700 1 -- 172.21.15.62:0/4086516682 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb904005610 con 0x7fb9100b0870 2021-12-17T18:25:10.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.272+0000 7fb9168e4700 1 -- 172.21.15.62:0/4086516682 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9100a3390 con 0x7fb9100b0870 2021-12-17T18:25:10.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.272+0000 7fb9168e4700 1 -- 172.21.15.62:0/4086516682 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9100679f0 con 0x7fb9100b0870 2021-12-17T18:25:10.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.272+0000 7fb90d7fa700 1 -- 172.21.15.62:0/4086516682 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb904010070 con 0x7fb9100b0870 2021-12-17T18:25:10.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.272+0000 7fb90d7fa700 1 --2- 172.21.15.62:0/4086516682 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8f0053640 0x7fb8f0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:10.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.272+0000 7fb90d7fa700 1 -- 172.21.15.62:0/4086516682 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fb90406b1b0 con 0x7fb9100b0870 2021-12-17T18:25:10.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.272+0000 7fb90ffff700 1 --2- 172.21.15.62:0/4086516682 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8f0053640 0x7fb8f0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:10.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.276+0000 7fb90ffff700 1 --2- 172.21.15.62:0/4086516682 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8f0053640 0x7fb8f0055b00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fb90001a000 tx=0x7fb900014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:10.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.280+0000 7fb90d7fa700 1 -- 172.21.15.62:0/4086516682 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb904042180 con 0x7fb9100b0870 2021-12-17T18:25:10.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.444+0000 7fb9168e4700 1 -- 172.21.15.62:0/4086516682 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb9100a30b0 con 0x7fb9100b0870 2021-12-17T18:25:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.848+0000 7fb90d7fa700 1 -- 172.21.15.62:0/4086516682 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb9040457a0 con 0x7fb9100b0870 2021-12-17T18:25:10.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.852+0000 7fb9168e4700 1 -- 172.21.15.62:0/4086516682 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8f0053640 msgr2=0x7fb8f0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:10.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.852+0000 7fb9168e4700 1 --2- 172.21.15.62:0/4086516682 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8f0053640 0x7fb8f0055b00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fb90001a000 tx=0x7fb900014000).stop 2021-12-17T18:25:10.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.852+0000 7fb9168e4700 1 -- 172.21.15.62:0/4086516682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9100b0870 msgr2=0x7fb9100a9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:10.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.852+0000 7fb9168e4700 1 --2- 172.21.15.62:0/4086516682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9100b0870 0x7fb9100a9720 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fb9040011d0 tx=0x7fb904007bc0).stop 2021-12-17T18:25:10.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.852+0000 7fb9168e4700 1 -- 172.21.15.62:0/4086516682 shutdown_connections 2021-12-17T18:25:10.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.852+0000 7fb9168e4700 1 --2- 172.21.15.62:0/4086516682 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb8f0053640 0x7fb8f0055b00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:10.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.852+0000 7fb9168e4700 1 --2- 172.21.15.62:0/4086516682 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9100b36e0 0x7fb9100a9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:10.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.852+0000 7fb9168e4700 1 --2- 172.21.15.62:0/4086516682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9100b0870 0x7fb9100a9720 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:10.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.852+0000 7fb9168e4700 1 --2- 172.21.15.62:0/4086516682 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb91005f8d0 0x7fb9100ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:10.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.852+0000 7fb9168e4700 1 -- 172.21.15.62:0/4086516682 >> 172.21.15.62:0/4086516682 conn(0x7fb91005bcd0 msgr2=0x7fb910147000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:10.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.852+0000 7fb9168e4700 1 -- 172.21.15.62:0/4086516682 shutdown_connections 2021-12-17T18:25:10.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.852+0000 7fb9168e4700 1 -- 172.21.15.62:0/4086516682 wait complete. 2021-12-17T18:25:10.874 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-12-17T18:25:10.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.992+0000 7fa97664f700 1 Processor -- start 2021-12-17T18:25:10.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.992+0000 7fa97664f700 1 -- start start 2021-12-17T18:25:11.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa97664f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa97005fa70 0x7fa970061390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:11.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa97664f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa9701405f0 0x7fa970062450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:11.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa97664f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97005fe50 con 0x7fa970064de0 2021-12-17T18:25:11.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa97664f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9700646a0 con 0x7fa9701405f0 2021-12-17T18:25:11.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa97664f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa970064940 con 0x7fa97005fa70 2021-12-17T18:25:11.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa975e4e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa9701405f0 0x7fa970062450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:11.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa975e4e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa9701405f0 0x7fa970062450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52650/0 (socket says 172.21.15.62:52650) 2021-12-17T18:25:11.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa975e4e700 1 -- 172.21.15.62:0/24761393 learned_addr learned my addr 172.21.15.62:0/24761393 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:11.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa97564d700 1 --2- 172.21.15.62:0/24761393 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa97005fa70 0x7fa970061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:11.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa95ffff700 1 -- 172.21.15.62:0/24761393 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294333185 0 0) 0x7fa97005fe50 con 0x7fa970064de0 2021-12-17T18:25:11.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa975e4e700 1 -- 172.21.15.62:0/24761393 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa97005fa70 msgr2=0x7fa970061390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:11.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa975e4e700 1 --2- 172.21.15.62:0/24761393 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa97005fa70 0x7fa970061390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:11.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa975e4e700 1 -- 172.21.15.62:0/24761393 >> v1:172.21.15.109:6789/0 conn(0x7fa970064de0 legacy=0x7fa97013fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:11.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa975e4e700 1 -- 172.21.15.62:0/24761393 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa970142e50 con 0x7fa9701405f0 2021-12-17T18:25:11.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa975e4e700 1 --2- 172.21.15.62:0/24761393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9701405f0 0x7fa970062450 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fa9680032f0 tx=0x7fa968009290).ready entity=mon.0 client_cookie=e3bcf9b18869bd8c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:11.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa95ffff700 1 -- 172.21.15.62:0/24761393 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa96800b8a0 con 0x7fa9701405f0 2021-12-17T18:25:11.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa95ffff700 1 -- 172.21.15.62:0/24761393 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96800ba00 con 0x7fa9701405f0 2021-12-17T18:25:11.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa95ffff700 1 -- 172.21.15.62:0/24761393 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa96800bb70 con 0x7fa9701405f0 2021-12-17T18:25:11.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa97664f700 1 -- 172.21.15.62:0/24761393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9701405f0 msgr2=0x7fa970062450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:11.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa97664f700 1 --2- 172.21.15.62:0/24761393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9701405f0 0x7fa970062450 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fa9680032f0 tx=0x7fa968009290).stop 2021-12-17T18:25:11.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa97664f700 1 -- 172.21.15.62:0/24761393 shutdown_connections 2021-12-17T18:25:11.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa97664f700 1 --2- 172.21.15.62:0/24761393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9701405f0 0x7fa970062450 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:11.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa97664f700 1 --2- 172.21.15.62:0/24761393 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa97005fa70 0x7fa970061390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:11.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa97664f700 1 -- 172.21.15.62:0/24761393 >> 172.21.15.62:0/24761393 conn(0x7fa97005bcd0 msgr2=0x7fa970063510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:11.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:10.996+0000 7fa97664f700 1 -- 172.21.15.62:0/24761393 shutdown_connections 2021-12-17T18:25:11.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.000+0000 7fa97664f700 1 -- 172.21.15.62:0/24761393 wait complete. 2021-12-17T18:25:11.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.000+0000 7fa97664f700 1 Processor -- start 2021-12-17T18:25:11.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.000+0000 7fa97664f700 1 -- start start 2021-12-17T18:25:11.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.000+0000 7fa97664f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa97005fa70 0x7fa970152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:11.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.000+0000 7fa97664f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa970064de0 0x7fa9700b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:11.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.000+0000 7fa97664f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9701405f0 0x7fa97013ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:11.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.000+0000 7fa97664f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa970148e40 con 0x7fa9701405f0 2021-12-17T18:25:11.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.000+0000 7fa97664f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa970067420 con 0x7fa970064de0 2021-12-17T18:25:11.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.000+0000 7fa97664f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa970066ee0 con 0x7fa97005fa70 2021-12-17T18:25:11.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.000+0000 7fa975e4e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9701405f0 0x7fa97013ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:11.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.000+0000 7fa975e4e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9701405f0 0x7fa97013ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52656/0 (socket says 172.21.15.62:52656) 2021-12-17T18:25:11.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.000+0000 7fa975e4e700 1 -- 172.21.15.62:0/3345213094 learned_addr learned my addr 172.21.15.62:0/3345213094 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:11.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.000+0000 7fa97564d700 1 --2- 172.21.15.62:0/3345213094 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa97005fa70 0x7fa970152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:11.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.000+0000 7fa974e4c700 1 --2- 172.21.15.62:0/3345213094 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa970064de0 0x7fa9700b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:11.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.004+0000 7fa975e4e700 1 -- 172.21.15.62:0/3345213094 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa97005fa70 msgr2=0x7fa970152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:11.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.004+0000 7fa975e4e700 1 --2- 172.21.15.62:0/3345213094 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa97005fa70 0x7fa970152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:11.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.004+0000 7fa975e4e700 1 -- 172.21.15.62:0/3345213094 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa970064de0 msgr2=0x7fa9700b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:11.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.004+0000 7fa975e4e700 1 --2- 172.21.15.62:0/3345213094 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa970064de0 0x7fa9700b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:11.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.004+0000 7fa975e4e700 1 -- 172.21.15.62:0/3345213094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa968009530 con 0x7fa9701405f0 2021-12-17T18:25:11.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.004+0000 7fa975e4e700 1 --2- 172.21.15.62:0/3345213094 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9701405f0 0x7fa97013ec20 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fa9680032f0 tx=0x7fa968016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:11.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.004+0000 7fa95e7fc700 1 -- 172.21.15.62:0/3345213094 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa96800b8a0 con 0x7fa9701405f0 2021-12-17T18:25:11.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.004+0000 7fa95e7fc700 1 -- 172.21.15.62:0/3345213094 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa968021630 con 0x7fa9701405f0 2021-12-17T18:25:11.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.004+0000 7fa97664f700 1 -- 172.21.15.62:0/3345213094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa970067180 con 0x7fa9701405f0 2021-12-17T18:25:11.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.004+0000 7fa95e7fc700 1 -- 172.21.15.62:0/3345213094 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa968021990 con 0x7fa9701405f0 2021-12-17T18:25:11.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.004+0000 7fa97664f700 1 -- 172.21.15.62:0/3345213094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa970066b80 con 0x7fa9701405f0 2021-12-17T18:25:11.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.004+0000 7fa95e7fc700 1 -- 172.21.15.62:0/3345213094 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa968027020 con 0x7fa9701405f0 2021-12-17T18:25:11.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.004+0000 7fa97664f700 1 -- 172.21.15.62:0/3345213094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9700666f0 con 0x7fa9701405f0 2021-12-17T18:25:11.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.004+0000 7fa95e7fc700 1 --2- 172.21.15.62:0/3345213094 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa950053610 0x7fa950055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:11.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.004+0000 7fa95e7fc700 1 -- 172.21.15.62:0/3345213094 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fa96806cd60 con 0x7fa9701405f0 2021-12-17T18:25:11.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.008+0000 7fa97564d700 1 --2- 172.21.15.62:0/3345213094 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa950053610 0x7fa950055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:11.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.008+0000 7fa97564d700 1 --2- 172.21.15.62:0/3345213094 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa950053610 0x7fa950055ad0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fa96c00b000 tx=0x7fa96c006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:11.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.012+0000 7fa95e7fc700 1 -- 172.21.15.62:0/3345213094 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa9700666f0 con 0x7fa9701405f0 2021-12-17T18:25:11.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.140+0000 7fa97664f700 1 -- 172.21.15.62:0/3345213094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa9700666f0 con 0x7fa9701405f0 2021-12-17T18:25:11.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.856+0000 7fa95e7fc700 1 -- 172.21.15.62:0/3345213094 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) v1 ==== 185+0+0 (secure 0 0 0) 0x7fa9700666f0 con 0x7fa9701405f0 2021-12-17T18:25:11.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.860+0000 7fa97664f700 1 -- 172.21.15.62:0/3345213094 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa950053610 msgr2=0x7fa950055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:11.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.860+0000 7fa97664f700 1 --2- 172.21.15.62:0/3345213094 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa950053610 0x7fa950055ad0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fa96c00b000 tx=0x7fa96c006df0).stop 2021-12-17T18:25:11.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.860+0000 7fa97664f700 1 -- 172.21.15.62:0/3345213094 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9701405f0 msgr2=0x7fa97013ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:11.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.860+0000 7fa97664f700 1 --2- 172.21.15.62:0/3345213094 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9701405f0 0x7fa97013ec20 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fa9680032f0 tx=0x7fa968016000).stop 2021-12-17T18:25:11.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.860+0000 7fa97664f700 1 -- 172.21.15.62:0/3345213094 shutdown_connections 2021-12-17T18:25:11.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.860+0000 7fa97664f700 1 --2- 172.21.15.62:0/3345213094 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa950053610 0x7fa950055ad0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:11.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.860+0000 7fa97664f700 1 --2- 172.21.15.62:0/3345213094 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9701405f0 0x7fa97013ec20 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:11.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.860+0000 7fa97664f700 1 --2- 172.21.15.62:0/3345213094 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa970064de0 0x7fa9700b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:11.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.860+0000 7fa97664f700 1 --2- 172.21.15.62:0/3345213094 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa97005fa70 0x7fa970152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:11.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.860+0000 7fa97664f700 1 -- 172.21.15.62:0/3345213094 >> 172.21.15.62:0/3345213094 conn(0x7fa97005bcd0 msgr2=0x7fa9701426c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:11.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.860+0000 7fa97664f700 1 -- 172.21.15.62:0/3345213094 shutdown_connections 2021-12-17T18:25:11.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.860+0000 7fa97664f700 1 -- 172.21.15.62:0/3345213094 wait complete. 2021-12-17T18:25:11.870 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2021-12-17T18:25:11.880 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-12-17T18:25:11.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.992+0000 7ff525844700 1 Processor -- start 2021-12-17T18:25:11.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.992+0000 7ff525844700 1 -- start start 2021-12-17T18:25:11.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.992+0000 7ff525844700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff52005f730 0x7ff52005fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:12.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.992+0000 7ff525844700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff520147630 con 0x7ff520062730 2021-12-17T18:25:12.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.992+0000 7ff525844700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff520143210 con 0x7ff5201471c0 2021-12-17T18:25:12.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.992+0000 7ff525844700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5201434b0 con 0x7ff52005f730 2021-12-17T18:25:12.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff51e7fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff520062730 0x7ff520143bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36244/0 (socket says 172.21.15.62:36244) 2021-12-17T18:25:12.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff51e7fc700 1 -- 172.21.15.62:0/2152375040 learned_addr learned my addr 172.21.15.62:0/2152375040 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:12.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff51effd700 1 --2- 172.21.15.62:0/2152375040 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff52005f730 0x7ff52005fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:12.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff51dffb700 1 -- 172.21.15.62:0/2152375040 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298609362 0 0) 0x7ff520147630 con 0x7ff520062730 2021-12-17T18:25:12.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff51dffb700 1 -- 172.21.15.62:0/2152375040 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff500003260 con 0x7ff520062730 2021-12-17T18:25:12.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff51dffb700 1 -- 172.21.15.62:0/2152375040 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221186111 0 0) 0x7ff520143210 con 0x7ff5201471c0 2021-12-17T18:25:12.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff51dffb700 1 -- 172.21.15.62:0/2152375040 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff520147630 con 0x7ff5201471c0 2021-12-17T18:25:12.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff51effd700 1 -- 172.21.15.62:0/2152375040 >> v1:172.21.15.109:6789/0 conn(0x7ff5201471c0 legacy=0x7ff5200b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:12.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff51effd700 1 -- 172.21.15.62:0/2152375040 >> v1:172.21.15.62:6789/0 conn(0x7ff520062730 legacy=0x7ff520143bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:12.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff51effd700 1 -- 172.21.15.62:0/2152375040 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff520143750 con 0x7ff52005f730 2021-12-17T18:25:12.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff51effd700 1 --2- 172.21.15.62:0/2152375040 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff52005f730 0x7ff52005fb10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ff510002f70 tx=0x7ff510006df0).ready entity=mon.2 client_cookie=114db7d9c58c066b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:12.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff51dffb700 1 -- 172.21.15.62:0/2152375040 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff51000d5c0 con 0x7ff52005f730 2021-12-17T18:25:12.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff51dffb700 1 -- 172.21.15.62:0/2152375040 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff510000e90 con 0x7ff52005f730 2021-12-17T18:25:12.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff51dffb700 1 -- 172.21.15.62:0/2152375040 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff51000d910 con 0x7ff52005f730 2021-12-17T18:25:12.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff525844700 1 -- 172.21.15.62:0/2152375040 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff52005f730 msgr2=0x7ff52005fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:12.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff525844700 1 --2- 172.21.15.62:0/2152375040 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff52005f730 0x7ff52005fb10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ff510002f70 tx=0x7ff510006df0).stop 2021-12-17T18:25:12.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff525844700 1 -- 172.21.15.62:0/2152375040 shutdown_connections 2021-12-17T18:25:12.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff525844700 1 --2- 172.21.15.62:0/2152375040 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff52005f730 0x7ff52005fb10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:12.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff525844700 1 -- 172.21.15.62:0/2152375040 >> 172.21.15.62:0/2152375040 conn(0x7ff5200b64f0 msgr2=0x7ff5200b68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:12.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff525844700 1 -- 172.21.15.62:0/2152375040 shutdown_connections 2021-12-17T18:25:12.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:11.996+0000 7ff525844700 1 -- 172.21.15.62:0/2152375040 wait complete. 2021-12-17T18:25:12.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff525844700 1 Processor -- start 2021-12-17T18:25:12.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff525844700 1 -- start start 2021-12-17T18:25:12.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff525844700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff52005f730 0x7ff5200aa770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:12.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff525844700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff520062730 0x7ff5200aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:12.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff525844700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5201471c0 0x7ff520152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:12.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff525844700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff520145ad0 con 0x7ff5201471c0 2021-12-17T18:25:12.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff525844700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5200ad010 con 0x7ff52005f730 2021-12-17T18:25:12.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff525844700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5200ad2b0 con 0x7ff520062730 2021-12-17T18:25:12.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff51effd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff52005f730 0x7ff5200aa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:12.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff51f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5201471c0 0x7ff520152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:12.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff51e7fc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff520062730 0x7ff5200aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:12.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff51effd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff52005f730 0x7ff5200aa770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:59216/0 (socket says 172.21.15.62:59216) 2021-12-17T18:25:12.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff51e7fc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff520062730 0x7ff5200aac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:46370/0 (socket says 172.21.15.62:46370) 2021-12-17T18:25:12.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff51effd700 1 -- 172.21.15.62:0/2255106079 learned_addr learned my addr 172.21.15.62:0/2255106079 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:12.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff51effd700 1 -- 172.21.15.62:0/2255106079 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff520062730 msgr2=0x7ff5200aac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:12.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff51effd700 1 --2- 172.21.15.62:0/2255106079 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff520062730 0x7ff5200aac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:12.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff51effd700 1 -- 172.21.15.62:0/2255106079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5201471c0 msgr2=0x7ff520152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:12.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff51effd700 1 --2- 172.21.15.62:0/2255106079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5201471c0 0x7ff520152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:12.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff51effd700 1 -- 172.21.15.62:0/2255106079 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51000b180 con 0x7ff52005f730 2021-12-17T18:25:12.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff51e7fc700 1 --2- 172.21.15.62:0/2255106079 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff520062730 0x7ff5200aac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:12.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff51effd700 1 --2- 172.21.15.62:0/2255106079 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff52005f730 0x7ff5200aa770 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7ff510002f70 tx=0x7ff510014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:12.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff517fff700 1 -- 172.21.15.62:0/2255106079 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff510016070 con 0x7ff52005f730 2021-12-17T18:25:12.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff517fff700 1 -- 172.21.15.62:0/2255106079 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5100137d0 con 0x7ff52005f730 2021-12-17T18:25:12.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff525844700 1 -- 172.21.15.62:0/2255106079 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff520145110 con 0x7ff52005f730 2021-12-17T18:25:12.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff517fff700 1 -- 172.21.15.62:0/2255106079 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff510013b30 con 0x7ff52005f730 2021-12-17T18:25:12.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.000+0000 7ff525844700 1 -- 172.21.15.62:0/2255106079 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff520146420 con 0x7ff52005f730 2021-12-17T18:25:12.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.004+0000 7ff525844700 1 -- 172.21.15.62:0/2255106079 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5201452a0 con 0x7ff52005f730 2021-12-17T18:25:12.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.004+0000 7ff517fff700 1 -- 172.21.15.62:0/2255106079 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff51000f030 con 0x7ff52005f730 2021-12-17T18:25:12.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.004+0000 7ff517fff700 1 --2- 172.21.15.62:0/2255106079 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff5040534f0 0x7ff5040559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:12.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.004+0000 7ff517fff700 1 -- 172.21.15.62:0/2255106079 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5764+0+0 (secure 0 0 0) 0x7ff51006c3d0 con 0x7ff52005f730 2021-12-17T18:25:12.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.004+0000 7ff51e7fc700 1 --2- 172.21.15.62:0/2255106079 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff5040534f0 0x7ff5040559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:12.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.008+0000 7ff51e7fc700 1 --2- 172.21.15.62:0/2255106079 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff5040534f0 0x7ff5040559b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7ff50800d000 tx=0x7ff508009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:12.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.012+0000 7ff517fff700 1 -- 172.21.15.62:0/2255106079 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff5100435c0 con 0x7ff52005f730 2021-12-17T18:25:12.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.144+0000 7ff525844700 1 -- 172.21.15.62:0/2255106079 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff5200b1d40 con 0x7ff52005f730 2021-12-17T18:25:12.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.864+0000 7ff517fff700 1 -- 172.21.15.62:0/2255106079 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff5100230d0 con 0x7ff52005f730 2021-12-17T18:25:12.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.868+0000 7ff525844700 1 -- 172.21.15.62:0/2255106079 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff5040534f0 msgr2=0x7ff5040559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:12.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.868+0000 7ff525844700 1 --2- 172.21.15.62:0/2255106079 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff5040534f0 0x7ff5040559b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7ff50800d000 tx=0x7ff508009040).stop 2021-12-17T18:25:12.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.868+0000 7ff525844700 1 -- 172.21.15.62:0/2255106079 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff52005f730 msgr2=0x7ff5200aa770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:12.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.868+0000 7ff525844700 1 --2- 172.21.15.62:0/2255106079 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff52005f730 0x7ff5200aa770 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7ff510002f70 tx=0x7ff510014000).stop 2021-12-17T18:25:12.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.868+0000 7ff525844700 1 -- 172.21.15.62:0/2255106079 shutdown_connections 2021-12-17T18:25:12.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.868+0000 7ff525844700 1 --2- 172.21.15.62:0/2255106079 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff5040534f0 0x7ff5040559b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:12.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.868+0000 7ff525844700 1 --2- 172.21.15.62:0/2255106079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5201471c0 0x7ff520152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:12.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.868+0000 7ff525844700 1 --2- 172.21.15.62:0/2255106079 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff520062730 0x7ff5200aac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:12.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.868+0000 7ff525844700 1 --2- 172.21.15.62:0/2255106079 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff52005f730 0x7ff5200aa770 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:12.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.868+0000 7ff525844700 1 -- 172.21.15.62:0/2255106079 >> 172.21.15.62:0/2255106079 conn(0x7ff5200b64f0 msgr2=0x7ff5200b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:12.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.868+0000 7ff525844700 1 -- 172.21.15.62:0/2255106079 shutdown_connections 2021-12-17T18:25:12.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:12.868+0000 7ff525844700 1 -- 172.21.15.62:0/2255106079 wait complete. 2021-12-17T18:25:12.878 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2021-12-17T18:25:12.890 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-12-17T18:25:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.000+0000 7f00c6fe7700 1 Processor -- start 2021-12-17T18:25:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.000+0000 7f00c6fe7700 1 -- start start 2021-12-17T18:25:13.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.000+0000 7f00c6fe7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c00b43e0 0x7f00c00b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:13.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.000+0000 7f00c6fe7700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f00c0140a70 0x7f00c0140f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:13.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.000+0000 7f00c6fe7700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c014b930 con 0x7f00c00b2010 2021-12-17T18:25:13.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.000+0000 7f00c6fe7700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c00b47c0 con 0x7f00c0140a70 2021-12-17T18:25:13.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.000+0000 7f00c6fe7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c014acf0 con 0x7f00c00b43e0 2021-12-17T18:25:13.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.000+0000 7f00c67e6700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f00c0140a70 0x7f00c0140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:13.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.000+0000 7f00c5fe5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c00b43e0 0x7f00c00b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:13.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.000+0000 7f00c67e6700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f00c0140a70 0x7f00c0140f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:59228/0 (socket says 172.21.15.62:59228) 2021-12-17T18:25:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.000+0000 7f00c67e6700 1 -- 172.21.15.62:0/1871641061 learned_addr learned my addr 172.21.15.62:0/1871641061 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.000+0000 7f00c5fe5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c00b43e0 0x7f00c00b2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:46376/0 (socket says 172.21.15.62:46376) 2021-12-17T18:25:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.000+0000 7f00c5fe5700 1 -- 172.21.15.62:0/1871641061 >> v2:172.21.15.109:3300/0 conn(0x7f00c0140a70 msgr2=0x7f00c0140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.000+0000 7f00c5fe5700 1 --2- 172.21.15.62:0/1871641061 >> v2:172.21.15.109:3300/0 conn(0x7f00c0140a70 0x7f00c0140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.000+0000 7f00c5fe5700 1 -- 172.21.15.62:0/1871641061 >> v1:172.21.15.109:6789/0 conn(0x7f00c00b2010 legacy=0x7f00c0147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.000+0000 7f00c5fe5700 1 -- 172.21.15.62:0/1871641061 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c0147520 con 0x7f00c00b43e0 2021-12-17T18:25:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.000+0000 7f00c67e6700 1 --2- 172.21.15.62:0/1871641061 >> v2:172.21.15.109:3300/0 conn(0x7f00c0140a70 0x7f00c0140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.004+0000 7f00c5fe5700 1 --2- 172.21.15.62:0/1871641061 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c00b43e0 0x7f00c00b2520 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f00bc002f70 tx=0x7f00bc006df0).ready entity=mon.2 client_cookie=84451f9d1b2acd9a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.004+0000 7f00c4fe3700 1 -- 172.21.15.62:0/1871641061 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00bc00d570 con 0x7f00c00b43e0 2021-12-17T18:25:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.004+0000 7f00c4fe3700 1 -- 172.21.15.62:0/1871641061 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00bc000e90 con 0x7f00c00b43e0 2021-12-17T18:25:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.004+0000 7f00c4fe3700 1 -- 172.21.15.62:0/1871641061 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00bc00d8c0 con 0x7f00c00b43e0 2021-12-17T18:25:13.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.004+0000 7f00c6fe7700 1 -- 172.21.15.62:0/1871641061 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c00b43e0 msgr2=0x7f00c00b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:13.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.004+0000 7f00c6fe7700 1 --2- 172.21.15.62:0/1871641061 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c00b43e0 0x7f00c00b2520 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f00bc002f70 tx=0x7f00bc006df0).stop 2021-12-17T18:25:13.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.004+0000 7f00c6fe7700 1 -- 172.21.15.62:0/1871641061 shutdown_connections 2021-12-17T18:25:13.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.004+0000 7f00c6fe7700 1 --2- 172.21.15.62:0/1871641061 >> v2:172.21.15.109:3300/0 conn(0x7f00c0140a70 0x7f00c0140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.004+0000 7f00c6fe7700 1 --2- 172.21.15.62:0/1871641061 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c00b43e0 0x7f00c00b2520 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.004+0000 7f00c6fe7700 1 -- 172.21.15.62:0/1871641061 >> 172.21.15.62:0/1871641061 conn(0x7f00c005c960 msgr2=0x7f00c005cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:13.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.004+0000 7f00c6fe7700 1 -- 172.21.15.62:0/1871641061 shutdown_connections 2021-12-17T18:25:13.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.004+0000 7f00c6fe7700 1 -- 172.21.15.62:0/1871641061 wait complete. 2021-12-17T18:25:13.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c6fe7700 1 Processor -- start 2021-12-17T18:25:13.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c6fe7700 1 -- start start 2021-12-17T18:25:13.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c6fe7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c00b2010 0x7f00c00ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:13.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c6fe7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c00b43e0 0x7f00c0155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:13.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c6fe7700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f00c0140a70 0x7f00c0156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:13.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c6fe7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c01577b0 con 0x7f00c00b43e0 2021-12-17T18:25:13.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c6fe7700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c00ae730 con 0x7f00c0140a70 2021-12-17T18:25:13.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c6fe7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c00ae9d0 con 0x7f00c00b2010 2021-12-17T18:25:13.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c57e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c00b43e0 0x7f00c0155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:13.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c57e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c00b43e0 0x7f00c0155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52682/0 (socket says 172.21.15.62:52682) 2021-12-17T18:25:13.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c57e4700 1 -- 172.21.15.62:0/164725533 learned_addr learned my addr 172.21.15.62:0/164725533 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c5fe5700 1 --2- 172.21.15.62:0/164725533 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c00b2010 0x7f00c00ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c67e6700 1 --2- 172.21.15.62:0/164725533 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f00c0140a70 0x7f00c0156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c57e4700 1 -- 172.21.15.62:0/164725533 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c00b2010 msgr2=0x7f00c00ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c57e4700 1 --2- 172.21.15.62:0/164725533 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c00b2010 0x7f00c00ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c57e4700 1 -- 172.21.15.62:0/164725533 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f00c0140a70 msgr2=0x7f00c0156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c57e4700 1 --2- 172.21.15.62:0/164725533 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f00c0140a70 0x7f00c0156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c57e4700 1 -- 172.21.15.62:0/164725533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b8009530 con 0x7f00c00b43e0 2021-12-17T18:25:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c57e4700 1 --2- 172.21.15.62:0/164725533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c00b43e0 0x7f00c0155b60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f00c0147b40 tx=0x7f00b4007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00b2ffd700 1 -- 172.21.15.62:0/164725533 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00b4007030 con 0x7f00c00b43e0 2021-12-17T18:25:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c6fe7700 1 -- 172.21.15.62:0/164725533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00bc00b180 con 0x7f00c00b43e0 2021-12-17T18:25:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00b2ffd700 1 -- 172.21.15.62:0/164725533 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b4007190 con 0x7f00c00b43e0 2021-12-17T18:25:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00b2ffd700 1 -- 172.21.15.62:0/164725533 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00b4006510 con 0x7f00c00b43e0 2021-12-17T18:25:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.008+0000 7f00c6fe7700 1 -- 172.21.15.62:0/164725533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c0156540 con 0x7f00c00b43e0 2021-12-17T18:25:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.012+0000 7f00c6fe7700 1 -- 172.21.15.62:0/164725533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c00aeb90 con 0x7f00c00b43e0 2021-12-17T18:25:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.012+0000 7f00b2ffd700 1 -- 172.21.15.62:0/164725533 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f00b4010030 con 0x7f00c00b43e0 2021-12-17T18:25:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.012+0000 7f00b2ffd700 1 --2- 172.21.15.62:0/164725533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00a00536a0 0x7f00a0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.012+0000 7f00b2ffd700 1 -- 172.21.15.62:0/164725533 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f00b406b350 con 0x7f00c00b43e0 2021-12-17T18:25:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.012+0000 7f00c5fe5700 1 --2- 172.21.15.62:0/164725533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00a00536a0 0x7f00a0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.012+0000 7f00c5fe5700 1 --2- 172.21.15.62:0/164725533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00a00536a0 0x7f00a0055b60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f00bc01a000 tx=0x7f00bc014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.016+0000 7f00b2ffd700 1 -- 172.21.15.62:0/164725533 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f00b40425d0 con 0x7f00c00b43e0 2021-12-17T18:25:13.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.140+0000 7f00c6fe7700 1 -- 172.21.15.62:0/164725533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f00c0157610 con 0x7f00c00b43e0 2021-12-17T18:25:13.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.148+0000 7f00b2ffd700 1 -- 172.21.15.62:0/164725533 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f00c0157610 con 0x7f00c00b43e0 2021-12-17T18:25:13.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.148+0000 7f00c6fe7700 1 -- 172.21.15.62:0/164725533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00a00536a0 msgr2=0x7f00a0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:13.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.148+0000 7f00c6fe7700 1 --2- 172.21.15.62:0/164725533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00a00536a0 0x7f00a0055b60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f00bc01a000 tx=0x7f00bc014000).stop 2021-12-17T18:25:13.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.148+0000 7f00c6fe7700 1 -- 172.21.15.62:0/164725533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c00b43e0 msgr2=0x7f00c0155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:13.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.148+0000 7f00c6fe7700 1 --2- 172.21.15.62:0/164725533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c00b43e0 0x7f00c0155b60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f00c0147b40 tx=0x7f00b4007be0).stop 2021-12-17T18:25:13.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.148+0000 7f00c6fe7700 1 -- 172.21.15.62:0/164725533 shutdown_connections 2021-12-17T18:25:13.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.148+0000 7f00c6fe7700 1 --2- 172.21.15.62:0/164725533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00a00536a0 0x7f00a0055b60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.148+0000 7f00c6fe7700 1 --2- 172.21.15.62:0/164725533 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f00c0140a70 0x7f00c0156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.148+0000 7f00c6fe7700 1 --2- 172.21.15.62:0/164725533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c00b43e0 0x7f00c0155b60 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.148+0000 7f00c6fe7700 1 --2- 172.21.15.62:0/164725533 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c00b2010 0x7f00c00ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.148+0000 7f00c6fe7700 1 -- 172.21.15.62:0/164725533 >> 172.21.15.62:0/164725533 conn(0x7f00c005c960 msgr2=0x7f00c00b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:13.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.148+0000 7f00c6fe7700 1 -- 172.21.15.62:0/164725533 shutdown_connections 2021-12-17T18:25:13.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.148+0000 7f00c6fe7700 1 -- 172.21.15.62:0/164725533 wait complete. 2021-12-17T18:25:13.167 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-12-17T18:25:13.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd77cc700 1 Processor -- start 2021-12-17T18:25:13.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd77cc700 1 -- start start 2021-12-17T18:25:13.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd77cc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7fd00b21f0 0x7f7fd014aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:13.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd77cc700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd00b2ce0 con 0x7f7fd00b1730 2021-12-17T18:25:13.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd77cc700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd00aca60 con 0x7f7fd00a7bb0 2021-12-17T18:25:13.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd77cc700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd0147870 con 0x7f7fd00b21f0 2021-12-17T18:25:13.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd4d67700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7fd00b1730 0x7f7fd00ace90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36270/0 (socket says 172.21.15.62:36270) 2021-12-17T18:25:13.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd4d67700 1 -- 172.21.15.62:0/3184029106 learned_addr learned my addr 172.21.15.62:0/3184029106 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:13.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd5568700 1 --2- 172.21.15.62:0/3184029106 >> v2:172.21.15.109:3300/0 conn(0x7f7fd00b21f0 0x7f7fd014aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:13.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fc7fff700 1 -- 172.21.15.62:0/3184029106 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543831527 0 0) 0x7f7fd00b2ce0 con 0x7f7fd00b1730 2021-12-17T18:25:13.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fc7fff700 1 -- 172.21.15.62:0/3184029106 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fbc003260 con 0x7f7fd00b1730 2021-12-17T18:25:13.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fc7fff700 1 -- 172.21.15.62:0/3184029106 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1426467513 0 0) 0x7f7fbc003260 con 0x7f7fd00b1730 2021-12-17T18:25:13.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fc7fff700 1 -- 172.21.15.62:0/3184029106 >> v2:172.21.15.109:3300/0 conn(0x7f7fd00b21f0 msgr2=0x7f7fd014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:13.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fc7fff700 1 --2- 172.21.15.62:0/3184029106 >> v2:172.21.15.109:3300/0 conn(0x7f7fd00b21f0 0x7f7fd014aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fc7fff700 1 -- 172.21.15.62:0/3184029106 >> v1:172.21.15.109:6789/0 conn(0x7f7fd00a7bb0 legacy=0x7f7fd0067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:13.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fc7fff700 1 -- 172.21.15.62:0/3184029106 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd00b2f10 con 0x7f7fd00b1730 2021-12-17T18:25:13.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fc7fff700 1 -- 172.21.15.62:0/3184029106 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f7fc80019e0 con 0x7f7fd00b1730 2021-12-17T18:25:13.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fc7fff700 1 -- 172.21.15.62:0/3184029106 >> v1:172.21.15.62:6789/0 conn(0x7f7fd00b1730 legacy=0x7f7fd00ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:13.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fc7fff700 1 --2- 172.21.15.62:0/3184029106 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7fbc003750 0x7f7fbc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:13.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fc7fff700 1 --2- 172.21.15.62:0/3184029106 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7fbc004500 0x7f7fbc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:13.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fc7fff700 1 --2- 172.21.15.62:0/3184029106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fbc004e70 0x7f7fbc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:13.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fc7fff700 1 -- 172.21.15.62:0/3184029106 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc00bcf0 con 0x7f7fbc004e70 2021-12-17T18:25:13.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fc7fff700 1 -- 172.21.15.62:0/3184029106 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc00be60 con 0x7f7fbc004500 2021-12-17T18:25:13.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fc7fff700 1 -- 172.21.15.62:0/3184029106 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc00c020 con 0x7f7fbc003750 2021-12-17T18:25:13.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd5568700 1 --2- 172.21.15.62:0/3184029106 >> v2:172.21.15.109:3300/0 conn(0x7f7fd00b21f0 0x7f7fd014aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:13.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd5d69700 1 --2- 172.21.15.62:0/3184029106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fbc004e70 0x7f7fbc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:13.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd4d67700 1 --2- 172.21.15.62:0/3184029106 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7fbc004500 0x7f7fbc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:13.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd5568700 1 --2- 172.21.15.62:0/3184029106 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7fbc003750 0x7f7fbc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:13.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd5d69700 1 -- 172.21.15.62:0/3184029106 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7fbc003750 msgr2=0x7f7fbc003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:13.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd5d69700 1 --2- 172.21.15.62:0/3184029106 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7fbc003750 0x7f7fbc003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd5d69700 1 -- 172.21.15.62:0/3184029106 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7fbc004500 msgr2=0x7f7fbc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:13.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd5d69700 1 --2- 172.21.15.62:0/3184029106 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7fbc004500 0x7f7fbc004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd5d69700 1 -- 172.21.15.62:0/3184029106 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc003260 con 0x7f7fbc004e70 2021-12-17T18:25:13.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd5d69700 1 -- 172.21.15.62:0/3184029106 reap_dead start 2021-12-17T18:25:13.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fd5d69700 1 --2- 172.21.15.62:0/3184029106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fbc004e70 0x7f7fbc00b750 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f7fd0061080 tx=0x7f7fc0007a00).ready entity=mon.0 client_cookie=91e5f79f5a3293ce server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:13.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.268+0000 7f7fc7fff700 1 -- 172.21.15.62:0/3184029106 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fc0007d10 con 0x7f7fbc004e70 2021-12-17T18:25:13.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.272+0000 7f7fc7fff700 1 -- 172.21.15.62:0/3184029106 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc0007030 con 0x7f7fbc004e70 2021-12-17T18:25:13.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.272+0000 7f7fc7fff700 1 -- 172.21.15.62:0/3184029106 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fc0007390 con 0x7f7fbc004e70 2021-12-17T18:25:13.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.272+0000 7f7fd77cc700 1 -- 172.21.15.62:0/3184029106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fbc004e70 msgr2=0x7f7fbc00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:13.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.272+0000 7f7fd77cc700 1 --2- 172.21.15.62:0/3184029106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fbc004e70 0x7f7fbc00b750 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f7fd0061080 tx=0x7f7fc0007a00).stop 2021-12-17T18:25:13.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.272+0000 7f7fd77cc700 1 -- 172.21.15.62:0/3184029106 shutdown_connections 2021-12-17T18:25:13.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.272+0000 7f7fd77cc700 1 --2- 172.21.15.62:0/3184029106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fbc004e70 0x7f7fbc00b750 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.272+0000 7f7fd77cc700 1 -- 172.21.15.62:0/3184029106 >> 172.21.15.62:0/3184029106 conn(0x7f7fd005f730 msgr2=0x7f7fd005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:13.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.272+0000 7f7fd77cc700 1 -- 172.21.15.62:0/3184029106 shutdown_connections 2021-12-17T18:25:13.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.272+0000 7f7fd77cc700 1 -- 172.21.15.62:0/3184029106 wait complete. 2021-12-17T18:25:13.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.272+0000 7f7fd77cc700 1 Processor -- start 2021-12-17T18:25:13.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.272+0000 7f7fd77cc700 1 -- start start 2021-12-17T18:25:13.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd77cc700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7fbc004e70 0x7f7fd014a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:13.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd77cc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd00aa910 0x7f7fd00aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:13.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd77cc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7fd0157150 0x7f7fd01575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:13.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd77cc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd0156d30 con 0x7f7fd00aa910 2021-12-17T18:25:13.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd77cc700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd015b210 con 0x7f7fbc004e70 2021-12-17T18:25:13.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd77cc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd015a4b0 con 0x7f7fd0157150 2021-12-17T18:25:13.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd4d67700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd00aa910 0x7f7fd00aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:13.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd4d67700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd00aa910 0x7f7fd00aad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52702/0 (socket says 172.21.15.62:52702) 2021-12-17T18:25:13.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd5568700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7fbc004e70 0x7f7fd014a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:13.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd5d69700 1 --2- 172.21.15.62:0/442027428 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7fd0157150 0x7f7fd01575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:13.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd4d67700 1 -- 172.21.15.62:0/442027428 learned_addr learned my addr 172.21.15.62:0/442027428 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:13.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd4d67700 1 -- 172.21.15.62:0/442027428 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7fd0157150 msgr2=0x7f7fd01575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:13.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd4d67700 1 --2- 172.21.15.62:0/442027428 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7fd0157150 0x7f7fd01575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd4d67700 1 -- 172.21.15.62:0/442027428 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7fbc004e70 msgr2=0x7f7fd014a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:13.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd4d67700 1 --2- 172.21.15.62:0/442027428 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7fbc004e70 0x7f7fd014a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd4d67700 1 -- 172.21.15.62:0/442027428 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd00ab260 con 0x7f7fd00aa910 2021-12-17T18:25:13.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd5568700 1 --2- 172.21.15.62:0/442027428 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7fbc004e70 0x7f7fd014a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:13.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd4d67700 1 --2- 172.21.15.62:0/442027428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd00aa910 0x7f7fd00aad70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f7fc8001490 tx=0x7f7fd00b30a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:13.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fc67fc700 1 -- 172.21.15.62:0/442027428 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fc800f820 con 0x7f7fd00aa910 2021-12-17T18:25:13.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fc67fc700 1 -- 172.21.15.62:0/442027428 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc800f980 con 0x7f7fd00aa910 2021-12-17T18:25:13.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd77cc700 1 -- 172.21.15.62:0/442027428 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd00a9500 con 0x7f7fd00aa910 2021-12-17T18:25:13.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fc67fc700 1 -- 172.21.15.62:0/442027428 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fc800fce0 con 0x7f7fd00aa910 2021-12-17T18:25:13.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd77cc700 1 -- 172.21.15.62:0/442027428 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd00aeb40 con 0x7f7fd00aa910 2021-12-17T18:25:13.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.276+0000 7f7fd77cc700 1 -- 172.21.15.62:0/442027428 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd0156e70 con 0x7f7fd00aa910 2021-12-17T18:25:13.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.280+0000 7f7fc67fc700 1 -- 172.21.15.62:0/442027428 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7fc801c360 con 0x7f7fd00aa910 2021-12-17T18:25:13.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.280+0000 7f7fc67fc700 1 --2- 172.21.15.62:0/442027428 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fb00536a0 0x7f7fb0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:13.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.280+0000 7f7fc67fc700 1 -- 172.21.15.62:0/442027428 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f7fc806b880 con 0x7f7fd00aa910 2021-12-17T18:25:13.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.280+0000 7f7fd5568700 1 --2- 172.21.15.62:0/442027428 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fb00536a0 0x7f7fb0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:13.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.280+0000 7f7fd5568700 1 --2- 172.21.15.62:0/442027428 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fb00536a0 0x7f7fb0055b60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f7fcc00b000 tx=0x7f7fcc006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:13.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.284+0000 7f7fc67fc700 1 -- 172.21.15.62:0/442027428 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7fc8042b20 con 0x7f7fd00aa910 2021-12-17T18:25:13.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.456+0000 7f7fd77cc700 1 -- 172.21.15.62:0/442027428 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7f7fd015a2c0 con 0x7f7fd00aa910 2021-12-17T18:25:13.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.872+0000 7f7fc67fc700 1 -- 172.21.15.62:0/442027428 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v296) v1 ==== 139+0+0 (secure 0 0 0) 0x7f7fc8019030 con 0x7f7fd00aa910 2021-12-17T18:25:13.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.876+0000 7f7fd77cc700 1 -- 172.21.15.62:0/442027428 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fb00536a0 msgr2=0x7f7fb0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:13.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.876+0000 7f7fd77cc700 1 --2- 172.21.15.62:0/442027428 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fb00536a0 0x7f7fb0055b60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f7fcc00b000 tx=0x7f7fcc006df0).stop 2021-12-17T18:25:13.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.876+0000 7f7fd77cc700 1 -- 172.21.15.62:0/442027428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd00aa910 msgr2=0x7f7fd00aad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:13.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.876+0000 7f7fd77cc700 1 --2- 172.21.15.62:0/442027428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd00aa910 0x7f7fd00aad70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f7fc8001490 tx=0x7f7fd00b30a0).stop 2021-12-17T18:25:13.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.876+0000 7f7fd77cc700 1 -- 172.21.15.62:0/442027428 shutdown_connections 2021-12-17T18:25:13.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.876+0000 7f7fd77cc700 1 --2- 172.21.15.62:0/442027428 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fb00536a0 0x7f7fb0055b60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.876+0000 7f7fd77cc700 1 --2- 172.21.15.62:0/442027428 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7fd0157150 0x7f7fd01575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.876+0000 7f7fd77cc700 1 --2- 172.21.15.62:0/442027428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd00aa910 0x7f7fd00aad70 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.876+0000 7f7fd77cc700 1 --2- 172.21.15.62:0/442027428 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7fbc004e70 0x7f7fd014a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:13.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.876+0000 7f7fd77cc700 1 -- 172.21.15.62:0/442027428 >> 172.21.15.62:0/442027428 conn(0x7f7fd005f730 msgr2=0x7f7fd014e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:13.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.876+0000 7f7fd77cc700 1 -- 172.21.15.62:0/442027428 shutdown_connections 2021-12-17T18:25:13.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:13.876+0000 7f7fd77cc700 1 -- 172.21.15.62:0/442027428 wait complete. 2021-12-17T18:25:13.898 INFO:tasks.cephfs_test_runner:test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) ... ok 2021-12-17T18:25:13.899 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode (tasks.cephfs.test_misc.TestMisc) 2021-12-17T18:25:13.899 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-12-17T18:25:14.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.004+0000 7fb2be3f4700 1 Processor -- start 2021-12-17T18:25:14.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.004+0000 7fb2be3f4700 1 -- start start 2021-12-17T18:25:14.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.004+0000 7fb2be3f4700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fb2b80b1d60 0x7fb2b8142c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:14.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.004+0000 7fb2be3f4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb2b8143120 0x7fb2b813ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:14.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.004+0000 7fb2be3f4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b80b6c40 con 0x7fb2b80679a0 2021-12-17T18:25:14.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.004+0000 7fb2be3f4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b80aeea0 con 0x7fb2b8143120 2021-12-17T18:25:14.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.004+0000 7fb2be3f4700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b8067d80 con 0x7fb2b80b1d60 2021-12-17T18:25:14.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.004+0000 7fb2bdbf3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb2b8143120 0x7fb2b813ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:14.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.004+0000 7fb2bd3f2700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb2b80679a0 0x7fb2b80b6410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36290/0 (socket says 172.21.15.62:36290) 2021-12-17T18:25:14.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.004+0000 7fb2bd3f2700 1 -- 172.21.15.62:0/280539814 learned_addr learned my addr 172.21.15.62:0/280539814 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:14.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2bcbf1700 1 --2- 172.21.15.62:0/280539814 >> v2:172.21.15.109:3300/0 conn(0x7fb2b80b1d60 0x7fb2b8142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:14.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2bdbf3700 1 -- 172.21.15.62:0/280539814 >> v2:172.21.15.109:3300/0 conn(0x7fb2b80b1d60 msgr2=0x7fb2b8142c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:14.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2affff700 1 -- 172.21.15.62:0/280539814 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304214106 0 0) 0x7fb2b80b6c40 con 0x7fb2b80679a0 2021-12-17T18:25:14.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2bdbf3700 1 --2- 172.21.15.62:0/280539814 >> v2:172.21.15.109:3300/0 conn(0x7fb2b80b1d60 0x7fb2b8142c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:14.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2bdbf3700 1 -- 172.21.15.62:0/280539814 >> v1:172.21.15.62:6789/0 conn(0x7fb2b80679a0 legacy=0x7fb2b80b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:14.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2bdbf3700 1 -- 172.21.15.62:0/280539814 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b80b1620 con 0x7fb2b8143120 2021-12-17T18:25:14.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2bcbf1700 1 --2- 172.21.15.62:0/280539814 >> v2:172.21.15.109:3300/0 conn(0x7fb2b80b1d60 0x7fb2b8142c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:14.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2bdbf3700 1 --2- 172.21.15.62:0/280539814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b8143120 0x7fb2b813ea00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fb2b0002f70 tx=0x7fb2b0006df0).ready entity=mon.0 client_cookie=bb56431b4b4945cd server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:14.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2affff700 1 -- 172.21.15.62:0/280539814 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2b000d5c0 con 0x7fb2b8143120 2021-12-17T18:25:14.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2affff700 1 -- 172.21.15.62:0/280539814 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b0000e90 con 0x7fb2b8143120 2021-12-17T18:25:14.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2affff700 1 -- 172.21.15.62:0/280539814 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2b000d910 con 0x7fb2b8143120 2021-12-17T18:25:14.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2be3f4700 1 -- 172.21.15.62:0/280539814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b8143120 msgr2=0x7fb2b813ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:14.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2be3f4700 1 --2- 172.21.15.62:0/280539814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b8143120 0x7fb2b813ea00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fb2b0002f70 tx=0x7fb2b0006df0).stop 2021-12-17T18:25:14.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2be3f4700 1 -- 172.21.15.62:0/280539814 shutdown_connections 2021-12-17T18:25:14.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2be3f4700 1 --2- 172.21.15.62:0/280539814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b8143120 0x7fb2b813ea00 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:14.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2be3f4700 1 --2- 172.21.15.62:0/280539814 >> v2:172.21.15.109:3300/0 conn(0x7fb2b80b1d60 0x7fb2b8142c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:14.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2be3f4700 1 -- 172.21.15.62:0/280539814 >> 172.21.15.62:0/280539814 conn(0x7fb2b805caf0 msgr2=0x7fb2b805cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:14.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2be3f4700 1 -- 172.21.15.62:0/280539814 shutdown_connections 2021-12-17T18:25:14.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.008+0000 7fb2be3f4700 1 -- 172.21.15.62:0/280539814 wait complete. 2021-12-17T18:25:14.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.012+0000 7fb2be3f4700 1 Processor -- start 2021-12-17T18:25:14.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.012+0000 7fb2be3f4700 1 -- start start 2021-12-17T18:25:14.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.012+0000 7fb2be3f4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb2b80679a0 0x7fb2b80b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:14.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.012+0000 7fb2be3f4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b80b1d60 0x7fb2b80655f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:14.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.012+0000 7fb2be3f4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b8143120 0x7fb2b8065ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:14.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.012+0000 7fb2be3f4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b8064be0 con 0x7fb2b8143120 2021-12-17T18:25:14.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.012+0000 7fb2be3f4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b8065150 con 0x7fb2b80679a0 2021-12-17T18:25:14.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.012+0000 7fb2be3f4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b8153560 con 0x7fb2b80b1d60 2021-12-17T18:25:14.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.012+0000 7fb2bdbf3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b8143120 0x7fb2b8065ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:14.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.012+0000 7fb2bdbf3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b8143120 0x7fb2b8065ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52718/0 (socket says 172.21.15.62:52718) 2021-12-17T18:25:14.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.012+0000 7fb2bdbf3700 1 -- 172.21.15.62:0/3204690653 learned_addr learned my addr 172.21.15.62:0/3204690653 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:14.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.012+0000 7fb2bcbf1700 1 --2- 172.21.15.62:0/3204690653 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b80b1d60 0x7fb2b80655f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:14.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.012+0000 7fb2bd3f2700 1 --2- 172.21.15.62:0/3204690653 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb2b80679a0 0x7fb2b80b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:14.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.016+0000 7fb2bdbf3700 1 -- 172.21.15.62:0/3204690653 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b80b1d60 msgr2=0x7fb2b80655f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:14.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.016+0000 7fb2bdbf3700 1 --2- 172.21.15.62:0/3204690653 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b80b1d60 0x7fb2b80655f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:14.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.016+0000 7fb2bdbf3700 1 -- 172.21.15.62:0/3204690653 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb2b80679a0 msgr2=0x7fb2b80b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:14.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.016+0000 7fb2bdbf3700 1 --2- 172.21.15.62:0/3204690653 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb2b80679a0 0x7fb2b80b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:14.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.016+0000 7fb2bdbf3700 1 -- 172.21.15.62:0/3204690653 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b000b180 con 0x7fb2b8143120 2021-12-17T18:25:14.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.016+0000 7fb2bdbf3700 1 --2- 172.21.15.62:0/3204690653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b8143120 0x7fb2b8065ae0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fb2b0002f70 tx=0x7fb2b0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:14.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.016+0000 7fb2ae7fc700 1 -- 172.21.15.62:0/3204690653 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2b0006b20 con 0x7fb2b8143120 2021-12-17T18:25:14.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.016+0000 7fb2ae7fc700 1 -- 172.21.15.62:0/3204690653 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b0013de0 con 0x7fb2b8143120 2021-12-17T18:25:14.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.016+0000 7fb2be3f4700 1 -- 172.21.15.62:0/3204690653 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b80ac7b0 con 0x7fb2b8143120 2021-12-17T18:25:14.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.016+0000 7fb2ae7fc700 1 -- 172.21.15.62:0/3204690653 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2b001e5f0 con 0x7fb2b8143120 2021-12-17T18:25:14.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.016+0000 7fb2be3f4700 1 -- 172.21.15.62:0/3204690653 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b80aca90 con 0x7fb2b8143120 2021-12-17T18:25:14.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.016+0000 7fb2ae7fc700 1 -- 172.21.15.62:0/3204690653 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb2b0025030 con 0x7fb2b8143120 2021-12-17T18:25:14.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.016+0000 7fb2be3f4700 1 -- 172.21.15.62:0/3204690653 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b8064fb0 con 0x7fb2b8143120 2021-12-17T18:25:14.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.016+0000 7fb2ae7fc700 1 --2- 172.21.15.62:0/3204690653 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2a0053610 0x7fb2a0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:14.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.016+0000 7fb2ae7fc700 1 -- 172.21.15.62:0/3204690653 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fb2b006c310 con 0x7fb2b8143120 2021-12-17T18:25:14.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.016+0000 7fb2bd3f2700 1 --2- 172.21.15.62:0/3204690653 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2a0053610 0x7fb2a0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:14.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.020+0000 7fb2bd3f2700 1 --2- 172.21.15.62:0/3204690653 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2a0053610 0x7fb2a0055ad0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fb2a800d000 tx=0x7fb2a8007a00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:14.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.024+0000 7fb2ae7fc700 1 -- 172.21.15.62:0/3204690653 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb2b8064fb0 con 0x7fb2b8143120 2021-12-17T18:25:14.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.192+0000 7fb2be3f4700 1 -- 172.21.15.62:0/3204690653 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7fb2b8064fb0 con 0x7fb2b8143120 2021-12-17T18:25:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.876+0000 7fb2ae7fc700 1 -- 172.21.15.62:0/3204690653 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v297) v1 ==== 129+0+0 (secure 0 0 0) 0x7fb2b8064fb0 con 0x7fb2b8143120 2021-12-17T18:25:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.880+0000 7fb2be3f4700 1 -- 172.21.15.62:0/3204690653 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2a0053610 msgr2=0x7fb2a0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:14.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.880+0000 7fb2be3f4700 1 --2- 172.21.15.62:0/3204690653 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2a0053610 0x7fb2a0055ad0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fb2a800d000 tx=0x7fb2a8007a00).stop 2021-12-17T18:25:14.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.880+0000 7fb2be3f4700 1 -- 172.21.15.62:0/3204690653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b8143120 msgr2=0x7fb2b8065ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:14.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.880+0000 7fb2be3f4700 1 --2- 172.21.15.62:0/3204690653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b8143120 0x7fb2b8065ae0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fb2b0002f70 tx=0x7fb2b0014000).stop 2021-12-17T18:25:14.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.880+0000 7fb2be3f4700 1 -- 172.21.15.62:0/3204690653 shutdown_connections 2021-12-17T18:25:14.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.880+0000 7fb2be3f4700 1 --2- 172.21.15.62:0/3204690653 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2a0053610 0x7fb2a0055ad0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:14.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.880+0000 7fb2be3f4700 1 --2- 172.21.15.62:0/3204690653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b8143120 0x7fb2b8065ae0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:14.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.880+0000 7fb2be3f4700 1 --2- 172.21.15.62:0/3204690653 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b80b1d60 0x7fb2b80655f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.880+0000 7fb2be3f4700 1 --2- 172.21.15.62:0/3204690653 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb2b80679a0 0x7fb2b80b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.880+0000 7fb2be3f4700 1 -- 172.21.15.62:0/3204690653 >> 172.21.15.62:0/3204690653 conn(0x7fb2b805caf0 msgr2=0x7fb2b805bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.880+0000 7fb2be3f4700 1 -- 172.21.15.62:0/3204690653 shutdown_connections 2021-12-17T18:25:14.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:14.880+0000 7fb2be3f4700 1 -- 172.21.15.62:0/3204690653 wait complete. 2021-12-17T18:25:14.904 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-12-17T18:25:15.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.012+0000 7ff214fab700 1 Processor -- start 2021-12-17T18:25:15.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.012+0000 7ff214fab700 1 -- start start 2021-12-17T18:25:15.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.012+0000 7ff214fab700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff21005ca90 0x7ff21014abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:15.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.012+0000 7ff214fab700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2100b2860 con 0x7ff2100b06b0 2021-12-17T18:25:15.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.012+0000 7ff214fab700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2100ad550 con 0x7ff2100604d0 2021-12-17T18:25:15.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.012+0000 7ff214fab700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2101475c0 con 0x7ff21005ca90 2021-12-17T18:25:15.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.012+0000 7ff20effd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff2100b06b0 0x7ff2100ace40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36304/0 (socket says 172.21.15.62:36304) 2021-12-17T18:25:15.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.012+0000 7ff20effd700 1 -- 172.21.15.62:0/2024522197 learned_addr learned my addr 172.21.15.62:0/2024522197 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:15.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.012+0000 7ff20f7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff21005ca90 0x7ff21014abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:15.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.012+0000 7ff20e7fc700 1 -- 172.21.15.62:0/2024522197 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853288105 0 0) 0x7ff2100b2860 con 0x7ff2100b06b0 2021-12-17T18:25:15.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.012+0000 7ff20e7fc700 1 -- 172.21.15.62:0/2024522197 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1fc003260 con 0x7ff2100b06b0 2021-12-17T18:25:15.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.016+0000 7ff20f7fe700 1 -- 172.21.15.62:0/2024522197 >> v1:172.21.15.109:6789/0 conn(0x7ff2100604d0 legacy=0x7ff210146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:15.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.016+0000 7ff20f7fe700 1 -- 172.21.15.62:0/2024522197 >> v1:172.21.15.62:6789/0 conn(0x7ff2100b06b0 legacy=0x7ff2100ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:15.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.016+0000 7ff20f7fe700 1 -- 172.21.15.62:0/2024522197 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100ac740 con 0x7ff21005ca90 2021-12-17T18:25:15.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.016+0000 7ff20f7fe700 1 --2- 172.21.15.62:0/2024522197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff21005ca90 0x7ff21014abf0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7ff204002f70 tx=0x7ff204006df0).ready entity=mon.0 client_cookie=d354ae2c6b9e87a0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:15.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.016+0000 7ff20e7fc700 1 -- 172.21.15.62:0/2024522197 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff20400d610 con 0x7ff21005ca90 2021-12-17T18:25:15.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.016+0000 7ff20e7fc700 1 -- 172.21.15.62:0/2024522197 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff204000e90 con 0x7ff21005ca90 2021-12-17T18:25:15.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.016+0000 7ff20e7fc700 1 -- 172.21.15.62:0/2024522197 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff20400d960 con 0x7ff21005ca90 2021-12-17T18:25:15.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.016+0000 7ff214fab700 1 -- 172.21.15.62:0/2024522197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff21005ca90 msgr2=0x7ff21014abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:15.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.016+0000 7ff214fab700 1 --2- 172.21.15.62:0/2024522197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff21005ca90 0x7ff21014abf0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7ff204002f70 tx=0x7ff204006df0).stop 2021-12-17T18:25:15.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.016+0000 7ff214fab700 1 -- 172.21.15.62:0/2024522197 shutdown_connections 2021-12-17T18:25:15.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.016+0000 7ff214fab700 1 --2- 172.21.15.62:0/2024522197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff21005ca90 0x7ff21014abf0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.016+0000 7ff214fab700 1 -- 172.21.15.62:0/2024522197 >> 172.21.15.62:0/2024522197 conn(0x7ff21005c070 msgr2=0x7ff210062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:15.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.016+0000 7ff214fab700 1 -- 172.21.15.62:0/2024522197 shutdown_connections 2021-12-17T18:25:15.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.016+0000 7ff214fab700 1 -- 172.21.15.62:0/2024522197 wait complete. 2021-12-17T18:25:15.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff214fab700 1 Processor -- start 2021-12-17T18:25:15.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff214fab700 1 -- start start 2021-12-17T18:25:15.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff214fab700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff21005ca90 0x7ff21015a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:15.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff214fab700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff2100604d0 0x7ff2101421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:15.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff214fab700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2100b06b0 0x7ff21009eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:15.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff214fab700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21015ac00 con 0x7ff2100b06b0 2021-12-17T18:25:15.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff214fab700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff210063a10 con 0x7ff2100604d0 2021-12-17T18:25:15.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff214fab700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff210063cb0 con 0x7ff21005ca90 2021-12-17T18:25:15.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff20ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2100b06b0 0x7ff21009eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:15.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff20ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2100b06b0 0x7ff21009eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52732/0 (socket says 172.21.15.62:52732) 2021-12-17T18:25:15.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff20ffff700 1 -- 172.21.15.62:0/3625737444 learned_addr learned my addr 172.21.15.62:0/3625737444 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:15.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff20effd700 1 --2- 172.21.15.62:0/3625737444 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff2100604d0 0x7ff2101421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:15.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff20f7fe700 1 --2- 172.21.15.62:0/3625737444 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff21005ca90 0x7ff21015a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:15.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff20ffff700 1 -- 172.21.15.62:0/3625737444 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff21005ca90 msgr2=0x7ff21015a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:15.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff20ffff700 1 --2- 172.21.15.62:0/3625737444 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff21005ca90 0x7ff21015a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff20ffff700 1 -- 172.21.15.62:0/3625737444 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff2100604d0 msgr2=0x7ff2101421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:15.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff20ffff700 1 --2- 172.21.15.62:0/3625737444 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff2100604d0 0x7ff2101421a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff20ffff700 1 -- 172.21.15.62:0/3625737444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20400b180 con 0x7ff2100b06b0 2021-12-17T18:25:15.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff20f7fe700 1 --2- 172.21.15.62:0/3625737444 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff21005ca90 0x7ff21015a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:15.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff20ffff700 1 --2- 172.21.15.62:0/3625737444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2100b06b0 0x7ff21009eb60 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7ff21005d1f0 tx=0x7ff208007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:15.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.020+0000 7ff20cff9700 1 -- 172.21.15.62:0/3625737444 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff20800e4a0 con 0x7ff2100b06b0 2021-12-17T18:25:15.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.024+0000 7ff20cff9700 1 -- 172.21.15.62:0/3625737444 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20800e600 con 0x7ff2100b06b0 2021-12-17T18:25:15.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.024+0000 7ff214fab700 1 -- 172.21.15.62:0/3625737444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff210142690 con 0x7ff2100b06b0 2021-12-17T18:25:15.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.024+0000 7ff20cff9700 1 -- 172.21.15.62:0/3625737444 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff20800e960 con 0x7ff2100b06b0 2021-12-17T18:25:15.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.024+0000 7ff214fab700 1 -- 172.21.15.62:0/3625737444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21009f270 con 0x7ff2100b06b0 2021-12-17T18:25:15.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.024+0000 7ff20cff9700 1 -- 172.21.15.62:0/3625737444 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff208019030 con 0x7ff2100b06b0 2021-12-17T18:25:15.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.024+0000 7ff214fab700 1 -- 172.21.15.62:0/3625737444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2100b2a90 con 0x7ff2100b06b0 2021-12-17T18:25:15.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.024+0000 7ff20cff9700 1 --2- 172.21.15.62:0/3625737444 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff1f00536a0 0x7ff1f0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:15.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.024+0000 7ff20cff9700 1 -- 172.21.15.62:0/3625737444 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ff20806aea0 con 0x7ff2100b06b0 2021-12-17T18:25:15.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.024+0000 7ff20f7fe700 1 --2- 172.21.15.62:0/3625737444 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff1f00536a0 0x7ff1f0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:15.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.028+0000 7ff20f7fe700 1 --2- 172.21.15.62:0/3625737444 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff1f00536a0 0x7ff1f0055b60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7ff204018000 tx=0x7ff204014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:15.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.028+0000 7ff20cff9700 1 -- 172.21.15.62:0/3625737444 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff208042120 con 0x7ff2100b06b0 2021-12-17T18:25:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.160+0000 7ff214fab700 1 -- 172.21.15.62:0/3625737444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff2100573d0 con 0x7ff2100b06b0 2021-12-17T18:25:15.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.168+0000 7ff20cff9700 1 -- 172.21.15.62:0/3625737444 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff208045740 con 0x7ff2100b06b0 2021-12-17T18:25:15.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.168+0000 7ff214fab700 1 -- 172.21.15.62:0/3625737444 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff1f00536a0 msgr2=0x7ff1f0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:15.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.168+0000 7ff214fab700 1 --2- 172.21.15.62:0/3625737444 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff1f00536a0 0x7ff1f0055b60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7ff204018000 tx=0x7ff204014000).stop 2021-12-17T18:25:15.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.168+0000 7ff214fab700 1 -- 172.21.15.62:0/3625737444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2100b06b0 msgr2=0x7ff21009eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:15.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.168+0000 7ff214fab700 1 --2- 172.21.15.62:0/3625737444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2100b06b0 0x7ff21009eb60 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7ff21005d1f0 tx=0x7ff208007f40).stop 2021-12-17T18:25:15.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.168+0000 7ff214fab700 1 -- 172.21.15.62:0/3625737444 shutdown_connections 2021-12-17T18:25:15.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.168+0000 7ff214fab700 1 --2- 172.21.15.62:0/3625737444 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff1f00536a0 0x7ff1f0055b60 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.168+0000 7ff214fab700 1 --2- 172.21.15.62:0/3625737444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2100b06b0 0x7ff21009eb60 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.168+0000 7ff214fab700 1 --2- 172.21.15.62:0/3625737444 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff2100604d0 0x7ff2101421a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.168+0000 7ff214fab700 1 --2- 172.21.15.62:0/3625737444 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff21005ca90 0x7ff21015a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.168+0000 7ff214fab700 1 -- 172.21.15.62:0/3625737444 >> 172.21.15.62:0/3625737444 conn(0x7ff21005c070 msgr2=0x7ff2101482b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:15.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.168+0000 7ff214fab700 1 -- 172.21.15.62:0/3625737444 shutdown_connections 2021-12-17T18:25:15.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.168+0000 7ff214fab700 1 -- 172.21.15.62:0/3625737444 wait complete. 2021-12-17T18:25:15.187 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:25:15.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:15.202 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:15.225 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:15.247 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:15.269 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:15.290 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:25:15.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:15.291 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:15.291 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:15.298 INFO:teuthology.orchestra.run.smithi125.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-12-17T18:25:15.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:25:15.300 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-12-17T18:25:15.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:15.301 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:15.301 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:15.309 INFO:teuthology.orchestra.run.smithi158.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:25:15.309 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:25:15.310 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-12-17T18:25:15.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:15.311 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:15.311 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:25:15.318 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:25:15.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:25:15.319 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:25:15.320 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:25:15.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.424+0000 7ff028acd700 1 Processor -- start 2021-12-17T18:25:15.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.424+0000 7ff028acd700 1 -- start start 2021-12-17T18:25:15.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.424+0000 7ff028acd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff024141480 0x7ff024147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:15.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.424+0000 7ff028acd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff0240a8e10 0x7ff0240b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:15.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.424+0000 7ff028acd700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff024147610 con 0x7ff0240b6050 2021-12-17T18:25:15.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.424+0000 7ff028acd700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0241478b0 con 0x7ff0240a8e10 2021-12-17T18:25:15.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.424+0000 7ff028acd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff024147b50 con 0x7ff024141480 2021-12-17T18:25:15.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff022ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff0240a8e10 0x7ff0240b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:15.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff023fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff0240b6050 0x7ff0240a7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36320/0 (socket says 172.21.15.62:36320) 2021-12-17T18:25:15.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff023fff700 1 -- 172.21.15.62:0/3135101834 learned_addr learned my addr 172.21.15.62:0/3135101834 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:15.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff0237fe700 1 --2- 172.21.15.62:0/3135101834 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff024141480 0x7ff024147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:15.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff0227fc700 1 -- 172.21.15.62:0/3135101834 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629338283 0 0) 0x7ff024147610 con 0x7ff0240b6050 2021-12-17T18:25:15.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff0227fc700 1 -- 172.21.15.62:0/3135101834 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff010003260 con 0x7ff0240b6050 2021-12-17T18:25:15.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff022ffd700 1 -- 172.21.15.62:0/3135101834 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff024141480 msgr2=0x7ff024147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:15.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff0227fc700 1 -- 172.21.15.62:0/3135101834 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2669937924 0 0) 0x7ff010003260 con 0x7ff0240b6050 2021-12-17T18:25:15.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff022ffd700 1 --2- 172.21.15.62:0/3135101834 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff024141480 0x7ff024147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff022ffd700 1 -- 172.21.15.62:0/3135101834 >> v1:172.21.15.62:6789/0 conn(0x7ff0240b6050 legacy=0x7ff0240a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff022ffd700 1 -- 172.21.15.62:0/3135101834 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0240b1b90 con 0x7ff0240a8e10 2021-12-17T18:25:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff022ffd700 1 --2- 172.21.15.62:0/3135101834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0240a8e10 0x7ff0240b5b60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7ff01c001800 tx=0x7ff0140091d0).ready entity=mon.0 client_cookie=f455db0f0fedcc19 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff0227fc700 1 -- 172.21.15.62:0/3135101834 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff01c001660 con 0x7ff0240a8e10 2021-12-17T18:25:15.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff0227fc700 1 -- 172.21.15.62:0/3135101834 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01400f510 con 0x7ff0240a8e10 2021-12-17T18:25:15.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff0227fc700 1 -- 172.21.15.62:0/3135101834 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff01400f680 con 0x7ff0240a8e10 2021-12-17T18:25:15.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff028acd700 1 -- 172.21.15.62:0/3135101834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0240a8e10 msgr2=0x7ff0240b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:15.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff028acd700 1 --2- 172.21.15.62:0/3135101834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0240a8e10 0x7ff0240b5b60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7ff01c001800 tx=0x7ff0140091d0).stop 2021-12-17T18:25:15.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff028acd700 1 -- 172.21.15.62:0/3135101834 shutdown_connections 2021-12-17T18:25:15.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff028acd700 1 --2- 172.21.15.62:0/3135101834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0240a8e10 0x7ff0240b5b60 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff028acd700 1 --2- 172.21.15.62:0/3135101834 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff024141480 0x7ff024147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff028acd700 1 -- 172.21.15.62:0/3135101834 >> 172.21.15.62:0/3135101834 conn(0x7ff02405d220 msgr2=0x7ff0240b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:15.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff028acd700 1 -- 172.21.15.62:0/3135101834 shutdown_connections 2021-12-17T18:25:15.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.428+0000 7ff028acd700 1 -- 172.21.15.62:0/3135101834 wait complete. 2021-12-17T18:25:15.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.432+0000 7ff028acd700 1 Processor -- start 2021-12-17T18:25:15.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.432+0000 7ff028acd700 1 -- start start 2021-12-17T18:25:15.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.432+0000 7ff028acd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0240a8e10 0x7ff02414aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:15.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.432+0000 7ff028acd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0240b6050 0x7ff0240addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:15.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.432+0000 7ff028acd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff024141480 0x7ff02415a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:15.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.432+0000 7ff028acd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff024148d30 con 0x7ff0240b6050 2021-12-17T18:25:15.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.432+0000 7ff028acd700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff024148fd0 con 0x7ff0240a8e10 2021-12-17T18:25:15.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.432+0000 7ff028acd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff024149270 con 0x7ff024141480 2021-12-17T18:25:15.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.432+0000 7ff022ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0240b6050 0x7ff0240addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:15.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.432+0000 7ff022ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0240b6050 0x7ff0240addd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52744/0 (socket says 172.21.15.62:52744) 2021-12-17T18:25:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.432+0000 7ff0237fe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0240a8e10 0x7ff02414aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.432+0000 7ff022ffd700 1 -- 172.21.15.62:0/2323901660 learned_addr learned my addr 172.21.15.62:0/2323901660 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.432+0000 7ff023fff700 1 --2- 172.21.15.62:0/2323901660 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff024141480 0x7ff02415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.436+0000 7ff0237fe700 1 -- 172.21.15.62:0/2323901660 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff024141480 msgr2=0x7ff02415a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.436+0000 7ff0237fe700 1 --2- 172.21.15.62:0/2323901660 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff024141480 0x7ff02415a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.436+0000 7ff0237fe700 1 -- 172.21.15.62:0/2323901660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0240b6050 msgr2=0x7ff0240addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.436+0000 7ff0237fe700 1 --2- 172.21.15.62:0/2323901660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0240b6050 0x7ff0240addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.436+0000 7ff0237fe700 1 -- 172.21.15.62:0/2323901660 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff014009470 con 0x7ff0240a8e10 2021-12-17T18:25:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.436+0000 7ff022ffd700 1 --2- 172.21.15.62:0/2323901660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0240b6050 0x7ff0240addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:15.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.436+0000 7ff023fff700 1 --2- 172.21.15.62:0/2323901660 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff024141480 0x7ff02415a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:15.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.436+0000 7ff0237fe700 1 --2- 172.21.15.62:0/2323901660 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0240a8e10 0x7ff02414aa20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7ff01800c000 tx=0x7ff018006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:15.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.436+0000 7ff020ff9700 1 -- 172.21.15.62:0/2323901660 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff018011750 con 0x7ff0240a8e10 2021-12-17T18:25:15.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.436+0000 7ff020ff9700 1 -- 172.21.15.62:0/2323901660 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0180118b0 con 0x7ff0240a8e10 2021-12-17T18:25:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.436+0000 7ff020ff9700 1 -- 172.21.15.62:0/2323901660 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff018011c10 con 0x7ff0240a8e10 2021-12-17T18:25:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.436+0000 7ff028acd700 1 -- 172.21.15.62:0/2323901660 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff024156e70 con 0x7ff0240a8e10 2021-12-17T18:25:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.436+0000 7ff028acd700 1 -- 172.21.15.62:0/2323901660 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02414b410 con 0x7ff0240a8e10 2021-12-17T18:25:15.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.436+0000 7ff028acd700 1 -- 172.21.15.62:0/2323901660 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff024141860 con 0x7ff0240a8e10 2021-12-17T18:25:15.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.436+0000 7ff020ff9700 1 -- 172.21.15.62:0/2323901660 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff018011d70 con 0x7ff0240a8e10 2021-12-17T18:25:15.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.440+0000 7ff020ff9700 1 --2- 172.21.15.62:0/2323901660 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff004053610 0x7ff004055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:15.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.440+0000 7ff020ff9700 1 -- 172.21.15.62:0/2323901660 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ff01806ba90 con 0x7ff0240a8e10 2021-12-17T18:25:15.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.440+0000 7ff022ffd700 1 --2- 172.21.15.62:0/2323901660 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff004053610 0x7ff004055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:15.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.440+0000 7ff022ffd700 1 --2- 172.21.15.62:0/2323901660 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff004053610 0x7ff004055ad0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7ff01401b000 tx=0x7ff014016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.448+0000 7ff020ff9700 1 -- 172.21.15.62:0/2323901660 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff018042d30 con 0x7ff0240a8e10 2021-12-17T18:25:15.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.576+0000 7ff028acd700 1 -- 172.21.15.62:0/2323901660 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff0240573d0 con 0x7ff0240a8e10 2021-12-17T18:25:15.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.580+0000 7ff020ff9700 1 -- 172.21.15.62:0/2323901660 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v75) v1 ==== 81+0+28946 (secure 0 0 0) 0x7ff018046350 con 0x7ff0240a8e10 2021-12-17T18:25:15.586 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:15.586 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:25:15.586 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 75, 2021-12-17T18:25:15.586 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:25:15.587 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:25:15.587 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:25:12.857888+0000", 2021-12-17T18:25:15.587 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:25:15.587 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:25:15.588 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:25:15.588 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:25:15.588 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:25:15.588 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:25:15.589 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:25:15.589 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:25:15.589 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:25:15.589 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:15.590 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:25:15.590 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:25:15.590 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:25:15.590 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:25:15.591 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:25:15.591 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 14, 2021-12-17T18:25:15.591 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:25:15.591 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:25:15.592 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:25:15.592 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:25:15.592 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:25:15.592 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.592 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:25:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:25:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:25:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:25:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:25:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:25:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:25:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:25:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:25:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:25:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:25:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:25:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:25:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:25:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:25:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:25:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:25:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:25:15.597 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:25:15.597 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:25:15.597 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:25:15.597 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:25:15.597 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:25:15.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.598 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:25:15.598 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:25:15.598 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:25:15.599 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:25:15.599 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:25:15.599 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:25:15.599 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:25:15.600 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:25:15.600 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:25:15.600 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:25:15.600 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:25:15.600 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:25:15.601 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:25:15.601 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:25:15.601 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:25:15.601 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:25:15.602 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:25:15.602 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:25:15.602 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:25:15.602 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:25:15.603 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:25:15.603 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:25:15.603 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:25:15.603 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:25:15.604 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:25:15.604 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:25:15.604 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:25:15.604 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.604 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:25:15.605 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:25:15.605 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:25:15.605 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:25:15.605 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:25:15.606 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:25:15.606 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:25:15.606 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:25:15.606 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:25:15.607 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:25:15.607 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:25:15.607 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:25:15.607 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:25:15.608 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.608 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:25:15.608 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:25:15.608 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.609 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:25:15.609 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:25:15.610 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:25:15.610 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:25:15.610 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:25:15.610 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:25:15.611 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:25:15.611 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:25:15.611 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:25:15.611 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:25:15.612 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:25:15.612 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:25:15.612 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:25:15.612 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:25:15.613 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:25:15.613 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:25:15.613 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:25:15.613 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:25:15.614 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:25:15.614 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:25:15.614 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:25:15.614 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:25:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:25:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:25:15.616 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:25:15.616 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:25:15.616 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:25:15.617 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:25:15.617 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:25:15.617 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:25:15.617 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:25:15.617 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:25:15.618 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:25:15.618 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:25:15.618 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:25:15.618 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:25:15.619 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:25:15.619 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:25:15.619 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:25:15.619 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:25:15.620 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:25:15.620 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:25:15.620 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:25:15.620 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:25:15.620 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:25:15.621 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:25:15.621 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:25:15.621 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:25:15.621 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:25:15.622 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:25:15.622 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.622 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:25:15.622 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:25:15.622 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:25:15.623 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:25:15.623 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:25:15.623 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:25:15.623 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:25:15.624 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:25:15.624 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:25:15.624 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:25:15.624 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:25:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:25:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:25:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:25:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.626 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:15.626 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:25:15.626 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.626 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:25:15.627 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:25:15.627 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:15.627 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:15.627 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:15.628 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:15.628 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:15.628 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:15.628 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:15.629 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 69, 2021-12-17T18:25:15.629 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:15.629 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:15.629 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:15.630 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.630 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.630 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.630 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:25:15.631 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:15.631 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.631 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.631 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.632 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:25:15.632 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:15.632 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.632 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.633 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.633 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:15.633 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.633 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.633 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.634 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:25:15.634 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:15.634 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.634 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.635 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.635 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:25:15.635 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:15.635 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.635 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.636 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.636 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:15.636 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.636 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.637 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.637 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:25:15.637 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:15.637 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.638 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.638 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.638 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:25:15.638 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:15.638 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.639 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.639 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.639 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:15.639 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.640 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.640 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.640 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:25:15.640 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:15.640 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.641 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.641 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.641 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:25:15.641 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:15.642 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.642 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.642 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.642 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:25:15.643 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:25:15.643 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:25:15.643 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:25:15.643 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:15.644 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:15.644 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:15.644 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.644 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.644 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.645 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:25:15.645 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:25:15.645 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:15.645 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:15.646 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:15.646 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:15.646 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:15.646 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:15.647 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:15.647 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 59, 2021-12-17T18:25:15.647 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:15.647 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:15.647 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:15.648 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.648 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.648 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.648 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:25:15.649 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:15.649 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.649 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.649 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.649 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:25:15.650 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:15.650 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.650 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.650 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.651 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:15.651 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.651 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.651 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.651 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:25:15.652 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:15.652 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.652 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.652 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.653 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:25:15.653 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:15.653 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.653 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.653 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.654 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:15.654 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.654 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.654 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.655 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:25:15.655 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:15.655 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.655 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.656 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.656 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:25:15.656 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:15.656 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.657 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.657 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.657 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:15.657 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.658 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.658 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.658 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:25:15.658 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:15.658 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.659 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.659 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.659 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:25:15.659 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:15.660 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.660 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.660 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.660 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:25:15.661 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:25:15.661 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:25:15.661 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:25:15.661 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:15.661 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:15.662 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:15.662 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.662 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.662 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.663 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:25:15.663 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:25:15.663 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:15.663 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:15.663 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:15.664 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:15.664 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:15.664 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:15.664 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:15.665 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 69, 2021-12-17T18:25:15.665 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:15.665 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:15.665 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:15.665 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.666 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.666 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.666 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:25:15.666 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:15.667 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.667 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.667 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.667 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:25:15.667 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:15.668 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.668 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.668 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.669 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:15.669 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.669 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.669 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.670 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:25:15.670 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:15.670 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.670 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.671 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.671 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:25:15.671 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:15.671 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.671 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.672 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.672 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:15.672 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.672 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.673 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.673 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:25:15.673 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:15.673 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.673 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.674 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.674 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:25:15.674 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:15.674 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:25:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:25:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.678 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.678 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.678 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:25:15.678 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:25:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:25:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:25:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:15.680 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.680 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.680 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.680 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:25:15.681 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:25:15.681 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:15.681 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:15.681 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:15.681 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:15.682 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:15.682 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:15.682 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:15.682 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 69, 2021-12-17T18:25:15.683 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:15.683 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:15.683 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:15.683 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.684 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.684 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.684 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:25:15.684 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:15.685 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.685 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.685 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.685 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:25:15.685 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:15.686 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.686 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.686 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.686 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:15.687 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.687 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.687 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.687 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:25:15.687 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:15.688 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.688 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.688 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.688 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:25:15.689 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:15.689 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.689 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.689 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.689 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:15.690 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.690 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.690 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.690 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:25:15.691 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:15.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.691 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.691 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:25:15.692 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:15.692 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.692 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.692 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.693 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:15.693 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.693 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.693 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.693 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:25:15.694 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:15.694 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.694 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.694 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:25:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:25:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:25:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:25:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:25:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:25:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:25:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 68, 2021-12-17T18:25:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:25:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:25:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:25:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:25:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:25:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:15.709 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.709 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.709 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.709 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:25:15.710 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:15.710 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.710 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.710 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.711 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:15.711 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.711 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.711 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.711 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:25:15.712 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:15.712 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.712 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.712 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.713 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:25:15.713 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:15.713 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.713 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.713 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.714 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:25:15.714 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:25:15.714 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:25:15.714 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:25:15.715 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:15.715 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:15.715 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:15.715 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.715 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.716 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.716 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:25:15.716 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:25:15.716 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:15.717 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:15.717 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:15.717 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:15.717 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:15.718 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:15.718 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:15.718 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 69, 2021-12-17T18:25:15.718 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:15.718 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:15.719 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:15.719 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.719 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.719 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.720 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:25:15.720 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:15.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.720 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.720 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.721 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:25:15.721 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:15.721 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.721 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.722 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.722 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:15.722 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.722 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.723 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.723 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:25:15.723 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:15.723 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.724 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.724 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.724 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:25:15.724 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:15.725 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.725 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.725 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:15.725 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.726 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.726 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.726 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:25:15.726 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:15.727 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.727 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.727 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.727 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:25:15.727 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:15.729 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.729 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.729 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.729 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:25:15.729 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:15.730 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.730 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.730 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.730 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:25:15.731 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:15.731 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.731 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.731 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.731 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:25:15.732 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:25:15.732 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:25:15.732 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:25:15.732 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:15.733 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:15.733 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:15.733 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.733 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.733 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.734 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:25:15.734 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:25:15.734 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:15.734 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:15.735 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:15.735 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:15.735 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:15.735 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:15.735 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:15.736 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 69, 2021-12-17T18:25:15.736 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:15.736 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:15.737 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:15.737 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.737 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.737 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.737 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:25:15.738 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:15.738 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.738 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.738 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.739 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:25:15.739 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:15.739 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.739 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.739 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.740 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:15.740 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.740 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.740 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.741 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:25:15.741 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:15.741 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.741 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.741 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.742 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:25:15.742 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:15.742 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.742 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.743 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.743 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:15.743 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.743 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.744 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.744 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:25:15.744 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:15.744 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.744 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.745 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.745 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:25:15.745 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:15.745 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.746 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.746 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.746 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:15.746 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.746 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.747 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.747 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:25:15.747 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:15.747 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.748 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.748 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.748 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:25:15.748 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:15.749 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.749 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.749 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.749 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:25:15.750 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:25:15.750 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:25:15.750 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:25:15.750 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:15.751 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:15.751 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:15.751 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.751 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.751 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.752 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:25:15.752 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:25:15.752 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:15.752 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:15.753 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:15.753 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:15.753 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:15.753 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:15.753 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:15.754 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 69, 2021-12-17T18:25:15.754 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:15.754 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:15.754 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:15.755 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.755 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.755 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.755 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:25:15.755 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:25:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:25:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.760 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.760 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:25:15.760 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:15.760 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.761 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.761 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.761 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:15.761 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.761 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.762 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.762 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:25:15.762 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:15.762 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.763 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.763 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.763 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:25:15.763 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:15.764 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.764 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.764 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.764 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:15.764 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:15.765 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.765 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:15.765 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:25:15.765 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:15.766 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.766 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.766 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:15.766 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:25:15.767 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:15.767 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.767 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.767 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.767 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:25:15.768 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:25:15.768 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:25:15.768 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:25:15.768 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:15.769 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:15.769 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:15.769 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:15.769 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.769 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:15.770 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:25:15.770 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.770 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:25:15.770 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:15.771 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:15.771 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:15.771 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:15.771 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:15.771 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:25:15.772 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:15.772 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.772 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.772 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:25:15.773 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:15.773 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:15.773 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:15.773 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:15.773 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:15.774 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:25:15.774 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:15.774 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.774 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.775 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:25:15.775 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:15.775 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:15.775 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:15.776 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:15.776 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:15.776 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:25:15.776 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:15.777 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.777 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.777 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:25:15.777 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:15.777 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:15.778 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:15.778 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:15.778 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:15.778 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:25:15.779 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:15.779 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.779 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.779 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:25:15.780 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:15.780 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:15.780 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:15.780 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:15.781 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:15.781 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:25:15.781 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:15.781 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.781 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.782 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:25:15.782 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:15.782 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:15.782 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:15.783 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:15.783 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:15.783 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:25:15.783 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:15.783 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.784 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.784 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:25:15.784 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:15.784 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:15.785 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:15.785 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:15.785 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:15.785 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:25:15.785 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:15.786 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.786 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:15.786 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:25:15.786 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:15.787 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:15.787 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:15.787 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:15.787 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:15.787 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:25:15.788 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:15.788 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.788 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:15.788 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:25:15.789 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:25:15.789 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:25:15.789 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:25:15.789 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": { 2021-12-17T18:25:15.790 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6833/414220193": "2021-12-18T18:25:09.251804+0000", 2021-12-17T18:25:15.790 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6832/414220193": "2021-12-18T18:25:09.251804+0000", 2021-12-17T18:25:15.790 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.125:0/479948347": "2021-12-17T19:24:57.482027+0000" 2021-12-17T18:25:15.790 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.791 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:25:15.791 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:25:15.791 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:25:15.791 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:25:15.791 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:25:15.792 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:25:15.792 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:25:15.792 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:25:15.792 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:15.793 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:15.793 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:25:15.793 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:25:15.793 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:25:15.793 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:25:15.794 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:25:15.794 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:25:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.584+0000 7ff028acd700 1 -- 172.21.15.62:0/2323901660 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff004053610 msgr2=0x7ff004055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.584+0000 7ff028acd700 1 --2- 172.21.15.62:0/2323901660 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff004053610 0x7ff004055ad0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7ff01401b000 tx=0x7ff014016000).stop 2021-12-17T18:25:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.584+0000 7ff028acd700 1 -- 172.21.15.62:0/2323901660 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0240a8e10 msgr2=0x7ff02414aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.584+0000 7ff028acd700 1 --2- 172.21.15.62:0/2323901660 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0240a8e10 0x7ff02414aa20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7ff01800c000 tx=0x7ff018006df0).stop 2021-12-17T18:25:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.584+0000 7ff028acd700 1 -- 172.21.15.62:0/2323901660 shutdown_connections 2021-12-17T18:25:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.584+0000 7ff028acd700 1 --2- 172.21.15.62:0/2323901660 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff004053610 0x7ff004055ad0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.584+0000 7ff028acd700 1 --2- 172.21.15.62:0/2323901660 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff024141480 0x7ff02415a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.584+0000 7ff028acd700 1 --2- 172.21.15.62:0/2323901660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0240b6050 0x7ff0240addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.584+0000 7ff028acd700 1 --2- 172.21.15.62:0/2323901660 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0240a8e10 0x7ff02414aa20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.584+0000 7ff028acd700 1 -- 172.21.15.62:0/2323901660 >> 172.21.15.62:0/2323901660 conn(0x7ff02405d220 msgr2=0x7ff0240b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.584+0000 7ff028acd700 1 -- 172.21.15.62:0/2323901660 shutdown_connections 2021-12-17T18:25:15.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.584+0000 7ff028acd700 1 -- 172.21.15.62:0/2323901660 wait complete. 2021-12-17T18:25:15.800 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:15.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.908+0000 7f4a7ab79700 1 Processor -- start 2021-12-17T18:25:15.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.908+0000 7f4a7ab79700 1 -- start start 2021-12-17T18:25:15.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a7ab79700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4a740b5b20 0x7f4a740b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:15.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a7ab79700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f4a740b3760 0x7f4a740b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:15.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a7ab79700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a740b5f00 con 0x7f4a740b6c70 2021-12-17T18:25:15.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a7ab79700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a740b3020 con 0x7f4a740b5b20 2021-12-17T18:25:15.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a7ab79700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a740b32c0 con 0x7f4a740b3760 2021-12-17T18:25:15.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a79b77700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4a740b5b20 0x7f4a740b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:15.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a79b77700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4a740b5b20 0x7f4a740b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52752/0 (socket says 172.21.15.62:52752) 2021-12-17T18:25:15.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a79b77700 1 -- 172.21.15.62:0/670572505 learned_addr learned my addr 172.21.15.62:0/670572505 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:15.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a79376700 1 --2- 172.21.15.62:0/670572505 >> v2:172.21.15.109:3300/0 conn(0x7f4a740b3760 0x7f4a740b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:15.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a79b77700 1 -- 172.21.15.62:0/670572505 >> v2:172.21.15.109:3300/0 conn(0x7f4a740b3760 msgr2=0x7f4a740b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:15.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a79b77700 1 --2- 172.21.15.62:0/670572505 >> v2:172.21.15.109:3300/0 conn(0x7f4a740b3760 0x7f4a740b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a79b77700 1 -- 172.21.15.62:0/670572505 >> v1:172.21.15.109:6789/0 conn(0x7f4a740b6c70 legacy=0x7f4a74146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:15.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a79b77700 1 -- 172.21.15.62:0/670572505 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a740b5440 con 0x7f4a740b5b20 2021-12-17T18:25:15.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a79376700 1 --2- 172.21.15.62:0/670572505 >> v2:172.21.15.109:3300/0 conn(0x7f4a740b3760 0x7f4a740b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:15.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a79b77700 1 --2- 172.21.15.62:0/670572505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a740b5b20 0x7f4a740b6290 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f4a70002f70 tx=0x7f4a70006eb0).ready entity=mon.0 client_cookie=f82315d8ae562c64 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:15.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a78b75700 1 -- 172.21.15.62:0/670572505 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a7000d610 con 0x7f4a740b5b20 2021-12-17T18:25:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a78b75700 1 -- 172.21.15.62:0/670572505 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a70000e90 con 0x7f4a740b5b20 2021-12-17T18:25:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a78b75700 1 -- 172.21.15.62:0/670572505 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a7000d9a0 con 0x7f4a740b5b20 2021-12-17T18:25:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a7ab79700 1 -- 172.21.15.62:0/670572505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a740b5b20 msgr2=0x7f4a740b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:15.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a7ab79700 1 --2- 172.21.15.62:0/670572505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a740b5b20 0x7f4a740b6290 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f4a70002f70 tx=0x7f4a70006eb0).stop 2021-12-17T18:25:15.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a7ab79700 1 -- 172.21.15.62:0/670572505 shutdown_connections 2021-12-17T18:25:15.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a7ab79700 1 --2- 172.21.15.62:0/670572505 >> v2:172.21.15.109:3300/0 conn(0x7f4a740b3760 0x7f4a740b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a7ab79700 1 --2- 172.21.15.62:0/670572505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a740b5b20 0x7f4a740b6290 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a7ab79700 1 -- 172.21.15.62:0/670572505 >> 172.21.15.62:0/670572505 conn(0x7f4a7405c750 msgr2=0x7f4a7405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:15.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a7ab79700 1 -- 172.21.15.62:0/670572505 shutdown_connections 2021-12-17T18:25:15.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.912+0000 7f4a7ab79700 1 -- 172.21.15.62:0/670572505 wait complete. 2021-12-17T18:25:15.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a7ab79700 1 Processor -- start 2021-12-17T18:25:15.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a7ab79700 1 -- start start 2021-12-17T18:25:15.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a7ab79700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4a740b5b20 0x7f4a740af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:15.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a7ab79700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a740b6c70 0x7f4a74142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:15.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a7ab79700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4a74149030 0x7f4a74152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:15.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a7ab79700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74143040 con 0x7f4a740b6c70 2021-12-17T18:25:15.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a7ab79700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74143290 con 0x7f4a74149030 2021-12-17T18:25:15.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a7ab79700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74143530 con 0x7f4a740b5b20 2021-12-17T18:25:15.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a79376700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a740b6c70 0x7f4a74142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:15.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a79b77700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4a740b5b20 0x7f4a740af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:15.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a79376700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a740b6c70 0x7f4a74142b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52758/0 (socket says 172.21.15.62:52758) 2021-12-17T18:25:15.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a79376700 1 -- 172.21.15.62:0/1949643624 learned_addr learned my addr 172.21.15.62:0/1949643624 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:15.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a7a378700 1 --2- 172.21.15.62:0/1949643624 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4a74149030 0x7f4a74152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:15.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a79376700 1 -- 172.21.15.62:0/1949643624 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4a740b5b20 msgr2=0x7f4a740af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:15.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a79376700 1 --2- 172.21.15.62:0/1949643624 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4a740b5b20 0x7f4a740af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a79376700 1 -- 172.21.15.62:0/1949643624 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4a74149030 msgr2=0x7f4a74152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:15.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a79376700 1 --2- 172.21.15.62:0/1949643624 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4a74149030 0x7f4a74152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:15.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.916+0000 7f4a79376700 1 -- 172.21.15.62:0/1949643624 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7000b1e0 con 0x7f4a740b6c70 2021-12-17T18:25:15.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.920+0000 7f4a79376700 1 --2- 172.21.15.62:0/1949643624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a740b6c70 0x7f4a74142b50 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f4a6800a000 tx=0x7f4a68008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:15.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.920+0000 7f4a66ffd700 1 -- 172.21.15.62:0/1949643624 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a68011780 con 0x7f4a740b6c70 2021-12-17T18:25:15.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.920+0000 7f4a66ffd700 1 -- 172.21.15.62:0/1949643624 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a680118e0 con 0x7f4a740b6c70 2021-12-17T18:25:15.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.920+0000 7f4a7ab79700 1 -- 172.21.15.62:0/1949643624 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a741437d0 con 0x7f4a740b6c70 2021-12-17T18:25:15.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.920+0000 7f4a66ffd700 1 -- 172.21.15.62:0/1949643624 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a68011c40 con 0x7f4a740b6c70 2021-12-17T18:25:15.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.920+0000 7f4a7ab79700 1 -- 172.21.15.62:0/1949643624 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a74152720 con 0x7f4a740b6c70 2021-12-17T18:25:15.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.920+0000 7f4a7ab79700 1 -- 172.21.15.62:0/1949643624 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a740573d0 con 0x7f4a740b6c70 2021-12-17T18:25:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.920+0000 7f4a66ffd700 1 -- 172.21.15.62:0/1949643624 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4a6801c460 con 0x7f4a740b6c70 2021-12-17T18:25:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.924+0000 7f4a66ffd700 1 --2- 172.21.15.62:0/1949643624 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4a540536a0 0x7f4a54055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.924+0000 7f4a66ffd700 1 -- 172.21.15.62:0/1949643624 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f4a6806baf0 con 0x7f4a740b6c70 2021-12-17T18:25:15.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.924+0000 7f4a79b77700 1 --2- 172.21.15.62:0/1949643624 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4a540536a0 0x7f4a54055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:15.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.924+0000 7f4a79b77700 1 --2- 172.21.15.62:0/1949643624 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4a540536a0 0x7f4a54055b60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f4a7001c000 tx=0x7f4a70015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:15.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:15.928+0000 7f4a66ffd700 1 -- 172.21.15.62:0/1949643624 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4a68042d90 con 0x7f4a740b6c70 2021-12-17T18:25:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.092+0000 7f4a7ab79700 1 -- 172.21.15.62:0/1949643624 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a74044690 con 0x7f4a740b6c70 2021-12-17T18:25:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.092+0000 7f4a66ffd700 1 -- 172.21.15.62:0/1949643624 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+1212 (secure 0 0 0) 0x7f4a680463b0 con 0x7f4a740b6c70 2021-12-17T18:25:16.099 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:16.099 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5672,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/2267359903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":2267359903},{"type":"v1","addr":"172.21.15.109:6835","nonce":2267359903}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30},{"gid":6627,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3029317548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3029317548},{"type":"v1","addr":"172.21.15.62:6833","nonce":3029317548}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34}],"filesystems":[]} 2021-12-17T18:25:16.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.096+0000 7f4a7ab79700 1 -- 172.21.15.62:0/1949643624 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4a540536a0 msgr2=0x7f4a54055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:16.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.096+0000 7f4a7ab79700 1 --2- 172.21.15.62:0/1949643624 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4a540536a0 0x7f4a54055b60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f4a7001c000 tx=0x7f4a70015000).stop 2021-12-17T18:25:16.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.096+0000 7f4a7ab79700 1 -- 172.21.15.62:0/1949643624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a740b6c70 msgr2=0x7f4a74142b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:16.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.096+0000 7f4a7ab79700 1 --2- 172.21.15.62:0/1949643624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a740b6c70 0x7f4a74142b50 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f4a6800a000 tx=0x7f4a68008040).stop 2021-12-17T18:25:16.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.096+0000 7f4a7ab79700 1 -- 172.21.15.62:0/1949643624 shutdown_connections 2021-12-17T18:25:16.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.096+0000 7f4a7ab79700 1 --2- 172.21.15.62:0/1949643624 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4a540536a0 0x7f4a54055b60 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:16.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.096+0000 7f4a7ab79700 1 --2- 172.21.15.62:0/1949643624 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4a74149030 0x7f4a74152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:16.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.096+0000 7f4a7ab79700 1 --2- 172.21.15.62:0/1949643624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a740b6c70 0x7f4a74142b50 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:16.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.096+0000 7f4a7ab79700 1 --2- 172.21.15.62:0/1949643624 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4a740b5b20 0x7f4a740af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:16.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.096+0000 7f4a7ab79700 1 -- 172.21.15.62:0/1949643624 >> 172.21.15.62:0/1949643624 conn(0x7f4a7405c750 msgr2=0x7f4a740b79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:16.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.096+0000 7f4a7ab79700 1 -- 172.21.15.62:0/1949643624 shutdown_connections 2021-12-17T18:25:16.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.096+0000 7f4a7ab79700 1 -- 172.21.15.62:0/1949643624 wait complete. 2021-12-17T18:25:16.104 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 34 2021-12-17T18:25:16.112 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:16.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f00525fd700 1 Processor -- start 2021-12-17T18:25:16.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f00525fd700 1 -- start start 2021-12-17T18:25:16.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f00525fd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f004c0b3260 0x7f004c140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:16.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f00525fd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f004c0b0c90 0x7f004c063dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:16.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f00525fd700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004c140df0 con 0x7f004c0af680 2021-12-17T18:25:16.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f00525fd700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f004c0b13a0 con 0x7f004c0b0c90 2021-12-17T18:25:16.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f00525fd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004c0afa60 con 0x7f004c0b3260 2021-12-17T18:25:16.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f0051dfc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f004c0b0c90 0x7f004c063dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:16.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f0051dfc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f004c0b0c90 0x7f004c063dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52768/0 (socket says 172.21.15.62:52768) 2021-12-17T18:25:16.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f0051dfc700 1 -- 172.21.15.62:0/1610406703 learned_addr learned my addr 172.21.15.62:0/1610406703 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:16.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f0050dfa700 1 --2- 172.21.15.62:0/1610406703 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f004c0b3260 0x7f004c140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:16.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f0051dfc700 1 -- 172.21.15.62:0/1610406703 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f004c0b3260 msgr2=0x7f004c140900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:16.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f0051dfc700 1 --2- 172.21.15.62:0/1610406703 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f004c0b3260 0x7f004c140900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:16.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f0051dfc700 1 -- 172.21.15.62:0/1610406703 >> v1:172.21.15.109:6789/0 conn(0x7f004c0af680 legacy=0x7f004c1401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:16.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f0051dfc700 1 -- 172.21.15.62:0/1610406703 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c0b29a0 con 0x7f004c0b0c90 2021-12-17T18:25:16.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f0051dfc700 1 --2- 172.21.15.62:0/1610406703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004c0b0c90 0x7f004c063dd0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f00440032f0 tx=0x7f0044009290).ready entity=mon.0 client_cookie=772abb3ed02d1fb1 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:16.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f003bfff700 1 -- 172.21.15.62:0/1610406703 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f004400b8a0 con 0x7f004c0b0c90 2021-12-17T18:25:16.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f003bfff700 1 -- 172.21.15.62:0/1610406703 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004400ba00 con 0x7f004c0b0c90 2021-12-17T18:25:16.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.212+0000 7f003bfff700 1 -- 172.21.15.62:0/1610406703 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f004400bb70 con 0x7f004c0b0c90 2021-12-17T18:25:16.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.216+0000 7f00525fd700 1 -- 172.21.15.62:0/1610406703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004c0b0c90 msgr2=0x7f004c063dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:16.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.216+0000 7f00525fd700 1 --2- 172.21.15.62:0/1610406703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004c0b0c90 0x7f004c063dd0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f00440032f0 tx=0x7f0044009290).stop 2021-12-17T18:25:16.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.216+0000 7f00525fd700 1 -- 172.21.15.62:0/1610406703 shutdown_connections 2021-12-17T18:25:16.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.216+0000 7f00525fd700 1 --2- 172.21.15.62:0/1610406703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004c0b0c90 0x7f004c063dd0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:16.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.216+0000 7f00525fd700 1 --2- 172.21.15.62:0/1610406703 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f004c0b3260 0x7f004c140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:16.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.216+0000 7f00525fd700 1 -- 172.21.15.62:0/1610406703 >> 172.21.15.62:0/1610406703 conn(0x7f004c05c750 msgr2=0x7f004c05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:16.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.216+0000 7f00525fd700 1 -- 172.21.15.62:0/1610406703 shutdown_connections 2021-12-17T18:25:16.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.216+0000 7f00525fd700 1 -- 172.21.15.62:0/1610406703 wait complete. 2021-12-17T18:25:16.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.216+0000 7f00525fd700 1 Processor -- start 2021-12-17T18:25:16.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.216+0000 7f00525fd700 1 -- start start 2021-12-17T18:25:16.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f00525fd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f004c0af680 0x7f004c065980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:16.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f00525fd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004c0b0c90 0x7f004c0b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:16.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f00525fd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f004c0b3260 0x7f004c13f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:16.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f00525fd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c066df0 con 0x7f004c0b0c90 2021-12-17T18:25:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f00525fd700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c064c60 con 0x7f004c0b3260 2021-12-17T18:25:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f00525fd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004c064f00 con 0x7f004c0af680 2021-12-17T18:25:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f0050dfa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004c0b0c90 0x7f004c0b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:16.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f0050dfa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004c0b0c90 0x7f004c0b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52772/0 (socket says 172.21.15.62:52772) 2021-12-17T18:25:16.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f00515fb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f004c0af680 0x7f004c065980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:16.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f0050dfa700 1 -- 172.21.15.62:0/4095959071 learned_addr learned my addr 172.21.15.62:0/4095959071 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:16.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f0051dfc700 1 --2- 172.21.15.62:0/4095959071 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f004c0b3260 0x7f004c13f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:16.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f0050dfa700 1 -- 172.21.15.62:0/4095959071 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f004c0af680 msgr2=0x7f004c065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:16.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f0050dfa700 1 --2- 172.21.15.62:0/4095959071 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f004c0af680 0x7f004c065980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:16.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f0050dfa700 1 -- 172.21.15.62:0/4095959071 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f004c0b3260 msgr2=0x7f004c13f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:16.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f0050dfa700 1 --2- 172.21.15.62:0/4095959071 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f004c0b3260 0x7f004c13f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:16.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f0050dfa700 1 -- 172.21.15.62:0/4095959071 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0044009530 con 0x7f004c0b0c90 2021-12-17T18:25:16.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f0050dfa700 1 --2- 172.21.15.62:0/4095959071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004c0b0c90 0x7f004c0b52b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f003c00c000 tx=0x7f003c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:16.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f003a7fc700 1 -- 172.21.15.62:0/4095959071 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f003c011750 con 0x7f004c0b0c90 2021-12-17T18:25:16.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f003a7fc700 1 -- 172.21.15.62:0/4095959071 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c0118b0 con 0x7f004c0b0c90 2021-12-17T18:25:16.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f003a7fc700 1 -- 172.21.15.62:0/4095959071 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f003c011c10 con 0x7f004c0b0c90 2021-12-17T18:25:16.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f00525fd700 1 -- 172.21.15.62:0/4095959071 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004c0af0b0 con 0x7f004c0b0c90 2021-12-17T18:25:16.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.220+0000 7f00525fd700 1 -- 172.21.15.62:0/4095959071 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004c065180 con 0x7f004c0b0c90 2021-12-17T18:25:16.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.224+0000 7f00525fd700 1 -- 172.21.15.62:0/4095959071 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004c0b2c40 con 0x7f004c0b0c90 2021-12-17T18:25:16.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.224+0000 7f003a7fc700 1 -- 172.21.15.62:0/4095959071 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f003c011d70 con 0x7f004c0b0c90 2021-12-17T18:25:16.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.224+0000 7f003a7fc700 1 --2- 172.21.15.62:0/4095959071 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f002c053610 0x7f002c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:16.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.224+0000 7f003a7fc700 1 -- 172.21.15.62:0/4095959071 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f003c06bbc0 con 0x7f004c0b0c90 2021-12-17T18:25:16.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.224+0000 7f00515fb700 1 --2- 172.21.15.62:0/4095959071 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f002c053610 0x7f002c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:16.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.224+0000 7f00515fb700 1 --2- 172.21.15.62:0/4095959071 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f002c053610 0x7f002c055ad0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f004800d000 tx=0x7f0048000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:16.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.228+0000 7f003a7fc700 1 -- 172.21.15.62:0/4095959071 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f003c042ec0 con 0x7f004c0b0c90 2021-12-17T18:25:16.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.388+0000 7f00525fd700 1 -- 172.21.15.62:0/4095959071 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f004c0573d0 con 0x7f004c0b0c90 2021-12-17T18:25:16.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.388+0000 7f003a7fc700 1 -- 172.21.15.62:0/4095959071 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+1212 (secure 0 0 0) 0x7f003c0464e0 con 0x7f004c0b0c90 2021-12-17T18:25:16.394 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:16.395 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5672,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/2267359903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":2267359903},{"type":"v1","addr":"172.21.15.109:6835","nonce":2267359903}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30},{"gid":6627,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3029317548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3029317548},{"type":"v1","addr":"172.21.15.62:6833","nonce":3029317548}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34}],"filesystems":[]} 2021-12-17T18:25:16.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.388+0000 7f00525fd700 1 -- 172.21.15.62:0/4095959071 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f002c053610 msgr2=0x7f002c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:16.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.388+0000 7f00525fd700 1 --2- 172.21.15.62:0/4095959071 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f002c053610 0x7f002c055ad0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f004800d000 tx=0x7f0048000bc0).stop 2021-12-17T18:25:16.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.388+0000 7f00525fd700 1 -- 172.21.15.62:0/4095959071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004c0b0c90 msgr2=0x7f004c0b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:16.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.388+0000 7f00525fd700 1 --2- 172.21.15.62:0/4095959071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004c0b0c90 0x7f004c0b52b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f003c00c000 tx=0x7f003c006df0).stop 2021-12-17T18:25:16.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.388+0000 7f00525fd700 1 -- 172.21.15.62:0/4095959071 shutdown_connections 2021-12-17T18:25:16.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.388+0000 7f00525fd700 1 --2- 172.21.15.62:0/4095959071 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f002c053610 0x7f002c055ad0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:16.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.388+0000 7f00525fd700 1 --2- 172.21.15.62:0/4095959071 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f004c0b3260 0x7f004c13f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:16.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.388+0000 7f00525fd700 1 --2- 172.21.15.62:0/4095959071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004c0b0c90 0x7f004c0b52b0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:16.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.388+0000 7f00525fd700 1 --2- 172.21.15.62:0/4095959071 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f004c0af680 0x7f004c065980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:16.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.388+0000 7f00525fd700 1 -- 172.21.15.62:0/4095959071 >> 172.21.15.62:0/4095959071 conn(0x7f004c05c750 msgr2=0x7f004c140f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:16.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.388+0000 7f00525fd700 1 -- 172.21.15.62:0/4095959071 shutdown_connections 2021-12-17T18:25:16.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.388+0000 7f00525fd700 1 -- 172.21.15.62:0/4095959071 wait complete. 2021-12-17T18:25:16.401 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 34 2021-12-17T18:25:16.406 INFO:tasks.ceph.mds.a:Restarting daemon 2021-12-17T18:25:16.407 INFO:tasks.ceph.mds.a:Stopping old one... 2021-12-17T18:25:16.407 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-12-17T18:25:16.407 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:25:16.408 INFO:tasks.ceph.mds.b:Restarting daemon 2021-12-17T18:25:16.408 INFO:tasks.ceph.mds.b:Stopping old one... 2021-12-17T18:25:16.408 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-12-17T18:25:16.409 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:25:16.423 INFO:tasks.ceph.mds.a:Stopped 2021-12-17T18:25:16.424 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-12-17T18:25:16.425 INFO:tasks.ceph.mds.b:Stopped 2021-12-17T18:25:16.425 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-12-17T18:25:16.428 INFO:tasks.ceph.mds.b:Started 2021-12-17T18:25:16.428 DEBUG:teuthology.parallel:result is None 2021-12-17T18:25:16.469 INFO:tasks.ceph.mds.a:Started 2021-12-17T18:25:16.470 DEBUG:teuthology.parallel:result is None 2021-12-17T18:25:16.470 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-12-17T18:25:16.501 INFO:tasks.ceph.mds.b.smithi109.stdout:starting mds.b at 2021-12-17T18:25:16.557 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:25:16.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.580+0000 7ff5012ab700 1 Processor -- start 2021-12-17T18:25:16.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.580+0000 7ff5012ab700 1 -- start start 2021-12-17T18:25:16.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff5012ab700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4fc0b0580 0x7ff4fc0af860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:16.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff5012ab700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4fc0afd50 con 0x7ff4fc0affc0 2021-12-17T18:25:16.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff5012ab700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4fc067c10 con 0x7ff4fc067830 2021-12-17T18:25:16.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff5012ab700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc144630 con 0x7ff4fc0b0580 2021-12-17T18:25:16.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff4fb7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff4fc0affc0 0x7ff4fc143560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36372/0 (socket says 172.21.15.62:36372) 2021-12-17T18:25:16.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff4fb7fe700 1 -- 172.21.15.62:0/310435404 learned_addr learned my addr 172.21.15.62:0/310435404 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:16.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff4fa7fc700 1 --2- 172.21.15.62:0/310435404 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4fc0b0580 0x7ff4fc0af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:16.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff4f9ffb700 1 -- 172.21.15.62:0/310435404 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520747966 0 0) 0x7ff4ec001110 con 0x7ff4fc0affc0 2021-12-17T18:25:16.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff4f9ffb700 1 -- 172.21.15.62:0/310435404 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4dc003260 con 0x7ff4fc0affc0 2021-12-17T18:25:16.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff4fa7fc700 1 -- 172.21.15.62:0/310435404 >> v1:172.21.15.109:6789/0 conn(0x7ff4fc067830 legacy=0x7ff4fc0af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:16.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff4fa7fc700 1 -- 172.21.15.62:0/310435404 >> v1:172.21.15.62:6789/0 conn(0x7ff4fc0affc0 legacy=0x7ff4fc143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:16.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff4f9ffb700 1 -- 172.21.15.62:0/310435404 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1652120261 0 0) 0x7ff4dc003260 con 0x7ff4fc0affc0 2021-12-17T18:25:16.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff4fa7fc700 1 -- 172.21.15.62:0/310435404 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc0b0ce0 con 0x7ff4fc0b0580 2021-12-17T18:25:16.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff4fa7fc700 1 --2- 172.21.15.62:0/310435404 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4fc0b0580 0x7ff4fc0af860 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7ff4ec001990 tx=0x7ff4e40091d0).ready entity=mon.2 client_cookie=c19587c879b83084 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:16.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff4f9ffb700 1 -- 172.21.15.62:0/310435404 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4ec0017f0 con 0x7ff4fc0b0580 2021-12-17T18:25:16.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff4f9ffb700 1 -- 172.21.15.62:0/310435404 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e400b580 con 0x7ff4fc0b0580 2021-12-17T18:25:16.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff4f9ffb700 1 -- 172.21.15.62:0/310435404 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4e400b6f0 con 0x7ff4fc0b0580 2021-12-17T18:25:16.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff5012ab700 1 -- 172.21.15.62:0/310435404 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4fc0b0580 msgr2=0x7ff4fc0af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:16.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff5012ab700 1 --2- 172.21.15.62:0/310435404 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4fc0b0580 0x7ff4fc0af860 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7ff4ec001990 tx=0x7ff4e40091d0).stop 2021-12-17T18:25:16.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff5012ab700 1 -- 172.21.15.62:0/310435404 shutdown_connections 2021-12-17T18:25:16.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff5012ab700 1 --2- 172.21.15.62:0/310435404 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4fc0b0580 0x7ff4fc0af860 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0x7ff4ec001990 tx=0x7ff4e40091d0).stop 2021-12-17T18:25:16.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff5012ab700 1 -- 172.21.15.62:0/310435404 >> 172.21.15.62:0/310435404 conn(0x7ff4fc0626d0 msgr2=0x7ff4fc05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:16.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff5012ab700 1 -- 172.21.15.62:0/310435404 shutdown_connections 2021-12-17T18:25:16.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff5012ab700 1 -- 172.21.15.62:0/310435404 wait complete. 2021-12-17T18:25:16.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff5012ab700 1 Processor -- start 2021-12-17T18:25:16.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.584+0000 7ff5012ab700 1 -- start start 2021-12-17T18:25:16.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff5012ab700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff4fc067830 0x7ff4fc152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:16.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff5012ab700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4fc0affc0 0x7ff4fc0a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:16.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff5012ab700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4fc0a14e0 0x7ff4fc1424c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:16.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff5012ab700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc1564a0 con 0x7ff4fc0affc0 2021-12-17T18:25:16.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff5012ab700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0a7950 con 0x7ff4fc067830 2021-12-17T18:25:16.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff5012ab700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0a76b0 con 0x7ff4fc0a14e0 2021-12-17T18:25:16.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff4fa7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4fc0affc0 0x7ff4fc0a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:16.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff4fa7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4fc0affc0 0x7ff4fc0a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52798/0 (socket says 172.21.15.62:52798) 2021-12-17T18:25:16.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff4fb7fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4fc0a14e0 0x7ff4fc1424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:16.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff4fa7fc700 1 -- 172.21.15.62:0/2037864634 learned_addr learned my addr 172.21.15.62:0/2037864634 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:16.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff4faffd700 1 --2- 172.21.15.62:0/2037864634 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff4fc067830 0x7ff4fc152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:16.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff4fb7fe700 1 -- 172.21.15.62:0/2037864634 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff4fc067830 msgr2=0x7ff4fc152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:16.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff4fb7fe700 1 --2- 172.21.15.62:0/2037864634 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff4fc067830 0x7ff4fc152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:16.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff4fb7fe700 1 -- 172.21.15.62:0/2037864634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4fc0affc0 msgr2=0x7ff4fc0a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:16.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff4fb7fe700 1 --2- 172.21.15.62:0/2037864634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4fc0affc0 0x7ff4fc0a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:16.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff4fb7fe700 1 -- 172.21.15.62:0/2037864634 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e4009470 con 0x7ff4fc0a14e0 2021-12-17T18:25:16.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff4fa7fc700 1 --2- 172.21.15.62:0/2037864634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4fc0affc0 0x7ff4fc0a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:16.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff4fb7fe700 1 --2- 172.21.15.62:0/2037864634 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4fc0a14e0 0x7ff4fc1424c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ff4ec001a50 tx=0x7ff4ec001dd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:16.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff4f3fff700 1 -- 172.21.15.62:0/2037864634 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4ec000e90 con 0x7ff4fc0a14e0 2021-12-17T18:25:16.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff4f3fff700 1 -- 172.21.15.62:0/2037864634 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec007170 con 0x7ff4fc0a14e0 2021-12-17T18:25:16.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff5012ab700 1 -- 172.21.15.62:0/2037864634 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4fc1532d0 con 0x7ff4fc0a14e0 2021-12-17T18:25:16.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff4f3fff700 1 -- 172.21.15.62:0/2037864634 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4ec004520 con 0x7ff4fc0a14e0 2021-12-17T18:25:16.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff5012ab700 1 -- 172.21.15.62:0/2037864634 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4fc0a3bb0 con 0x7ff4fc0a14e0 2021-12-17T18:25:16.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff5012ab700 1 -- 172.21.15.62:0/2037864634 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d4003410 con 0x7ff4fc0a14e0 2021-12-17T18:25:16.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.588+0000 7ff4f3fff700 1 -- 172.21.15.62:0/2037864634 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff4ec004680 con 0x7ff4fc0a14e0 2021-12-17T18:25:16.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.592+0000 7ff4f3fff700 1 --2- 172.21.15.62:0/2037864634 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4dc053820 0x7ff4dc055ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:16.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.592+0000 7ff4f3fff700 1 -- 172.21.15.62:0/2037864634 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ff4ec06b5c0 con 0x7ff4fc0a14e0 2021-12-17T18:25:16.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.592+0000 7ff4faffd700 1 --2- 172.21.15.62:0/2037864634 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4dc053820 0x7ff4dc055ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:16.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.592+0000 7ff4faffd700 1 --2- 172.21.15.62:0/2037864634 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4dc053820 0x7ff4dc055ce0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7ff4f400d000 tx=0x7ff4f4007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:16.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.596+0000 7ff4f3fff700 1 -- 172.21.15.62:0/2037864634 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff4ec042a20 con 0x7ff4fc0a14e0 2021-12-17T18:25:16.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:16.736+0000 7ff5012ab700 1 -- 172.21.15.62:0/2037864634 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7ff4d4003990 con 0x7ff4fc0a14e0 2021-12-17T18:25:17.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.532+0000 7ff4f3fff700 1 -- 172.21.15.62:0/2037864634 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v77) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff4ec046040 con 0x7ff4fc0a14e0 2021-12-17T18:25:17.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.536+0000 7ff5012ab700 1 -- 172.21.15.62:0/2037864634 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4dc053820 msgr2=0x7ff4dc055ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.536+0000 7ff5012ab700 1 --2- 172.21.15.62:0/2037864634 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4dc053820 0x7ff4dc055ce0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7ff4f400d000 tx=0x7ff4f4007b90).stop 2021-12-17T18:25:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.536+0000 7ff5012ab700 1 -- 172.21.15.62:0/2037864634 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4fc0a14e0 msgr2=0x7ff4fc1424c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.536+0000 7ff5012ab700 1 --2- 172.21.15.62:0/2037864634 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4fc0a14e0 0x7ff4fc1424c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ff4ec001a50 tx=0x7ff4ec001dd0).stop 2021-12-17T18:25:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.536+0000 7ff5012ab700 1 -- 172.21.15.62:0/2037864634 shutdown_connections 2021-12-17T18:25:17.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.536+0000 7ff5012ab700 1 --2- 172.21.15.62:0/2037864634 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4dc053820 0x7ff4dc055ce0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:17.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.536+0000 7ff5012ab700 1 --2- 172.21.15.62:0/2037864634 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4fc0a14e0 0x7ff4fc1424c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:17.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.536+0000 7ff5012ab700 1 --2- 172.21.15.62:0/2037864634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4fc0affc0 0x7ff4fc0a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:17.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.536+0000 7ff5012ab700 1 --2- 172.21.15.62:0/2037864634 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff4fc067830 0x7ff4fc152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:17.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.536+0000 7ff5012ab700 1 -- 172.21.15.62:0/2037864634 >> 172.21.15.62:0/2037864634 conn(0x7ff4fc0626d0 msgr2=0x7ff4fc0ac990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:17.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.536+0000 7ff5012ab700 1 -- 172.21.15.62:0/2037864634 shutdown_connections 2021-12-17T18:25:17.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.536+0000 7ff5012ab700 1 -- 172.21.15.62:0/2037864634 wait complete. 2021-12-17T18:25:17.545 INFO:teuthology.orchestra.run.smithi062.stderr: removed all blacklist entries 2021-12-17T18:25:17.556 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-12-17T18:25:17.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-12-17T18:25:17.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.656+0000 7f465258d700 1 Processor -- start 2021-12-17T18:25:17.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.656+0000 7f465258d700 1 -- start start 2021-12-17T18:25:17.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f465258d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f464c143500 0x7f464c05fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:17.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f465258d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464c0b6280 con 0x7f464c0b5ea0 2021-12-17T18:25:17.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f465258d700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464c142880 con 0x7f464c060330 2021-12-17T18:25:17.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f465258d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464c142b20 con 0x7f464c143500 2021-12-17T18:25:17.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f465158b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f464c0b5ea0 0x7f464c05f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36384/0 (socket says 172.21.15.62:36384) 2021-12-17T18:25:17.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f465158b700 1 -- 172.21.15.62:0/2736322928 learned_addr learned my addr 172.21.15.62:0/2736322928 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:17.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f4650d8a700 1 --2- 172.21.15.62:0/2736322928 >> v2:172.21.15.109:3300/0 conn(0x7f464c143500 0x7f464c05fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:17.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f464bfff700 1 -- 172.21.15.62:0/2736322928 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877300478 0 0) 0x7f464c0b6280 con 0x7f464c0b5ea0 2021-12-17T18:25:17.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f464bfff700 1 -- 172.21.15.62:0/2736322928 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4638003260 con 0x7f464c0b5ea0 2021-12-17T18:25:17.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f464bfff700 1 -- 172.21.15.62:0/2736322928 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265791378 0 0) 0x7f464c142880 con 0x7f464c060330 2021-12-17T18:25:17.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f464bfff700 1 -- 172.21.15.62:0/2736322928 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f464c0b6280 con 0x7f464c060330 2021-12-17T18:25:17.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f4650d8a700 1 -- 172.21.15.62:0/2736322928 >> v1:172.21.15.109:6789/0 conn(0x7f464c060330 legacy=0x7f464c13f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:17.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f4650d8a700 1 -- 172.21.15.62:0/2736322928 >> v1:172.21.15.62:6789/0 conn(0x7f464c0b5ea0 legacy=0x7f464c05f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:17.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f4650d8a700 1 -- 172.21.15.62:0/2736322928 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c142dc0 con 0x7f464c143500 2021-12-17T18:25:17.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f4650d8a700 1 --2- 172.21.15.62:0/2736322928 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f464c143500 0x7f464c05fe40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f463c0032f0 tx=0x7f463c0091d0).ready entity=mon.1 client_cookie=f08a229637a48a3a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:17.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f464bfff700 1 -- 172.21.15.62:0/2736322928 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f463c00b600 con 0x7f464c143500 2021-12-17T18:25:17.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f464bfff700 1 -- 172.21.15.62:0/2736322928 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c00b760 con 0x7f464c143500 2021-12-17T18:25:17.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f464bfff700 1 -- 172.21.15.62:0/2736322928 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f463c00b8d0 con 0x7f464c143500 2021-12-17T18:25:17.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f465258d700 1 -- 172.21.15.62:0/2736322928 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f464c143500 msgr2=0x7f464c05fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:17.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f465258d700 1 --2- 172.21.15.62:0/2736322928 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f464c143500 0x7f464c05fe40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f463c0032f0 tx=0x7f463c0091d0).stop 2021-12-17T18:25:17.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f465258d700 1 -- 172.21.15.62:0/2736322928 shutdown_connections 2021-12-17T18:25:17.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f465258d700 1 --2- 172.21.15.62:0/2736322928 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f464c143500 0x7f464c05fe40 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:17.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f465258d700 1 -- 172.21.15.62:0/2736322928 >> 172.21.15.62:0/2736322928 conn(0x7f464c05d220 msgr2=0x7f464c0b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:17.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f465258d700 1 -- 172.21.15.62:0/2736322928 shutdown_connections 2021-12-17T18:25:17.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.660+0000 7f465258d700 1 -- 172.21.15.62:0/2736322928 wait complete. 2021-12-17T18:25:17.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f465258d700 1 Processor -- start 2021-12-17T18:25:17.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f465258d700 1 -- start start 2021-12-17T18:25:17.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f465258d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f464c060330 0x7f464c0a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f465258d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f464c0b5ea0 0x7f464c0ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f465258d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f464c143500 0x7f464c0abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f465258d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c09f1c0 con 0x7f464c0b5ea0 2021-12-17T18:25:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f465258d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0a0520 con 0x7f464c143500 2021-12-17T18:25:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f465258d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0aa040 con 0x7f464c060330 2021-12-17T18:25:17.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f4650d8a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f464c0b5ea0 0x7f464c0ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:17.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f4650d8a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f464c0b5ea0 0x7f464c0ab7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52810/0 (socket says 172.21.15.62:52810) 2021-12-17T18:25:17.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f4650d8a700 1 -- 172.21.15.62:0/2378262503 learned_addr learned my addr 172.21.15.62:0/2378262503 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:17.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f465158b700 1 --2- 172.21.15.62:0/2378262503 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f464c060330 0x7f464c0a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:17.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f4651d8c700 1 --2- 172.21.15.62:0/2378262503 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f464c143500 0x7f464c0abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:17.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f4650d8a700 1 -- 172.21.15.62:0/2378262503 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f464c060330 msgr2=0x7f464c0a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:17.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f4650d8a700 1 --2- 172.21.15.62:0/2378262503 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f464c060330 0x7f464c0a0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:17.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f4650d8a700 1 -- 172.21.15.62:0/2378262503 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f464c143500 msgr2=0x7f464c0abc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:17.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f4650d8a700 1 --2- 172.21.15.62:0/2378262503 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f464c143500 0x7f464c0abc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:17.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f4650d8a700 1 -- 172.21.15.62:0/2378262503 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c009470 con 0x7f464c0b5ea0 2021-12-17T18:25:17.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f4651d8c700 1 --2- 172.21.15.62:0/2378262503 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f464c143500 0x7f464c0abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:25:17.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f465158b700 1 --2- 172.21.15.62:0/2378262503 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f464c060330 0x7f464c0a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:17.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.664+0000 7f4650d8a700 1 --2- 172.21.15.62:0/2378262503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f464c0b5ea0 0x7f464c0ab7a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f463c0032f0 tx=0x7f463c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:17.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.668+0000 7f464a7fc700 1 -- 172.21.15.62:0/2378262503 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f463c00b600 con 0x7f464c0b5ea0 2021-12-17T18:25:17.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.668+0000 7f464a7fc700 1 -- 172.21.15.62:0/2378262503 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c0107a0 con 0x7f464c0b5ea0 2021-12-17T18:25:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.668+0000 7f465258d700 1 -- 172.21.15.62:0/2378262503 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464c0aa480 con 0x7f464c0b5ea0 2021-12-17T18:25:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.668+0000 7f464a7fc700 1 -- 172.21.15.62:0/2378262503 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f463c010b00 con 0x7f464c0b5ea0 2021-12-17T18:25:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.668+0000 7f465258d700 1 -- 172.21.15.62:0/2378262503 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c0a9d10 con 0x7f464c0b5ea0 2021-12-17T18:25:17.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.668+0000 7f465258d700 1 -- 172.21.15.62:0/2378262503 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464c0aa240 con 0x7f464c0b5ea0 2021-12-17T18:25:17.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.668+0000 7f464a7fc700 1 -- 172.21.15.62:0/2378262503 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f463c027030 con 0x7f464c0b5ea0 2021-12-17T18:25:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.668+0000 7f464a7fc700 1 --2- 172.21.15.62:0/2378262503 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f462c0536a0 0x7f462c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.668+0000 7f464a7fc700 1 -- 172.21.15.62:0/2378262503 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f463c06c610 con 0x7f464c0b5ea0 2021-12-17T18:25:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.672+0000 7f465158b700 1 --2- 172.21.15.62:0/2378262503 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f462c0536a0 0x7f462c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.672+0000 7f465158b700 1 --2- 172.21.15.62:0/2378262503 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f462c0536a0 0x7f462c055b60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f464000b000 tx=0x7f4640009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.676+0000 7f464a7fc700 1 -- 172.21.15.62:0/2378262503 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f463c0439d0 con 0x7f464c0b5ea0 2021-12-17T18:25:17.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.844+0000 7f465258d700 1 -- 172.21.15.62:0/2378262503 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f464c0aaf20 con 0x7f464c0b5ea0 2021-12-17T18:25:17.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.844+0000 7f464a7fc700 1 -- 172.21.15.62:0/2378262503 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f463c025090 con 0x7f464c0b5ea0 2021-12-17T18:25:17.849 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:17.849 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:25:17.850 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_dump": [ 2021-12-17T18:25:17.850 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:17.850 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.a", 2021-12-17T18:25:17.851 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhxCS0LBAAtUlkgWYg4l3fQ2au7jMUDg==", 2021-12-17T18:25:17.851 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:17.851 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:25:17.851 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:17.852 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:17.852 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:17.852 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:17.852 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:17.852 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:17.853 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.b", 2021-12-17T18:25:17.853 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhoRJAMxAAP/NmDQRwJjYip2rxJsQlYg==", 2021-12-17T18:25:17.853 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:17.853 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:25:17.854 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:17.854 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:17.854 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:17.854 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:17.855 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:17.855 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:17.855 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.0", 2021-12-17T18:25:17.855 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBA1LxhJXzhKhAAUnxP3G5VuATkQLoDALFjVg==", 2021-12-17T18:25:17.856 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:17.856 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:17.856 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:17.856 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:17.857 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:17.857 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:17.857 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:17.857 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.1", 2021-12-17T18:25:17.858 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBD1LxhregUDhAABrxQ2jQ4BwXvuWh/D9SkbQ==", 2021-12-17T18:25:17.858 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:17.858 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:17.859 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:17.859 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:17.859 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:17.859 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:17.860 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:17.860 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.2", 2021-12-17T18:25:17.860 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBF1LxhOo/SLhAAhQQLW/VKFx1sgm8chnD5tw==", 2021-12-17T18:25:17.860 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:17.860 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:17.861 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:17.861 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:17.861 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:17.861 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:17.862 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:17.862 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.3", 2021-12-17T18:25:17.862 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBI1LxhT2ZQExAA999j8V5bJAJ2PuaQqSkUOw==", 2021-12-17T18:25:17.862 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:17.863 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:17.863 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:17.863 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:17.863 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:17.863 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:17.864 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:17.864 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.4", 2021-12-17T18:25:17.864 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBN1LxhKBDzFhAAKmPF0FXnnfXtweo+6z9nxg==", 2021-12-17T18:25:17.864 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:17.865 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:17.865 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:17.865 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:17.865 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:17.866 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:17.866 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:17.866 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.5", 2021-12-17T18:25:17.867 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBP1LxhtqkAORAAVaFLVNIUMs4Sytk8WRaGNA==", 2021-12-17T18:25:17.867 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:17.867 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:17.867 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:17.868 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:17.868 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:17.868 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:17.868 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:17.869 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.6", 2021-12-17T18:25:17.869 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBS1LxhNtncGhAAgG64g1ie54CDp9Y7uldKQA==", 2021-12-17T18:25:17.869 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:17.869 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:17.870 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:17.870 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:17.870 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:17.870 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:17.871 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:17.871 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.7", 2021-12-17T18:25:17.871 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBV1Lxh3DcDABAAHVskSVtoEJ8BxCCAs3ZDVA==", 2021-12-17T18:25:17.871 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:17.871 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:17.872 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:17.872 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:17.872 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:17.872 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:17.873 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:17.873 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.0", 2021-12-17T18:25:17.873 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxh9QhCNxAALkWTJorDpbt9yrikL7/NWg==", 2021-12-17T18:25:17.873 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:17.874 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:25:17.874 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:25:17.874 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:25:17.875 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:17.875 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:17.875 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:17.875 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.1", 2021-12-17T18:25:17.876 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxhxm52OxAAbqXVaqRDmt4Ezj9xyCEODQ==", 2021-12-17T18:25:17.876 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:17.876 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:25:17.877 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:25:17.877 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:25:17.877 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:17.877 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:17.878 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:17.878 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.2", 2021-12-17T18:25:17.878 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+1LxhXu08BBAATRcUAZvMNg9ou4PLszDtmA==", 2021-12-17T18:25:17.878 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:17.879 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:25:17.879 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:25:17.879 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:25:17.880 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:17.880 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:17.880 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:17.880 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.admin", 2021-12-17T18:25:17.881 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhyAGlDRAA2ggSG5yBBFbMgK2fCBk2mQ==", 2021-12-17T18:25:17.881 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:17.881 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:25:17.881 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:17.881 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:17.882 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:17.882 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:17.882 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:17.882 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:17.883 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.x", 2021-12-17T18:25:17.883 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhzvntKRAAFQlg69Z6d2nWX0GxSshsMw==", 2021-12-17T18:25:17.883 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:17.883 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:25:17.884 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:25:17.884 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:17.884 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:17.884 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:17.885 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:17.885 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.y", 2021-12-17T18:25:17.885 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhKdTGJRAArzUN3A1U5Efw0NG9Gw2Gcw==", 2021-12-17T18:25:17.886 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:17.886 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:25:17.886 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:25:17.886 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:17.887 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:17.887 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:17.887 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:17.887 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:25:17.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.844+0000 7f465258d700 1 -- 172.21.15.62:0/2378262503 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f462c0536a0 msgr2=0x7f462c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:17.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.844+0000 7f465258d700 1 --2- 172.21.15.62:0/2378262503 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f462c0536a0 0x7f462c055b60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f464000b000 tx=0x7f4640009040).stop 2021-12-17T18:25:17.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.844+0000 7f465258d700 1 -- 172.21.15.62:0/2378262503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f464c0b5ea0 msgr2=0x7f464c0ab7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:17.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.844+0000 7f465258d700 1 --2- 172.21.15.62:0/2378262503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f464c0b5ea0 0x7f464c0ab7a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f463c0032f0 tx=0x7f463c016000).stop 2021-12-17T18:25:17.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.844+0000 7f465258d700 1 -- 172.21.15.62:0/2378262503 shutdown_connections 2021-12-17T18:25:17.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.844+0000 7f465258d700 1 --2- 172.21.15.62:0/2378262503 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f462c0536a0 0x7f462c055b60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:17.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.844+0000 7f465258d700 1 --2- 172.21.15.62:0/2378262503 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f464c143500 0x7f464c0abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:17.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.844+0000 7f465258d700 1 --2- 172.21.15.62:0/2378262503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f464c0b5ea0 0x7f464c0ab7a0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:17.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.844+0000 7f465258d700 1 --2- 172.21.15.62:0/2378262503 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f464c060330 0x7f464c0a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:17.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.844+0000 7f465258d700 1 -- 172.21.15.62:0/2378262503 >> 172.21.15.62:0/2378262503 conn(0x7f464c05d220 msgr2=0x7f464c05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:17.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.844+0000 7f465258d700 1 -- 172.21.15.62:0/2378262503 shutdown_connections 2021-12-17T18:25:17.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.844+0000 7f465258d700 1 -- 172.21.15.62:0/2378262503 wait complete. 2021-12-17T18:25:17.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:25:17.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.992+0000 7f5edacb2700 1 Processor -- start 2021-12-17T18:25:17.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.992+0000 7f5edacb2700 1 -- start start 2021-12-17T18:25:18.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.992+0000 7f5edacb2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ed40b5b20 0x7f5ed40b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.992+0000 7f5edacb2700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5ed40b3760 0x7f5ed40b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.992+0000 7f5edacb2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5ed40b6c70 0x7f5ed4146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.992+0000 7f5edacb2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed40b5f00 con 0x7f5ed40b6c70 2021-12-17T18:25:18.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.992+0000 7f5edacb2700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed40b3020 con 0x7f5ed40b3760 2021-12-17T18:25:18.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.992+0000 7f5edacb2700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed40b32c0 con 0x7f5ed40b5b20 2021-12-17T18:25:18.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.992+0000 7f5eda4b1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5ed40b6c70 0x7f5ed4146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.992+0000 7f5eda4b1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5ed40b6c70 0x7f5ed4146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52822/0 (socket says 172.21.15.62:52822) 2021-12-17T18:25:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.992+0000 7f5eda4b1700 1 -- 172.21.15.62:0/140571546 learned_addr learned my addr 172.21.15.62:0/140571546 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.992+0000 7f5ed94af700 1 --2- 172.21.15.62:0/140571546 >> v2:172.21.15.109:3300/0 conn(0x7f5ed40b3760 0x7f5ed40b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5ed9cb0700 1 --2- 172.21.15.62:0/140571546 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ed40b5b20 0x7f5ed40b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5eda4b1700 1 -- 172.21.15.62:0/140571546 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ed40b5b20 msgr2=0x7f5ed40b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:18.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5eda4b1700 1 --2- 172.21.15.62:0/140571546 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ed40b5b20 0x7f5ed40b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5eda4b1700 1 -- 172.21.15.62:0/140571546 >> v2:172.21.15.109:3300/0 conn(0x7f5ed40b3760 msgr2=0x7f5ed40b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:18.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5eda4b1700 1 --2- 172.21.15.62:0/140571546 >> v2:172.21.15.109:3300/0 conn(0x7f5ed40b3760 0x7f5ed40b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5eda4b1700 1 -- 172.21.15.62:0/140571546 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed40b5440 con 0x7f5ed40b6c70 2021-12-17T18:25:18.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5ed94af700 1 --2- 172.21.15.62:0/140571546 >> v2:172.21.15.109:3300/0 conn(0x7f5ed40b3760 0x7f5ed40b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:18.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5eda4b1700 1 --2- 172.21.15.62:0/140571546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ed40b6c70 0x7f5ed4146980 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f5ecc002f70 tx=0x7f5ecc006eb0).ready entity=mon.0 client_cookie=76c34591c10d9445 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:18.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5ed8cae700 1 -- 172.21.15.62:0/140571546 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ecc00d570 con 0x7f5ed40b6c70 2021-12-17T18:25:18.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5ed8cae700 1 -- 172.21.15.62:0/140571546 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc000e90 con 0x7f5ed40b6c70 2021-12-17T18:25:18.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5ed8cae700 1 -- 172.21.15.62:0/140571546 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ecc00d900 con 0x7f5ed40b6c70 2021-12-17T18:25:18.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5edacb2700 1 -- 172.21.15.62:0/140571546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ed40b6c70 msgr2=0x7f5ed4146980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5edacb2700 1 --2- 172.21.15.62:0/140571546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ed40b6c70 0x7f5ed4146980 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f5ecc002f70 tx=0x7f5ecc006eb0).stop 2021-12-17T18:25:18.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5edacb2700 1 -- 172.21.15.62:0/140571546 shutdown_connections 2021-12-17T18:25:18.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5edacb2700 1 --2- 172.21.15.62:0/140571546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ed40b6c70 0x7f5ed4146980 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5edacb2700 1 --2- 172.21.15.62:0/140571546 >> v2:172.21.15.109:3300/0 conn(0x7f5ed40b3760 0x7f5ed40b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5edacb2700 1 --2- 172.21.15.62:0/140571546 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ed40b5b20 0x7f5ed40b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5edacb2700 1 -- 172.21.15.62:0/140571546 >> 172.21.15.62:0/140571546 conn(0x7f5ed405c750 msgr2=0x7f5ed405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:18.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5edacb2700 1 -- 172.21.15.62:0/140571546 shutdown_connections 2021-12-17T18:25:18.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:17.996+0000 7f5edacb2700 1 -- 172.21.15.62:0/140571546 wait complete. 2021-12-17T18:25:18.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5edacb2700 1 Processor -- start 2021-12-17T18:25:18.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5edacb2700 1 -- start start 2021-12-17T18:25:18.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5edacb2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ed40b5b20 0x7f5ed4144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5edacb2700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ed40b6c70 0x7f5ed4144030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5edacb2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ed4144520 0x7f5ed40ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5edacb2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed4065000 con 0x7f5ed4144520 2021-12-17T18:25:18.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5edacb2700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed4142ee0 con 0x7f5ed40b6c70 2021-12-17T18:25:18.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5edacb2700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed4064d60 con 0x7f5ed40b5b20 2021-12-17T18:25:18.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5eda4b1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ed4144520 0x7f5ed40ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5eda4b1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ed4144520 0x7f5ed40ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52828/0 (socket says 172.21.15.62:52828) 2021-12-17T18:25:18.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5eda4b1700 1 -- 172.21.15.62:0/1039199009 learned_addr learned my addr 172.21.15.62:0/1039199009 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:18.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5ed9cb0700 1 --2- 172.21.15.62:0/1039199009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ed40b5b20 0x7f5ed4144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5ed94af700 1 --2- 172.21.15.62:0/1039199009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ed40b6c70 0x7f5ed4144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5eda4b1700 1 -- 172.21.15.62:0/1039199009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ed40b5b20 msgr2=0x7f5ed4144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5eda4b1700 1 --2- 172.21.15.62:0/1039199009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ed40b5b20 0x7f5ed4144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5eda4b1700 1 -- 172.21.15.62:0/1039199009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ed40b6c70 msgr2=0x7f5ed4144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5eda4b1700 1 --2- 172.21.15.62:0/1039199009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ed40b6c70 0x7f5ed4144030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5eda4b1700 1 -- 172.21.15.62:0/1039199009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed0009470 con 0x7f5ed4144520 2021-12-17T18:25:18.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5ed9cb0700 1 --2- 172.21.15.62:0/1039199009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ed40b5b20 0x7f5ed4144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:18.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5ed94af700 1 --2- 172.21.15.62:0/1039199009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ed40b6c70 0x7f5ed4144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5eda4b1700 1 --2- 172.21.15.62:0/1039199009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ed4144520 0x7f5ed40ae9a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f5ecc002f70 tx=0x7f5ecc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.000+0000 7f5ec2ffd700 1 -- 172.21.15.62:0/1039199009 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ecc006b40 con 0x7f5ed4144520 2021-12-17T18:25:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.004+0000 7f5ec2ffd700 1 -- 172.21.15.62:0/1039199009 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc0068b0 con 0x7f5ed4144520 2021-12-17T18:25:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.004+0000 7f5edacb2700 1 -- 172.21.15.62:0/1039199009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ecc00b1e0 con 0x7f5ed4144520 2021-12-17T18:25:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.004+0000 7f5ec2ffd700 1 -- 172.21.15.62:0/1039199009 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ecc00de20 con 0x7f5ed4144520 2021-12-17T18:25:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.004+0000 7f5edacb2700 1 -- 172.21.15.62:0/1039199009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed4145030 con 0x7f5ed4144520 2021-12-17T18:25:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.004+0000 7f5edacb2700 1 -- 172.21.15.62:0/1039199009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed40573d0 con 0x7f5ed4144520 2021-12-17T18:25:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.004+0000 7f5ec2ffd700 1 -- 172.21.15.62:0/1039199009 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5ecc025030 con 0x7f5ed4144520 2021-12-17T18:25:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.004+0000 7f5ec2ffd700 1 --2- 172.21.15.62:0/1039199009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5eb4053580 0x7f5eb4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.004+0000 7f5ec2ffd700 1 -- 172.21.15.62:0/1039199009 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5ecc06c6f0 con 0x7f5ed4144520 2021-12-17T18:25:18.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.004+0000 7f5ed9cb0700 1 --2- 172.21.15.62:0/1039199009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5eb4053580 0x7f5eb4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.004+0000 7f5ed9cb0700 1 --2- 172.21.15.62:0/1039199009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5eb4053580 0x7f5eb4055a40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f5ec400c000 tx=0x7f5ec4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:18.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.008+0000 7f5ec2ffd700 1 -- 172.21.15.62:0/1039199009 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ecc043b80 con 0x7f5ed4144520 2021-12-17T18:25:18.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.136+0000 7f5edacb2700 1 -- 172.21.15.62:0/1039199009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ed40b9fe0 con 0x7f5ed4144520 2021-12-17T18:25:18.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.140+0000 7f5ec2ffd700 1 -- 172.21.15.62:0/1039199009 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+13230 (secure 0 0 0) 0x7f5ecc023020 con 0x7f5ed4144520 2021-12-17T18:25:18.146 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:18.146 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":77,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:25:17.524138+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:25:18.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.140+0000 7f5edacb2700 1 -- 172.21.15.62:0/1039199009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5eb4053580 msgr2=0x7f5eb4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.140+0000 7f5edacb2700 1 --2- 172.21.15.62:0/1039199009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5eb4053580 0x7f5eb4055a40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f5ec400c000 tx=0x7f5ec4008040).stop 2021-12-17T18:25:18.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.140+0000 7f5edacb2700 1 -- 172.21.15.62:0/1039199009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ed4144520 msgr2=0x7f5ed40ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.140+0000 7f5edacb2700 1 --2- 172.21.15.62:0/1039199009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ed4144520 0x7f5ed40ae9a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f5ecc002f70 tx=0x7f5ecc015000).stop 2021-12-17T18:25:18.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.140+0000 7f5edacb2700 1 -- 172.21.15.62:0/1039199009 shutdown_connections 2021-12-17T18:25:18.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.140+0000 7f5edacb2700 1 --2- 172.21.15.62:0/1039199009 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5eb4053580 0x7f5eb4055a40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.140+0000 7f5edacb2700 1 --2- 172.21.15.62:0/1039199009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ed4144520 0x7f5ed40ae9a0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.140+0000 7f5edacb2700 1 --2- 172.21.15.62:0/1039199009 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5ed40b6c70 0x7f5ed4144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.140+0000 7f5edacb2700 1 --2- 172.21.15.62:0/1039199009 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5ed40b5b20 0x7f5ed4144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.140+0000 7f5edacb2700 1 -- 172.21.15.62:0/1039199009 >> 172.21.15.62:0/1039199009 conn(0x7f5ed405c750 msgr2=0x7f5ed405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:18.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.140+0000 7f5edacb2700 1 -- 172.21.15.62:0/1039199009 shutdown_connections 2021-12-17T18:25:18.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.140+0000 7f5edacb2700 1 -- 172.21.15.62:0/1039199009 wait complete. 2021-12-17T18:25:18.158 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-12-17T18:25:18.159 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:25:18.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.260+0000 7fc10b45d700 1 Processor -- start 2021-12-17T18:25:18.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.260+0000 7fc10b45d700 1 -- start start 2021-12-17T18:25:18.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc10b45d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc1040b47c0 0x7fc1040b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc10b45d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1040b5be0 0x7fc104143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc10b45d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1040b0870 con 0x7fc10405ca90 2021-12-17T18:25:18.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc10b45d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10405ce70 con 0x7fc1040b47c0 2021-12-17T18:25:18.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc10b45d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1040b05d0 con 0x7fc1040b5be0 2021-12-17T18:25:18.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc10a45b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc10405ca90 0x7fc1040b1d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36412/0 (socket says 172.21.15.62:36412) 2021-12-17T18:25:18.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc10a45b700 1 -- 172.21.15.62:0/2552510116 learned_addr learned my addr 172.21.15.62:0/2552510116 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:18.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc109c5a700 1 --2- 172.21.15.62:0/2552510116 >> v2:172.21.15.109:3300/0 conn(0x7fc1040b47c0 0x7fc1040b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc10ac5c700 1 --2- 172.21.15.62:0/2552510116 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1040b5be0 0x7fc104143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc109459700 1 -- 172.21.15.62:0/2552510116 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101938928 0 0) 0x7fc1040b0870 con 0x7fc10405ca90 2021-12-17T18:25:18.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc109459700 1 -- 172.21.15.62:0/2552510116 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0ec003260 con 0x7fc10405ca90 2021-12-17T18:25:18.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc109c5a700 1 -- 172.21.15.62:0/2552510116 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1040b5be0 msgr2=0x7fc104143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:18.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc109c5a700 1 --2- 172.21.15.62:0/2552510116 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1040b5be0 0x7fc104143ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc109c5a700 1 -- 172.21.15.62:0/2552510116 >> v1:172.21.15.62:6789/0 conn(0x7fc10405ca90 legacy=0x7fc1040b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc109c5a700 1 -- 172.21.15.62:0/2552510116 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1040b5250 con 0x7fc1040b47c0 2021-12-17T18:25:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc109c5a700 1 --2- 172.21.15.62:0/2552510116 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1040b47c0 0x7fc1040b56f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fc100002f70 tx=0x7fc100006df0).ready entity=mon.1 client_cookie=a13889fb08f6061e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc109459700 1 -- 172.21.15.62:0/2552510116 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc10000d4a0 con 0x7fc1040b47c0 2021-12-17T18:25:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc109459700 1 -- 172.21.15.62:0/2552510116 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc100000e90 con 0x7fc1040b47c0 2021-12-17T18:25:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc109459700 1 -- 172.21.15.62:0/2552510116 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc10000d7f0 con 0x7fc1040b47c0 2021-12-17T18:25:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc10b45d700 1 -- 172.21.15.62:0/2552510116 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1040b47c0 msgr2=0x7fc1040b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc10b45d700 1 --2- 172.21.15.62:0/2552510116 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1040b47c0 0x7fc1040b56f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fc100002f70 tx=0x7fc100006df0).stop 2021-12-17T18:25:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc10b45d700 1 -- 172.21.15.62:0/2552510116 shutdown_connections 2021-12-17T18:25:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc10b45d700 1 --2- 172.21.15.62:0/2552510116 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1040b5be0 0x7fc104143ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc10b45d700 1 --2- 172.21.15.62:0/2552510116 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1040b47c0 0x7fc1040b56f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc10b45d700 1 -- 172.21.15.62:0/2552510116 >> 172.21.15.62:0/2552510116 conn(0x7fc10405bcd0 msgr2=0x7fc104062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc10b45d700 1 -- 172.21.15.62:0/2552510116 shutdown_connections 2021-12-17T18:25:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.264+0000 7fc10b45d700 1 -- 172.21.15.62:0/2552510116 wait complete. 2021-12-17T18:25:18.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc10b45d700 1 Processor -- start 2021-12-17T18:25:18.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc10b45d700 1 -- start start 2021-12-17T18:25:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc10b45d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc10405ca90 0x7fc1040af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc10b45d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1040b47c0 0x7fc104142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc10b45d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1040b5be0 0x7fc104143080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc10b45d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1041568e0 con 0x7fc1040b47c0 2021-12-17T18:25:18.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc10b45d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1040b9b80 con 0x7fc1040b5be0 2021-12-17T18:25:18.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc10b45d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1040b9de0 con 0x7fc10405ca90 2021-12-17T18:25:18.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc109c5a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1040b47c0 0x7fc104142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc109c5a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1040b47c0 0x7fc104142b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52838/0 (socket says 172.21.15.62:52838) 2021-12-17T18:25:18.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc109c5a700 1 -- 172.21.15.62:0/107821761 learned_addr learned my addr 172.21.15.62:0/107821761 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:18.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc10ac5c700 1 --2- 172.21.15.62:0/107821761 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1040b5be0 0x7fc104143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc10a45b700 1 --2- 172.21.15.62:0/107821761 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc10405ca90 0x7fc1040af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc109c5a700 1 -- 172.21.15.62:0/107821761 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc10405ca90 msgr2=0x7fc1040af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc109c5a700 1 --2- 172.21.15.62:0/107821761 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc10405ca90 0x7fc1040af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc109c5a700 1 -- 172.21.15.62:0/107821761 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1040b5be0 msgr2=0x7fc104143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc109c5a700 1 --2- 172.21.15.62:0/107821761 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1040b5be0 0x7fc104143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc109c5a700 1 -- 172.21.15.62:0/107821761 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10000b180 con 0x7fc1040b47c0 2021-12-17T18:25:18.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc10ac5c700 1 --2- 172.21.15.62:0/107821761 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1040b5be0 0x7fc104143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:18.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc109c5a700 1 --2- 172.21.15.62:0/107821761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1040b47c0 0x7fc104142b90 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fc100002f70 tx=0x7fc100014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:18.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc0f77fe700 1 -- 172.21.15.62:0/107821761 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc100016070 con 0x7fc1040b47c0 2021-12-17T18:25:18.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc0f77fe700 1 -- 172.21.15.62:0/107821761 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc100013a40 con 0x7fc1040b47c0 2021-12-17T18:25:18.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc10b45d700 1 -- 172.21.15.62:0/107821761 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1040672a0 con 0x7fc1040b47c0 2021-12-17T18:25:18.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc0f77fe700 1 -- 172.21.15.62:0/107821761 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc100013da0 con 0x7fc1040b47c0 2021-12-17T18:25:18.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.268+0000 7fc10b45d700 1 -- 172.21.15.62:0/107821761 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1040ba280 con 0x7fc1040b47c0 2021-12-17T18:25:18.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.272+0000 7fc0f77fe700 1 -- 172.21.15.62:0/107821761 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc100025030 con 0x7fc1040b47c0 2021-12-17T18:25:18.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.272+0000 7fc0f77fe700 1 --2- 172.21.15.62:0/107821761 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc0e40536d0 0x7fc0e4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.272+0000 7fc10b45d700 1 -- 172.21.15.62:0/107821761 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1040b9fa0 con 0x7fc1040b47c0 2021-12-17T18:25:18.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.272+0000 7fc0f77fe700 1 -- 172.21.15.62:0/107821761 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc10006c660 con 0x7fc1040b47c0 2021-12-17T18:25:18.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.272+0000 7fc10a45b700 1 --2- 172.21.15.62:0/107821761 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc0e40536d0 0x7fc0e4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.272+0000 7fc10a45b700 1 --2- 172.21.15.62:0/107821761 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc0e40536d0 0x7fc0e4055b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fc0f800b000 tx=0x7fc0f8009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.276+0000 7fc0f77fe700 1 -- 172.21.15.62:0/107821761 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc1000439e0 con 0x7fc1040b47c0 2021-12-17T18:25:18.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.400+0000 7fc10b45d700 1 -- 172.21.15.62:0/107821761 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc1040b3980 con 0x7fc1040b47c0 2021-12-17T18:25:18.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.400+0000 7fc0f77fe700 1 -- 172.21.15.62:0/107821761 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v77) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc1000230b0 con 0x7fc1040b47c0 2021-12-17T18:25:18.408 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:25:18.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.404+0000 7fc10b45d700 1 -- 172.21.15.62:0/107821761 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc0e40536d0 msgr2=0x7fc0e4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.404+0000 7fc10b45d700 1 --2- 172.21.15.62:0/107821761 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc0e40536d0 0x7fc0e4055b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fc0f800b000 tx=0x7fc0f8009040).stop 2021-12-17T18:25:18.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.404+0000 7fc10b45d700 1 -- 172.21.15.62:0/107821761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1040b47c0 msgr2=0x7fc104142b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.404+0000 7fc10b45d700 1 --2- 172.21.15.62:0/107821761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1040b47c0 0x7fc104142b90 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fc100002f70 tx=0x7fc100014000).stop 2021-12-17T18:25:18.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.404+0000 7fc10b45d700 1 -- 172.21.15.62:0/107821761 shutdown_connections 2021-12-17T18:25:18.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.404+0000 7fc10b45d700 1 --2- 172.21.15.62:0/107821761 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc0e40536d0 0x7fc0e4055b90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.404+0000 7fc10b45d700 1 --2- 172.21.15.62:0/107821761 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1040b5be0 0x7fc104143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.404+0000 7fc10b45d700 1 --2- 172.21.15.62:0/107821761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1040b47c0 0x7fc104142b90 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.404+0000 7fc10b45d700 1 --2- 172.21.15.62:0/107821761 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc10405ca90 0x7fc1040af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.404+0000 7fc10b45d700 1 -- 172.21.15.62:0/107821761 >> 172.21.15.62:0/107821761 conn(0x7fc10405bcd0 msgr2=0x7fc10405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:18.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.404+0000 7fc10b45d700 1 -- 172.21.15.62:0/107821761 shutdown_connections 2021-12-17T18:25:18.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.404+0000 7fc10b45d700 1 -- 172.21.15.62:0/107821761 wait complete. 2021-12-17T18:25:18.421 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:25:18.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8cd9a0700 1 Processor -- start 2021-12-17T18:25:18.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8cd9a0700 1 -- start start 2021-12-17T18:25:18.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8cd9a0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8c80b4230 0x7fc8c80b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8cd9a0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c805ce70 con 0x7fc8c80b3540 2021-12-17T18:25:18.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8cd9a0700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c80b1bc0 con 0x7fc8c805ca90 2021-12-17T18:25:18.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8cd9a0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c80b1e60 con 0x7fc8c80b4230 2021-12-17T18:25:18.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8c7fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc8c80b3540 0x7fc8c8145a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36428/0 (socket says 172.21.15.62:36428) 2021-12-17T18:25:18.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8c7fff700 1 -- 172.21.15.62:0/910339868 learned_addr learned my addr 172.21.15.62:0/910339868 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:18.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8cd19f700 1 --2- 172.21.15.62:0/910339868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8c80b4230 0x7fc8c80b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8c77fe700 1 -- 172.21.15.62:0/910339868 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677666805 0 0) 0x7fc8c805ce70 con 0x7fc8c80b3540 2021-12-17T18:25:18.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8c77fe700 1 -- 172.21.15.62:0/910339868 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8b4003260 con 0x7fc8c80b3540 2021-12-17T18:25:18.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8c77fe700 1 -- 172.21.15.62:0/910339868 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3450136894 0 0) 0x7fc8b4003260 con 0x7fc8c80b3540 2021-12-17T18:25:18.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8cd19f700 1 -- 172.21.15.62:0/910339868 >> v1:172.21.15.109:6789/0 conn(0x7fc8c805ca90 legacy=0x7fc8c80b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8cd19f700 1 -- 172.21.15.62:0/910339868 >> v1:172.21.15.62:6789/0 conn(0x7fc8c80b3540 legacy=0x7fc8c8145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8cd19f700 1 -- 172.21.15.62:0/910339868 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c80b2100 con 0x7fc8c80b4230 2021-12-17T18:25:18.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8cd19f700 1 --2- 172.21.15.62:0/910339868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8c80b4230 0x7fc8c80b25a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fc8b8001980 tx=0x7fc8c00091d0).ready entity=mon.2 client_cookie=e5ab5560103a8b78 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:18.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8c77fe700 1 -- 172.21.15.62:0/910339868 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8b80017e0 con 0x7fc8c80b4230 2021-12-17T18:25:18.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8c77fe700 1 -- 172.21.15.62:0/910339868 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c000b580 con 0x7fc8c80b4230 2021-12-17T18:25:18.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.532+0000 7fc8c77fe700 1 -- 172.21.15.62:0/910339868 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8c000b6f0 con 0x7fc8c80b4230 2021-12-17T18:25:18.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd9a0700 1 -- 172.21.15.62:0/910339868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8c80b4230 msgr2=0x7fc8c80b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd9a0700 1 --2- 172.21.15.62:0/910339868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8c80b4230 0x7fc8c80b25a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fc8b8001980 tx=0x7fc8c00091d0).stop 2021-12-17T18:25:18.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd9a0700 1 -- 172.21.15.62:0/910339868 shutdown_connections 2021-12-17T18:25:18.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd9a0700 1 --2- 172.21.15.62:0/910339868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8c80b4230 0x7fc8c80b25a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd9a0700 1 -- 172.21.15.62:0/910339868 >> 172.21.15.62:0/910339868 conn(0x7fc8c805bcd0 msgr2=0x7fc8c8062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:18.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd9a0700 1 -- 172.21.15.62:0/910339868 shutdown_connections 2021-12-17T18:25:18.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd9a0700 1 -- 172.21.15.62:0/910339868 wait complete. 2021-12-17T18:25:18.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd9a0700 1 Processor -- start 2021-12-17T18:25:18.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd9a0700 1 -- start start 2021-12-17T18:25:18.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd9a0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8c805ca90 0x7fc8c8146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd9a0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8c80b3540 0x7fc8c8063d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd9a0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c80b4230 0x7fc8c8141080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd9a0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c81496a0 con 0x7fc8c80b4230 2021-12-17T18:25:18.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd9a0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c8145b20 con 0x7fc8c80b3540 2021-12-17T18:25:18.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd9a0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c8145dc0 con 0x7fc8c805ca90 2021-12-17T18:25:18.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd19f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c80b4230 0x7fc8c8141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd19f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c80b4230 0x7fc8c8141080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52856/0 (socket says 172.21.15.62:52856) 2021-12-17T18:25:18.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd19f700 1 -- 172.21.15.62:0/3626347217 learned_addr learned my addr 172.21.15.62:0/3626347217 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:18.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8c7fff700 1 --2- 172.21.15.62:0/3626347217 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8c80b3540 0x7fc8c8063d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cc99e700 1 --2- 172.21.15.62:0/3626347217 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8c805ca90 0x7fc8c8146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd19f700 1 -- 172.21.15.62:0/3626347217 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8c805ca90 msgr2=0x7fc8c8146aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd19f700 1 --2- 172.21.15.62:0/3626347217 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8c805ca90 0x7fc8c8146aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd19f700 1 -- 172.21.15.62:0/3626347217 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8c80b3540 msgr2=0x7fc8c8063d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd19f700 1 --2- 172.21.15.62:0/3626347217 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8c80b3540 0x7fc8c8063d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd19f700 1 -- 172.21.15.62:0/3626347217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c0009470 con 0x7fc8c80b4230 2021-12-17T18:25:18.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8c7fff700 1 --2- 172.21.15.62:0/3626347217 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8c80b3540 0x7fc8c8063d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:18.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cc99e700 1 --2- 172.21.15.62:0/3626347217 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8c805ca90 0x7fc8c8146aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:25:18.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.536+0000 7fc8cd19f700 1 --2- 172.21.15.62:0/3626347217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c80b4230 0x7fc8c8141080 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7fc8b8001980 tx=0x7fc8c0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:18.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.540+0000 7fc8c5ffb700 1 -- 172.21.15.62:0/3626347217 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8c00032d0 con 0x7fc8c80b4230 2021-12-17T18:25:18.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.540+0000 7fc8c5ffb700 1 -- 172.21.15.62:0/3626347217 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c0011a90 con 0x7fc8c80b4230 2021-12-17T18:25:18.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.540+0000 7fc8c5ffb700 1 -- 172.21.15.62:0/3626347217 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8c0011df0 con 0x7fc8c80b4230 2021-12-17T18:25:18.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.540+0000 7fc8cd9a0700 1 -- 172.21.15.62:0/3626347217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c8146260 con 0x7fc8c80b4230 2021-12-17T18:25:18.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.540+0000 7fc8cd9a0700 1 -- 172.21.15.62:0/3626347217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c8064390 con 0x7fc8c80b4230 2021-12-17T18:25:18.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.540+0000 7fc8cd9a0700 1 -- 172.21.15.62:0/3626347217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c8145f80 con 0x7fc8c80b4230 2021-12-17T18:25:18.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.540+0000 7fc8c5ffb700 1 -- 172.21.15.62:0/3626347217 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc8c0026030 con 0x7fc8c80b4230 2021-12-17T18:25:18.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.540+0000 7fc8c5ffb700 1 --2- 172.21.15.62:0/3626347217 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8a80536a0 0x7fc8a8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.540+0000 7fc8c5ffb700 1 -- 172.21.15.62:0/3626347217 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc8c006bfe0 con 0x7fc8c80b4230 2021-12-17T18:25:18.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.540+0000 7fc8cc99e700 1 --2- 172.21.15.62:0/3626347217 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8a80536a0 0x7fc8a8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.544+0000 7fc8cc99e700 1 --2- 172.21.15.62:0/3626347217 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8a80536a0 0x7fc8a8055b60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fc8bc008000 tx=0x7fc8bc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:18.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.544+0000 7fc8c5ffb700 1 -- 172.21.15.62:0/3626347217 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc8c0046ea0 con 0x7fc8c80b4230 2021-12-17T18:25:18.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.668+0000 7fc8cd9a0700 1 -- 172.21.15.62:0/3626347217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc8c80603f0 con 0x7fc8c80b4230 2021-12-17T18:25:18.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.668+0000 7fc8c5ffb700 1 -- 172.21.15.62:0/3626347217 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v77) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc8c0015020 con 0x7fc8c80b4230 2021-12-17T18:25:18.674 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:25:18.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.668+0000 7fc8cd9a0700 1 -- 172.21.15.62:0/3626347217 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8a80536a0 msgr2=0x7fc8a8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.668+0000 7fc8cd9a0700 1 --2- 172.21.15.62:0/3626347217 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8a80536a0 0x7fc8a8055b60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fc8bc008000 tx=0x7fc8bc009040).stop 2021-12-17T18:25:18.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.668+0000 7fc8cd9a0700 1 -- 172.21.15.62:0/3626347217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c80b4230 msgr2=0x7fc8c8141080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.668+0000 7fc8cd9a0700 1 --2- 172.21.15.62:0/3626347217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c80b4230 0x7fc8c8141080 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7fc8b8001980 tx=0x7fc8c0016000).stop 2021-12-17T18:25:18.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.668+0000 7fc8cd9a0700 1 -- 172.21.15.62:0/3626347217 shutdown_connections 2021-12-17T18:25:18.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.668+0000 7fc8cd9a0700 1 --2- 172.21.15.62:0/3626347217 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8a80536a0 0x7fc8a8055b60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.668+0000 7fc8cd9a0700 1 --2- 172.21.15.62:0/3626347217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c80b4230 0x7fc8c8141080 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.668+0000 7fc8cd9a0700 1 --2- 172.21.15.62:0/3626347217 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc8c80b3540 0x7fc8c8063d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.668+0000 7fc8cd9a0700 1 --2- 172.21.15.62:0/3626347217 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8c805ca90 0x7fc8c8146aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.668+0000 7fc8cd9a0700 1 -- 172.21.15.62:0/3626347217 >> 172.21.15.62:0/3626347217 conn(0x7fc8c805bcd0 msgr2=0x7fc8c80b94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:18.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.668+0000 7fc8cd9a0700 1 -- 172.21.15.62:0/3626347217 shutdown_connections 2021-12-17T18:25:18.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.668+0000 7fc8cd9a0700 1 -- 172.21.15.62:0/3626347217 wait complete. 2021-12-17T18:25:18.687 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-12-17T18:25:18.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.788+0000 7f7bf759e700 1 Processor -- start 2021-12-17T18:25:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.788+0000 7f7bf759e700 1 -- start start 2021-12-17T18:25:18.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.788+0000 7f7bf759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bf80a8e10 0x7f7bf8147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.788+0000 7f7bf759e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7bf80a71e0 0x7f7bf80a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.788+0000 7f7bf759e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf80b6270 con 0x7f7bf8141480 2021-12-17T18:25:18.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.788+0000 7f7bf759e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf8147610 con 0x7f7bf80a71e0 2021-12-17T18:25:18.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.788+0000 7f7bf759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf81478b0 con 0x7f7bf80a8e10 2021-12-17T18:25:18.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.788+0000 7f7bf6d9d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7bf80a71e0 0x7f7bf80a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.788+0000 7f7beffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bf80a8e10 0x7f7bf8147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.788+0000 7f7bf6d9d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7bf80a71e0 0x7f7bf80a7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:59414/0 (socket says 172.21.15.62:59414) 2021-12-17T18:25:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.788+0000 7f7bf6d9d700 1 -- 172.21.15.62:0/3668673305 learned_addr learned my addr 172.21.15.62:0/3668673305 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.788+0000 7f7bf659c700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f7bf8141480 0x7f7bf80b5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:52760/0 (socket says 172.21.15.62:52760) 2021-12-17T18:25:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.788+0000 7f7beffff700 1 -- 172.21.15.62:0/3668673305 >> v2:172.21.15.109:3300/0 conn(0x7f7bf80a71e0 msgr2=0x7f7bf80a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:18.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.788+0000 7f7beffff700 1 --2- 172.21.15.62:0/3668673305 >> v2:172.21.15.109:3300/0 conn(0x7f7bf80a71e0 0x7f7bf80a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.788+0000 7f7beffff700 1 -- 172.21.15.62:0/3668673305 >> v1:172.21.15.109:6789/0 conn(0x7f7bf8141480 legacy=0x7f7bf80b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.788+0000 7f7beffff700 1 -- 172.21.15.62:0/3668673305 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf8147b50 con 0x7f7bf80a8e10 2021-12-17T18:25:18.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.788+0000 7f7bf6d9d700 1 --2- 172.21.15.62:0/3668673305 >> v2:172.21.15.109:3300/0 conn(0x7f7bf80a71e0 0x7f7bf80a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:18.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7beffff700 1 --2- 172.21.15.62:0/3668673305 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bf80a8e10 0x7f7bf8147ff0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f7be0002f70 tx=0x7f7be0006df0).ready entity=mon.2 client_cookie=672d827a9cee18fd server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:18.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf5d9b700 1 -- 172.21.15.62:0/3668673305 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be000d570 con 0x7f7bf80a8e10 2021-12-17T18:25:18.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf5d9b700 1 -- 172.21.15.62:0/3668673305 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be0000e90 con 0x7f7bf80a8e10 2021-12-17T18:25:18.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf5d9b700 1 -- 172.21.15.62:0/3668673305 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be000d8c0 con 0x7f7bf80a8e10 2021-12-17T18:25:18.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf759e700 1 -- 172.21.15.62:0/3668673305 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bf80a8e10 msgr2=0x7f7bf8147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf759e700 1 --2- 172.21.15.62:0/3668673305 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bf80a8e10 0x7f7bf8147ff0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f7be0002f70 tx=0x7f7be0006df0).stop 2021-12-17T18:25:18.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf759e700 1 -- 172.21.15.62:0/3668673305 shutdown_connections 2021-12-17T18:25:18.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf759e700 1 --2- 172.21.15.62:0/3668673305 >> v2:172.21.15.109:3300/0 conn(0x7f7bf80a71e0 0x7f7bf80a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf759e700 1 --2- 172.21.15.62:0/3668673305 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bf80a8e10 0x7f7bf8147ff0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf759e700 1 -- 172.21.15.62:0/3668673305 >> 172.21.15.62:0/3668673305 conn(0x7f7bf805d220 msgr2=0x7f7bf80b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:18.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf759e700 1 -- 172.21.15.62:0/3668673305 shutdown_connections 2021-12-17T18:25:18.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf759e700 1 -- 172.21.15.62:0/3668673305 wait complete. 2021-12-17T18:25:18.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf759e700 1 Processor -- start 2021-12-17T18:25:18.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf759e700 1 -- start start 2021-12-17T18:25:18.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bf80a71e0 0x7f7bf80aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bf80a8e10 0x7f7bf815ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf8141480 0x7f7bf80aada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf815b320 con 0x7f7bf8141480 2021-12-17T18:25:18.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf8148ae0 con 0x7f7bf80a71e0 2021-12-17T18:25:18.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf8148d80 con 0x7f7bf80a8e10 2021-12-17T18:25:18.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf6d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf8141480 0x7f7bf80aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf6d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf8141480 0x7f7bf80aada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52870/0 (socket says 172.21.15.62:52870) 2021-12-17T18:25:18.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf6d9d700 1 -- 172.21.15.62:0/780836112 learned_addr learned my addr 172.21.15.62:0/780836112 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:18.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7bf659c700 1 --2- 172.21.15.62:0/780836112 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bf80a71e0 0x7f7bf80aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.792+0000 7f7beffff700 1 --2- 172.21.15.62:0/780836112 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bf80a8e10 0x7f7bf815ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.796+0000 7f7bf659c700 1 -- 172.21.15.62:0/780836112 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bf80a8e10 msgr2=0x7f7bf815ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.796+0000 7f7bf659c700 1 --2- 172.21.15.62:0/780836112 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bf80a8e10 0x7f7bf815ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.796+0000 7f7bf659c700 1 -- 172.21.15.62:0/780836112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf8141480 msgr2=0x7f7bf80aada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.796+0000 7f7bf659c700 1 --2- 172.21.15.62:0/780836112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf8141480 0x7f7bf80aada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.796+0000 7f7bf659c700 1 -- 172.21.15.62:0/780836112 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf0009530 con 0x7f7bf80a71e0 2021-12-17T18:25:18.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.796+0000 7f7bf6d9d700 1 --2- 172.21.15.62:0/780836112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf8141480 0x7f7bf80aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:18.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.796+0000 7f7bf659c700 1 --2- 172.21.15.62:0/780836112 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bf80a71e0 0x7f7bf80aece0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f7bf8148a00 tx=0x7f7be8007ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:18.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.796+0000 7f7bef7fe700 1 -- 172.21.15.62:0/780836112 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be8007e30 con 0x7f7bf80a71e0 2021-12-17T18:25:18.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.796+0000 7f7bef7fe700 1 -- 172.21.15.62:0/780836112 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be80070d0 con 0x7f7bf80a71e0 2021-12-17T18:25:18.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.796+0000 7f7bf759e700 1 -- 172.21.15.62:0/780836112 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be000b180 con 0x7f7bf80a71e0 2021-12-17T18:25:18.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.796+0000 7f7bef7fe700 1 -- 172.21.15.62:0/780836112 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be8007430 con 0x7f7bf80a71e0 2021-12-17T18:25:18.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.796+0000 7f7bf759e700 1 -- 172.21.15.62:0/780836112 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf80abfb0 con 0x7f7bf80a71e0 2021-12-17T18:25:18.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.796+0000 7f7bf759e700 1 -- 172.21.15.62:0/780836112 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf8149100 con 0x7f7bf80a71e0 2021-12-17T18:25:18.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.796+0000 7f7bef7fe700 1 -- 172.21.15.62:0/780836112 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7be8010070 con 0x7f7bf80a71e0 2021-12-17T18:25:18.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.796+0000 7f7bef7fe700 1 --2- 172.21.15.62:0/780836112 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7bdc053610 0x7f7bdc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:18.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.796+0000 7f7bef7fe700 1 -- 172.21.15.62:0/780836112 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7be806a980 con 0x7f7bf80a71e0 2021-12-17T18:25:18.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.796+0000 7f7beffff700 1 --2- 172.21.15.62:0/780836112 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7bdc053610 0x7f7bdc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:18.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.800+0000 7f7beffff700 1 --2- 172.21.15.62:0/780836112 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7bdc053610 0x7f7bdc055ad0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f7be001a000 tx=0x7f7be0014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:18.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.808+0000 7f7bef7fe700 1 -- 172.21.15.62:0/780836112 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7be8041e10 con 0x7f7bf80a71e0 2021-12-17T18:25:18.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.936+0000 7f7bf759e700 1 -- 172.21.15.62:0/780836112 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7bf80b1b90 con 0x7f7bf80a71e0 2021-12-17T18:25:18.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.940+0000 7f7bef7fe700 1 -- 172.21.15.62:0/780836112 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) v1 ==== 84+0+143 (secure 0 0 0) 0x7f7be8045430 con 0x7f7bf80a71e0 2021-12-17T18:25:18.944 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:18.944 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2021-12-17T18:25:18.945 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:18.945 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2021-12-17T18:25:18.945 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "device_health_metrics" 2021-12-17T18:25:18.946 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:18.946 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:18.946 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2021-12-17T18:25:18.947 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2021-12-17T18:25:18.947 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:18.947 INFO:teuthology.orchestra.run.smithi062.stdout:] 2021-12-17T18:25:18.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.940+0000 7f7bf759e700 1 -- 172.21.15.62:0/780836112 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7bdc053610 msgr2=0x7f7bdc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.940+0000 7f7bf759e700 1 --2- 172.21.15.62:0/780836112 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7bdc053610 0x7f7bdc055ad0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f7be001a000 tx=0x7f7be0014000).stop 2021-12-17T18:25:18.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.940+0000 7f7bf759e700 1 -- 172.21.15.62:0/780836112 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bf80a71e0 msgr2=0x7f7bf80aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:18.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.940+0000 7f7bf759e700 1 --2- 172.21.15.62:0/780836112 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bf80a71e0 0x7f7bf80aece0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f7bf8148a00 tx=0x7f7be8007ba0).stop 2021-12-17T18:25:18.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.940+0000 7f7bf759e700 1 -- 172.21.15.62:0/780836112 shutdown_connections 2021-12-17T18:25:18.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.940+0000 7f7bf759e700 1 --2- 172.21.15.62:0/780836112 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7bdc053610 0x7f7bdc055ad0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.940+0000 7f7bf759e700 1 --2- 172.21.15.62:0/780836112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf8141480 0x7f7bf80aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.940+0000 7f7bf759e700 1 --2- 172.21.15.62:0/780836112 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bf80a8e10 0x7f7bf815ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.940+0000 7f7bf759e700 1 --2- 172.21.15.62:0/780836112 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bf80a71e0 0x7f7bf80aece0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:18.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.940+0000 7f7bf759e700 1 -- 172.21.15.62:0/780836112 >> 172.21.15.62:0/780836112 conn(0x7f7bf805d220 msgr2=0x7f7bf81469d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:18.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.940+0000 7f7bf759e700 1 -- 172.21.15.62:0/780836112 shutdown_connections 2021-12-17T18:25:18.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:18.940+0000 7f7bf759e700 1 -- 172.21.15.62:0/780836112 wait complete. 2021-12-17T18:25:18.963 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-12-17T18:25:18.964 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-12-17T18:25:19.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.072+0000 7f0e0dc06700 1 Processor -- start 2021-12-17T18:25:19.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.072+0000 7f0e0dc06700 1 -- start start 2021-12-17T18:25:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.072+0000 7f0e0dc06700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e08065ba0 0x7f0e08066330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.072+0000 7f0e0dc06700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f0e08144220 0x7f0e08144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.072+0000 7f0e0dc06700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e08066a40 con 0x7f0e080b6700 2021-12-17T18:25:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.072+0000 7f0e0dc06700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e08066820 con 0x7f0e08065ba0 2021-12-17T18:25:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.072+0000 7f0e0dc06700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e08140b00 con 0x7f0e08144220 2021-12-17T18:25:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.072+0000 7f0e07fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e08065ba0 0x7f0e08066330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.072+0000 7f0e07fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e08065ba0 0x7f0e08066330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52876/0 (socket says 172.21.15.62:52876) 2021-12-17T18:25:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.072+0000 7f0e07fff700 1 -- 172.21.15.62:0/615575186 learned_addr learned my addr 172.21.15.62:0/615575186 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:19.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.072+0000 7f0e0d405700 1 --2- 172.21.15.62:0/615575186 >> v2:172.21.15.109:3300/0 conn(0x7f0e08144220 0x7f0e08144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:19.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.072+0000 7f0e07fff700 1 -- 172.21.15.62:0/615575186 >> v2:172.21.15.109:3300/0 conn(0x7f0e08144220 msgr2=0x7f0e08144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:19.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.072+0000 7f0e07fff700 1 --2- 172.21.15.62:0/615575186 >> v2:172.21.15.109:3300/0 conn(0x7f0e08144220 0x7f0e08144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:19.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.072+0000 7f0e07fff700 1 -- 172.21.15.62:0/615575186 >> v1:172.21.15.109:6789/0 conn(0x7f0e080b6700 legacy=0x7f0e080aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:19.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.072+0000 7f0e07fff700 1 -- 172.21.15.62:0/615575186 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e080b6ae0 con 0x7f0e08065ba0 2021-12-17T18:25:19.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.072+0000 7f0e07fff700 1 --2- 172.21.15.62:0/615575186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e08065ba0 0x7f0e08066330 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f0e080ae4f0 tx=0x7f0df4006eb0).ready entity=mon.0 client_cookie=dd3c5a4a55a9ac75 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:19.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e077fe700 1 -- 172.21.15.62:0/615575186 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0df400d5c0 con 0x7f0e08065ba0 2021-12-17T18:25:19.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e077fe700 1 -- 172.21.15.62:0/615575186 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df4000e90 con 0x7f0e08065ba0 2021-12-17T18:25:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e077fe700 1 -- 172.21.15.62:0/615575186 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0df400d950 con 0x7f0e08065ba0 2021-12-17T18:25:19.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0dc06700 1 -- 172.21.15.62:0/615575186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e08065ba0 msgr2=0x7f0e08066330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:19.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0dc06700 1 --2- 172.21.15.62:0/615575186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e08065ba0 0x7f0e08066330 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f0e080ae4f0 tx=0x7f0df4006eb0).stop 2021-12-17T18:25:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0dc06700 1 -- 172.21.15.62:0/615575186 shutdown_connections 2021-12-17T18:25:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0dc06700 1 --2- 172.21.15.62:0/615575186 >> v2:172.21.15.109:3300/0 conn(0x7f0e08144220 0x7f0e08144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0dc06700 1 --2- 172.21.15.62:0/615575186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e08065ba0 0x7f0e08066330 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0dc06700 1 -- 172.21.15.62:0/615575186 >> 172.21.15.62:0/615575186 conn(0x7f0e0805c750 msgr2=0x7f0e080b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:19.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0dc06700 1 -- 172.21.15.62:0/615575186 shutdown_connections 2021-12-17T18:25:19.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0dc06700 1 -- 172.21.15.62:0/615575186 wait complete. 2021-12-17T18:25:19.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0dc06700 1 Processor -- start 2021-12-17T18:25:19.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0dc06700 1 -- start start 2021-12-17T18:25:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0dc06700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e08065ba0 0x7f0e08064b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0dc06700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0e080b6700 0x7f0e080af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0dc06700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0e08144220 0x7f0e080b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0dc06700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080b0600 con 0x7f0e08065ba0 2021-12-17T18:25:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0dc06700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080638b0 con 0x7f0e080b6700 2021-12-17T18:25:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0dc06700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080b1d80 con 0x7f0e08144220 2021-12-17T18:25:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0cc04700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e08065ba0 0x7f0e08064b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0cc04700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e08065ba0 0x7f0e08064b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52880/0 (socket says 172.21.15.62:52880) 2021-12-17T18:25:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e07fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0e080b6700 0x7f0e080af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0d405700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0e08144220 0x7f0e080b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.076+0000 7f0e0cc04700 1 -- 172.21.15.62:0/2093304573 learned_addr learned my addr 172.21.15.62:0/2093304573 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.080+0000 7f0e0cc04700 1 -- 172.21.15.62:0/2093304573 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0e08144220 msgr2=0x7f0e080b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.080+0000 7f0e0cc04700 1 --2- 172.21.15.62:0/2093304573 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0e08144220 0x7f0e080b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.080+0000 7f0e0cc04700 1 -- 172.21.15.62:0/2093304573 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0e080b6700 msgr2=0x7f0e080af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:19.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.080+0000 7f0e0cc04700 1 --2- 172.21.15.62:0/2093304573 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0e080b6700 0x7f0e080af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:19.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.080+0000 7f0e0cc04700 1 -- 172.21.15.62:0/2093304573 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df400b1e0 con 0x7f0e08065ba0 2021-12-17T18:25:19.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.080+0000 7f0e07fff700 1 --2- 172.21.15.62:0/2093304573 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0e080b6700 0x7f0e080af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:19.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.080+0000 7f0e0cc04700 1 --2- 172.21.15.62:0/2093304573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e08065ba0 0x7f0e08064b40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f0e0805c400 tx=0x7f0dfc007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.080+0000 7f0e05ffb700 1 -- 172.21.15.62:0/2093304573 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dfc012400 con 0x7f0e08065ba0 2021-12-17T18:25:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.080+0000 7f0e05ffb700 1 -- 172.21.15.62:0/2093304573 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc012560 con 0x7f0e08065ba0 2021-12-17T18:25:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.080+0000 7f0e0dc06700 1 -- 172.21.15.62:0/2093304573 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e08063ae0 con 0x7f0e08065ba0 2021-12-17T18:25:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.080+0000 7f0e05ffb700 1 -- 172.21.15.62:0/2093304573 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dfc0128c0 con 0x7f0e08065ba0 2021-12-17T18:25:19.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.080+0000 7f0e0dc06700 1 -- 172.21.15.62:0/2093304573 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e08063520 con 0x7f0e08065ba0 2021-12-17T18:25:19.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.080+0000 7f0e05ffb700 1 -- 172.21.15.62:0/2093304573 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0dfc019030 con 0x7f0e08065ba0 2021-12-17T18:25:19.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.080+0000 7f0e0dc06700 1 -- 172.21.15.62:0/2093304573 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e080ae760 con 0x7f0e08065ba0 2021-12-17T18:25:19.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.084+0000 7f0e05ffb700 1 --2- 172.21.15.62:0/2093304573 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0de80536a0 0x7f0de8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:19.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.084+0000 7f0e05ffb700 1 -- 172.21.15.62:0/2093304573 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0dfc06aa20 con 0x7f0e08065ba0 2021-12-17T18:25:19.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.084+0000 7f0e07fff700 1 --2- 172.21.15.62:0/2093304573 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0de80536a0 0x7f0de8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.084+0000 7f0e07fff700 1 --2- 172.21.15.62:0/2093304573 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0de80536a0 0x7f0de8055b60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f0df401b000 tx=0x7f0df4015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.088+0000 7f0e05ffb700 1 -- 172.21.15.62:0/2093304573 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0dfc041d40 con 0x7f0e08065ba0 2021-12-17T18:25:19.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:19.216+0000 7f0e0dc06700 1 -- 172.21.15.62:0/2093304573 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f0e080573d0 con 0x7f0e08065ba0 2021-12-17T18:25:20.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.192+0000 7f0e05ffb700 1 -- 172.21.15.62:0/2093304573 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v78) v1 ==== 133+0+0 (secure 0 0 0) 0x7f0dfc045360 con 0x7f0e08065ba0 2021-12-17T18:25:20.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.196+0000 7f0e0dc06700 1 -- 172.21.15.62:0/2093304573 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0de80536a0 msgr2=0x7f0de8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:20.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.196+0000 7f0e0dc06700 1 --2- 172.21.15.62:0/2093304573 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0de80536a0 0x7f0de8055b60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f0df401b000 tx=0x7f0df4015000).stop 2021-12-17T18:25:20.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.196+0000 7f0e0dc06700 1 -- 172.21.15.62:0/2093304573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e08065ba0 msgr2=0x7f0e08064b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:20.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.196+0000 7f0e0dc06700 1 --2- 172.21.15.62:0/2093304573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e08065ba0 0x7f0e08064b40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f0e0805c400 tx=0x7f0dfc007c50).stop 2021-12-17T18:25:20.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.196+0000 7f0e0dc06700 1 -- 172.21.15.62:0/2093304573 shutdown_connections 2021-12-17T18:25:20.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.196+0000 7f0e0dc06700 1 --2- 172.21.15.62:0/2093304573 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0de80536a0 0x7f0de8055b60 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.196+0000 7f0e0dc06700 1 --2- 172.21.15.62:0/2093304573 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0e08144220 0x7f0e080b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.196+0000 7f0e0dc06700 1 --2- 172.21.15.62:0/2093304573 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0e080b6700 0x7f0e080af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.196+0000 7f0e0dc06700 1 --2- 172.21.15.62:0/2093304573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e08065ba0 0x7f0e08064b40 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.196+0000 7f0e0dc06700 1 -- 172.21.15.62:0/2093304573 >> 172.21.15.62:0/2093304573 conn(0x7f0e0805c750 msgr2=0x7f0e080b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:20.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.196+0000 7f0e0dc06700 1 -- 172.21.15.62:0/2093304573 shutdown_connections 2021-12-17T18:25:20.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.196+0000 7f0e0dc06700 1 -- 172.21.15.62:0/2093304573 wait complete. 2021-12-17T18:25:20.205 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2021-12-17T18:25:20.215 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-12-17T18:25:20.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.320+0000 7f5ddae0e700 1 Processor -- start 2021-12-17T18:25:20.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.320+0000 7f5ddae0e700 1 -- start start 2021-12-17T18:25:20.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.320+0000 7f5ddae0e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5dd405c750 0x7f5dd405cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:20.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5ddae0e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd41473c0 con 0x7f5dd4146f70 2021-12-17T18:25:20.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5ddae0e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd4142ff0 con 0x7f5dd4060260 2021-12-17T18:25:20.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5ddae0e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd4143290 con 0x7f5dd405c750 2021-12-17T18:25:20.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5dd93ab700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5dd4146f70 0x7f5dd40b4c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36470/0 (socket says 172.21.15.62:36470) 2021-12-17T18:25:20.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5dd8baa700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5dd405c750 0x7f5dd405cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:20.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5dd93ab700 1 -- 172.21.15.62:0/3792642341 learned_addr learned my addr 172.21.15.62:0/3792642341 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:20.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5dcb7fe700 1 -- 172.21.15.62:0/3792642341 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126952619 0 0) 0x7f5dcc001490 con 0x7f5dd4146f70 2021-12-17T18:25:20.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5dcb7fe700 1 -- 172.21.15.62:0/3792642341 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dc0003260 con 0x7f5dd4146f70 2021-12-17T18:25:20.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5dd8baa700 1 -- 172.21.15.62:0/3792642341 >> v1:172.21.15.109:6789/0 conn(0x7f5dd4060260 legacy=0x7f5dd41439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:20.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5dd8baa700 1 -- 172.21.15.62:0/3792642341 >> v1:172.21.15.62:6789/0 conn(0x7f5dd4146f70 legacy=0x7f5dd40b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:20.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5dd8baa700 1 -- 172.21.15.62:0/3792642341 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd4143530 con 0x7f5dd405c750 2021-12-17T18:25:20.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5dd8baa700 1 --2- 172.21.15.62:0/3792642341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd405c750 0x7f5dd405cb30 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f5dd0002f70 tx=0x7f5dd0006df0).ready entity=mon.0 client_cookie=e48e681ff07635d4 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:20.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5dcb7fe700 1 -- 172.21.15.62:0/3792642341 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dd000d610 con 0x7f5dd405c750 2021-12-17T18:25:20.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5dcb7fe700 1 -- 172.21.15.62:0/3792642341 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd0000e90 con 0x7f5dd405c750 2021-12-17T18:25:20.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5dcb7fe700 1 -- 172.21.15.62:0/3792642341 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dd000d960 con 0x7f5dd405c750 2021-12-17T18:25:20.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5ddae0e700 1 -- 172.21.15.62:0/3792642341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd405c750 msgr2=0x7f5dd405cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:20.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5ddae0e700 1 --2- 172.21.15.62:0/3792642341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd405c750 0x7f5dd405cb30 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f5dd0002f70 tx=0x7f5dd0006df0).stop 2021-12-17T18:25:20.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5ddae0e700 1 -- 172.21.15.62:0/3792642341 shutdown_connections 2021-12-17T18:25:20.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5ddae0e700 1 --2- 172.21.15.62:0/3792642341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd405c750 0x7f5dd405cb30 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5ddae0e700 1 -- 172.21.15.62:0/3792642341 >> 172.21.15.62:0/3792642341 conn(0x7f5dd4062430 msgr2=0x7f5dd4062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:20.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5ddae0e700 1 -- 172.21.15.62:0/3792642341 shutdown_connections 2021-12-17T18:25:20.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5ddae0e700 1 -- 172.21.15.62:0/3792642341 wait complete. 2021-12-17T18:25:20.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5ddae0e700 1 Processor -- start 2021-12-17T18:25:20.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.324+0000 7f5ddae0e700 1 -- start start 2021-12-17T18:25:20.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5ddae0e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5dd405c750 0x7f5dd41405f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:20.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5ddae0e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd4060260 0x7f5dd413d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:20.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5ddae0e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5dd4146f70 0x7f5dd413dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:20.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5ddae0e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd4066960 con 0x7f5dd4060260 2021-12-17T18:25:20.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5ddae0e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd4066c00 con 0x7f5dd4146f70 2021-12-17T18:25:20.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5ddae0e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd4066ea0 con 0x7f5dd405c750 2021-12-17T18:25:20.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5dcbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd4060260 0x7f5dd413d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:20.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5dcbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd4060260 0x7f5dd413d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52896/0 (socket says 172.21.15.62:52896) 2021-12-17T18:25:20.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5dcbfff700 1 -- 172.21.15.62:0/3715515077 learned_addr learned my addr 172.21.15.62:0/3715515077 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:20.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5dd93ab700 1 --2- 172.21.15.62:0/3715515077 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5dd4146f70 0x7f5dd413dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:20.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5dd8baa700 1 --2- 172.21.15.62:0/3715515077 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5dd405c750 0x7f5dd41405f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:20.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5dcbfff700 1 -- 172.21.15.62:0/3715515077 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5dd405c750 msgr2=0x7f5dd41405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:20.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5dcbfff700 1 --2- 172.21.15.62:0/3715515077 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5dd405c750 0x7f5dd41405f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5dcbfff700 1 -- 172.21.15.62:0/3715515077 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5dd4146f70 msgr2=0x7f5dd413dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:20.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5dcbfff700 1 --2- 172.21.15.62:0/3715515077 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5dd4146f70 0x7f5dd413dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5dcbfff700 1 -- 172.21.15.62:0/3715515077 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd000b180 con 0x7f5dd4060260 2021-12-17T18:25:20.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5dcbfff700 1 --2- 172.21.15.62:0/3715515077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd4060260 0x7f5dd413d7d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f5dd405d110 tx=0x7f5dc4007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:20.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5dc9ffb700 1 -- 172.21.15.62:0/3715515077 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dc4012400 con 0x7f5dd4060260 2021-12-17T18:25:20.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5dc9ffb700 1 -- 172.21.15.62:0/3715515077 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc4012560 con 0x7f5dd4060260 2021-12-17T18:25:20.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5ddae0e700 1 -- 172.21.15.62:0/3715515077 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd4067340 con 0x7f5dd4060260 2021-12-17T18:25:20.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5dc9ffb700 1 -- 172.21.15.62:0/3715515077 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dc40128c0 con 0x7f5dd4060260 2021-12-17T18:25:20.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5ddae0e700 1 -- 172.21.15.62:0/3715515077 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd40665e0 con 0x7f5dd4060260 2021-12-17T18:25:20.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.328+0000 7f5ddae0e700 1 -- 172.21.15.62:0/3715515077 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd4067060 con 0x7f5dd4060260 2021-12-17T18:25:20.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.332+0000 7f5dc9ffb700 1 -- 172.21.15.62:0/3715515077 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5dc4019030 con 0x7f5dd4060260 2021-12-17T18:25:20.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.332+0000 7f5dc9ffb700 1 --2- 172.21.15.62:0/3715515077 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5db4053610 0x7f5db4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:20.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.332+0000 7f5dc9ffb700 1 -- 172.21.15.62:0/3715515077 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f5dc406aaa0 con 0x7f5dd4060260 2021-12-17T18:25:20.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.332+0000 7f5dd8baa700 1 --2- 172.21.15.62:0/3715515077 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5db4053610 0x7f5db4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:20.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.332+0000 7f5dd8baa700 1 --2- 172.21.15.62:0/3715515077 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5db4053610 0x7f5db4055ad0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f5dd001a000 tx=0x7f5dd0014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:20.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.340+0000 7f5dc9ffb700 1 -- 172.21.15.62:0/3715515077 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5dc4041d70 con 0x7f5dd4060260 2021-12-17T18:25:20.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.468+0000 7f5ddae0e700 1 -- 172.21.15.62:0/3715515077 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f5dd40b52b0 con 0x7f5dd4060260 2021-12-17T18:25:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.568+0000 7f5dc9ffb700 1 -- 172.21.15.62:0/3715515077 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v79) v1 ==== 125+0+0 (secure 0 0 0) 0x7f5dc4045390 con 0x7f5dd4060260 2021-12-17T18:25:20.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.572+0000 7f5ddae0e700 1 -- 172.21.15.62:0/3715515077 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5db4053610 msgr2=0x7f5db4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:20.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.572+0000 7f5ddae0e700 1 --2- 172.21.15.62:0/3715515077 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5db4053610 0x7f5db4055ad0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f5dd001a000 tx=0x7f5dd0014000).stop 2021-12-17T18:25:20.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.572+0000 7f5ddae0e700 1 -- 172.21.15.62:0/3715515077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd4060260 msgr2=0x7f5dd413d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.572+0000 7f5ddae0e700 1 --2- 172.21.15.62:0/3715515077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd4060260 0x7f5dd413d7d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f5dd405d110 tx=0x7f5dc4007c50).stop 2021-12-17T18:25:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.572+0000 7f5ddae0e700 1 -- 172.21.15.62:0/3715515077 shutdown_connections 2021-12-17T18:25:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.572+0000 7f5ddae0e700 1 --2- 172.21.15.62:0/3715515077 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5db4053610 0x7f5db4055ad0 secure :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0x7f5dd001a000 tx=0x7f5dd0014000).stop 2021-12-17T18:25:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.572+0000 7f5ddae0e700 1 --2- 172.21.15.62:0/3715515077 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5dd4146f70 0x7f5dd413dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.572+0000 7f5ddae0e700 1 --2- 172.21.15.62:0/3715515077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd4060260 0x7f5dd413d7d0 secure :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0x7f5dd405d110 tx=0x7f5dc4007c50).stop 2021-12-17T18:25:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.572+0000 7f5ddae0e700 1 --2- 172.21.15.62:0/3715515077 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5dd405c750 0x7f5dd41405f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.572+0000 7f5ddae0e700 1 -- 172.21.15.62:0/3715515077 >> 172.21.15.62:0/3715515077 conn(0x7f5dd4062430 msgr2=0x7f5dd4145600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.572+0000 7f5ddae0e700 1 -- 172.21.15.62:0/3715515077 shutdown_connections 2021-12-17T18:25:20.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.572+0000 7f5ddae0e700 1 -- 172.21.15.62:0/3715515077 wait complete. 2021-12-17T18:25:20.581 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2021-12-17T18:25:20.594 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-12-17T18:25:20.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.692+0000 7f3343041700 1 Processor -- start 2021-12-17T18:25:20.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.692+0000 7f3343041700 1 -- start start 2021-12-17T18:25:20.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.692+0000 7f3343041700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f333c0b34b0 0x7f333c0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:20.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.692+0000 7f3343041700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f333c0604b0 0x7f333c146230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:20.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.692+0000 7f3343041700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333c05ce70 con 0x7f333c05ca90 2021-12-17T18:25:20.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.692+0000 7f3343041700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333c0b2d70 con 0x7f333c0604b0 2021-12-17T18:25:20.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.692+0000 7f3343041700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0b3010 con 0x7f333c0b34b0 2021-12-17T18:25:20.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.692+0000 7f334203f700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f333c05ca90 0x7f333c145b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36482/0 (socket says 172.21.15.62:36482) 2021-12-17T18:25:20.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f334203f700 1 -- 172.21.15.62:0/2639282230 learned_addr learned my addr 172.21.15.62:0/2639282230 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:20.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f3342840700 1 --2- 172.21.15.62:0/2639282230 >> v2:172.21.15.109:3300/0 conn(0x7f333c0604b0 0x7f333c146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:20.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f334183e700 1 --2- 172.21.15.62:0/2639282230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f333c0b34b0 0x7f333c0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:20.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f334103d700 1 -- 172.21.15.62:0/2639282230 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050567946 0 0) 0x7f333c05ce70 con 0x7f333c05ca90 2021-12-17T18:25:20.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f334103d700 1 -- 172.21.15.62:0/2639282230 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3324003260 con 0x7f333c05ca90 2021-12-17T18:25:20.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f334183e700 1 -- 172.21.15.62:0/2639282230 >> v2:172.21.15.109:3300/0 conn(0x7f333c0604b0 msgr2=0x7f333c146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:20.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f334183e700 1 --2- 172.21.15.62:0/2639282230 >> v2:172.21.15.109:3300/0 conn(0x7f333c0604b0 0x7f333c146230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f334183e700 1 -- 172.21.15.62:0/2639282230 >> v1:172.21.15.62:6789/0 conn(0x7f333c05ca90 legacy=0x7f333c145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:20.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f334183e700 1 -- 172.21.15.62:0/2639282230 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c0b2ab0 con 0x7f333c0b34b0 2021-12-17T18:25:20.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f334183e700 1 --2- 172.21.15.62:0/2639282230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f333c0b34b0 0x7f333c0b2470 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f3338002f70 tx=0x7f3338006df0).ready entity=mon.2 client_cookie=ae863654209b707d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f334103d700 1 -- 172.21.15.62:0/2639282230 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f333800d4a0 con 0x7f333c0b34b0 2021-12-17T18:25:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f334103d700 1 -- 172.21.15.62:0/2639282230 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3338000e90 con 0x7f333c0b34b0 2021-12-17T18:25:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f334103d700 1 -- 172.21.15.62:0/2639282230 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f333800d7f0 con 0x7f333c0b34b0 2021-12-17T18:25:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f3343041700 1 -- 172.21.15.62:0/2639282230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f333c0b34b0 msgr2=0x7f333c0b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:20.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f3343041700 1 --2- 172.21.15.62:0/2639282230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f333c0b34b0 0x7f333c0b2470 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f3338002f70 tx=0x7f3338006df0).stop 2021-12-17T18:25:20.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f3343041700 1 -- 172.21.15.62:0/2639282230 shutdown_connections 2021-12-17T18:25:20.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f3343041700 1 --2- 172.21.15.62:0/2639282230 >> v2:172.21.15.109:3300/0 conn(0x7f333c0604b0 0x7f333c146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f3343041700 1 --2- 172.21.15.62:0/2639282230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f333c0b34b0 0x7f333c0b2470 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f3343041700 1 -- 172.21.15.62:0/2639282230 >> 172.21.15.62:0/2639282230 conn(0x7f333c05bcd0 msgr2=0x7f333c062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:20.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f3343041700 1 -- 172.21.15.62:0/2639282230 shutdown_connections 2021-12-17T18:25:20.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.696+0000 7f3343041700 1 -- 172.21.15.62:0/2639282230 wait complete. 2021-12-17T18:25:20.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f3343041700 1 Processor -- start 2021-12-17T18:25:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f3343041700 1 -- start start 2021-12-17T18:25:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f3343041700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f333c05ca90 0x7f333c147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f3343041700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f333c0604b0 0x7f333c1406e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f3343041700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f333c0b34b0 0x7f333c152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:20.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f3343041700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c152590 con 0x7f333c05ca90 2021-12-17T18:25:20.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f3343041700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c152830 con 0x7f333c0b34b0 2021-12-17T18:25:20.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f3343041700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c152ad0 con 0x7f333c0604b0 2021-12-17T18:25:20.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f334203f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f333c05ca90 0x7f333c147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:20.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f334203f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f333c05ca90 0x7f333c147aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52908/0 (socket says 172.21.15.62:52908) 2021-12-17T18:25:20.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f334203f700 1 -- 172.21.15.62:0/261170401 learned_addr learned my addr 172.21.15.62:0/261170401 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:20.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f3342840700 1 --2- 172.21.15.62:0/261170401 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f333c0b34b0 0x7f333c152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:20.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f334183e700 1 --2- 172.21.15.62:0/261170401 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f333c0604b0 0x7f333c1406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:20.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f334203f700 1 -- 172.21.15.62:0/261170401 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f333c0604b0 msgr2=0x7f333c1406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:20.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f334203f700 1 --2- 172.21.15.62:0/261170401 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f333c0604b0 0x7f333c1406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f334203f700 1 -- 172.21.15.62:0/261170401 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f333c0b34b0 msgr2=0x7f333c152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:20.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f334203f700 1 --2- 172.21.15.62:0/261170401 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f333c0b34b0 0x7f333c152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f334203f700 1 -- 172.21.15.62:0/261170401 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333800b180 con 0x7f333c05ca90 2021-12-17T18:25:20.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f334183e700 1 --2- 172.21.15.62:0/261170401 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f333c0604b0 0x7f333c1406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:20.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f334203f700 1 --2- 172.21.15.62:0/261170401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f333c05ca90 0x7f333c147aa0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f332c001110 tx=0x7f332c007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:20.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f332b7fe700 1 -- 172.21.15.62:0/261170401 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f332c0070d0 con 0x7f333c05ca90 2021-12-17T18:25:20.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f332b7fe700 1 -- 172.21.15.62:0/261170401 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c007230 con 0x7f333c05ca90 2021-12-17T18:25:20.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f3343041700 1 -- 172.21.15.62:0/261170401 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333c1522c0 con 0x7f333c05ca90 2021-12-17T18:25:20.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f332b7fe700 1 -- 172.21.15.62:0/261170401 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f332c005610 con 0x7f333c05ca90 2021-12-17T18:25:20.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.700+0000 7f3343041700 1 -- 172.21.15.62:0/261170401 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333c065410 con 0x7f333c05ca90 2021-12-17T18:25:20.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.704+0000 7f3343041700 1 -- 172.21.15.62:0/261170401 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333c0b4500 con 0x7f333c05ca90 2021-12-17T18:25:20.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.704+0000 7f332b7fe700 1 -- 172.21.15.62:0/261170401 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f332c010070 con 0x7f333c05ca90 2021-12-17T18:25:20.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.704+0000 7f332b7fe700 1 --2- 172.21.15.62:0/261170401 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f331c053610 0x7f331c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:20.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.704+0000 7f332b7fe700 1 -- 172.21.15.62:0/261170401 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f332c06af30 con 0x7f333c05ca90 2021-12-17T18:25:20.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.704+0000 7f334183e700 1 --2- 172.21.15.62:0/261170401 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f331c053610 0x7f331c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:20.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.704+0000 7f334183e700 1 --2- 172.21.15.62:0/261170401 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f331c053610 0x7f331c055ad0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f3338018000 tx=0x7f3338014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:20.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.712+0000 7f332b7fe700 1 -- 172.21.15.62:0/261170401 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f332c041f90 con 0x7f333c05ca90 2021-12-17T18:25:20.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.880+0000 7f3343041700 1 -- 172.21.15.62:0/261170401 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f333c0573d0 con 0x7f333c05ca90 2021-12-17T18:25:20.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.892+0000 7f332b7fe700 1 -- 172.21.15.62:0/261170401 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 15 and data pool 16 v36) v1 ==== 189+0+0 (secure 0 0 0) 0x7f332c018070 con 0x7f333c05ca90 2021-12-17T18:25:20.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.896+0000 7f3343041700 1 -- 172.21.15.62:0/261170401 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f331c053610 msgr2=0x7f331c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:20.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.896+0000 7f3343041700 1 --2- 172.21.15.62:0/261170401 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f331c053610 0x7f331c055ad0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f3338018000 tx=0x7f3338014000).stop 2021-12-17T18:25:20.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.896+0000 7f3343041700 1 -- 172.21.15.62:0/261170401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f333c05ca90 msgr2=0x7f333c147aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:20.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.896+0000 7f3343041700 1 --2- 172.21.15.62:0/261170401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f333c05ca90 0x7f333c147aa0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f332c001110 tx=0x7f332c007aa0).stop 2021-12-17T18:25:20.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.896+0000 7f3343041700 1 -- 172.21.15.62:0/261170401 shutdown_connections 2021-12-17T18:25:20.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.896+0000 7f3343041700 1 --2- 172.21.15.62:0/261170401 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f331c053610 0x7f331c055ad0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.896+0000 7f3343041700 1 --2- 172.21.15.62:0/261170401 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f333c0b34b0 0x7f333c152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.896+0000 7f3343041700 1 --2- 172.21.15.62:0/261170401 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f333c0604b0 0x7f333c1406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.896+0000 7f3343041700 1 --2- 172.21.15.62:0/261170401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f333c05ca90 0x7f333c147aa0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:20.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.896+0000 7f3343041700 1 -- 172.21.15.62:0/261170401 >> 172.21.15.62:0/261170401 conn(0x7f333c05bcd0 msgr2=0x7f333c0b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:20.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.896+0000 7f3343041700 1 -- 172.21.15.62:0/261170401 shutdown_connections 2021-12-17T18:25:20.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:20.896+0000 7f3343041700 1 -- 172.21.15.62:0/261170401 wait complete. 2021-12-17T18:25:20.905 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 15 and data pool 16 2021-12-17T18:25:20.918 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:25:21.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad6556b700 1 Processor -- start 2021-12-17T18:25:21.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad6556b700 1 -- start start 2021-12-17T18:25:21.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad6556b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fad600b6060 0x7fad6013fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:21.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad6556b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fad600afcf0 0x7fad60143280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:21.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad6556b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad600b1540 con 0x7fad600b5c80 2021-12-17T18:25:21.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad6556b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad600b0160 con 0x7fad600afcf0 2021-12-17T18:25:21.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad6556b700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad600af5b0 con 0x7fad600b6060 2021-12-17T18:25:21.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad5ffff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fad600b5c80 0x7fad60142b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36508/0 (socket says 172.21.15.62:36508) 2021-12-17T18:25:21.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad5ffff700 1 -- 172.21.15.62:0/495619617 learned_addr learned my addr 172.21.15.62:0/495619617 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:21.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad64d6a700 1 --2- 172.21.15.62:0/495619617 >> v2:172.21.15.62:3300/0 conn(0x7fad600afcf0 0x7fad60143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:21.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad5f7fe700 1 --2- 172.21.15.62:0/495619617 >> v2:172.21.15.109:3300/0 conn(0x7fad600b6060 0x7fad6013fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:21.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad5effd700 1 -- 172.21.15.62:0/495619617 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955326807 0 0) 0x7fad600b1540 con 0x7fad600b5c80 2021-12-17T18:25:21.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad5effd700 1 -- 172.21.15.62:0/495619617 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad4c003260 con 0x7fad600b5c80 2021-12-17T18:25:21.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad64d6a700 1 -- 172.21.15.62:0/495619617 >> v2:172.21.15.109:3300/0 conn(0x7fad600b6060 msgr2=0x7fad6013fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:21.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad64d6a700 1 --2- 172.21.15.62:0/495619617 >> v2:172.21.15.109:3300/0 conn(0x7fad600b6060 0x7fad6013fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad64d6a700 1 -- 172.21.15.62:0/495619617 >> v1:172.21.15.62:6789/0 conn(0x7fad600b5c80 legacy=0x7fad60142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad64d6a700 1 -- 172.21.15.62:0/495619617 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad600af850 con 0x7fad600afcf0 2021-12-17T18:25:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad64d6a700 1 --2- 172.21.15.62:0/495619617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad600afcf0 0x7fad60143280 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fad50002f70 tx=0x7fad50006df0).ready entity=mon.0 client_cookie=fa7b85909d11a1fc server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad5effd700 1 -- 172.21.15.62:0/495619617 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad5000d4f0 con 0x7fad600afcf0 2021-12-17T18:25:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad5effd700 1 -- 172.21.15.62:0/495619617 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad50000e90 con 0x7fad600afcf0 2021-12-17T18:25:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad5effd700 1 -- 172.21.15.62:0/495619617 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad5000d840 con 0x7fad600afcf0 2021-12-17T18:25:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad6556b700 1 -- 172.21.15.62:0/495619617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad600afcf0 msgr2=0x7fad60143280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad6556b700 1 --2- 172.21.15.62:0/495619617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad600afcf0 0x7fad60143280 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fad50002f70 tx=0x7fad50006df0).stop 2021-12-17T18:25:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad6556b700 1 -- 172.21.15.62:0/495619617 shutdown_connections 2021-12-17T18:25:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad6556b700 1 --2- 172.21.15.62:0/495619617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad600afcf0 0x7fad60143280 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad6556b700 1 --2- 172.21.15.62:0/495619617 >> v2:172.21.15.109:3300/0 conn(0x7fad600b6060 0x7fad6013fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.008+0000 7fad6556b700 1 -- 172.21.15.62:0/495619617 >> 172.21.15.62:0/495619617 conn(0x7fad6005c750 msgr2=0x7fad6005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad6556b700 1 -- 172.21.15.62:0/495619617 shutdown_connections 2021-12-17T18:25:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad6556b700 1 -- 172.21.15.62:0/495619617 wait complete. 2021-12-17T18:25:21.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad6556b700 1 Processor -- start 2021-12-17T18:25:21.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad6556b700 1 -- start start 2021-12-17T18:25:21.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad6556b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fad600afcf0 0x7fad600a2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:21.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad6556b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad600b5c80 0x7fad600a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:21.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad6556b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fad600b6060 0x7fad601520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:21.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad6556b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad600a3570 con 0x7fad600b5c80 2021-12-17T18:25:21.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad6556b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad600a3c30 con 0x7fad600afcf0 2021-12-17T18:25:21.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad6556b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad600a5540 con 0x7fad600b6060 2021-12-17T18:25:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad5f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad600b5c80 0x7fad600a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad5f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad600b5c80 0x7fad600a2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52934/0 (socket says 172.21.15.62:52934) 2021-12-17T18:25:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad5f7fe700 1 -- 172.21.15.62:0/3412386023 learned_addr learned my addr 172.21.15.62:0/3412386023 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad5ffff700 1 --2- 172.21.15.62:0/3412386023 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fad600afcf0 0x7fad600a2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad64d6a700 1 --2- 172.21.15.62:0/3412386023 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fad600b6060 0x7fad601520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad5f7fe700 1 -- 172.21.15.62:0/3412386023 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fad600b6060 msgr2=0x7fad601520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad5f7fe700 1 --2- 172.21.15.62:0/3412386023 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fad600b6060 0x7fad601520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad5f7fe700 1 -- 172.21.15.62:0/3412386023 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fad600afcf0 msgr2=0x7fad600a2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad5f7fe700 1 --2- 172.21.15.62:0/3412386023 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fad600afcf0 0x7fad600a2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad5f7fe700 1 -- 172.21.15.62:0/3412386023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5000b180 con 0x7fad600b5c80 2021-12-17T18:25:21.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad5ffff700 1 --2- 172.21.15.62:0/3412386023 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fad600afcf0 0x7fad600a2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:21.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad5f7fe700 1 --2- 172.21.15.62:0/3412386023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad600b5c80 0x7fad600a2c10 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fad5800c000 tx=0x7fad580091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:21.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad5d7fa700 1 -- 172.21.15.62:0/3412386023 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad5800c850 con 0x7fad600b5c80 2021-12-17T18:25:21.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad5d7fa700 1 -- 172.21.15.62:0/3412386023 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5800c9b0 con 0x7fad600b5c80 2021-12-17T18:25:21.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad6556b700 1 -- 172.21.15.62:0/3412386023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad600a32d0 con 0x7fad600b5c80 2021-12-17T18:25:21.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad5d7fa700 1 -- 172.21.15.62:0/3412386023 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad5800cd10 con 0x7fad600b5c80 2021-12-17T18:25:21.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.012+0000 7fad6556b700 1 -- 172.21.15.62:0/3412386023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad600a0f50 con 0x7fad600b5c80 2021-12-17T18:25:21.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.016+0000 7fad6556b700 1 -- 172.21.15.62:0/3412386023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad600a3100 con 0x7fad600b5c80 2021-12-17T18:25:21.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.016+0000 7fad5d7fa700 1 -- 172.21.15.62:0/3412386023 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fad58022070 con 0x7fad600b5c80 2021-12-17T18:25:21.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.016+0000 7fad5d7fa700 1 --2- 172.21.15.62:0/3412386023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fad400536a0 0x7fad40055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:21.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.016+0000 7fad5d7fa700 1 -- 172.21.15.62:0/3412386023 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fad5806c070 con 0x7fad600b5c80 2021-12-17T18:25:21.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.016+0000 7fad5ffff700 1 --2- 172.21.15.62:0/3412386023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fad400536a0 0x7fad40055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:21.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.016+0000 7fad5ffff700 1 --2- 172.21.15.62:0/3412386023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fad400536a0 0x7fad40055b60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fad5400b000 tx=0x7fad54009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:21.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.028+0000 7fad5d7fa700 1 -- 172.21.15.62:0/3412386023 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fad58043130 con 0x7fad600b5c80 2021-12-17T18:25:21.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.156+0000 7fad6556b700 1 -- 172.21.15.62:0/3412386023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad600573d0 con 0x7fad600b5c80 2021-12-17T18:25:21.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.156+0000 7fad5d7fa700 1 -- 172.21.15.62:0/3412386023 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16102 (secure 0 0 0) 0x7fad58046750 con 0x7fad600b5c80 2021-12-17T18:25:21.163 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:21.164 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":80,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:25:20.884277+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:25:19.272638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-12-17T18:25:20.525388+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:25:21.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.160+0000 7fad6556b700 1 -- 172.21.15.62:0/3412386023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fad400536a0 msgr2=0x7fad40055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.160+0000 7fad6556b700 1 --2- 172.21.15.62:0/3412386023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fad400536a0 0x7fad40055b60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fad5400b000 tx=0x7fad54009040).stop 2021-12-17T18:25:21.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.160+0000 7fad6556b700 1 -- 172.21.15.62:0/3412386023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad600b5c80 msgr2=0x7fad600a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.160+0000 7fad6556b700 1 --2- 172.21.15.62:0/3412386023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad600b5c80 0x7fad600a2c10 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fad5800c000 tx=0x7fad580091d0).stop 2021-12-17T18:25:21.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.160+0000 7fad6556b700 1 -- 172.21.15.62:0/3412386023 shutdown_connections 2021-12-17T18:25:21.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.160+0000 7fad6556b700 1 --2- 172.21.15.62:0/3412386023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fad400536a0 0x7fad40055b60 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.160+0000 7fad6556b700 1 --2- 172.21.15.62:0/3412386023 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fad600b6060 0x7fad601520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.160+0000 7fad6556b700 1 --2- 172.21.15.62:0/3412386023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad600b5c80 0x7fad600a2c10 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.160+0000 7fad6556b700 1 --2- 172.21.15.62:0/3412386023 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fad600afcf0 0x7fad600a2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.160+0000 7fad6556b700 1 -- 172.21.15.62:0/3412386023 >> 172.21.15.62:0/3412386023 conn(0x7fad6005c750 msgr2=0x7fad60142d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.160+0000 7fad6556b700 1 -- 172.21.15.62:0/3412386023 shutdown_connections 2021-12-17T18:25:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.160+0000 7fad6556b700 1 -- 172.21.15.62:0/3412386023 wait complete. 2021-12-17T18:25:21.178 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:25:21.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.280+0000 7f35c077a700 1 Processor -- start 2021-12-17T18:25:21.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.280+0000 7f35c077a700 1 -- start start 2021-12-17T18:25:21.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35c077a700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f35b80b1730 0x7f35b80ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:21.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35c077a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f35b80a7bb0 0x7f35b8067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:21.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35c077a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b80b2ce0 con 0x7f35b80b21f0 2021-12-17T18:25:21.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35c077a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b814b5b0 con 0x7f35b80a7bb0 2021-12-17T18:25:21.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35c077a700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b8147870 con 0x7f35b80b1730 2021-12-17T18:25:21.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35bed17700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f35b80a7bb0 0x7f35b8067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:21.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35be516700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f35b80b21f0 0x7f35b814aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36524/0 (socket says 172.21.15.62:36524) 2021-12-17T18:25:21.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35be516700 1 -- 172.21.15.62:0/3144120260 learned_addr learned my addr 172.21.15.62:0/3144120260 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:21.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35bdd15700 1 --2- 172.21.15.62:0/3144120260 >> v2:172.21.15.109:3300/0 conn(0x7f35b80b1730 0x7f35b80ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:21.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35bd514700 1 -- 172.21.15.62:0/3144120260 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098700792 0 0) 0x7f35b80b2ce0 con 0x7f35b80b21f0 2021-12-17T18:25:21.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35bed17700 1 -- 172.21.15.62:0/3144120260 >> v2:172.21.15.109:3300/0 conn(0x7f35b80b1730 msgr2=0x7f35b80ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:21.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35bed17700 1 --2- 172.21.15.62:0/3144120260 >> v2:172.21.15.109:3300/0 conn(0x7f35b80b1730 0x7f35b80ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35bed17700 1 -- 172.21.15.62:0/3144120260 >> v1:172.21.15.62:6789/0 conn(0x7f35b80b21f0 legacy=0x7f35b814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35bed17700 1 -- 172.21.15.62:0/3144120260 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b80aca60 con 0x7f35b80a7bb0 2021-12-17T18:25:21.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35bed17700 1 --2- 172.21.15.62:0/3144120260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35b80a7bb0 0x7f35b8067120 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f35b80b1c00 tx=0x7f35b00091d0).ready entity=mon.0 client_cookie=9705afe010a6dd34 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:21.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35bd514700 1 -- 172.21.15.62:0/3144120260 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b0009ea0 con 0x7f35b80a7bb0 2021-12-17T18:25:21.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35bd514700 1 -- 172.21.15.62:0/3144120260 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b000b860 con 0x7f35b80a7bb0 2021-12-17T18:25:21.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35bd514700 1 -- 172.21.15.62:0/3144120260 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b000b9d0 con 0x7f35b80a7bb0 2021-12-17T18:25:21.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35c077a700 1 -- 172.21.15.62:0/3144120260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35b80a7bb0 msgr2=0x7f35b8067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35c077a700 1 --2- 172.21.15.62:0/3144120260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35b80a7bb0 0x7f35b8067120 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f35b80b1c00 tx=0x7f35b00091d0).stop 2021-12-17T18:25:21.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35c077a700 1 -- 172.21.15.62:0/3144120260 shutdown_connections 2021-12-17T18:25:21.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35c077a700 1 --2- 172.21.15.62:0/3144120260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35b80a7bb0 0x7f35b8067120 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35c077a700 1 --2- 172.21.15.62:0/3144120260 >> v2:172.21.15.109:3300/0 conn(0x7f35b80b1730 0x7f35b80ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35c077a700 1 -- 172.21.15.62:0/3144120260 >> 172.21.15.62:0/3144120260 conn(0x7f35b805f730 msgr2=0x7f35b805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:21.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35c077a700 1 -- 172.21.15.62:0/3144120260 shutdown_connections 2021-12-17T18:25:21.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.284+0000 7f35c077a700 1 -- 172.21.15.62:0/3144120260 wait complete. 2021-12-17T18:25:21.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.288+0000 7f35c077a700 1 Processor -- start 2021-12-17T18:25:21.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.288+0000 7f35c077a700 1 -- start start 2021-12-17T18:25:21.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.288+0000 7f35c077a700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35b80a7bb0 0x7f35b811d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:21.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.288+0000 7f35c077a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35b80b1730 0x7f35b8064de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:21.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.288+0000 7f35c077a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35b80b21f0 0x7f35b80652d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:21.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.288+0000 7f35c077a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b8157700 con 0x7f35b80b21f0 2021-12-17T18:25:21.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.288+0000 7f35c077a700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b8157b30 con 0x7f35b80a7bb0 2021-12-17T18:25:21.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.288+0000 7f35c077a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b8064450 con 0x7f35b80b1730 2021-12-17T18:25:21.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.288+0000 7f35bed17700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35b80b21f0 0x7f35b80652d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:21.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.288+0000 7f35bed17700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35b80b21f0 0x7f35b80652d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52952/0 (socket says 172.21.15.62:52952) 2021-12-17T18:25:21.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.288+0000 7f35bed17700 1 -- 172.21.15.62:0/4268223583 learned_addr learned my addr 172.21.15.62:0/4268223583 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:21.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.288+0000 7f35bdd15700 1 --2- 172.21.15.62:0/4268223583 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35b80b1730 0x7f35b8064de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:21.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.288+0000 7f35be516700 1 --2- 172.21.15.62:0/4268223583 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35b80a7bb0 0x7f35b811d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:21.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.288+0000 7f35bdd15700 1 -- 172.21.15.62:0/4268223583 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35b80a7bb0 msgr2=0x7f35b811d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.292+0000 7f35bdd15700 1 --2- 172.21.15.62:0/4268223583 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35b80a7bb0 0x7f35b811d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.292+0000 7f35bdd15700 1 -- 172.21.15.62:0/4268223583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35b80b21f0 msgr2=0x7f35b80652d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.292+0000 7f35bdd15700 1 --2- 172.21.15.62:0/4268223583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35b80b21f0 0x7f35b80652d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.292+0000 7f35bdd15700 1 -- 172.21.15.62:0/4268223583 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b0009470 con 0x7f35b80b1730 2021-12-17T18:25:21.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.292+0000 7f35bdd15700 1 --2- 172.21.15.62:0/4268223583 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35b80b1730 0x7f35b8064de0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f35a800a000 tx=0x7f35a8008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:21.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.292+0000 7f35a77fe700 1 -- 172.21.15.62:0/4268223583 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35a8011590 con 0x7f35b80b1730 2021-12-17T18:25:21.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.292+0000 7f35a77fe700 1 -- 172.21.15.62:0/4268223583 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a80116f0 con 0x7f35b80b1730 2021-12-17T18:25:21.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.292+0000 7f35c077a700 1 -- 172.21.15.62:0/4268223583 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b8157d10 con 0x7f35b80b1730 2021-12-17T18:25:21.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.292+0000 7f35a77fe700 1 -- 172.21.15.62:0/4268223583 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35a8011a50 con 0x7f35b80b1730 2021-12-17T18:25:21.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.292+0000 7f35c077a700 1 -- 172.21.15.62:0/4268223583 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b811db90 con 0x7f35b80b1730 2021-12-17T18:25:21.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.292+0000 7f35c077a700 1 -- 172.21.15.62:0/4268223583 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b80ad380 con 0x7f35b80b1730 2021-12-17T18:25:21.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.292+0000 7f35a77fe700 1 -- 172.21.15.62:0/4268223583 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f35a8011bb0 con 0x7f35b80b1730 2021-12-17T18:25:21.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.292+0000 7f35a77fe700 1 --2- 172.21.15.62:0/4268223583 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f35980536d0 0x7f3598055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:21.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.292+0000 7f35a77fe700 1 -- 172.21.15.62:0/4268223583 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f35a806b6c0 con 0x7f35b80b1730 2021-12-17T18:25:21.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.296+0000 7f35be516700 1 --2- 172.21.15.62:0/4268223583 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f35980536d0 0x7f3598055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:21.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.296+0000 7f35be516700 1 --2- 172.21.15.62:0/4268223583 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f35980536d0 0x7f3598055b90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f35b400d000 tx=0x7f35b4007c20).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:21.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.304+0000 7f35a77fe700 1 -- 172.21.15.62:0/4268223583 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f35a80426b0 con 0x7f35b80b1730 2021-12-17T18:25:21.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.428+0000 7f35c077a700 1 -- 172.21.15.62:0/4268223583 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35b80573d0 con 0x7f35b80b1730 2021-12-17T18:25:21.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.432+0000 7f35a77fe700 1 -- 172.21.15.62:0/4268223583 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16102 (secure 0 0 0) 0x7f35a8045cd0 con 0x7f35b80b1730 2021-12-17T18:25:21.438 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:21.438 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":80,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:25:20.884277+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:25:19.272638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-12-17T18:25:20.525388+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:25:21.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.432+0000 7f35c077a700 1 -- 172.21.15.62:0/4268223583 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f35980536d0 msgr2=0x7f3598055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.432+0000 7f35c077a700 1 --2- 172.21.15.62:0/4268223583 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f35980536d0 0x7f3598055b90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f35b400d000 tx=0x7f35b4007c20).stop 2021-12-17T18:25:21.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.432+0000 7f35c077a700 1 -- 172.21.15.62:0/4268223583 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35b80b1730 msgr2=0x7f35b8064de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.432+0000 7f35c077a700 1 --2- 172.21.15.62:0/4268223583 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35b80b1730 0x7f35b8064de0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f35a800a000 tx=0x7f35a8008040).stop 2021-12-17T18:25:21.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.432+0000 7f35c077a700 1 -- 172.21.15.62:0/4268223583 shutdown_connections 2021-12-17T18:25:21.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.432+0000 7f35c077a700 1 --2- 172.21.15.62:0/4268223583 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f35980536d0 0x7f3598055b90 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.432+0000 7f35c077a700 1 --2- 172.21.15.62:0/4268223583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35b80b21f0 0x7f35b80652d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.432+0000 7f35c077a700 1 --2- 172.21.15.62:0/4268223583 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f35b80b1730 0x7f35b8064de0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.432+0000 7f35c077a700 1 --2- 172.21.15.62:0/4268223583 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f35b80a7bb0 0x7f35b811d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.432+0000 7f35c077a700 1 -- 172.21.15.62:0/4268223583 >> 172.21.15.62:0/4268223583 conn(0x7f35b805f730 msgr2=0x7f35b814adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:21.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.432+0000 7f35c077a700 1 -- 172.21.15.62:0/4268223583 shutdown_connections 2021-12-17T18:25:21.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.436+0000 7f35c077a700 1 -- 172.21.15.62:0/4268223583 wait complete. 2021-12-17T18:25:21.451 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-12-17T18:25:21.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd14db8700 1 Processor -- start 2021-12-17T18:25:21.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd14db8700 1 -- start start 2021-12-17T18:25:21.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd14db8700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fdd10064e90 0x7fdd100633f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:21.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd14db8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd100ae840 con 0x7fdd100b7900 2021-12-17T18:25:21.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd14db8700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd100b7ce0 con 0x7fdd100b2d70 2021-12-17T18:25:21.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd14db8700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd100ae250 con 0x7fdd10064e90 2021-12-17T18:25:21.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd0e59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdd100b7900 0x7fdd10064780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36536/0 (socket says 172.21.15.62:36536) 2021-12-17T18:25:21.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd0e59c700 1 -- 172.21.15.62:0/237286465 learned_addr learned my addr 172.21.15.62:0/237286465 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:21.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd0dd9b700 1 --2- 172.21.15.62:0/237286465 >> v2:172.21.15.109:3300/0 conn(0x7fdd10064e90 0x7fdd100633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:21.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd0d59a700 1 -- 172.21.15.62:0/237286465 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172422813 0 0) 0x7fdd00001110 con 0x7fdd100b7900 2021-12-17T18:25:21.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd0d59a700 1 -- 172.21.15.62:0/237286465 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcf4003260 con 0x7fdd100b7900 2021-12-17T18:25:21.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd0dd9b700 1 -- 172.21.15.62:0/237286465 >> v1:172.21.15.109:6789/0 conn(0x7fdd100b2d70 legacy=0x7fdd100b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd0dd9b700 1 -- 172.21.15.62:0/237286465 >> v1:172.21.15.62:6789/0 conn(0x7fdd100b7900 legacy=0x7fdd10064780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd0dd9b700 1 -- 172.21.15.62:0/237286465 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd100ad640 con 0x7fdd10064e90 2021-12-17T18:25:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd0dd9b700 1 --2- 172.21.15.62:0/237286465 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd10064e90 0x7fdd100633f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fdd04002f70 tx=0x7fdd04006df0).ready entity=mon.1 client_cookie=9a0984f2e5cb30ca server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd0d59a700 1 -- 172.21.15.62:0/237286465 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0400d610 con 0x7fdd10064e90 2021-12-17T18:25:21.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd0d59a700 1 -- 172.21.15.62:0/237286465 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd04000e90 con 0x7fdd10064e90 2021-12-17T18:25:21.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd0d59a700 1 -- 172.21.15.62:0/237286465 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0400d960 con 0x7fdd10064e90 2021-12-17T18:25:21.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd14db8700 1 -- 172.21.15.62:0/237286465 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd10064e90 msgr2=0x7fdd100633f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd14db8700 1 --2- 172.21.15.62:0/237286465 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd10064e90 0x7fdd100633f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fdd04002f70 tx=0x7fdd04006df0).stop 2021-12-17T18:25:21.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd14db8700 1 -- 172.21.15.62:0/237286465 shutdown_connections 2021-12-17T18:25:21.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd14db8700 1 --2- 172.21.15.62:0/237286465 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd10064e90 0x7fdd100633f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd14db8700 1 -- 172.21.15.62:0/237286465 >> 172.21.15.62:0/237286465 conn(0x7fdd10062510 msgr2=0x7fdd10062920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:21.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd14db8700 1 -- 172.21.15.62:0/237286465 shutdown_connections 2021-12-17T18:25:21.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.556+0000 7fdd14db8700 1 -- 172.21.15.62:0/237286465 wait complete. 2021-12-17T18:25:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd14db8700 1 Processor -- start 2021-12-17T18:25:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd14db8700 1 -- start start 2021-12-17T18:25:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd14db8700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd10064e90 0x7fdd101453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd14db8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd100b2d70 0x7fdd10146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd14db8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdd100b7900 0x7fdd1013f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd14db8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd10146720 con 0x7fdd100b2d70 2021-12-17T18:25:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd14db8700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd10145f80 con 0x7fdd10064e90 2021-12-17T18:25:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd14db8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd100b1970 con 0x7fdd100b7900 2021-12-17T18:25:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd0dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd100b2d70 0x7fdd10146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd0dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd100b2d70 0x7fdd10146d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52964/0 (socket says 172.21.15.62:52964) 2021-12-17T18:25:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd0dd9b700 1 -- 172.21.15.62:0/3119658202 learned_addr learned my addr 172.21.15.62:0/3119658202 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd0ed9d700 1 --2- 172.21.15.62:0/3119658202 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdd100b7900 0x7fdd1013f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd0e59c700 1 --2- 172.21.15.62:0/3119658202 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd10064e90 0x7fdd101453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd0dd9b700 1 -- 172.21.15.62:0/3119658202 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdd100b7900 msgr2=0x7fdd1013f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd0dd9b700 1 --2- 172.21.15.62:0/3119658202 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdd100b7900 0x7fdd1013f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd0dd9b700 1 -- 172.21.15.62:0/3119658202 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd10064e90 msgr2=0x7fdd101453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd0dd9b700 1 --2- 172.21.15.62:0/3119658202 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd10064e90 0x7fdd101453d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd0dd9b700 1 -- 172.21.15.62:0/3119658202 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0400b180 con 0x7fdd100b2d70 2021-12-17T18:25:21.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd0e59c700 1 --2- 172.21.15.62:0/3119658202 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd10064e90 0x7fdd101453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:21.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd0dd9b700 1 --2- 172.21.15.62:0/3119658202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd100b2d70 0x7fdd10146d90 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7fdd04002f70 tx=0x7fdd04014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:21.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdcff7fe700 1 -- 172.21.15.62:0/3119658202 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd04016070 con 0x7fdd100b2d70 2021-12-17T18:25:21.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdcff7fe700 1 -- 172.21.15.62:0/3119658202 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0400de90 con 0x7fdd100b2d70 2021-12-17T18:25:21.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd14db8700 1 -- 172.21.15.62:0/3119658202 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd101458c0 con 0x7fdd100b2d70 2021-12-17T18:25:21.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdcff7fe700 1 -- 172.21.15.62:0/3119658202 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd04013e50 con 0x7fdd100b2d70 2021-12-17T18:25:21.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.560+0000 7fdd14db8700 1 -- 172.21.15.62:0/3119658202 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd10145170 con 0x7fdd100b2d70 2021-12-17T18:25:21.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.564+0000 7fdd14db8700 1 -- 172.21.15.62:0/3119658202 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd100573d0 con 0x7fdd100b2d70 2021-12-17T18:25:21.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.564+0000 7fdcff7fe700 1 -- 172.21.15.62:0/3119658202 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdd04025030 con 0x7fdd100b2d70 2021-12-17T18:25:21.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.564+0000 7fdcff7fe700 1 --2- 172.21.15.62:0/3119658202 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdcec053640 0x7fdcec055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:21.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.564+0000 7fdcff7fe700 1 -- 172.21.15.62:0/3119658202 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdd0406c920 con 0x7fdd100b2d70 2021-12-17T18:25:21.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.564+0000 7fdd0e59c700 1 --2- 172.21.15.62:0/3119658202 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdcec053640 0x7fdcec055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:21.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.564+0000 7fdd0e59c700 1 --2- 172.21.15.62:0/3119658202 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdcec053640 0x7fdcec055b00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fdd0000b000 tx=0x7fdd00009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:21.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.568+0000 7fdcff7fe700 1 -- 172.21.15.62:0/3119658202 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdd04043a00 con 0x7fdd100b2d70 2021-12-17T18:25:21.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.732+0000 7fdd14db8700 1 -- 172.21.15.62:0/3119658202 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdd10060ec0 con 0x7fdd100b2d70 2021-12-17T18:25:21.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.896+0000 7fdcff7fe700 1 -- 172.21.15.62:0/3119658202 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v37) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdd04023020 con 0x7fdd100b2d70 2021-12-17T18:25:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.900+0000 7fdd14db8700 1 -- 172.21.15.62:0/3119658202 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdcec053640 msgr2=0x7fdcec055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.900+0000 7fdd14db8700 1 --2- 172.21.15.62:0/3119658202 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdcec053640 0x7fdcec055b00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fdd0000b000 tx=0x7fdd00009040).stop 2021-12-17T18:25:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.900+0000 7fdd14db8700 1 -- 172.21.15.62:0/3119658202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd100b2d70 msgr2=0x7fdd10146d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.900+0000 7fdd14db8700 1 --2- 172.21.15.62:0/3119658202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd100b2d70 0x7fdd10146d90 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7fdd04002f70 tx=0x7fdd04014000).stop 2021-12-17T18:25:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.900+0000 7fdd14db8700 1 -- 172.21.15.62:0/3119658202 shutdown_connections 2021-12-17T18:25:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.900+0000 7fdd14db8700 1 --2- 172.21.15.62:0/3119658202 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdcec053640 0x7fdcec055b00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.900+0000 7fdd14db8700 1 --2- 172.21.15.62:0/3119658202 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdd100b7900 0x7fdd1013f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.900+0000 7fdd14db8700 1 --2- 172.21.15.62:0/3119658202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd100b2d70 0x7fdd10146d90 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.900+0000 7fdd14db8700 1 --2- 172.21.15.62:0/3119658202 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd10064e90 0x7fdd101453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:21.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.900+0000 7fdd14db8700 1 -- 172.21.15.62:0/3119658202 >> 172.21.15.62:0/3119658202 conn(0x7fdd10062510 msgr2=0x7fdd100b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:21.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.900+0000 7fdd14db8700 1 -- 172.21.15.62:0/3119658202 shutdown_connections 2021-12-17T18:25:21.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:21.900+0000 7fdd14db8700 1 -- 172.21.15.62:0/3119658202 wait complete. 2021-12-17T18:25:21.918 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:22.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d8889700 1 Processor -- start 2021-12-17T18:25:22.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d8889700 1 -- start start 2021-12-17T18:25:22.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d8889700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0d40682c0 0x7fa0d40abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d8889700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d40b6280 con 0x7fa0d40aeaa0 2021-12-17T18:25:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d8889700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d4145190 con 0x7fa0d40b5ea0 2021-12-17T18:25:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d8889700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40af090 con 0x7fa0d40682c0 2021-12-17T18:25:22.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d3fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa0d40aeaa0 0x7fa0d4142500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36554/0 (socket says 172.21.15.62:36554) 2021-12-17T18:25:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d3fff700 1 -- 172.21.15.62:0/2615695198 learned_addr learned my addr 172.21.15.62:0/2615695198 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0caffd700 1 --2- 172.21.15.62:0/2615695198 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0d40682c0 0x7fa0d40abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d2ffd700 1 -- 172.21.15.62:0/2615695198 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908715504 0 0) 0x7fa0d40b6280 con 0x7fa0d40aeaa0 2021-12-17T18:25:22.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d2ffd700 1 -- 172.21.15.62:0/2615695198 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0b4003260 con 0x7fa0d40aeaa0 2021-12-17T18:25:22.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0caffd700 1 -- 172.21.15.62:0/2615695198 >> v1:172.21.15.109:6789/0 conn(0x7fa0d40b5ea0 legacy=0x7fa0d40b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0caffd700 1 -- 172.21.15.62:0/2615695198 >> v1:172.21.15.62:6789/0 conn(0x7fa0d40aeaa0 legacy=0x7fa0d4142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0caffd700 1 -- 172.21.15.62:0/2615695198 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d4145430 con 0x7fa0d40682c0 2021-12-17T18:25:22.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0caffd700 1 --2- 172.21.15.62:0/2615695198 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0d40682c0 0x7fa0d40abb10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa0bc002f70 tx=0x7fa0bc006df0).ready entity=mon.2 client_cookie=307079c78ed8d7f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:22.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d2ffd700 1 -- 172.21.15.62:0/2615695198 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0bc00d570 con 0x7fa0d40682c0 2021-12-17T18:25:22.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d2ffd700 1 -- 172.21.15.62:0/2615695198 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc000e90 con 0x7fa0d40682c0 2021-12-17T18:25:22.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d2ffd700 1 -- 172.21.15.62:0/2615695198 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0bc00d8c0 con 0x7fa0d40682c0 2021-12-17T18:25:22.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d8889700 1 -- 172.21.15.62:0/2615695198 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0d40682c0 msgr2=0x7fa0d40abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d8889700 1 --2- 172.21.15.62:0/2615695198 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0d40682c0 0x7fa0d40abb10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa0bc002f70 tx=0x7fa0bc006df0).stop 2021-12-17T18:25:22.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d8889700 1 -- 172.21.15.62:0/2615695198 shutdown_connections 2021-12-17T18:25:22.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d8889700 1 --2- 172.21.15.62:0/2615695198 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0d40682c0 0x7fa0d40abb10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d8889700 1 -- 172.21.15.62:0/2615695198 >> 172.21.15.62:0/2615695198 conn(0x7fa0d405d220 msgr2=0x7fa0d40b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:22.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d8889700 1 -- 172.21.15.62:0/2615695198 shutdown_connections 2021-12-17T18:25:22.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.024+0000 7fa0d8889700 1 -- 172.21.15.62:0/2615695198 wait complete. 2021-12-17T18:25:22.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d8889700 1 Processor -- start 2021-12-17T18:25:22.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d8889700 1 -- start start 2021-12-17T18:25:22.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d8889700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0d40682c0 0x7fa0d40659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d8889700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa0d40aeaa0 0x7fa0d40a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d8889700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0d40b5ea0 0x7fa0d40ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d8889700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d4152b90 con 0x7fa0d40682c0 2021-12-17T18:25:22.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d8889700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40ad8e0 con 0x7fa0d40aeaa0 2021-12-17T18:25:22.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d8889700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40adb80 con 0x7fa0d40b5ea0 2021-12-17T18:25:22.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0d40682c0 0x7fa0d40659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0caffd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa0d40aeaa0 0x7fa0d40a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0caffd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa0d40aeaa0 0x7fa0d40a60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:59528/0 (socket says 172.21.15.62:59528) 2021-12-17T18:25:22.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0caffd700 1 -- 172.21.15.62:0/3777651547 learned_addr learned my addr 172.21.15.62:0/3777651547 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:22.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0d40682c0 0x7fa0d40659c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52976/0 (socket says 172.21.15.62:52976) 2021-12-17T18:25:22.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d3fff700 1 --2- 172.21.15.62:0/3777651547 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0d40b5ea0 0x7fa0d40ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d37fe700 1 -- 172.21.15.62:0/3777651547 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0d40b5ea0 msgr2=0x7fa0d40ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d37fe700 1 --2- 172.21.15.62:0/3777651547 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0d40b5ea0 0x7fa0d40ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d37fe700 1 -- 172.21.15.62:0/3777651547 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa0d40aeaa0 msgr2=0x7fa0d40a60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d37fe700 1 --2- 172.21.15.62:0/3777651547 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa0d40aeaa0 0x7fa0d40a60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d37fe700 1 -- 172.21.15.62:0/3777651547 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc00b180 con 0x7fa0d40682c0 2021-12-17T18:25:22.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d37fe700 1 --2- 172.21.15.62:0/3777651547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0d40682c0 0x7fa0d40659c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7fa0d4061560 tx=0x7fa0c4007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:22.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d17fa700 1 -- 172.21.15.62:0/3777651547 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0c400ccd0 con 0x7fa0d40682c0 2021-12-17T18:25:22.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d17fa700 1 -- 172.21.15.62:0/3777651547 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c400ce30 con 0x7fa0d40682c0 2021-12-17T18:25:22.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d8889700 1 -- 172.21.15.62:0/3777651547 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d40ade20 con 0x7fa0d40682c0 2021-12-17T18:25:22.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d17fa700 1 -- 172.21.15.62:0/3777651547 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0c40125f0 con 0x7fa0d40682c0 2021-12-17T18:25:22.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.028+0000 7fa0d8889700 1 -- 172.21.15.62:0/3777651547 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d40ae6c0 con 0x7fa0d40682c0 2021-12-17T18:25:22.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.032+0000 7fa0d8889700 1 -- 172.21.15.62:0/3777651547 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d40afdf0 con 0x7fa0d40682c0 2021-12-17T18:25:22.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.032+0000 7fa0d17fa700 1 -- 172.21.15.62:0/3777651547 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa0c4019030 con 0x7fa0d40682c0 2021-12-17T18:25:22.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.032+0000 7fa0d17fa700 1 --2- 172.21.15.62:0/3777651547 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa0b8053610 0x7fa0b8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.032+0000 7fa0d17fa700 1 -- 172.21.15.62:0/3777651547 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa0c406ab10 con 0x7fa0d40682c0 2021-12-17T18:25:22.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.032+0000 7fa0caffd700 1 --2- 172.21.15.62:0/3777651547 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa0b8053610 0x7fa0b8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.032+0000 7fa0caffd700 1 --2- 172.21.15.62:0/3777651547 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa0b8053610 0x7fa0b8055ad0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fa0bc01a000 tx=0x7fa0bc014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:22.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.040+0000 7fa0d17fa700 1 -- 172.21.15.62:0/3777651547 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa0c4041c70 con 0x7fa0d40682c0 2021-12-17T18:25:22.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.200+0000 7fa0d8889700 1 -- 172.21.15.62:0/3777651547 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0d40573d0 con 0x7fa0d40682c0 2021-12-17T18:25:22.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.204+0000 7fa0d17fa700 1 -- 172.21.15.62:0/3777651547 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+2143 (secure 0 0 0) 0x7fa0c4045290 con 0x7fa0d40682c0 2021-12-17T18:25:22.210 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:22.210 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":37,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3760020760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3760020760},{"type":"v1","addr":"172.21.15.109:6835","nonce":3760020760}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:25:20.884652+0000","modified":"2021-12-17T18:25:21.888425+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1765551619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1765551619},{"type":"v1","addr":"172.21.15.62:6833","nonce":1765551619}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-12-17T18:25:22.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.204+0000 7fa0d8889700 1 -- 172.21.15.62:0/3777651547 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa0b8053610 msgr2=0x7fa0b8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.204+0000 7fa0d8889700 1 --2- 172.21.15.62:0/3777651547 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa0b8053610 0x7fa0b8055ad0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fa0bc01a000 tx=0x7fa0bc014000).stop 2021-12-17T18:25:22.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.204+0000 7fa0d8889700 1 -- 172.21.15.62:0/3777651547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0d40682c0 msgr2=0x7fa0d40659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.204+0000 7fa0d8889700 1 --2- 172.21.15.62:0/3777651547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0d40682c0 0x7fa0d40659c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7fa0d4061560 tx=0x7fa0c4007b90).stop 2021-12-17T18:25:22.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.204+0000 7fa0d8889700 1 -- 172.21.15.62:0/3777651547 shutdown_connections 2021-12-17T18:25:22.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.204+0000 7fa0d8889700 1 --2- 172.21.15.62:0/3777651547 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa0b8053610 0x7fa0b8055ad0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.204+0000 7fa0d8889700 1 --2- 172.21.15.62:0/3777651547 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0d40b5ea0 0x7fa0d40ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.204+0000 7fa0d8889700 1 --2- 172.21.15.62:0/3777651547 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa0d40aeaa0 0x7fa0d40a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.204+0000 7fa0d8889700 1 --2- 172.21.15.62:0/3777651547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0d40682c0 0x7fa0d40659c0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.204+0000 7fa0d8889700 1 -- 172.21.15.62:0/3777651547 >> 172.21.15.62:0/3777651547 conn(0x7fa0d405d220 msgr2=0x7fa0d40ab8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:22.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.204+0000 7fa0d8889700 1 -- 172.21.15.62:0/3777651547 shutdown_connections 2021-12-17T18:25:22.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.204+0000 7fa0d8889700 1 -- 172.21.15.62:0/3777651547 wait complete. 2021-12-17T18:25:22.216 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 37 2021-12-17T18:25:22.222 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:25:22.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.316+0000 7facc1098700 1 Processor -- start 2021-12-17T18:25:22.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.316+0000 7facc1098700 1 -- start start 2021-12-17T18:25:22.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.316+0000 7facc1098700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7facbc141480 0x7facbc147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.316+0000 7facc1098700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7facbc0a71e0 0x7facbc0a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.316+0000 7facc1098700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facbc0b6270 con 0x7facbc0a8e10 2021-12-17T18:25:22.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.316+0000 7facc1098700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facbc147610 con 0x7facbc0a71e0 2021-12-17T18:25:22.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.316+0000 7facc1098700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facbc1478b0 con 0x7facbc141480 2021-12-17T18:25:22.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.316+0000 7facc0897700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7facbc0a71e0 0x7facbc0a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.316+0000 7facbb7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7facbc0a8e10 0x7facbc0b5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36568/0 (socket says 172.21.15.62:36568) 2021-12-17T18:25:22.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.316+0000 7facbb7fe700 1 -- 172.21.15.62:0/1255253909 learned_addr learned my addr 172.21.15.62:0/1255253909 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:22.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facbbfff700 1 --2- 172.21.15.62:0/1255253909 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7facbc141480 0x7facbc147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facc0897700 1 -- 172.21.15.62:0/1255253909 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7facbc141480 msgr2=0x7facbc147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facc0897700 1 --2- 172.21.15.62:0/1255253909 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7facbc141480 0x7facbc147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facc0897700 1 -- 172.21.15.62:0/1255253909 >> v1:172.21.15.62:6789/0 conn(0x7facbc0a8e10 legacy=0x7facbc0b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facbaffd700 1 -- 172.21.15.62:0/1255253909 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434010551 0 0) 0x7facbc0b6270 con 0x7facbc0a8e10 2021-12-17T18:25:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facc0897700 1 -- 172.21.15.62:0/1255253909 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc147b50 con 0x7facbc0a71e0 2021-12-17T18:25:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facc0897700 1 --2- 172.21.15.62:0/1255253909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc0a71e0 0x7facbc0a7900 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7facb40032f0 tx=0x7facb40091d0).ready entity=mon.0 client_cookie=50f0993a03f65263 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facbaffd700 1 -- 172.21.15.62:0/1255253909 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facb400b6c0 con 0x7facbc0a71e0 2021-12-17T18:25:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facbaffd700 1 -- 172.21.15.62:0/1255253909 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb400b820 con 0x7facbc0a71e0 2021-12-17T18:25:22.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facbaffd700 1 -- 172.21.15.62:0/1255253909 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facb400b990 con 0x7facbc0a71e0 2021-12-17T18:25:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facc1098700 1 -- 172.21.15.62:0/1255253909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc0a71e0 msgr2=0x7facbc0a7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facc1098700 1 --2- 172.21.15.62:0/1255253909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc0a71e0 0x7facbc0a7900 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7facb40032f0 tx=0x7facb40091d0).stop 2021-12-17T18:25:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facc1098700 1 -- 172.21.15.62:0/1255253909 shutdown_connections 2021-12-17T18:25:22.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facc1098700 1 --2- 172.21.15.62:0/1255253909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc0a71e0 0x7facbc0a7900 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facc1098700 1 --2- 172.21.15.62:0/1255253909 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7facbc141480 0x7facbc147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facc1098700 1 -- 172.21.15.62:0/1255253909 >> 172.21.15.62:0/1255253909 conn(0x7facbc05d220 msgr2=0x7facbc0b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facc1098700 1 -- 172.21.15.62:0/1255253909 shutdown_connections 2021-12-17T18:25:22.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facc1098700 1 -- 172.21.15.62:0/1255253909 wait complete. 2021-12-17T18:25:22.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facc1098700 1 Processor -- start 2021-12-17T18:25:22.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.320+0000 7facc1098700 1 -- start start 2021-12-17T18:25:22.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc1098700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7facbc0a71e0 0x7facbc148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc1098700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7facbc0a8e10 0x7facbc0ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc1098700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc141480 0x7facbc0ac950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc1098700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc0aee90 con 0x7facbc141480 2021-12-17T18:25:22.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc1098700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc0af0b0 con 0x7facbc0a8e10 2021-12-17T18:25:22.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc1098700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facbc0af350 con 0x7facbc0a71e0 2021-12-17T18:25:22.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc0897700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc141480 0x7facbc0ac950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc0897700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc141480 0x7facbc0ac950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52994/0 (socket says 172.21.15.62:52994) 2021-12-17T18:25:22.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc0897700 1 -- 172.21.15.62:0/3272015034 learned_addr learned my addr 172.21.15.62:0/3272015034 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:22.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facbbfff700 1 --2- 172.21.15.62:0/3272015034 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7facbc0a71e0 0x7facbc148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facbb7fe700 1 --2- 172.21.15.62:0/3272015034 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7facbc0a8e10 0x7facbc0ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc0897700 1 -- 172.21.15.62:0/3272015034 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7facbc0a71e0 msgr2=0x7facbc148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc0897700 1 --2- 172.21.15.62:0/3272015034 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7facbc0a71e0 0x7facbc148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc0897700 1 -- 172.21.15.62:0/3272015034 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7facbc0a8e10 msgr2=0x7facbc0ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc0897700 1 --2- 172.21.15.62:0/3272015034 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7facbc0a8e10 0x7facbc0ae9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc0897700 1 -- 172.21.15.62:0/3272015034 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb4009470 con 0x7facbc141480 2021-12-17T18:25:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc0897700 1 --2- 172.21.15.62:0/3272015034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc141480 0x7facbc0ac950 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7facb40032f0 tx=0x7facb4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facb97fa700 1 -- 172.21.15.62:0/3272015034 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facb400b6c0 con 0x7facbc141480 2021-12-17T18:25:22.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facb97fa700 1 -- 172.21.15.62:0/3272015034 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb4021630 con 0x7facbc141480 2021-12-17T18:25:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc1098700 1 -- 172.21.15.62:0/3272015034 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facbc0af5f0 con 0x7facbc141480 2021-12-17T18:25:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facb97fa700 1 -- 172.21.15.62:0/3272015034 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facb4021990 con 0x7facbc141480 2021-12-17T18:25:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc1098700 1 -- 172.21.15.62:0/3272015034 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facbc0ade50 con 0x7facbc141480 2021-12-17T18:25:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facc1098700 1 -- 172.21.15.62:0/3272015034 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facbc0b1b90 con 0x7facbc141480 2021-12-17T18:25:22.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.324+0000 7facb97fa700 1 -- 172.21.15.62:0/3272015034 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7facb400f070 con 0x7facbc141480 2021-12-17T18:25:22.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.328+0000 7facb97fa700 1 --2- 172.21.15.62:0/3272015034 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faca00536a0 0x7faca0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.328+0000 7facb97fa700 1 -- 172.21.15.62:0/3272015034 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7facb406c040 con 0x7facbc141480 2021-12-17T18:25:22.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.328+0000 7facbbfff700 1 --2- 172.21.15.62:0/3272015034 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faca00536a0 0x7faca0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.328+0000 7facbbfff700 1 --2- 172.21.15.62:0/3272015034 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faca00536a0 0x7faca0055b60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7facac00b000 tx=0x7facac006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:22.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.332+0000 7facb97fa700 1 -- 172.21.15.62:0/3272015034 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7facb40431a0 con 0x7facbc141480 2021-12-17T18:25:22.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.464+0000 7facc1098700 1 -- 172.21.15.62:0/3272015034 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facbc0573d0 con 0x7facbc141480 2021-12-17T18:25:22.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.464+0000 7facb97fa700 1 -- 172.21.15.62:0/3272015034 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16089 (secure 0 0 0) 0x7facb4015030 con 0x7facbc141480 2021-12-17T18:25:22.471 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:22.471 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":81,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:25:21.887449+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:25:19.272638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-12-17T18:25:20.525388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:25:22.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.468+0000 7facc1098700 1 -- 172.21.15.62:0/3272015034 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faca00536a0 msgr2=0x7faca0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.468+0000 7facc1098700 1 --2- 172.21.15.62:0/3272015034 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faca00536a0 0x7faca0055b60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7facac00b000 tx=0x7facac006df0).stop 2021-12-17T18:25:22.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.468+0000 7facc1098700 1 -- 172.21.15.62:0/3272015034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc141480 msgr2=0x7facbc0ac950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.468+0000 7facc1098700 1 --2- 172.21.15.62:0/3272015034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc141480 0x7facbc0ac950 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7facb40032f0 tx=0x7facb4016000).stop 2021-12-17T18:25:22.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.468+0000 7facc1098700 1 -- 172.21.15.62:0/3272015034 shutdown_connections 2021-12-17T18:25:22.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.468+0000 7facc1098700 1 --2- 172.21.15.62:0/3272015034 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faca00536a0 0x7faca0055b60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.468+0000 7facc1098700 1 --2- 172.21.15.62:0/3272015034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc141480 0x7facbc0ac950 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.468+0000 7facc1098700 1 --2- 172.21.15.62:0/3272015034 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7facbc0a8e10 0x7facbc0ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.468+0000 7facc1098700 1 --2- 172.21.15.62:0/3272015034 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7facbc0a71e0 0x7facbc148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.468+0000 7facc1098700 1 -- 172.21.15.62:0/3272015034 >> 172.21.15.62:0/3272015034 conn(0x7facbc05d220 msgr2=0x7facbc13f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:22.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.468+0000 7facc1098700 1 -- 172.21.15.62:0/3272015034 shutdown_connections 2021-12-17T18:25:22.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.468+0000 7facc1098700 1 -- 172.21.15.62:0/3272015034 wait complete. 2021-12-17T18:25:22.484 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:25:22.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c6894c700 1 Processor -- start 2021-12-17T18:25:22.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c6894c700 1 -- start start 2021-12-17T18:25:22.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c6894c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5c640b4340 0x7f5c641471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c6894c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c640b51a0 0x7f5c640b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c6894c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c640b09e0 con 0x7f5c64142660 2021-12-17T18:25:22.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c6894c700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c641467d0 con 0x7f5c640b4340 2021-12-17T18:25:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c6894c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c64146a70 con 0x7f5c640b51a0 2021-12-17T18:25:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c62d9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5c64142660 0x7f5c640b5a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36582/0 (socket says 172.21.15.62:36582) 2021-12-17T18:25:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c62d9d700 1 -- 172.21.15.62:0/1297183559 learned_addr learned my addr 172.21.15.62:0/1297183559 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c59d9b700 1 --2- 172.21.15.62:0/1297183559 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c640b51a0 0x7f5c640b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c6259c700 1 --2- 172.21.15.62:0/1297183559 >> v2:172.21.15.109:3300/0 conn(0x7f5c640b4340 0x7f5c641471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c61d9b700 1 -- 172.21.15.62:0/1297183559 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667149067 0 0) 0x7f5c640b09e0 con 0x7f5c64142660 2021-12-17T18:25:22.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c61d9b700 1 -- 172.21.15.62:0/1297183559 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c44003260 con 0x7f5c64142660 2021-12-17T18:25:22.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c59d9b700 1 -- 172.21.15.62:0/1297183559 >> v2:172.21.15.109:3300/0 conn(0x7f5c640b4340 msgr2=0x7f5c641471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:22.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c59d9b700 1 --2- 172.21.15.62:0/1297183559 >> v2:172.21.15.109:3300/0 conn(0x7f5c640b4340 0x7f5c641471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c59d9b700 1 -- 172.21.15.62:0/1297183559 >> v1:172.21.15.62:6789/0 conn(0x7f5c64142660 legacy=0x7f5c640b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c59d9b700 1 -- 172.21.15.62:0/1297183559 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c64146d10 con 0x7f5c640b51a0 2021-12-17T18:25:22.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c6259c700 1 --2- 172.21.15.62:0/1297183559 >> v2:172.21.15.109:3300/0 conn(0x7f5c640b4340 0x7f5c641471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:22.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c59d9b700 1 --2- 172.21.15.62:0/1297183559 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c640b51a0 0x7f5c640b28f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f5c4c002f70 tx=0x7f5c4c006df0).ready entity=mon.2 client_cookie=bc0740310ff4b0df server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:22.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c61d9b700 1 -- 172.21.15.62:0/1297183559 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c4c00d4a0 con 0x7f5c640b51a0 2021-12-17T18:25:22.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c61d9b700 1 -- 172.21.15.62:0/1297183559 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4c000e90 con 0x7f5c640b51a0 2021-12-17T18:25:22.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.596+0000 7f5c61d9b700 1 -- 172.21.15.62:0/1297183559 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c4c00d7f0 con 0x7f5c640b51a0 2021-12-17T18:25:22.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.600+0000 7f5c6894c700 1 -- 172.21.15.62:0/1297183559 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c640b51a0 msgr2=0x7f5c640b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.600+0000 7f5c6894c700 1 --2- 172.21.15.62:0/1297183559 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c640b51a0 0x7f5c640b28f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f5c4c002f70 tx=0x7f5c4c006df0).stop 2021-12-17T18:25:22.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.600+0000 7f5c6894c700 1 -- 172.21.15.62:0/1297183559 shutdown_connections 2021-12-17T18:25:22.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.600+0000 7f5c6894c700 1 --2- 172.21.15.62:0/1297183559 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c640b51a0 0x7f5c640b28f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.600+0000 7f5c6894c700 1 --2- 172.21.15.62:0/1297183559 >> v2:172.21.15.109:3300/0 conn(0x7f5c640b4340 0x7f5c641471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.600+0000 7f5c6894c700 1 -- 172.21.15.62:0/1297183559 >> 172.21.15.62:0/1297183559 conn(0x7f5c6405c750 msgr2=0x7f5c6405cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:22.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.600+0000 7f5c6894c700 1 -- 172.21.15.62:0/1297183559 shutdown_connections 2021-12-17T18:25:22.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.600+0000 7f5c6894c700 1 -- 172.21.15.62:0/1297183559 wait complete. 2021-12-17T18:25:22.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.600+0000 7f5c6894c700 1 Processor -- start 2021-12-17T18:25:22.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.600+0000 7f5c6894c700 1 -- start start 2021-12-17T18:25:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c6894c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c640b4340 0x7f5c64148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c6894c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c640b51a0 0x7f5c64149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c6894c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c64142660 0x7f5c64155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c6894c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c64067350 con 0x7f5c640b51a0 2021-12-17T18:25:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c6894c700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6414a130 con 0x7f5c64142660 2021-12-17T18:25:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c6894c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6414a3c0 con 0x7f5c640b4340 2021-12-17T18:25:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c59d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c640b51a0 0x7f5c64149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c59d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c640b51a0 0x7f5c64149c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53008/0 (socket says 172.21.15.62:53008) 2021-12-17T18:25:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c59d9b700 1 -- 172.21.15.62:0/3621031734 learned_addr learned my addr 172.21.15.62:0/3621031734 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c62d9d700 1 --2- 172.21.15.62:0/3621031734 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c64142660 0x7f5c64155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c6259c700 1 --2- 172.21.15.62:0/3621031734 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c640b4340 0x7f5c64148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c59d9b700 1 -- 172.21.15.62:0/3621031734 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c640b4340 msgr2=0x7f5c64148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c59d9b700 1 --2- 172.21.15.62:0/3621031734 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c640b4340 0x7f5c64148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c59d9b700 1 -- 172.21.15.62:0/3621031734 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c64142660 msgr2=0x7f5c64155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c59d9b700 1 --2- 172.21.15.62:0/3621031734 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c64142660 0x7f5c64155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c59d9b700 1 -- 172.21.15.62:0/3621031734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5400b180 con 0x7f5c640b51a0 2021-12-17T18:25:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c59d9b700 1 --2- 172.21.15.62:0/3621031734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c640b51a0 0x7f5c64149c40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f5c4c002f70 tx=0x7f5c4c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c5bfff700 1 -- 172.21.15.62:0/3621031734 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c4c016070 con 0x7f5c640b51a0 2021-12-17T18:25:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c5bfff700 1 -- 172.21.15.62:0/3621031734 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4c0137d0 con 0x7f5c640b51a0 2021-12-17T18:25:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c6894c700 1 -- 172.21.15.62:0/3621031734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4c00b180 con 0x7f5c640b51a0 2021-12-17T18:25:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c5bfff700 1 -- 172.21.15.62:0/3621031734 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c4c013b30 con 0x7f5c640b51a0 2021-12-17T18:25:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c6894c700 1 -- 172.21.15.62:0/3621031734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c64155b40 con 0x7f5c640b51a0 2021-12-17T18:25:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.604+0000 7f5c6894c700 1 -- 172.21.15.62:0/3621031734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c640b4720 con 0x7f5c640b51a0 2021-12-17T18:25:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.608+0000 7f5c5bfff700 1 -- 172.21.15.62:0/3621031734 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5c4c00f030 con 0x7f5c640b51a0 2021-12-17T18:25:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.608+0000 7f5c5bfff700 1 --2- 172.21.15.62:0/3621031734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c48053610 0x7f5c48055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.608+0000 7f5c5bfff700 1 -- 172.21.15.62:0/3621031734 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5c4c06c640 con 0x7f5c640b51a0 2021-12-17T18:25:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.608+0000 7f5c6259c700 1 --2- 172.21.15.62:0/3621031734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c48053610 0x7f5c48055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.608+0000 7f5c6259c700 1 --2- 172.21.15.62:0/3621031734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c48053610 0x7f5c48055ad0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f5c5400b000 tx=0x7f5c54006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:22.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.616+0000 7f5c5bfff700 1 -- 172.21.15.62:0/3621031734 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5c4c043690 con 0x7f5c640b51a0 2021-12-17T18:25:22.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.784+0000 7f5c6894c700 1 -- 172.21.15.62:0/3621031734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5c640573d0 con 0x7f5c640b51a0 2021-12-17T18:25:22.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.792+0000 7f5c5bfff700 1 -- 172.21.15.62:0/3621031734 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v26) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5c4c046cb0 con 0x7f5c640b51a0 2021-12-17T18:25:22.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.792+0000 7f5c6894c700 1 -- 172.21.15.62:0/3621031734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c48053610 msgr2=0x7f5c48055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.792+0000 7f5c6894c700 1 --2- 172.21.15.62:0/3621031734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c48053610 0x7f5c48055ad0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f5c5400b000 tx=0x7f5c54006df0).stop 2021-12-17T18:25:22.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.792+0000 7f5c6894c700 1 -- 172.21.15.62:0/3621031734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c640b51a0 msgr2=0x7f5c64149c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.792+0000 7f5c6894c700 1 --2- 172.21.15.62:0/3621031734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c640b51a0 0x7f5c64149c40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f5c4c002f70 tx=0x7f5c4c014000).stop 2021-12-17T18:25:22.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.792+0000 7f5c6894c700 1 -- 172.21.15.62:0/3621031734 shutdown_connections 2021-12-17T18:25:22.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.792+0000 7f5c6894c700 1 --2- 172.21.15.62:0/3621031734 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c48053610 0x7f5c48055ad0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.792+0000 7f5c6894c700 1 --2- 172.21.15.62:0/3621031734 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c64142660 0x7f5c64155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.792+0000 7f5c6894c700 1 --2- 172.21.15.62:0/3621031734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c640b51a0 0x7f5c64149c40 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.792+0000 7f5c6894c700 1 --2- 172.21.15.62:0/3621031734 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c640b4340 0x7f5c64148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.792+0000 7f5c6894c700 1 -- 172.21.15.62:0/3621031734 >> 172.21.15.62:0/3621031734 conn(0x7f5c6405c750 msgr2=0x7f5c64141330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:22.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.792+0000 7f5c6894c700 1 -- 172.21.15.62:0/3621031734 shutdown_connections 2021-12-17T18:25:22.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.792+0000 7f5c6894c700 1 -- 172.21.15.62:0/3621031734 wait complete. 2021-12-17T18:25:22.802 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.0 2021-12-17T18:25:22.811 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:25:22.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f752f165700 1 Processor -- start 2021-12-17T18:25:22.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f752f165700 1 -- start start 2021-12-17T18:25:22.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f752f165700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75280b66c0 0x7f752805f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f752f165700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7528060330 0x7f75280aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f752f165700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75280b6aa0 con 0x7f75280b2240 2021-12-17T18:25:22.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f752f165700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75280ad9c0 con 0x7f7528060330 2021-12-17T18:25:22.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f752f165700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75280ad4b0 con 0x7f75280b66c0 2021-12-17T18:25:22.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f752d702700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7528060330 0x7f75280aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f752cf01700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75280b66c0 0x7f752805f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f752d702700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7528060330 0x7f75280aeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:59566/0 (socket says 172.21.15.62:59566) 2021-12-17T18:25:22.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f752cf01700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75280b66c0 0x7f752805f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:46714/0 (socket says 172.21.15.62:46714) 2021-12-17T18:25:22.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f752d702700 1 -- 172.21.15.62:0/523823715 learned_addr learned my addr 172.21.15.62:0/523823715 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:22.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f751ffff700 1 --1- 172.21.15.62:0/523823715 >> v1:172.21.15.109:6789/0 conn(0x7f75280b2240 0x7f752805fc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:52914/0 (socket says 172.21.15.62:52914) 2021-12-17T18:25:22.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f752d702700 1 -- 172.21.15.62:0/523823715 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75280b66c0 msgr2=0x7f752805f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:22.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f752d702700 1 --2- 172.21.15.62:0/523823715 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75280b66c0 0x7f752805f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f752d702700 1 -- 172.21.15.62:0/523823715 >> v1:172.21.15.109:6789/0 conn(0x7f75280b2240 legacy=0x7f752805fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f752d702700 1 -- 172.21.15.62:0/523823715 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75280b0b70 con 0x7f7528060330 2021-12-17T18:25:22.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.928+0000 7f752d702700 1 --2- 172.21.15.62:0/523823715 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7528060330 0x7f75280aeb00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f75200032f0 tx=0x7f7520009290).ready entity=mon.1 client_cookie=76d3c75d383e3ba9 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:22.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.932+0000 7f751f7fe700 1 -- 172.21.15.62:0/523823715 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f752000b8a0 con 0x7f7528060330 2021-12-17T18:25:22.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.932+0000 7f751f7fe700 1 -- 172.21.15.62:0/523823715 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752000ba00 con 0x7f7528060330 2021-12-17T18:25:22.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.932+0000 7f751f7fe700 1 -- 172.21.15.62:0/523823715 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f752000bb70 con 0x7f7528060330 2021-12-17T18:25:22.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.932+0000 7f752f165700 1 -- 172.21.15.62:0/523823715 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7528060330 msgr2=0x7f75280aeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.932+0000 7f752f165700 1 --2- 172.21.15.62:0/523823715 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7528060330 0x7f75280aeb00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f75200032f0 tx=0x7f7520009290).stop 2021-12-17T18:25:22.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.932+0000 7f752f165700 1 -- 172.21.15.62:0/523823715 shutdown_connections 2021-12-17T18:25:22.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.932+0000 7f752f165700 1 --2- 172.21.15.62:0/523823715 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7528060330 0x7f75280aeb00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.932+0000 7f752f165700 1 --2- 172.21.15.62:0/523823715 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75280b66c0 0x7f752805f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.932+0000 7f752f165700 1 -- 172.21.15.62:0/523823715 >> 172.21.15.62:0/523823715 conn(0x7f752805d220 msgr2=0x7f75280b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:22.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.932+0000 7f752f165700 1 -- 172.21.15.62:0/523823715 shutdown_connections 2021-12-17T18:25:22.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.932+0000 7f752f165700 1 -- 172.21.15.62:0/523823715 wait complete. 2021-12-17T18:25:22.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.932+0000 7f752f165700 1 Processor -- start 2021-12-17T18:25:22.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.932+0000 7f752f165700 1 -- start start 2021-12-17T18:25:22.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752f165700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7528060330 0x7f7528064910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752f165700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75280b2240 0x7f7528159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752f165700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75280b66c0 0x7f75280a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752f165700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75280a7720 con 0x7f75280b66c0 2021-12-17T18:25:22.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752f165700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7528066890 con 0x7f7528060330 2021-12-17T18:25:22.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752f165700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7528066b00 con 0x7f75280b2240 2021-12-17T18:25:22.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752d702700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75280b66c0 0x7f75280a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752d702700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75280b66c0 0x7f75280a7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53022/0 (socket says 172.21.15.62:53022) 2021-12-17T18:25:22.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752d702700 1 -- 172.21.15.62:0/360664835 learned_addr learned my addr 172.21.15.62:0/360664835 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:22.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752cf01700 1 --2- 172.21.15.62:0/360664835 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7528060330 0x7f7528064910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f751ffff700 1 --2- 172.21.15.62:0/360664835 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75280b2240 0x7f7528159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752d702700 1 -- 172.21.15.62:0/360664835 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75280b2240 msgr2=0x7f7528159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752d702700 1 --2- 172.21.15.62:0/360664835 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75280b2240 0x7f7528159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752d702700 1 -- 172.21.15.62:0/360664835 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7528060330 msgr2=0x7f7528064910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:22.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752d702700 1 --2- 172.21.15.62:0/360664835 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7528060330 0x7f7528064910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:22.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752d702700 1 -- 172.21.15.62:0/360664835 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520009530 con 0x7f75280b66c0 2021-12-17T18:25:22.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752d702700 1 --2- 172.21.15.62:0/360664835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75280b66c0 0x7f75280a7b50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f7528066a20 tx=0x7f7520016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:22.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f751dffb700 1 -- 172.21.15.62:0/360664835 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f752000b8a0 con 0x7f75280b66c0 2021-12-17T18:25:22.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f751dffb700 1 -- 172.21.15.62:0/360664835 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7520021440 con 0x7f75280b66c0 2021-12-17T18:25:22.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752f165700 1 -- 172.21.15.62:0/360664835 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752814a310 con 0x7f75280b66c0 2021-12-17T18:25:22.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f751dffb700 1 -- 172.21.15.62:0/360664835 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75200217a0 con 0x7f75280b66c0 2021-12-17T18:25:22.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.936+0000 7f752f165700 1 -- 172.21.15.62:0/360664835 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7528149ec0 con 0x7f75280b66c0 2021-12-17T18:25:22.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.940+0000 7f752f165700 1 -- 172.21.15.62:0/360664835 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75280ad1a0 con 0x7f75280b66c0 2021-12-17T18:25:22.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.940+0000 7f751dffb700 1 -- 172.21.15.62:0/360664835 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7520028070 con 0x7f75280b66c0 2021-12-17T18:25:22.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.940+0000 7f751dffb700 1 --2- 172.21.15.62:0/360664835 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75080536a0 0x7f7508055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:22.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.940+0000 7f751dffb700 1 -- 172.21.15.62:0/360664835 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f752006cb10 con 0x7f75280b66c0 2021-12-17T18:25:22.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.940+0000 7f752cf01700 1 --2- 172.21.15.62:0/360664835 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75080536a0 0x7f7508055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:22.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.940+0000 7f752cf01700 1 --2- 172.21.15.62:0/360664835 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75080536a0 0x7f7508055b60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f752400b000 tx=0x7f7524006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:22.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:22.948+0000 7f751dffb700 1 -- 172.21.15.62:0/360664835 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7520043ae0 con 0x7f75280b66c0 2021-12-17T18:25:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.116+0000 7f752f165700 1 -- 172.21.15.62:0/360664835 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f75280573d0 con 0x7f75280b66c0 2021-12-17T18:25:23.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.124+0000 7f751dffb700 1 -- 172.21.15.62:0/360664835 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v27) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7520047100 con 0x7f75280b66c0 2021-12-17T18:25:23.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.128+0000 7f752f165700 1 -- 172.21.15.62:0/360664835 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75080536a0 msgr2=0x7f7508055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:23.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.128+0000 7f752f165700 1 --2- 172.21.15.62:0/360664835 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75080536a0 0x7f7508055b60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f752400b000 tx=0x7f7524006df0).stop 2021-12-17T18:25:23.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.128+0000 7f752f165700 1 -- 172.21.15.62:0/360664835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75280b66c0 msgr2=0x7f75280a7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:23.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.128+0000 7f752f165700 1 --2- 172.21.15.62:0/360664835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75280b66c0 0x7f75280a7b50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f7528066a20 tx=0x7f7520016000).stop 2021-12-17T18:25:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.128+0000 7f752f165700 1 -- 172.21.15.62:0/360664835 shutdown_connections 2021-12-17T18:25:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.128+0000 7f752f165700 1 --2- 172.21.15.62:0/360664835 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75080536a0 0x7f7508055b60 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.128+0000 7f752f165700 1 --2- 172.21.15.62:0/360664835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75280b66c0 0x7f75280a7b50 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.128+0000 7f752f165700 1 --2- 172.21.15.62:0/360664835 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75280b2240 0x7f7528159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.128+0000 7f752f165700 1 --2- 172.21.15.62:0/360664835 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7528060330 0x7f7528064910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.128+0000 7f752f165700 1 -- 172.21.15.62:0/360664835 >> 172.21.15.62:0/360664835 conn(0x7f752805d220 msgr2=0x7f752814a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:23.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.128+0000 7f752f165700 1 -- 172.21.15.62:0/360664835 shutdown_connections 2021-12-17T18:25:23.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.128+0000 7f752f165700 1 -- 172.21.15.62:0/360664835 wait complete. 2021-12-17T18:25:23.136 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.1 2021-12-17T18:25:23.147 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:25:23.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f9078a82700 1 Processor -- start 2021-12-17T18:25:23.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f9078a82700 1 -- start start 2021-12-17T18:25:23.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f9078a82700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90740ad470 0x7f90740ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:23.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f9078a82700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90740b0480 0x7f9074140360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:23.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f9078a82700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90740afba0 con 0x7f9074140850 2021-12-17T18:25:23.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f9078a82700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907405be20 con 0x7f90740b0480 2021-12-17T18:25:23.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f9078a82700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90740afdd0 con 0x7f90740ad470 2021-12-17T18:25:23.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f9072ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90740b0480 0x7f9074140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:23.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f9073fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9074140850 0x7f9074143490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36608/0 (socket says 172.21.15.62:36608) 2021-12-17T18:25:23.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f9072ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90740b0480 0x7f9074140360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53030/0 (socket says 172.21.15.62:53030) 2021-12-17T18:25:23.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f9073fff700 1 -- 172.21.15.62:0/4035794532 learned_addr learned my addr 172.21.15.62:0/4035794532 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f90737fe700 1 --2- 172.21.15.62:0/4035794532 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90740ad470 0x7f90740ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f9072ffd700 1 -- 172.21.15.62:0/4035794532 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90740ad470 msgr2=0x7f90740ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f9072ffd700 1 --2- 172.21.15.62:0/4035794532 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90740ad470 0x7f90740ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f9072ffd700 1 -- 172.21.15.62:0/4035794532 >> v1:172.21.15.62:6789/0 conn(0x7f9074140850 legacy=0x7f9074143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:23.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f9072ffd700 1 -- 172.21.15.62:0/4035794532 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907413fe60 con 0x7f90740b0480 2021-12-17T18:25:23.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f9072ffd700 1 --2- 172.21.15.62:0/4035794532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90740b0480 0x7f9074140360 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f9068002f70 tx=0x7f9068006e80).ready entity=mon.0 client_cookie=7c952807d69b7259 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:23.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.256+0000 7f90727fc700 1 -- 172.21.15.62:0/4035794532 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f906800ba70 con 0x7f90740b0480 2021-12-17T18:25:23.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f90727fc700 1 -- 172.21.15.62:0/4035794532 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9068000e90 con 0x7f90740b0480 2021-12-17T18:25:23.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f90727fc700 1 -- 172.21.15.62:0/4035794532 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f906800bdc0 con 0x7f90740b0480 2021-12-17T18:25:23.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9078a82700 1 -- 172.21.15.62:0/4035794532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90740b0480 msgr2=0x7f9074140360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:23.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9078a82700 1 --2- 172.21.15.62:0/4035794532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90740b0480 0x7f9074140360 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f9068002f70 tx=0x7f9068006e80).stop 2021-12-17T18:25:23.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9078a82700 1 -- 172.21.15.62:0/4035794532 shutdown_connections 2021-12-17T18:25:23.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9078a82700 1 --2- 172.21.15.62:0/4035794532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90740b0480 0x7f9074140360 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9078a82700 1 --2- 172.21.15.62:0/4035794532 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90740ad470 0x7f90740ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9078a82700 1 -- 172.21.15.62:0/4035794532 >> 172.21.15.62:0/4035794532 conn(0x7f90740b5ae0 msgr2=0x7f90740b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:23.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9078a82700 1 -- 172.21.15.62:0/4035794532 shutdown_connections 2021-12-17T18:25:23.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9078a82700 1 -- 172.21.15.62:0/4035794532 wait complete. 2021-12-17T18:25:23.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9078a82700 1 Processor -- start 2021-12-17T18:25:23.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9078a82700 1 -- start start 2021-12-17T18:25:23.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9078a82700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f90740ad470 0x7f90741437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:23.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9078a82700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90740b0480 0x7f9074063b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:23.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9078a82700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9074140850 0x7f9074064060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:23.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9078a82700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9074155c50 con 0x7f9074140850 2021-12-17T18:25:23.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9078a82700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9074066a90 con 0x7f90740ad470 2021-12-17T18:25:23.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9078a82700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90740654d0 con 0x7f90740b0480 2021-12-17T18:25:23.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9073fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9074140850 0x7f9074064060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:23.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9073fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9074140850 0x7f9074064060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53036/0 (socket says 172.21.15.62:53036) 2021-12-17T18:25:23.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9073fff700 1 -- 172.21.15.62:0/2101262630 learned_addr learned my addr 172.21.15.62:0/2101262630 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:23.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f90737fe700 1 --2- 172.21.15.62:0/2101262630 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f90740ad470 0x7f90741437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:23.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9072ffd700 1 --2- 172.21.15.62:0/2101262630 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90740b0480 0x7f9074063b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:23.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9073fff700 1 -- 172.21.15.62:0/2101262630 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90740b0480 msgr2=0x7f9074063b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:23.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9073fff700 1 --2- 172.21.15.62:0/2101262630 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90740b0480 0x7f9074063b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9073fff700 1 -- 172.21.15.62:0/2101262630 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f90740ad470 msgr2=0x7f90741437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:23.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9073fff700 1 --2- 172.21.15.62:0/2101262630 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f90740ad470 0x7f90741437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.260+0000 7f9073fff700 1 -- 172.21.15.62:0/2101262630 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906800d410 con 0x7f9074140850 2021-12-17T18:25:23.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.264+0000 7f9073fff700 1 --2- 172.21.15.62:0/2101262630 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9074140850 0x7f9074064060 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f90740b5a30 tx=0x7f906c0013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:23.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.264+0000 7f9070ff9700 1 -- 172.21.15.62:0/2101262630 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f906c005ba0 con 0x7f9074140850 2021-12-17T18:25:23.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.264+0000 7f9070ff9700 1 -- 172.21.15.62:0/2101262630 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c005d00 con 0x7f9074140850 2021-12-17T18:25:23.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.264+0000 7f9078a82700 1 -- 172.21.15.62:0/2101262630 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9074065770 con 0x7f9074140850 2021-12-17T18:25:23.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.264+0000 7f9070ff9700 1 -- 172.21.15.62:0/2101262630 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f906c0072c0 con 0x7f9074140850 2021-12-17T18:25:23.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.264+0000 7f9078a82700 1 -- 172.21.15.62:0/2101262630 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90741440d0 con 0x7f9074140850 2021-12-17T18:25:23.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.264+0000 7f9078a82700 1 -- 172.21.15.62:0/2101262630 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9074067c20 con 0x7f9074140850 2021-12-17T18:25:23.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.264+0000 7f9070ff9700 1 -- 172.21.15.62:0/2101262630 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f906c010070 con 0x7f9074140850 2021-12-17T18:25:23.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.264+0000 7f9070ff9700 1 --2- 172.21.15.62:0/2101262630 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f90540535b0 0x7f9054055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:23.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.268+0000 7f9070ff9700 1 -- 172.21.15.62:0/2101262630 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f906c06b230 con 0x7f9074140850 2021-12-17T18:25:23.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.268+0000 7f90737fe700 1 --2- 172.21.15.62:0/2101262630 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f90540535b0 0x7f9054055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:23.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.268+0000 7f90737fe700 1 --2- 172.21.15.62:0/2101262630 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f90540535b0 0x7f9054055a70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f906400c000 tx=0x7f9064008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:23.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.272+0000 7f9070ff9700 1 -- 172.21.15.62:0/2101262630 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f906c068e90 con 0x7f9074140850 2021-12-17T18:25:23.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.440+0000 7f9078a82700 1 -- 172.21.15.62:0/2101262630 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9074065900 con 0x7f9074140850 2021-12-17T18:25:23.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.448+0000 7f9070ff9700 1 -- 172.21.15.62:0/2101262630 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v28) v1 ==== 184+0+0 (secure 0 0 0) 0x7f906c042280 con 0x7f9074140850 2021-12-17T18:25:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.448+0000 7f9078a82700 1 -- 172.21.15.62:0/2101262630 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f90540535b0 msgr2=0x7f9054055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.448+0000 7f9078a82700 1 --2- 172.21.15.62:0/2101262630 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f90540535b0 0x7f9054055a70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f906400c000 tx=0x7f9064008040).stop 2021-12-17T18:25:23.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.448+0000 7f9078a82700 1 -- 172.21.15.62:0/2101262630 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9074140850 msgr2=0x7f9074064060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.448+0000 7f9078a82700 1 --2- 172.21.15.62:0/2101262630 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9074140850 0x7f9074064060 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f90740b5a30 tx=0x7f906c0013a0).stop 2021-12-17T18:25:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.448+0000 7f9078a82700 1 -- 172.21.15.62:0/2101262630 shutdown_connections 2021-12-17T18:25:23.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.448+0000 7f9078a82700 1 --2- 172.21.15.62:0/2101262630 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f90540535b0 0x7f9054055a70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.448+0000 7f9078a82700 1 --2- 172.21.15.62:0/2101262630 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9074140850 0x7f9074064060 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.448+0000 7f9078a82700 1 --2- 172.21.15.62:0/2101262630 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90740b0480 0x7f9074063b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.448+0000 7f9078a82700 1 --2- 172.21.15.62:0/2101262630 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f90740ad470 0x7f90741437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.448+0000 7f9078a82700 1 -- 172.21.15.62:0/2101262630 >> 172.21.15.62:0/2101262630 conn(0x7f90740b5ae0 msgr2=0x7f90740b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:23.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.448+0000 7f9078a82700 1 -- 172.21.15.62:0/2101262630 shutdown_connections 2021-12-17T18:25:23.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.448+0000 7f9078a82700 1 -- 172.21.15.62:0/2101262630 wait complete. 2021-12-17T18:25:23.458 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.2 2021-12-17T18:25:23.468 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:23.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.568+0000 7f6ecbfff700 1 Processor -- start 2021-12-17T18:25:23.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.568+0000 7f6ecbfff700 1 -- start start 2021-12-17T18:25:23.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecbfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6ecc0b5c80 0x7f6ecc0b6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:23.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecbfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc13fb60 0x7f6ecc143280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:23.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecbfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ecc0b1540 con 0x7f6ecc0afcf0 2021-12-17T18:25:23.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecbfff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ecc13ffd0 con 0x7f6ecc0b5c80 2021-12-17T18:25:23.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecbfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0b0140 con 0x7f6ecc13fb60 2021-12-17T18:25:23.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ec3fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6ecc0afcf0 0x7f6ecc142b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36622/0 (socket says 172.21.15.62:36622) 2021-12-17T18:25:23.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ec3fff700 1 -- 172.21.15.62:0/2675728715 learned_addr learned my addr 172.21.15.62:0/2675728715 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecaffd700 1 --2- 172.21.15.62:0/2675728715 >> v2:172.21.15.109:3300/0 conn(0x7f6ecc0b5c80 0x7f6ecc0b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecb7fe700 1 --2- 172.21.15.62:0/2675728715 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc13fb60 0x7f6ecc143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6eca7fc700 1 -- 172.21.15.62:0/2675728715 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261918718 0 0) 0x7f6ecc0b1540 con 0x7f6ecc0afcf0 2021-12-17T18:25:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6eca7fc700 1 -- 172.21.15.62:0/2675728715 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eac003260 con 0x7f6ecc0afcf0 2021-12-17T18:25:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecaffd700 1 -- 172.21.15.62:0/2675728715 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc13fb60 msgr2=0x7f6ecc143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecaffd700 1 --2- 172.21.15.62:0/2675728715 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc13fb60 0x7f6ecc143280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecaffd700 1 -- 172.21.15.62:0/2675728715 >> v1:172.21.15.62:6789/0 conn(0x7f6ecc0afcf0 legacy=0x7f6ecc142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecaffd700 1 -- 172.21.15.62:0/2675728715 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc0af5b0 con 0x7f6ecc0b5c80 2021-12-17T18:25:23.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecaffd700 1 --2- 172.21.15.62:0/2675728715 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6ecc0b5c80 0x7f6ecc0b6060 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f6ebc002f70 tx=0x7f6ebc006df0).ready entity=mon.1 client_cookie=7aead1d6b143737a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:23.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6eca7fc700 1 -- 172.21.15.62:0/2675728715 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ebc00d4a0 con 0x7f6ecc0b5c80 2021-12-17T18:25:23.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6eca7fc700 1 -- 172.21.15.62:0/2675728715 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc000e90 con 0x7f6ecc0b5c80 2021-12-17T18:25:23.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6eca7fc700 1 -- 172.21.15.62:0/2675728715 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ebc00d7f0 con 0x7f6ecc0b5c80 2021-12-17T18:25:23.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecbfff700 1 -- 172.21.15.62:0/2675728715 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6ecc0b5c80 msgr2=0x7f6ecc0b6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecbfff700 1 --2- 172.21.15.62:0/2675728715 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6ecc0b5c80 0x7f6ecc0b6060 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f6ebc002f70 tx=0x7f6ebc006df0).stop 2021-12-17T18:25:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecbfff700 1 -- 172.21.15.62:0/2675728715 shutdown_connections 2021-12-17T18:25:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecbfff700 1 --2- 172.21.15.62:0/2675728715 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc13fb60 0x7f6ecc143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecbfff700 1 --2- 172.21.15.62:0/2675728715 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6ecc0b5c80 0x7f6ecc0b6060 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecbfff700 1 -- 172.21.15.62:0/2675728715 >> 172.21.15.62:0/2675728715 conn(0x7f6ecc05c750 msgr2=0x7f6ecc05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:23.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecbfff700 1 -- 172.21.15.62:0/2675728715 shutdown_connections 2021-12-17T18:25:23.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.572+0000 7f6ecbfff700 1 -- 172.21.15.62:0/2675728715 wait complete. 2021-12-17T18:25:23.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ecbfff700 1 Processor -- start 2021-12-17T18:25:23.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ecbfff700 1 -- start start 2021-12-17T18:25:23.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ecbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ecc0afcf0 0x7f6ecc13b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:23.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ecbfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc0b5c80 0x7f6ecc063c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:23.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ecbfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6ecc13fb60 0x7f6ecc1514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:23.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ecbfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc064e90 con 0x7f6ecc0afcf0 2021-12-17T18:25:23.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ecbfff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0643b0 con 0x7f6ecc13fb60 2021-12-17T18:25:23.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ecbfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc064610 con 0x7f6ecc0b5c80 2021-12-17T18:25:23.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ecaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ecc0afcf0 0x7f6ecc13b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:23.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ecaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ecc0afcf0 0x7f6ecc13b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53046/0 (socket says 172.21.15.62:53046) 2021-12-17T18:25:23.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ecaffd700 1 -- 172.21.15.62:0/580776867 learned_addr learned my addr 172.21.15.62:0/580776867 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:23.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ecb7fe700 1 --2- 172.21.15.62:0/580776867 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6ecc13fb60 0x7f6ecc1514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:23.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ec3fff700 1 --2- 172.21.15.62:0/580776867 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc0b5c80 0x7f6ecc063c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:23.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ecaffd700 1 -- 172.21.15.62:0/580776867 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc0b5c80 msgr2=0x7f6ecc063c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:23.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ecaffd700 1 --2- 172.21.15.62:0/580776867 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc0b5c80 0x7f6ecc063c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ecaffd700 1 -- 172.21.15.62:0/580776867 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6ecc13fb60 msgr2=0x7f6ecc1514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:23.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ecaffd700 1 --2- 172.21.15.62:0/580776867 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6ecc13fb60 0x7f6ecc1514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.576+0000 7f6ecaffd700 1 -- 172.21.15.62:0/580776867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc00b180 con 0x7f6ecc0afcf0 2021-12-17T18:25:23.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.580+0000 7f6ecaffd700 1 --2- 172.21.15.62:0/580776867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ecc0afcf0 0x7f6ecc13b7e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f6ebc002f70 tx=0x7f6ebc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:23.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.580+0000 7f6ec8ff9700 1 -- 172.21.15.62:0/580776867 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ebc016070 con 0x7f6ecc0afcf0 2021-12-17T18:25:23.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.580+0000 7f6ec8ff9700 1 -- 172.21.15.62:0/580776867 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc0137d0 con 0x7f6ecc0afcf0 2021-12-17T18:25:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.580+0000 7f6ec8ff9700 1 -- 172.21.15.62:0/580776867 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ebc013b30 con 0x7f6ecc0afcf0 2021-12-17T18:25:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.580+0000 7f6ecbfff700 1 -- 172.21.15.62:0/580776867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc0ac780 con 0x7f6ecc0afcf0 2021-12-17T18:25:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.580+0000 7f6ecbfff700 1 -- 172.21.15.62:0/580776867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc151b40 con 0x7f6ecc0afcf0 2021-12-17T18:25:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.580+0000 7f6ecbfff700 1 -- 172.21.15.62:0/580776867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ecc064180 con 0x7f6ecc0afcf0 2021-12-17T18:25:23.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.580+0000 7f6ec8ff9700 1 -- 172.21.15.62:0/580776867 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6ebc025030 con 0x7f6ecc0afcf0 2021-12-17T18:25:23.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.580+0000 7f6ec8ff9700 1 --2- 172.21.15.62:0/580776867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eb0055790 0x7f6eb0057c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:23.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.580+0000 7f6ec8ff9700 1 -- 172.21.15.62:0/580776867 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6ebc06c8f0 con 0x7f6ecc0afcf0 2021-12-17T18:25:23.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.580+0000 7f6ec3fff700 1 --2- 172.21.15.62:0/580776867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eb0055790 0x7f6eb0057c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:23.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.584+0000 7f6ec3fff700 1 --2- 172.21.15.62:0/580776867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eb0055790 0x7f6eb0057c50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f6eb400d000 tx=0x7f6eb4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.588+0000 7f6ec8ff9700 1 -- 172.21.15.62:0/580776867 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6ebc043a50 con 0x7f6ecc0afcf0 2021-12-17T18:25:23.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.752+0000 7f6ecbfff700 1 -- 172.21.15.62:0/580776867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ecc0af850 con 0x7f6ecc0afcf0 2021-12-17T18:25:23.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.752+0000 7f6ec8ff9700 1 -- 172.21.15.62:0/580776867 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f6ebc023020 con 0x7f6ecc0afcf0 2021-12-17T18:25:23.757 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:23.758 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":37,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3760020760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3760020760},{"type":"v1","addr":"172.21.15.109:6835","nonce":3760020760}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:25:20.884652+0000","modified":"2021-12-17T18:25:21.888425+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1765551619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1765551619},{"type":"v1","addr":"172.21.15.62:6833","nonce":1765551619}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-12-17T18:25:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.752+0000 7f6ecbfff700 1 -- 172.21.15.62:0/580776867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eb0055790 msgr2=0x7f6eb0057c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.752+0000 7f6ecbfff700 1 --2- 172.21.15.62:0/580776867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eb0055790 0x7f6eb0057c50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f6eb400d000 tx=0x7f6eb4009040).stop 2021-12-17T18:25:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.752+0000 7f6ecbfff700 1 -- 172.21.15.62:0/580776867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ecc0afcf0 msgr2=0x7f6ecc13b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.752+0000 7f6ecbfff700 1 --2- 172.21.15.62:0/580776867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ecc0afcf0 0x7f6ecc13b7e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f6ebc002f70 tx=0x7f6ebc014000).stop 2021-12-17T18:25:23.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.752+0000 7f6ecbfff700 1 -- 172.21.15.62:0/580776867 shutdown_connections 2021-12-17T18:25:23.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.752+0000 7f6ecbfff700 1 --2- 172.21.15.62:0/580776867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eb0055790 0x7f6eb0057c50 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.752+0000 7f6ecbfff700 1 --2- 172.21.15.62:0/580776867 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6ecc13fb60 0x7f6ecc1514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.752+0000 7f6ecbfff700 1 --2- 172.21.15.62:0/580776867 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6ecc0b5c80 0x7f6ecc063c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.752+0000 7f6ecbfff700 1 --2- 172.21.15.62:0/580776867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ecc0afcf0 0x7f6ecc13b7e0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:23.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.752+0000 7f6ecbfff700 1 -- 172.21.15.62:0/580776867 >> 172.21.15.62:0/580776867 conn(0x7f6ecc05c750 msgr2=0x7f6ecc0ad4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:23.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.752+0000 7f6ecbfff700 1 -- 172.21.15.62:0/580776867 shutdown_connections 2021-12-17T18:25:23.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:23.752+0000 7f6ecbfff700 1 -- 172.21.15.62:0/580776867 wait complete. 2021-12-17T18:25:23.763 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 37 2021-12-17T18:25:23.972 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:25:20.884652+0000', 'modified': '2021-12-17T18:25:21.888425+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6714}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6714': {'gid': 6714, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/1765551619', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 1765551619}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 1765551619}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:25:23.973 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:25:23.974 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:25:24.093 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":6714,"want_state":"up:active","state":"up:active","rank_uptime":3.1943050930000001,"mdsmap_epoch":37,"osdmap_epoch":81,"osdmap_epoch_barrier":81,"uptime":7.5240251689999997} 2021-12-17T18:25:24.094 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 6714, "mdsmap_epoch": 37, "osdmap_epoch": 81, "osdmap_epoch_barrier": 81, "rank_uptime": 3.194305093, "state": "up:active", "uptime": 7.524025169, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:25:24.094 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:25:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24e290d700 1 Processor -- start 2021-12-17T18:25:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24e290d700 1 -- start start 2021-12-17T18:25:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24e290d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f24dc0b5730 0x7f24dc0ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24e290d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f24dc0aede0 0x7f24dc146680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24e290d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24dc0b0d50 con 0x7f24dc0b0970 2021-12-17T18:25:24.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24e290d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24dc0afec0 con 0x7f24dc0b5730 2021-12-17T18:25:24.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24e290d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc0b5cb0 con 0x7f24dc0aede0 2021-12-17T18:25:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24db7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f24dc0b5730 0x7f24dc0ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24db7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f24dc0b5730 0x7f24dc0ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53054/0 (socket says 172.21.15.62:53054) 2021-12-17T18:25:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24db7fe700 1 -- 172.21.15.62:0/533040435 learned_addr learned my addr 172.21.15.62:0/533040435 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24e0eaa700 1 --2- 172.21.15.62:0/533040435 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f24dc0aede0 0x7f24dc146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24db7fe700 1 -- 172.21.15.62:0/533040435 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f24dc0aede0 msgr2=0x7f24dc146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24db7fe700 1 --2- 172.21.15.62:0/533040435 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f24dc0aede0 0x7f24dc146680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24db7fe700 1 -- 172.21.15.62:0/533040435 >> v1:172.21.15.62:6789/0 conn(0x7f24dc0b0970 legacy=0x7f24dc0b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24db7fe700 1 -- 172.21.15.62:0/533040435 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24dc0b13e0 con 0x7f24dc0b5730 2021-12-17T18:25:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24db7fe700 1 --2- 172.21.15.62:0/533040435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24dc0b5730 0x7f24dc0ae8f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f24cc002f70 tx=0x7f24cc006eb0).ready entity=mon.0 client_cookie=a614917c8867397 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24daffd700 1 -- 172.21.15.62:0/533040435 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24cc00d5c0 con 0x7f24dc0b5730 2021-12-17T18:25:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24daffd700 1 -- 172.21.15.62:0/533040435 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24cc000e90 con 0x7f24dc0b5730 2021-12-17T18:25:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24daffd700 1 -- 172.21.15.62:0/533040435 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24cc00d950 con 0x7f24dc0b5730 2021-12-17T18:25:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24e290d700 1 -- 172.21.15.62:0/533040435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24dc0b5730 msgr2=0x7f24dc0ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24e290d700 1 --2- 172.21.15.62:0/533040435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24dc0b5730 0x7f24dc0ae8f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f24cc002f70 tx=0x7f24cc006eb0).stop 2021-12-17T18:25:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24e290d700 1 -- 172.21.15.62:0/533040435 shutdown_connections 2021-12-17T18:25:24.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24e290d700 1 --2- 172.21.15.62:0/533040435 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f24dc0aede0 0x7f24dc146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24e290d700 1 --2- 172.21.15.62:0/533040435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24dc0b5730 0x7f24dc0ae8f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24e290d700 1 -- 172.21.15.62:0/533040435 >> 172.21.15.62:0/533040435 conn(0x7f24dc05cb40 msgr2=0x7f24dc05cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:24.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24e290d700 1 -- 172.21.15.62:0/533040435 shutdown_connections 2021-12-17T18:25:24.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.196+0000 7f24e290d700 1 -- 172.21.15.62:0/533040435 wait complete. 2021-12-17T18:25:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.200+0000 7f24e290d700 1 Processor -- start 2021-12-17T18:25:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.200+0000 7f24e290d700 1 -- start start 2021-12-17T18:25:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24e290d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f24dc0aede0 0x7f24dc0b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24e290d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f24dc0b0970 0x7f24dc15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24e290d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24dc0b5730 0x7f24dc0a8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24e290d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc0a8760 con 0x7f24dc0b5730 2021-12-17T18:25:24.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24e290d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc0a8980 con 0x7f24dc0b0970 2021-12-17T18:25:24.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24e290d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc0a8c20 con 0x7f24dc0aede0 2021-12-17T18:25:24.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24e0eaa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24dc0b5730 0x7f24dc0a8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24e0eaa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24dc0b5730 0x7f24dc0a8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53064/0 (socket says 172.21.15.62:53064) 2021-12-17T18:25:24.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24db7fe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f24dc0b0970 0x7f24dc15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24e0eaa700 1 -- 172.21.15.62:0/2405063631 learned_addr learned my addr 172.21.15.62:0/2405063631 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:24.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24dbfff700 1 --2- 172.21.15.62:0/2405063631 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f24dc0aede0 0x7f24dc0b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24e0eaa700 1 -- 172.21.15.62:0/2405063631 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f24dc0aede0 msgr2=0x7f24dc0b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24e0eaa700 1 --2- 172.21.15.62:0/2405063631 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f24dc0aede0 0x7f24dc0b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24e0eaa700 1 -- 172.21.15.62:0/2405063631 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f24dc0b0970 msgr2=0x7f24dc15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24e0eaa700 1 --2- 172.21.15.62:0/2405063631 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f24dc0b0970 0x7f24dc15a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24e0eaa700 1 -- 172.21.15.62:0/2405063631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc00b1e0 con 0x7f24dc0b5730 2021-12-17T18:25:24.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24e0eaa700 1 --2- 172.21.15.62:0/2405063631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24dc0b5730 0x7f24dc0a8270 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f24d400a000 tx=0x7f24d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24d97fa700 1 -- 172.21.15.62:0/2405063631 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24d400c070 con 0x7f24dc0b5730 2021-12-17T18:25:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24d97fa700 1 -- 172.21.15.62:0/2405063631 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d40133f0 con 0x7f24dc0b5730 2021-12-17T18:25:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24e290d700 1 -- 172.21.15.62:0/2405063631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24dc0aa140 con 0x7f24dc0b5730 2021-12-17T18:25:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24d97fa700 1 -- 172.21.15.62:0/2405063631 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24d4013750 con 0x7f24dc0b5730 2021-12-17T18:25:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.204+0000 7f24e290d700 1 -- 172.21.15.62:0/2405063631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24dc0a7ed0 con 0x7f24dc0b5730 2021-12-17T18:25:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.208+0000 7f24d97fa700 1 -- 172.21.15.62:0/2405063631 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f24d40138b0 con 0x7f24dc0b5730 2021-12-17T18:25:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.208+0000 7f24e290d700 1 -- 172.21.15.62:0/2405063631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24dc0aa2d0 con 0x7f24dc0b5730 2021-12-17T18:25:24.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.208+0000 7f24d97fa700 1 --2- 172.21.15.62:0/2405063631 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f24bc053580 0x7f24bc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.208+0000 7f24d97fa700 1 -- 172.21.15.62:0/2405063631 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f24d406b700 con 0x7f24dc0b5730 2021-12-17T18:25:24.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.208+0000 7f24dbfff700 1 --2- 172.21.15.62:0/2405063631 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f24bc053580 0x7f24bc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.208+0000 7f24dbfff700 1 --2- 172.21.15.62:0/2405063631 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f24bc053580 0x7f24bc055a40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f24d000d000 tx=0x7f24d0000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:24.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.212+0000 7f24d97fa700 1 -- 172.21.15.62:0/2405063631 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f24d4042860 con 0x7f24dc0b5730 2021-12-17T18:25:24.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.340+0000 7f24e290d700 1 -- 172.21.15.62:0/2405063631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24dc06a2b0 con 0x7f24dc0b5730 2021-12-17T18:25:24.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.340+0000 7f24d97fa700 1 -- 172.21.15.62:0/2405063631 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f24d400f040 con 0x7f24dc0b5730 2021-12-17T18:25:24.348 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:24.348 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":81,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:25:21.887449+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:25:19.272638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-12-17T18:25:20.525388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:25:24.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.344+0000 7f24e290d700 1 -- 172.21.15.62:0/2405063631 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f24bc053580 msgr2=0x7f24bc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.344+0000 7f24e290d700 1 --2- 172.21.15.62:0/2405063631 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f24bc053580 0x7f24bc055a40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f24d000d000 tx=0x7f24d0000bc0).stop 2021-12-17T18:25:24.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.344+0000 7f24e290d700 1 -- 172.21.15.62:0/2405063631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24dc0b5730 msgr2=0x7f24dc0a8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.344+0000 7f24e290d700 1 --2- 172.21.15.62:0/2405063631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24dc0b5730 0x7f24dc0a8270 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f24d400a000 tx=0x7f24d4008040).stop 2021-12-17T18:25:24.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.344+0000 7f24e290d700 1 -- 172.21.15.62:0/2405063631 shutdown_connections 2021-12-17T18:25:24.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.344+0000 7f24e290d700 1 --2- 172.21.15.62:0/2405063631 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f24bc053580 0x7f24bc055a40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.344+0000 7f24e290d700 1 --2- 172.21.15.62:0/2405063631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24dc0b5730 0x7f24dc0a8270 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.344+0000 7f24e290d700 1 --2- 172.21.15.62:0/2405063631 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f24dc0b0970 0x7f24dc15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.344+0000 7f24e290d700 1 --2- 172.21.15.62:0/2405063631 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f24dc0aede0 0x7f24dc0b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.344+0000 7f24e290d700 1 -- 172.21.15.62:0/2405063631 >> 172.21.15.62:0/2405063631 conn(0x7f24dc05cb40 msgr2=0x7f24dc0b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:24.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.344+0000 7f24e290d700 1 -- 172.21.15.62:0/2405063631 shutdown_connections 2021-12-17T18:25:24.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.344+0000 7f24e290d700 1 -- 172.21.15.62:0/2405063631 wait complete. 2021-12-17T18:25:24.361 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:25:19.272638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:25:20.525388+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:25:24.362 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:25:24.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.468+0000 7f2931ea5700 1 Processor -- start 2021-12-17T18:25:24.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.468+0000 7f2931ea5700 1 -- start start 2021-12-17T18:25:24.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.468+0000 7f2931ea5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f292c0b47c0 0x7f292c0b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.468+0000 7f2931ea5700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f292c0b5be0 0x7f292c143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.468+0000 7f2931ea5700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f292c0b0870 con 0x7f292c05ca90 2021-12-17T18:25:24.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.468+0000 7f2931ea5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292c05ce70 con 0x7f292c0b47c0 2021-12-17T18:25:24.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.468+0000 7f2931ea5700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292c0b05d0 con 0x7f292c0b5be0 2021-12-17T18:25:24.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f292bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f292c0b47c0 0x7f292c0b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f292bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f292c0b47c0 0x7f292c0b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53070/0 (socket says 172.21.15.62:53070) 2021-12-17T18:25:24.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f292bfff700 1 -- 172.21.15.62:0/322253949 learned_addr learned my addr 172.21.15.62:0/322253949 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:24.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f29316a4700 1 --2- 172.21.15.62:0/322253949 >> v2:172.21.15.109:3300/0 conn(0x7f292c0b5be0 0x7f292c143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f292bfff700 1 -- 172.21.15.62:0/322253949 >> v2:172.21.15.109:3300/0 conn(0x7f292c0b5be0 msgr2=0x7f292c143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:24.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f292bfff700 1 --2- 172.21.15.62:0/322253949 >> v2:172.21.15.109:3300/0 conn(0x7f292c0b5be0 0x7f292c143ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f292bfff700 1 -- 172.21.15.62:0/322253949 >> v1:172.21.15.109:6789/0 conn(0x7f292c05ca90 legacy=0x7f292c0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f292bfff700 1 -- 172.21.15.62:0/322253949 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292c0b5250 con 0x7f292c0b47c0 2021-12-17T18:25:24.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f292bfff700 1 --2- 172.21.15.62:0/322253949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f292c0b47c0 0x7f292c0b56f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f2914002f70 tx=0x7f2914006eb0).ready entity=mon.0 client_cookie=f85e552790dba4d1 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:24.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f292b7fe700 1 -- 172.21.15.62:0/322253949 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f291400d5c0 con 0x7f292c0b47c0 2021-12-17T18:25:24.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f292b7fe700 1 -- 172.21.15.62:0/322253949 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2914000e90 con 0x7f292c0b47c0 2021-12-17T18:25:24.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f292b7fe700 1 -- 172.21.15.62:0/322253949 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f291400d950 con 0x7f292c0b47c0 2021-12-17T18:25:24.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f2931ea5700 1 -- 172.21.15.62:0/322253949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f292c0b47c0 msgr2=0x7f292c0b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f2931ea5700 1 --2- 172.21.15.62:0/322253949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f292c0b47c0 0x7f292c0b56f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f2914002f70 tx=0x7f2914006eb0).stop 2021-12-17T18:25:24.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f2931ea5700 1 -- 172.21.15.62:0/322253949 shutdown_connections 2021-12-17T18:25:24.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f2931ea5700 1 --2- 172.21.15.62:0/322253949 >> v2:172.21.15.109:3300/0 conn(0x7f292c0b5be0 0x7f292c143ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f2931ea5700 1 --2- 172.21.15.62:0/322253949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f292c0b47c0 0x7f292c0b56f0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f2931ea5700 1 -- 172.21.15.62:0/322253949 >> 172.21.15.62:0/322253949 conn(0x7f292c05bcd0 msgr2=0x7f292c062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:24.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f2931ea5700 1 -- 172.21.15.62:0/322253949 shutdown_connections 2021-12-17T18:25:24.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f2931ea5700 1 -- 172.21.15.62:0/322253949 wait complete. 2021-12-17T18:25:24.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f2931ea5700 1 Processor -- start 2021-12-17T18:25:24.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.472+0000 7f2931ea5700 1 -- start start 2021-12-17T18:25:24.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2931ea5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f292c05ca90 0x7f292c155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2931ea5700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f292c0b47c0 0x7f292c065680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2931ea5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f292c0b5be0 0x7f292c0a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2931ea5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c0b2910 con 0x7f292c05ca90 2021-12-17T18:25:24.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2931ea5700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c0a5310 con 0x7f292c0b47c0 2021-12-17T18:25:24.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2931ea5700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292c0b21d0 con 0x7f292c0b5be0 2021-12-17T18:25:24.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2930ea3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f292c05ca90 0x7f292c155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2930ea3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f292c05ca90 0x7f292c155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53074/0 (socket says 172.21.15.62:53074) 2021-12-17T18:25:24.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2930ea3700 1 -- 172.21.15.62:0/1446393696 learned_addr learned my addr 172.21.15.62:0/1446393696 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:24.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f292bfff700 1 --2- 172.21.15.62:0/1446393696 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f292c0b47c0 0x7f292c065680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f29316a4700 1 --2- 172.21.15.62:0/1446393696 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f292c0b5be0 0x7f292c0a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2930ea3700 1 -- 172.21.15.62:0/1446393696 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f292c0b5be0 msgr2=0x7f292c0a2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2930ea3700 1 --2- 172.21.15.62:0/1446393696 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f292c0b5be0 0x7f292c0a2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2930ea3700 1 -- 172.21.15.62:0/1446393696 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f292c0b47c0 msgr2=0x7f292c065680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2930ea3700 1 --2- 172.21.15.62:0/1446393696 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f292c0b47c0 0x7f292c065680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2930ea3700 1 -- 172.21.15.62:0/1446393696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291400b1e0 con 0x7f292c05ca90 2021-12-17T18:25:24.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2930ea3700 1 --2- 172.21.15.62:0/1446393696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f292c05ca90 0x7f292c155c60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f292c062e10 tx=0x7f291c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:24.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2929ffb700 1 -- 172.21.15.62:0/1446393696 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f291c012400 con 0x7f292c05ca90 2021-12-17T18:25:24.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2929ffb700 1 -- 172.21.15.62:0/1446393696 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c012560 con 0x7f292c05ca90 2021-12-17T18:25:24.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2931ea5700 1 -- 172.21.15.62:0/1446393696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f292c0b2470 con 0x7f292c05ca90 2021-12-17T18:25:24.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2929ffb700 1 -- 172.21.15.62:0/1446393696 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f291c0128c0 con 0x7f292c05ca90 2021-12-17T18:25:24.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2931ea5700 1 -- 172.21.15.62:0/1446393696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292c0a4f60 con 0x7f292c05ca90 2021-12-17T18:25:24.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2929ffb700 1 -- 172.21.15.62:0/1446393696 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f291c019030 con 0x7f292c05ca90 2021-12-17T18:25:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.476+0000 7f2931ea5700 1 -- 172.21.15.62:0/1446393696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292c0b2600 con 0x7f292c05ca90 2021-12-17T18:25:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.480+0000 7f2929ffb700 1 --2- 172.21.15.62:0/1446393696 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2910053610 0x7f2910055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.480+0000 7f2929ffb700 1 -- 172.21.15.62:0/1446393696 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f291c06ad50 con 0x7f292c05ca90 2021-12-17T18:25:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.480+0000 7f292bfff700 1 --2- 172.21.15.62:0/1446393696 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2910053610 0x7f2910055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.480+0000 7f292bfff700 1 --2- 172.21.15.62:0/1446393696 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2910053610 0x7f2910055ad0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f291401c000 tx=0x7f2914015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.484+0000 7f2929ffb700 1 -- 172.21.15.62:0/1446393696 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f291c041d40 con 0x7f292c05ca90 2021-12-17T18:25:24.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.612+0000 7f2931ea5700 1 -- 172.21.15.62:0/1446393696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f292c0b3980 con 0x7f292c05ca90 2021-12-17T18:25:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.612+0000 7f2929ffb700 1 -- 172.21.15.62:0/1446393696 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v81) v1 ==== 110+0+10 (secure 0 0 0) 0x7f291c045360 con 0x7f292c05ca90 2021-12-17T18:25:24.617 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:25:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.612+0000 7f2931ea5700 1 -- 172.21.15.62:0/1446393696 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2910053610 msgr2=0x7f2910055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.612+0000 7f2931ea5700 1 --2- 172.21.15.62:0/1446393696 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2910053610 0x7f2910055ad0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f291401c000 tx=0x7f2914015000).stop 2021-12-17T18:25:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.612+0000 7f2931ea5700 1 -- 172.21.15.62:0/1446393696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f292c05ca90 msgr2=0x7f292c155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.612+0000 7f2931ea5700 1 --2- 172.21.15.62:0/1446393696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f292c05ca90 0x7f292c155c60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f292c062e10 tx=0x7f291c007c50).stop 2021-12-17T18:25:24.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.612+0000 7f2931ea5700 1 -- 172.21.15.62:0/1446393696 shutdown_connections 2021-12-17T18:25:24.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.612+0000 7f2931ea5700 1 --2- 172.21.15.62:0/1446393696 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2910053610 0x7f2910055ad0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.612+0000 7f2931ea5700 1 --2- 172.21.15.62:0/1446393696 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f292c0b5be0 0x7f292c0a2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.612+0000 7f2931ea5700 1 --2- 172.21.15.62:0/1446393696 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f292c0b47c0 0x7f292c065680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.612+0000 7f2931ea5700 1 --2- 172.21.15.62:0/1446393696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f292c05ca90 0x7f292c155c60 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.612+0000 7f2931ea5700 1 -- 172.21.15.62:0/1446393696 >> 172.21.15.62:0/1446393696 conn(0x7f292c05bcd0 msgr2=0x7f292c0b7540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.612+0000 7f2931ea5700 1 -- 172.21.15.62:0/1446393696 shutdown_connections 2021-12-17T18:25:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.612+0000 7f2931ea5700 1 -- 172.21.15.62:0/1446393696 wait complete. 2021-12-17T18:25:24.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:25:24.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.736+0000 7f64384b7700 1 Processor -- start 2021-12-17T18:25:24.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.736+0000 7f64384b7700 1 -- start start 2021-12-17T18:25:24.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f64384b7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6430060260 0x7f643005cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f64384b7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6430146f70 0x7f64300b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f64384b7700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6430142ff0 con 0x7f643005c750 2021-12-17T18:25:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f64384b7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6430147420 con 0x7f6430146f70 2021-12-17T18:25:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f64384b7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6430143290 con 0x7f6430060260 2021-12-17T18:25:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f6436a54700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6430146f70 0x7f64300b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f6436a54700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6430146f70 0x7f64300b4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53084/0 (socket says 172.21.15.62:53084) 2021-12-17T18:25:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f6436a54700 1 -- 172.21.15.62:0/673534381 learned_addr learned my addr 172.21.15.62:0/673534381 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f6435a52700 1 --2- 172.21.15.62:0/673534381 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6430060260 0x7f643005cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f6436a54700 1 -- 172.21.15.62:0/673534381 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6430060260 msgr2=0x7f643005cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f6436a54700 1 --2- 172.21.15.62:0/673534381 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6430060260 0x7f643005cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f6436a54700 1 -- 172.21.15.62:0/673534381 >> v1:172.21.15.109:6789/0 conn(0x7f643005c750 legacy=0x7f64301439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f6436a54700 1 -- 172.21.15.62:0/673534381 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6430143530 con 0x7f6430146f70 2021-12-17T18:25:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f6436a54700 1 --2- 172.21.15.62:0/673534381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6430146f70 0x7f64300b4c80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f64300b2600 tx=0x7f6428009290).ready entity=mon.0 client_cookie=5c6fa469d9692a0e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f6435251700 1 -- 172.21.15.62:0/673534381 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f642800b860 con 0x7f6430146f70 2021-12-17T18:25:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f6435251700 1 -- 172.21.15.62:0/673534381 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642800b9c0 con 0x7f6430146f70 2021-12-17T18:25:24.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f6435251700 1 -- 172.21.15.62:0/673534381 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f642800bb30 con 0x7f6430146f70 2021-12-17T18:25:24.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f64384b7700 1 -- 172.21.15.62:0/673534381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6430146f70 msgr2=0x7f64300b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f64384b7700 1 --2- 172.21.15.62:0/673534381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6430146f70 0x7f64300b4c80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f64300b2600 tx=0x7f6428009290).stop 2021-12-17T18:25:24.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f64384b7700 1 -- 172.21.15.62:0/673534381 shutdown_connections 2021-12-17T18:25:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f64384b7700 1 --2- 172.21.15.62:0/673534381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6430146f70 0x7f64300b4c80 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f64384b7700 1 --2- 172.21.15.62:0/673534381 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6430060260 0x7f643005cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f64384b7700 1 -- 172.21.15.62:0/673534381 >> 172.21.15.62:0/673534381 conn(0x7f6430062430 msgr2=0x7f6430062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f64384b7700 1 -- 172.21.15.62:0/673534381 shutdown_connections 2021-12-17T18:25:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.740+0000 7f64384b7700 1 -- 172.21.15.62:0/673534381 wait complete. 2021-12-17T18:25:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f64384b7700 1 Processor -- start 2021-12-17T18:25:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f64384b7700 1 -- start start 2021-12-17T18:25:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f64384b7700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f643005c750 0x7f64300b9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f64384b7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6430060260 0x7f64300669c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f64384b7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6430146f70 0x7f6430066eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f64384b7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643013a370 con 0x7f6430146f70 2021-12-17T18:25:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f64384b7700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64300b8460 con 0x7f643005c750 2021-12-17T18:25:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f64384b7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64300b9340 con 0x7f6430060260 2021-12-17T18:25:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f6436a54700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6430146f70 0x7f6430066eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f6436a54700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6430146f70 0x7f6430066eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53092/0 (socket says 172.21.15.62:53092) 2021-12-17T18:25:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f6436a54700 1 -- 172.21.15.62:0/3121854153 learned_addr learned my addr 172.21.15.62:0/3121854153 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f6436253700 1 --2- 172.21.15.62:0/3121854153 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f643005c750 0x7f64300b9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f6435a52700 1 --2- 172.21.15.62:0/3121854153 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6430060260 0x7f64300669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f6436a54700 1 -- 172.21.15.62:0/3121854153 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6430060260 msgr2=0x7f64300669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f6436a54700 1 --2- 172.21.15.62:0/3121854153 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6430060260 0x7f64300669c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f6436a54700 1 -- 172.21.15.62:0/3121854153 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f643005c750 msgr2=0x7f64300b9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f6436a54700 1 --2- 172.21.15.62:0/3121854153 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f643005c750 0x7f64300b9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f6436a54700 1 -- 172.21.15.62:0/3121854153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6428009530 con 0x7f6430146f70 2021-12-17T18:25:24.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f6436a54700 1 --2- 172.21.15.62:0/3121854153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6430146f70 0x7f6430066eb0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f64300b2600 tx=0x7f6428016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:24.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f641f7fe700 1 -- 172.21.15.62:0/3121854153 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64280032f0 con 0x7f6430146f70 2021-12-17T18:25:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f641f7fe700 1 -- 172.21.15.62:0/3121854153 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6428021480 con 0x7f6430146f70 2021-12-17T18:25:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f64384b7700 1 -- 172.21.15.62:0/3121854153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64300b95e0 con 0x7f6430146f70 2021-12-17T18:25:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f641f7fe700 1 -- 172.21.15.62:0/3121854153 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64280217e0 con 0x7f6430146f70 2021-12-17T18:25:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.744+0000 7f64384b7700 1 -- 172.21.15.62:0/3121854153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64301403d0 con 0x7f6430146f70 2021-12-17T18:25:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.748+0000 7f641f7fe700 1 -- 172.21.15.62:0/3121854153 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f642800f070 con 0x7f6430146f70 2021-12-17T18:25:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.748+0000 7f64384b7700 1 -- 172.21.15.62:0/3121854153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64300573d0 con 0x7f6430146f70 2021-12-17T18:25:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.748+0000 7f641f7fe700 1 --2- 172.21.15.62:0/3121854153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6410053640 0x7f6410055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.748+0000 7f641f7fe700 1 -- 172.21.15.62:0/3121854153 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f642806cdd0 con 0x7f6430146f70 2021-12-17T18:25:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.748+0000 7f6436253700 1 --2- 172.21.15.62:0/3121854153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6410053640 0x7f6410055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.748+0000 7f6436253700 1 --2- 172.21.15.62:0/3121854153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6410053640 0x7f6410055b00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f642000d000 tx=0x7f6420007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.752+0000 7f641f7fe700 1 -- 172.21.15.62:0/3121854153 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6428043ed0 con 0x7f6430146f70 2021-12-17T18:25:24.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.880+0000 7f64384b7700 1 -- 172.21.15.62:0/3121854153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f64300b4390 con 0x7f6430146f70 2021-12-17T18:25:24.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.880+0000 7f641f7fe700 1 -- 172.21.15.62:0/3121854153 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v81) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6428015030 con 0x7f6430146f70 2021-12-17T18:25:24.886 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:25:24.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.884+0000 7f64384b7700 1 -- 172.21.15.62:0/3121854153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6410053640 msgr2=0x7f6410055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.884+0000 7f64384b7700 1 --2- 172.21.15.62:0/3121854153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6410053640 0x7f6410055b00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f642000d000 tx=0x7f6420007b90).stop 2021-12-17T18:25:24.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.884+0000 7f64384b7700 1 -- 172.21.15.62:0/3121854153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6430146f70 msgr2=0x7f6430066eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:24.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.884+0000 7f64384b7700 1 --2- 172.21.15.62:0/3121854153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6430146f70 0x7f6430066eb0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f64300b2600 tx=0x7f6428016000).stop 2021-12-17T18:25:24.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.884+0000 7f64384b7700 1 -- 172.21.15.62:0/3121854153 shutdown_connections 2021-12-17T18:25:24.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.884+0000 7f64384b7700 1 --2- 172.21.15.62:0/3121854153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6410053640 0x7f6410055b00 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.884+0000 7f64384b7700 1 --2- 172.21.15.62:0/3121854153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6430146f70 0x7f6430066eb0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.884+0000 7f64384b7700 1 --2- 172.21.15.62:0/3121854153 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6430060260 0x7f64300669c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.884+0000 7f64384b7700 1 --2- 172.21.15.62:0/3121854153 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f643005c750 0x7f64300b9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:24.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.884+0000 7f64384b7700 1 -- 172.21.15.62:0/3121854153 >> 172.21.15.62:0/3121854153 conn(0x7f6430062430 msgr2=0x7f64300b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:24.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.884+0000 7f64384b7700 1 -- 172.21.15.62:0/3121854153 shutdown_connections 2021-12-17T18:25:24.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:24.884+0000 7f64384b7700 1 -- 172.21.15.62:0/3121854153 wait complete. 2021-12-17T18:25:24.905 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:25:25.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f669ab70700 1 Processor -- start 2021-12-17T18:25:25.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f669ab70700 1 -- start start 2021-12-17T18:25:25.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f669ab70700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f669405ca90 0x7f669414abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f669ab70700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f66940b06b0 0x7f66940ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f669ab70700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66940604d0 0x7f66940ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f669ab70700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66941475c0 con 0x7f669405ca90 2021-12-17T18:25:25.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f669ab70700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669405fa40 con 0x7f66940b06b0 2021-12-17T18:25:25.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f669ab70700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66940b2860 con 0x7f66940604d0 2021-12-17T18:25:25.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f6699b6e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f669405ca90 0x7f669414abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f6699b6e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f669405ca90 0x7f669414abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53096/0 (socket says 172.21.15.62:53096) 2021-12-17T18:25:25.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f6699b6e700 1 -- 172.21.15.62:0/1778410225 learned_addr learned my addr 172.21.15.62:0/1778410225 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:25.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f669a36f700 1 --2- 172.21.15.62:0/1778410225 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66940604d0 0x7f66940ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f669936d700 1 --2- 172.21.15.62:0/1778410225 >> v2:172.21.15.109:3300/0 conn(0x7f66940b06b0 0x7f66940ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f6699b6e700 1 -- 172.21.15.62:0/1778410225 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66940604d0 msgr2=0x7f66940ab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:25.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f6699b6e700 1 --2- 172.21.15.62:0/1778410225 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66940604d0 0x7f66940ab5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f6699b6e700 1 -- 172.21.15.62:0/1778410225 >> v2:172.21.15.109:3300/0 conn(0x7f66940b06b0 msgr2=0x7f66940ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:25.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f6699b6e700 1 --2- 172.21.15.62:0/1778410225 >> v2:172.21.15.109:3300/0 conn(0x7f66940b06b0 0x7f66940ace40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f6699b6e700 1 -- 172.21.15.62:0/1778410225 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66940ac740 con 0x7f669405ca90 2021-12-17T18:25:25.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f669a36f700 1 --2- 172.21.15.62:0/1778410225 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66940604d0 0x7f66940ab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:25.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f6699b6e700 1 --2- 172.21.15.62:0/1778410225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f669405ca90 0x7f669414abf0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f6690002f70 tx=0x7f6690006eb0).ready entity=mon.0 client_cookie=e32ad5069567a288 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f6698b6c700 1 -- 172.21.15.62:0/1778410225 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f669000d570 con 0x7f669405ca90 2021-12-17T18:25:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f6698b6c700 1 -- 172.21.15.62:0/1778410225 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6690000e90 con 0x7f669405ca90 2021-12-17T18:25:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.012+0000 7f6698b6c700 1 -- 172.21.15.62:0/1778410225 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f669000d900 con 0x7f669405ca90 2021-12-17T18:25:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669ab70700 1 -- 172.21.15.62:0/1778410225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f669405ca90 msgr2=0x7f669414abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669ab70700 1 --2- 172.21.15.62:0/1778410225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f669405ca90 0x7f669414abf0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f6690002f70 tx=0x7f6690006eb0).stop 2021-12-17T18:25:25.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669ab70700 1 -- 172.21.15.62:0/1778410225 shutdown_connections 2021-12-17T18:25:25.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669ab70700 1 --2- 172.21.15.62:0/1778410225 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66940604d0 0x7f66940ab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669ab70700 1 --2- 172.21.15.62:0/1778410225 >> v2:172.21.15.109:3300/0 conn(0x7f66940b06b0 0x7f66940ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669ab70700 1 --2- 172.21.15.62:0/1778410225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f669405ca90 0x7f669414abf0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669ab70700 1 -- 172.21.15.62:0/1778410225 >> 172.21.15.62:0/1778410225 conn(0x7f669405c070 msgr2=0x7f6694062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:25.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669ab70700 1 -- 172.21.15.62:0/1778410225 shutdown_connections 2021-12-17T18:25:25.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669ab70700 1 -- 172.21.15.62:0/1778410225 wait complete. 2021-12-17T18:25:25.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669ab70700 1 Processor -- start 2021-12-17T18:25:25.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669ab70700 1 -- start start 2021-12-17T18:25:25.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669ab70700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f669405ca90 0x7f66940b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669ab70700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66940604d0 0x7f6694157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669ab70700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66940b06b0 0x7f669414c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669ab70700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669414d490 con 0x7f66940b06b0 2021-12-17T18:25:25.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669ab70700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6694156b30 con 0x7f66940604d0 2021-12-17T18:25:25.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669ab70700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6694156dd0 con 0x7f669405ca90 2021-12-17T18:25:25.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669a36f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66940b06b0 0x7f669414c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669a36f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66940b06b0 0x7f669414c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53106/0 (socket says 172.21.15.62:53106) 2021-12-17T18:25:25.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669a36f700 1 -- 172.21.15.62:0/1694902704 learned_addr learned my addr 172.21.15.62:0/1694902704 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:25.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f6699b6e700 1 --2- 172.21.15.62:0/1694902704 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f669405ca90 0x7f66940b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669936d700 1 --2- 172.21.15.62:0/1694902704 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66940604d0 0x7f6694157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669a36f700 1 -- 172.21.15.62:0/1694902704 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f669405ca90 msgr2=0x7f66940b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669a36f700 1 --2- 172.21.15.62:0/1694902704 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f669405ca90 0x7f66940b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669a36f700 1 -- 172.21.15.62:0/1694902704 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66940604d0 msgr2=0x7f6694157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669a36f700 1 --2- 172.21.15.62:0/1694902704 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66940604d0 0x7f6694157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f669a36f700 1 -- 172.21.15.62:0/1694902704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669000b1e0 con 0x7f66940b06b0 2021-12-17T18:25:25.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.016+0000 7f6699b6e700 1 --2- 172.21.15.62:0/1694902704 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f669405ca90 0x7f66940b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:25.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.020+0000 7f669a36f700 1 --2- 172.21.15.62:0/1694902704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66940b06b0 0x7f669414c170 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f668c006cc0 tx=0x7f668c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:25.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.020+0000 7f668affd700 1 -- 172.21.15.62:0/1694902704 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f668c013620 con 0x7f66940b06b0 2021-12-17T18:25:25.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.020+0000 7f668affd700 1 -- 172.21.15.62:0/1694902704 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c013780 con 0x7f66940b06b0 2021-12-17T18:25:25.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.020+0000 7f668affd700 1 -- 172.21.15.62:0/1694902704 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f668c013ae0 con 0x7f66940b06b0 2021-12-17T18:25:25.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.020+0000 7f669ab70700 1 -- 172.21.15.62:0/1694902704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6694157070 con 0x7f66940b06b0 2021-12-17T18:25:25.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.020+0000 7f669ab70700 1 -- 172.21.15.62:0/1694902704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669414c660 con 0x7f66940b06b0 2021-12-17T18:25:25.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.020+0000 7f669ab70700 1 -- 172.21.15.62:0/1694902704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669414bd50 con 0x7f66940b06b0 2021-12-17T18:25:25.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.020+0000 7f668affd700 1 -- 172.21.15.62:0/1694902704 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f668c013c40 con 0x7f66940b06b0 2021-12-17T18:25:25.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.020+0000 7f668affd700 1 --2- 172.21.15.62:0/1694902704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f667c053610 0x7f667c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.020+0000 7f668affd700 1 -- 172.21.15.62:0/1694902704 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f668c06bcc0 con 0x7f66940b06b0 2021-12-17T18:25:25.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.020+0000 7f6699b6e700 1 --2- 172.21.15.62:0/1694902704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f667c053610 0x7f667c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.024+0000 7f6699b6e700 1 --2- 172.21.15.62:0/1694902704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f667c053610 0x7f667c055ad0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f669001a000 tx=0x7f6690015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:25.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.024+0000 7f668affd700 1 -- 172.21.15.62:0/1694902704 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f669414bd50 con 0x7f66940b06b0 2021-12-17T18:25:25.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.148+0000 7f669ab70700 1 -- 172.21.15.62:0/1694902704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f669414bd50 con 0x7f66940b06b0 2021-12-17T18:25:25.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.152+0000 7f668affd700 1 -- 172.21.15.62:0/1694902704 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+10 (secure 0 0 0) 0x7f669414bd50 con 0x7f66940b06b0 2021-12-17T18:25:25.156 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:25:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.152+0000 7f669ab70700 1 -- 172.21.15.62:0/1694902704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f667c053610 msgr2=0x7f667c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.152+0000 7f669ab70700 1 --2- 172.21.15.62:0/1694902704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f667c053610 0x7f667c055ad0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f669001a000 tx=0x7f6690015000).stop 2021-12-17T18:25:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.152+0000 7f669ab70700 1 -- 172.21.15.62:0/1694902704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66940b06b0 msgr2=0x7f669414c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.152+0000 7f669ab70700 1 --2- 172.21.15.62:0/1694902704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66940b06b0 0x7f669414c170 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f668c006cc0 tx=0x7f668c008040).stop 2021-12-17T18:25:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.152+0000 7f669ab70700 1 -- 172.21.15.62:0/1694902704 shutdown_connections 2021-12-17T18:25:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.152+0000 7f669ab70700 1 --2- 172.21.15.62:0/1694902704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f667c053610 0x7f667c055ad0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.152+0000 7f669ab70700 1 --2- 172.21.15.62:0/1694902704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66940b06b0 0x7f669414c170 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.152+0000 7f669ab70700 1 --2- 172.21.15.62:0/1694902704 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66940604d0 0x7f6694157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.152+0000 7f669ab70700 1 --2- 172.21.15.62:0/1694902704 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f669405ca90 0x7f66940b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.152+0000 7f669ab70700 1 -- 172.21.15.62:0/1694902704 >> 172.21.15.62:0/1694902704 conn(0x7f669405c070 msgr2=0x7f6694148d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:25.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.152+0000 7f669ab70700 1 -- 172.21.15.62:0/1694902704 shutdown_connections 2021-12-17T18:25:25.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.152+0000 7f669ab70700 1 -- 172.21.15.62:0/1694902704 wait complete. 2021-12-17T18:25:25.169 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:25:25.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.280+0000 7f336e7c7700 1 Processor -- start 2021-12-17T18:25:25.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.280+0000 7f336e7c7700 1 -- start start 2021-12-17T18:25:25.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f336e7c7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f33680b31c0 0x7f336813e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f336e7c7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3368062570 0x7f33680b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f336e7c7700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3368066e50 con 0x7f3368066a70 2021-12-17T18:25:25.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f336e7c7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3368062bf0 con 0x7f33680b31c0 2021-12-17T18:25:25.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f336e7c7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33680b3660 con 0x7f3368062570 2021-12-17T18:25:25.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f336cfc4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f33680b31c0 0x7f336813e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f336cfc4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f33680b31c0 0x7f336813e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53112/0 (socket says 172.21.15.62:53112) 2021-12-17T18:25:25.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f336cfc4700 1 -- 172.21.15.62:0/2448359333 learned_addr learned my addr 172.21.15.62:0/2448359333 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:25.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f336dfc6700 1 --2- 172.21.15.62:0/2448359333 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3368062570 0x7f33680b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f336cfc4700 1 -- 172.21.15.62:0/2448359333 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3368062570 msgr2=0x7f33680b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:25.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f336cfc4700 1 --2- 172.21.15.62:0/2448359333 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3368062570 0x7f33680b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f336cfc4700 1 -- 172.21.15.62:0/2448359333 >> v1:172.21.15.62:6789/0 conn(0x7f3368066a70 legacy=0x7f336813dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f336cfc4700 1 -- 172.21.15.62:0/2448359333 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33680b3900 con 0x7f33680b31c0 2021-12-17T18:25:25.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f336cfc4700 1 --2- 172.21.15.62:0/2448359333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33680b31c0 0x7f336813e2c0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f3358002f70 tx=0x7f3358006eb0).ready entity=mon.0 client_cookie=12989f3079942a3f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:25.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f336dfc6700 1 --2- 172.21.15.62:0/2448359333 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3368062570 0x7f33680b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:25:25.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f335ffff700 1 -- 172.21.15.62:0/2448359333 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f335800d5c0 con 0x7f33680b31c0 2021-12-17T18:25:25.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f335ffff700 1 -- 172.21.15.62:0/2448359333 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3358000e90 con 0x7f33680b31c0 2021-12-17T18:25:25.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.284+0000 7f335ffff700 1 -- 172.21.15.62:0/2448359333 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f335800d950 con 0x7f33680b31c0 2021-12-17T18:25:25.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.288+0000 7f336e7c7700 1 -- 172.21.15.62:0/2448359333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33680b31c0 msgr2=0x7f336813e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.288+0000 7f336e7c7700 1 --2- 172.21.15.62:0/2448359333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33680b31c0 0x7f336813e2c0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f3358002f70 tx=0x7f3358006eb0).stop 2021-12-17T18:25:25.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.288+0000 7f336e7c7700 1 -- 172.21.15.62:0/2448359333 shutdown_connections 2021-12-17T18:25:25.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.288+0000 7f336e7c7700 1 --2- 172.21.15.62:0/2448359333 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3368062570 0x7f33680b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.288+0000 7f336e7c7700 1 --2- 172.21.15.62:0/2448359333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33680b31c0 0x7f336813e2c0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.288+0000 7f336e7c7700 1 -- 172.21.15.62:0/2448359333 >> 172.21.15.62:0/2448359333 conn(0x7f3368063510 msgr2=0x7f33680638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:25.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.288+0000 7f336e7c7700 1 -- 172.21.15.62:0/2448359333 shutdown_connections 2021-12-17T18:25:25.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.288+0000 7f336e7c7700 1 -- 172.21.15.62:0/2448359333 wait complete. 2021-12-17T18:25:25.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.288+0000 7f336e7c7700 1 Processor -- start 2021-12-17T18:25:25.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.288+0000 7f336e7c7700 1 -- start start 2021-12-17T18:25:25.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336e7c7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3368062570 0x7f336813a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336e7c7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3368066a70 0x7f33681421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336e7c7700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33680b31c0 0x7f33681426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336e7c7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3368143810 con 0x7f3368062570 2021-12-17T18:25:25.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336e7c7700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3368143a40 con 0x7f33680b31c0 2021-12-17T18:25:25.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336e7c7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3368143ce0 con 0x7f3368066a70 2021-12-17T18:25:25.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336d7c5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3368062570 0x7f336813a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336d7c5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3368062570 0x7f336813a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53116/0 (socket says 172.21.15.62:53116) 2021-12-17T18:25:25.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336d7c5700 1 -- 172.21.15.62:0/2848855711 learned_addr learned my addr 172.21.15.62:0/2848855711 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:25.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336cfc4700 1 --2- 172.21.15.62:0/2848855711 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3368066a70 0x7f33681421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336dfc6700 1 --2- 172.21.15.62:0/2848855711 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33680b31c0 0x7f33681426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336d7c5700 1 -- 172.21.15.62:0/2848855711 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3368066a70 msgr2=0x7f33681421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336d7c5700 1 --2- 172.21.15.62:0/2848855711 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3368066a70 0x7f33681421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336d7c5700 1 -- 172.21.15.62:0/2848855711 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33680b31c0 msgr2=0x7f33681426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336d7c5700 1 --2- 172.21.15.62:0/2848855711 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33680b31c0 0x7f33681426b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336d7c5700 1 -- 172.21.15.62:0/2848855711 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335800b1e0 con 0x7f3368062570 2021-12-17T18:25:25.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336d7c5700 1 --2- 172.21.15.62:0/2848855711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3368062570 0x7f336813a860 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f3368068610 tx=0x7f3364007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:25.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f335e7fc700 1 -- 172.21.15.62:0/2848855711 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f336400ce30 con 0x7f3368062570 2021-12-17T18:25:25.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336e7c7700 1 -- 172.21.15.62:0/2848855711 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33680ad820 con 0x7f3368062570 2021-12-17T18:25:25.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f335e7fc700 1 -- 172.21.15.62:0/2848855711 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3364007240 con 0x7f3368062570 2021-12-17T18:25:25.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336e7c7700 1 -- 172.21.15.62:0/2848855711 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3368139d90 con 0x7f3368062570 2021-12-17T18:25:25.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f335e7fc700 1 -- 172.21.15.62:0/2848855711 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3364006700 con 0x7f3368062570 2021-12-17T18:25:25.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.292+0000 7f336e7c7700 1 -- 172.21.15.62:0/2848855711 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3368143ea0 con 0x7f3368062570 2021-12-17T18:25:25.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.296+0000 7f335e7fc700 1 -- 172.21.15.62:0/2848855711 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3364010030 con 0x7f3368062570 2021-12-17T18:25:25.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.296+0000 7f335e7fc700 1 --2- 172.21.15.62:0/2848855711 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f33500534f0 0x7f33500559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.296+0000 7f335e7fc700 1 -- 172.21.15.62:0/2848855711 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f336406bc20 con 0x7f3368062570 2021-12-17T18:25:25.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.296+0000 7f336cfc4700 1 --2- 172.21.15.62:0/2848855711 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f33500534f0 0x7f33500559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.296+0000 7f336cfc4700 1 --2- 172.21.15.62:0/2848855711 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f33500534f0 0x7f33500559b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f335801a000 tx=0x7f3358015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:25.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.296+0000 7f335e7fc700 1 -- 172.21.15.62:0/2848855711 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3364042d80 con 0x7f3368062570 2021-12-17T18:25:25.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.424+0000 7f336e7c7700 1 -- 172.21.15.62:0/2848855711 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f33680b3ba0 con 0x7f3368062570 2021-12-17T18:25:25.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.424+0000 7f335e7fc700 1 -- 172.21.15.62:0/2848855711 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+10 (secure 0 0 0) 0x7f33640463a0 con 0x7f3368062570 2021-12-17T18:25:25.430 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:25:25.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.428+0000 7f336e7c7700 1 -- 172.21.15.62:0/2848855711 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f33500534f0 msgr2=0x7f33500559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.428+0000 7f336e7c7700 1 --2- 172.21.15.62:0/2848855711 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f33500534f0 0x7f33500559b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f335801a000 tx=0x7f3358015000).stop 2021-12-17T18:25:25.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.428+0000 7f336e7c7700 1 -- 172.21.15.62:0/2848855711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3368062570 msgr2=0x7f336813a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.428+0000 7f336e7c7700 1 --2- 172.21.15.62:0/2848855711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3368062570 0x7f336813a860 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f3368068610 tx=0x7f3364007c10).stop 2021-12-17T18:25:25.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.428+0000 7f336e7c7700 1 -- 172.21.15.62:0/2848855711 shutdown_connections 2021-12-17T18:25:25.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.428+0000 7f336e7c7700 1 --2- 172.21.15.62:0/2848855711 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f33500534f0 0x7f33500559b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.428+0000 7f336e7c7700 1 --2- 172.21.15.62:0/2848855711 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f33680b31c0 0x7f33681426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.428+0000 7f336e7c7700 1 --2- 172.21.15.62:0/2848855711 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3368066a70 0x7f33681421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.428+0000 7f336e7c7700 1 --2- 172.21.15.62:0/2848855711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3368062570 0x7f336813a860 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.428+0000 7f336e7c7700 1 -- 172.21.15.62:0/2848855711 >> 172.21.15.62:0/2848855711 conn(0x7f3368063510 msgr2=0x7f33680638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:25.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.428+0000 7f336e7c7700 1 -- 172.21.15.62:0/2848855711 shutdown_connections 2021-12-17T18:25:25.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.428+0000 7f336e7c7700 1 -- 172.21.15.62:0/2848855711 wait complete. 2021-12-17T18:25:25.446 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:25:25.447 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:25.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.548+0000 7f95a6e27700 1 Processor -- start 2021-12-17T18:25:25.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.548+0000 7f95a6e27700 1 -- start start 2021-12-17T18:25:25.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.548+0000 7f95a6e27700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f95a0146ed0 0x7f95a0143e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.548+0000 7f95a6e27700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a00b0f20 con 0x7f95a0146af0 2021-12-17T18:25:25.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.548+0000 7f95a6e27700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a00b11c0 con 0x7f95a01421f0 2021-12-17T18:25:25.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.548+0000 7f95a6e27700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a0147360 con 0x7f95a0146ed0 2021-12-17T18:25:25.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.548+0000 7f95a5e25700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f95a0146af0 0x7f95a0143770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36704/0 (socket says 172.21.15.62:36704) 2021-12-17T18:25:25.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.548+0000 7f95a5e25700 1 -- 172.21.15.62:0/376383259 learned_addr learned my addr 172.21.15.62:0/376383259 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:25.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.548+0000 7f95a5624700 1 --2- 172.21.15.62:0/376383259 >> v2:172.21.15.109:3300/0 conn(0x7f95a0146ed0 0x7f95a0143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a4e23700 1 -- 172.21.15.62:0/376383259 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11969801 0 0) 0x7f95a00b0f20 con 0x7f95a0146af0 2021-12-17T18:25:25.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a4e23700 1 -- 172.21.15.62:0/376383259 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9588003260 con 0x7f95a0146af0 2021-12-17T18:25:25.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a5624700 1 -- 172.21.15.62:0/376383259 >> v1:172.21.15.109:6789/0 conn(0x7f95a01421f0 legacy=0x7f95a0142640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a5624700 1 -- 172.21.15.62:0/376383259 >> v1:172.21.15.62:6789/0 conn(0x7f95a0146af0 legacy=0x7f95a0143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a5624700 1 -- 172.21.15.62:0/376383259 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a00b0c30 con 0x7f95a0146ed0 2021-12-17T18:25:25.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a5624700 1 --2- 172.21.15.62:0/376383259 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f95a0146ed0 0x7f95a0143e80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f959c002f70 tx=0x7f959c006df0).ready entity=mon.1 client_cookie=3e56769c43b121fb server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:25.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a4e23700 1 -- 172.21.15.62:0/376383259 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f959c00d610 con 0x7f95a0146ed0 2021-12-17T18:25:25.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a4e23700 1 -- 172.21.15.62:0/376383259 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c000e90 con 0x7f95a0146ed0 2021-12-17T18:25:25.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a4e23700 1 -- 172.21.15.62:0/376383259 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f959c00d960 con 0x7f95a0146ed0 2021-12-17T18:25:25.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a6e27700 1 -- 172.21.15.62:0/376383259 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f95a0146ed0 msgr2=0x7f95a0143e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a6e27700 1 --2- 172.21.15.62:0/376383259 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f95a0146ed0 0x7f95a0143e80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f959c002f70 tx=0x7f959c006df0).stop 2021-12-17T18:25:25.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a6e27700 1 -- 172.21.15.62:0/376383259 shutdown_connections 2021-12-17T18:25:25.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a6e27700 1 --2- 172.21.15.62:0/376383259 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f95a0146ed0 0x7f95a0143e80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a6e27700 1 -- 172.21.15.62:0/376383259 >> 172.21.15.62:0/376383259 conn(0x7f95a0062430 msgr2=0x7f95a0062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:25.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a6e27700 1 -- 172.21.15.62:0/376383259 shutdown_connections 2021-12-17T18:25:25.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a6e27700 1 -- 172.21.15.62:0/376383259 wait complete. 2021-12-17T18:25:25.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a6e27700 1 Processor -- start 2021-12-17T18:25:25.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a6e27700 1 -- start start 2021-12-17T18:25:25.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a6e27700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f95a01421f0 0x7f95a00b4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a6e27700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f95a0146af0 0x7f95a01416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a6e27700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95a0146ed0 0x7f95a0155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a6e27700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a013fd10 con 0x7f95a0146ed0 2021-12-17T18:25:25.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a6e27700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a0141290 con 0x7f95a01421f0 2021-12-17T18:25:25.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.552+0000 7f95a6e27700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a0149880 con 0x7f95a0146af0 2021-12-17T18:25:25.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f95a6626700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95a0146ed0 0x7f95a0155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f95a6626700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95a0146ed0 0x7f95a0155830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53132/0 (socket says 172.21.15.62:53132) 2021-12-17T18:25:25.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f95a6626700 1 -- 172.21.15.62:0/4096292910 learned_addr learned my addr 172.21.15.62:0/4096292910 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:25.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f95a5e25700 1 --2- 172.21.15.62:0/4096292910 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f95a01421f0 0x7f95a00b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f95a5624700 1 --2- 172.21.15.62:0/4096292910 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f95a0146af0 0x7f95a01416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f95a6626700 1 -- 172.21.15.62:0/4096292910 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f95a0146af0 msgr2=0x7f95a01416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f95a6626700 1 --2- 172.21.15.62:0/4096292910 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f95a0146af0 0x7f95a01416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f95a6626700 1 -- 172.21.15.62:0/4096292910 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f95a01421f0 msgr2=0x7f95a00b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f95a6626700 1 --2- 172.21.15.62:0/4096292910 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f95a01421f0 0x7f95a00b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f95a6626700 1 -- 172.21.15.62:0/4096292910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c00b180 con 0x7f95a0146ed0 2021-12-17T18:25:25.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f95a6626700 1 --2- 172.21.15.62:0/4096292910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95a0146ed0 0x7f95a0155830 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f95a00ac5b0 tx=0x7f9598007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:25.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f958effd700 1 -- 172.21.15.62:0/4096292910 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f959800f470 con 0x7f95a0146ed0 2021-12-17T18:25:25.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f958effd700 1 -- 172.21.15.62:0/4096292910 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959800f5d0 con 0x7f95a0146ed0 2021-12-17T18:25:25.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f95a6e27700 1 -- 172.21.15.62:0/4096292910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a01495e0 con 0x7f95a0146ed0 2021-12-17T18:25:25.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f958effd700 1 -- 172.21.15.62:0/4096292910 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f959800f930 con 0x7f95a0146ed0 2021-12-17T18:25:25.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f95a6e27700 1 -- 172.21.15.62:0/4096292910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a013ed10 con 0x7f95a0146ed0 2021-12-17T18:25:25.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f95a6e27700 1 -- 172.21.15.62:0/4096292910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a0141400 con 0x7f95a0146ed0 2021-12-17T18:25:25.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f958effd700 1 -- 172.21.15.62:0/4096292910 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9598019030 con 0x7f95a0146ed0 2021-12-17T18:25:25.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f958effd700 1 --2- 172.21.15.62:0/4096292910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f95800536d0 0x7f9580055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:25.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.556+0000 7f958effd700 1 -- 172.21.15.62:0/4096292910 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f959806af00 con 0x7f95a0146ed0 2021-12-17T18:25:25.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.560+0000 7f95a5e25700 1 --2- 172.21.15.62:0/4096292910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f95800536d0 0x7f9580055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:25.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.560+0000 7f95a5e25700 1 --2- 172.21.15.62:0/4096292910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f95800536d0 0x7f9580055b90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f959000d000 tx=0x7f9590009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:25.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.564+0000 7f958effd700 1 -- 172.21.15.62:0/4096292910 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9598042000 con 0x7f95a0146ed0 2021-12-17T18:25:25.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.724+0000 7f95a6e27700 1 -- 172.21.15.62:0/4096292910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95a013f020 con 0x7f95a0146ed0 2021-12-17T18:25:25.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.728+0000 7f958effd700 1 -- 172.21.15.62:0/4096292910 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f9598045620 con 0x7f95a0146ed0 2021-12-17T18:25:25.732 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:25.732 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":37,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3760020760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3760020760},{"type":"v1","addr":"172.21.15.109:6835","nonce":3760020760}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:25:20.884652+0000","modified":"2021-12-17T18:25:21.888425+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1765551619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1765551619},{"type":"v1","addr":"172.21.15.62:6833","nonce":1765551619}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-12-17T18:25:25.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.728+0000 7f95a6e27700 1 -- 172.21.15.62:0/4096292910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f95800536d0 msgr2=0x7f9580055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.728+0000 7f95a6e27700 1 --2- 172.21.15.62:0/4096292910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f95800536d0 0x7f9580055b90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f959000d000 tx=0x7f9590009040).stop 2021-12-17T18:25:25.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.728+0000 7f95a6e27700 1 -- 172.21.15.62:0/4096292910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95a0146ed0 msgr2=0x7f95a0155830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:25.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.728+0000 7f95a6e27700 1 --2- 172.21.15.62:0/4096292910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95a0146ed0 0x7f95a0155830 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f95a00ac5b0 tx=0x7f9598007f40).stop 2021-12-17T18:25:25.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.728+0000 7f95a6e27700 1 -- 172.21.15.62:0/4096292910 shutdown_connections 2021-12-17T18:25:25.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.728+0000 7f95a6e27700 1 --2- 172.21.15.62:0/4096292910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f95800536d0 0x7f9580055b90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.728+0000 7f95a6e27700 1 --2- 172.21.15.62:0/4096292910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95a0146ed0 0x7f95a0155830 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.728+0000 7f95a6e27700 1 --2- 172.21.15.62:0/4096292910 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f95a0146af0 0x7f95a01416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.728+0000 7f95a6e27700 1 --2- 172.21.15.62:0/4096292910 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f95a01421f0 0x7f95a00b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:25.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.728+0000 7f95a6e27700 1 -- 172.21.15.62:0/4096292910 >> 172.21.15.62:0/4096292910 conn(0x7f95a0062430 msgr2=0x7f95a005ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:25.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.728+0000 7f95a6e27700 1 -- 172.21.15.62:0/4096292910 shutdown_connections 2021-12-17T18:25:25.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:25.728+0000 7f95a6e27700 1 -- 172.21.15.62:0/4096292910 wait complete. 2021-12-17T18:25:25.737 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 37 2021-12-17T18:25:25.947 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:25:20.884652+0000', 'modified': '2021-12-17T18:25:21.888425+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6714}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6714': {'gid': 6714, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/1765551619', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 1765551619}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 1765551619}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:25:25.948 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:25:25.948 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:25:26.063 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":6714,"want_state":"up:active","state":"up:active","rank_uptime":5.1641497909999998,"mdsmap_epoch":37,"osdmap_epoch":81,"osdmap_epoch_barrier":81,"uptime":9.4938692390000003} 2021-12-17T18:25:26.063 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 6714, "mdsmap_epoch": 37, "osdmap_epoch": 81, "osdmap_epoch_barrier": 81, "rank_uptime": 5.164149791, "state": "up:active", "uptime": 9.493869239, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:25:26.064 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:25:26.064 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-12-17T18:25:26.065 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-12-17T18:25:26.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:26.066 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:26.074 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:25:26.132 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:25:26.133 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:25:26.145 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:25:26.146 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:25:26.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:26.148 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:25:26.154 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:25:26.154 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:26.197 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:25:26.217 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:25:26.218 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:25:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:25:26.229 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:25:26.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:26.231 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:25:26.273 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14670]: starting ceph client 2021-12-17T18:25:26.273 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2021-12-17T18:25:26.269+0000 7f49e8357080 -1 init, newargv = 0x562538fb0f10 newargc=9 2021-12-17T18:25:26.283 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14670]: starting fuse 2021-12-17T18:25:27.379 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:25:27.399 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:25:27.400 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:25:27.459 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:25:27.460 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:25:27.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:27.462 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:25:27.471 INFO:teuthology.orchestra.run.smithi125.stdout:52 2021-12-17T18:25:27.471 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:25:27.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:27.472 DEBUG:teuthology.orchestra.run.smithi125:> sudo python3 -c ' 2021-12-17T18:25:27.472 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2021-12-17T18:25:27.473 DEBUG:teuthology.orchestra.run.smithi125:> import re 2021-12-17T18:25:27.473 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:25:27.474 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2021-12-17T18:25:27.474 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:25:27.475 DEBUG:teuthology.orchestra.run.smithi125:> def find_socket(client_name): 2021-12-17T18:25:27.475 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-12-17T18:25:27.475 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2021-12-17T18:25:27.476 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:25:27.476 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2021-12-17T18:25:27.477 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2021-12-17T18:25:27.477 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2021-12-17T18:25:27.477 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2021-12-17T18:25:27.478 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:25:27.478 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2021-12-17T18:25:27.479 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:25:27.479 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:25:27.480 DEBUG:teuthology.orchestra.run.smithi125:> return f 2021-12-17T18:25:27.480 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:25:27.480 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:25:27.481 DEBUG:teuthology.orchestra.run.smithi125:> print(find_socket("client.0")) 2021-12-17T18:25:27.481 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:25:27.558 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.14670.asok 2021-12-17T18:25:27.563 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14670.asok 2021-12-17T18:25:27.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:27.564 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14670.asok status 2021-12-17T18:25:27.659 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2021-12-17T18:25:27.659 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2021-12-17T18:25:27.660 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:25:27.660 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:25:27.660 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2021-12-17T18:25:27.660 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2021-12-17T18:25:27.661 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-12-17T18:25:27.661 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "14670", 2021-12-17T18:25:27.661 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2021-12-17T18:25:27.661 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:25:27.662 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2021-12-17T18:25:27.662 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2021-12-17T18:25:27.662 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 6065, 2021-12-17T18:25:27.662 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2021-12-17T18:25:27.663 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2021-12-17T18:25:27.663 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2021-12-17T18:25:27.663 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 6065 2021-12-17T18:25:27.664 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:25:27.664 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:25:27.664 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:25:27.665 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:25:27.665 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 1777518952 2021-12-17T18:25:27.665 INFO:teuthology.orchestra.run.smithi125.stdout: } 2021-12-17T18:25:27.665 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:25:27.666 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:25:27.666 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:25:27.666 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:25:27.666 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 1777518952 2021-12-17T18:25:27.666 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:25:27.667 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.6065 172.21.15.125:0/1777518952", 2021-12-17T18:25:27.667 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "172.21.15.125:0/1777518952", 2021-12-17T18:25:27.667 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2021-12-17T18:25:27.668 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 37, 2021-12-17T18:25:27.668 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 81, 2021-12-17T18:25:27.668 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:25:27.668 INFO:teuthology.orchestra.run.smithi125.stdout: "blacklisted": false, 2021-12-17T18:25:27.669 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2021-12-17T18:25:27.669 INFO:teuthology.orchestra.run.smithi125.stdout:} 2021-12-17T18:25:27.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:27.670 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:27.671 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:27.682 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:25:27.683 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:25:27.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:27.684 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:27.745 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:25:27.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.852+0000 7f9f90f33700 1 Processor -- start 2021-12-17T18:25:27.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.852+0000 7f9f90f33700 1 -- start start 2021-12-17T18:25:27.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.852+0000 7f9f90f33700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f8c1472c0 0x7f9f8c0a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:27.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.852+0000 7f9f90f33700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9f8c1427b0 0x7f9f8c142c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:27.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.852+0000 7f9f90f33700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8c0b1840 con 0x7f9f8c0b5ea0 2021-12-17T18:25:27.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.852+0000 7f9f90f33700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8c0b6280 con 0x7f9f8c1427b0 2021-12-17T18:25:27.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.852+0000 7f9f90f33700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0b1a70 con 0x7f9f8c1472c0 2021-12-17T18:25:27.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.852+0000 7f9f8bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9f8c1427b0 0x7f9f8c142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:27.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f8bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9f8c1427b0 0x7f9f8c142c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53142/0 (socket says 172.21.15.62:53142) 2021-12-17T18:25:27.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f8bfff700 1 -- 172.21.15.62:0/4002436538 learned_addr learned my addr 172.21.15.62:0/4002436538 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:27.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f83fff700 1 --2- 172.21.15.62:0/4002436538 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f8c1472c0 0x7f9f8c0a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:27.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f83fff700 1 -- 172.21.15.62:0/4002436538 >> v2:172.21.15.62:3300/0 conn(0x7f9f8c1427b0 msgr2=0x7f9f8c142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:27.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f83fff700 1 --2- 172.21.15.62:0/4002436538 >> v2:172.21.15.62:3300/0 conn(0x7f9f8c1427b0 0x7f9f8c142c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:27.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f83fff700 1 -- 172.21.15.62:0/4002436538 >> v1:172.21.15.109:6789/0 conn(0x7f9f8c0b5ea0 legacy=0x7f9f8c0b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:27.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f83fff700 1 -- 172.21.15.62:0/4002436538 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c0b1d10 con 0x7f9f8c1472c0 2021-12-17T18:25:27.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f83fff700 1 --2- 172.21.15.62:0/4002436538 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f8c1472c0 0x7f9f8c0a8d20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f9f7c002f70 tx=0x7f9f7c006df0).ready entity=mon.2 client_cookie=5b3e67c94f2780f0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:27.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f8affd700 1 -- 172.21.15.62:0/4002436538 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f7c00d570 con 0x7f9f8c1472c0 2021-12-17T18:25:27.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f8affd700 1 -- 172.21.15.62:0/4002436538 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c000e90 con 0x7f9f8c1472c0 2021-12-17T18:25:27.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f8affd700 1 -- 172.21.15.62:0/4002436538 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f7c00d8c0 con 0x7f9f8c1472c0 2021-12-17T18:25:27.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f90f33700 1 -- 172.21.15.62:0/4002436538 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f8c1472c0 msgr2=0x7f9f8c0a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:27.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f90f33700 1 --2- 172.21.15.62:0/4002436538 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f8c1472c0 0x7f9f8c0a8d20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f9f7c002f70 tx=0x7f9f7c006df0).stop 2021-12-17T18:25:27.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f90f33700 1 -- 172.21.15.62:0/4002436538 shutdown_connections 2021-12-17T18:25:27.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f90f33700 1 --2- 172.21.15.62:0/4002436538 >> v2:172.21.15.62:3300/0 conn(0x7f9f8c1427b0 0x7f9f8c142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:27.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f90f33700 1 --2- 172.21.15.62:0/4002436538 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f8c1472c0 0x7f9f8c0a8d20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:27.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f90f33700 1 -- 172.21.15.62:0/4002436538 >> 172.21.15.62:0/4002436538 conn(0x7f9f8c05d220 msgr2=0x7f9f8c0b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:27.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f90f33700 1 -- 172.21.15.62:0/4002436538 shutdown_connections 2021-12-17T18:25:27.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.856+0000 7f9f90f33700 1 -- 172.21.15.62:0/4002436538 wait complete. 2021-12-17T18:25:27.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f90f33700 1 Processor -- start 2021-12-17T18:25:27.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f90f33700 1 -- start start 2021-12-17T18:25:27.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f90f33700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c0b5ea0 0x7f9f8c0a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:27.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f90f33700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9f8c1427b0 0x7f9f8c0a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:27.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f90f33700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f8c1472c0 0x7f9f8c151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:27.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f90f33700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0a2c70 con 0x7f9f8c0b5ea0 2021-12-17T18:25:27.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f90f33700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0a2f10 con 0x7f9f8c1427b0 2021-12-17T18:25:27.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f90f33700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0a31b0 con 0x7f9f8c1472c0 2021-12-17T18:25:27.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f8b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c0b5ea0 0x7f9f8c0a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:27.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f8b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c0b5ea0 0x7f9f8c0a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53144/0 (socket says 172.21.15.62:53144) 2021-12-17T18:25:27.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f8b7fe700 1 -- 172.21.15.62:0/3022254767 learned_addr learned my addr 172.21.15.62:0/3022254767 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:27.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f83fff700 1 --2- 172.21.15.62:0/3022254767 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9f8c1427b0 0x7f9f8c0a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:27.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f8bfff700 1 --2- 172.21.15.62:0/3022254767 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f8c1472c0 0x7f9f8c151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:27.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f8b7fe700 1 -- 172.21.15.62:0/3022254767 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f8c1472c0 msgr2=0x7f9f8c151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:27.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f8b7fe700 1 --2- 172.21.15.62:0/3022254767 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f8c1472c0 0x7f9f8c151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:27.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f8b7fe700 1 -- 172.21.15.62:0/3022254767 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9f8c1427b0 msgr2=0x7f9f8c0a25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:27.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f8b7fe700 1 --2- 172.21.15.62:0/3022254767 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9f8c1427b0 0x7f9f8c0a25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:27.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.860+0000 7f9f8b7fe700 1 -- 172.21.15.62:0/3022254767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c00b180 con 0x7f9f8c0b5ea0 2021-12-17T18:25:27.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.864+0000 7f9f8b7fe700 1 --2- 172.21.15.62:0/3022254767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c0b5ea0 0x7f9f8c0a08e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f9f8c0af9f0 tx=0x7f9f74007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:27.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.864+0000 7f9f897fa700 1 -- 172.21.15.62:0/3022254767 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f74007030 con 0x7f9f8c0b5ea0 2021-12-17T18:25:27.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.864+0000 7f9f897fa700 1 -- 172.21.15.62:0/3022254767 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f74007190 con 0x7f9f8c0b5ea0 2021-12-17T18:25:27.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.864+0000 7f9f897fa700 1 -- 172.21.15.62:0/3022254767 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f74006510 con 0x7f9f8c0b5ea0 2021-12-17T18:25:27.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.864+0000 7f9f90f33700 1 -- 172.21.15.62:0/3022254767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8c09fe10 con 0x7f9f8c0b5ea0 2021-12-17T18:25:27.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.864+0000 7f9f90f33700 1 -- 172.21.15.62:0/3022254767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8c152010 con 0x7f9f8c0b5ea0 2021-12-17T18:25:27.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.864+0000 7f9f90f33700 1 -- 172.21.15.62:0/3022254767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8c0a2ac0 con 0x7f9f8c0b5ea0 2021-12-17T18:25:27.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.864+0000 7f9f897fa700 1 -- 172.21.15.62:0/3022254767 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9f74010030 con 0x7f9f8c0b5ea0 2021-12-17T18:25:27.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.864+0000 7f9f897fa700 1 --2- 172.21.15.62:0/3022254767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f70053610 0x7f9f70055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:27.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.864+0000 7f9f897fa700 1 -- 172.21.15.62:0/3022254767 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9f7406b510 con 0x7f9f8c0b5ea0 2021-12-17T18:25:27.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.864+0000 7f9f83fff700 1 --2- 172.21.15.62:0/3022254767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f70053610 0x7f9f70055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:27.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.868+0000 7f9f83fff700 1 --2- 172.21.15.62:0/3022254767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f70053610 0x7f9f70055ad0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f9f7c01a000 tx=0x7f9f7c014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:27.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:27.876+0000 7f9f897fa700 1 -- 172.21.15.62:0/3022254767 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9f740425d0 con 0x7f9f8c0b5ea0 2021-12-17T18:25:28.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.004+0000 7f9f90f33700 1 -- 172.21.15.62:0/3022254767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f8c0a3370 con 0x7f9f8c0b5ea0 2021-12-17T18:25:28.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.004+0000 7f9f897fa700 1 -- 172.21.15.62:0/3022254767 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f9f74045bf0 con 0x7f9f8c0b5ea0 2021-12-17T18:25:28.011 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:28.011 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":81,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:25:21.887449+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:25:19.272638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-12-17T18:25:20.525388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:25:28.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.008+0000 7f9f90f33700 1 -- 172.21.15.62:0/3022254767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f70053610 msgr2=0x7f9f70055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.008+0000 7f9f90f33700 1 --2- 172.21.15.62:0/3022254767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f70053610 0x7f9f70055ad0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f9f7c01a000 tx=0x7f9f7c014000).stop 2021-12-17T18:25:28.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.008+0000 7f9f90f33700 1 -- 172.21.15.62:0/3022254767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c0b5ea0 msgr2=0x7f9f8c0a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.008+0000 7f9f90f33700 1 --2- 172.21.15.62:0/3022254767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c0b5ea0 0x7f9f8c0a08e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f9f8c0af9f0 tx=0x7f9f74007c10).stop 2021-12-17T18:25:28.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.008+0000 7f9f90f33700 1 -- 172.21.15.62:0/3022254767 shutdown_connections 2021-12-17T18:25:28.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.008+0000 7f9f90f33700 1 --2- 172.21.15.62:0/3022254767 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f70053610 0x7f9f70055ad0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.008+0000 7f9f90f33700 1 --2- 172.21.15.62:0/3022254767 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f8c1472c0 0x7f9f8c151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.008+0000 7f9f90f33700 1 --2- 172.21.15.62:0/3022254767 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9f8c1427b0 0x7f9f8c0a25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.008+0000 7f9f90f33700 1 --2- 172.21.15.62:0/3022254767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c0b5ea0 0x7f9f8c0a08e0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.008+0000 7f9f90f33700 1 -- 172.21.15.62:0/3022254767 >> 172.21.15.62:0/3022254767 conn(0x7f9f8c05d220 msgr2=0x7f9f8c0b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:28.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.008+0000 7f9f90f33700 1 -- 172.21.15.62:0/3022254767 shutdown_connections 2021-12-17T18:25:28.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.008+0000 7f9f90f33700 1 -- 172.21.15.62:0/3022254767 wait complete. 2021-12-17T18:25:28.032 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:25:19.272638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:25:20.525388+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:25:28.033 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:25:28.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd8024bc700 1 Processor -- start 2021-12-17T18:25:28.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd8024bc700 1 -- start start 2021-12-17T18:25:28.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd8024bc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7fc0b2070 0x7fd7fc0aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd8024bc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd7fc143810 0x7fd7fc0b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd8024bc700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7fc0ac950 con 0x7fd7fc0afeb0 2021-12-17T18:25:28.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd8024bc700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7fc142ca0 con 0x7fd7fc143810 2021-12-17T18:25:28.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd8024bc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc0b2450 con 0x7fd7fc0b2070 2021-12-17T18:25:28.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd800cb9700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd7fc0afeb0 0x7fd7fc143100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36736/0 (socket says 172.21.15.62:36736) 2021-12-17T18:25:28.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd800cb9700 1 -- 172.21.15.62:0/275252045 learned_addr learned my addr 172.21.15.62:0/275252045 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:28.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd8014ba700 1 --2- 172.21.15.62:0/275252045 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7fc0b2070 0x7fd7fc0aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd801cbb700 1 --2- 172.21.15.62:0/275252045 >> v2:172.21.15.109:3300/0 conn(0x7fd7fc143810 0x7fd7fc0b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd7f3fff700 1 -- 172.21.15.62:0/275252045 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484997832 0 0) 0x7fd7fc0ac950 con 0x7fd7fc0afeb0 2021-12-17T18:25:28.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd7f3fff700 1 -- 172.21.15.62:0/275252045 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7e0003260 con 0x7fd7fc0afeb0 2021-12-17T18:25:28.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd8014ba700 1 -- 172.21.15.62:0/275252045 >> v2:172.21.15.109:3300/0 conn(0x7fd7fc143810 msgr2=0x7fd7fc0b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:28.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd8014ba700 1 --2- 172.21.15.62:0/275252045 >> v2:172.21.15.109:3300/0 conn(0x7fd7fc143810 0x7fd7fc0b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd8014ba700 1 -- 172.21.15.62:0/275252045 >> v1:172.21.15.62:6789/0 conn(0x7fd7fc0afeb0 legacy=0x7fd7fc143100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd8014ba700 1 -- 172.21.15.62:0/275252045 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc0ace20 con 0x7fd7fc0b2070 2021-12-17T18:25:28.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd8014ba700 1 --2- 172.21.15.62:0/275252045 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7fc0b2070 0x7fd7fc0aeac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fd7f8002f70 tx=0x7fd7f8006df0).ready entity=mon.2 client_cookie=8036bec9937691ce server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:28.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd7f3fff700 1 -- 172.21.15.62:0/275252045 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7f800e7a0 con 0x7fd7fc0b2070 2021-12-17T18:25:28.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd7f3fff700 1 -- 172.21.15.62:0/275252045 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f8000e90 con 0x7fd7fc0b2070 2021-12-17T18:25:28.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.140+0000 7fd7f3fff700 1 -- 172.21.15.62:0/275252045 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7f800eaf0 con 0x7fd7fc0b2070 2021-12-17T18:25:28.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd8024bc700 1 -- 172.21.15.62:0/275252045 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7fc0b2070 msgr2=0x7fd7fc0aeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd8024bc700 1 --2- 172.21.15.62:0/275252045 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7fc0b2070 0x7fd7fc0aeac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fd7f8002f70 tx=0x7fd7f8006df0).stop 2021-12-17T18:25:28.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd8024bc700 1 -- 172.21.15.62:0/275252045 shutdown_connections 2021-12-17T18:25:28.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd8024bc700 1 --2- 172.21.15.62:0/275252045 >> v2:172.21.15.109:3300/0 conn(0x7fd7fc143810 0x7fd7fc0b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd8024bc700 1 --2- 172.21.15.62:0/275252045 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7fc0b2070 0x7fd7fc0aeac0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd8024bc700 1 -- 172.21.15.62:0/275252045 >> 172.21.15.62:0/275252045 conn(0x7fd7fc05c070 msgr2=0x7fd7fc062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:28.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd8024bc700 1 -- 172.21.15.62:0/275252045 shutdown_connections 2021-12-17T18:25:28.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd8024bc700 1 -- 172.21.15.62:0/275252045 wait complete. 2021-12-17T18:25:28.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd8024bc700 1 Processor -- start 2021-12-17T18:25:28.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd8024bc700 1 -- start start 2021-12-17T18:25:28.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd8024bc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7fc0afeb0 0x7fd7fc0ab490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd8024bc700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd7fc0b2070 0x7fd7fc063490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd8024bc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7fc143810 0x7fd7fc148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd8024bc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc09ede0 con 0x7fd7fc143810 2021-12-17T18:25:28.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd8024bc700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc09fa00 con 0x7fd7fc0b2070 2021-12-17T18:25:28.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd8024bc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc09fc80 con 0x7fd7fc0afeb0 2021-12-17T18:25:28.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd801cbb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7fc143810 0x7fd7fc148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd801cbb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7fc143810 0x7fd7fc148420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53162/0 (socket says 172.21.15.62:53162) 2021-12-17T18:25:28.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd801cbb700 1 -- 172.21.15.62:0/1365490669 learned_addr learned my addr 172.21.15.62:0/1365490669 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:28.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd8014ba700 1 --2- 172.21.15.62:0/1365490669 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7fc0afeb0 0x7fd7fc0ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.144+0000 7fd800cb9700 1 --2- 172.21.15.62:0/1365490669 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd7fc0b2070 0x7fd7fc063490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.148+0000 7fd801cbb700 1 -- 172.21.15.62:0/1365490669 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7fc0afeb0 msgr2=0x7fd7fc0ab490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.148+0000 7fd801cbb700 1 --2- 172.21.15.62:0/1365490669 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7fc0afeb0 0x7fd7fc0ab490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.148+0000 7fd801cbb700 1 -- 172.21.15.62:0/1365490669 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd7fc0b2070 msgr2=0x7fd7fc063490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.148+0000 7fd801cbb700 1 --2- 172.21.15.62:0/1365490669 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd7fc0b2070 0x7fd7fc063490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.148+0000 7fd801cbb700 1 -- 172.21.15.62:0/1365490669 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f800b180 con 0x7fd7fc143810 2021-12-17T18:25:28.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.148+0000 7fd801cbb700 1 --2- 172.21.15.62:0/1365490669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7fc143810 0x7fd7fc148420 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fd7f400c000 tx=0x7fd7f40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:28.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.148+0000 7fd7f27fc700 1 -- 172.21.15.62:0/1365490669 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7f4012600 con 0x7fd7fc143810 2021-12-17T18:25:28.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.148+0000 7fd7f27fc700 1 -- 172.21.15.62:0/1365490669 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f4012760 con 0x7fd7fc143810 2021-12-17T18:25:28.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.148+0000 7fd8024bc700 1 -- 172.21.15.62:0/1365490669 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7fc1526a0 con 0x7fd7fc143810 2021-12-17T18:25:28.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.148+0000 7fd7f27fc700 1 -- 172.21.15.62:0/1365490669 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7f4012ac0 con 0x7fd7fc143810 2021-12-17T18:25:28.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.148+0000 7fd8024bc700 1 -- 172.21.15.62:0/1365490669 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7fc0652b0 con 0x7fd7fc143810 2021-12-17T18:25:28.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.148+0000 7fd7f27fc700 1 -- 172.21.15.62:0/1365490669 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd7f4022070 con 0x7fd7fc143810 2021-12-17T18:25:28.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.148+0000 7fd8024bc700 1 -- 172.21.15.62:0/1365490669 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7fc0acb80 con 0x7fd7fc143810 2021-12-17T18:25:28.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.148+0000 7fd7f27fc700 1 --2- 172.21.15.62:0/1365490669 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd7e4053610 0x7fd7e4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.148+0000 7fd7f27fc700 1 -- 172.21.15.62:0/1365490669 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd7f406bf30 con 0x7fd7fc143810 2021-12-17T18:25:28.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.148+0000 7fd8014ba700 1 --2- 172.21.15.62:0/1365490669 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd7e4053610 0x7fd7e4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.152+0000 7fd8014ba700 1 --2- 172.21.15.62:0/1365490669 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd7e4053610 0x7fd7e4055ad0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fd7f801b000 tx=0x7fd7f8015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:28.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.152+0000 7fd7f27fc700 1 -- 172.21.15.62:0/1365490669 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd7f4042f00 con 0x7fd7fc143810 2021-12-17T18:25:28.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.280+0000 7fd8024bc700 1 -- 172.21.15.62:0/1365490669 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd7fc0573d0 con 0x7fd7fc143810 2021-12-17T18:25:28.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.280+0000 7fd7f27fc700 1 -- 172.21.15.62:0/1365490669 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v81) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd7f4016020 con 0x7fd7fc143810 2021-12-17T18:25:28.286 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:25:28.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.284+0000 7fd8024bc700 1 -- 172.21.15.62:0/1365490669 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd7e4053610 msgr2=0x7fd7e4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.284+0000 7fd8024bc700 1 --2- 172.21.15.62:0/1365490669 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd7e4053610 0x7fd7e4055ad0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fd7f801b000 tx=0x7fd7f8015000).stop 2021-12-17T18:25:28.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.284+0000 7fd8024bc700 1 -- 172.21.15.62:0/1365490669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7fc143810 msgr2=0x7fd7fc148420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.284+0000 7fd8024bc700 1 --2- 172.21.15.62:0/1365490669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7fc143810 0x7fd7fc148420 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fd7f400c000 tx=0x7fd7f40091d0).stop 2021-12-17T18:25:28.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.284+0000 7fd8024bc700 1 -- 172.21.15.62:0/1365490669 shutdown_connections 2021-12-17T18:25:28.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.284+0000 7fd8024bc700 1 --2- 172.21.15.62:0/1365490669 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd7e4053610 0x7fd7e4055ad0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.284+0000 7fd8024bc700 1 --2- 172.21.15.62:0/1365490669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7fc143810 0x7fd7fc148420 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.284+0000 7fd8024bc700 1 --2- 172.21.15.62:0/1365490669 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd7fc0b2070 0x7fd7fc063490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.284+0000 7fd8024bc700 1 --2- 172.21.15.62:0/1365490669 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7fc0afeb0 0x7fd7fc0ab490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.284+0000 7fd8024bc700 1 -- 172.21.15.62:0/1365490669 >> 172.21.15.62:0/1365490669 conn(0x7fd7fc05c070 msgr2=0x7fd7fc0b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:28.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.284+0000 7fd8024bc700 1 -- 172.21.15.62:0/1365490669 shutdown_connections 2021-12-17T18:25:28.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.284+0000 7fd8024bc700 1 -- 172.21.15.62:0/1365490669 wait complete. 2021-12-17T18:25:28.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:25:28.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.408+0000 7f56a759e700 1 Processor -- start 2021-12-17T18:25:28.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.408+0000 7f56a759e700 1 -- start start 2021-12-17T18:25:28.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.408+0000 7f56a759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56a805ca90 0x7f56a80afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.408+0000 7f56a759e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f56a81466f0 0x7f56a8143b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.408+0000 7f56a759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a81433c0 con 0x7f56a80b17e0 2021-12-17T18:25:28.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.408+0000 7f56a759e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a8143660 con 0x7f56a81466f0 2021-12-17T18:25:28.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.408+0000 7f56a759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a8143120 con 0x7f56a805ca90 2021-12-17T18:25:28.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.408+0000 7f56a6d9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f56a80b17e0 0x7f56a80b1ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36750/0 (socket says 172.21.15.62:36750) 2021-12-17T18:25:28.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.408+0000 7f56a6d9d700 1 -- 172.21.15.62:0/4154205093 learned_addr learned my addr 172.21.15.62:0/4154205093 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:28.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.408+0000 7f56a659c700 1 --2- 172.21.15.62:0/4154205093 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56a805ca90 0x7f56a80afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.408+0000 7f56a5d9b700 1 --2- 172.21.15.62:0/4154205093 >> v2:172.21.15.109:3300/0 conn(0x7f56a81466f0 0x7f56a8143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.408+0000 7f56a559a700 1 -- 172.21.15.62:0/4154205093 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116239737 0 0) 0x7f56a81433c0 con 0x7f56a80b17e0 2021-12-17T18:25:28.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a559a700 1 -- 172.21.15.62:0/4154205093 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f568c003260 con 0x7f56a80b17e0 2021-12-17T18:25:28.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a5d9b700 1 -- 172.21.15.62:0/4154205093 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56a805ca90 msgr2=0x7f56a80afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:28.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a5d9b700 1 --2- 172.21.15.62:0/4154205093 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56a805ca90 0x7f56a80afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a5d9b700 1 -- 172.21.15.62:0/4154205093 >> v1:172.21.15.62:6789/0 conn(0x7f56a80b17e0 legacy=0x7f56a80b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a5d9b700 1 -- 172.21.15.62:0/4154205093 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a805ce70 con 0x7f56a81466f0 2021-12-17T18:25:28.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a5d9b700 1 --2- 172.21.15.62:0/4154205093 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56a81466f0 0x7f56a8143b00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f56980032f0 tx=0x7f56980091d0).ready entity=mon.1 client_cookie=e42a225603c3ab09 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:28.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a559a700 1 -- 172.21.15.62:0/4154205093 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f569800b600 con 0x7f56a81466f0 2021-12-17T18:25:28.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a559a700 1 -- 172.21.15.62:0/4154205093 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569800b760 con 0x7f56a81466f0 2021-12-17T18:25:28.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a559a700 1 -- 172.21.15.62:0/4154205093 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f569800b910 con 0x7f56a81466f0 2021-12-17T18:25:28.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a759e700 1 -- 172.21.15.62:0/4154205093 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56a81466f0 msgr2=0x7f56a8143b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a759e700 1 --2- 172.21.15.62:0/4154205093 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56a81466f0 0x7f56a8143b00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f56980032f0 tx=0x7f56980091d0).stop 2021-12-17T18:25:28.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a759e700 1 -- 172.21.15.62:0/4154205093 shutdown_connections 2021-12-17T18:25:28.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a759e700 1 --2- 172.21.15.62:0/4154205093 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56a81466f0 0x7f56a8143b00 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a759e700 1 --2- 172.21.15.62:0/4154205093 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56a805ca90 0x7f56a80afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a759e700 1 -- 172.21.15.62:0/4154205093 >> 172.21.15.62:0/4154205093 conn(0x7f56a805be70 msgr2=0x7f56a8062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:28.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a759e700 1 -- 172.21.15.62:0/4154205093 shutdown_connections 2021-12-17T18:25:28.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a759e700 1 -- 172.21.15.62:0/4154205093 wait complete. 2021-12-17T18:25:28.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a759e700 1 Processor -- start 2021-12-17T18:25:28.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a759e700 1 -- start start 2021-12-17T18:25:28.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56a805ca90 0x7f56a81562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a80b17e0 0x7f56a8063850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56a81466f0 0x7f56a81400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a81567d0 con 0x7f56a80b17e0 2021-12-17T18:25:28.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a80af110 con 0x7f56a81466f0 2021-12-17T18:25:28.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a80a32f0 con 0x7f56a805ca90 2021-12-17T18:25:28.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a5d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a80b17e0 0x7f56a8063850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a5d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a80b17e0 0x7f56a8063850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53174/0 (socket says 172.21.15.62:53174) 2021-12-17T18:25:28.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a5d9b700 1 -- 172.21.15.62:0/951059959 learned_addr learned my addr 172.21.15.62:0/951059959 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:28.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a659c700 1 --2- 172.21.15.62:0/951059959 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56a805ca90 0x7f56a81562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a6d9d700 1 --2- 172.21.15.62:0/951059959 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56a81466f0 0x7f56a81400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a5d9b700 1 -- 172.21.15.62:0/951059959 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56a805ca90 msgr2=0x7f56a81562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a5d9b700 1 --2- 172.21.15.62:0/951059959 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56a805ca90 0x7f56a81562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a5d9b700 1 -- 172.21.15.62:0/951059959 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56a81466f0 msgr2=0x7f56a81400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a5d9b700 1 --2- 172.21.15.62:0/951059959 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56a81466f0 0x7f56a81400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a5d9b700 1 -- 172.21.15.62:0/951059959 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5698009470 con 0x7f56a80b17e0 2021-12-17T18:25:28.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.412+0000 7f56a5d9b700 1 --2- 172.21.15.62:0/951059959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a80b17e0 0x7f56a8063850 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f56980032f0 tx=0x7f5698016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:28.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.416+0000 7f56977fe700 1 -- 172.21.15.62:0/951059959 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f569800b600 con 0x7f56a80b17e0 2021-12-17T18:25:28.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.416+0000 7f56977fe700 1 -- 172.21.15.62:0/951059959 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569801f3f0 con 0x7f56a80b17e0 2021-12-17T18:25:28.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.416+0000 7f56977fe700 1 -- 172.21.15.62:0/951059959 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f569801f750 con 0x7f56a80b17e0 2021-12-17T18:25:28.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.416+0000 7f56a759e700 1 -- 172.21.15.62:0/951059959 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a80a3590 con 0x7f56a80b17e0 2021-12-17T18:25:28.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.416+0000 7f56a759e700 1 -- 172.21.15.62:0/951059959 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a8063f60 con 0x7f56a80b17e0 2021-12-17T18:25:28.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.416+0000 7f56977fe700 1 -- 172.21.15.62:0/951059959 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5698026030 con 0x7f56a80b17e0 2021-12-17T18:25:28.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.416+0000 7f56a759e700 1 -- 172.21.15.62:0/951059959 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a80b0310 con 0x7f56a80b17e0 2021-12-17T18:25:28.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.416+0000 7f56977fe700 1 --2- 172.21.15.62:0/951059959 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56840536a0 0x7f5684055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.416+0000 7f56977fe700 1 -- 172.21.15.62:0/951059959 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f569806c460 con 0x7f56a80b17e0 2021-12-17T18:25:28.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.416+0000 7f56a659c700 1 --2- 172.21.15.62:0/951059959 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56840536a0 0x7f5684055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.416+0000 7f56a659c700 1 --2- 172.21.15.62:0/951059959 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56840536a0 0x7f5684055b60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f569c00b000 tx=0x7f569c006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:28.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.424+0000 7f56977fe700 1 -- 172.21.15.62:0/951059959 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f56980435c0 con 0x7f56a80b17e0 2021-12-17T18:25:28.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.548+0000 7f56a759e700 1 -- 172.21.15.62:0/951059959 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f56a80a39b0 con 0x7f56a80b17e0 2021-12-17T18:25:28.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.548+0000 7f56977fe700 1 -- 172.21.15.62:0/951059959 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v81) v1 ==== 92+0+10 (secure 0 0 0) 0x7f56980150a0 con 0x7f56a80b17e0 2021-12-17T18:25:28.555 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:25:28.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.552+0000 7f56a759e700 1 -- 172.21.15.62:0/951059959 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56840536a0 msgr2=0x7f5684055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.552+0000 7f56a759e700 1 --2- 172.21.15.62:0/951059959 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56840536a0 0x7f5684055b60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f569c00b000 tx=0x7f569c006df0).stop 2021-12-17T18:25:28.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.552+0000 7f56a759e700 1 -- 172.21.15.62:0/951059959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a80b17e0 msgr2=0x7f56a8063850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.552+0000 7f56a759e700 1 --2- 172.21.15.62:0/951059959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a80b17e0 0x7f56a8063850 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f56980032f0 tx=0x7f5698016000).stop 2021-12-17T18:25:28.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.552+0000 7f56a759e700 1 -- 172.21.15.62:0/951059959 shutdown_connections 2021-12-17T18:25:28.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.552+0000 7f56a759e700 1 --2- 172.21.15.62:0/951059959 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56840536a0 0x7f5684055b60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.552+0000 7f56a759e700 1 --2- 172.21.15.62:0/951059959 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56a81466f0 0x7f56a81400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.552+0000 7f56a759e700 1 --2- 172.21.15.62:0/951059959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a80b17e0 0x7f56a8063850 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.552+0000 7f56a759e700 1 --2- 172.21.15.62:0/951059959 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56a805ca90 0x7f56a81562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.552+0000 7f56a759e700 1 -- 172.21.15.62:0/951059959 >> 172.21.15.62:0/951059959 conn(0x7f56a805be70 msgr2=0x7f56a81413a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:28.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.552+0000 7f56a759e700 1 -- 172.21.15.62:0/951059959 shutdown_connections 2021-12-17T18:25:28.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.552+0000 7f56a759e700 1 -- 172.21.15.62:0/951059959 wait complete. 2021-12-17T18:25:28.568 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:25:28.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.672+0000 7f7285719700 1 Processor -- start 2021-12-17T18:25:28.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.672+0000 7f7285719700 1 -- start start 2021-12-17T18:25:28.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7285719700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f72800b5dd0 0x7f7280146da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7285719700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f72800b41f0 0x7f7280141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7285719700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72800b2010 con 0x7f72800b05b0 2021-12-17T18:25:28.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7285719700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72800b0990 con 0x7f72800b5dd0 2021-12-17T18:25:28.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7285719700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7280147290 con 0x7f72800b41f0 2021-12-17T18:25:28.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f727effd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f72800b05b0 0x7f7280146690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36760/0 (socket says 172.21.15.62:36760) 2021-12-17T18:25:28.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7277fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f72800b5dd0 0x7f7280146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f727effd700 1 -- 172.21.15.62:0/4247181677 learned_addr learned my addr 172.21.15.62:0/4247181677 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:28.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f727f7fe700 1 --2- 172.21.15.62:0/4247181677 >> v2:172.21.15.109:3300/0 conn(0x7f72800b41f0 0x7f7280141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7277fff700 1 -- 172.21.15.62:0/4247181677 >> v2:172.21.15.109:3300/0 conn(0x7f72800b41f0 msgr2=0x7f7280141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:28.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7277fff700 1 --2- 172.21.15.62:0/4247181677 >> v2:172.21.15.109:3300/0 conn(0x7f72800b41f0 0x7f7280141fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7277fff700 1 -- 172.21.15.62:0/4247181677 >> v1:172.21.15.62:6789/0 conn(0x7f72800b05b0 legacy=0x7f7280146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7277fff700 1 -- 172.21.15.62:0/4247181677 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72800b2240 con 0x7f72800b5dd0 2021-12-17T18:25:28.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7277fff700 1 --2- 172.21.15.62:0/4247181677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72800b5dd0 0x7f7280146da0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f72800b15f0 tx=0x7f7268006df0).ready entity=mon.0 client_cookie=97f3df6537d1eb40 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:28.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f727e7fc700 1 -- 172.21.15.62:0/4247181677 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f726800d5c0 con 0x7f72800b5dd0 2021-12-17T18:25:28.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f727e7fc700 1 -- 172.21.15.62:0/4247181677 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7268000e90 con 0x7f72800b5dd0 2021-12-17T18:25:28.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f727e7fc700 1 -- 172.21.15.62:0/4247181677 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f726800d910 con 0x7f72800b5dd0 2021-12-17T18:25:28.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7285719700 1 -- 172.21.15.62:0/4247181677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72800b5dd0 msgr2=0x7f7280146da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7285719700 1 --2- 172.21.15.62:0/4247181677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72800b5dd0 0x7f7280146da0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f72800b15f0 tx=0x7f7268006df0).stop 2021-12-17T18:25:28.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7285719700 1 -- 172.21.15.62:0/4247181677 shutdown_connections 2021-12-17T18:25:28.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7285719700 1 --2- 172.21.15.62:0/4247181677 >> v2:172.21.15.109:3300/0 conn(0x7f72800b41f0 0x7f7280141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7285719700 1 --2- 172.21.15.62:0/4247181677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72800b5dd0 0x7f7280146da0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7285719700 1 -- 172.21.15.62:0/4247181677 >> 172.21.15.62:0/4247181677 conn(0x7f7280062510 msgr2=0x7f72800628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:28.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7285719700 1 -- 172.21.15.62:0/4247181677 shutdown_connections 2021-12-17T18:25:28.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.676+0000 7f7285719700 1 -- 172.21.15.62:0/4247181677 wait complete. 2021-12-17T18:25:28.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f7285719700 1 Processor -- start 2021-12-17T18:25:28.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f7285719700 1 -- start start 2021-12-17T18:25:28.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f7285719700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72800b05b0 0x7f7280063cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f7285719700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72800b41f0 0x7f728013f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f7285719700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72800b5dd0 0x7f7280153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f7285719700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72800658b0 con 0x7f72800b05b0 2021-12-17T18:25:28.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f7285719700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7280064b70 con 0x7f72800b5dd0 2021-12-17T18:25:28.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f7285719700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728013feb0 con 0x7f72800b41f0 2021-12-17T18:25:28.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f727effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72800b05b0 0x7f7280063cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f727effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72800b05b0 0x7f7280063cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53186/0 (socket says 172.21.15.62:53186) 2021-12-17T18:25:28.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f727effd700 1 -- 172.21.15.62:0/1312768894 learned_addr learned my addr 172.21.15.62:0/1312768894 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:28.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f7277fff700 1 --2- 172.21.15.62:0/1312768894 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72800b41f0 0x7f728013f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f727f7fe700 1 --2- 172.21.15.62:0/1312768894 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72800b5dd0 0x7f7280153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f727effd700 1 -- 172.21.15.62:0/1312768894 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72800b41f0 msgr2=0x7f728013f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f727effd700 1 --2- 172.21.15.62:0/1312768894 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72800b41f0 0x7f728013f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f727effd700 1 -- 172.21.15.62:0/1312768894 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72800b5dd0 msgr2=0x7f7280153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f727effd700 1 --2- 172.21.15.62:0/1312768894 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72800b5dd0 0x7f7280153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f727effd700 1 -- 172.21.15.62:0/1312768894 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726800b180 con 0x7f72800b05b0 2021-12-17T18:25:28.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f727effd700 1 --2- 172.21.15.62:0/1312768894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72800b05b0 0x7f7280063cf0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f72800664a0 tx=0x7f7270007ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:28.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f727cff9700 1 -- 172.21.15.62:0/1312768894 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72700070d0 con 0x7f72800b05b0 2021-12-17T18:25:28.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f727cff9700 1 -- 172.21.15.62:0/1312768894 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7270007230 con 0x7f72800b05b0 2021-12-17T18:25:28.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f727cff9700 1 -- 172.21.15.62:0/1312768894 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7270005610 con 0x7f72800b05b0 2021-12-17T18:25:28.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f7285719700 1 -- 172.21.15.62:0/1312768894 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7280152ad0 con 0x7f72800b05b0 2021-12-17T18:25:28.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.680+0000 7f7285719700 1 -- 172.21.15.62:0/1312768894 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72800647f0 con 0x7f72800b05b0 2021-12-17T18:25:28.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.684+0000 7f727cff9700 1 -- 172.21.15.62:0/1312768894 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7270010070 con 0x7f72800b05b0 2021-12-17T18:25:28.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.684+0000 7f7285719700 1 -- 172.21.15.62:0/1312768894 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7280152f70 con 0x7f72800b05b0 2021-12-17T18:25:28.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.684+0000 7f727cff9700 1 --2- 172.21.15.62:0/1312768894 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7264053580 0x7f7264055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.684+0000 7f727cff9700 1 -- 172.21.15.62:0/1312768894 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f727006ae40 con 0x7f72800b05b0 2021-12-17T18:25:28.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.684+0000 7f7277fff700 1 --2- 172.21.15.62:0/1312768894 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7264053580 0x7f7264055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.684+0000 7f7277fff700 1 --2- 172.21.15.62:0/1312768894 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7264053580 0x7f7264055a40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f726801a000 tx=0x7f7268014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:28.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.692+0000 7f727cff9700 1 -- 172.21.15.62:0/1312768894 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7280152f70 con 0x7f72800b05b0 2021-12-17T18:25:28.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.820+0000 7f7285719700 1 -- 172.21.15.62:0/1312768894 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7280152f70 con 0x7f72800b05b0 2021-12-17T18:25:28.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.824+0000 7f727cff9700 1 -- 172.21.15.62:0/1312768894 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7280152f70 con 0x7f72800b05b0 2021-12-17T18:25:28.829 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:25:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.824+0000 7f7285719700 1 -- 172.21.15.62:0/1312768894 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7264053580 msgr2=0x7f7264055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.824+0000 7f7285719700 1 --2- 172.21.15.62:0/1312768894 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7264053580 0x7f7264055a40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f726801a000 tx=0x7f7268014000).stop 2021-12-17T18:25:28.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.824+0000 7f7285719700 1 -- 172.21.15.62:0/1312768894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72800b05b0 msgr2=0x7f7280063cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.824+0000 7f7285719700 1 --2- 172.21.15.62:0/1312768894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72800b05b0 0x7f7280063cf0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f72800664a0 tx=0x7f7270007ca0).stop 2021-12-17T18:25:28.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.824+0000 7f7285719700 1 -- 172.21.15.62:0/1312768894 shutdown_connections 2021-12-17T18:25:28.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.824+0000 7f7285719700 1 --2- 172.21.15.62:0/1312768894 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7264053580 0x7f7264055a40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.824+0000 7f7285719700 1 --2- 172.21.15.62:0/1312768894 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72800b5dd0 0x7f7280153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.824+0000 7f7285719700 1 --2- 172.21.15.62:0/1312768894 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72800b41f0 0x7f728013f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.824+0000 7f7285719700 1 --2- 172.21.15.62:0/1312768894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72800b05b0 0x7f7280063cf0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.824+0000 7f7285719700 1 -- 172.21.15.62:0/1312768894 >> 172.21.15.62:0/1312768894 conn(0x7f7280062510 msgr2=0x7f72800b8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:28.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.824+0000 7f7285719700 1 -- 172.21.15.62:0/1312768894 shutdown_connections 2021-12-17T18:25:28.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.824+0000 7f7285719700 1 -- 172.21.15.62:0/1312768894 wait complete. 2021-12-17T18:25:28.842 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:25:28.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.948+0000 7f72066e9700 1 Processor -- start 2021-12-17T18:25:28.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.948+0000 7f72066e9700 1 -- start start 2021-12-17T18:25:28.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f72066e9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f72000b0b50 0x7f72000aee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f72066e9700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f720013e360 0x7f720013e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f72066e9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72000b1220 con 0x7f72000ad290 2021-12-17T18:25:28.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f72066e9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72000ad670 con 0x7f72000b0b50 2021-12-17T18:25:28.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f72066e9700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f720013f3f0 con 0x7f720013e360 2021-12-17T18:25:28.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f72056e7700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f72000ad290 0x7f72000ae720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36774/0 (socket says 172.21.15.62:36774) 2021-12-17T18:25:28.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f72056e7700 1 -- 172.21.15.62:0/1084359469 learned_addr learned my addr 172.21.15.62:0/1084359469 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:28.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f7204ee6700 1 --2- 172.21.15.62:0/1084359469 >> v2:172.21.15.62:3300/0 conn(0x7f72000b0b50 0x7f72000aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f7205ee8700 1 --2- 172.21.15.62:0/1084359469 >> v2:172.21.15.109:3300/0 conn(0x7f720013e360 0x7f720013e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f71effff700 1 -- 172.21.15.62:0/1084359469 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587249169 0 0) 0x7f72000b1220 con 0x7f72000ad290 2021-12-17T18:25:28.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f71effff700 1 -- 172.21.15.62:0/1084359469 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71e8003180 con 0x7f72000ad290 2021-12-17T18:25:28.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f7204ee6700 1 -- 172.21.15.62:0/1084359469 >> v2:172.21.15.109:3300/0 conn(0x7f720013e360 msgr2=0x7f720013e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:28.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f7204ee6700 1 --2- 172.21.15.62:0/1084359469 >> v2:172.21.15.109:3300/0 conn(0x7f720013e360 0x7f720013e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f7204ee6700 1 -- 172.21.15.62:0/1084359469 >> v1:172.21.15.62:6789/0 conn(0x7f72000ad290 legacy=0x7f72000ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f7204ee6700 1 -- 172.21.15.62:0/1084359469 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72000b07f0 con 0x7f72000b0b50 2021-12-17T18:25:28.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f7204ee6700 1 --2- 172.21.15.62:0/1084359469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72000b0b50 0x7f72000aee30 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f72000ae5c0 tx=0x7f71f0006df0).ready entity=mon.0 client_cookie=81b3cc1cff6e27f8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:28.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f71effff700 1 -- 172.21.15.62:0/1084359469 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71f000d4f0 con 0x7f72000b0b50 2021-12-17T18:25:28.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f71effff700 1 -- 172.21.15.62:0/1084359469 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f0000e90 con 0x7f72000b0b50 2021-12-17T18:25:28.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f71effff700 1 -- 172.21.15.62:0/1084359469 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71f000d840 con 0x7f72000b0b50 2021-12-17T18:25:28.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f72066e9700 1 -- 172.21.15.62:0/1084359469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72000b0b50 msgr2=0x7f72000aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f72066e9700 1 --2- 172.21.15.62:0/1084359469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72000b0b50 0x7f72000aee30 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f72000ae5c0 tx=0x7f71f0006df0).stop 2021-12-17T18:25:28.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f72066e9700 1 -- 172.21.15.62:0/1084359469 shutdown_connections 2021-12-17T18:25:28.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f72066e9700 1 --2- 172.21.15.62:0/1084359469 >> v2:172.21.15.109:3300/0 conn(0x7f720013e360 0x7f720013e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f72066e9700 1 --2- 172.21.15.62:0/1084359469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72000b0b50 0x7f72000aee30 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f72066e9700 1 -- 172.21.15.62:0/1084359469 >> 172.21.15.62:0/1084359469 conn(0x7f720005c750 msgr2=0x7f720005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:28.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f72066e9700 1 -- 172.21.15.62:0/1084359469 shutdown_connections 2021-12-17T18:25:28.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.952+0000 7f72066e9700 1 -- 172.21.15.62:0/1084359469 wait complete. 2021-12-17T18:25:28.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.956+0000 7f72066e9700 1 Processor -- start 2021-12-17T18:25:28.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.956+0000 7f72066e9700 1 -- start start 2021-12-17T18:25:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.956+0000 7f72066e9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72000ad290 0x7f72000a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.956+0000 7f72066e9700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72000b0b50 0x7f720014ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.956+0000 7f72066e9700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f720013e360 0x7f7200066c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.956+0000 7f72066e9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7200139e90 con 0x7f72000ad290 2021-12-17T18:25:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.956+0000 7f72066e9700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720014e070 con 0x7f72000b0b50 2021-12-17T18:25:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.956+0000 7f72066e9700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720014e2b0 con 0x7f720013e360 2021-12-17T18:25:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.956+0000 7f72056e7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72000ad290 0x7f72000a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.956+0000 7f72056e7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72000ad290 0x7f72000a1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53200/0 (socket says 172.21.15.62:53200) 2021-12-17T18:25:28.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.956+0000 7f72056e7700 1 -- 172.21.15.62:0/4288569018 learned_addr learned my addr 172.21.15.62:0/4288569018 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:28.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.956+0000 7f7204ee6700 1 --2- 172.21.15.62:0/4288569018 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72000b0b50 0x7f720014ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.956+0000 7f7205ee8700 1 --2- 172.21.15.62:0/4288569018 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f720013e360 0x7f7200066c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.960+0000 7f72056e7700 1 -- 172.21.15.62:0/4288569018 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f720013e360 msgr2=0x7f7200066c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.960+0000 7f72056e7700 1 --2- 172.21.15.62:0/4288569018 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f720013e360 0x7f7200066c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.960+0000 7f72056e7700 1 -- 172.21.15.62:0/4288569018 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72000b0b50 msgr2=0x7f720014ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:28.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.960+0000 7f72056e7700 1 --2- 172.21.15.62:0/4288569018 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72000b0b50 0x7f720014ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:28.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.960+0000 7f72056e7700 1 -- 172.21.15.62:0/4288569018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f000b180 con 0x7f72000ad290 2021-12-17T18:25:28.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.960+0000 7f72056e7700 1 --2- 172.21.15.62:0/4288569018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72000ad290 0x7f72000a1d30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f71fc001110 tx=0x7f71fc007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:28.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.960+0000 7f71ee7fc700 1 -- 172.21.15.62:0/4288569018 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71fc00ce80 con 0x7f72000ad290 2021-12-17T18:25:28.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.960+0000 7f71ee7fc700 1 -- 172.21.15.62:0/4288569018 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc0070d0 con 0x7f72000ad290 2021-12-17T18:25:28.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.960+0000 7f72066e9700 1 -- 172.21.15.62:0/4288569018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720014e550 con 0x7f72000ad290 2021-12-17T18:25:28.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.960+0000 7f71ee7fc700 1 -- 172.21.15.62:0/4288569018 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71fc007430 con 0x7f72000ad290 2021-12-17T18:25:28.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.960+0000 7f72066e9700 1 -- 172.21.15.62:0/4288569018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720014f180 con 0x7f72000ad290 2021-12-17T18:25:28.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.960+0000 7f71ee7fc700 1 -- 172.21.15.62:0/4288569018 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f71fc010070 con 0x7f72000ad290 2021-12-17T18:25:28.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.960+0000 7f72066e9700 1 -- 172.21.15.62:0/4288569018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7200067ac0 con 0x7f72000ad290 2021-12-17T18:25:28.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.960+0000 7f71ee7fc700 1 --2- 172.21.15.62:0/4288569018 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71e0053580 0x7f71e0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:28.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.960+0000 7f71ee7fc700 1 -- 172.21.15.62:0/4288569018 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f71fc06af00 con 0x7f72000ad290 2021-12-17T18:25:28.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.960+0000 7f7204ee6700 1 --2- 172.21.15.62:0/4288569018 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71e0053580 0x7f71e0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:28.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.964+0000 7f7204ee6700 1 --2- 172.21.15.62:0/4288569018 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71e0053580 0x7f71e0055a40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f71f001a000 tx=0x7f71f0014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:28.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:28.968+0000 7f71ee7fc700 1 -- 172.21.15.62:0/4288569018 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7200067ac0 con 0x7f72000ad290 2021-12-17T18:25:29.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.096+0000 7f72066e9700 1 -- 172.21.15.62:0/4288569018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7200067ac0 con 0x7f72000ad290 2021-12-17T18:25:29.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.096+0000 7f71ee7fc700 1 -- 172.21.15.62:0/4288569018 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7200067ac0 con 0x7f72000ad290 2021-12-17T18:25:29.102 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:25:29.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.100+0000 7f72066e9700 1 -- 172.21.15.62:0/4288569018 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71e0053580 msgr2=0x7f71e0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:29.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.100+0000 7f72066e9700 1 --2- 172.21.15.62:0/4288569018 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71e0053580 0x7f71e0055a40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f71f001a000 tx=0x7f71f0014000).stop 2021-12-17T18:25:29.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.100+0000 7f72066e9700 1 -- 172.21.15.62:0/4288569018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72000ad290 msgr2=0x7f72000a1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:29.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.100+0000 7f72066e9700 1 --2- 172.21.15.62:0/4288569018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72000ad290 0x7f72000a1d30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f71fc001110 tx=0x7f71fc007aa0).stop 2021-12-17T18:25:29.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.100+0000 7f72066e9700 1 -- 172.21.15.62:0/4288569018 shutdown_connections 2021-12-17T18:25:29.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.100+0000 7f72066e9700 1 --2- 172.21.15.62:0/4288569018 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71e0053580 0x7f71e0055a40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:29.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.100+0000 7f72066e9700 1 --2- 172.21.15.62:0/4288569018 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f720013e360 0x7f7200066c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:29.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.100+0000 7f72066e9700 1 --2- 172.21.15.62:0/4288569018 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72000b0b50 0x7f720014ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:29.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.100+0000 7f72066e9700 1 --2- 172.21.15.62:0/4288569018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72000ad290 0x7f72000a1d30 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:29.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.100+0000 7f72066e9700 1 -- 172.21.15.62:0/4288569018 >> 172.21.15.62:0/4288569018 conn(0x7f720005c750 msgr2=0x7f720013e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:29.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.100+0000 7f72066e9700 1 -- 172.21.15.62:0/4288569018 shutdown_connections 2021-12-17T18:25:29.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.100+0000 7f72066e9700 1 -- 172.21.15.62:0/4288569018 wait complete. 2021-12-17T18:25:29.120 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:25:29.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:29.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.216+0000 7fc63a5a3700 1 Processor -- start 2021-12-17T18:25:29.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.216+0000 7fc63a5a3700 1 -- start start 2021-12-17T18:25:29.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc63a5a3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6340a8e10 0x7fc634147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:29.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc63a5a3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6340b6270 con 0x7fc6340a71e0 2021-12-17T18:25:29.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc63a5a3700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc634147610 con 0x7fc634141480 2021-12-17T18:25:29.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc63a5a3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6341478b0 con 0x7fc6340a8e10 2021-12-17T18:25:29.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc638da0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6340a8e10 0x7fc634147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:29.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc639da2700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc6340a71e0 0x7fc6340a7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36792/0 (socket says 172.21.15.62:36792) 2021-12-17T18:25:29.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc639da2700 1 -- 172.21.15.62:0/2971338807 learned_addr learned my addr 172.21.15.62:0/2971338807 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:29.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc62bfff700 1 -- 172.21.15.62:0/2971338807 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2963999161 0 0) 0x7fc6340b6270 con 0x7fc6340a71e0 2021-12-17T18:25:29.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc62bfff700 1 -- 172.21.15.62:0/2971338807 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc618003260 con 0x7fc6340a71e0 2021-12-17T18:25:29.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc638da0700 1 -- 172.21.15.62:0/2971338807 >> v1:172.21.15.109:6789/0 conn(0x7fc634141480 legacy=0x7fc6340b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:29.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc638da0700 1 -- 172.21.15.62:0/2971338807 >> v1:172.21.15.62:6789/0 conn(0x7fc6340a71e0 legacy=0x7fc6340a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:29.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc638da0700 1 -- 172.21.15.62:0/2971338807 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc634147b50 con 0x7fc6340a8e10 2021-12-17T18:25:29.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc638da0700 1 --2- 172.21.15.62:0/2971338807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6340a8e10 0x7fc634147ff0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7fc624002f70 tx=0x7fc624006df0).ready entity=mon.0 client_cookie=10c203b71ffc0abd server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:29.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc62bfff700 1 -- 172.21.15.62:0/2971338807 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc62400d610 con 0x7fc6340a8e10 2021-12-17T18:25:29.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc62bfff700 1 -- 172.21.15.62:0/2971338807 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc624000e90 con 0x7fc6340a8e10 2021-12-17T18:25:29.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc62bfff700 1 -- 172.21.15.62:0/2971338807 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc62400d960 con 0x7fc6340a8e10 2021-12-17T18:25:29.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc63a5a3700 1 -- 172.21.15.62:0/2971338807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6340a8e10 msgr2=0x7fc634147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:29.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.220+0000 7fc63a5a3700 1 --2- 172.21.15.62:0/2971338807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6340a8e10 0x7fc634147ff0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7fc624002f70 tx=0x7fc624006df0).stop 2021-12-17T18:25:29.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.224+0000 7fc63a5a3700 1 -- 172.21.15.62:0/2971338807 shutdown_connections 2021-12-17T18:25:29.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.224+0000 7fc63a5a3700 1 --2- 172.21.15.62:0/2971338807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6340a8e10 0x7fc634147ff0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:29.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.224+0000 7fc63a5a3700 1 -- 172.21.15.62:0/2971338807 >> 172.21.15.62:0/2971338807 conn(0x7fc63405d220 msgr2=0x7fc6340b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:29.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.224+0000 7fc63a5a3700 1 -- 172.21.15.62:0/2971338807 shutdown_connections 2021-12-17T18:25:29.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.224+0000 7fc63a5a3700 1 -- 172.21.15.62:0/2971338807 wait complete. 2021-12-17T18:25:29.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.224+0000 7fc63a5a3700 1 Processor -- start 2021-12-17T18:25:29.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.224+0000 7fc63a5a3700 1 -- start start 2021-12-17T18:25:29.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc63a5a3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6340a71e0 0x7fc6340a9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:29.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc63a5a3700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc6340a8e10 0x7fc63414a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:29.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc63a5a3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc634141480 0x7fc6340ab470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:29.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc63a5a3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340aadb0 con 0x7fc634141480 2021-12-17T18:25:29.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc63a5a3700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63413e780 con 0x7fc6340a8e10 2021-12-17T18:25:29.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc63a5a3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340aafd0 con 0x7fc6340a71e0 2021-12-17T18:25:29.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc639da2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc634141480 0x7fc6340ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:29.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc639da2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc634141480 0x7fc6340ab470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53218/0 (socket says 172.21.15.62:53218) 2021-12-17T18:25:29.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc639da2700 1 -- 172.21.15.62:0/48659733 learned_addr learned my addr 172.21.15.62:0/48659733 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:29.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc6395a1700 1 --2- 172.21.15.62:0/48659733 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6340a71e0 0x7fc6340a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:29.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc638da0700 1 --2- 172.21.15.62:0/48659733 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc6340a8e10 0x7fc63414a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:29.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc639da2700 1 -- 172.21.15.62:0/48659733 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6340a71e0 msgr2=0x7fc6340a9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:29.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc639da2700 1 --2- 172.21.15.62:0/48659733 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6340a71e0 0x7fc6340a9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:29.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc639da2700 1 -- 172.21.15.62:0/48659733 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc6340a8e10 msgr2=0x7fc63414a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:29.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc639da2700 1 --2- 172.21.15.62:0/48659733 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc6340a8e10 0x7fc63414a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:29.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc639da2700 1 -- 172.21.15.62:0/48659733 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62400b180 con 0x7fc634141480 2021-12-17T18:25:29.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc639da2700 1 --2- 172.21.15.62:0/48659733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc634141480 0x7fc6340ab470 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7fc62c001490 tx=0x7fc62c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:29.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc62a7fc700 1 -- 172.21.15.62:0/48659733 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc62c005ba0 con 0x7fc634141480 2021-12-17T18:25:29.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc62a7fc700 1 -- 172.21.15.62:0/48659733 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c005d00 con 0x7fc634141480 2021-12-17T18:25:29.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc62a7fc700 1 -- 172.21.15.62:0/48659733 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc62c0072c0 con 0x7fc634141480 2021-12-17T18:25:29.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc63a5a3700 1 -- 172.21.15.62:0/48659733 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63414aee0 con 0x7fc634141480 2021-12-17T18:25:29.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.228+0000 7fc63a5a3700 1 -- 172.21.15.62:0/48659733 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63414a190 con 0x7fc634141480 2021-12-17T18:25:29.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.232+0000 7fc62a7fc700 1 -- 172.21.15.62:0/48659733 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc62c010070 con 0x7fc634141480 2021-12-17T18:25:29.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.232+0000 7fc63a5a3700 1 -- 172.21.15.62:0/48659733 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6340ab190 con 0x7fc634141480 2021-12-17T18:25:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.232+0000 7fc62a7fc700 1 --2- 172.21.15.62:0/48659733 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc61c053610 0x7fc61c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.232+0000 7fc62a7fc700 1 -- 172.21.15.62:0/48659733 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc62c06b440 con 0x7fc634141480 2021-12-17T18:25:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.232+0000 7fc6395a1700 1 --2- 172.21.15.62:0/48659733 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc61c053610 0x7fc61c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.232+0000 7fc6395a1700 1 --2- 172.21.15.62:0/48659733 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc61c053610 0x7fc61c055ad0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fc63000b000 tx=0x7fc630009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:29.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.236+0000 7fc62a7fc700 1 -- 172.21.15.62:0/48659733 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc62c042500 con 0x7fc634141480 2021-12-17T18:25:29.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.400+0000 7fc63a5a3700 1 -- 172.21.15.62:0/48659733 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6340b1b90 con 0x7fc634141480 2021-12-17T18:25:29.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.400+0000 7fc62a7fc700 1 -- 172.21.15.62:0/48659733 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+2143 (secure 0 0 0) 0x7fc62c045b20 con 0x7fc634141480 2021-12-17T18:25:29.406 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:29.407 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":37,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3760020760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3760020760},{"type":"v1","addr":"172.21.15.109:6835","nonce":3760020760}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:25:20.884652+0000","modified":"2021-12-17T18:25:21.888425+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1765551619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1765551619},{"type":"v1","addr":"172.21.15.62:6833","nonce":1765551619}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-12-17T18:25:29.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.400+0000 7fc63a5a3700 1 -- 172.21.15.62:0/48659733 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc61c053610 msgr2=0x7fc61c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:29.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.400+0000 7fc63a5a3700 1 --2- 172.21.15.62:0/48659733 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc61c053610 0x7fc61c055ad0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fc63000b000 tx=0x7fc630009040).stop 2021-12-17T18:25:29.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.400+0000 7fc63a5a3700 1 -- 172.21.15.62:0/48659733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc634141480 msgr2=0x7fc6340ab470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:29.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.400+0000 7fc63a5a3700 1 --2- 172.21.15.62:0/48659733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc634141480 0x7fc6340ab470 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7fc62c001490 tx=0x7fc62c007e00).stop 2021-12-17T18:25:29.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.400+0000 7fc63a5a3700 1 -- 172.21.15.62:0/48659733 shutdown_connections 2021-12-17T18:25:29.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.400+0000 7fc63a5a3700 1 --2- 172.21.15.62:0/48659733 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc61c053610 0x7fc61c055ad0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:29.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.400+0000 7fc63a5a3700 1 --2- 172.21.15.62:0/48659733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc634141480 0x7fc6340ab470 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:29.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.400+0000 7fc63a5a3700 1 --2- 172.21.15.62:0/48659733 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc6340a8e10 0x7fc63414a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:29.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.400+0000 7fc63a5a3700 1 --2- 172.21.15.62:0/48659733 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc6340a71e0 0x7fc6340a9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:29.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.400+0000 7fc63a5a3700 1 -- 172.21.15.62:0/48659733 >> 172.21.15.62:0/48659733 conn(0x7fc63405d220 msgr2=0x7fc63405fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:29.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.400+0000 7fc63a5a3700 1 -- 172.21.15.62:0/48659733 shutdown_connections 2021-12-17T18:25:29.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:29.400+0000 7fc63a5a3700 1 -- 172.21.15.62:0/48659733 wait complete. 2021-12-17T18:25:29.413 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 37 2021-12-17T18:25:29.620 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:25:20.884652+0000', 'modified': '2021-12-17T18:25:21.888425+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6714}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6714': {'gid': 6714, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/1765551619', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 1765551619}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 1765551619}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:25:29.621 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:25:29.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:25:29.745 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":6714,"want_state":"up:active","state":"up:active","rank_uptime":8.8463264479999992,"mdsmap_epoch":37,"osdmap_epoch":81,"osdmap_epoch_barrier":81,"uptime":13.176042016} 2021-12-17T18:25:29.746 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 6714, "mdsmap_epoch": 37, "osdmap_epoch": 81, "osdmap_epoch_barrier": 81, "rank_uptime": 8.846326448, "state": "up:active", "uptime": 13.176042016, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:25:29.747 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:25:29.747 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-12-17T18:25:29.747 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi158.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-12-17T18:25:29.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:29.748 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:29.757 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:25:29.773 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:25:29.774 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:25:29.790 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:25:29.791 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:25:29.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:29.792 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:25:29.797 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:25:29.798 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:29.841 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:25:29.859 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:25:29.860 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:25:29.870 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:25:29.871 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:25:29.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:29.872 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:25:29.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:2021-12-17T18:25:29.913+0000 7fcff1338080 -1 init, newargv = 0x55e4001b4cb0 newargc=9ceph-fuse[ 2021-12-17T18:25:29.918 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:14129]: starting ceph client 2021-12-17T18:25:29.928 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14129]: starting fuse 2021-12-17T18:25:30.978 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:25:30.998 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:25:30.999 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:25:31.055 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:25:31.056 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:25:31.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:31.057 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:25:31.064 INFO:teuthology.orchestra.run.smithi158.stdout:52 2021-12-17T18:25:31.065 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:25:31.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:31.066 DEBUG:teuthology.orchestra.run.smithi158:> sudo python3 -c ' 2021-12-17T18:25:31.066 DEBUG:teuthology.orchestra.run.smithi158:> import glob 2021-12-17T18:25:31.066 DEBUG:teuthology.orchestra.run.smithi158:> import re 2021-12-17T18:25:31.067 DEBUG:teuthology.orchestra.run.smithi158:> import os 2021-12-17T18:25:31.067 DEBUG:teuthology.orchestra.run.smithi158:> import subprocess 2021-12-17T18:25:31.068 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:25:31.068 DEBUG:teuthology.orchestra.run.smithi158:> def find_socket(client_name): 2021-12-17T18:25:31.069 DEBUG:teuthology.orchestra.run.smithi158:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-12-17T18:25:31.069 DEBUG:teuthology.orchestra.run.smithi158:> files = glob.glob(asok_path) 2021-12-17T18:25:31.070 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:25:31.070 DEBUG:teuthology.orchestra.run.smithi158:> # Given a non-glob path, it better be there 2021-12-17T18:25:31.071 DEBUG:teuthology.orchestra.run.smithi158:> if "*" not in asok_path: 2021-12-17T18:25:31.071 DEBUG:teuthology.orchestra.run.smithi158:> assert(len(files) == 1) 2021-12-17T18:25:31.072 DEBUG:teuthology.orchestra.run.smithi158:> return files[0] 2021-12-17T18:25:31.072 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:25:31.072 DEBUG:teuthology.orchestra.run.smithi158:> for f in files: 2021-12-17T18:25:31.073 DEBUG:teuthology.orchestra.run.smithi158:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:25:31.073 DEBUG:teuthology.orchestra.run.smithi158:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:25:31.074 DEBUG:teuthology.orchestra.run.smithi158:> return f 2021-12-17T18:25:31.074 DEBUG:teuthology.orchestra.run.smithi158:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:25:31.075 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:25:31.075 DEBUG:teuthology.orchestra.run.smithi158:> print(find_socket("client.1")) 2021-12-17T18:25:31.076 DEBUG:teuthology.orchestra.run.smithi158:> ' 2021-12-17T18:25:31.122 INFO:teuthology.orchestra.run.smithi158.stdout:/var/run/ceph/ceph-client.1.14129.asok 2021-12-17T18:25:31.127 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14129.asok 2021-12-17T18:25:31.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:31.128 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14129.asok status 2021-12-17T18:25:31.212 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2021-12-17T18:25:31.213 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": { 2021-12-17T18:25:31.213 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:25:31.213 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:25:31.213 INFO:teuthology.orchestra.run.smithi158.stdout: "entity_id": "1", 2021-12-17T18:25:31.214 INFO:teuthology.orchestra.run.smithi158.stdout: "hostname": "smithi158", 2021-12-17T18:25:31.214 INFO:teuthology.orchestra.run.smithi158.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-12-17T18:25:31.214 INFO:teuthology.orchestra.run.smithi158.stdout: "pid": "14129", 2021-12-17T18:25:31.214 INFO:teuthology.orchestra.run.smithi158.stdout: "root": "/" 2021-12-17T18:25:31.215 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:25:31.215 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_count": 0, 2021-12-17T18:25:31.215 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_pinned_count": 0, 2021-12-17T18:25:31.215 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 6933, 2021-12-17T18:25:31.216 INFO:teuthology.orchestra.run.smithi158.stdout: "inst": { 2021-12-17T18:25:31.216 INFO:teuthology.orchestra.run.smithi158.stdout: "name": { 2021-12-17T18:25:31.216 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "client", 2021-12-17T18:25:31.217 INFO:teuthology.orchestra.run.smithi158.stdout: "num": 6933 2021-12-17T18:25:31.217 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:25:31.217 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:25:31.218 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:25:31.218 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:25:31.218 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 940296092 2021-12-17T18:25:31.218 INFO:teuthology.orchestra.run.smithi158.stdout: } 2021-12-17T18:25:31.219 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:25:31.219 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:25:31.219 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:25:31.219 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:25:31.220 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 940296092 2021-12-17T18:25:31.220 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:25:31.220 INFO:teuthology.orchestra.run.smithi158.stdout: "inst_str": "client.6933 172.21.15.158:0/940296092", 2021-12-17T18:25:31.220 INFO:teuthology.orchestra.run.smithi158.stdout: "addr_str": "172.21.15.158:0/940296092", 2021-12-17T18:25:31.221 INFO:teuthology.orchestra.run.smithi158.stdout: "inode_count": 1, 2021-12-17T18:25:31.221 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_epoch": 37, 2021-12-17T18:25:31.221 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch": 81, 2021-12-17T18:25:31.221 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:25:31.222 INFO:teuthology.orchestra.run.smithi158.stdout: "blacklisted": false, 2021-12-17T18:25:31.222 INFO:teuthology.orchestra.run.smithi158.stdout: "fs_name": "cephfs" 2021-12-17T18:25:31.222 INFO:teuthology.orchestra.run.smithi158.stdout:} 2021-12-17T18:25:31.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:31.224 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:31.224 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:31.231 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:25:31.232 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:25:31.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:31.233 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:31.293 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:31.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2dae8e700 1 Processor -- start 2021-12-17T18:25:31.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2dae8e700 1 -- start start 2021-12-17T18:25:31.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2dae8e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa2d405ffe0 0x7fa2d40679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:31.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2dae8e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa2d40ad360 0x7fa2d40b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:31.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2dae8e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d40b2e90 con 0x7fa2d40b57e0 2021-12-17T18:25:31.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2dae8e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d40b4b70 con 0x7fa2d405ffe0 2021-12-17T18:25:31.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2dae8e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d40b4e10 con 0x7fa2d40ad360 2021-12-17T18:25:31.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2d8c2a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa2d405ffe0 0x7fa2d40679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:31.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2d8c2a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa2d405ffe0 0x7fa2d40679c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53224/0 (socket says 172.21.15.62:53224) 2021-12-17T18:25:31.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2d8c2a700 1 -- 172.21.15.62:0/7210702 learned_addr learned my addr 172.21.15.62:0/7210702 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:31.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2cbfff700 1 --2- 172.21.15.62:0/7210702 >> v2:172.21.15.109:3300/0 conn(0x7fa2d40ad360 0x7fa2d40b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:31.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2d8c2a700 1 -- 172.21.15.62:0/7210702 >> v2:172.21.15.109:3300/0 conn(0x7fa2d40ad360 msgr2=0x7fa2d40b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:31.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2d8c2a700 1 --2- 172.21.15.62:0/7210702 >> v2:172.21.15.109:3300/0 conn(0x7fa2d40ad360 0x7fa2d40b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:31.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2d8c2a700 1 -- 172.21.15.62:0/7210702 >> v1:172.21.15.109:6789/0 conn(0x7fa2d40b57e0 legacy=0x7fa2d40b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:31.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2d8c2a700 1 -- 172.21.15.62:0/7210702 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d40b52b0 con 0x7fa2d405ffe0 2021-12-17T18:25:31.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2d8c2a700 1 --2- 172.21.15.62:0/7210702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d405ffe0 0x7fa2d40679c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fa2d0002f70 tx=0x7fa2d0006eb0).ready entity=mon.0 client_cookie=1b8c8480de7003b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:31.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2cb7fe700 1 -- 172.21.15.62:0/7210702 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d000d610 con 0x7fa2d405ffe0 2021-12-17T18:25:31.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2cb7fe700 1 -- 172.21.15.62:0/7210702 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d0000e90 con 0x7fa2d405ffe0 2021-12-17T18:25:31.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2cb7fe700 1 -- 172.21.15.62:0/7210702 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d000d9a0 con 0x7fa2d405ffe0 2021-12-17T18:25:31.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2dae8e700 1 -- 172.21.15.62:0/7210702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d405ffe0 msgr2=0x7fa2d40679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:31.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2dae8e700 1 --2- 172.21.15.62:0/7210702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d405ffe0 0x7fa2d40679c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fa2d0002f70 tx=0x7fa2d0006eb0).stop 2021-12-17T18:25:31.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2dae8e700 1 -- 172.21.15.62:0/7210702 shutdown_connections 2021-12-17T18:25:31.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2dae8e700 1 --2- 172.21.15.62:0/7210702 >> v2:172.21.15.109:3300/0 conn(0x7fa2d40ad360 0x7fa2d40b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:31.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2dae8e700 1 --2- 172.21.15.62:0/7210702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d405ffe0 0x7fa2d40679c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:31.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2dae8e700 1 -- 172.21.15.62:0/7210702 >> 172.21.15.62:0/7210702 conn(0x7fa2d40626d0 msgr2=0x7fa2d405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:31.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2dae8e700 1 -- 172.21.15.62:0/7210702 shutdown_connections 2021-12-17T18:25:31.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.400+0000 7fa2dae8e700 1 -- 172.21.15.62:0/7210702 wait complete. 2021-12-17T18:25:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.404+0000 7fa2dae8e700 1 Processor -- start 2021-12-17T18:25:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.404+0000 7fa2dae8e700 1 -- start start 2021-12-17T18:25:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.404+0000 7fa2dae8e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d405ffe0 0x7fa2d40afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.404+0000 7fa2dae8e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa2d40ad360 0x7fa2d4065180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:31.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.404+0000 7fa2dae8e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa2d40b57e0 0x7fa2d4065f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:31.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.404+0000 7fa2dae8e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d4156e70 con 0x7fa2d405ffe0 2021-12-17T18:25:31.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.404+0000 7fa2dae8e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d4152b70 con 0x7fa2d40ad360 2021-12-17T18:25:31.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.404+0000 7fa2dae8e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d4152e10 con 0x7fa2d40b57e0 2021-12-17T18:25:31.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.404+0000 7fa2d8c2a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d405ffe0 0x7fa2d40afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:31.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.404+0000 7fa2d8c2a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d405ffe0 0x7fa2d40afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53228/0 (socket says 172.21.15.62:53228) 2021-12-17T18:25:31.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.404+0000 7fa2d8c2a700 1 -- 172.21.15.62:0/914740702 learned_addr learned my addr 172.21.15.62:0/914740702 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:31.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.404+0000 7fa2cbfff700 1 --2- 172.21.15.62:0/914740702 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa2d40ad360 0x7fa2d4065180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:31.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.404+0000 7fa2d942b700 1 --2- 172.21.15.62:0/914740702 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa2d40b57e0 0x7fa2d4065f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:31.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.404+0000 7fa2d8c2a700 1 -- 172.21.15.62:0/914740702 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa2d40b57e0 msgr2=0x7fa2d4065f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:31.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.408+0000 7fa2d8c2a700 1 --2- 172.21.15.62:0/914740702 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa2d40b57e0 0x7fa2d4065f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:31.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.408+0000 7fa2d8c2a700 1 -- 172.21.15.62:0/914740702 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa2d40ad360 msgr2=0x7fa2d4065180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:31.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.408+0000 7fa2d8c2a700 1 --2- 172.21.15.62:0/914740702 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa2d40ad360 0x7fa2d4065180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:31.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.408+0000 7fa2d8c2a700 1 -- 172.21.15.62:0/914740702 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d000b1e0 con 0x7fa2d405ffe0 2021-12-17T18:25:31.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.408+0000 7fa2d8c2a700 1 --2- 172.21.15.62:0/914740702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d405ffe0 0x7fa2d40afd20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7fa2d0002f70 tx=0x7fa2d0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:31.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.408+0000 7fa2c9ffb700 1 -- 172.21.15.62:0/914740702 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d0011690 con 0x7fa2d405ffe0 2021-12-17T18:25:31.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.408+0000 7fa2c9ffb700 1 -- 172.21.15.62:0/914740702 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d00117f0 con 0x7fa2d405ffe0 2021-12-17T18:25:31.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.408+0000 7fa2dae8e700 1 -- 172.21.15.62:0/914740702 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d40b03c0 con 0x7fa2d405ffe0 2021-12-17T18:25:31.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.408+0000 7fa2c9ffb700 1 -- 172.21.15.62:0/914740702 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d0011b50 con 0x7fa2d405ffe0 2021-12-17T18:25:31.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.408+0000 7fa2dae8e700 1 -- 172.21.15.62:0/914740702 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d4156a10 con 0x7fa2d405ffe0 2021-12-17T18:25:31.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.408+0000 7fa2dae8e700 1 -- 172.21.15.62:0/914740702 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d4156c90 con 0x7fa2d405ffe0 2021-12-17T18:25:31.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.408+0000 7fa2c9ffb700 1 -- 172.21.15.62:0/914740702 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa2d0025030 con 0x7fa2d405ffe0 2021-12-17T18:25:31.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.412+0000 7fa2c9ffb700 1 --2- 172.21.15.62:0/914740702 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa2b4053610 0x7fa2b4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:31.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.412+0000 7fa2c9ffb700 1 -- 172.21.15.62:0/914740702 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa2d006c960 con 0x7fa2d405ffe0 2021-12-17T18:25:31.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.412+0000 7fa2cbfff700 1 --2- 172.21.15.62:0/914740702 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa2b4053610 0x7fa2b4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:31.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.412+0000 7fa2cbfff700 1 --2- 172.21.15.62:0/914740702 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa2b4053610 0x7fa2b4055ad0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fa2c400c000 tx=0x7fa2c4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:31.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.416+0000 7fa2c9ffb700 1 -- 172.21.15.62:0/914740702 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa2d0043ac0 con 0x7fa2d405ffe0 2021-12-17T18:25:31.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.584+0000 7fa2dae8e700 1 -- 172.21.15.62:0/914740702 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2d40573d0 con 0x7fa2d405ffe0 2021-12-17T18:25:31.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.584+0000 7fa2c9ffb700 1 -- 172.21.15.62:0/914740702 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+2143 (secure 0 0 0) 0x7fa2d0023020 con 0x7fa2d405ffe0 2021-12-17T18:25:31.589 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:31.589 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":37,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3760020760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3760020760},{"type":"v1","addr":"172.21.15.109:6835","nonce":3760020760}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:25:20.884652+0000","modified":"2021-12-17T18:25:21.888425+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1765551619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1765551619},{"type":"v1","addr":"172.21.15.62:6833","nonce":1765551619}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-12-17T18:25:31.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.584+0000 7fa2dae8e700 1 -- 172.21.15.62:0/914740702 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa2b4053610 msgr2=0x7fa2b4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:31.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.584+0000 7fa2dae8e700 1 --2- 172.21.15.62:0/914740702 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa2b4053610 0x7fa2b4055ad0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fa2c400c000 tx=0x7fa2c4008040).stop 2021-12-17T18:25:31.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.584+0000 7fa2dae8e700 1 -- 172.21.15.62:0/914740702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d405ffe0 msgr2=0x7fa2d40afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:31.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.584+0000 7fa2dae8e700 1 --2- 172.21.15.62:0/914740702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d405ffe0 0x7fa2d40afd20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7fa2d0002f70 tx=0x7fa2d0015000).stop 2021-12-17T18:25:31.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.584+0000 7fa2dae8e700 1 -- 172.21.15.62:0/914740702 shutdown_connections 2021-12-17T18:25:31.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.584+0000 7fa2dae8e700 1 --2- 172.21.15.62:0/914740702 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa2b4053610 0x7fa2b4055ad0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:31.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.584+0000 7fa2dae8e700 1 --2- 172.21.15.62:0/914740702 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa2d40b57e0 0x7fa2d4065f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:31.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.584+0000 7fa2dae8e700 1 --2- 172.21.15.62:0/914740702 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa2d40ad360 0x7fa2d4065180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:31.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.584+0000 7fa2dae8e700 1 --2- 172.21.15.62:0/914740702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d405ffe0 0x7fa2d40afd20 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:31.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.584+0000 7fa2dae8e700 1 -- 172.21.15.62:0/914740702 >> 172.21.15.62:0/914740702 conn(0x7fa2d40626d0 msgr2=0x7fa2d40b9190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:31.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.584+0000 7fa2dae8e700 1 -- 172.21.15.62:0/914740702 shutdown_connections 2021-12-17T18:25:31.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:31.584+0000 7fa2dae8e700 1 -- 172.21.15.62:0/914740702 wait complete. 2021-12-17T18:25:31.594 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 37 2021-12-17T18:25:31.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1 2021-12-17T18:25:31.706 INFO:teuthology.orchestra.run.smithi062.stdout:{"path":"/","ino":1,"rdev":0,"ctime":"2021-12-17T18:25:31.287953+0000","btime":"2021-12-17T18:25:20.889966+0000","mode":17407,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":16,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":0,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-12-17T18:25:20.889966+0000","atime":"0.000000","time_warp_seq":0,"change_attr":2,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-12-17T18:25:31.287953+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-12-17T18:25:20.889966+0000"},"version":4,"file_data_version":0,"xattr_version":1,"backtrace_version":3,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent"],"client_caps":[{"client_id":6065,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2},{"client_id":6933,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2}],"loner":-1,"want_loner":-1,"mds_caps_wanted":[]} 2021-12-17T18:25:31.707 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "2021-12-17T18:25:20.889966+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "0.000000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 3, "btime": "2021-12-17T18:25:20.889966+0000", "change_attr": 2, "client_caps": [ { "client_id": 6065, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" }, { "client_id": 6933, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-12-17T18:25:31.287953+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 0, "ino": 1, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 16, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 17407, "mtime": "2021-12-17T18:25:20.889966+0000", "nestlock": {}, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/", "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2021-12-17T18:25:31.287953+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "uid": 0, "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2021-12-17T18:25:31.707 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:25:31.708 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:31.729 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:31.749 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:31.770 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:31.792 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:31.813 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:25:31.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:31.814 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:31.815 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:31.823 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:25:31.824 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:25:31.824 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:25:31.825 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:25:31.825 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:31.882 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14670]: fuse finished with error 0 and tester_r 0 2021-12-17T18:25:31.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:31.885 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:31.885 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:31.892 INFO:teuthology.orchestra.run.smithi125.stdout:ext2/ext3 2021-12-17T18:25:31.893 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:25:32.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:25:32.010 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:32.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:32.017 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:32.017 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:32.026 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:25:32.027 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:25:32.027 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi158.front.sepia.ceph.com... 2021-12-17T18:25:32.028 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:25:32.028 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:32.082 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14129]: fuse finished with error 0 and tester_r 0 2021-12-17T18:25:32.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:32.085 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:32.085 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:32.093 INFO:teuthology.orchestra.run.smithi158.stdout:ext2/ext3 2021-12-17T18:25:32.094 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:25:32.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:25:32.112 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:32.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:32.120 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:32.120 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:25:32.127 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:25:32.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:25:32.129 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:25:32.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:25:32.130 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:25:32.137 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:25:32.138 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:25:32.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:25:32.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba87d7700 1 Processor -- start 2021-12-17T18:25:32.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba87d7700 1 -- start start 2021-12-17T18:25:32.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba87d7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7ba00b21f0 0x7f7ba014aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:32.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba87d7700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7ba00b1730 0x7f7ba00ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:32.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba87d7700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba00b2ce0 con 0x7f7ba00a7bb0 2021-12-17T18:25:32.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba87d7700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba0147870 con 0x7f7ba00b1730 2021-12-17T18:25:32.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba87d7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba00b2f10 con 0x7f7ba00b21f0 2021-12-17T18:25:32.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba6573700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7ba00b21f0 0x7f7ba014aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:32.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba5d72700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7ba00b1730 0x7f7ba00ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:32.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba5d72700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7ba00b1730 0x7f7ba00ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:59790/0 (socket says 172.21.15.62:59790) 2021-12-17T18:25:32.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba5d72700 1 -- 172.21.15.62:0/3238148774 learned_addr learned my addr 172.21.15.62:0/3238148774 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:32.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba6573700 1 --2- 172.21.15.62:0/3238148774 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7ba00b21f0 0x7f7ba014aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:46938/0 (socket says 172.21.15.62:46938) 2021-12-17T18:25:32.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba6d74700 1 --1- 172.21.15.62:0/3238148774 >> v1:172.21.15.109:6789/0 conn(0x7f7ba00a7bb0 0x7f7ba0067120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:53138/0 (socket says 172.21.15.62:53138) 2021-12-17T18:25:32.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba5d72700 1 -- 172.21.15.62:0/3238148774 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7ba00b21f0 msgr2=0x7f7ba014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:32.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba5d72700 1 --2- 172.21.15.62:0/3238148774 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7ba00b21f0 0x7f7ba014aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:32.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba5d72700 1 -- 172.21.15.62:0/3238148774 >> v1:172.21.15.109:6789/0 conn(0x7f7ba00a7bb0 legacy=0x7f7ba0067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:32.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba5d72700 1 -- 172.21.15.62:0/3238148774 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba00aca60 con 0x7f7ba00b1730 2021-12-17T18:25:32.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba5d72700 1 --2- 172.21.15.62:0/3238148774 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7ba00b1730 0x7f7ba00ace90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f7b900032f0 tx=0x7f7b90009290).ready entity=mon.1 client_cookie=7c6552194e4e8fb7 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:32.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba5571700 1 -- 172.21.15.62:0/3238148774 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b9000b8a0 con 0x7f7ba00b1730 2021-12-17T18:25:32.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba5571700 1 -- 172.21.15.62:0/3238148774 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9000ba00 con 0x7f7ba00b1730 2021-12-17T18:25:32.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba5571700 1 -- 172.21.15.62:0/3238148774 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b9000bb70 con 0x7f7ba00b1730 2021-12-17T18:25:32.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba87d7700 1 -- 172.21.15.62:0/3238148774 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7ba00b1730 msgr2=0x7f7ba00ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:32.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba87d7700 1 --2- 172.21.15.62:0/3238148774 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7ba00b1730 0x7f7ba00ace90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f7b900032f0 tx=0x7f7b90009290).stop 2021-12-17T18:25:32.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba87d7700 1 -- 172.21.15.62:0/3238148774 shutdown_connections 2021-12-17T18:25:32.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba87d7700 1 --2- 172.21.15.62:0/3238148774 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7ba00b1730 0x7f7ba00ace90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:32.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.248+0000 7f7ba87d7700 1 --2- 172.21.15.62:0/3238148774 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7ba00b21f0 0x7f7ba014aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:32.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba87d7700 1 -- 172.21.15.62:0/3238148774 >> 172.21.15.62:0/3238148774 conn(0x7f7ba005f730 msgr2=0x7f7ba005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:32.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba87d7700 1 -- 172.21.15.62:0/3238148774 shutdown_connections 2021-12-17T18:25:32.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba87d7700 1 -- 172.21.15.62:0/3238148774 wait complete. 2021-12-17T18:25:32.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba87d7700 1 Processor -- start 2021-12-17T18:25:32.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba87d7700 1 -- start start 2021-12-17T18:25:32.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba87d7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7ba00a7bb0 0x7f7ba00aab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:32.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba87d7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ba00b1730 0x7f7ba01579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:32.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba87d7700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7ba00b21f0 0x7f7ba014d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:32.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba87d7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba014cd40 con 0x7f7ba00b1730 2021-12-17T18:25:32.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba87d7700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba0156dd0 con 0x7f7ba00b21f0 2021-12-17T18:25:32.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba87d7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba0157000 con 0x7f7ba00a7bb0 2021-12-17T18:25:32.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba5d72700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ba00b1730 0x7f7ba01579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:32.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba6d74700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7ba00b21f0 0x7f7ba014d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:32.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba5d72700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ba00b1730 0x7f7ba01579e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53244/0 (socket says 172.21.15.62:53244) 2021-12-17T18:25:32.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba5d72700 1 -- 172.21.15.62:0/916773374 learned_addr learned my addr 172.21.15.62:0/916773374 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:32.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba6573700 1 --2- 172.21.15.62:0/916773374 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7ba00a7bb0 0x7f7ba00aab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:32.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba6d74700 1 -- 172.21.15.62:0/916773374 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7ba00a7bb0 msgr2=0x7f7ba00aab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:32.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba6d74700 1 --2- 172.21.15.62:0/916773374 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7ba00a7bb0 0x7f7ba00aab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:32.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba6d74700 1 -- 172.21.15.62:0/916773374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ba00b1730 msgr2=0x7f7ba01579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:32.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba6d74700 1 --2- 172.21.15.62:0/916773374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ba00b1730 0x7f7ba01579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:32.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba6d74700 1 -- 172.21.15.62:0/916773374 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b90009530 con 0x7f7ba00b21f0 2021-12-17T18:25:32.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba5d72700 1 --2- 172.21.15.62:0/916773374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ba00b1730 0x7f7ba01579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:32.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.252+0000 7f7ba6d74700 1 --2- 172.21.15.62:0/916773374 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7ba00b21f0 0x7f7ba014d620 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f7ba0061080 tx=0x7f7b98007b00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:32.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.256+0000 7f7b9f7fe700 1 -- 172.21.15.62:0/916773374 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b980072e0 con 0x7f7ba00b21f0 2021-12-17T18:25:32.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.256+0000 7f7b9f7fe700 1 -- 172.21.15.62:0/916773374 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9800cb40 con 0x7f7ba00b21f0 2021-12-17T18:25:32.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.256+0000 7f7ba87d7700 1 -- 172.21.15.62:0/916773374 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba01572a0 con 0x7f7ba00b21f0 2021-12-17T18:25:32.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.256+0000 7f7b9f7fe700 1 -- 172.21.15.62:0/916773374 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b98005550 con 0x7f7ba00b21f0 2021-12-17T18:25:32.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.256+0000 7f7ba87d7700 1 -- 172.21.15.62:0/916773374 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba00ac2c0 con 0x7f7ba00b21f0 2021-12-17T18:25:32.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.256+0000 7f7ba87d7700 1 -- 172.21.15.62:0/916773374 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba00638e0 con 0x7f7ba00b21f0 2021-12-17T18:25:32.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.256+0000 7f7b9f7fe700 1 -- 172.21.15.62:0/916773374 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7b98010070 con 0x7f7ba00b21f0 2021-12-17T18:25:32.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.256+0000 7f7b9f7fe700 1 --2- 172.21.15.62:0/916773374 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b84053610 0x7f7b84055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:32.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.256+0000 7f7b9f7fe700 1 -- 172.21.15.62:0/916773374 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7b9806ad00 con 0x7f7ba00b21f0 2021-12-17T18:25:32.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.256+0000 7f7ba6573700 1 --2- 172.21.15.62:0/916773374 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b84053610 0x7f7b84055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:32.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.260+0000 7f7ba6573700 1 --2- 172.21.15.62:0/916773374 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b84053610 0x7f7b84055ad0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f7b8800b000 tx=0x7f7b88006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:32.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.264+0000 7f7b9f7fe700 1 -- 172.21.15.62:0/916773374 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7ba00638e0 con 0x7f7ba00b21f0 2021-12-17T18:25:32.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.396+0000 7f7ba87d7700 1 -- 172.21.15.62:0/916773374 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f7ba00638e0 con 0x7f7ba00b21f0 2021-12-17T18:25:32.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.396+0000 7f7b9f7fe700 1 -- 172.21.15.62:0/916773374 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v81) v1 ==== 81+0+33696 (secure 0 0 0) 0x7f7ba00638e0 con 0x7f7ba00b21f0 2021-12-17T18:25:32.404 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:32.404 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:25:32.405 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 81, 2021-12-17T18:25:32.405 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:25:32.405 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:25:32.405 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:25:21.887449+0000", 2021-12-17T18:25:32.406 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:25:32.406 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:25:32.407 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:25:32.407 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:25:32.407 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:25:32.407 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:25:32.408 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:25:32.408 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:25:32.408 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:25:32.408 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:32.409 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:25:32.409 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:25:32.409 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:25:32.410 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:25:32.410 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:25:32.410 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 16, 2021-12-17T18:25:32.410 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:25:32.411 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:25:32.411 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:25:32.411 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:25:32.411 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:25:32.412 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.412 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:25:32.412 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:25:32.412 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:25:32.413 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:25:32.413 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:25:32.413 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:25:32.413 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:25:32.414 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:25:32.414 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:25:32.414 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:25:32.414 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:25:32.415 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:25:32.415 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:25:32.415 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:25:32.415 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:25:32.416 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:25:32.416 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:25:32.416 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:25:32.417 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:25:32.417 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:25:32.417 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:25:32.418 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:25:32.418 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:25:32.418 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.418 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:25:32.419 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:25:32.419 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:25:32.419 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:25:32.419 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:25:32.420 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:25:32.420 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:25:32.420 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:25:32.420 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:25:32.420 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:25:32.421 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:25:32.421 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:25:32.421 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:25:32.421 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:25:32.422 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:25:32.422 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:25:32.422 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:25:32.422 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:25:32.423 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:25:32.423 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:25:32.423 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:25:32.423 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:25:32.424 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:25:32.424 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:25:32.424 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:25:32.424 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:25:32.424 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:25:32.425 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.425 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:25:32.425 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:25:32.425 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:25:32.426 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:25:32.426 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:25:32.426 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:25:32.426 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:25:32.427 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:25:32.427 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:25:32.427 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:25:32.427 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:25:32.428 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:25:32.428 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:25:32.428 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.428 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:25:32.429 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:25:32.429 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.429 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.429 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.430 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:25:32.430 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:25:32.430 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:25:32.430 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:25:32.431 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:25:32.431 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:25:32.431 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:25:32.431 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:25:32.431 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:25:32.432 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:25:32.432 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:25:32.432 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:25:32.432 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:25:32.433 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:25:32.433 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:25:32.433 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:25:32.433 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:25:32.433 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:25:32.434 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:25:32.434 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:25:32.434 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:25:32.434 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:25:32.435 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:25:32.435 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.435 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:25:32.435 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:25:32.435 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:25:32.436 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:25:32.436 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:25:32.436 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:25:32.436 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:25:32.437 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:25:32.437 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:25:32.437 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:25:32.437 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:25:32.438 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:25:32.438 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:25:32.438 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:25:32.438 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:25:32.439 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:25:32.439 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:25:32.439 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:25:32.439 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:25:32.440 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:25:32.440 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:25:32.440 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:25:32.440 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:25:32.441 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:25:32.441 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:25:32.441 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:25:32.441 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:25:32.441 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.442 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:25:32.442 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:25:32.442 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:25:32.442 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:25:32.443 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:25:32.443 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:25:32.443 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:25:32.443 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:25:32.444 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:25:32.444 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:25:32.444 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:25:32.444 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:25:32.445 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:25:32.445 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:25:32.445 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.445 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.446 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.446 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 15, 2021-12-17T18:25:32.446 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2021-12-17T18:25:32.446 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:25:19.272638+0000", 2021-12-17T18:25:32.447 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:25:32.447 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:25:32.447 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:25:32.447 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:25:32.448 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:25:32.448 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:25:32.448 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:25:32.449 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:25:32.449 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:25:32.449 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:25:32.449 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:25:32.450 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:25:32.450 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:25:32.450 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:25:32.450 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:25:32.451 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:25:32.451 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:25:32.451 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:25:32.451 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:25:32.452 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:25:32.452 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.452 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "80", 2021-12-17T18:25:32.452 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:25:32.452 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:25:32.453 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:25:32.453 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:25:32.453 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:25:32.453 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:25:32.454 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:25:32.454 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:25:32.454 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:25:32.454 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:25:32.455 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:25:32.455 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:25:32.455 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:25:32.455 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:25:32.456 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:25:32.456 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:25:32.456 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:25:32.456 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:25:32.456 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:25:32.457 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:25:32.457 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:25:32.457 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:25:32.457 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:25:32.458 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:25:32.458 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:25:32.458 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:25:32.458 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.459 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:25:32.459 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:25:32.459 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:25:32.459 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:25:32.460 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:25:32.460 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:25:32.460 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:25:32.460 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:25:32.461 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:25:32.461 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:25:32.461 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:25:32.461 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:25:32.461 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2021-12-17T18:25:32.462 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2021-12-17T18:25:32.462 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2021-12-17T18:25:32.462 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.462 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:25:32.463 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:25:32.463 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2021-12-17T18:25:32.463 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.463 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.464 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.464 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.464 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 16, 2021-12-17T18:25:32.464 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2021-12-17T18:25:32.464 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:25:20.525388+0000", 2021-12-17T18:25:32.465 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:25:32.465 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:25:32.465 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:25:32.465 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:25:32.466 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:25:32.466 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:25:32.466 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:25:32.466 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:25:32.467 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:25:32.467 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:25:32.467 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:25:32.467 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:25:32.467 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:25:32.468 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:25:32.468 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:25:32.468 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:25:32.468 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:25:32.469 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:25:32.469 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:25:32.469 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:25:32.469 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.470 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "81", 2021-12-17T18:25:32.470 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:25:32.470 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:25:32.470 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:25:32.471 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:25:32.471 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:25:32.471 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:25:32.471 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:25:32.472 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:25:32.472 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:25:32.472 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:25:32.472 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:25:32.472 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:25:32.473 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:25:32.473 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:25:32.473 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:25:32.473 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:25:32.474 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:25:32.474 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:25:32.474 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:25:32.474 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:25:32.475 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:25:32.475 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:25:32.475 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:25:32.476 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:25:32.476 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:25:32.476 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:25:32.476 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.477 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:25:32.477 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:25:32.477 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:25:32.477 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:25:32.478 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:25:32.478 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:25:32.478 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:25:32.478 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:25:32.479 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:25:32.479 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:25:32.479 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:25:32.479 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:25:32.479 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:25:32.480 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:25:32.480 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2021-12-17T18:25:32.480 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.480 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.481 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.481 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:32.481 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:25:32.481 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.481 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:25:32.482 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:25:32.482 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:32.482 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:32.482 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:32.483 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:32.483 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:32.483 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:32.483 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:32.484 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 79, 2021-12-17T18:25:32.484 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:32.484 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:32.484 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:32.484 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.485 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.485 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.485 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:25:32.485 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:32.486 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.486 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.486 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.486 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:25:32.486 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:32.487 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.487 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.487 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.487 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:32.488 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.488 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.488 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.488 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:25:32.489 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:32.489 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.489 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.489 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.490 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:25:32.490 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:32.490 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.490 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.491 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.491 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:32.491 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.491 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.492 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.492 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:25:32.492 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:32.492 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.492 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.493 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.493 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:25:32.493 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:32.493 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.494 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.494 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.494 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:32.495 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.495 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.495 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.495 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:25:32.496 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:32.496 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.496 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.496 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.497 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:25:32.497 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:32.497 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.497 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.497 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.498 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:25:32.498 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:25:32.498 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:25:32.498 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:25:32.499 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:32.499 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:32.499 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:32.499 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.500 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.500 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.500 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:25:32.500 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:25:32.500 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:32.501 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:32.501 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:32.501 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:32.501 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:32.502 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:32.502 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:32.502 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 78, 2021-12-17T18:25:32.502 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:32.503 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:32.503 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:32.503 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.503 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.504 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.504 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:25:32.504 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:32.504 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.505 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.505 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.505 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:25:32.505 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:32.506 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.506 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.506 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.506 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:32.507 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.507 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.507 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.507 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:25:32.507 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:32.508 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.508 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.508 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.508 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:25:32.509 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:32.509 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.509 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.509 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.510 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:32.510 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.510 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.510 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.511 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:25:32.511 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:32.511 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.511 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.512 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.512 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:25:32.512 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:32.512 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.513 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.513 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.513 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:32.513 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.514 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.514 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.514 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:25:32.514 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:32.515 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.515 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.515 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.515 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:25:32.516 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:32.516 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.516 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.516 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.517 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:25:32.517 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:25:32.517 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:25:32.517 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:25:32.517 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:32.518 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:32.518 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:32.518 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.518 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.519 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.519 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:25:32.519 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:25:32.519 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:32.520 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:32.520 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:32.520 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:32.520 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:32.521 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:32.521 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:32.521 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 79, 2021-12-17T18:25:32.521 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:32.522 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:32.522 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:32.522 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.522 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.523 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.523 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:25:32.523 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:32.524 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.524 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.524 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.524 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:25:32.525 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:32.525 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.525 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.526 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.526 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:32.526 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.526 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.527 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.527 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:25:32.527 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:32.528 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.528 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.528 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.528 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:25:32.529 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:32.529 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.529 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.529 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.529 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:32.530 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.530 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.530 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.530 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:25:32.531 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:32.531 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.531 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.531 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.532 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:25:32.532 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:32.532 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.532 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.533 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.533 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:32.533 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.533 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.533 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.534 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:25:32.534 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:32.534 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.534 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.535 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.535 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:25:32.535 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:32.535 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.536 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.536 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.536 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:25:32.536 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:25:32.537 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:25:32.537 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:25:32.537 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:32.537 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:32.538 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:32.538 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.538 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.538 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.539 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:25:32.539 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:25:32.539 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:32.539 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:32.540 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:32.540 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:32.540 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:32.540 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:32.540 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:32.541 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 79, 2021-12-17T18:25:32.541 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:32.541 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:32.541 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:32.542 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.542 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.542 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.542 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:25:32.543 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:32.543 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.543 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.543 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.544 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:25:32.544 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:32.544 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.544 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.544 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.545 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:32.545 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.545 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.546 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:25:32.546 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:32.546 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.546 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.547 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.547 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:25:32.547 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:32.547 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.548 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.548 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.548 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:32.548 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.548 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.549 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.549 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:25:32.549 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:32.549 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.550 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.550 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.550 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:25:32.550 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:32.551 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.551 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.551 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.551 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:32.552 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.552 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.552 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.552 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:25:32.552 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:32.553 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.553 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.553 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.553 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:25:32.554 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:32.554 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.554 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.554 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.555 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:25:32.555 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:25:32.555 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:25:32.555 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:25:32.556 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:32.556 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:32.556 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:32.556 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.557 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.557 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.557 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:25:32.557 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:25:32.558 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:32.558 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:32.558 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:32.559 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:32.559 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:32.559 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:32.559 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:32.559 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 79, 2021-12-17T18:25:32.560 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:32.560 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:32.560 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:32.560 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.561 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.561 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.561 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:25:32.561 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:32.562 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.562 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.562 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.562 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:25:32.563 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:32.563 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.563 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.563 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.564 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:32.564 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.564 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.564 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.564 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:25:32.565 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:32.565 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.565 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.566 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:25:32.566 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:32.566 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.566 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.567 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.567 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:32.567 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.567 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.568 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.568 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:25:32.568 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:32.568 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.569 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.569 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.569 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:25:32.569 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:32.570 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.570 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.570 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.570 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:32.571 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.571 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.571 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.571 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:25:32.572 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:32.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.572 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.572 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.573 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:25:32.573 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:32.573 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.573 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.573 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.574 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:25:32.574 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:25:32.574 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:25:32.574 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:25:32.575 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:32.575 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:32.575 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:32.575 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.575 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.576 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.576 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:25:32.576 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:25:32.577 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:32.577 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:32.577 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:32.577 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:32.577 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:32.578 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:32.578 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:32.578 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 79, 2021-12-17T18:25:32.578 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:32.579 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:32.579 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:32.579 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.579 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.580 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.580 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:25:32.580 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:32.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.581 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.581 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.581 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:25:32.581 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:32.581 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.582 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.582 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.582 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:32.582 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.583 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.583 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.583 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:25:32.583 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:32.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.584 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.584 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.584 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:25:32.585 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:32.585 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.585 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.586 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:32.586 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.586 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.586 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.587 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:25:32.587 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:32.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.587 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.588 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.588 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:25:32.588 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:32.588 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.589 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.589 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:32.589 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.589 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.590 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.590 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:25:32.590 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:32.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.591 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.591 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.591 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:25:32.591 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:32.592 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.592 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.592 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.592 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:25:32.593 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:25:32.593 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:25:32.593 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:25:32.593 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:32.594 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:32.594 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:32.594 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.595 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.595 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:25:32.595 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:25:32.595 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:32.596 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:32.596 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:32.596 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:32.596 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:32.597 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:32.597 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:32.597 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 79, 2021-12-17T18:25:32.597 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:32.598 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:32.598 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:32.598 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.598 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.599 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.599 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:25:32.599 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:32.599 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.599 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.600 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.600 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:25:32.600 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:32.600 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.601 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.601 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.601 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:32.601 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.602 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.602 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.602 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:25:32.602 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:32.603 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.603 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.603 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.603 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:25:32.603 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:32.604 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.604 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.604 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.604 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:32.605 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.605 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.605 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.605 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:25:32.605 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:32.606 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.606 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.606 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.606 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:25:32.607 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:32.607 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.607 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.607 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.608 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:32.608 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.608 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.608 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.609 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:25:32.609 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:32.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.609 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.610 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:25:32.610 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:32.610 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.610 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.611 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:25:32.611 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:25:32.611 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:25:32.612 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:25:32.612 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:32.612 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:32.612 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:32.612 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.613 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.613 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.613 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:25:32.613 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:25:32.614 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:32.614 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:32.614 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:32.614 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:32.614 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:32.615 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:32.615 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:32.615 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 69, 2021-12-17T18:25:32.615 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:32.616 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:32.616 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:32.616 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.616 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.617 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:25:32.617 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:32.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.618 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.618 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:25:32.618 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:32.618 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.619 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.619 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.619 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:32.619 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.619 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.620 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.620 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:25:32.620 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:32.620 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.621 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.621 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.621 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:25:32.622 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:32.622 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.622 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.622 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.623 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:32.623 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.623 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.623 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.624 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:25:32.624 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:32.624 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.624 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.625 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.625 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:25:32.625 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:32.625 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.626 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.626 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.626 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:32.626 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:32.626 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.627 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:32.627 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:25:32.627 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:32.627 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.628 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.628 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:32.628 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:25:32.628 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:32.629 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.629 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.629 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.629 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:25:32.630 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:25:32.630 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:25:32.630 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:25:32.630 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:32.631 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:32.631 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:32.631 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:32.631 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.632 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:32.632 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:25:32.632 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.632 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:25:32.633 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:32.633 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:32.633 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:32.633 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:32.633 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:32.634 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:25:32.634 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:32.634 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.634 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.635 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:25:32.635 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:32.635 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:32.635 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:32.636 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:32.636 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:32.636 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:25:32.636 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:32.637 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.637 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.637 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:25:32.637 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:32.637 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:32.638 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:32.638 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:32.638 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:32.639 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:25:32.639 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:32.639 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.639 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.640 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:25:32.640 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:32.640 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:32.640 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:32.641 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:32.641 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:32.641 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:25:32.641 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:32.642 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.642 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.642 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:25:32.642 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:32.643 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:32.643 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:32.643 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:32.643 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:32.644 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:25:32.644 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:32.644 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.645 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.645 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:25:32.645 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:32.645 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:32.646 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:32.646 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:32.646 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:32.646 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:25:32.647 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:32.647 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.647 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.647 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:25:32.647 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:32.648 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:32.648 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:32.648 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:32.648 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:32.649 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:25:32.649 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:32.649 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.649 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:32.650 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:25:32.650 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:32.650 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:32.650 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:32.651 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:32.651 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:32.651 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:25:32.651 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:32.652 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.652 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:32.652 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:25:32.652 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:25:32.653 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:25:32.653 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:25:32.653 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": {}, 2021-12-17T18:25:32.653 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:25:32.654 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:25:32.654 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:25:32.654 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:25:32.654 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:25:32.655 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:25:32.655 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:25:32.655 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:25:32.655 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:32.656 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:32.656 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:25:32.656 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:25:32.656 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:25:32.656 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:25:32.657 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:25:32.657 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:25:32.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.400+0000 7f7ba87d7700 1 -- 172.21.15.62:0/916773374 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b84053610 msgr2=0x7f7b84055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:32.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.400+0000 7f7ba87d7700 1 --2- 172.21.15.62:0/916773374 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b84053610 0x7f7b84055ad0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f7b8800b000 tx=0x7f7b88006df0).stop 2021-12-17T18:25:32.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.400+0000 7f7ba87d7700 1 -- 172.21.15.62:0/916773374 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7ba00b21f0 msgr2=0x7f7ba014d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:32.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.400+0000 7f7ba87d7700 1 --2- 172.21.15.62:0/916773374 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7ba00b21f0 0x7f7ba014d620 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f7ba0061080 tx=0x7f7b98007b00).stop 2021-12-17T18:25:32.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.400+0000 7f7ba87d7700 1 -- 172.21.15.62:0/916773374 shutdown_connections 2021-12-17T18:25:32.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.400+0000 7f7ba87d7700 1 --2- 172.21.15.62:0/916773374 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b84053610 0x7f7b84055ad0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.400+0000 7f7ba87d7700 1 --2- 172.21.15.62:0/916773374 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7ba00b21f0 0x7f7ba014d620 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.400+0000 7f7ba87d7700 1 --2- 172.21.15.62:0/916773374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ba00b1730 0x7f7ba01579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.400+0000 7f7ba87d7700 1 --2- 172.21.15.62:0/916773374 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7ba00a7bb0 0x7f7ba00aab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:32.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.400+0000 7f7ba87d7700 1 -- 172.21.15.62:0/916773374 >> 172.21.15.62:0/916773374 conn(0x7f7ba005f730 msgr2=0x7f7ba00afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.400+0000 7f7ba87d7700 1 -- 172.21.15.62:0/916773374 shutdown_connections 2021-12-17T18:25:32.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.400+0000 7f7ba87d7700 1 -- 172.21.15.62:0/916773374 wait complete. 2021-12-17T18:25:32.663 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:32.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.768+0000 7fb3e2fc5700 1 Processor -- start 2021-12-17T18:25:32.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.768+0000 7fb3e2fc5700 1 -- start start 2021-12-17T18:25:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e2fc5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3dc0b5b20 0x7fb3dc0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e2fc5700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc0b5f00 con 0x7fb3dc1458d0 2021-12-17T18:25:32.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e2fc5700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc0b3020 con 0x7fb3dc0b3760 2021-12-17T18:25:32.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e2fc5700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0b32c0 con 0x7fb3dc0b5b20 2021-12-17T18:25:32.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e27c4700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb3dc1458d0 0x7fb3dc145d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36834/0 (socket says 172.21.15.62:36834) 2021-12-17T18:25:32.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e27c4700 1 -- 172.21.15.62:0/28209514 learned_addr learned my addr 172.21.15.62:0/28209514 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:32.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e1fc3700 1 --2- 172.21.15.62:0/28209514 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3dc0b5b20 0x7fb3dc0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:32.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e0fc1700 1 -- 172.21.15.62:0/28209514 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352783574 0 0) 0x7fb3dc0b5f00 con 0x7fb3dc1458d0 2021-12-17T18:25:32.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e0fc1700 1 -- 172.21.15.62:0/28209514 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3c4003260 con 0x7fb3dc1458d0 2021-12-17T18:25:32.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e0fc1700 1 -- 172.21.15.62:0/28209514 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550223466 0 0) 0x7fb3dc0b3020 con 0x7fb3dc0b3760 2021-12-17T18:25:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e0fc1700 1 -- 172.21.15.62:0/28209514 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3dc0b5f00 con 0x7fb3dc0b3760 2021-12-17T18:25:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e1fc3700 1 -- 172.21.15.62:0/28209514 >> v1:172.21.15.109:6789/0 conn(0x7fb3dc0b3760 legacy=0x7fb3dc0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e1fc3700 1 -- 172.21.15.62:0/28209514 >> v1:172.21.15.62:6789/0 conn(0x7fb3dc1458d0 legacy=0x7fb3dc145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e1fc3700 1 -- 172.21.15.62:0/28209514 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc0b6e90 con 0x7fb3dc0b5b20 2021-12-17T18:25:32.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e1fc3700 1 --2- 172.21.15.62:0/28209514 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3dc0b5b20 0x7fb3dc0b6290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fb3cc002f70 tx=0x7fb3cc006df0).ready entity=mon.2 client_cookie=498ccd654fcf603c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:32.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e0fc1700 1 -- 172.21.15.62:0/28209514 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3cc00d5c0 con 0x7fb3dc0b5b20 2021-12-17T18:25:32.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e0fc1700 1 -- 172.21.15.62:0/28209514 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc000e90 con 0x7fb3dc0b5b20 2021-12-17T18:25:32.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e0fc1700 1 -- 172.21.15.62:0/28209514 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3cc00d910 con 0x7fb3dc0b5b20 2021-12-17T18:25:32.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e2fc5700 1 -- 172.21.15.62:0/28209514 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3dc0b5b20 msgr2=0x7fb3dc0b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:32.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e2fc5700 1 --2- 172.21.15.62:0/28209514 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3dc0b5b20 0x7fb3dc0b6290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fb3cc002f70 tx=0x7fb3cc006df0).stop 2021-12-17T18:25:32.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e2fc5700 1 -- 172.21.15.62:0/28209514 shutdown_connections 2021-12-17T18:25:32.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e2fc5700 1 --2- 172.21.15.62:0/28209514 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3dc0b5b20 0x7fb3dc0b6290 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:32.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e2fc5700 1 -- 172.21.15.62:0/28209514 >> 172.21.15.62:0/28209514 conn(0x7fb3dc05c750 msgr2=0x7fb3dc05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:32.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e2fc5700 1 -- 172.21.15.62:0/28209514 shutdown_connections 2021-12-17T18:25:32.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.772+0000 7fb3e2fc5700 1 -- 172.21.15.62:0/28209514 wait complete. 2021-12-17T18:25:32.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e2fc5700 1 Processor -- start 2021-12-17T18:25:32.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e2fc5700 1 -- start start 2021-12-17T18:25:32.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e2fc5700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3dc0b5b20 0x7fb3dc0b9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:32.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e2fc5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3dc1458d0 0x7fb3dc155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:32.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e2fc5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3dc066440 0x7fb3dc0a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:32.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e2fc5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc1569c0 con 0x7fb3dc1458d0 2021-12-17T18:25:32.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e2fc5700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc155f90 con 0x7fb3dc0b5b20 2021-12-17T18:25:32.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e2fc5700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0a42a0 con 0x7fb3dc066440 2021-12-17T18:25:32.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e17c2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3dc1458d0 0x7fb3dc155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:32.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e17c2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3dc1458d0 0x7fb3dc155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53258/0 (socket says 172.21.15.62:53258) 2021-12-17T18:25:32.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e17c2700 1 -- 172.21.15.62:0/3014475755 learned_addr learned my addr 172.21.15.62:0/3014475755 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:32.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e1fc3700 1 --2- 172.21.15.62:0/3014475755 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3dc0b5b20 0x7fb3dc0b9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:32.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e27c4700 1 --2- 172.21.15.62:0/3014475755 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3dc066440 0x7fb3dc0a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:32.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e17c2700 1 -- 172.21.15.62:0/3014475755 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3dc066440 msgr2=0x7fb3dc0a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:32.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e17c2700 1 --2- 172.21.15.62:0/3014475755 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3dc066440 0x7fb3dc0a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:32.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e17c2700 1 -- 172.21.15.62:0/3014475755 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3dc0b5b20 msgr2=0x7fb3dc0b9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:32.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e17c2700 1 --2- 172.21.15.62:0/3014475755 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3dc0b5b20 0x7fb3dc0b9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e17c2700 1 -- 172.21.15.62:0/3014475755 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc00b180 con 0x7fb3dc1458d0 2021-12-17T18:25:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e1fc3700 1 --2- 172.21.15.62:0/3014475755 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3dc0b5b20 0x7fb3dc0b9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e17c2700 1 --2- 172.21.15.62:0/3014475755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3dc1458d0 0x7fb3dc155aa0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7fb3dc156b00 tx=0x7fb3d8007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3caffd700 1 -- 172.21.15.62:0/3014475755 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d800ce70 con 0x7fb3dc1458d0 2021-12-17T18:25:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3caffd700 1 -- 172.21.15.62:0/3014475755 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d8012400 con 0x7fb3dc1458d0 2021-12-17T18:25:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3caffd700 1 -- 172.21.15.62:0/3014475755 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d8012760 con 0x7fb3dc1458d0 2021-12-17T18:25:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e2fc5700 1 -- 172.21.15.62:0/3014475755 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc065740 con 0x7fb3dc1458d0 2021-12-17T18:25:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.776+0000 7fb3e2fc5700 1 -- 172.21.15.62:0/3014475755 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc0672c0 con 0x7fb3dc1458d0 2021-12-17T18:25:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.780+0000 7fb3e2fc5700 1 -- 172.21.15.62:0/3014475755 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc0573d0 con 0x7fb3dc1458d0 2021-12-17T18:25:32.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.780+0000 7fb3caffd700 1 -- 172.21.15.62:0/3014475755 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb3d8019030 con 0x7fb3dc1458d0 2021-12-17T18:25:32.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.780+0000 7fb3caffd700 1 --2- 172.21.15.62:0/3014475755 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb3bc053580 0x7fb3bc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:32.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.780+0000 7fb3caffd700 1 -- 172.21.15.62:0/3014475755 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb3d806ab90 con 0x7fb3dc1458d0 2021-12-17T18:25:32.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.780+0000 7fb3e1fc3700 1 --2- 172.21.15.62:0/3014475755 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb3bc053580 0x7fb3bc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:32.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.780+0000 7fb3e1fc3700 1 --2- 172.21.15.62:0/3014475755 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb3bc053580 0x7fb3bc055a40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fb3cc018000 tx=0x7fb3cc014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:32.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.788+0000 7fb3caffd700 1 -- 172.21.15.62:0/3014475755 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb3d8041cf0 con 0x7fb3dc1458d0 2021-12-17T18:25:32.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.956+0000 7fb3e2fc5700 1 -- 172.21.15.62:0/3014475755 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3dc05cb30 con 0x7fb3dc1458d0 2021-12-17T18:25:32.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.956+0000 7fb3caffd700 1 -- 172.21.15.62:0/3014475755 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+2143 (secure 0 0 0) 0x7fb3d8045310 con 0x7fb3dc1458d0 2021-12-17T18:25:32.962 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:32.962 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":37,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3760020760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3760020760},{"type":"v1","addr":"172.21.15.109:6835","nonce":3760020760}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:25:20.884652+0000","modified":"2021-12-17T18:25:21.888425+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1765551619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1765551619},{"type":"v1","addr":"172.21.15.62:6833","nonce":1765551619}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-12-17T18:25:32.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.956+0000 7fb3e2fc5700 1 -- 172.21.15.62:0/3014475755 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb3bc053580 msgr2=0x7fb3bc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:32.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.956+0000 7fb3e2fc5700 1 --2- 172.21.15.62:0/3014475755 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb3bc053580 0x7fb3bc055a40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fb3cc018000 tx=0x7fb3cc014000).stop 2021-12-17T18:25:32.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.956+0000 7fb3e2fc5700 1 -- 172.21.15.62:0/3014475755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3dc1458d0 msgr2=0x7fb3dc155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:32.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.956+0000 7fb3e2fc5700 1 --2- 172.21.15.62:0/3014475755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3dc1458d0 0x7fb3dc155aa0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7fb3dc156b00 tx=0x7fb3d8007a90).stop 2021-12-17T18:25:32.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.956+0000 7fb3e2fc5700 1 -- 172.21.15.62:0/3014475755 shutdown_connections 2021-12-17T18:25:32.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.956+0000 7fb3e2fc5700 1 --2- 172.21.15.62:0/3014475755 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb3bc053580 0x7fb3bc055a40 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:32.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.956+0000 7fb3e2fc5700 1 --2- 172.21.15.62:0/3014475755 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3dc066440 0x7fb3dc0a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:32.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.956+0000 7fb3e2fc5700 1 --2- 172.21.15.62:0/3014475755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3dc1458d0 0x7fb3dc155aa0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:32.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.956+0000 7fb3e2fc5700 1 --2- 172.21.15.62:0/3014475755 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3dc0b5b20 0x7fb3dc0b9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:32.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.956+0000 7fb3e2fc5700 1 -- 172.21.15.62:0/3014475755 >> 172.21.15.62:0/3014475755 conn(0x7fb3dc05c750 msgr2=0x7fb3dc05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:32.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.956+0000 7fb3e2fc5700 1 -- 172.21.15.62:0/3014475755 shutdown_connections 2021-12-17T18:25:32.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:32.956+0000 7fb3e2fc5700 1 -- 172.21.15.62:0/3014475755 wait complete. 2021-12-17T18:25:32.967 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 37 2021-12-17T18:25:32.975 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-12-17T18:25:33.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.076+0000 7fd6c7629700 1 Processor -- start 2021-12-17T18:25:33.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.076+0000 7fd6c7629700 1 -- start start 2021-12-17T18:25:33.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.076+0000 7fd6c7629700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6c00a7bb0 0x7fd6c0067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:33.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.076+0000 7fd6c7629700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c00b2ce0 con 0x7fd6c00b1730 2021-12-17T18:25:33.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.076+0000 7fd6c7629700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c00aca60 con 0x7fd6c00b21f0 2021-12-17T18:25:33.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.076+0000 7fd6c7629700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c014b5b0 con 0x7fd6c00a7bb0 2021-12-17T18:25:33.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.076+0000 7fd6c4bc4700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd6c00b1730 0x7fd6c00ace90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36844/0 (socket says 172.21.15.62:36844) 2021-12-17T18:25:33.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.076+0000 7fd6c4bc4700 1 -- 172.21.15.62:0/163817822 learned_addr learned my addr 172.21.15.62:0/163817822 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:33.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c5bc6700 1 --2- 172.21.15.62:0/163817822 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6c00a7bb0 0x7fd6c0067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:33.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 -- 172.21.15.62:0/163817822 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732412045 0 0) 0x7fd6c00b2ce0 con 0x7fd6c00b1730 2021-12-17T18:25:33.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 -- 172.21.15.62:0/163817822 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6a4003260 con 0x7fd6c00b1730 2021-12-17T18:25:33.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 -- 172.21.15.62:0/163817822 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 274378176 0 0) 0x7fd6a4003260 con 0x7fd6c00b1730 2021-12-17T18:25:33.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 -- 172.21.15.62:0/163817822 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6c00a7bb0 msgr2=0x7fd6c0067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:33.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 --2- 172.21.15.62:0/163817822 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6c00a7bb0 0x7fd6c0067120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:33.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 -- 172.21.15.62:0/163817822 >> v1:172.21.15.109:6789/0 conn(0x7fd6c00b21f0 legacy=0x7fd6c014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:33.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 -- 172.21.15.62:0/163817822 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c00b2f10 con 0x7fd6c00b1730 2021-12-17T18:25:33.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 -- 172.21.15.62:0/163817822 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fd6bc001660 con 0x7fd6c00b1730 2021-12-17T18:25:33.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 -- 172.21.15.62:0/163817822 >> v1:172.21.15.62:6789/0 conn(0x7fd6c00b1730 legacy=0x7fd6c00ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:33.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 --2- 172.21.15.62:0/163817822 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6a4003780 0x7fd6a4003b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:33.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 --2- 172.21.15.62:0/163817822 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6a4004090 0x7fd6a4004560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:33.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 --2- 172.21.15.62:0/163817822 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6a4004d10 0x7fd6a400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:33.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 -- 172.21.15.62:0/163817822 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c014b5b0 con 0x7fd6a4004090 2021-12-17T18:25:33.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 -- 172.21.15.62:0/163817822 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a400bc40 con 0x7fd6a4004d10 2021-12-17T18:25:33.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 -- 172.21.15.62:0/163817822 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a400bd80 con 0x7fd6a4003780 2021-12-17T18:25:33.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c5bc6700 1 --2- 172.21.15.62:0/163817822 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6c00a7bb0 0x7fd6c0067120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:33.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c4bc4700 1 --2- 172.21.15.62:0/163817822 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6a4004090 0x7fd6a4004560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:33.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c53c5700 1 --2- 172.21.15.62:0/163817822 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6a4003780 0x7fd6a4003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:33.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c5bc6700 1 --2- 172.21.15.62:0/163817822 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6a4004d10 0x7fd6a400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:33.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c4bc4700 1 -- 172.21.15.62:0/163817822 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6a4003780 msgr2=0x7fd6a4003b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:33.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c4bc4700 1 --2- 172.21.15.62:0/163817822 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6a4003780 0x7fd6a4003b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:33.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c4bc4700 1 -- 172.21.15.62:0/163817822 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6a4004d10 msgr2=0x7fd6a400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:33.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c4bc4700 1 --2- 172.21.15.62:0/163817822 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6a4004d10 0x7fd6a400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:33.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c4bc4700 1 -- 172.21.15.62:0/163817822 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a4003260 con 0x7fd6a4004090 2021-12-17T18:25:33.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c4bc4700 1 --2- 172.21.15.62:0/163817822 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6a4004090 0x7fd6a4004560 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7fd6bc001370 tx=0x7fd6c00b31b0).ready entity=mon.0 client_cookie=8ba791069da89a2c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:33.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 -- 172.21.15.62:0/163817822 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6bc0071a0 con 0x7fd6a4004090 2021-12-17T18:25:33.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 -- 172.21.15.62:0/163817822 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc007300 con 0x7fd6a4004090 2021-12-17T18:25:33.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6b7fff700 1 -- 172.21.15.62:0/163817822 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6bc00cae0 con 0x7fd6a4004090 2021-12-17T18:25:33.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c7629700 1 -- 172.21.15.62:0/163817822 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6a4004090 msgr2=0x7fd6a4004560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:33.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c7629700 1 --2- 172.21.15.62:0/163817822 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6a4004090 0x7fd6a4004560 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7fd6bc001370 tx=0x7fd6c00b31b0).stop 2021-12-17T18:25:33.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c5bc6700 1 -- 172.21.15.62:0/163817822 reap_dead start 2021-12-17T18:25:33.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c7629700 1 -- 172.21.15.62:0/163817822 shutdown_connections 2021-12-17T18:25:33.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c7629700 1 -- 172.21.15.62:0/163817822 >> 172.21.15.62:0/163817822 conn(0x7fd6c005f730 msgr2=0x7fd6c005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:33.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c7629700 1 -- 172.21.15.62:0/163817822 shutdown_connections 2021-12-17T18:25:33.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.080+0000 7fd6c7629700 1 -- 172.21.15.62:0/163817822 wait complete. 2021-12-17T18:25:33.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c7629700 1 Processor -- start 2021-12-17T18:25:33.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c7629700 1 -- start start 2021-12-17T18:25:33.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c7629700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6a4004090 0x7fd6c014da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:33.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c7629700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6c014c280 0x7fd6c01468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:33.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c7629700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6c0146de0 0x7fd6c0156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:33.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c7629700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c014d200 con 0x7fd6c0146de0 2021-12-17T18:25:33.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c7629700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c014df60 con 0x7fd6c014c280 2021-12-17T18:25:33.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c7629700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c014e1a0 con 0x7fd6a4004090 2021-12-17T18:25:33.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c5bc6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6c0146de0 0x7fd6c0156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:33.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c5bc6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6c0146de0 0x7fd6c0156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53280/0 (socket says 172.21.15.62:53280) 2021-12-17T18:25:33.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c5bc6700 1 -- 172.21.15.62:0/2444150153 learned_addr learned my addr 172.21.15.62:0/2444150153 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:33.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c4bc4700 1 --2- 172.21.15.62:0/2444150153 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6c014c280 0x7fd6c01468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:33.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c53c5700 1 --2- 172.21.15.62:0/2444150153 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6a4004090 0x7fd6c014da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:33.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c5bc6700 1 -- 172.21.15.62:0/2444150153 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6a4004090 msgr2=0x7fd6c014da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:33.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c5bc6700 1 --2- 172.21.15.62:0/2444150153 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6a4004090 0x7fd6c014da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:33.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c5bc6700 1 -- 172.21.15.62:0/2444150153 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6c014c280 msgr2=0x7fd6c01468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:33.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c5bc6700 1 --2- 172.21.15.62:0/2444150153 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6c014c280 0x7fd6c01468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:33.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c5bc6700 1 -- 172.21.15.62:0/2444150153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c014d430 con 0x7fd6c0146de0 2021-12-17T18:25:33.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c4bc4700 1 --2- 172.21.15.62:0/2444150153 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6c014c280 0x7fd6c01468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:33.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c5bc6700 1 --2- 172.21.15.62:0/2444150153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6c0146de0 0x7fd6c0156be0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7fd6b800b000 tx=0x7fd6b80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:33.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6b67fc700 1 -- 172.21.15.62:0/2444150153 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6b801a070 con 0x7fd6c0146de0 2021-12-17T18:25:33.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6b67fc700 1 -- 172.21.15.62:0/2444150153 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b800f980 con 0x7fd6c0146de0 2021-12-17T18:25:33.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c7629700 1 -- 172.21.15.62:0/2444150153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c00ac190 con 0x7fd6c0146de0 2021-12-17T18:25:33.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6b67fc700 1 -- 172.21.15.62:0/2444150153 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6b800fce0 con 0x7fd6c0146de0 2021-12-17T18:25:33.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.084+0000 7fd6c7629700 1 -- 172.21.15.62:0/2444150153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c0147270 con 0x7fd6c0146de0 2021-12-17T18:25:33.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.088+0000 7fd6c7629700 1 -- 172.21.15.62:0/2444150153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c00573d0 con 0x7fd6c0146de0 2021-12-17T18:25:33.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.088+0000 7fd6b67fc700 1 -- 172.21.15.62:0/2444150153 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd6b8014440 con 0x7fd6c0146de0 2021-12-17T18:25:33.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.088+0000 7fd6b67fc700 1 --2- 172.21.15.62:0/2444150153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd6a8053640 0x7fd6a8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:33.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.088+0000 7fd6b67fc700 1 -- 172.21.15.62:0/2444150153 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd6b806c2b0 con 0x7fd6c0146de0 2021-12-17T18:25:33.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.088+0000 7fd6c53c5700 1 --2- 172.21.15.62:0/2444150153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd6a8053640 0x7fd6a8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:33.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.088+0000 7fd6c53c5700 1 --2- 172.21.15.62:0/2444150153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd6a8053640 0x7fd6a8055b00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fd6b0003000 tx=0x7fd6b0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:33.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.092+0000 7fd6b67fc700 1 -- 172.21.15.62:0/2444150153 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd6b80433b0 con 0x7fd6c0146de0 2021-12-17T18:25:33.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.260+0000 7fd6c7629700 1 -- 172.21.15.62:0/2444150153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd6c00af860 con 0x7fd6c0146de0 2021-12-17T18:25:33.742 INFO:tasks.ceph.mon.a.smithi062.stderr:2021-12-17T18:25:33.740+0000 7f8d3b366700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-12-17T18:25:33.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.744+0000 7fd6b67fc700 1 -- 172.21.15.62:0/2444150153 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd6b80469d0 con 0x7fd6c0146de0 2021-12-17T18:25:33.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.748+0000 7fd6c7629700 1 -- 172.21.15.62:0/2444150153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd6a8053640 msgr2=0x7fd6a8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:33.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.748+0000 7fd6c7629700 1 --2- 172.21.15.62:0/2444150153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd6a8053640 0x7fd6a8055b00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fd6b0003000 tx=0x7fd6b0009040).stop 2021-12-17T18:25:33.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.748+0000 7fd6c7629700 1 -- 172.21.15.62:0/2444150153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6c0146de0 msgr2=0x7fd6c0156be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:33.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.748+0000 7fd6c7629700 1 --2- 172.21.15.62:0/2444150153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6c0146de0 0x7fd6c0156be0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7fd6b800b000 tx=0x7fd6b80091d0).stop 2021-12-17T18:25:33.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.748+0000 7fd6c7629700 1 -- 172.21.15.62:0/2444150153 shutdown_connections 2021-12-17T18:25:33.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.748+0000 7fd6c7629700 1 --2- 172.21.15.62:0/2444150153 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd6a8053640 0x7fd6a8055b00 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:33.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.748+0000 7fd6c7629700 1 --2- 172.21.15.62:0/2444150153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6c0146de0 0x7fd6c0156be0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:33.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.748+0000 7fd6c7629700 1 --2- 172.21.15.62:0/2444150153 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6c014c280 0x7fd6c01468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:33.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.748+0000 7fd6c7629700 1 --2- 172.21.15.62:0/2444150153 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6a4004090 0x7fd6c014da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:33.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.748+0000 7fd6c7629700 1 -- 172.21.15.62:0/2444150153 >> 172.21.15.62:0/2444150153 conn(0x7fd6c005f730 msgr2=0x7fd6c014adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:33.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.748+0000 7fd6c7629700 1 -- 172.21.15.62:0/2444150153 shutdown_connections 2021-12-17T18:25:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.748+0000 7fd6c7629700 1 -- 172.21.15.62:0/2444150153 wait complete. 2021-12-17T18:25:33.758 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-12-17T18:25:33.771 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:33.776 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:25:33.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92b324700 1 Processor -- start 2021-12-17T18:25:33.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92b324700 1 -- start start 2021-12-17T18:25:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92b324700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc924141480 0x7fc924147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92b324700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc9240a8e10 0x7fc9240b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92b324700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc9240b6050 0x7fc9240a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92b324700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc924147610 con 0x7fc9240a8e10 2021-12-17T18:25:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92b324700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9241478b0 con 0x7fc924141480 2021-12-17T18:25:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92b324700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc924147b50 con 0x7fc9240b6050 2021-12-17T18:25:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc929b21700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc9240a8e10 0x7fc9240b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc929b21700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc9240a8e10 0x7fc9240b5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53298/0 (socket says 172.21.15.62:53298) 2021-12-17T18:25:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc929b21700 1 -- 172.21.15.62:0/685686617 learned_addr learned my addr 172.21.15.62:0/685686617 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:33.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92a322700 1 --2- 172.21.15.62:0/685686617 >> v2:172.21.15.109:3300/0 conn(0x7fc924141480 0x7fc924147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:33.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92ab23700 1 --2- 172.21.15.62:0/685686617 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc9240b6050 0x7fc9240a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:33.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc929b21700 1 -- 172.21.15.62:0/685686617 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc9240b6050 msgr2=0x7fc9240a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:33.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc929b21700 1 --2- 172.21.15.62:0/685686617 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc9240b6050 0x7fc9240a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:33.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc929b21700 1 -- 172.21.15.62:0/685686617 >> v2:172.21.15.109:3300/0 conn(0x7fc924141480 msgr2=0x7fc924147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:33.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc929b21700 1 --2- 172.21.15.62:0/685686617 >> v2:172.21.15.109:3300/0 conn(0x7fc924141480 0x7fc924147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:33.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc929b21700 1 -- 172.21.15.62:0/685686617 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9240b1b90 con 0x7fc9240a8e10 2021-12-17T18:25:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc929b21700 1 --2- 172.21.15.62:0/685686617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240a8e10 0x7fc9240b5b60 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fc91c0032f0 tx=0x7fc91c009290).ready entity=mon.0 client_cookie=354fbb0c35c43119 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc929320700 1 -- 172.21.15.62:0/685686617 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc91c00b870 con 0x7fc9240a8e10 2021-12-17T18:25:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc929320700 1 -- 172.21.15.62:0/685686617 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c00b9d0 con 0x7fc9240a8e10 2021-12-17T18:25:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc929320700 1 -- 172.21.15.62:0/685686617 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc91c00bb40 con 0x7fc9240a8e10 2021-12-17T18:25:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92b324700 1 -- 172.21.15.62:0/685686617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240a8e10 msgr2=0x7fc9240b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92b324700 1 --2- 172.21.15.62:0/685686617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240a8e10 0x7fc9240b5b60 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fc91c0032f0 tx=0x7fc91c009290).stop 2021-12-17T18:25:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92b324700 1 -- 172.21.15.62:0/685686617 shutdown_connections 2021-12-17T18:25:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92b324700 1 --2- 172.21.15.62:0/685686617 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc9240b6050 0x7fc9240a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92b324700 1 --2- 172.21.15.62:0/685686617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240a8e10 0x7fc9240b5b60 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92b324700 1 --2- 172.21.15.62:0/685686617 >> v2:172.21.15.109:3300/0 conn(0x7fc924141480 0x7fc924147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92b324700 1 -- 172.21.15.62:0/685686617 >> 172.21.15.62:0/685686617 conn(0x7fc92405d220 msgr2=0x7fc9240b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92b324700 1 -- 172.21.15.62:0/685686617 shutdown_connections 2021-12-17T18:25:33.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.864+0000 7fc92b324700 1 -- 172.21.15.62:0/685686617 wait complete. 2021-12-17T18:25:33.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92b324700 1 Processor -- start 2021-12-17T18:25:33.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92b324700 1 -- start start 2021-12-17T18:25:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92b324700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc9240a8e10 0x7fc924146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:33.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92b324700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc9240b6050 0x7fc9241489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92b324700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc924141480 0x7fc92415ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92b324700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92413c680 con 0x7fc924141480 2021-12-17T18:25:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92b324700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92414b8a0 con 0x7fc9240a8e10 2021-12-17T18:25:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92b324700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92415a4e0 con 0x7fc9240b6050 2021-12-17T18:25:33.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92ab23700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc924141480 0x7fc92415ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:33.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc929b21700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc9240b6050 0x7fc9241489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:33.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92ab23700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc924141480 0x7fc92415ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53306/0 (socket says 172.21.15.62:53306) 2021-12-17T18:25:33.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92a322700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc9240a8e10 0x7fc924146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:33.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92ab23700 1 -- 172.21.15.62:0/730655890 learned_addr learned my addr 172.21.15.62:0/730655890 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:33.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92ab23700 1 -- 172.21.15.62:0/730655890 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc9240b6050 msgr2=0x7fc9241489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:33.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92ab23700 1 --2- 172.21.15.62:0/730655890 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc9240b6050 0x7fc9241489d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:33.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92ab23700 1 -- 172.21.15.62:0/730655890 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc9240a8e10 msgr2=0x7fc924146da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:33.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92ab23700 1 --2- 172.21.15.62:0/730655890 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc9240a8e10 0x7fc924146da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:33.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92ab23700 1 -- 172.21.15.62:0/730655890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c009530 con 0x7fc924141480 2021-12-17T18:25:33.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92ab23700 1 --2- 172.21.15.62:0/730655890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc924141480 0x7fc92415ac20 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7fc91400a000 tx=0x7fc914008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:33.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc91b7fe700 1 -- 172.21.15.62:0/730655890 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc914012610 con 0x7fc924141480 2021-12-17T18:25:33.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc91b7fe700 1 -- 172.21.15.62:0/730655890 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc914012770 con 0x7fc924141480 2021-12-17T18:25:33.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92b324700 1 -- 172.21.15.62:0/730655890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92415a780 con 0x7fc924141480 2021-12-17T18:25:33.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc91b7fe700 1 -- 172.21.15.62:0/730655890 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc914012ad0 con 0x7fc924141480 2021-12-17T18:25:33.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.868+0000 7fc92b324700 1 -- 172.21.15.62:0/730655890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9240ae9f0 con 0x7fc924141480 2021-12-17T18:25:33.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.872+0000 7fc91b7fe700 1 -- 172.21.15.62:0/730655890 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc914012c30 con 0x7fc924141480 2021-12-17T18:25:33.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.872+0000 7fc92b324700 1 -- 172.21.15.62:0/730655890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92414b6f0 con 0x7fc924141480 2021-12-17T18:25:33.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.872+0000 7fc91b7fe700 1 --2- 172.21.15.62:0/730655890 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9040536a0 0x7fc904055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:33.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.872+0000 7fc91b7fe700 1 -- 172.21.15.62:0/730655890 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc91406bd80 con 0x7fc924141480 2021-12-17T18:25:33.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.872+0000 7fc92a322700 1 --2- 172.21.15.62:0/730655890 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9040536a0 0x7fc904055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:33.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.872+0000 7fc92a322700 1 --2- 172.21.15.62:0/730655890 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9040536a0 0x7fc904055b60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fc92000c000 tx=0x7fc920008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:33.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:33.876+0000 7fc91b7fe700 1 -- 172.21.15.62:0/730655890 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc914042d20 con 0x7fc924141480 2021-12-17T18:25:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.040+0000 7fc92b324700 1 -- 172.21.15.62:0/730655890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc924141860 con 0x7fc924141480 2021-12-17T18:25:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.044+0000 7fc91b7fe700 1 -- 172.21.15.62:0/730655890 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+1782 (secure 0 0 0) 0x7fc914046340 con 0x7fc924141480 2021-12-17T18:25:34.049 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:34.049 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":38,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3760020760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3760020760},{"type":"v1","addr":"172.21.15.109:6835","nonce":3760020760}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:25:20.884652+0000","modified":"2021-12-17T18:25:33.741289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-12-17T18:25:34.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.044+0000 7fc92b324700 1 -- 172.21.15.62:0/730655890 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9040536a0 msgr2=0x7fc904055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:34.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.044+0000 7fc92b324700 1 --2- 172.21.15.62:0/730655890 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9040536a0 0x7fc904055b60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fc92000c000 tx=0x7fc920008040).stop 2021-12-17T18:25:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.044+0000 7fc92b324700 1 -- 172.21.15.62:0/730655890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc924141480 msgr2=0x7fc92415ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.044+0000 7fc92b324700 1 --2- 172.21.15.62:0/730655890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc924141480 0x7fc92415ac20 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7fc91400a000 tx=0x7fc914008040).stop 2021-12-17T18:25:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.044+0000 7fc92b324700 1 -- 172.21.15.62:0/730655890 shutdown_connections 2021-12-17T18:25:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.044+0000 7fc92b324700 1 --2- 172.21.15.62:0/730655890 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9040536a0 0x7fc904055b60 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.044+0000 7fc92b324700 1 --2- 172.21.15.62:0/730655890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc924141480 0x7fc92415ac20 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.044+0000 7fc92b324700 1 --2- 172.21.15.62:0/730655890 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc9240b6050 0x7fc9241489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.044+0000 7fc92b324700 1 --2- 172.21.15.62:0/730655890 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc9240a8e10 0x7fc924146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.044+0000 7fc92b324700 1 -- 172.21.15.62:0/730655890 >> 172.21.15.62:0/730655890 conn(0x7fc92405d220 msgr2=0x7fc92405ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.044+0000 7fc92b324700 1 -- 172.21.15.62:0/730655890 shutdown_connections 2021-12-17T18:25:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.044+0000 7fc92b324700 1 -- 172.21.15.62:0/730655890 wait complete. 2021-12-17T18:25:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 38 2021-12-17T18:25:34.062 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-12-17T18:25:34.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.208+0000 7f1e3511c700 1 Processor -- start 2021-12-17T18:25:34.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.208+0000 7f1e3511c700 1 -- start start 2021-12-17T18:25:34.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.208+0000 7f1e3511c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e300b21f0 0x7f1e3014aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:34.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.208+0000 7f1e3511c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1e300b1730 0x7f1e300ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.208+0000 7f1e3511c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1e300a7bb0 0x7f1e30067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.208+0000 7f1e3511c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e30147870 con 0x7f1e300b1730 2021-12-17T18:25:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.208+0000 7f1e3511c700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e300b2ce0 con 0x7f1e300a7bb0 2021-12-17T18:25:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.208+0000 7f1e3511c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e300aca60 con 0x7f1e300b21f0 2021-12-17T18:25:34.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e2e59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1e300b1730 0x7f1e300ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:34.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e2e59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1e300b1730 0x7f1e300ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53312/0 (socket says 172.21.15.62:53312) 2021-12-17T18:25:34.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e2e59c700 1 -- 172.21.15.62:0/4084550631 learned_addr learned my addr 172.21.15.62:0/4084550631 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:34.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e2ed9d700 1 --2- 172.21.15.62:0/4084550631 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e300b21f0 0x7f1e3014aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:34.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e2f59e700 1 --2- 172.21.15.62:0/4084550631 >> v2:172.21.15.109:3300/0 conn(0x7f1e300a7bb0 0x7f1e30067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:34.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e2e59c700 1 -- 172.21.15.62:0/4084550631 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e300b21f0 msgr2=0x7f1e3014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:34.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e2e59c700 1 --2- 172.21.15.62:0/4084550631 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e300b21f0 0x7f1e3014aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:34.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e2e59c700 1 -- 172.21.15.62:0/4084550631 >> v2:172.21.15.109:3300/0 conn(0x7f1e300a7bb0 msgr2=0x7f1e30067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:34.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e2e59c700 1 --2- 172.21.15.62:0/4084550631 >> v2:172.21.15.109:3300/0 conn(0x7f1e300a7bb0 0x7f1e30067120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:34.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e2e59c700 1 -- 172.21.15.62:0/4084550631 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e300b2f10 con 0x7f1e300b1730 2021-12-17T18:25:34.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e2e59c700 1 --2- 172.21.15.62:0/4084550631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e300b1730 0x7f1e300ace90 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f1e24002f70 tx=0x7f1e24006eb0).ready entity=mon.0 client_cookie=7b14619e81da19cf server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:34.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e2dd9b700 1 -- 172.21.15.62:0/4084550631 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e2400d570 con 0x7f1e300b1730 2021-12-17T18:25:34.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e2dd9b700 1 -- 172.21.15.62:0/4084550631 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e24000e90 con 0x7f1e300b1730 2021-12-17T18:25:34.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e2dd9b700 1 -- 172.21.15.62:0/4084550631 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e2400d900 con 0x7f1e300b1730 2021-12-17T18:25:34.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e3511c700 1 -- 172.21.15.62:0/4084550631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e300b1730 msgr2=0x7f1e300ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:34.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e3511c700 1 --2- 172.21.15.62:0/4084550631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e300b1730 0x7f1e300ace90 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f1e24002f70 tx=0x7f1e24006eb0).stop 2021-12-17T18:25:34.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e3511c700 1 -- 172.21.15.62:0/4084550631 shutdown_connections 2021-12-17T18:25:34.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e3511c700 1 --2- 172.21.15.62:0/4084550631 >> v2:172.21.15.109:3300/0 conn(0x7f1e300a7bb0 0x7f1e30067120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:34.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e3511c700 1 --2- 172.21.15.62:0/4084550631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e300b1730 0x7f1e300ace90 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:34.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e3511c700 1 --2- 172.21.15.62:0/4084550631 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e300b21f0 0x7f1e3014aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:34.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e3511c700 1 -- 172.21.15.62:0/4084550631 >> 172.21.15.62:0/4084550631 conn(0x7f1e3005f730 msgr2=0x7f1e3005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:34.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e3511c700 1 -- 172.21.15.62:0/4084550631 shutdown_connections 2021-12-17T18:25:34.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e3511c700 1 -- 172.21.15.62:0/4084550631 wait complete. 2021-12-17T18:25:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e3511c700 1 Processor -- start 2021-12-17T18:25:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.212+0000 7f1e3511c700 1 -- start start 2021-12-17T18:25:34.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e3511c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e300a7bb0 0x7f1e3014dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:34.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e3511c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1e300b1730 0x7f1e3015a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:34.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e3511c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e300b21f0 0x7f1e300aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:34.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e3511c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3014eaf0 con 0x7f1e300b21f0 2021-12-17T18:25:34.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e3511c700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3014d940 con 0x7f1e300b1730 2021-12-17T18:25:34.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e3511c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e30157da0 con 0x7f1e300a7bb0 2021-12-17T18:25:34.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e2f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e300b21f0 0x7f1e300aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:34.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e2f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e300b21f0 0x7f1e300aa490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53320/0 (socket says 172.21.15.62:53320) 2021-12-17T18:25:34.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e2f59e700 1 -- 172.21.15.62:0/2726110280 learned_addr learned my addr 172.21.15.62:0/2726110280 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:34.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e2e59c700 1 --2- 172.21.15.62:0/2726110280 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1e300b1730 0x7f1e3015a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:34.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e2ed9d700 1 --2- 172.21.15.62:0/2726110280 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e300a7bb0 0x7f1e3014dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:34.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e2f59e700 1 -- 172.21.15.62:0/2726110280 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e300a7bb0 msgr2=0x7f1e3014dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:34.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e2f59e700 1 --2- 172.21.15.62:0/2726110280 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e300a7bb0 0x7f1e3014dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:34.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e2f59e700 1 -- 172.21.15.62:0/2726110280 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1e300b1730 msgr2=0x7f1e3015a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:34.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e2f59e700 1 --2- 172.21.15.62:0/2726110280 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1e300b1730 0x7f1e3015a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:34.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e2f59e700 1 -- 172.21.15.62:0/2726110280 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2400b1e0 con 0x7f1e300b21f0 2021-12-17T18:25:34.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e2f59e700 1 --2- 172.21.15.62:0/2726110280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e300b21f0 0x7f1e300aa490 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f1e2000c000 tx=0x7f1e20006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e1ffff700 1 -- 172.21.15.62:0/2726110280 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e20011750 con 0x7f1e300b21f0 2021-12-17T18:25:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e1ffff700 1 -- 172.21.15.62:0/2726110280 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e200118b0 con 0x7f1e300b21f0 2021-12-17T18:25:34.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e3511c700 1 -- 172.21.15.62:0/2726110280 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3015acb0 con 0x7f1e300b21f0 2021-12-17T18:25:34.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e3511c700 1 -- 172.21.15.62:0/2726110280 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e300abf50 con 0x7f1e300b21f0 2021-12-17T18:25:34.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e1ffff700 1 -- 172.21.15.62:0/2726110280 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e20011c10 con 0x7f1e300b21f0 2021-12-17T18:25:34.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e3511c700 1 -- 172.21.15.62:0/2726110280 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e300573d0 con 0x7f1e300b21f0 2021-12-17T18:25:34.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.216+0000 7f1e1ffff700 1 -- 172.21.15.62:0/2726110280 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1e20011d70 con 0x7f1e300b21f0 2021-12-17T18:25:34.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.220+0000 7f1e1ffff700 1 --2- 172.21.15.62:0/2726110280 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e0c0536a0 0x7f1e0c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:34.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.220+0000 7f1e1ffff700 1 -- 172.21.15.62:0/2726110280 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1e2006bca0 con 0x7f1e300b21f0 2021-12-17T18:25:34.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.220+0000 7f1e2ed9d700 1 --2- 172.21.15.62:0/2726110280 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e0c0536a0 0x7f1e0c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:34.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.220+0000 7f1e2ed9d700 1 --2- 172.21.15.62:0/2726110280 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e0c0536a0 0x7f1e0c055b60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f1e2800b000 tx=0x7f1e280091d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:34.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.224+0000 7f1e1ffff700 1 -- 172.21.15.62:0/2726110280 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1e20070070 con 0x7f1e300b21f0 2021-12-17T18:25:34.392 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:25:34.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:34.388+0000 7f1e3511c700 1 -- 172.21.15.62:0/2726110280 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1e300af860 con 0x7f1e300b21f0 2021-12-17T18:25:34.396 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:25:34.398 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:25:34.401 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:25:34.403 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:25:35.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.272+0000 7f1e1ffff700 1 -- 172.21.15.62:0/2726110280 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1e20042db0 con 0x7f1e300b21f0 2021-12-17T18:25:35.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.276+0000 7f1e3511c700 1 -- 172.21.15.62:0/2726110280 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e0c0536a0 msgr2=0x7f1e0c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:35.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.276+0000 7f1e3511c700 1 --2- 172.21.15.62:0/2726110280 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e0c0536a0 0x7f1e0c055b60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f1e2800b000 tx=0x7f1e280091d0).stop 2021-12-17T18:25:35.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.276+0000 7f1e3511c700 1 -- 172.21.15.62:0/2726110280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e300b21f0 msgr2=0x7f1e300aa490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:35.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.276+0000 7f1e3511c700 1 --2- 172.21.15.62:0/2726110280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e300b21f0 0x7f1e300aa490 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f1e2000c000 tx=0x7f1e20006df0).stop 2021-12-17T18:25:35.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.276+0000 7f1e3511c700 1 -- 172.21.15.62:0/2726110280 shutdown_connections 2021-12-17T18:25:35.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.276+0000 7f1e3511c700 1 --2- 172.21.15.62:0/2726110280 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e0c0536a0 0x7f1e0c055b60 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:35.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.276+0000 7f1e3511c700 1 --2- 172.21.15.62:0/2726110280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e300b21f0 0x7f1e300aa490 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:35.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.276+0000 7f1e3511c700 1 --2- 172.21.15.62:0/2726110280 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1e300b1730 0x7f1e3015a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:35.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.276+0000 7f1e3511c700 1 --2- 172.21.15.62:0/2726110280 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e300a7bb0 0x7f1e3014dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:35.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.276+0000 7f1e3511c700 1 -- 172.21.15.62:0/2726110280 >> 172.21.15.62:0/2726110280 conn(0x7f1e3005f730 msgr2=0x7f1e300ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:35.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.276+0000 7f1e3511c700 1 -- 172.21.15.62:0/2726110280 shutdown_connections 2021-12-17T18:25:35.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.276+0000 7f1e3511c700 1 -- 172.21.15.62:0/2726110280 wait complete. 2021-12-17T18:25:35.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-12-17T18:25:35.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.412+0000 7fa74f643700 1 Processor -- start 2021-12-17T18:25:35.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.412+0000 7fa74f643700 1 -- start start 2021-12-17T18:25:35.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.412+0000 7fa74f643700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7480b51a0 0x7fa7481471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:35.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.412+0000 7fa74f643700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7480b09e0 con 0x7fa7480b4340 2021-12-17T18:25:35.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.412+0000 7fa74f643700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7481467d0 con 0x7fa748142d70 2021-12-17T18:25:35.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.412+0000 7fa74f643700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa748146a70 con 0x7fa7480b51a0 2021-12-17T18:25:35.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.412+0000 7fa74d3df700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa7480b4340 0x7fa748142660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36904/0 (socket says 172.21.15.62:36904) 2021-12-17T18:25:35.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa74d3df700 1 -- 172.21.15.62:0/1508270438 learned_addr learned my addr 172.21.15.62:0/1508270438 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:35.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa74dbe0700 1 --2- 172.21.15.62:0/1508270438 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7480b51a0 0x7fa7481471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:35.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa73ffff700 1 -- 172.21.15.62:0/1508270438 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967289502 0 0) 0x7fa7480b09e0 con 0x7fa7480b4340 2021-12-17T18:25:35.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa73ffff700 1 -- 172.21.15.62:0/1508270438 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa72c003260 con 0x7fa7480b4340 2021-12-17T18:25:35.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa73ffff700 1 -- 172.21.15.62:0/1508270438 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2098144912 0 0) 0x7fa7481467d0 con 0x7fa748142d70 2021-12-17T18:25:35.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa73ffff700 1 -- 172.21.15.62:0/1508270438 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7480b09e0 con 0x7fa748142d70 2021-12-17T18:25:35.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa74dbe0700 1 -- 172.21.15.62:0/1508270438 >> v1:172.21.15.109:6789/0 conn(0x7fa748142d70 legacy=0x7fa7480b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:35.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa74dbe0700 1 -- 172.21.15.62:0/1508270438 >> v1:172.21.15.62:6789/0 conn(0x7fa7480b4340 legacy=0x7fa748142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:35.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa74dbe0700 1 -- 172.21.15.62:0/1508270438 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa748146d10 con 0x7fa7480b51a0 2021-12-17T18:25:35.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa74dbe0700 1 --2- 172.21.15.62:0/1508270438 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7480b51a0 0x7fa7481471b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa7400032f0 tx=0x7fa7400091d0).ready entity=mon.2 client_cookie=f9c497cb4c84d5a9 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa73ffff700 1 -- 172.21.15.62:0/1508270438 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa74000b640 con 0x7fa7480b51a0 2021-12-17T18:25:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa73ffff700 1 -- 172.21.15.62:0/1508270438 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74000b7a0 con 0x7fa7480b51a0 2021-12-17T18:25:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa73ffff700 1 -- 172.21.15.62:0/1508270438 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa74000b910 con 0x7fa7480b51a0 2021-12-17T18:25:35.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa74f643700 1 -- 172.21.15.62:0/1508270438 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7480b51a0 msgr2=0x7fa7481471b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:35.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa74f643700 1 --2- 172.21.15.62:0/1508270438 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7480b51a0 0x7fa7481471b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa7400032f0 tx=0x7fa7400091d0).stop 2021-12-17T18:25:35.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa74f643700 1 -- 172.21.15.62:0/1508270438 shutdown_connections 2021-12-17T18:25:35.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa74f643700 1 --2- 172.21.15.62:0/1508270438 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7480b51a0 0x7fa7481471b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:35.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa74f643700 1 -- 172.21.15.62:0/1508270438 >> 172.21.15.62:0/1508270438 conn(0x7fa74805c750 msgr2=0x7fa74805cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:35.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa74f643700 1 -- 172.21.15.62:0/1508270438 shutdown_connections 2021-12-17T18:25:35.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.416+0000 7fa74f643700 1 -- 172.21.15.62:0/1508270438 wait complete. 2021-12-17T18:25:35.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74f643700 1 Processor -- start 2021-12-17T18:25:35.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74f643700 1 -- start start 2021-12-17T18:25:35.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74f643700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa7480b4340 0x7fa748144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:35.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74f643700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7480b51a0 0x7fa74813c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:35.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74f643700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa748142d70 0x7fa74813c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:35.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74f643700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7480b86a0 con 0x7fa748142d70 2021-12-17T18:25:35.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74f643700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7480b76d0 con 0x7fa7480b4340 2021-12-17T18:25:35.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74f643700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7480b7930 con 0x7fa7480b51a0 2021-12-17T18:25:35.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74dbe0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa748142d70 0x7fa74813c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:35.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74dbe0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa748142d70 0x7fa74813c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53334/0 (socket says 172.21.15.62:53334) 2021-12-17T18:25:35.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74cbde700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7480b51a0 0x7fa74813c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74dbe0700 1 -- 172.21.15.62:0/2568455058 learned_addr learned my addr 172.21.15.62:0/2568455058 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74d3df700 1 --2- 172.21.15.62:0/2568455058 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa7480b4340 0x7fa748144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74dbe0700 1 -- 172.21.15.62:0/2568455058 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7480b51a0 msgr2=0x7fa74813c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74dbe0700 1 --2- 172.21.15.62:0/2568455058 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7480b51a0 0x7fa74813c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:35.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74dbe0700 1 -- 172.21.15.62:0/2568455058 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa7480b4340 msgr2=0x7fa748144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:35.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74dbe0700 1 --2- 172.21.15.62:0/2568455058 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa7480b4340 0x7fa748144890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:35.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74dbe0700 1 -- 172.21.15.62:0/2568455058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa740009470 con 0x7fa748142d70 2021-12-17T18:25:35.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74cbde700 1 --2- 172.21.15.62:0/2568455058 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7480b51a0 0x7fa74813c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74dbe0700 1 --2- 172.21.15.62:0/2568455058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa748142d70 0x7fa74813c590 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fa7400032f0 tx=0x7fa740016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa73e7fc700 1 -- 172.21.15.62:0/2568455058 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa74000b910 con 0x7fa748142d70 2021-12-17T18:25:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa73e7fc700 1 -- 172.21.15.62:0/2568455058 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74001f3f0 con 0x7fa748142d70 2021-12-17T18:25:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74f643700 1 -- 172.21.15.62:0/2568455058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74813e940 con 0x7fa748142d70 2021-12-17T18:25:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa73e7fc700 1 -- 172.21.15.62:0/2568455058 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa74000b640 con 0x7fa748142d70 2021-12-17T18:25:35.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.420+0000 7fa74f643700 1 -- 172.21.15.62:0/2568455058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74813ca80 con 0x7fa748142d70 2021-12-17T18:25:35.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.424+0000 7fa74f643700 1 -- 172.21.15.62:0/2568455058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7480b7af0 con 0x7fa748142d70 2021-12-17T18:25:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.424+0000 7fa73e7fc700 1 -- 172.21.15.62:0/2568455058 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa740026030 con 0x7fa748142d70 2021-12-17T18:25:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.424+0000 7fa73e7fc700 1 --2- 172.21.15.62:0/2568455058 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa730053610 0x7fa730055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.424+0000 7fa73e7fc700 1 -- 172.21.15.62:0/2568455058 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa74006c350 con 0x7fa748142d70 2021-12-17T18:25:35.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.424+0000 7fa74d3df700 1 --2- 172.21.15.62:0/2568455058 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa730053610 0x7fa730055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:35.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.424+0000 7fa74d3df700 1 --2- 172.21.15.62:0/2568455058 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa730053610 0x7fa730055ad0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7fa73800d000 tx=0x7fa738009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:35.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.436+0000 7fa73e7fc700 1 -- 172.21.15.62:0/2568455058 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa740043460 con 0x7fa748142d70 2021-12-17T18:25:35.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:35.564+0000 7fa74f643700 1 -- 172.21.15.62:0/2568455058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa7480b4720 con 0x7fa748142d70 2021-12-17T18:25:36.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.284+0000 7fa73e7fc700 1 -- 172.21.15.62:0/2568455058 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) v1 ==== 185+0+0 (secure 0 0 0) 0x7fa7400150e0 con 0x7fa748142d70 2021-12-17T18:25:36.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.288+0000 7fa74f643700 1 -- 172.21.15.62:0/2568455058 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa730053610 msgr2=0x7fa730055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:36.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.288+0000 7fa74f643700 1 --2- 172.21.15.62:0/2568455058 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa730053610 0x7fa730055ad0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7fa73800d000 tx=0x7fa738009040).stop 2021-12-17T18:25:36.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.288+0000 7fa74f643700 1 -- 172.21.15.62:0/2568455058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa748142d70 msgr2=0x7fa74813c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:36.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.288+0000 7fa74f643700 1 --2- 172.21.15.62:0/2568455058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa748142d70 0x7fa74813c590 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fa7400032f0 tx=0x7fa740016000).stop 2021-12-17T18:25:36.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.288+0000 7fa74f643700 1 -- 172.21.15.62:0/2568455058 shutdown_connections 2021-12-17T18:25:36.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.288+0000 7fa74f643700 1 --2- 172.21.15.62:0/2568455058 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa730053610 0x7fa730055ad0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:36.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.288+0000 7fa74f643700 1 --2- 172.21.15.62:0/2568455058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa748142d70 0x7fa74813c590 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:36.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.288+0000 7fa74f643700 1 --2- 172.21.15.62:0/2568455058 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7480b51a0 0x7fa74813c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:36.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.288+0000 7fa74f643700 1 --2- 172.21.15.62:0/2568455058 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa7480b4340 0x7fa748144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:36.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.288+0000 7fa74f643700 1 -- 172.21.15.62:0/2568455058 >> 172.21.15.62:0/2568455058 conn(0x7fa74805c750 msgr2=0x7fa748145b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:36.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.288+0000 7fa74f643700 1 -- 172.21.15.62:0/2568455058 shutdown_connections 2021-12-17T18:25:36.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.288+0000 7fa74f643700 1 -- 172.21.15.62:0/2568455058 wait complete. 2021-12-17T18:25:36.296 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2021-12-17T18:25:36.311 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-12-17T18:25:36.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.424+0000 7f27bf59e700 1 Processor -- start 2021-12-17T18:25:36.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.424+0000 7f27bf59e700 1 -- start start 2021-12-17T18:25:36.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bf59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f27c005ca90 0x7f27c00b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:36.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bf59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27c00b34b0 0x7f27c0145b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:36.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bf59e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c005ce70 con 0x7f27c00604b0 2021-12-17T18:25:36.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bf59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c00b2d70 con 0x7f27c005ca90 2021-12-17T18:25:36.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bf59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c00b3010 con 0x7f27c00b34b0 2021-12-17T18:25:36.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27be59c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f27c005ca90 0x7f27c00b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:36.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bdd9b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27c00b34b0 0x7f27c0145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:36.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bed9d700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f27c00604b0 0x7f27c0146010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:53242/0 (socket says 172.21.15.62:53242) 2021-12-17T18:25:36.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bed9d700 1 -- 172.21.15.62:0/3374078226 learned_addr learned my addr 172.21.15.62:0/3374078226 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bd59a700 1 -- 172.21.15.62:0/3374078226 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198374474 0 0) 0x7f27c005ce70 con 0x7f27c00604b0 2021-12-17T18:25:36.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bd59a700 1 -- 172.21.15.62:0/3374078226 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27a4003260 con 0x7f27c00604b0 2021-12-17T18:25:36.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27be59c700 1 -- 172.21.15.62:0/3374078226 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27c00b34b0 msgr2=0x7f27c0145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:36.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27be59c700 1 --2- 172.21.15.62:0/3374078226 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27c00b34b0 0x7f27c0145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:36.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27be59c700 1 -- 172.21.15.62:0/3374078226 >> v1:172.21.15.109:6789/0 conn(0x7f27c00604b0 legacy=0x7f27c0146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:36.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27be59c700 1 -- 172.21.15.62:0/3374078226 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c00b2ab0 con 0x7f27c005ca90 2021-12-17T18:25:36.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bdd9b700 1 --2- 172.21.15.62:0/3374078226 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27c00b34b0 0x7f27c0145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:36.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27be59c700 1 --2- 172.21.15.62:0/3374078226 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27c005ca90 0x7f27c00b2470 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f27b4002f70 tx=0x7f27b4006df0).ready entity=mon.1 client_cookie=a6cfab0bfc914dc4 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:36.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bd59a700 1 -- 172.21.15.62:0/3374078226 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27b400d4a0 con 0x7f27c005ca90 2021-12-17T18:25:36.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bd59a700 1 -- 172.21.15.62:0/3374078226 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b4000e90 con 0x7f27c005ca90 2021-12-17T18:25:36.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bd59a700 1 -- 172.21.15.62:0/3374078226 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27b400d7f0 con 0x7f27c005ca90 2021-12-17T18:25:36.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bf59e700 1 -- 172.21.15.62:0/3374078226 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27c005ca90 msgr2=0x7f27c00b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:36.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bf59e700 1 --2- 172.21.15.62:0/3374078226 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27c005ca90 0x7f27c00b2470 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f27b4002f70 tx=0x7f27b4006df0).stop 2021-12-17T18:25:36.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bf59e700 1 -- 172.21.15.62:0/3374078226 shutdown_connections 2021-12-17T18:25:36.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bf59e700 1 --2- 172.21.15.62:0/3374078226 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27c00b34b0 0x7f27c0145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:36.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bf59e700 1 --2- 172.21.15.62:0/3374078226 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27c005ca90 0x7f27c00b2470 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:36.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bf59e700 1 -- 172.21.15.62:0/3374078226 >> 172.21.15.62:0/3374078226 conn(0x7f27c005bcd0 msgr2=0x7f27c0062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:36.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bf59e700 1 -- 172.21.15.62:0/3374078226 shutdown_connections 2021-12-17T18:25:36.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.428+0000 7f27bf59e700 1 -- 172.21.15.62:0/3374078226 wait complete. 2021-12-17T18:25:36.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bf59e700 1 Processor -- start 2021-12-17T18:25:36.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bf59e700 1 -- start start 2021-12-17T18:25:36.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bf59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27c005ca90 0x7f27c0064060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:36.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bf59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27c00604b0 0x7f27c0066b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:36.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bf59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27c00b34b0 0x7f27c0142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:36.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bf59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c00a4d50 con 0x7f27c00604b0 2021-12-17T18:25:36.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bf59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c00a38f0 con 0x7f27c00b34b0 2021-12-17T18:25:36.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bf59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c00a6950 con 0x7f27c005ca90 2021-12-17T18:25:36.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bdd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27c00604b0 0x7f27c0066b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:36.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bdd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27c00604b0 0x7f27c0066b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53344/0 (socket says 172.21.15.62:53344) 2021-12-17T18:25:36.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bdd9b700 1 -- 172.21.15.62:0/3723513961 learned_addr learned my addr 172.21.15.62:0/3723513961 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:36.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27be59c700 1 --2- 172.21.15.62:0/3723513961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27c005ca90 0x7f27c0064060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:36.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bed9d700 1 --2- 172.21.15.62:0/3723513961 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27c00b34b0 0x7f27c0142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:36.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bdd9b700 1 -- 172.21.15.62:0/3723513961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27c005ca90 msgr2=0x7f27c0064060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:36.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bdd9b700 1 --2- 172.21.15.62:0/3723513961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27c005ca90 0x7f27c0064060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:36.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bdd9b700 1 -- 172.21.15.62:0/3723513961 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27c00b34b0 msgr2=0x7f27c0142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:36.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bdd9b700 1 --2- 172.21.15.62:0/3723513961 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27c00b34b0 0x7f27c0142600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:36.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bdd9b700 1 -- 172.21.15.62:0/3723513961 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b000b180 con 0x7f27c00604b0 2021-12-17T18:25:36.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bdd9b700 1 --2- 172.21.15.62:0/3723513961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27c00604b0 0x7f27c0066b10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f27b000c000 tx=0x7f27b0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:36.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27af7fe700 1 -- 172.21.15.62:0/3723513961 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27b0010780 con 0x7f27c00604b0 2021-12-17T18:25:36.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27af7fe700 1 -- 172.21.15.62:0/3723513961 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b00108e0 con 0x7f27c00604b0 2021-12-17T18:25:36.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.432+0000 7f27bf59e700 1 -- 172.21.15.62:0/3723513961 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b400b180 con 0x7f27c00604b0 2021-12-17T18:25:36.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.436+0000 7f27af7fe700 1 -- 172.21.15.62:0/3723513961 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27b0010c40 con 0x7f27c00604b0 2021-12-17T18:25:36.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.436+0000 7f27bf59e700 1 -- 172.21.15.62:0/3723513961 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c00a3530 con 0x7f27c00604b0 2021-12-17T18:25:36.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.436+0000 7f27bf59e700 1 -- 172.21.15.62:0/3723513961 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c00b4500 con 0x7f27c00604b0 2021-12-17T18:25:36.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.436+0000 7f27af7fe700 1 -- 172.21.15.62:0/3723513961 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f27b001c460 con 0x7f27c00604b0 2021-12-17T18:25:36.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.436+0000 7f27af7fe700 1 --2- 172.21.15.62:0/3723513961 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f279c0536a0 0x7f279c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:36.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.440+0000 7f27af7fe700 1 -- 172.21.15.62:0/3723513961 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f27b006bc80 con 0x7f27c00604b0 2021-12-17T18:25:36.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.440+0000 7f27be59c700 1 --2- 172.21.15.62:0/3723513961 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f279c0536a0 0x7f279c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:36.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.440+0000 7f27be59c700 1 --2- 172.21.15.62:0/3723513961 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f279c0536a0 0x7f279c055b60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f27b401a000 tx=0x7f27b4014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:36.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.444+0000 7f27af7fe700 1 -- 172.21.15.62:0/3723513961 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f27b0042ee0 con 0x7f27c00604b0 2021-12-17T18:25:36.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:36.576+0000 7f27bf59e700 1 -- 172.21.15.62:0/3723513961 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f27c00573d0 con 0x7f27c00604b0 2021-12-17T18:25:37.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.284+0000 7f27af7fe700 1 -- 172.21.15.62:0/3723513961 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) v1 ==== 173+0+0 (secure 0 0 0) 0x7f27b0046500 con 0x7f27c00604b0 2021-12-17T18:25:37.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.292+0000 7f27bf59e700 1 -- 172.21.15.62:0/3723513961 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f279c0536a0 msgr2=0x7f279c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:37.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.292+0000 7f27bf59e700 1 --2- 172.21.15.62:0/3723513961 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f279c0536a0 0x7f279c055b60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f27b401a000 tx=0x7f27b4014000).stop 2021-12-17T18:25:37.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.292+0000 7f27bf59e700 1 -- 172.21.15.62:0/3723513961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27c00604b0 msgr2=0x7f27c0066b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:37.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.292+0000 7f27bf59e700 1 --2- 172.21.15.62:0/3723513961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27c00604b0 0x7f27c0066b10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f27b000c000 tx=0x7f27b0006df0).stop 2021-12-17T18:25:37.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.292+0000 7f27bf59e700 1 -- 172.21.15.62:0/3723513961 shutdown_connections 2021-12-17T18:25:37.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.292+0000 7f27bf59e700 1 --2- 172.21.15.62:0/3723513961 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f279c0536a0 0x7f279c055b60 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:37.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.292+0000 7f27bf59e700 1 --2- 172.21.15.62:0/3723513961 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f27c00b34b0 0x7f27c0142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:37.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.292+0000 7f27bf59e700 1 --2- 172.21.15.62:0/3723513961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27c00604b0 0x7f27c0066b10 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:37.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.292+0000 7f27bf59e700 1 --2- 172.21.15.62:0/3723513961 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f27c005ca90 0x7f27c0064060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:37.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.292+0000 7f27bf59e700 1 -- 172.21.15.62:0/3723513961 >> 172.21.15.62:0/3723513961 conn(0x7f27c005bcd0 msgr2=0x7f27c00b8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:37.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.292+0000 7f27bf59e700 1 -- 172.21.15.62:0/3723513961 shutdown_connections 2021-12-17T18:25:37.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.292+0000 7f27bf59e700 1 -- 172.21.15.62:0/3723513961 wait complete. 2021-12-17T18:25:37.300 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2021-12-17T18:25:37.311 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-12-17T18:25:37.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc359e700 1 Processor -- start 2021-12-17T18:25:37.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc359e700 1 -- start start 2021-12-17T18:25:37.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7facc40afe00 0x7facc4147b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:37.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc414b4e0 con 0x7facc40ae820 2021-12-17T18:25:37.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc359e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc40b2980 con 0x7facc40b0310 2021-12-17T18:25:37.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc414b710 con 0x7facc40afe00 2021-12-17T18:25:37.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc2d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7facc40afe00 0x7facc4147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:37.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc259c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7facc40ae820 0x7facc4141100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36932/0 (socket says 172.21.15.62:36932) 2021-12-17T18:25:37.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc259c700 1 -- 172.21.15.62:0/1710400582 learned_addr learned my addr 172.21.15.62:0/1710400582 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:37.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc2d9d700 1 -- 172.21.15.62:0/1710400582 >> v1:172.21.15.109:6789/0 conn(0x7facc40b0310 legacy=0x7facc4147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:37.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc2d9d700 1 -- 172.21.15.62:0/1710400582 >> v1:172.21.15.62:6789/0 conn(0x7facc40ae820 legacy=0x7facc4141100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:37.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc2d9d700 1 -- 172.21.15.62:0/1710400582 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc40b2c20 con 0x7facc40afe00 2021-12-17T18:25:37.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc2d9d700 1 --2- 172.21.15.62:0/1710400582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facc40afe00 0x7facc4147b40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7facbc0032f0 tx=0x7facbc0091d0).ready entity=mon.0 client_cookie=599c5a876986e42f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:37.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc159a700 1 -- 172.21.15.62:0/1710400582 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facbc009ea0 con 0x7facc40afe00 2021-12-17T18:25:37.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc159a700 1 -- 172.21.15.62:0/1710400582 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc00b8a0 con 0x7facc40afe00 2021-12-17T18:25:37.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc159a700 1 -- 172.21.15.62:0/1710400582 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facbc00ba10 con 0x7facc40afe00 2021-12-17T18:25:37.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc359e700 1 -- 172.21.15.62:0/1710400582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facc40afe00 msgr2=0x7facc4147b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:37.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc359e700 1 --2- 172.21.15.62:0/1710400582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facc40afe00 0x7facc4147b40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7facbc0032f0 tx=0x7facbc0091d0).stop 2021-12-17T18:25:37.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc359e700 1 -- 172.21.15.62:0/1710400582 shutdown_connections 2021-12-17T18:25:37.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc359e700 1 --2- 172.21.15.62:0/1710400582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facc40afe00 0x7facc4147b40 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:37.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.416+0000 7facc359e700 1 -- 172.21.15.62:0/1710400582 >> 172.21.15.62:0/1710400582 conn(0x7facc4062430 msgr2=0x7facc4062840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:37.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.420+0000 7facc359e700 1 -- 172.21.15.62:0/1710400582 shutdown_connections 2021-12-17T18:25:37.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.420+0000 7facc359e700 1 -- 172.21.15.62:0/1710400582 wait complete. 2021-12-17T18:25:37.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.420+0000 7facc359e700 1 Processor -- start 2021-12-17T18:25:37.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.420+0000 7facc359e700 1 -- start start 2021-12-17T18:25:37.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.420+0000 7facc359e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7facc40ae820 0x7facc4066410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:37.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.420+0000 7facc359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facc40afe00 0x7facc4157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:37.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.420+0000 7facc359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7facc40b0310 0x7facc4157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:37.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facc359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc4157a60 con 0x7facc40afe00 2021-12-17T18:25:37.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facc359e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc4148370 con 0x7facc40ae820 2021-12-17T18:25:37.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facc359e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc4148610 con 0x7facc40b0310 2021-12-17T18:25:37.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facc1d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facc40afe00 0x7facc4157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:37.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facc1d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facc40afe00 0x7facc4157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53360/0 (socket says 172.21.15.62:53360) 2021-12-17T18:25:37.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facc1d9b700 1 -- 172.21.15.62:0/571676990 learned_addr learned my addr 172.21.15.62:0/571676990 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:37.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facc2d9d700 1 --2- 172.21.15.62:0/571676990 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7facc40b0310 0x7facc4157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:37.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facc259c700 1 --2- 172.21.15.62:0/571676990 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7facc40ae820 0x7facc4066410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:37.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facc1d9b700 1 -- 172.21.15.62:0/571676990 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7facc40b0310 msgr2=0x7facc4157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:37.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facc1d9b700 1 --2- 172.21.15.62:0/571676990 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7facc40b0310 0x7facc4157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:37.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facc1d9b700 1 -- 172.21.15.62:0/571676990 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7facc40ae820 msgr2=0x7facc4066410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:37.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facc1d9b700 1 --2- 172.21.15.62:0/571676990 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7facc40ae820 0x7facc4066410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:37.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facc1d9b700 1 -- 172.21.15.62:0/571676990 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc009470 con 0x7facc40afe00 2021-12-17T18:25:37.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facc1d9b700 1 --2- 172.21.15.62:0/571676990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facc40afe00 0x7facc4157080 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7facc40b53b0 tx=0x7facb4007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:37.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facb37fe700 1 -- 172.21.15.62:0/571676990 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facb4012400 con 0x7facc40afe00 2021-12-17T18:25:37.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facb37fe700 1 -- 172.21.15.62:0/571676990 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb4012560 con 0x7facc40afe00 2021-12-17T18:25:37.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facc359e700 1 -- 172.21.15.62:0/571676990 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc4156be0 con 0x7facc40afe00 2021-12-17T18:25:37.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facb37fe700 1 -- 172.21.15.62:0/571676990 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facb40128c0 con 0x7facc40afe00 2021-12-17T18:25:37.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facc359e700 1 -- 172.21.15.62:0/571676990 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc4144470 con 0x7facc40afe00 2021-12-17T18:25:37.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.424+0000 7facc359e700 1 -- 172.21.15.62:0/571676990 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc4156d70 con 0x7facc40afe00 2021-12-17T18:25:37.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.428+0000 7facb37fe700 1 -- 172.21.15.62:0/571676990 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7facb4019030 con 0x7facc40afe00 2021-12-17T18:25:37.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.428+0000 7facb37fe700 1 --2- 172.21.15.62:0/571676990 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faca00536d0 0x7faca0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:37.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.428+0000 7facb37fe700 1 -- 172.21.15.62:0/571676990 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5339+0+0 (secure 0 0 0) 0x7facb406a890 con 0x7facc40afe00 2021-12-17T18:25:37.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.428+0000 7facc259c700 1 --2- 172.21.15.62:0/571676990 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faca00536d0 0x7faca0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:37.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.428+0000 7facc259c700 1 --2- 172.21.15.62:0/571676990 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faca00536d0 0x7faca0055b90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7facb800d000 tx=0x7facb8009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:37.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.432+0000 7facb37fe700 1 -- 172.21.15.62:0/571676990 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7facb4041cd0 con 0x7facc40afe00 2021-12-17T18:25:37.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.564+0000 7facc359e700 1 -- 172.21.15.62:0/571676990 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7facc4141810 con 0x7facc40afe00 2021-12-17T18:25:37.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.572+0000 7facb37fe700 1 -- 172.21.15.62:0/571676990 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7facb40452f0 con 0x7facc40afe00 2021-12-17T18:25:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.572+0000 7facc359e700 1 -- 172.21.15.62:0/571676990 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faca00536d0 msgr2=0x7faca0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.572+0000 7facc359e700 1 --2- 172.21.15.62:0/571676990 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faca00536d0 0x7faca0055b90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7facb800d000 tx=0x7facb8009040).stop 2021-12-17T18:25:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.572+0000 7facc359e700 1 -- 172.21.15.62:0/571676990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facc40afe00 msgr2=0x7facc4157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:37.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.572+0000 7facc359e700 1 --2- 172.21.15.62:0/571676990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facc40afe00 0x7facc4157080 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7facc40b53b0 tx=0x7facb4007c50).stop 2021-12-17T18:25:37.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.572+0000 7facc359e700 1 -- 172.21.15.62:0/571676990 shutdown_connections 2021-12-17T18:25:37.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.572+0000 7facc359e700 1 --2- 172.21.15.62:0/571676990 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faca00536d0 0x7faca0055b90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:37.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.572+0000 7facc359e700 1 --2- 172.21.15.62:0/571676990 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7facc40b0310 0x7facc4157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:37.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.572+0000 7facc359e700 1 --2- 172.21.15.62:0/571676990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facc40afe00 0x7facc4157080 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:37.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.572+0000 7facc359e700 1 --2- 172.21.15.62:0/571676990 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7facc40ae820 0x7facc4066410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:37.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.572+0000 7facc359e700 1 -- 172.21.15.62:0/571676990 >> 172.21.15.62:0/571676990 conn(0x7facc4062430 msgr2=0x7facc405fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:37.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.572+0000 7facc359e700 1 -- 172.21.15.62:0/571676990 shutdown_connections 2021-12-17T18:25:37.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.572+0000 7facc359e700 1 -- 172.21.15.62:0/571676990 wait complete. 2021-12-17T18:25:37.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-12-17T18:25:37.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2b774f700 1 Processor -- start 2021-12-17T18:25:37.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2b774f700 1 -- start start 2021-12-17T18:25:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2b774f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b00a7810 0x7fb2b00aca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2b774f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb2b00b0870 0x7fb2b00b2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:37.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2b774f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b0147870 con 0x7fb2b00a8cc0 2021-12-17T18:25:37.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2b774f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b00a90a0 con 0x7fb2b00b0870 2021-12-17T18:25:37.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2b774f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00affc0 con 0x7fb2b00a7810 2021-12-17T18:25:37.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2b54eb700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb2b00a8cc0 0x7fb2b014b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36946/0 (socket says 172.21.15.62:36946) 2021-12-17T18:25:37.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2b54eb700 1 -- 172.21.15.62:0/310130206 learned_addr learned my addr 172.21.15.62:0/310130206 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:37.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2b5cec700 1 --2- 172.21.15.62:0/310130206 >> v2:172.21.15.62:3300/0 conn(0x7fb2b00b0870 0x7fb2b00b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:37.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2b4cea700 1 --2- 172.21.15.62:0/310130206 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b00a7810 0x7fb2b00aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:37.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2a3fff700 1 -- 172.21.15.62:0/310130206 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915267439 0 0) 0x7fb2b0147870 con 0x7fb2b00a8cc0 2021-12-17T18:25:37.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2a3fff700 1 -- 172.21.15.62:0/310130206 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb294003260 con 0x7fb2b00a8cc0 2021-12-17T18:25:37.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2b4cea700 1 -- 172.21.15.62:0/310130206 >> v2:172.21.15.62:3300/0 conn(0x7fb2b00b0870 msgr2=0x7fb2b00b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:37.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2b4cea700 1 --2- 172.21.15.62:0/310130206 >> v2:172.21.15.62:3300/0 conn(0x7fb2b00b0870 0x7fb2b00b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:37.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2b4cea700 1 -- 172.21.15.62:0/310130206 >> v1:172.21.15.62:6789/0 conn(0x7fb2b00a8cc0 legacy=0x7fb2b014b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:37.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2b4cea700 1 -- 172.21.15.62:0/310130206 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b00b0260 con 0x7fb2b00a7810 2021-12-17T18:25:37.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2b4cea700 1 --2- 172.21.15.62:0/310130206 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b00a7810 0x7fb2b00aca60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fb2a80032f0 tx=0x7fb2a80091d0).ready entity=mon.2 client_cookie=54237f7d7c816fae server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:37.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2a3fff700 1 -- 172.21.15.62:0/310130206 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2a800b600 con 0x7fb2b00a7810 2021-12-17T18:25:37.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2a3fff700 1 -- 172.21.15.62:0/310130206 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a800b760 con 0x7fb2b00a7810 2021-12-17T18:25:37.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.692+0000 7fb2a3fff700 1 -- 172.21.15.62:0/310130206 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2a800b8d0 con 0x7fb2b00a7810 2021-12-17T18:25:37.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.696+0000 7fb2b774f700 1 -- 172.21.15.62:0/310130206 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b00a7810 msgr2=0x7fb2b00aca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:37.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.696+0000 7fb2b774f700 1 --2- 172.21.15.62:0/310130206 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b00a7810 0x7fb2b00aca60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fb2a80032f0 tx=0x7fb2a80091d0).stop 2021-12-17T18:25:37.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.696+0000 7fb2b774f700 1 -- 172.21.15.62:0/310130206 shutdown_connections 2021-12-17T18:25:37.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.696+0000 7fb2b774f700 1 --2- 172.21.15.62:0/310130206 >> v2:172.21.15.62:3300/0 conn(0x7fb2b00b0870 0x7fb2b00b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:37.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.696+0000 7fb2b774f700 1 --2- 172.21.15.62:0/310130206 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b00a7810 0x7fb2b00aca60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:37.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.696+0000 7fb2b774f700 1 -- 172.21.15.62:0/310130206 >> 172.21.15.62:0/310130206 conn(0x7fb2b005caa0 msgr2=0x7fb2b005ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:37.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.696+0000 7fb2b774f700 1 -- 172.21.15.62:0/310130206 shutdown_connections 2021-12-17T18:25:37.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.696+0000 7fb2b774f700 1 -- 172.21.15.62:0/310130206 wait complete. 2021-12-17T18:25:37.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.696+0000 7fb2b774f700 1 Processor -- start 2021-12-17T18:25:37.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.696+0000 7fb2b774f700 1 -- start start 2021-12-17T18:25:37.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b774f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb2b00a7810 0x7fb2b00ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:37.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b774f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b00a8cc0 0x7fb2b0066310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:37.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b774f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b00b0870 0x7fb2b0066800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:37.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b774f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00644c0 con 0x7fb2b00b0870 2021-12-17T18:25:37.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b774f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00634b0 con 0x7fb2b00a7810 2021-12-17T18:25:37.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b774f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0063750 con 0x7fb2b00a8cc0 2021-12-17T18:25:37.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b5cec700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b00b0870 0x7fb2b0066800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:37.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b5cec700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b00b0870 0x7fb2b0066800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53376/0 (socket says 172.21.15.62:53376) 2021-12-17T18:25:37.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b54eb700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb2b00a7810 0x7fb2b00ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:37.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b4cea700 1 --2- 172.21.15.62:0/3015438215 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b00a8cc0 0x7fb2b0066310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:37.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b5cec700 1 -- 172.21.15.62:0/3015438215 learned_addr learned my addr 172.21.15.62:0/3015438215 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:37.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b5cec700 1 -- 172.21.15.62:0/3015438215 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b00a8cc0 msgr2=0x7fb2b0066310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:37.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b5cec700 1 --2- 172.21.15.62:0/3015438215 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b00a8cc0 0x7fb2b0066310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:37.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b5cec700 1 -- 172.21.15.62:0/3015438215 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb2b00a7810 msgr2=0x7fb2b00ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:37.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b5cec700 1 --2- 172.21.15.62:0/3015438215 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb2b00a7810 0x7fb2b00ae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:37.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b5cec700 1 -- 172.21.15.62:0/3015438215 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a8009470 con 0x7fb2b00b0870 2021-12-17T18:25:37.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b5cec700 1 --2- 172.21.15.62:0/3015438215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b00b0870 0x7fb2b0066800 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7fb2ac00c000 tx=0x7fb2ac006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:37.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2a27fc700 1 -- 172.21.15.62:0/3015438215 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2ac011750 con 0x7fb2b00b0870 2021-12-17T18:25:37.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2a27fc700 1 -- 172.21.15.62:0/3015438215 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac0118b0 con 0x7fb2b00b0870 2021-12-17T18:25:37.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b774f700 1 -- 172.21.15.62:0/3015438215 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b00639f0 con 0x7fb2b00b0870 2021-12-17T18:25:37.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2a27fc700 1 -- 172.21.15.62:0/3015438215 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2ac011c10 con 0x7fb2b00b0870 2021-12-17T18:25:37.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b774f700 1 -- 172.21.15.62:0/3015438215 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b0065220 con 0x7fb2b00b0870 2021-12-17T18:25:37.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.700+0000 7fb2b774f700 1 -- 172.21.15.62:0/3015438215 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b0063b80 con 0x7fb2b00b0870 2021-12-17T18:25:37.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.704+0000 7fb2a27fc700 1 -- 172.21.15.62:0/3015438215 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb2ac011d70 con 0x7fb2b00b0870 2021-12-17T18:25:37.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.704+0000 7fb2a27fc700 1 --2- 172.21.15.62:0/3015438215 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2980536a0 0x7fb298055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:37.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.704+0000 7fb2a27fc700 1 -- 172.21.15.62:0/3015438215 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fb2ac06ba00 con 0x7fb2b00b0870 2021-12-17T18:25:37.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.704+0000 7fb2b54eb700 1 --2- 172.21.15.62:0/3015438215 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2980536a0 0x7fb298055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:37.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.704+0000 7fb2b54eb700 1 --2- 172.21.15.62:0/3015438215 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2980536a0 0x7fb298055b60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fb2a400d000 tx=0x7fb2a4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:37.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.708+0000 7fb2a27fc700 1 -- 172.21.15.62:0/3015438215 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb2ac042da0 con 0x7fb2b00b0870 2021-12-17T18:25:37.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:37.876+0000 7fb2b774f700 1 -- 172.21.15.62:0/3015438215 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7fb2b00b0c80 con 0x7fb2b00b0870 2021-12-17T18:25:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.288+0000 7fb2a27fc700 1 -- 172.21.15.62:0/3015438215 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v318) v1 ==== 126+0+0 (secure 0 0 0) 0x7fb2ac0463c0 con 0x7fb2b00b0870 2021-12-17T18:25:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.292+0000 7fb2b774f700 1 -- 172.21.15.62:0/3015438215 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2980536a0 msgr2=0x7fb298055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.292+0000 7fb2b774f700 1 --2- 172.21.15.62:0/3015438215 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2980536a0 0x7fb298055b60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fb2a400d000 tx=0x7fb2a4009040).stop 2021-12-17T18:25:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.292+0000 7fb2b774f700 1 -- 172.21.15.62:0/3015438215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b00b0870 msgr2=0x7fb2b0066800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:38.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.292+0000 7fb2b774f700 1 --2- 172.21.15.62:0/3015438215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b00b0870 0x7fb2b0066800 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7fb2ac00c000 tx=0x7fb2ac006df0).stop 2021-12-17T18:25:38.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.292+0000 7fb2b774f700 1 -- 172.21.15.62:0/3015438215 shutdown_connections 2021-12-17T18:25:38.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.292+0000 7fb2b774f700 1 --2- 172.21.15.62:0/3015438215 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2980536a0 0x7fb298055b60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:38.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.292+0000 7fb2b774f700 1 --2- 172.21.15.62:0/3015438215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b00b0870 0x7fb2b0066800 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:38.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.292+0000 7fb2b774f700 1 --2- 172.21.15.62:0/3015438215 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb2b00a8cc0 0x7fb2b0066310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:38.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.292+0000 7fb2b774f700 1 --2- 172.21.15.62:0/3015438215 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb2b00a7810 0x7fb2b00ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:38.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.292+0000 7fb2b774f700 1 -- 172.21.15.62:0/3015438215 >> 172.21.15.62:0/3015438215 conn(0x7fb2b005caa0 msgr2=0x7fb2b00b4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:38.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.292+0000 7fb2b774f700 1 -- 172.21.15.62:0/3015438215 shutdown_connections 2021-12-17T18:25:38.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.292+0000 7fb2b774f700 1 -- 172.21.15.62:0/3015438215 wait complete. 2021-12-17T18:25:38.313 INFO:tasks.cephfs_test_runner:test_dump_inode (tasks.cephfs.test_misc.TestMisc) ... ok 2021-12-17T18:25:38.313 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) 2021-12-17T18:25:38.314 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-12-17T18:25:38.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.420+0000 7f2c029c2700 1 Processor -- start 2021-12-17T18:25:38.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.420+0000 7f2c029c2700 1 -- start start 2021-12-17T18:25:38.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.420+0000 7f2c029c2700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f2bfc141480 0x7f2bfc147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:38.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.420+0000 7f2c029c2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bfc0b6270 con 0x7f2bfc0a71e0 2021-12-17T18:25:38.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.420+0000 7f2c029c2700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bfc147610 con 0x7f2bfc0a8e10 2021-12-17T18:25:38.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.420+0000 7f2c029c2700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bfc1478b0 con 0x7f2bfc141480 2021-12-17T18:25:38.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.420+0000 7f2c021c1700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2bfc0a71e0 0x7f2bfc0a7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36964/0 (socket says 172.21.15.62:36964) 2021-12-17T18:25:38.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.420+0000 7f2c021c1700 1 -- 172.21.15.62:0/442890693 learned_addr learned my addr 172.21.15.62:0/442890693 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:38.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.420+0000 7f2c019c0700 1 --2- 172.21.15.62:0/442890693 >> v2:172.21.15.109:3300/0 conn(0x7f2bfc141480 0x7f2bfc147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:38.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.420+0000 7f2c009be700 1 -- 172.21.15.62:0/442890693 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737453064 0 0) 0x7f2bfc0b6270 con 0x7f2bfc0a71e0 2021-12-17T18:25:38.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.420+0000 7f2c009be700 1 -- 172.21.15.62:0/442890693 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2be4003260 con 0x7f2bfc0a71e0 2021-12-17T18:25:38.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.420+0000 7f2c009be700 1 -- 172.21.15.62:0/442890693 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290290801 0 0) 0x7f2bfc147610 con 0x7f2bfc0a8e10 2021-12-17T18:25:38.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c009be700 1 -- 172.21.15.62:0/442890693 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bfc0b6270 con 0x7f2bfc0a8e10 2021-12-17T18:25:38.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c009be700 1 -- 172.21.15.62:0/442890693 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3830158302 0 0) 0x7f2be4003260 con 0x7f2bfc0a71e0 2021-12-17T18:25:38.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c019c0700 1 -- 172.21.15.62:0/442890693 >> v1:172.21.15.109:6789/0 conn(0x7f2bfc0a8e10 legacy=0x7f2bfc0b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:38.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c019c0700 1 -- 172.21.15.62:0/442890693 >> v1:172.21.15.62:6789/0 conn(0x7f2bfc0a71e0 legacy=0x7f2bfc0a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:38.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c019c0700 1 -- 172.21.15.62:0/442890693 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc147b50 con 0x7f2bfc141480 2021-12-17T18:25:38.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c019c0700 1 --2- 172.21.15.62:0/442890693 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2bfc141480 0x7f2bfc147ff0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f2bf4001490 tx=0x7f2bec006df0).ready entity=mon.1 client_cookie=7aa034fced6e8e29 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:38.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c009be700 1 -- 172.21.15.62:0/442890693 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bf40019e0 con 0x7f2bfc141480 2021-12-17T18:25:38.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c009be700 1 -- 172.21.15.62:0/442890693 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec000e90 con 0x7f2bfc141480 2021-12-17T18:25:38.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c009be700 1 -- 172.21.15.62:0/442890693 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bec012460 con 0x7f2bfc141480 2021-12-17T18:25:38.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c029c2700 1 -- 172.21.15.62:0/442890693 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2bfc141480 msgr2=0x7f2bfc147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:38.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c029c2700 1 --2- 172.21.15.62:0/442890693 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2bfc141480 0x7f2bfc147ff0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f2bf4001490 tx=0x7f2bec006df0).stop 2021-12-17T18:25:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c029c2700 1 -- 172.21.15.62:0/442890693 shutdown_connections 2021-12-17T18:25:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c029c2700 1 --2- 172.21.15.62:0/442890693 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2bfc141480 0x7f2bfc147ff0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c029c2700 1 -- 172.21.15.62:0/442890693 >> 172.21.15.62:0/442890693 conn(0x7f2bfc05d220 msgr2=0x7f2bfc0b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c029c2700 1 -- 172.21.15.62:0/442890693 shutdown_connections 2021-12-17T18:25:38.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c029c2700 1 -- 172.21.15.62:0/442890693 wait complete. 2021-12-17T18:25:38.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c029c2700 1 Processor -- start 2021-12-17T18:25:38.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c029c2700 1 -- start start 2021-12-17T18:25:38.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c029c2700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2bfc0a71e0 0x7f2bfc13e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:38.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c029c2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bfc0a8e10 0x7f2bfc0ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:38.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c029c2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2bfc141480 0x7f2bfc148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:38.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c029c2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0aae40 con 0x7f2bfc0a8e10 2021-12-17T18:25:38.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c029c2700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc149190 con 0x7f2bfc0a71e0 2021-12-17T18:25:38.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.424+0000 7f2c029c2700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0ac150 con 0x7f2bfc141480 2021-12-17T18:25:38.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2c011bf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bfc0a8e10 0x7f2bfc0ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:38.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2c011bf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bfc0a8e10 0x7f2bfc0ae5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53386/0 (socket says 172.21.15.62:53386) 2021-12-17T18:25:38.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2c011bf700 1 -- 172.21.15.62:0/3559451533 learned_addr learned my addr 172.21.15.62:0/3559451533 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:38.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2c021c1700 1 --2- 172.21.15.62:0/3559451533 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2bfc141480 0x7f2bfc148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:38.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2c019c0700 1 --2- 172.21.15.62:0/3559451533 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2bfc0a71e0 0x7f2bfc13e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:38.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2c011bf700 1 -- 172.21.15.62:0/3559451533 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2bfc141480 msgr2=0x7f2bfc148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:38.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2c011bf700 1 --2- 172.21.15.62:0/3559451533 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2bfc141480 0x7f2bfc148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:38.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2c011bf700 1 -- 172.21.15.62:0/3559451533 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2bfc0a71e0 msgr2=0x7f2bfc13e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:38.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2c011bf700 1 --2- 172.21.15.62:0/3559451533 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2bfc0a71e0 0x7f2bfc13e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:38.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2c011bf700 1 -- 172.21.15.62:0/3559451533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec00b180 con 0x7f2bfc0a8e10 2021-12-17T18:25:38.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2c019c0700 1 --2- 172.21.15.62:0/3559451533 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2bfc0a71e0 0x7f2bfc13e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:38.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2c011bf700 1 --2- 172.21.15.62:0/3559451533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bfc0a8e10 0x7f2bfc0ae5a0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f2bfc149320 tx=0x7f2bf8007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:38.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2beaffd700 1 -- 172.21.15.62:0/3559451533 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bf800ce40 con 0x7f2bfc0a8e10 2021-12-17T18:25:38.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2c029c2700 1 -- 172.21.15.62:0/3559451533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bfc0aa900 con 0x7f2bfc0a8e10 2021-12-17T18:25:38.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2c029c2700 1 -- 172.21.15.62:0/3559451533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bfc14b770 con 0x7f2bfc0a8e10 2021-12-17T18:25:38.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2beaffd700 1 -- 172.21.15.62:0/3559451533 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf800f470 con 0x7f2bfc0a8e10 2021-12-17T18:25:38.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2beaffd700 1 -- 172.21.15.62:0/3559451533 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bf800f7d0 con 0x7f2bfc0a8e10 2021-12-17T18:25:38.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.428+0000 7f2c029c2700 1 -- 172.21.15.62:0/3559451533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bfc0b1b90 con 0x7f2bfc0a8e10 2021-12-17T18:25:38.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.432+0000 7f2beaffd700 1 -- 172.21.15.62:0/3559451533 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2bf8010070 con 0x7f2bfc0a8e10 2021-12-17T18:25:38.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.432+0000 7f2beaffd700 1 --2- 172.21.15.62:0/3559451533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2bdc0534f0 0x7f2bdc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:38.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.432+0000 7f2beaffd700 1 -- 172.21.15.62:0/3559451533 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f2bf806b280 con 0x7f2bfc0a8e10 2021-12-17T18:25:38.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.432+0000 7f2c019c0700 1 --2- 172.21.15.62:0/3559451533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2bdc0534f0 0x7f2bdc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:38.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.432+0000 7f2c019c0700 1 --2- 172.21.15.62:0/3559451533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2bdc0534f0 0x7f2bdc0559b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f2bec018000 tx=0x7f2bec014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:38.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.436+0000 7f2beaffd700 1 -- 172.21.15.62:0/3559451533 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2bf80426c0 con 0x7f2bfc0a8e10 2021-12-17T18:25:38.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:38.604+0000 7f2c029c2700 1 -- 172.21.15.62:0/3559451533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7f2bfc0573d0 con 0x7f2bfc0a8e10 2021-12-17T18:25:39.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.292+0000 7f2beaffd700 1 -- 172.21.15.62:0/3559451533 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v319) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2bf8045ce0 con 0x7f2bfc0a8e10 2021-12-17T18:25:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.296+0000 7f2c029c2700 1 -- 172.21.15.62:0/3559451533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2bdc0534f0 msgr2=0x7f2bdc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.296+0000 7f2c029c2700 1 --2- 172.21.15.62:0/3559451533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2bdc0534f0 0x7f2bdc0559b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f2bec018000 tx=0x7f2bec014000).stop 2021-12-17T18:25:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.296+0000 7f2c029c2700 1 -- 172.21.15.62:0/3559451533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bfc0a8e10 msgr2=0x7f2bfc0ae5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.296+0000 7f2c029c2700 1 --2- 172.21.15.62:0/3559451533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bfc0a8e10 0x7f2bfc0ae5a0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f2bfc149320 tx=0x7f2bf8007ae0).stop 2021-12-17T18:25:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.296+0000 7f2c029c2700 1 -- 172.21.15.62:0/3559451533 shutdown_connections 2021-12-17T18:25:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.296+0000 7f2c029c2700 1 --2- 172.21.15.62:0/3559451533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2bdc0534f0 0x7f2bdc0559b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.296+0000 7f2c029c2700 1 --2- 172.21.15.62:0/3559451533 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2bfc141480 0x7f2bfc148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.296+0000 7f2c029c2700 1 --2- 172.21.15.62:0/3559451533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bfc0a8e10 0x7f2bfc0ae5a0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.296+0000 7f2c029c2700 1 --2- 172.21.15.62:0/3559451533 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2bfc0a71e0 0x7f2bfc13e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.296+0000 7f2c029c2700 1 -- 172.21.15.62:0/3559451533 >> 172.21.15.62:0/3559451533 conn(0x7f2bfc05d220 msgr2=0x7f2bfc145eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:39.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.296+0000 7f2c029c2700 1 -- 172.21.15.62:0/3559451533 shutdown_connections 2021-12-17T18:25:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.296+0000 7f2c029c2700 1 -- 172.21.15.62:0/3559451533 wait complete. 2021-12-17T18:25:39.316 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-12-17T18:25:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec326f9700 1 Processor -- start 2021-12-17T18:25:39.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec326f9700 1 -- start start 2021-12-17T18:25:39.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec326f9700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fec2c0b07c0 0x7fec2c0b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:39.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec326f9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec2c147440 0x7fec2c05fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec326f9700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2c0606e0 con 0x7fec2c0b5330 2021-12-17T18:25:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec326f9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2c141950 con 0x7fec2c147440 2021-12-17T18:25:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec326f9700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c05fa10 con 0x7fec2c0b07c0 2021-12-17T18:25:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec30c96700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec2c147440 0x7fec2c05fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec30c96700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec2c147440 0x7fec2c05fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53398/0 (socket says 172.21.15.62:53398) 2021-12-17T18:25:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec30c96700 1 -- 172.21.15.62:0/1023601214 learned_addr learned my addr 172.21.15.62:0/1023601214 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec2b7fe700 1 --2- 172.21.15.62:0/1023601214 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fec2c0b07c0 0x7fec2c0b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec30c96700 1 -- 172.21.15.62:0/1023601214 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fec2c0b07c0 msgr2=0x7fec2c0b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec30c96700 1 --2- 172.21.15.62:0/1023601214 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fec2c0b07c0 0x7fec2c0b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec30c96700 1 -- 172.21.15.62:0/1023601214 >> v1:172.21.15.109:6789/0 conn(0x7fec2c0b5330 legacy=0x7fec2c147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec30c96700 1 -- 172.21.15.62:0/1023601214 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c060980 con 0x7fec2c147440 2021-12-17T18:25:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec30c96700 1 --2- 172.21.15.62:0/1023601214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec2c147440 0x7fec2c05fc40 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7fec240032f0 tx=0x7fec24009290).ready entity=mon.0 client_cookie=bc40d91a19da1f74 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec2affd700 1 -- 172.21.15.62:0/1023601214 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec2400b8a0 con 0x7fec2c147440 2021-12-17T18:25:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec2affd700 1 -- 172.21.15.62:0/1023601214 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2400ba00 con 0x7fec2c147440 2021-12-17T18:25:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec2affd700 1 -- 172.21.15.62:0/1023601214 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec2400bb70 con 0x7fec2c147440 2021-12-17T18:25:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec326f9700 1 -- 172.21.15.62:0/1023601214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec2c147440 msgr2=0x7fec2c05fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec326f9700 1 --2- 172.21.15.62:0/1023601214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec2c147440 0x7fec2c05fc40 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7fec240032f0 tx=0x7fec24009290).stop 2021-12-17T18:25:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec326f9700 1 -- 172.21.15.62:0/1023601214 shutdown_connections 2021-12-17T18:25:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec326f9700 1 --2- 172.21.15.62:0/1023601214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec2c147440 0x7fec2c05fc40 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec326f9700 1 --2- 172.21.15.62:0/1023601214 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fec2c0b07c0 0x7fec2c0b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.428+0000 7fec326f9700 1 -- 172.21.15.62:0/1023601214 >> 172.21.15.62:0/1023601214 conn(0x7fec2c05c750 msgr2=0x7fec2c05cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.432+0000 7fec326f9700 1 -- 172.21.15.62:0/1023601214 shutdown_connections 2021-12-17T18:25:39.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.432+0000 7fec326f9700 1 -- 172.21.15.62:0/1023601214 wait complete. 2021-12-17T18:25:39.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.432+0000 7fec326f9700 1 Processor -- start 2021-12-17T18:25:39.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.432+0000 7fec326f9700 1 -- start start 2021-12-17T18:25:39.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec326f9700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fec2c0b07c0 0x7fec2c148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:39.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec326f9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec2c0b5330 0x7fec2c14cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec326f9700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fec2c147440 0x7fec2c14d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec326f9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c142aa0 con 0x7fec2c0b5330 2021-12-17T18:25:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec326f9700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0af0e0 con 0x7fec2c0b07c0 2021-12-17T18:25:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec326f9700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0af380 con 0x7fec2c147440 2021-12-17T18:25:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec2b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec2c0b5330 0x7fec2c14cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec2b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec2c0b5330 0x7fec2c14cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53404/0 (socket says 172.21.15.62:53404) 2021-12-17T18:25:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec2b7fe700 1 -- 172.21.15.62:0/3800224267 learned_addr learned my addr 172.21.15.62:0/3800224267 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec2bfff700 1 --2- 172.21.15.62:0/3800224267 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fec2c0b07c0 0x7fec2c148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec30c96700 1 --2- 172.21.15.62:0/3800224267 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fec2c147440 0x7fec2c14d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec2b7fe700 1 -- 172.21.15.62:0/3800224267 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fec2c147440 msgr2=0x7fec2c14d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec2b7fe700 1 --2- 172.21.15.62:0/3800224267 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fec2c147440 0x7fec2c14d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec2b7fe700 1 -- 172.21.15.62:0/3800224267 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fec2c0b07c0 msgr2=0x7fec2c148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec2b7fe700 1 --2- 172.21.15.62:0/3800224267 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fec2c0b07c0 0x7fec2c148ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec2b7fe700 1 -- 172.21.15.62:0/3800224267 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec24009530 con 0x7fec2c0b5330 2021-12-17T18:25:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec2b7fe700 1 --2- 172.21.15.62:0/3800224267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec2c0b5330 0x7fec2c14cc40 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fec2000c000 tx=0x7fec20006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec297fa700 1 -- 172.21.15.62:0/3800224267 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec20010780 con 0x7fec2c0b5330 2021-12-17T18:25:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec297fa700 1 -- 172.21.15.62:0/3800224267 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec200108e0 con 0x7fec2c0b5330 2021-12-17T18:25:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec326f9700 1 -- 172.21.15.62:0/3800224267 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2c0af620 con 0x7fec2c0b5330 2021-12-17T18:25:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec297fa700 1 -- 172.21.15.62:0/3800224267 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec20010c40 con 0x7fec2c0b5330 2021-12-17T18:25:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec326f9700 1 -- 172.21.15.62:0/3800224267 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2c0aecb0 con 0x7fec2c0b5330 2021-12-17T18:25:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.436+0000 7fec297fa700 1 -- 172.21.15.62:0/3800224267 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fec2001c460 con 0x7fec2c0b5330 2021-12-17T18:25:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.440+0000 7fec326f9700 1 -- 172.21.15.62:0/3800224267 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2c0aef30 con 0x7fec2c0b5330 2021-12-17T18:25:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.440+0000 7fec297fa700 1 --2- 172.21.15.62:0/3800224267 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fec0c053640 0x7fec0c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.440+0000 7fec297fa700 1 -- 172.21.15.62:0/3800224267 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fec2006ba80 con 0x7fec2c0b5330 2021-12-17T18:25:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.440+0000 7fec2bfff700 1 --2- 172.21.15.62:0/3800224267 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fec0c053640 0x7fec0c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.440+0000 7fec2bfff700 1 --2- 172.21.15.62:0/3800224267 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fec0c053640 0x7fec0c055b00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fec1c00d000 tx=0x7fec1c007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:39.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.444+0000 7fec297fa700 1 -- 172.21.15.62:0/3800224267 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fec20042dc0 con 0x7fec2c0b5330 2021-12-17T18:25:39.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.576+0000 7fec326f9700 1 -- 172.21.15.62:0/3800224267 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fec2c0af7b0 con 0x7fec2c0b5330 2021-12-17T18:25:39.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.584+0000 7fec297fa700 1 -- 172.21.15.62:0/3800224267 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fec200463e0 con 0x7fec2c0b5330 2021-12-17T18:25:39.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.588+0000 7fec326f9700 1 -- 172.21.15.62:0/3800224267 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fec0c053640 msgr2=0x7fec0c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.588+0000 7fec326f9700 1 --2- 172.21.15.62:0/3800224267 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fec0c053640 0x7fec0c055b00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fec1c00d000 tx=0x7fec1c007b90).stop 2021-12-17T18:25:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.588+0000 7fec326f9700 1 -- 172.21.15.62:0/3800224267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec2c0b5330 msgr2=0x7fec2c14cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.588+0000 7fec326f9700 1 --2- 172.21.15.62:0/3800224267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec2c0b5330 0x7fec2c14cc40 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fec2000c000 tx=0x7fec20006df0).stop 2021-12-17T18:25:39.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.588+0000 7fec326f9700 1 -- 172.21.15.62:0/3800224267 shutdown_connections 2021-12-17T18:25:39.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.588+0000 7fec326f9700 1 --2- 172.21.15.62:0/3800224267 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fec0c053640 0x7fec0c055b00 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.588+0000 7fec326f9700 1 --2- 172.21.15.62:0/3800224267 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fec2c147440 0x7fec2c14d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.588+0000 7fec326f9700 1 --2- 172.21.15.62:0/3800224267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec2c0b5330 0x7fec2c14cc40 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.588+0000 7fec326f9700 1 --2- 172.21.15.62:0/3800224267 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fec2c0b07c0 0x7fec2c148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.588+0000 7fec326f9700 1 -- 172.21.15.62:0/3800224267 >> 172.21.15.62:0/3800224267 conn(0x7fec2c05c750 msgr2=0x7fec2c05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:39.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.588+0000 7fec326f9700 1 -- 172.21.15.62:0/3800224267 shutdown_connections 2021-12-17T18:25:39.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.588+0000 7fec326f9700 1 -- 172.21.15.62:0/3800224267 wait complete. 2021-12-17T18:25:39.605 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:25:39.605 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:39.633 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:39.655 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:39.676 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:39.697 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:39.718 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:25:39.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:39.719 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:39.719 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:39.726 INFO:teuthology.orchestra.run.smithi125.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-12-17T18:25:39.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:25:39.728 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-12-17T18:25:39.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:39.729 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:39.729 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:39.737 INFO:teuthology.orchestra.run.smithi158.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:25:39.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:25:39.739 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-12-17T18:25:39.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:39.740 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:39.740 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:25:39.747 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:25:39.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:25:39.749 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:25:39.750 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:25:39.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc14911d700 1 Processor -- start 2021-12-17T18:25:39.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc14911d700 1 -- start start 2021-12-17T18:25:39.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc14911d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc1440b21f0 0x7fc14414aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc14911d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1440a7bb0 0x7fc144067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc14911d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1440b2ce0 con 0x7fc1440b1730 2021-12-17T18:25:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc14911d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc144147870 con 0x7fc1440b21f0 2021-12-17T18:25:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc14911d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1440b2f10 con 0x7fc1440a7bb0 2021-12-17T18:25:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc142d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc1440b21f0 0x7fc14414aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc142d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc1440b21f0 0x7fc14414aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53410/0 (socket says 172.21.15.62:53410) 2021-12-17T18:25:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc142d9d700 1 -- 172.21.15.62:0/1122685095 learned_addr learned my addr 172.21.15.62:0/1122685095 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:39.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc14359e700 1 --2- 172.21.15.62:0/1122685095 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1440a7bb0 0x7fc144067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:39.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc142d9d700 1 -- 172.21.15.62:0/1122685095 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1440a7bb0 msgr2=0x7fc144067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:39.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc142d9d700 1 --2- 172.21.15.62:0/1122685095 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1440a7bb0 0x7fc144067120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc142d9d700 1 -- 172.21.15.62:0/1122685095 >> v1:172.21.15.62:6789/0 conn(0x7fc1440b1730 legacy=0x7fc1440ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc141d9b700 1 -- 172.21.15.62:0/1122685095 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836927221 0 0) 0x7fc1440b2ce0 con 0x7fc1440b1730 2021-12-17T18:25:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc142d9d700 1 -- 172.21.15.62:0/1122685095 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1440aca60 con 0x7fc1440b21f0 2021-12-17T18:25:39.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc142d9d700 1 --2- 172.21.15.62:0/1122685095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1440b21f0 0x7fc14414aea0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fc1340032f0 tx=0x7fc134009290).ready entity=mon.0 client_cookie=7913886ffe7884d0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:39.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc141d9b700 1 -- 172.21.15.62:0/1122685095 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc13400b8a0 con 0x7fc1440b21f0 2021-12-17T18:25:39.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc141d9b700 1 -- 172.21.15.62:0/1122685095 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13400ba00 con 0x7fc1440b21f0 2021-12-17T18:25:39.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc141d9b700 1 -- 172.21.15.62:0/1122685095 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc13400bb70 con 0x7fc1440b21f0 2021-12-17T18:25:39.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc14911d700 1 -- 172.21.15.62:0/1122685095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1440b21f0 msgr2=0x7fc14414aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc14911d700 1 --2- 172.21.15.62:0/1122685095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1440b21f0 0x7fc14414aea0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fc1340032f0 tx=0x7fc134009290).stop 2021-12-17T18:25:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc14911d700 1 -- 172.21.15.62:0/1122685095 shutdown_connections 2021-12-17T18:25:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc14911d700 1 --2- 172.21.15.62:0/1122685095 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1440a7bb0 0x7fc144067120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc14911d700 1 --2- 172.21.15.62:0/1122685095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1440b21f0 0x7fc14414aea0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.860+0000 7fc14911d700 1 -- 172.21.15.62:0/1122685095 >> 172.21.15.62:0/1122685095 conn(0x7fc14405f730 msgr2=0x7fc14405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.864+0000 7fc14911d700 1 -- 172.21.15.62:0/1122685095 shutdown_connections 2021-12-17T18:25:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.864+0000 7fc14911d700 1 -- 172.21.15.62:0/1122685095 wait complete. 2021-12-17T18:25:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.864+0000 7fc14911d700 1 Processor -- start 2021-12-17T18:25:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.864+0000 7fc14911d700 1 -- start start 2021-12-17T18:25:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14911d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1440a7bb0 0x7fc1440a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14911d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1440b1730 0x7fc144146a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14911d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1440b21f0 0x7fc144146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14911d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14413a600 con 0x7fc1440b1730 2021-12-17T18:25:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14911d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1440aafd0 con 0x7fc1440a7bb0 2021-12-17T18:25:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14911d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1440b0ae0 con 0x7fc1440b21f0 2021-12-17T18:25:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1440b1730 0x7fc144146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc142d9d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1440a7bb0 0x7fc1440a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1440b21f0 0x7fc144146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1440b21f0 0x7fc144146f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:47122/0 (socket says 172.21.15.62:47122) 2021-12-17T18:25:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc142d9d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1440a7bb0 0x7fc1440a9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:59966/0 (socket says 172.21.15.62:59966) 2021-12-17T18:25:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1440b1730 0x7fc144146a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53418/0 (socket says 172.21.15.62:53418) 2021-12-17T18:25:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14359e700 1 -- 172.21.15.62:0/2379771167 learned_addr learned my addr 172.21.15.62:0/2379771167 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14259c700 1 -- 172.21.15.62:0/2379771167 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1440b21f0 msgr2=0x7fc144146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14259c700 1 --2- 172.21.15.62:0/2379771167 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1440b21f0 0x7fc144146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14259c700 1 -- 172.21.15.62:0/2379771167 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1440a7bb0 msgr2=0x7fc1440a9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14259c700 1 --2- 172.21.15.62:0/2379771167 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1440a7bb0 0x7fc1440a9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14259c700 1 -- 172.21.15.62:0/2379771167 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc134009530 con 0x7fc1440b1730 2021-12-17T18:25:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14359e700 1 --2- 172.21.15.62:0/2379771167 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1440b21f0 0x7fc144146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc142d9d700 1 --2- 172.21.15.62:0/2379771167 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1440a7bb0 0x7fc1440a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14259c700 1 --2- 172.21.15.62:0/2379771167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1440b1730 0x7fc144146a60 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7fc1440ab110 tx=0x7fc138007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc133fff700 1 -- 172.21.15.62:0/2379771167 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc138012400 con 0x7fc1440b1730 2021-12-17T18:25:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc133fff700 1 -- 172.21.15.62:0/2379771167 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc138012560 con 0x7fc1440b1730 2021-12-17T18:25:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14911d700 1 -- 172.21.15.62:0/2379771167 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1440aa5f0 con 0x7fc1440b1730 2021-12-17T18:25:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc133fff700 1 -- 172.21.15.62:0/2379771167 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1380128c0 con 0x7fc1440b1730 2021-12-17T18:25:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14911d700 1 -- 172.21.15.62:0/2379771167 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1440aab30 con 0x7fc1440b1730 2021-12-17T18:25:39.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.868+0000 7fc14911d700 1 -- 172.21.15.62:0/2379771167 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1440573d0 con 0x7fc1440b1730 2021-12-17T18:25:39.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.872+0000 7fc133fff700 1 -- 172.21.15.62:0/2379771167 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc138019030 con 0x7fc1440b1730 2021-12-17T18:25:39.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.872+0000 7fc133fff700 1 --2- 172.21.15.62:0/2379771167 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1200536a0 0x7fc120055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:39.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.872+0000 7fc133fff700 1 -- 172.21.15.62:0/2379771167 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fc13806a940 con 0x7fc1440b1730 2021-12-17T18:25:39.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.872+0000 7fc142d9d700 1 --2- 172.21.15.62:0/2379771167 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1200536a0 0x7fc120055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:39.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.872+0000 7fc142d9d700 1 --2- 172.21.15.62:0/2379771167 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1200536a0 0x7fc120055b60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fc13401b000 tx=0x7fc134016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:39.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:39.876+0000 7fc133fff700 1 -- 172.21.15.62:0/2379771167 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc138041d20 con 0x7fc1440b1730 2021-12-17T18:25:40.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.008+0000 7fc14911d700 1 -- 172.21.15.62:0/2379771167 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc1440af860 con 0x7fc1440b1730 2021-12-17T18:25:40.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.008+0000 7fc133fff700 1 -- 172.21.15.62:0/2379771167 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v84) v1 ==== 81+0+28876 (secure 0 0 0) 0x7fc1380280e0 con 0x7fc1440b1730 2021-12-17T18:25:40.015 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:40.015 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:25:40.016 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 84, 2021-12-17T18:25:40.016 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:25:40.016 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:25:40.016 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:25:37.282242+0000", 2021-12-17T18:25:40.017 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:25:40.017 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:25:40.017 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:25:40.017 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:25:40.017 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:25:40.018 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:25:40.018 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:25:40.018 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:25:40.018 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:25:40.019 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:40.019 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:25:40.019 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:25:40.019 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:25:40.020 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:25:40.020 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:25:40.020 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 16, 2021-12-17T18:25:40.020 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:25:40.021 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:25:40.021 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:25:40.021 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:25:40.021 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:25:40.021 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.022 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:25:40.022 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:25:40.022 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:25:40.022 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:25:40.023 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:25:40.023 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:25:40.023 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:25:40.023 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:25:40.024 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:25:40.024 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:25:40.024 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:25:40.024 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:25:40.025 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:25:40.025 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:25:40.025 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:25:40.026 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:25:40.026 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:25:40.026 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:25:40.026 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:25:40.027 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:25:40.027 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:25:40.027 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:25:40.027 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:25:40.028 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.028 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:25:40.028 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:25:40.028 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:25:40.029 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:25:40.029 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:25:40.029 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:25:40.030 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:25:40.030 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:25:40.030 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:25:40.030 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:25:40.031 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:25:40.031 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:25:40.031 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:25:40.032 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:25:40.032 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:25:40.032 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:25:40.032 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:25:40.033 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:25:40.033 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:25:40.033 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:25:40.033 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:25:40.033 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:25:40.034 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:25:40.034 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:25:40.034 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:25:40.034 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:25:40.035 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:25:40.035 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.035 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:25:40.035 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:25:40.036 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:25:40.036 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:25:40.036 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:25:40.037 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:25:40.037 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:25:40.037 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:25:40.037 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:25:40.038 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:25:40.038 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:25:40.038 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:25:40.038 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:25:40.039 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.039 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:25:40.039 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:25:40.040 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.040 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.040 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.041 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:25:40.041 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:25:40.041 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:25:40.041 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:25:40.041 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:25:40.042 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:25:40.042 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:25:40.042 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:25:40.042 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:25:40.043 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:25:40.043 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:25:40.043 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:25:40.043 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:25:40.044 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:25:40.044 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:25:40.044 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:25:40.044 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:25:40.045 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:25:40.045 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:25:40.045 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:25:40.046 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:25:40.046 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:25:40.046 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:25:40.046 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.046 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:25:40.047 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:25:40.047 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:25:40.047 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:25:40.047 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:25:40.048 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:25:40.048 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:25:40.048 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:25:40.049 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:25:40.049 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:25:40.049 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:25:40.050 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:25:40.050 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:25:40.050 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:25:40.050 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:25:40.051 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:25:40.051 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:25:40.051 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:25:40.051 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:25:40.052 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:25:40.052 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:25:40.052 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:25:40.052 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:25:40.053 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:25:40.053 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:25:40.053 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:25:40.053 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:25:40.053 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.054 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:25:40.054 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:25:40.054 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:25:40.054 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:25:40.055 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:25:40.055 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:25:40.055 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:25:40.055 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:25:40.056 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:25:40.056 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:25:40.056 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:25:40.056 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:25:40.056 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:25:40.057 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:25:40.057 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.057 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.057 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:40.058 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:25:40.058 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.058 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:25:40.058 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:25:40.059 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:40.059 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:40.059 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:40.060 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:40.060 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:40.060 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:40.060 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:40.061 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 79, 2021-12-17T18:25:40.061 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:40.061 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:40.061 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:40.062 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.062 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.062 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.062 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:25:40.063 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:40.063 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.063 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.063 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.063 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:25:40.064 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:40.064 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.064 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.064 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.065 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:40.065 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.065 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.065 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.066 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:25:40.066 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:40.066 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.066 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.067 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.067 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:25:40.067 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:40.068 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.068 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.068 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.069 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:40.069 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.069 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.070 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.070 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:25:40.070 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:40.070 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.071 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.071 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.071 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:25:40.071 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:40.072 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.072 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.072 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.072 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:40.073 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.073 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.073 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.073 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:25:40.074 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:40.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.074 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.074 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.075 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:25:40.075 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:40.075 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.075 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.076 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.076 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:25:40.076 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:25:40.076 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:25:40.076 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:25:40.077 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:40.077 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:40.077 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:40.077 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.078 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.078 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.078 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:25:40.079 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:25:40.079 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:40.079 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:40.079 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:40.080 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:40.080 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:40.080 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:40.081 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:40.081 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 78, 2021-12-17T18:25:40.081 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:40.081 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:40.082 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:40.082 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.082 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.082 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.082 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:25:40.083 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:40.083 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.083 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.083 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.084 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:25:40.084 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:40.084 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.084 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.085 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.085 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:40.085 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.085 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.086 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.086 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:25:40.086 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:40.086 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.086 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.087 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.087 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:25:40.087 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:40.087 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.088 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.088 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.088 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:40.088 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.089 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.089 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.089 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:25:40.090 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:40.090 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.090 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.091 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.091 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:25:40.091 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:40.091 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.092 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.092 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.092 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:40.092 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.092 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.093 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.093 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:25:40.093 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:40.093 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.094 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.094 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.094 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:25:40.094 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:40.095 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.095 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.095 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.095 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:25:40.096 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:25:40.096 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:25:40.096 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:25:40.096 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:40.097 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:40.097 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:40.097 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.097 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.098 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.098 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:25:40.098 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:25:40.099 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:40.099 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:40.099 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:40.100 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:40.100 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:40.100 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:40.100 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:40.100 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 79, 2021-12-17T18:25:40.101 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:40.101 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:40.101 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:40.101 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.102 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.102 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.102 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:25:40.102 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:40.103 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.103 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.103 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.103 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:25:40.104 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:40.104 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.104 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.104 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.105 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:40.105 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.105 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.105 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.105 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:25:40.106 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:40.106 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.106 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.106 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.107 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:25:40.107 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:40.107 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.107 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.108 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.108 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:40.108 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.109 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.109 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.109 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:25:40.110 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:40.110 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.110 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.110 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.111 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:25:40.111 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:40.111 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.111 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.112 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.112 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:40.112 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.112 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.112 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.113 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:25:40.113 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:40.113 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.113 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.114 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.114 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:25:40.114 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:40.114 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.115 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.115 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.115 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:25:40.115 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:25:40.116 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:25:40.116 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:25:40.116 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:40.116 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:40.117 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:40.117 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.117 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.117 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.118 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:25:40.118 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:25:40.118 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:40.119 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:40.119 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:40.119 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:40.120 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:40.120 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:40.120 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:40.120 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 79, 2021-12-17T18:25:40.120 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:40.121 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:40.121 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:40.121 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.121 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.122 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.122 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:25:40.122 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:40.122 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.123 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.123 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.123 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:25:40.123 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:40.123 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.124 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.124 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.124 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:40.124 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.125 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.125 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.125 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:25:40.125 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:40.125 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.126 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.126 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.126 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:25:40.126 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:40.127 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.127 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.127 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.128 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:40.128 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.128 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.128 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.129 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:25:40.129 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:40.129 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.130 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.130 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.130 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:25:40.130 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:40.131 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.131 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.131 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.131 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:40.132 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.132 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.132 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.132 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:25:40.132 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:40.133 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.133 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.133 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.133 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:25:40.134 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:40.134 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.134 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.134 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.135 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:25:40.135 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:25:40.135 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:25:40.135 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:25:40.136 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:40.136 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:40.136 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:40.136 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.136 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.137 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.137 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:25:40.137 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:25:40.138 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:40.138 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:40.138 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:40.138 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:40.139 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:40.139 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:40.139 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:40.140 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 79, 2021-12-17T18:25:40.140 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:40.140 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:40.140 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:40.140 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.141 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.141 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.141 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:25:40.141 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:40.142 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.142 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.142 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.142 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:25:40.143 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:40.143 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.143 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.143 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.144 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:40.144 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.144 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.144 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.144 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:25:40.145 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:40.145 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.145 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.145 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.146 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:25:40.146 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:40.146 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.146 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.147 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.147 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:40.147 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.147 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.148 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.148 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:25:40.148 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:40.149 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.149 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.149 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.150 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:25:40.150 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:40.150 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.150 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.150 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.151 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:40.151 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.151 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.151 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.152 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:25:40.152 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:40.152 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.152 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.153 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.153 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:25:40.153 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:40.153 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.154 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.154 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.154 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:25:40.154 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:25:40.155 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:25:40.155 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:25:40.155 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:40.155 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:40.155 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:40.156 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.156 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.156 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.156 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:25:40.157 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:25:40.157 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:40.157 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:40.157 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:40.158 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:40.158 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:40.158 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:40.159 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:40.159 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 79, 2021-12-17T18:25:40.159 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:40.159 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:40.160 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:40.160 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.160 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.160 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.161 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:25:40.161 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:40.161 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.161 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.162 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.162 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:25:40.162 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:40.162 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.163 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.163 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.163 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:40.163 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.163 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.164 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.164 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:25:40.164 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:40.164 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.165 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.165 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.165 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:25:40.165 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:40.166 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.166 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.166 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.166 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:40.167 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.167 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.167 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.167 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:25:40.168 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:40.168 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.168 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.168 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.169 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:25:40.169 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:40.169 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.170 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.170 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.170 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:40.170 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.171 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.171 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.171 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:25:40.171 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:40.172 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.172 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.172 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.172 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:25:40.172 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:40.173 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.173 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.173 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.173 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:25:40.174 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:25:40.174 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:25:40.174 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:25:40.174 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:40.175 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:40.175 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:40.175 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.175 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.176 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.176 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:25:40.176 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:25:40.176 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:40.176 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:40.177 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:40.177 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:40.177 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:40.177 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:40.178 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:40.178 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 79, 2021-12-17T18:25:40.178 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:40.179 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:40.179 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:40.179 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.180 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.180 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.180 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:25:40.180 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:40.181 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.181 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.181 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.181 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:25:40.181 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:40.182 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.182 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.182 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.182 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:40.183 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.183 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.183 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.183 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:25:40.184 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:40.184 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.184 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.184 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.184 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:25:40.185 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:40.185 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.185 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.185 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.186 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:40.186 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.186 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.186 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.187 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:25:40.187 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:40.187 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.187 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.188 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.188 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:25:40.188 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:40.188 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.189 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.189 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.189 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:40.190 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.190 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.190 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.190 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:25:40.191 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:40.191 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.191 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.191 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.192 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:25:40.192 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:40.192 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.192 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.192 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.193 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:25:40.193 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:25:40.193 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:25:40.193 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:25:40.194 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:40.194 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:40.194 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:40.194 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.194 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.195 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.195 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:25:40.195 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:25:40.195 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:40.196 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:40.196 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:40.196 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:40.196 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:40.197 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:40.197 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:40.197 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 69, 2021-12-17T18:25:40.197 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:40.198 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:40.198 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:40.198 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.199 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.199 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.199 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:25:40.199 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:40.200 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.200 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.200 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.200 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:25:40.201 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:40.201 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.201 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.201 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.202 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:40.202 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.202 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.202 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.203 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:25:40.203 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:40.203 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.203 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.204 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.204 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:25:40.204 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:40.204 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.204 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.205 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.205 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:40.205 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.205 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.206 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.206 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:25:40.206 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:40.206 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.207 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.207 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.207 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:25:40.208 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:40.208 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.208 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.209 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.209 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:40.209 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:40.209 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.209 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:40.210 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:25:40.210 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:40.210 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.210 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.211 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:40.211 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:25:40.211 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:40.211 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.212 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.212 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.212 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:25:40.212 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:25:40.213 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:25:40.213 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:25:40.213 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:40.213 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:40.213 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:40.214 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:40.214 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.214 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:40.214 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:25:40.215 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.215 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:25:40.215 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:40.215 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:40.216 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:40.216 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:40.216 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:40.216 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:25:40.217 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:40.217 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.217 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.217 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:25:40.218 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:40.218 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:40.218 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:40.219 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:40.219 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:40.219 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:25:40.220 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:40.220 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.220 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.220 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:25:40.221 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:40.221 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:40.221 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:40.221 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:40.222 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:40.222 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:25:40.222 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:40.222 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.223 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.223 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:25:40.223 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:40.223 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:40.224 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:40.224 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:40.224 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:40.224 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:25:40.225 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:40.225 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.225 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.225 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:25:40.226 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:40.226 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:40.226 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:40.226 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:40.226 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:40.227 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:25:40.227 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:40.227 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.227 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.228 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:25:40.228 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:40.228 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:40.229 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:40.229 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:40.229 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:40.229 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:25:40.230 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:40.230 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.230 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.230 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:25:40.231 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:40.231 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:40.231 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:40.231 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:40.232 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:40.232 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:25:40.232 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:40.232 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.233 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:40.233 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:25:40.233 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:40.233 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:40.234 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:40.234 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:40.234 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:40.234 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:25:40.235 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:40.235 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.235 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:40.235 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:25:40.235 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:25:40.236 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:25:40.236 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:25:40.236 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": { 2021-12-17T18:25:40.236 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6833/1765551619": "2021-12-18T18:25:33.265514+0000", 2021-12-17T18:25:40.237 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6832/1765551619": "2021-12-18T18:25:33.265514+0000" 2021-12-17T18:25:40.237 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.237 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:25:40.238 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:25:40.238 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:25:40.238 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:25:40.238 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:25:40.239 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:25:40.239 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:25:40.239 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:25:40.240 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:40.240 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:40.240 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:25:40.240 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:25:40.241 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:25:40.241 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:25:40.241 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:25:40.241 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:25:40.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.012+0000 7fc14911d700 1 -- 172.21.15.62:0/2379771167 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1200536a0 msgr2=0x7fc120055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:40.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.012+0000 7fc14911d700 1 --2- 172.21.15.62:0/2379771167 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1200536a0 0x7fc120055b60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fc13401b000 tx=0x7fc134016000).stop 2021-12-17T18:25:40.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.012+0000 7fc14911d700 1 -- 172.21.15.62:0/2379771167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1440b1730 msgr2=0x7fc144146a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:40.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.012+0000 7fc14911d700 1 --2- 172.21.15.62:0/2379771167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1440b1730 0x7fc144146a60 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7fc1440ab110 tx=0x7fc138007a00).stop 2021-12-17T18:25:40.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.012+0000 7fc14911d700 1 -- 172.21.15.62:0/2379771167 shutdown_connections 2021-12-17T18:25:40.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.012+0000 7fc14911d700 1 --2- 172.21.15.62:0/2379771167 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1200536a0 0x7fc120055b60 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.012+0000 7fc14911d700 1 --2- 172.21.15.62:0/2379771167 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1440b21f0 0x7fc144146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.012+0000 7fc14911d700 1 --2- 172.21.15.62:0/2379771167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1440b1730 0x7fc144146a60 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.012+0000 7fc14911d700 1 --2- 172.21.15.62:0/2379771167 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1440a7bb0 0x7fc1440a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.012+0000 7fc14911d700 1 -- 172.21.15.62:0/2379771167 >> 172.21.15.62:0/2379771167 conn(0x7fc14405f730 msgr2=0x7fc144148530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:40.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.012+0000 7fc14911d700 1 -- 172.21.15.62:0/2379771167 shutdown_connections 2021-12-17T18:25:40.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.012+0000 7fc14911d700 1 -- 172.21.15.62:0/2379771167 wait complete. 2021-12-17T18:25:40.248 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:40.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0cae6e700 1 Processor -- start 2021-12-17T18:25:40.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0cae6e700 1 -- start start 2021-12-17T18:25:40.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0cae6e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0c40b21f0 0x7fa0c414aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:40.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0cae6e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa0c40b1730 0x7fa0c40ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:40.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0cae6e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c40b2ce0 con 0x7fa0c40a7bb0 2021-12-17T18:25:40.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0cae6e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c4147870 con 0x7fa0c40b1730 2021-12-17T18:25:40.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0cae6e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40b2f10 con 0x7fa0c40b21f0 2021-12-17T18:25:40.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0c3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa0c40b1730 0x7fa0c40ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:40.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0c3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa0c40b1730 0x7fa0c40ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53424/0 (socket says 172.21.15.62:53424) 2021-12-17T18:25:40.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0c3fff700 1 -- 172.21.15.62:0/2225082540 learned_addr learned my addr 172.21.15.62:0/2225082540 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:40.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0c8c0a700 1 --2- 172.21.15.62:0/2225082540 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0c40b21f0 0x7fa0c414aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:40.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0c3fff700 1 -- 172.21.15.62:0/2225082540 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0c40b21f0 msgr2=0x7fa0c414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:40.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0c3fff700 1 --2- 172.21.15.62:0/2225082540 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0c40b21f0 0x7fa0c414aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0c3fff700 1 -- 172.21.15.62:0/2225082540 >> v1:172.21.15.109:6789/0 conn(0x7fa0c40a7bb0 legacy=0x7fa0c4067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:40.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0c3fff700 1 -- 172.21.15.62:0/2225082540 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c40aca60 con 0x7fa0c40b1730 2021-12-17T18:25:40.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0c8c0a700 1 --2- 172.21.15.62:0/2225082540 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0c40b21f0 0x7fa0c414aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:25:40.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0c3fff700 1 --2- 172.21.15.62:0/2225082540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40b1730 0x7fa0c40ace90 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7fa0b4002f70 tx=0x7fa0b4006eb0).ready entity=mon.0 client_cookie=f23d532d674e1e44 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:40.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0c37fe700 1 -- 172.21.15.62:0/2225082540 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0b400d5c0 con 0x7fa0c40b1730 2021-12-17T18:25:40.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0c37fe700 1 -- 172.21.15.62:0/2225082540 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b4000e90 con 0x7fa0c40b1730 2021-12-17T18:25:40.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0c37fe700 1 -- 172.21.15.62:0/2225082540 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0b400d950 con 0x7fa0c40b1730 2021-12-17T18:25:40.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0cae6e700 1 -- 172.21.15.62:0/2225082540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40b1730 msgr2=0x7fa0c40ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:40.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0cae6e700 1 --2- 172.21.15.62:0/2225082540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40b1730 0x7fa0c40ace90 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7fa0b4002f70 tx=0x7fa0b4006eb0).stop 2021-12-17T18:25:40.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0cae6e700 1 -- 172.21.15.62:0/2225082540 shutdown_connections 2021-12-17T18:25:40.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0cae6e700 1 --2- 172.21.15.62:0/2225082540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40b1730 0x7fa0c40ace90 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0cae6e700 1 --2- 172.21.15.62:0/2225082540 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0c40b21f0 0x7fa0c414aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0cae6e700 1 -- 172.21.15.62:0/2225082540 >> 172.21.15.62:0/2225082540 conn(0x7fa0c405f730 msgr2=0x7fa0c405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:40.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0cae6e700 1 -- 172.21.15.62:0/2225082540 shutdown_connections 2021-12-17T18:25:40.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.356+0000 7fa0cae6e700 1 -- 172.21.15.62:0/2225082540 wait complete. 2021-12-17T18:25:40.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.360+0000 7fa0cae6e700 1 Processor -- start 2021-12-17T18:25:40.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.360+0000 7fa0cae6e700 1 -- start start 2021-12-17T18:25:40.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0cae6e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0c40a7bb0 0x7fa0c414cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:40.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0cae6e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa0c40b1730 0x7fa0c414bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:40.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0cae6e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40b21f0 0x7fa0c4063a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:40.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0cae6e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40aa690 con 0x7fa0c40b21f0 2021-12-17T18:25:40.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0cae6e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c414dc40 con 0x7fa0c40b1730 2021-12-17T18:25:40.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0cae6e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c414c860 con 0x7fa0c40a7bb0 2021-12-17T18:25:40.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0c940b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40b21f0 0x7fa0c4063a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:40.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0c940b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40b21f0 0x7fa0c4063a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53434/0 (socket says 172.21.15.62:53434) 2021-12-17T18:25:40.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0c940b700 1 -- 172.21.15.62:0/2224862348 learned_addr learned my addr 172.21.15.62:0/2224862348 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:40.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0c3fff700 1 --2- 172.21.15.62:0/2224862348 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa0c40b1730 0x7fa0c414bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:40.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0c8c0a700 1 --2- 172.21.15.62:0/2224862348 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0c40a7bb0 0x7fa0c414cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:40.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0c940b700 1 -- 172.21.15.62:0/2224862348 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0c40a7bb0 msgr2=0x7fa0c414cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:40.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0c940b700 1 --2- 172.21.15.62:0/2224862348 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0c40a7bb0 0x7fa0c414cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0c940b700 1 -- 172.21.15.62:0/2224862348 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa0c40b1730 msgr2=0x7fa0c414bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:40.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0c940b700 1 --2- 172.21.15.62:0/2224862348 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa0c40b1730 0x7fa0c414bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0c940b700 1 -- 172.21.15.62:0/2224862348 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b400b1e0 con 0x7fa0c40b21f0 2021-12-17T18:25:40.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0c8c0a700 1 --2- 172.21.15.62:0/2224862348 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0c40a7bb0 0x7fa0c414cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:40.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0c940b700 1 --2- 172.21.15.62:0/2224862348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40b21f0 0x7fa0c4063a00 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fa0c4061080 tx=0x7fa0bc007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:40.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0c1ffb700 1 -- 172.21.15.62:0/2224862348 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0bc00f470 con 0x7fa0c40b21f0 2021-12-17T18:25:40.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0c1ffb700 1 -- 172.21.15.62:0/2224862348 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc00f5d0 con 0x7fa0c40b21f0 2021-12-17T18:25:40.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0cae6e700 1 -- 172.21.15.62:0/2224862348 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c40aa8c0 con 0x7fa0c40b21f0 2021-12-17T18:25:40.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0c1ffb700 1 -- 172.21.15.62:0/2224862348 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0bc00f930 con 0x7fa0c40b21f0 2021-12-17T18:25:40.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0cae6e700 1 -- 172.21.15.62:0/2224862348 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c40a9c50 con 0x7fa0c40b21f0 2021-12-17T18:25:40.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0cae6e700 1 -- 172.21.15.62:0/2224862348 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c40a9840 con 0x7fa0c40b21f0 2021-12-17T18:25:40.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.364+0000 7fa0c1ffb700 1 -- 172.21.15.62:0/2224862348 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa0bc019030 con 0x7fa0c40b21f0 2021-12-17T18:25:40.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.368+0000 7fa0c1ffb700 1 --2- 172.21.15.62:0/2224862348 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa0a4053580 0x7fa0a4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:40.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.368+0000 7fa0c1ffb700 1 -- 172.21.15.62:0/2224862348 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fa0bc06af00 con 0x7fa0c40b21f0 2021-12-17T18:25:40.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.368+0000 7fa0c8c0a700 1 --2- 172.21.15.62:0/2224862348 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa0a4053580 0x7fa0a4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:40.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.368+0000 7fa0c8c0a700 1 --2- 172.21.15.62:0/2224862348 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa0a4053580 0x7fa0a4055a40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fa0b800b000 tx=0x7fa0b8008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:40.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.372+0000 7fa0c1ffb700 1 -- 172.21.15.62:0/2224862348 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa0c40a9840 con 0x7fa0c40b21f0 2021-12-17T18:25:40.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.536+0000 7fa0cae6e700 1 -- 172.21.15.62:0/2224862348 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0c40ac7f0 con 0x7fa0c40b21f0 2021-12-17T18:25:40.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.540+0000 7fa0c1ffb700 1 -- 172.21.15.62:0/2224862348 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+1209 (secure 0 0 0) 0x7fa0c40ac7f0 con 0x7fa0c40b21f0 2021-12-17T18:25:40.545 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:40.545 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3760020760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3760020760},{"type":"v1","addr":"172.21.15.109:6835","nonce":3760020760}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35},{"gid":6963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6833/962750659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":962750659},{"type":"v1","addr":"172.21.15.62:6833","nonce":962750659}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":40}],"filesystems":[]} 2021-12-17T18:25:40.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.540+0000 7fa0cae6e700 1 -- 172.21.15.62:0/2224862348 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa0a4053580 msgr2=0x7fa0a4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:40.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.540+0000 7fa0cae6e700 1 --2- 172.21.15.62:0/2224862348 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa0a4053580 0x7fa0a4055a40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fa0b800b000 tx=0x7fa0b8008040).stop 2021-12-17T18:25:40.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.540+0000 7fa0cae6e700 1 -- 172.21.15.62:0/2224862348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40b21f0 msgr2=0x7fa0c4063a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:40.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.540+0000 7fa0cae6e700 1 --2- 172.21.15.62:0/2224862348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40b21f0 0x7fa0c4063a00 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fa0c4061080 tx=0x7fa0bc007f10).stop 2021-12-17T18:25:40.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.540+0000 7fa0cae6e700 1 -- 172.21.15.62:0/2224862348 shutdown_connections 2021-12-17T18:25:40.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.540+0000 7fa0cae6e700 1 --2- 172.21.15.62:0/2224862348 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa0a4053580 0x7fa0a4055a40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.540+0000 7fa0cae6e700 1 --2- 172.21.15.62:0/2224862348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40b21f0 0x7fa0c4063a00 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.540+0000 7fa0cae6e700 1 --2- 172.21.15.62:0/2224862348 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa0c40b1730 0x7fa0c414bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.540+0000 7fa0cae6e700 1 --2- 172.21.15.62:0/2224862348 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa0c40a7bb0 0x7fa0c414cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.540+0000 7fa0cae6e700 1 -- 172.21.15.62:0/2224862348 >> 172.21.15.62:0/2224862348 conn(0x7fa0c405f730 msgr2=0x7fa0c40afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:40.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.540+0000 7fa0cae6e700 1 -- 172.21.15.62:0/2224862348 shutdown_connections 2021-12-17T18:25:40.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.540+0000 7fa0cae6e700 1 -- 172.21.15.62:0/2224862348 wait complete. 2021-12-17T18:25:40.551 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 40 2021-12-17T18:25:40.562 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.660+0000 7f5df8840700 1 Processor -- start 2021-12-17T18:25:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.660+0000 7f5df8840700 1 -- start start 2021-12-17T18:25:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df8840700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5df40b1730 0x7f5df40ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df8840700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5df40a7bb0 0x7f5df4067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df8840700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df40b2ce0 con 0x7f5df40b21f0 2021-12-17T18:25:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df8840700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df414b5b0 con 0x7f5df40a7bb0 2021-12-17T18:25:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df8840700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df4147870 con 0x7f5df40b1730 2021-12-17T18:25:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df2d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5df40a7bb0 0x7f5df4067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df2d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5df40a7bb0 0x7f5df4067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53442/0 (socket says 172.21.15.62:53442) 2021-12-17T18:25:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df2d9d700 1 -- 172.21.15.62:0/1177042262 learned_addr learned my addr 172.21.15.62:0/1177042262 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df1d9b700 1 --2- 172.21.15.62:0/1177042262 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5df40b1730 0x7f5df40ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:40.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df2d9d700 1 -- 172.21.15.62:0/1177042262 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5df40b1730 msgr2=0x7f5df40ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:40.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df2d9d700 1 --2- 172.21.15.62:0/1177042262 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5df40b1730 0x7f5df40ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df2d9d700 1 -- 172.21.15.62:0/1177042262 >> v1:172.21.15.109:6789/0 conn(0x7f5df40b21f0 legacy=0x7f5df414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:40.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df2d9d700 1 -- 172.21.15.62:0/1177042262 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df40aca60 con 0x7f5df40a7bb0 2021-12-17T18:25:40.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df2d9d700 1 --2- 172.21.15.62:0/1177042262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df40a7bb0 0x7f5df4067120 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f5dec0032f0 tx=0x7f5dec009290).ready entity=mon.0 client_cookie=f47ce26013f45cab server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:40.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df159a700 1 -- 172.21.15.62:0/1177042262 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dec00b8a0 con 0x7f5df40a7bb0 2021-12-17T18:25:40.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df159a700 1 -- 172.21.15.62:0/1177042262 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec00ba00 con 0x7f5df40a7bb0 2021-12-17T18:25:40.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df159a700 1 -- 172.21.15.62:0/1177042262 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dec00bb70 con 0x7f5df40a7bb0 2021-12-17T18:25:40.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df8840700 1 -- 172.21.15.62:0/1177042262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df40a7bb0 msgr2=0x7f5df4067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:40.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df8840700 1 --2- 172.21.15.62:0/1177042262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df40a7bb0 0x7f5df4067120 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f5dec0032f0 tx=0x7f5dec009290).stop 2021-12-17T18:25:40.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df8840700 1 -- 172.21.15.62:0/1177042262 shutdown_connections 2021-12-17T18:25:40.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df8840700 1 --2- 172.21.15.62:0/1177042262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df40a7bb0 0x7f5df4067120 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df8840700 1 --2- 172.21.15.62:0/1177042262 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5df40b1730 0x7f5df40ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df8840700 1 -- 172.21.15.62:0/1177042262 >> 172.21.15.62:0/1177042262 conn(0x7f5df405f730 msgr2=0x7f5df405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df8840700 1 -- 172.21.15.62:0/1177042262 shutdown_connections 2021-12-17T18:25:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.664+0000 7f5df8840700 1 -- 172.21.15.62:0/1177042262 wait complete. 2021-12-17T18:25:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.668+0000 7f5df8840700 1 Processor -- start 2021-12-17T18:25:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.668+0000 7f5df8840700 1 -- start start 2021-12-17T18:25:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.668+0000 7f5df8840700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5df40a7bb0 0x7f5df40aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.668+0000 7f5df8840700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df40b1730 0x7f5df40ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:40.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.668+0000 7f5df8840700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5df40b21f0 0x7f5df4063ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:40.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.668+0000 7f5df8840700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df40ab770 con 0x7f5df40b1730 2021-12-17T18:25:40.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.668+0000 7f5df8840700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df40638b0 con 0x7f5df40a7bb0 2021-12-17T18:25:40.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.668+0000 7f5df8840700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df40ab990 con 0x7f5df40b21f0 2021-12-17T18:25:40.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.668+0000 7f5df1d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df40b1730 0x7f5df40ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:40.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.668+0000 7f5df259c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5df40a7bb0 0x7f5df40aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:40.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.668+0000 7f5df1d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df40b1730 0x7f5df40ab280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53448/0 (socket says 172.21.15.62:53448) 2021-12-17T18:25:40.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.668+0000 7f5df1d9b700 1 -- 172.21.15.62:0/652882654 learned_addr learned my addr 172.21.15.62:0/652882654 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:40.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.668+0000 7f5df2d9d700 1 --2- 172.21.15.62:0/652882654 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5df40b21f0 0x7f5df4063ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:40.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.672+0000 7f5df1d9b700 1 -- 172.21.15.62:0/652882654 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5df40b21f0 msgr2=0x7f5df4063ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:40.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.672+0000 7f5df1d9b700 1 --2- 172.21.15.62:0/652882654 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5df40b21f0 0x7f5df4063ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.672+0000 7f5df1d9b700 1 -- 172.21.15.62:0/652882654 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5df40a7bb0 msgr2=0x7f5df40aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:40.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.672+0000 7f5df1d9b700 1 --2- 172.21.15.62:0/652882654 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5df40a7bb0 0x7f5df40aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.672+0000 7f5df1d9b700 1 -- 172.21.15.62:0/652882654 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec009530 con 0x7f5df40b1730 2021-12-17T18:25:40.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.672+0000 7f5df1d9b700 1 --2- 172.21.15.62:0/652882654 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df40b1730 0x7f5df40ab280 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f5de400a000 tx=0x7f5de4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:40.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.672+0000 7f5de37fe700 1 -- 172.21.15.62:0/652882654 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5de4011780 con 0x7f5df40b1730 2021-12-17T18:25:40.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.672+0000 7f5de37fe700 1 -- 172.21.15.62:0/652882654 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de40118e0 con 0x7f5df40b1730 2021-12-17T18:25:40.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.672+0000 7f5df8840700 1 -- 172.21.15.62:0/652882654 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df40abc30 con 0x7f5df40b1730 2021-12-17T18:25:40.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.672+0000 7f5de37fe700 1 -- 172.21.15.62:0/652882654 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5de4011c40 con 0x7f5df40b1730 2021-12-17T18:25:40.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.672+0000 7f5df8840700 1 -- 172.21.15.62:0/652882654 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df4067050 con 0x7f5df40b1730 2021-12-17T18:25:40.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.672+0000 7f5df8840700 1 -- 172.21.15.62:0/652882654 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df40b2f10 con 0x7f5df40b1730 2021-12-17T18:25:40.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.672+0000 7f5de37fe700 1 -- 172.21.15.62:0/652882654 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5de4012420 con 0x7f5df40b1730 2021-12-17T18:25:40.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.676+0000 7f5de37fe700 1 --2- 172.21.15.62:0/652882654 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5dd00536a0 0x7f5dd0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:40.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.676+0000 7f5de37fe700 1 -- 172.21.15.62:0/652882654 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f5de406b540 con 0x7f5df40b1730 2021-12-17T18:25:40.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.676+0000 7f5df259c700 1 --2- 172.21.15.62:0/652882654 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5dd00536a0 0x7f5dd0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:40.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.676+0000 7f5df259c700 1 --2- 172.21.15.62:0/652882654 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5dd00536a0 0x7f5dd0055b60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f5de800d000 tx=0x7f5de8007b70).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:40.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.680+0000 7f5de37fe700 1 -- 172.21.15.62:0/652882654 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5de4042810 con 0x7f5df40b1730 2021-12-17T18:25:40.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.844+0000 7f5df8840700 1 -- 172.21.15.62:0/652882654 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5df40573d0 con 0x7f5df40b1730 2021-12-17T18:25:40.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.844+0000 7f5de37fe700 1 -- 172.21.15.62:0/652882654 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+1209 (secure 0 0 0) 0x7f5de4045e30 con 0x7f5df40b1730 2021-12-17T18:25:40.850 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:40.850 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3760020760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3760020760},{"type":"v1","addr":"172.21.15.109:6835","nonce":3760020760}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35},{"gid":6963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6833/962750659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":962750659},{"type":"v1","addr":"172.21.15.62:6833","nonce":962750659}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":40}],"filesystems":[]} 2021-12-17T18:25:40.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.848+0000 7f5df8840700 1 -- 172.21.15.62:0/652882654 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5dd00536a0 msgr2=0x7f5dd0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:40.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.848+0000 7f5df8840700 1 --2- 172.21.15.62:0/652882654 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5dd00536a0 0x7f5dd0055b60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f5de800d000 tx=0x7f5de8007b70).stop 2021-12-17T18:25:40.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.848+0000 7f5df8840700 1 -- 172.21.15.62:0/652882654 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df40b1730 msgr2=0x7f5df40ab280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:40.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.848+0000 7f5df8840700 1 --2- 172.21.15.62:0/652882654 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df40b1730 0x7f5df40ab280 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f5de400a000 tx=0x7f5de4008040).stop 2021-12-17T18:25:40.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.848+0000 7f5df8840700 1 -- 172.21.15.62:0/652882654 shutdown_connections 2021-12-17T18:25:40.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.848+0000 7f5df8840700 1 --2- 172.21.15.62:0/652882654 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5dd00536a0 0x7f5dd0055b60 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.848+0000 7f5df8840700 1 --2- 172.21.15.62:0/652882654 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5df40b21f0 0x7f5df4063ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.848+0000 7f5df8840700 1 --2- 172.21.15.62:0/652882654 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df40b1730 0x7f5df40ab280 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.848+0000 7f5df8840700 1 --2- 172.21.15.62:0/652882654 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5df40a7bb0 0x7f5df40aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.848+0000 7f5df8840700 1 -- 172.21.15.62:0/652882654 >> 172.21.15.62:0/652882654 conn(0x7f5df405f730 msgr2=0x7f5df41479c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:40.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.848+0000 7f5df8840700 1 -- 172.21.15.62:0/652882654 shutdown_connections 2021-12-17T18:25:40.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.848+0000 7f5df8840700 1 -- 172.21.15.62:0/652882654 wait complete. 2021-12-17T18:25:40.856 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 40 2021-12-17T18:25:40.867 INFO:tasks.ceph.mds.a:Restarting daemon 2021-12-17T18:25:40.867 INFO:tasks.ceph.mds.a:Stopping old one... 2021-12-17T18:25:40.868 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-12-17T18:25:40.868 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:25:40.869 INFO:tasks.ceph.mds.b:Restarting daemon 2021-12-17T18:25:40.869 INFO:tasks.ceph.mds.b:Stopping old one... 2021-12-17T18:25:40.869 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-12-17T18:25:40.869 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:25:40.878 INFO:tasks.ceph.mds.a:Stopped 2021-12-17T18:25:40.878 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-12-17T18:25:40.881 INFO:tasks.ceph.mds.a:Started 2021-12-17T18:25:40.881 DEBUG:teuthology.parallel:result is None 2021-12-17T18:25:40.884 INFO:tasks.ceph.mds.b:Stopped 2021-12-17T18:25:40.885 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-12-17T18:25:40.887 INFO:tasks.ceph.mds.b:Started 2021-12-17T18:25:40.888 DEBUG:teuthology.parallel:result is None 2021-12-17T18:25:40.888 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-12-17T18:25:40.947 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:25:40.963 INFO:tasks.ceph.mds.b.smithi109.stdout:starting mds.b at 2021-12-17T18:25:40.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.980+0000 7ff180b0f700 1 Processor -- start 2021-12-17T18:25:40.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.980+0000 7ff180b0f700 1 -- start start 2021-12-17T18:25:40.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.980+0000 7ff180b0f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff17c0b6610 0x7ff17c0641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:40.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.980+0000 7ff180b0f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff17c140bf0 0x7ff17c141080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:40.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.980+0000 7ff180b0f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17c067c70 con 0x7ff17c0ad0a0 2021-12-17T18:25:40.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.980+0000 7ff180b0f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17c141570 con 0x7ff17c0b6610 2021-12-17T18:25:40.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.980+0000 7ff180b0f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c0b69f0 con 0x7ff17c140bf0 2021-12-17T18:25:40.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff17b7fe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff17c0b6610 0x7ff17c0641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:40.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff17affd700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7ff17c0ad0a0 0x7ff17c144ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:53366/0 (socket says 172.21.15.62:53366) 2021-12-17T18:25:40.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff17affd700 1 -- 172.21.15.62:0/1152094847 learned_addr learned my addr 172.21.15.62:0/1152094847 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:40.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff17bfff700 1 --2- 172.21.15.62:0/1152094847 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff17c140bf0 0x7ff17c141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:40.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff17a7fc700 1 -- 172.21.15.62:0/1152094847 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925924157 0 0) 0x7ff17c067c70 con 0x7ff17c0ad0a0 2021-12-17T18:25:40.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff17a7fc700 1 -- 172.21.15.62:0/1152094847 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff168003260 con 0x7ff17c0ad0a0 2021-12-17T18:25:40.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff17bfff700 1 -- 172.21.15.62:0/1152094847 >> v2:172.21.15.109:3300/0 conn(0x7ff17c0b6610 msgr2=0x7ff17c0641f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:40.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff17bfff700 1 --2- 172.21.15.62:0/1152094847 >> v2:172.21.15.109:3300/0 conn(0x7ff17c0b6610 0x7ff17c0641f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff17bfff700 1 -- 172.21.15.62:0/1152094847 >> v1:172.21.15.109:6789/0 conn(0x7ff17c0ad0a0 legacy=0x7ff17c144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:40.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff17bfff700 1 -- 172.21.15.62:0/1152094847 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c1441c0 con 0x7ff17c140bf0 2021-12-17T18:25:40.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff17b7fe700 1 --2- 172.21.15.62:0/1152094847 >> v2:172.21.15.109:3300/0 conn(0x7ff17c0b6610 0x7ff17c0641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:40.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff17bfff700 1 --2- 172.21.15.62:0/1152094847 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff17c140bf0 0x7ff17c141080 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7ff1740032f0 tx=0x7ff1740091d0).ready entity=mon.2 client_cookie=f2c71bca10ca734 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:40.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff17a7fc700 1 -- 172.21.15.62:0/1152094847 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff17400b600 con 0x7ff17c140bf0 2021-12-17T18:25:40.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff17a7fc700 1 -- 172.21.15.62:0/1152094847 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17400b760 con 0x7ff17c140bf0 2021-12-17T18:25:40.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff17a7fc700 1 -- 172.21.15.62:0/1152094847 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff17400b8d0 con 0x7ff17c140bf0 2021-12-17T18:25:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff180b0f700 1 -- 172.21.15.62:0/1152094847 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff17c140bf0 msgr2=0x7ff17c141080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff180b0f700 1 --2- 172.21.15.62:0/1152094847 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff17c140bf0 0x7ff17c141080 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7ff1740032f0 tx=0x7ff1740091d0).stop 2021-12-17T18:25:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff180b0f700 1 -- 172.21.15.62:0/1152094847 shutdown_connections 2021-12-17T18:25:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff180b0f700 1 --2- 172.21.15.62:0/1152094847 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff17c140bf0 0x7ff17c141080 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff180b0f700 1 --2- 172.21.15.62:0/1152094847 >> v2:172.21.15.109:3300/0 conn(0x7ff17c0b6610 0x7ff17c0641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:40.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff180b0f700 1 -- 172.21.15.62:0/1152094847 >> 172.21.15.62:0/1152094847 conn(0x7ff17c05d1c0 msgr2=0x7ff17c0b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:40.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff180b0f700 1 -- 172.21.15.62:0/1152094847 shutdown_connections 2021-12-17T18:25:40.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.984+0000 7ff180b0f700 1 -- 172.21.15.62:0/1152094847 wait complete. 2021-12-17T18:25:40.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff180b0f700 1 Processor -- start 2021-12-17T18:25:40.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff180b0f700 1 -- start start 2021-12-17T18:25:40.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff180b0f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff17c0ad0a0 0x7ff17c140330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:41.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff180b0f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff17c0b6610 0x7ff17c150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:41.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff180b0f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff17c140bf0 0x7ff17c067050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:41.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff180b0f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c09f260 con 0x7ff17c0ad0a0 2021-12-17T18:25:41.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff180b0f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c1533a0 con 0x7ff17c140bf0 2021-12-17T18:25:41.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff180b0f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c150d50 con 0x7ff17c0b6610 2021-12-17T18:25:41.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff17b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff17c0ad0a0 0x7ff17c140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:41.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff17b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff17c0ad0a0 0x7ff17c140330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53470/0 (socket says 172.21.15.62:53470) 2021-12-17T18:25:41.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff17b7fe700 1 -- 172.21.15.62:0/3720714456 learned_addr learned my addr 172.21.15.62:0/3720714456 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:41.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff17affd700 1 --2- 172.21.15.62:0/3720714456 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff17c0b6610 0x7ff17c150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff17bfff700 1 --2- 172.21.15.62:0/3720714456 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff17c140bf0 0x7ff17c067050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff17b7fe700 1 -- 172.21.15.62:0/3720714456 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff17c0b6610 msgr2=0x7ff17c150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff17b7fe700 1 --2- 172.21.15.62:0/3720714456 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff17c0b6610 0x7ff17c150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff17b7fe700 1 -- 172.21.15.62:0/3720714456 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff17c140bf0 msgr2=0x7ff17c067050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:41.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff17b7fe700 1 --2- 172.21.15.62:0/3720714456 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff17c140bf0 0x7ff17c067050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:41.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff17b7fe700 1 -- 172.21.15.62:0/3720714456 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c00b180 con 0x7ff17c0ad0a0 2021-12-17T18:25:41.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff17b7fe700 1 --2- 172.21.15.62:0/3720714456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff17c0ad0a0 0x7ff17c140330 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7ff16c00c000 tx=0x7ff16c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:41.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff178ff9700 1 -- 172.21.15.62:0/3720714456 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff16c00c5f0 con 0x7ff17c0ad0a0 2021-12-17T18:25:41.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff180b0f700 1 -- 172.21.15.62:0/3720714456 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff174009470 con 0x7ff17c0ad0a0 2021-12-17T18:25:41.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff178ff9700 1 -- 172.21.15.62:0/3720714456 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c00c750 con 0x7ff17c0ad0a0 2021-12-17T18:25:41.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff178ff9700 1 -- 172.21.15.62:0/3720714456 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff16c00cab0 con 0x7ff17c0ad0a0 2021-12-17T18:25:41.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.988+0000 7ff180b0f700 1 -- 172.21.15.62:0/3720714456 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17c0657d0 con 0x7ff17c0ad0a0 2021-12-17T18:25:41.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.992+0000 7ff180b0f700 1 -- 172.21.15.62:0/3720714456 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17c144460 con 0x7ff17c0ad0a0 2021-12-17T18:25:41.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.992+0000 7ff178ff9700 1 -- 172.21.15.62:0/3720714456 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff16c00cc10 con 0x7ff17c0ad0a0 2021-12-17T18:25:41.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.992+0000 7ff178ff9700 1 --2- 172.21.15.62:0/3720714456 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff15c053610 0x7ff15c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:41.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.992+0000 7ff178ff9700 1 -- 172.21.15.62:0/3720714456 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5339+0+0 (secure 0 0 0) 0x7ff16c06bbd0 con 0x7ff17c0ad0a0 2021-12-17T18:25:41.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.992+0000 7ff17affd700 1 --2- 172.21.15.62:0/3720714456 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff15c053610 0x7ff15c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:41.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:40.992+0000 7ff17affd700 1 --2- 172.21.15.62:0/3720714456 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff15c053610 0x7ff15c055ad0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7ff17000d000 tx=0x7ff170009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:41.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:41.000+0000 7ff178ff9700 1 -- 172.21.15.62:0/3720714456 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff16c046e60 con 0x7ff17c0ad0a0 2021-12-17T18:25:41.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:41.136+0000 7ff180b0f700 1 -- 172.21.15.62:0/3720714456 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7ff17c0573d0 con 0x7ff17c0ad0a0 2021-12-17T18:25:41.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:41.964+0000 7ff178ff9700 1 -- 172.21.15.62:0/3720714456 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v86) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff16c042f70 con 0x7ff17c0ad0a0 2021-12-17T18:25:41.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:41.968+0000 7ff180b0f700 1 -- 172.21.15.62:0/3720714456 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff15c053610 msgr2=0x7ff15c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:41.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:41.968+0000 7ff180b0f700 1 --2- 172.21.15.62:0/3720714456 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff15c053610 0x7ff15c055ad0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7ff17000d000 tx=0x7ff170009040).stop 2021-12-17T18:25:41.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:41.968+0000 7ff180b0f700 1 -- 172.21.15.62:0/3720714456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff17c0ad0a0 msgr2=0x7ff17c140330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:41.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:41.968+0000 7ff180b0f700 1 --2- 172.21.15.62:0/3720714456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff17c0ad0a0 0x7ff17c140330 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7ff16c00c000 tx=0x7ff16c006df0).stop 2021-12-17T18:25:41.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:41.968+0000 7ff180b0f700 1 -- 172.21.15.62:0/3720714456 shutdown_connections 2021-12-17T18:25:41.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:41.968+0000 7ff180b0f700 1 --2- 172.21.15.62:0/3720714456 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff15c053610 0x7ff15c055ad0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:41.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:41.968+0000 7ff180b0f700 1 --2- 172.21.15.62:0/3720714456 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff17c140bf0 0x7ff17c067050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:41.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:41.968+0000 7ff180b0f700 1 --2- 172.21.15.62:0/3720714456 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff17c0b6610 0x7ff17c150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:41.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:41.968+0000 7ff180b0f700 1 --2- 172.21.15.62:0/3720714456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff17c0ad0a0 0x7ff17c140330 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:41.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:41.968+0000 7ff180b0f700 1 -- 172.21.15.62:0/3720714456 >> 172.21.15.62:0/3720714456 conn(0x7ff17c05d1c0 msgr2=0x7ff17c05fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:41.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:41.968+0000 7ff180b0f700 1 -- 172.21.15.62:0/3720714456 shutdown_connections 2021-12-17T18:25:41.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:41.968+0000 7ff180b0f700 1 -- 172.21.15.62:0/3720714456 wait complete. 2021-12-17T18:25:41.978 INFO:teuthology.orchestra.run.smithi062.stderr: removed all blacklist entries 2021-12-17T18:25:41.989 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-12-17T18:25:41.990 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-12-17T18:25:42.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f08266fe700 1 Processor -- start 2021-12-17T18:25:42.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f08266fe700 1 -- start start 2021-12-17T18:25:42.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f08266fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b2a40 0x7f08200afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f08266fe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f082013cd40 0x7f082013d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f08266fe700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08200b2e20 con 0x7f082013fe00 2021-12-17T18:25:42.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f08266fe700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08200ae860 con 0x7f082013cd40 2021-12-17T18:25:42.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f08266fe700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0820143800 con 0x7f08200b2a40 2021-12-17T18:25:42.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f0824efb700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f082013cd40 0x7f082013d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f08256fc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b2a40 0x7f08200afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f0825efd700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f082013fe00 0x7f0820140220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:53382/0 (socket says 172.21.15.62:53382) 2021-12-17T18:25:42.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f0824efb700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f082013cd40 0x7f082013d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:60034/0 (socket says 172.21.15.62:60034) 2021-12-17T18:25:42.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f0825efd700 1 -- 172.21.15.62:0/2724421686 learned_addr learned my addr 172.21.15.62:0/2724421686 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:42.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f08256fc700 1 -- 172.21.15.62:0/2724421686 >> v2:172.21.15.109:3300/0 conn(0x7f082013cd40 msgr2=0x7f082013d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:42.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f08256fc700 1 --2- 172.21.15.62:0/2724421686 >> v2:172.21.15.109:3300/0 conn(0x7f082013cd40 0x7f082013d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f08256fc700 1 -- 172.21.15.62:0/2724421686 >> v1:172.21.15.109:6789/0 conn(0x7f082013fe00 legacy=0x7f0820140220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f08256fc700 1 -- 172.21.15.62:0/2724421686 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0820143aa0 con 0x7f08200b2a40 2021-12-17T18:25:42.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f0824efb700 1 --2- 172.21.15.62:0/2724421686 >> v2:172.21.15.109:3300/0 conn(0x7f082013cd40 0x7f082013d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:42.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.096+0000 7f08256fc700 1 --2- 172.21.15.62:0/2724421686 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b2a40 0x7f08200afcf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f081c0032f0 tx=0x7f081c0091d0).ready entity=mon.2 client_cookie=73c1a1c78bc39926 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:42.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.100+0000 7f080ffff700 1 -- 172.21.15.62:0/2724421686 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f081c00b6c0 con 0x7f08200b2a40 2021-12-17T18:25:42.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.100+0000 7f080ffff700 1 -- 172.21.15.62:0/2724421686 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c00b820 con 0x7f08200b2a40 2021-12-17T18:25:42.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.100+0000 7f080ffff700 1 -- 172.21.15.62:0/2724421686 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f081c00b990 con 0x7f08200b2a40 2021-12-17T18:25:42.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.100+0000 7f08266fe700 1 -- 172.21.15.62:0/2724421686 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b2a40 msgr2=0x7f08200afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.100+0000 7f08266fe700 1 --2- 172.21.15.62:0/2724421686 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b2a40 0x7f08200afcf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f081c0032f0 tx=0x7f081c0091d0).stop 2021-12-17T18:25:42.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.100+0000 7f08266fe700 1 -- 172.21.15.62:0/2724421686 shutdown_connections 2021-12-17T18:25:42.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.100+0000 7f08266fe700 1 --2- 172.21.15.62:0/2724421686 >> v2:172.21.15.109:3300/0 conn(0x7f082013cd40 0x7f082013d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.100+0000 7f08266fe700 1 --2- 172.21.15.62:0/2724421686 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f08200b2a40 0x7f08200afcf0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.100+0000 7f08266fe700 1 -- 172.21.15.62:0/2724421686 >> 172.21.15.62:0/2724421686 conn(0x7f082005c750 msgr2=0x7f082005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:42.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.100+0000 7f08266fe700 1 -- 172.21.15.62:0/2724421686 shutdown_connections 2021-12-17T18:25:42.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.100+0000 7f08266fe700 1 -- 172.21.15.62:0/2724421686 wait complete. 2021-12-17T18:25:42.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f08266fe700 1 Processor -- start 2021-12-17T18:25:42.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f08266fe700 1 -- start start 2021-12-17T18:25:42.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f08266fe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f08200b2a40 0x7f08200b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f08266fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f082013cd40 0x7f08201211c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f08266fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f082013fe00 0x7f0820153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f08266fe700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0820067640 con 0x7f082013fe00 2021-12-17T18:25:42.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f08266fe700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08200678e0 con 0x7f08200b2a40 2021-12-17T18:25:42.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f08266fe700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0820153860 con 0x7f082013cd40 2021-12-17T18:25:42.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f0825efd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f082013fe00 0x7f0820153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f0825efd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f082013fe00 0x7f0820153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53490/0 (socket says 172.21.15.62:53490) 2021-12-17T18:25:42.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f08256fc700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f08200b2a40 0x7f08200b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f0825efd700 1 -- 172.21.15.62:0/3431083230 learned_addr learned my addr 172.21.15.62:0/3431083230 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:42.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f0824efb700 1 --2- 172.21.15.62:0/3431083230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f082013cd40 0x7f08201211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f0825efd700 1 -- 172.21.15.62:0/3431083230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f082013cd40 msgr2=0x7f08201211c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f0825efd700 1 --2- 172.21.15.62:0/3431083230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f082013cd40 0x7f08201211c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f0825efd700 1 -- 172.21.15.62:0/3431083230 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f08200b2a40 msgr2=0x7f08200b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f0825efd700 1 --2- 172.21.15.62:0/3431083230 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f08200b2a40 0x7f08200b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f0825efd700 1 -- 172.21.15.62:0/3431083230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081000b180 con 0x7f082013fe00 2021-12-17T18:25:42.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f08256fc700 1 --2- 172.21.15.62:0/3431083230 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f08200b2a40 0x7f08200b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:42.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f0825efd700 1 --2- 172.21.15.62:0/3431083230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f082013fe00 0x7f0820153d00 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f08200b3430 tx=0x7f0818007b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:42.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f080e7fc700 1 -- 172.21.15.62:0/3431083230 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08180070d0 con 0x7f082013fe00 2021-12-17T18:25:42.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.104+0000 7f080e7fc700 1 -- 172.21.15.62:0/3431083230 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0818007230 con 0x7f082013fe00 2021-12-17T18:25:42.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.108+0000 7f08266fe700 1 -- 172.21.15.62:0/3431083230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f081c009470 con 0x7f082013fe00 2021-12-17T18:25:42.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.108+0000 7f080e7fc700 1 -- 172.21.15.62:0/3431083230 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0818005610 con 0x7f082013fe00 2021-12-17T18:25:42.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.108+0000 7f08266fe700 1 -- 172.21.15.62:0/3431083230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08200672e0 con 0x7f082013fe00 2021-12-17T18:25:42.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.108+0000 7f080e7fc700 1 -- 172.21.15.62:0/3431083230 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0818010070 con 0x7f082013fe00 2021-12-17T18:25:42.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.108+0000 7f080e7fc700 1 --2- 172.21.15.62:0/3431083230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0800053640 0x7f0800055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.108+0000 7f080e7fc700 1 -- 172.21.15.62:0/3431083230 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f081806aa30 con 0x7f082013fe00 2021-12-17T18:25:42.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.108+0000 7f08266fe700 1 -- 172.21.15.62:0/3431083230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0820153a20 con 0x7f082013fe00 2021-12-17T18:25:42.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.108+0000 7f08256fc700 1 --2- 172.21.15.62:0/3431083230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0800053640 0x7f0800055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.108+0000 7f08256fc700 1 --2- 172.21.15.62:0/3431083230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0800053640 0x7f0800055b00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f081c01b000 tx=0x7f081c016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:42.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.116+0000 7f080e7fc700 1 -- 172.21.15.62:0/3431083230 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0818018030 con 0x7f082013fe00 2021-12-17T18:25:42.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.288+0000 7f08266fe700 1 -- 172.21.15.62:0/3431083230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0820143d40 con 0x7f082013fe00 2021-12-17T18:25:42.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.288+0000 7f080e7fc700 1 -- 172.21.15.62:0/3431083230 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v28) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f0818041ec0 con 0x7f082013fe00 2021-12-17T18:25:42.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:42.294 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:25:42.294 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_dump": [ 2021-12-17T18:25:42.295 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:42.295 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.a", 2021-12-17T18:25:42.295 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhxCS0LBAAtUlkgWYg4l3fQ2au7jMUDg==", 2021-12-17T18:25:42.295 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:42.296 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:25:42.296 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:42.296 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:42.296 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:42.297 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:42.297 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:42.297 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:42.297 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.b", 2021-12-17T18:25:42.297 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhoRJAMxAAP/NmDQRwJjYip2rxJsQlYg==", 2021-12-17T18:25:42.298 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:42.298 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:25:42.298 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:42.299 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:42.299 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:42.299 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:42.299 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:42.300 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:42.300 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.0", 2021-12-17T18:25:42.300 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBA1LxhJXzhKhAAUnxP3G5VuATkQLoDALFjVg==", 2021-12-17T18:25:42.300 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:42.301 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:42.301 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:42.301 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:42.301 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:42.301 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:42.302 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:42.302 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.1", 2021-12-17T18:25:42.302 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBD1LxhregUDhAABrxQ2jQ4BwXvuWh/D9SkbQ==", 2021-12-17T18:25:42.302 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:42.303 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:42.303 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:42.303 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:42.303 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:42.303 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:42.304 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:42.304 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.2", 2021-12-17T18:25:42.304 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBF1LxhOo/SLhAAhQQLW/VKFx1sgm8chnD5tw==", 2021-12-17T18:25:42.304 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:42.305 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:42.305 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:42.305 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:42.305 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:42.305 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:42.306 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:42.306 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.3", 2021-12-17T18:25:42.306 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBI1LxhT2ZQExAA999j8V5bJAJ2PuaQqSkUOw==", 2021-12-17T18:25:42.306 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:42.307 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:42.307 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:42.307 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:42.307 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:42.308 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:42.308 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:42.308 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.4", 2021-12-17T18:25:42.308 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBN1LxhKBDzFhAAKmPF0FXnnfXtweo+6z9nxg==", 2021-12-17T18:25:42.309 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:42.309 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:42.309 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:42.309 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:42.309 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:42.310 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:42.310 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:42.310 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.5", 2021-12-17T18:25:42.311 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBP1LxhtqkAORAAVaFLVNIUMs4Sytk8WRaGNA==", 2021-12-17T18:25:42.311 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:42.311 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:42.311 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:42.312 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:42.312 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:42.312 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:42.312 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:42.312 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.6", 2021-12-17T18:25:42.313 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBS1LxhNtncGhAAgG64g1ie54CDp9Y7uldKQA==", 2021-12-17T18:25:42.313 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:42.313 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:42.313 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:42.314 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:42.314 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:42.314 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:42.314 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:42.315 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.7", 2021-12-17T18:25:42.315 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBV1Lxh3DcDABAAHVskSVtoEJ8BxCCAs3ZDVA==", 2021-12-17T18:25:42.315 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:42.315 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:42.315 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:42.316 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:42.316 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:42.316 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:42.316 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:42.317 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.0", 2021-12-17T18:25:42.317 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxh9QhCNxAALkWTJorDpbt9yrikL7/NWg==", 2021-12-17T18:25:42.317 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:42.317 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:25:42.317 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:25:42.318 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:25:42.318 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:42.318 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:42.318 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:42.319 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.1", 2021-12-17T18:25:42.319 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxhxm52OxAAbqXVaqRDmt4Ezj9xyCEODQ==", 2021-12-17T18:25:42.319 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:42.319 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:25:42.320 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:25:42.320 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:25:42.320 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:42.320 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:42.320 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:42.321 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.2", 2021-12-17T18:25:42.321 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+1LxhXu08BBAATRcUAZvMNg9ou4PLszDtmA==", 2021-12-17T18:25:42.321 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:42.322 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:25:42.322 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:25:42.322 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:25:42.322 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:42.323 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:42.323 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:42.323 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.admin", 2021-12-17T18:25:42.323 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhyAGlDRAA2ggSG5yBBFbMgK2fCBk2mQ==", 2021-12-17T18:25:42.324 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:42.324 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:25:42.324 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:25:42.324 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:25:42.325 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:42.325 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:42.325 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:42.325 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:42.325 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.x", 2021-12-17T18:25:42.326 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhzvntKRAAFQlg69Z6d2nWX0GxSshsMw==", 2021-12-17T18:25:42.326 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:42.326 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:25:42.326 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:25:42.327 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:42.327 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:42.327 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:42.327 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:42.328 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.y", 2021-12-17T18:25:42.328 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhKdTGJRAArzUN3A1U5Efw0NG9Gw2Gcw==", 2021-12-17T18:25:42.328 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:25:42.328 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:25:42.328 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:25:42.329 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:25:42.329 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:42.329 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:42.329 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:42.330 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:25:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.288+0000 7f08266fe700 1 -- 172.21.15.62:0/3431083230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0800053640 msgr2=0x7f0800055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.288+0000 7f08266fe700 1 --2- 172.21.15.62:0/3431083230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0800053640 0x7f0800055b00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f081c01b000 tx=0x7f081c016000).stop 2021-12-17T18:25:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.288+0000 7f08266fe700 1 -- 172.21.15.62:0/3431083230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f082013fe00 msgr2=0x7f0820153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.288+0000 7f08266fe700 1 --2- 172.21.15.62:0/3431083230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f082013fe00 0x7f0820153d00 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f08200b3430 tx=0x7f0818007b80).stop 2021-12-17T18:25:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.292+0000 7f08266fe700 1 -- 172.21.15.62:0/3431083230 shutdown_connections 2021-12-17T18:25:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.292+0000 7f08266fe700 1 --2- 172.21.15.62:0/3431083230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0800053640 0x7f0800055b00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.292+0000 7f08266fe700 1 --2- 172.21.15.62:0/3431083230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f082013fe00 0x7f0820153d00 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.292+0000 7f08266fe700 1 --2- 172.21.15.62:0/3431083230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f082013cd40 0x7f08201211c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.292+0000 7f08266fe700 1 --2- 172.21.15.62:0/3431083230 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f08200b2a40 0x7f08200b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.292+0000 7f08266fe700 1 -- 172.21.15.62:0/3431083230 >> 172.21.15.62:0/3431083230 conn(0x7f082005c750 msgr2=0x7f0820142b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.292+0000 7f08266fe700 1 -- 172.21.15.62:0/3431083230 shutdown_connections 2021-12-17T18:25:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.292+0000 7f08266fe700 1 -- 172.21.15.62:0/3431083230 wait complete. 2021-12-17T18:25:42.336 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:25:42.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.436+0000 7f7007e2f700 1 Processor -- start 2021-12-17T18:25:42.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.436+0000 7f7007e2f700 1 -- start start 2021-12-17T18:25:42.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7007e2f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f70000aee10 0x7f70000b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7007e2f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7000144fa0 0x7f70001406d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7007e2f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70000a8e00 con 0x7f70000aaca0 2021-12-17T18:25:42.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7007e2f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70000a90a0 con 0x7f70000aee10 2021-12-17T18:25:42.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7007e2f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70000af8b0 con 0x7f7000144fa0 2021-12-17T18:25:42.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7005bcb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f70000aee10 0x7f70000b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f70053ca700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f70000aaca0 0x7f7000144890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37074/0 (socket says 172.21.15.62:37074) 2021-12-17T18:25:42.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f70053ca700 1 -- 172.21.15.62:0/2322456505 learned_addr learned my addr 172.21.15.62:0/2322456505 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:42.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f70063cc700 1 --2- 172.21.15.62:0/2322456505 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7000144fa0 0x7f70001406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7004bc9700 1 -- 172.21.15.62:0/2322456505 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812925016 0 0) 0x7f70000a8e00 con 0x7f70000aaca0 2021-12-17T18:25:42.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7005bcb700 1 -- 172.21.15.62:0/2322456505 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7000144fa0 msgr2=0x7f70001406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:42.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7005bcb700 1 --2- 172.21.15.62:0/2322456505 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7000144fa0 0x7f70001406d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7005bcb700 1 -- 172.21.15.62:0/2322456505 >> v1:172.21.15.62:6789/0 conn(0x7f70000aaca0 legacy=0x7f7000144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7005bcb700 1 -- 172.21.15.62:0/2322456505 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70000b2da0 con 0x7f70000aee10 2021-12-17T18:25:42.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7005bcb700 1 --2- 172.21.15.62:0/2322456505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70000aee10 0x7f70000b1610 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f6ff0002f70 tx=0x7f6ff0006df0).ready entity=mon.0 client_cookie=a378c3a48d086fec server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:42.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7004bc9700 1 -- 172.21.15.62:0/2322456505 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ff000d570 con 0x7f70000aee10 2021-12-17T18:25:42.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7004bc9700 1 -- 172.21.15.62:0/2322456505 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff0000e90 con 0x7f70000aee10 2021-12-17T18:25:42.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7004bc9700 1 -- 172.21.15.62:0/2322456505 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ff000d8c0 con 0x7f70000aee10 2021-12-17T18:25:42.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7007e2f700 1 -- 172.21.15.62:0/2322456505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70000aee10 msgr2=0x7f70000b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7007e2f700 1 --2- 172.21.15.62:0/2322456505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70000aee10 0x7f70000b1610 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f6ff0002f70 tx=0x7f6ff0006df0).stop 2021-12-17T18:25:42.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7007e2f700 1 -- 172.21.15.62:0/2322456505 shutdown_connections 2021-12-17T18:25:42.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7007e2f700 1 --2- 172.21.15.62:0/2322456505 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7000144fa0 0x7f70001406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7007e2f700 1 --2- 172.21.15.62:0/2322456505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70000aee10 0x7f70000b1610 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7007e2f700 1 -- 172.21.15.62:0/2322456505 >> 172.21.15.62:0/2322456505 conn(0x7f700005f730 msgr2=0x7f700005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:42.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7007e2f700 1 -- 172.21.15.62:0/2322456505 shutdown_connections 2021-12-17T18:25:42.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.440+0000 7f7007e2f700 1 -- 172.21.15.62:0/2322456505 wait complete. 2021-12-17T18:25:42.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7007e2f700 1 Processor -- start 2021-12-17T18:25:42.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7007e2f700 1 -- start start 2021-12-17T18:25:42.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7007e2f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70000aaca0 0x7f70001437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7007e2f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f70000aee10 0x7f7000064090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7007e2f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7000144fa0 0x7f7000064580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7007e2f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70000ad8e0 con 0x7f70000aaca0 2021-12-17T18:25:42.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7007e2f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70001474f0 con 0x7f70000aee10 2021-12-17T18:25:42.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7007e2f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7000147990 con 0x7f7000144fa0 2021-12-17T18:25:42.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7005bcb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70000aaca0 0x7f70001437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7005bcb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70000aaca0 0x7f70001437a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53500/0 (socket says 172.21.15.62:53500) 2021-12-17T18:25:42.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7005bcb700 1 -- 172.21.15.62:0/881318628 learned_addr learned my addr 172.21.15.62:0/881318628 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:42.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f70063cc700 1 --2- 172.21.15.62:0/881318628 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7000144fa0 0x7f7000064580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f70053ca700 1 --2- 172.21.15.62:0/881318628 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f70000aee10 0x7f7000064090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7005bcb700 1 -- 172.21.15.62:0/881318628 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7000144fa0 msgr2=0x7f7000064580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7005bcb700 1 --2- 172.21.15.62:0/881318628 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7000144fa0 0x7f7000064580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7005bcb700 1 -- 172.21.15.62:0/881318628 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f70000aee10 msgr2=0x7f7000064090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7005bcb700 1 --2- 172.21.15.62:0/881318628 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f70000aee10 0x7f7000064090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7005bcb700 1 -- 172.21.15.62:0/881318628 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff000b180 con 0x7f70000aaca0 2021-12-17T18:25:42.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7005bcb700 1 --2- 172.21.15.62:0/881318628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70000aaca0 0x7f70001437a0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f6ff0002f70 tx=0x7f6ff0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:42.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f6feeffd700 1 -- 172.21.15.62:0/881318628 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ff0006a60 con 0x7f70000aaca0 2021-12-17T18:25:42.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f6feeffd700 1 -- 172.21.15.62:0/881318628 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff000d8f0 con 0x7f70000aaca0 2021-12-17T18:25:42.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7007e2f700 1 -- 172.21.15.62:0/881318628 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7000066990 con 0x7f70000aaca0 2021-12-17T18:25:42.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f6feeffd700 1 -- 172.21.15.62:0/881318628 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ff0011d70 con 0x7f70000aaca0 2021-12-17T18:25:42.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.444+0000 7f7007e2f700 1 -- 172.21.15.62:0/881318628 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70000acb30 con 0x7f70000aaca0 2021-12-17T18:25:42.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.448+0000 7f7007e2f700 1 -- 172.21.15.62:0/881318628 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70001476b0 con 0x7f70000aaca0 2021-12-17T18:25:42.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.448+0000 7f6feeffd700 1 -- 172.21.15.62:0/881318628 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6ff0025030 con 0x7f70000aaca0 2021-12-17T18:25:42.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.448+0000 7f6feeffd700 1 --2- 172.21.15.62:0/881318628 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6fe0053610 0x7f6fe0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.448+0000 7f6feeffd700 1 -- 172.21.15.62:0/881318628 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6ff006c690 con 0x7f70000aaca0 2021-12-17T18:25:42.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.448+0000 7f70053ca700 1 --2- 172.21.15.62:0/881318628 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6fe0053610 0x7f6fe0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.448+0000 7f70053ca700 1 --2- 172.21.15.62:0/881318628 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6fe0053610 0x7f6fe0055ad0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f6ffc00d000 tx=0x7f6ffc007c20).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:42.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.452+0000 7f6feeffd700 1 -- 172.21.15.62:0/881318628 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6ff0043b20 con 0x7f70000aaca0 2021-12-17T18:25:42.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.580+0000 7f7007e2f700 1 -- 172.21.15.62:0/881318628 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7000145410 con 0x7f70000aaca0 2021-12-17T18:25:42.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.580+0000 7f6feeffd700 1 -- 172.21.15.62:0/881318628 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+13230 (secure 0 0 0) 0x7f6ff0023070 con 0x7f70000aaca0 2021-12-17T18:25:42.587 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:42.588 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":86,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:25:41.959332+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:25:42.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.584+0000 7f7007e2f700 1 -- 172.21.15.62:0/881318628 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6fe0053610 msgr2=0x7f6fe0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.584+0000 7f7007e2f700 1 --2- 172.21.15.62:0/881318628 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6fe0053610 0x7f6fe0055ad0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f6ffc00d000 tx=0x7f6ffc007c20).stop 2021-12-17T18:25:42.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.584+0000 7f7007e2f700 1 -- 172.21.15.62:0/881318628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70000aaca0 msgr2=0x7f70001437a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.584+0000 7f7007e2f700 1 --2- 172.21.15.62:0/881318628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70000aaca0 0x7f70001437a0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f6ff0002f70 tx=0x7f6ff0015000).stop 2021-12-17T18:25:42.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.584+0000 7f7007e2f700 1 -- 172.21.15.62:0/881318628 shutdown_connections 2021-12-17T18:25:42.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.584+0000 7f7007e2f700 1 --2- 172.21.15.62:0/881318628 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6fe0053610 0x7f6fe0055ad0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.584+0000 7f7007e2f700 1 --2- 172.21.15.62:0/881318628 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7000144fa0 0x7f7000064580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.584+0000 7f7007e2f700 1 --2- 172.21.15.62:0/881318628 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f70000aee10 0x7f7000064090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.584+0000 7f7007e2f700 1 --2- 172.21.15.62:0/881318628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70000aaca0 0x7f70001437a0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.584+0000 7f7007e2f700 1 -- 172.21.15.62:0/881318628 >> 172.21.15.62:0/881318628 conn(0x7f700005f730 msgr2=0x7f700006ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:42.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.584+0000 7f7007e2f700 1 -- 172.21.15.62:0/881318628 shutdown_connections 2021-12-17T18:25:42.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.584+0000 7f7007e2f700 1 -- 172.21.15.62:0/881318628 wait complete. 2021-12-17T18:25:42.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-12-17T18:25:42.602 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:25:42.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a40809700 1 Processor -- start 2021-12-17T18:25:42.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a40809700 1 -- start start 2021-12-17T18:25:42.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a40809700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5a3c0b4a40 0x7f5a3c0b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a40809700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3c0b46a0 con 0x7f5a3c0b23d0 2021-12-17T18:25:42.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a40809700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3c05ce70 con 0x7f5a3c05ca90 2021-12-17T18:25:42.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a40809700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3c0b0ff0 con 0x7f5a3c0b4a40 2021-12-17T18:25:42.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a32ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5a3c0b4a40 0x7f5a3c0b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a32ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5a3c0b4a40 0x7f5a3c0b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53510/0 (socket says 172.21.15.62:53510) 2021-12-17T18:25:42.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a3bfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5a3c0b23d0 0x7f5a3c1467a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37092/0 (socket says 172.21.15.62:37092) 2021-12-17T18:25:42.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a32ffd700 1 -- 172.21.15.62:0/288154842 learned_addr learned my addr 172.21.15.62:0/288154842 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:42.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a32ffd700 1 -- 172.21.15.62:0/288154842 >> v1:172.21.15.109:6789/0 conn(0x7f5a3c05ca90 legacy=0x7f5a3c14ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a3affd700 1 -- 172.21.15.62:0/288154842 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395074920 0 0) 0x7f5a3c0b46a0 con 0x7f5a3c0b23d0 2021-12-17T18:25:42.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a32ffd700 1 -- 172.21.15.62:0/288154842 >> v1:172.21.15.62:6789/0 conn(0x7f5a3c0b23d0 legacy=0x7f5a3c1467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a32ffd700 1 -- 172.21.15.62:0/288154842 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c0b4230 con 0x7f5a3c0b4a40 2021-12-17T18:25:42.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a32ffd700 1 --2- 172.21.15.62:0/288154842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3c0b4a40 0x7f5a3c0b37a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f5a3c0b4500 tx=0x7f5a24006eb0).ready entity=mon.0 client_cookie=a1c802929d2468fc server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:42.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a3affd700 1 -- 172.21.15.62:0/288154842 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a2400d660 con 0x7f5a3c0b4a40 2021-12-17T18:25:42.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a3affd700 1 -- 172.21.15.62:0/288154842 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a24000e90 con 0x7f5a3c0b4a40 2021-12-17T18:25:42.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.704+0000 7f5a3affd700 1 -- 172.21.15.62:0/288154842 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a2400d9b0 con 0x7f5a3c0b4a40 2021-12-17T18:25:42.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.708+0000 7f5a40809700 1 -- 172.21.15.62:0/288154842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3c0b4a40 msgr2=0x7f5a3c0b37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.708+0000 7f5a40809700 1 --2- 172.21.15.62:0/288154842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3c0b4a40 0x7f5a3c0b37a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f5a3c0b4500 tx=0x7f5a24006eb0).stop 2021-12-17T18:25:42.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.708+0000 7f5a40809700 1 -- 172.21.15.62:0/288154842 shutdown_connections 2021-12-17T18:25:42.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.708+0000 7f5a40809700 1 --2- 172.21.15.62:0/288154842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3c0b4a40 0x7f5a3c0b37a0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.708+0000 7f5a40809700 1 -- 172.21.15.62:0/288154842 >> 172.21.15.62:0/288154842 conn(0x7f5a3c05bcd0 msgr2=0x7f5a3c062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:42.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.708+0000 7f5a40809700 1 -- 172.21.15.62:0/288154842 shutdown_connections 2021-12-17T18:25:42.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.708+0000 7f5a40809700 1 -- 172.21.15.62:0/288154842 wait complete. 2021-12-17T18:25:42.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.708+0000 7f5a40809700 1 Processor -- start 2021-12-17T18:25:42.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.708+0000 7f5a40809700 1 -- start start 2021-12-17T18:25:42.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a40809700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3c05ca90 0x7f5a3c0b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a40809700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5a3c0b23d0 0x7f5a3c157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a40809700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5a3c0b4a40 0x7f5a3c157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a40809700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c064800 con 0x7f5a3c05ca90 2021-12-17T18:25:42.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a40809700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c064aa0 con 0x7f5a3c0b23d0 2021-12-17T18:25:42.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a40809700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c157b20 con 0x7f5a3c0b4a40 2021-12-17T18:25:42.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a3b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3c05ca90 0x7f5a3c0b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a3b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3c05ca90 0x7f5a3c0b6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53514/0 (socket says 172.21.15.62:53514) 2021-12-17T18:25:42.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a3b7fe700 1 -- 172.21.15.62:0/3024944832 learned_addr learned my addr 172.21.15.62:0/3024944832 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:42.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a32ffd700 1 --2- 172.21.15.62:0/3024944832 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5a3c0b23d0 0x7f5a3c157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a3bfff700 1 --2- 172.21.15.62:0/3024944832 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5a3c0b4a40 0x7f5a3c157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a3b7fe700 1 -- 172.21.15.62:0/3024944832 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5a3c0b4a40 msgr2=0x7f5a3c157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a3b7fe700 1 --2- 172.21.15.62:0/3024944832 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5a3c0b4a40 0x7f5a3c157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a3b7fe700 1 -- 172.21.15.62:0/3024944832 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5a3c0b23d0 msgr2=0x7f5a3c157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a3b7fe700 1 --2- 172.21.15.62:0/3024944832 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5a3c0b23d0 0x7f5a3c157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a3b7fe700 1 -- 172.21.15.62:0/3024944832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2400b1e0 con 0x7f5a3c05ca90 2021-12-17T18:25:42.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a32ffd700 1 --2- 172.21.15.62:0/3024944832 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5a3c0b23d0 0x7f5a3c157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:42.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a3b7fe700 1 --2- 172.21.15.62:0/3024944832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3c05ca90 0x7f5a3c0b6610 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f5a3c0b1c90 tx=0x7f5a2c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:42.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a397fa700 1 -- 172.21.15.62:0/3024944832 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a2c00ce30 con 0x7f5a3c05ca90 2021-12-17T18:25:42.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a397fa700 1 -- 172.21.15.62:0/3024944832 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c00f470 con 0x7f5a3c05ca90 2021-12-17T18:25:42.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a397fa700 1 -- 172.21.15.62:0/3024944832 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a2c00f7d0 con 0x7f5a3c05ca90 2021-12-17T18:25:42.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a40809700 1 -- 172.21.15.62:0/3024944832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3c156c30 con 0x7f5a3c05ca90 2021-12-17T18:25:42.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a40809700 1 -- 172.21.15.62:0/3024944832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3c14dc50 con 0x7f5a3c05ca90 2021-12-17T18:25:42.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.712+0000 7f5a40809700 1 -- 172.21.15.62:0/3024944832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3c0829b0 con 0x7f5a3c05ca90 2021-12-17T18:25:42.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.716+0000 7f5a397fa700 1 -- 172.21.15.62:0/3024944832 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5a2c019030 con 0x7f5a3c05ca90 2021-12-17T18:25:42.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.716+0000 7f5a397fa700 1 --2- 172.21.15.62:0/3024944832 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5a200536a0 0x7f5a20055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.716+0000 7f5a397fa700 1 -- 172.21.15.62:0/3024944832 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5a2c06aa70 con 0x7f5a3c05ca90 2021-12-17T18:25:42.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.716+0000 7f5a32ffd700 1 --2- 172.21.15.62:0/3024944832 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5a200536a0 0x7f5a20055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.716+0000 7f5a32ffd700 1 --2- 172.21.15.62:0/3024944832 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5a200536a0 0x7f5a20055b60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f5a24019000 tx=0x7f5a24015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:42.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.724+0000 7f5a397fa700 1 -- 172.21.15.62:0/3024944832 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5a3c0829b0 con 0x7f5a3c05ca90 2021-12-17T18:25:42.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.852+0000 7f5a40809700 1 -- 172.21.15.62:0/3024944832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5a3c0829b0 con 0x7f5a3c05ca90 2021-12-17T18:25:42.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.852+0000 7f5a397fa700 1 -- 172.21.15.62:0/3024944832 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v86) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5a3c0829b0 con 0x7f5a3c05ca90 2021-12-17T18:25:42.859 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:25:42.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.856+0000 7f5a40809700 1 -- 172.21.15.62:0/3024944832 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5a200536a0 msgr2=0x7f5a20055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.856+0000 7f5a40809700 1 --2- 172.21.15.62:0/3024944832 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5a200536a0 0x7f5a20055b60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f5a24019000 tx=0x7f5a24015000).stop 2021-12-17T18:25:42.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.856+0000 7f5a40809700 1 -- 172.21.15.62:0/3024944832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3c05ca90 msgr2=0x7f5a3c0b6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.856+0000 7f5a40809700 1 --2- 172.21.15.62:0/3024944832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3c05ca90 0x7f5a3c0b6610 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f5a3c0b1c90 tx=0x7f5a2c007c50).stop 2021-12-17T18:25:42.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.856+0000 7f5a40809700 1 -- 172.21.15.62:0/3024944832 shutdown_connections 2021-12-17T18:25:42.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.856+0000 7f5a40809700 1 --2- 172.21.15.62:0/3024944832 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5a200536a0 0x7f5a20055b60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.856+0000 7f5a40809700 1 --2- 172.21.15.62:0/3024944832 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5a3c0b4a40 0x7f5a3c157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.856+0000 7f5a40809700 1 --2- 172.21.15.62:0/3024944832 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5a3c0b23d0 0x7f5a3c157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.856+0000 7f5a40809700 1 --2- 172.21.15.62:0/3024944832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3c05ca90 0x7f5a3c0b6610 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.856+0000 7f5a40809700 1 -- 172.21.15.62:0/3024944832 >> 172.21.15.62:0/3024944832 conn(0x7f5a3c05bcd0 msgr2=0x7f5a3c147f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:42.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.856+0000 7f5a40809700 1 -- 172.21.15.62:0/3024944832 shutdown_connections 2021-12-17T18:25:42.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.856+0000 7f5a40809700 1 -- 172.21.15.62:0/3024944832 wait complete. 2021-12-17T18:25:42.871 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:25:42.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.976+0000 7fc459ffa700 1 Processor -- start 2021-12-17T18:25:42.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.976+0000 7fc459ffa700 1 -- start start 2021-12-17T18:25:42.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.976+0000 7fc459ffa700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc45405c750 0x7fc45405cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.976+0000 7fc459ffa700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc454060260 0x7fc454146f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.976+0000 7fc459ffa700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc4541439d0 0x7fc4540b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.976+0000 7fc459ffa700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc454142ff0 con 0x7fc45405c750 2021-12-17T18:25:42.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.976+0000 7fc459ffa700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc454143290 con 0x7fc454060260 2021-12-17T18:25:42.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.976+0000 7fc459ffa700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc454143530 con 0x7fc4541439d0 2021-12-17T18:25:42.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.976+0000 7fc4537fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc45405c750 0x7fc45405cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.976+0000 7fc4537fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc45405c750 0x7fc45405cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53522/0 (socket says 172.21.15.62:53522) 2021-12-17T18:25:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.976+0000 7fc4537fe700 1 -- 172.21.15.62:0/151629518 learned_addr learned my addr 172.21.15.62:0/151629518 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.976+0000 7fc44affd700 1 --2- 172.21.15.62:0/151629518 >> v2:172.21.15.109:3300/0 conn(0x7fc454060260 0x7fc454146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.976+0000 7fc453fff700 1 --2- 172.21.15.62:0/151629518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc4541439d0 0x7fc4540b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc4537fe700 1 -- 172.21.15.62:0/151629518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc4541439d0 msgr2=0x7fc4540b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:42.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc4537fe700 1 --2- 172.21.15.62:0/151629518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc4541439d0 0x7fc4540b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc4537fe700 1 -- 172.21.15.62:0/151629518 >> v2:172.21.15.109:3300/0 conn(0x7fc454060260 msgr2=0x7fc454146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:42.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc4537fe700 1 --2- 172.21.15.62:0/151629518 >> v2:172.21.15.109:3300/0 conn(0x7fc454060260 0x7fc454146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc4537fe700 1 -- 172.21.15.62:0/151629518 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc454143e40 con 0x7fc45405c750 2021-12-17T18:25:42.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc44affd700 1 --2- 172.21.15.62:0/151629518 >> v2:172.21.15.109:3300/0 conn(0x7fc454060260 0x7fc454146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:42.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc4537fe700 1 --2- 172.21.15.62:0/151629518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc45405c750 0x7fc45405cb30 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7fc444002f70 tx=0x7fc444006eb0).ready entity=mon.0 client_cookie=b90f41804cf07ba9 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:42.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc452ffd700 1 -- 172.21.15.62:0/151629518 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc44400d570 con 0x7fc45405c750 2021-12-17T18:25:42.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc452ffd700 1 -- 172.21.15.62:0/151629518 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc444000e90 con 0x7fc45405c750 2021-12-17T18:25:42.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc452ffd700 1 -- 172.21.15.62:0/151629518 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc44400d900 con 0x7fc45405c750 2021-12-17T18:25:42.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc459ffa700 1 -- 172.21.15.62:0/151629518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc45405c750 msgr2=0x7fc45405cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc459ffa700 1 --2- 172.21.15.62:0/151629518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc45405c750 0x7fc45405cb30 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7fc444002f70 tx=0x7fc444006eb0).stop 2021-12-17T18:25:42.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc459ffa700 1 -- 172.21.15.62:0/151629518 shutdown_connections 2021-12-17T18:25:42.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc459ffa700 1 --2- 172.21.15.62:0/151629518 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc4541439d0 0x7fc4540b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc459ffa700 1 --2- 172.21.15.62:0/151629518 >> v2:172.21.15.109:3300/0 conn(0x7fc454060260 0x7fc454146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc459ffa700 1 --2- 172.21.15.62:0/151629518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc45405c750 0x7fc45405cb30 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc459ffa700 1 -- 172.21.15.62:0/151629518 >> 172.21.15.62:0/151629518 conn(0x7fc454062430 msgr2=0x7fc454062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:42.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc459ffa700 1 -- 172.21.15.62:0/151629518 shutdown_connections 2021-12-17T18:25:42.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc459ffa700 1 -- 172.21.15.62:0/151629518 wait complete. 2021-12-17T18:25:42.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc459ffa700 1 Processor -- start 2021-12-17T18:25:42.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.980+0000 7fc459ffa700 1 -- start start 2021-12-17T18:25:42.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc459ffa700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc45405c750 0x7fc454064ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc459ffa700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc454060260 0x7fc454065390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc459ffa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4541439d0 0x7fc454152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:42.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc459ffa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc454066fb0 con 0x7fc4541439d0 2021-12-17T18:25:42.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc459ffa700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4541524f0 con 0x7fc45405c750 2021-12-17T18:25:42.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc459ffa700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4540671e0 con 0x7fc454060260 2021-12-17T18:25:42.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc453fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4541439d0 0x7fc454152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc453fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4541439d0 0x7fc454152bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53532/0 (socket says 172.21.15.62:53532) 2021-12-17T18:25:42.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc453fff700 1 -- 172.21.15.62:0/481450982 learned_addr learned my addr 172.21.15.62:0/481450982 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:42.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc4537fe700 1 --2- 172.21.15.62:0/481450982 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc45405c750 0x7fc454064ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc44affd700 1 --2- 172.21.15.62:0/481450982 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc454060260 0x7fc454065390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:42.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc453fff700 1 -- 172.21.15.62:0/481450982 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc454060260 msgr2=0x7fc454065390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc453fff700 1 --2- 172.21.15.62:0/481450982 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc454060260 0x7fc454065390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc453fff700 1 -- 172.21.15.62:0/481450982 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc45405c750 msgr2=0x7fc454064ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:42.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc453fff700 1 --2- 172.21.15.62:0/481450982 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc45405c750 0x7fc454064ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:42.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc453fff700 1 -- 172.21.15.62:0/481450982 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c00b180 con 0x7fc4541439d0 2021-12-17T18:25:42.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc453fff700 1 --2- 172.21.15.62:0/481450982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4541439d0 0x7fc454152bd0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7fc44c006e00 tx=0x7fc44c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:42.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc4517fa700 1 -- 172.21.15.62:0/481450982 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc44c012600 con 0x7fc4541439d0 2021-12-17T18:25:42.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc4517fa700 1 -- 172.21.15.62:0/481450982 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c012760 con 0x7fc4541439d0 2021-12-17T18:25:42.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc4517fa700 1 -- 172.21.15.62:0/481450982 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc44c012ac0 con 0x7fc4541439d0 2021-12-17T18:25:43.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc459ffa700 1 -- 172.21.15.62:0/481450982 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44400b1e0 con 0x7fc4541439d0 2021-12-17T18:25:43.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc459ffa700 1 -- 172.21.15.62:0/481450982 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc454063f50 con 0x7fc4541439d0 2021-12-17T18:25:43.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.984+0000 7fc459ffa700 1 -- 172.21.15.62:0/481450982 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4540573d0 con 0x7fc4541439d0 2021-12-17T18:25:43.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.988+0000 7fc4517fa700 1 -- 172.21.15.62:0/481450982 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc44c022070 con 0x7fc4541439d0 2021-12-17T18:25:43.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.988+0000 7fc4517fa700 1 --2- 172.21.15.62:0/481450982 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc42c0534f0 0x7fc42c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.988+0000 7fc4517fa700 1 -- 172.21.15.62:0/481450982 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc44c06bb90 con 0x7fc4541439d0 2021-12-17T18:25:43.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.988+0000 7fc4537fe700 1 --2- 172.21.15.62:0/481450982 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc42c0534f0 0x7fc42c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.988+0000 7fc4537fe700 1 --2- 172.21.15.62:0/481450982 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc42c0534f0 0x7fc42c0559b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fc44401c000 tx=0x7fc444015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:43.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:42.992+0000 7fc4517fa700 1 -- 172.21.15.62:0/481450982 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc44c042f80 con 0x7fc4541439d0 2021-12-17T18:25:43.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.120+0000 7fc459ffa700 1 -- 172.21.15.62:0/481450982 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc4540b4390 con 0x7fc4541439d0 2021-12-17T18:25:43.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.120+0000 7fc4517fa700 1 -- 172.21.15.62:0/481450982 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v86) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc44c016070 con 0x7fc4541439d0 2021-12-17T18:25:43.126 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:25:43.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.120+0000 7fc459ffa700 1 -- 172.21.15.62:0/481450982 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc42c0534f0 msgr2=0x7fc42c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.120+0000 7fc459ffa700 1 --2- 172.21.15.62:0/481450982 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc42c0534f0 0x7fc42c0559b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fc44401c000 tx=0x7fc444015000).stop 2021-12-17T18:25:43.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.120+0000 7fc459ffa700 1 -- 172.21.15.62:0/481450982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4541439d0 msgr2=0x7fc454152bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.120+0000 7fc459ffa700 1 --2- 172.21.15.62:0/481450982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4541439d0 0x7fc454152bd0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7fc44c006e00 tx=0x7fc44c0091d0).stop 2021-12-17T18:25:43.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.120+0000 7fc459ffa700 1 -- 172.21.15.62:0/481450982 shutdown_connections 2021-12-17T18:25:43.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.120+0000 7fc459ffa700 1 --2- 172.21.15.62:0/481450982 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc42c0534f0 0x7fc42c0559b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.120+0000 7fc459ffa700 1 --2- 172.21.15.62:0/481450982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4541439d0 0x7fc454152bd0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.120+0000 7fc459ffa700 1 --2- 172.21.15.62:0/481450982 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc454060260 0x7fc454065390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.120+0000 7fc459ffa700 1 --2- 172.21.15.62:0/481450982 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc45405c750 0x7fc454064ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.120+0000 7fc459ffa700 1 -- 172.21.15.62:0/481450982 >> 172.21.15.62:0/481450982 conn(0x7fc454062430 msgr2=0x7fc4540b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:43.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.120+0000 7fc459ffa700 1 -- 172.21.15.62:0/481450982 shutdown_connections 2021-12-17T18:25:43.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.120+0000 7fc459ffa700 1 -- 172.21.15.62:0/481450982 wait complete. 2021-12-17T18:25:43.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-12-17T18:25:43.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.236+0000 7f130c8e7700 1 Processor -- start 2021-12-17T18:25:43.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.236+0000 7f130c8e7700 1 -- start start 2021-12-17T18:25:43.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f130c8e7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f13080b5b20 0x7f13080b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f130c8e7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13080b3760 0x7f13080b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f130c8e7700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f13080b6c70 0x7f1308146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f130c8e7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13080b5f00 con 0x7f13080b5b20 2021-12-17T18:25:43.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f130c8e7700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13080b3020 con 0x7f13080b6c70 2021-12-17T18:25:43.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f130c8e7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13080b32c0 con 0x7f13080b3760 2021-12-17T18:25:43.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f13077fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f13080b5b20 0x7f13080b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f13077fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f13080b5b20 0x7f13080b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53538/0 (socket says 172.21.15.62:53538) 2021-12-17T18:25:43.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f13077fe700 1 -- 172.21.15.62:0/686108144 learned_addr learned my addr 172.21.15.62:0/686108144 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:43.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f1306ffd700 1 --2- 172.21.15.62:0/686108144 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13080b3760 0x7f13080b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f1307fff700 1 --2- 172.21.15.62:0/686108144 >> v2:172.21.15.109:3300/0 conn(0x7f13080b6c70 0x7f1308146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f13077fe700 1 -- 172.21.15.62:0/686108144 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13080b3760 msgr2=0x7f13080b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:43.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f13077fe700 1 --2- 172.21.15.62:0/686108144 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13080b3760 0x7f13080b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f13077fe700 1 -- 172.21.15.62:0/686108144 >> v2:172.21.15.109:3300/0 conn(0x7f13080b6c70 msgr2=0x7f1308146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:43.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f13077fe700 1 --2- 172.21.15.62:0/686108144 >> v2:172.21.15.109:3300/0 conn(0x7f13080b6c70 0x7f1308146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f13077fe700 1 -- 172.21.15.62:0/686108144 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13080b5440 con 0x7f13080b5b20 2021-12-17T18:25:43.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f13077fe700 1 --2- 172.21.15.62:0/686108144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13080b5b20 0x7f13080b6290 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f12f80032f0 tx=0x7f12f8009290).ready entity=mon.0 client_cookie=73f506f4e7652102 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:43.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f13067fc700 1 -- 172.21.15.62:0/686108144 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12f800b680 con 0x7f13080b5b20 2021-12-17T18:25:43.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f13067fc700 1 -- 172.21.15.62:0/686108144 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f800b7e0 con 0x7f13080b5b20 2021-12-17T18:25:43.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f13067fc700 1 -- 172.21.15.62:0/686108144 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12f800b950 con 0x7f13080b5b20 2021-12-17T18:25:43.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f130c8e7700 1 -- 172.21.15.62:0/686108144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13080b5b20 msgr2=0x7f13080b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f130c8e7700 1 --2- 172.21.15.62:0/686108144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13080b5b20 0x7f13080b6290 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f12f80032f0 tx=0x7f12f8009290).stop 2021-12-17T18:25:43.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f130c8e7700 1 -- 172.21.15.62:0/686108144 shutdown_connections 2021-12-17T18:25:43.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f130c8e7700 1 --2- 172.21.15.62:0/686108144 >> v2:172.21.15.109:3300/0 conn(0x7f13080b6c70 0x7f1308146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f130c8e7700 1 --2- 172.21.15.62:0/686108144 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13080b3760 0x7f13080b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f130c8e7700 1 --2- 172.21.15.62:0/686108144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13080b5b20 0x7f13080b6290 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f130c8e7700 1 -- 172.21.15.62:0/686108144 >> 172.21.15.62:0/686108144 conn(0x7f130805c750 msgr2=0x7f130805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:43.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f130c8e7700 1 -- 172.21.15.62:0/686108144 shutdown_connections 2021-12-17T18:25:43.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.240+0000 7f130c8e7700 1 -- 172.21.15.62:0/686108144 wait complete. 2021-12-17T18:25:43.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.244+0000 7f130c8e7700 1 Processor -- start 2021-12-17T18:25:43.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.244+0000 7f130c8e7700 1 -- start start 2021-12-17T18:25:43.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.244+0000 7f130c8e7700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13080b5b20 0x7f1308065b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.244+0000 7f130c8e7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13080b6c70 0x7f1308146e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.244+0000 7f130c8e7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13080669e0 0x7f1308147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.244+0000 7f130c8e7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1308067160 con 0x7f13080669e0 2021-12-17T18:25:43.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.244+0000 7f130c8e7700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1308143c40 con 0x7f13080b5b20 2021-12-17T18:25:43.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.244+0000 7f130c8e7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1308143ee0 con 0x7f13080b6c70 2021-12-17T18:25:43.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.244+0000 7f1307fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13080669e0 0x7f1308147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.244+0000 7f1307fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13080669e0 0x7f1308147340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53546/0 (socket says 172.21.15.62:53546) 2021-12-17T18:25:43.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.244+0000 7f1307fff700 1 -- 172.21.15.62:0/3070321039 learned_addr learned my addr 172.21.15.62:0/3070321039 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:43.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.244+0000 7f13077fe700 1 --2- 172.21.15.62:0/3070321039 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13080b5b20 0x7f1308065b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f1306ffd700 1 --2- 172.21.15.62:0/3070321039 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13080b6c70 0x7f1308146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f1307fff700 1 -- 172.21.15.62:0/3070321039 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13080b6c70 msgr2=0x7f1308146e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f1307fff700 1 --2- 172.21.15.62:0/3070321039 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13080b6c70 0x7f1308146e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f1307fff700 1 -- 172.21.15.62:0/3070321039 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13080b5b20 msgr2=0x7f1308065b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f1307fff700 1 --2- 172.21.15.62:0/3070321039 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13080b5b20 0x7f1308065b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f1307fff700 1 -- 172.21.15.62:0/3070321039 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f8009530 con 0x7f13080669e0 2021-12-17T18:25:43.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f1306ffd700 1 --2- 172.21.15.62:0/3070321039 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13080b6c70 0x7f1308146e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:43.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f1307fff700 1 --2- 172.21.15.62:0/3070321039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13080669e0 0x7f1308147340 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f130000c000 tx=0x7f1300006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:43.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f1304ff9700 1 -- 172.21.15.62:0/3070321039 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1300011750 con 0x7f13080669e0 2021-12-17T18:25:43.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f1304ff9700 1 -- 172.21.15.62:0/3070321039 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13000118b0 con 0x7f13080669e0 2021-12-17T18:25:43.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f130c8e7700 1 -- 172.21.15.62:0/3070321039 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1308144180 con 0x7f13080669e0 2021-12-17T18:25:43.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f1304ff9700 1 -- 172.21.15.62:0/3070321039 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1300011c10 con 0x7f13080669e0 2021-12-17T18:25:43.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f130c8e7700 1 -- 172.21.15.62:0/3070321039 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1308144620 con 0x7f13080669e0 2021-12-17T18:25:43.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f130c8e7700 1 -- 172.21.15.62:0/3070321039 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1308142770 con 0x7f13080669e0 2021-12-17T18:25:43.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f1304ff9700 1 -- 172.21.15.62:0/3070321039 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1300011d70 con 0x7f13080669e0 2021-12-17T18:25:43.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f1304ff9700 1 --2- 172.21.15.62:0/3070321039 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12e80536a0 0x7f12e8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f1304ff9700 1 -- 172.21.15.62:0/3070321039 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f130006ba20 con 0x7f13080669e0 2021-12-17T18:25:43.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.248+0000 7f13077fe700 1 --2- 172.21.15.62:0/3070321039 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12e80536a0 0x7f12e8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.252+0000 7f13077fe700 1 --2- 172.21.15.62:0/3070321039 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12e80536a0 0x7f12e8055b60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f12f801a000 tx=0x7f12f8017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:43.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.256+0000 7f1304ff9700 1 -- 172.21.15.62:0/3070321039 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1300042e30 con 0x7f13080669e0 2021-12-17T18:25:43.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.384+0000 7f130c8e7700 1 -- 172.21.15.62:0/3070321039 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1308144310 con 0x7f13080669e0 2021-12-17T18:25:43.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.384+0000 7f1304ff9700 1 -- 172.21.15.62:0/3070321039 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v86) v1 ==== 84+0+143 (secure 0 0 0) 0x7f1300046450 con 0x7f13080669e0 2021-12-17T18:25:43.390 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:43.390 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2021-12-17T18:25:43.390 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:43.391 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2021-12-17T18:25:43.391 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "device_health_metrics" 2021-12-17T18:25:43.391 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:43.391 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:43.392 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2021-12-17T18:25:43.392 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2021-12-17T18:25:43.392 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:43.392 INFO:teuthology.orchestra.run.smithi062.stdout:] 2021-12-17T18:25:43.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.384+0000 7f130c8e7700 1 -- 172.21.15.62:0/3070321039 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12e80536a0 msgr2=0x7f12e8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.384+0000 7f130c8e7700 1 --2- 172.21.15.62:0/3070321039 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12e80536a0 0x7f12e8055b60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f12f801a000 tx=0x7f12f8017000).stop 2021-12-17T18:25:43.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.384+0000 7f130c8e7700 1 -- 172.21.15.62:0/3070321039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13080669e0 msgr2=0x7f1308147340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.384+0000 7f130c8e7700 1 --2- 172.21.15.62:0/3070321039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13080669e0 0x7f1308147340 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f130000c000 tx=0x7f1300006df0).stop 2021-12-17T18:25:43.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.384+0000 7f130c8e7700 1 -- 172.21.15.62:0/3070321039 shutdown_connections 2021-12-17T18:25:43.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.384+0000 7f130c8e7700 1 --2- 172.21.15.62:0/3070321039 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12e80536a0 0x7f12e8055b60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.384+0000 7f130c8e7700 1 --2- 172.21.15.62:0/3070321039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13080669e0 0x7f1308147340 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.384+0000 7f130c8e7700 1 --2- 172.21.15.62:0/3070321039 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13080b6c70 0x7f1308146e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.384+0000 7f130c8e7700 1 --2- 172.21.15.62:0/3070321039 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13080b5b20 0x7f1308065b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.384+0000 7f130c8e7700 1 -- 172.21.15.62:0/3070321039 >> 172.21.15.62:0/3070321039 conn(0x7f130805c750 msgr2=0x7f130805f850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:43.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.384+0000 7f130c8e7700 1 -- 172.21.15.62:0/3070321039 shutdown_connections 2021-12-17T18:25:43.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.384+0000 7f130c8e7700 1 -- 172.21.15.62:0/3070321039 wait complete. 2021-12-17T18:25:43.403 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-12-17T18:25:43.403 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-12-17T18:25:43.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.504+0000 7f25f2157700 1 Processor -- start 2021-12-17T18:25:43.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.504+0000 7f25f2157700 1 -- start start 2021-12-17T18:25:43.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f2157700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f25ec0b40b0 0x7f25ec143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f2157700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25ec0b0870 con 0x7f25ec05ca90 2021-12-17T18:25:43.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f2157700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25ec05ce70 con 0x7f25ec0b47c0 2021-12-17T18:25:43.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f2157700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25ec0b05d0 con 0x7f25ec0b40b0 2021-12-17T18:25:43.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f1956700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f25ec0b40b0 0x7f25ec143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f1155700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f25ec05ca90 0x7f25ec0b1d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37130/0 (socket says 172.21.15.62:37130) 2021-12-17T18:25:43.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f1155700 1 -- 172.21.15.62:0/482887145 learned_addr learned my addr 172.21.15.62:0/482887145 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:43.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f1956700 1 -- 172.21.15.62:0/482887145 >> v1:172.21.15.109:6789/0 conn(0x7f25ec0b47c0 legacy=0x7f25ec0b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f1956700 1 -- 172.21.15.62:0/482887145 >> v1:172.21.15.62:6789/0 conn(0x7f25ec05ca90 legacy=0x7f25ec0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25dbfff700 1 -- 172.21.15.62:0/482887145 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825184167 0 0) 0x7f25ec0b0870 con 0x7f25ec05ca90 2021-12-17T18:25:43.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f1956700 1 -- 172.21.15.62:0/482887145 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ec0b5250 con 0x7f25ec0b40b0 2021-12-17T18:25:43.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f1956700 1 --2- 172.21.15.62:0/482887145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25ec0b40b0 0x7f25ec143ba0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f25e40032f0 tx=0x7f25e40091d0).ready entity=mon.0 client_cookie=32ac22a53b7d6b9e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:43.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25dbfff700 1 -- 172.21.15.62:0/482887145 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e4009ea0 con 0x7f25ec0b40b0 2021-12-17T18:25:43.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25dbfff700 1 -- 172.21.15.62:0/482887145 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e400b8a0 con 0x7f25ec0b40b0 2021-12-17T18:25:43.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25dbfff700 1 -- 172.21.15.62:0/482887145 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e400ba10 con 0x7f25ec0b40b0 2021-12-17T18:25:43.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f2157700 1 -- 172.21.15.62:0/482887145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25ec0b40b0 msgr2=0x7f25ec143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f2157700 1 --2- 172.21.15.62:0/482887145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25ec0b40b0 0x7f25ec143ba0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f25e40032f0 tx=0x7f25e40091d0).stop 2021-12-17T18:25:43.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f2157700 1 -- 172.21.15.62:0/482887145 shutdown_connections 2021-12-17T18:25:43.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f2157700 1 --2- 172.21.15.62:0/482887145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25ec0b40b0 0x7f25ec143ba0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f2157700 1 -- 172.21.15.62:0/482887145 >> 172.21.15.62:0/482887145 conn(0x7f25ec05bcd0 msgr2=0x7f25ec062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:43.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f2157700 1 -- 172.21.15.62:0/482887145 shutdown_connections 2021-12-17T18:25:43.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.508+0000 7f25f2157700 1 -- 172.21.15.62:0/482887145 wait complete. 2021-12-17T18:25:43.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.512+0000 7f25f2157700 1 Processor -- start 2021-12-17T18:25:43.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.512+0000 7f25f2157700 1 -- start start 2021-12-17T18:25:43.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.512+0000 7f25f2157700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f25ec05ca90 0x7f25ec155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.512+0000 7f25f2157700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f25ec0b40b0 0x7f25ec141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.512+0000 7f25f2157700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25ec0b47c0 0x7f25ec065170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.512+0000 7f25f2157700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec156a70 con 0x7f25ec0b47c0 2021-12-17T18:25:43.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.512+0000 7f25f2157700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec063a50 con 0x7f25ec0b40b0 2021-12-17T18:25:43.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.512+0000 7f25f2157700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec063cf0 con 0x7f25ec05ca90 2021-12-17T18:25:43.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.512+0000 7f25f1956700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25ec0b47c0 0x7f25ec065170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.512+0000 7f25f1956700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25ec0b47c0 0x7f25ec065170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53560/0 (socket says 172.21.15.62:53560) 2021-12-17T18:25:43.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.512+0000 7f25f1956700 1 -- 172.21.15.62:0/580580984 learned_addr learned my addr 172.21.15.62:0/580580984 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:43.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.512+0000 7f25f0954700 1 --2- 172.21.15.62:0/580580984 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f25ec0b40b0 0x7f25ec141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.512+0000 7f25f1155700 1 --2- 172.21.15.62:0/580580984 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f25ec05ca90 0x7f25ec155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.516+0000 7f25f1956700 1 -- 172.21.15.62:0/580580984 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f25ec05ca90 msgr2=0x7f25ec155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.516+0000 7f25f1956700 1 --2- 172.21.15.62:0/580580984 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f25ec05ca90 0x7f25ec155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.516+0000 7f25f1956700 1 -- 172.21.15.62:0/580580984 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f25ec0b40b0 msgr2=0x7f25ec141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.516+0000 7f25f1956700 1 --2- 172.21.15.62:0/580580984 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f25ec0b40b0 0x7f25ec141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.516+0000 7f25f1956700 1 -- 172.21.15.62:0/580580984 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e4009470 con 0x7f25ec0b47c0 2021-12-17T18:25:43.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.516+0000 7f25f1956700 1 --2- 172.21.15.62:0/580580984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25ec0b47c0 0x7f25ec065170 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f25e40032f0 tx=0x7f25e4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:43.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.516+0000 7f25da7fc700 1 -- 172.21.15.62:0/580580984 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e4009ea0 con 0x7f25ec0b47c0 2021-12-17T18:25:43.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.516+0000 7f25da7fc700 1 -- 172.21.15.62:0/580580984 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e401f3f0 con 0x7f25ec0b47c0 2021-12-17T18:25:43.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.516+0000 7f25f2157700 1 -- 172.21.15.62:0/580580984 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ec064bd0 con 0x7f25ec0b47c0 2021-12-17T18:25:43.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.516+0000 7f25da7fc700 1 -- 172.21.15.62:0/580580984 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e401f750 con 0x7f25ec0b47c0 2021-12-17T18:25:43.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.516+0000 7f25f2157700 1 -- 172.21.15.62:0/580580984 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ec063760 con 0x7f25ec0b47c0 2021-12-17T18:25:43.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.516+0000 7f25f2157700 1 -- 172.21.15.62:0/580580984 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ec067310 con 0x7f25ec0b47c0 2021-12-17T18:25:43.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.516+0000 7f25da7fc700 1 -- 172.21.15.62:0/580580984 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f25e4026030 con 0x7f25ec0b47c0 2021-12-17T18:25:43.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.516+0000 7f25da7fc700 1 --2- 172.21.15.62:0/580580984 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25cc053580 0x7f25cc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.520+0000 7f25da7fc700 1 -- 172.21.15.62:0/580580984 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f25e406c330 con 0x7f25ec0b47c0 2021-12-17T18:25:43.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.520+0000 7f25f1155700 1 --2- 172.21.15.62:0/580580984 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25cc053580 0x7f25cc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.520+0000 7f25f1155700 1 --2- 172.21.15.62:0/580580984 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25cc053580 0x7f25cc055a40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f25e800d000 tx=0x7f25e80011a0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:43.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.524+0000 7f25da7fc700 1 -- 172.21.15.62:0/580580984 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f25ec067310 con 0x7f25ec0b47c0 2021-12-17T18:25:43.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.648+0000 7f25f2157700 1 -- 172.21.15.62:0/580580984 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f25ec067310 con 0x7f25ec0b47c0 2021-12-17T18:25:43.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.760+0000 7f25da7fc700 1 -- 172.21.15.62:0/580580984 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v87) v1 ==== 133+0+0 (secure 0 0 0) 0x7f25ec067310 con 0x7f25ec0b47c0 2021-12-17T18:25:43.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.764+0000 7f25f2157700 1 -- 172.21.15.62:0/580580984 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25cc053580 msgr2=0x7f25cc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.764+0000 7f25f2157700 1 --2- 172.21.15.62:0/580580984 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25cc053580 0x7f25cc055a40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f25e800d000 tx=0x7f25e80011a0).stop 2021-12-17T18:25:43.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.764+0000 7f25f2157700 1 -- 172.21.15.62:0/580580984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25ec0b47c0 msgr2=0x7f25ec065170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.764+0000 7f25f2157700 1 --2- 172.21.15.62:0/580580984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25ec0b47c0 0x7f25ec065170 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f25e40032f0 tx=0x7f25e4016000).stop 2021-12-17T18:25:43.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.764+0000 7f25f2157700 1 -- 172.21.15.62:0/580580984 shutdown_connections 2021-12-17T18:25:43.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.764+0000 7f25f2157700 1 --2- 172.21.15.62:0/580580984 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25cc053580 0x7f25cc055a40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.764+0000 7f25f2157700 1 --2- 172.21.15.62:0/580580984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25ec0b47c0 0x7f25ec065170 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.764+0000 7f25f2157700 1 --2- 172.21.15.62:0/580580984 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f25ec0b40b0 0x7f25ec141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.764+0000 7f25f2157700 1 --2- 172.21.15.62:0/580580984 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f25ec05ca90 0x7f25ec155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.764+0000 7f25f2157700 1 -- 172.21.15.62:0/580580984 >> 172.21.15.62:0/580580984 conn(0x7f25ec05bcd0 msgr2=0x7f25ec0b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:43.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.764+0000 7f25f2157700 1 -- 172.21.15.62:0/580580984 shutdown_connections 2021-12-17T18:25:43.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.764+0000 7f25f2157700 1 -- 172.21.15.62:0/580580984 wait complete. 2021-12-17T18:25:43.772 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2021-12-17T18:25:43.786 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-12-17T18:25:43.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf66fc1700 1 Processor -- start 2021-12-17T18:25:43.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf66fc1700 1 -- start start 2021-12-17T18:25:43.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf66fc1700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fcf6005ca90 0x7fcf6014b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf66fc1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf60060750 con 0x7fcf6005f730 2021-12-17T18:25:43.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf66fc1700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6014ac00 con 0x7fcf600ac040 2021-12-17T18:25:43.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf66fc1700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6014aea0 con 0x7fcf6005ca90 2021-12-17T18:25:43.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf667c0700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcf6005f730 0x7fcf60146510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37146/0 (socket says 172.21.15.62:37146) 2021-12-17T18:25:43.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf667c0700 1 -- 172.21.15.62:0/1102767160 learned_addr learned my addr 172.21.15.62:0/1102767160 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:43.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf65fbf700 1 --2- 172.21.15.62:0/1102767160 >> v2:172.21.15.109:3300/0 conn(0x7fcf6005ca90 0x7fcf6014b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf64fbd700 1 -- 172.21.15.62:0/1102767160 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338206928 0 0) 0x7fcf60060750 con 0x7fcf6005f730 2021-12-17T18:25:43.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf64fbd700 1 -- 172.21.15.62:0/1102767160 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf48003260 con 0x7fcf6005f730 2021-12-17T18:25:43.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf64fbd700 1 -- 172.21.15.62:0/1102767160 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2843024547 0 0) 0x7fcf48003260 con 0x7fcf6005f730 2021-12-17T18:25:43.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf64fbd700 1 -- 172.21.15.62:0/1102767160 >> v2:172.21.15.109:3300/0 conn(0x7fcf6005ca90 msgr2=0x7fcf6014b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:43.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf64fbd700 1 --2- 172.21.15.62:0/1102767160 >> v2:172.21.15.109:3300/0 conn(0x7fcf6005ca90 0x7fcf6014b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf64fbd700 1 -- 172.21.15.62:0/1102767160 >> v1:172.21.15.109:6789/0 conn(0x7fcf600ac040 legacy=0x7fcf601475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf64fbd700 1 -- 172.21.15.62:0/1102767160 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6005ce70 con 0x7fcf6005f730 2021-12-17T18:25:43.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf64fbd700 1 -- 172.21.15.62:0/1102767160 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fcf58001a00 con 0x7fcf6005f730 2021-12-17T18:25:43.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf64fbd700 1 -- 172.21.15.62:0/1102767160 >> v1:172.21.15.62:6789/0 conn(0x7fcf6005f730 legacy=0x7fcf60146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf64fbd700 1 --2- 172.21.15.62:0/1102767160 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf48003750 0x7fcf48003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf64fbd700 1 --2- 172.21.15.62:0/1102767160 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf48004500 0x7fcf48004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf64fbd700 1 --2- 172.21.15.62:0/1102767160 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf48004e70 0x7fcf4800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf64fbd700 1 -- 172.21.15.62:0/1102767160 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6014aea0 con 0x7fcf48003750 2021-12-17T18:25:43.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf64fbd700 1 -- 172.21.15.62:0/1102767160 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4800bc70 con 0x7fcf48004e70 2021-12-17T18:25:43.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf64fbd700 1 -- 172.21.15.62:0/1102767160 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4800be30 con 0x7fcf48004500 2021-12-17T18:25:43.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.892+0000 7fcf65fbf700 1 --2- 172.21.15.62:0/1102767160 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf48003750 0x7fcf48003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf667c0700 1 --2- 172.21.15.62:0/1102767160 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf48004e70 0x7fcf4800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf657be700 1 --2- 172.21.15.62:0/1102767160 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf48004500 0x7fcf48004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf65fbf700 1 -- 172.21.15.62:0/1102767160 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf48004500 msgr2=0x7fcf48004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:43.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf65fbf700 1 --2- 172.21.15.62:0/1102767160 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf48004500 0x7fcf48004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf65fbf700 1 -- 172.21.15.62:0/1102767160 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf48004e70 msgr2=0x7fcf4800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:43.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf65fbf700 1 --2- 172.21.15.62:0/1102767160 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf48004e70 0x7fcf4800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf65fbf700 1 -- 172.21.15.62:0/1102767160 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf48003260 con 0x7fcf48003750 2021-12-17T18:25:43.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf667c0700 1 --2- 172.21.15.62:0/1102767160 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf48004e70 0x7fcf4800b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:25:43.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf657be700 1 --2- 172.21.15.62:0/1102767160 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf48004500 0x7fcf48004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:25:43.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf667c0700 1 -- 172.21.15.62:0/1102767160 reap_dead start 2021-12-17T18:25:43.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf65fbf700 1 --2- 172.21.15.62:0/1102767160 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf48003750 0x7fcf48003b30 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7fcf5000c000 tx=0x7fcf50006df0).ready entity=mon.0 client_cookie=c1b4625b4c7c567c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:43.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf64fbd700 1 -- 172.21.15.62:0/1102767160 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf5000e830 con 0x7fcf48003750 2021-12-17T18:25:43.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf64fbd700 1 -- 172.21.15.62:0/1102767160 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5000e990 con 0x7fcf48003750 2021-12-17T18:25:43.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf64fbd700 1 -- 172.21.15.62:0/1102767160 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf5000ecf0 con 0x7fcf48003750 2021-12-17T18:25:43.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf66fc1700 1 -- 172.21.15.62:0/1102767160 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf48003750 msgr2=0x7fcf48003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf66fc1700 1 --2- 172.21.15.62:0/1102767160 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf48003750 0x7fcf48003b30 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7fcf5000c000 tx=0x7fcf50006df0).stop 2021-12-17T18:25:43.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf66fc1700 1 -- 172.21.15.62:0/1102767160 shutdown_connections 2021-12-17T18:25:43.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf66fc1700 1 --2- 172.21.15.62:0/1102767160 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf48003750 0x7fcf48003b30 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf66fc1700 1 -- 172.21.15.62:0/1102767160 >> 172.21.15.62:0/1102767160 conn(0x7fcf6005be70 msgr2=0x7fcf60062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:43.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf66fc1700 1 -- 172.21.15.62:0/1102767160 shutdown_connections 2021-12-17T18:25:43.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf66fc1700 1 -- 172.21.15.62:0/1102767160 wait complete. 2021-12-17T18:25:43.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf66fc1700 1 Processor -- start 2021-12-17T18:25:43.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf66fc1700 1 -- start start 2021-12-17T18:25:43.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf66fc1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf48003750 0x7fcf600a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf66fc1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf600ad910 0x7fcf600a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf66fc1700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf600add90 0x7fcf60156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf66fc1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf600a2670 con 0x7fcf600ad910 2021-12-17T18:25:43.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf66fc1700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf60143850 con 0x7fcf600add90 2021-12-17T18:25:43.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf66fc1700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf601568b0 con 0x7fcf48003750 2021-12-17T18:25:43.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf657be700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf600ad910 0x7fcf600a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf657be700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf600ad910 0x7fcf600a1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53580/0 (socket says 172.21.15.62:53580) 2021-12-17T18:25:43.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf657be700 1 -- 172.21.15.62:0/1560557294 learned_addr learned my addr 172.21.15.62:0/1560557294 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:43.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf667c0700 1 --2- 172.21.15.62:0/1560557294 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf600add90 0x7fcf60156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf65fbf700 1 --2- 172.21.15.62:0/1560557294 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf48003750 0x7fcf600a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf657be700 1 -- 172.21.15.62:0/1560557294 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf48003750 msgr2=0x7fcf600a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.896+0000 7fcf657be700 1 --2- 172.21.15.62:0/1560557294 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf48003750 0x7fcf600a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.900+0000 7fcf657be700 1 -- 172.21.15.62:0/1560557294 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf600add90 msgr2=0x7fcf60156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:43.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.900+0000 7fcf657be700 1 --2- 172.21.15.62:0/1560557294 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf600add90 0x7fcf60156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:43.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.900+0000 7fcf657be700 1 -- 172.21.15.62:0/1560557294 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf60063bd0 con 0x7fcf600ad910 2021-12-17T18:25:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.900+0000 7fcf667c0700 1 --2- 172.21.15.62:0/1560557294 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf600add90 0x7fcf60156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.900+0000 7fcf657be700 1 --2- 172.21.15.62:0/1560557294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf600ad910 0x7fcf600a1590 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fcf5c008000 tx=0x7fcf5c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.900+0000 7fcf4effd700 1 -- 172.21.15.62:0/1560557294 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf5c013470 con 0x7fcf600ad910 2021-12-17T18:25:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.900+0000 7fcf4effd700 1 -- 172.21.15.62:0/1560557294 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c0135d0 con 0x7fcf600ad910 2021-12-17T18:25:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.900+0000 7fcf4effd700 1 -- 172.21.15.62:0/1560557294 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf5c013930 con 0x7fcf600ad910 2021-12-17T18:25:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.900+0000 7fcf66fc1700 1 -- 172.21.15.62:0/1560557294 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf60156ae0 con 0x7fcf600ad910 2021-12-17T18:25:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.900+0000 7fcf66fc1700 1 -- 172.21.15.62:0/1560557294 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf60063e70 con 0x7fcf600ad910 2021-12-17T18:25:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.900+0000 7fcf66fc1700 1 -- 172.21.15.62:0/1560557294 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf600a06d0 con 0x7fcf600ad910 2021-12-17T18:25:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.900+0000 7fcf4effd700 1 -- 172.21.15.62:0/1560557294 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcf5c013a90 con 0x7fcf600ad910 2021-12-17T18:25:43.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.900+0000 7fcf4effd700 1 --2- 172.21.15.62:0/1560557294 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcf400536a0 0x7fcf40055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:43.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.900+0000 7fcf4effd700 1 -- 172.21.15.62:0/1560557294 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fcf5c06b530 con 0x7fcf600ad910 2021-12-17T18:25:43.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.900+0000 7fcf65fbf700 1 --2- 172.21.15.62:0/1560557294 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcf400536a0 0x7fcf40055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:43.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.904+0000 7fcf65fbf700 1 --2- 172.21.15.62:0/1560557294 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcf400536a0 0x7fcf40055b60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fcf5001b000 tx=0x7fcf50019000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:43.904+0000 7fcf4effd700 1 -- 172.21.15.62:0/1560557294 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf5c042750 con 0x7fcf600ad910 2021-12-17T18:25:44.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.028+0000 7fcf66fc1700 1 -- 172.21.15.62:0/1560557294 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fcf600573d0 con 0x7fcf600ad910 2021-12-17T18:25:44.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.772+0000 7fcf4effd700 1 -- 172.21.15.62:0/1560557294 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v88) v1 ==== 125+0+0 (secure 0 0 0) 0x7fcf5c045d70 con 0x7fcf600ad910 2021-12-17T18:25:44.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.780+0000 7fcf66fc1700 1 -- 172.21.15.62:0/1560557294 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcf400536a0 msgr2=0x7fcf40055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:44.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.780+0000 7fcf66fc1700 1 --2- 172.21.15.62:0/1560557294 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcf400536a0 0x7fcf40055b60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fcf5001b000 tx=0x7fcf50019000).stop 2021-12-17T18:25:44.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.780+0000 7fcf66fc1700 1 -- 172.21.15.62:0/1560557294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf600ad910 msgr2=0x7fcf600a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:44.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.780+0000 7fcf66fc1700 1 --2- 172.21.15.62:0/1560557294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf600ad910 0x7fcf600a1590 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fcf5c008000 tx=0x7fcf5c009040).stop 2021-12-17T18:25:44.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.780+0000 7fcf66fc1700 1 -- 172.21.15.62:0/1560557294 shutdown_connections 2021-12-17T18:25:44.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.780+0000 7fcf66fc1700 1 --2- 172.21.15.62:0/1560557294 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcf400536a0 0x7fcf40055b60 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:44.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.780+0000 7fcf66fc1700 1 --2- 172.21.15.62:0/1560557294 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcf600add90 0x7fcf60156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:44.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.780+0000 7fcf66fc1700 1 --2- 172.21.15.62:0/1560557294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf600ad910 0x7fcf600a1590 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:44.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.780+0000 7fcf66fc1700 1 --2- 172.21.15.62:0/1560557294 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcf48003750 0x7fcf600a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:44.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.780+0000 7fcf66fc1700 1 -- 172.21.15.62:0/1560557294 >> 172.21.15.62:0/1560557294 conn(0x7fcf6005be70 msgr2=0x7fcf600b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:44.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.780+0000 7fcf66fc1700 1 -- 172.21.15.62:0/1560557294 shutdown_connections 2021-12-17T18:25:44.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.780+0000 7fcf66fc1700 1 -- 172.21.15.62:0/1560557294 wait complete. 2021-12-17T18:25:44.788 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2021-12-17T18:25:44.801 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-12-17T18:25:44.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.908+0000 7f709f692700 1 Processor -- start 2021-12-17T18:25:44.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.908+0000 7f709f692700 1 -- start start 2021-12-17T18:25:44.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.908+0000 7f709f692700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7098066110 0x7f7098142400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:44.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.908+0000 7f709f692700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f70981428f0 0x7f7098142d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:44.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.908+0000 7f709f692700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70980ad6d0 con 0x7f70980b4370 2021-12-17T18:25:44.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.908+0000 7f709f692700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70980ae650 con 0x7f7098066110 2021-12-17T18:25:44.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.908+0000 7f709f692700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70980b4750 con 0x7f70981428f0 2021-12-17T18:25:44.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.908+0000 7f709cc2d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7098066110 0x7f7098142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:44.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.908+0000 7f709cc2d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7098066110 0x7f7098142400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53588/0 (socket says 172.21.15.62:53588) 2021-12-17T18:25:44.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.908+0000 7f709cc2d700 1 -- 172.21.15.62:0/1155186596 learned_addr learned my addr 172.21.15.62:0/1155186596 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:44.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.908+0000 7f709dc2f700 1 --2- 172.21.15.62:0/1155186596 >> v2:172.21.15.109:3300/0 conn(0x7f70981428f0 0x7f7098142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:44.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f709cc2d700 1 -- 172.21.15.62:0/1155186596 >> v2:172.21.15.109:3300/0 conn(0x7f70981428f0 msgr2=0x7f7098142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:44.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f709cc2d700 1 --2- 172.21.15.62:0/1155186596 >> v2:172.21.15.109:3300/0 conn(0x7f70981428f0 0x7f7098142d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:44.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f709cc2d700 1 -- 172.21.15.62:0/1155186596 >> v1:172.21.15.109:6789/0 conn(0x7f70980b4370 legacy=0x7f7098065a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:44.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f709cc2d700 1 -- 172.21.15.62:0/1155186596 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70980ad430 con 0x7f7098066110 2021-12-17T18:25:44.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f709cc2d700 1 --2- 172.21.15.62:0/1155186596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7098066110 0x7f7098142400 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f7094002f70 tx=0x7f7094006eb0).ready entity=mon.0 client_cookie=60ee504977fa3bc5 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:44.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f708ffff700 1 -- 172.21.15.62:0/1155186596 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f709400d5c0 con 0x7f7098066110 2021-12-17T18:25:44.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f708ffff700 1 -- 172.21.15.62:0/1155186596 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7094000e90 con 0x7f7098066110 2021-12-17T18:25:44.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f708ffff700 1 -- 172.21.15.62:0/1155186596 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f709400d950 con 0x7f7098066110 2021-12-17T18:25:44.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f709f692700 1 -- 172.21.15.62:0/1155186596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7098066110 msgr2=0x7f7098142400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:44.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f709f692700 1 --2- 172.21.15.62:0/1155186596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7098066110 0x7f7098142400 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f7094002f70 tx=0x7f7094006eb0).stop 2021-12-17T18:25:44.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f709f692700 1 -- 172.21.15.62:0/1155186596 shutdown_connections 2021-12-17T18:25:44.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f709f692700 1 --2- 172.21.15.62:0/1155186596 >> v2:172.21.15.109:3300/0 conn(0x7f70981428f0 0x7f7098142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:44.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f709f692700 1 --2- 172.21.15.62:0/1155186596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7098066110 0x7f7098142400 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:44.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f709f692700 1 -- 172.21.15.62:0/1155186596 >> 172.21.15.62:0/1155186596 conn(0x7f709805c960 msgr2=0x7f709805cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:44.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f709f692700 1 -- 172.21.15.62:0/1155186596 shutdown_connections 2021-12-17T18:25:44.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f709f692700 1 -- 172.21.15.62:0/1155186596 wait complete. 2021-12-17T18:25:44.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f709f692700 1 Processor -- start 2021-12-17T18:25:44.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.912+0000 7f709f692700 1 -- start start 2021-12-17T18:25:44.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709f692700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7098066110 0x7f7098152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:44.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709f692700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70980b4370 0x7f709813f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:44.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709f692700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70981428f0 0x7f70980aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:44.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709f692700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7098146fe0 con 0x7f70980b4370 2021-12-17T18:25:44.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709f692700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7098152980 con 0x7f7098066110 2021-12-17T18:25:44.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709f692700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7098152c20 con 0x7f70981428f0 2021-12-17T18:25:44.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709cc2d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70980b4370 0x7f709813f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:44.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709cc2d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70980b4370 0x7f709813f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53590/0 (socket says 172.21.15.62:53590) 2021-12-17T18:25:44.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709cc2d700 1 -- 172.21.15.62:0/3719192251 learned_addr learned my addr 172.21.15.62:0/3719192251 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:44.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709d42e700 1 --2- 172.21.15.62:0/3719192251 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7098066110 0x7f7098152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:44.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709dc2f700 1 --2- 172.21.15.62:0/3719192251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70981428f0 0x7f70980aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:44.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709cc2d700 1 -- 172.21.15.62:0/3719192251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70981428f0 msgr2=0x7f70980aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:44.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709cc2d700 1 --2- 172.21.15.62:0/3719192251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70981428f0 0x7f70980aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:44.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709cc2d700 1 -- 172.21.15.62:0/3719192251 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7098066110 msgr2=0x7f7098152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:44.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709cc2d700 1 --2- 172.21.15.62:0/3719192251 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7098066110 0x7f7098152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:44.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709cc2d700 1 -- 172.21.15.62:0/3719192251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709400b1e0 con 0x7f70980b4370 2021-12-17T18:25:44.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709d42e700 1 --2- 172.21.15.62:0/3719192251 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7098066110 0x7f7098152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:44.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709cc2d700 1 --2- 172.21.15.62:0/3719192251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70980b4370 0x7f709813f7a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f7094002f70 tx=0x7f7094015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:44.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f708e7fc700 1 -- 172.21.15.62:0/3719192251 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7094011990 con 0x7f70980b4370 2021-12-17T18:25:44.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f708e7fc700 1 -- 172.21.15.62:0/3719192251 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7094011af0 con 0x7f70980b4370 2021-12-17T18:25:44.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709f692700 1 -- 172.21.15.62:0/3719192251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7098152ec0 con 0x7f70980b4370 2021-12-17T18:25:44.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f708e7fc700 1 -- 172.21.15.62:0/3719192251 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7094011e50 con 0x7f70980b4370 2021-12-17T18:25:44.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709f692700 1 -- 172.21.15.62:0/3719192251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709813feb0 con 0x7f70980b4370 2021-12-17T18:25:44.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f709f692700 1 -- 172.21.15.62:0/3719192251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70980ae3b0 con 0x7f70980b4370 2021-12-17T18:25:44.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f708e7fc700 1 -- 172.21.15.62:0/3719192251 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7094025030 con 0x7f70980b4370 2021-12-17T18:25:44.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f708e7fc700 1 --2- 172.21.15.62:0/3719192251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7080053640 0x7f7080055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:44.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.916+0000 7f708e7fc700 1 -- 172.21.15.62:0/3719192251 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f709406ca80 con 0x7f70980b4370 2021-12-17T18:25:44.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.920+0000 7f709d42e700 1 --2- 172.21.15.62:0/3719192251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7080053640 0x7f7080055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:44.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.920+0000 7f709d42e700 1 --2- 172.21.15.62:0/3719192251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7080053640 0x7f7080055b00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f708800b000 tx=0x7f7088009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:44.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:44.923+0000 7f708e7fc700 1 -- 172.21.15.62:0/3719192251 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7094043c50 con 0x7f70980b4370 2021-12-17T18:25:45.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.091+0000 7f709f692700 1 -- 172.21.15.62:0/3719192251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f70980573d0 con 0x7f70980b4370 2021-12-17T18:25:45.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.103+0000 7f708e7fc700 1 -- 172.21.15.62:0/3719192251 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 17 and data pool 18 v42) v1 ==== 189+0+0 (secure 0 0 0) 0x7f7094023020 con 0x7f70980b4370 2021-12-17T18:25:45.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.107+0000 7f709f692700 1 -- 172.21.15.62:0/3719192251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7080053640 msgr2=0x7f7080055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.107+0000 7f709f692700 1 --2- 172.21.15.62:0/3719192251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7080053640 0x7f7080055b00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f708800b000 tx=0x7f7088009040).stop 2021-12-17T18:25:45.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.107+0000 7f709f692700 1 -- 172.21.15.62:0/3719192251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70980b4370 msgr2=0x7f709813f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.107+0000 7f709f692700 1 --2- 172.21.15.62:0/3719192251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70980b4370 0x7f709813f7a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f7094002f70 tx=0x7f7094015000).stop 2021-12-17T18:25:45.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.107+0000 7f709f692700 1 -- 172.21.15.62:0/3719192251 shutdown_connections 2021-12-17T18:25:45.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.107+0000 7f709f692700 1 --2- 172.21.15.62:0/3719192251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7080053640 0x7f7080055b00 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.107+0000 7f709f692700 1 --2- 172.21.15.62:0/3719192251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f70981428f0 0x7f70980aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.107+0000 7f709f692700 1 --2- 172.21.15.62:0/3719192251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70980b4370 0x7f709813f7a0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.107+0000 7f709f692700 1 --2- 172.21.15.62:0/3719192251 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7098066110 0x7f7098152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.107+0000 7f709f692700 1 -- 172.21.15.62:0/3719192251 >> 172.21.15.62:0/3719192251 conn(0x7f709805c960 msgr2=0x7f7098141720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:45.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.107+0000 7f709f692700 1 -- 172.21.15.62:0/3719192251 shutdown_connections 2021-12-17T18:25:45.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.107+0000 7f709f692700 1 -- 172.21.15.62:0/3719192251 wait complete. 2021-12-17T18:25:45.118 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 17 and data pool 18 2021-12-17T18:25:45.131 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:25:45.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.219+0000 7fd62484d700 1 Processor -- start 2021-12-17T18:25:45.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.219+0000 7fd62484d700 1 -- start start 2021-12-17T18:25:45.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd62484d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd6200b3a40 0x7fd6200b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd62484d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd6200b07d0 0x7fd6201432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd62484d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd620067870 0x7fd6201437b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd62484d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6200b3e20 con 0x7fd6200b3a40 2021-12-17T18:25:45.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd62484d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6200af900 con 0x7fd6200b07d0 2021-12-17T18:25:45.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd62484d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200afba0 con 0x7fd620067870 2021-12-17T18:25:45.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd61ed9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd6200b3a40 0x7fd6200b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd61ed9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd6200b3a40 0x7fd6200b02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53606/0 (socket says 172.21.15.62:53606) 2021-12-17T18:25:45.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd61ed9d700 1 -- 172.21.15.62:0/4042485861 learned_addr learned my addr 172.21.15.62:0/4042485861 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:45.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd61f59e700 1 --2- 172.21.15.62:0/4042485861 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd620067870 0x7fd6201437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd61e59c700 1 --2- 172.21.15.62:0/4042485861 >> v2:172.21.15.109:3300/0 conn(0x7fd6200b07d0 0x7fd6201432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd61ed9d700 1 -- 172.21.15.62:0/4042485861 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd620067870 msgr2=0x7fd6201437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:45.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd61ed9d700 1 --2- 172.21.15.62:0/4042485861 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd620067870 0x7fd6201437b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd61ed9d700 1 -- 172.21.15.62:0/4042485861 >> v2:172.21.15.109:3300/0 conn(0x7fd6200b07d0 msgr2=0x7fd6201432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:45.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd61ed9d700 1 --2- 172.21.15.62:0/4042485861 >> v2:172.21.15.109:3300/0 conn(0x7fd6200b07d0 0x7fd6201432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd61ed9d700 1 -- 172.21.15.62:0/4042485861 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6200afe40 con 0x7fd6200b3a40 2021-12-17T18:25:45.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd61ed9d700 1 --2- 172.21.15.62:0/4042485861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6200b3a40 0x7fd6200b02e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7fd610002f70 tx=0x7fd610006eb0).ready entity=mon.0 client_cookie=b172a21ff41c0075 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:45.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd61dd9b700 1 -- 172.21.15.62:0/4042485861 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd61000d570 con 0x7fd6200b3a40 2021-12-17T18:25:45.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd61dd9b700 1 -- 172.21.15.62:0/4042485861 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd610000e90 con 0x7fd6200b3a40 2021-12-17T18:25:45.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd61dd9b700 1 -- 172.21.15.62:0/4042485861 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd61000d900 con 0x7fd6200b3a40 2021-12-17T18:25:45.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd62484d700 1 -- 172.21.15.62:0/4042485861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6200b3a40 msgr2=0x7fd6200b02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd62484d700 1 --2- 172.21.15.62:0/4042485861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6200b3a40 0x7fd6200b02e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7fd610002f70 tx=0x7fd610006eb0).stop 2021-12-17T18:25:45.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd62484d700 1 -- 172.21.15.62:0/4042485861 shutdown_connections 2021-12-17T18:25:45.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd62484d700 1 --2- 172.21.15.62:0/4042485861 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd620067870 0x7fd6201437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd62484d700 1 --2- 172.21.15.62:0/4042485861 >> v2:172.21.15.109:3300/0 conn(0x7fd6200b07d0 0x7fd6201432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd62484d700 1 --2- 172.21.15.62:0/4042485861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6200b3a40 0x7fd6200b02e0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd62484d700 1 -- 172.21.15.62:0/4042485861 >> 172.21.15.62:0/4042485861 conn(0x7fd6200b7020 msgr2=0x7fd6200b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:45.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd62484d700 1 -- 172.21.15.62:0/4042485861 shutdown_connections 2021-12-17T18:25:45.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.223+0000 7fd62484d700 1 -- 172.21.15.62:0/4042485861 wait complete. 2021-12-17T18:25:45.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd62484d700 1 Processor -- start 2021-12-17T18:25:45.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd62484d700 1 -- start start 2021-12-17T18:25:45.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd62484d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd620067870 0x7fd620155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd62484d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6200b07d0 0x7fd62013c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd62484d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6200b3a40 0x7fd620149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd62484d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200645d0 con 0x7fd6200b3a40 2021-12-17T18:25:45.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd62484d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd620132f00 con 0x7fd6200b07d0 2021-12-17T18:25:45.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd62484d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200637a0 con 0x7fd620067870 2021-12-17T18:25:45.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd61f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6200b3a40 0x7fd620149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd61ed9d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd620067870 0x7fd620155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd61f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6200b3a40 0x7fd620149b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53616/0 (socket says 172.21.15.62:53616) 2021-12-17T18:25:45.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd61ed9d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd620067870 0x7fd620155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:47314/0 (socket says 172.21.15.62:47314) 2021-12-17T18:25:45.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd61f59e700 1 -- 172.21.15.62:0/3011861805 learned_addr learned my addr 172.21.15.62:0/3011861805 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:45.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd61e59c700 1 --2- 172.21.15.62:0/3011861805 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6200b07d0 0x7fd62013c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd61f59e700 1 -- 172.21.15.62:0/3011861805 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd620067870 msgr2=0x7fd620155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd61f59e700 1 --2- 172.21.15.62:0/3011861805 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd620067870 0x7fd620155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd61f59e700 1 -- 172.21.15.62:0/3011861805 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6200b07d0 msgr2=0x7fd62013c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd61f59e700 1 --2- 172.21.15.62:0/3011861805 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6200b07d0 0x7fd62013c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd61f59e700 1 -- 172.21.15.62:0/3011861805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61000b1e0 con 0x7fd6200b3a40 2021-12-17T18:25:45.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd61f59e700 1 --2- 172.21.15.62:0/3011861805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6200b3a40 0x7fd620149b00 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7fd61800a000 tx=0x7fd618008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:45.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd60ffff700 1 -- 172.21.15.62:0/3011861805 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd618013620 con 0x7fd6200b3a40 2021-12-17T18:25:45.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd60ffff700 1 -- 172.21.15.62:0/3011861805 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd618013780 con 0x7fd6200b3a40 2021-12-17T18:25:45.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd62484d700 1 -- 172.21.15.62:0/3011861805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62013c580 con 0x7fd6200b3a40 2021-12-17T18:25:45.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd60ffff700 1 -- 172.21.15.62:0/3011861805 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd618013ae0 con 0x7fd6200b3a40 2021-12-17T18:25:45.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.227+0000 7fd62484d700 1 -- 172.21.15.62:0/3011861805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6201411c0 con 0x7fd6200b3a40 2021-12-17T18:25:45.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.231+0000 7fd62484d700 1 -- 172.21.15.62:0/3011861805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd620064740 con 0x7fd6200b3a40 2021-12-17T18:25:45.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.231+0000 7fd60ffff700 1 -- 172.21.15.62:0/3011861805 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd618013c40 con 0x7fd6200b3a40 2021-12-17T18:25:45.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.231+0000 7fd60ffff700 1 --2- 172.21.15.62:0/3011861805 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd5fc0534f0 0x7fd5fc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.231+0000 7fd60ffff700 1 -- 172.21.15.62:0/3011861805 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd61806bab0 con 0x7fd6200b3a40 2021-12-17T18:25:45.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.231+0000 7fd61ed9d700 1 --2- 172.21.15.62:0/3011861805 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd5fc0534f0 0x7fd5fc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.231+0000 7fd61ed9d700 1 --2- 172.21.15.62:0/3011861805 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd5fc0534f0 0x7fd5fc0559b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fd61001c000 tx=0x7fd610015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:45.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.235+0000 7fd60ffff700 1 -- 172.21.15.62:0/3011861805 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd618042bb0 con 0x7fd6200b3a40 2021-12-17T18:25:45.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.363+0000 7fd62484d700 1 -- 172.21.15.62:0/3011861805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6200ad740 con 0x7fd6200b3a40 2021-12-17T18:25:45.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.367+0000 7fd60ffff700 1 -- 172.21.15.62:0/3011861805 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16102 (secure 0 0 0) 0x7fd6180461d0 con 0x7fd6200b3a40 2021-12-17T18:25:45.373 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:45.373 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":90,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:25:45.098634+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:25:43.705181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-12-17T18:25:44.085619+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:25:45.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.371+0000 7fd62484d700 1 -- 172.21.15.62:0/3011861805 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd5fc0534f0 msgr2=0x7fd5fc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.371+0000 7fd62484d700 1 --2- 172.21.15.62:0/3011861805 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd5fc0534f0 0x7fd5fc0559b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fd61001c000 tx=0x7fd610015000).stop 2021-12-17T18:25:45.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.371+0000 7fd62484d700 1 -- 172.21.15.62:0/3011861805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6200b3a40 msgr2=0x7fd620149b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.371+0000 7fd62484d700 1 --2- 172.21.15.62:0/3011861805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6200b3a40 0x7fd620149b00 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7fd61800a000 tx=0x7fd618008040).stop 2021-12-17T18:25:45.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.371+0000 7fd62484d700 1 -- 172.21.15.62:0/3011861805 shutdown_connections 2021-12-17T18:25:45.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.371+0000 7fd62484d700 1 --2- 172.21.15.62:0/3011861805 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd5fc0534f0 0x7fd5fc0559b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.371+0000 7fd62484d700 1 --2- 172.21.15.62:0/3011861805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6200b3a40 0x7fd620149b00 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.371+0000 7fd62484d700 1 --2- 172.21.15.62:0/3011861805 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6200b07d0 0x7fd62013c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.371+0000 7fd62484d700 1 --2- 172.21.15.62:0/3011861805 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd620067870 0x7fd620155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.371+0000 7fd62484d700 1 -- 172.21.15.62:0/3011861805 >> 172.21.15.62:0/3011861805 conn(0x7fd6200b7020 msgr2=0x7fd620133e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:45.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.371+0000 7fd62484d700 1 -- 172.21.15.62:0/3011861805 shutdown_connections 2021-12-17T18:25:45.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.371+0000 7fd62484d700 1 -- 172.21.15.62:0/3011861805 wait complete. 2021-12-17T18:25:45.392 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:25:45.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.483+0000 7fa65973b700 1 Processor -- start 2021-12-17T18:25:45.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.483+0000 7fa65973b700 1 -- start start 2021-12-17T18:25:45.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa65973b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6540b1730 0x7fa6540ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa65973b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6540b2ce0 con 0x7fa6540b21f0 2021-12-17T18:25:45.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa65973b700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6540aca60 con 0x7fa6540a7bb0 2021-12-17T18:25:45.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa65973b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65414b5b0 con 0x7fa6540b1730 2021-12-17T18:25:45.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa652ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa6540b21f0 0x7fa65414aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37202/0 (socket says 172.21.15.62:37202) 2021-12-17T18:25:45.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa652ffd700 1 -- 172.21.15.62:0/2316220788 learned_addr learned my addr 172.21.15.62:0/2316220788 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:45.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa6527fc700 1 --2- 172.21.15.62:0/2316220788 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6540b1730 0x7fa6540ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 -- 172.21.15.62:0/2316220788 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188611000 0 0) 0x7fa6540b2ce0 con 0x7fa6540b21f0 2021-12-17T18:25:45.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 -- 172.21.15.62:0/2316220788 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa638003260 con 0x7fa6540b21f0 2021-12-17T18:25:45.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 -- 172.21.15.62:0/2316220788 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275184418 0 0) 0x7fa6540aca60 con 0x7fa6540a7bb0 2021-12-17T18:25:45.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 -- 172.21.15.62:0/2316220788 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6540b2ce0 con 0x7fa6540a7bb0 2021-12-17T18:25:45.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 -- 172.21.15.62:0/2316220788 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1889574895 0 0) 0x7fa638003260 con 0x7fa6540b21f0 2021-12-17T18:25:45.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 -- 172.21.15.62:0/2316220788 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6540b1730 msgr2=0x7fa6540ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:45.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 --2- 172.21.15.62:0/2316220788 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6540b1730 0x7fa6540ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 -- 172.21.15.62:0/2316220788 >> v1:172.21.15.109:6789/0 conn(0x7fa6540a7bb0 legacy=0x7fa654067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 -- 172.21.15.62:0/2316220788 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6540b2f10 con 0x7fa6540b21f0 2021-12-17T18:25:45.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 -- 172.21.15.62:0/2316220788 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fa648001660 con 0x7fa6540b21f0 2021-12-17T18:25:45.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 -- 172.21.15.62:0/2316220788 >> v1:172.21.15.62:6789/0 conn(0x7fa6540b21f0 legacy=0x7fa65414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 --2- 172.21.15.62:0/2316220788 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa638003910 0x7fa638003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 --2- 172.21.15.62:0/2316220788 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6540b1730 0x7fa638004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 --2- 172.21.15.62:0/2316220788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6380049f0 0x7fa638004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 -- 172.21.15.62:0/2316220788 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65414b5b0 con 0x7fa6380049f0 2021-12-17T18:25:45.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 -- 172.21.15.62:0/2316220788 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63800b780 con 0x7fa638003910 2021-12-17T18:25:45.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 -- 172.21.15.62:0/2316220788 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63800b940 con 0x7fa6540b1730 2021-12-17T18:25:45.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa652ffd700 1 --2- 172.21.15.62:0/2316220788 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa638003910 0x7fa638003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa6527fc700 1 --2- 172.21.15.62:0/2316220788 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6540b1730 0x7fa638004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa6537fe700 1 --2- 172.21.15.62:0/2316220788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6380049f0 0x7fa638004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa652ffd700 1 -- 172.21.15.62:0/2316220788 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6540b1730 msgr2=0x7fa638004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:45.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa652ffd700 1 --2- 172.21.15.62:0/2316220788 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6540b1730 0x7fa638004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa652ffd700 1 -- 172.21.15.62:0/2316220788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6380049f0 msgr2=0x7fa638004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:45.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa652ffd700 1 --2- 172.21.15.62:0/2316220788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6380049f0 0x7fa638004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa652ffd700 1 -- 172.21.15.62:0/2316220788 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa638003260 con 0x7fa638003910 2021-12-17T18:25:45.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa652ffd700 1 --2- 172.21.15.62:0/2316220788 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa638003910 0x7fa638003d10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fa648001430 tx=0x7fa6540b31b0).ready entity=mon.1 client_cookie=1b7f342d0a7879dd server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:45.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.487+0000 7fa651ffb700 1 -- 172.21.15.62:0/2316220788 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6480071a0 con 0x7fa638003910 2021-12-17T18:25:45.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa651ffb700 1 -- 172.21.15.62:0/2316220788 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa648007300 con 0x7fa638003910 2021-12-17T18:25:45.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa651ffb700 1 -- 172.21.15.62:0/2316220788 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa64800c8f0 con 0x7fa638003910 2021-12-17T18:25:45.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa65973b700 1 -- 172.21.15.62:0/2316220788 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa638003910 msgr2=0x7fa638003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa65973b700 1 --2- 172.21.15.62:0/2316220788 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa638003910 0x7fa638003d10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fa648001430 tx=0x7fa6540b31b0).stop 2021-12-17T18:25:45.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa6537fe700 1 -- 172.21.15.62:0/2316220788 reap_dead start 2021-12-17T18:25:45.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa65973b700 1 -- 172.21.15.62:0/2316220788 shutdown_connections 2021-12-17T18:25:45.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa65973b700 1 -- 172.21.15.62:0/2316220788 >> 172.21.15.62:0/2316220788 conn(0x7fa65405f730 msgr2=0x7fa65405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:45.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa65973b700 1 -- 172.21.15.62:0/2316220788 shutdown_connections 2021-12-17T18:25:45.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa65973b700 1 -- 172.21.15.62:0/2316220788 wait complete. 2021-12-17T18:25:45.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa65973b700 1 Processor -- start 2021-12-17T18:25:45.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa65973b700 1 -- start start 2021-12-17T18:25:45.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa65973b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6541490e0 0x7fa65414f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa65973b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa6540640d0 0x7fa65415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa65973b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa65415a9a0 0x7fa654146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa65973b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6541494c0 con 0x7fa65415a9a0 2021-12-17T18:25:45.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa65973b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6540652c0 con 0x7fa6540640d0 2021-12-17T18:25:45.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa65973b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa654064fe0 con 0x7fa6541490e0 2021-12-17T18:25:45.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa6537fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa65415a9a0 0x7fa654146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa6537fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa65415a9a0 0x7fa654146860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53636/0 (socket says 172.21.15.62:53636) 2021-12-17T18:25:45.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa6537fe700 1 -- 172.21.15.62:0/3274392420 learned_addr learned my addr 172.21.15.62:0/3274392420 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:45.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa6527fc700 1 --2- 172.21.15.62:0/3274392420 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa6540640d0 0x7fa65415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.491+0000 7fa652ffd700 1 --2- 172.21.15.62:0/3274392420 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6541490e0 0x7fa65414f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.495+0000 7fa6537fe700 1 -- 172.21.15.62:0/3274392420 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6541490e0 msgr2=0x7fa65414f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.495+0000 7fa6537fe700 1 --2- 172.21.15.62:0/3274392420 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6541490e0 0x7fa65414f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.495+0000 7fa6537fe700 1 -- 172.21.15.62:0/3274392420 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa6540640d0 msgr2=0x7fa65415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.495+0000 7fa6537fe700 1 --2- 172.21.15.62:0/3274392420 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa6540640d0 0x7fa65415a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.495+0000 7fa6537fe700 1 -- 172.21.15.62:0/3274392420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65415ae20 con 0x7fa65415a9a0 2021-12-17T18:25:45.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.495+0000 7fa6537fe700 1 --2- 172.21.15.62:0/3274392420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa65415a9a0 0x7fa654146860 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7fa64c000b60 tx=0x7fa64c007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:45.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.495+0000 7fa643fff700 1 -- 172.21.15.62:0/3274392420 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa64c0133f0 con 0x7fa65415a9a0 2021-12-17T18:25:45.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.495+0000 7fa643fff700 1 -- 172.21.15.62:0/3274392420 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c013550 con 0x7fa65415a9a0 2021-12-17T18:25:45.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.495+0000 7fa643fff700 1 -- 172.21.15.62:0/3274392420 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa64c0138b0 con 0x7fa65415a9a0 2021-12-17T18:25:45.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.495+0000 7fa65973b700 1 -- 172.21.15.62:0/3274392420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6540637c0 con 0x7fa65415a9a0 2021-12-17T18:25:45.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.495+0000 7fa65973b700 1 -- 172.21.15.62:0/3274392420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa654063d60 con 0x7fa65415a9a0 2021-12-17T18:25:45.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.495+0000 7fa65973b700 1 -- 172.21.15.62:0/3274392420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa654065480 con 0x7fa65415a9a0 2021-12-17T18:25:45.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.495+0000 7fa643fff700 1 -- 172.21.15.62:0/3274392420 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa64c01a030 con 0x7fa65415a9a0 2021-12-17T18:25:45.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.499+0000 7fa643fff700 1 --2- 172.21.15.62:0/3274392420 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa630053580 0x7fa630055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.499+0000 7fa643fff700 1 -- 172.21.15.62:0/3274392420 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa64c06b220 con 0x7fa65415a9a0 2021-12-17T18:25:45.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.499+0000 7fa652ffd700 1 --2- 172.21.15.62:0/3274392420 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa630053580 0x7fa630055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.499+0000 7fa652ffd700 1 --2- 172.21.15.62:0/3274392420 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa630053580 0x7fa630055a40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fa648014000 tx=0x7fa648013000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:45.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.503+0000 7fa643fff700 1 -- 172.21.15.62:0/3274392420 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa64c042380 con 0x7fa65415a9a0 2021-12-17T18:25:45.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.627+0000 7fa65973b700 1 -- 172.21.15.62:0/3274392420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6540573d0 con 0x7fa65415a9a0 2021-12-17T18:25:45.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.631+0000 7fa643fff700 1 -- 172.21.15.62:0/3274392420 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16102 (secure 0 0 0) 0x7fa64c0459a0 con 0x7fa65415a9a0 2021-12-17T18:25:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:45.638 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":90,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:25:45.098634+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:25:43.705181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-12-17T18:25:44.085619+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:25:45.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.631+0000 7fa65973b700 1 -- 172.21.15.62:0/3274392420 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa630053580 msgr2=0x7fa630055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.631+0000 7fa65973b700 1 --2- 172.21.15.62:0/3274392420 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa630053580 0x7fa630055a40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fa648014000 tx=0x7fa648013000).stop 2021-12-17T18:25:45.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.631+0000 7fa65973b700 1 -- 172.21.15.62:0/3274392420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa65415a9a0 msgr2=0x7fa654146860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.631+0000 7fa65973b700 1 --2- 172.21.15.62:0/3274392420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa65415a9a0 0x7fa654146860 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7fa64c000b60 tx=0x7fa64c007a00).stop 2021-12-17T18:25:45.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.631+0000 7fa65973b700 1 -- 172.21.15.62:0/3274392420 shutdown_connections 2021-12-17T18:25:45.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.631+0000 7fa65973b700 1 --2- 172.21.15.62:0/3274392420 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa630053580 0x7fa630055a40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.631+0000 7fa65973b700 1 --2- 172.21.15.62:0/3274392420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa65415a9a0 0x7fa654146860 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.631+0000 7fa65973b700 1 --2- 172.21.15.62:0/3274392420 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa6540640d0 0x7fa65415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.631+0000 7fa65973b700 1 --2- 172.21.15.62:0/3274392420 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6541490e0 0x7fa65414f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.631+0000 7fa65973b700 1 -- 172.21.15.62:0/3274392420 >> 172.21.15.62:0/3274392420 conn(0x7fa65405f730 msgr2=0x7fa65405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:45.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.635+0000 7fa65973b700 1 -- 172.21.15.62:0/3274392420 shutdown_connections 2021-12-17T18:25:45.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.635+0000 7fa65973b700 1 -- 172.21.15.62:0/3274392420 wait complete. 2021-12-17T18:25:45.651 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-12-17T18:25:45.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.751+0000 7fba835c6700 1 Processor -- start 2021-12-17T18:25:45.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.751+0000 7fba835c6700 1 -- start start 2021-12-17T18:25:45.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.751+0000 7fba835c6700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fba7c0b5330 0x7fba7c0b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.751+0000 7fba835c6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba7c0b07c0 0x7fba7c05fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.751+0000 7fba835c6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c0606e0 con 0x7fba7c147440 2021-12-17T18:25:45.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.751+0000 7fba835c6700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c141950 con 0x7fba7c0b5330 2021-12-17T18:25:45.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.751+0000 7fba835c6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c05fa10 con 0x7fba7c0b07c0 2021-12-17T18:25:45.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.751+0000 7fba81b63700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fba7c147440 0x7fba7c147b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37224/0 (socket says 172.21.15.62:37224) 2021-12-17T18:25:45.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.751+0000 7fba81b63700 1 -- 172.21.15.62:0/322977560 learned_addr learned my addr 172.21.15.62:0/322977560 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:45.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.751+0000 7fba80b61700 1 --2- 172.21.15.62:0/322977560 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba7c0b07c0 0x7fba7c05fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.751+0000 7fba81362700 1 --2- 172.21.15.62:0/322977560 >> v2:172.21.15.109:3300/0 conn(0x7fba7c0b5330 0x7fba7c0b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.751+0000 7fba73fff700 1 -- 172.21.15.62:0/322977560 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032165647 0 0) 0x7fba7c0606e0 con 0x7fba7c147440 2021-12-17T18:25:45.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.751+0000 7fba73fff700 1 -- 172.21.15.62:0/322977560 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba60003260 con 0x7fba7c147440 2021-12-17T18:25:45.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba73fff700 1 -- 172.21.15.62:0/322977560 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2168979170 0 0) 0x7fba60003260 con 0x7fba7c147440 2021-12-17T18:25:45.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba73fff700 1 -- 172.21.15.62:0/322977560 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba7c0b07c0 msgr2=0x7fba7c05fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:45.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba73fff700 1 --2- 172.21.15.62:0/322977560 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba7c0b07c0 0x7fba7c05fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba73fff700 1 -- 172.21.15.62:0/322977560 >> v2:172.21.15.109:3300/0 conn(0x7fba7c0b5330 msgr2=0x7fba7c0b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:45.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba73fff700 1 --2- 172.21.15.62:0/322977560 >> v2:172.21.15.109:3300/0 conn(0x7fba7c0b5330 0x7fba7c0b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba73fff700 1 -- 172.21.15.62:0/322977560 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c060980 con 0x7fba7c147440 2021-12-17T18:25:45.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba73fff700 1 -- 172.21.15.62:0/322977560 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fba740019e0 con 0x7fba7c147440 2021-12-17T18:25:45.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba73fff700 1 -- 172.21.15.62:0/322977560 >> v1:172.21.15.62:6789/0 conn(0x7fba7c147440 legacy=0x7fba7c147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba73fff700 1 --2- 172.21.15.62:0/322977560 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba7c0b07c0 0x7fba60003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba73fff700 1 --2- 172.21.15.62:0/322977560 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba60003c80 0x7fba60004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba73fff700 1 --2- 172.21.15.62:0/322977560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba600049f0 0x7fba60004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba73fff700 1 -- 172.21.15.62:0/322977560 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c141950 con 0x7fba600049f0 2021-12-17T18:25:45.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba73fff700 1 -- 172.21.15.62:0/322977560 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6000b750 con 0x7fba60003c80 2021-12-17T18:25:45.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba73fff700 1 -- 172.21.15.62:0/322977560 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6000b890 con 0x7fba7c0b07c0 2021-12-17T18:25:45.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba81b63700 1 --2- 172.21.15.62:0/322977560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba600049f0 0x7fba60004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba81362700 1 --2- 172.21.15.62:0/322977560 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba7c0b07c0 0x7fba60003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba80b61700 1 --2- 172.21.15.62:0/322977560 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba60003c80 0x7fba60004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba81b63700 1 -- 172.21.15.62:0/322977560 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba7c0b07c0 msgr2=0x7fba60003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:45.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba81b63700 1 --2- 172.21.15.62:0/322977560 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba7c0b07c0 0x7fba60003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba81b63700 1 -- 172.21.15.62:0/322977560 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba60003c80 msgr2=0x7fba60004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:45.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba81b63700 1 --2- 172.21.15.62:0/322977560 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba60003c80 0x7fba60004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba81b63700 1 -- 172.21.15.62:0/322977560 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba60003260 con 0x7fba600049f0 2021-12-17T18:25:45.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba81b63700 1 --2- 172.21.15.62:0/322977560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba600049f0 0x7fba60004e70 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7fba600054d0 tx=0x7fba7c061c80).ready entity=mon.0 client_cookie=796a4d0e7e2a767a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:45.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba73fff700 1 -- 172.21.15.62:0/322977560 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba7400cd90 con 0x7fba600049f0 2021-12-17T18:25:45.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba73fff700 1 -- 172.21.15.62:0/322977560 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba74005990 con 0x7fba600049f0 2021-12-17T18:25:45.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba73fff700 1 -- 172.21.15.62:0/322977560 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba74005cf0 con 0x7fba600049f0 2021-12-17T18:25:45.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba835c6700 1 -- 172.21.15.62:0/322977560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba600049f0 msgr2=0x7fba60004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba835c6700 1 --2- 172.21.15.62:0/322977560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba600049f0 0x7fba60004e70 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7fba600054d0 tx=0x7fba7c061c80).stop 2021-12-17T18:25:45.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba81b63700 1 -- 172.21.15.62:0/322977560 reap_dead start 2021-12-17T18:25:45.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba835c6700 1 -- 172.21.15.62:0/322977560 shutdown_connections 2021-12-17T18:25:45.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba835c6700 1 -- 172.21.15.62:0/322977560 >> 172.21.15.62:0/322977560 conn(0x7fba7c05c750 msgr2=0x7fba7c05cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:45.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba835c6700 1 -- 172.21.15.62:0/322977560 shutdown_connections 2021-12-17T18:25:45.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba835c6700 1 -- 172.21.15.62:0/322977560 wait complete. 2021-12-17T18:25:45.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.755+0000 7fba835c6700 1 Processor -- start 2021-12-17T18:25:45.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba835c6700 1 -- start start 2021-12-17T18:25:45.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba835c6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba600049f0 0x7fba7c144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba835c6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba7c142150 0x7fba7c1432a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba835c6700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba7c14b320 0x7fba7c143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba835c6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0af040 con 0x7fba600049f0 2021-12-17T18:25:45.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba835c6700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0af2e0 con 0x7fba7c14b320 2021-12-17T18:25:45.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba835c6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c14ae80 con 0x7fba7c142150 2021-12-17T18:25:45.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba81362700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba600049f0 0x7fba7c144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba81362700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba600049f0 0x7fba7c144650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53652/0 (socket says 172.21.15.62:53652) 2021-12-17T18:25:45.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba81362700 1 -- 172.21.15.62:0/3285564844 learned_addr learned my addr 172.21.15.62:0/3285564844 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:45.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba81b63700 1 --2- 172.21.15.62:0/3285564844 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba7c14b320 0x7fba7c143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba80b61700 1 --2- 172.21.15.62:0/3285564844 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba7c142150 0x7fba7c1432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba81362700 1 -- 172.21.15.62:0/3285564844 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba7c142150 msgr2=0x7fba7c1432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba81362700 1 --2- 172.21.15.62:0/3285564844 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba7c142150 0x7fba7c1432a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba81362700 1 -- 172.21.15.62:0/3285564844 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba7c14b320 msgr2=0x7fba7c143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:45.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba81362700 1 --2- 172.21.15.62:0/3285564844 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba7c14b320 0x7fba7c143790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:45.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba81362700 1 -- 172.21.15.62:0/3285564844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c146610 con 0x7fba600049f0 2021-12-17T18:25:45.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba81b63700 1 --2- 172.21.15.62:0/3285564844 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba7c14b320 0x7fba7c143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:45.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba81362700 1 --2- 172.21.15.62:0/3285564844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba600049f0 0x7fba7c144650 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fba6c00b000 tx=0x7fba6c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:45.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba727fc700 1 -- 172.21.15.62:0/3285564844 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba6c00f730 con 0x7fba600049f0 2021-12-17T18:25:45.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba727fc700 1 -- 172.21.15.62:0/3285564844 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c00f890 con 0x7fba600049f0 2021-12-17T18:25:45.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba835c6700 1 -- 172.21.15.62:0/3285564844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c143c80 con 0x7fba600049f0 2021-12-17T18:25:45.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba727fc700 1 -- 172.21.15.62:0/3285564844 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba6c00fc30 con 0x7fba600049f0 2021-12-17T18:25:45.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.759+0000 7fba835c6700 1 -- 172.21.15.62:0/3285564844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c141c30 con 0x7fba600049f0 2021-12-17T18:25:45.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.763+0000 7fba727fc700 1 -- 172.21.15.62:0/3285564844 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fba6c014440 con 0x7fba600049f0 2021-12-17T18:25:45.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.763+0000 7fba727fc700 1 --2- 172.21.15.62:0/3285564844 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba640534f0 0x7fba640559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:45.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.763+0000 7fba835c6700 1 -- 172.21.15.62:0/3285564844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7c0573d0 con 0x7fba600049f0 2021-12-17T18:25:45.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.763+0000 7fba727fc700 1 -- 172.21.15.62:0/3285564844 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fba6c06c420 con 0x7fba600049f0 2021-12-17T18:25:45.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.763+0000 7fba80b61700 1 --2- 172.21.15.62:0/3285564844 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba640534f0 0x7fba640559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:45.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.763+0000 7fba80b61700 1 --2- 172.21.15.62:0/3285564844 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba640534f0 0x7fba640559b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fba7800b000 tx=0x7fba78008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:45.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.767+0000 7fba727fc700 1 -- 172.21.15.62:0/3285564844 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fba6c018070 con 0x7fba600049f0 2021-12-17T18:25:45.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:45.931+0000 7fba835c6700 1 -- 172.21.15.62:0/3285564844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fba7c14b040 con 0x7fba600049f0 2021-12-17T18:25:46.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.115+0000 7fba727fc700 1 -- 172.21.15.62:0/3285564844 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) v1 ==== 118+0+0 (secure 0 0 0) 0x7fba6c043410 con 0x7fba600049f0 2021-12-17T18:25:46.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.115+0000 7fba835c6700 1 -- 172.21.15.62:0/3285564844 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba640534f0 msgr2=0x7fba640559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.115+0000 7fba835c6700 1 --2- 172.21.15.62:0/3285564844 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba640534f0 0x7fba640559b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fba7800b000 tx=0x7fba78008040).stop 2021-12-17T18:25:46.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.115+0000 7fba835c6700 1 -- 172.21.15.62:0/3285564844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba600049f0 msgr2=0x7fba7c144650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.115+0000 7fba835c6700 1 --2- 172.21.15.62:0/3285564844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba600049f0 0x7fba7c144650 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fba6c00b000 tx=0x7fba6c006df0).stop 2021-12-17T18:25:46.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.115+0000 7fba835c6700 1 -- 172.21.15.62:0/3285564844 shutdown_connections 2021-12-17T18:25:46.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.115+0000 7fba835c6700 1 --2- 172.21.15.62:0/3285564844 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fba640534f0 0x7fba640559b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.115+0000 7fba835c6700 1 --2- 172.21.15.62:0/3285564844 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fba7c14b320 0x7fba7c143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.115+0000 7fba835c6700 1 --2- 172.21.15.62:0/3285564844 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fba7c142150 0x7fba7c1432a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.115+0000 7fba835c6700 1 --2- 172.21.15.62:0/3285564844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba600049f0 0x7fba7c144650 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.115+0000 7fba835c6700 1 -- 172.21.15.62:0/3285564844 >> 172.21.15.62:0/3285564844 conn(0x7fba7c05c750 msgr2=0x7fba7c149300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:46.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.115+0000 7fba835c6700 1 -- 172.21.15.62:0/3285564844 shutdown_connections 2021-12-17T18:25:46.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.115+0000 7fba835c6700 1 -- 172.21.15.62:0/3285564844 wait complete. 2021-12-17T18:25:46.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:46.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a604d700 1 Processor -- start 2021-12-17T18:25:46.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a604d700 1 -- start start 2021-12-17T18:25:46.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a604d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6a00b3760 0x7ff6a00b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a604d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff6a01458d0 0x7ff6a0145d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a604d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a00b5f00 con 0x7ff6a00b5b20 2021-12-17T18:25:46.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a604d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a00b3020 con 0x7ff6a00b3760 2021-12-17T18:25:46.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a604d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a00b32c0 con 0x7ff6a01458d0 2021-12-17T18:25:46.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a484a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6a00b3760 0x7ff6a00b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a504b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff6a00b5b20 0x7ff6a00b6290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37240/0 (socket says 172.21.15.62:37240) 2021-12-17T18:25:46.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a484a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6a00b3760 0x7ff6a00b69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53662/0 (socket says 172.21.15.62:53662) 2021-12-17T18:25:46.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a504b700 1 -- 172.21.15.62:0/2446989641 learned_addr learned my addr 172.21.15.62:0/2446989641 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:46.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a584c700 1 --2- 172.21.15.62:0/2446989641 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff6a01458d0 0x7ff6a0145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a484a700 1 -- 172.21.15.62:0/2446989641 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff6a01458d0 msgr2=0x7ff6a0145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:46.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a484a700 1 --2- 172.21.15.62:0/2446989641 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff6a01458d0 0x7ff6a0145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a484a700 1 -- 172.21.15.62:0/2446989641 >> v1:172.21.15.62:6789/0 conn(0x7ff6a00b5b20 legacy=0x7ff6a00b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a484a700 1 -- 172.21.15.62:0/2446989641 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a00b6e90 con 0x7ff6a00b3760 2021-12-17T18:25:46.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff68ffff700 1 -- 172.21.15.62:0/2446989641 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285585806 0 0) 0x7ff6a00b5f00 con 0x7ff6a00b5b20 2021-12-17T18:25:46.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a484a700 1 --2- 172.21.15.62:0/2446989641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a00b3760 0x7ff6a00b69a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7ff69c002f70 tx=0x7ff69c006df0).ready entity=mon.0 client_cookie=d079bdd90f5a520f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:46.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff68ffff700 1 -- 172.21.15.62:0/2446989641 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff69c00d570 con 0x7ff6a00b3760 2021-12-17T18:25:46.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff68ffff700 1 -- 172.21.15.62:0/2446989641 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c000e90 con 0x7ff6a00b3760 2021-12-17T18:25:46.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff68ffff700 1 -- 172.21.15.62:0/2446989641 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff69c00d8c0 con 0x7ff6a00b3760 2021-12-17T18:25:46.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a604d700 1 -- 172.21.15.62:0/2446989641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a00b3760 msgr2=0x7ff6a00b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a604d700 1 --2- 172.21.15.62:0/2446989641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a00b3760 0x7ff6a00b69a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7ff69c002f70 tx=0x7ff69c006df0).stop 2021-12-17T18:25:46.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a604d700 1 -- 172.21.15.62:0/2446989641 shutdown_connections 2021-12-17T18:25:46.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a604d700 1 --2- 172.21.15.62:0/2446989641 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff6a01458d0 0x7ff6a0145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a604d700 1 --2- 172.21.15.62:0/2446989641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a00b3760 0x7ff6a00b69a0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a604d700 1 -- 172.21.15.62:0/2446989641 >> 172.21.15.62:0/2446989641 conn(0x7ff6a005c750 msgr2=0x7ff6a005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:46.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a604d700 1 -- 172.21.15.62:0/2446989641 shutdown_connections 2021-12-17T18:25:46.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.247+0000 7ff6a604d700 1 -- 172.21.15.62:0/2446989641 wait complete. 2021-12-17T18:25:46.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a604d700 1 Processor -- start 2021-12-17T18:25:46.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a604d700 1 -- start start 2021-12-17T18:25:46.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a604d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff6a00b5b20 0x7ff6a0155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a604d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff6a01458d0 0x7ff6a00b9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a604d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a0065bc0 0x7ff6a0146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a604d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a0064da0 con 0x7ff6a0065bc0 2021-12-17T18:25:46.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a604d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a0065040 con 0x7ff6a01458d0 2021-12-17T18:25:46.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a604d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a0066be0 con 0x7ff6a00b5b20 2021-12-17T18:25:46.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a584c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a0065bc0 0x7ff6a0146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a584c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a0065bc0 0x7ff6a0146f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53670/0 (socket says 172.21.15.62:53670) 2021-12-17T18:25:46.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a584c700 1 -- 172.21.15.62:0/2472454023 learned_addr learned my addr 172.21.15.62:0/2472454023 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:46.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a484a700 1 --2- 172.21.15.62:0/2472454023 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff6a01458d0 0x7ff6a00b9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a504b700 1 --2- 172.21.15.62:0/2472454023 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff6a00b5b20 0x7ff6a0155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a584c700 1 -- 172.21.15.62:0/2472454023 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff6a00b5b20 msgr2=0x7ff6a0155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a584c700 1 --2- 172.21.15.62:0/2472454023 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff6a00b5b20 0x7ff6a0155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a584c700 1 -- 172.21.15.62:0/2472454023 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff6a01458d0 msgr2=0x7ff6a00b9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a584c700 1 --2- 172.21.15.62:0/2472454023 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff6a01458d0 0x7ff6a00b9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a584c700 1 -- 172.21.15.62:0/2472454023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c00b180 con 0x7ff6a0065bc0 2021-12-17T18:25:46.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a504b700 1 --2- 172.21.15.62:0/2472454023 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff6a00b5b20 0x7ff6a0155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:25:46.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a584c700 1 --2- 172.21.15.62:0/2472454023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a0065bc0 0x7ff6a0146f50 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7ff698006e00 tx=0x7ff6980091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:46.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff68e7fc700 1 -- 172.21.15.62:0/2472454023 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff69800c7f0 con 0x7ff6a0065bc0 2021-12-17T18:25:46.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff68e7fc700 1 -- 172.21.15.62:0/2472454023 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69800c950 con 0x7ff6a0065bc0 2021-12-17T18:25:46.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a604d700 1 -- 172.21.15.62:0/2472454023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a0064820 con 0x7ff6a0065bc0 2021-12-17T18:25:46.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff68e7fc700 1 -- 172.21.15.62:0/2472454023 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff69800ccb0 con 0x7ff6a0065bc0 2021-12-17T18:25:46.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a604d700 1 -- 172.21.15.62:0/2472454023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a01475e0 con 0x7ff6a0065bc0 2021-12-17T18:25:46.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.251+0000 7ff6a604d700 1 -- 172.21.15.62:0/2472454023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a00573d0 con 0x7ff6a0065bc0 2021-12-17T18:25:46.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.255+0000 7ff68e7fc700 1 -- 172.21.15.62:0/2472454023 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff698022070 con 0x7ff6a0065bc0 2021-12-17T18:25:46.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.255+0000 7ff68e7fc700 1 --2- 172.21.15.62:0/2472454023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6800536a0 0x7ff680055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.255+0000 7ff68e7fc700 1 -- 172.21.15.62:0/2472454023 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff69806bfe0 con 0x7ff6a0065bc0 2021-12-17T18:25:46.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.255+0000 7ff6a504b700 1 --2- 172.21.15.62:0/2472454023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6800536a0 0x7ff680055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.255+0000 7ff6a504b700 1 --2- 172.21.15.62:0/2472454023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6800536a0 0x7ff680055b60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7ff690008000 tx=0x7ff690009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:46.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.259+0000 7ff68e7fc700 1 -- 172.21.15.62:0/2472454023 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff698043140 con 0x7ff6a0065bc0 2021-12-17T18:25:46.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.423+0000 7ff6a604d700 1 -- 172.21.15.62:0/2472454023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6a0068f30 con 0x7ff6a0065bc0 2021-12-17T18:25:46.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.423+0000 7ff68e7fc700 1 -- 172.21.15.62:0/2472454023 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2140 (secure 0 0 0) 0x7ff698016020 con 0x7ff6a0065bc0 2021-12-17T18:25:46.431 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:46.432 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":43,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.109:6835/1223620032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1223620032},{"type":"v1","addr":"172.21.15.109:6835","nonce":1223620032}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":42}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:25:45.098870+0000","modified":"2021-12-17T18:25:46.102354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7044":{"gid":7044,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/994270358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":994270358},{"type":"v1","addr":"172.21.15.62:6833","nonce":994270358}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-12-17T18:25:46.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.427+0000 7ff6a604d700 1 -- 172.21.15.62:0/2472454023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6800536a0 msgr2=0x7ff680055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.427+0000 7ff6a604d700 1 --2- 172.21.15.62:0/2472454023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6800536a0 0x7ff680055b60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7ff690008000 tx=0x7ff690009040).stop 2021-12-17T18:25:46.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.427+0000 7ff6a604d700 1 -- 172.21.15.62:0/2472454023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a0065bc0 msgr2=0x7ff6a0146f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.427+0000 7ff6a604d700 1 --2- 172.21.15.62:0/2472454023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a0065bc0 0x7ff6a0146f50 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7ff698006e00 tx=0x7ff6980091d0).stop 2021-12-17T18:25:46.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.427+0000 7ff6a604d700 1 -- 172.21.15.62:0/2472454023 shutdown_connections 2021-12-17T18:25:46.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.427+0000 7ff6a604d700 1 --2- 172.21.15.62:0/2472454023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6800536a0 0x7ff680055b60 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.427+0000 7ff6a604d700 1 --2- 172.21.15.62:0/2472454023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a0065bc0 0x7ff6a0146f50 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.427+0000 7ff6a604d700 1 --2- 172.21.15.62:0/2472454023 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff6a01458d0 0x7ff6a00b9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.427+0000 7ff6a604d700 1 --2- 172.21.15.62:0/2472454023 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff6a00b5b20 0x7ff6a0155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.427+0000 7ff6a604d700 1 -- 172.21.15.62:0/2472454023 >> 172.21.15.62:0/2472454023 conn(0x7ff6a005c750 msgr2=0x7ff6a0144d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:46.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.427+0000 7ff6a604d700 1 -- 172.21.15.62:0/2472454023 shutdown_connections 2021-12-17T18:25:46.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.427+0000 7ff6a604d700 1 -- 172.21.15.62:0/2472454023 wait complete. 2021-12-17T18:25:46.436 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 43 2021-12-17T18:25:46.445 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:25:46.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754f2cc700 1 Processor -- start 2021-12-17T18:25:46.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754f2cc700 1 -- start start 2021-12-17T18:25:46.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754f2cc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f754805f8d0 0x7f75480b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754f2cc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f75480b2ed0 0x7f75480aec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754f2cc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75480af370 0x7f75480af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754f2cc700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75480ae4e0 con 0x7f754805f8d0 2021-12-17T18:25:46.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754f2cc700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75480ae780 con 0x7f75480b2ed0 2021-12-17T18:25:46.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754f2cc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75480af110 con 0x7f75480af370 2021-12-17T18:25:46.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754d068700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f754805f8d0 0x7f75480b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754d068700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f754805f8d0 0x7f75480b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53674/0 (socket says 172.21.15.62:53674) 2021-12-17T18:25:46.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754d068700 1 -- 172.21.15.62:0/3737906300 learned_addr learned my addr 172.21.15.62:0/3737906300 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:46.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754c867700 1 --2- 172.21.15.62:0/3737906300 >> v2:172.21.15.109:3300/0 conn(0x7f75480b2ed0 0x7f75480aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754d869700 1 --2- 172.21.15.62:0/3737906300 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75480af370 0x7f75480af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754d068700 1 -- 172.21.15.62:0/3737906300 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75480af370 msgr2=0x7f75480af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:46.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754d068700 1 --2- 172.21.15.62:0/3737906300 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75480af370 0x7f75480af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754d068700 1 -- 172.21.15.62:0/3737906300 >> v2:172.21.15.109:3300/0 conn(0x7f75480b2ed0 msgr2=0x7f75480aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:46.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754d068700 1 --2- 172.21.15.62:0/3737906300 >> v2:172.21.15.109:3300/0 conn(0x7f75480b2ed0 0x7f75480aec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754d068700 1 -- 172.21.15.62:0/3737906300 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75480b12e0 con 0x7f754805f8d0 2021-12-17T18:25:46.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754c867700 1 --2- 172.21.15.62:0/3737906300 >> v2:172.21.15.109:3300/0 conn(0x7f75480b2ed0 0x7f75480aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:46.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754d068700 1 --2- 172.21.15.62:0/3737906300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754805f8d0 0x7f75480b36b0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f7544002f70 tx=0x7f7544006eb0).ready entity=mon.0 client_cookie=bcf1edeeeab2e316 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:46.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f753ffff700 1 -- 172.21.15.62:0/3737906300 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f754400d570 con 0x7f754805f8d0 2021-12-17T18:25:46.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f753ffff700 1 -- 172.21.15.62:0/3737906300 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7544000e90 con 0x7f754805f8d0 2021-12-17T18:25:46.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f753ffff700 1 -- 172.21.15.62:0/3737906300 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f754400d900 con 0x7f754805f8d0 2021-12-17T18:25:46.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754f2cc700 1 -- 172.21.15.62:0/3737906300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754805f8d0 msgr2=0x7f75480b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754f2cc700 1 --2- 172.21.15.62:0/3737906300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754805f8d0 0x7f75480b36b0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f7544002f70 tx=0x7f7544006eb0).stop 2021-12-17T18:25:46.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754f2cc700 1 -- 172.21.15.62:0/3737906300 shutdown_connections 2021-12-17T18:25:46.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754f2cc700 1 --2- 172.21.15.62:0/3737906300 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75480af370 0x7f75480af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754f2cc700 1 --2- 172.21.15.62:0/3737906300 >> v2:172.21.15.109:3300/0 conn(0x7f75480b2ed0 0x7f75480aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754f2cc700 1 --2- 172.21.15.62:0/3737906300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754805f8d0 0x7f75480b36b0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754f2cc700 1 -- 172.21.15.62:0/3737906300 >> 172.21.15.62:0/3737906300 conn(0x7f754805bcd0 msgr2=0x7f75480638c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:46.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754f2cc700 1 -- 172.21.15.62:0/3737906300 shutdown_connections 2021-12-17T18:25:46.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.543+0000 7f754f2cc700 1 -- 172.21.15.62:0/3737906300 wait complete. 2021-12-17T18:25:46.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754f2cc700 1 Processor -- start 2021-12-17T18:25:46.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754f2cc700 1 -- start start 2021-12-17T18:25:46.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754f2cc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754805f8d0 0x7f7548066df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754f2cc700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75480af370 0x7f7548159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754f2cc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75480b2ed0 0x7f754809f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754f2cc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75480ad740 con 0x7f754805f8d0 2021-12-17T18:25:46.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754f2cc700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75480a1910 con 0x7f75480af370 2021-12-17T18:25:46.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754f2cc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75480a1bb0 con 0x7f75480b2ed0 2021-12-17T18:25:46.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754d068700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754805f8d0 0x7f7548066df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754d068700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754805f8d0 0x7f7548066df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53680/0 (socket says 172.21.15.62:53680) 2021-12-17T18:25:46.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754d068700 1 -- 172.21.15.62:0/3064829329 learned_addr learned my addr 172.21.15.62:0/3064829329 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:46.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754d869700 1 --2- 172.21.15.62:0/3064829329 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75480b2ed0 0x7f754809f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754c867700 1 --2- 172.21.15.62:0/3064829329 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75480af370 0x7f7548159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754d068700 1 -- 172.21.15.62:0/3064829329 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75480b2ed0 msgr2=0x7f754809f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754d068700 1 --2- 172.21.15.62:0/3064829329 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75480b2ed0 0x7f754809f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754d068700 1 -- 172.21.15.62:0/3064829329 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75480af370 msgr2=0x7f7548159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754d068700 1 --2- 172.21.15.62:0/3064829329 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75480af370 0x7f7548159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754d068700 1 -- 172.21.15.62:0/3064829329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7540009470 con 0x7f754805f8d0 2021-12-17T18:25:46.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754c867700 1 --2- 172.21.15.62:0/3064829329 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75480af370 0x7f7548159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:46.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.547+0000 7f754d068700 1 --2- 172.21.15.62:0/3064829329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754805f8d0 0x7f7548066df0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f7544002f70 tx=0x7f7544015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:46.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.551+0000 7f753e7fc700 1 -- 172.21.15.62:0/3064829329 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75440117e0 con 0x7f754805f8d0 2021-12-17T18:25:46.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.551+0000 7f753e7fc700 1 -- 172.21.15.62:0/3064829329 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7544011940 con 0x7f754805f8d0 2021-12-17T18:25:46.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.551+0000 7f754f2cc700 1 -- 172.21.15.62:0/3064829329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754400b1e0 con 0x7f754805f8d0 2021-12-17T18:25:46.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.551+0000 7f753e7fc700 1 -- 172.21.15.62:0/3064829329 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7544011ca0 con 0x7f754805f8d0 2021-12-17T18:25:46.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.551+0000 7f754f2cc700 1 -- 172.21.15.62:0/3064829329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754815a4b0 con 0x7f754805f8d0 2021-12-17T18:25:46.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.551+0000 7f754f2cc700 1 -- 172.21.15.62:0/3064829329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75480573d0 con 0x7f754805f8d0 2021-12-17T18:25:46.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.551+0000 7f753e7fc700 1 -- 172.21.15.62:0/3064829329 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7544025030 con 0x7f754805f8d0 2021-12-17T18:25:46.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.551+0000 7f753e7fc700 1 --2- 172.21.15.62:0/3064829329 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75280536d0 0x7f7528055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.551+0000 7f753e7fc700 1 -- 172.21.15.62:0/3064829329 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f754406cad0 con 0x7f754805f8d0 2021-12-17T18:25:46.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.551+0000 7f754c867700 1 --2- 172.21.15.62:0/3064829329 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75280536d0 0x7f7528055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.555+0000 7f754c867700 1 --2- 172.21.15.62:0/3064829329 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75280536d0 0x7f7528055b90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f754000b000 tx=0x7f7540008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:46.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.559+0000 7f753e7fc700 1 -- 172.21.15.62:0/3064829329 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7544043b90 con 0x7f754805f8d0 2021-12-17T18:25:46.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.687+0000 7f754f2cc700 1 -- 172.21.15.62:0/3064829329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7548068f30 con 0x7f754805f8d0 2021-12-17T18:25:46.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.691+0000 7f753e7fc700 1 -- 172.21.15.62:0/3064829329 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16102 (secure 0 0 0) 0x7f7544023020 con 0x7f754805f8d0 2021-12-17T18:25:46.697 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:46.697 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":91,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:25:46.101202+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:25:43.705181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-12-17T18:25:44.085619+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:25:46.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.691+0000 7f754f2cc700 1 -- 172.21.15.62:0/3064829329 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75280536d0 msgr2=0x7f7528055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.691+0000 7f754f2cc700 1 --2- 172.21.15.62:0/3064829329 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75280536d0 0x7f7528055b90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f754000b000 tx=0x7f7540008040).stop 2021-12-17T18:25:46.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.691+0000 7f754f2cc700 1 -- 172.21.15.62:0/3064829329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754805f8d0 msgr2=0x7f7548066df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.691+0000 7f754f2cc700 1 --2- 172.21.15.62:0/3064829329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754805f8d0 0x7f7548066df0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f7544002f70 tx=0x7f7544015000).stop 2021-12-17T18:25:46.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.691+0000 7f754f2cc700 1 -- 172.21.15.62:0/3064829329 shutdown_connections 2021-12-17T18:25:46.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.691+0000 7f754f2cc700 1 --2- 172.21.15.62:0/3064829329 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75280536d0 0x7f7528055b90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.691+0000 7f754f2cc700 1 --2- 172.21.15.62:0/3064829329 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75480b2ed0 0x7f754809f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.691+0000 7f754f2cc700 1 --2- 172.21.15.62:0/3064829329 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75480af370 0x7f7548159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.691+0000 7f754f2cc700 1 --2- 172.21.15.62:0/3064829329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754805f8d0 0x7f7548066df0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.691+0000 7f754f2cc700 1 -- 172.21.15.62:0/3064829329 >> 172.21.15.62:0/3064829329 conn(0x7f754805bcd0 msgr2=0x7f75480b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:46.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.691+0000 7f754f2cc700 1 -- 172.21.15.62:0/3064829329 shutdown_connections 2021-12-17T18:25:46.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.691+0000 7f754f2cc700 1 -- 172.21.15.62:0/3064829329 wait complete. 2021-12-17T18:25:46.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:25:46.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.823+0000 7f7f54a2c700 1 Processor -- start 2021-12-17T18:25:46.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.823+0000 7f7f54a2c700 1 -- start start 2021-12-17T18:25:46.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f54a2c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f500b09d0 0x7f7f50144b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f54a2c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f500b6780 con 0x7f7f50145060 2021-12-17T18:25:46.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f54a2c700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f501446d0 con 0x7f7f500b0db0 2021-12-17T18:25:46.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f54a2c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f50060550 con 0x7f7f500b09d0 2021-12-17T18:25:46.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4f59e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7f50145060 0x7f7f5005fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37270/0 (socket says 172.21.15.62:37270) 2021-12-17T18:25:46.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4f59e700 1 -- 172.21.15.62:0/907655367 learned_addr learned my addr 172.21.15.62:0/907655367 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:46.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4ed9d700 1 --2- 172.21.15.62:0/907655367 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f500b09d0 0x7f7f50144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 -- 172.21.15.62:0/907655367 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966452243 0 0) 0x7f7f500b6780 con 0x7f7f50145060 2021-12-17T18:25:46.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 -- 172.21.15.62:0/907655367 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f34003260 con 0x7f7f50145060 2021-12-17T18:25:46.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 -- 172.21.15.62:0/907655367 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1909940703 0 0) 0x7f7f34003260 con 0x7f7f50145060 2021-12-17T18:25:46.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 -- 172.21.15.62:0/907655367 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f500b09d0 msgr2=0x7f7f50144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:46.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 --2- 172.21.15.62:0/907655367 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f500b09d0 0x7f7f50144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 -- 172.21.15.62:0/907655367 >> v1:172.21.15.109:6789/0 conn(0x7f7f500b0db0 legacy=0x7f7f5005f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 -- 172.21.15.62:0/907655367 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5005bcd0 con 0x7f7f50145060 2021-12-17T18:25:46.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 -- 172.21.15.62:0/907655367 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f7f480019e0 con 0x7f7f50145060 2021-12-17T18:25:46.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 -- 172.21.15.62:0/907655367 >> v1:172.21.15.62:6789/0 conn(0x7f7f50145060 legacy=0x7f7f5005fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 --2- 172.21.15.62:0/907655367 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f500b09d0 0x7f7f34003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 --2- 172.21.15.62:0/907655367 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7f34003c70 0x7f7f34004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 --2- 172.21.15.62:0/907655367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f340049f0 0x7f7f34004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 -- 172.21.15.62:0/907655367 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f50060550 con 0x7f7f340049f0 2021-12-17T18:25:46.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 -- 172.21.15.62:0/907655367 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3400fb60 con 0x7f7f34003c70 2021-12-17T18:25:46.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 -- 172.21.15.62:0/907655367 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3400fd20 con 0x7f7f500b09d0 2021-12-17T18:25:46.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4f59e700 1 --2- 172.21.15.62:0/907655367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f340049f0 0x7f7f34004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4ed9d700 1 --2- 172.21.15.62:0/907655367 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f500b09d0 0x7f7f34003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4659c700 1 --2- 172.21.15.62:0/907655367 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7f34003c70 0x7f7f34004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4f59e700 1 -- 172.21.15.62:0/907655367 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f500b09d0 msgr2=0x7f7f34003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:46.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4f59e700 1 --2- 172.21.15.62:0/907655367 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f500b09d0 0x7f7f34003780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4f59e700 1 -- 172.21.15.62:0/907655367 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7f34003c70 msgr2=0x7f7f34004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:46.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4f59e700 1 --2- 172.21.15.62:0/907655367 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7f34003c70 0x7f7f34004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4f59e700 1 -- 172.21.15.62:0/907655367 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f34003260 con 0x7f7f340049f0 2021-12-17T18:25:46.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4f59e700 1 --2- 172.21.15.62:0/907655367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f340049f0 0x7f7f34004e70 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f7f480016f0 tx=0x7f7f480021b0).ready entity=mon.0 client_cookie=b5955b14eacada85 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:46.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 -- 172.21.15.62:0/907655367 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f4800cca0 con 0x7f7f340049f0 2021-12-17T18:25:46.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 -- 172.21.15.62:0/907655367 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4800ce00 con 0x7f7f340049f0 2021-12-17T18:25:46.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4e59c700 1 -- 172.21.15.62:0/907655367 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f48005b80 con 0x7f7f340049f0 2021-12-17T18:25:46.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f54a2c700 1 -- 172.21.15.62:0/907655367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f340049f0 msgr2=0x7f7f34004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f54a2c700 1 --2- 172.21.15.62:0/907655367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f340049f0 0x7f7f34004e70 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f7f480016f0 tx=0x7f7f480021b0).stop 2021-12-17T18:25:46.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f4f59e700 1 -- 172.21.15.62:0/907655367 reap_dead start 2021-12-17T18:25:46.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f54a2c700 1 -- 172.21.15.62:0/907655367 shutdown_connections 2021-12-17T18:25:46.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f54a2c700 1 -- 172.21.15.62:0/907655367 >> 172.21.15.62:0/907655367 conn(0x7f7f500b5ae0 msgr2=0x7f7f500b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:46.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f54a2c700 1 -- 172.21.15.62:0/907655367 shutdown_connections 2021-12-17T18:25:46.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.827+0000 7f7f54a2c700 1 -- 172.21.15.62:0/907655367 wait complete. 2021-12-17T18:25:46.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.831+0000 7f7f54a2c700 1 Processor -- start 2021-12-17T18:25:46.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.831+0000 7f7f54a2c700 1 -- start start 2021-12-17T18:25:46.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f54a2c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f5013ac10 0x7f7f500ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f54a2c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f50140570 0x7f7f5013edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f54a2c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7f501514a0 0x7f7f50151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f54a2c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5013fab0 con 0x7f7f5013ac10 2021-12-17T18:25:46.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f54a2c700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f50140bd0 con 0x7f7f501514a0 2021-12-17T18:25:46.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f54a2c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f50151e10 con 0x7f7f50140570 2021-12-17T18:25:46.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f4ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f5013ac10 0x7f7f500ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f4ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f5013ac10 0x7f7f500ae360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53700/0 (socket says 172.21.15.62:53700) 2021-12-17T18:25:46.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f4ed9d700 1 -- 172.21.15.62:0/480259443 learned_addr learned my addr 172.21.15.62:0/480259443 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:46.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f4f59e700 1 --2- 172.21.15.62:0/480259443 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7f501514a0 0x7f7f50151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f4659c700 1 --2- 172.21.15.62:0/480259443 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f50140570 0x7f7f5013edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f4ed9d700 1 -- 172.21.15.62:0/480259443 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f50140570 msgr2=0x7f7f5013edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f4ed9d700 1 --2- 172.21.15.62:0/480259443 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f50140570 0x7f7f5013edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f4ed9d700 1 -- 172.21.15.62:0/480259443 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7f501514a0 msgr2=0x7f7f50151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:46.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f4ed9d700 1 --2- 172.21.15.62:0/480259443 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7f501514a0 0x7f7f50151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:46.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f4ed9d700 1 -- 172.21.15.62:0/480259443 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f500aea70 con 0x7f7f5013ac10 2021-12-17T18:25:46.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f4ed9d700 1 --2- 172.21.15.62:0/480259443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f5013ac10 0x7f7f500ae360 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f7f4000b000 tx=0x7f7f40006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:46.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f4cd99700 1 -- 172.21.15.62:0/480259443 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f4000f700 con 0x7f7f5013ac10 2021-12-17T18:25:46.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f4cd99700 1 -- 172.21.15.62:0/480259443 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4000f860 con 0x7f7f5013ac10 2021-12-17T18:25:46.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f54a2c700 1 -- 172.21.15.62:0/480259443 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5013aff0 con 0x7f7f5013ac10 2021-12-17T18:25:46.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f4cd99700 1 -- 172.21.15.62:0/480259443 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f4000fbc0 con 0x7f7f5013ac10 2021-12-17T18:25:46.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f54a2c700 1 -- 172.21.15.62:0/480259443 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f500aef70 con 0x7f7f5013ac10 2021-12-17T18:25:46.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.835+0000 7f7f54a2c700 1 -- 172.21.15.62:0/480259443 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f500573d0 con 0x7f7f5013ac10 2021-12-17T18:25:46.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.839+0000 7f7f4cd99700 1 -- 172.21.15.62:0/480259443 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7f4000fd20 con 0x7f7f5013ac10 2021-12-17T18:25:46.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.839+0000 7f7f4cd99700 1 --2- 172.21.15.62:0/480259443 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7f280534f0 0x7f7f280559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:46.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.839+0000 7f7f4cd99700 1 -- 172.21.15.62:0/480259443 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7f4006c330 con 0x7f7f5013ac10 2021-12-17T18:25:46.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.839+0000 7f7f4659c700 1 --2- 172.21.15.62:0/480259443 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7f280534f0 0x7f7f280559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:46.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.839+0000 7f7f4659c700 1 --2- 172.21.15.62:0/480259443 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7f280534f0 0x7f7f280559b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f7f38003000 tx=0x7f7f380079e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:46.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:46.847+0000 7f7f4cd99700 1 -- 172.21.15.62:0/480259443 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7f40043320 con 0x7f7f5013ac10 2021-12-17T18:25:47.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.011+0000 7f7f54a2c700 1 -- 172.21.15.62:0/480259443 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7f5006a330 con 0x7f7f5013ac10 2021-12-17T18:25:47.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.019+0000 7f7f4cd99700 1 -- 172.21.15.62:0/480259443 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v29) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7f40018020 con 0x7f7f5013ac10 2021-12-17T18:25:47.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.023+0000 7f7f54a2c700 1 -- 172.21.15.62:0/480259443 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7f280534f0 msgr2=0x7f7f280559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.023+0000 7f7f54a2c700 1 --2- 172.21.15.62:0/480259443 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7f280534f0 0x7f7f280559b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f7f38003000 tx=0x7f7f380079e0).stop 2021-12-17T18:25:47.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.023+0000 7f7f54a2c700 1 -- 172.21.15.62:0/480259443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f5013ac10 msgr2=0x7f7f500ae360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.023+0000 7f7f54a2c700 1 --2- 172.21.15.62:0/480259443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f5013ac10 0x7f7f500ae360 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f7f4000b000 tx=0x7f7f40006df0).stop 2021-12-17T18:25:47.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.023+0000 7f7f54a2c700 1 -- 172.21.15.62:0/480259443 shutdown_connections 2021-12-17T18:25:47.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.023+0000 7f7f54a2c700 1 --2- 172.21.15.62:0/480259443 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7f280534f0 0x7f7f280559b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.023+0000 7f7f54a2c700 1 --2- 172.21.15.62:0/480259443 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7f501514a0 0x7f7f50151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.023+0000 7f7f54a2c700 1 --2- 172.21.15.62:0/480259443 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f50140570 0x7f7f5013edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.023+0000 7f7f54a2c700 1 --2- 172.21.15.62:0/480259443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f5013ac10 0x7f7f500ae360 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.023+0000 7f7f54a2c700 1 -- 172.21.15.62:0/480259443 >> 172.21.15.62:0/480259443 conn(0x7f7f500b5ae0 msgr2=0x7f7f50137ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:47.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.023+0000 7f7f54a2c700 1 -- 172.21.15.62:0/480259443 shutdown_connections 2021-12-17T18:25:47.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.023+0000 7f7f54a2c700 1 -- 172.21.15.62:0/480259443 wait complete. 2021-12-17T18:25:47.034 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.0 2021-12-17T18:25:47.044 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:25:47.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f369a5a7700 1 Processor -- start 2021-12-17T18:25:47.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f369a5a7700 1 -- start start 2021-12-17T18:25:47.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f369a5a7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f36940b2160 0x7f3694147480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f369a5a7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f36940b0750 0x7f369414af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f369a5a7700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f369405f730 0x7f369414b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f369a5a7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3694147970 con 0x7f36940b0750 2021-12-17T18:25:47.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f369a5a7700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3694060ac0 con 0x7f369405f730 2021-12-17T18:25:47.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f369a5a7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36940b2540 con 0x7f36940b2160 2021-12-17T18:25:47.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f36937fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f36940b0750 0x7f369414af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f36937fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f36940b0750 0x7f369414af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53708/0 (socket says 172.21.15.62:53708) 2021-12-17T18:25:47.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f36937fe700 1 -- 172.21.15.62:0/3775989546 learned_addr learned my addr 172.21.15.62:0/3775989546 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:47.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f3693fff700 1 --2- 172.21.15.62:0/3775989546 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f36940b2160 0x7f3694147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f3698b44700 1 --2- 172.21.15.62:0/3775989546 >> v2:172.21.15.109:3300/0 conn(0x7f369405f730 0x7f369414b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f36937fe700 1 -- 172.21.15.62:0/3775989546 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f36940b2160 msgr2=0x7f3694147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:47.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f36937fe700 1 --2- 172.21.15.62:0/3775989546 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f36940b2160 0x7f3694147480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f36937fe700 1 -- 172.21.15.62:0/3775989546 >> v2:172.21.15.109:3300/0 conn(0x7f369405f730 msgr2=0x7f369414b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:47.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f36937fe700 1 --2- 172.21.15.62:0/3775989546 >> v2:172.21.15.109:3300/0 conn(0x7f369405f730 0x7f369414b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f36937fe700 1 -- 172.21.15.62:0/3775989546 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369405fd90 con 0x7f36940b0750 2021-12-17T18:25:47.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f36937fe700 1 --2- 172.21.15.62:0/3775989546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36940b0750 0x7f369414af30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f3684002f70 tx=0x7f3684006eb0).ready entity=mon.0 client_cookie=19e4907771ff455 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:47.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f3692ffd700 1 -- 172.21.15.62:0/3775989546 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f368400d570 con 0x7f36940b0750 2021-12-17T18:25:47.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f3692ffd700 1 -- 172.21.15.62:0/3775989546 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3684000e90 con 0x7f36940b0750 2021-12-17T18:25:47.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.139+0000 7f3692ffd700 1 -- 172.21.15.62:0/3775989546 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f368400d900 con 0x7f36940b0750 2021-12-17T18:25:47.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f369a5a7700 1 -- 172.21.15.62:0/3775989546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36940b0750 msgr2=0x7f369414af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f369a5a7700 1 --2- 172.21.15.62:0/3775989546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36940b0750 0x7f369414af30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f3684002f70 tx=0x7f3684006eb0).stop 2021-12-17T18:25:47.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f369a5a7700 1 -- 172.21.15.62:0/3775989546 shutdown_connections 2021-12-17T18:25:47.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f369a5a7700 1 --2- 172.21.15.62:0/3775989546 >> v2:172.21.15.109:3300/0 conn(0x7f369405f730 0x7f369414b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f369a5a7700 1 --2- 172.21.15.62:0/3775989546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36940b0750 0x7f369414af30 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f369a5a7700 1 --2- 172.21.15.62:0/3775989546 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f36940b2160 0x7f3694147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f369a5a7700 1 -- 172.21.15.62:0/3775989546 >> 172.21.15.62:0/3775989546 conn(0x7f3694062430 msgr2=0x7f3694062840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:47.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f369a5a7700 1 -- 172.21.15.62:0/3775989546 shutdown_connections 2021-12-17T18:25:47.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f369a5a7700 1 -- 172.21.15.62:0/3775989546 wait complete. 2021-12-17T18:25:47.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f369a5a7700 1 Processor -- start 2021-12-17T18:25:47.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f369a5a7700 1 -- start start 2021-12-17T18:25:47.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f369a5a7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f369405f730 0x7f369414bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f369a5a7700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f36940b0750 0x7f36940aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f369a5a7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f36940b2160 0x7f3694156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f369a5a7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36940ae410 con 0x7f369405f730 2021-12-17T18:25:47.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f369a5a7700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3694157610 con 0x7f36940b0750 2021-12-17T18:25:47.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f369a5a7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36940ae640 con 0x7f36940b2160 2021-12-17T18:25:47.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f3693fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f369405f730 0x7f369414bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f3693fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f369405f730 0x7f369414bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53716/0 (socket says 172.21.15.62:53716) 2021-12-17T18:25:47.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f36937fe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f36940b0750 0x7f36940aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f3698b44700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f36940b2160 0x7f3694156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f3693fff700 1 -- 172.21.15.62:0/4293241998 learned_addr learned my addr 172.21.15.62:0/4293241998 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:47.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f3693fff700 1 -- 172.21.15.62:0/4293241998 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f36940b2160 msgr2=0x7f3694156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f3693fff700 1 --2- 172.21.15.62:0/4293241998 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f36940b2160 0x7f3694156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f3693fff700 1 -- 172.21.15.62:0/4293241998 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f36940b0750 msgr2=0x7f36940aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f3693fff700 1 --2- 172.21.15.62:0/4293241998 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f36940b0750 0x7f36940aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f3693fff700 1 -- 172.21.15.62:0/4293241998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368400b1e0 con 0x7f369405f730 2021-12-17T18:25:47.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f36937fe700 1 --2- 172.21.15.62:0/4293241998 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f36940b0750 0x7f36940aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:47.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.143+0000 7f3693fff700 1 --2- 172.21.15.62:0/4293241998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f369405f730 0x7f369414bb70 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f367c00c000 tx=0x7f367c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:47.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.147+0000 7f36917fa700 1 -- 172.21.15.62:0/4293241998 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f367c011750 con 0x7f369405f730 2021-12-17T18:25:47.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.147+0000 7f36917fa700 1 -- 172.21.15.62:0/4293241998 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c0118b0 con 0x7f369405f730 2021-12-17T18:25:47.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.147+0000 7f369a5a7700 1 -- 172.21.15.62:0/4293241998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36940a2ae0 con 0x7f369405f730 2021-12-17T18:25:47.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.147+0000 7f36917fa700 1 -- 172.21.15.62:0/4293241998 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f367c011c10 con 0x7f369405f730 2021-12-17T18:25:47.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.147+0000 7f369a5a7700 1 -- 172.21.15.62:0/4293241998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369414c280 con 0x7f369405f730 2021-12-17T18:25:47.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.147+0000 7f369a5a7700 1 -- 172.21.15.62:0/4293241998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3694060030 con 0x7f369405f730 2021-12-17T18:25:47.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.147+0000 7f36917fa700 1 -- 172.21.15.62:0/4293241998 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f367c011d70 con 0x7f369405f730 2021-12-17T18:25:47.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.147+0000 7f36917fa700 1 --2- 172.21.15.62:0/4293241998 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3678053610 0x7f3678055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.147+0000 7f36917fa700 1 -- 172.21.15.62:0/4293241998 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f367c06bec0 con 0x7f369405f730 2021-12-17T18:25:47.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.147+0000 7f36937fe700 1 --2- 172.21.15.62:0/4293241998 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3678053610 0x7f3678055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.151+0000 7f36937fe700 1 --2- 172.21.15.62:0/4293241998 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3678053610 0x7f3678055ad0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f368401c000 tx=0x7f3684015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:47.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.151+0000 7f36917fa700 1 -- 172.21.15.62:0/4293241998 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f367c042e30 con 0x7f369405f730 2021-12-17T18:25:47.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.319+0000 7f369a5a7700 1 -- 172.21.15.62:0/4293241998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f36940573d0 con 0x7f369405f730 2021-12-17T18:25:47.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.327+0000 7f36917fa700 1 -- 172.21.15.62:0/4293241998 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v30) v1 ==== 184+0+0 (secure 0 0 0) 0x7f367c046450 con 0x7f369405f730 2021-12-17T18:25:47.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.327+0000 7f369a5a7700 1 -- 172.21.15.62:0/4293241998 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3678053610 msgr2=0x7f3678055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.327+0000 7f369a5a7700 1 --2- 172.21.15.62:0/4293241998 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3678053610 0x7f3678055ad0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f368401c000 tx=0x7f3684015000).stop 2021-12-17T18:25:47.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.327+0000 7f369a5a7700 1 -- 172.21.15.62:0/4293241998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f369405f730 msgr2=0x7f369414bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.327+0000 7f369a5a7700 1 --2- 172.21.15.62:0/4293241998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f369405f730 0x7f369414bb70 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f367c00c000 tx=0x7f367c006df0).stop 2021-12-17T18:25:47.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.331+0000 7f369a5a7700 1 -- 172.21.15.62:0/4293241998 shutdown_connections 2021-12-17T18:25:47.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.331+0000 7f369a5a7700 1 --2- 172.21.15.62:0/4293241998 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3678053610 0x7f3678055ad0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.331+0000 7f369a5a7700 1 --2- 172.21.15.62:0/4293241998 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f36940b2160 0x7f3694156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.331+0000 7f369a5a7700 1 --2- 172.21.15.62:0/4293241998 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f36940b0750 0x7f36940aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.331+0000 7f369a5a7700 1 --2- 172.21.15.62:0/4293241998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f369405f730 0x7f369414bb70 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.331+0000 7f369a5a7700 1 -- 172.21.15.62:0/4293241998 >> 172.21.15.62:0/4293241998 conn(0x7f3694062430 msgr2=0x7f369414ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:47.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.331+0000 7f369a5a7700 1 -- 172.21.15.62:0/4293241998 shutdown_connections 2021-12-17T18:25:47.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.331+0000 7f369a5a7700 1 -- 172.21.15.62:0/4293241998 wait complete. 2021-12-17T18:25:47.339 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.1 2021-12-17T18:25:47.349 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:25:47.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.451+0000 7ffa861ed700 1 Processor -- start 2021-12-17T18:25:47.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.451+0000 7ffa861ed700 1 -- start start 2021-12-17T18:25:47.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.451+0000 7ffa861ed700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa80066180 0x7ffa801401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.451+0000 7ffa861ed700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffa801406e0 0x7ffa80140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.451+0000 7ffa861ed700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa800ad430 con 0x7ffa8005ca90 2021-12-17T18:25:47.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.451+0000 7ffa861ed700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa800adba0 con 0x7ffa801406e0 2021-12-17T18:25:47.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.451+0000 7ffa861ed700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800ad660 con 0x7ffa80066180 2021-12-17T18:25:47.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.451+0000 7ffa859ec700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffa801406e0 0x7ffa80140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.451+0000 7ffa859ec700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffa801406e0 0x7ffa80140b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53724/0 (socket says 172.21.15.62:53724) 2021-12-17T18:25:47.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.451+0000 7ffa859ec700 1 -- 172.21.15.62:0/2010827701 learned_addr learned my addr 172.21.15.62:0/2010827701 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:47.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.451+0000 7ffa849ea700 1 --2- 172.21.15.62:0/2010827701 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa80066180 0x7ffa801401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.451+0000 7ffa859ec700 1 -- 172.21.15.62:0/2010827701 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa80066180 msgr2=0x7ffa801401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:47.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.451+0000 7ffa859ec700 1 --2- 172.21.15.62:0/2010827701 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa80066180 0x7ffa801401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.455+0000 7ffa859ec700 1 -- 172.21.15.62:0/2010827701 >> v1:172.21.15.109:6789/0 conn(0x7ffa8005ca90 legacy=0x7ffa80065a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:47.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.455+0000 7ffa859ec700 1 -- 172.21.15.62:0/2010827701 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa800ad900 con 0x7ffa801406e0 2021-12-17T18:25:47.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.455+0000 7ffa859ec700 1 --2- 172.21.15.62:0/2010827701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa801406e0 0x7ffa80140b50 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7ffa8005d200 tx=0x7ffa78009290).ready entity=mon.0 client_cookie=a13575d1f4c0f59b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:47.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.455+0000 7ffa73fff700 1 -- 172.21.15.62:0/2010827701 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa7800b860 con 0x7ffa801406e0 2021-12-17T18:25:47.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.455+0000 7ffa73fff700 1 -- 172.21.15.62:0/2010827701 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7800b9c0 con 0x7ffa801406e0 2021-12-17T18:25:47.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.455+0000 7ffa73fff700 1 -- 172.21.15.62:0/2010827701 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa7800bb70 con 0x7ffa801406e0 2021-12-17T18:25:47.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.455+0000 7ffa861ed700 1 -- 172.21.15.62:0/2010827701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa801406e0 msgr2=0x7ffa80140b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.455+0000 7ffa861ed700 1 --2- 172.21.15.62:0/2010827701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa801406e0 0x7ffa80140b50 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7ffa8005d200 tx=0x7ffa78009290).stop 2021-12-17T18:25:47.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.455+0000 7ffa861ed700 1 -- 172.21.15.62:0/2010827701 shutdown_connections 2021-12-17T18:25:47.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.455+0000 7ffa861ed700 1 --2- 172.21.15.62:0/2010827701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa801406e0 0x7ffa80140b50 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.455+0000 7ffa861ed700 1 --2- 172.21.15.62:0/2010827701 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa80066180 0x7ffa801401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.455+0000 7ffa861ed700 1 -- 172.21.15.62:0/2010827701 >> 172.21.15.62:0/2010827701 conn(0x7ffa80062430 msgr2=0x7ffa80062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:47.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.455+0000 7ffa861ed700 1 -- 172.21.15.62:0/2010827701 shutdown_connections 2021-12-17T18:25:47.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.455+0000 7ffa861ed700 1 -- 172.21.15.62:0/2010827701 wait complete. 2021-12-17T18:25:47.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.455+0000 7ffa861ed700 1 Processor -- start 2021-12-17T18:25:47.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.455+0000 7ffa861ed700 1 -- start start 2021-12-17T18:25:47.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa861ed700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffa8005ca90 0x7ffa800b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa861ed700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa80066180 0x7ffa8013c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa861ed700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa801406e0 0x7ffa800af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa861ed700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa80110980 con 0x7ffa801406e0 2021-12-17T18:25:47.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa861ed700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800b7270 con 0x7ffa8005ca90 2021-12-17T18:25:47.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa861ed700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800b7510 con 0x7ffa80066180 2021-12-17T18:25:47.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa859ec700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa801406e0 0x7ffa800af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa849ea700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa80066180 0x7ffa8013c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa859ec700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa801406e0 0x7ffa800af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53732/0 (socket says 172.21.15.62:53732) 2021-12-17T18:25:47.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa849ea700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa80066180 0x7ffa8013c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:47432/0 (socket says 172.21.15.62:47432) 2021-12-17T18:25:47.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa859ec700 1 -- 172.21.15.62:0/2870648157 learned_addr learned my addr 172.21.15.62:0/2870648157 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:47.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa851eb700 1 --2- 172.21.15.62:0/2870648157 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffa8005ca90 0x7ffa800b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa859ec700 1 -- 172.21.15.62:0/2870648157 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa80066180 msgr2=0x7ffa8013c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa859ec700 1 --2- 172.21.15.62:0/2870648157 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa80066180 0x7ffa8013c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa859ec700 1 -- 172.21.15.62:0/2870648157 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffa8005ca90 msgr2=0x7ffa800b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa859ec700 1 --2- 172.21.15.62:0/2870648157 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffa8005ca90 0x7ffa800b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa859ec700 1 -- 172.21.15.62:0/2870648157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa78009530 con 0x7ffa801406e0 2021-12-17T18:25:47.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa859ec700 1 --2- 172.21.15.62:0/2870648157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa801406e0 0x7ffa800af090 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7ffa8005d200 tx=0x7ffa78016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:47.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa727fc700 1 -- 172.21.15.62:0/2870648157 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa780032f0 con 0x7ffa801406e0 2021-12-17T18:25:47.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa727fc700 1 -- 172.21.15.62:0/2870648157 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa78021440 con 0x7ffa801406e0 2021-12-17T18:25:47.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa861ed700 1 -- 172.21.15.62:0/2870648157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa80153940 con 0x7ffa801406e0 2021-12-17T18:25:47.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa727fc700 1 -- 172.21.15.62:0/2870648157 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa780217a0 con 0x7ffa801406e0 2021-12-17T18:25:47.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.459+0000 7ffa861ed700 1 -- 172.21.15.62:0/2870648157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa800b80c0 con 0x7ffa801406e0 2021-12-17T18:25:47.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.463+0000 7ffa861ed700 1 -- 172.21.15.62:0/2870648157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa800b76d0 con 0x7ffa801406e0 2021-12-17T18:25:47.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.463+0000 7ffa727fc700 1 -- 172.21.15.62:0/2870648157 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffa7800f070 con 0x7ffa801406e0 2021-12-17T18:25:47.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.463+0000 7ffa727fc700 1 --2- 172.21.15.62:0/2870648157 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffa68053640 0x7ffa68055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.463+0000 7ffa727fc700 1 -- 172.21.15.62:0/2870648157 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffa7806c800 con 0x7ffa801406e0 2021-12-17T18:25:47.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.463+0000 7ffa851eb700 1 --2- 172.21.15.62:0/2870648157 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffa68053640 0x7ffa68055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.463+0000 7ffa851eb700 1 --2- 172.21.15.62:0/2870648157 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffa68053640 0x7ffa68055b00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7ffa7400d000 tx=0x7ffa74007b70).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:47.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.471+0000 7ffa727fc700 1 -- 172.21.15.62:0/2870648157 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffa78043960 con 0x7ffa801406e0 2021-12-17T18:25:47.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.635+0000 7ffa861ed700 1 -- 172.21.15.62:0/2870648157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ffa800b28b0 con 0x7ffa801406e0 2021-12-17T18:25:47.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.643+0000 7ffa727fc700 1 -- 172.21.15.62:0/2870648157 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v31) v1 ==== 184+0+0 (secure 0 0 0) 0x7ffa78015070 con 0x7ffa801406e0 2021-12-17T18:25:47.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.643+0000 7ffa861ed700 1 -- 172.21.15.62:0/2870648157 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffa68053640 msgr2=0x7ffa68055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.643+0000 7ffa861ed700 1 --2- 172.21.15.62:0/2870648157 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffa68053640 0x7ffa68055b00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7ffa7400d000 tx=0x7ffa74007b70).stop 2021-12-17T18:25:47.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.643+0000 7ffa861ed700 1 -- 172.21.15.62:0/2870648157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa801406e0 msgr2=0x7ffa800af090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.643+0000 7ffa861ed700 1 --2- 172.21.15.62:0/2870648157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa801406e0 0x7ffa800af090 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7ffa8005d200 tx=0x7ffa78016000).stop 2021-12-17T18:25:47.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.643+0000 7ffa861ed700 1 -- 172.21.15.62:0/2870648157 shutdown_connections 2021-12-17T18:25:47.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.643+0000 7ffa861ed700 1 --2- 172.21.15.62:0/2870648157 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffa68053640 0x7ffa68055b00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.643+0000 7ffa861ed700 1 --2- 172.21.15.62:0/2870648157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa801406e0 0x7ffa800af090 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.643+0000 7ffa861ed700 1 --2- 172.21.15.62:0/2870648157 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffa80066180 0x7ffa8013c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.643+0000 7ffa861ed700 1 --2- 172.21.15.62:0/2870648157 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffa8005ca90 0x7ffa800b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.643+0000 7ffa861ed700 1 -- 172.21.15.62:0/2870648157 >> 172.21.15.62:0/2870648157 conn(0x7ffa80062430 msgr2=0x7ffa8013de50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:47.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.643+0000 7ffa861ed700 1 -- 172.21.15.62:0/2870648157 shutdown_connections 2021-12-17T18:25:47.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.643+0000 7ffa861ed700 1 -- 172.21.15.62:0/2870648157 wait complete. 2021-12-17T18:25:47.655 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.2 2021-12-17T18:25:47.665 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:47.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.763+0000 7f88409b0700 1 Processor -- start 2021-12-17T18:25:47.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.763+0000 7f88409b0700 1 -- start start 2021-12-17T18:25:47.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f88409b0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f883c0b3a40 0x7f883c0b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f88409b0700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f883c067870 0x7f883c1439d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f88409b0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883c0b3e20 con 0x7f883c0b07d0 2021-12-17T18:25:47.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f88409b0700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883c0af900 con 0x7f883c067870 2021-12-17T18:25:47.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f88409b0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0afba0 con 0x7f883c0b3a40 2021-12-17T18:25:47.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f883affd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f883c0b07d0 0x7f883c1432c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37316/0 (socket says 172.21.15.62:37316) 2021-12-17T18:25:47.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f883affd700 1 -- 172.21.15.62:0/84121673 learned_addr learned my addr 172.21.15.62:0/84121673 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:47.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f883bfff700 1 --2- 172.21.15.62:0/84121673 >> v2:172.21.15.109:3300/0 conn(0x7f883c067870 0x7f883c1439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f883b7fe700 1 --2- 172.21.15.62:0/84121673 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f883c0b3a40 0x7f883c0b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f883a7fc700 1 -- 172.21.15.62:0/84121673 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957142660 0 0) 0x7f883c0b3e20 con 0x7f883c0b07d0 2021-12-17T18:25:47.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f883a7fc700 1 -- 172.21.15.62:0/84121673 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8828003260 con 0x7f883c0b07d0 2021-12-17T18:25:47.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f883a7fc700 1 -- 172.21.15.62:0/84121673 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1135899813 0 0) 0x7f8828003260 con 0x7f883c0b07d0 2021-12-17T18:25:47.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f883b7fe700 1 -- 172.21.15.62:0/84121673 >> v2:172.21.15.109:3300/0 conn(0x7f883c067870 msgr2=0x7f883c1439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:47.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f883b7fe700 1 --2- 172.21.15.62:0/84121673 >> v2:172.21.15.109:3300/0 conn(0x7f883c067870 0x7f883c1439d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f883b7fe700 1 -- 172.21.15.62:0/84121673 >> v1:172.21.15.62:6789/0 conn(0x7f883c0b07d0 legacy=0x7f883c1432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f883b7fe700 1 -- 172.21.15.62:0/84121673 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c0afe40 con 0x7f883c0b3a40 2021-12-17T18:25:47.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f883b7fe700 1 --2- 172.21.15.62:0/84121673 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f883c0b3a40 0x7f883c0b02e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f8830001800 tx=0x7f882c006df0).ready entity=mon.2 client_cookie=4e00b06d667c5ec3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:47.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f883a7fc700 1 -- 172.21.15.62:0/84121673 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8830001660 con 0x7f883c0b3a40 2021-12-17T18:25:47.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f883a7fc700 1 -- 172.21.15.62:0/84121673 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c000e90 con 0x7f883c0b3a40 2021-12-17T18:25:47.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f883a7fc700 1 -- 172.21.15.62:0/84121673 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f882c012460 con 0x7f883c0b3a40 2021-12-17T18:25:47.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f88409b0700 1 -- 172.21.15.62:0/84121673 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f883c0b3a40 msgr2=0x7f883c0b02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f88409b0700 1 --2- 172.21.15.62:0/84121673 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f883c0b3a40 0x7f883c0b02e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f8830001800 tx=0x7f882c006df0).stop 2021-12-17T18:25:47.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f88409b0700 1 -- 172.21.15.62:0/84121673 shutdown_connections 2021-12-17T18:25:47.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f88409b0700 1 --2- 172.21.15.62:0/84121673 >> v2:172.21.15.109:3300/0 conn(0x7f883c067870 0x7f883c1439d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f88409b0700 1 --2- 172.21.15.62:0/84121673 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f883c0b3a40 0x7f883c0b02e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f88409b0700 1 -- 172.21.15.62:0/84121673 >> 172.21.15.62:0/84121673 conn(0x7f883c0b7020 msgr2=0x7f883c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:47.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f88409b0700 1 -- 172.21.15.62:0/84121673 shutdown_connections 2021-12-17T18:25:47.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.767+0000 7f88409b0700 1 -- 172.21.15.62:0/84121673 wait complete. 2021-12-17T18:25:47.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f88409b0700 1 Processor -- start 2021-12-17T18:25:47.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f88409b0700 1 -- start start 2021-12-17T18:25:47.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f88409b0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f883c067870 0x7f883c140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f88409b0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f883c0b07d0 0x7f883c138360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f88409b0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f883c0b3a40 0x7f883c063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f88409b0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c1361e0 con 0x7f883c0b07d0 2021-12-17T18:25:47.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f88409b0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c138850 con 0x7f883c067870 2021-12-17T18:25:47.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f88409b0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0651f0 con 0x7f883c0b3a40 2021-12-17T18:25:47.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f883affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f883c0b07d0 0x7f883c138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f883b7fe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f883c067870 0x7f883c140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f883bfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f883c0b3a40 0x7f883c063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f883b7fe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f883c067870 0x7f883c140090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:60292/0 (socket says 172.21.15.62:60292) 2021-12-17T18:25:47.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f883affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f883c0b07d0 0x7f883c138360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53744/0 (socket says 172.21.15.62:53744) 2021-12-17T18:25:47.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f883b7fe700 1 -- 172.21.15.62:0/2785540332 learned_addr learned my addr 172.21.15.62:0/2785540332 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:47.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f883bfff700 1 -- 172.21.15.62:0/2785540332 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f883c067870 msgr2=0x7f883c140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f883bfff700 1 --2- 172.21.15.62:0/2785540332 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f883c067870 0x7f883c140090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f883bfff700 1 -- 172.21.15.62:0/2785540332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f883c0b07d0 msgr2=0x7f883c138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f883bfff700 1 --2- 172.21.15.62:0/2785540332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f883c0b07d0 0x7f883c138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f883bfff700 1 -- 172.21.15.62:0/2785540332 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c00b180 con 0x7f883c0b3a40 2021-12-17T18:25:47.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.771+0000 7f883bfff700 1 --2- 172.21.15.62:0/2785540332 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f883c0b3a40 0x7f883c063620 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f883c137910 tx=0x7f88340091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:47.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.775+0000 7f8838ff9700 1 -- 172.21.15.62:0/2785540332 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8834012600 con 0x7f883c0b3a40 2021-12-17T18:25:47.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.775+0000 7f8838ff9700 1 -- 172.21.15.62:0/2785540332 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8834012760 con 0x7f883c0b3a40 2021-12-17T18:25:47.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.775+0000 7f88409b0700 1 -- 172.21.15.62:0/2785540332 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883c065770 con 0x7f883c0b3a40 2021-12-17T18:25:47.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.775+0000 7f8838ff9700 1 -- 172.21.15.62:0/2785540332 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8834012ac0 con 0x7f883c0b3a40 2021-12-17T18:25:47.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.775+0000 7f88409b0700 1 -- 172.21.15.62:0/2785540332 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883c064f00 con 0x7f883c0b3a40 2021-12-17T18:25:47.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.775+0000 7f88409b0700 1 -- 172.21.15.62:0/2785540332 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883c065930 con 0x7f883c0b3a40 2021-12-17T18:25:47.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.775+0000 7f8838ff9700 1 -- 172.21.15.62:0/2785540332 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8834012c20 con 0x7f883c0b3a40 2021-12-17T18:25:47.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.775+0000 7f8838ff9700 1 --2- 172.21.15.62:0/2785540332 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f881c0536a0 0x7f881c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:47.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.775+0000 7f8838ff9700 1 -- 172.21.15.62:0/2785540332 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f883406bb90 con 0x7f883c0b3a40 2021-12-17T18:25:47.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.775+0000 7f883b7fe700 1 --2- 172.21.15.62:0/2785540332 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f881c0536a0 0x7f881c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:47.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.775+0000 7f883b7fe700 1 --2- 172.21.15.62:0/2785540332 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f881c0536a0 0x7f881c055b60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f882c01a000 tx=0x7f882c014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:47.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.783+0000 7f8838ff9700 1 -- 172.21.15.62:0/2785540332 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8834042c70 con 0x7f883c0b3a40 2021-12-17T18:25:47.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.951+0000 7f88409b0700 1 -- 172.21.15.62:0/2785540332 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f883c0ad740 con 0x7f883c0b3a40 2021-12-17T18:25:47.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.955+0000 7f8838ff9700 1 -- 172.21.15.62:0/2785540332 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f8834016020 con 0x7f883c0b3a40 2021-12-17T18:25:47.960 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:47.960 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":43,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.109:6835/1223620032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1223620032},{"type":"v1","addr":"172.21.15.109:6835","nonce":1223620032}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":42}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:25:45.098870+0000","modified":"2021-12-17T18:25:46.102354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7044":{"gid":7044,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/994270358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":994270358},{"type":"v1","addr":"172.21.15.62:6833","nonce":994270358}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-12-17T18:25:47.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.955+0000 7f88409b0700 1 -- 172.21.15.62:0/2785540332 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f881c0536a0 msgr2=0x7f881c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.955+0000 7f88409b0700 1 --2- 172.21.15.62:0/2785540332 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f881c0536a0 0x7f881c055b60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f882c01a000 tx=0x7f882c014000).stop 2021-12-17T18:25:47.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.955+0000 7f88409b0700 1 -- 172.21.15.62:0/2785540332 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f883c0b3a40 msgr2=0x7f883c063620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:47.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.955+0000 7f88409b0700 1 --2- 172.21.15.62:0/2785540332 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f883c0b3a40 0x7f883c063620 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f883c137910 tx=0x7f88340091d0).stop 2021-12-17T18:25:47.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.955+0000 7f88409b0700 1 -- 172.21.15.62:0/2785540332 shutdown_connections 2021-12-17T18:25:47.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.955+0000 7f88409b0700 1 --2- 172.21.15.62:0/2785540332 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f881c0536a0 0x7f881c055b60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.955+0000 7f88409b0700 1 --2- 172.21.15.62:0/2785540332 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f883c0b3a40 0x7f883c063620 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.955+0000 7f88409b0700 1 --2- 172.21.15.62:0/2785540332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f883c0b07d0 0x7f883c138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.955+0000 7f88409b0700 1 --2- 172.21.15.62:0/2785540332 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f883c067870 0x7f883c140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:47.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.955+0000 7f88409b0700 1 -- 172.21.15.62:0/2785540332 >> 172.21.15.62:0/2785540332 conn(0x7f883c0b7020 msgr2=0x7f883c0b5500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:47.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.955+0000 7f88409b0700 1 -- 172.21.15.62:0/2785540332 shutdown_connections 2021-12-17T18:25:47.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:47.955+0000 7f88409b0700 1 -- 172.21.15.62:0/2785540332 wait complete. 2021-12-17T18:25:47.967 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 43 2021-12-17T18:25:48.179 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:25:45.098870+0000', 'modified': '2021-12-17T18:25:46.102354+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7044}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7044': {'gid': 7044, 'name': 'a', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/994270358', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 994270358}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 994270358}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:25:48.180 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:25:48.180 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:25:48.298 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":7044,"want_state":"up:active","state":"up:active","rank_uptime":3.1861372810000002,"mdsmap_epoch":43,"osdmap_epoch":92,"osdmap_epoch_barrier":91,"uptime":7.3400013470000003} 2021-12-17T18:25:48.299 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 7044, "mdsmap_epoch": 43, "osdmap_epoch": 92, "osdmap_epoch_barrier": 91, "rank_uptime": 3.186137281, "state": "up:active", "uptime": 7.340001347, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:25:48.300 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:25:48.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4739f700 1 Processor -- start 2021-12-17T18:25:48.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4739f700 1 -- start start 2021-12-17T18:25:48.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4739f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fde400682c0 0x7fde400b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4739f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde400ad610 0x7fde400b2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4739f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde40143640 con 0x7fde400a8d20 2021-12-17T18:25:48.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4739f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde401438e0 con 0x7fde400682c0 2021-12-17T18:25:48.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4739f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde400aca60 con 0x7fde400ad610 2021-12-17T18:25:48.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4493a700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fde400a8d20 0x7fde400acf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37330/0 (socket says 172.21.15.62:37330) 2021-12-17T18:25:48.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4493a700 1 -- 172.21.15.62:0/1663138276 learned_addr learned my addr 172.21.15.62:0/1663138276 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:48.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4593c700 1 --2- 172.21.15.62:0/1663138276 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde400ad610 0x7fde400b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4513b700 1 --2- 172.21.15.62:0/1663138276 >> v2:172.21.15.109:3300/0 conn(0x7fde400682c0 0x7fde400b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde2ffff700 1 -- 172.21.15.62:0/1663138276 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828453621 0 0) 0x7fde40143640 con 0x7fde400a8d20 2021-12-17T18:25:48.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde2ffff700 1 -- 172.21.15.62:0/1663138276 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde28005470 con 0x7fde400a8d20 2021-12-17T18:25:48.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde2ffff700 1 -- 172.21.15.62:0/1663138276 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4245849129 0 0) 0x7fde28005470 con 0x7fde400a8d20 2021-12-17T18:25:48.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde2ffff700 1 -- 172.21.15.62:0/1663138276 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde400ad610 msgr2=0x7fde400b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:48.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde2ffff700 1 --2- 172.21.15.62:0/1663138276 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde400ad610 0x7fde400b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde2ffff700 1 -- 172.21.15.62:0/1663138276 >> v2:172.21.15.109:3300/0 conn(0x7fde400682c0 msgr2=0x7fde400b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:48.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde2ffff700 1 --2- 172.21.15.62:0/1663138276 >> v2:172.21.15.109:3300/0 conn(0x7fde400682c0 0x7fde400b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde2ffff700 1 -- 172.21.15.62:0/1663138276 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde40140630 con 0x7fde400a8d20 2021-12-17T18:25:48.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde2ffff700 1 -- 172.21.15.62:0/1663138276 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fde30001660 con 0x7fde400a8d20 2021-12-17T18:25:48.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde2ffff700 1 -- 172.21.15.62:0/1663138276 >> v1:172.21.15.62:6789/0 conn(0x7fde400a8d20 legacy=0x7fde400acf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:48.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde2ffff700 1 --2- 172.21.15.62:0/1663138276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde28005960 0x7fde28005d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde2ffff700 1 --2- 172.21.15.62:0/1663138276 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde400ad610 0x7fde28006710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde2ffff700 1 --2- 172.21.15.62:0/1663138276 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde28006c00 0x7fde28007080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde2ffff700 1 -- 172.21.15.62:0/1663138276 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde401438e0 con 0x7fde28005960 2021-12-17T18:25:48.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde2ffff700 1 -- 172.21.15.62:0/1663138276 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde400aca60 con 0x7fde28006c00 2021-12-17T18:25:48.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde2ffff700 1 -- 172.21.15.62:0/1663138276 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2800d960 con 0x7fde400ad610 2021-12-17T18:25:48.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4513b700 1 --2- 172.21.15.62:0/1663138276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde28005960 0x7fde28005d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4493a700 1 --2- 172.21.15.62:0/1663138276 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde400ad610 0x7fde28006710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4593c700 1 --2- 172.21.15.62:0/1663138276 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde28006c00 0x7fde28007080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4493a700 1 -- 172.21.15.62:0/1663138276 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde28006c00 msgr2=0x7fde28007080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:48.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4493a700 1 --2- 172.21.15.62:0/1663138276 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde28006c00 0x7fde28007080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4493a700 1 -- 172.21.15.62:0/1663138276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde28005960 msgr2=0x7fde28005d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:48.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4493a700 1 --2- 172.21.15.62:0/1663138276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde28005960 0x7fde28005d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4493a700 1 -- 172.21.15.62:0/1663138276 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde28005470 con 0x7fde400ad610 2021-12-17T18:25:48.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4513b700 1 --2- 172.21.15.62:0/1663138276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde28005960 0x7fde28005d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:48.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde4493a700 1 --2- 172.21.15.62:0/1663138276 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde400ad610 0x7fde28006710 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fde30001370 tx=0x7fde30001e50).ready entity=mon.2 client_cookie=43da073eaebc5fc3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:48.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.395+0000 7fde2ffff700 1 -- 172.21.15.62:0/1663138276 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde300070d0 con 0x7fde400ad610 2021-12-17T18:25:48.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde2ffff700 1 -- 172.21.15.62:0/1663138276 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde30007230 con 0x7fde400ad610 2021-12-17T18:25:48.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde2ffff700 1 -- 172.21.15.62:0/1663138276 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde3000c9c0 con 0x7fde400ad610 2021-12-17T18:25:48.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4739f700 1 -- 172.21.15.62:0/1663138276 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde400ad610 msgr2=0x7fde28006710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:48.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4739f700 1 --2- 172.21.15.62:0/1663138276 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde400ad610 0x7fde28006710 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fde30001370 tx=0x7fde30001e50).stop 2021-12-17T18:25:48.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4593c700 1 -- 172.21.15.62:0/1663138276 reap_dead start 2021-12-17T18:25:48.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4739f700 1 -- 172.21.15.62:0/1663138276 shutdown_connections 2021-12-17T18:25:48.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4739f700 1 -- 172.21.15.62:0/1663138276 >> 172.21.15.62:0/1663138276 conn(0x7fde4005f730 msgr2=0x7fde4005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:48.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4739f700 1 -- 172.21.15.62:0/1663138276 shutdown_connections 2021-12-17T18:25:48.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4739f700 1 -- 172.21.15.62:0/1663138276 wait complete. 2021-12-17T18:25:48.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4739f700 1 Processor -- start 2021-12-17T18:25:48.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4739f700 1 -- start start 2021-12-17T18:25:48.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4739f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde400ad610 0x7fde4009ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4739f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde400a1470 0x7fde400ab440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4739f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde400aa510 0x7fde400aa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4739f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde401527a0 con 0x7fde400aa510 2021-12-17T18:25:48.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4739f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde400abe30 con 0x7fde400ad610 2021-12-17T18:25:48.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4739f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde400a1d40 con 0x7fde400a1470 2021-12-17T18:25:48.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4593c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde400aa510 0x7fde400aa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4593c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde400aa510 0x7fde400aa9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53766/0 (socket says 172.21.15.62:53766) 2021-12-17T18:25:48.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4513b700 1 --2- 172.21.15.62:0/1339545335 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde400ad610 0x7fde4009ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4593c700 1 -- 172.21.15.62:0/1339545335 learned_addr learned my addr 172.21.15.62:0/1339545335 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:48.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.399+0000 7fde4493a700 1 --2- 172.21.15.62:0/1339545335 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde400a1470 0x7fde400ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.403+0000 7fde4493a700 1 -- 172.21.15.62:0/1339545335 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde400ad610 msgr2=0x7fde4009ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:48.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.403+0000 7fde4493a700 1 --2- 172.21.15.62:0/1339545335 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde400ad610 0x7fde4009ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.403+0000 7fde4493a700 1 -- 172.21.15.62:0/1339545335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde400aa510 msgr2=0x7fde400aa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:48.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.403+0000 7fde4493a700 1 --2- 172.21.15.62:0/1339545335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde400aa510 0x7fde400aa9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.403+0000 7fde4493a700 1 -- 172.21.15.62:0/1339545335 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde401534d0 con 0x7fde400a1470 2021-12-17T18:25:48.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.403+0000 7fde4593c700 1 --2- 172.21.15.62:0/1339545335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde400aa510 0x7fde400aa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:48.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.403+0000 7fde4493a700 1 --2- 172.21.15.62:0/1339545335 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde400a1470 0x7fde400ab440 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fde30001370 tx=0x7fde30015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:48.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.403+0000 7fde2e7fc700 1 -- 172.21.15.62:0/1339545335 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde300070d0 con 0x7fde400a1470 2021-12-17T18:25:48.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.403+0000 7fde2e7fc700 1 -- 172.21.15.62:0/1339545335 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde30004520 con 0x7fde400a1470 2021-12-17T18:25:48.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.403+0000 7fde4739f700 1 -- 172.21.15.62:0/1339545335 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde400ac350 con 0x7fde400a1470 2021-12-17T18:25:48.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.403+0000 7fde2e7fc700 1 -- 172.21.15.62:0/1339545335 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde30004880 con 0x7fde400a1470 2021-12-17T18:25:48.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.403+0000 7fde4739f700 1 -- 172.21.15.62:0/1339545335 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4009e9d0 con 0x7fde400a1470 2021-12-17T18:25:48.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.403+0000 7fde4739f700 1 -- 172.21.15.62:0/1339545335 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde400a1e80 con 0x7fde400a1470 2021-12-17T18:25:48.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.403+0000 7fde2e7fc700 1 -- 172.21.15.62:0/1339545335 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fde30026070 con 0x7fde400a1470 2021-12-17T18:25:48.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.403+0000 7fde2e7fc700 1 --2- 172.21.15.62:0/1339545335 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde20053610 0x7fde20055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.403+0000 7fde2e7fc700 1 -- 172.21.15.62:0/1339545335 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fde3006c000 con 0x7fde400a1470 2021-12-17T18:25:48.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.407+0000 7fde4513b700 1 --2- 172.21.15.62:0/1339545335 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde20053610 0x7fde20055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.407+0000 7fde4513b700 1 --2- 172.21.15.62:0/1339545335 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde20053610 0x7fde20055ad0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fde3c00b000 tx=0x7fde3c0091d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:48.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.415+0000 7fde2e7fc700 1 -- 172.21.15.62:0/1339545335 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fde300430c0 con 0x7fde400a1470 2021-12-17T18:25:48.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.543+0000 7fde4739f700 1 -- 172.21.15.62:0/1339545335 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde400ab050 con 0x7fde400a1470 2021-12-17T18:25:48.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.543+0000 7fde2e7fc700 1 -- 172.21.15.62:0/1339545335 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fde300466e0 con 0x7fde400a1470 2021-12-17T18:25:48.551 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:48.551 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":92,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:25:47.114772+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:25:43.705181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-12-17T18:25:44.085619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:25:48.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.547+0000 7fde4739f700 1 -- 172.21.15.62:0/1339545335 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde20053610 msgr2=0x7fde20055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:48.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.547+0000 7fde4739f700 1 --2- 172.21.15.62:0/1339545335 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde20053610 0x7fde20055ad0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fde3c00b000 tx=0x7fde3c0091d0).stop 2021-12-17T18:25:48.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.547+0000 7fde4739f700 1 -- 172.21.15.62:0/1339545335 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde400a1470 msgr2=0x7fde400ab440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:48.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.547+0000 7fde4739f700 1 --2- 172.21.15.62:0/1339545335 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde400a1470 0x7fde400ab440 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fde30001370 tx=0x7fde30015000).stop 2021-12-17T18:25:48.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.547+0000 7fde4739f700 1 -- 172.21.15.62:0/1339545335 shutdown_connections 2021-12-17T18:25:48.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.547+0000 7fde4739f700 1 --2- 172.21.15.62:0/1339545335 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fde20053610 0x7fde20055ad0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.547+0000 7fde4739f700 1 --2- 172.21.15.62:0/1339545335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde400aa510 0x7fde400aa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.547+0000 7fde4739f700 1 --2- 172.21.15.62:0/1339545335 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fde400a1470 0x7fde400ab440 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.547+0000 7fde4739f700 1 --2- 172.21.15.62:0/1339545335 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fde400ad610 0x7fde4009ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.547+0000 7fde4739f700 1 -- 172.21.15.62:0/1339545335 >> 172.21.15.62:0/1339545335 conn(0x7fde4005f730 msgr2=0x7fde400aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:48.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.547+0000 7fde4739f700 1 -- 172.21.15.62:0/1339545335 shutdown_connections 2021-12-17T18:25:48.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.547+0000 7fde4739f700 1 -- 172.21.15.62:0/1339545335 wait complete. 2021-12-17T18:25:48.570 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:25:43.705181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:25:44.085619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:25:48.571 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:25:48.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.671+0000 7f1958e66700 1 Processor -- start 2021-12-17T18:25:48.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.671+0000 7f1958e66700 1 -- start start 2021-12-17T18:25:48.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.671+0000 7f1958e66700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f19540b47c0 0x7f19540b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.671+0000 7f1958e66700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19540b0870 con 0x7f195405ca90 2021-12-17T18:25:48.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.671+0000 7f1958e66700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195405ce70 con 0x7f19540b5be0 2021-12-17T18:25:48.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.671+0000 7f1958e66700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19540b05d0 con 0x7f19540b47c0 2021-12-17T18:25:48.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.671+0000 7f1952ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f19540b47c0 0x7f19540b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.671+0000 7f1952ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f19540b47c0 0x7f19540b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53772/0 (socket says 172.21.15.62:53772) 2021-12-17T18:25:48.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.671+0000 7f1952ffd700 1 -- 172.21.15.62:0/2945105477 learned_addr learned my addr 172.21.15.62:0/2945105477 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:48.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.671+0000 7f1952ffd700 1 -- 172.21.15.62:0/2945105477 >> v1:172.21.15.109:6789/0 conn(0x7f19540b5be0 legacy=0x7f1954143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:48.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.671+0000 7f1952ffd700 1 -- 172.21.15.62:0/2945105477 >> v1:172.21.15.62:6789/0 conn(0x7f195405ca90 legacy=0x7f19540b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:48.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.671+0000 7f19527fc700 1 -- 172.21.15.62:0/2945105477 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853948916 0 0) 0x7f19540b0870 con 0x7f195405ca90 2021-12-17T18:25:48.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.671+0000 7f1952ffd700 1 -- 172.21.15.62:0/2945105477 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19540b5250 con 0x7f19540b47c0 2021-12-17T18:25:48.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.675+0000 7f1952ffd700 1 --2- 172.21.15.62:0/2945105477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19540b47c0 0x7f19540b56f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f1944002f70 tx=0x7f1944006eb0).ready entity=mon.0 client_cookie=862173236398863e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:48.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.675+0000 7f19527fc700 1 -- 172.21.15.62:0/2945105477 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f194400d660 con 0x7f19540b47c0 2021-12-17T18:25:48.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.675+0000 7f19527fc700 1 -- 172.21.15.62:0/2945105477 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1944000e90 con 0x7f19540b47c0 2021-12-17T18:25:48.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.675+0000 7f19527fc700 1 -- 172.21.15.62:0/2945105477 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f194400d9b0 con 0x7f19540b47c0 2021-12-17T18:25:48.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.675+0000 7f1958e66700 1 -- 172.21.15.62:0/2945105477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19540b47c0 msgr2=0x7f19540b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:48.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.675+0000 7f1958e66700 1 --2- 172.21.15.62:0/2945105477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19540b47c0 0x7f19540b56f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f1944002f70 tx=0x7f1944006eb0).stop 2021-12-17T18:25:48.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.675+0000 7f1958e66700 1 -- 172.21.15.62:0/2945105477 shutdown_connections 2021-12-17T18:25:48.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.675+0000 7f1958e66700 1 --2- 172.21.15.62:0/2945105477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19540b47c0 0x7f19540b56f0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.675+0000 7f1958e66700 1 -- 172.21.15.62:0/2945105477 >> 172.21.15.62:0/2945105477 conn(0x7f195405bcd0 msgr2=0x7f1954062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:48.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.675+0000 7f1958e66700 1 -- 172.21.15.62:0/2945105477 shutdown_connections 2021-12-17T18:25:48.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.675+0000 7f1958e66700 1 -- 172.21.15.62:0/2945105477 wait complete. 2021-12-17T18:25:48.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.675+0000 7f1958e66700 1 Processor -- start 2021-12-17T18:25:48.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.675+0000 7f1958e66700 1 -- start start 2021-12-17T18:25:48.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f1958e66700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195405ca90 0x7f195414a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f1958e66700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f19540b47c0 0x7f1954066850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f1958e66700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f19540b5be0 0x7f1954066d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f1958e66700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19540b0480 con 0x7f195405ca90 2021-12-17T18:25:48.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f1958e66700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19540a3580 con 0x7f19540b5be0 2021-12-17T18:25:48.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f1958e66700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1954156930 con 0x7f19540b47c0 2021-12-17T18:25:48.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f19537fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195405ca90 0x7f195414a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f19537fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195405ca90 0x7f195414a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53776/0 (socket says 172.21.15.62:53776) 2021-12-17T18:25:48.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f19537fe700 1 -- 172.21.15.62:0/3345145524 learned_addr learned my addr 172.21.15.62:0/3345145524 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:48.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f1953fff700 1 --2- 172.21.15.62:0/3345145524 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f19540b5be0 0x7f1954066d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f1952ffd700 1 --2- 172.21.15.62:0/3345145524 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f19540b47c0 0x7f1954066850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f19537fe700 1 -- 172.21.15.62:0/3345145524 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f19540b47c0 msgr2=0x7f1954066850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:48.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f19537fe700 1 --2- 172.21.15.62:0/3345145524 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f19540b47c0 0x7f1954066850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f19537fe700 1 -- 172.21.15.62:0/3345145524 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f19540b5be0 msgr2=0x7f1954066d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:48.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f19537fe700 1 --2- 172.21.15.62:0/3345145524 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f19540b5be0 0x7f1954066d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f19537fe700 1 -- 172.21.15.62:0/3345145524 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194400b1e0 con 0x7f195405ca90 2021-12-17T18:25:48.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f19537fe700 1 --2- 172.21.15.62:0/3345145524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195405ca90 0x7f195414a850 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f193c000bc0 tx=0x7f193c007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:48.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f1950ff9700 1 -- 172.21.15.62:0/3345145524 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f193c012400 con 0x7f195405ca90 2021-12-17T18:25:48.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f1950ff9700 1 -- 172.21.15.62:0/3345145524 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c012560 con 0x7f195405ca90 2021-12-17T18:25:48.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f1958e66700 1 -- 172.21.15.62:0/3345145524 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1954156bd0 con 0x7f195405ca90 2021-12-17T18:25:48.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f1950ff9700 1 -- 172.21.15.62:0/3345145524 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f193c0128c0 con 0x7f195405ca90 2021-12-17T18:25:48.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f1958e66700 1 -- 172.21.15.62:0/3345145524 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19540663f0 con 0x7f195405ca90 2021-12-17T18:25:48.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.679+0000 7f1958e66700 1 -- 172.21.15.62:0/3345145524 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19540b3980 con 0x7f195405ca90 2021-12-17T18:25:48.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.683+0000 7f1950ff9700 1 -- 172.21.15.62:0/3345145524 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f193c019030 con 0x7f195405ca90 2021-12-17T18:25:48.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.683+0000 7f1950ff9700 1 --2- 172.21.15.62:0/3345145524 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f19380534f0 0x7f19380559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.683+0000 7f1950ff9700 1 -- 172.21.15.62:0/3345145524 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f193c06ab80 con 0x7f195405ca90 2021-12-17T18:25:48.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.683+0000 7f1952ffd700 1 --2- 172.21.15.62:0/3345145524 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f19380534f0 0x7f19380559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.683+0000 7f1952ffd700 1 --2- 172.21.15.62:0/3345145524 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f19380534f0 0x7f19380559b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f194401c000 tx=0x7f1944015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:48.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.691+0000 7f1950ff9700 1 -- 172.21.15.62:0/3345145524 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f193c041d90 con 0x7f195405ca90 2021-12-17T18:25:48.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.819+0000 7f1958e66700 1 -- 172.21.15.62:0/3345145524 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f19540573d0 con 0x7f195405ca90 2021-12-17T18:25:48.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.819+0000 7f1950ff9700 1 -- 172.21.15.62:0/3345145524 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v92) v1 ==== 110+0+10 (secure 0 0 0) 0x7f193c0453b0 con 0x7f195405ca90 2021-12-17T18:25:48.827 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:25:48.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.823+0000 7f1958e66700 1 -- 172.21.15.62:0/3345145524 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f19380534f0 msgr2=0x7f19380559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:48.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.823+0000 7f1958e66700 1 --2- 172.21.15.62:0/3345145524 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f19380534f0 0x7f19380559b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f194401c000 tx=0x7f1944015000).stop 2021-12-17T18:25:48.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.823+0000 7f1958e66700 1 -- 172.21.15.62:0/3345145524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195405ca90 msgr2=0x7f195414a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:48.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.823+0000 7f1958e66700 1 --2- 172.21.15.62:0/3345145524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195405ca90 0x7f195414a850 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f193c000bc0 tx=0x7f193c007a70).stop 2021-12-17T18:25:48.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.823+0000 7f1958e66700 1 -- 172.21.15.62:0/3345145524 shutdown_connections 2021-12-17T18:25:48.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.823+0000 7f1958e66700 1 --2- 172.21.15.62:0/3345145524 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f19380534f0 0x7f19380559b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.823+0000 7f1958e66700 1 --2- 172.21.15.62:0/3345145524 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f19540b5be0 0x7f1954066d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.823+0000 7f1958e66700 1 --2- 172.21.15.62:0/3345145524 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f19540b47c0 0x7f1954066850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.823+0000 7f1958e66700 1 --2- 172.21.15.62:0/3345145524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195405ca90 0x7f195414a850 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.823+0000 7f1958e66700 1 -- 172.21.15.62:0/3345145524 >> 172.21.15.62:0/3345145524 conn(0x7f195405bcd0 msgr2=0x7f19540b60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:48.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.823+0000 7f1958e66700 1 -- 172.21.15.62:0/3345145524 shutdown_connections 2021-12-17T18:25:48.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.823+0000 7f1958e66700 1 -- 172.21.15.62:0/3345145524 wait complete. 2021-12-17T18:25:48.845 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:25:48.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0976599700 1 Processor -- start 2021-12-17T18:25:48.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0976599700 1 -- start start 2021-12-17T18:25:48.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0976599700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0970066150 0x7f0970144520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0976599700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f097013a910 0x7f097013ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0976599700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097005ce70 con 0x7f097005ca90 2021-12-17T18:25:48.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0976599700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09700604c0 con 0x7f0970066150 2021-12-17T18:25:48.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0976599700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0970142080 con 0x7f097013a910 2021-12-17T18:25:48.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0974d96700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0970066150 0x7f0970144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0974d96700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0970066150 0x7f0970144520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53786/0 (socket says 172.21.15.62:53786) 2021-12-17T18:25:48.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0974d96700 1 -- 172.21.15.62:0/889361960 learned_addr learned my addr 172.21.15.62:0/889361960 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:48.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0975d98700 1 --2- 172.21.15.62:0/889361960 >> v2:172.21.15.109:3300/0 conn(0x7f097013a910 0x7f097013ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0974d96700 1 -- 172.21.15.62:0/889361960 >> v2:172.21.15.109:3300/0 conn(0x7f097013a910 msgr2=0x7f097013ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:48.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0974d96700 1 --2- 172.21.15.62:0/889361960 >> v2:172.21.15.109:3300/0 conn(0x7f097013a910 0x7f097013ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0974d96700 1 -- 172.21.15.62:0/889361960 >> v1:172.21.15.109:6789/0 conn(0x7f097005ca90 legacy=0x7f0970065a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:48.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0974d96700 1 -- 172.21.15.62:0/889361960 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09700adb50 con 0x7f0970066150 2021-12-17T18:25:48.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0974d96700 1 --2- 172.21.15.62:0/889361960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0970066150 0x7f0970144520 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f0970065920 tx=0x7f096c009290).ready entity=mon.0 client_cookie=fc6d8d7d0715b232 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:48.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0963fff700 1 -- 172.21.15.62:0/889361960 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f096c00b860 con 0x7f0970066150 2021-12-17T18:25:48.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0963fff700 1 -- 172.21.15.62:0/889361960 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c00b9c0 con 0x7f0970066150 2021-12-17T18:25:48.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.951+0000 7f0963fff700 1 -- 172.21.15.62:0/889361960 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f096c00bb30 con 0x7f0970066150 2021-12-17T18:25:48.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.955+0000 7f0976599700 1 -- 172.21.15.62:0/889361960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0970066150 msgr2=0x7f0970144520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:48.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.955+0000 7f0976599700 1 --2- 172.21.15.62:0/889361960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0970066150 0x7f0970144520 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f0970065920 tx=0x7f096c009290).stop 2021-12-17T18:25:48.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.955+0000 7f0976599700 1 -- 172.21.15.62:0/889361960 shutdown_connections 2021-12-17T18:25:48.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.955+0000 7f0976599700 1 --2- 172.21.15.62:0/889361960 >> v2:172.21.15.109:3300/0 conn(0x7f097013a910 0x7f097013ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.955+0000 7f0976599700 1 --2- 172.21.15.62:0/889361960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0970066150 0x7f0970144520 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.955+0000 7f0976599700 1 -- 172.21.15.62:0/889361960 >> 172.21.15.62:0/889361960 conn(0x7f097005be70 msgr2=0x7f0970062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:48.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.955+0000 7f0976599700 1 -- 172.21.15.62:0/889361960 shutdown_connections 2021-12-17T18:25:48.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.955+0000 7f0976599700 1 -- 172.21.15.62:0/889361960 wait complete. 2021-12-17T18:25:48.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.955+0000 7f0976599700 1 Processor -- start 2021-12-17T18:25:48.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.955+0000 7f0976599700 1 -- start start 2021-12-17T18:25:48.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0976599700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f097005ca90 0x7f09700b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0976599700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0970066150 0x7f09700aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0976599700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f097013a910 0x7f09700b6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0976599700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09700b6230 con 0x7f0970066150 2021-12-17T18:25:48.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0976599700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09700b64d0 con 0x7f097013a910 2021-12-17T18:25:48.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0976599700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09701442f0 con 0x7f097005ca90 2021-12-17T18:25:48.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0974d96700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0970066150 0x7f09700aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0974d96700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0970066150 0x7f09700aef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53792/0 (socket says 172.21.15.62:53792) 2021-12-17T18:25:48.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0974d96700 1 -- 172.21.15.62:0/1766510632 learned_addr learned my addr 172.21.15.62:0/1766510632 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:48.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0975d98700 1 --2- 172.21.15.62:0/1766510632 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f097013a910 0x7f09700b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0975597700 1 --2- 172.21.15.62:0/1766510632 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f097005ca90 0x7f09700b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0974d96700 1 -- 172.21.15.62:0/1766510632 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f097005ca90 msgr2=0x7f09700b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:48.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0974d96700 1 --2- 172.21.15.62:0/1766510632 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f097005ca90 0x7f09700b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0974d96700 1 -- 172.21.15.62:0/1766510632 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f097013a910 msgr2=0x7f09700b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:48.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0974d96700 1 --2- 172.21.15.62:0/1766510632 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f097013a910 0x7f09700b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:48.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0974d96700 1 -- 172.21.15.62:0/1766510632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c009530 con 0x7f0970066150 2021-12-17T18:25:48.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0975d98700 1 --2- 172.21.15.62:0/1766510632 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f097013a910 0x7f09700b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:48.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0974d96700 1 --2- 172.21.15.62:0/1766510632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0970066150 0x7f09700aef50 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f0970065920 tx=0x7f096c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:48.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0962ffd700 1 -- 172.21.15.62:0/1766510632 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f096c021480 con 0x7f0970066150 2021-12-17T18:25:48.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0962ffd700 1 -- 172.21.15.62:0/1766510632 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c0215e0 con 0x7f0970066150 2021-12-17T18:25:48.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0976599700 1 -- 172.21.15.62:0/1766510632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09700b6e60 con 0x7f0970066150 2021-12-17T18:25:48.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0962ffd700 1 -- 172.21.15.62:0/1766510632 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f096c021940 con 0x7f0970066150 2021-12-17T18:25:48.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0976599700 1 -- 172.21.15.62:0/1766510632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09700afed0 con 0x7f0970066150 2021-12-17T18:25:48.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0976599700 1 -- 172.21.15.62:0/1766510632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09700b6080 con 0x7f0970066150 2021-12-17T18:25:48.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0962ffd700 1 -- 172.21.15.62:0/1766510632 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f096c00f070 con 0x7f0970066150 2021-12-17T18:25:48.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.959+0000 7f0962ffd700 1 --2- 172.21.15.62:0/1766510632 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f094c0536a0 0x7f094c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:48.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.963+0000 7f0962ffd700 1 -- 172.21.15.62:0/1766510632 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f096c06cd50 con 0x7f0970066150 2021-12-17T18:25:48.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.963+0000 7f0975597700 1 --2- 172.21.15.62:0/1766510632 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f094c0536a0 0x7f094c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:48.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.963+0000 7f0975597700 1 --2- 172.21.15.62:0/1766510632 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f094c0536a0 0x7f094c055b60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f096400b000 tx=0x7f0964009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:48.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:48.967+0000 7f0962ffd700 1 -- 172.21.15.62:0/1766510632 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f096c043f60 con 0x7f0970066150 2021-12-17T18:25:49.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.091+0000 7f0976599700 1 -- 172.21.15.62:0/1766510632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f09700573d0 con 0x7f0970066150 2021-12-17T18:25:49.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.095+0000 7f0962ffd700 1 -- 172.21.15.62:0/1766510632 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v92) v1 ==== 92+0+10 (secure 0 0 0) 0x7f096c015030 con 0x7f0970066150 2021-12-17T18:25:49.101 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:25:49.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.095+0000 7f0976599700 1 -- 172.21.15.62:0/1766510632 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f094c0536a0 msgr2=0x7f094c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.095+0000 7f0976599700 1 --2- 172.21.15.62:0/1766510632 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f094c0536a0 0x7f094c055b60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f096400b000 tx=0x7f0964009040).stop 2021-12-17T18:25:49.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.095+0000 7f0976599700 1 -- 172.21.15.62:0/1766510632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0970066150 msgr2=0x7f09700aef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.095+0000 7f0976599700 1 --2- 172.21.15.62:0/1766510632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0970066150 0x7f09700aef50 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f0970065920 tx=0x7f096c016000).stop 2021-12-17T18:25:49.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.095+0000 7f0976599700 1 -- 172.21.15.62:0/1766510632 shutdown_connections 2021-12-17T18:25:49.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.095+0000 7f0976599700 1 --2- 172.21.15.62:0/1766510632 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f094c0536a0 0x7f094c055b60 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.095+0000 7f0976599700 1 --2- 172.21.15.62:0/1766510632 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f097013a910 0x7f09700b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.095+0000 7f0976599700 1 --2- 172.21.15.62:0/1766510632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0970066150 0x7f09700aef50 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.095+0000 7f0976599700 1 --2- 172.21.15.62:0/1766510632 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f097005ca90 0x7f09700b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.095+0000 7f0976599700 1 -- 172.21.15.62:0/1766510632 >> 172.21.15.62:0/1766510632 conn(0x7f097005be70 msgr2=0x7f097013ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:49.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.095+0000 7f0976599700 1 -- 172.21.15.62:0/1766510632 shutdown_connections 2021-12-17T18:25:49.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.095+0000 7f0976599700 1 -- 172.21.15.62:0/1766510632 wait complete. 2021-12-17T18:25:49.113 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:25:49.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71fae26700 1 Processor -- start 2021-12-17T18:25:49.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71fae26700 1 -- start start 2021-12-17T18:25:49.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71fae26700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f71f4147440 0x7f71f40b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:49.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71fae26700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f40606e0 con 0x7f71f40b07c0 2021-12-17T18:25:49.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71fae26700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f4060980 con 0x7f71f40b5330 2021-12-17T18:25:49.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71fae26700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f4141950 con 0x7f71f4147440 2021-12-17T18:25:49.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71f3fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f71f40b07c0 0x7f71f414ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37380/0 (socket says 172.21.15.62:37380) 2021-12-17T18:25:49.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71f3fff700 1 -- 172.21.15.62:0/933586928 learned_addr learned my addr 172.21.15.62:0/933586928 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:49.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71f93c3700 1 --2- 172.21.15.62:0/933586928 >> v2:172.21.15.109:3300/0 conn(0x7f71f4147440 0x7f71f40b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:49.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71f37fe700 1 -- 172.21.15.62:0/933586928 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884013007 0 0) 0x7f71f40606e0 con 0x7f71f40b07c0 2021-12-17T18:25:49.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71f37fe700 1 -- 172.21.15.62:0/933586928 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71e0003260 con 0x7f71f40b07c0 2021-12-17T18:25:49.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71f37fe700 1 -- 172.21.15.62:0/933586928 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543604592 0 0) 0x7f71f4060980 con 0x7f71f40b5330 2021-12-17T18:25:49.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71f37fe700 1 -- 172.21.15.62:0/933586928 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71f40606e0 con 0x7f71f40b5330 2021-12-17T18:25:49.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71f93c3700 1 -- 172.21.15.62:0/933586928 >> v1:172.21.15.109:6789/0 conn(0x7f71f40b5330 legacy=0x7f71f4147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71f93c3700 1 -- 172.21.15.62:0/933586928 >> v1:172.21.15.62:6789/0 conn(0x7f71f40b07c0 legacy=0x7f71f414ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71f93c3700 1 -- 172.21.15.62:0/933586928 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f4148250 con 0x7f71f4147440 2021-12-17T18:25:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71f93c3700 1 --2- 172.21.15.62:0/933586928 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f71f4147440 0x7f71f40b5710 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f71ec0032f0 tx=0x7f71ec0091d0).ready entity=mon.1 client_cookie=b678b5fa040650a0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71f37fe700 1 -- 172.21.15.62:0/933586928 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71ec00b600 con 0x7f71f4147440 2021-12-17T18:25:49.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71f37fe700 1 -- 172.21.15.62:0/933586928 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec00b760 con 0x7f71f4147440 2021-12-17T18:25:49.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.223+0000 7f71f37fe700 1 -- 172.21.15.62:0/933586928 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71ec00b8d0 con 0x7f71f4147440 2021-12-17T18:25:49.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71fae26700 1 -- 172.21.15.62:0/933586928 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f71f4147440 msgr2=0x7f71f40b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71fae26700 1 --2- 172.21.15.62:0/933586928 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f71f4147440 0x7f71f40b5710 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f71ec0032f0 tx=0x7f71ec0091d0).stop 2021-12-17T18:25:49.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71fae26700 1 -- 172.21.15.62:0/933586928 shutdown_connections 2021-12-17T18:25:49.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71fae26700 1 --2- 172.21.15.62:0/933586928 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f71f4147440 0x7f71f40b5710 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71fae26700 1 -- 172.21.15.62:0/933586928 >> 172.21.15.62:0/933586928 conn(0x7f71f405c750 msgr2=0x7f71f405cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:49.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71fae26700 1 -- 172.21.15.62:0/933586928 shutdown_connections 2021-12-17T18:25:49.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71fae26700 1 -- 172.21.15.62:0/933586928 wait complete. 2021-12-17T18:25:49.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71fae26700 1 Processor -- start 2021-12-17T18:25:49.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71fae26700 1 -- start start 2021-12-17T18:25:49.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71fae26700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71f40b07c0 0x7f71f41462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:49.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71fae26700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f71f40b5330 0x7f71f40aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:49.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71fae26700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71f4147440 0x7f71f41432a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:49.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71fae26700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40aea40 con 0x7f71f40b07c0 2021-12-17T18:25:49.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71fae26700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4142240 con 0x7f71f40b5330 2021-12-17T18:25:49.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71fae26700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4141fa0 con 0x7f71f4147440 2021-12-17T18:25:49.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71f8bc2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71f40b07c0 0x7f71f41462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:49.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71f8bc2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71f40b07c0 0x7f71f41462e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53804/0 (socket says 172.21.15.62:53804) 2021-12-17T18:25:49.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71f8bc2700 1 -- 172.21.15.62:0/1515354882 learned_addr learned my addr 172.21.15.62:0/1515354882 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:49.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71f3fff700 1 --2- 172.21.15.62:0/1515354882 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f71f40b5330 0x7f71f40aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:49.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.227+0000 7f71f93c3700 1 --2- 172.21.15.62:0/1515354882 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71f4147440 0x7f71f41432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:49.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.231+0000 7f71f3fff700 1 -- 172.21.15.62:0/1515354882 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71f4147440 msgr2=0x7f71f41432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.231+0000 7f71f3fff700 1 --2- 172.21.15.62:0/1515354882 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71f4147440 0x7f71f41432a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.231+0000 7f71f3fff700 1 -- 172.21.15.62:0/1515354882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71f40b07c0 msgr2=0x7f71f41462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.231+0000 7f71f3fff700 1 --2- 172.21.15.62:0/1515354882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71f40b07c0 0x7f71f41462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.231+0000 7f71f3fff700 1 -- 172.21.15.62:0/1515354882 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec009470 con 0x7f71f40b5330 2021-12-17T18:25:49.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.231+0000 7f71f8bc2700 1 --2- 172.21.15.62:0/1515354882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71f40b07c0 0x7f71f41462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:49.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.231+0000 7f71f3fff700 1 --2- 172.21.15.62:0/1515354882 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f71f40b5330 0x7f71f40aeea0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f71e8001110 tx=0x7f71e8007a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:49.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.231+0000 7f71f1ffb700 1 -- 172.21.15.62:0/1515354882 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71e800ce80 con 0x7f71f40b5330 2021-12-17T18:25:49.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.231+0000 7f71f1ffb700 1 -- 172.21.15.62:0/1515354882 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e80070d0 con 0x7f71f40b5330 2021-12-17T18:25:49.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.231+0000 7f71fae26700 1 -- 172.21.15.62:0/1515354882 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f40adb50 con 0x7f71f40b5330 2021-12-17T18:25:49.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.231+0000 7f71f1ffb700 1 -- 172.21.15.62:0/1515354882 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71e8007430 con 0x7f71f40b5330 2021-12-17T18:25:49.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.231+0000 7f71fae26700 1 -- 172.21.15.62:0/1515354882 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f40af7b0 con 0x7f71f40b5330 2021-12-17T18:25:49.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.231+0000 7f71fae26700 1 -- 172.21.15.62:0/1515354882 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f40af390 con 0x7f71f40b5330 2021-12-17T18:25:49.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.231+0000 7f71f1ffb700 1 -- 172.21.15.62:0/1515354882 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f71e801a060 con 0x7f71f40b5330 2021-12-17T18:25:49.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.235+0000 7f71f1ffb700 1 --2- 172.21.15.62:0/1515354882 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71d4053610 0x7f71d4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:49.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.235+0000 7f71f1ffb700 1 -- 172.21.15.62:0/1515354882 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f71e806af60 con 0x7f71f40b5330 2021-12-17T18:25:49.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.235+0000 7f71f8bc2700 1 --2- 172.21.15.62:0/1515354882 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71d4053610 0x7f71d4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:49.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.235+0000 7f71f8bc2700 1 --2- 172.21.15.62:0/1515354882 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71d4053610 0x7f71d4055ad0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f71e400d000 tx=0x7f71e4007ae0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:49.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.243+0000 7f71f1ffb700 1 -- 172.21.15.62:0/1515354882 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f71e80420c0 con 0x7f71f40b5330 2021-12-17T18:25:49.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.371+0000 7f71fae26700 1 -- 172.21.15.62:0/1515354882 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71f40aebb0 con 0x7f71f40b5330 2021-12-17T18:25:49.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.375+0000 7f71f1ffb700 1 -- 172.21.15.62:0/1515354882 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+10 (secure 0 0 0) 0x7f71e8018070 con 0x7f71f40b5330 2021-12-17T18:25:49.381 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:25:49.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.375+0000 7f71fae26700 1 -- 172.21.15.62:0/1515354882 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71d4053610 msgr2=0x7f71d4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.375+0000 7f71fae26700 1 --2- 172.21.15.62:0/1515354882 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71d4053610 0x7f71d4055ad0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f71e400d000 tx=0x7f71e4007ae0).stop 2021-12-17T18:25:49.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.375+0000 7f71fae26700 1 -- 172.21.15.62:0/1515354882 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f71f40b5330 msgr2=0x7f71f40aeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.375+0000 7f71fae26700 1 --2- 172.21.15.62:0/1515354882 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f71f40b5330 0x7f71f40aeea0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f71e8001110 tx=0x7f71e8007a20).stop 2021-12-17T18:25:49.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.375+0000 7f71fae26700 1 -- 172.21.15.62:0/1515354882 shutdown_connections 2021-12-17T18:25:49.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.375+0000 7f71fae26700 1 --2- 172.21.15.62:0/1515354882 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71d4053610 0x7f71d4055ad0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.375+0000 7f71fae26700 1 --2- 172.21.15.62:0/1515354882 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f71f4147440 0x7f71f41432a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.375+0000 7f71fae26700 1 --2- 172.21.15.62:0/1515354882 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f71f40b5330 0x7f71f40aeea0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.375+0000 7f71fae26700 1 --2- 172.21.15.62:0/1515354882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71f40b07c0 0x7f71f41462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.375+0000 7f71fae26700 1 -- 172.21.15.62:0/1515354882 >> 172.21.15.62:0/1515354882 conn(0x7f71f405c750 msgr2=0x7f71f40b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:49.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.375+0000 7f71fae26700 1 -- 172.21.15.62:0/1515354882 shutdown_connections 2021-12-17T18:25:49.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.375+0000 7f71fae26700 1 -- 172.21.15.62:0/1515354882 wait complete. 2021-12-17T18:25:49.394 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:25:49.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.499+0000 7fefcffff700 1 Processor -- start 2021-12-17T18:25:49.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.499+0000 7fefcffff700 1 -- start start 2021-12-17T18:25:49.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.499+0000 7fefcffff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fefd00b2fb0 0x7fefd0061390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:49.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.499+0000 7fefcffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fefd0062910 0x7fefd0140430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:49.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.499+0000 7fefcffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd013fd30 con 0x7fefd0140920 2021-12-17T18:25:49.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.499+0000 7fefcffff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd013ff90 con 0x7fefd00b2fb0 2021-12-17T18:25:49.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.499+0000 7fefcffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd00653d0 con 0x7fefd0062910 2021-12-17T18:25:49.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefcf7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fefd0140920 0x7fefd01431f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37396/0 (socket says 172.21.15.62:37396) 2021-12-17T18:25:49.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefcf7fe700 1 -- 172.21.15.62:0/3775453376 learned_addr learned my addr 172.21.15.62:0/3775453376 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:49.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefce7fc700 1 --2- 172.21.15.62:0/3775453376 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fefd0062910 0x7fefd0140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:49.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefceffd700 1 --2- 172.21.15.62:0/3775453376 >> v2:172.21.15.109:3300/0 conn(0x7fefd00b2fb0 0x7fefd0061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:49.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefcdffb700 1 -- 172.21.15.62:0/3775453376 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713796905 0 0) 0x7fefd013fd30 con 0x7fefd0140920 2021-12-17T18:25:49.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefcdffb700 1 -- 172.21.15.62:0/3775453376 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefb0003260 con 0x7fefd0140920 2021-12-17T18:25:49.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefce7fc700 1 -- 172.21.15.62:0/3775453376 >> v2:172.21.15.109:3300/0 conn(0x7fefd00b2fb0 msgr2=0x7fefd0061390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:49.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefce7fc700 1 --2- 172.21.15.62:0/3775453376 >> v2:172.21.15.109:3300/0 conn(0x7fefd00b2fb0 0x7fefd0061390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefce7fc700 1 -- 172.21.15.62:0/3775453376 >> v1:172.21.15.62:6789/0 conn(0x7fefd0140920 legacy=0x7fefd01431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefce7fc700 1 -- 172.21.15.62:0/3775453376 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd00656a0 con 0x7fefd0062910 2021-12-17T18:25:49.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefceffd700 1 --2- 172.21.15.62:0/3775453376 >> v2:172.21.15.109:3300/0 conn(0x7fefd00b2fb0 0x7fefd0061390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:49.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefce7fc700 1 --2- 172.21.15.62:0/3775453376 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fefd0062910 0x7fefd0140430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fefb8002f70 tx=0x7fefb8006df0).ready entity=mon.2 client_cookie=3fd3bce5ccdf1141 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:49.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefcdffb700 1 -- 172.21.15.62:0/3775453376 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefb800d4a0 con 0x7fefd0062910 2021-12-17T18:25:49.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefcdffb700 1 -- 172.21.15.62:0/3775453376 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb8000e90 con 0x7fefd0062910 2021-12-17T18:25:49.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefcdffb700 1 -- 172.21.15.62:0/3775453376 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefb800d7f0 con 0x7fefd0062910 2021-12-17T18:25:49.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefcffff700 1 -- 172.21.15.62:0/3775453376 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fefd0062910 msgr2=0x7fefd0140430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefcffff700 1 --2- 172.21.15.62:0/3775453376 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fefd0062910 0x7fefd0140430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fefb8002f70 tx=0x7fefb8006df0).stop 2021-12-17T18:25:49.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefcffff700 1 -- 172.21.15.62:0/3775453376 shutdown_connections 2021-12-17T18:25:49.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefcffff700 1 --2- 172.21.15.62:0/3775453376 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fefd0062910 0x7fefd0140430 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefcffff700 1 --2- 172.21.15.62:0/3775453376 >> v2:172.21.15.109:3300/0 conn(0x7fefd00b2fb0 0x7fefd0061390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefcffff700 1 -- 172.21.15.62:0/3775453376 >> 172.21.15.62:0/3775453376 conn(0x7fefd0063510 msgr2=0x7fefd00638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:49.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefcffff700 1 -- 172.21.15.62:0/3775453376 shutdown_connections 2021-12-17T18:25:49.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.503+0000 7fefcffff700 1 -- 172.21.15.62:0/3775453376 wait complete. 2021-12-17T18:25:49.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefcffff700 1 Processor -- start 2021-12-17T18:25:49.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefcffff700 1 -- start start 2021-12-17T18:25:49.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefcffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefd0062910 0x7fefd013f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:49.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefcffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fefd00b2fb0 0x7fefd01249c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefcffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fefd0140920 0x7fefd0120a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefcffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd0142970 con 0x7fefd0062910 2021-12-17T18:25:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefcffff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd0120680 con 0x7fefd0140920 2021-12-17T18:25:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefcffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd00aeec0 con 0x7fefd00b2fb0 2021-12-17T18:25:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefceffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefd0062910 0x7fefd013f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefceffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefd0062910 0x7fefd013f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53818/0 (socket says 172.21.15.62:53818) 2021-12-17T18:25:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefceffd700 1 -- 172.21.15.62:0/3398145138 learned_addr learned my addr 172.21.15.62:0/3398145138 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefce7fc700 1 --2- 172.21.15.62:0/3398145138 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fefd00b2fb0 0x7fefd01249c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:49.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefcf7fe700 1 --2- 172.21.15.62:0/3398145138 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fefd0140920 0x7fefd0120a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:49.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefceffd700 1 -- 172.21.15.62:0/3398145138 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fefd00b2fb0 msgr2=0x7fefd01249c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefceffd700 1 --2- 172.21.15.62:0/3398145138 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fefd00b2fb0 0x7fefd01249c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefceffd700 1 -- 172.21.15.62:0/3398145138 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fefd0140920 msgr2=0x7fefd0120a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefceffd700 1 --2- 172.21.15.62:0/3398145138 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fefd0140920 0x7fefd0120a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefceffd700 1 -- 172.21.15.62:0/3398145138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc000b180 con 0x7fefd0062910 2021-12-17T18:25:49.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefce7fc700 1 --2- 172.21.15.62:0/3398145138 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fefd00b2fb0 0x7fefd01249c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:49.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefceffd700 1 --2- 172.21.15.62:0/3398145138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefd0062910 0x7fefd013f040 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7fefc000c000 tx=0x7fefc0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:49.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefc7fff700 1 -- 172.21.15.62:0/3398145138 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc000c9e0 con 0x7fefd0062910 2021-12-17T18:25:49.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefc7fff700 1 -- 172.21.15.62:0/3398145138 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc000cb40 con 0x7fefd0062910 2021-12-17T18:25:49.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefcffff700 1 -- 172.21.15.62:0/3398145138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb800b180 con 0x7fefd0062910 2021-12-17T18:25:49.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefc7fff700 1 -- 172.21.15.62:0/3398145138 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc000cea0 con 0x7fefd0062910 2021-12-17T18:25:49.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.507+0000 7fefcffff700 1 -- 172.21.15.62:0/3398145138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd00afdd0 con 0x7fefd0062910 2021-12-17T18:25:49.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.511+0000 7fefcffff700 1 -- 172.21.15.62:0/3398145138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd0143f40 con 0x7fefd0062910 2021-12-17T18:25:49.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.511+0000 7fefc7fff700 1 -- 172.21.15.62:0/3398145138 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fefc001c460 con 0x7fefd0062910 2021-12-17T18:25:49.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.511+0000 7fefc7fff700 1 --2- 172.21.15.62:0/3398145138 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fefb40536a0 0x7fefb4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:49.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.511+0000 7fefc7fff700 1 -- 172.21.15.62:0/3398145138 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fefc006bfa0 con 0x7fefd0062910 2021-12-17T18:25:49.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.511+0000 7fefce7fc700 1 --2- 172.21.15.62:0/3398145138 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fefb40536a0 0x7fefb4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:49.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.511+0000 7fefce7fc700 1 --2- 172.21.15.62:0/3398145138 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fefb40536a0 0x7fefb4055b60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fefb8018000 tx=0x7fefb8014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:49.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.515+0000 7fefc7fff700 1 -- 172.21.15.62:0/3398145138 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fefd0143f40 con 0x7fefd0062910 2021-12-17T18:25:49.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.643+0000 7fefcffff700 1 -- 172.21.15.62:0/3398145138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fefd0143f40 con 0x7fefd0062910 2021-12-17T18:25:49.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.643+0000 7fefc7fff700 1 -- 172.21.15.62:0/3398145138 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+10 (secure 0 0 0) 0x7fefd0143f40 con 0x7fefd0062910 2021-12-17T18:25:49.651 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:25:49.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.647+0000 7fefcffff700 1 -- 172.21.15.62:0/3398145138 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fefb40536a0 msgr2=0x7fefb4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.647+0000 7fefcffff700 1 --2- 172.21.15.62:0/3398145138 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fefb40536a0 0x7fefb4055b60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fefb8018000 tx=0x7fefb8014000).stop 2021-12-17T18:25:49.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.647+0000 7fefcffff700 1 -- 172.21.15.62:0/3398145138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefd0062910 msgr2=0x7fefd013f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.647+0000 7fefcffff700 1 --2- 172.21.15.62:0/3398145138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefd0062910 0x7fefd013f040 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7fefc000c000 tx=0x7fefc0006df0).stop 2021-12-17T18:25:49.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.647+0000 7fefcffff700 1 -- 172.21.15.62:0/3398145138 shutdown_connections 2021-12-17T18:25:49.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.647+0000 7fefcffff700 1 --2- 172.21.15.62:0/3398145138 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fefb40536a0 0x7fefb4055b60 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.647+0000 7fefcffff700 1 --2- 172.21.15.62:0/3398145138 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fefd0140920 0x7fefd0120a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.647+0000 7fefcffff700 1 --2- 172.21.15.62:0/3398145138 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fefd00b2fb0 0x7fefd01249c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.647+0000 7fefcffff700 1 --2- 172.21.15.62:0/3398145138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefd0062910 0x7fefd013f040 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.647+0000 7fefcffff700 1 -- 172.21.15.62:0/3398145138 >> 172.21.15.62:0/3398145138 conn(0x7fefd0063510 msgr2=0x7fefd00b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:49.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.647+0000 7fefcffff700 1 -- 172.21.15.62:0/3398145138 shutdown_connections 2021-12-17T18:25:49.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.647+0000 7fefcffff700 1 -- 172.21.15.62:0/3398145138 wait complete. 2021-12-17T18:25:49.664 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:25:49.665 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:49.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.759+0000 7f65d9767700 1 Processor -- start 2021-12-17T18:25:49.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d9767700 1 -- start start 2021-12-17T18:25:49.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d9767700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f65d4065630 0x7f65d4066bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:49.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d9767700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f65d4144fa0 0x7f65d41404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:49.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d9767700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d4065a10 con 0x7f65d40b1ff0 2021-12-17T18:25:49.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d9767700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d40670c0 con 0x7f65d4065630 2021-12-17T18:25:49.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d9767700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d4067330 con 0x7f65d4144fa0 2021-12-17T18:25:49.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f65d4065630 0x7f65d4066bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:49.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65cb7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f65d40b1ff0 0x7f65d4144890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37410/0 (socket says 172.21.15.62:37410) 2021-12-17T18:25:49.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65cb7fe700 1 -- 172.21.15.62:0/2153605522 learned_addr learned my addr 172.21.15.62:0/2153605522 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:49.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d8f66700 1 --2- 172.21.15.62:0/2153605522 >> v2:172.21.15.109:3300/0 conn(0x7f65d4144fa0 0x7f65d41404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:49.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d37fe700 1 -- 172.21.15.62:0/2153605522 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101343563 0 0) 0x7f65d4065a10 con 0x7f65d40b1ff0 2021-12-17T18:25:49.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d37fe700 1 -- 172.21.15.62:0/2153605522 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65b4003260 con 0x7f65d40b1ff0 2021-12-17T18:25:49.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d3fff700 1 -- 172.21.15.62:0/2153605522 >> v2:172.21.15.109:3300/0 conn(0x7f65d4144fa0 msgr2=0x7f65d41404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:49.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d3fff700 1 --2- 172.21.15.62:0/2153605522 >> v2:172.21.15.109:3300/0 conn(0x7f65d4144fa0 0x7f65d41404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d3fff700 1 -- 172.21.15.62:0/2153605522 >> v1:172.21.15.62:6789/0 conn(0x7f65d40b1ff0 legacy=0x7f65d4144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d37fe700 1 -- 172.21.15.62:0/2153605522 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 521804600 0 0) 0x7f65b4003260 con 0x7f65d40b1ff0 2021-12-17T18:25:49.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d3fff700 1 -- 172.21.15.62:0/2153605522 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d40675d0 con 0x7f65d4065630 2021-12-17T18:25:49.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d8f66700 1 --2- 172.21.15.62:0/2153605522 >> v2:172.21.15.109:3300/0 conn(0x7f65d4144fa0 0x7f65d41404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:49.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d3fff700 1 --2- 172.21.15.62:0/2153605522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d4065630 0x7f65d4066bd0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f65d4066190 tx=0x7f65c4006df0).ready entity=mon.0 client_cookie=aaff770f27c7d3ed server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:49.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d37fe700 1 -- 172.21.15.62:0/2153605522 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65bc001660 con 0x7f65d4065630 2021-12-17T18:25:49.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d37fe700 1 -- 172.21.15.62:0/2153605522 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c4000e90 con 0x7f65d4065630 2021-12-17T18:25:49.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d37fe700 1 -- 172.21.15.62:0/2153605522 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65c4012460 con 0x7f65d4065630 2021-12-17T18:25:49.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d9767700 1 -- 172.21.15.62:0/2153605522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d4065630 msgr2=0x7f65d4066bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d9767700 1 --2- 172.21.15.62:0/2153605522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d4065630 0x7f65d4066bd0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f65d4066190 tx=0x7f65c4006df0).stop 2021-12-17T18:25:49.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d9767700 1 -- 172.21.15.62:0/2153605522 shutdown_connections 2021-12-17T18:25:49.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d9767700 1 --2- 172.21.15.62:0/2153605522 >> v2:172.21.15.109:3300/0 conn(0x7f65d4144fa0 0x7f65d41404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d9767700 1 --2- 172.21.15.62:0/2153605522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d4065630 0x7f65d4066bd0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d9767700 1 -- 172.21.15.62:0/2153605522 >> 172.21.15.62:0/2153605522 conn(0x7f65d405c750 msgr2=0x7f65d405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:49.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d9767700 1 -- 172.21.15.62:0/2153605522 shutdown_connections 2021-12-17T18:25:49.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.763+0000 7f65d9767700 1 -- 172.21.15.62:0/2153605522 wait complete. 2021-12-17T18:25:49.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d9767700 1 Processor -- start 2021-12-17T18:25:49.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d9767700 1 -- start start 2021-12-17T18:25:49.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d9767700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d4065630 0x7f65d40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:49.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d9767700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65d40b1ff0 0x7f65d4153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:49.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d9767700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f65d4144fa0 0x7f65d4154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:49.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d9767700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40b12e0 con 0x7f65d4065630 2021-12-17T18:25:49.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d9767700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40b05f0 con 0x7f65d4144fa0 2021-12-17T18:25:49.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d9767700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d409f930 con 0x7f65d40b1ff0 2021-12-17T18:25:49.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d4065630 0x7f65d40ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:49.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d4065630 0x7f65d40ae9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53832/0 (socket says 172.21.15.62:53832) 2021-12-17T18:25:49.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d3fff700 1 -- 172.21.15.62:0/3861563840 learned_addr learned my addr 172.21.15.62:0/3861563840 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:49.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65cb7fe700 1 --2- 172.21.15.62:0/3861563840 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65d40b1ff0 0x7f65d4153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:49.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d8f66700 1 --2- 172.21.15.62:0/3861563840 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f65d4144fa0 0x7f65d4154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:49.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d3fff700 1 -- 172.21.15.62:0/3861563840 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65d40b1ff0 msgr2=0x7f65d4153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d3fff700 1 --2- 172.21.15.62:0/3861563840 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65d40b1ff0 0x7f65d4153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d3fff700 1 -- 172.21.15.62:0/3861563840 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f65d4144fa0 msgr2=0x7f65d4154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d3fff700 1 --2- 172.21.15.62:0/3861563840 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f65d4144fa0 0x7f65d4154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d3fff700 1 -- 172.21.15.62:0/3861563840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc009470 con 0x7f65d4065630 2021-12-17T18:25:49.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d8f66700 1 --2- 172.21.15.62:0/3861563840 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f65d4144fa0 0x7f65d4154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:49.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d3fff700 1 --2- 172.21.15.62:0/3861563840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d4065630 0x7f65d40ae9c0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f65d40b1c50 tx=0x7f65c4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:49.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d1ffb700 1 -- 172.21.15.62:0/3861563840 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65c400d920 con 0x7f65d4065630 2021-12-17T18:25:49.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d1ffb700 1 -- 172.21.15.62:0/3861563840 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c400da80 con 0x7f65d4065630 2021-12-17T18:25:49.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d9767700 1 -- 172.21.15.62:0/3861563840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c400b180 con 0x7f65d4065630 2021-12-17T18:25:49.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d1ffb700 1 -- 172.21.15.62:0/3861563840 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65c400dde0 con 0x7f65d4065630 2021-12-17T18:25:49.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.767+0000 7f65d9767700 1 -- 172.21.15.62:0/3861563840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d40aded0 con 0x7f65d4065630 2021-12-17T18:25:49.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.771+0000 7f65d9767700 1 -- 172.21.15.62:0/3861563840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d40affc0 con 0x7f65d4065630 2021-12-17T18:25:49.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.771+0000 7f65d1ffb700 1 -- 172.21.15.62:0/3861563840 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f65c4025030 con 0x7f65d4065630 2021-12-17T18:25:49.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.771+0000 7f65d1ffb700 1 --2- 172.21.15.62:0/3861563840 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f65b80534f0 0x7f65b80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:49.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.771+0000 7f65d1ffb700 1 -- 172.21.15.62:0/3861563840 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f65c406c700 con 0x7f65d4065630 2021-12-17T18:25:49.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.771+0000 7f65cb7fe700 1 --2- 172.21.15.62:0/3861563840 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f65b80534f0 0x7f65b80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:49.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.771+0000 7f65cb7fe700 1 --2- 172.21.15.62:0/3861563840 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f65b80534f0 0x7f65b80559b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f65bc00d000 tx=0x7f65bc001e40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:49.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.775+0000 7f65d1ffb700 1 -- 172.21.15.62:0/3861563840 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f65c4043790 con 0x7f65d4065630 2021-12-17T18:25:49.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.939+0000 7f65d9767700 1 -- 172.21.15.62:0/3861563840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65d40573d0 con 0x7f65d4065630 2021-12-17T18:25:49.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.943+0000 7f65d1ffb700 1 -- 172.21.15.62:0/3861563840 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f65c4023020 con 0x7f65d4065630 2021-12-17T18:25:49.949 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:49.949 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":43,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.109:6835/1223620032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1223620032},{"type":"v1","addr":"172.21.15.109:6835","nonce":1223620032}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":42}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:25:45.098870+0000","modified":"2021-12-17T18:25:46.102354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7044":{"gid":7044,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/994270358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":994270358},{"type":"v1","addr":"172.21.15.62:6833","nonce":994270358}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-12-17T18:25:49.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.943+0000 7f65d9767700 1 -- 172.21.15.62:0/3861563840 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f65b80534f0 msgr2=0x7f65b80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.943+0000 7f65d9767700 1 --2- 172.21.15.62:0/3861563840 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f65b80534f0 0x7f65b80559b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f65bc00d000 tx=0x7f65bc001e40).stop 2021-12-17T18:25:49.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.943+0000 7f65d9767700 1 -- 172.21.15.62:0/3861563840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d4065630 msgr2=0x7f65d40ae9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:49.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.943+0000 7f65d9767700 1 --2- 172.21.15.62:0/3861563840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d4065630 0x7f65d40ae9c0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f65d40b1c50 tx=0x7f65c4014000).stop 2021-12-17T18:25:49.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.943+0000 7f65d9767700 1 -- 172.21.15.62:0/3861563840 shutdown_connections 2021-12-17T18:25:49.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.943+0000 7f65d9767700 1 --2- 172.21.15.62:0/3861563840 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f65b80534f0 0x7f65b80559b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.943+0000 7f65d9767700 1 --2- 172.21.15.62:0/3861563840 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f65d4144fa0 0x7f65d4154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.943+0000 7f65d9767700 1 --2- 172.21.15.62:0/3861563840 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f65d40b1ff0 0x7f65d4153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.943+0000 7f65d9767700 1 --2- 172.21.15.62:0/3861563840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d4065630 0x7f65d40ae9c0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:49.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.943+0000 7f65d9767700 1 -- 172.21.15.62:0/3861563840 >> 172.21.15.62:0/3861563840 conn(0x7f65d405c750 msgr2=0x7f65d40b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:49.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.943+0000 7f65d9767700 1 -- 172.21.15.62:0/3861563840 shutdown_connections 2021-12-17T18:25:49.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:49.943+0000 7f65d9767700 1 -- 172.21.15.62:0/3861563840 wait complete. 2021-12-17T18:25:49.954 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 43 2021-12-17T18:25:50.163 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:25:45.098870+0000', 'modified': '2021-12-17T18:25:46.102354+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7044}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7044': {'gid': 7044, 'name': 'a', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/994270358', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 994270358}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 994270358}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:25:50.164 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:25:50.165 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:25:50.279 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":7044,"want_state":"up:active","state":"up:active","rank_uptime":5.16694735,"mdsmap_epoch":43,"osdmap_epoch":92,"osdmap_epoch_barrier":91,"uptime":9.3208092100000002} 2021-12-17T18:25:50.280 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 7044, "mdsmap_epoch": 43, "osdmap_epoch": 92, "osdmap_epoch_barrier": 91, "rank_uptime": 5.16694735, "state": "up:active", "uptime": 9.32080921, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:25:50.280 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:25:50.281 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-12-17T18:25:50.281 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-12-17T18:25:50.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:50.282 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:50.290 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:25:50.307 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:25:50.307 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:25:50.318 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:25:50.319 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:25:50.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:50.321 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:25:50.370 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:25:50.370 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:50.373 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:25:50.390 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:25:50.390 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:25:50.400 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:25:50.402 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:25:50.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:50.403 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:25:50.448 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[147662021-12-17T18:25:50.444+0000 7f7c76ecb080 -1 init, newargv = 0x55cd82414080 newargc=9]: starting ceph client 2021-12-17T18:25:50.448 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr: 2021-12-17T18:25:50.458 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14766]: starting fuse 2021-12-17T18:25:51.554 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:25:51.573 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:25:51.574 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:25:51.587 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:25:51.588 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:25:51.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:51.589 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:25:51.596 INFO:teuthology.orchestra.run.smithi125.stdout:52 2021-12-17T18:25:51.597 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:25:51.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:51.597 DEBUG:teuthology.orchestra.run.smithi125:> sudo python3 -c ' 2021-12-17T18:25:51.598 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2021-12-17T18:25:51.599 DEBUG:teuthology.orchestra.run.smithi125:> import re 2021-12-17T18:25:51.599 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:25:51.599 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2021-12-17T18:25:51.600 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:25:51.600 DEBUG:teuthology.orchestra.run.smithi125:> def find_socket(client_name): 2021-12-17T18:25:51.601 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-12-17T18:25:51.601 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2021-12-17T18:25:51.601 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:25:51.602 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2021-12-17T18:25:51.603 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2021-12-17T18:25:51.603 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2021-12-17T18:25:51.603 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2021-12-17T18:25:51.604 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:25:51.604 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2021-12-17T18:25:51.605 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:25:51.605 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:25:51.605 DEBUG:teuthology.orchestra.run.smithi125:> return f 2021-12-17T18:25:51.606 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:25:51.606 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:25:51.607 DEBUG:teuthology.orchestra.run.smithi125:> print(find_socket("client.0")) 2021-12-17T18:25:51.607 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:25:51.683 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.14766.asok 2021-12-17T18:25:51.688 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14766.asok 2021-12-17T18:25:51.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:51.689 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14766.asok status 2021-12-17T18:25:51.776 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2021-12-17T18:25:51.776 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2021-12-17T18:25:51.777 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:25:51.777 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:25:51.777 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2021-12-17T18:25:51.777 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2021-12-17T18:25:51.778 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-12-17T18:25:51.778 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "14766", 2021-12-17T18:25:51.778 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2021-12-17T18:25:51.778 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:25:51.779 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2021-12-17T18:25:51.779 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2021-12-17T18:25:51.779 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 7069, 2021-12-17T18:25:51.779 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2021-12-17T18:25:51.779 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2021-12-17T18:25:51.780 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2021-12-17T18:25:51.780 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 7069 2021-12-17T18:25:51.780 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:25:51.780 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:25:51.781 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:25:51.781 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:25:51.781 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 638522809 2021-12-17T18:25:51.781 INFO:teuthology.orchestra.run.smithi125.stdout: } 2021-12-17T18:25:51.782 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:25:51.782 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:25:51.782 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:25:51.782 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:25:51.783 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 638522809 2021-12-17T18:25:51.783 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:25:51.783 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.7069 172.21.15.125:0/638522809", 2021-12-17T18:25:51.784 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "172.21.15.125:0/638522809", 2021-12-17T18:25:51.784 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2021-12-17T18:25:51.784 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 43, 2021-12-17T18:25:51.784 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 92, 2021-12-17T18:25:51.785 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:25:51.785 INFO:teuthology.orchestra.run.smithi125.stdout: "blacklisted": false, 2021-12-17T18:25:51.785 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2021-12-17T18:25:51.785 INFO:teuthology.orchestra.run.smithi125.stdout:} 2021-12-17T18:25:51.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:51.787 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:51.788 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:51.795 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:25:51.796 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:25:51.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:51.797 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:51.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:25:51.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be7fff700 1 Processor -- start 2021-12-17T18:25:51.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be7fff700 1 -- start start 2021-12-17T18:25:51.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be7fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5be8141480 0x7f5be8147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:51.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be7fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5be80a8e10 0x7f5be80b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:51.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be7fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5be80b6050 0x7f5be80a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:51.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be7fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be8147610 con 0x7f5be8141480 2021-12-17T18:25:51.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be7fff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be81478b0 con 0x7f5be80a8e10 2021-12-17T18:25:51.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be7fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be8147b50 con 0x7f5be80b6050 2021-12-17T18:25:51.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be6ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5be8141480 0x7f5be8147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:51.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be67fc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5be80a8e10 0x7f5be80b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:51.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be6ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5be8141480 0x7f5be8147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53842/0 (socket says 172.21.15.62:53842) 2021-12-17T18:25:51.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be77fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5be80b6050 0x7f5be80a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:51.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be6ffd700 1 -- 172.21.15.62:0/486783998 learned_addr learned my addr 172.21.15.62:0/486783998 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:51.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be67fc700 1 -- 172.21.15.62:0/486783998 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5be80b6050 msgr2=0x7f5be80a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:51.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be67fc700 1 --2- 172.21.15.62:0/486783998 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5be80b6050 0x7f5be80a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:51.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be67fc700 1 -- 172.21.15.62:0/486783998 >> v2:172.21.15.62:3300/0 conn(0x7f5be8141480 msgr2=0x7f5be8147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:51.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be67fc700 1 --2- 172.21.15.62:0/486783998 >> v2:172.21.15.62:3300/0 conn(0x7f5be8141480 0x7f5be8147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:51.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be67fc700 1 -- 172.21.15.62:0/486783998 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be80b1b90 con 0x7f5be80a8e10 2021-12-17T18:25:51.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be67fc700 1 --2- 172.21.15.62:0/486783998 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5be80a8e10 0x7f5be80b5b60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f5bd8002f70 tx=0x7f5bd8006df0).ready entity=mon.1 client_cookie=9439c234e715a5e8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:51.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be5ffb700 1 -- 172.21.15.62:0/486783998 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bd800d4a0 con 0x7f5be80a8e10 2021-12-17T18:25:51.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be5ffb700 1 -- 172.21.15.62:0/486783998 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd8000e90 con 0x7f5be80a8e10 2021-12-17T18:25:51.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.923+0000 7f5be5ffb700 1 -- 172.21.15.62:0/486783998 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bd800d7f0 con 0x7f5be80a8e10 2021-12-17T18:25:51.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.927+0000 7f5be7fff700 1 -- 172.21.15.62:0/486783998 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5be80a8e10 msgr2=0x7f5be80b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:51.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.927+0000 7f5be7fff700 1 --2- 172.21.15.62:0/486783998 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5be80a8e10 0x7f5be80b5b60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f5bd8002f70 tx=0x7f5bd8006df0).stop 2021-12-17T18:25:51.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.927+0000 7f5be7fff700 1 -- 172.21.15.62:0/486783998 shutdown_connections 2021-12-17T18:25:51.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.927+0000 7f5be7fff700 1 --2- 172.21.15.62:0/486783998 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5be80b6050 0x7f5be80a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:51.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.927+0000 7f5be7fff700 1 --2- 172.21.15.62:0/486783998 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5be80a8e10 0x7f5be80b5b60 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:51.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.927+0000 7f5be7fff700 1 --2- 172.21.15.62:0/486783998 >> v2:172.21.15.62:3300/0 conn(0x7f5be8141480 0x7f5be8147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:51.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.927+0000 7f5be7fff700 1 -- 172.21.15.62:0/486783998 >> 172.21.15.62:0/486783998 conn(0x7f5be805d220 msgr2=0x7f5be80b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:51.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.927+0000 7f5be7fff700 1 -- 172.21.15.62:0/486783998 shutdown_connections 2021-12-17T18:25:51.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.927+0000 7f5be7fff700 1 -- 172.21.15.62:0/486783998 wait complete. 2021-12-17T18:25:51.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.927+0000 7f5be7fff700 1 Processor -- start 2021-12-17T18:25:51.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.927+0000 7f5be7fff700 1 -- start start 2021-12-17T18:25:51.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be7fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5be80a8e10 0x7f5be8149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:51.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5be80b6050 0x7f5be8135580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:51.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be7fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5be8141480 0x7f5be8135a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:51.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be7fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be8143280 con 0x7f5be80b6050 2021-12-17T18:25:51.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be7fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be8143520 con 0x7f5be8141480 2021-12-17T18:25:51.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be7fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be81437c0 con 0x7f5be80a8e10 2021-12-17T18:25:51.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be67fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5be80b6050 0x7f5be8135580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:51.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be67fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5be80b6050 0x7f5be8135580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53848/0 (socket says 172.21.15.62:53848) 2021-12-17T18:25:51.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be67fc700 1 -- 172.21.15.62:0/4016116118 learned_addr learned my addr 172.21.15.62:0/4016116118 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:51.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be77fe700 1 --2- 172.21.15.62:0/4016116118 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5be8141480 0x7f5be8135a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:51.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be6ffd700 1 --2- 172.21.15.62:0/4016116118 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5be80a8e10 0x7f5be8149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:51.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be67fc700 1 -- 172.21.15.62:0/4016116118 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5be80a8e10 msgr2=0x7f5be8149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:51.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be67fc700 1 --2- 172.21.15.62:0/4016116118 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5be80a8e10 0x7f5be8149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:51.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be67fc700 1 -- 172.21.15.62:0/4016116118 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5be8141480 msgr2=0x7f5be8135a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:51.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be67fc700 1 --2- 172.21.15.62:0/4016116118 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5be8141480 0x7f5be8135a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:51.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be67fc700 1 -- 172.21.15.62:0/4016116118 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd800b180 con 0x7f5be80b6050 2021-12-17T18:25:51.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be6ffd700 1 --2- 172.21.15.62:0/4016116118 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5be80a8e10 0x7f5be8149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:51.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be67fc700 1 --2- 172.21.15.62:0/4016116118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5be80b6050 0x7f5be8135580 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f5bd8002f70 tx=0x7f5bd8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:51.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5bd7fff700 1 -- 172.21.15.62:0/4016116118 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bd8016070 con 0x7f5be80b6050 2021-12-17T18:25:51.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5bd7fff700 1 -- 172.21.15.62:0/4016116118 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd800de90 con 0x7f5be80b6050 2021-12-17T18:25:51.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be7fff700 1 -- 172.21.15.62:0/4016116118 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be8141c70 con 0x7f5be80b6050 2021-12-17T18:25:51.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5bd7fff700 1 -- 172.21.15.62:0/4016116118 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bd8013e90 con 0x7f5be80b6050 2021-12-17T18:25:51.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.931+0000 7f5be7fff700 1 -- 172.21.15.62:0/4016116118 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be814b670 con 0x7f5be80b6050 2021-12-17T18:25:51.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.935+0000 7f5be7fff700 1 -- 172.21.15.62:0/4016116118 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be81430d0 con 0x7f5be80b6050 2021-12-17T18:25:51.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.935+0000 7f5bd7fff700 1 -- 172.21.15.62:0/4016116118 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5bd8025030 con 0x7f5be80b6050 2021-12-17T18:25:51.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.935+0000 7f5bd7fff700 1 --2- 172.21.15.62:0/4016116118 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bc40536a0 0x7f5bc4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:51.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.935+0000 7f5bd7fff700 1 -- 172.21.15.62:0/4016116118 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5bd806c830 con 0x7f5be80b6050 2021-12-17T18:25:51.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.935+0000 7f5be6ffd700 1 --2- 172.21.15.62:0/4016116118 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bc40536a0 0x7f5bc4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:51.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.935+0000 7f5be6ffd700 1 --2- 172.21.15.62:0/4016116118 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bc40536a0 0x7f5bc4055b60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f5bdc008000 tx=0x7f5bdc008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:51.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:51.943+0000 7f5bd7fff700 1 -- 172.21.15.62:0/4016116118 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5bd8043990 con 0x7f5be80b6050 2021-12-17T18:25:52.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.071+0000 7f5be7fff700 1 -- 172.21.15.62:0/4016116118 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5be8143980 con 0x7f5be80b6050 2021-12-17T18:25:52.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.075+0000 7f5bd7fff700 1 -- 172.21.15.62:0/4016116118 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f5bd8023090 con 0x7f5be80b6050 2021-12-17T18:25:52.082 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:52.082 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":92,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:25:47.114772+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:25:43.705181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-12-17T18:25:44.085619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:25:52.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.075+0000 7f5be7fff700 1 -- 172.21.15.62:0/4016116118 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bc40536a0 msgr2=0x7f5bc4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.075+0000 7f5be7fff700 1 --2- 172.21.15.62:0/4016116118 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bc40536a0 0x7f5bc4055b60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f5bdc008000 tx=0x7f5bdc008040).stop 2021-12-17T18:25:52.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.075+0000 7f5be7fff700 1 -- 172.21.15.62:0/4016116118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5be80b6050 msgr2=0x7f5be8135580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.075+0000 7f5be7fff700 1 --2- 172.21.15.62:0/4016116118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5be80b6050 0x7f5be8135580 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f5bd8002f70 tx=0x7f5bd8014000).stop 2021-12-17T18:25:52.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.075+0000 7f5be7fff700 1 -- 172.21.15.62:0/4016116118 shutdown_connections 2021-12-17T18:25:52.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.075+0000 7f5be7fff700 1 --2- 172.21.15.62:0/4016116118 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bc40536a0 0x7f5bc4055b60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.075+0000 7f5be7fff700 1 --2- 172.21.15.62:0/4016116118 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5be8141480 0x7f5be8135a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.075+0000 7f5be7fff700 1 --2- 172.21.15.62:0/4016116118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5be80b6050 0x7f5be8135580 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.075+0000 7f5be7fff700 1 --2- 172.21.15.62:0/4016116118 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5be80a8e10 0x7f5be8149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.075+0000 7f5be7fff700 1 -- 172.21.15.62:0/4016116118 >> 172.21.15.62:0/4016116118 conn(0x7f5be805d220 msgr2=0x7f5be805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:52.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.075+0000 7f5be7fff700 1 -- 172.21.15.62:0/4016116118 shutdown_connections 2021-12-17T18:25:52.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.075+0000 7f5be7fff700 1 -- 172.21.15.62:0/4016116118 wait complete. 2021-12-17T18:25:52.096 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:25:43.705181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:25:44.085619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:25:52.097 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:25:52.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.199+0000 7f92f0ba9700 1 Processor -- start 2021-12-17T18:25:52.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.199+0000 7f92f0ba9700 1 -- start start 2021-12-17T18:25:52.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92f0ba9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f92ec063de0 0x7f92ec140a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92f0ba9700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f92ec0b1ee0 0x7f92ec0b2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92f0ba9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec140f70 con 0x7f92ec0ac9f0 2021-12-17T18:25:52.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92f0ba9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ec0b7540 con 0x7f92ec063de0 2021-12-17T18:25:52.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92f0ba9700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ec0acdd0 con 0x7f92ec0b1ee0 2021-12-17T18:25:52.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92ea59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f92ec0ac9f0 0x7f92ec140370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37434/0 (socket says 172.21.15.62:37434) 2021-12-17T18:25:52.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92ea59c700 1 -- 172.21.15.62:0/1063326490 learned_addr learned my addr 172.21.15.62:0/1063326490 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:52.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92e9d9b700 1 --2- 172.21.15.62:0/1063326490 >> v2:172.21.15.62:3300/0 conn(0x7f92ec063de0 0x7f92ec140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92ead9d700 1 --2- 172.21.15.62:0/1063326490 >> v2:172.21.15.109:3300/0 conn(0x7f92ec0b1ee0 0x7f92ec0b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92e959a700 1 -- 172.21.15.62:0/1063326490 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868669152 0 0) 0x7f92dc001110 con 0x7f92ec0ac9f0 2021-12-17T18:25:52.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92e959a700 1 -- 172.21.15.62:0/1063326490 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92d0003260 con 0x7f92ec0ac9f0 2021-12-17T18:25:52.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92e9d9b700 1 -- 172.21.15.62:0/1063326490 >> v2:172.21.15.109:3300/0 conn(0x7f92ec0b1ee0 msgr2=0x7f92ec0b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:52.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92e9d9b700 1 --2- 172.21.15.62:0/1063326490 >> v2:172.21.15.109:3300/0 conn(0x7f92ec0b1ee0 0x7f92ec0b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92e9d9b700 1 -- 172.21.15.62:0/1063326490 >> v1:172.21.15.62:6789/0 conn(0x7f92ec0ac9f0 legacy=0x7f92ec140370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92e9d9b700 1 -- 172.21.15.62:0/1063326490 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec0b6b60 con 0x7f92ec063de0 2021-12-17T18:25:52.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92e9d9b700 1 --2- 172.21.15.62:0/1063326490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92ec063de0 0x7f92ec140a80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f92ec063730 tx=0x7f92e0006df0).ready entity=mon.0 client_cookie=f0e03b2bdf1c67ef server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:52.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92e959a700 1 -- 172.21.15.62:0/1063326490 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92e000d4f0 con 0x7f92ec063de0 2021-12-17T18:25:52.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92e959a700 1 -- 172.21.15.62:0/1063326490 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e0000e90 con 0x7f92ec063de0 2021-12-17T18:25:52.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92e959a700 1 -- 172.21.15.62:0/1063326490 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92e000d840 con 0x7f92ec063de0 2021-12-17T18:25:52.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92f0ba9700 1 -- 172.21.15.62:0/1063326490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92ec063de0 msgr2=0x7f92ec140a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92f0ba9700 1 --2- 172.21.15.62:0/1063326490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92ec063de0 0x7f92ec140a80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f92ec063730 tx=0x7f92e0006df0).stop 2021-12-17T18:25:52.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92f0ba9700 1 -- 172.21.15.62:0/1063326490 shutdown_connections 2021-12-17T18:25:52.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92f0ba9700 1 --2- 172.21.15.62:0/1063326490 >> v2:172.21.15.109:3300/0 conn(0x7f92ec0b1ee0 0x7f92ec0b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92f0ba9700 1 --2- 172.21.15.62:0/1063326490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92ec063de0 0x7f92ec140a80 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92f0ba9700 1 -- 172.21.15.62:0/1063326490 >> 172.21.15.62:0/1063326490 conn(0x7f92ec0625b0 msgr2=0x7f92ec062990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:52.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92f0ba9700 1 -- 172.21.15.62:0/1063326490 shutdown_connections 2021-12-17T18:25:52.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.203+0000 7f92f0ba9700 1 -- 172.21.15.62:0/1063326490 wait complete. 2021-12-17T18:25:52.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92f0ba9700 1 Processor -- start 2021-12-17T18:25:52.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92f0ba9700 1 -- start start 2021-12-17T18:25:52.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92f0ba9700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f92ec063de0 0x7f92ec1392c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92f0ba9700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92ec0ac9f0 0x7f92ec0642c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92f0ba9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92ec0b1ee0 0x7f92ec066ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92f0ba9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0647b0 con 0x7f92ec0b1ee0 2021-12-17T18:25:52.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92f0ba9700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0aaca0 con 0x7f92ec063de0 2021-12-17T18:25:52.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92f0ba9700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec135500 con 0x7f92ec0ac9f0 2021-12-17T18:25:52.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92ead9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92ec0b1ee0 0x7f92ec066ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92ea59c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f92ec063de0 0x7f92ec1392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92ead9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92ec0b1ee0 0x7f92ec066ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53864/0 (socket says 172.21.15.62:53864) 2021-12-17T18:25:52.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92ead9d700 1 -- 172.21.15.62:0/3261835581 learned_addr learned my addr 172.21.15.62:0/3261835581 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:52.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92e9d9b700 1 --2- 172.21.15.62:0/3261835581 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92ec0ac9f0 0x7f92ec0642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92ea59c700 1 -- 172.21.15.62:0/3261835581 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92ec0ac9f0 msgr2=0x7f92ec0642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92ea59c700 1 --2- 172.21.15.62:0/3261835581 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92ec0ac9f0 0x7f92ec0642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92ea59c700 1 -- 172.21.15.62:0/3261835581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92ec0b1ee0 msgr2=0x7f92ec066ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92ea59c700 1 --2- 172.21.15.62:0/3261835581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92ec0b1ee0 0x7f92ec066ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.207+0000 7f92ea59c700 1 -- 172.21.15.62:0/3261835581 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e000b180 con 0x7f92ec063de0 2021-12-17T18:25:52.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.211+0000 7f92ea59c700 1 --2- 172.21.15.62:0/3261835581 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f92ec063de0 0x7f92ec1392c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f92dc0012a0 tx=0x7f92dc0078a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:52.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.211+0000 7f92db7fe700 1 -- 172.21.15.62:0/3261835581 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92dc00ce50 con 0x7f92ec063de0 2021-12-17T18:25:52.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.211+0000 7f92db7fe700 1 -- 172.21.15.62:0/3261835581 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92dc0070d0 con 0x7f92ec063de0 2021-12-17T18:25:52.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.211+0000 7f92f0ba9700 1 -- 172.21.15.62:0/3261835581 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ec0aaed0 con 0x7f92ec063de0 2021-12-17T18:25:52.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.211+0000 7f92db7fe700 1 -- 172.21.15.62:0/3261835581 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92dc007430 con 0x7f92ec063de0 2021-12-17T18:25:52.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.211+0000 7f92f0ba9700 1 -- 172.21.15.62:0/3261835581 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ec0abe30 con 0x7f92ec063de0 2021-12-17T18:25:52.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.211+0000 7f92f0ba9700 1 -- 172.21.15.62:0/3261835581 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ec0ab370 con 0x7f92ec063de0 2021-12-17T18:25:52.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.211+0000 7f92db7fe700 1 -- 172.21.15.62:0/3261835581 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f92dc01a060 con 0x7f92ec063de0 2021-12-17T18:25:52.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.211+0000 7f92db7fe700 1 --2- 172.21.15.62:0/3261835581 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f92c80534f0 0x7f92c80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.211+0000 7f92db7fe700 1 -- 172.21.15.62:0/3261835581 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f92dc06aee0 con 0x7f92ec063de0 2021-12-17T18:25:52.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.211+0000 7f92e9d9b700 1 --2- 172.21.15.62:0/3261835581 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f92c80534f0 0x7f92c80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.215+0000 7f92e9d9b700 1 --2- 172.21.15.62:0/3261835581 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f92c80534f0 0x7f92c80559b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f92e001a000 tx=0x7f92e0014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:52.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.223+0000 7f92db7fe700 1 -- 172.21.15.62:0/3261835581 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f92dc041f30 con 0x7f92ec063de0 2021-12-17T18:25:52.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.347+0000 7f92f0ba9700 1 -- 172.21.15.62:0/3261835581 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f92ec140f70 con 0x7f92ec063de0 2021-12-17T18:25:52.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.351+0000 7f92db7fe700 1 -- 172.21.15.62:0/3261835581 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v92) v1 ==== 110+0+10 (secure 0 0 0) 0x7f92ec140f70 con 0x7f92ec063de0 2021-12-17T18:25:52.357 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:25:52.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.351+0000 7f92f0ba9700 1 -- 172.21.15.62:0/3261835581 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f92c80534f0 msgr2=0x7f92c80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.351+0000 7f92f0ba9700 1 --2- 172.21.15.62:0/3261835581 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f92c80534f0 0x7f92c80559b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f92e001a000 tx=0x7f92e0014000).stop 2021-12-17T18:25:52.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.351+0000 7f92f0ba9700 1 -- 172.21.15.62:0/3261835581 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f92ec063de0 msgr2=0x7f92ec1392c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.351+0000 7f92f0ba9700 1 --2- 172.21.15.62:0/3261835581 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f92ec063de0 0x7f92ec1392c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f92dc0012a0 tx=0x7f92dc0078a0).stop 2021-12-17T18:25:52.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.351+0000 7f92f0ba9700 1 -- 172.21.15.62:0/3261835581 shutdown_connections 2021-12-17T18:25:52.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.351+0000 7f92f0ba9700 1 --2- 172.21.15.62:0/3261835581 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f92c80534f0 0x7f92c80559b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.351+0000 7f92f0ba9700 1 --2- 172.21.15.62:0/3261835581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92ec0b1ee0 0x7f92ec066ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.351+0000 7f92f0ba9700 1 --2- 172.21.15.62:0/3261835581 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92ec0ac9f0 0x7f92ec0642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.351+0000 7f92f0ba9700 1 --2- 172.21.15.62:0/3261835581 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f92ec063de0 0x7f92ec1392c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.355+0000 7f92f0ba9700 1 -- 172.21.15.62:0/3261835581 >> 172.21.15.62:0/3261835581 conn(0x7f92ec0625b0 msgr2=0x7f92ec144660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:52.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.355+0000 7f92f0ba9700 1 -- 172.21.15.62:0/3261835581 shutdown_connections 2021-12-17T18:25:52.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.355+0000 7f92f0ba9700 1 -- 172.21.15.62:0/3261835581 wait complete. 2021-12-17T18:25:52.374 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:25:52.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed81216700 1 Processor -- start 2021-12-17T18:25:52.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed81216700 1 -- start start 2021-12-17T18:25:52.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed81216700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fed7c0b1480 0x7fed7c0b1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed81216700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fed7c0b1dc0 0x7fed7c147660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed81216700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed7c0b2930 con 0x7fed7c0625a0 2021-12-17T18:25:52.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed81216700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed7c0b23f0 con 0x7fed7c0b1480 2021-12-17T18:25:52.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed81216700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed7c0b2690 con 0x7fed7c0b1dc0 2021-12-17T18:25:52.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed7ad9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fed7c0b1480 0x7fed7c0b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed7a59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fed7c0625a0 0x7fed7c144560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37450/0 (socket says 172.21.15.62:37450) 2021-12-17T18:25:52.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed7a59c700 1 -- 172.21.15.62:0/600558397 learned_addr learned my addr 172.21.15.62:0/600558397 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:52.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed7b59e700 1 --2- 172.21.15.62:0/600558397 >> v2:172.21.15.109:3300/0 conn(0x7fed7c0b1dc0 0x7fed7c147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed79d9b700 1 -- 172.21.15.62:0/600558397 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189454014 0 0) 0x7fed7c0b2930 con 0x7fed7c0625a0 2021-12-17T18:25:52.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed79d9b700 1 -- 172.21.15.62:0/600558397 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed60003260 con 0x7fed7c0625a0 2021-12-17T18:25:52.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed7ad9d700 1 -- 172.21.15.62:0/600558397 >> v2:172.21.15.109:3300/0 conn(0x7fed7c0b1dc0 msgr2=0x7fed7c147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:52.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed7ad9d700 1 --2- 172.21.15.62:0/600558397 >> v2:172.21.15.109:3300/0 conn(0x7fed7c0b1dc0 0x7fed7c147660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed7ad9d700 1 -- 172.21.15.62:0/600558397 >> v1:172.21.15.62:6789/0 conn(0x7fed7c0625a0 legacy=0x7fed7c144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed7ad9d700 1 -- 172.21.15.62:0/600558397 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7c061390 con 0x7fed7c0b1480 2021-12-17T18:25:52.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed7ad9d700 1 --2- 172.21.15.62:0/600558397 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c0b1480 0x7fed7c0b1860 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7fed7c147380 tx=0x7fed70006df0).ready entity=mon.0 client_cookie=77c5be724f9f67b3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:52.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed79d9b700 1 -- 172.21.15.62:0/600558397 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed7000d4f0 con 0x7fed7c0b1480 2021-12-17T18:25:52.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed79d9b700 1 -- 172.21.15.62:0/600558397 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed70000e90 con 0x7fed7c0b1480 2021-12-17T18:25:52.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed79d9b700 1 -- 172.21.15.62:0/600558397 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed7000d840 con 0x7fed7c0b1480 2021-12-17T18:25:52.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed81216700 1 -- 172.21.15.62:0/600558397 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c0b1480 msgr2=0x7fed7c0b1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed81216700 1 --2- 172.21.15.62:0/600558397 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c0b1480 0x7fed7c0b1860 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7fed7c147380 tx=0x7fed70006df0).stop 2021-12-17T18:25:52.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed81216700 1 -- 172.21.15.62:0/600558397 shutdown_connections 2021-12-17T18:25:52.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed81216700 1 --2- 172.21.15.62:0/600558397 >> v2:172.21.15.109:3300/0 conn(0x7fed7c0b1dc0 0x7fed7c147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed81216700 1 --2- 172.21.15.62:0/600558397 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c0b1480 0x7fed7c0b1860 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed81216700 1 -- 172.21.15.62:0/600558397 >> 172.21.15.62:0/600558397 conn(0x7fed7c0b64d0 msgr2=0x7fed7c0b68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:52.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed81216700 1 -- 172.21.15.62:0/600558397 shutdown_connections 2021-12-17T18:25:52.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.479+0000 7fed81216700 1 -- 172.21.15.62:0/600558397 wait complete. 2021-12-17T18:25:52.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed81216700 1 Processor -- start 2021-12-17T18:25:52.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed81216700 1 -- start start 2021-12-17T18:25:52.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed81216700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fed7c0625a0 0x7fed7c141f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed81216700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c0b1480 0x7fed7c1490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed81216700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fed7c0b1dc0 0x7fed7c159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed81216700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c14a370 con 0x7fed7c0b1480 2021-12-17T18:25:52.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed81216700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c1468b0 con 0x7fed7c0b1dc0 2021-12-17T18:25:52.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed81216700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c148c30 con 0x7fed7c0625a0 2021-12-17T18:25:52.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed7a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c0b1480 0x7fed7c1490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed7a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c0b1480 0x7fed7c1490d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53874/0 (socket says 172.21.15.62:53874) 2021-12-17T18:25:52.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed7a59c700 1 -- 172.21.15.62:0/3807231727 learned_addr learned my addr 172.21.15.62:0/3807231727 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:52.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed7b59e700 1 --2- 172.21.15.62:0/3807231727 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fed7c0b1dc0 0x7fed7c159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed7ad9d700 1 --2- 172.21.15.62:0/3807231727 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fed7c0625a0 0x7fed7c141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed7a59c700 1 -- 172.21.15.62:0/3807231727 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fed7c0625a0 msgr2=0x7fed7c141f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed7a59c700 1 --2- 172.21.15.62:0/3807231727 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fed7c0625a0 0x7fed7c141f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed7a59c700 1 -- 172.21.15.62:0/3807231727 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fed7c0b1dc0 msgr2=0x7fed7c159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed7a59c700 1 --2- 172.21.15.62:0/3807231727 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fed7c0b1dc0 0x7fed7c159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed7a59c700 1 -- 172.21.15.62:0/3807231727 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7000b180 con 0x7fed7c0b1480 2021-12-17T18:25:52.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed7ad9d700 1 --2- 172.21.15.62:0/3807231727 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fed7c0625a0 0x7fed7c141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:25:52.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed7a59c700 1 --2- 172.21.15.62:0/3807231727 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c0b1480 0x7fed7c1490d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7fed6c001110 tx=0x7fed6c007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:52.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed6bfff700 1 -- 172.21.15.62:0/3807231727 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed6c007e10 con 0x7fed7c0b1480 2021-12-17T18:25:52.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed6bfff700 1 -- 172.21.15.62:0/3807231727 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6c0072e0 con 0x7fed7c0b1480 2021-12-17T18:25:52.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed81216700 1 -- 172.21.15.62:0/3807231727 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7c145340 con 0x7fed7c0b1480 2021-12-17T18:25:52.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed6bfff700 1 -- 172.21.15.62:0/3807231727 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed6c005800 con 0x7fed7c0b1480 2021-12-17T18:25:52.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed81216700 1 -- 172.21.15.62:0/3807231727 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7c146030 con 0x7fed7c0b1480 2021-12-17T18:25:52.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.483+0000 7fed81216700 1 -- 172.21.15.62:0/3807231727 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7c146a70 con 0x7fed7c0b1480 2021-12-17T18:25:52.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.487+0000 7fed6bfff700 1 -- 172.21.15.62:0/3807231727 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fed6c010070 con 0x7fed7c0b1480 2021-12-17T18:25:52.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.487+0000 7fed6bfff700 1 --2- 172.21.15.62:0/3807231727 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fed580536a0 0x7fed58055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.487+0000 7fed6bfff700 1 -- 172.21.15.62:0/3807231727 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fed6c06b040 con 0x7fed7c0b1480 2021-12-17T18:25:52.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.487+0000 7fed7ad9d700 1 --2- 172.21.15.62:0/3807231727 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fed580536a0 0x7fed58055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.487+0000 7fed7ad9d700 1 --2- 172.21.15.62:0/3807231727 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fed580536a0 0x7fed58055b60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fed70015000 tx=0x7fed70014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:52.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.491+0000 7fed6bfff700 1 -- 172.21.15.62:0/3807231727 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fed6c0421a0 con 0x7fed7c0b1480 2021-12-17T18:25:52.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.619+0000 7fed81216700 1 -- 172.21.15.62:0/3807231727 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fed7c144c70 con 0x7fed7c0b1480 2021-12-17T18:25:52.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.619+0000 7fed6bfff700 1 -- 172.21.15.62:0/3807231727 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v92) v1 ==== 92+0+10 (secure 0 0 0) 0x7fed6c0457c0 con 0x7fed7c0b1480 2021-12-17T18:25:52.625 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:25:52.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.619+0000 7fed81216700 1 -- 172.21.15.62:0/3807231727 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fed580536a0 msgr2=0x7fed58055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.619+0000 7fed81216700 1 --2- 172.21.15.62:0/3807231727 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fed580536a0 0x7fed58055b60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fed70015000 tx=0x7fed70014000).stop 2021-12-17T18:25:52.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.619+0000 7fed81216700 1 -- 172.21.15.62:0/3807231727 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c0b1480 msgr2=0x7fed7c1490d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.619+0000 7fed81216700 1 --2- 172.21.15.62:0/3807231727 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c0b1480 0x7fed7c1490d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7fed6c001110 tx=0x7fed6c007ad0).stop 2021-12-17T18:25:52.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.619+0000 7fed81216700 1 -- 172.21.15.62:0/3807231727 shutdown_connections 2021-12-17T18:25:52.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.619+0000 7fed81216700 1 --2- 172.21.15.62:0/3807231727 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fed580536a0 0x7fed58055b60 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.619+0000 7fed81216700 1 --2- 172.21.15.62:0/3807231727 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fed7c0b1dc0 0x7fed7c159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.619+0000 7fed81216700 1 --2- 172.21.15.62:0/3807231727 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c0b1480 0x7fed7c1490d0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.619+0000 7fed81216700 1 --2- 172.21.15.62:0/3807231727 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fed7c0625a0 0x7fed7c141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.619+0000 7fed81216700 1 -- 172.21.15.62:0/3807231727 >> 172.21.15.62:0/3807231727 conn(0x7fed7c0b64d0 msgr2=0x7fed7c147580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:52.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.619+0000 7fed81216700 1 -- 172.21.15.62:0/3807231727 shutdown_connections 2021-12-17T18:25:52.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.619+0000 7fed81216700 1 -- 172.21.15.62:0/3807231727 wait complete. 2021-12-17T18:25:52.639 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:25:52.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfeb32700 1 Processor -- start 2021-12-17T18:25:52.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfeb32700 1 -- start start 2021-12-17T18:25:52.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfeb32700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fbcf80b05b0 0x7fbcf8146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfeb32700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbcf80b5dd0 0x7fbcf8146b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfeb32700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbcf8147070 0x7fbcf805f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfeb32700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf80b2010 con 0x7fbcf8147070 2021-12-17T18:25:52.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfeb32700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf80b0990 con 0x7fbcf80b05b0 2021-12-17T18:25:52.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfeb32700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80b2240 con 0x7fbcf80b5dd0 2021-12-17T18:25:52.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfd0cf700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbcf8147070 0x7fbcf805f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfd0cf700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbcf8147070 0x7fbcf805f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53884/0 (socket says 172.21.15.62:53884) 2021-12-17T18:25:52.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfd0cf700 1 -- 172.21.15.62:0/1523127422 learned_addr learned my addr 172.21.15.62:0/1523127422 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:52.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfc8ce700 1 --2- 172.21.15.62:0/1523127422 >> v2:172.21.15.109:3300/0 conn(0x7fbcf80b05b0 0x7fbcf8146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbceffff700 1 --2- 172.21.15.62:0/1523127422 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbcf80b5dd0 0x7fbcf8146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfd0cf700 1 -- 172.21.15.62:0/1523127422 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbcf80b5dd0 msgr2=0x7fbcf8146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:52.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfd0cf700 1 --2- 172.21.15.62:0/1523127422 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbcf80b5dd0 0x7fbcf8146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfd0cf700 1 -- 172.21.15.62:0/1523127422 >> v2:172.21.15.109:3300/0 conn(0x7fbcf80b05b0 msgr2=0x7fbcf8146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:52.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfd0cf700 1 --2- 172.21.15.62:0/1523127422 >> v2:172.21.15.109:3300/0 conn(0x7fbcf80b05b0 0x7fbcf8146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfd0cf700 1 -- 172.21.15.62:0/1523127422 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf80b24e0 con 0x7fbcf8147070 2021-12-17T18:25:52.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfd0cf700 1 --2- 172.21.15.62:0/1523127422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcf8147070 0x7fbcf805f730 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7fbcf00032f0 tx=0x7fbcf0009290).ready entity=mon.0 client_cookie=a5f0c2e8ab58081c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:52.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcef7fe700 1 -- 172.21.15.62:0/1523127422 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcf000b870 con 0x7fbcf8147070 2021-12-17T18:25:52.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcef7fe700 1 -- 172.21.15.62:0/1523127422 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf000b9d0 con 0x7fbcf8147070 2021-12-17T18:25:52.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcef7fe700 1 -- 172.21.15.62:0/1523127422 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcf000bb40 con 0x7fbcf8147070 2021-12-17T18:25:52.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfeb32700 1 -- 172.21.15.62:0/1523127422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcf8147070 msgr2=0x7fbcf805f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfeb32700 1 --2- 172.21.15.62:0/1523127422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcf8147070 0x7fbcf805f730 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7fbcf00032f0 tx=0x7fbcf0009290).stop 2021-12-17T18:25:52.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfeb32700 1 -- 172.21.15.62:0/1523127422 shutdown_connections 2021-12-17T18:25:52.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfeb32700 1 --2- 172.21.15.62:0/1523127422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcf8147070 0x7fbcf805f730 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfeb32700 1 --2- 172.21.15.62:0/1523127422 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbcf80b5dd0 0x7fbcf8146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfeb32700 1 --2- 172.21.15.62:0/1523127422 >> v2:172.21.15.109:3300/0 conn(0x7fbcf80b05b0 0x7fbcf8146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfeb32700 1 -- 172.21.15.62:0/1523127422 >> 172.21.15.62:0/1523127422 conn(0x7fbcf8062510 msgr2=0x7fbcf80628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:52.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfeb32700 1 -- 172.21.15.62:0/1523127422 shutdown_connections 2021-12-17T18:25:52.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.747+0000 7fbcfeb32700 1 -- 172.21.15.62:0/1523127422 wait complete. 2021-12-17T18:25:52.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfeb32700 1 Processor -- start 2021-12-17T18:25:52.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfeb32700 1 -- start start 2021-12-17T18:25:52.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfeb32700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbcf80b05b0 0x7fbcf80645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfeb32700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbcf80b5dd0 0x7fbcf8140410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfeb32700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcf8140900 0x7fbcf8066bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfeb32700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf813fac0 con 0x7fbcf8140900 2021-12-17T18:25:52.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfeb32700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf813fd60 con 0x7fbcf80b5dd0 2021-12-17T18:25:52.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfeb32700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf813e950 con 0x7fbcf80b05b0 2021-12-17T18:25:52.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfd0cf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcf8140900 0x7fbcf8066bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfd0cf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcf8140900 0x7fbcf8066bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53892/0 (socket says 172.21.15.62:53892) 2021-12-17T18:25:52.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfd0cf700 1 -- 172.21.15.62:0/381359554 learned_addr learned my addr 172.21.15.62:0/381359554 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:52.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbceffff700 1 --2- 172.21.15.62:0/381359554 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbcf80b5dd0 0x7fbcf8140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfc8ce700 1 --2- 172.21.15.62:0/381359554 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbcf80b05b0 0x7fbcf80645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfd0cf700 1 -- 172.21.15.62:0/381359554 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbcf80b05b0 msgr2=0x7fbcf80645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfd0cf700 1 --2- 172.21.15.62:0/381359554 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbcf80b05b0 0x7fbcf80645a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfd0cf700 1 -- 172.21.15.62:0/381359554 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbcf80b5dd0 msgr2=0x7fbcf8140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfd0cf700 1 --2- 172.21.15.62:0/381359554 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbcf80b5dd0 0x7fbcf8140410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfd0cf700 1 -- 172.21.15.62:0/381359554 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf0009530 con 0x7fbcf8140900 2021-12-17T18:25:52.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfd0cf700 1 --2- 172.21.15.62:0/381359554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcf8140900 0x7fbcf8066bc0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7fbcf00032f0 tx=0x7fbcf0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:52.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcedffb700 1 -- 172.21.15.62:0/381359554 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcf000b870 con 0x7fbcf8140900 2021-12-17T18:25:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcedffb700 1 -- 172.21.15.62:0/381359554 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf0021670 con 0x7fbcf8140900 2021-12-17T18:25:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcedffb700 1 -- 172.21.15.62:0/381359554 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcf00219d0 con 0x7fbcf8140900 2021-12-17T18:25:52.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfeb32700 1 -- 172.21.15.62:0/381359554 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf813fac0 con 0x7fbcf8140900 2021-12-17T18:25:52.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.751+0000 7fbcfeb32700 1 -- 172.21.15.62:0/381359554 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf80670b0 con 0x7fbcf8140900 2021-12-17T18:25:52.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.755+0000 7fbcfeb32700 1 -- 172.21.15.62:0/381359554 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf80b2780 con 0x7fbcf8140900 2021-12-17T18:25:52.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.755+0000 7fbcedffb700 1 -- 172.21.15.62:0/381359554 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbcf000f070 con 0x7fbcf8140900 2021-12-17T18:25:52.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.755+0000 7fbcedffb700 1 --2- 172.21.15.62:0/381359554 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbcd8053580 0x7fbcd8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:52.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.755+0000 7fbcedffb700 1 -- 172.21.15.62:0/381359554 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbcf006c9a0 con 0x7fbcf8140900 2021-12-17T18:25:52.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.755+0000 7fbcfc8ce700 1 --2- 172.21.15.62:0/381359554 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbcd8053580 0x7fbcd8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:52.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.755+0000 7fbcfc8ce700 1 --2- 172.21.15.62:0/381359554 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbcd8053580 0x7fbcd8055a40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fbcf400b000 tx=0x7fbcf4006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:52.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.763+0000 7fbcedffb700 1 -- 172.21.15.62:0/381359554 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbcf0043bb0 con 0x7fbcf8140900 2021-12-17T18:25:52.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.887+0000 7fbcfeb32700 1 -- 172.21.15.62:0/381359554 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbcf813eb10 con 0x7fbcf8140900 2021-12-17T18:25:52.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.887+0000 7fbcedffb700 1 -- 172.21.15.62:0/381359554 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+10 (secure 0 0 0) 0x7fbcf0015070 con 0x7fbcf8140900 2021-12-17T18:25:52.893 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:25:52.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.887+0000 7fbcfeb32700 1 -- 172.21.15.62:0/381359554 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbcd8053580 msgr2=0x7fbcd8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.887+0000 7fbcfeb32700 1 --2- 172.21.15.62:0/381359554 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbcd8053580 0x7fbcd8055a40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fbcf400b000 tx=0x7fbcf4006df0).stop 2021-12-17T18:25:52.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.887+0000 7fbcfeb32700 1 -- 172.21.15.62:0/381359554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcf8140900 msgr2=0x7fbcf8066bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:52.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.887+0000 7fbcfeb32700 1 --2- 172.21.15.62:0/381359554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcf8140900 0x7fbcf8066bc0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7fbcf00032f0 tx=0x7fbcf0016000).stop 2021-12-17T18:25:52.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.887+0000 7fbcfeb32700 1 -- 172.21.15.62:0/381359554 shutdown_connections 2021-12-17T18:25:52.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.887+0000 7fbcfeb32700 1 --2- 172.21.15.62:0/381359554 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbcd8053580 0x7fbcd8055a40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.887+0000 7fbcfeb32700 1 --2- 172.21.15.62:0/381359554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcf8140900 0x7fbcf8066bc0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.887+0000 7fbcfeb32700 1 --2- 172.21.15.62:0/381359554 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbcf80b5dd0 0x7fbcf8140410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.887+0000 7fbcfeb32700 1 --2- 172.21.15.62:0/381359554 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbcf80b05b0 0x7fbcf80645a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:52.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.887+0000 7fbcfeb32700 1 -- 172.21.15.62:0/381359554 >> 172.21.15.62:0/381359554 conn(0x7fbcf8062510 msgr2=0x7fbcf81466e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:52.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.887+0000 7fbcfeb32700 1 -- 172.21.15.62:0/381359554 shutdown_connections 2021-12-17T18:25:52.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:52.887+0000 7fbcfeb32700 1 -- 172.21.15.62:0/381359554 wait complete. 2021-12-17T18:25:52.906 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:25:53.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.007+0000 7f724f579700 1 Processor -- start 2021-12-17T18:25:53.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.007+0000 7f724f579700 1 -- start start 2021-12-17T18:25:53.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724f579700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f72480ad290 0x7f72480ae720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:53.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724f579700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f724813e360 0x7f724813e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:53.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724f579700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72480b1220 con 0x7f72480b0b50 2021-12-17T18:25:53.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724f579700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72480ad670 con 0x7f72480ad290 2021-12-17T18:25:53.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724f579700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724813f3f0 con 0x7f724813e360 2021-12-17T18:25:53.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724dd76700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f72480b0b50 0x7f72480aec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37480/0 (socket says 172.21.15.62:37480) 2021-12-17T18:25:53.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724dd76700 1 -- 172.21.15.62:0/1885171847 learned_addr learned my addr 172.21.15.62:0/1885171847 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:53.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724ed78700 1 --2- 172.21.15.62:0/1885171847 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f724813e360 0x7f724813e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:53.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724e577700 1 --2- 172.21.15.62:0/1885171847 >> v2:172.21.15.109:3300/0 conn(0x7f72480ad290 0x7f72480ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:53.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724d575700 1 -- 172.21.15.62:0/1885171847 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025356671 0 0) 0x7f72480b1220 con 0x7f72480b0b50 2021-12-17T18:25:53.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724d575700 1 -- 172.21.15.62:0/1885171847 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7230003260 con 0x7f72480b0b50 2021-12-17T18:25:53.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724ed78700 1 -- 172.21.15.62:0/1885171847 >> v2:172.21.15.109:3300/0 conn(0x7f72480ad290 msgr2=0x7f72480ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:53.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724ed78700 1 --2- 172.21.15.62:0/1885171847 >> v2:172.21.15.109:3300/0 conn(0x7f72480ad290 0x7f72480ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724ed78700 1 -- 172.21.15.62:0/1885171847 >> v1:172.21.15.62:6789/0 conn(0x7f72480b0b50 legacy=0x7f72480aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:53.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724ed78700 1 -- 172.21.15.62:0/1885171847 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72480b07f0 con 0x7f724813e360 2021-12-17T18:25:53.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724ed78700 1 --2- 172.21.15.62:0/1885171847 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f724813e360 0x7f724813e7f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f72480ae5c0 tx=0x7f72400091d0).ready entity=mon.2 client_cookie=77a3f18979fef136 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:53.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724d575700 1 -- 172.21.15.62:0/1885171847 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f724000b5a0 con 0x7f724813e360 2021-12-17T18:25:53.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724d575700 1 -- 172.21.15.62:0/1885171847 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724000b700 con 0x7f724813e360 2021-12-17T18:25:53.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724d575700 1 -- 172.21.15.62:0/1885171847 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f724000b8b0 con 0x7f724813e360 2021-12-17T18:25:53.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724f579700 1 -- 172.21.15.62:0/1885171847 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f724813e360 msgr2=0x7f724813e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:53.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.011+0000 7f724f579700 1 --2- 172.21.15.62:0/1885171847 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f724813e360 0x7f724813e7f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f72480ae5c0 tx=0x7f72400091d0).stop 2021-12-17T18:25:53.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.015+0000 7f724f579700 1 -- 172.21.15.62:0/1885171847 shutdown_connections 2021-12-17T18:25:53.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.015+0000 7f724f579700 1 --2- 172.21.15.62:0/1885171847 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f724813e360 0x7f724813e7f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.015+0000 7f724f579700 1 --2- 172.21.15.62:0/1885171847 >> v2:172.21.15.109:3300/0 conn(0x7f72480ad290 0x7f72480ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.015+0000 7f724f579700 1 -- 172.21.15.62:0/1885171847 >> 172.21.15.62:0/1885171847 conn(0x7f724805c750 msgr2=0x7f724805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:53.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.015+0000 7f724f579700 1 -- 172.21.15.62:0/1885171847 shutdown_connections 2021-12-17T18:25:53.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.015+0000 7f724f579700 1 -- 172.21.15.62:0/1885171847 wait complete. 2021-12-17T18:25:53.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.015+0000 7f724f579700 1 Processor -- start 2021-12-17T18:25:53.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.015+0000 7f724f579700 1 -- start start 2021-12-17T18:25:53.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724f579700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72480ad290 0x7f724813bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:53.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724f579700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72480b0b50 0x7f7248064200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:53.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724f579700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f724813e360 0x7f7248136480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:53.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724f579700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724813c3c0 con 0x7f72480b0b50 2021-12-17T18:25:53.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724f579700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7248065c80 con 0x7f72480ad290 2021-12-17T18:25:53.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724f579700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7248065f20 con 0x7f724813e360 2021-12-17T18:25:53.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724dd76700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72480b0b50 0x7f7248064200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:53.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724dd76700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72480b0b50 0x7f7248064200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53904/0 (socket says 172.21.15.62:53904) 2021-12-17T18:25:53.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724dd76700 1 -- 172.21.15.62:0/2817088275 learned_addr learned my addr 172.21.15.62:0/2817088275 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:53.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724e577700 1 --2- 172.21.15.62:0/2817088275 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72480ad290 0x7f724813bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:53.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724ed78700 1 --2- 172.21.15.62:0/2817088275 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f724813e360 0x7f7248136480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:53.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724dd76700 1 -- 172.21.15.62:0/2817088275 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f724813e360 msgr2=0x7f7248136480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:53.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724dd76700 1 --2- 172.21.15.62:0/2817088275 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f724813e360 0x7f7248136480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724dd76700 1 -- 172.21.15.62:0/2817088275 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72480ad290 msgr2=0x7f724813bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:53.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724dd76700 1 --2- 172.21.15.62:0/2817088275 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72480ad290 0x7f724813bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724dd76700 1 -- 172.21.15.62:0/2817088275 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7240009470 con 0x7f72480b0b50 2021-12-17T18:25:53.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724dd76700 1 --2- 172.21.15.62:0/2817088275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72480b0b50 0x7f7248064200 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f723c001110 tx=0x7f723c007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:53.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f723b7fe700 1 -- 172.21.15.62:0/2817088275 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f723c00ce20 con 0x7f72480b0b50 2021-12-17T18:25:53.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f723b7fe700 1 -- 172.21.15.62:0/2817088275 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723c0072e0 con 0x7f72480b0b50 2021-12-17T18:25:53.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724f579700 1 -- 172.21.15.62:0/2817088275 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72480661c0 con 0x7f72480b0b50 2021-12-17T18:25:53.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f723b7fe700 1 -- 172.21.15.62:0/2817088275 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f723c005800 con 0x7f72480b0b50 2021-12-17T18:25:53.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f724f579700 1 -- 172.21.15.62:0/2817088275 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7248066460 con 0x7f72480b0b50 2021-12-17T18:25:53.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.019+0000 7f723b7fe700 1 -- 172.21.15.62:0/2817088275 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f723c010070 con 0x7f72480b0b50 2021-12-17T18:25:53.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.023+0000 7f724f579700 1 -- 172.21.15.62:0/2817088275 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72480b0550 con 0x7f72480b0b50 2021-12-17T18:25:53.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.023+0000 7f723b7fe700 1 --2- 172.21.15.62:0/2817088275 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7228053520 0x7f72280559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:53.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.023+0000 7f723b7fe700 1 -- 172.21.15.62:0/2817088275 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f723c06b070 con 0x7f72480b0b50 2021-12-17T18:25:53.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.023+0000 7f724e577700 1 --2- 172.21.15.62:0/2817088275 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7228053520 0x7f72280559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:53.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.023+0000 7f724e577700 1 --2- 172.21.15.62:0/2817088275 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7228053520 0x7f72280559e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f724400b000 tx=0x7f7244006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:53.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.027+0000 7f723b7fe700 1 -- 172.21.15.62:0/2817088275 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f723c042130 con 0x7f72480b0b50 2021-12-17T18:25:53.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.151+0000 7f724f579700 1 -- 172.21.15.62:0/2817088275 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f72480573d0 con 0x7f72480b0b50 2021-12-17T18:25:53.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.151+0000 7f723b7fe700 1 -- 172.21.15.62:0/2817088275 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+10 (secure 0 0 0) 0x7f723c018070 con 0x7f72480b0b50 2021-12-17T18:25:53.160 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:25:53.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.155+0000 7f724f579700 1 -- 172.21.15.62:0/2817088275 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7228053520 msgr2=0x7f72280559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:53.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.155+0000 7f724f579700 1 --2- 172.21.15.62:0/2817088275 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7228053520 0x7f72280559e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f724400b000 tx=0x7f7244006df0).stop 2021-12-17T18:25:53.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.155+0000 7f724f579700 1 -- 172.21.15.62:0/2817088275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72480b0b50 msgr2=0x7f7248064200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:53.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.155+0000 7f724f579700 1 --2- 172.21.15.62:0/2817088275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72480b0b50 0x7f7248064200 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f723c001110 tx=0x7f723c007ad0).stop 2021-12-17T18:25:53.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.155+0000 7f724f579700 1 -- 172.21.15.62:0/2817088275 shutdown_connections 2021-12-17T18:25:53.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.155+0000 7f724f579700 1 --2- 172.21.15.62:0/2817088275 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7228053520 0x7f72280559e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.155+0000 7f724f579700 1 --2- 172.21.15.62:0/2817088275 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f724813e360 0x7f7248136480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.155+0000 7f724f579700 1 --2- 172.21.15.62:0/2817088275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72480b0b50 0x7f7248064200 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.155+0000 7f724f579700 1 --2- 172.21.15.62:0/2817088275 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72480ad290 0x7f724813bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.155+0000 7f724f579700 1 -- 172.21.15.62:0/2817088275 >> 172.21.15.62:0/2817088275 conn(0x7f724805c750 msgr2=0x7f724813f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:53.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.155+0000 7f724f579700 1 -- 172.21.15.62:0/2817088275 shutdown_connections 2021-12-17T18:25:53.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.155+0000 7f724f579700 1 -- 172.21.15.62:0/2817088275 wait complete. 2021-12-17T18:25:53.173 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:25:53.174 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:53.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.275+0000 7f45f94ea700 1 Processor -- start 2021-12-17T18:25:53.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.275+0000 7f45f94ea700 1 -- start start 2021-12-17T18:25:53.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.275+0000 7f45f94ea700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45f4141480 0x7f45f4147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:53.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.275+0000 7f45f94ea700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f45f40a71e0 0x7f45f40a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:53.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.275+0000 7f45f94ea700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f40b6270 con 0x7f45f40a8e10 2021-12-17T18:25:53.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.275+0000 7f45f94ea700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f4147610 con 0x7f45f40a71e0 2021-12-17T18:25:53.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.275+0000 7f45f94ea700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f41478b0 con 0x7f45f4141480 2021-12-17T18:25:53.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.275+0000 7f45f3fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45f4141480 0x7f45f4147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:53.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.275+0000 7f45f8ce9700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f45f40a71e0 0x7f45f40a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:53.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.275+0000 7f45f37fe700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f45f40a8e10 0x7f45f40b5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:53810/0 (socket says 172.21.15.62:53810) 2021-12-17T18:25:53.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.275+0000 7f45f37fe700 1 -- 172.21.15.62:0/180882564 learned_addr learned my addr 172.21.15.62:0/180882564 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:53.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f2ffd700 1 -- 172.21.15.62:0/180882564 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864542130 0 0) 0x7f45f40b6270 con 0x7f45f40a8e10 2021-12-17T18:25:53.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f2ffd700 1 -- 172.21.15.62:0/180882564 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45e0003260 con 0x7f45f40a8e10 2021-12-17T18:25:53.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f8ce9700 1 -- 172.21.15.62:0/180882564 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45f4141480 msgr2=0x7f45f4147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:53.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f8ce9700 1 --2- 172.21.15.62:0/180882564 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45f4141480 0x7f45f4147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f8ce9700 1 -- 172.21.15.62:0/180882564 >> v1:172.21.15.109:6789/0 conn(0x7f45f40a8e10 legacy=0x7f45f40b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:53.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f8ce9700 1 -- 172.21.15.62:0/180882564 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f4147b50 con 0x7f45f40a71e0 2021-12-17T18:25:53.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f8ce9700 1 --2- 172.21.15.62:0/180882564 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45f40a71e0 0x7f45f40a7900 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f45ec0032f0 tx=0x7f45ec0091d0).ready entity=mon.1 client_cookie=c5e740308ab4bb02 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:53.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f2ffd700 1 -- 172.21.15.62:0/180882564 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45ec00b600 con 0x7f45f40a71e0 2021-12-17T18:25:53.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f2ffd700 1 -- 172.21.15.62:0/180882564 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec00b760 con 0x7f45f40a71e0 2021-12-17T18:25:53.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f2ffd700 1 -- 172.21.15.62:0/180882564 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45ec00b8d0 con 0x7f45f40a71e0 2021-12-17T18:25:53.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f94ea700 1 -- 172.21.15.62:0/180882564 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45f40a71e0 msgr2=0x7f45f40a7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:53.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f94ea700 1 --2- 172.21.15.62:0/180882564 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45f40a71e0 0x7f45f40a7900 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f45ec0032f0 tx=0x7f45ec0091d0).stop 2021-12-17T18:25:53.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f94ea700 1 -- 172.21.15.62:0/180882564 shutdown_connections 2021-12-17T18:25:53.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f94ea700 1 --2- 172.21.15.62:0/180882564 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45f40a71e0 0x7f45f40a7900 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f94ea700 1 --2- 172.21.15.62:0/180882564 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45f4141480 0x7f45f4147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f94ea700 1 -- 172.21.15.62:0/180882564 >> 172.21.15.62:0/180882564 conn(0x7f45f405d220 msgr2=0x7f45f40b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:53.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f94ea700 1 -- 172.21.15.62:0/180882564 shutdown_connections 2021-12-17T18:25:53.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f94ea700 1 -- 172.21.15.62:0/180882564 wait complete. 2021-12-17T18:25:53.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f94ea700 1 Processor -- start 2021-12-17T18:25:53.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.279+0000 7f45f94ea700 1 -- start start 2021-12-17T18:25:53.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f94ea700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f40a71e0 0x7f45f415a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:53.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f94ea700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45f40a8e10 0x7f45f40af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:53.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f94ea700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45f4141480 0x7f45f40a9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:53.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f94ea700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f4141f20 con 0x7f45f40a71e0 2021-12-17T18:25:53.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f94ea700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f41419e0 con 0x7f45f40a8e10 2021-12-17T18:25:53.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f94ea700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f4141c80 con 0x7f45f4141480 2021-12-17T18:25:53.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f40a71e0 0x7f45f415a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:53.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f40a71e0 0x7f45f415a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53916/0 (socket says 172.21.15.62:53916) 2021-12-17T18:25:53.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f3fff700 1 -- 172.21.15.62:0/1062210903 learned_addr learned my addr 172.21.15.62:0/1062210903 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:53.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f37fe700 1 --2- 172.21.15.62:0/1062210903 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45f40a8e10 0x7f45f40af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:53.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f8ce9700 1 --2- 172.21.15.62:0/1062210903 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45f4141480 0x7f45f40a9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:53.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f37fe700 1 -- 172.21.15.62:0/1062210903 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45f4141480 msgr2=0x7f45f40a9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:53.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f37fe700 1 --2- 172.21.15.62:0/1062210903 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45f4141480 0x7f45f40a9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f37fe700 1 -- 172.21.15.62:0/1062210903 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f40a71e0 msgr2=0x7f45f415a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:53.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f37fe700 1 --2- 172.21.15.62:0/1062210903 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f40a71e0 0x7f45f415a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f37fe700 1 -- 172.21.15.62:0/1062210903 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec009470 con 0x7f45f40a8e10 2021-12-17T18:25:53.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f3fff700 1 --2- 172.21.15.62:0/1062210903 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f40a71e0 0x7f45f415a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:53.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f37fe700 1 --2- 172.21.15.62:0/1062210903 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45f40a8e10 0x7f45f40af250 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f45e4001110 tx=0x7f45e40079e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:53.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f17fa700 1 -- 172.21.15.62:0/1062210903 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45e400cd80 con 0x7f45f40a8e10 2021-12-17T18:25:53.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f17fa700 1 -- 172.21.15.62:0/1062210903 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e40070d0 con 0x7f45f40a8e10 2021-12-17T18:25:53.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f94ea700 1 -- 172.21.15.62:0/1062210903 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f40a96d0 con 0x7f45f40a8e10 2021-12-17T18:25:53.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f17fa700 1 -- 172.21.15.62:0/1062210903 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45e4007430 con 0x7f45f40a8e10 2021-12-17T18:25:53.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f94ea700 1 -- 172.21.15.62:0/1062210903 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f40abff0 con 0x7f45f40a8e10 2021-12-17T18:25:53.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.283+0000 7f45f94ea700 1 -- 172.21.15.62:0/1062210903 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f40a9c30 con 0x7f45f40a8e10 2021-12-17T18:25:53.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.287+0000 7f45f17fa700 1 -- 172.21.15.62:0/1062210903 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f45e4010070 con 0x7f45f40a8e10 2021-12-17T18:25:53.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.287+0000 7f45f17fa700 1 --2- 172.21.15.62:0/1062210903 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45d4053580 0x7f45d4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:53.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.287+0000 7f45f17fa700 1 -- 172.21.15.62:0/1062210903 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f45e406ae90 con 0x7f45f40a8e10 2021-12-17T18:25:53.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.287+0000 7f45f3fff700 1 --2- 172.21.15.62:0/1062210903 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45d4053580 0x7f45d4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:53.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.287+0000 7f45f3fff700 1 --2- 172.21.15.62:0/1062210903 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45d4053580 0x7f45d4055a40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f45e800b000 tx=0x7f45e8006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:53.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.295+0000 7f45f17fa700 1 -- 172.21.15.62:0/1062210903 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f45f40a9c30 con 0x7f45f40a8e10 2021-12-17T18:25:53.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.455+0000 7f45f94ea700 1 -- 172.21.15.62:0/1062210903 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45f40a9c30 con 0x7f45f40a8e10 2021-12-17T18:25:53.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.459+0000 7f45f17fa700 1 -- 172.21.15.62:0/1062210903 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f45f40a9c30 con 0x7f45f40a8e10 2021-12-17T18:25:53.465 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:53.465 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":43,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.109:6835/1223620032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1223620032},{"type":"v1","addr":"172.21.15.109:6835","nonce":1223620032}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":42}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:25:45.098870+0000","modified":"2021-12-17T18:25:46.102354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7044":{"gid":7044,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/994270358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":994270358},{"type":"v1","addr":"172.21.15.62:6833","nonce":994270358}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-12-17T18:25:53.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.459+0000 7f45f94ea700 1 -- 172.21.15.62:0/1062210903 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45d4053580 msgr2=0x7f45d4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:53.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.459+0000 7f45f94ea700 1 --2- 172.21.15.62:0/1062210903 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45d4053580 0x7f45d4055a40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f45e800b000 tx=0x7f45e8006df0).stop 2021-12-17T18:25:53.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.459+0000 7f45f94ea700 1 -- 172.21.15.62:0/1062210903 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45f40a8e10 msgr2=0x7f45f40af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:53.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.459+0000 7f45f94ea700 1 --2- 172.21.15.62:0/1062210903 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45f40a8e10 0x7f45f40af250 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f45e4001110 tx=0x7f45e40079e0).stop 2021-12-17T18:25:53.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.459+0000 7f45f94ea700 1 -- 172.21.15.62:0/1062210903 shutdown_connections 2021-12-17T18:25:53.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.459+0000 7f45f94ea700 1 --2- 172.21.15.62:0/1062210903 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45d4053580 0x7f45d4055a40 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.459+0000 7f45f94ea700 1 --2- 172.21.15.62:0/1062210903 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45f4141480 0x7f45f40a9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.459+0000 7f45f94ea700 1 --2- 172.21.15.62:0/1062210903 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45f40a8e10 0x7f45f40af250 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.459+0000 7f45f94ea700 1 --2- 172.21.15.62:0/1062210903 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f40a71e0 0x7f45f415a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:53.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.459+0000 7f45f94ea700 1 -- 172.21.15.62:0/1062210903 >> 172.21.15.62:0/1062210903 conn(0x7f45f405d220 msgr2=0x7f45f40b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:53.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.459+0000 7f45f94ea700 1 -- 172.21.15.62:0/1062210903 shutdown_connections 2021-12-17T18:25:53.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:53.459+0000 7f45f94ea700 1 -- 172.21.15.62:0/1062210903 wait complete. 2021-12-17T18:25:53.471 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 43 2021-12-17T18:25:53.679 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:25:45.098870+0000', 'modified': '2021-12-17T18:25:46.102354+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7044}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7044': {'gid': 7044, 'name': 'a', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/994270358', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 994270358}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 994270358}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:25:53.679 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:25:53.680 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:25:53.795 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":7044,"want_state":"up:active","state":"up:active","rank_uptime":8.6830009019999999,"mdsmap_epoch":43,"osdmap_epoch":92,"osdmap_epoch_barrier":91,"uptime":12.836863817999999} 2021-12-17T18:25:53.796 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 7044, "mdsmap_epoch": 43, "osdmap_epoch": 92, "osdmap_epoch_barrier": 91, "rank_uptime": 8.683000902, "state": "up:active", "uptime": 12.836863818, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:25:53.796 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:25:53.797 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-12-17T18:25:53.797 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi158.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-12-17T18:25:53.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:53.798 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:53.806 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:25:53.820 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:25:53.821 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:25:53.879 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:25:53.880 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:25:53.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:53.881 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:25:53.886 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:25:53.886 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:53.934 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:25:53.953 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:25:53.953 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:25:53.964 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:25:53.965 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:25:53.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:53.966 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:25:54.006 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:2021-12-17T18:25:54.001+0000 7ff5b2a3a080 -1 init, newargv = 0x555dded06040 newargc=9ceph-fuse[14225 2021-12-17T18:25:54.006 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:]: starting ceph client 2021-12-17T18:25:54.017 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14225]: starting fuse 2021-12-17T18:25:55.075 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:25:55.094 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:25:55.094 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:25:55.151 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:25:55.152 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:25:55.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:55.153 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:25:55.159 INFO:teuthology.orchestra.run.smithi158.stdout:52 2021-12-17T18:25:55.159 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:25:55.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:55.161 DEBUG:teuthology.orchestra.run.smithi158:> sudo python3 -c ' 2021-12-17T18:25:55.162 DEBUG:teuthology.orchestra.run.smithi158:> import glob 2021-12-17T18:25:55.163 DEBUG:teuthology.orchestra.run.smithi158:> import re 2021-12-17T18:25:55.164 DEBUG:teuthology.orchestra.run.smithi158:> import os 2021-12-17T18:25:55.165 DEBUG:teuthology.orchestra.run.smithi158:> import subprocess 2021-12-17T18:25:55.165 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:25:55.166 DEBUG:teuthology.orchestra.run.smithi158:> def find_socket(client_name): 2021-12-17T18:25:55.166 DEBUG:teuthology.orchestra.run.smithi158:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-12-17T18:25:55.166 DEBUG:teuthology.orchestra.run.smithi158:> files = glob.glob(asok_path) 2021-12-17T18:25:55.167 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:25:55.167 DEBUG:teuthology.orchestra.run.smithi158:> # Given a non-glob path, it better be there 2021-12-17T18:25:55.168 DEBUG:teuthology.orchestra.run.smithi158:> if "*" not in asok_path: 2021-12-17T18:25:55.168 DEBUG:teuthology.orchestra.run.smithi158:> assert(len(files) == 1) 2021-12-17T18:25:55.169 DEBUG:teuthology.orchestra.run.smithi158:> return files[0] 2021-12-17T18:25:55.170 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:25:55.171 DEBUG:teuthology.orchestra.run.smithi158:> for f in files: 2021-12-17T18:25:55.171 DEBUG:teuthology.orchestra.run.smithi158:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:25:55.172 DEBUG:teuthology.orchestra.run.smithi158:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:25:55.172 DEBUG:teuthology.orchestra.run.smithi158:> return f 2021-12-17T18:25:55.173 DEBUG:teuthology.orchestra.run.smithi158:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:25:55.173 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:25:55.174 DEBUG:teuthology.orchestra.run.smithi158:> print(find_socket("client.1")) 2021-12-17T18:25:55.174 DEBUG:teuthology.orchestra.run.smithi158:> ' 2021-12-17T18:25:55.218 INFO:teuthology.orchestra.run.smithi158.stdout:/var/run/ceph/ceph-client.1.14225.asok 2021-12-17T18:25:55.224 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14225.asok 2021-12-17T18:25:55.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:55.226 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14225.asok status 2021-12-17T18:25:55.356 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2021-12-17T18:25:55.356 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": { 2021-12-17T18:25:55.356 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:25:55.356 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:25:55.357 INFO:teuthology.orchestra.run.smithi158.stdout: "entity_id": "1", 2021-12-17T18:25:55.357 INFO:teuthology.orchestra.run.smithi158.stdout: "hostname": "smithi158", 2021-12-17T18:25:55.357 INFO:teuthology.orchestra.run.smithi158.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-12-17T18:25:55.357 INFO:teuthology.orchestra.run.smithi158.stdout: "pid": "14225", 2021-12-17T18:25:55.358 INFO:teuthology.orchestra.run.smithi158.stdout: "root": "/" 2021-12-17T18:25:55.358 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:25:55.358 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_count": 0, 2021-12-17T18:25:55.358 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_pinned_count": 0, 2021-12-17T18:25:55.359 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 7114, 2021-12-17T18:25:55.359 INFO:teuthology.orchestra.run.smithi158.stdout: "inst": { 2021-12-17T18:25:55.359 INFO:teuthology.orchestra.run.smithi158.stdout: "name": { 2021-12-17T18:25:55.359 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "client", 2021-12-17T18:25:55.359 INFO:teuthology.orchestra.run.smithi158.stdout: "num": 7114 2021-12-17T18:25:55.360 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:25:55.360 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:25:55.360 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:25:55.360 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:25:55.361 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 2239804356 2021-12-17T18:25:55.361 INFO:teuthology.orchestra.run.smithi158.stdout: } 2021-12-17T18:25:55.361 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:25:55.361 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:25:55.362 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:25:55.362 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:25:55.362 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 2239804356 2021-12-17T18:25:55.362 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:25:55.362 INFO:teuthology.orchestra.run.smithi158.stdout: "inst_str": "client.7114 172.21.15.158:0/2239804356", 2021-12-17T18:25:55.363 INFO:teuthology.orchestra.run.smithi158.stdout: "addr_str": "172.21.15.158:0/2239804356", 2021-12-17T18:25:55.363 INFO:teuthology.orchestra.run.smithi158.stdout: "inode_count": 1, 2021-12-17T18:25:55.363 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_epoch": 43, 2021-12-17T18:25:55.363 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch": 92, 2021-12-17T18:25:55.364 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:25:55.364 INFO:teuthology.orchestra.run.smithi158.stdout: "blacklisted": false, 2021-12-17T18:25:55.364 INFO:teuthology.orchestra.run.smithi158.stdout: "fs_name": "cephfs" 2021-12-17T18:25:55.364 INFO:teuthology.orchestra.run.smithi158.stdout:} 2021-12-17T18:25:55.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:55.366 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:55.367 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:55.374 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:25:55.375 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:25:55.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:55.376 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:55.392 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-12-17T18:25:55.393 DEBUG:teuthology.orchestra.run.smithi125:> cd /home/ubuntu/cephtest/mnt.0 && sudo mkdir -p foo 2021-12-17T18:25:55.425 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-12-17T18:25:55.426 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:25:55.426 DEBUG:teuthology.orchestra.run.smithi125:> import stat 2021-12-17T18:25:55.426 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:25:55.427 DEBUG:teuthology.orchestra.run.smithi125:> print(os.stat("/home/ubuntu/cephtest/mnt.0/foo").st_ino) 2021-12-17T18:25:55.427 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:25:55.544 INFO:teuthology.orchestra.run.smithi125.stdout:1099511627776 2021-12-17T18:25:55.735 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:55.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.843+0000 7fb306109700 1 Processor -- start 2021-12-17T18:25:55.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.843+0000 7fb306109700 1 -- start start 2021-12-17T18:25:55.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb306109700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3000b21f0 0x7fb30014aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:55.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb306109700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fb3000b1730 0x7fb3000ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:55.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb306109700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb3000a7bb0 0x7fb300067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:55.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb306109700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb300147870 con 0x7fb3000a7bb0 2021-12-17T18:25:55.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb306109700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3000b2ce0 con 0x7fb3000b1730 2021-12-17T18:25:55.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb306109700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000aca60 con 0x7fb3000b21f0 2021-12-17T18:25:55.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb2fffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb3000a7bb0 0x7fb300067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:55.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb2fffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb3000a7bb0 0x7fb300067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53926/0 (socket says 172.21.15.62:53926) 2021-12-17T18:25:55.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb2fffff700 1 -- 172.21.15.62:0/182053365 learned_addr learned my addr 172.21.15.62:0/182053365 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:55.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb2f6ffd700 1 --2- 172.21.15.62:0/182053365 >> v2:172.21.15.109:3300/0 conn(0x7fb3000b1730 0x7fb3000ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:55.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb2ff7fe700 1 --2- 172.21.15.62:0/182053365 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3000b21f0 0x7fb30014aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:55.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb2fffff700 1 -- 172.21.15.62:0/182053365 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3000b21f0 msgr2=0x7fb30014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:55.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb2fffff700 1 --2- 172.21.15.62:0/182053365 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3000b21f0 0x7fb30014aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:55.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb2fffff700 1 -- 172.21.15.62:0/182053365 >> v2:172.21.15.109:3300/0 conn(0x7fb3000b1730 msgr2=0x7fb3000ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:55.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb2fffff700 1 --2- 172.21.15.62:0/182053365 >> v2:172.21.15.109:3300/0 conn(0x7fb3000b1730 0x7fb3000ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:55.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb2fffff700 1 -- 172.21.15.62:0/182053365 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3000b2f10 con 0x7fb3000a7bb0 2021-12-17T18:25:55.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb2f6ffd700 1 --2- 172.21.15.62:0/182053365 >> v2:172.21.15.109:3300/0 conn(0x7fb3000b1730 0x7fb3000ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:25:55.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb2fffff700 1 --2- 172.21.15.62:0/182053365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3000a7bb0 0x7fb300067120 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7fb2f80032f0 tx=0x7fb2f8009290).ready entity=mon.0 client_cookie=85311d892251f8c4 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:55.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb2feffd700 1 -- 172.21.15.62:0/182053365 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2f800b680 con 0x7fb3000a7bb0 2021-12-17T18:25:55.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb2feffd700 1 -- 172.21.15.62:0/182053365 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f800b7e0 con 0x7fb3000a7bb0 2021-12-17T18:25:55.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb2feffd700 1 -- 172.21.15.62:0/182053365 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2f800b950 con 0x7fb3000a7bb0 2021-12-17T18:25:55.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb306109700 1 -- 172.21.15.62:0/182053365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3000a7bb0 msgr2=0x7fb300067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:55.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb306109700 1 --2- 172.21.15.62:0/182053365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3000a7bb0 0x7fb300067120 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7fb2f80032f0 tx=0x7fb2f8009290).stop 2021-12-17T18:25:55.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb306109700 1 -- 172.21.15.62:0/182053365 shutdown_connections 2021-12-17T18:25:55.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb306109700 1 --2- 172.21.15.62:0/182053365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3000a7bb0 0x7fb300067120 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:55.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb306109700 1 --2- 172.21.15.62:0/182053365 >> v2:172.21.15.109:3300/0 conn(0x7fb3000b1730 0x7fb3000ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:55.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb306109700 1 --2- 172.21.15.62:0/182053365 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3000b21f0 0x7fb30014aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:55.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb306109700 1 -- 172.21.15.62:0/182053365 >> 172.21.15.62:0/182053365 conn(0x7fb30005f730 msgr2=0x7fb30005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:55.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb306109700 1 -- 172.21.15.62:0/182053365 shutdown_connections 2021-12-17T18:25:55.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.847+0000 7fb306109700 1 -- 172.21.15.62:0/182053365 wait complete. 2021-12-17T18:25:55.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb306109700 1 Processor -- start 2021-12-17T18:25:55.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb306109700 1 -- start start 2021-12-17T18:25:55.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb306109700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3000a7bb0 0x7fb300065ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:55.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb306109700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3000b1730 0x7fb300157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:55.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb306109700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3000b21f0 0x7fb300064ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:55.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb306109700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb300066820 con 0x7fb3000b1730 2021-12-17T18:25:55.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb306109700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb300157e30 con 0x7fb3000a7bb0 2021-12-17T18:25:55.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb306109700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb300063c50 con 0x7fb3000b21f0 2021-12-17T18:25:55.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb2f6ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3000b1730 0x7fb300157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:55.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb2ff7fe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3000a7bb0 0x7fb300065ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:55.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb2fffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3000b21f0 0x7fb300064ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:55.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb2ff7fe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3000a7bb0 0x7fb300065ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:60478/0 (socket says 172.21.15.62:60478) 2021-12-17T18:25:55.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb2ff7fe700 1 -- 172.21.15.62:0/3783672196 learned_addr learned my addr 172.21.15.62:0/3783672196 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:55.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb2f6ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3000b1730 0x7fb300157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53930/0 (socket says 172.21.15.62:53930) 2021-12-17T18:25:55.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb2f6ffd700 1 -- 172.21.15.62:0/3783672196 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3000b21f0 msgr2=0x7fb300064ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:55.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb2f6ffd700 1 --2- 172.21.15.62:0/3783672196 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3000b21f0 0x7fb300064ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:55.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb2f6ffd700 1 -- 172.21.15.62:0/3783672196 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3000a7bb0 msgr2=0x7fb300065ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:55.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb2f6ffd700 1 --2- 172.21.15.62:0/3783672196 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3000a7bb0 0x7fb300065ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:55.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb2f6ffd700 1 -- 172.21.15.62:0/3783672196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e800b180 con 0x7fb3000b1730 2021-12-17T18:25:55.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb2f6ffd700 1 --2- 172.21.15.62:0/3783672196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3000b1730 0x7fb300157940 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7fb300157fc0 tx=0x7fb2e8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:55.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb2fd7fa700 1 -- 172.21.15.62:0/3783672196 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2e8010780 con 0x7fb3000b1730 2021-12-17T18:25:55.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb2fd7fa700 1 -- 172.21.15.62:0/3783672196 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e80108e0 con 0x7fb3000b1730 2021-12-17T18:25:55.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb306109700 1 -- 172.21.15.62:0/3783672196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f8009530 con 0x7fb3000b1730 2021-12-17T18:25:55.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb2fd7fa700 1 -- 172.21.15.62:0/3783672196 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2e8010c40 con 0x7fb3000b1730 2021-12-17T18:25:55.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.851+0000 7fb306109700 1 -- 172.21.15.62:0/3783672196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3000644c0 con 0x7fb3000b1730 2021-12-17T18:25:55.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.855+0000 7fb306109700 1 -- 172.21.15.62:0/3783672196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb300065580 con 0x7fb3000b1730 2021-12-17T18:25:55.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.855+0000 7fb2fd7fa700 1 -- 172.21.15.62:0/3783672196 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb2e801c460 con 0x7fb3000b1730 2021-12-17T18:25:55.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.855+0000 7fb2fd7fa700 1 --2- 172.21.15.62:0/3783672196 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2e4053610 0x7fb2e4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:55.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.855+0000 7fb2fd7fa700 1 -- 172.21.15.62:0/3783672196 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb2e806bed0 con 0x7fb3000b1730 2021-12-17T18:25:55.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.855+0000 7fb2ff7fe700 1 --2- 172.21.15.62:0/3783672196 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2e4053610 0x7fb2e4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:55.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.855+0000 7fb2ff7fe700 1 --2- 172.21.15.62:0/3783672196 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2e4053610 0x7fb2e4055ad0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fb2f000b000 tx=0x7fb2f0006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:55.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:55.863+0000 7fb2fd7fa700 1 -- 172.21.15.62:0/3783672196 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb2e8042e40 con 0x7fb3000b1730 2021-12-17T18:25:56.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.027+0000 7fb306109700 1 -- 172.21.15.62:0/3783672196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3001576e0 con 0x7fb3000b1730 2021-12-17T18:25:56.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.031+0000 7fb2fd7fa700 1 -- 172.21.15.62:0/3783672196 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fb2e8046460 con 0x7fb3000b1730 2021-12-17T18:25:56.037 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:56.037 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":43,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.109:6835/1223620032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1223620032},{"type":"v1","addr":"172.21.15.109:6835","nonce":1223620032}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":42}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:25:45.098870+0000","modified":"2021-12-17T18:25:46.102354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7044":{"gid":7044,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/994270358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":994270358},{"type":"v1","addr":"172.21.15.62:6833","nonce":994270358}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-12-17T18:25:56.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.031+0000 7fb306109700 1 -- 172.21.15.62:0/3783672196 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2e4053610 msgr2=0x7fb2e4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:56.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.031+0000 7fb306109700 1 --2- 172.21.15.62:0/3783672196 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2e4053610 0x7fb2e4055ad0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fb2f000b000 tx=0x7fb2f0006df0).stop 2021-12-17T18:25:56.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.031+0000 7fb306109700 1 -- 172.21.15.62:0/3783672196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3000b1730 msgr2=0x7fb300157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:56.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.031+0000 7fb306109700 1 --2- 172.21.15.62:0/3783672196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3000b1730 0x7fb300157940 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7fb300157fc0 tx=0x7fb2e8006df0).stop 2021-12-17T18:25:56.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.031+0000 7fb306109700 1 -- 172.21.15.62:0/3783672196 shutdown_connections 2021-12-17T18:25:56.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.031+0000 7fb306109700 1 --2- 172.21.15.62:0/3783672196 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2e4053610 0x7fb2e4055ad0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:56.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.031+0000 7fb306109700 1 --2- 172.21.15.62:0/3783672196 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3000b21f0 0x7fb300064ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:56.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.031+0000 7fb306109700 1 --2- 172.21.15.62:0/3783672196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3000b1730 0x7fb300157940 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:56.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.031+0000 7fb306109700 1 --2- 172.21.15.62:0/3783672196 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3000a7bb0 0x7fb300065ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:56.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.031+0000 7fb306109700 1 -- 172.21.15.62:0/3783672196 >> 172.21.15.62:0/3783672196 conn(0x7fb30005f730 msgr2=0x7fb3000b3610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:56.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.031+0000 7fb306109700 1 -- 172.21.15.62:0/3783672196 shutdown_connections 2021-12-17T18:25:56.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.031+0000 7fb306109700 1 -- 172.21.15.62:0/3783672196 wait complete. 2021-12-17T18:25:56.046 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 43 2021-12-17T18:25:56.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 0x10000000000 2021-12-17T18:25:56.157 INFO:teuthology.orchestra.run.smithi062.stdout:{"path":"/foo","ino":1099511627776,"rdev":0,"ctime":"2021-12-17T18:25:55.414722+0000","btime":"2021-12-17T18:25:55.414722+0000","mode":16877,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-12-17T18:25:55.414722+0000","atime":"2021-12-17T18:25:55.414722+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":7069,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":7069,"want_loner":7069,"mds_caps_wanted":[]} 2021-12-17T18:25:56.159 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2021-12-17T18:25:55.414722+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "backtrace_version": 2, "btime": "2021-12-17T18:25:55.414722+0000", "change_attr": 0, "client_caps": [ { "client_id": 7069, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-12-17T18:25:55.414722+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "flocklock": {}, "gid": 0, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 7069, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2021-12-17T18:25:55.414722+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/foo", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 0, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": 7069, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "xattrs": [] } 2021-12-17T18:25:56.160 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:25:56.161 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:56.182 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:56.204 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:56.226 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:56.247 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:25:56.268 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:25:56.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:56.269 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:56.270 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:56.278 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:25:56.280 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:25:56.280 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:25:56.281 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:25:56.282 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:56.297 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14766]: fuse finished with error 0 and tester_r 0 2021-12-17T18:25:56.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:56.299 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:56.300 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:56.350 INFO:teuthology.orchestra.run.smithi125.stdout:ext2/ext3 2021-12-17T18:25:56.351 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:25:56.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:25:56.452 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:25:56.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:56.461 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:56.462 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:56.470 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:25:56.471 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:25:56.471 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi158.front.sepia.ceph.com... 2021-12-17T18:25:56.472 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:25:56.472 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:56.526 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14225]: fuse finished with error 0 and tester_r 0 2021-12-17T18:25:56.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:56.529 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:56.530 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:56.538 INFO:teuthology.orchestra.run.smithi158.stdout:ext2/ext3 2021-12-17T18:25:56.539 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:25:56.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:25:56.602 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:25:56.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:25:56.610 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:25:56.610 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:25:56.617 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:25:56.618 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:25:56.619 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:25:56.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:25:56.620 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:25:56.627 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:25:56.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:25:56.628 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:25:56.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.735+0000 7f2e22e32700 1 Processor -- start 2021-12-17T18:25:56.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.735+0000 7f2e22e32700 1 -- start start 2021-12-17T18:25:56.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.735+0000 7f2e22e32700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e1c0682c0 0x7f2e1c0abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:56.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.735+0000 7f2e22e32700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c0b6280 con 0x7f2e1c0aeaa0 2021-12-17T18:25:56.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.735+0000 7f2e22e32700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c145190 con 0x7f2e1c0b5ea0 2021-12-17T18:25:56.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.735+0000 7f2e22e32700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c0af090 con 0x7f2e1c0682c0 2021-12-17T18:25:56.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.735+0000 7f2e22631700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2e1c0aeaa0 0x7f2e1c142500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37520/0 (socket says 172.21.15.62:37520) 2021-12-17T18:25:56.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.735+0000 7f2e22631700 1 -- 172.21.15.62:0/396974464 learned_addr learned my addr 172.21.15.62:0/396974464 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:56.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.735+0000 7f2e2162f700 1 --2- 172.21.15.62:0/396974464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e1c0682c0 0x7f2e1c0abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:56.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.735+0000 7f2e20e2e700 1 -- 172.21.15.62:0/396974464 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88982787 0 0) 0x7f2e1c0b6280 con 0x7f2e1c0aeaa0 2021-12-17T18:25:56.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.735+0000 7f2e20e2e700 1 -- 172.21.15.62:0/396974464 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e04003260 con 0x7f2e1c0aeaa0 2021-12-17T18:25:56.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.735+0000 7f2e20e2e700 1 -- 172.21.15.62:0/396974464 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264595385 0 0) 0x7f2e1c145190 con 0x7f2e1c0b5ea0 2021-12-17T18:25:56.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.735+0000 7f2e20e2e700 1 -- 172.21.15.62:0/396974464 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e1c0b6280 con 0x7f2e1c0b5ea0 2021-12-17T18:25:56.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.735+0000 7f2e2162f700 1 -- 172.21.15.62:0/396974464 >> v1:172.21.15.109:6789/0 conn(0x7f2e1c0b5ea0 legacy=0x7f2e1c0b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:56.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.735+0000 7f2e2162f700 1 -- 172.21.15.62:0/396974464 >> v1:172.21.15.62:6789/0 conn(0x7f2e1c0aeaa0 legacy=0x7f2e1c142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:56.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.735+0000 7f2e2162f700 1 -- 172.21.15.62:0/396974464 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c145430 con 0x7f2e1c0682c0 2021-12-17T18:25:56.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.735+0000 7f2e2162f700 1 --2- 172.21.15.62:0/396974464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e1c0682c0 0x7f2e1c0abb10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f2e18002f70 tx=0x7f2e18006df0).ready entity=mon.2 client_cookie=e24c8eeb97478cd6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:56.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e20e2e700 1 -- 172.21.15.62:0/396974464 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e1800d5c0 con 0x7f2e1c0682c0 2021-12-17T18:25:56.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e20e2e700 1 -- 172.21.15.62:0/396974464 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e18000e90 con 0x7f2e1c0682c0 2021-12-17T18:25:56.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e20e2e700 1 -- 172.21.15.62:0/396974464 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e1800d910 con 0x7f2e1c0682c0 2021-12-17T18:25:56.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22e32700 1 -- 172.21.15.62:0/396974464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e1c0682c0 msgr2=0x7f2e1c0abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:56.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22e32700 1 --2- 172.21.15.62:0/396974464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e1c0682c0 0x7f2e1c0abb10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f2e18002f70 tx=0x7f2e18006df0).stop 2021-12-17T18:25:56.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22e32700 1 -- 172.21.15.62:0/396974464 shutdown_connections 2021-12-17T18:25:56.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22e32700 1 --2- 172.21.15.62:0/396974464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e1c0682c0 0x7f2e1c0abb10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:56.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22e32700 1 -- 172.21.15.62:0/396974464 >> 172.21.15.62:0/396974464 conn(0x7f2e1c05d220 msgr2=0x7f2e1c0b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:56.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22e32700 1 -- 172.21.15.62:0/396974464 shutdown_connections 2021-12-17T18:25:56.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22e32700 1 -- 172.21.15.62:0/396974464 wait complete. 2021-12-17T18:25:56.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22e32700 1 Processor -- start 2021-12-17T18:25:56.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22e32700 1 -- start start 2021-12-17T18:25:56.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22e32700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2e1c0682c0 0x7f2e1c0b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:56.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22e32700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e1c0aeaa0 0x7f2e1c13eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:56.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22e32700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e1c0b5ea0 0x7f2e1c13f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:56.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22e32700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c066410 con 0x7f2e1c0b5ea0 2021-12-17T18:25:56.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22e32700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c065a30 con 0x7f2e1c0682c0 2021-12-17T18:25:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22e32700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c065cd0 con 0x7f2e1c0aeaa0 2021-12-17T18:25:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22631700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e1c0b5ea0 0x7f2e1c13f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22631700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e1c0b5ea0 0x7f2e1c13f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53946/0 (socket says 172.21.15.62:53946) 2021-12-17T18:25:56.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e22631700 1 -- 172.21.15.62:0/106762806 learned_addr learned my addr 172.21.15.62:0/106762806 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e2162f700 1 --2- 172.21.15.62:0/106762806 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e1c0aeaa0 0x7f2e1c13eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.739+0000 7f2e21e30700 1 --2- 172.21.15.62:0/106762806 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2e1c0682c0 0x7f2e1c0b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.743+0000 7f2e22631700 1 -- 172.21.15.62:0/106762806 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e1c0aeaa0 msgr2=0x7f2e1c13eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.743+0000 7f2e22631700 1 --2- 172.21.15.62:0/106762806 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e1c0aeaa0 0x7f2e1c13eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.743+0000 7f2e22631700 1 -- 172.21.15.62:0/106762806 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2e1c0682c0 msgr2=0x7f2e1c0b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.743+0000 7f2e22631700 1 --2- 172.21.15.62:0/106762806 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2e1c0682c0 0x7f2e1c0b49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.743+0000 7f2e22631700 1 -- 172.21.15.62:0/106762806 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1800b180 con 0x7f2e1c0b5ea0 2021-12-17T18:25:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.743+0000 7f2e22631700 1 --2- 172.21.15.62:0/106762806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e1c0b5ea0 0x7f2e1c13f090 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f2e14001490 tx=0x7f2e14007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:56.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.743+0000 7f2e0affd700 1 -- 172.21.15.62:0/106762806 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e14005c70 con 0x7f2e1c0b5ea0 2021-12-17T18:25:56.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.743+0000 7f2e0affd700 1 -- 172.21.15.62:0/106762806 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e14005dd0 con 0x7f2e1c0b5ea0 2021-12-17T18:25:56.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.743+0000 7f2e22e32700 1 -- 172.21.15.62:0/106762806 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1c065f70 con 0x7f2e1c0b5ea0 2021-12-17T18:25:56.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.743+0000 7f2e0affd700 1 -- 172.21.15.62:0/106762806 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e140072c0 con 0x7f2e1c0b5ea0 2021-12-17T18:25:56.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.743+0000 7f2e22e32700 1 -- 172.21.15.62:0/106762806 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1c065590 con 0x7f2e1c0b5ea0 2021-12-17T18:25:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.743+0000 7f2e22e32700 1 -- 172.21.15.62:0/106762806 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1c064330 con 0x7f2e1c0b5ea0 2021-12-17T18:25:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.743+0000 7f2e0affd700 1 -- 172.21.15.62:0/106762806 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2e14010070 con 0x7f2e1c0b5ea0 2021-12-17T18:25:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.743+0000 7f2e0affd700 1 --2- 172.21.15.62:0/106762806 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2dfc053610 0x7f2dfc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.743+0000 7f2e0affd700 1 -- 172.21.15.62:0/106762806 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2e1406b490 con 0x7f2e1c0b5ea0 2021-12-17T18:25:56.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.743+0000 7f2e21e30700 1 --2- 172.21.15.62:0/106762806 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2dfc053610 0x7f2dfc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:56.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.747+0000 7f2e21e30700 1 --2- 172.21.15.62:0/106762806 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2dfc053610 0x7f2dfc055ad0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f2e0c00d000 tx=0x7f2e0c007a00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:56.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.751+0000 7f2e0affd700 1 -- 172.21.15.62:0/106762806 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2e1c064330 con 0x7f2e1c0b5ea0 2021-12-17T18:25:56.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.879+0000 7f2e22e32700 1 -- 172.21.15.62:0/106762806 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2e1c066100 con 0x7f2e1c0b5ea0 2021-12-17T18:25:56.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.883+0000 7f2e0affd700 1 -- 172.21.15.62:0/106762806 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v92) v1 ==== 81+0+33696 (secure 0 0 0) 0x7f2e14042550 con 0x7f2e1c0b5ea0 2021-12-17T18:25:56.889 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:56.889 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:25:56.889 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 92, 2021-12-17T18:25:56.890 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:25:56.890 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:25:56.890 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:25:47.114772+0000", 2021-12-17T18:25:56.890 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:25:56.891 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:25:56.891 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:25:56.891 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:25:56.892 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:25:56.892 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:25:56.892 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:25:56.892 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:25:56.893 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:25:56.893 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:56.893 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:25:56.893 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:25:56.893 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:25:56.894 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:25:56.894 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:25:56.894 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 18, 2021-12-17T18:25:56.894 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:25:56.895 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:25:56.895 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:25:56.895 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:25:56.895 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:25:56.896 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.896 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:25:56.896 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:25:56.896 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:25:56.896 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:25:56.897 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:25:56.897 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:25:56.897 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:25:56.897 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:25:56.898 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:25:56.898 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:25:56.898 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:25:56.898 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:25:56.899 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:25:56.899 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:25:56.899 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:25:56.899 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:25:56.900 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:25:56.900 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:25:56.900 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:25:56.900 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:25:56.901 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:25:56.901 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:25:56.901 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:25:56.901 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.901 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:25:56.902 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:25:56.902 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:25:56.902 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:25:56.903 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:25:56.903 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:25:56.903 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:25:56.903 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:25:56.904 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:25:56.904 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:25:56.904 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:25:56.904 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:25:56.905 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:25:56.905 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:25:56.905 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:25:56.905 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:25:56.906 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:25:56.906 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:25:56.906 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:25:56.906 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:25:56.906 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:25:56.907 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:25:56.907 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:25:56.907 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:25:56.907 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:25:56.908 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:25:56.908 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:25:56.908 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.908 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:25:56.908 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:25:56.909 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:25:56.909 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:25:56.909 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:25:56.909 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:25:56.910 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:25:56.910 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:25:56.910 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:25:56.910 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:25:56.911 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:25:56.911 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:25:56.911 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:25:56.911 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.911 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:25:56.912 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:25:56.912 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:56.912 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.912 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.913 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:25:56.913 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:25:56.913 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:25:56.913 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:25:56.914 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:25:56.914 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:25:56.914 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:25:56.915 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:25:56.915 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:25:56.915 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:25:56.915 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:25:56.916 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:25:56.916 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:25:56.916 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:25:56.916 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:25:56.917 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:25:56.917 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:25:56.917 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:25:56.917 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:25:56.917 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:25:56.918 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:25:56.918 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:25:56.918 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:25:56.918 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.919 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:25:56.919 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:25:56.919 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:25:56.919 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:25:56.919 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:25:56.920 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:25:56.920 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:25:56.920 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:25:56.920 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:25:56.921 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:25:56.921 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:25:56.921 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:25:56.921 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:25:56.921 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:25:56.922 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:25:56.922 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:25:56.922 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:25:56.922 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:25:56.923 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:25:56.923 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:25:56.923 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:25:56.923 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:25:56.923 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:25:56.924 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:25:56.924 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:25:56.924 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:25:56.924 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:25:56.925 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.925 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:25:56.925 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:25:56.925 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:25:56.925 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:25:56.926 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:25:56.926 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:25:56.926 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:25:56.926 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:25:56.927 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:25:56.927 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:25:56.927 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:25:56.927 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:25:56.927 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:25:56.928 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:25:56.928 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:56.928 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.928 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.929 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 17, 2021-12-17T18:25:56.929 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2021-12-17T18:25:56.929 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:25:43.705181+0000", 2021-12-17T18:25:56.929 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:25:56.929 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:25:56.930 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:25:56.930 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:25:56.930 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:25:56.930 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:25:56.930 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:25:56.931 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:25:56.931 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:25:56.931 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:25:56.932 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:25:56.932 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:25:56.932 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:25:56.932 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:25:56.933 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:25:56.933 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:25:56.933 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:25:56.933 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:25:56.933 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:25:56.934 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:25:56.934 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.934 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "90", 2021-12-17T18:25:56.934 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:25:56.935 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:25:56.935 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:25:56.935 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:25:56.936 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:25:56.936 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:25:56.936 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:25:56.936 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:25:56.937 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:25:56.937 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:25:56.937 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:25:56.937 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:25:56.937 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:25:56.938 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:25:56.938 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:25:56.938 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:25:56.938 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:25:56.939 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:25:56.939 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:25:56.939 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:25:56.939 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:25:56.939 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:25:56.940 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:25:56.940 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:25:56.940 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:25:56.940 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:25:56.941 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.941 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:25:56.941 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:25:56.941 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:25:56.941 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:25:56.942 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:25:56.942 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:25:56.942 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:25:56.942 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:25:56.943 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:25:56.943 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:25:56.943 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:25:56.943 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:25:56.943 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2021-12-17T18:25:56.944 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2021-12-17T18:25:56.944 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2021-12-17T18:25:56.944 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.944 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:25:56.945 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:25:56.945 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2021-12-17T18:25:56.945 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:56.945 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:56.945 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.946 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.946 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 18, 2021-12-17T18:25:56.946 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2021-12-17T18:25:56.946 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:25:44.085619+0000", 2021-12-17T18:25:56.947 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:25:56.947 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:25:56.947 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:25:56.947 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:25:56.947 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:25:56.948 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:25:56.948 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:25:56.948 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:25:56.948 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:25:56.949 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:25:56.949 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:25:56.949 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:25:56.949 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:25:56.949 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:25:56.950 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:25:56.950 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:25:56.950 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:25:56.950 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:25:56.950 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:25:56.951 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:25:56.951 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.951 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "92", 2021-12-17T18:25:56.951 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:25:56.952 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:25:56.952 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:25:56.952 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:25:56.952 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:25:56.952 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:25:56.953 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:25:56.953 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:25:56.953 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:25:56.953 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:25:56.954 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:25:56.954 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:25:56.954 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:25:56.954 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:25:56.954 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:25:56.955 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:25:56.955 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:25:56.955 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:25:56.955 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:25:56.955 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:25:56.956 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:25:56.956 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:25:56.956 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:25:56.956 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:25:56.957 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:25:56.957 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:25:56.957 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.957 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:25:56.957 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:25:56.958 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:25:56.958 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:25:56.958 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:25:56.958 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:25:56.959 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:25:56.959 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:25:56.959 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:25:56.959 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:25:56.959 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:25:56.960 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:25:56.960 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:25:56.960 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:25:56.960 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2021-12-17T18:25:56.960 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:56.961 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:56.961 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:56.961 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:56.961 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:25:56.962 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.962 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:25:56.962 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:25:56.962 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:56.962 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:56.963 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:56.963 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:56.963 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:56.963 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:56.964 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:56.964 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 88, 2021-12-17T18:25:56.964 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:56.964 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:56.964 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:56.965 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:56.965 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.965 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:56.965 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:25:56.965 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:56.966 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.966 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.966 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:56.966 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:25:56.967 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:56.967 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:56.967 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:56.967 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.967 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:56.968 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:56.968 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.968 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:56.968 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:25:56.968 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:56.969 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.969 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.969 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:56.969 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:25:56.970 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:56.970 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:56.970 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:56.970 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.970 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:56.971 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:56.971 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.971 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:56.971 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:25:56.972 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:56.972 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.972 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.972 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:56.972 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:25:56.973 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:56.973 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:56.973 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:56.973 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.973 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:56.974 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:56.974 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.974 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:56.974 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:25:56.975 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:56.975 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.975 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.975 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:56.976 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:25:56.976 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:25:56.976 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:56.976 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:56.976 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.977 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:25:56.977 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:25:56.977 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:25:56.977 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:25:56.977 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:56.978 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:56.978 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:56.978 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:56.978 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.979 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.979 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:25:56.979 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:25:56.979 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:56.979 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:56.980 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:56.980 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:56.980 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:56.980 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:56.981 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:56.981 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 88, 2021-12-17T18:25:56.981 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:56.981 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:56.981 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:56.982 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:56.982 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.982 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:56.982 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:25:56.982 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:56.983 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.983 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.983 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:56.983 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:25:56.984 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:56.984 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:56.984 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:56.984 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.984 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:56.985 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:56.985 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.985 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:56.985 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:25:56.985 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:56.986 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.986 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.986 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:56.986 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:25:56.987 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:56.987 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:56.987 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:56.987 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.987 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:56.988 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:56.988 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.988 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:56.988 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:25:56.989 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:56.989 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.989 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.989 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:56.989 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:25:56.990 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:56.990 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:56.990 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:56.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.991 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:56.991 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:56.991 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.991 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:56.991 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:25:56.992 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:56.992 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.992 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.992 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:56.993 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:25:56.993 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:25:56.993 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:56.993 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:56.993 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.994 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:25:56.994 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:25:56.994 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:25:56.994 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:25:56.995 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:56.995 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:56.995 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:56.995 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:56.995 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:56.996 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.996 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:25:56.996 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:25:56.996 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:56.997 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:56.997 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:56.997 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:56.997 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:56.997 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:56.998 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:56.998 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 89, 2021-12-17T18:25:56.998 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:56.998 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:56.999 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:56.999 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:56.999 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:56.999 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:56.999 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:25:57.000 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:57.000 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.000 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.000 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.000 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:25:57.001 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:57.001 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.001 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.001 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.002 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:57.002 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.002 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.002 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.003 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:25:57.003 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:57.003 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.003 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.003 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.004 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:25:57.004 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:57.004 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.004 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.005 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.005 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:57.005 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.005 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.005 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.006 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:25:57.006 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:57.006 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.006 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.007 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.007 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:25:57.007 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:57.007 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.007 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.008 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.008 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:57.008 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.008 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.009 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.009 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:25:57.009 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:57.009 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.009 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.010 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.010 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:25:57.010 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:25:57.010 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.011 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.011 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.011 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:25:57.011 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:25:57.011 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:25:57.012 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:25:57.012 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:57.012 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:57.012 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:57.012 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.013 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.013 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.013 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:25:57.013 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:25:57.014 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:57.014 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:57.014 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:57.014 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:57.014 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:57.015 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:57.015 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:57.015 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 90, 2021-12-17T18:25:57.015 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:57.016 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:57.016 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:57.016 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.016 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.016 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.017 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:25:57.017 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:57.017 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.017 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.017 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.018 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:25:57.018 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:57.018 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.018 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.019 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.019 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:57.019 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.019 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.019 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.020 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:25:57.020 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:57.020 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.020 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.021 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.021 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:25:57.021 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:57.021 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.021 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.022 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.022 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:57.022 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.022 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.022 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.023 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:25:57.023 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:57.023 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.023 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.024 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.024 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:25:57.024 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:57.024 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.024 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.025 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.025 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:57.025 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.025 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.026 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.026 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:25:57.026 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:57.026 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.026 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.027 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.027 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:25:57.027 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:25:57.027 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.028 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.028 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.028 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:25:57.028 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:25:57.028 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:25:57.029 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:25:57.029 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:57.029 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:57.029 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:57.029 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.030 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.030 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.030 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:25:57.030 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:25:57.031 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:57.031 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:57.031 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:57.031 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:57.031 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:57.032 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:57.032 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:57.032 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 87, 2021-12-17T18:25:57.032 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:57.033 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:57.033 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:57.033 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.033 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.033 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.034 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:25:57.034 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:57.034 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.034 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.035 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.035 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:25:57.035 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:57.035 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.035 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.036 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.036 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:57.036 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.036 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.037 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.037 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:25:57.037 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:57.037 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.037 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.038 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.038 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:25:57.038 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:57.038 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.039 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.039 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.039 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:57.039 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.039 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.040 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.040 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:25:57.040 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:57.040 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.041 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.041 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.041 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:25:57.041 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:57.041 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.042 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.042 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.042 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:57.042 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.043 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.043 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.043 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:25:57.043 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:57.043 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.044 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.044 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.044 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:25:57.044 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:25:57.045 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.045 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.045 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.045 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:25:57.045 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:25:57.046 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:25:57.046 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:25:57.046 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:57.046 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:57.047 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:57.047 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.047 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.047 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.047 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:25:57.048 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:25:57.048 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:57.048 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:57.048 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:57.048 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:57.049 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:57.049 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:57.049 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:57.049 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 79, 2021-12-17T18:25:57.050 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:57.050 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:57.050 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:57.050 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.050 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.051 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.051 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:25:57.051 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:57.051 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.052 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.052 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.052 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:25:57.052 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:57.052 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.053 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.053 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.053 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:57.053 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.054 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.054 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.054 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:25:57.054 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:57.054 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.055 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.055 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.055 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:25:57.055 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:57.056 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.056 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.056 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.056 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:57.056 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.057 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.057 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.057 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:25:57.057 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:57.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.058 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.058 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.058 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:25:57.059 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:57.059 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.059 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.059 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.059 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:57.060 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.060 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.060 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.060 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:25:57.061 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:57.061 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.061 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.061 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.062 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:25:57.062 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:25:57.062 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.062 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.062 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.063 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:25:57.063 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:25:57.063 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:25:57.063 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:25:57.064 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:57.064 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:57.064 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:57.064 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.065 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.065 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:25:57.065 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:25:57.065 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:57.066 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:57.066 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:57.066 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:57.066 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:57.067 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:57.067 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:57.067 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 87, 2021-12-17T18:25:57.067 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:57.067 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:57.068 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:57.068 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.068 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.068 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.069 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:25:57.069 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:57.069 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.069 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.069 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.070 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:25:57.070 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:57.070 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.070 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.071 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.071 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:57.071 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.071 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.071 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.072 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:25:57.072 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:57.072 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.072 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.073 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.073 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:25:57.073 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:57.073 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.074 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.074 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:57.074 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.075 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.075 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.075 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:25:57.075 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:57.075 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.076 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.076 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.076 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:25:57.076 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:57.077 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.077 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.077 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.077 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:57.077 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.078 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.078 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.078 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:25:57.078 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:57.079 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.079 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.079 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.079 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:25:57.079 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:25:57.080 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.080 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.080 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.080 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:25:57.081 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:25:57.081 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:25:57.081 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:25:57.081 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:57.081 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:57.082 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:57.082 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.082 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.082 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.082 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:25:57.083 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:25:57.083 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:25:57.083 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:25:57.083 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:25:57.084 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:25:57.084 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:25:57.084 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:25:57.084 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:25:57.084 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 88, 2021-12-17T18:25:57.085 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:25:57.085 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:25:57.085 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:25:57.085 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.086 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.086 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.086 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:25:57.086 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:57.086 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.087 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.087 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.087 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:25:57.087 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:57.087 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.088 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.088 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.088 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:25:57.088 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.089 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.089 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.089 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:25:57.089 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:57.089 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.090 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.090 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.090 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:25:57.090 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:57.091 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.091 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.091 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.091 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:25:57.091 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.092 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.092 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.092 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:25:57.092 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:57.093 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.093 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.093 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.093 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:25:57.093 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:57.094 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.094 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.094 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.094 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:25:57.095 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:25:57.095 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.095 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:25:57.095 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:25:57.095 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:57.096 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.096 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.096 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:25:57.096 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:25:57.097 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:25:57.097 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.097 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.097 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.097 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:25:57.098 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:25:57.098 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:25:57.098 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:25:57.098 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:25:57.098 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:25:57.099 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:25:57.099 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:25:57.099 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.099 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:57.100 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:25:57.100 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.100 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:25:57.100 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:57.100 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:57.101 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:57.101 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:57.101 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:57.101 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:25:57.102 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:57.102 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.102 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.102 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:25:57.102 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:57.103 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:57.103 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:57.103 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:57.103 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:57.104 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:25:57.104 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:57.104 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.104 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.104 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:25:57.105 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:57.105 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:57.105 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:57.105 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:57.106 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:57.106 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:25:57.106 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:57.106 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.107 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.107 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:25:57.107 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:57.107 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:57.107 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:57.108 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:57.108 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:57.108 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:25:57.108 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:57.108 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.109 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.109 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:25:57.109 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:57.109 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:57.110 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:57.110 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:57.110 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:57.110 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:25:57.110 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:57.111 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.111 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.111 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:25:57.111 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:57.112 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:57.112 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:57.112 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:57.112 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:57.112 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:25:57.113 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:57.113 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.113 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.113 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:25:57.113 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:57.114 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:57.114 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:57.114 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:57.114 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:57.115 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:25:57.115 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:57.115 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.115 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:25:57.115 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:25:57.116 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:25:57.116 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:25:57.116 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:25:57.116 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:25:57.117 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:25:57.117 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:25:57.117 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:25:57.117 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.117 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:25:57.118 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:25:57.118 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:25:57.118 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:25:57.118 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:25:57.119 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": {}, 2021-12-17T18:25:57.119 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:25:57.119 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:25:57.119 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:25:57.119 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:25:57.120 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:25:57.120 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:25:57.120 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:25:57.120 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:25:57.121 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:25:57.121 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:25:57.121 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:25:57.121 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:25:57.121 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:25:57.122 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:25:57.122 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:25:57.122 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:25:57.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.883+0000 7f2e22e32700 1 -- 172.21.15.62:0/106762806 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2dfc053610 msgr2=0x7f2dfc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:57.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.883+0000 7f2e22e32700 1 --2- 172.21.15.62:0/106762806 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2dfc053610 0x7f2dfc055ad0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f2e0c00d000 tx=0x7f2e0c007a00).stop 2021-12-17T18:25:57.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.883+0000 7f2e22e32700 1 -- 172.21.15.62:0/106762806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e1c0b5ea0 msgr2=0x7f2e1c13f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:57.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.883+0000 7f2e22e32700 1 --2- 172.21.15.62:0/106762806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e1c0b5ea0 0x7f2e1c13f090 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f2e14001490 tx=0x7f2e14007e00).stop 2021-12-17T18:25:57.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.883+0000 7f2e22e32700 1 -- 172.21.15.62:0/106762806 shutdown_connections 2021-12-17T18:25:57.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.883+0000 7f2e22e32700 1 --2- 172.21.15.62:0/106762806 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2dfc053610 0x7f2dfc055ad0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.883+0000 7f2e22e32700 1 --2- 172.21.15.62:0/106762806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e1c0b5ea0 0x7f2e1c13f090 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.883+0000 7f2e22e32700 1 --2- 172.21.15.62:0/106762806 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2e1c0aeaa0 0x7f2e1c13eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.883+0000 7f2e22e32700 1 --2- 172.21.15.62:0/106762806 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2e1c0682c0 0x7f2e1c0b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.883+0000 7f2e22e32700 1 -- 172.21.15.62:0/106762806 >> 172.21.15.62:0/106762806 conn(0x7f2e1c05d220 msgr2=0x7f2e1c0ab8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:57.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.883+0000 7f2e22e32700 1 -- 172.21.15.62:0/106762806 shutdown_connections 2021-12-17T18:25:57.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:56.883+0000 7f2e22e32700 1 -- 172.21.15.62:0/106762806 wait complete. 2021-12-17T18:25:57.128 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:57.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.231+0000 7f6f0f59e700 1 Processor -- start 2021-12-17T18:25:57.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.231+0000 7f6f0f59e700 1 -- start start 2021-12-17T18:25:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0f59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6f100a8e10 0x7f6f10147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0f59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6f100a71e0 0x7f6f100a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0f59e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f100b6270 con 0x7f6f10141480 2021-12-17T18:25:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0f59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f10147610 con 0x7f6f100a8e10 2021-12-17T18:25:57.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0f59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f101478b0 con 0x7f6f100a71e0 2021-12-17T18:25:57.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0dd9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6f100a8e10 0x7f6f10147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:57.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0dd9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6f100a8e10 0x7f6f10147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53950/0 (socket says 172.21.15.62:53950) 2021-12-17T18:25:57.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0dd9b700 1 -- 172.21.15.62:0/1206860931 learned_addr learned my addr 172.21.15.62:0/1206860931 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:57.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0ed9d700 1 --2- 172.21.15.62:0/1206860931 >> v2:172.21.15.109:3300/0 conn(0x7f6f100a71e0 0x7f6f100a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:57.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0dd9b700 1 -- 172.21.15.62:0/1206860931 >> v2:172.21.15.109:3300/0 conn(0x7f6f100a71e0 msgr2=0x7f6f100a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:57.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0dd9b700 1 --2- 172.21.15.62:0/1206860931 >> v2:172.21.15.109:3300/0 conn(0x7f6f100a71e0 0x7f6f100a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0dd9b700 1 -- 172.21.15.62:0/1206860931 >> v1:172.21.15.109:6789/0 conn(0x7f6f10141480 legacy=0x7f6f100b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:57.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0dd9b700 1 -- 172.21.15.62:0/1206860931 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f10147b50 con 0x7f6f100a8e10 2021-12-17T18:25:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0dd9b700 1 --2- 172.21.15.62:0/1206860931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f100a8e10 0x7f6f10147ff0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f6f00002f70 tx=0x7f6f00006eb0).ready entity=mon.0 client_cookie=a6f9a475835462ee server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0d59a700 1 -- 172.21.15.62:0/1206860931 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f0000d610 con 0x7f6f100a8e10 2021-12-17T18:25:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0d59a700 1 -- 172.21.15.62:0/1206860931 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f00000e90 con 0x7f6f100a8e10 2021-12-17T18:25:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0d59a700 1 -- 172.21.15.62:0/1206860931 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f0000d9a0 con 0x7f6f100a8e10 2021-12-17T18:25:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0f59e700 1 -- 172.21.15.62:0/1206860931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f100a8e10 msgr2=0x7f6f10147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0f59e700 1 --2- 172.21.15.62:0/1206860931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f100a8e10 0x7f6f10147ff0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f6f00002f70 tx=0x7f6f00006eb0).stop 2021-12-17T18:25:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0f59e700 1 -- 172.21.15.62:0/1206860931 shutdown_connections 2021-12-17T18:25:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0f59e700 1 --2- 172.21.15.62:0/1206860931 >> v2:172.21.15.109:3300/0 conn(0x7f6f100a71e0 0x7f6f100a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0f59e700 1 --2- 172.21.15.62:0/1206860931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f100a8e10 0x7f6f10147ff0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0f59e700 1 -- 172.21.15.62:0/1206860931 >> 172.21.15.62:0/1206860931 conn(0x7f6f1005d220 msgr2=0x7f6f100b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:57.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0f59e700 1 -- 172.21.15.62:0/1206860931 shutdown_connections 2021-12-17T18:25:57.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0f59e700 1 -- 172.21.15.62:0/1206860931 wait complete. 2021-12-17T18:25:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0f59e700 1 Processor -- start 2021-12-17T18:25:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.235+0000 7f6f0f59e700 1 -- start start 2021-12-17T18:25:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6f100a71e0 0x7f6f100b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f100a8e10 0x7f6f1015a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:57.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0f59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6f10141480 0x7f6f100ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:57.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f100ae0e0 con 0x7f6f100a8e10 2021-12-17T18:25:57.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0f59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f100ae310 con 0x7f6f10141480 2021-12-17T18:25:57.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f100ae5b0 con 0x7f6f100a71e0 2021-12-17T18:25:57.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f100a8e10 0x7f6f1015a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:57.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f100a8e10 0x7f6f1015a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53958/0 (socket says 172.21.15.62:53958) 2021-12-17T18:25:57.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0dd9b700 1 -- 172.21.15.62:0/2842442668 learned_addr learned my addr 172.21.15.62:0/2842442668 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:57.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0e59c700 1 --2- 172.21.15.62:0/2842442668 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6f100a71e0 0x7f6f100b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:57.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0ed9d700 1 --2- 172.21.15.62:0/2842442668 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6f10141480 0x7f6f100ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:57.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0dd9b700 1 -- 172.21.15.62:0/2842442668 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6f100a71e0 msgr2=0x7f6f100b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:57.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0dd9b700 1 --2- 172.21.15.62:0/2842442668 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6f100a71e0 0x7f6f100b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0dd9b700 1 -- 172.21.15.62:0/2842442668 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6f10141480 msgr2=0x7f6f100ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:57.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0dd9b700 1 --2- 172.21.15.62:0/2842442668 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6f10141480 0x7f6f100ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0dd9b700 1 -- 172.21.15.62:0/2842442668 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0000b1e0 con 0x7f6f100a8e10 2021-12-17T18:25:57.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0dd9b700 1 --2- 172.21.15.62:0/2842442668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f100a8e10 0x7f6f1015a650 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f6f00002f70 tx=0x7f6f00015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:57.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6eff7fe700 1 -- 172.21.15.62:0/2842442668 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f00011760 con 0x7f6f100a8e10 2021-12-17T18:25:57.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6eff7fe700 1 -- 172.21.15.62:0/2842442668 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f000118c0 con 0x7f6f100a8e10 2021-12-17T18:25:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0f59e700 1 -- 172.21.15.62:0/2842442668 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f100a9330 con 0x7f6f100a8e10 2021-12-17T18:25:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6eff7fe700 1 -- 172.21.15.62:0/2842442668 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f00011c20 con 0x7f6f100a8e10 2021-12-17T18:25:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.239+0000 7f6f0f59e700 1 -- 172.21.15.62:0/2842442668 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f100af430 con 0x7f6f100a8e10 2021-12-17T18:25:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.243+0000 7f6f0f59e700 1 -- 172.21.15.62:0/2842442668 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f100ae770 con 0x7f6f100a8e10 2021-12-17T18:25:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.243+0000 7f6eff7fe700 1 -- 172.21.15.62:0/2842442668 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6f00025030 con 0x7f6f100a8e10 2021-12-17T18:25:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.243+0000 7f6eff7fe700 1 --2- 172.21.15.62:0/2842442668 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eec0536a0 0x7f6eec055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.243+0000 7f6eff7fe700 1 -- 172.21.15.62:0/2842442668 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6f0006cb40 con 0x7f6f100a8e10 2021-12-17T18:25:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.243+0000 7f6f0e59c700 1 --2- 172.21.15.62:0/2842442668 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eec0536a0 0x7f6eec055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:57.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.243+0000 7f6f0e59c700 1 --2- 172.21.15.62:0/2842442668 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eec0536a0 0x7f6eec055b60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f6f0400d000 tx=0x7f6f04007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:57.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.247+0000 7f6eff7fe700 1 -- 172.21.15.62:0/2842442668 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6f00043c20 con 0x7f6f100a8e10 2021-12-17T18:25:57.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.411+0000 7f6f0f59e700 1 -- 172.21.15.62:0/2842442668 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f100573d0 con 0x7f6f100a8e10 2021-12-17T18:25:57.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.411+0000 7f6eff7fe700 1 -- 172.21.15.62:0/2842442668 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f6f00023020 con 0x7f6f100a8e10 2021-12-17T18:25:57.419 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:57.419 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":43,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.109:6835/1223620032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1223620032},{"type":"v1","addr":"172.21.15.109:6835","nonce":1223620032}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":42}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:25:45.098870+0000","modified":"2021-12-17T18:25:46.102354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7044":{"gid":7044,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/994270358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":994270358},{"type":"v1","addr":"172.21.15.62:6833","nonce":994270358}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-12-17T18:25:57.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.415+0000 7f6f0f59e700 1 -- 172.21.15.62:0/2842442668 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eec0536a0 msgr2=0x7f6eec055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:57.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.415+0000 7f6f0f59e700 1 --2- 172.21.15.62:0/2842442668 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eec0536a0 0x7f6eec055b60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f6f0400d000 tx=0x7f6f04007b90).stop 2021-12-17T18:25:57.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.415+0000 7f6f0f59e700 1 -- 172.21.15.62:0/2842442668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f100a8e10 msgr2=0x7f6f1015a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:57.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.415+0000 7f6f0f59e700 1 --2- 172.21.15.62:0/2842442668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f100a8e10 0x7f6f1015a650 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f6f00002f70 tx=0x7f6f00015000).stop 2021-12-17T18:25:57.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.415+0000 7f6f0f59e700 1 -- 172.21.15.62:0/2842442668 shutdown_connections 2021-12-17T18:25:57.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.415+0000 7f6f0f59e700 1 --2- 172.21.15.62:0/2842442668 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6eec0536a0 0x7f6eec055b60 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.415+0000 7f6f0f59e700 1 --2- 172.21.15.62:0/2842442668 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6f10141480 0x7f6f100ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.415+0000 7f6f0f59e700 1 --2- 172.21.15.62:0/2842442668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f100a8e10 0x7f6f1015a650 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.415+0000 7f6f0f59e700 1 --2- 172.21.15.62:0/2842442668 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6f100a71e0 0x7f6f100b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.415+0000 7f6f0f59e700 1 -- 172.21.15.62:0/2842442668 >> 172.21.15.62:0/2842442668 conn(0x7f6f1005d220 msgr2=0x7f6f10144930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:57.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.415+0000 7f6f0f59e700 1 -- 172.21.15.62:0/2842442668 shutdown_connections 2021-12-17T18:25:57.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.415+0000 7f6f0f59e700 1 -- 172.21.15.62:0/2842442668 wait complete. 2021-12-17T18:25:57.424 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 43 2021-12-17T18:25:57.436 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-12-17T18:25:57.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee57560700 1 Processor -- start 2021-12-17T18:25:57.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee57560700 1 -- start start 2021-12-17T18:25:57.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee57560700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fee50062620 0x7fee5013c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:57.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee57560700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee50143610 0x7fee5014d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:57.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee57560700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee50146e30 con 0x7fee5013cc60 2021-12-17T18:25:57.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee57560700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee50062a00 con 0x7fee50062620 2021-12-17T18:25:57.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee57560700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee500b59e0 con 0x7fee50143610 2021-12-17T18:25:57.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee5655e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fee50062620 0x7fee5013c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:57.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee5655e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fee50062620 0x7fee5013c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53964/0 (socket says 172.21.15.62:53964) 2021-12-17T18:25:57.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee5655e700 1 -- 172.21.15.62:0/1709881337 learned_addr learned my addr 172.21.15.62:0/1709881337 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:57.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee56d5f700 1 --2- 172.21.15.62:0/1709881337 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee50143610 0x7fee5014d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:57.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee5655e700 1 -- 172.21.15.62:0/1709881337 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee50143610 msgr2=0x7fee5014d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:57.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee5655e700 1 --2- 172.21.15.62:0/1709881337 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee50143610 0x7fee5014d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee5655e700 1 -- 172.21.15.62:0/1709881337 >> v1:172.21.15.109:6789/0 conn(0x7fee5013cc60 legacy=0x7fee50142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:57.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee5655e700 1 -- 172.21.15.62:0/1709881337 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee50147060 con 0x7fee50062620 2021-12-17T18:25:57.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee5655e700 1 --2- 172.21.15.62:0/1709881337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee50062620 0x7fee5013c770 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fee4c002f70 tx=0x7fee4c006eb0).ready entity=mon.0 client_cookie=72fc3045499b42c8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:57.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee5555c700 1 -- 172.21.15.62:0/1709881337 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee4c00d5c0 con 0x7fee50062620 2021-12-17T18:25:57.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee5555c700 1 -- 172.21.15.62:0/1709881337 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c000e90 con 0x7fee50062620 2021-12-17T18:25:57.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee5555c700 1 -- 172.21.15.62:0/1709881337 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee4c00d950 con 0x7fee50062620 2021-12-17T18:25:57.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee57560700 1 -- 172.21.15.62:0/1709881337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee50062620 msgr2=0x7fee5013c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:57.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee57560700 1 --2- 172.21.15.62:0/1709881337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee50062620 0x7fee5013c770 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fee4c002f70 tx=0x7fee4c006eb0).stop 2021-12-17T18:25:57.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee57560700 1 -- 172.21.15.62:0/1709881337 shutdown_connections 2021-12-17T18:25:57.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee57560700 1 --2- 172.21.15.62:0/1709881337 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee50143610 0x7fee5014d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee57560700 1 --2- 172.21.15.62:0/1709881337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee50062620 0x7fee5013c770 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee57560700 1 -- 172.21.15.62:0/1709881337 >> 172.21.15.62:0/1709881337 conn(0x7fee5005c750 msgr2=0x7fee5005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:57.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee57560700 1 -- 172.21.15.62:0/1709881337 shutdown_connections 2021-12-17T18:25:57.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.531+0000 7fee57560700 1 -- 172.21.15.62:0/1709881337 wait complete. 2021-12-17T18:25:57.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee57560700 1 Processor -- start 2021-12-17T18:25:57.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee57560700 1 -- start start 2021-12-17T18:25:57.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee57560700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee5013cc60 0x7fee50145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:57.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee57560700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fee50143610 0x7fee50066320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:57.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee57560700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee50062bd0 0x7fee50063080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:57.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee57560700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee50066810 con 0x7fee50062bd0 2021-12-17T18:25:57.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee57560700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee50140460 con 0x7fee50143610 2021-12-17T18:25:57.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee57560700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee50063570 con 0x7fee5013cc60 2021-12-17T18:25:57.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee56d5f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee50062bd0 0x7fee50063080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:57.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee56d5f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee50062bd0 0x7fee50063080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53972/0 (socket says 172.21.15.62:53972) 2021-12-17T18:25:57.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee56d5f700 1 -- 172.21.15.62:0/2630837891 learned_addr learned my addr 172.21.15.62:0/2630837891 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:57.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee5655e700 1 --2- 172.21.15.62:0/2630837891 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee5013cc60 0x7fee50145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:57.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee55d5d700 1 --2- 172.21.15.62:0/2630837891 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fee50143610 0x7fee50066320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee56d5f700 1 -- 172.21.15.62:0/2630837891 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee5013cc60 msgr2=0x7fee50145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee56d5f700 1 --2- 172.21.15.62:0/2630837891 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee5013cc60 0x7fee50145dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee56d5f700 1 -- 172.21.15.62:0/2630837891 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fee50143610 msgr2=0x7fee50066320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee56d5f700 1 --2- 172.21.15.62:0/2630837891 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fee50143610 0x7fee50066320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee56d5f700 1 -- 172.21.15.62:0/2630837891 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c00b1e0 con 0x7fee50062bd0 2021-12-17T18:25:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee55d5d700 1 --2- 172.21.15.62:0/2630837891 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fee50143610 0x7fee50066320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee5655e700 1 --2- 172.21.15.62:0/2630837891 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee5013cc60 0x7fee50145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee56d5f700 1 --2- 172.21.15.62:0/2630837891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee50062bd0 0x7fee50063080 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7fee50066080 tx=0x7fee48008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee3f7fe700 1 -- 172.21.15.62:0/2630837891 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee480127e0 con 0x7fee50062bd0 2021-12-17T18:25:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee3f7fe700 1 -- 172.21.15.62:0/2630837891 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee48012940 con 0x7fee50062bd0 2021-12-17T18:25:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee57560700 1 -- 172.21.15.62:0/2630837891 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee50065e30 con 0x7fee50062bd0 2021-12-17T18:25:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee3f7fe700 1 -- 172.21.15.62:0/2630837891 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee48012ca0 con 0x7fee50062bd0 2021-12-17T18:25:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.535+0000 7fee57560700 1 -- 172.21.15.62:0/2630837891 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee501406a0 con 0x7fee50062bd0 2021-12-17T18:25:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.539+0000 7fee57560700 1 -- 172.21.15.62:0/2630837891 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee500660c0 con 0x7fee50062bd0 2021-12-17T18:25:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.539+0000 7fee3f7fe700 1 -- 172.21.15.62:0/2630837891 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fee48013480 con 0x7fee50062bd0 2021-12-17T18:25:57.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.539+0000 7fee3f7fe700 1 --2- 172.21.15.62:0/2630837891 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fee30053610 0x7fee30055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.539+0000 7fee3f7fe700 1 -- 172.21.15.62:0/2630837891 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fee4806bf00 con 0x7fee50062bd0 2021-12-17T18:25:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.539+0000 7fee5655e700 1 --2- 172.21.15.62:0/2630837891 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fee30053610 0x7fee30055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.539+0000 7fee5655e700 1 --2- 172.21.15.62:0/2630837891 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fee30053610 0x7fee30055ad0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fee4c01a000 tx=0x7fee4c015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:57.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.543+0000 7fee3f7fe700 1 -- 172.21.15.62:0/2630837891 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fee48042e70 con 0x7fee50062bd0 2021-12-17T18:25:57.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:57.707+0000 7fee57560700 1 -- 172.21.15.62:0/2630837891 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fee500b42c0 con 0x7fee50062bd0 2021-12-17T18:25:58.688 INFO:tasks.ceph.mon.a.smithi062.stderr:2021-12-17T18:25:58.683+0000 7f8d3b366700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-12-17T18:25:58.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.687+0000 7fee3f7fe700 1 -- 172.21.15.62:0/2630837891 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) v1 ==== 161+0+0 (secure 0 0 0) 0x7fee48012e00 con 0x7fee50062bd0 2021-12-17T18:25:58.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.691+0000 7fee57560700 1 -- 172.21.15.62:0/2630837891 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fee30053610 msgr2=0x7fee30055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:58.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.691+0000 7fee57560700 1 --2- 172.21.15.62:0/2630837891 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fee30053610 0x7fee30055ad0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fee4c01a000 tx=0x7fee4c015000).stop 2021-12-17T18:25:58.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.691+0000 7fee57560700 1 -- 172.21.15.62:0/2630837891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee50062bd0 msgr2=0x7fee50063080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:58.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.691+0000 7fee57560700 1 --2- 172.21.15.62:0/2630837891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee50062bd0 0x7fee50063080 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7fee50066080 tx=0x7fee48008040).stop 2021-12-17T18:25:58.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.691+0000 7fee57560700 1 -- 172.21.15.62:0/2630837891 shutdown_connections 2021-12-17T18:25:58.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.691+0000 7fee57560700 1 --2- 172.21.15.62:0/2630837891 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fee30053610 0x7fee30055ad0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:58.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.691+0000 7fee57560700 1 --2- 172.21.15.62:0/2630837891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee50062bd0 0x7fee50063080 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:58.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.691+0000 7fee57560700 1 --2- 172.21.15.62:0/2630837891 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fee50143610 0x7fee50066320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:58.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.691+0000 7fee57560700 1 --2- 172.21.15.62:0/2630837891 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee5013cc60 0x7fee50145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:58.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.691+0000 7fee57560700 1 -- 172.21.15.62:0/2630837891 >> 172.21.15.62:0/2630837891 conn(0x7fee5005c750 msgr2=0x7fee500b8710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:58.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.691+0000 7fee57560700 1 -- 172.21.15.62:0/2630837891 shutdown_connections 2021-12-17T18:25:58.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.691+0000 7fee57560700 1 -- 172.21.15.62:0/2630837891 wait complete. 2021-12-17T18:25:58.702 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-12-17T18:25:58.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:25:58.721 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:25:58.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.815+0000 7fa552a50700 1 Processor -- start 2021-12-17T18:25:58.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.815+0000 7fa552a50700 1 -- start start 2021-12-17T18:25:58.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa552a50700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa54c0b5c80 0x7fa54c0b6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:58.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa552a50700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa54c0afcf0 0x7fa54c142b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:58.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa552a50700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa54c143060 0x7fa54c143490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:58.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa552a50700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa54c0b1540 con 0x7fa54c0b5c80 2021-12-17T18:25:58.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa552a50700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa54c0b0140 con 0x7fa54c143060 2021-12-17T18:25:58.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa552a50700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c0af5b0 con 0x7fa54c0afcf0 2021-12-17T18:25:58.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa551a4e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa54c0b5c80 0x7fa54c0b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:58.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa551a4e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa54c0b5c80 0x7fa54c0b6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53988/0 (socket says 172.21.15.62:53988) 2021-12-17T18:25:58.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa551a4e700 1 -- 172.21.15.62:0/1000815752 learned_addr learned my addr 172.21.15.62:0/1000815752 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:58.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa55124d700 1 --2- 172.21.15.62:0/1000815752 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa54c0afcf0 0x7fa54c142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:58.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa55224f700 1 --2- 172.21.15.62:0/1000815752 >> v2:172.21.15.109:3300/0 conn(0x7fa54c143060 0x7fa54c143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:58.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa551a4e700 1 -- 172.21.15.62:0/1000815752 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa54c0afcf0 msgr2=0x7fa54c142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:58.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa551a4e700 1 --2- 172.21.15.62:0/1000815752 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa54c0afcf0 0x7fa54c142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:58.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa551a4e700 1 -- 172.21.15.62:0/1000815752 >> v2:172.21.15.109:3300/0 conn(0x7fa54c143060 msgr2=0x7fa54c143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:58.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa551a4e700 1 --2- 172.21.15.62:0/1000815752 >> v2:172.21.15.109:3300/0 conn(0x7fa54c143060 0x7fa54c143490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:58.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa551a4e700 1 -- 172.21.15.62:0/1000815752 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c0af850 con 0x7fa54c0b5c80 2021-12-17T18:25:58.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa551a4e700 1 --2- 172.21.15.62:0/1000815752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa54c0b5c80 0x7fa54c0b6060 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7fa548002f70 tx=0x7fa548006e40).ready entity=mon.0 client_cookie=e14d8249ca16fefc server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:58.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa550a4c700 1 -- 172.21.15.62:0/1000815752 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa54800bb90 con 0x7fa54c0b5c80 2021-12-17T18:25:58.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa550a4c700 1 -- 172.21.15.62:0/1000815752 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa548000e90 con 0x7fa54c0b5c80 2021-12-17T18:25:58.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa550a4c700 1 -- 172.21.15.62:0/1000815752 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5480153f0 con 0x7fa54c0b5c80 2021-12-17T18:25:58.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa552a50700 1 -- 172.21.15.62:0/1000815752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa54c0b5c80 msgr2=0x7fa54c0b6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:58.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa552a50700 1 --2- 172.21.15.62:0/1000815752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa54c0b5c80 0x7fa54c0b6060 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7fa548002f70 tx=0x7fa548006e40).stop 2021-12-17T18:25:58.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa552a50700 1 -- 172.21.15.62:0/1000815752 shutdown_connections 2021-12-17T18:25:58.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa552a50700 1 --2- 172.21.15.62:0/1000815752 >> v2:172.21.15.109:3300/0 conn(0x7fa54c143060 0x7fa54c143490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:58.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa552a50700 1 --2- 172.21.15.62:0/1000815752 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa54c0afcf0 0x7fa54c142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:58.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa552a50700 1 --2- 172.21.15.62:0/1000815752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa54c0b5c80 0x7fa54c0b6060 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:58.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa552a50700 1 -- 172.21.15.62:0/1000815752 >> 172.21.15.62:0/1000815752 conn(0x7fa54c05c750 msgr2=0x7fa54c05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:58.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa552a50700 1 -- 172.21.15.62:0/1000815752 shutdown_connections 2021-12-17T18:25:58.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.819+0000 7fa552a50700 1 -- 172.21.15.62:0/1000815752 wait complete. 2021-12-17T18:25:58.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa552a50700 1 Processor -- start 2021-12-17T18:25:58.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa552a50700 1 -- start start 2021-12-17T18:25:58.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa552a50700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa54c0afcf0 0x7fa54c0a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:58.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa552a50700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa54c0b5c80 0x7fa54c13ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:58.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa552a50700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa54c143060 0x7fa54c13d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:58.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa552a50700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c09eff0 con 0x7fa54c143060 2021-12-17T18:25:58.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa552a50700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c09ed50 con 0x7fa54c0b5c80 2021-12-17T18:25:58.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa552a50700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c09ff60 con 0x7fa54c0afcf0 2021-12-17T18:25:58.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa55224f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa54c143060 0x7fa54c13d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:58.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa55224f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa54c143060 0x7fa54c13d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53998/0 (socket says 172.21.15.62:53998) 2021-12-17T18:25:58.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa55224f700 1 -- 172.21.15.62:0/2511159926 learned_addr learned my addr 172.21.15.62:0/2511159926 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:58.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa551a4e700 1 --2- 172.21.15.62:0/2511159926 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa54c0afcf0 0x7fa54c0a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:58.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa55124d700 1 --2- 172.21.15.62:0/2511159926 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa54c0b5c80 0x7fa54c13ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:58.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa55224f700 1 -- 172.21.15.62:0/2511159926 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa54c0afcf0 msgr2=0x7fa54c0a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:58.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa55224f700 1 --2- 172.21.15.62:0/2511159926 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa54c0afcf0 0x7fa54c0a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:58.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa55224f700 1 -- 172.21.15.62:0/2511159926 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa54c0b5c80 msgr2=0x7fa54c13ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:58.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa55224f700 1 --2- 172.21.15.62:0/2511159926 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa54c0b5c80 0x7fa54c13ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:58.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa55224f700 1 -- 172.21.15.62:0/2511159926 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54800d4d0 con 0x7fa54c143060 2021-12-17T18:25:58.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa551a4e700 1 --2- 172.21.15.62:0/2511159926 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa54c0afcf0 0x7fa54c0a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:25:58.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa55224f700 1 --2- 172.21.15.62:0/2511159926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa54c143060 0x7fa54c13d380 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7fa544006e00 tx=0x7fa5440091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:58.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa53affd700 1 -- 172.21.15.62:0/2511159926 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa54400c7f0 con 0x7fa54c143060 2021-12-17T18:25:58.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa53affd700 1 -- 172.21.15.62:0/2511159926 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54400c950 con 0x7fa54c143060 2021-12-17T18:25:58.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa552a50700 1 -- 172.21.15.62:0/2511159926 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54c09e9d0 con 0x7fa54c143060 2021-12-17T18:25:58.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa53affd700 1 -- 172.21.15.62:0/2511159926 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa54400ccb0 con 0x7fa54c143060 2021-12-17T18:25:58.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.823+0000 7fa552a50700 1 -- 172.21.15.62:0/2511159926 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54c13d870 con 0x7fa54c143060 2021-12-17T18:25:58.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.827+0000 7fa552a50700 1 -- 172.21.15.62:0/2511159926 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54c143980 con 0x7fa54c143060 2021-12-17T18:25:58.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.827+0000 7fa53affd700 1 -- 172.21.15.62:0/2511159926 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa544022070 con 0x7fa54c143060 2021-12-17T18:25:58.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.827+0000 7fa53affd700 1 --2- 172.21.15.62:0/2511159926 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa52c053580 0x7fa52c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:58.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.827+0000 7fa53affd700 1 -- 172.21.15.62:0/2511159926 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa54406c1c0 con 0x7fa54c143060 2021-12-17T18:25:58.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.827+0000 7fa551a4e700 1 --2- 172.21.15.62:0/2511159926 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa52c053580 0x7fa52c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:58.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.827+0000 7fa551a4e700 1 --2- 172.21.15.62:0/2511159926 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa52c053580 0x7fa52c055a40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fa548006fc0 tx=0x7fa548018000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:58.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.831+0000 7fa53affd700 1 -- 172.21.15.62:0/2511159926 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa544043140 con 0x7fa54c143060 2021-12-17T18:25:59.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.995+0000 7fa552a50700 1 -- 172.21.15.62:0/2511159926 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa54c0a0130 con 0x7fa54c143060 2021-12-17T18:25:59.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.995+0000 7fa53affd700 1 -- 172.21.15.62:0/2511159926 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+1782 (secure 0 0 0) 0x7fa544016090 con 0x7fa54c143060 2021-12-17T18:25:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:25:59.003 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":44,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.109:6835/1223620032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1223620032},{"type":"v1","addr":"172.21.15.109:6835","nonce":1223620032}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":42}],"filesystems":[{"mdsmap":{"epoch":44,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:25:45.098870+0000","modified":"2021-12-17T18:25:58.686249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-12-17T18:25:59.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.999+0000 7fa552a50700 1 -- 172.21.15.62:0/2511159926 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa52c053580 msgr2=0x7fa52c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:59.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.999+0000 7fa552a50700 1 --2- 172.21.15.62:0/2511159926 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa52c053580 0x7fa52c055a40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fa548006fc0 tx=0x7fa548018000).stop 2021-12-17T18:25:59.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.999+0000 7fa552a50700 1 -- 172.21.15.62:0/2511159926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa54c143060 msgr2=0x7fa54c13d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:59.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.999+0000 7fa552a50700 1 --2- 172.21.15.62:0/2511159926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa54c143060 0x7fa54c13d380 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7fa544006e00 tx=0x7fa5440091d0).stop 2021-12-17T18:25:59.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.999+0000 7fa552a50700 1 -- 172.21.15.62:0/2511159926 shutdown_connections 2021-12-17T18:25:59.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.999+0000 7fa552a50700 1 --2- 172.21.15.62:0/2511159926 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa52c053580 0x7fa52c055a40 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:59.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.999+0000 7fa552a50700 1 --2- 172.21.15.62:0/2511159926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa54c143060 0x7fa54c13d380 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:59.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.999+0000 7fa552a50700 1 --2- 172.21.15.62:0/2511159926 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa54c0b5c80 0x7fa54c13ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:59.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.999+0000 7fa552a50700 1 --2- 172.21.15.62:0/2511159926 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa54c0afcf0 0x7fa54c0a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:59.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.999+0000 7fa552a50700 1 -- 172.21.15.62:0/2511159926 >> 172.21.15.62:0/2511159926 conn(0x7fa54c05c750 msgr2=0x7fa54c13dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:59.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.999+0000 7fa552a50700 1 -- 172.21.15.62:0/2511159926 shutdown_connections 2021-12-17T18:25:59.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:58.999+0000 7fa552a50700 1 -- 172.21.15.62:0/2511159926 wait complete. 2021-12-17T18:25:59.008 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 44 2021-12-17T18:25:59.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-12-17T18:25:59.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.119+0000 7f449ffff700 1 Processor -- start 2021-12-17T18:25:59.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.119+0000 7f449ffff700 1 -- start start 2021-12-17T18:25:59.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f44a01430f0 0x7f44a0140750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:59.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f44a0064940 0x7f44a0064dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:59.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449ffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a0064050 con 0x7f44a00b6820 2021-12-17T18:25:59.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449ffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a00b6c00 con 0x7f44a0064940 2021-12-17T18:25:59.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449ffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a005f9d0 con 0x7f44a01430f0 2021-12-17T18:25:59.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449f7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f44a0064940 0x7f44a0064dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:59.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449effd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f44a00b6820 0x7f44a0140040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37582/0 (socket says 172.21.15.62:37582) 2021-12-17T18:25:59.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449effd700 1 -- 172.21.15.62:0/564844240 learned_addr learned my addr 172.21.15.62:0/564844240 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:25:59.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449f7fe700 1 --2- 172.21.15.62:0/564844240 >> v2:172.21.15.62:3300/0 conn(0x7f44a0064940 0x7f44a0064dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54006/0 (socket says 172.21.15.62:54006) 2021-12-17T18:25:59.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449e7fc700 1 --2- 172.21.15.62:0/564844240 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f44a01430f0 0x7f44a0140750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:59.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449f7fe700 1 -- 172.21.15.62:0/564844240 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f44a01430f0 msgr2=0x7f44a0140750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:25:59.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449f7fe700 1 --2- 172.21.15.62:0/564844240 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f44a01430f0 0x7f44a0140750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:59.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449f7fe700 1 -- 172.21.15.62:0/564844240 >> v1:172.21.15.62:6789/0 conn(0x7f44a00b6820 legacy=0x7f44a0140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:59.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449f7fe700 1 -- 172.21.15.62:0/564844240 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a005f730 con 0x7f44a0064940 2021-12-17T18:25:59.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449f7fe700 1 --2- 172.21.15.62:0/564844240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44a0064940 0x7f44a0064dd0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f44980032f0 tx=0x7f44980091d0).ready entity=mon.0 client_cookie=68cb2eecc3c04999 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:59.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449dffb700 1 -- 172.21.15.62:0/564844240 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f449800b6c0 con 0x7f44a0064940 2021-12-17T18:25:59.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449dffb700 1 -- 172.21.15.62:0/564844240 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449800b820 con 0x7f44a0064940 2021-12-17T18:25:59.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449dffb700 1 -- 172.21.15.62:0/564844240 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f449800b990 con 0x7f44a0064940 2021-12-17T18:25:59.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449ffff700 1 -- 172.21.15.62:0/564844240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44a0064940 msgr2=0x7f44a0064dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:59.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449ffff700 1 --2- 172.21.15.62:0/564844240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44a0064940 0x7f44a0064dd0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f44980032f0 tx=0x7f44980091d0).stop 2021-12-17T18:25:59.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449ffff700 1 -- 172.21.15.62:0/564844240 shutdown_connections 2021-12-17T18:25:59.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449ffff700 1 --2- 172.21.15.62:0/564844240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44a0064940 0x7f44a0064dd0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:59.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449ffff700 1 --2- 172.21.15.62:0/564844240 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f44a01430f0 0x7f44a0140750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:59.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449ffff700 1 -- 172.21.15.62:0/564844240 >> 172.21.15.62:0/564844240 conn(0x7f44a00625b0 msgr2=0x7f44a0063620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:59.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449ffff700 1 -- 172.21.15.62:0/564844240 shutdown_connections 2021-12-17T18:25:59.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.123+0000 7f449ffff700 1 -- 172.21.15.62:0/564844240 wait complete. 2021-12-17T18:25:59.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449ffff700 1 Processor -- start 2021-12-17T18:25:59.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449ffff700 1 -- start start 2021-12-17T18:25:59.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449ffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f44a0064940 0x7f44a01455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:59.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44a00b6820 0x7f44a013ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:59.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f44a01430f0 0x7f44a0145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:59.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a0113ff0 con 0x7f44a00b6820 2021-12-17T18:25:59.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449ffff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a01526d0 con 0x7f44a0064940 2021-12-17T18:25:59.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449ffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00b6010 con 0x7f44a01430f0 2021-12-17T18:25:59.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44a00b6820 0x7f44a013ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:59.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44a00b6820 0x7f44a013ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54010/0 (socket says 172.21.15.62:54010) 2021-12-17T18:25:59.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449e7fc700 1 -- 172.21.15.62:0/3625795745 learned_addr learned my addr 172.21.15.62:0/3625795745 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:25:59.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449f7fe700 1 --2- 172.21.15.62:0/3625795745 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f44a01430f0 0x7f44a0145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:59.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449effd700 1 --2- 172.21.15.62:0/3625795745 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f44a0064940 0x7f44a01455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:59.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449e7fc700 1 -- 172.21.15.62:0/3625795745 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f44a01430f0 msgr2=0x7f44a0145f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:59.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449e7fc700 1 --2- 172.21.15.62:0/3625795745 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f44a01430f0 0x7f44a0145f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:59.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449e7fc700 1 -- 172.21.15.62:0/3625795745 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f44a0064940 msgr2=0x7f44a01455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:59.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449e7fc700 1 --2- 172.21.15.62:0/3625795745 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f44a0064940 0x7f44a01455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:59.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449e7fc700 1 -- 172.21.15.62:0/3625795745 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4498009470 con 0x7f44a00b6820 2021-12-17T18:25:59.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.127+0000 7f449e7fc700 1 --2- 172.21.15.62:0/3625795745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44a00b6820 0x7f44a013ee50 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f448800c000 tx=0x7f4488006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:59.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.131+0000 7f4497fff700 1 -- 172.21.15.62:0/3625795745 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4488011750 con 0x7f44a00b6820 2021-12-17T18:25:59.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.131+0000 7f4497fff700 1 -- 172.21.15.62:0/3625795745 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44880118b0 con 0x7f44a00b6820 2021-12-17T18:25:59.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.131+0000 7f449ffff700 1 -- 172.21.15.62:0/3625795745 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a0114290 con 0x7f44a00b6820 2021-12-17T18:25:59.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.131+0000 7f4497fff700 1 -- 172.21.15.62:0/3625795745 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4488011c10 con 0x7f44a00b6820 2021-12-17T18:25:59.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.131+0000 7f449ffff700 1 -- 172.21.15.62:0/3625795745 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a013f560 con 0x7f44a00b6820 2021-12-17T18:25:59.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.131+0000 7f449ffff700 1 -- 172.21.15.62:0/3625795745 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a00573d0 con 0x7f44a00b6820 2021-12-17T18:25:59.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.131+0000 7f4497fff700 1 -- 172.21.15.62:0/3625795745 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4488011d70 con 0x7f44a00b6820 2021-12-17T18:25:59.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.131+0000 7f4497fff700 1 --2- 172.21.15.62:0/3625795745 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4484053640 0x7f4484055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:25:59.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.131+0000 7f4497fff700 1 -- 172.21.15.62:0/3625795745 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f448806be30 con 0x7f44a00b6820 2021-12-17T18:25:59.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.131+0000 7f449effd700 1 --2- 172.21.15.62:0/3625795745 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4484053640 0x7f4484055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:25:59.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.135+0000 7f449effd700 1 --2- 172.21.15.62:0/3625795745 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4484053640 0x7f4484055b00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f449000d000 tx=0x7f4490009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:25:59.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.135+0000 7f4497fff700 1 -- 172.21.15.62:0/3625795745 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4488042dd0 con 0x7f44a00b6820 2021-12-17T18:25:59.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.303+0000 7f449ffff700 1 -- 172.21.15.62:0/3625795745 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f44a0152890 con 0x7f44a00b6820 2021-12-17T18:25:59.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.847+0000 7f4497fff700 1 -- 172.21.15.62:0/3625795745 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7f44880463f0 con 0x7f44a00b6820 2021-12-17T18:25:59.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.851+0000 7f449ffff700 1 -- 172.21.15.62:0/3625795745 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4484053640 msgr2=0x7f4484055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:59.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.851+0000 7f449ffff700 1 --2- 172.21.15.62:0/3625795745 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4484053640 0x7f4484055b00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f449000d000 tx=0x7f4490009040).stop 2021-12-17T18:25:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.851+0000 7f449ffff700 1 -- 172.21.15.62:0/3625795745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44a00b6820 msgr2=0x7f44a013ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:25:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.851+0000 7f449ffff700 1 --2- 172.21.15.62:0/3625795745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44a00b6820 0x7f44a013ee50 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f448800c000 tx=0x7f4488006df0).stop 2021-12-17T18:25:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.855+0000 7f449ffff700 1 -- 172.21.15.62:0/3625795745 shutdown_connections 2021-12-17T18:25:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.855+0000 7f449ffff700 1 --2- 172.21.15.62:0/3625795745 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4484053640 0x7f4484055b00 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:59.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.855+0000 7f449ffff700 1 --2- 172.21.15.62:0/3625795745 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f44a01430f0 0x7f44a0145f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:59.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.855+0000 7f449ffff700 1 --2- 172.21.15.62:0/3625795745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44a00b6820 0x7f44a013ee50 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:59.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.855+0000 7f449ffff700 1 --2- 172.21.15.62:0/3625795745 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f44a0064940 0x7f44a01455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:25:59.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.855+0000 7f449ffff700 1 -- 172.21.15.62:0/3625795745 >> 172.21.15.62:0/3625795745 conn(0x7f44a00625b0 msgr2=0x7f44a013e130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:25:59.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.855+0000 7f449ffff700 1 -- 172.21.15.62:0/3625795745 shutdown_connections 2021-12-17T18:25:59.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.855+0000 7f449ffff700 1 -- 172.21.15.62:0/3625795745 wait complete. 2021-12-17T18:25:59.876 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-12-17T18:25:59.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.987+0000 7fd2cea78700 1 Processor -- start 2021-12-17T18:25:59.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.987+0000 7fd2cea78700 1 -- start start 2021-12-17T18:25:59.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2cea78700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2c8142f70 0x7fd2c80679b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:00.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2cea78700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c80b0610 con 0x7fd2c80b6520 2021-12-17T18:26:00.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2cea78700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c80b0870 con 0x7fd2c80aead0 2021-12-17T18:26:00.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2cea78700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c80b0b10 con 0x7fd2c8142f70 2021-12-17T18:26:00.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2cc814700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd2c80b6520 0x7fd2c813cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37596/0 (socket says 172.21.15.62:37596) 2021-12-17T18:26:00.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2cc814700 1 -- 172.21.15.62:0/4246657116 learned_addr learned my addr 172.21.15.62:0/4246657116 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:00.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2cd015700 1 --2- 172.21.15.62:0/4246657116 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2c8142f70 0x7fd2c80679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:00.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 -- 172.21.15.62:0/4246657116 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1913948634 0 0) 0x7fd2c80b0610 con 0x7fd2c80b6520 2021-12-17T18:26:00.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 -- 172.21.15.62:0/4246657116 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2b4003260 con 0x7fd2c80b6520 2021-12-17T18:26:00.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 -- 172.21.15.62:0/4246657116 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804487364 0 0) 0x7fd2c80b0870 con 0x7fd2c80aead0 2021-12-17T18:26:00.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 -- 172.21.15.62:0/4246657116 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c80b0610 con 0x7fd2c80aead0 2021-12-17T18:26:00.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 -- 172.21.15.62:0/4246657116 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 412331634 0 0) 0x7fd2b4003260 con 0x7fd2c80b6520 2021-12-17T18:26:00.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 -- 172.21.15.62:0/4246657116 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2c8142f70 msgr2=0x7fd2c80679b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:00.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 --2- 172.21.15.62:0/4246657116 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2c8142f70 0x7fd2c80679b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:00.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 -- 172.21.15.62:0/4246657116 >> v1:172.21.15.109:6789/0 conn(0x7fd2c80aead0 legacy=0x7fd2c8146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:00.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 -- 172.21.15.62:0/4246657116 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c80b6900 con 0x7fd2c80b6520 2021-12-17T18:26:00.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 -- 172.21.15.62:0/4246657116 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fd2c4001660 con 0x7fd2c80b6520 2021-12-17T18:26:00.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 -- 172.21.15.62:0/4246657116 >> v1:172.21.15.62:6789/0 conn(0x7fd2c80b6520 legacy=0x7fd2c813cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:00.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 --2- 172.21.15.62:0/4246657116 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2c8142f70 0x7fd2b4003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:00.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 --2- 172.21.15.62:0/4246657116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2b4003e20 0x7fd2b4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:00.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 --2- 172.21.15.62:0/4246657116 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd2b40049f0 0x7fd2b4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:00.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 -- 172.21.15.62:0/4246657116 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c80b0b10 con 0x7fd2b4003e20 2021-12-17T18:26:00.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 -- 172.21.15.62:0/4246657116 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b400b800 con 0x7fd2b40049f0 2021-12-17T18:26:00.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 -- 172.21.15.62:0/4246657116 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b400b9c0 con 0x7fd2c8142f70 2021-12-17T18:26:00.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bffff700 1 --2- 172.21.15.62:0/4246657116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2b4003e20 0x7fd2b4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:00.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2cc814700 1 --2- 172.21.15.62:0/4246657116 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2c8142f70 0x7fd2b4003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:00.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2cd015700 1 --2- 172.21.15.62:0/4246657116 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd2b40049f0 0x7fd2b4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:00.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bffff700 1 -- 172.21.15.62:0/4246657116 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2c8142f70 msgr2=0x7fd2b4003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:00.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bffff700 1 --2- 172.21.15.62:0/4246657116 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2c8142f70 0x7fd2b4003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:00.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bffff700 1 -- 172.21.15.62:0/4246657116 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd2b40049f0 msgr2=0x7fd2b4004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:00.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bffff700 1 --2- 172.21.15.62:0/4246657116 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd2b40049f0 0x7fd2b4004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:00.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bffff700 1 -- 172.21.15.62:0/4246657116 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b4003260 con 0x7fd2b4003e20 2021-12-17T18:26:00.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2cd015700 1 --2- 172.21.15.62:0/4246657116 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd2b40049f0 0x7fd2b4004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:00.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bffff700 1 --2- 172.21.15.62:0/4246657116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2b4003e20 0x7fd2b4004500 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7fd2b8001110 tx=0x7fd2b8007a00).ready entity=mon.0 client_cookie=4a607ffae163c272 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:00.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 -- 172.21.15.62:0/4246657116 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2b8007d10 con 0x7fd2b4003e20 2021-12-17T18:26:00.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 -- 172.21.15.62:0/4246657116 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b8007030 con 0x7fd2b4003e20 2021-12-17T18:26:00.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.991+0000 7fd2bf7fe700 1 -- 172.21.15.62:0/4246657116 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2b8007390 con 0x7fd2b4003e20 2021-12-17T18:26:00.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.995+0000 7fd2cea78700 1 -- 172.21.15.62:0/4246657116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2b4003e20 msgr2=0x7fd2b4004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:00.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.995+0000 7fd2cea78700 1 --2- 172.21.15.62:0/4246657116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2b4003e20 0x7fd2b4004500 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7fd2b8001110 tx=0x7fd2b8007a00).stop 2021-12-17T18:26:00.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.995+0000 7fd2cd015700 1 -- 172.21.15.62:0/4246657116 reap_dead start 2021-12-17T18:26:00.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.995+0000 7fd2cea78700 1 -- 172.21.15.62:0/4246657116 shutdown_connections 2021-12-17T18:26:00.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.995+0000 7fd2cea78700 1 -- 172.21.15.62:0/4246657116 >> 172.21.15.62:0/4246657116 conn(0x7fd2c805d220 msgr2=0x7fd2c80b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:00.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.995+0000 7fd2cea78700 1 -- 172.21.15.62:0/4246657116 shutdown_connections 2021-12-17T18:26:00.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.995+0000 7fd2cea78700 1 -- 172.21.15.62:0/4246657116 wait complete. 2021-12-17T18:26:00.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.995+0000 7fd2cea78700 1 Processor -- start 2021-12-17T18:26:00.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.995+0000 7fd2cea78700 1 -- start start 2021-12-17T18:26:00.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cea78700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2b4003e20 0x7fd2c81423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:00.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cea78700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2c8140430 0x7fd2c8139de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:00.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cea78700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd2c813a2d0 0x7fd2c80b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:00.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cea78700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c80b2d80 con 0x7fd2b4003e20 2021-12-17T18:26:00.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cea78700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c80b3020 con 0x7fd2c813a2d0 2021-12-17T18:26:00.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cea78700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c813eca0 con 0x7fd2c8140430 2021-12-17T18:26:00.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cc814700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2b4003e20 0x7fd2c81423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cc814700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2b4003e20 0x7fd2c81423a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54028/0 (socket says 172.21.15.62:54028) 2021-12-17T18:26:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cc814700 1 -- 172.21.15.62:0/2006756459 learned_addr learned my addr 172.21.15.62:0/2006756459 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2bffff700 1 --2- 172.21.15.62:0/2006756459 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2c8140430 0x7fd2c8139de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:00.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cd015700 1 --2- 172.21.15.62:0/2006756459 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd2c813a2d0 0x7fd2c80b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:00.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cc814700 1 -- 172.21.15.62:0/2006756459 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2c8140430 msgr2=0x7fd2c8139de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:00.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cc814700 1 --2- 172.21.15.62:0/2006756459 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2c8140430 0x7fd2c8139de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:00.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cc814700 1 -- 172.21.15.62:0/2006756459 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd2c813a2d0 msgr2=0x7fd2c80b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:00.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cc814700 1 --2- 172.21.15.62:0/2006756459 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd2c813a2d0 0x7fd2c80b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:00.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cc814700 1 -- 172.21.15.62:0/2006756459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c813e920 con 0x7fd2b4003e20 2021-12-17T18:26:00.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cc814700 1 --2- 172.21.15.62:0/2006756459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2b4003e20 0x7fd2c81423a0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fd2c400d000 tx=0x7fd2c4001db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:00.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2bdffb700 1 -- 172.21.15.62:0/2006756459 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c40116b0 con 0x7fd2b4003e20 2021-12-17T18:26:00.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2bdffb700 1 -- 172.21.15.62:0/2006756459 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c4011810 con 0x7fd2b4003e20 2021-12-17T18:26:00.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cea78700 1 -- 172.21.15.62:0/2006756459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c813a750 con 0x7fd2b4003e20 2021-12-17T18:26:00.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2bdffb700 1 -- 172.21.15.62:0/2006756459 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c4011b70 con 0x7fd2b4003e20 2021-12-17T18:26:00.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cea78700 1 -- 172.21.15.62:0/2006756459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c8145e00 con 0x7fd2b4003e20 2021-12-17T18:26:00.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2bdffb700 1 -- 172.21.15.62:0/2006756459 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd2c401b030 con 0x7fd2b4003e20 2021-12-17T18:26:00.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:25:59.999+0000 7fd2cea78700 1 -- 172.21.15.62:0/2006756459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c813eab0 con 0x7fd2b4003e20 2021-12-17T18:26:00.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.003+0000 7fd2bdffb700 1 --2- 172.21.15.62:0/2006756459 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd2a80535b0 0x7fd2a8055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:00.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.003+0000 7fd2bdffb700 1 -- 172.21.15.62:0/2006756459 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd2c406b340 con 0x7fd2b4003e20 2021-12-17T18:26:00.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.003+0000 7fd2bffff700 1 --2- 172.21.15.62:0/2006756459 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd2a80535b0 0x7fd2a8055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:00.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.003+0000 7fd2bffff700 1 --2- 172.21.15.62:0/2006756459 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd2a80535b0 0x7fd2a8055a70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fd2b8018000 tx=0x7fd2b8016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:00.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.007+0000 7fd2bdffb700 1 -- 172.21.15.62:0/2006756459 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd2c4042450 con 0x7fd2b4003e20 2021-12-17T18:26:00.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.135+0000 7fd2cea78700 1 -- 172.21.15.62:0/2006756459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd2c8145e00 con 0x7fd2b4003e20 2021-12-17T18:26:00.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.855+0000 7fd2bdffb700 1 -- 172.21.15.62:0/2006756459 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) v1 ==== 185+0+0 (secure 0 0 0) 0x7fd2c8145e00 con 0x7fd2b4003e20 2021-12-17T18:26:00.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.859+0000 7fd2cea78700 1 -- 172.21.15.62:0/2006756459 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd2a80535b0 msgr2=0x7fd2a8055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:00.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.859+0000 7fd2cea78700 1 --2- 172.21.15.62:0/2006756459 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd2a80535b0 0x7fd2a8055a70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fd2b8018000 tx=0x7fd2b8016000).stop 2021-12-17T18:26:00.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.859+0000 7fd2cea78700 1 -- 172.21.15.62:0/2006756459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2b4003e20 msgr2=0x7fd2c81423a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:00.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.859+0000 7fd2cea78700 1 --2- 172.21.15.62:0/2006756459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2b4003e20 0x7fd2c81423a0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fd2c400d000 tx=0x7fd2c4001db0).stop 2021-12-17T18:26:00.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.859+0000 7fd2cea78700 1 -- 172.21.15.62:0/2006756459 shutdown_connections 2021-12-17T18:26:00.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.859+0000 7fd2cea78700 1 --2- 172.21.15.62:0/2006756459 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd2a80535b0 0x7fd2a8055a70 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:00.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.859+0000 7fd2cea78700 1 --2- 172.21.15.62:0/2006756459 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd2c813a2d0 0x7fd2c80b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:00.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.859+0000 7fd2cea78700 1 --2- 172.21.15.62:0/2006756459 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2c8140430 0x7fd2c8139de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:00.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.859+0000 7fd2cea78700 1 --2- 172.21.15.62:0/2006756459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2b4003e20 0x7fd2c81423a0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:00.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.859+0000 7fd2cea78700 1 -- 172.21.15.62:0/2006756459 >> 172.21.15.62:0/2006756459 conn(0x7fd2c805d220 msgr2=0x7fd2c80b4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:00.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.859+0000 7fd2cea78700 1 -- 172.21.15.62:0/2006756459 shutdown_connections 2021-12-17T18:26:00.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.859+0000 7fd2cea78700 1 -- 172.21.15.62:0/2006756459 wait complete. 2021-12-17T18:26:00.869 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2021-12-17T18:26:00.882 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-12-17T18:26:00.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.991+0000 7fa49cc8c700 1 Processor -- start 2021-12-17T18:26:00.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.991+0000 7fa49cc8c700 1 -- start start 2021-12-17T18:26:00.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.991+0000 7fa49cc8c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa4980ad130 0x7fa498143340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:00.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.991+0000 7fa49cc8c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4980b6600 con 0x7fa498143830 2021-12-17T18:26:01.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.991+0000 7fa49cc8c700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa49805fe50 con 0x7fa49805fa70 2021-12-17T18:26:01.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.991+0000 7fa49cc8c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4980adba0 con 0x7fa4980ad130 2021-12-17T18:26:01.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.991+0000 7fa48ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa4980ad130 0x7fa498143340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:01.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.991+0000 7fa497fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa498143830 0x7fa49813fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37620/0 (socket says 172.21.15.62:37620) 2021-12-17T18:26:01.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.991+0000 7fa497fff700 1 -- 172.21.15.62:0/3193566570 learned_addr learned my addr 172.21.15.62:0/3193566570 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:01.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.995+0000 7fa48ffff700 1 -- 172.21.15.62:0/3193566570 >> v1:172.21.15.109:6789/0 conn(0x7fa49805fa70 legacy=0x7fa498142c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:01.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.995+0000 7fa48ffff700 1 -- 172.21.15.62:0/3193566570 >> v1:172.21.15.62:6789/0 conn(0x7fa498143830 legacy=0x7fa49813fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:01.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.995+0000 7fa48ffff700 1 -- 172.21.15.62:0/3193566570 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4980b6830 con 0x7fa4980ad130 2021-12-17T18:26:01.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.995+0000 7fa496ffd700 1 -- 172.21.15.62:0/3193566570 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677063797 0 0) 0x7fa4980b6600 con 0x7fa498143830 2021-12-17T18:26:01.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.995+0000 7fa48ffff700 1 --2- 172.21.15.62:0/3193566570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4980ad130 0x7fa498143340 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7fa480002f70 tx=0x7fa480006df0).ready entity=mon.0 client_cookie=dbc86e01983e4483 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:01.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.995+0000 7fa496ffd700 1 -- 172.21.15.62:0/3193566570 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa48000d610 con 0x7fa4980ad130 2021-12-17T18:26:01.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.995+0000 7fa496ffd700 1 -- 172.21.15.62:0/3193566570 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa480000e90 con 0x7fa4980ad130 2021-12-17T18:26:01.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.995+0000 7fa496ffd700 1 -- 172.21.15.62:0/3193566570 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa48000d960 con 0x7fa4980ad130 2021-12-17T18:26:01.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.995+0000 7fa49cc8c700 1 -- 172.21.15.62:0/3193566570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4980ad130 msgr2=0x7fa498143340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:01.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.995+0000 7fa49cc8c700 1 --2- 172.21.15.62:0/3193566570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4980ad130 0x7fa498143340 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7fa480002f70 tx=0x7fa480006df0).stop 2021-12-17T18:26:01.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.995+0000 7fa49cc8c700 1 -- 172.21.15.62:0/3193566570 shutdown_connections 2021-12-17T18:26:01.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.995+0000 7fa49cc8c700 1 --2- 172.21.15.62:0/3193566570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4980ad130 0x7fa498143340 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:01.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.995+0000 7fa49cc8c700 1 -- 172.21.15.62:0/3193566570 >> 172.21.15.62:0/3193566570 conn(0x7fa4980b5ae0 msgr2=0x7fa4980b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:01.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.995+0000 7fa49cc8c700 1 -- 172.21.15.62:0/3193566570 shutdown_connections 2021-12-17T18:26:01.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.995+0000 7fa49cc8c700 1 -- 172.21.15.62:0/3193566570 wait complete. 2021-12-17T18:26:01.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa49cc8c700 1 Processor -- start 2021-12-17T18:26:01.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa49cc8c700 1 -- start start 2021-12-17T18:26:01.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa49cc8c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa49805fa70 0x7fa4980641d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:01.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa49cc8c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4980ad130 0x7fa498150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:01.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa49cc8c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa498143830 0x7fa498151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:01.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa49cc8c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa498144940 con 0x7fa49805fa70 2021-12-17T18:26:01.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa49cc8c700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa498143d30 con 0x7fa498143830 2021-12-17T18:26:01.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa49cc8c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4981306d0 con 0x7fa4980ad130 2021-12-17T18:26:01.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa4977fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa49805fa70 0x7fa4980641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:01.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa4977fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa49805fa70 0x7fa4980641d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54042/0 (socket says 172.21.15.62:54042) 2021-12-17T18:26:01.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa4977fe700 1 -- 172.21.15.62:0/1641705286 learned_addr learned my addr 172.21.15.62:0/1641705286 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:01.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa497fff700 1 --2- 172.21.15.62:0/1641705286 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa498143830 0x7fa498151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:01.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa48ffff700 1 --2- 172.21.15.62:0/1641705286 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4980ad130 0x7fa498150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:01.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa4977fe700 1 -- 172.21.15.62:0/1641705286 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4980ad130 msgr2=0x7fa498150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:01.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa4977fe700 1 --2- 172.21.15.62:0/1641705286 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4980ad130 0x7fa498150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:01.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa4977fe700 1 -- 172.21.15.62:0/1641705286 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa498143830 msgr2=0x7fa498151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:01.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa4977fe700 1 --2- 172.21.15.62:0/1641705286 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa498143830 0x7fa498151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:01.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa4977fe700 1 -- 172.21.15.62:0/1641705286 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48000b180 con 0x7fa49805fa70 2021-12-17T18:26:01.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa497fff700 1 --2- 172.21.15.62:0/1641705286 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa498143830 0x7fa498151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:26:01.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa48ffff700 1 --2- 172.21.15.62:0/1641705286 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4980ad130 0x7fa498150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:26:01.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa4977fe700 1 --2- 172.21.15.62:0/1641705286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa49805fa70 0x7fa4980641d0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7fa498144a80 tx=0x7fa488007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:01.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa4957fa700 1 -- 172.21.15.62:0/1641705286 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa48800ce20 con 0x7fa49805fa70 2021-12-17T18:26:01.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa4957fa700 1 -- 172.21.15.62:0/1641705286 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48800f470 con 0x7fa49805fa70 2021-12-17T18:26:01.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa49cc8c700 1 -- 172.21.15.62:0/1641705286 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa498143f60 con 0x7fa49805fa70 2021-12-17T18:26:01.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa4957fa700 1 -- 172.21.15.62:0/1641705286 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa48800f7d0 con 0x7fa49805fa70 2021-12-17T18:26:01.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa49cc8c700 1 -- 172.21.15.62:0/1641705286 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4981444a0 con 0x7fa49805fa70 2021-12-17T18:26:01.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa49cc8c700 1 -- 172.21.15.62:0/1641705286 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4980af330 con 0x7fa49805fa70 2021-12-17T18:26:01.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:00.999+0000 7fa4957fa700 1 -- 172.21.15.62:0/1641705286 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa488019030 con 0x7fa49805fa70 2021-12-17T18:26:01.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.003+0000 7fa4957fa700 1 --2- 172.21.15.62:0/1641705286 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa47c0536a0 0x7fa47c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:01.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.003+0000 7fa4957fa700 1 -- 172.21.15.62:0/1641705286 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fa48806acd0 con 0x7fa49805fa70 2021-12-17T18:26:01.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.003+0000 7fa48ffff700 1 --2- 172.21.15.62:0/1641705286 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa47c0536a0 0x7fa47c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:01.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.003+0000 7fa48ffff700 1 --2- 172.21.15.62:0/1641705286 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa47c0536a0 0x7fa47c055b60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fa480017000 tx=0x7fa480015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:01.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.007+0000 7fa4957fa700 1 -- 172.21.15.62:0/1641705286 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa488041f90 con 0x7fa49805fa70 2021-12-17T18:26:01.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.131+0000 7fa49cc8c700 1 -- 172.21.15.62:0/1641705286 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa4980573d0 con 0x7fa49805fa70 2021-12-17T18:26:01.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.875+0000 7fa4957fa700 1 -- 172.21.15.62:0/1641705286 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) v1 ==== 173+0+0 (secure 0 0 0) 0x7fa4880455b0 con 0x7fa49805fa70 2021-12-17T18:26:01.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.879+0000 7fa49cc8c700 1 -- 172.21.15.62:0/1641705286 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa47c0536a0 msgr2=0x7fa47c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:01.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.879+0000 7fa49cc8c700 1 --2- 172.21.15.62:0/1641705286 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa47c0536a0 0x7fa47c055b60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fa480017000 tx=0x7fa480015000).stop 2021-12-17T18:26:01.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.879+0000 7fa49cc8c700 1 -- 172.21.15.62:0/1641705286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa49805fa70 msgr2=0x7fa4980641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:01.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.879+0000 7fa49cc8c700 1 --2- 172.21.15.62:0/1641705286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa49805fa70 0x7fa4980641d0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7fa498144a80 tx=0x7fa488007c50).stop 2021-12-17T18:26:01.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.879+0000 7fa49cc8c700 1 -- 172.21.15.62:0/1641705286 shutdown_connections 2021-12-17T18:26:01.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.879+0000 7fa49cc8c700 1 --2- 172.21.15.62:0/1641705286 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa47c0536a0 0x7fa47c055b60 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:01.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.879+0000 7fa49cc8c700 1 --2- 172.21.15.62:0/1641705286 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa498143830 0x7fa498151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:01.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.879+0000 7fa49cc8c700 1 --2- 172.21.15.62:0/1641705286 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa4980ad130 0x7fa498150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:01.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.879+0000 7fa49cc8c700 1 --2- 172.21.15.62:0/1641705286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa49805fa70 0x7fa4980641d0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:01.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.879+0000 7fa49cc8c700 1 -- 172.21.15.62:0/1641705286 >> 172.21.15.62:0/1641705286 conn(0x7fa4980b5ae0 msgr2=0x7fa498142f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:01.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.879+0000 7fa49cc8c700 1 -- 172.21.15.62:0/1641705286 shutdown_connections 2021-12-17T18:26:01.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:01.879+0000 7fa49cc8c700 1 -- 172.21.15.62:0/1641705286 wait complete. 2021-12-17T18:26:01.888 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2021-12-17T18:26:01.898 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-12-17T18:26:02.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.003+0000 7fda7747a700 1 Processor -- start 2021-12-17T18:26:02.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.003+0000 7fda7747a700 1 -- start start 2021-12-17T18:26:02.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.003+0000 7fda7747a700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fda70143940 0x7fda70143d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:02.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.003+0000 7fda7747a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda700b23c0 0x7fda70140030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:02.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.003+0000 7fda7747a700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda700b01d0 con 0x7fda700b15b0 2021-12-17T18:26:02.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.003+0000 7fda7747a700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7013dac0 con 0x7fda70143940 2021-12-17T18:26:02.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.003+0000 7fda7747a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda700b08e0 con 0x7fda700b23c0 2021-12-17T18:26:02.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.003+0000 7fda76c79700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda700b23c0 0x7fda70140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:02.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.003+0000 7fda76478700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fda70143940 0x7fda70143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:02.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.003+0000 7fda75c77700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7fda700b15b0 0x7fda700b1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:53950/0 (socket says 172.21.15.62:53950) 2021-12-17T18:26:02.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.003+0000 7fda75c77700 1 -- 172.21.15.62:0/4185218809 learned_addr learned my addr 172.21.15.62:0/4185218809 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:02.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda75476700 1 -- 172.21.15.62:0/4185218809 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244174551 0 0) 0x7fda700b01d0 con 0x7fda700b15b0 2021-12-17T18:26:02.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda75476700 1 -- 172.21.15.62:0/4185218809 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda58003260 con 0x7fda700b15b0 2021-12-17T18:26:02.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda76c79700 1 -- 172.21.15.62:0/4185218809 >> v2:172.21.15.109:3300/0 conn(0x7fda70143940 msgr2=0x7fda70143d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:02.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda76c79700 1 --2- 172.21.15.62:0/4185218809 >> v2:172.21.15.109:3300/0 conn(0x7fda70143940 0x7fda70143d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:02.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda76c79700 1 -- 172.21.15.62:0/4185218809 >> v1:172.21.15.109:6789/0 conn(0x7fda700b15b0 legacy=0x7fda700b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:02.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda76c79700 1 -- 172.21.15.62:0/4185218809 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda70144390 con 0x7fda700b23c0 2021-12-17T18:26:02.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda76c79700 1 --2- 172.21.15.62:0/4185218809 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda700b23c0 0x7fda70140030 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fda680032f0 tx=0x7fda680091d0).ready entity=mon.2 client_cookie=e4e69f4a2e30a652 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:02.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda75476700 1 -- 172.21.15.62:0/4185218809 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda6800b600 con 0x7fda700b23c0 2021-12-17T18:26:02.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda75476700 1 -- 172.21.15.62:0/4185218809 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6800b760 con 0x7fda700b23c0 2021-12-17T18:26:02.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda75476700 1 -- 172.21.15.62:0/4185218809 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda6800b8d0 con 0x7fda700b23c0 2021-12-17T18:26:02.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda7747a700 1 -- 172.21.15.62:0/4185218809 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda700b23c0 msgr2=0x7fda70140030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:02.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda7747a700 1 --2- 172.21.15.62:0/4185218809 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda700b23c0 0x7fda70140030 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fda680032f0 tx=0x7fda680091d0).stop 2021-12-17T18:26:02.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda7747a700 1 -- 172.21.15.62:0/4185218809 shutdown_connections 2021-12-17T18:26:02.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda7747a700 1 --2- 172.21.15.62:0/4185218809 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda700b23c0 0x7fda70140030 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:02.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda7747a700 1 --2- 172.21.15.62:0/4185218809 >> v2:172.21.15.109:3300/0 conn(0x7fda70143940 0x7fda70143d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:02.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda7747a700 1 -- 172.21.15.62:0/4185218809 >> 172.21.15.62:0/4185218809 conn(0x7fda700b6550 msgr2=0x7fda700b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:02.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda7747a700 1 -- 172.21.15.62:0/4185218809 shutdown_connections 2021-12-17T18:26:02.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda7747a700 1 -- 172.21.15.62:0/4185218809 wait complete. 2021-12-17T18:26:02.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.007+0000 7fda7747a700 1 Processor -- start 2021-12-17T18:26:02.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda7747a700 1 -- start start 2021-12-17T18:26:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda7747a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda700b15b0 0x7fda70063880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda7747a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda700b23c0 0x7fda70135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda7747a700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fda70143940 0x7fda700655a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda7747a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda70142fa0 con 0x7fda700b23c0 2021-12-17T18:26:02.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda7747a700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda70141b60 con 0x7fda70143940 2021-12-17T18:26:02.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda7747a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda70065140 con 0x7fda700b15b0 2021-12-17T18:26:02.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda75c77700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda700b23c0 0x7fda70135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:02.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda75c77700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda700b23c0 0x7fda70135790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54058/0 (socket says 172.21.15.62:54058) 2021-12-17T18:26:02.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda75c77700 1 -- 172.21.15.62:0/782419051 learned_addr learned my addr 172.21.15.62:0/782419051 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:02.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda76478700 1 --2- 172.21.15.62:0/782419051 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda700b15b0 0x7fda70063880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:02.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda76c79700 1 --2- 172.21.15.62:0/782419051 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fda70143940 0x7fda700655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:02.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda75c77700 1 -- 172.21.15.62:0/782419051 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda700b15b0 msgr2=0x7fda70063880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda75c77700 1 --2- 172.21.15.62:0/782419051 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda700b15b0 0x7fda70063880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda75c77700 1 -- 172.21.15.62:0/782419051 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fda70143940 msgr2=0x7fda700655a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda75c77700 1 --2- 172.21.15.62:0/782419051 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fda70143940 0x7fda700655a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda75c77700 1 -- 172.21.15.62:0/782419051 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda68009470 con 0x7fda700b23c0 2021-12-17T18:26:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda75c77700 1 --2- 172.21.15.62:0/782419051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda700b23c0 0x7fda70135790 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7fda70064fe0 tx=0x7fda6c007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:02.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda637fe700 1 -- 172.21.15.62:0/782419051 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda6c0070d0 con 0x7fda700b23c0 2021-12-17T18:26:02.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda637fe700 1 -- 172.21.15.62:0/782419051 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c007230 con 0x7fda700b23c0 2021-12-17T18:26:02.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda7747a700 1 -- 172.21.15.62:0/782419051 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda70141db0 con 0x7fda700b23c0 2021-12-17T18:26:02.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda637fe700 1 -- 172.21.15.62:0/782419051 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda6c005610 con 0x7fda700b23c0 2021-12-17T18:26:02.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.011+0000 7fda7747a700 1 -- 172.21.15.62:0/782419051 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda70143110 con 0x7fda700b23c0 2021-12-17T18:26:02.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.015+0000 7fda7747a700 1 -- 172.21.15.62:0/782419051 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda700b0440 con 0x7fda700b23c0 2021-12-17T18:26:02.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.015+0000 7fda637fe700 1 -- 172.21.15.62:0/782419051 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fda6c010070 con 0x7fda700b23c0 2021-12-17T18:26:02.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.015+0000 7fda637fe700 1 --2- 172.21.15.62:0/782419051 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fda500535b0 0x7fda50055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:02.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.015+0000 7fda637fe700 1 -- 172.21.15.62:0/782419051 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fda6c06acc0 con 0x7fda700b23c0 2021-12-17T18:26:02.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.015+0000 7fda76478700 1 --2- 172.21.15.62:0/782419051 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fda500535b0 0x7fda50055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:02.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.015+0000 7fda76478700 1 --2- 172.21.15.62:0/782419051 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fda500535b0 0x7fda50055a70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fda6400b000 tx=0x7fda64006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:02.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.023+0000 7fda637fe700 1 -- 172.21.15.62:0/782419051 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fda6c071080 con 0x7fda700b23c0 2021-12-17T18:26:02.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.151+0000 7fda7747a700 1 -- 172.21.15.62:0/782419051 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fda700573d0 con 0x7fda700b23c0 2021-12-17T18:26:02.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.159+0000 7fda637fe700 1 -- 172.21.15.62:0/782419051 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fda6c041ff0 con 0x7fda700b23c0 2021-12-17T18:26:02.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.163+0000 7fda7747a700 1 -- 172.21.15.62:0/782419051 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fda500535b0 msgr2=0x7fda50055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:02.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.163+0000 7fda7747a700 1 --2- 172.21.15.62:0/782419051 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fda500535b0 0x7fda50055a70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fda6400b000 tx=0x7fda64006df0).stop 2021-12-17T18:26:02.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.163+0000 7fda7747a700 1 -- 172.21.15.62:0/782419051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda700b23c0 msgr2=0x7fda70135790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:02.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.163+0000 7fda7747a700 1 --2- 172.21.15.62:0/782419051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda700b23c0 0x7fda70135790 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7fda70064fe0 tx=0x7fda6c007ad0).stop 2021-12-17T18:26:02.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.163+0000 7fda7747a700 1 -- 172.21.15.62:0/782419051 shutdown_connections 2021-12-17T18:26:02.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.163+0000 7fda7747a700 1 --2- 172.21.15.62:0/782419051 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fda500535b0 0x7fda50055a70 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:02.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.163+0000 7fda7747a700 1 --2- 172.21.15.62:0/782419051 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fda70143940 0x7fda700655a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:02.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.163+0000 7fda7747a700 1 --2- 172.21.15.62:0/782419051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda700b23c0 0x7fda70135790 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:02.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.163+0000 7fda7747a700 1 --2- 172.21.15.62:0/782419051 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fda700b15b0 0x7fda70063880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:02.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.163+0000 7fda7747a700 1 -- 172.21.15.62:0/782419051 >> 172.21.15.62:0/782419051 conn(0x7fda700b6550 msgr2=0x7fda70061b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:02.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.163+0000 7fda7747a700 1 -- 172.21.15.62:0/782419051 shutdown_connections 2021-12-17T18:26:02.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.163+0000 7fda7747a700 1 -- 172.21.15.62:0/782419051 wait complete. 2021-12-17T18:26:02.181 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-12-17T18:26:02.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.275+0000 7f5179490700 1 Processor -- start 2021-12-17T18:26:02.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f5179490700 1 -- start start 2021-12-17T18:26:02.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f5179490700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f51740b57e0 0x7f51740679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:02.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f5179490700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51740b2e90 con 0x7f51740ad360 2021-12-17T18:26:02.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f5179490700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51740b4b70 con 0x7f517405ffe0 2021-12-17T18:26:02.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f5179490700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51740b4e10 con 0x7f51740b57e0 2021-12-17T18:26:02.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f51737fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f51740b57e0 0x7f51740679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:02.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f51727fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f51740ad360 0x7f51741438a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37646/0 (socket says 172.21.15.62:37646) 2021-12-17T18:26:02.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f51727fc700 1 -- 172.21.15.62:0/4249877647 learned_addr learned my addr 172.21.15.62:0/4249877647 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:02.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f5171ffb700 1 -- 172.21.15.62:0/4249877647 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746206141 0 0) 0x7f51740b2e90 con 0x7f51740ad360 2021-12-17T18:26:02.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f5171ffb700 1 -- 172.21.15.62:0/4249877647 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f515c003260 con 0x7f51740ad360 2021-12-17T18:26:02.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f5171ffb700 1 -- 172.21.15.62:0/4249877647 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121234005 0 0) 0x7f51740b4b70 con 0x7f517405ffe0 2021-12-17T18:26:02.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f5171ffb700 1 -- 172.21.15.62:0/4249877647 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51740b2e90 con 0x7f517405ffe0 2021-12-17T18:26:02.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f51737fe700 1 -- 172.21.15.62:0/4249877647 >> v1:172.21.15.109:6789/0 conn(0x7f517405ffe0 legacy=0x7f51740b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:02.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f51737fe700 1 -- 172.21.15.62:0/4249877647 >> v1:172.21.15.62:6789/0 conn(0x7f51740ad360 legacy=0x7f51741438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:02.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f51737fe700 1 -- 172.21.15.62:0/4249877647 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51740b52b0 con 0x7f51740b57e0 2021-12-17T18:26:02.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f51737fe700 1 --2- 172.21.15.62:0/4249877647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51740b57e0 0x7f51740679c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f516c0032f0 tx=0x7f516c0091d0).ready entity=mon.0 client_cookie=e253b26740800110 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:02.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f5171ffb700 1 -- 172.21.15.62:0/4249877647 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f516c00b600 con 0x7f51740b57e0 2021-12-17T18:26:02.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f5171ffb700 1 -- 172.21.15.62:0/4249877647 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c00b760 con 0x7f51740b57e0 2021-12-17T18:26:02.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.279+0000 7f5171ffb700 1 -- 172.21.15.62:0/4249877647 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f516c00b8d0 con 0x7f51740b57e0 2021-12-17T18:26:02.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.283+0000 7f5179490700 1 -- 172.21.15.62:0/4249877647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51740b57e0 msgr2=0x7f51740679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:02.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.283+0000 7f5179490700 1 --2- 172.21.15.62:0/4249877647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51740b57e0 0x7f51740679c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f516c0032f0 tx=0x7f516c0091d0).stop 2021-12-17T18:26:02.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.283+0000 7f5179490700 1 -- 172.21.15.62:0/4249877647 shutdown_connections 2021-12-17T18:26:02.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.283+0000 7f5179490700 1 --2- 172.21.15.62:0/4249877647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51740b57e0 0x7f51740679c0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:02.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.283+0000 7f5179490700 1 -- 172.21.15.62:0/4249877647 >> 172.21.15.62:0/4249877647 conn(0x7f51740626d0 msgr2=0x7f517405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:02.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.283+0000 7f5179490700 1 -- 172.21.15.62:0/4249877647 shutdown_connections 2021-12-17T18:26:02.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.283+0000 7f5179490700 1 -- 172.21.15.62:0/4249877647 wait complete. 2021-12-17T18:26:02.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.283+0000 7f5179490700 1 Processor -- start 2021-12-17T18:26:02.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.283+0000 7f5179490700 1 -- start start 2021-12-17T18:26:02.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f5179490700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f517405ffe0 0x7f51740b8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:02.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f5179490700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51740ad360 0x7f5174065bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:02.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f5179490700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51740b57e0 0x7f5174067320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:02.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f5179490700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5174066260 con 0x7f51740b57e0 2021-12-17T18:26:02.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f5179490700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5174067810 con 0x7f517405ffe0 2021-12-17T18:26:02.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f5179490700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5174066be0 con 0x7f51740ad360 2021-12-17T18:26:02.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f51737fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51740b57e0 0x7f5174067320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:02.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f51737fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51740b57e0 0x7f5174067320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54072/0 (socket says 172.21.15.62:54072) 2021-12-17T18:26:02.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f51737fe700 1 -- 172.21.15.62:0/1468107489 learned_addr learned my addr 172.21.15.62:0/1468107489 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:02.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f5172ffd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f517405ffe0 0x7f51740b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:02.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f51727fc700 1 --2- 172.21.15.62:0/1468107489 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51740ad360 0x7f5174065bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:02.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f51737fe700 1 -- 172.21.15.62:0/1468107489 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51740ad360 msgr2=0x7f5174065bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:02.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f51737fe700 1 --2- 172.21.15.62:0/1468107489 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51740ad360 0x7f5174065bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:02.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f51737fe700 1 -- 172.21.15.62:0/1468107489 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f517405ffe0 msgr2=0x7f51740b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:02.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f51737fe700 1 --2- 172.21.15.62:0/1468107489 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f517405ffe0 0x7f51740b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:02.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f51737fe700 1 -- 172.21.15.62:0/1468107489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c009470 con 0x7f51740b57e0 2021-12-17T18:26:02.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f51737fe700 1 --2- 172.21.15.62:0/1468107489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51740b57e0 0x7f5174067320 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f516c0032f0 tx=0x7f516c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:02.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f516bfff700 1 -- 172.21.15.62:0/1468107489 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f516c00b600 con 0x7f51740b57e0 2021-12-17T18:26:02.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f516bfff700 1 -- 172.21.15.62:0/1468107489 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c021630 con 0x7f51740b57e0 2021-12-17T18:26:02.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f5179490700 1 -- 172.21.15.62:0/1468107489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5174066e80 con 0x7f51740b57e0 2021-12-17T18:26:02.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f516bfff700 1 -- 172.21.15.62:0/1468107489 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f516c021990 con 0x7f51740b57e0 2021-12-17T18:26:02.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f5179490700 1 -- 172.21.15.62:0/1468107489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51740664d0 con 0x7f51740b57e0 2021-12-17T18:26:02.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f516bfff700 1 -- 172.21.15.62:0/1468107489 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f516c027020 con 0x7f51740b57e0 2021-12-17T18:26:02.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.287+0000 7f5179490700 1 -- 172.21.15.62:0/1468107489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51740660b0 con 0x7f51740b57e0 2021-12-17T18:26:02.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.291+0000 7f516bfff700 1 --2- 172.21.15.62:0/1468107489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5150053580 0x7f5150055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:02.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.291+0000 7f516bfff700 1 -- 172.21.15.62:0/1468107489 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f516c06cb10 con 0x7f51740b57e0 2021-12-17T18:26:02.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.291+0000 7f5172ffd700 1 --2- 172.21.15.62:0/1468107489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5150053580 0x7f5150055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:02.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.291+0000 7f5172ffd700 1 --2- 172.21.15.62:0/1468107489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5150053580 0x7f5150055a40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f516400d000 tx=0x7f5164007a20).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:02.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.291+0000 7f516bfff700 1 -- 172.21.15.62:0/1468107489 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f516c043e40 con 0x7f51740b57e0 2021-12-17T18:26:02.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.463+0000 7f5179490700 1 -- 172.21.15.62:0/1468107489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7f5174067010 con 0x7f51740b57e0 2021-12-17T18:26:02.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.879+0000 7f516bfff700 1 -- 172.21.15.62:0/1468107489 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v340) v1 ==== 138+0+0 (secure 0 0 0) 0x7f516c015020 con 0x7f51740b57e0 2021-12-17T18:26:02.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.883+0000 7f5179490700 1 -- 172.21.15.62:0/1468107489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5150053580 msgr2=0x7f5150055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:02.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.883+0000 7f5179490700 1 --2- 172.21.15.62:0/1468107489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5150053580 0x7f5150055a40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f516400d000 tx=0x7f5164007a20).stop 2021-12-17T18:26:02.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.883+0000 7f5179490700 1 -- 172.21.15.62:0/1468107489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51740b57e0 msgr2=0x7f5174067320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:02.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.883+0000 7f5179490700 1 --2- 172.21.15.62:0/1468107489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51740b57e0 0x7f5174067320 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f516c0032f0 tx=0x7f516c016000).stop 2021-12-17T18:26:02.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.883+0000 7f5179490700 1 -- 172.21.15.62:0/1468107489 shutdown_connections 2021-12-17T18:26:02.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.883+0000 7f5179490700 1 --2- 172.21.15.62:0/1468107489 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5150053580 0x7f5150055a40 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:02.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.883+0000 7f5179490700 1 --2- 172.21.15.62:0/1468107489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51740b57e0 0x7f5174067320 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:02.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.883+0000 7f5179490700 1 --2- 172.21.15.62:0/1468107489 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51740ad360 0x7f5174065bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:02.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.883+0000 7f5179490700 1 --2- 172.21.15.62:0/1468107489 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f517405ffe0 0x7f51740b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:02.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.883+0000 7f5179490700 1 -- 172.21.15.62:0/1468107489 >> 172.21.15.62:0/1468107489 conn(0x7f51740626d0 msgr2=0x7f51740b91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:02.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.883+0000 7f5179490700 1 -- 172.21.15.62:0/1468107489 shutdown_connections 2021-12-17T18:26:02.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:02.883+0000 7f5179490700 1 -- 172.21.15.62:0/1468107489 wait complete. 2021-12-17T18:26:02.905 INFO:tasks.cephfs_test_runner:test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) ... ok 2021-12-17T18:26:02.906 INFO:tasks.cephfs_test_runner:Starting test: test_filtered_df (tasks.cephfs.test_misc.TestMisc) 2021-12-17T18:26:02.906 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-12-17T18:26:03.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.011+0000 7f376396a700 1 Processor -- start 2021-12-17T18:26:03.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.011+0000 7f376396a700 1 -- start start 2021-12-17T18:26:03.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.011+0000 7f376396a700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f375c067830 0x7f375c146940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:03.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.011+0000 7f376396a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f375c0aca60 0x7f375c146e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:03.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.011+0000 7f376396a700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375c067c10 con 0x7f375c0affc0 2021-12-17T18:26:03.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.011+0000 7f376396a700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375c0b2d40 con 0x7f375c067830 2021-12-17T18:26:03.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.011+0000 7f376396a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c060520 con 0x7f375c0aca60 2021-12-17T18:26:03.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.011+0000 7f3761706700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f375c067830 0x7f375c146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:03.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.011+0000 7f3761f07700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f375c0affc0 0x7f375c1436c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:53980/0 (socket says 172.21.15.62:53980) 2021-12-17T18:26:03.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f3760f05700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f375c0aca60 0x7f375c146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:03.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f3761f07700 1 -- 172.21.15.62:0/1660415948 learned_addr learned my addr 172.21.15.62:0/1660415948 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:03.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f3753fff700 1 -- 172.21.15.62:0/1660415948 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030058301 0 0) 0x7f375c067c10 con 0x7f375c0affc0 2021-12-17T18:26:03.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f3753fff700 1 -- 172.21.15.62:0/1660415948 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3740003260 con 0x7f375c0affc0 2021-12-17T18:26:03.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f3760f05700 1 -- 172.21.15.62:0/1660415948 >> v2:172.21.15.109:3300/0 conn(0x7f375c067830 msgr2=0x7f375c146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:03.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f3760f05700 1 --2- 172.21.15.62:0/1660415948 >> v2:172.21.15.109:3300/0 conn(0x7f375c067830 0x7f375c146940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:03.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f3760f05700 1 -- 172.21.15.62:0/1660415948 >> v1:172.21.15.109:6789/0 conn(0x7f375c0affc0 legacy=0x7f375c1436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:03.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f3760f05700 1 -- 172.21.15.62:0/1660415948 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c0acf00 con 0x7f375c0aca60 2021-12-17T18:26:03.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f3761706700 1 --2- 172.21.15.62:0/1660415948 >> v2:172.21.15.109:3300/0 conn(0x7f375c067830 0x7f375c146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:03.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f3760f05700 1 --2- 172.21.15.62:0/1660415948 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f375c0aca60 0x7f375c146e30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f3758002f70 tx=0x7f3758006df0).ready entity=mon.2 client_cookie=47e12f86826ae0b5 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:03.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f3753fff700 1 -- 172.21.15.62:0/1660415948 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f375800d4a0 con 0x7f375c0aca60 2021-12-17T18:26:03.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f3753fff700 1 -- 172.21.15.62:0/1660415948 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3758000e90 con 0x7f375c0aca60 2021-12-17T18:26:03.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f3753fff700 1 -- 172.21.15.62:0/1660415948 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f375800d7f0 con 0x7f375c0aca60 2021-12-17T18:26:03.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f376396a700 1 -- 172.21.15.62:0/1660415948 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f375c0aca60 msgr2=0x7f375c146e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:03.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f376396a700 1 --2- 172.21.15.62:0/1660415948 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f375c0aca60 0x7f375c146e30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f3758002f70 tx=0x7f3758006df0).stop 2021-12-17T18:26:03.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f376396a700 1 -- 172.21.15.62:0/1660415948 shutdown_connections 2021-12-17T18:26:03.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f376396a700 1 --2- 172.21.15.62:0/1660415948 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f375c0aca60 0x7f375c146e30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:03.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f376396a700 1 --2- 172.21.15.62:0/1660415948 >> v2:172.21.15.109:3300/0 conn(0x7f375c067830 0x7f375c146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:03.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f376396a700 1 -- 172.21.15.62:0/1660415948 >> 172.21.15.62:0/1660415948 conn(0x7f375c05f730 msgr2=0x7f375c05fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:03.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f376396a700 1 -- 172.21.15.62:0/1660415948 shutdown_connections 2021-12-17T18:26:03.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.015+0000 7f376396a700 1 -- 172.21.15.62:0/1660415948 wait complete. 2021-12-17T18:26:03.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f376396a700 1 Processor -- start 2021-12-17T18:26:03.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f376396a700 1 -- start start 2021-12-17T18:26:03.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f376396a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f375c067830 0x7f375c147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:03.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f376396a700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f375c0aca60 0x7f375c09eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:03.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f376396a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f375c0affc0 0x7f375c1404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:03.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f376396a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c147a60 con 0x7f375c067830 2021-12-17T18:26:03.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f376396a700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c153400 con 0x7f375c0aca60 2021-12-17T18:26:03.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f376396a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c1536a0 con 0x7f375c0affc0 2021-12-17T18:26:03.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f3761706700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f375c067830 0x7f375c147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:03.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f3761706700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f375c067830 0x7f375c147570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54082/0 (socket says 172.21.15.62:54082) 2021-12-17T18:26:03.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f3761706700 1 -- 172.21.15.62:0/2264850066 learned_addr learned my addr 172.21.15.62:0/2264850066 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:03.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f3760f05700 1 --2- 172.21.15.62:0/2264850066 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f375c0aca60 0x7f375c09eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:03.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f3761f07700 1 --2- 172.21.15.62:0/2264850066 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f375c0affc0 0x7f375c1404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:03.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f3761706700 1 -- 172.21.15.62:0/2264850066 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f375c0affc0 msgr2=0x7f375c1404a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:03.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f3761706700 1 --2- 172.21.15.62:0/2264850066 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f375c0affc0 0x7f375c1404a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:03.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f3761706700 1 -- 172.21.15.62:0/2264850066 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f375c0aca60 msgr2=0x7f375c09eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:03.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f3761706700 1 --2- 172.21.15.62:0/2264850066 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f375c0aca60 0x7f375c09eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:03.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f3761706700 1 -- 172.21.15.62:0/2264850066 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c00b180 con 0x7f375c067830 2021-12-17T18:26:03.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f3761706700 1 --2- 172.21.15.62:0/2264850066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f375c067830 0x7f375c147570 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f374c00c000 tx=0x7f374c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:03.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f37527fc700 1 -- 172.21.15.62:0/2264850066 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f374c00c890 con 0x7f375c067830 2021-12-17T18:26:03.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f37527fc700 1 -- 172.21.15.62:0/2264850066 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c00c9f0 con 0x7f375c067830 2021-12-17T18:26:03.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f376396a700 1 -- 172.21.15.62:0/2264850066 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375800b180 con 0x7f375c067830 2021-12-17T18:26:03.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f37527fc700 1 -- 172.21.15.62:0/2264850066 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f374c00cd50 con 0x7f375c067830 2021-12-17T18:26:03.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.019+0000 7f376396a700 1 -- 172.21.15.62:0/2264850066 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375c14adc0 con 0x7f375c067830 2021-12-17T18:26:03.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.023+0000 7f376396a700 1 -- 172.21.15.62:0/2264850066 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375c153a20 con 0x7f375c067830 2021-12-17T18:26:03.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.023+0000 7f37527fc700 1 -- 172.21.15.62:0/2264850066 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f374c01c460 con 0x7f375c067830 2021-12-17T18:26:03.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.023+0000 7f37527fc700 1 --2- 172.21.15.62:0/2264850066 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3744053610 0x7f3744055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:03.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.023+0000 7f37527fc700 1 -- 172.21.15.62:0/2264850066 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f374c06bc30 con 0x7f375c067830 2021-12-17T18:26:03.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.023+0000 7f3760f05700 1 --2- 172.21.15.62:0/2264850066 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3744053610 0x7f3744055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:03.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.023+0000 7f3760f05700 1 --2- 172.21.15.62:0/2264850066 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3744053610 0x7f3744055ad0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f375801a000 tx=0x7f3758014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:03.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.031+0000 7f37527fc700 1 -- 172.21.15.62:0/2264850066 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f374c043010 con 0x7f375c067830 2021-12-17T18:26:03.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.203+0000 7f376396a700 1 -- 172.21.15.62:0/2264850066 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7f375c0b12a0 con 0x7f375c067830 2021-12-17T18:26:03.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.887+0000 7f37527fc700 1 -- 172.21.15.62:0/2264850066 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v341) v1 ==== 130+0+0 (secure 0 0 0) 0x7f374c046630 con 0x7f375c067830 2021-12-17T18:26:03.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.891+0000 7f376396a700 1 -- 172.21.15.62:0/2264850066 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3744053610 msgr2=0x7f3744055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:03.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.891+0000 7f376396a700 1 --2- 172.21.15.62:0/2264850066 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3744053610 0x7f3744055ad0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f375801a000 tx=0x7f3758014000).stop 2021-12-17T18:26:03.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.891+0000 7f376396a700 1 -- 172.21.15.62:0/2264850066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f375c067830 msgr2=0x7f375c147570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:03.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.891+0000 7f376396a700 1 --2- 172.21.15.62:0/2264850066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f375c067830 0x7f375c147570 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f374c00c000 tx=0x7f374c006df0).stop 2021-12-17T18:26:03.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.891+0000 7f376396a700 1 -- 172.21.15.62:0/2264850066 shutdown_connections 2021-12-17T18:26:03.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.891+0000 7f376396a700 1 --2- 172.21.15.62:0/2264850066 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3744053610 0x7f3744055ad0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:03.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.891+0000 7f376396a700 1 --2- 172.21.15.62:0/2264850066 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f375c0affc0 0x7f375c1404a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:03.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.891+0000 7f376396a700 1 --2- 172.21.15.62:0/2264850066 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f375c0aca60 0x7f375c09eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:03.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.891+0000 7f376396a700 1 --2- 172.21.15.62:0/2264850066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f375c067830 0x7f375c147570 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:03.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.891+0000 7f376396a700 1 -- 172.21.15.62:0/2264850066 >> 172.21.15.62:0/2264850066 conn(0x7f375c05f730 msgr2=0x7f375c0aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:03.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.891+0000 7f376396a700 1 -- 172.21.15.62:0/2264850066 shutdown_connections 2021-12-17T18:26:03.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:03.891+0000 7f376396a700 1 -- 172.21.15.62:0/2264850066 wait complete. 2021-12-17T18:26:03.913 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-12-17T18:26:04.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.023+0000 7f9b7ffff700 1 Processor -- start 2021-12-17T18:26:04.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.023+0000 7f9b7ffff700 1 -- start start 2021-12-17T18:26:04.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9b800b47c0 0x7f9b800b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7ffff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f9b800b5be0 0x7f9b80143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7ffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b800b0870 con 0x7f9b8005ca90 2021-12-17T18:26:04.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7ffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8005ce70 con 0x7f9b800b47c0 2021-12-17T18:26:04.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7ffff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b800b05d0 con 0x7f9b800b5be0 2021-12-17T18:26:04.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b77fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9b800b47c0 0x7f9b800b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7effd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9b8005ca90 0x7f9b800b1d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37672/0 (socket says 172.21.15.62:37672) 2021-12-17T18:26:04.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7effd700 1 -- 172.21.15.62:0/2415742299 learned_addr learned my addr 172.21.15.62:0/2415742299 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:04.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7f7fe700 1 --2- 172.21.15.62:0/2415742299 >> v2:172.21.15.109:3300/0 conn(0x7f9b800b5be0 0x7f9b80143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b77fff700 1 -- 172.21.15.62:0/2415742299 >> v2:172.21.15.109:3300/0 conn(0x7f9b800b5be0 msgr2=0x7f9b80143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:04.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b77fff700 1 --2- 172.21.15.62:0/2415742299 >> v2:172.21.15.109:3300/0 conn(0x7f9b800b5be0 0x7f9b80143ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b77fff700 1 -- 172.21.15.62:0/2415742299 >> v1:172.21.15.62:6789/0 conn(0x7f9b8005ca90 legacy=0x7f9b800b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:04.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b77fff700 1 -- 172.21.15.62:0/2415742299 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b800b5250 con 0x7f9b800b47c0 2021-12-17T18:26:04.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7e7fc700 1 -- 172.21.15.62:0/2415742299 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879494248 0 0) 0x7f9b800b0870 con 0x7f9b8005ca90 2021-12-17T18:26:04.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7f7fe700 1 --2- 172.21.15.62:0/2415742299 >> v2:172.21.15.109:3300/0 conn(0x7f9b800b5be0 0x7f9b80143ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:04.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b77fff700 1 --2- 172.21.15.62:0/2415742299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b800b47c0 0x7f9b800b56f0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f9b68002f70 tx=0x7f9b68006df0).ready entity=mon.0 client_cookie=209294e36c8fd753 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:04.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7e7fc700 1 -- 172.21.15.62:0/2415742299 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b6800d5c0 con 0x7f9b800b47c0 2021-12-17T18:26:04.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7e7fc700 1 -- 172.21.15.62:0/2415742299 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b68000e90 con 0x7f9b800b47c0 2021-12-17T18:26:04.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7e7fc700 1 -- 172.21.15.62:0/2415742299 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b6800d910 con 0x7f9b800b47c0 2021-12-17T18:26:04.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7ffff700 1 -- 172.21.15.62:0/2415742299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b800b47c0 msgr2=0x7f9b800b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:04.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7ffff700 1 --2- 172.21.15.62:0/2415742299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b800b47c0 0x7f9b800b56f0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f9b68002f70 tx=0x7f9b68006df0).stop 2021-12-17T18:26:04.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7ffff700 1 -- 172.21.15.62:0/2415742299 shutdown_connections 2021-12-17T18:26:04.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7ffff700 1 --2- 172.21.15.62:0/2415742299 >> v2:172.21.15.109:3300/0 conn(0x7f9b800b5be0 0x7f9b80143ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7ffff700 1 --2- 172.21.15.62:0/2415742299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b800b47c0 0x7f9b800b56f0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.027+0000 7f9b7ffff700 1 -- 172.21.15.62:0/2415742299 >> 172.21.15.62:0/2415742299 conn(0x7f9b8005bcd0 msgr2=0x7f9b80062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:04.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.031+0000 7f9b7ffff700 1 -- 172.21.15.62:0/2415742299 shutdown_connections 2021-12-17T18:26:04.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.031+0000 7f9b7ffff700 1 -- 172.21.15.62:0/2415742299 wait complete. 2021-12-17T18:26:04.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.031+0000 7f9b7ffff700 1 Processor -- start 2021-12-17T18:26:04.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.031+0000 7f9b7ffff700 1 -- start start 2021-12-17T18:26:04.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.031+0000 7f9b7ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9b8005ca90 0x7f9b80148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.031+0000 7f9b7ffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9b800b47c0 0x7f9b80065520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.031+0000 7f9b7ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b800b5be0 0x7f9b80065a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.031+0000 7f9b7ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b80146020 con 0x7f9b800b5be0 2021-12-17T18:26:04.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.031+0000 7f9b7ffff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b801466b0 con 0x7f9b800b47c0 2021-12-17T18:26:04.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.031+0000 7f9b7ffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b801472c0 con 0x7f9b8005ca90 2021-12-17T18:26:04.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.031+0000 7f9b7f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b800b5be0 0x7f9b80065a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.031+0000 7f9b7f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b800b5be0 0x7f9b80065a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54102/0 (socket says 172.21.15.62:54102) 2021-12-17T18:26:04.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.031+0000 7f9b7f7fe700 1 -- 172.21.15.62:0/1440812858 learned_addr learned my addr 172.21.15.62:0/1440812858 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:04.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.031+0000 7f9b77fff700 1 --2- 172.21.15.62:0/1440812858 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9b800b47c0 0x7f9b80065520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.031+0000 7f9b7effd700 1 --2- 172.21.15.62:0/1440812858 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9b8005ca90 0x7f9b80148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.035+0000 7f9b7f7fe700 1 -- 172.21.15.62:0/1440812858 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9b8005ca90 msgr2=0x7f9b80148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:04.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.035+0000 7f9b7f7fe700 1 --2- 172.21.15.62:0/1440812858 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9b8005ca90 0x7f9b80148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.035+0000 7f9b7f7fe700 1 -- 172.21.15.62:0/1440812858 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9b800b47c0 msgr2=0x7f9b80065520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:04.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.035+0000 7f9b7f7fe700 1 --2- 172.21.15.62:0/1440812858 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9b800b47c0 0x7f9b80065520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.035+0000 7f9b7f7fe700 1 -- 172.21.15.62:0/1440812858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6800b180 con 0x7f9b800b5be0 2021-12-17T18:26:04.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.035+0000 7f9b7f7fe700 1 --2- 172.21.15.62:0/1440812858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b800b5be0 0x7f9b80065a10 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f9b801467f0 tx=0x7f9b78008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:04.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.035+0000 7f9b7cff9700 1 -- 172.21.15.62:0/1440812858 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b7800f710 con 0x7f9b800b5be0 2021-12-17T18:26:04.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.035+0000 7f9b7cff9700 1 -- 172.21.15.62:0/1440812858 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7800f870 con 0x7f9b800b5be0 2021-12-17T18:26:04.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.035+0000 7f9b7ffff700 1 -- 172.21.15.62:0/1440812858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b80146210 con 0x7f9b800b5be0 2021-12-17T18:26:04.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.035+0000 7f9b7cff9700 1 -- 172.21.15.62:0/1440812858 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b7800fbd0 con 0x7f9b800b5be0 2021-12-17T18:26:04.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.035+0000 7f9b7ffff700 1 -- 172.21.15.62:0/1440812858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b80066b30 con 0x7f9b800b5be0 2021-12-17T18:26:04.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.035+0000 7f9b7ffff700 1 -- 172.21.15.62:0/1440812858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b801463a0 con 0x7f9b800b5be0 2021-12-17T18:26:04.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.035+0000 7f9b7cff9700 1 -- 172.21.15.62:0/1440812858 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9b7801a030 con 0x7f9b800b5be0 2021-12-17T18:26:04.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.035+0000 7f9b7cff9700 1 --2- 172.21.15.62:0/1440812858 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9b64053610 0x7f9b64055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.035+0000 7f9b7cff9700 1 -- 172.21.15.62:0/1440812858 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f9b7806b540 con 0x7f9b800b5be0 2021-12-17T18:26:04.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.039+0000 7f9b7effd700 1 --2- 172.21.15.62:0/1440812858 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9b64053610 0x7f9b64055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.039+0000 7f9b7effd700 1 --2- 172.21.15.62:0/1440812858 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9b64053610 0x7f9b64055ad0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f9b7000d000 tx=0x7f9b70007a00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:04.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.043+0000 7f9b7cff9700 1 -- 172.21.15.62:0/1440812858 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9b78042980 con 0x7f9b800b5be0 2021-12-17T18:26:04.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.175+0000 7f9b7ffff700 1 -- 172.21.15.62:0/1440812858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9b800b3980 con 0x7f9b800b5be0 2021-12-17T18:26:04.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.183+0000 7f9b7cff9700 1 -- 172.21.15.62:0/1440812858 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9b78045fa0 con 0x7f9b800b5be0 2021-12-17T18:26:04.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.183+0000 7f9b7ffff700 1 -- 172.21.15.62:0/1440812858 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9b64053610 msgr2=0x7f9b64055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:04.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.183+0000 7f9b7ffff700 1 --2- 172.21.15.62:0/1440812858 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9b64053610 0x7f9b64055ad0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f9b7000d000 tx=0x7f9b70007a00).stop 2021-12-17T18:26:04.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.183+0000 7f9b7ffff700 1 -- 172.21.15.62:0/1440812858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b800b5be0 msgr2=0x7f9b80065a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:04.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.183+0000 7f9b7ffff700 1 --2- 172.21.15.62:0/1440812858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b800b5be0 0x7f9b80065a10 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f9b801467f0 tx=0x7f9b78008040).stop 2021-12-17T18:26:04.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.183+0000 7f9b7ffff700 1 -- 172.21.15.62:0/1440812858 shutdown_connections 2021-12-17T18:26:04.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.183+0000 7f9b7ffff700 1 --2- 172.21.15.62:0/1440812858 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9b64053610 0x7f9b64055ad0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.183+0000 7f9b7ffff700 1 --2- 172.21.15.62:0/1440812858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b800b5be0 0x7f9b80065a10 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.183+0000 7f9b7ffff700 1 --2- 172.21.15.62:0/1440812858 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9b800b47c0 0x7f9b80065520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.183+0000 7f9b7ffff700 1 --2- 172.21.15.62:0/1440812858 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9b8005ca90 0x7f9b80148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.183+0000 7f9b7ffff700 1 -- 172.21.15.62:0/1440812858 >> 172.21.15.62:0/1440812858 conn(0x7f9b8005bcd0 msgr2=0x7f9b8005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:04.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.183+0000 7f9b7ffff700 1 -- 172.21.15.62:0/1440812858 shutdown_connections 2021-12-17T18:26:04.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.183+0000 7f9b7ffff700 1 -- 172.21.15.62:0/1440812858 wait complete. 2021-12-17T18:26:04.202 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:26:04.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:26:04.222 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:26:04.244 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:26:04.263 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:26:04.284 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:26:04.306 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:26:04.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:04.307 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:04.307 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:04.314 INFO:teuthology.orchestra.run.smithi125.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-12-17T18:26:04.315 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:26:04.316 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-12-17T18:26:04.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:04.317 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:04.317 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:04.324 INFO:teuthology.orchestra.run.smithi158.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:26:04.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:26:04.326 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-12-17T18:26:04.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:04.327 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:04.327 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:26:04.335 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:26:04.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:26:04.336 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:26:04.337 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:26:04.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.439+0000 7fe3820e4700 1 Processor -- start 2021-12-17T18:26:04.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.439+0000 7fe3820e4700 1 -- start start 2021-12-17T18:26:04.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.439+0000 7fe3820e4700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe37c05ffe0 0x7fe37c0679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.439+0000 7fe3820e4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe37c0b57e0 0x7fe37c0b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.439+0000 7fe3820e4700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37c0b2e90 con 0x7fe37c0ad360 2021-12-17T18:26:04.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.439+0000 7fe3820e4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37c0b4b70 con 0x7fe37c0b57e0 2021-12-17T18:26:04.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.439+0000 7fe3820e4700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37c0b4e10 con 0x7fe37c05ffe0 2021-12-17T18:26:04.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.439+0000 7fe37bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe37c0b57e0 0x7fe37c0b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.439+0000 7fe37bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe37c0b57e0 0x7fe37c0b39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54110/0 (socket says 172.21.15.62:54110) 2021-12-17T18:26:04.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.439+0000 7fe37bfff700 1 -- 172.21.15.62:0/218860583 learned_addr learned my addr 172.21.15.62:0/218860583 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:04.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.443+0000 7fe37b7fe700 1 --2- 172.21.15.62:0/218860583 >> v2:172.21.15.109:3300/0 conn(0x7fe37c05ffe0 0x7fe37c0679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.443+0000 7fe37bfff700 1 -- 172.21.15.62:0/218860583 >> v2:172.21.15.109:3300/0 conn(0x7fe37c05ffe0 msgr2=0x7fe37c0679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:04.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.443+0000 7fe37bfff700 1 --2- 172.21.15.62:0/218860583 >> v2:172.21.15.109:3300/0 conn(0x7fe37c05ffe0 0x7fe37c0679c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.443+0000 7fe37bfff700 1 -- 172.21.15.62:0/218860583 >> v1:172.21.15.109:6789/0 conn(0x7fe37c0ad360 legacy=0x7fe37c0b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:04.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.443+0000 7fe37bfff700 1 -- 172.21.15.62:0/218860583 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c0b52b0 con 0x7fe37c0b57e0 2021-12-17T18:26:04.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.443+0000 7fe37bfff700 1 --2- 172.21.15.62:0/218860583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0b57e0 0x7fe37c0b39d0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7fe3740032f0 tx=0x7fe374009290).ready entity=mon.0 client_cookie=8771a87850127129 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:04.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.443+0000 7fe37a7fc700 1 -- 172.21.15.62:0/218860583 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37400b870 con 0x7fe37c0b57e0 2021-12-17T18:26:04.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.443+0000 7fe37a7fc700 1 -- 172.21.15.62:0/218860583 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37400b9d0 con 0x7fe37c0b57e0 2021-12-17T18:26:04.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.443+0000 7fe37a7fc700 1 -- 172.21.15.62:0/218860583 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37400bb40 con 0x7fe37c0b57e0 2021-12-17T18:26:04.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.443+0000 7fe3820e4700 1 -- 172.21.15.62:0/218860583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0b57e0 msgr2=0x7fe37c0b39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:04.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.443+0000 7fe3820e4700 1 --2- 172.21.15.62:0/218860583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0b57e0 0x7fe37c0b39d0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7fe3740032f0 tx=0x7fe374009290).stop 2021-12-17T18:26:04.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.443+0000 7fe3820e4700 1 -- 172.21.15.62:0/218860583 shutdown_connections 2021-12-17T18:26:04.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.443+0000 7fe3820e4700 1 --2- 172.21.15.62:0/218860583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0b57e0 0x7fe37c0b39d0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.443+0000 7fe3820e4700 1 --2- 172.21.15.62:0/218860583 >> v2:172.21.15.109:3300/0 conn(0x7fe37c05ffe0 0x7fe37c0679c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.443+0000 7fe3820e4700 1 -- 172.21.15.62:0/218860583 >> 172.21.15.62:0/218860583 conn(0x7fe37c0626d0 msgr2=0x7fe37c05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:04.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.443+0000 7fe3820e4700 1 -- 172.21.15.62:0/218860583 shutdown_connections 2021-12-17T18:26:04.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.443+0000 7fe3820e4700 1 -- 172.21.15.62:0/218860583 wait complete. 2021-12-17T18:26:04.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe3820e4700 1 Processor -- start 2021-12-17T18:26:04.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe3820e4700 1 -- start start 2021-12-17T18:26:04.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe3820e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c05ffe0 0x7fe37c0b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe3820e4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe37c0ad360 0x7fe37c156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe3820e4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe37c0b57e0 0x7fe37c1527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe3820e4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c064fb0 con 0x7fe37c05ffe0 2021-12-17T18:26:04.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe3820e4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c067500 con 0x7fe37c0b57e0 2021-12-17T18:26:04.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe3820e4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c156c40 con 0x7fe37c0ad360 2021-12-17T18:26:04.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe37b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c05ffe0 0x7fe37c0b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe37b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c05ffe0 0x7fe37c0b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54112/0 (socket says 172.21.15.62:54112) 2021-12-17T18:26:04.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe37b7fe700 1 -- 172.21.15.62:0/1241036147 learned_addr learned my addr 172.21.15.62:0/1241036147 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:04.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe37bfff700 1 --2- 172.21.15.62:0/1241036147 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe37c0b57e0 0x7fe37c1527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe37affd700 1 --2- 172.21.15.62:0/1241036147 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe37c0ad360 0x7fe37c156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe37b7fe700 1 -- 172.21.15.62:0/1241036147 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe37c0ad360 msgr2=0x7fe37c156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:04.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe37b7fe700 1 --2- 172.21.15.62:0/1241036147 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe37c0ad360 0x7fe37c156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe37b7fe700 1 -- 172.21.15.62:0/1241036147 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe37c0b57e0 msgr2=0x7fe37c1527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:04.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe37b7fe700 1 --2- 172.21.15.62:0/1241036147 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe37c0b57e0 0x7fe37c1527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe37b7fe700 1 -- 172.21.15.62:0/1241036147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe374009530 con 0x7fe37c05ffe0 2021-12-17T18:26:04.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.447+0000 7fe37b7fe700 1 --2- 172.21.15.62:0/1241036147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c05ffe0 0x7fe37c0b0000 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7fe37c067640 tx=0x7fe36c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:04.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.451+0000 7fe378ff9700 1 -- 172.21.15.62:0/1241036147 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe36c010780 con 0x7fe37c05ffe0 2021-12-17T18:26:04.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.451+0000 7fe378ff9700 1 -- 172.21.15.62:0/1241036147 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c0108e0 con 0x7fe37c05ffe0 2021-12-17T18:26:04.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.451+0000 7fe3820e4700 1 -- 172.21.15.62:0/1241036147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37c155d70 con 0x7fe37c05ffe0 2021-12-17T18:26:04.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.451+0000 7fe378ff9700 1 -- 172.21.15.62:0/1241036147 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe36c010c40 con 0x7fe37c05ffe0 2021-12-17T18:26:04.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.451+0000 7fe3820e4700 1 -- 172.21.15.62:0/1241036147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37c0651b0 con 0x7fe37c05ffe0 2021-12-17T18:26:04.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.451+0000 7fe3820e4700 1 -- 172.21.15.62:0/1241036147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37c156120 con 0x7fe37c05ffe0 2021-12-17T18:26:04.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.451+0000 7fe378ff9700 1 -- 172.21.15.62:0/1241036147 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe36c01c460 con 0x7fe37c05ffe0 2021-12-17T18:26:04.466 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.451+0000 7fe378ff9700 1 --2- 172.21.15.62:0/1241036147 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe35c0536a0 0x7fe35c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.466 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.451+0000 7fe378ff9700 1 -- 172.21.15.62:0/1241036147 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fe36c06ba00 con 0x7fe37c05ffe0 2021-12-17T18:26:04.466 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.455+0000 7fe37affd700 1 --2- 172.21.15.62:0/1241036147 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe35c0536a0 0x7fe35c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.466 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.455+0000 7fe37affd700 1 --2- 172.21.15.62:0/1241036147 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe35c0536a0 0x7fe35c055b60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fe37000d000 tx=0x7fe370000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:04.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.459+0000 7fe378ff9700 1 -- 172.21.15.62:0/1241036147 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe36c042de0 con 0x7fe37c05ffe0 2021-12-17T18:26:04.471 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:26:04.474 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:26:04.476 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:26:04.479 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:26:04.481 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:26:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.591+0000 7fe3820e4700 1 -- 172.21.15.62:0/1241036147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe37c0573d0 con 0x7fe37c05ffe0 2021-12-17T18:26:04.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.591+0000 7fe378ff9700 1 -- 172.21.15.62:0/1241036147 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v95) v1 ==== 81+0+28874 (secure 0 0 0) 0x7fe36c046400 con 0x7fe37c05ffe0 2021-12-17T18:26:04.599 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:04.599 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:26:04.599 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 95, 2021-12-17T18:26:04.600 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:26:04.600 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:26:04.600 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:26:01.865430+0000", 2021-12-17T18:26:04.601 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:26:04.601 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:26:04.601 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:26:04.601 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:26:04.601 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:26:04.602 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:26:04.602 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:26:04.602 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:26:04.602 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:26:04.603 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:26:04.603 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:26:04.603 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:26:04.603 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:26:04.604 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:26:04.604 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:26:04.604 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 18, 2021-12-17T18:26:04.604 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:26:04.605 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:26:04.605 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:26:04.605 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:26:04.605 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:26:04.606 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.606 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:26:04.606 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:26:04.606 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:26:04.606 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:26:04.607 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:26:04.607 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:26:04.607 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:26:04.607 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:26:04.608 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:26:04.608 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:26:04.608 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:26:04.608 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:26:04.609 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:26:04.609 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:26:04.609 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:26:04.609 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:26:04.609 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:26:04.610 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:26:04.610 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:26:04.610 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:26:04.610 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:26:04.611 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:26:04.611 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:26:04.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.611 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:26:04.612 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:26:04.612 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:26:04.612 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:26:04.612 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:26:04.612 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:26:04.613 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:26:04.613 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:26:04.613 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:26:04.613 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:26:04.614 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:26:04.614 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:26:04.614 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:26:04.614 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:26:04.615 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:26:04.615 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:26:04.615 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:26:04.615 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:26:04.615 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:26:04.616 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:26:04.616 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:26:04.616 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:26:04.616 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:26:04.617 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:26:04.617 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:26:04.617 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:26:04.617 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:26:04.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.618 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:26:04.618 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:26:04.618 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:26:04.619 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:26:04.619 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:26:04.619 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:26:04.619 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:26:04.619 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:26:04.620 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:26:04.620 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:26:04.620 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:26:04.620 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:26:04.621 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:26:04.621 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.621 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:26:04.621 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:26:04.622 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.622 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.622 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.622 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:26:04.622 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:26:04.623 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:26:04.623 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:26:04.623 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:26:04.623 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:26:04.624 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:26:04.624 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:26:04.624 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:26:04.624 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:26:04.625 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:26:04.625 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:26:04.625 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:26:04.625 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:26:04.625 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:26:04.626 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:26:04.626 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:26:04.626 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:26:04.626 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:26:04.627 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:26:04.627 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:26:04.627 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:26:04.627 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:26:04.628 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.628 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:26:04.628 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:26:04.628 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:26:04.628 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:26:04.629 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:26:04.629 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:26:04.629 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:26:04.629 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:26:04.630 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:26:04.630 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:26:04.630 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:26:04.630 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:26:04.631 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:26:04.631 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:26:04.631 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:26:04.631 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:26:04.632 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:26:04.632 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:26:04.632 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:26:04.632 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:26:04.632 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:26:04.633 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:26:04.633 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:26:04.633 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:26:04.633 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:26:04.634 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:26:04.634 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:26:04.634 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.634 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:26:04.635 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:26:04.635 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:26:04.635 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:26:04.635 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:26:04.636 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:26:04.636 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:26:04.636 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:26:04.636 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:26:04.636 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:26:04.637 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:26:04.637 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:26:04.637 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:26:04.637 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:26:04.638 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.638 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.638 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:26:04.638 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:26:04.639 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.639 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:26:04.639 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:26:04.639 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:04.640 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:04.640 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:04.640 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:04.640 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:04.640 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:04.641 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:04.641 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 88, 2021-12-17T18:26:04.641 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:04.641 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:04.642 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:04.642 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.642 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.642 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.643 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:26:04.643 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:04.643 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.643 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.643 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.644 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:26:04.644 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:04.644 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.644 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.645 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.645 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:04.645 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.645 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.646 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.646 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:26:04.646 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:04.646 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.646 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.647 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.647 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:26:04.647 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:04.647 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.648 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.648 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.648 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:04.648 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.649 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.649 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.649 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:26:04.649 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:04.649 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.650 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.650 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.650 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:26:04.650 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:04.651 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.651 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.651 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.651 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:04.652 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.652 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.652 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.652 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:26:04.652 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:04.653 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.653 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.653 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.653 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:26:04.654 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:04.654 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.654 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.654 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.655 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:26:04.655 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:26:04.655 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:26:04.655 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:26:04.656 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:04.656 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:04.656 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:04.656 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.656 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.657 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.657 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:26:04.657 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:26:04.657 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:04.658 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:04.658 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:04.658 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:04.658 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:04.659 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:04.659 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:04.659 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 88, 2021-12-17T18:26:04.659 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:04.660 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:04.660 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:04.660 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.660 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.660 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.661 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:26:04.661 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:04.661 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.662 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.662 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.662 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:26:04.662 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:04.663 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.663 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.663 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.663 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:04.664 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.664 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.664 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.664 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:26:04.665 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:04.665 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.665 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.666 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.666 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:26:04.667 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:04.667 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.667 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.667 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.668 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:04.668 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.668 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.668 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.668 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:26:04.669 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:04.669 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.669 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.669 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.670 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:26:04.670 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:04.670 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.670 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.671 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.671 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:04.671 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.671 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.672 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.672 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:26:04.672 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:04.672 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.673 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.673 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.673 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:26:04.673 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:04.673 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.674 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.674 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.674 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:26:04.674 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:26:04.675 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:26:04.675 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:26:04.675 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:04.675 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:04.676 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:04.676 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.676 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.676 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.677 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:26:04.677 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:26:04.677 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:04.677 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:04.678 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:04.678 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:04.678 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:04.678 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:04.679 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:04.679 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 89, 2021-12-17T18:26:04.679 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:04.679 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:04.680 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:04.680 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.680 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.680 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.680 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:26:04.681 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:04.681 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.681 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.681 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.682 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:26:04.682 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:04.682 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.682 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.683 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.683 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:04.683 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.683 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.683 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.684 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:26:04.684 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:04.684 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.684 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.685 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.685 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:26:04.685 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:04.685 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.685 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.686 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.686 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:04.686 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.686 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.687 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.687 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:26:04.687 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:04.687 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.688 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.688 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.688 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:26:04.688 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:04.688 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.689 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.689 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.689 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:04.689 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.690 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.690 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.690 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:26:04.690 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:04.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.691 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.691 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:26:04.691 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:04.692 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.692 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.692 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.692 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:26:04.693 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:26:04.693 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:26:04.693 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:26:04.693 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:04.694 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:04.694 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:04.694 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.694 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.694 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.695 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:26:04.695 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:26:04.695 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:04.695 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:04.696 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:04.696 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:04.696 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:04.696 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:04.697 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:04.697 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 90, 2021-12-17T18:26:04.697 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:04.697 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:04.698 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:04.698 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.698 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.698 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:26:04.699 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:04.699 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.699 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.699 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.700 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:26:04.700 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:04.700 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.700 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.700 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.701 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:04.701 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.701 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.701 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.702 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:26:04.702 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:04.702 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.702 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.703 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.703 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:26:04.703 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:04.703 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.703 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.704 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:04.704 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.704 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.705 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.705 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:26:04.705 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:04.705 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.706 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.706 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.706 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:26:04.706 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:04.707 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.707 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.707 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.707 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:04.708 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.708 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.708 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.708 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:26:04.708 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:04.709 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.709 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.709 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.709 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:26:04.710 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:04.710 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.710 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.710 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.711 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:26:04.711 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:26:04.711 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:26:04.711 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:26:04.711 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:04.712 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:04.712 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:04.712 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.712 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.713 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.713 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:26:04.713 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:26:04.713 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:04.713 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:04.714 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:04.714 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:04.714 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:04.714 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:04.715 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:04.715 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 87, 2021-12-17T18:26:04.715 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:04.715 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:04.716 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:04.716 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.716 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.716 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.716 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:26:04.717 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:04.717 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.717 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.717 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.718 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:26:04.718 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:04.718 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.718 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.719 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.719 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:04.719 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.719 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.720 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.720 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:26:04.720 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:04.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.720 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.721 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.721 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:26:04.721 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:04.721 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.722 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.722 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.722 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:04.722 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.723 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.723 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.723 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:26:04.723 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:04.723 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.724 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.724 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.724 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:26:04.724 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:04.725 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.725 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.725 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:04.726 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.726 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.726 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.726 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:26:04.726 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:04.727 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.727 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.727 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.727 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:26:04.728 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:04.728 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.728 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.728 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.728 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:26:04.729 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:26:04.729 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:26:04.729 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:26:04.730 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:04.730 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:04.730 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:04.730 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.730 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.731 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.731 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:26:04.731 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:26:04.731 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:04.732 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:04.732 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:04.732 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:04.732 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:04.733 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:04.733 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:04.733 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 79, 2021-12-17T18:26:04.733 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:04.734 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:04.734 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:04.734 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.734 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.734 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.735 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:26:04.735 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:04.735 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.735 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.736 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.736 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:26:04.736 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:04.736 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.737 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.737 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.737 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:04.737 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.738 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.738 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.738 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:26:04.738 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:04.738 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.739 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.739 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.739 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:26:04.739 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:04.740 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.740 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.740 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.740 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:04.741 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.741 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.741 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.741 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:26:04.741 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:04.742 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.742 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.742 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.742 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:26:04.743 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:04.743 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.743 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.743 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.744 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:04.744 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.744 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.744 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.744 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:26:04.745 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:04.745 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.745 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.745 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.746 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:26:04.746 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:04.746 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.746 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.747 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.747 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:26:04.747 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:26:04.747 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:26:04.747 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:26:04.748 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:04.748 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:04.748 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:04.748 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.749 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.749 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.749 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:26:04.749 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:26:04.750 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:04.750 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:04.750 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:04.750 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:04.750 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:04.751 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:04.751 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:04.751 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 87, 2021-12-17T18:26:04.751 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:04.752 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:04.752 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:04.752 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.752 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.752 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.753 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:26:04.753 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:04.753 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.753 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.754 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.754 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:26:04.754 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:04.754 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.755 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.755 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.755 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:04.755 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.756 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.756 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.756 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:26:04.756 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:04.757 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.757 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.757 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.757 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:26:04.757 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:04.758 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.758 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.758 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.759 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:04.759 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.759 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.759 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.759 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:26:04.760 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:04.760 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.760 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.760 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.761 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:26:04.761 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:04.761 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.761 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.762 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.762 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:04.762 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.762 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.763 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.763 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:26:04.763 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:04.763 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.763 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.764 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.764 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:26:04.764 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:04.764 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.765 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.765 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.765 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:26:04.765 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:26:04.766 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:26:04.766 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:26:04.766 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:04.766 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:04.767 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:04.767 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.767 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.767 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.767 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:26:04.768 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:26:04.768 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:04.768 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:04.768 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:04.769 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:04.769 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:04.769 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:04.769 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:04.770 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 88, 2021-12-17T18:26:04.770 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:04.770 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:04.770 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:04.770 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.771 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.771 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.771 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:26:04.771 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:04.772 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.772 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.772 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.772 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:26:04.773 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:04.773 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.773 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.773 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.774 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:04.774 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.774 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.774 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.774 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:26:04.775 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:04.775 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.775 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.775 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.776 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:26:04.776 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:04.776 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.776 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.777 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.777 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:04.777 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.777 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.778 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.778 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:26:04.778 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:04.778 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.779 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.779 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.779 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:26:04.779 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:04.780 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.780 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.780 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.780 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:04.781 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:04.781 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.781 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:04.781 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:26:04.782 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:04.782 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.782 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.782 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:04.783 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:26:04.783 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:04.783 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.783 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.784 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.784 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:26:04.784 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:26:04.784 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:26:04.785 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:26:04.785 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:04.785 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:04.785 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:04.786 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:04.786 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.786 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:26:04.786 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:26:04.787 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.787 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:26:04.787 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:04.787 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:04.787 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:04.788 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:04.788 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:04.788 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:26:04.788 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:04.789 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.789 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.789 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:26:04.789 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:04.790 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:04.790 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:04.790 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:04.790 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:04.791 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:26:04.791 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:04.791 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.791 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.792 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:26:04.792 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:04.792 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:04.792 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:04.793 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:04.793 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:04.793 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:26:04.793 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:04.793 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.794 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.794 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:26:04.794 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:04.794 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:04.795 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:04.795 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:04.795 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:04.795 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:26:04.796 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:04.796 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.796 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.796 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:26:04.796 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:04.797 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:04.797 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:04.797 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:04.797 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:04.798 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:26:04.798 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:04.798 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.798 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.799 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:26:04.799 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:04.799 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:04.799 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:04.799 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:04.800 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:04.800 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:26:04.800 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:04.800 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.801 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.801 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:26:04.801 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:04.801 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:04.801 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:04.802 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:04.802 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:04.802 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:26:04.802 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:04.803 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.803 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:04.803 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:26:04.803 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:04.804 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:04.804 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:04.804 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:04.804 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:04.804 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:26:04.805 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:04.805 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.805 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:26:04.805 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:26:04.806 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:26:04.806 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:26:04.806 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:26:04.806 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": { 2021-12-17T18:26:04.806 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6833/994270358": "2021-12-18T18:25:57.713721+0000", 2021-12-17T18:26:04.807 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6832/994270358": "2021-12-18T18:25:57.713721+0000" 2021-12-17T18:26:04.807 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.807 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:26:04.807 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:26:04.808 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:26:04.808 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:26:04.808 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:26:04.808 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:26:04.809 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:26:04.809 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:26:04.809 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:04.809 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:04.809 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:26:04.810 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:26:04.810 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:26:04.810 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:26:04.810 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:26:04.811 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:26:04.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.595+0000 7fe3820e4700 1 -- 172.21.15.62:0/1241036147 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe35c0536a0 msgr2=0x7fe35c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:04.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.595+0000 7fe3820e4700 1 --2- 172.21.15.62:0/1241036147 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe35c0536a0 0x7fe35c055b60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fe37000d000 tx=0x7fe370000bc0).stop 2021-12-17T18:26:04.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.595+0000 7fe3820e4700 1 -- 172.21.15.62:0/1241036147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c05ffe0 msgr2=0x7fe37c0b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:04.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.595+0000 7fe3820e4700 1 --2- 172.21.15.62:0/1241036147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c05ffe0 0x7fe37c0b0000 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7fe37c067640 tx=0x7fe36c006df0).stop 2021-12-17T18:26:04.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.595+0000 7fe3820e4700 1 -- 172.21.15.62:0/1241036147 shutdown_connections 2021-12-17T18:26:04.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.595+0000 7fe3820e4700 1 --2- 172.21.15.62:0/1241036147 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe35c0536a0 0x7fe35c055b60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.595+0000 7fe3820e4700 1 --2- 172.21.15.62:0/1241036147 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe37c0b57e0 0x7fe37c1527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.595+0000 7fe3820e4700 1 --2- 172.21.15.62:0/1241036147 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe37c0ad360 0x7fe37c156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.595+0000 7fe3820e4700 1 --2- 172.21.15.62:0/1241036147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c05ffe0 0x7fe37c0b0000 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.595+0000 7fe3820e4700 1 -- 172.21.15.62:0/1241036147 >> 172.21.15.62:0/1241036147 conn(0x7fe37c0626d0 msgr2=0x7fe37c1433c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:04.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.595+0000 7fe3820e4700 1 -- 172.21.15.62:0/1241036147 shutdown_connections 2021-12-17T18:26:04.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.595+0000 7fe3820e4700 1 -- 172.21.15.62:0/1241036147 wait complete. 2021-12-17T18:26:04.816 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:26:04.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858759e700 1 Processor -- start 2021-12-17T18:26:04.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858759e700 1 -- start start 2021-12-17T18:26:04.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858759e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f8588141480 0x7f8588147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85880a8e10 0x7f85880b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8588147610 con 0x7f85880b6050 2021-12-17T18:26:04.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858759e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85881478b0 con 0x7f8588141480 2021-12-17T18:26:04.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8588147b50 con 0x7f85880a8e10 2021-12-17T18:26:04.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f8586d9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f85880b6050 0x7f85880a7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37704/0 (socket says 172.21.15.62:37704) 2021-12-17T18:26:04.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f8586d9d700 1 -- 172.21.15.62:0/1823740818 learned_addr learned my addr 172.21.15.62:0/1823740818 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:04.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f8585d9b700 1 --2- 172.21.15.62:0/1823740818 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85880a8e10 0x7f85880b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858659c700 1 --2- 172.21.15.62:0/1823740818 >> v2:172.21.15.109:3300/0 conn(0x7f8588141480 0x7f8588147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 -- 172.21.15.62:0/1823740818 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875474726 0 0) 0x7f8588147610 con 0x7f85880b6050 2021-12-17T18:26:04.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 -- 172.21.15.62:0/1823740818 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f856c003260 con 0x7f85880b6050 2021-12-17T18:26:04.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 -- 172.21.15.62:0/1823740818 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 716226584 0 0) 0x7f856c003260 con 0x7f85880b6050 2021-12-17T18:26:04.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 -- 172.21.15.62:0/1823740818 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85880a8e10 msgr2=0x7f85880b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:04.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 --2- 172.21.15.62:0/1823740818 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85880a8e10 0x7f85880b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 -- 172.21.15.62:0/1823740818 >> v2:172.21.15.109:3300/0 conn(0x7f8588141480 msgr2=0x7f8588147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:04.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 --2- 172.21.15.62:0/1823740818 >> v2:172.21.15.109:3300/0 conn(0x7f8588141480 0x7f8588147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 -- 172.21.15.62:0/1823740818 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85880b1b90 con 0x7f85880b6050 2021-12-17T18:26:04.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 -- 172.21.15.62:0/1823740818 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f8580001660 con 0x7f85880b6050 2021-12-17T18:26:04.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f8585d9b700 1 --2- 172.21.15.62:0/1823740818 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85880a8e10 0x7f85880b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:04.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 -- 172.21.15.62:0/1823740818 >> v1:172.21.15.62:6789/0 conn(0x7f85880b6050 legacy=0x7f85880a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:04.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 --2- 172.21.15.62:0/1823740818 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85880a8e10 0x7f856c003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 --2- 172.21.15.62:0/1823740818 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f856c003c60 0x7f856c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 --2- 172.21.15.62:0/1823740818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f856c0049f0 0x7f856c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 -- 172.21.15.62:0/1823740818 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85881478b0 con 0x7f856c0049f0 2021-12-17T18:26:04.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 -- 172.21.15.62:0/1823740818 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8588147b50 con 0x7f856c003c60 2021-12-17T18:26:04.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 -- 172.21.15.62:0/1823740818 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c00b750 con 0x7f85880a8e10 2021-12-17T18:26:04.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f8586d9d700 1 --2- 172.21.15.62:0/1823740818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f856c0049f0 0x7f856c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858659c700 1 --2- 172.21.15.62:0/1823740818 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85880a8e10 0x7f856c003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f8585d9b700 1 --2- 172.21.15.62:0/1823740818 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f856c003c60 0x7f856c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f8586d9d700 1 -- 172.21.15.62:0/1823740818 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85880a8e10 msgr2=0x7f856c003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:04.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f8586d9d700 1 --2- 172.21.15.62:0/1823740818 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85880a8e10 0x7f856c003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f8586d9d700 1 -- 172.21.15.62:0/1823740818 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f856c003c60 msgr2=0x7f856c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:04.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f8586d9d700 1 --2- 172.21.15.62:0/1823740818 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f856c003c60 0x7f856c004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f8586d9d700 1 -- 172.21.15.62:0/1823740818 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8578009470 con 0x7f856c0049f0 2021-12-17T18:26:04.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f8586d9d700 1 --2- 172.21.15.62:0/1823740818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f856c0049f0 0x7f856c004e70 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f856c004470 tx=0x7f8580001e50).ready entity=mon.0 client_cookie=f1c3ae1504a8db32 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:04.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 -- 172.21.15.62:0/1823740818 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85800070d0 con 0x7f856c0049f0 2021-12-17T18:26:04.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 -- 172.21.15.62:0/1823740818 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8580007230 con 0x7f856c0049f0 2021-12-17T18:26:04.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.927+0000 7f858559a700 1 -- 172.21.15.62:0/1823740818 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f858000c980 con 0x7f856c0049f0 2021-12-17T18:26:04.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f858759e700 1 -- 172.21.15.62:0/1823740818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f856c0049f0 msgr2=0x7f856c004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:04.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f858759e700 1 --2- 172.21.15.62:0/1823740818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f856c0049f0 0x7f856c004e70 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f856c004470 tx=0x7f8580001e50).stop 2021-12-17T18:26:04.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f8586d9d700 1 -- 172.21.15.62:0/1823740818 reap_dead start 2021-12-17T18:26:04.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f858759e700 1 -- 172.21.15.62:0/1823740818 shutdown_connections 2021-12-17T18:26:04.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f858759e700 1 -- 172.21.15.62:0/1823740818 >> 172.21.15.62:0/1823740818 conn(0x7f858805d220 msgr2=0x7f85880b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:04.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f858759e700 1 -- 172.21.15.62:0/1823740818 shutdown_connections 2021-12-17T18:26:04.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f858759e700 1 -- 172.21.15.62:0/1823740818 wait complete. 2021-12-17T18:26:04.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f858759e700 1 Processor -- start 2021-12-17T18:26:04.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f858759e700 1 -- start start 2021-12-17T18:26:04.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f858759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f856c0049f0 0x7f858815add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f858759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f858814b390 0x7f85880635a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f858759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85880664c0 0x7f8588066940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f858759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8588063a90 con 0x7f85880664c0 2021-12-17T18:26:04.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f858759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85880a9330 con 0x7f858814b390 2021-12-17T18:26:04.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f858759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8588063cd0 con 0x7f856c0049f0 2021-12-17T18:26:04.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f8586d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85880664c0 0x7f8588066940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f8586d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85880664c0 0x7f8588066940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54136/0 (socket says 172.21.15.62:54136) 2021-12-17T18:26:04.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f8586d9d700 1 -- 172.21.15.62:0/109615349 learned_addr learned my addr 172.21.15.62:0/109615349 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:04.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f8585d9b700 1 --2- 172.21.15.62:0/109615349 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f858814b390 0x7f85880635a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f858659c700 1 --2- 172.21.15.62:0/109615349 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f856c0049f0 0x7f858815add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f8586d9d700 1 -- 172.21.15.62:0/109615349 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f856c0049f0 msgr2=0x7f858815add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:04.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f8586d9d700 1 --2- 172.21.15.62:0/109615349 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f856c0049f0 0x7f858815add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f8586d9d700 1 -- 172.21.15.62:0/109615349 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f858814b390 msgr2=0x7f85880635a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:04.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f8586d9d700 1 --2- 172.21.15.62:0/109615349 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f858814b390 0x7f85880635a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:04.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f8586d9d700 1 -- 172.21.15.62:0/109615349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8588063f70 con 0x7f85880664c0 2021-12-17T18:26:04.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f8586d9d700 1 --2- 172.21.15.62:0/109615349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85880664c0 0x7f8588066940 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f8588061fe0 tx=0x7f8580015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:04.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f85777fe700 1 -- 172.21.15.62:0/109615349 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8580004710 con 0x7f85880664c0 2021-12-17T18:26:04.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f858759e700 1 -- 172.21.15.62:0/109615349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8588066e30 con 0x7f85880664c0 2021-12-17T18:26:04.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f85777fe700 1 -- 172.21.15.62:0/109615349 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8580004870 con 0x7f85880664c0 2021-12-17T18:26:04.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f85777fe700 1 -- 172.21.15.62:0/109615349 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8580004bd0 con 0x7f85880664c0 2021-12-17T18:26:04.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.931+0000 7f858759e700 1 -- 172.21.15.62:0/109615349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85880a9fe0 con 0x7f85880664c0 2021-12-17T18:26:04.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.935+0000 7f858759e700 1 -- 172.21.15.62:0/109615349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85880573d0 con 0x7f85880664c0 2021-12-17T18:26:04.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.935+0000 7f85777fe700 1 -- 172.21.15.62:0/109615349 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8580027070 con 0x7f85880664c0 2021-12-17T18:26:04.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.935+0000 7f85777fe700 1 --2- 172.21.15.62:0/109615349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8564053610 0x7f8564055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:04.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.935+0000 7f85777fe700 1 -- 172.21.15.62:0/109615349 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f858006c000 con 0x7f85880664c0 2021-12-17T18:26:04.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.935+0000 7f858659c700 1 --2- 172.21.15.62:0/109615349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8564053610 0x7f8564055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:04.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.935+0000 7f858659c700 1 --2- 172.21.15.62:0/109615349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8564053610 0x7f8564055ad0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f857c00b000 tx=0x7f857c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:04.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:04.943+0000 7f85777fe700 1 -- 172.21.15.62:0/109615349 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f85800433a0 con 0x7f85880664c0 2021-12-17T18:26:05.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.103+0000 7f858759e700 1 -- 172.21.15.62:0/109615349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85880684f0 con 0x7f85880664c0 2021-12-17T18:26:05.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.107+0000 7f85777fe700 1 -- 172.21.15.62:0/109615349 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+1212 (secure 0 0 0) 0x7f85800469c0 con 0x7f85880664c0 2021-12-17T18:26:05.113 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:05.113 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":46,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.109:6835/1223620032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1223620032},{"type":"v1","addr":"172.21.15.109:6835","nonce":1223620032}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":42},{"gid":7287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6833/2260051905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2260051905},{"type":"v1","addr":"172.21.15.62:6833","nonce":2260051905}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46}],"filesystems":[]} 2021-12-17T18:26:05.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.107+0000 7f858759e700 1 -- 172.21.15.62:0/109615349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8564053610 msgr2=0x7f8564055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:05.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.107+0000 7f858759e700 1 --2- 172.21.15.62:0/109615349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8564053610 0x7f8564055ad0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f857c00b000 tx=0x7f857c008040).stop 2021-12-17T18:26:05.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.107+0000 7f858759e700 1 -- 172.21.15.62:0/109615349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85880664c0 msgr2=0x7f8588066940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:05.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.107+0000 7f858759e700 1 --2- 172.21.15.62:0/109615349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85880664c0 0x7f8588066940 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f8588061fe0 tx=0x7f8580015000).stop 2021-12-17T18:26:05.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.107+0000 7f858759e700 1 -- 172.21.15.62:0/109615349 shutdown_connections 2021-12-17T18:26:05.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.107+0000 7f858759e700 1 --2- 172.21.15.62:0/109615349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8564053610 0x7f8564055ad0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.107+0000 7f858759e700 1 --2- 172.21.15.62:0/109615349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85880664c0 0x7f8588066940 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.107+0000 7f858759e700 1 --2- 172.21.15.62:0/109615349 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f858814b390 0x7f85880635a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.107+0000 7f858759e700 1 --2- 172.21.15.62:0/109615349 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f856c0049f0 0x7f858815add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.107+0000 7f858759e700 1 -- 172.21.15.62:0/109615349 >> 172.21.15.62:0/109615349 conn(0x7f858805d220 msgr2=0x7f8588146c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:05.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.107+0000 7f858759e700 1 -- 172.21.15.62:0/109615349 shutdown_connections 2021-12-17T18:26:05.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.107+0000 7f858759e700 1 -- 172.21.15.62:0/109615349 wait complete. 2021-12-17T18:26:05.118 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 46 2021-12-17T18:26:05.126 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:26:05.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.223+0000 7fd579477700 1 Processor -- start 2021-12-17T18:26:05.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.223+0000 7fd579477700 1 -- start start 2021-12-17T18:26:05.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.223+0000 7fd579477700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd5740b3760 0x7fd5740b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:05.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.223+0000 7fd579477700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd5741458d0 0x7fd574145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:05.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.223+0000 7fd579477700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5740b5f00 con 0x7fd5740b5b20 2021-12-17T18:26:05.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.223+0000 7fd579477700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5740b3020 con 0x7fd5741458d0 2021-12-17T18:26:05.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.223+0000 7fd579477700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5740b32c0 con 0x7fd5740b3760 2021-12-17T18:26:05.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.223+0000 7fd578c76700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd5741458d0 0x7fd574145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:05.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd578c76700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd5741458d0 0x7fd574145cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54144/0 (socket says 172.21.15.62:54144) 2021-12-17T18:26:05.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd578c76700 1 -- 172.21.15.62:0/3156194115 learned_addr learned my addr 172.21.15.62:0/3156194115 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:05.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd5737fe700 1 --2- 172.21.15.62:0/3156194115 >> v2:172.21.15.109:3300/0 conn(0x7fd5740b3760 0x7fd5740b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:05.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd5737fe700 1 -- 172.21.15.62:0/3156194115 >> v2:172.21.15.62:3300/0 conn(0x7fd5741458d0 msgr2=0x7fd574145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:05.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd5737fe700 1 --2- 172.21.15.62:0/3156194115 >> v2:172.21.15.62:3300/0 conn(0x7fd5741458d0 0x7fd574145cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd5737fe700 1 -- 172.21.15.62:0/3156194115 >> v1:172.21.15.109:6789/0 conn(0x7fd5740b5b20 legacy=0x7fd5740b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:05.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd5737fe700 1 -- 172.21.15.62:0/3156194115 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5740b6e90 con 0x7fd5740b3760 2021-12-17T18:26:05.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd5737fe700 1 --2- 172.21.15.62:0/3156194115 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd5740b3760 0x7fd5740b69a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fd564002f70 tx=0x7fd564006df0).ready entity=mon.1 client_cookie=fcd350a6375e591a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:05.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd572ffd700 1 -- 172.21.15.62:0/3156194115 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd56400d570 con 0x7fd5740b3760 2021-12-17T18:26:05.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd572ffd700 1 -- 172.21.15.62:0/3156194115 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd564000e90 con 0x7fd5740b3760 2021-12-17T18:26:05.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd572ffd700 1 -- 172.21.15.62:0/3156194115 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd56400d8c0 con 0x7fd5740b3760 2021-12-17T18:26:05.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd579477700 1 -- 172.21.15.62:0/3156194115 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd5740b3760 msgr2=0x7fd5740b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:05.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd579477700 1 --2- 172.21.15.62:0/3156194115 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd5740b3760 0x7fd5740b69a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fd564002f70 tx=0x7fd564006df0).stop 2021-12-17T18:26:05.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd579477700 1 -- 172.21.15.62:0/3156194115 shutdown_connections 2021-12-17T18:26:05.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd579477700 1 --2- 172.21.15.62:0/3156194115 >> v2:172.21.15.62:3300/0 conn(0x7fd5741458d0 0x7fd574145cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd579477700 1 --2- 172.21.15.62:0/3156194115 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd5740b3760 0x7fd5740b69a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd579477700 1 -- 172.21.15.62:0/3156194115 >> 172.21.15.62:0/3156194115 conn(0x7fd57405c750 msgr2=0x7fd57405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:05.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd579477700 1 -- 172.21.15.62:0/3156194115 shutdown_connections 2021-12-17T18:26:05.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd579477700 1 -- 172.21.15.62:0/3156194115 wait complete. 2021-12-17T18:26:05.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd579477700 1 Processor -- start 2021-12-17T18:26:05.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.227+0000 7fd579477700 1 -- start start 2021-12-17T18:26:05.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd579477700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5740b5b20 0x7fd5740647b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:05.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd579477700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd5741458d0 0x7fd574152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:05.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd579477700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd574066780 0x7fd574144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:05.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd579477700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd574064ca0 con 0x7fd5740b5b20 2021-12-17T18:26:05.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd579477700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd574152a30 con 0x7fd574066780 2021-12-17T18:26:05.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd579477700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd574064ec0 con 0x7fd5741458d0 2021-12-17T18:26:05.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd573fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5740b5b20 0x7fd5740647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:05.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd573fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5740b5b20 0x7fd5740647b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54148/0 (socket says 172.21.15.62:54148) 2021-12-17T18:26:05.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd573fff700 1 -- 172.21.15.62:0/1126691711 learned_addr learned my addr 172.21.15.62:0/1126691711 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:05.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd578c76700 1 --2- 172.21.15.62:0/1126691711 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd574066780 0x7fd574144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:05.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd5737fe700 1 --2- 172.21.15.62:0/1126691711 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd5741458d0 0x7fd574152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:05.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd573fff700 1 -- 172.21.15.62:0/1126691711 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd5741458d0 msgr2=0x7fd574152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:05.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd573fff700 1 --2- 172.21.15.62:0/1126691711 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd5741458d0 0x7fd574152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd573fff700 1 -- 172.21.15.62:0/1126691711 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd574066780 msgr2=0x7fd574144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:05.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd573fff700 1 --2- 172.21.15.62:0/1126691711 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd574066780 0x7fd574144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd573fff700 1 -- 172.21.15.62:0/1126691711 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56400b180 con 0x7fd5740b5b20 2021-12-17T18:26:05.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd573fff700 1 --2- 172.21.15.62:0/1126691711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5740b5b20 0x7fd5740647b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7fd5740b97b0 tx=0x7fd568007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:05.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd5717fa700 1 -- 172.21.15.62:0/1126691711 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd568007030 con 0x7fd5740b5b20 2021-12-17T18:26:05.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd5717fa700 1 -- 172.21.15.62:0/1126691711 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd568007190 con 0x7fd5740b5b20 2021-12-17T18:26:05.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd579477700 1 -- 172.21.15.62:0/1126691711 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd574065160 con 0x7fd5740b5b20 2021-12-17T18:26:05.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd5717fa700 1 -- 172.21.15.62:0/1126691711 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd568006510 con 0x7fd5740b5b20 2021-12-17T18:26:05.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd579477700 1 -- 172.21.15.62:0/1126691711 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5741449f0 con 0x7fd5740b5b20 2021-12-17T18:26:05.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.231+0000 7fd579477700 1 -- 172.21.15.62:0/1126691711 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5740573d0 con 0x7fd5740b5b20 2021-12-17T18:26:05.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.235+0000 7fd5717fa700 1 -- 172.21.15.62:0/1126691711 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd568010030 con 0x7fd5740b5b20 2021-12-17T18:26:05.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.235+0000 7fd5717fa700 1 --2- 172.21.15.62:0/1126691711 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd554053610 0x7fd554055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:05.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.235+0000 7fd5717fa700 1 -- 172.21.15.62:0/1126691711 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fd56806b1b0 con 0x7fd5740b5b20 2021-12-17T18:26:05.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.235+0000 7fd5737fe700 1 --2- 172.21.15.62:0/1126691711 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd554053610 0x7fd554055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:05.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.235+0000 7fd5737fe700 1 --2- 172.21.15.62:0/1126691711 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd554053610 0x7fd554055ad0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fd56401a000 tx=0x7fd564014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:05.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.239+0000 7fd5717fa700 1 -- 172.21.15.62:0/1126691711 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd5680425f0 con 0x7fd5740b5b20 2021-12-17T18:26:05.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.403+0000 7fd579477700 1 -- 172.21.15.62:0/1126691711 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd574068f30 con 0x7fd5740b5b20 2021-12-17T18:26:05.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.403+0000 7fd5717fa700 1 -- 172.21.15.62:0/1126691711 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+1212 (secure 0 0 0) 0x7fd568045c10 con 0x7fd5740b5b20 2021-12-17T18:26:05.412 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:05.412 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":46,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.109:6835/1223620032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1223620032},{"type":"v1","addr":"172.21.15.109:6835","nonce":1223620032}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":42},{"gid":7287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6833/2260051905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2260051905},{"type":"v1","addr":"172.21.15.62:6833","nonce":2260051905}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46}],"filesystems":[]} 2021-12-17T18:26:05.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.407+0000 7fd579477700 1 -- 172.21.15.62:0/1126691711 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd554053610 msgr2=0x7fd554055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:05.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.407+0000 7fd579477700 1 --2- 172.21.15.62:0/1126691711 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd554053610 0x7fd554055ad0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fd56401a000 tx=0x7fd564014000).stop 2021-12-17T18:26:05.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.407+0000 7fd579477700 1 -- 172.21.15.62:0/1126691711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5740b5b20 msgr2=0x7fd5740647b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:05.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.407+0000 7fd579477700 1 --2- 172.21.15.62:0/1126691711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5740b5b20 0x7fd5740647b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7fd5740b97b0 tx=0x7fd568007c10).stop 2021-12-17T18:26:05.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.407+0000 7fd579477700 1 -- 172.21.15.62:0/1126691711 shutdown_connections 2021-12-17T18:26:05.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.407+0000 7fd579477700 1 --2- 172.21.15.62:0/1126691711 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd554053610 0x7fd554055ad0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.407+0000 7fd579477700 1 --2- 172.21.15.62:0/1126691711 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd574066780 0x7fd574144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.407+0000 7fd579477700 1 --2- 172.21.15.62:0/1126691711 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd5741458d0 0x7fd574152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.407+0000 7fd579477700 1 --2- 172.21.15.62:0/1126691711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5740b5b20 0x7fd5740647b0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.407+0000 7fd579477700 1 -- 172.21.15.62:0/1126691711 >> 172.21.15.62:0/1126691711 conn(0x7fd57405c750 msgr2=0x7fd5740b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:05.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.407+0000 7fd579477700 1 -- 172.21.15.62:0/1126691711 shutdown_connections 2021-12-17T18:26:05.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.407+0000 7fd579477700 1 -- 172.21.15.62:0/1126691711 wait complete. 2021-12-17T18:26:05.417 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 46 2021-12-17T18:26:05.431 INFO:tasks.ceph.mds.a:Restarting daemon 2021-12-17T18:26:05.432 INFO:tasks.ceph.mds.a:Stopping old one... 2021-12-17T18:26:05.432 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-12-17T18:26:05.432 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:26:05.433 INFO:tasks.ceph.mds.b:Restarting daemon 2021-12-17T18:26:05.433 INFO:tasks.ceph.mds.b:Stopping old one... 2021-12-17T18:26:05.433 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-12-17T18:26:05.433 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:26:05.442 INFO:tasks.ceph.mds.a:Stopped 2021-12-17T18:26:05.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-12-17T18:26:05.448 INFO:tasks.ceph.mds.b:Stopped 2021-12-17T18:26:05.448 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-12-17T18:26:05.485 INFO:tasks.ceph.mds.a:Started 2021-12-17T18:26:05.486 DEBUG:teuthology.parallel:result is None 2021-12-17T18:26:05.492 INFO:tasks.ceph.mds.b:Started 2021-12-17T18:26:05.492 DEBUG:teuthology.parallel:result is None 2021-12-17T18:26:05.493 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-12-17T18:26:05.557 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:26:05.570 INFO:tasks.ceph.mds.b.smithi109.stdout:starting mds.b at 2021-12-17T18:26:05.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.587+0000 7f82dbfff700 1 Processor -- start 2021-12-17T18:26:05.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.587+0000 7f82dbfff700 1 -- start start 2021-12-17T18:26:05.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.587+0000 7f82dbfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82dc0b6610 0x7f82dc13e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:05.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.587+0000 7f82dbfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f82dc142860 0x7f82dc142c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:05.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.587+0000 7f82dbfff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82dc0acd00 con 0x7f82dc0b1080 2021-12-17T18:26:05.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.587+0000 7f82dbfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82dc0ad910 con 0x7f82dc142860 2021-12-17T18:26:05.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.587+0000 7f82dbfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc0b69f0 con 0x7f82dc0b6610 2021-12-17T18:26:05.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.587+0000 7f82db7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f82dc142860 0x7f82dc142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:05.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.587+0000 7f82db7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f82dc142860 0x7f82dc142c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54170/0 (socket says 172.21.15.62:54170) 2021-12-17T18:26:05.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.587+0000 7f82daffd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82dc0b6610 0x7f82dc13e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:05.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.587+0000 7f82db7fe700 1 -- 172.21.15.62:0/3677898653 learned_addr learned my addr 172.21.15.62:0/3677898653 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:05.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82db7fe700 1 -- 172.21.15.62:0/3677898653 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82dc0b6610 msgr2=0x7f82dc13e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:05.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82db7fe700 1 --2- 172.21.15.62:0/3677898653 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82dc0b6610 0x7f82dc13e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82db7fe700 1 -- 172.21.15.62:0/3677898653 >> v1:172.21.15.109:6789/0 conn(0x7f82dc0b1080 legacy=0x7f82dc13eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:05.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82db7fe700 1 -- 172.21.15.62:0/3677898653 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc13f1f0 con 0x7f82dc142860 2021-12-17T18:26:05.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82db7fe700 1 --2- 172.21.15.62:0/3677898653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82dc142860 0x7f82dc142c90 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f82d40032f0 tx=0x7f82d400b530).ready entity=mon.0 client_cookie=9be8e882c050aa56 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:05.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82da7fc700 1 -- 172.21.15.62:0/3677898653 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82d400de20 con 0x7f82dc142860 2021-12-17T18:26:05.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82da7fc700 1 -- 172.21.15.62:0/3677898653 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d4010470 con 0x7f82dc142860 2021-12-17T18:26:05.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82da7fc700 1 -- 172.21.15.62:0/3677898653 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82d40107d0 con 0x7f82dc142860 2021-12-17T18:26:05.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82dbfff700 1 -- 172.21.15.62:0/3677898653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82dc142860 msgr2=0x7f82dc142c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:05.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82dbfff700 1 --2- 172.21.15.62:0/3677898653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82dc142860 0x7f82dc142c90 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f82d40032f0 tx=0x7f82d400b530).stop 2021-12-17T18:26:05.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82dbfff700 1 -- 172.21.15.62:0/3677898653 shutdown_connections 2021-12-17T18:26:05.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82dbfff700 1 --2- 172.21.15.62:0/3677898653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82dc142860 0x7f82dc142c90 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82dbfff700 1 --2- 172.21.15.62:0/3677898653 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82dc0b6610 0x7f82dc13e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82dbfff700 1 -- 172.21.15.62:0/3677898653 >> 172.21.15.62:0/3677898653 conn(0x7f82dc05d1c0 msgr2=0x7f82dc0b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:05.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82dbfff700 1 -- 172.21.15.62:0/3677898653 shutdown_connections 2021-12-17T18:26:05.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82dbfff700 1 -- 172.21.15.62:0/3677898653 wait complete. 2021-12-17T18:26:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82dbfff700 1 Processor -- start 2021-12-17T18:26:05.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82dbfff700 1 -- start start 2021-12-17T18:26:05.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82dbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82dc0b1080 0x7f82dc13b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:05.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82dbfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f82dc0b6610 0x7f82dc0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:05.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82dbfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82dc142860 0x7f82dc13cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:05.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82dbfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc064e60 con 0x7f82dc0b1080 2021-12-17T18:26:05.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82dbfff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc13b140 con 0x7f82dc0b6610 2021-12-17T18:26:05.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.591+0000 7f82dbfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc13d110 con 0x7f82dc142860 2021-12-17T18:26:05.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82daffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82dc0b1080 0x7f82dc13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:05.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82daffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82dc0b1080 0x7f82dc13b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54172/0 (socket says 172.21.15.62:54172) 2021-12-17T18:26:05.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82daffd700 1 -- 172.21.15.62:0/2934888341 learned_addr learned my addr 172.21.15.62:0/2934888341 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:05.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82d3fff700 1 --2- 172.21.15.62:0/2934888341 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f82dc0b6610 0x7f82dc0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:05.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82db7fe700 1 --2- 172.21.15.62:0/2934888341 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82dc142860 0x7f82dc13cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:05.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82daffd700 1 -- 172.21.15.62:0/2934888341 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82dc142860 msgr2=0x7f82dc13cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:05.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82daffd700 1 --2- 172.21.15.62:0/2934888341 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82dc142860 0x7f82dc13cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82daffd700 1 -- 172.21.15.62:0/2934888341 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f82dc0b6610 msgr2=0x7f82dc0b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:05.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82daffd700 1 --2- 172.21.15.62:0/2934888341 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f82dc0b6610 0x7f82dc0b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:05.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82daffd700 1 -- 172.21.15.62:0/2934888341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d400b7d0 con 0x7f82dc0b1080 2021-12-17T18:26:05.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82daffd700 1 --2- 172.21.15.62:0/2934888341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82dc0b1080 0x7f82dc13b660 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f82cc00c000 tx=0x7f82cc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:05.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82d8ff9700 1 -- 172.21.15.62:0/2934888341 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82cc010780 con 0x7f82dc0b1080 2021-12-17T18:26:05.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82d8ff9700 1 -- 172.21.15.62:0/2934888341 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc0108e0 con 0x7f82dc0b1080 2021-12-17T18:26:05.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82dbfff700 1 -- 172.21.15.62:0/2934888341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82dc13d630 con 0x7f82dc0b1080 2021-12-17T18:26:05.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82d8ff9700 1 -- 172.21.15.62:0/2934888341 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82cc010c40 con 0x7f82dc0b1080 2021-12-17T18:26:05.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82dbfff700 1 -- 172.21.15.62:0/2934888341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82dc0664f0 con 0x7f82dc0b1080 2021-12-17T18:26:05.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82dbfff700 1 -- 172.21.15.62:0/2934888341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82dc0acf30 con 0x7f82dc0b1080 2021-12-17T18:26:05.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82d8ff9700 1 -- 172.21.15.62:0/2934888341 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f82cc01c460 con 0x7f82dc0b1080 2021-12-17T18:26:05.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82d8ff9700 1 --2- 172.21.15.62:0/2934888341 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f82c0053580 0x7f82c0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:05.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82d8ff9700 1 -- 172.21.15.62:0/2934888341 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f82cc06bb20 con 0x7f82dc0b1080 2021-12-17T18:26:05.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.595+0000 7f82d3fff700 1 --2- 172.21.15.62:0/2934888341 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f82c0053580 0x7f82c0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:05.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.599+0000 7f82d3fff700 1 --2- 172.21.15.62:0/2934888341 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f82c0053580 0x7f82c0055a40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f82c400d000 tx=0x7f82c4007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:05.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.603+0000 7f82d8ff9700 1 -- 172.21.15.62:0/2934888341 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f82cc042e60 con 0x7f82dc0b1080 2021-12-17T18:26:05.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:05.739+0000 7f82dbfff700 1 -- 172.21.15.62:0/2934888341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f82dc0573d0 con 0x7f82dc0b1080 2021-12-17T18:26:06.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.615+0000 7f82d8ff9700 1 -- 172.21.15.62:0/2934888341 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v98) v1 ==== 97+0+0 (secure 0 0 0) 0x7f82cc046480 con 0x7f82dc0b1080 2021-12-17T18:26:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.619+0000 7f82dbfff700 1 -- 172.21.15.62:0/2934888341 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f82c0053580 msgr2=0x7f82c0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.619+0000 7f82dbfff700 1 --2- 172.21.15.62:0/2934888341 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f82c0053580 0x7f82c0055a40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f82c400d000 tx=0x7f82c4007b90).stop 2021-12-17T18:26:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.619+0000 7f82dbfff700 1 -- 172.21.15.62:0/2934888341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82dc0b1080 msgr2=0x7f82dc13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.619+0000 7f82dbfff700 1 --2- 172.21.15.62:0/2934888341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82dc0b1080 0x7f82dc13b660 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f82cc00c000 tx=0x7f82cc006df0).stop 2021-12-17T18:26:06.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.619+0000 7f82dbfff700 1 -- 172.21.15.62:0/2934888341 shutdown_connections 2021-12-17T18:26:06.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.619+0000 7f82dbfff700 1 --2- 172.21.15.62:0/2934888341 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f82c0053580 0x7f82c0055a40 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:06.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.619+0000 7f82dbfff700 1 --2- 172.21.15.62:0/2934888341 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82dc142860 0x7f82dc13cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:06.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.619+0000 7f82dbfff700 1 --2- 172.21.15.62:0/2934888341 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f82dc0b6610 0x7f82dc0b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:06.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.619+0000 7f82dbfff700 1 --2- 172.21.15.62:0/2934888341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82dc0b1080 0x7f82dc13b660 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:06.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.619+0000 7f82dbfff700 1 -- 172.21.15.62:0/2934888341 >> 172.21.15.62:0/2934888341 conn(0x7f82dc05d1c0 msgr2=0x7f82dc0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:06.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.619+0000 7f82dbfff700 1 -- 172.21.15.62:0/2934888341 shutdown_connections 2021-12-17T18:26:06.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.619+0000 7f82dbfff700 1 -- 172.21.15.62:0/2934888341 wait complete. 2021-12-17T18:26:06.630 INFO:teuthology.orchestra.run.smithi062.stderr: removed all blacklist entries 2021-12-17T18:26:06.640 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-12-17T18:26:06.641 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-12-17T18:26:06.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.739+0000 7f1619d9c700 1 Processor -- start 2021-12-17T18:26:06.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.739+0000 7f1619d9c700 1 -- start start 2021-12-17T18:26:06.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f1619d9c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f16140b5ea0 0x7f16140a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:06.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f1619d9c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f16141472c0 0x7f16140b0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:06.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f1619d9c700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16140b1840 con 0x7f16141427b0 2021-12-17T18:26:06.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f1619d9c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16140b6280 con 0x7f16141472c0 2021-12-17T18:26:06.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f1619d9c700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16140b1a70 con 0x7f16140b5ea0 2021-12-17T18:26:06.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f160bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f16141472c0 0x7f16140b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:06.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f160bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f16141472c0 0x7f16140b0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54182/0 (socket says 172.21.15.62:54182) 2021-12-17T18:26:06.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f160bfff700 1 -- 172.21.15.62:0/1757982048 learned_addr learned my addr 172.21.15.62:0/1757982048 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:06.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f1618d9a700 1 --2- 172.21.15.62:0/1757982048 >> v2:172.21.15.109:3300/0 conn(0x7f16140b5ea0 0x7f16140a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:06.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f160bfff700 1 -- 172.21.15.62:0/1757982048 >> v2:172.21.15.109:3300/0 conn(0x7f16140b5ea0 msgr2=0x7f16140a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:06.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f160bfff700 1 --2- 172.21.15.62:0/1757982048 >> v2:172.21.15.109:3300/0 conn(0x7f16140b5ea0 0x7f16140a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:06.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f160bfff700 1 -- 172.21.15.62:0/1757982048 >> v1:172.21.15.109:6789/0 conn(0x7f16141427b0 legacy=0x7f1614143740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:06.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f160bfff700 1 -- 172.21.15.62:0/1757982048 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16140b1d10 con 0x7f16141472c0 2021-12-17T18:26:06.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f160bfff700 1 --2- 172.21.15.62:0/1757982048 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16141472c0 0x7f16140b0020 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f1610002f70 tx=0x7f1610006eb0).ready entity=mon.0 client_cookie=ab9dd9dde2205166 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:06.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f160b7fe700 1 -- 172.21.15.62:0/1757982048 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f161000d610 con 0x7f16141472c0 2021-12-17T18:26:06.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f160b7fe700 1 -- 172.21.15.62:0/1757982048 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1610000e90 con 0x7f16141472c0 2021-12-17T18:26:06.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f160b7fe700 1 -- 172.21.15.62:0/1757982048 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f161000d9a0 con 0x7f16141472c0 2021-12-17T18:26:06.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f1619d9c700 1 -- 172.21.15.62:0/1757982048 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16141472c0 msgr2=0x7f16140b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:06.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f1619d9c700 1 --2- 172.21.15.62:0/1757982048 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16141472c0 0x7f16140b0020 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f1610002f70 tx=0x7f1610006eb0).stop 2021-12-17T18:26:06.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f1619d9c700 1 -- 172.21.15.62:0/1757982048 shutdown_connections 2021-12-17T18:26:06.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f1619d9c700 1 --2- 172.21.15.62:0/1757982048 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16141472c0 0x7f16140b0020 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:06.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f1619d9c700 1 --2- 172.21.15.62:0/1757982048 >> v2:172.21.15.109:3300/0 conn(0x7f16140b5ea0 0x7f16140a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:06.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f1619d9c700 1 -- 172.21.15.62:0/1757982048 >> 172.21.15.62:0/1757982048 conn(0x7f161405d220 msgr2=0x7f16140b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:06.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f1619d9c700 1 -- 172.21.15.62:0/1757982048 shutdown_connections 2021-12-17T18:26:06.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.743+0000 7f1619d9c700 1 -- 172.21.15.62:0/1757982048 wait complete. 2021-12-17T18:26:06.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.747+0000 7f1619d9c700 1 Processor -- start 2021-12-17T18:26:06.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.747+0000 7f1619d9c700 1 -- start start 2021-12-17T18:26:06.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.747+0000 7f1619d9c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f16140b5ea0 0x7f16140b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:06.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.747+0000 7f1619d9c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f16141427b0 0x7f161409ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:06.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.747+0000 7f1619d9c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16141472c0 0x7f1614152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:06.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.747+0000 7f1619d9c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1614155b70 con 0x7f16141472c0 2021-12-17T18:26:06.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.747+0000 7f1619d9c700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1614155d60 con 0x7f16141427b0 2021-12-17T18:26:06.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.747+0000 7f1619d9c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16141525a0 con 0x7f16140b5ea0 2021-12-17T18:26:06.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.747+0000 7f161959b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16141472c0 0x7f1614152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:06.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.747+0000 7f1618d9a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f16140b5ea0 0x7f16140b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:06.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.747+0000 7f161959b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16141472c0 0x7f1614152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54192/0 (socket says 172.21.15.62:54192) 2021-12-17T18:26:06.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.747+0000 7f161959b700 1 -- 172.21.15.62:0/603257641 learned_addr learned my addr 172.21.15.62:0/603257641 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:06.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.751+0000 7f160bfff700 1 --2- 172.21.15.62:0/603257641 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f16141427b0 0x7f161409ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:06.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.751+0000 7f161959b700 1 -- 172.21.15.62:0/603257641 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f16140b5ea0 msgr2=0x7f16140b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:06.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.751+0000 7f161959b700 1 --2- 172.21.15.62:0/603257641 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f16140b5ea0 0x7f16140b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:06.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.751+0000 7f161959b700 1 -- 172.21.15.62:0/603257641 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f16141427b0 msgr2=0x7f161409ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:06.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.751+0000 7f161959b700 1 --2- 172.21.15.62:0/603257641 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f16141427b0 0x7f161409ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:06.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.751+0000 7f161959b700 1 -- 172.21.15.62:0/603257641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161000b1e0 con 0x7f16141472c0 2021-12-17T18:26:06.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.751+0000 7f160bfff700 1 --2- 172.21.15.62:0/603257641 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f16141427b0 0x7f161409ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:06.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.751+0000 7f161959b700 1 --2- 172.21.15.62:0/603257641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16141472c0 0x7f1614152ce0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f1614063060 tx=0x7f160c007f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:06.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.751+0000 7f1609ffb700 1 -- 172.21.15.62:0/603257641 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f160c00f470 con 0x7f16141472c0 2021-12-17T18:26:06.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.751+0000 7f1609ffb700 1 -- 172.21.15.62:0/603257641 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160c00f5d0 con 0x7f16141472c0 2021-12-17T18:26:06.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.751+0000 7f1609ffb700 1 -- 172.21.15.62:0/603257641 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f160c00f930 con 0x7f16141472c0 2021-12-17T18:26:06.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.751+0000 7f1619d9c700 1 -- 172.21.15.62:0/603257641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1614152840 con 0x7f16141472c0 2021-12-17T18:26:06.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.751+0000 7f1619d9c700 1 -- 172.21.15.62:0/603257641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f161409f400 con 0x7f16141472c0 2021-12-17T18:26:06.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.751+0000 7f1619d9c700 1 -- 172.21.15.62:0/603257641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16141432a0 con 0x7f16141472c0 2021-12-17T18:26:06.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.751+0000 7f1609ffb700 1 -- 172.21.15.62:0/603257641 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f160c019030 con 0x7f16141472c0 2021-12-17T18:26:06.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.755+0000 7f1609ffb700 1 --2- 172.21.15.62:0/603257641 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f15f4053610 0x7f15f4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:06.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.755+0000 7f1609ffb700 1 -- 172.21.15.62:0/603257641 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f160c06b100 con 0x7f16141472c0 2021-12-17T18:26:06.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.755+0000 7f1618d9a700 1 --2- 172.21.15.62:0/603257641 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f15f4053610 0x7f15f4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:06.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.755+0000 7f1618d9a700 1 --2- 172.21.15.62:0/603257641 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f15f4053610 0x7f15f4055ad0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f160400c000 tx=0x7f1604008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:06.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.759+0000 7f1609ffb700 1 -- 172.21.15.62:0/603257641 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f160c042590 con 0x7f16141472c0 2021-12-17T18:26:06.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.927+0000 7f1619d9c700 1 -- 172.21.15.62:0/603257641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f16140573d0 con 0x7f16141472c0 2021-12-17T18:26:06.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.927+0000 7f1609ffb700 1 -- 172.21.15.62:0/603257641 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v31) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f160c017070 con 0x7f16141472c0 2021-12-17T18:26:06.936 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:06.936 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:26:06.937 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_dump": [ 2021-12-17T18:26:06.937 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:06.937 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.a", 2021-12-17T18:26:06.937 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhxCS0LBAAtUlkgWYg4l3fQ2au7jMUDg==", 2021-12-17T18:26:06.937 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:06.938 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:26:06.938 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:06.938 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:06.938 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:06.939 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:06.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:06.939 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:06.939 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.b", 2021-12-17T18:26:06.940 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhoRJAMxAAP/NmDQRwJjYip2rxJsQlYg==", 2021-12-17T18:26:06.940 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:06.940 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:26:06.940 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:06.940 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:06.941 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:06.941 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:06.941 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:06.941 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:06.942 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.0", 2021-12-17T18:26:06.942 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBA1LxhJXzhKhAAUnxP3G5VuATkQLoDALFjVg==", 2021-12-17T18:26:06.942 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:06.942 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:06.943 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:06.943 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:06.943 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:06.943 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:06.944 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:06.944 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.1", 2021-12-17T18:26:06.944 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBD1LxhregUDhAABrxQ2jQ4BwXvuWh/D9SkbQ==", 2021-12-17T18:26:06.944 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:06.944 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:06.945 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:06.945 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:06.945 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:06.945 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:06.946 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:06.946 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.2", 2021-12-17T18:26:06.946 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBF1LxhOo/SLhAAhQQLW/VKFx1sgm8chnD5tw==", 2021-12-17T18:26:06.946 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:06.947 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:06.947 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:06.947 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:06.947 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:06.947 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:06.948 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:06.948 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.3", 2021-12-17T18:26:06.948 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBI1LxhT2ZQExAA999j8V5bJAJ2PuaQqSkUOw==", 2021-12-17T18:26:06.948 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:06.948 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:06.949 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:06.949 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:06.949 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:06.949 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:06.950 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:06.950 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.4", 2021-12-17T18:26:06.950 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBN1LxhKBDzFhAAKmPF0FXnnfXtweo+6z9nxg==", 2021-12-17T18:26:06.950 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:06.951 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:06.951 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:06.951 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:06.951 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:06.951 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:06.952 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:06.952 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.5", 2021-12-17T18:26:06.952 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBP1LxhtqkAORAAVaFLVNIUMs4Sytk8WRaGNA==", 2021-12-17T18:26:06.952 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:06.953 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:06.953 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:06.953 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:06.953 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:06.953 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:06.954 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:06.954 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.6", 2021-12-17T18:26:06.954 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBS1LxhNtncGhAAgG64g1ie54CDp9Y7uldKQA==", 2021-12-17T18:26:06.954 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:06.955 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:06.955 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:06.955 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:06.955 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:06.955 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:06.956 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:06.956 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.7", 2021-12-17T18:26:06.956 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBV1Lxh3DcDABAAHVskSVtoEJ8BxCCAs3ZDVA==", 2021-12-17T18:26:06.956 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:06.957 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:06.957 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:06.957 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:06.957 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:06.958 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:06.958 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:06.958 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.0", 2021-12-17T18:26:06.958 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxh9QhCNxAALkWTJorDpbt9yrikL7/NWg==", 2021-12-17T18:26:06.958 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:06.959 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:26:06.959 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:26:06.959 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:26:06.959 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:06.959 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:06.960 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:06.960 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.1", 2021-12-17T18:26:06.960 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxhxm52OxAAbqXVaqRDmt4Ezj9xyCEODQ==", 2021-12-17T18:26:06.960 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:06.961 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:26:06.961 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:26:06.961 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:26:06.961 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:06.961 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:06.962 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:06.962 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.2", 2021-12-17T18:26:06.962 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+1LxhXu08BBAATRcUAZvMNg9ou4PLszDtmA==", 2021-12-17T18:26:06.962 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:06.963 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:26:06.963 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:26:06.963 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:26:06.963 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:06.964 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:06.964 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:06.964 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.admin", 2021-12-17T18:26:06.964 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhyAGlDRAA2ggSG5yBBFbMgK2fCBk2mQ==", 2021-12-17T18:26:06.964 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:06.965 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:26:06.965 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:06.965 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:06.965 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:06.965 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:06.966 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:06.966 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:06.966 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.x", 2021-12-17T18:26:06.966 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhzvntKRAAFQlg69Z6d2nWX0GxSshsMw==", 2021-12-17T18:26:06.967 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:06.967 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:26:06.967 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:26:06.967 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:06.968 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:06.968 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:06.968 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:06.968 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.y", 2021-12-17T18:26:06.968 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhKdTGJRAArzUN3A1U5Efw0NG9Gw2Gcw==", 2021-12-17T18:26:06.969 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:06.969 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:26:06.969 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:26:06.969 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:06.970 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:06.970 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:06.970 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:06.970 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:26:06.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.931+0000 7f1619d9c700 1 -- 172.21.15.62:0/603257641 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f15f4053610 msgr2=0x7f15f4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:06.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.931+0000 7f1619d9c700 1 --2- 172.21.15.62:0/603257641 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f15f4053610 0x7f15f4055ad0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f160400c000 tx=0x7f1604008040).stop 2021-12-17T18:26:06.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.931+0000 7f1619d9c700 1 -- 172.21.15.62:0/603257641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16141472c0 msgr2=0x7f1614152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:06.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.931+0000 7f1619d9c700 1 --2- 172.21.15.62:0/603257641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16141472c0 0x7f1614152ce0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f1614063060 tx=0x7f160c007f00).stop 2021-12-17T18:26:06.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.931+0000 7f1619d9c700 1 -- 172.21.15.62:0/603257641 shutdown_connections 2021-12-17T18:26:06.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.931+0000 7f1619d9c700 1 --2- 172.21.15.62:0/603257641 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f15f4053610 0x7f15f4055ad0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:06.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.931+0000 7f1619d9c700 1 --2- 172.21.15.62:0/603257641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16141472c0 0x7f1614152ce0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:06.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.931+0000 7f1619d9c700 1 --2- 172.21.15.62:0/603257641 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f16141427b0 0x7f161409ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:06.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.931+0000 7f1619d9c700 1 --2- 172.21.15.62:0/603257641 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f16140b5ea0 0x7f16140b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:06.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.931+0000 7f1619d9c700 1 -- 172.21.15.62:0/603257641 >> 172.21.15.62:0/603257641 conn(0x7f161405d220 msgr2=0x7f1614141a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:06.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.931+0000 7f1619d9c700 1 -- 172.21.15.62:0/603257641 shutdown_connections 2021-12-17T18:26:06.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:06.931+0000 7f1619d9c700 1 -- 172.21.15.62:0/603257641 wait complete. 2021-12-17T18:26:06.975 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:26:07.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f365e118700 1 Processor -- start 2021-12-17T18:26:07.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f365e118700 1 -- start start 2021-12-17T18:26:07.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f365e118700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f36580affc0 0x7f365814ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f365e118700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3658067c10 con 0x7f36580aca60 2021-12-17T18:26:07.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f365e118700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3658147760 con 0x7f3658067830 2021-12-17T18:26:07.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f365e118700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36580b2d40 con 0x7f36580affc0 2021-12-17T18:26:07.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f364effd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f36580aca60 0x7f3658147050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37778/0 (socket says 172.21.15.62:37778) 2021-12-17T18:26:07.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f364effd700 1 -- 172.21.15.62:0/239303546 learned_addr learned my addr 172.21.15.62:0/239303546 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:07.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f3657fff700 1 --2- 172.21.15.62:0/239303546 >> v2:172.21.15.62:3300/0 conn(0x7f36580affc0 0x7f365814ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f3656ffd700 1 -- 172.21.15.62:0/239303546 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112300745 0 0) 0x7f3658067c10 con 0x7f36580aca60 2021-12-17T18:26:07.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f3656ffd700 1 -- 172.21.15.62:0/239303546 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3638003260 con 0x7f36580aca60 2021-12-17T18:26:07.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f3657fff700 1 -- 172.21.15.62:0/239303546 >> v1:172.21.15.109:6789/0 conn(0x7f3658067830 legacy=0x7f3658146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f3656ffd700 1 -- 172.21.15.62:0/239303546 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938530371 0 0) 0x7f3658147760 con 0x7f3658067830 2021-12-17T18:26:07.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f3657fff700 1 -- 172.21.15.62:0/239303546 >> v1:172.21.15.62:6789/0 conn(0x7f36580aca60 legacy=0x7f3658147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f3657fff700 1 -- 172.21.15.62:0/239303546 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3658060520 con 0x7f36580affc0 2021-12-17T18:26:07.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f3657fff700 1 --2- 172.21.15.62:0/239303546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36580affc0 0x7f365814ded0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f36500032f0 tx=0x7f36500091d0).ready entity=mon.0 client_cookie=501a17b681ae9704 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:07.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f3656ffd700 1 -- 172.21.15.62:0/239303546 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f365000b6c0 con 0x7f36580affc0 2021-12-17T18:26:07.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f3656ffd700 1 -- 172.21.15.62:0/239303546 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365000b820 con 0x7f36580affc0 2021-12-17T18:26:07.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f3656ffd700 1 -- 172.21.15.62:0/239303546 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f365000b990 con 0x7f36580affc0 2021-12-17T18:26:07.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f365e118700 1 -- 172.21.15.62:0/239303546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36580affc0 msgr2=0x7f365814ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f365e118700 1 --2- 172.21.15.62:0/239303546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36580affc0 0x7f365814ded0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f36500032f0 tx=0x7f36500091d0).stop 2021-12-17T18:26:07.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f365e118700 1 -- 172.21.15.62:0/239303546 shutdown_connections 2021-12-17T18:26:07.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f365e118700 1 --2- 172.21.15.62:0/239303546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36580affc0 0x7f365814ded0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f365e118700 1 -- 172.21.15.62:0/239303546 >> 172.21.15.62:0/239303546 conn(0x7f365805f730 msgr2=0x7f365805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:07.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f365e118700 1 -- 172.21.15.62:0/239303546 shutdown_connections 2021-12-17T18:26:07.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.075+0000 7f365e118700 1 -- 172.21.15.62:0/239303546 wait complete. 2021-12-17T18:26:07.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f365e118700 1 Processor -- start 2021-12-17T18:26:07.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f365e118700 1 -- start start 2021-12-17T18:26:07.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f365e118700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3658067830 0x7f36581528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f365e118700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f36580aca60 0x7f365809edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f365e118700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36580affc0 0x7f36580ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f365e118700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3658152de0 con 0x7f36580affc0 2021-12-17T18:26:07.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f365e118700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3658153000 con 0x7f3658067830 2021-12-17T18:26:07.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f365e118700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36581532a0 con 0x7f36580aca60 2021-12-17T18:26:07.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f3657fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36580affc0 0x7f36580ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f36577fe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3658067830 0x7f36581528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f3657fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36580affc0 0x7f36580ab4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54206/0 (socket says 172.21.15.62:54206) 2021-12-17T18:26:07.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f364effd700 1 --2- 172.21.15.62:0/905573956 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f36580aca60 0x7f365809edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f3657fff700 1 -- 172.21.15.62:0/905573956 learned_addr learned my addr 172.21.15.62:0/905573956 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:07.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f3657fff700 1 -- 172.21.15.62:0/905573956 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f36580aca60 msgr2=0x7f365809edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f3657fff700 1 --2- 172.21.15.62:0/905573956 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f36580aca60 0x7f365809edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f3657fff700 1 -- 172.21.15.62:0/905573956 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3658067830 msgr2=0x7f36581528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f3657fff700 1 --2- 172.21.15.62:0/905573956 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3658067830 0x7f36581528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f3657fff700 1 -- 172.21.15.62:0/905573956 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3650009470 con 0x7f36580affc0 2021-12-17T18:26:07.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f3657fff700 1 --2- 172.21.15.62:0/905573956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36580affc0 0x7f36580ab4a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f36500032f0 tx=0x7f3650016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:07.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f36557fa700 1 -- 172.21.15.62:0/905573956 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f365000b6c0 con 0x7f36580affc0 2021-12-17T18:26:07.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f365e118700 1 -- 172.21.15.62:0/905573956 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3658153540 con 0x7f36580affc0 2021-12-17T18:26:07.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.079+0000 7f36557fa700 1 -- 172.21.15.62:0/905573956 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3650021630 con 0x7f36580affc0 2021-12-17T18:26:07.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.083+0000 7f36557fa700 1 -- 172.21.15.62:0/905573956 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3650021990 con 0x7f36580affc0 2021-12-17T18:26:07.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.083+0000 7f365e118700 1 -- 172.21.15.62:0/905573956 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36580a2700 con 0x7f36580affc0 2021-12-17T18:26:07.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.083+0000 7f365e118700 1 -- 172.21.15.62:0/905573956 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36580acf00 con 0x7f36580affc0 2021-12-17T18:26:07.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.083+0000 7f36557fa700 1 -- 172.21.15.62:0/905573956 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3650027020 con 0x7f36580affc0 2021-12-17T18:26:07.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.083+0000 7f36557fa700 1 --2- 172.21.15.62:0/905573956 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f363c053610 0x7f363c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.083+0000 7f36557fa700 1 -- 172.21.15.62:0/905573956 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f365006cb00 con 0x7f36580affc0 2021-12-17T18:26:07.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.083+0000 7f36577fe700 1 --2- 172.21.15.62:0/905573956 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f363c053610 0x7f363c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.087+0000 7f36577fe700 1 --2- 172.21.15.62:0/905573956 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f363c053610 0x7f363c055ad0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f364800d000 tx=0x7f3648009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:07.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.091+0000 7f36557fa700 1 -- 172.21.15.62:0/905573956 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f365006ee60 con 0x7f36580affc0 2021-12-17T18:26:07.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.219+0000 7f365e118700 1 -- 172.21.15.62:0/905573956 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36580573d0 con 0x7f36580affc0 2021-12-17T18:26:07.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.219+0000 7f36557fa700 1 -- 172.21.15.62:0/905573956 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+13230 (secure 0 0 0) 0x7f3650015020 con 0x7f36580affc0 2021-12-17T18:26:07.228 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:07.228 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":98,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:26:06.607857+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:26:07.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.227+0000 7f365e118700 1 -- 172.21.15.62:0/905573956 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f363c053610 msgr2=0x7f363c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.227+0000 7f365e118700 1 --2- 172.21.15.62:0/905573956 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f363c053610 0x7f363c055ad0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f364800d000 tx=0x7f3648009040).stop 2021-12-17T18:26:07.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.227+0000 7f365e118700 1 -- 172.21.15.62:0/905573956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36580affc0 msgr2=0x7f36580ab4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.227+0000 7f365e118700 1 --2- 172.21.15.62:0/905573956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36580affc0 0x7f36580ab4a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f36500032f0 tx=0x7f3650016000).stop 2021-12-17T18:26:07.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.227+0000 7f365e118700 1 -- 172.21.15.62:0/905573956 shutdown_connections 2021-12-17T18:26:07.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.227+0000 7f365e118700 1 --2- 172.21.15.62:0/905573956 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f363c053610 0x7f363c055ad0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.227+0000 7f365e118700 1 --2- 172.21.15.62:0/905573956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36580affc0 0x7f36580ab4a0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.227+0000 7f365e118700 1 --2- 172.21.15.62:0/905573956 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f36580aca60 0x7f365809edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.227+0000 7f365e118700 1 --2- 172.21.15.62:0/905573956 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3658067830 0x7f36581528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.227+0000 7f365e118700 1 -- 172.21.15.62:0/905573956 >> 172.21.15.62:0/905573956 conn(0x7f365805f730 msgr2=0x7f36580ae070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:07.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.227+0000 7f365e118700 1 -- 172.21.15.62:0/905573956 shutdown_connections 2021-12-17T18:26:07.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.227+0000 7f365e118700 1 -- 172.21.15.62:0/905573956 wait complete. 2021-12-17T18:26:07.248 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-12-17T18:26:07.248 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:26:07.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.351+0000 7fc1fbfff700 1 Processor -- start 2021-12-17T18:26:07.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.351+0000 7fc1fbfff700 1 -- start start 2021-12-17T18:26:07.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1fbfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc1fc063b00 0x7fc1fc063ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1fbfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc1fc0b1260 0x7fc1fc061670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1fbfff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1fc143dc0 con 0x7fc1fc13cc70 2021-12-17T18:26:07.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1fbfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1fc0b1b90 con 0x7fc1fc063b00 2021-12-17T18:26:07.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1fbfff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1fc061d00 con 0x7fc1fc0b1260 2021-12-17T18:26:07.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1faffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc1fc063b00 0x7fc1fc063ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1faffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc1fc063b00 0x7fc1fc063ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54210/0 (socket says 172.21.15.62:54210) 2021-12-17T18:26:07.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1faffd700 1 -- 172.21.15.62:0/2355609455 learned_addr learned my addr 172.21.15.62:0/2355609455 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:07.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1f27fc700 1 --2- 172.21.15.62:0/2355609455 >> v2:172.21.15.109:3300/0 conn(0x7fc1fc0b1260 0x7fc1fc061670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1faffd700 1 -- 172.21.15.62:0/2355609455 >> v2:172.21.15.109:3300/0 conn(0x7fc1fc0b1260 msgr2=0x7fc1fc061670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:07.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1faffd700 1 --2- 172.21.15.62:0/2355609455 >> v2:172.21.15.109:3300/0 conn(0x7fc1fc0b1260 0x7fc1fc061670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1faffd700 1 -- 172.21.15.62:0/2355609455 >> v1:172.21.15.109:6789/0 conn(0x7fc1fc13cc70 legacy=0x7fc1fc0621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1faffd700 1 -- 172.21.15.62:0/2355609455 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1fc1439c0 con 0x7fc1fc063b00 2021-12-17T18:26:07.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1faffd700 1 --2- 172.21.15.62:0/2355609455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1fc063b00 0x7fc1fc063ee0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7fc1ec002f70 tx=0x7fc1ec006eb0).ready entity=mon.0 client_cookie=2cfe86bec0872004 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:07.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1fa7fc700 1 -- 172.21.15.62:0/2355609455 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1ec00d5c0 con 0x7fc1fc063b00 2021-12-17T18:26:07.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1fa7fc700 1 -- 172.21.15.62:0/2355609455 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec000e90 con 0x7fc1fc063b00 2021-12-17T18:26:07.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1fa7fc700 1 -- 172.21.15.62:0/2355609455 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1ec00d950 con 0x7fc1fc063b00 2021-12-17T18:26:07.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1fbfff700 1 -- 172.21.15.62:0/2355609455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1fc063b00 msgr2=0x7fc1fc063ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1fbfff700 1 --2- 172.21.15.62:0/2355609455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1fc063b00 0x7fc1fc063ee0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7fc1ec002f70 tx=0x7fc1ec006eb0).stop 2021-12-17T18:26:07.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1fbfff700 1 -- 172.21.15.62:0/2355609455 shutdown_connections 2021-12-17T18:26:07.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1fbfff700 1 --2- 172.21.15.62:0/2355609455 >> v2:172.21.15.109:3300/0 conn(0x7fc1fc0b1260 0x7fc1fc061670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1fbfff700 1 --2- 172.21.15.62:0/2355609455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1fc063b00 0x7fc1fc063ee0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1fbfff700 1 -- 172.21.15.62:0/2355609455 >> 172.21.15.62:0/2355609455 conn(0x7fc1fc060a50 msgr2=0x7fc1fc05bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:07.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1fbfff700 1 -- 172.21.15.62:0/2355609455 shutdown_connections 2021-12-17T18:26:07.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.355+0000 7fc1fbfff700 1 -- 172.21.15.62:0/2355609455 wait complete. 2021-12-17T18:26:07.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1fbfff700 1 Processor -- start 2021-12-17T18:26:07.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1fbfff700 1 -- start start 2021-12-17T18:26:07.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1fbfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1fc063b00 0x7fc1fc0b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1fbfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1fc0b1260 0x7fc1fc13ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1fbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1fc13cc70 0x7fc1fc1526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1fbfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc0673c0 con 0x7fc1fc13cc70 2021-12-17T18:26:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1fbfff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc152270 con 0x7fc1fc063b00 2021-12-17T18:26:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1fbfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc13e150 con 0x7fc1fc0b1260 2021-12-17T18:26:07.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1fb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1fc13cc70 0x7fc1fc1526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1fb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1fc13cc70 0x7fc1fc1526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54220/0 (socket says 172.21.15.62:54220) 2021-12-17T18:26:07.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1fb7fe700 1 -- 172.21.15.62:0/2027494417 learned_addr learned my addr 172.21.15.62:0/2027494417 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:07.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1faffd700 1 --2- 172.21.15.62:0/2027494417 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1fc063b00 0x7fc1fc0b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1f27fc700 1 --2- 172.21.15.62:0/2027494417 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1fc0b1260 0x7fc1fc13ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1fb7fe700 1 -- 172.21.15.62:0/2027494417 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1fc0b1260 msgr2=0x7fc1fc13ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1fb7fe700 1 --2- 172.21.15.62:0/2027494417 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1fc0b1260 0x7fc1fc13ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1fb7fe700 1 -- 172.21.15.62:0/2027494417 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1fc063b00 msgr2=0x7fc1fc0b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1fb7fe700 1 --2- 172.21.15.62:0/2027494417 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1fc063b00 0x7fc1fc0b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1fb7fe700 1 -- 172.21.15.62:0/2027494417 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec00b1e0 con 0x7fc1fc13cc70 2021-12-17T18:26:07.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1f27fc700 1 --2- 172.21.15.62:0/2027494417 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1fc0b1260 0x7fc1fc13ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:07.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.359+0000 7fc1fb7fe700 1 --2- 172.21.15.62:0/2027494417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1fc13cc70 0x7fc1fc1526d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fc1fc0af0c0 tx=0x7fc1f40013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:07.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.363+0000 7fc1f8ff9700 1 -- 172.21.15.62:0/2027494417 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1f4006aa0 con 0x7fc1fc13cc70 2021-12-17T18:26:07.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.363+0000 7fc1f8ff9700 1 -- 172.21.15.62:0/2027494417 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f4006c00 con 0x7fc1fc13cc70 2021-12-17T18:26:07.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.363+0000 7fc1fbfff700 1 -- 172.21.15.62:0/2027494417 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1fc13deb0 con 0x7fc1fc13cc70 2021-12-17T18:26:07.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.363+0000 7fc1f8ff9700 1 -- 172.21.15.62:0/2027494417 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1f4007030 con 0x7fc1fc13cc70 2021-12-17T18:26:07.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.363+0000 7fc1fbfff700 1 -- 172.21.15.62:0/2027494417 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1fc140430 con 0x7fc1fc13cc70 2021-12-17T18:26:07.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.363+0000 7fc1fbfff700 1 -- 172.21.15.62:0/2027494417 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1fc0b2910 con 0x7fc1fc13cc70 2021-12-17T18:26:07.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.363+0000 7fc1f8ff9700 1 -- 172.21.15.62:0/2027494417 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc1f4010030 con 0x7fc1fc13cc70 2021-12-17T18:26:07.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.363+0000 7fc1f8ff9700 1 --2- 172.21.15.62:0/2027494417 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1e00536d0 0x7fc1e0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.363+0000 7fc1f8ff9700 1 -- 172.21.15.62:0/2027494417 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc1f406b480 con 0x7fc1fc13cc70 2021-12-17T18:26:07.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.363+0000 7fc1faffd700 1 --2- 172.21.15.62:0/2027494417 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1e00536d0 0x7fc1e0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.363+0000 7fc1faffd700 1 --2- 172.21.15.62:0/2027494417 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1e00536d0 0x7fc1e0055b90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fc1ec01c000 tx=0x7fc1ec015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:07.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.371+0000 7fc1f8ff9700 1 -- 172.21.15.62:0/2027494417 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc1f4042910 con 0x7fc1fc13cc70 2021-12-17T18:26:07.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.491+0000 7fc1fbfff700 1 -- 172.21.15.62:0/2027494417 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc1fc0573d0 con 0x7fc1fc13cc70 2021-12-17T18:26:07.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.495+0000 7fc1f8ff9700 1 -- 172.21.15.62:0/2027494417 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v98) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc1f4045f30 con 0x7fc1fc13cc70 2021-12-17T18:26:07.500 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:26:07.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.495+0000 7fc1fbfff700 1 -- 172.21.15.62:0/2027494417 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1e00536d0 msgr2=0x7fc1e0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.495+0000 7fc1fbfff700 1 --2- 172.21.15.62:0/2027494417 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1e00536d0 0x7fc1e0055b90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fc1ec01c000 tx=0x7fc1ec015000).stop 2021-12-17T18:26:07.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.495+0000 7fc1fbfff700 1 -- 172.21.15.62:0/2027494417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1fc13cc70 msgr2=0x7fc1fc1526d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.495+0000 7fc1fbfff700 1 --2- 172.21.15.62:0/2027494417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1fc13cc70 0x7fc1fc1526d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fc1fc0af0c0 tx=0x7fc1f40013a0).stop 2021-12-17T18:26:07.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.495+0000 7fc1fbfff700 1 -- 172.21.15.62:0/2027494417 shutdown_connections 2021-12-17T18:26:07.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.495+0000 7fc1fbfff700 1 --2- 172.21.15.62:0/2027494417 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1e00536d0 0x7fc1e0055b90 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.495+0000 7fc1fbfff700 1 --2- 172.21.15.62:0/2027494417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1fc13cc70 0x7fc1fc1526d0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.495+0000 7fc1fbfff700 1 --2- 172.21.15.62:0/2027494417 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc1fc0b1260 0x7fc1fc13ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.495+0000 7fc1fbfff700 1 --2- 172.21.15.62:0/2027494417 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc1fc063b00 0x7fc1fc0b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.495+0000 7fc1fbfff700 1 -- 172.21.15.62:0/2027494417 >> 172.21.15.62:0/2027494417 conn(0x7fc1fc060a50 msgr2=0x7fc1fc0b5800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:07.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.495+0000 7fc1fbfff700 1 -- 172.21.15.62:0/2027494417 shutdown_connections 2021-12-17T18:26:07.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.495+0000 7fc1fbfff700 1 -- 172.21.15.62:0/2027494417 wait complete. 2021-12-17T18:26:07.513 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:26:07.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.611+0000 7fae90364700 1 Processor -- start 2021-12-17T18:26:07.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.611+0000 7fae90364700 1 -- start start 2021-12-17T18:26:07.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae90364700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fae880b2580 0x7fae88144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae90364700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fae88060710 0x7fae88065c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae90364700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae880b1a50 con 0x7fae8805f730 2021-12-17T18:26:07.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae90364700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae880657d0 con 0x7fae88060710 2021-12-17T18:26:07.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae90364700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae880b2960 con 0x7fae880b2580 2021-12-17T18:26:07.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8e901700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fae8805f730 0x7fae88140160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37808/0 (socket says 172.21.15.62:37808) 2021-12-17T18:26:07.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8e901700 1 -- 172.21.15.62:0/2301047251 learned_addr learned my addr 172.21.15.62:0/2301047251 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:07.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d8ff700 1 --2- 172.21.15.62:0/2301047251 >> v2:172.21.15.109:3300/0 conn(0x7fae88060710 0x7fae88065c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8e100700 1 --2- 172.21.15.62:0/2301047251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fae880b2580 0x7fae88144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 -- 172.21.15.62:0/2301047251 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280305786 0 0) 0x7fae880b1a50 con 0x7fae8805f730 2021-12-17T18:26:07.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 -- 172.21.15.62:0/2301047251 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae70003260 con 0x7fae8805f730 2021-12-17T18:26:07.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 -- 172.21.15.62:0/2301047251 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 70501476 0 0) 0x7fae70003260 con 0x7fae8805f730 2021-12-17T18:26:07.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 -- 172.21.15.62:0/2301047251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fae880b2580 msgr2=0x7fae88144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:07.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 --2- 172.21.15.62:0/2301047251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fae880b2580 0x7fae88144390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 -- 172.21.15.62:0/2301047251 >> v2:172.21.15.109:3300/0 conn(0x7fae88060710 msgr2=0x7fae88065c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:07.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 --2- 172.21.15.62:0/2301047251 >> v2:172.21.15.109:3300/0 conn(0x7fae88060710 0x7fae88065c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 -- 172.21.15.62:0/2301047251 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae880b4e50 con 0x7fae8805f730 2021-12-17T18:26:07.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 -- 172.21.15.62:0/2301047251 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fae800019e0 con 0x7fae8805f730 2021-12-17T18:26:07.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d8ff700 1 --2- 172.21.15.62:0/2301047251 >> v2:172.21.15.109:3300/0 conn(0x7fae88060710 0x7fae88065c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:07.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 -- 172.21.15.62:0/2301047251 >> v1:172.21.15.62:6789/0 conn(0x7fae8805f730 legacy=0x7fae88140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 --2- 172.21.15.62:0/2301047251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fae880b2580 0x7fae70003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 --2- 172.21.15.62:0/2301047251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae70003c80 0x7fae70004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 --2- 172.21.15.62:0/2301047251 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fae700049f0 0x7fae70004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 -- 172.21.15.62:0/2301047251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae880657d0 con 0x7fae70003c80 2021-12-17T18:26:07.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 -- 172.21.15.62:0/2301047251 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae880b2960 con 0x7fae700049f0 2021-12-17T18:26:07.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 -- 172.21.15.62:0/2301047251 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7000b750 con 0x7fae880b2580 2021-12-17T18:26:07.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d8ff700 1 --2- 172.21.15.62:0/2301047251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae70003c80 0x7fae70004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8e100700 1 --2- 172.21.15.62:0/2301047251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fae880b2580 0x7fae70003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8e901700 1 --2- 172.21.15.62:0/2301047251 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fae700049f0 0x7fae70004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d8ff700 1 -- 172.21.15.62:0/2301047251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fae880b2580 msgr2=0x7fae70003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:07.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d8ff700 1 --2- 172.21.15.62:0/2301047251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fae880b2580 0x7fae70003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d8ff700 1 -- 172.21.15.62:0/2301047251 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fae700049f0 msgr2=0x7fae70004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:07.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d8ff700 1 --2- 172.21.15.62:0/2301047251 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fae700049f0 0x7fae70004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d8ff700 1 -- 172.21.15.62:0/2301047251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae70003260 con 0x7fae70003c80 2021-12-17T18:26:07.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d8ff700 1 --2- 172.21.15.62:0/2301047251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae70003c80 0x7fae70004500 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7fae700054d0 tx=0x7fae78006df0).ready entity=mon.0 client_cookie=19f70e5aedc31397 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:07.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 -- 172.21.15.62:0/2301047251 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae7800e830 con 0x7fae70003c80 2021-12-17T18:26:07.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 -- 172.21.15.62:0/2301047251 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7800e990 con 0x7fae70003c80 2021-12-17T18:26:07.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8d0fe700 1 -- 172.21.15.62:0/2301047251 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae7800ecf0 con 0x7fae70003c80 2021-12-17T18:26:07.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae90364700 1 -- 172.21.15.62:0/2301047251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae70003c80 msgr2=0x7fae70004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae90364700 1 --2- 172.21.15.62:0/2301047251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae70003c80 0x7fae70004500 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7fae700054d0 tx=0x7fae78006df0).stop 2021-12-17T18:26:07.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.615+0000 7fae8e901700 1 -- 172.21.15.62:0/2301047251 reap_dead start 2021-12-17T18:26:07.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.619+0000 7fae90364700 1 -- 172.21.15.62:0/2301047251 shutdown_connections 2021-12-17T18:26:07.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.619+0000 7fae90364700 1 -- 172.21.15.62:0/2301047251 >> 172.21.15.62:0/2301047251 conn(0x7fae8805c750 msgr2=0x7fae8805cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:07.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.619+0000 7fae90364700 1 -- 172.21.15.62:0/2301047251 shutdown_connections 2021-12-17T18:26:07.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.619+0000 7fae90364700 1 -- 172.21.15.62:0/2301047251 wait complete. 2021-12-17T18:26:07.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.619+0000 7fae90364700 1 Processor -- start 2021-12-17T18:26:07.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.619+0000 7fae90364700 1 -- start start 2021-12-17T18:26:07.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.619+0000 7fae90364700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fae70003c80 0x7fae88146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.619+0000 7fae90364700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fae88155630 0x7fae880b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.619+0000 7fae90364700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae880b0770 0x7fae88155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.619+0000 7fae90364700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae881462a0 con 0x7fae880b0770 2021-12-17T18:26:07.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.619+0000 7fae90364700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae88146000 con 0x7fae88155630 2021-12-17T18:26:07.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.619+0000 7fae90364700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae880b0e70 con 0x7fae70003c80 2021-12-17T18:26:07.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.619+0000 7fae8e901700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae880b0770 0x7fae88155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.619+0000 7fae8e100700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fae70003c80 0x7fae88146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.619+0000 7fae8e901700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae880b0770 0x7fae88155c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54240/0 (socket says 172.21.15.62:54240) 2021-12-17T18:26:07.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.619+0000 7fae8e901700 1 -- 172.21.15.62:0/2027693919 learned_addr learned my addr 172.21.15.62:0/2027693919 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:07.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.619+0000 7fae8d8ff700 1 --2- 172.21.15.62:0/2027693919 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fae88155630 0x7fae880b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.623+0000 7fae8e901700 1 -- 172.21.15.62:0/2027693919 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fae70003c80 msgr2=0x7fae88146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.623+0000 7fae8e901700 1 --2- 172.21.15.62:0/2027693919 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fae70003c80 0x7fae88146460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.623+0000 7fae8e901700 1 -- 172.21.15.62:0/2027693919 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fae88155630 msgr2=0x7fae880b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.623+0000 7fae8e901700 1 --2- 172.21.15.62:0/2027693919 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fae88155630 0x7fae880b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.623+0000 7fae8e901700 1 -- 172.21.15.62:0/2027693919 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae880649c0 con 0x7fae880b0770 2021-12-17T18:26:07.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.623+0000 7fae8e901700 1 --2- 172.21.15.62:0/2027693919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae880b0770 0x7fae88155c90 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7fae80000b60 tx=0x7fae800021d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:07.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.623+0000 7fae777fe700 1 -- 172.21.15.62:0/2027693919 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae80011850 con 0x7fae880b0770 2021-12-17T18:26:07.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.623+0000 7fae777fe700 1 -- 172.21.15.62:0/2027693919 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae800119b0 con 0x7fae880b0770 2021-12-17T18:26:07.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.623+0000 7fae90364700 1 -- 172.21.15.62:0/2027693919 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae88156180 con 0x7fae880b0770 2021-12-17T18:26:07.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.623+0000 7fae777fe700 1 -- 172.21.15.62:0/2027693919 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae80011d10 con 0x7fae880b0770 2021-12-17T18:26:07.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.623+0000 7fae90364700 1 -- 172.21.15.62:0/2027693919 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae88152400 con 0x7fae880b0770 2021-12-17T18:26:07.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.623+0000 7fae90364700 1 -- 172.21.15.62:0/2027693919 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae880b4bb0 con 0x7fae880b0770 2021-12-17T18:26:07.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.623+0000 7fae777fe700 1 -- 172.21.15.62:0/2027693919 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fae8001b030 con 0x7fae880b0770 2021-12-17T18:26:07.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.623+0000 7fae777fe700 1 --2- 172.21.15.62:0/2027693919 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fae680535b0 0x7fae68055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.623+0000 7fae777fe700 1 -- 172.21.15.62:0/2027693919 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fae8006b180 con 0x7fae880b0770 2021-12-17T18:26:07.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.623+0000 7fae8e100700 1 --2- 172.21.15.62:0/2027693919 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fae680535b0 0x7fae68055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.627+0000 7fae8e100700 1 --2- 172.21.15.62:0/2027693919 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fae680535b0 0x7fae68055a70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fae8400b000 tx=0x7fae84006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:07.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.631+0000 7fae777fe700 1 -- 172.21.15.62:0/2027693919 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fae80042610 con 0x7fae880b0770 2021-12-17T18:26:07.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.759+0000 7fae90364700 1 -- 172.21.15.62:0/2027693919 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fae880573d0 con 0x7fae880b0770 2021-12-17T18:26:07.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.759+0000 7fae777fe700 1 -- 172.21.15.62:0/2027693919 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7fae80019030 con 0x7fae880b0770 2021-12-17T18:26:07.767 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:26:07.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.763+0000 7fae90364700 1 -- 172.21.15.62:0/2027693919 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fae680535b0 msgr2=0x7fae68055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.763+0000 7fae90364700 1 --2- 172.21.15.62:0/2027693919 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fae680535b0 0x7fae68055a70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fae8400b000 tx=0x7fae84006df0).stop 2021-12-17T18:26:07.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.763+0000 7fae90364700 1 -- 172.21.15.62:0/2027693919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae880b0770 msgr2=0x7fae88155c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.763+0000 7fae90364700 1 --2- 172.21.15.62:0/2027693919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae880b0770 0x7fae88155c90 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7fae80000b60 tx=0x7fae800021d0).stop 2021-12-17T18:26:07.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.763+0000 7fae90364700 1 -- 172.21.15.62:0/2027693919 shutdown_connections 2021-12-17T18:26:07.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.763+0000 7fae90364700 1 --2- 172.21.15.62:0/2027693919 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fae680535b0 0x7fae68055a70 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.763+0000 7fae90364700 1 --2- 172.21.15.62:0/2027693919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae880b0770 0x7fae88155c90 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.763+0000 7fae90364700 1 --2- 172.21.15.62:0/2027693919 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fae88155630 0x7fae880b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.763+0000 7fae90364700 1 --2- 172.21.15.62:0/2027693919 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fae70003c80 0x7fae88146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.763+0000 7fae90364700 1 -- 172.21.15.62:0/2027693919 >> 172.21.15.62:0/2027693919 conn(0x7fae8805c750 msgr2=0x7fae8813ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:07.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.763+0000 7fae90364700 1 -- 172.21.15.62:0/2027693919 shutdown_connections 2021-12-17T18:26:07.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.763+0000 7fae90364700 1 -- 172.21.15.62:0/2027693919 wait complete. 2021-12-17T18:26:07.781 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-12-17T18:26:07.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.879+0000 7f90202d4700 1 Processor -- start 2021-12-17T18:26:07.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.879+0000 7f90202d4700 1 -- start start 2021-12-17T18:26:07.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f90202d4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90180b21f0 0x7f901814aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f90202d4700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f90180b1730 0x7f90180ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f90202d4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90180a7bb0 0x7f9018067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f90202d4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9018147870 con 0x7f90180a7bb0 2021-12-17T18:26:07.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f90202d4700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90180b2ce0 con 0x7f90180b1730 2021-12-17T18:26:07.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f90202d4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90180aca60 con 0x7f90180b21f0 2021-12-17T18:26:07.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f901e871700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90180a7bb0 0x7f9018067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f901e871700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90180a7bb0 0x7f9018067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54248/0 (socket says 172.21.15.62:54248) 2021-12-17T18:26:07.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f901e070700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90180b21f0 0x7f901814aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f901e871700 1 -- 172.21.15.62:0/1786636493 learned_addr learned my addr 172.21.15.62:0/1786636493 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:07.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f901d86f700 1 --2- 172.21.15.62:0/1786636493 >> v2:172.21.15.109:3300/0 conn(0x7f90180b1730 0x7f90180ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f901e871700 1 -- 172.21.15.62:0/1786636493 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90180b21f0 msgr2=0x7f901814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:07.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f901e871700 1 --2- 172.21.15.62:0/1786636493 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90180b21f0 0x7f901814aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f901e871700 1 -- 172.21.15.62:0/1786636493 >> v2:172.21.15.109:3300/0 conn(0x7f90180b1730 msgr2=0x7f90180ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:07.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f901e871700 1 --2- 172.21.15.62:0/1786636493 >> v2:172.21.15.109:3300/0 conn(0x7f90180b1730 0x7f90180ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f901e871700 1 -- 172.21.15.62:0/1786636493 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90180b2f10 con 0x7f90180a7bb0 2021-12-17T18:26:07.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f901d86f700 1 --2- 172.21.15.62:0/1786636493 >> v2:172.21.15.109:3300/0 conn(0x7f90180b1730 0x7f90180ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:07.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f901e070700 1 --2- 172.21.15.62:0/1786636493 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90180b21f0 0x7f901814aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:07.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f901e871700 1 --2- 172.21.15.62:0/1786636493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90180a7bb0 0x7f9018067120 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f9010002f70 tx=0x7f9010006eb0).ready entity=mon.0 client_cookie=ea94444aadd19fca server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:07.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f901d06e700 1 -- 172.21.15.62:0/1786636493 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f901000d570 con 0x7f90180a7bb0 2021-12-17T18:26:07.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f901d06e700 1 -- 172.21.15.62:0/1786636493 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9010000e90 con 0x7f90180a7bb0 2021-12-17T18:26:07.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f901d06e700 1 -- 172.21.15.62:0/1786636493 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f901000d900 con 0x7f90180a7bb0 2021-12-17T18:26:07.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f90202d4700 1 -- 172.21.15.62:0/1786636493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90180a7bb0 msgr2=0x7f9018067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f90202d4700 1 --2- 172.21.15.62:0/1786636493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90180a7bb0 0x7f9018067120 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f9010002f70 tx=0x7f9010006eb0).stop 2021-12-17T18:26:07.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f90202d4700 1 -- 172.21.15.62:0/1786636493 shutdown_connections 2021-12-17T18:26:07.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f90202d4700 1 --2- 172.21.15.62:0/1786636493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90180a7bb0 0x7f9018067120 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f90202d4700 1 --2- 172.21.15.62:0/1786636493 >> v2:172.21.15.109:3300/0 conn(0x7f90180b1730 0x7f90180ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f90202d4700 1 --2- 172.21.15.62:0/1786636493 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90180b21f0 0x7f901814aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f90202d4700 1 -- 172.21.15.62:0/1786636493 >> 172.21.15.62:0/1786636493 conn(0x7f901805f730 msgr2=0x7f901805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:07.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f90202d4700 1 -- 172.21.15.62:0/1786636493 shutdown_connections 2021-12-17T18:26:07.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.883+0000 7f90202d4700 1 -- 172.21.15.62:0/1786636493 wait complete. 2021-12-17T18:26:07.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f90202d4700 1 Processor -- start 2021-12-17T18:26:07.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f90202d4700 1 -- start start 2021-12-17T18:26:07.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f90202d4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f90180a7bb0 0x7f9018065ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f90202d4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90180b1730 0x7f90181578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f90202d4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90180b21f0 0x7f90180aaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f90202d4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9018064200 con 0x7f90180b21f0 2021-12-17T18:26:07.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f90202d4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9018063cc0 con 0x7f90180a7bb0 2021-12-17T18:26:07.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f90202d4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9018063f60 con 0x7f90180b1730 2021-12-17T18:26:07.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f901e871700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90180b21f0 0x7f90180aaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f901e871700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90180b21f0 0x7f90180aaea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54252/0 (socket says 172.21.15.62:54252) 2021-12-17T18:26:07.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f901e871700 1 -- 172.21.15.62:0/3065443966 learned_addr learned my addr 172.21.15.62:0/3065443966 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:07.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f901e070700 1 --2- 172.21.15.62:0/3065443966 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f90180a7bb0 0x7f9018065ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f901d86f700 1 --2- 172.21.15.62:0/3065443966 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90180b1730 0x7f90181578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f901e070700 1 -- 172.21.15.62:0/3065443966 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90180b1730 msgr2=0x7f90181578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f901e070700 1 --2- 172.21.15.62:0/3065443966 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90180b1730 0x7f90181578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f901e070700 1 -- 172.21.15.62:0/3065443966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90180b21f0 msgr2=0x7f90180aaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:07.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f901e070700 1 --2- 172.21.15.62:0/3065443966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90180b21f0 0x7f90180aaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:07.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f901e070700 1 -- 172.21.15.62:0/3065443966 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9014009470 con 0x7f90180a7bb0 2021-12-17T18:26:07.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f901e871700 1 --2- 172.21.15.62:0/3065443966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90180b21f0 0x7f90180aaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:07.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f901d86f700 1 --2- 172.21.15.62:0/3065443966 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90180b1730 0x7f90181578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:07.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f901e070700 1 --2- 172.21.15.62:0/3065443966 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f90180a7bb0 0x7f9018065ac0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f900800c000 tx=0x7f9008006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:07.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f90077fe700 1 -- 172.21.15.62:0/3065443966 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9008010780 con 0x7f90180a7bb0 2021-12-17T18:26:07.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f90202d4700 1 -- 172.21.15.62:0/3065443966 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900800b180 con 0x7f90180a7bb0 2021-12-17T18:26:07.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f90077fe700 1 -- 172.21.15.62:0/3065443966 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90080108e0 con 0x7f90180a7bb0 2021-12-17T18:26:07.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f90202d4700 1 -- 172.21.15.62:0/3065443966 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901000b1e0 con 0x7f90180a7bb0 2021-12-17T18:26:07.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.887+0000 7f90077fe700 1 -- 172.21.15.62:0/3065443966 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9008010c40 con 0x7f90180a7bb0 2021-12-17T18:26:07.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.891+0000 7f90202d4700 1 -- 172.21.15.62:0/3065443966 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90180573d0 con 0x7f90180a7bb0 2021-12-17T18:26:07.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.891+0000 7f90077fe700 1 -- 172.21.15.62:0/3065443966 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f900801c460 con 0x7f90180a7bb0 2021-12-17T18:26:07.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.891+0000 7f90077fe700 1 --2- 172.21.15.62:0/3065443966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ff8053640 0x7f8ff8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:07.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.891+0000 7f90077fe700 1 -- 172.21.15.62:0/3065443966 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f900806ba40 con 0x7f90180a7bb0 2021-12-17T18:26:07.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.891+0000 7f901d86f700 1 --2- 172.21.15.62:0/3065443966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ff8053640 0x7f8ff8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:07.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.891+0000 7f901d86f700 1 --2- 172.21.15.62:0/3065443966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ff8053640 0x7f8ff8055b00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f901400b000 tx=0x7f90140091d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:07.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:07.899+0000 7f90077fe700 1 -- 172.21.15.62:0/3065443966 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9008042dd0 con 0x7f90180a7bb0 2021-12-17T18:26:08.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.027+0000 7f90202d4700 1 -- 172.21.15.62:0/3065443966 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f90180af860 con 0x7f90180a7bb0 2021-12-17T18:26:08.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.031+0000 7f90077fe700 1 -- 172.21.15.62:0/3065443966 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v98) v1 ==== 84+0+143 (secure 0 0 0) 0x7f90080463f0 con 0x7f90180a7bb0 2021-12-17T18:26:08.036 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:08.036 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2021-12-17T18:26:08.037 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:08.037 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2021-12-17T18:26:08.037 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "device_health_metrics" 2021-12-17T18:26:08.037 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:08.038 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:08.038 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2021-12-17T18:26:08.038 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2021-12-17T18:26:08.038 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:08.039 INFO:teuthology.orchestra.run.smithi062.stdout:] 2021-12-17T18:26:08.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.031+0000 7f90202d4700 1 -- 172.21.15.62:0/3065443966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ff8053640 msgr2=0x7f8ff8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:08.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.031+0000 7f90202d4700 1 --2- 172.21.15.62:0/3065443966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ff8053640 0x7f8ff8055b00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f901400b000 tx=0x7f90140091d0).stop 2021-12-17T18:26:08.040 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.031+0000 7f90202d4700 1 -- 172.21.15.62:0/3065443966 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f90180a7bb0 msgr2=0x7f9018065ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:08.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.031+0000 7f90202d4700 1 --2- 172.21.15.62:0/3065443966 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f90180a7bb0 0x7f9018065ac0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f900800c000 tx=0x7f9008006df0).stop 2021-12-17T18:26:08.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.031+0000 7f90202d4700 1 -- 172.21.15.62:0/3065443966 shutdown_connections 2021-12-17T18:26:08.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.031+0000 7f90202d4700 1 --2- 172.21.15.62:0/3065443966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ff8053640 0x7f8ff8055b00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:08.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.031+0000 7f90202d4700 1 --2- 172.21.15.62:0/3065443966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90180b21f0 0x7f90180aaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:08.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.031+0000 7f90202d4700 1 --2- 172.21.15.62:0/3065443966 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f90180b1730 0x7f90181578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:08.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.031+0000 7f90202d4700 1 --2- 172.21.15.62:0/3065443966 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f90180a7bb0 0x7f9018065ac0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:08.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.031+0000 7f90202d4700 1 -- 172.21.15.62:0/3065443966 >> 172.21.15.62:0/3065443966 conn(0x7f901805f730 msgr2=0x7f90180b5310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:08.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.031+0000 7f90202d4700 1 -- 172.21.15.62:0/3065443966 shutdown_connections 2021-12-17T18:26:08.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.031+0000 7f90202d4700 1 -- 172.21.15.62:0/3065443966 wait complete. 2021-12-17T18:26:08.049 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-12-17T18:26:08.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-12-17T18:26:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.159+0000 7fbee27d1700 1 Processor -- start 2021-12-17T18:26:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.159+0000 7fbee27d1700 1 -- start start 2021-12-17T18:26:08.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.159+0000 7fbee27d1700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fbedc0b47c0 0x7fbedc0b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:08.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.159+0000 7fbee27d1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc0b0870 con 0x7fbedc0b5be0 2021-12-17T18:26:08.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.159+0000 7fbee27d1700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc05ce70 con 0x7fbedc05ca90 2021-12-17T18:26:08.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.159+0000 7fbee27d1700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbedc0b05d0 con 0x7fbedc0b47c0 2021-12-17T18:26:08.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.159+0000 7fbee1fd0700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbedc0b5be0 0x7fbedc143ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37842/0 (socket says 172.21.15.62:37842) 2021-12-17T18:26:08.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.159+0000 7fbee1fd0700 1 -- 172.21.15.62:0/1026985320 learned_addr learned my addr 172.21.15.62:0/1026985320 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:08.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.159+0000 7fbee0fce700 1 --2- 172.21.15.62:0/1026985320 >> v2:172.21.15.109:3300/0 conn(0x7fbedc0b47c0 0x7fbedc0b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:08.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.163+0000 7fbecbfff700 1 -- 172.21.15.62:0/1026985320 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593018160 0 0) 0x7fbedc0b0870 con 0x7fbedc0b5be0 2021-12-17T18:26:08.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.163+0000 7fbecbfff700 1 -- 172.21.15.62:0/1026985320 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec4003260 con 0x7fbedc0b5be0 2021-12-17T18:26:08.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.163+0000 7fbee0fce700 1 -- 172.21.15.62:0/1026985320 >> v1:172.21.15.109:6789/0 conn(0x7fbedc05ca90 legacy=0x7fbedc0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:08.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.163+0000 7fbee0fce700 1 -- 172.21.15.62:0/1026985320 >> v1:172.21.15.62:6789/0 conn(0x7fbedc0b5be0 legacy=0x7fbedc143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:08.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.163+0000 7fbee0fce700 1 -- 172.21.15.62:0/1026985320 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc0b5250 con 0x7fbedc0b47c0 2021-12-17T18:26:08.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.163+0000 7fbee0fce700 1 --2- 172.21.15.62:0/1026985320 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbedc0b47c0 0x7fbedc0b56f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fbed8002f70 tx=0x7fbed8006df0).ready entity=mon.1 client_cookie=8cf308411b7c01e9 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:08.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.163+0000 7fbecbfff700 1 -- 172.21.15.62:0/1026985320 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbed800d610 con 0x7fbedc0b47c0 2021-12-17T18:26:08.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.163+0000 7fbecbfff700 1 -- 172.21.15.62:0/1026985320 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed8000e90 con 0x7fbedc0b47c0 2021-12-17T18:26:08.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.163+0000 7fbecbfff700 1 -- 172.21.15.62:0/1026985320 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbed800d960 con 0x7fbedc0b47c0 2021-12-17T18:26:08.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.163+0000 7fbee27d1700 1 -- 172.21.15.62:0/1026985320 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbedc0b47c0 msgr2=0x7fbedc0b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:08.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.163+0000 7fbee27d1700 1 --2- 172.21.15.62:0/1026985320 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbedc0b47c0 0x7fbedc0b56f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fbed8002f70 tx=0x7fbed8006df0).stop 2021-12-17T18:26:08.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.163+0000 7fbee27d1700 1 -- 172.21.15.62:0/1026985320 shutdown_connections 2021-12-17T18:26:08.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.163+0000 7fbee27d1700 1 --2- 172.21.15.62:0/1026985320 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbedc0b47c0 0x7fbedc0b56f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:08.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.163+0000 7fbee27d1700 1 -- 172.21.15.62:0/1026985320 >> 172.21.15.62:0/1026985320 conn(0x7fbedc05bcd0 msgr2=0x7fbedc062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:08.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.163+0000 7fbee27d1700 1 -- 172.21.15.62:0/1026985320 shutdown_connections 2021-12-17T18:26:08.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.163+0000 7fbee27d1700 1 -- 172.21.15.62:0/1026985320 wait complete. 2021-12-17T18:26:08.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee27d1700 1 Processor -- start 2021-12-17T18:26:08.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee27d1700 1 -- start start 2021-12-17T18:26:08.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee27d1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbedc05ca90 0x7fbedc152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:08.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee27d1700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbedc0b47c0 0x7fbedc0a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:08.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee27d1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbedc0b5be0 0x7fbedc0a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:08.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee27d1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0a4ac0 con 0x7fbedc05ca90 2021-12-17T18:26:08.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee27d1700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc066310 con 0x7fbedc0b47c0 2021-12-17T18:26:08.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee27d1700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc153420 con 0x7fbedc0b5be0 2021-12-17T18:26:08.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee17cf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbedc05ca90 0x7fbedc152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:08.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee17cf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbedc05ca90 0x7fbedc152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54264/0 (socket says 172.21.15.62:54264) 2021-12-17T18:26:08.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee0fce700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbedc0b47c0 0x7fbedc0a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:08.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee17cf700 1 -- 172.21.15.62:0/160067784 learned_addr learned my addr 172.21.15.62:0/160067784 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:08.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee1fd0700 1 --2- 172.21.15.62:0/160067784 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbedc0b5be0 0x7fbedc0a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:08.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee17cf700 1 -- 172.21.15.62:0/160067784 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbedc0b5be0 msgr2=0x7fbedc0a5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:08.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee17cf700 1 --2- 172.21.15.62:0/160067784 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbedc0b5be0 0x7fbedc0a5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:08.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee17cf700 1 -- 172.21.15.62:0/160067784 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbedc0b47c0 msgr2=0x7fbedc0a58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:08.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee17cf700 1 --2- 172.21.15.62:0/160067784 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbedc0b47c0 0x7fbedc0a58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:08.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee17cf700 1 -- 172.21.15.62:0/160067784 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed800b180 con 0x7fbedc05ca90 2021-12-17T18:26:08.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee17cf700 1 --2- 172.21.15.62:0/160067784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbedc05ca90 0x7fbedc152e70 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7fbedc0654e0 tx=0x7fbecc007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:08.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbeca7fc700 1 -- 172.21.15.62:0/160067784 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbecc007030 con 0x7fbedc05ca90 2021-12-17T18:26:08.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbeca7fc700 1 -- 172.21.15.62:0/160067784 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc007190 con 0x7fbedc05ca90 2021-12-17T18:26:08.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee27d1700 1 -- 172.21.15.62:0/160067784 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbedc065bd0 con 0x7fbedc05ca90 2021-12-17T18:26:08.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbeca7fc700 1 -- 172.21.15.62:0/160067784 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbecc006510 con 0x7fbedc05ca90 2021-12-17T18:26:08.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.167+0000 7fbee27d1700 1 -- 172.21.15.62:0/160067784 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc066c10 con 0x7fbedc05ca90 2021-12-17T18:26:08.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.171+0000 7fbee27d1700 1 -- 172.21.15.62:0/160067784 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbedc0b3980 con 0x7fbedc05ca90 2021-12-17T18:26:08.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.171+0000 7fbeca7fc700 1 -- 172.21.15.62:0/160067784 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbecc010030 con 0x7fbedc05ca90 2021-12-17T18:26:08.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.171+0000 7fbeca7fc700 1 --2- 172.21.15.62:0/160067784 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbebc053640 0x7fbebc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:08.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.171+0000 7fbeca7fc700 1 -- 172.21.15.62:0/160067784 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fbecc06b160 con 0x7fbedc05ca90 2021-12-17T18:26:08.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.171+0000 7fbee0fce700 1 --2- 172.21.15.62:0/160067784 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbebc053640 0x7fbebc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:08.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.171+0000 7fbee0fce700 1 --2- 172.21.15.62:0/160067784 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbebc053640 0x7fbebc055b00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fbed801a000 tx=0x7fbed8014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:08.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.175+0000 7fbeca7fc700 1 -- 172.21.15.62:0/160067784 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbecc0425f0 con 0x7fbedc05ca90 2021-12-17T18:26:08.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.303+0000 7fbee27d1700 1 -- 172.21.15.62:0/160067784 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fbedc0573d0 con 0x7fbedc05ca90 2021-12-17T18:26:08.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.931+0000 7fbeca7fc700 1 -- 172.21.15.62:0/160067784 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v99) v1 ==== 133+0+0 (secure 0 0 0) 0x7fbecc045c10 con 0x7fbedc05ca90 2021-12-17T18:26:08.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.935+0000 7fbee27d1700 1 -- 172.21.15.62:0/160067784 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbebc053640 msgr2=0x7fbebc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:08.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.935+0000 7fbee27d1700 1 --2- 172.21.15.62:0/160067784 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbebc053640 0x7fbebc055b00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fbed801a000 tx=0x7fbed8014000).stop 2021-12-17T18:26:08.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.935+0000 7fbee27d1700 1 -- 172.21.15.62:0/160067784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbedc05ca90 msgr2=0x7fbedc152e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:08.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.935+0000 7fbee27d1700 1 --2- 172.21.15.62:0/160067784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbedc05ca90 0x7fbedc152e70 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7fbedc0654e0 tx=0x7fbecc007c10).stop 2021-12-17T18:26:08.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.935+0000 7fbee27d1700 1 -- 172.21.15.62:0/160067784 shutdown_connections 2021-12-17T18:26:08.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.935+0000 7fbee27d1700 1 --2- 172.21.15.62:0/160067784 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbebc053640 0x7fbebc055b00 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:08.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.935+0000 7fbee27d1700 1 --2- 172.21.15.62:0/160067784 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbedc0b5be0 0x7fbedc0a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:08.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.935+0000 7fbee27d1700 1 --2- 172.21.15.62:0/160067784 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbedc0b47c0 0x7fbedc0a58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:08.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.935+0000 7fbee27d1700 1 --2- 172.21.15.62:0/160067784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbedc05ca90 0x7fbedc152e70 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:08.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.935+0000 7fbee27d1700 1 -- 172.21.15.62:0/160067784 >> 172.21.15.62:0/160067784 conn(0x7fbedc05bcd0 msgr2=0x7fbedc145ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:08.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.935+0000 7fbee27d1700 1 -- 172.21.15.62:0/160067784 shutdown_connections 2021-12-17T18:26:08.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:08.935+0000 7fbee27d1700 1 -- 172.21.15.62:0/160067784 wait complete. 2021-12-17T18:26:08.946 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2021-12-17T18:26:08.956 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-12-17T18:26:09.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.059+0000 7f721ada0700 1 Processor -- start 2021-12-17T18:26:09.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.059+0000 7f721ada0700 1 -- start start 2021-12-17T18:26:09.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.059+0000 7f721ada0700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f72140b3540 0x7f72140b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:09.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.059+0000 7f721ada0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72140b4230 0x7f72140b5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:09.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.059+0000 7f721ada0700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721405ce70 con 0x7f721405ca90 2021-12-17T18:26:09.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.059+0000 7f721ada0700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72140b1bc0 con 0x7f72140b3540 2021-12-17T18:26:09.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.059+0000 7f721ada0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72140b1e60 con 0x7f72140b4230 2021-12-17T18:26:09.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f721959d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f72140b3540 0x7f72140b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:09.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f721a59f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72140b4230 0x7f72140b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:09.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f7219d9e700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f721405ca90 0x7f72140b4f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:54174/0 (socket says 172.21.15.62:54174) 2021-12-17T18:26:09.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f7219d9e700 1 -- 172.21.15.62:0/736543637 learned_addr learned my addr 172.21.15.62:0/736543637 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:09.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f721959d700 1 -- 172.21.15.62:0/736543637 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72140b4230 msgr2=0x7f72140b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:09.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f721959d700 1 --2- 172.21.15.62:0/736543637 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72140b4230 0x7f72140b5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:09.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f721959d700 1 -- 172.21.15.62:0/736543637 >> v1:172.21.15.109:6789/0 conn(0x7f721405ca90 legacy=0x7f72140b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:09.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f721959d700 1 -- 172.21.15.62:0/736543637 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72140b2100 con 0x7f72140b3540 2021-12-17T18:26:09.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f721a59f700 1 --2- 172.21.15.62:0/736543637 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72140b4230 0x7f72140b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:09.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f721959d700 1 --2- 172.21.15.62:0/736543637 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72140b3540 0x7f72140b25a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f7210002f70 tx=0x7f7210006d90).ready entity=mon.1 client_cookie=242d65112fd79252 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:09.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f7218d9c700 1 -- 172.21.15.62:0/736543637 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f721000d4a0 con 0x7f72140b3540 2021-12-17T18:26:09.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f7218d9c700 1 -- 172.21.15.62:0/736543637 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7210000e90 con 0x7f72140b3540 2021-12-17T18:26:09.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f7218d9c700 1 -- 172.21.15.62:0/736543637 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f721000d7f0 con 0x7f72140b3540 2021-12-17T18:26:09.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f721ada0700 1 -- 172.21.15.62:0/736543637 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72140b3540 msgr2=0x7f72140b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:09.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f721ada0700 1 --2- 172.21.15.62:0/736543637 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72140b3540 0x7f72140b25a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f7210002f70 tx=0x7f7210006d90).stop 2021-12-17T18:26:09.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f721ada0700 1 -- 172.21.15.62:0/736543637 shutdown_connections 2021-12-17T18:26:09.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f721ada0700 1 --2- 172.21.15.62:0/736543637 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72140b4230 0x7f72140b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:09.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f721ada0700 1 --2- 172.21.15.62:0/736543637 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72140b3540 0x7f72140b25a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:09.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f721ada0700 1 -- 172.21.15.62:0/736543637 >> 172.21.15.62:0/736543637 conn(0x7f721405bcd0 msgr2=0x7f7214062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:09.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f721ada0700 1 -- 172.21.15.62:0/736543637 shutdown_connections 2021-12-17T18:26:09.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.063+0000 7f721ada0700 1 -- 172.21.15.62:0/736543637 wait complete. 2021-12-17T18:26:09.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721ada0700 1 Processor -- start 2021-12-17T18:26:09.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721ada0700 1 -- start start 2021-12-17T18:26:09.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721ada0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f721405ca90 0x7f721414a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:09.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721ada0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72140b3540 0x7f72140a3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:09.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721ada0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72140b4230 0x7f72140af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:09.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721ada0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7214148b10 con 0x7f72140b4230 2021-12-17T18:26:09.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721ada0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72140a5bb0 con 0x7f72140b3540 2021-12-17T18:26:09.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721ada0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72140a5e50 con 0x7f721405ca90 2021-12-17T18:26:09.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721959d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72140b3540 0x7f72140a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:09.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721a59f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72140b4230 0x7f72140af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:09.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721959d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72140b3540 0x7f72140a3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:60830/0 (socket says 172.21.15.62:60830) 2021-12-17T18:26:09.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721959d700 1 -- 172.21.15.62:0/1315236381 learned_addr learned my addr 172.21.15.62:0/1315236381 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:09.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f7219d9e700 1 --2- 172.21.15.62:0/1315236381 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f721405ca90 0x7f721414a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:09.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721a59f700 1 -- 172.21.15.62:0/1315236381 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f721405ca90 msgr2=0x7f721414a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:09.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721a59f700 1 --2- 172.21.15.62:0/1315236381 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f721405ca90 0x7f721414a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:09.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721a59f700 1 -- 172.21.15.62:0/1315236381 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72140b3540 msgr2=0x7f72140a3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:09.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721a59f700 1 --2- 172.21.15.62:0/1315236381 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72140b3540 0x7f72140a3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:09.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721a59f700 1 -- 172.21.15.62:0/1315236381 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720c009470 con 0x7f72140b4230 2021-12-17T18:26:09.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721a59f700 1 --2- 172.21.15.62:0/1315236381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72140b4230 0x7f72140af360 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f720c00c000 tx=0x7f720c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:09.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f7202ffd700 1 -- 172.21.15.62:0/1315236381 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f720c00c610 con 0x7f72140b4230 2021-12-17T18:26:09.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f7202ffd700 1 -- 172.21.15.62:0/1315236381 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c00c770 con 0x7f72140b4230 2021-12-17T18:26:09.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721ada0700 1 -- 172.21.15.62:0/1315236381 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721000b120 con 0x7f72140b4230 2021-12-17T18:26:09.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f7202ffd700 1 -- 172.21.15.62:0/1315236381 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f720c00cad0 con 0x7f72140b4230 2021-12-17T18:26:09.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.067+0000 7f721ada0700 1 -- 172.21.15.62:0/1315236381 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72140a39a0 con 0x7f72140b4230 2021-12-17T18:26:09.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.071+0000 7f721ada0700 1 -- 172.21.15.62:0/1315236381 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72140603f0 con 0x7f72140b4230 2021-12-17T18:26:09.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.071+0000 7f7202ffd700 1 -- 172.21.15.62:0/1315236381 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f720c022070 con 0x7f72140b4230 2021-12-17T18:26:09.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.071+0000 7f7202ffd700 1 --2- 172.21.15.62:0/1315236381 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71f40536d0 0x7f71f4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:09.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.071+0000 7f7202ffd700 1 -- 172.21.15.62:0/1315236381 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f720c06bd60 con 0x7f72140b4230 2021-12-17T18:26:09.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.071+0000 7f7219d9e700 1 --2- 172.21.15.62:0/1315236381 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71f40536d0 0x7f71f4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:09.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.071+0000 7f7219d9e700 1 --2- 172.21.15.62:0/1315236381 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71f40536d0 0x7f71f4055b90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f720400d000 tx=0x7f7204009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:09.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.079+0000 7f7202ffd700 1 -- 172.21.15.62:0/1315236381 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f720c042ff0 con 0x7f72140b4230 2021-12-17T18:26:09.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.199+0000 7f721ada0700 1 -- 172.21.15.62:0/1315236381 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f72140573d0 con 0x7f72140b4230 2021-12-17T18:26:09.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.935+0000 7f7202ffd700 1 -- 172.21.15.62:0/1315236381 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v100) v1 ==== 125+0+0 (secure 0 0 0) 0x7f720c0160a0 con 0x7f72140b4230 2021-12-17T18:26:09.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.943+0000 7f721ada0700 1 -- 172.21.15.62:0/1315236381 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71f40536d0 msgr2=0x7f71f4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:09.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.943+0000 7f721ada0700 1 --2- 172.21.15.62:0/1315236381 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71f40536d0 0x7f71f4055b90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f720400d000 tx=0x7f7204009040).stop 2021-12-17T18:26:09.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.943+0000 7f721ada0700 1 -- 172.21.15.62:0/1315236381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72140b4230 msgr2=0x7f72140af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:09.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.943+0000 7f721ada0700 1 --2- 172.21.15.62:0/1315236381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72140b4230 0x7f72140af360 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f720c00c000 tx=0x7f720c0091d0).stop 2021-12-17T18:26:09.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.943+0000 7f721ada0700 1 -- 172.21.15.62:0/1315236381 shutdown_connections 2021-12-17T18:26:09.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.943+0000 7f721ada0700 1 --2- 172.21.15.62:0/1315236381 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f71f40536d0 0x7f71f4055b90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:09.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.943+0000 7f721ada0700 1 --2- 172.21.15.62:0/1315236381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72140b4230 0x7f72140af360 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:09.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.943+0000 7f721ada0700 1 --2- 172.21.15.62:0/1315236381 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72140b3540 0x7f72140a3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:09.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.943+0000 7f721ada0700 1 --2- 172.21.15.62:0/1315236381 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f721405ca90 0x7f721414a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:09.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.943+0000 7f721ada0700 1 -- 172.21.15.62:0/1315236381 >> 172.21.15.62:0/1315236381 conn(0x7f721405bcd0 msgr2=0x7f72140623e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:09.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.943+0000 7f721ada0700 1 -- 172.21.15.62:0/1315236381 shutdown_connections 2021-12-17T18:26:09.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:09.943+0000 7f721ada0700 1 -- 172.21.15.62:0/1315236381 wait complete. 2021-12-17T18:26:09.954 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2021-12-17T18:26:09.964 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-12-17T18:26:10.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.067+0000 7f2d15c0b700 1 Processor -- start 2021-12-17T18:26:10.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.067+0000 7f2d15c0b700 1 -- start start 2021-12-17T18:26:10.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.067+0000 7f2d15c0b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f2d10142d70 0x7f2d101471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.067+0000 7f2d15c0b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d100b09e0 con 0x7f2d100b51a0 2021-12-17T18:26:10.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.067+0000 7f2d15c0b700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d101467d0 con 0x7f2d100b4340 2021-12-17T18:26:10.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.067+0000 7f2d15c0b700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d10146a70 con 0x7f2d10142d70 2021-12-17T18:26:10.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.067+0000 7f2d0ffff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2d100b51a0 0x7f2d100b5a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37870/0 (socket says 172.21.15.62:37870) 2021-12-17T18:26:10.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.067+0000 7f2d0ffff700 1 -- 172.21.15.62:0/407813219 learned_addr learned my addr 172.21.15.62:0/407813219 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:10.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0effd700 1 --2- 172.21.15.62:0/407813219 >> v2:172.21.15.109:3300/0 conn(0x7f2d10142d70 0x7f2d101471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 -- 172.21.15.62:0/407813219 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620392427 0 0) 0x7f2d100b09e0 con 0x7f2d100b51a0 2021-12-17T18:26:10.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 -- 172.21.15.62:0/407813219 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cf0003260 con 0x7f2d100b51a0 2021-12-17T18:26:10.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 -- 172.21.15.62:0/407813219 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247088015 0 0) 0x7f2d101467d0 con 0x7f2d100b4340 2021-12-17T18:26:10.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 -- 172.21.15.62:0/407813219 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d100b09e0 con 0x7f2d100b4340 2021-12-17T18:26:10.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 -- 172.21.15.62:0/407813219 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1879152892 0 0) 0x7f2cf0003260 con 0x7f2d100b51a0 2021-12-17T18:26:10.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 -- 172.21.15.62:0/407813219 >> v2:172.21.15.109:3300/0 conn(0x7f2d10142d70 msgr2=0x7f2d101471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:10.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 --2- 172.21.15.62:0/407813219 >> v2:172.21.15.109:3300/0 conn(0x7f2d10142d70 0x7f2d101471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 -- 172.21.15.62:0/407813219 >> v1:172.21.15.109:6789/0 conn(0x7f2d100b4340 legacy=0x7f2d10142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 -- 172.21.15.62:0/407813219 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d10146d10 con 0x7f2d100b51a0 2021-12-17T18:26:10.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 -- 172.21.15.62:0/407813219 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f2d08001660 con 0x7f2d100b51a0 2021-12-17T18:26:10.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 -- 172.21.15.62:0/407813219 >> v1:172.21.15.62:6789/0 conn(0x7f2d100b51a0 legacy=0x7f2d100b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 --2- 172.21.15.62:0/407813219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cf00038e0 0x7f2cf0003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 --2- 172.21.15.62:0/407813219 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cf0004500 0x7f2cf0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 --2- 172.21.15.62:0/407813219 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cf0004e70 0x7f2cf000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 -- 172.21.15.62:0/407813219 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10146a70 con 0x7f2cf00038e0 2021-12-17T18:26:10.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 -- 172.21.15.62:0/407813219 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf000bcf0 con 0x7f2cf0004e70 2021-12-17T18:26:10.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 -- 172.21.15.62:0/407813219 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf000beb0 con 0x7f2cf0004500 2021-12-17T18:26:10.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0f7fe700 1 --2- 172.21.15.62:0/407813219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cf00038e0 0x7f2cf0003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0effd700 1 --2- 172.21.15.62:0/407813219 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cf0004500 0x7f2cf0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0ffff700 1 --2- 172.21.15.62:0/407813219 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cf0004e70 0x7f2cf000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0f7fe700 1 -- 172.21.15.62:0/407813219 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cf0004500 msgr2=0x7f2cf0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0f7fe700 1 --2- 172.21.15.62:0/407813219 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2cf0004500 0x7f2cf0004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0f7fe700 1 -- 172.21.15.62:0/407813219 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cf0004e70 msgr2=0x7f2cf000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:10.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0f7fe700 1 --2- 172.21.15.62:0/407813219 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cf0004e70 0x7f2cf000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0f7fe700 1 -- 172.21.15.62:0/407813219 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf0003260 con 0x7f2cf00038e0 2021-12-17T18:26:10.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0ffff700 1 --2- 172.21.15.62:0/407813219 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cf0004e70 0x7f2cf000b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:26:10.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0ffff700 1 -- 172.21.15.62:0/407813219 reap_dead start 2021-12-17T18:26:10.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0f7fe700 1 --2- 172.21.15.62:0/407813219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cf00038e0 0x7f2cf0003ce0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f2d00001490 tx=0x7f2d00007d80).ready entity=mon.0 client_cookie=9edf501cb28e6de4 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:10.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 -- 172.21.15.62:0/407813219 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d00001780 con 0x7f2cf00038e0 2021-12-17T18:26:10.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 -- 172.21.15.62:0/407813219 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d00006890 con 0x7f2cf00038e0 2021-12-17T18:26:10.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d0e7fc700 1 -- 172.21.15.62:0/407813219 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d00006bf0 con 0x7f2cf00038e0 2021-12-17T18:26:10.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d15c0b700 1 -- 172.21.15.62:0/407813219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cf00038e0 msgr2=0x7f2cf0003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d15c0b700 1 --2- 172.21.15.62:0/407813219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cf00038e0 0x7f2cf0003ce0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f2d00001490 tx=0x7f2d00007d80).stop 2021-12-17T18:26:10.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d15c0b700 1 -- 172.21.15.62:0/407813219 shutdown_connections 2021-12-17T18:26:10.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d15c0b700 1 --2- 172.21.15.62:0/407813219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cf00038e0 0x7f2cf0003ce0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d15c0b700 1 -- 172.21.15.62:0/407813219 >> 172.21.15.62:0/407813219 conn(0x7f2d1005c750 msgr2=0x7f2d1005cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:10.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d15c0b700 1 -- 172.21.15.62:0/407813219 shutdown_connections 2021-12-17T18:26:10.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.071+0000 7f2d15c0b700 1 -- 172.21.15.62:0/407813219 wait complete. 2021-12-17T18:26:10.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d15c0b700 1 Processor -- start 2021-12-17T18:26:10.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d15c0b700 1 -- start start 2021-12-17T18:26:10.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d15c0b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cf00038e0 0x7f2d10140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d15c0b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d10155a40 0x7f2d10155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d15c0b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2d101563b0 0x7f2d1013f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d15c0b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100a3690 con 0x7f2d10155a40 2021-12-17T18:26:10.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d15c0b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10065d20 con 0x7f2cf00038e0 2021-12-17T18:26:10.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d15c0b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10066c60 con 0x7f2d101563b0 2021-12-17T18:26:10.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d0effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d10155a40 0x7f2d10155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d0effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d10155a40 0x7f2d10155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54300/0 (socket says 172.21.15.62:54300) 2021-12-17T18:26:10.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d0effd700 1 -- 172.21.15.62:0/438637952 learned_addr learned my addr 172.21.15.62:0/438637952 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:10.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d0ffff700 1 --2- 172.21.15.62:0/438637952 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2d101563b0 0x7f2d1013f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d0f7fe700 1 --2- 172.21.15.62:0/438637952 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cf00038e0 0x7f2d10140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d0effd700 1 -- 172.21.15.62:0/438637952 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2d101563b0 msgr2=0x7f2d1013f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d0effd700 1 --2- 172.21.15.62:0/438637952 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2d101563b0 0x7f2d1013f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d0effd700 1 -- 172.21.15.62:0/438637952 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cf00038e0 msgr2=0x7f2d10140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d0effd700 1 --2- 172.21.15.62:0/438637952 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cf00038e0 0x7f2d10140e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d0effd700 1 -- 172.21.15.62:0/438637952 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d10066f00 con 0x7f2d10155a40 2021-12-17T18:26:10.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d0effd700 1 --2- 172.21.15.62:0/438637952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d10155a40 0x7f2d10155ec0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f2cf800b000 tx=0x7f2cf8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:10.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d0cff9700 1 -- 172.21.15.62:0/438637952 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cf8012610 con 0x7f2d10155a40 2021-12-17T18:26:10.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d0cff9700 1 -- 172.21.15.62:0/438637952 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf8012770 con 0x7f2d10155a40 2021-12-17T18:26:10.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d15c0b700 1 -- 172.21.15.62:0/438637952 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d10156830 con 0x7f2d10155a40 2021-12-17T18:26:10.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d0cff9700 1 -- 172.21.15.62:0/438637952 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cf8012ad0 con 0x7f2d10155a40 2021-12-17T18:26:10.101 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.075+0000 7f2d15c0b700 1 -- 172.21.15.62:0/438637952 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d100b8110 con 0x7f2d10155a40 2021-12-17T18:26:10.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.079+0000 7f2d15c0b700 1 -- 172.21.15.62:0/438637952 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d100b4720 con 0x7f2d10155a40 2021-12-17T18:26:10.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.079+0000 7f2d0cff9700 1 -- 172.21.15.62:0/438637952 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2cf8012c30 con 0x7f2d10155a40 2021-12-17T18:26:10.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.079+0000 7f2d0cff9700 1 --2- 172.21.15.62:0/438637952 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2cf40536d0 0x7f2cf4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.079+0000 7f2d0cff9700 1 -- 172.21.15.62:0/438637952 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f2cf806c200 con 0x7f2d10155a40 2021-12-17T18:26:10.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.079+0000 7f2d0f7fe700 1 --2- 172.21.15.62:0/438637952 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2cf40536d0 0x7f2cf4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.079+0000 7f2d0f7fe700 1 --2- 172.21.15.62:0/438637952 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2cf40536d0 0x7f2cf4055b90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f2d0001b000 tx=0x7f2d00015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:10.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.087+0000 7f2d0cff9700 1 -- 172.21.15.62:0/438637952 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2cf8043330 con 0x7f2d10155a40 2021-12-17T18:26:10.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.251+0000 7f2d15c0b700 1 -- 172.21.15.62:0/438637952 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f2d100573d0 con 0x7f2d10155a40 2021-12-17T18:26:10.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.263+0000 7f2d0cff9700 1 -- 172.21.15.62:0/438637952 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 19 and data pool 20 v48) v1 ==== 189+0+0 (secure 0 0 0) 0x7f2cf8046950 con 0x7f2d10155a40 2021-12-17T18:26:10.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.267+0000 7f2d15c0b700 1 -- 172.21.15.62:0/438637952 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2cf40536d0 msgr2=0x7f2cf4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.267+0000 7f2d15c0b700 1 --2- 172.21.15.62:0/438637952 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2cf40536d0 0x7f2cf4055b90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f2d0001b000 tx=0x7f2d00015000).stop 2021-12-17T18:26:10.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.267+0000 7f2d15c0b700 1 -- 172.21.15.62:0/438637952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d10155a40 msgr2=0x7f2d10155ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.267+0000 7f2d15c0b700 1 --2- 172.21.15.62:0/438637952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d10155a40 0x7f2d10155ec0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f2cf800b000 tx=0x7f2cf8008040).stop 2021-12-17T18:26:10.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.267+0000 7f2d15c0b700 1 -- 172.21.15.62:0/438637952 shutdown_connections 2021-12-17T18:26:10.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.271+0000 7f2d15c0b700 1 --2- 172.21.15.62:0/438637952 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2cf40536d0 0x7f2cf4055b90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.271+0000 7f2d15c0b700 1 --2- 172.21.15.62:0/438637952 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2d101563b0 0x7f2d1013f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.271+0000 7f2d15c0b700 1 --2- 172.21.15.62:0/438637952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d10155a40 0x7f2d10155ec0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.271+0000 7f2d15c0b700 1 --2- 172.21.15.62:0/438637952 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2cf00038e0 0x7f2d10140e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.271+0000 7f2d15c0b700 1 -- 172.21.15.62:0/438637952 >> 172.21.15.62:0/438637952 conn(0x7f2d1005c750 msgr2=0x7f2d10143ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:10.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.271+0000 7f2d15c0b700 1 -- 172.21.15.62:0/438637952 shutdown_connections 2021-12-17T18:26:10.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.271+0000 7f2d15c0b700 1 -- 172.21.15.62:0/438637952 wait complete. 2021-12-17T18:26:10.279 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 19 and data pool 20 2021-12-17T18:26:10.290 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:26:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.375+0000 7f96730d8700 1 Processor -- start 2021-12-17T18:26:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.375+0000 7f96730d8700 1 -- start start 2021-12-17T18:26:10.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.375+0000 7f96730d8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f966c141480 0x7f966c147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.375+0000 7f96730d8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f966c0a8e10 0x7f966c0b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96730d8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966c147610 con 0x7f966c0b6050 2021-12-17T18:26:10.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96730d8700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966c1478b0 con 0x7f966c0a8e10 2021-12-17T18:26:10.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96730d8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c147b50 con 0x7f966c141480 2021-12-17T18:26:10.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96718d5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f966c0a8e10 0x7f966c0b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96728d7700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f966c0b6050 0x7f966c0a7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37900/0 (socket says 172.21.15.62:37900) 2021-12-17T18:26:10.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96728d7700 1 -- 172.21.15.62:0/1153867680 learned_addr learned my addr 172.21.15.62:0/1153867680 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:10.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96720d6700 1 --2- 172.21.15.62:0/1153867680 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f966c141480 0x7f966c147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96710d4700 1 -- 172.21.15.62:0/1153867680 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294723303 0 0) 0x7f966c147610 con 0x7f966c0b6050 2021-12-17T18:26:10.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96710d4700 1 -- 172.21.15.62:0/1153867680 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9658003260 con 0x7f966c0b6050 2021-12-17T18:26:10.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96718d5700 1 -- 172.21.15.62:0/1153867680 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f966c141480 msgr2=0x7f966c147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:10.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96718d5700 1 --2- 172.21.15.62:0/1153867680 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f966c141480 0x7f966c147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96718d5700 1 -- 172.21.15.62:0/1153867680 >> v1:172.21.15.62:6789/0 conn(0x7f966c0b6050 legacy=0x7f966c0a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96718d5700 1 -- 172.21.15.62:0/1153867680 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c0b1b90 con 0x7f966c0a8e10 2021-12-17T18:26:10.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96718d5700 1 --2- 172.21.15.62:0/1153867680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f966c0a8e10 0x7f966c0b5b60 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f9660002f70 tx=0x7f9660006df0).ready entity=mon.0 client_cookie=6ea80c577ae6118b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:10.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96710d4700 1 -- 172.21.15.62:0/1153867680 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f966000d4a0 con 0x7f966c0a8e10 2021-12-17T18:26:10.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96710d4700 1 -- 172.21.15.62:0/1153867680 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9660000e90 con 0x7f966c0a8e10 2021-12-17T18:26:10.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96710d4700 1 -- 172.21.15.62:0/1153867680 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f966000d7f0 con 0x7f966c0a8e10 2021-12-17T18:26:10.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96730d8700 1 -- 172.21.15.62:0/1153867680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f966c0a8e10 msgr2=0x7f966c0b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96730d8700 1 --2- 172.21.15.62:0/1153867680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f966c0a8e10 0x7f966c0b5b60 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f9660002f70 tx=0x7f9660006df0).stop 2021-12-17T18:26:10.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96730d8700 1 -- 172.21.15.62:0/1153867680 shutdown_connections 2021-12-17T18:26:10.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96730d8700 1 --2- 172.21.15.62:0/1153867680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f966c0a8e10 0x7f966c0b5b60 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96730d8700 1 --2- 172.21.15.62:0/1153867680 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f966c141480 0x7f966c147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96730d8700 1 -- 172.21.15.62:0/1153867680 >> 172.21.15.62:0/1153867680 conn(0x7f966c05d220 msgr2=0x7f966c0b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:10.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96730d8700 1 -- 172.21.15.62:0/1153867680 shutdown_connections 2021-12-17T18:26:10.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96730d8700 1 -- 172.21.15.62:0/1153867680 wait complete. 2021-12-17T18:26:10.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96730d8700 1 Processor -- start 2021-12-17T18:26:10.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.379+0000 7f96730d8700 1 -- start start 2021-12-17T18:26:10.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96730d8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f966c0a8e10 0x7f966c0abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96730d8700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f966c0b6050 0x7f966c14a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96730d8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f966c141480 0x7f966c15a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96730d8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c145430 con 0x7f966c141480 2021-12-17T18:26:10.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96730d8700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c1456d0 con 0x7f966c0b6050 2021-12-17T18:26:10.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96730d8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c145970 con 0x7f966c0a8e10 2021-12-17T18:26:10.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96728d7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f966c141480 0x7f966c15a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96728d7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f966c141480 0x7f966c15a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54328/0 (socket says 172.21.15.62:54328) 2021-12-17T18:26:10.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96728d7700 1 -- 172.21.15.62:0/3924737349 learned_addr learned my addr 172.21.15.62:0/3924737349 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:10.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96720d6700 1 --2- 172.21.15.62:0/3924737349 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f966c0a8e10 0x7f966c0abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96718d5700 1 --2- 172.21.15.62:0/3924737349 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f966c0b6050 0x7f966c14a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96728d7700 1 -- 172.21.15.62:0/3924737349 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f966c0a8e10 msgr2=0x7f966c0abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96728d7700 1 --2- 172.21.15.62:0/3924737349 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f966c0a8e10 0x7f966c0abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96728d7700 1 -- 172.21.15.62:0/3924737349 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f966c0b6050 msgr2=0x7f966c14a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96728d7700 1 --2- 172.21.15.62:0/3924737349 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f966c0b6050 0x7f966c14a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96728d7700 1 -- 172.21.15.62:0/3924737349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966000b180 con 0x7f966c141480 2021-12-17T18:26:10.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96720d6700 1 --2- 172.21.15.62:0/3924737349 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f966c0a8e10 0x7f966c0abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:10.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96728d7700 1 --2- 172.21.15.62:0/3924737349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f966c141480 0x7f966c15a460 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f9664001110 tx=0x7f9664007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:10.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f966b7fe700 1 -- 172.21.15.62:0/3924737349 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96640070d0 con 0x7f966c141480 2021-12-17T18:26:10.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f966b7fe700 1 -- 172.21.15.62:0/3924737349 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9664007230 con 0x7f966c141480 2021-12-17T18:26:10.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f966b7fe700 1 -- 172.21.15.62:0/3924737349 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9664005610 con 0x7f966c141480 2021-12-17T18:26:10.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96730d8700 1 -- 172.21.15.62:0/3924737349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966c14b490 con 0x7f966c141480 2021-12-17T18:26:10.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96730d8700 1 -- 172.21.15.62:0/3924737349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966c15a950 con 0x7f966c141480 2021-12-17T18:26:10.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f966b7fe700 1 -- 172.21.15.62:0/3924737349 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9664010070 con 0x7f966c141480 2021-12-17T18:26:10.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.383+0000 7f96730d8700 1 -- 172.21.15.62:0/3924737349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966c15a1a0 con 0x7f966c141480 2021-12-17T18:26:10.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.387+0000 7f966b7fe700 1 --2- 172.21.15.62:0/3924737349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f964c0536a0 0x7f964c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.387+0000 7f966b7fe700 1 -- 172.21.15.62:0/3924737349 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f966406b0e0 con 0x7f966c141480 2021-12-17T18:26:10.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.387+0000 7f96720d6700 1 --2- 172.21.15.62:0/3924737349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f964c0536a0 0x7f964c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.387+0000 7f96720d6700 1 --2- 172.21.15.62:0/3924737349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f964c0536a0 0x7f964c055b60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f965c00b000 tx=0x7f965c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:10.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.391+0000 7f966b7fe700 1 -- 172.21.15.62:0/3924737349 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f96640421c0 con 0x7f966c141480 2021-12-17T18:26:10.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.515+0000 7f96730d8700 1 -- 172.21.15.62:0/3924737349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f966c141860 con 0x7f966c141480 2021-12-17T18:26:10.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.519+0000 7f966b7fe700 1 -- 172.21.15.62:0/3924737349 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16110 (secure 0 0 0) 0x7f966404bf00 con 0x7f966c141480 2021-12-17T18:26:10.525 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:10.525 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":101,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:26:10.255592+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:26:08.360156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-12-17T18:26:09.261212+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:26:10.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.519+0000 7f96730d8700 1 -- 172.21.15.62:0/3924737349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f964c0536a0 msgr2=0x7f964c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.519+0000 7f96730d8700 1 --2- 172.21.15.62:0/3924737349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f964c0536a0 0x7f964c055b60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f965c00b000 tx=0x7f965c008040).stop 2021-12-17T18:26:10.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.519+0000 7f96730d8700 1 -- 172.21.15.62:0/3924737349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f966c141480 msgr2=0x7f966c15a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.519+0000 7f96730d8700 1 --2- 172.21.15.62:0/3924737349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f966c141480 0x7f966c15a460 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f9664001110 tx=0x7f9664007a80).stop 2021-12-17T18:26:10.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.519+0000 7f96730d8700 1 -- 172.21.15.62:0/3924737349 shutdown_connections 2021-12-17T18:26:10.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.519+0000 7f96730d8700 1 --2- 172.21.15.62:0/3924737349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f964c0536a0 0x7f964c055b60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.519+0000 7f96730d8700 1 --2- 172.21.15.62:0/3924737349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f966c141480 0x7f966c15a460 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.519+0000 7f96730d8700 1 --2- 172.21.15.62:0/3924737349 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f966c0b6050 0x7f966c14a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.519+0000 7f96730d8700 1 --2- 172.21.15.62:0/3924737349 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f966c0a8e10 0x7f966c0abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.519+0000 7f96730d8700 1 -- 172.21.15.62:0/3924737349 >> 172.21.15.62:0/3924737349 conn(0x7f966c05d220 msgr2=0x7f966c146d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:10.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.519+0000 7f96730d8700 1 -- 172.21.15.62:0/3924737349 shutdown_connections 2021-12-17T18:26:10.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.519+0000 7f96730d8700 1 -- 172.21.15.62:0/3924737349 wait complete. 2021-12-17T18:26:10.539 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:26:10.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.635+0000 7f2a88cb8700 1 Processor -- start 2021-12-17T18:26:10.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.635+0000 7f2a88cb8700 1 -- start start 2021-12-17T18:26:10.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.635+0000 7f2a88cb8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a840b21f0 0x7f2a8414aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.635+0000 7f2a88cb8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2a840b1730 0x7f2a840ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.635+0000 7f2a88cb8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a840b2ce0 con 0x7f2a840a7bb0 2021-12-17T18:26:10.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.635+0000 7f2a88cb8700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a84147870 con 0x7f2a840b1730 2021-12-17T18:26:10.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.635+0000 7f2a88cb8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a840b2f10 con 0x7f2a840b21f0 2021-12-17T18:26:10.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a81d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2a840b1730 0x7f2a840ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a81d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2a840b1730 0x7f2a840ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54332/0 (socket says 172.21.15.62:54332) 2021-12-17T18:26:10.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a81d9b700 1 -- 172.21.15.62:0/1794729434 learned_addr learned my addr 172.21.15.62:0/1794729434 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:10.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a8259c700 1 --2- 172.21.15.62:0/1794729434 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a840b21f0 0x7f2a8414aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a81d9b700 1 -- 172.21.15.62:0/1794729434 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a840b21f0 msgr2=0x7f2a8414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:10.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a81d9b700 1 --2- 172.21.15.62:0/1794729434 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a840b21f0 0x7f2a8414aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a81d9b700 1 -- 172.21.15.62:0/1794729434 >> v1:172.21.15.62:6789/0 conn(0x7f2a840a7bb0 legacy=0x7f2a84067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:10.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a81d9b700 1 -- 172.21.15.62:0/1794729434 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a840aca60 con 0x7f2a840b1730 2021-12-17T18:26:10.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a81d9b700 1 --2- 172.21.15.62:0/1794729434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a840b1730 0x7f2a840ace90 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f2a74002f70 tx=0x7f2a74006eb0).ready entity=mon.0 client_cookie=a3fb1d57669cb58a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:10.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a8159a700 1 -- 172.21.15.62:0/1794729434 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a7400d5c0 con 0x7f2a840b1730 2021-12-17T18:26:10.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a8159a700 1 -- 172.21.15.62:0/1794729434 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a74000e90 con 0x7f2a840b1730 2021-12-17T18:26:10.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a8159a700 1 -- 172.21.15.62:0/1794729434 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a7400d950 con 0x7f2a840b1730 2021-12-17T18:26:10.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a88cb8700 1 -- 172.21.15.62:0/1794729434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a840b1730 msgr2=0x7f2a840ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a88cb8700 1 --2- 172.21.15.62:0/1794729434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a840b1730 0x7f2a840ace90 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f2a74002f70 tx=0x7f2a74006eb0).stop 2021-12-17T18:26:10.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a88cb8700 1 -- 172.21.15.62:0/1794729434 shutdown_connections 2021-12-17T18:26:10.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a88cb8700 1 --2- 172.21.15.62:0/1794729434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a840b1730 0x7f2a840ace90 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a88cb8700 1 --2- 172.21.15.62:0/1794729434 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a840b21f0 0x7f2a8414aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a88cb8700 1 -- 172.21.15.62:0/1794729434 >> 172.21.15.62:0/1794729434 conn(0x7f2a8405f730 msgr2=0x7f2a8405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:10.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a88cb8700 1 -- 172.21.15.62:0/1794729434 shutdown_connections 2021-12-17T18:26:10.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a88cb8700 1 -- 172.21.15.62:0/1794729434 wait complete. 2021-12-17T18:26:10.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a88cb8700 1 Processor -- start 2021-12-17T18:26:10.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a88cb8700 1 -- start start 2021-12-17T18:26:10.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a88cb8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a840a7bb0 0x7f2a8414be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.639+0000 7f2a88cb8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a840b1730 0x7f2a8415a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a88cb8700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2a840b21f0 0x7f2a840a9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a88cb8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a840abb70 con 0x7f2a840b1730 2021-12-17T18:26:10.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a88cb8700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a840637a0 con 0x7f2a840b21f0 2021-12-17T18:26:10.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a88cb8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a840aab50 con 0x7f2a840a7bb0 2021-12-17T18:26:10.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a81d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a840b1730 0x7f2a8415a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a81d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a840b1730 0x7f2a8415a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54342/0 (socket says 172.21.15.62:54342) 2021-12-17T18:26:10.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a81d9b700 1 -- 172.21.15.62:0/923486093 learned_addr learned my addr 172.21.15.62:0/923486093 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:10.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a8259c700 1 --2- 172.21.15.62:0/923486093 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a840a7bb0 0x7f2a8414be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a82d9d700 1 --2- 172.21.15.62:0/923486093 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2a840b21f0 0x7f2a840a9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a81d9b700 1 -- 172.21.15.62:0/923486093 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a840a7bb0 msgr2=0x7f2a8414be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a81d9b700 1 --2- 172.21.15.62:0/923486093 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a840a7bb0 0x7f2a8414be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a81d9b700 1 -- 172.21.15.62:0/923486093 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2a840b21f0 msgr2=0x7f2a840a9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a81d9b700 1 --2- 172.21.15.62:0/923486093 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2a840b21f0 0x7f2a840a9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a81d9b700 1 -- 172.21.15.62:0/923486093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7400b1e0 con 0x7f2a840b1730 2021-12-17T18:26:10.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a82d9d700 1 --2- 172.21.15.62:0/923486093 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2a840b21f0 0x7f2a840a9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:10.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a81d9b700 1 --2- 172.21.15.62:0/923486093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a840b1730 0x7f2a8415a650 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f2a74002f70 tx=0x7f2a74015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:10.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a737fe700 1 -- 172.21.15.62:0/923486093 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a740117e0 con 0x7f2a840b1730 2021-12-17T18:26:10.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a737fe700 1 -- 172.21.15.62:0/923486093 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a74011940 con 0x7f2a840b1730 2021-12-17T18:26:10.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a737fe700 1 -- 172.21.15.62:0/923486093 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a74011ca0 con 0x7f2a840b1730 2021-12-17T18:26:10.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a88cb8700 1 -- 172.21.15.62:0/923486093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a840aadf0 con 0x7f2a840b1730 2021-12-17T18:26:10.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a88cb8700 1 -- 172.21.15.62:0/923486093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a840a99f0 con 0x7f2a840b1730 2021-12-17T18:26:10.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.643+0000 7f2a88cb8700 1 -- 172.21.15.62:0/923486093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a840573d0 con 0x7f2a840b1730 2021-12-17T18:26:10.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.647+0000 7f2a737fe700 1 -- 172.21.15.62:0/923486093 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2a74025030 con 0x7f2a840b1730 2021-12-17T18:26:10.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.647+0000 7f2a737fe700 1 --2- 172.21.15.62:0/923486093 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2a600536a0 0x7f2a60055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.647+0000 7f2a737fe700 1 -- 172.21.15.62:0/923486093 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2a7406cb40 con 0x7f2a840b1730 2021-12-17T18:26:10.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.647+0000 7f2a8259c700 1 --2- 172.21.15.62:0/923486093 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2a600536a0 0x7f2a60055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.647+0000 7f2a8259c700 1 --2- 172.21.15.62:0/923486093 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2a600536a0 0x7f2a60055b60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f2a7800c000 tx=0x7f2a78008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:10.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.651+0000 7f2a737fe700 1 -- 172.21.15.62:0/923486093 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2a74043ca0 con 0x7f2a840b1730 2021-12-17T18:26:10.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.775+0000 7f2a88cb8700 1 -- 172.21.15.62:0/923486093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a840af860 con 0x7f2a840b1730 2021-12-17T18:26:10.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.779+0000 7f2a737fe700 1 -- 172.21.15.62:0/923486093 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16110 (secure 0 0 0) 0x7f2a74023020 con 0x7f2a840b1730 2021-12-17T18:26:10.786 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:10.786 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":101,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:26:10.255592+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:26:08.360156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-12-17T18:26:09.261212+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:26:10.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.779+0000 7f2a88cb8700 1 -- 172.21.15.62:0/923486093 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2a600536a0 msgr2=0x7f2a60055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.779+0000 7f2a88cb8700 1 --2- 172.21.15.62:0/923486093 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2a600536a0 0x7f2a60055b60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f2a7800c000 tx=0x7f2a78008040).stop 2021-12-17T18:26:10.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.779+0000 7f2a88cb8700 1 -- 172.21.15.62:0/923486093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a840b1730 msgr2=0x7f2a8415a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.779+0000 7f2a88cb8700 1 --2- 172.21.15.62:0/923486093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a840b1730 0x7f2a8415a650 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f2a74002f70 tx=0x7f2a74015000).stop 2021-12-17T18:26:10.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.779+0000 7f2a88cb8700 1 -- 172.21.15.62:0/923486093 shutdown_connections 2021-12-17T18:26:10.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.779+0000 7f2a88cb8700 1 --2- 172.21.15.62:0/923486093 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2a600536a0 0x7f2a60055b60 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.779+0000 7f2a88cb8700 1 --2- 172.21.15.62:0/923486093 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2a840b21f0 0x7f2a840a9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.779+0000 7f2a88cb8700 1 --2- 172.21.15.62:0/923486093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a840b1730 0x7f2a8415a650 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.783+0000 7f2a88cb8700 1 --2- 172.21.15.62:0/923486093 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2a840a7bb0 0x7f2a8414be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.783+0000 7f2a88cb8700 1 -- 172.21.15.62:0/923486093 >> 172.21.15.62:0/923486093 conn(0x7f2a8405f730 msgr2=0x7f2a840afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:10.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.783+0000 7f2a88cb8700 1 -- 172.21.15.62:0/923486093 shutdown_connections 2021-12-17T18:26:10.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.783+0000 7f2a88cb8700 1 -- 172.21.15.62:0/923486093 wait complete. 2021-12-17T18:26:10.800 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-12-17T18:26:10.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f9347fff700 1 Processor -- start 2021-12-17T18:26:10.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f9347fff700 1 -- start start 2021-12-17T18:26:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f9347fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f93480b06b0 0x7f93480ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f9347fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f93480604d0 0x7f9348146510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f9347fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93480b2860 con 0x7f934805ca90 2021-12-17T18:26:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f9347fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93481475c0 con 0x7f93480b06b0 2021-12-17T18:26:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f9347fff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934805fa40 con 0x7f93480604d0 2021-12-17T18:26:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f93467fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f93480b06b0 0x7f93480ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f93467fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f93480b06b0 0x7f93480ace40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54348/0 (socket says 172.21.15.62:54348) 2021-12-17T18:26:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f93467fc700 1 -- 172.21.15.62:0/2546439035 learned_addr learned my addr 172.21.15.62:0/2546439035 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:10.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f9346ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f934805ca90 0x7f934814abf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37926/0 (socket says 172.21.15.62:37926) 2021-12-17T18:26:10.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f93477fe700 1 --2- 172.21.15.62:0/2546439035 >> v2:172.21.15.109:3300/0 conn(0x7f93480604d0 0x7f9348146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f93467fc700 1 -- 172.21.15.62:0/2546439035 >> v2:172.21.15.109:3300/0 conn(0x7f93480604d0 msgr2=0x7f9348146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:10.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f9345ffb700 1 -- 172.21.15.62:0/2546439035 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685368207 0 0) 0x7f93480b2860 con 0x7f934805ca90 2021-12-17T18:26:10.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f93467fc700 1 --2- 172.21.15.62:0/2546439035 >> v2:172.21.15.109:3300/0 conn(0x7f93480604d0 0x7f9348146510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f93467fc700 1 -- 172.21.15.62:0/2546439035 >> v1:172.21.15.62:6789/0 conn(0x7f934805ca90 legacy=0x7f934814abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f93467fc700 1 -- 172.21.15.62:0/2546439035 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934814b300 con 0x7f93480b06b0 2021-12-17T18:26:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f93467fc700 1 --2- 172.21.15.62:0/2546439035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93480b06b0 0x7f93480ace40 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f93380032f0 tx=0x7f9338009290).ready entity=mon.0 client_cookie=6c78e9493a57d08 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f9345ffb700 1 -- 172.21.15.62:0/2546439035 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f933800b870 con 0x7f93480b06b0 2021-12-17T18:26:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f9345ffb700 1 -- 172.21.15.62:0/2546439035 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933800b9d0 con 0x7f93480b06b0 2021-12-17T18:26:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.907+0000 7f9345ffb700 1 -- 172.21.15.62:0/2546439035 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f933800bb40 con 0x7f93480b06b0 2021-12-17T18:26:10.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.911+0000 7f9347fff700 1 -- 172.21.15.62:0/2546439035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93480b06b0 msgr2=0x7f93480ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.911+0000 7f9347fff700 1 --2- 172.21.15.62:0/2546439035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93480b06b0 0x7f93480ace40 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f93380032f0 tx=0x7f9338009290).stop 2021-12-17T18:26:10.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.911+0000 7f9347fff700 1 -- 172.21.15.62:0/2546439035 shutdown_connections 2021-12-17T18:26:10.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.911+0000 7f9347fff700 1 --2- 172.21.15.62:0/2546439035 >> v2:172.21.15.109:3300/0 conn(0x7f93480604d0 0x7f9348146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.911+0000 7f9347fff700 1 --2- 172.21.15.62:0/2546439035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93480b06b0 0x7f93480ace40 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.911+0000 7f9347fff700 1 -- 172.21.15.62:0/2546439035 >> 172.21.15.62:0/2546439035 conn(0x7f934805c070 msgr2=0x7f9348062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:10.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.911+0000 7f9347fff700 1 -- 172.21.15.62:0/2546439035 shutdown_connections 2021-12-17T18:26:10.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.911+0000 7f9347fff700 1 -- 172.21.15.62:0/2546439035 wait complete. 2021-12-17T18:26:10.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.911+0000 7f9347fff700 1 Processor -- start 2021-12-17T18:26:10.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.911+0000 7f9347fff700 1 -- start start 2021-12-17T18:26:10.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f9347fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f934805ca90 0x7f934814d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f9347fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93480604d0 0x7f93480a2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f9347fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f93480b06b0 0x7f934809e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f9347fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93481566c0 con 0x7f93480604d0 2021-12-17T18:26:10.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f9347fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9348063810 con 0x7f934805ca90 2021-12-17T18:26:10.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f9347fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934815a7f0 con 0x7f93480b06b0 2021-12-17T18:26:10.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f93467fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93480604d0 0x7f93480a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f93467fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93480604d0 0x7f93480a2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54354/0 (socket says 172.21.15.62:54354) 2021-12-17T18:26:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f93467fc700 1 -- 172.21.15.62:0/385529044 learned_addr learned my addr 172.21.15.62:0/385529044 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f93477fe700 1 --2- 172.21.15.62:0/385529044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f93480b06b0 0x7f934809e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f9346ffd700 1 --2- 172.21.15.62:0/385529044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f934805ca90 0x7f934814d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f93467fc700 1 -- 172.21.15.62:0/385529044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f93480b06b0 msgr2=0x7f934809e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f93467fc700 1 --2- 172.21.15.62:0/385529044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f93480b06b0 0x7f934809e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f93467fc700 1 -- 172.21.15.62:0/385529044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f934805ca90 msgr2=0x7f934814d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:10.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f93467fc700 1 --2- 172.21.15.62:0/385529044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f934805ca90 0x7f934814d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:10.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f93467fc700 1 -- 172.21.15.62:0/385529044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9338009530 con 0x7f93480604d0 2021-12-17T18:26:10.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f9346ffd700 1 --2- 172.21.15.62:0/385529044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f934805ca90 0x7f934814d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:10.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f93467fc700 1 --2- 172.21.15.62:0/385529044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93480604d0 0x7f93480a2220 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f93380032f0 tx=0x7f9338016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:10.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f9337fff700 1 -- 172.21.15.62:0/385529044 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9338021630 con 0x7f93480604d0 2021-12-17T18:26:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f9337fff700 1 -- 172.21.15.62:0/385529044 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9338021790 con 0x7f93480604d0 2021-12-17T18:26:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f9347fff700 1 -- 172.21.15.62:0/385529044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934815aa90 con 0x7f93480604d0 2021-12-17T18:26:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f9337fff700 1 -- 172.21.15.62:0/385529044 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9338021af0 con 0x7f93480604d0 2021-12-17T18:26:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.915+0000 7f9347fff700 1 -- 172.21.15.62:0/385529044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9348063490 con 0x7f93480604d0 2021-12-17T18:26:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.919+0000 7f9347fff700 1 -- 172.21.15.62:0/385529044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9348063650 con 0x7f93480604d0 2021-12-17T18:26:10.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.919+0000 7f9337fff700 1 -- 172.21.15.62:0/385529044 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9338027020 con 0x7f93480604d0 2021-12-17T18:26:10.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.919+0000 7f9337fff700 1 --2- 172.21.15.62:0/385529044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9324053610 0x7f9324055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:10.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.919+0000 7f9337fff700 1 -- 172.21.15.62:0/385529044 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f933806d120 con 0x7f93480604d0 2021-12-17T18:26:10.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.919+0000 7f9346ffd700 1 --2- 172.21.15.62:0/385529044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9324053610 0x7f9324055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:10.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.919+0000 7f9346ffd700 1 --2- 172.21.15.62:0/385529044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9324053610 0x7f9324055ad0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f933c00b000 tx=0x7f933c007100).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:10.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:10.927+0000 7f9337fff700 1 -- 172.21.15.62:0/385529044 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9338044330 con 0x7f93480604d0 2021-12-17T18:26:11.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.091+0000 7f9347fff700 1 -- 172.21.15.62:0/385529044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f93480b2a90 con 0x7f93480604d0 2021-12-17T18:26:11.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.259+0000 7f9337fff700 1 -- 172.21.15.62:0/385529044 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v49) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9338015070 con 0x7f93480604d0 2021-12-17T18:26:11.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.263+0000 7f9347fff700 1 -- 172.21.15.62:0/385529044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9324053610 msgr2=0x7f9324055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.263+0000 7f9347fff700 1 --2- 172.21.15.62:0/385529044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9324053610 0x7f9324055ad0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f933c00b000 tx=0x7f933c007100).stop 2021-12-17T18:26:11.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.263+0000 7f9347fff700 1 -- 172.21.15.62:0/385529044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93480604d0 msgr2=0x7f93480a2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.263+0000 7f9347fff700 1 --2- 172.21.15.62:0/385529044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93480604d0 0x7f93480a2220 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f93380032f0 tx=0x7f9338016000).stop 2021-12-17T18:26:11.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.267+0000 7f9347fff700 1 -- 172.21.15.62:0/385529044 shutdown_connections 2021-12-17T18:26:11.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.267+0000 7f9347fff700 1 --2- 172.21.15.62:0/385529044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9324053610 0x7f9324055ad0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.267+0000 7f9347fff700 1 --2- 172.21.15.62:0/385529044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f93480b06b0 0x7f934809e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.267+0000 7f9347fff700 1 --2- 172.21.15.62:0/385529044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93480604d0 0x7f93480a2220 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.267+0000 7f9347fff700 1 --2- 172.21.15.62:0/385529044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f934805ca90 0x7f934814d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.267+0000 7f9347fff700 1 -- 172.21.15.62:0/385529044 >> 172.21.15.62:0/385529044 conn(0x7f934805c070 msgr2=0x7f93480aeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:11.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.267+0000 7f9347fff700 1 -- 172.21.15.62:0/385529044 shutdown_connections 2021-12-17T18:26:11.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.267+0000 7f9347fff700 1 -- 172.21.15.62:0/385529044 wait complete. 2021-12-17T18:26:11.288 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:26:11.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8fac1a700 1 Processor -- start 2021-12-17T18:26:11.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8fac1a700 1 -- start start 2021-12-17T18:26:11.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8fac1a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8f405f8d0 0x7fd8f40b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:11.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8fac1a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f40ae4e0 con 0x7fd8f40af370 2021-12-17T18:26:11.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8fac1a700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f40ae780 con 0x7fd8f40b2ed0 2021-12-17T18:26:11.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8fac1a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40b12e0 con 0x7fd8f405f8d0 2021-12-17T18:26:11.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8f91b7700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd8f40af370 0x7fd8f414ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37942/0 (socket says 172.21.15.62:37942) 2021-12-17T18:26:11.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8f91b7700 1 -- 172.21.15.62:0/2373689083 learned_addr learned my addr 172.21.15.62:0/2373689083 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:11.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8f89b6700 1 --2- 172.21.15.62:0/2373689083 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8f405f8d0 0x7fd8f40b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:11.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8f37fe700 1 -- 172.21.15.62:0/2373689083 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150330471 0 0) 0x7fd8f40ae4e0 con 0x7fd8f40af370 2021-12-17T18:26:11.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8f37fe700 1 -- 172.21.15.62:0/2373689083 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8d4003260 con 0x7fd8f40af370 2021-12-17T18:26:11.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8f37fe700 1 -- 172.21.15.62:0/2373689083 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712087239 0 0) 0x7fd8f40ae780 con 0x7fd8f40b2ed0 2021-12-17T18:26:11.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8f89b6700 1 -- 172.21.15.62:0/2373689083 >> v1:172.21.15.109:6789/0 conn(0x7fd8f40b2ed0 legacy=0x7fd8f40aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8f89b6700 1 -- 172.21.15.62:0/2373689083 >> v1:172.21.15.62:6789/0 conn(0x7fd8f40af370 legacy=0x7fd8f414ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8f89b6700 1 -- 172.21.15.62:0/2373689083 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f40b1420 con 0x7fd8f405f8d0 2021-12-17T18:26:11.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8f89b6700 1 --2- 172.21.15.62:0/2373689083 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8f405f8d0 0x7fd8f40b36b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fd8ec001110 tx=0x7fd8e40091d0).ready entity=mon.2 client_cookie=4743ee1c5c7d7e7 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:11.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8f37fe700 1 -- 172.21.15.62:0/2373689083 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8e400b680 con 0x7fd8f405f8d0 2021-12-17T18:26:11.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.391+0000 7fd8f37fe700 1 -- 172.21.15.62:0/2373689083 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e400b7e0 con 0x7fd8f405f8d0 2021-12-17T18:26:11.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.395+0000 7fd8f37fe700 1 -- 172.21.15.62:0/2373689083 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8e400b950 con 0x7fd8f405f8d0 2021-12-17T18:26:11.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.395+0000 7fd8fac1a700 1 -- 172.21.15.62:0/2373689083 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8f405f8d0 msgr2=0x7fd8f40b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.395+0000 7fd8fac1a700 1 --2- 172.21.15.62:0/2373689083 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8f405f8d0 0x7fd8f40b36b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fd8ec001110 tx=0x7fd8e40091d0).stop 2021-12-17T18:26:11.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.395+0000 7fd8fac1a700 1 -- 172.21.15.62:0/2373689083 shutdown_connections 2021-12-17T18:26:11.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.395+0000 7fd8fac1a700 1 --2- 172.21.15.62:0/2373689083 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8f405f8d0 0x7fd8f40b36b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.395+0000 7fd8fac1a700 1 -- 172.21.15.62:0/2373689083 >> 172.21.15.62:0/2373689083 conn(0x7fd8f405bcd0 msgr2=0x7fd8f40638c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:11.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.395+0000 7fd8fac1a700 1 -- 172.21.15.62:0/2373689083 shutdown_connections 2021-12-17T18:26:11.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.395+0000 7fd8fac1a700 1 -- 172.21.15.62:0/2373689083 wait complete. 2021-12-17T18:26:11.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.395+0000 7fd8fac1a700 1 Processor -- start 2021-12-17T18:26:11.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.395+0000 7fd8fac1a700 1 -- start start 2021-12-17T18:26:11.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8fac1a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f405f8d0 0x7fd8f409f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:11.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8fac1a700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8f40af370 0x7fd8f4149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:11.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8fac1a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8f40b2ed0 0x7fd8f414a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:11.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8fac1a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f414a7b0 con 0x7fd8f405f8d0 2021-12-17T18:26:11.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8fac1a700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f4157680 con 0x7fd8f40af370 2021-12-17T18:26:11.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8fac1a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40a0160 con 0x7fd8f40b2ed0 2021-12-17T18:26:11.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8f89b6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f405f8d0 0x7fd8f409f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:11.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8f89b6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f405f8d0 0x7fd8f409f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54366/0 (socket says 172.21.15.62:54366) 2021-12-17T18:26:11.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8f89b6700 1 -- 172.21.15.62:0/2232071806 learned_addr learned my addr 172.21.15.62:0/2232071806 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:11.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8f91b7700 1 --2- 172.21.15.62:0/2232071806 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8f40b2ed0 0x7fd8f414a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:11.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8f3fff700 1 --2- 172.21.15.62:0/2232071806 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8f40af370 0x7fd8f4149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:11.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8f89b6700 1 -- 172.21.15.62:0/2232071806 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8f40b2ed0 msgr2=0x7fd8f414a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8f89b6700 1 --2- 172.21.15.62:0/2232071806 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8f40b2ed0 0x7fd8f414a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8f89b6700 1 -- 172.21.15.62:0/2232071806 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8f40af370 msgr2=0x7fd8f4149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8f89b6700 1 --2- 172.21.15.62:0/2232071806 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8f40af370 0x7fd8f4149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8f89b6700 1 -- 172.21.15.62:0/2232071806 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e4009470 con 0x7fd8f405f8d0 2021-12-17T18:26:11.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8f3fff700 1 --2- 172.21.15.62:0/2232071806 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8f40af370 0x7fd8f4149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:11.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8f89b6700 1 --2- 172.21.15.62:0/2232071806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f405f8d0 0x7fd8f409f890 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fd8ec001110 tx=0x7fd8e4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:11.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8f1ffb700 1 -- 172.21.15.62:0/2232071806 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8e400b680 con 0x7fd8f405f8d0 2021-12-17T18:26:11.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8f1ffb700 1 -- 172.21.15.62:0/2232071806 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e4021630 con 0x7fd8f405f8d0 2021-12-17T18:26:11.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8fac1a700 1 -- 172.21.15.62:0/2232071806 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f40aac90 con 0x7fd8f405f8d0 2021-12-17T18:26:11.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8f1ffb700 1 -- 172.21.15.62:0/2232071806 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8e4021990 con 0x7fd8f405f8d0 2021-12-17T18:26:11.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.399+0000 7fd8fac1a700 1 -- 172.21.15.62:0/2232071806 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f409fd80 con 0x7fd8f405f8d0 2021-12-17T18:26:11.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.403+0000 7fd8fac1a700 1 -- 172.21.15.62:0/2232071806 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f4157840 con 0x7fd8f405f8d0 2021-12-17T18:26:11.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.403+0000 7fd8f1ffb700 1 -- 172.21.15.62:0/2232071806 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd8e4027020 con 0x7fd8f405f8d0 2021-12-17T18:26:11.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.403+0000 7fd8f1ffb700 1 --2- 172.21.15.62:0/2232071806 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd8d80535b0 0x7fd8d8055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.403+0000 7fd8f1ffb700 1 -- 172.21.15.62:0/2232071806 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd8e406cdc0 con 0x7fd8f405f8d0 2021-12-17T18:26:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.403+0000 7fd8f3fff700 1 --2- 172.21.15.62:0/2232071806 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd8d80535b0 0x7fd8d8055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.403+0000 7fd8f3fff700 1 --2- 172.21.15.62:0/2232071806 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd8d80535b0 0x7fd8d8055a70 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fd8dc00b000 tx=0x7fd8dc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:11.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.407+0000 7fd8f1ffb700 1 -- 172.21.15.62:0/2232071806 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd8e4043e10 con 0x7fd8f405f8d0 2021-12-17T18:26:11.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.567+0000 7fd8fac1a700 1 -- 172.21.15.62:0/2232071806 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8f40b1420 con 0x7fd8f405f8d0 2021-12-17T18:26:11.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.567+0000 7fd8f1ffb700 1 -- 172.21.15.62:0/2232071806 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fd8f40b1420 con 0x7fd8f405f8d0 2021-12-17T18:26:11.576 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:11.576 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":49,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/965882605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":965882605},{"type":"v1","addr":"172.21.15.109:6835","nonce":965882605}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:26:10.256074+0000","modified":"2021-12-17T18:26:11.259115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1972867454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1972867454},{"type":"v1","addr":"172.21.15.62:6833","nonce":1972867454}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-12-17T18:26:11.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.571+0000 7fd8fac1a700 1 -- 172.21.15.62:0/2232071806 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd8d80535b0 msgr2=0x7fd8d8055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.571+0000 7fd8fac1a700 1 --2- 172.21.15.62:0/2232071806 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd8d80535b0 0x7fd8d8055a70 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fd8dc00b000 tx=0x7fd8dc009040).stop 2021-12-17T18:26:11.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.571+0000 7fd8fac1a700 1 -- 172.21.15.62:0/2232071806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f405f8d0 msgr2=0x7fd8f409f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.571+0000 7fd8fac1a700 1 --2- 172.21.15.62:0/2232071806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f405f8d0 0x7fd8f409f890 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fd8ec001110 tx=0x7fd8e4016000).stop 2021-12-17T18:26:11.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.571+0000 7fd8fac1a700 1 -- 172.21.15.62:0/2232071806 shutdown_connections 2021-12-17T18:26:11.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.571+0000 7fd8fac1a700 1 --2- 172.21.15.62:0/2232071806 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd8d80535b0 0x7fd8d8055a70 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.571+0000 7fd8fac1a700 1 --2- 172.21.15.62:0/2232071806 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8f40b2ed0 0x7fd8f414a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.571+0000 7fd8fac1a700 1 --2- 172.21.15.62:0/2232071806 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8f40af370 0x7fd8f4149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.571+0000 7fd8fac1a700 1 --2- 172.21.15.62:0/2232071806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f405f8d0 0x7fd8f409f890 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.571+0000 7fd8fac1a700 1 -- 172.21.15.62:0/2232071806 >> 172.21.15.62:0/2232071806 conn(0x7fd8f405bcd0 msgr2=0x7fd8f40b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:11.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.571+0000 7fd8fac1a700 1 -- 172.21.15.62:0/2232071806 shutdown_connections 2021-12-17T18:26:11.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.571+0000 7fd8fac1a700 1 -- 172.21.15.62:0/2232071806 wait complete. 2021-12-17T18:26:11.581 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 49 2021-12-17T18:26:11.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:26:11.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7e6d9700 1 Processor -- start 2021-12-17T18:26:11.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7e6d9700 1 -- start start 2021-12-17T18:26:11.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7e6d9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5b780a8e10 0x7f5b78147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7e6d9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b780b6270 con 0x7f5b780a71e0 2021-12-17T18:26:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7e6d9700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b78147610 con 0x7f5b78141480 2021-12-17T18:26:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7e6d9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b781478b0 con 0x7f5b780a8e10 2021-12-17T18:26:11.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7ced6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5b780a8e10 0x7f5b78147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:11.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7ced6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5b780a8e10 0x7f5b78147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54376/0 (socket says 172.21.15.62:54376) 2021-12-17T18:26:11.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7ced6700 1 -- 172.21.15.62:0/2909001482 learned_addr learned my addr 172.21.15.62:0/2909001482 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:11.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7ced6700 1 -- 172.21.15.62:0/2909001482 >> v1:172.21.15.109:6789/0 conn(0x7f5b78141480 legacy=0x7f5b780b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7ced6700 1 -- 172.21.15.62:0/2909001482 >> v1:172.21.15.62:6789/0 conn(0x7f5b780a71e0 legacy=0x7f5b780a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7ced6700 1 -- 172.21.15.62:0/2909001482 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b78147b50 con 0x7f5b780a8e10 2021-12-17T18:26:11.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b6ffff700 1 -- 172.21.15.62:0/2909001482 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454556518 0 0) 0x7f5b780b6270 con 0x7f5b780a71e0 2021-12-17T18:26:11.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7ced6700 1 --2- 172.21.15.62:0/2909001482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780a8e10 0x7f5b78147ff0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f5b68002f70 tx=0x7f5b68006eb0).ready entity=mon.0 client_cookie=1669e25a2970164e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:11.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b6ffff700 1 -- 172.21.15.62:0/2909001482 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b6800d660 con 0x7f5b780a8e10 2021-12-17T18:26:11.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b6ffff700 1 -- 172.21.15.62:0/2909001482 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b68000e90 con 0x7f5b780a8e10 2021-12-17T18:26:11.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b6ffff700 1 -- 172.21.15.62:0/2909001482 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b6800d9b0 con 0x7f5b780a8e10 2021-12-17T18:26:11.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7e6d9700 1 -- 172.21.15.62:0/2909001482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780a8e10 msgr2=0x7f5b78147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7e6d9700 1 --2- 172.21.15.62:0/2909001482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780a8e10 0x7f5b78147ff0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f5b68002f70 tx=0x7f5b68006eb0).stop 2021-12-17T18:26:11.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7e6d9700 1 -- 172.21.15.62:0/2909001482 shutdown_connections 2021-12-17T18:26:11.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7e6d9700 1 --2- 172.21.15.62:0/2909001482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780a8e10 0x7f5b78147ff0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7e6d9700 1 -- 172.21.15.62:0/2909001482 >> 172.21.15.62:0/2909001482 conn(0x7f5b7805d220 msgr2=0x7f5b780b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:11.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7e6d9700 1 -- 172.21.15.62:0/2909001482 shutdown_connections 2021-12-17T18:26:11.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.687+0000 7f5b7e6d9700 1 -- 172.21.15.62:0/2909001482 wait complete. 2021-12-17T18:26:11.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.691+0000 7f5b7e6d9700 1 Processor -- start 2021-12-17T18:26:11.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.691+0000 7f5b7e6d9700 1 -- start start 2021-12-17T18:26:11.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.691+0000 7f5b7e6d9700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5b780a71e0 0x7f5b780ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:11.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.691+0000 7f5b7e6d9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780a8e10 0x7f5b7814a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:11.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.691+0000 7f5b7e6d9700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5b78141480 0x7f5b7813dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:11.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.691+0000 7f5b7e6d9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780ad2b0 con 0x7f5b780a8e10 2021-12-17T18:26:11.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.691+0000 7f5b7e6d9700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780ae9a0 con 0x7f5b78141480 2021-12-17T18:26:11.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.691+0000 7f5b7e6d9700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780aec40 con 0x7f5b780a71e0 2021-12-17T18:26:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.691+0000 7f5b7ced6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780a8e10 0x7f5b7814a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.691+0000 7f5b7ced6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780a8e10 0x7f5b7814a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54382/0 (socket says 172.21.15.62:54382) 2021-12-17T18:26:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.691+0000 7f5b7ced6700 1 -- 172.21.15.62:0/3256414001 learned_addr learned my addr 172.21.15.62:0/3256414001 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.691+0000 7f5b7d6d7700 1 --2- 172.21.15.62:0/3256414001 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5b780a71e0 0x7f5b780ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:11.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.691+0000 7f5b7ded8700 1 --2- 172.21.15.62:0/3256414001 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5b78141480 0x7f5b7813dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:11.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.695+0000 7f5b7ced6700 1 -- 172.21.15.62:0/3256414001 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5b780a71e0 msgr2=0x7f5b780ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.695+0000 7f5b7ced6700 1 --2- 172.21.15.62:0/3256414001 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5b780a71e0 0x7f5b780ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.695+0000 7f5b7ced6700 1 -- 172.21.15.62:0/3256414001 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5b78141480 msgr2=0x7f5b7813dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.695+0000 7f5b7ced6700 1 --2- 172.21.15.62:0/3256414001 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5b78141480 0x7f5b7813dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.695+0000 7f5b7ced6700 1 -- 172.21.15.62:0/3256414001 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6800b1e0 con 0x7f5b780a8e10 2021-12-17T18:26:11.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.695+0000 7f5b7ced6700 1 --2- 172.21.15.62:0/3256414001 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780a8e10 0x7f5b7814a3f0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f5b68002f70 tx=0x7f5b68015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:11.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.695+0000 7f5b6e7fc700 1 -- 172.21.15.62:0/3256414001 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b6800d9c0 con 0x7f5b780a8e10 2021-12-17T18:26:11.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.695+0000 7f5b6e7fc700 1 -- 172.21.15.62:0/3256414001 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b68011b40 con 0x7f5b780a8e10 2021-12-17T18:26:11.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.695+0000 7f5b7e6d9700 1 -- 172.21.15.62:0/3256414001 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b780aeee0 con 0x7f5b780a8e10 2021-12-17T18:26:11.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.695+0000 7f5b6e7fc700 1 -- 172.21.15.62:0/3256414001 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b68011ea0 con 0x7f5b780a8e10 2021-12-17T18:26:11.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.695+0000 7f5b7e6d9700 1 -- 172.21.15.62:0/3256414001 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b780aa6f0 con 0x7f5b780a8e10 2021-12-17T18:26:11.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.695+0000 7f5b7e6d9700 1 -- 172.21.15.62:0/3256414001 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b780b1b90 con 0x7f5b780a8e10 2021-12-17T18:26:11.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.695+0000 7f5b6e7fc700 1 -- 172.21.15.62:0/3256414001 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5b68025030 con 0x7f5b780a8e10 2021-12-17T18:26:11.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.695+0000 7f5b6e7fc700 1 --2- 172.21.15.62:0/3256414001 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5b60053640 0x7f5b60055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:11.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.695+0000 7f5b6e7fc700 1 -- 172.21.15.62:0/3256414001 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5b6806cc20 con 0x7f5b780a8e10 2021-12-17T18:26:11.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.699+0000 7f5b7d6d7700 1 --2- 172.21.15.62:0/3256414001 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5b60053640 0x7f5b60055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:11.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.699+0000 7f5b7d6d7700 1 --2- 172.21.15.62:0/3256414001 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5b60053640 0x7f5b60055b00 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f5b7400d000 tx=0x7f5b74007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:11.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.703+0000 7f5b6e7fc700 1 -- 172.21.15.62:0/3256414001 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5b68043d80 con 0x7f5b780a8e10 2021-12-17T18:26:11.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.831+0000 7f5b7e6d9700 1 -- 172.21.15.62:0/3256414001 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b780684f0 con 0x7f5b780a8e10 2021-12-17T18:26:11.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.831+0000 7f5b6e7fc700 1 -- 172.21.15.62:0/3256414001 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16097 (secure 0 0 0) 0x7f5b68023070 con 0x7f5b780a8e10 2021-12-17T18:26:11.840 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:11.840 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":102,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:26:11.259910+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:26:08.360156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-12-17T18:26:09.261212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:26:11.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.835+0000 7f5b7e6d9700 1 -- 172.21.15.62:0/3256414001 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5b60053640 msgr2=0x7f5b60055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.835+0000 7f5b7e6d9700 1 --2- 172.21.15.62:0/3256414001 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5b60053640 0x7f5b60055b00 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f5b7400d000 tx=0x7f5b74007b90).stop 2021-12-17T18:26:11.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.835+0000 7f5b7e6d9700 1 -- 172.21.15.62:0/3256414001 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780a8e10 msgr2=0x7f5b7814a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.835+0000 7f5b7e6d9700 1 --2- 172.21.15.62:0/3256414001 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780a8e10 0x7f5b7814a3f0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f5b68002f70 tx=0x7f5b68015000).stop 2021-12-17T18:26:11.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.835+0000 7f5b7e6d9700 1 -- 172.21.15.62:0/3256414001 shutdown_connections 2021-12-17T18:26:11.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.835+0000 7f5b7e6d9700 1 --2- 172.21.15.62:0/3256414001 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5b60053640 0x7f5b60055b00 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.835+0000 7f5b7e6d9700 1 --2- 172.21.15.62:0/3256414001 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5b78141480 0x7f5b7813dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.835+0000 7f5b7e6d9700 1 --2- 172.21.15.62:0/3256414001 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780a8e10 0x7f5b7814a3f0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.835+0000 7f5b7e6d9700 1 --2- 172.21.15.62:0/3256414001 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5b780a71e0 0x7f5b780ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.835+0000 7f5b7e6d9700 1 -- 172.21.15.62:0/3256414001 >> 172.21.15.62:0/3256414001 conn(0x7f5b7805d220 msgr2=0x7f5b780b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:11.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.835+0000 7f5b7e6d9700 1 -- 172.21.15.62:0/3256414001 shutdown_connections 2021-12-17T18:26:11.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.835+0000 7f5b7e6d9700 1 -- 172.21.15.62:0/3256414001 wait complete. 2021-12-17T18:26:11.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:26:11.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.959+0000 7f0bd6428700 1 Processor -- start 2021-12-17T18:26:11.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.959+0000 7f0bd6428700 1 -- start start 2021-12-17T18:26:11.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.959+0000 7f0bd6428700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0bd00b1de0 0x7f0bd00ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:11.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.959+0000 7f0bd6428700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0bd00aeaa0 0x7f0bd013e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:11.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.959+0000 7f0bd6428700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd00afc00 con 0x7f0bd013ea40 2021-12-17T18:26:11.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.959+0000 7f0bd6428700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd013f5f0 con 0x7f0bd00aeaa0 2021-12-17T18:26:11.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.959+0000 7f0bd6428700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd00af230 con 0x7f0bd00b1de0 2021-12-17T18:26:11.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.959+0000 7f0bd4c25700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0bd00aeaa0 0x7f0bd013e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:11.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bd4c25700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0bd00aeaa0 0x7f0bd013e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54388/0 (socket says 172.21.15.62:54388) 2021-12-17T18:26:11.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bd4c25700 1 -- 172.21.15.62:0/753453050 learned_addr learned my addr 172.21.15.62:0/753453050 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:11.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bd5426700 1 --2- 172.21.15.62:0/753453050 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0bd00b1de0 0x7f0bd00ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:11.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bd4c25700 1 -- 172.21.15.62:0/753453050 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0bd00b1de0 msgr2=0x7f0bd00ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:11.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bd4c25700 1 --2- 172.21.15.62:0/753453050 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0bd00b1de0 0x7f0bd00ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bd4c25700 1 -- 172.21.15.62:0/753453050 >> v1:172.21.15.109:6789/0 conn(0x7f0bd013ea40 legacy=0x7f0bd00b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bd4c25700 1 -- 172.21.15.62:0/753453050 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd00afe60 con 0x7f0bd00aeaa0 2021-12-17T18:26:11.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bd5426700 1 --2- 172.21.15.62:0/753453050 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0bd00b1de0 0x7f0bd00ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:11.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bd4c25700 1 --2- 172.21.15.62:0/753453050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bd00aeaa0 0x7f0bd013e550 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f0bc80032f0 tx=0x7f0bc800b530).ready entity=mon.0 client_cookie=a9772607f4e9d155 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:11.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bcffff700 1 -- 172.21.15.62:0/753453050 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bc8010660 con 0x7f0bd00aeaa0 2021-12-17T18:26:11.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bcffff700 1 -- 172.21.15.62:0/753453050 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc80107c0 con 0x7f0bd00aeaa0 2021-12-17T18:26:11.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bcffff700 1 -- 172.21.15.62:0/753453050 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bc8010b20 con 0x7f0bd00aeaa0 2021-12-17T18:26:11.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bd6428700 1 -- 172.21.15.62:0/753453050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bd00aeaa0 msgr2=0x7f0bd013e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bd6428700 1 --2- 172.21.15.62:0/753453050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bd00aeaa0 0x7f0bd013e550 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f0bc80032f0 tx=0x7f0bc800b530).stop 2021-12-17T18:26:11.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bd6428700 1 -- 172.21.15.62:0/753453050 shutdown_connections 2021-12-17T18:26:11.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bd6428700 1 --2- 172.21.15.62:0/753453050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bd00aeaa0 0x7f0bd013e550 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bd6428700 1 --2- 172.21.15.62:0/753453050 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0bd00b1de0 0x7f0bd00ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bd6428700 1 -- 172.21.15.62:0/753453050 >> 172.21.15.62:0/753453050 conn(0x7f0bd005be70 msgr2=0x7f0bd0062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:11.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bd6428700 1 -- 172.21.15.62:0/753453050 shutdown_connections 2021-12-17T18:26:11.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.963+0000 7f0bd6428700 1 -- 172.21.15.62:0/753453050 wait complete. 2021-12-17T18:26:11.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd6428700 1 Processor -- start 2021-12-17T18:26:11.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd6428700 1 -- start start 2021-12-17T18:26:11.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd6428700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0bd00aeaa0 0x7f0bd00b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:11.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd6428700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bd00b1de0 0x7f0bd00abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:11.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd6428700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0bd013ea40 0x7f0bd00abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:11.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd6428700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd0066dd0 con 0x7f0bd00b1de0 2021-12-17T18:26:11.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd6428700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd00ac4d0 con 0x7f0bd00aeaa0 2021-12-17T18:26:11.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd6428700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd0067000 con 0x7f0bd013ea40 2021-12-17T18:26:11.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd4c25700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bd00b1de0 0x7f0bd00abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:11.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd4c25700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bd00b1de0 0x7f0bd00abaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54396/0 (socket says 172.21.15.62:54396) 2021-12-17T18:26:11.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd4c25700 1 -- 172.21.15.62:0/2298770760 learned_addr learned my addr 172.21.15.62:0/2298770760 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:11.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd5426700 1 --2- 172.21.15.62:0/2298770760 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0bd00aeaa0 0x7f0bd00b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:11.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd5c27700 1 --2- 172.21.15.62:0/2298770760 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0bd013ea40 0x7f0bd00abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:11.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd4c25700 1 -- 172.21.15.62:0/2298770760 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0bd013ea40 msgr2=0x7f0bd00abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd4c25700 1 --2- 172.21.15.62:0/2298770760 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0bd013ea40 0x7f0bd00abfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd4c25700 1 -- 172.21.15.62:0/2298770760 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0bd00aeaa0 msgr2=0x7f0bd00b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:11.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd4c25700 1 --2- 172.21.15.62:0/2298770760 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0bd00aeaa0 0x7f0bd00b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:11.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd4c25700 1 -- 172.21.15.62:0/2298770760 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc800b7d0 con 0x7f0bd00b1de0 2021-12-17T18:26:11.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd5c27700 1 --2- 172.21.15.62:0/2298770760 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0bd013ea40 0x7f0bd00abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:11.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bd4c25700 1 --2- 172.21.15.62:0/2298770760 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bd00b1de0 0x7f0bd00abaf0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f0bc80032f0 tx=0x7f0bd00add80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:11.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.967+0000 7f0bce7fc700 1 -- 172.21.15.62:0/2298770760 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bc801d070 con 0x7f0bd00b1de0 2021-12-17T18:26:11.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.971+0000 7f0bce7fc700 1 -- 172.21.15.62:0/2298770760 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc8018800 con 0x7f0bd00b1de0 2021-12-17T18:26:11.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.971+0000 7f0bd6428700 1 -- 172.21.15.62:0/2298770760 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd009fee0 con 0x7f0bd00b1de0 2021-12-17T18:26:11.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.971+0000 7f0bce7fc700 1 -- 172.21.15.62:0/2298770760 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bc8018b60 con 0x7f0bd00b1de0 2021-12-17T18:26:11.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.971+0000 7f0bd6428700 1 -- 172.21.15.62:0/2298770760 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd0145130 con 0x7f0bd00b1de0 2021-12-17T18:26:11.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.971+0000 7f0bd6428700 1 -- 172.21.15.62:0/2298770760 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd00aef00 con 0x7f0bd00b1de0 2021-12-17T18:26:11.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.971+0000 7f0bce7fc700 1 -- 172.21.15.62:0/2298770760 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0bc8018cc0 con 0x7f0bd00b1de0 2021-12-17T18:26:11.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.971+0000 7f0bce7fc700 1 --2- 172.21.15.62:0/2298770760 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0bb0053610 0x7f0bb0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:11.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.971+0000 7f0bce7fc700 1 -- 172.21.15.62:0/2298770760 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0bc806d080 con 0x7f0bd00b1de0 2021-12-17T18:26:11.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.971+0000 7f0bd5426700 1 --2- 172.21.15.62:0/2298770760 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0bb0053610 0x7f0bb0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:11.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.971+0000 7f0bd5426700 1 --2- 172.21.15.62:0/2298770760 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0bb0053610 0x7f0bb0055ad0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f0bc400c000 tx=0x7f0bc4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:11.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:11.979+0000 7f0bce7fc700 1 -- 172.21.15.62:0/2298770760 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0bc8044290 con 0x7f0bd00b1de0 2021-12-17T18:26:12.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.143+0000 7f0bd6428700 1 -- 172.21.15.62:0/2298770760 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0bd00573d0 con 0x7f0bd00b1de0 2021-12-17T18:26:12.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.155+0000 7f0bce7fc700 1 -- 172.21.15.62:0/2298770760 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v33) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0bc80478b0 con 0x7f0bd00b1de0 2021-12-17T18:26:12.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.155+0000 7f0bd6428700 1 -- 172.21.15.62:0/2298770760 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0bb0053610 msgr2=0x7f0bb0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:12.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.155+0000 7f0bd6428700 1 --2- 172.21.15.62:0/2298770760 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0bb0053610 0x7f0bb0055ad0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f0bc400c000 tx=0x7f0bc4008040).stop 2021-12-17T18:26:12.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.155+0000 7f0bd6428700 1 -- 172.21.15.62:0/2298770760 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bd00b1de0 msgr2=0x7f0bd00abaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:12.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.155+0000 7f0bd6428700 1 --2- 172.21.15.62:0/2298770760 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bd00b1de0 0x7f0bd00abaf0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f0bc80032f0 tx=0x7f0bd00add80).stop 2021-12-17T18:26:12.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.155+0000 7f0bd6428700 1 -- 172.21.15.62:0/2298770760 shutdown_connections 2021-12-17T18:26:12.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.155+0000 7f0bd6428700 1 --2- 172.21.15.62:0/2298770760 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0bb0053610 0x7f0bb0055ad0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:12.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.155+0000 7f0bd6428700 1 --2- 172.21.15.62:0/2298770760 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0bd013ea40 0x7f0bd00abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:12.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.155+0000 7f0bd6428700 1 --2- 172.21.15.62:0/2298770760 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bd00b1de0 0x7f0bd00abaf0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:12.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.155+0000 7f0bd6428700 1 --2- 172.21.15.62:0/2298770760 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0bd00aeaa0 0x7f0bd00b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:12.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.155+0000 7f0bd6428700 1 -- 172.21.15.62:0/2298770760 >> 172.21.15.62:0/2298770760 conn(0x7f0bd005be70 msgr2=0x7f0bd00b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:12.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.155+0000 7f0bd6428700 1 -- 172.21.15.62:0/2298770760 shutdown_connections 2021-12-17T18:26:12.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.155+0000 7f0bd6428700 1 -- 172.21.15.62:0/2298770760 wait complete. 2021-12-17T18:26:12.167 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.0 2021-12-17T18:26:12.176 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:26:12.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.283+0000 7fc5e1fc0700 1 Processor -- start 2021-12-17T18:26:12.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.283+0000 7fc5e1fc0700 1 -- start start 2021-12-17T18:26:12.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5e1fc0700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc5dc05fa70 0x7fc5dc061390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:12.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5e1fc0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc5dc064de0 0x7fc5dc062450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:12.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5e1fc0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5dc13fee0 0x7fc5dc140320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:12.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5e1fc0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5dc05fe50 con 0x7fc5dc064de0 2021-12-17T18:26:12.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5e1fc0700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5dc0646a0 con 0x7fc5dc05fa70 2021-12-17T18:26:12.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5e1fc0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc064940 con 0x7fc5dc13fee0 2021-12-17T18:26:12.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5d3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc5dc064de0 0x7fc5dc062450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:12.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5d3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc5dc064de0 0x7fc5dc062450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54406/0 (socket says 172.21.15.62:54406) 2021-12-17T18:26:12.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5e17bf700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5dc13fee0 0x7fc5dc140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:12.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5e0fbe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc5dc05fa70 0x7fc5dc061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:12.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5d3fff700 1 -- 172.21.15.62:0/691844162 learned_addr learned my addr 172.21.15.62:0/691844162 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:12.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5d3fff700 1 -- 172.21.15.62:0/691844162 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5dc13fee0 msgr2=0x7fc5dc140320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:12.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5d3fff700 1 --2- 172.21.15.62:0/691844162 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5dc13fee0 0x7fc5dc140320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:12.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5d3fff700 1 -- 172.21.15.62:0/691844162 >> v2:172.21.15.109:3300/0 conn(0x7fc5dc05fa70 msgr2=0x7fc5dc061390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:12.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5d3fff700 1 --2- 172.21.15.62:0/691844162 >> v2:172.21.15.109:3300/0 conn(0x7fc5dc05fa70 0x7fc5dc061390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:12.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5d3fff700 1 -- 172.21.15.62:0/691844162 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc140810 con 0x7fc5dc064de0 2021-12-17T18:26:12.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5e0fbe700 1 --2- 172.21.15.62:0/691844162 >> v2:172.21.15.109:3300/0 conn(0x7fc5dc05fa70 0x7fc5dc061390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:12.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5e17bf700 1 --2- 172.21.15.62:0/691844162 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5dc13fee0 0x7fc5dc140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:12.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5d3fff700 1 --2- 172.21.15.62:0/691844162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5dc064de0 0x7fc5dc062450 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fc5cc002f70 tx=0x7fc5cc006eb0).ready entity=mon.0 client_cookie=bb54449f457c41f3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:12.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5d37fe700 1 -- 172.21.15.62:0/691844162 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5cc00d570 con 0x7fc5dc064de0 2021-12-17T18:26:12.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5d37fe700 1 -- 172.21.15.62:0/691844162 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5cc000e90 con 0x7fc5dc064de0 2021-12-17T18:26:12.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.287+0000 7fc5d37fe700 1 -- 172.21.15.62:0/691844162 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5cc00d900 con 0x7fc5dc064de0 2021-12-17T18:26:12.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.291+0000 7fc5e1fc0700 1 -- 172.21.15.62:0/691844162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5dc064de0 msgr2=0x7fc5dc062450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:12.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.291+0000 7fc5e1fc0700 1 --2- 172.21.15.62:0/691844162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5dc064de0 0x7fc5dc062450 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fc5cc002f70 tx=0x7fc5cc006eb0).stop 2021-12-17T18:26:12.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.291+0000 7fc5e1fc0700 1 -- 172.21.15.62:0/691844162 shutdown_connections 2021-12-17T18:26:12.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.291+0000 7fc5e1fc0700 1 --2- 172.21.15.62:0/691844162 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5dc13fee0 0x7fc5dc140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:12.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.291+0000 7fc5e1fc0700 1 --2- 172.21.15.62:0/691844162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5dc064de0 0x7fc5dc062450 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:12.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.291+0000 7fc5e1fc0700 1 --2- 172.21.15.62:0/691844162 >> v2:172.21.15.109:3300/0 conn(0x7fc5dc05fa70 0x7fc5dc061390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:12.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.291+0000 7fc5e1fc0700 1 -- 172.21.15.62:0/691844162 >> 172.21.15.62:0/691844162 conn(0x7fc5dc05bcd0 msgr2=0x7fc5dc063510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:12.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.291+0000 7fc5e1fc0700 1 -- 172.21.15.62:0/691844162 shutdown_connections 2021-12-17T18:26:12.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.291+0000 7fc5e1fc0700 1 -- 172.21.15.62:0/691844162 wait complete. 2021-12-17T18:26:12.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.291+0000 7fc5e1fc0700 1 Processor -- start 2021-12-17T18:26:12.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.291+0000 7fc5e1fc0700 1 -- start start 2021-12-17T18:26:12.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.291+0000 7fc5e1fc0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5dc05fa70 0x7fc5dc141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:12.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.291+0000 7fc5e1fc0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc5dc064de0 0x7fc5dc13e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:12.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.291+0000 7fc5e1fc0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5dc13fee0 0x7fc5dc13e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:12.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.291+0000 7fc5e1fc0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc1462f0 con 0x7fc5dc13fee0 2021-12-17T18:26:12.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.291+0000 7fc5e1fc0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc1560d0 con 0x7fc5dc064de0 2021-12-17T18:26:12.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.291+0000 7fc5e1fc0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc152780 con 0x7fc5dc05fa70 2021-12-17T18:26:12.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.295+0000 7fc5e17bf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5dc13fee0 0x7fc5dc13e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:12.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.295+0000 7fc5e17bf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5dc13fee0 0x7fc5dc13e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54412/0 (socket says 172.21.15.62:54412) 2021-12-17T18:26:12.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.295+0000 7fc5e17bf700 1 -- 172.21.15.62:0/389032656 learned_addr learned my addr 172.21.15.62:0/389032656 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:12.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.295+0000 7fc5e0fbe700 1 --2- 172.21.15.62:0/389032656 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5dc05fa70 0x7fc5dc141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:12.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.295+0000 7fc5d3fff700 1 --2- 172.21.15.62:0/389032656 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc5dc064de0 0x7fc5dc13e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:12.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.295+0000 7fc5e17bf700 1 -- 172.21.15.62:0/389032656 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5dc05fa70 msgr2=0x7fc5dc141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:12.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.295+0000 7fc5e17bf700 1 --2- 172.21.15.62:0/389032656 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5dc05fa70 0x7fc5dc141fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:12.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.295+0000 7fc5e17bf700 1 -- 172.21.15.62:0/389032656 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc5dc064de0 msgr2=0x7fc5dc13e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:12.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.295+0000 7fc5e17bf700 1 --2- 172.21.15.62:0/389032656 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc5dc064de0 0x7fc5dc13e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:12.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.295+0000 7fc5e17bf700 1 -- 172.21.15.62:0/389032656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d800b180 con 0x7fc5dc13fee0 2021-12-17T18:26:12.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.295+0000 7fc5e17bf700 1 --2- 172.21.15.62:0/389032656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5dc13fee0 0x7fc5dc13e990 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7fc5d400c000 tx=0x7fc5d40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:12.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.295+0000 7fc5d1ffb700 1 -- 172.21.15.62:0/389032656 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5d400ee60 con 0x7fc5dc13fee0 2021-12-17T18:26:12.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.295+0000 7fc5d1ffb700 1 -- 172.21.15.62:0/389032656 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d400c7f0 con 0x7fc5dc13fee0 2021-12-17T18:26:12.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.295+0000 7fc5d1ffb700 1 -- 172.21.15.62:0/389032656 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5d400cb50 con 0x7fc5dc13fee0 2021-12-17T18:26:12.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.295+0000 7fc5e1fc0700 1 -- 172.21.15.62:0/389032656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d4009470 con 0x7fc5dc13fee0 2021-12-17T18:26:12.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.295+0000 7fc5e1fc0700 1 -- 172.21.15.62:0/389032656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5cc00b1e0 con 0x7fc5dc13fee0 2021-12-17T18:26:12.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.295+0000 7fc5e1fc0700 1 -- 172.21.15.62:0/389032656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5dc155ef0 con 0x7fc5dc13fee0 2021-12-17T18:26:12.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.299+0000 7fc5d1ffb700 1 -- 172.21.15.62:0/389032656 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc5d4022070 con 0x7fc5dc13fee0 2021-12-17T18:26:12.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.299+0000 7fc5d1ffb700 1 --2- 172.21.15.62:0/389032656 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc5bc0536d0 0x7fc5bc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:12.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.299+0000 7fc5d1ffb700 1 -- 172.21.15.62:0/389032656 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc5d406c0d0 con 0x7fc5dc13fee0 2021-12-17T18:26:12.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.299+0000 7fc5e0fbe700 1 --2- 172.21.15.62:0/389032656 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc5bc0536d0 0x7fc5bc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:12.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.299+0000 7fc5e0fbe700 1 --2- 172.21.15.62:0/389032656 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc5bc0536d0 0x7fc5bc055b90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fc5d800b000 tx=0x7fc5d8006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:12.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.307+0000 7fc5d1ffb700 1 -- 172.21.15.62:0/389032656 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc5d4043190 con 0x7fc5dc13fee0 2021-12-17T18:26:12.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.475+0000 7fc5e1fc0700 1 -- 172.21.15.62:0/389032656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc5dc0573d0 con 0x7fc5dc13fee0 2021-12-17T18:26:12.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.483+0000 7fc5d1ffb700 1 -- 172.21.15.62:0/389032656 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v34) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc5d40160e0 con 0x7fc5dc13fee0 2021-12-17T18:26:12.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.483+0000 7fc5e1fc0700 1 -- 172.21.15.62:0/389032656 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc5bc0536d0 msgr2=0x7fc5bc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:12.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.483+0000 7fc5e1fc0700 1 --2- 172.21.15.62:0/389032656 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc5bc0536d0 0x7fc5bc055b90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fc5d800b000 tx=0x7fc5d8006df0).stop 2021-12-17T18:26:12.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.483+0000 7fc5e1fc0700 1 -- 172.21.15.62:0/389032656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5dc13fee0 msgr2=0x7fc5dc13e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:12.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.483+0000 7fc5e1fc0700 1 --2- 172.21.15.62:0/389032656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5dc13fee0 0x7fc5dc13e990 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7fc5d400c000 tx=0x7fc5d40091d0).stop 2021-12-17T18:26:12.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.483+0000 7fc5e1fc0700 1 -- 172.21.15.62:0/389032656 shutdown_connections 2021-12-17T18:26:12.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.483+0000 7fc5e1fc0700 1 --2- 172.21.15.62:0/389032656 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc5bc0536d0 0x7fc5bc055b90 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:12.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.483+0000 7fc5e1fc0700 1 --2- 172.21.15.62:0/389032656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5dc13fee0 0x7fc5dc13e990 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:12.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.483+0000 7fc5e1fc0700 1 --2- 172.21.15.62:0/389032656 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc5dc064de0 0x7fc5dc13e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:12.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.483+0000 7fc5e1fc0700 1 --2- 172.21.15.62:0/389032656 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5dc05fa70 0x7fc5dc141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:12.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.483+0000 7fc5e1fc0700 1 -- 172.21.15.62:0/389032656 >> 172.21.15.62:0/389032656 conn(0x7fc5dc05bcd0 msgr2=0x7fc5dc149b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:12.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.483+0000 7fc5e1fc0700 1 -- 172.21.15.62:0/389032656 shutdown_connections 2021-12-17T18:26:12.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.483+0000 7fc5e1fc0700 1 -- 172.21.15.62:0/389032656 wait complete. 2021-12-17T18:26:12.494 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.1 2021-12-17T18:26:12.504 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:26:12.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.611+0000 7f4b809fc700 1 Processor -- start 2021-12-17T18:26:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.611+0000 7f4b809fc700 1 -- start start 2021-12-17T18:26:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.611+0000 7f4b809fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4b7c142d70 0x7f4b7c1471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.611+0000 7f4b809fc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f4b7c0b51a0 0x7f4b7c0b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.611+0000 7f4b809fc700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c0b09e0 con 0x7f4b7c0b4340 2021-12-17T18:26:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.611+0000 7f4b809fc700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7c1467d0 con 0x7f4b7c142d70 2021-12-17T18:26:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.611+0000 7f4b809fc700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7c146a70 con 0x7f4b7c0b51a0 2021-12-17T18:26:13.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.611+0000 7f4b79d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4b7c142d70 0x7f4b7c1471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.611+0000 7f4b79d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4b7c142d70 0x7f4b7c1471b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54418/0 (socket says 172.21.15.62:54418) 2021-12-17T18:26:13.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.611+0000 7f4b79d9b700 1 -- 172.21.15.62:0/1902118307 learned_addr learned my addr 172.21.15.62:0/1902118307 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:13.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.611+0000 7f4b7ad9d700 1 --2- 172.21.15.62:0/1902118307 >> v2:172.21.15.109:3300/0 conn(0x7f4b7c0b51a0 0x7f4b7c0b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.611+0000 7f4b79d9b700 1 -- 172.21.15.62:0/1902118307 >> v2:172.21.15.109:3300/0 conn(0x7f4b7c0b51a0 msgr2=0x7f4b7c0b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:13.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.611+0000 7f4b7959a700 1 -- 172.21.15.62:0/1902118307 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603163366 0 0) 0x7f4b7c0b09e0 con 0x7f4b7c0b4340 2021-12-17T18:26:13.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.611+0000 7f4b79d9b700 1 --2- 172.21.15.62:0/1902118307 >> v2:172.21.15.109:3300/0 conn(0x7f4b7c0b51a0 0x7f4b7c0b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.611+0000 7f4b79d9b700 1 -- 172.21.15.62:0/1902118307 >> v1:172.21.15.109:6789/0 conn(0x7f4b7c0b4340 legacy=0x7f4b7c142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:13.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.611+0000 7f4b79d9b700 1 -- 172.21.15.62:0/1902118307 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c146d10 con 0x7f4b7c142d70 2021-12-17T18:26:13.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.611+0000 7f4b79d9b700 1 --2- 172.21.15.62:0/1902118307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c142d70 0x7f4b7c1471b0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f4b6c002f70 tx=0x7f4b6c006eb0).ready entity=mon.0 client_cookie=8ac39ffb376c096f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:13.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b7959a700 1 -- 172.21.15.62:0/1902118307 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6c00d5c0 con 0x7f4b7c142d70 2021-12-17T18:26:13.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b7959a700 1 -- 172.21.15.62:0/1902118307 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c000e90 con 0x7f4b7c142d70 2021-12-17T18:26:13.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b7959a700 1 -- 172.21.15.62:0/1902118307 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6c00d910 con 0x7f4b7c142d70 2021-12-17T18:26:13.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b809fc700 1 -- 172.21.15.62:0/1902118307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c142d70 msgr2=0x7f4b7c1471b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:13.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b809fc700 1 --2- 172.21.15.62:0/1902118307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c142d70 0x7f4b7c1471b0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f4b6c002f70 tx=0x7f4b6c006eb0).stop 2021-12-17T18:26:13.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b809fc700 1 -- 172.21.15.62:0/1902118307 shutdown_connections 2021-12-17T18:26:13.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b809fc700 1 --2- 172.21.15.62:0/1902118307 >> v2:172.21.15.109:3300/0 conn(0x7f4b7c0b51a0 0x7f4b7c0b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b809fc700 1 --2- 172.21.15.62:0/1902118307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c142d70 0x7f4b7c1471b0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b809fc700 1 -- 172.21.15.62:0/1902118307 >> 172.21.15.62:0/1902118307 conn(0x7f4b7c05c750 msgr2=0x7f4b7c05cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:13.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b809fc700 1 -- 172.21.15.62:0/1902118307 shutdown_connections 2021-12-17T18:26:13.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b809fc700 1 -- 172.21.15.62:0/1902118307 wait complete. 2021-12-17T18:26:13.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b809fc700 1 Processor -- start 2021-12-17T18:26:13.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b809fc700 1 -- start start 2021-12-17T18:26:13.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b809fc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4b7c0b4340 0x7f4b7c1450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b809fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c0b51a0 0x7f4b7c0634b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b809fc700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4b7c142d70 0x7f4b7c13fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b809fc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c0639a0 con 0x7f4b7c0b51a0 2021-12-17T18:26:13.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b809fc700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c063bc0 con 0x7f4b7c142d70 2021-12-17T18:26:13.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b809fc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c0653f0 con 0x7f4b7c0b4340 2021-12-17T18:26:13.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b79d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c0b51a0 0x7f4b7c0634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b79d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c0b51a0 0x7f4b7c0634b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54424/0 (socket says 172.21.15.62:54424) 2021-12-17T18:26:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b79d9b700 1 -- 172.21.15.62:0/4132980188 learned_addr learned my addr 172.21.15.62:0/4132980188 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b7a59c700 1 --2- 172.21.15.62:0/4132980188 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4b7c0b4340 0x7f4b7c1450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b7ad9d700 1 --2- 172.21.15.62:0/4132980188 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4b7c142d70 0x7f4b7c13fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b79d9b700 1 -- 172.21.15.62:0/4132980188 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4b7c0b4340 msgr2=0x7f4b7c1450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b79d9b700 1 --2- 172.21.15.62:0/4132980188 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4b7c0b4340 0x7f4b7c1450c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b79d9b700 1 -- 172.21.15.62:0/4132980188 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4b7c142d70 msgr2=0x7f4b7c13fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b79d9b700 1 --2- 172.21.15.62:0/4132980188 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4b7c142d70 0x7f4b7c13fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b79d9b700 1 -- 172.21.15.62:0/4132980188 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c00b1e0 con 0x7f4b7c0b51a0 2021-12-17T18:26:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b7a59c700 1 --2- 172.21.15.62:0/4132980188 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4b7c0b4340 0x7f4b7c1450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.615+0000 7f4b79d9b700 1 --2- 172.21.15.62:0/4132980188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c0b51a0 0x7f4b7c0634b0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f4b6c002f70 tx=0x7f4b6c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.619+0000 7f4b737fe700 1 -- 172.21.15.62:0/4132980188 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6c011760 con 0x7f4b7c0b51a0 2021-12-17T18:26:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.619+0000 7f4b737fe700 1 -- 172.21.15.62:0/4132980188 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c0118c0 con 0x7f4b7c0b51a0 2021-12-17T18:26:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.619+0000 7f4b809fc700 1 -- 172.21.15.62:0/4132980188 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7c063e60 con 0x7f4b7c0b51a0 2021-12-17T18:26:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.619+0000 7f4b737fe700 1 -- 172.21.15.62:0/4132980188 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6c011c20 con 0x7f4b7c0b51a0 2021-12-17T18:26:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.619+0000 7f4b809fc700 1 -- 172.21.15.62:0/4132980188 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7c0b9ff0 con 0x7f4b7c0b51a0 2021-12-17T18:26:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.619+0000 7f4b809fc700 1 -- 172.21.15.62:0/4132980188 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7c0655b0 con 0x7f4b7c0b51a0 2021-12-17T18:26:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.619+0000 7f4b737fe700 1 -- 172.21.15.62:0/4132980188 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4b6c01a040 con 0x7f4b7c0b51a0 2021-12-17T18:26:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.619+0000 7f4b737fe700 1 --2- 172.21.15.62:0/4132980188 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4b60053580 0x7f4b60055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.619+0000 7f4b737fe700 1 -- 172.21.15.62:0/4132980188 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4b6c06c690 con 0x7f4b7c0b51a0 2021-12-17T18:26:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.619+0000 7f4b7a59c700 1 --2- 172.21.15.62:0/4132980188 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4b60053580 0x7f4b60055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.623+0000 7f4b7a59c700 1 --2- 172.21.15.62:0/4132980188 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4b60053580 0x7f4b60055a40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f4b6400d000 tx=0x7f4b64009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.623+0000 7f4b737fe700 1 -- 172.21.15.62:0/4132980188 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b6c043930 con 0x7f4b7c0b51a0 2021-12-17T18:26:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.795+0000 7f4b809fc700 1 -- 172.21.15.62:0/4132980188 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4b7c0b4720 con 0x7f4b7c0b51a0 2021-12-17T18:26:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.803+0000 7f4b737fe700 1 -- 172.21.15.62:0/4132980188 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v35) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4b6c046e10 con 0x7f4b7c0b51a0 2021-12-17T18:26:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.807+0000 7f4b809fc700 1 -- 172.21.15.62:0/4132980188 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4b60053580 msgr2=0x7f4b60055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.807+0000 7f4b809fc700 1 --2- 172.21.15.62:0/4132980188 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4b60053580 0x7f4b60055a40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f4b6400d000 tx=0x7f4b64009040).stop 2021-12-17T18:26:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.807+0000 7f4b809fc700 1 -- 172.21.15.62:0/4132980188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c0b51a0 msgr2=0x7f4b7c0634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.807+0000 7f4b809fc700 1 --2- 172.21.15.62:0/4132980188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c0b51a0 0x7f4b7c0634b0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f4b6c002f70 tx=0x7f4b6c015000).stop 2021-12-17T18:26:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.807+0000 7f4b809fc700 1 -- 172.21.15.62:0/4132980188 shutdown_connections 2021-12-17T18:26:13.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.807+0000 7f4b809fc700 1 --2- 172.21.15.62:0/4132980188 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4b60053580 0x7f4b60055a40 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.807+0000 7f4b809fc700 1 --2- 172.21.15.62:0/4132980188 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4b7c142d70 0x7f4b7c13fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.807+0000 7f4b809fc700 1 --2- 172.21.15.62:0/4132980188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c0b51a0 0x7f4b7c0634b0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.807+0000 7f4b809fc700 1 --2- 172.21.15.62:0/4132980188 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4b7c0b4340 0x7f4b7c1450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.807+0000 7f4b809fc700 1 -- 172.21.15.62:0/4132980188 >> 172.21.15.62:0/4132980188 conn(0x7f4b7c05c750 msgr2=0x7f4b7c0b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:13.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.807+0000 7f4b809fc700 1 -- 172.21.15.62:0/4132980188 shutdown_connections 2021-12-17T18:26:13.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:12.807+0000 7f4b809fc700 1 -- 172.21.15.62:0/4132980188 wait complete. 2021-12-17T18:26:13.028 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.2 2021-12-17T18:26:13.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:26:13.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe1300a9700 1 Processor -- start 2021-12-17T18:26:13.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe1300a9700 1 -- start start 2021-12-17T18:26:13.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe1300a9700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe1280b21f0 0x7fe12814aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe1300a9700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe1280b1730 0x7fe1280ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe1300a9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe1280a7bb0 0x7fe128067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe1300a9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe128147870 con 0x7fe1280a7bb0 2021-12-17T18:26:13.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe1300a9700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1280b2ce0 con 0x7fe1280b1730 2021-12-17T18:26:13.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe1300a9700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1280aca60 con 0x7fe1280b21f0 2021-12-17T18:26:13.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe12e646700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe1280a7bb0 0x7fe128067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe12e646700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe1280a7bb0 0x7fe128067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54434/0 (socket says 172.21.15.62:54434) 2021-12-17T18:26:13.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe12e646700 1 -- 172.21.15.62:0/1543046374 learned_addr learned my addr 172.21.15.62:0/1543046374 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:13.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe12d644700 1 --2- 172.21.15.62:0/1543046374 >> v2:172.21.15.109:3300/0 conn(0x7fe1280b1730 0x7fe1280ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe12de45700 1 --2- 172.21.15.62:0/1543046374 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe1280b21f0 0x7fe12814aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe12e646700 1 -- 172.21.15.62:0/1543046374 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe1280b21f0 msgr2=0x7fe12814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:13.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe12e646700 1 --2- 172.21.15.62:0/1543046374 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe1280b21f0 0x7fe12814aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe12e646700 1 -- 172.21.15.62:0/1543046374 >> v2:172.21.15.109:3300/0 conn(0x7fe1280b1730 msgr2=0x7fe1280ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:13.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe12e646700 1 --2- 172.21.15.62:0/1543046374 >> v2:172.21.15.109:3300/0 conn(0x7fe1280b1730 0x7fe1280ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe12e646700 1 -- 172.21.15.62:0/1543046374 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1280b2f10 con 0x7fe1280a7bb0 2021-12-17T18:26:13.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.163+0000 7fe12e646700 1 --2- 172.21.15.62:0/1543046374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1280a7bb0 0x7fe128067120 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7fe1200032f0 tx=0x7fe120009290).ready entity=mon.0 client_cookie=ff96c2c28741edad server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:13.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe12ce43700 1 -- 172.21.15.62:0/1543046374 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe12000b680 con 0x7fe1280a7bb0 2021-12-17T18:26:13.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe12ce43700 1 -- 172.21.15.62:0/1543046374 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12000b7e0 con 0x7fe1280a7bb0 2021-12-17T18:26:13.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe12ce43700 1 -- 172.21.15.62:0/1543046374 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe12000b950 con 0x7fe1280a7bb0 2021-12-17T18:26:13.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe1300a9700 1 -- 172.21.15.62:0/1543046374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1280a7bb0 msgr2=0x7fe128067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:13.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe1300a9700 1 --2- 172.21.15.62:0/1543046374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1280a7bb0 0x7fe128067120 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7fe1200032f0 tx=0x7fe120009290).stop 2021-12-17T18:26:13.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe1300a9700 1 -- 172.21.15.62:0/1543046374 shutdown_connections 2021-12-17T18:26:13.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe1300a9700 1 --2- 172.21.15.62:0/1543046374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1280a7bb0 0x7fe128067120 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe1300a9700 1 --2- 172.21.15.62:0/1543046374 >> v2:172.21.15.109:3300/0 conn(0x7fe1280b1730 0x7fe1280ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe1300a9700 1 --2- 172.21.15.62:0/1543046374 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe1280b21f0 0x7fe12814aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe1300a9700 1 -- 172.21.15.62:0/1543046374 >> 172.21.15.62:0/1543046374 conn(0x7fe12805f730 msgr2=0x7fe12805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:13.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe1300a9700 1 -- 172.21.15.62:0/1543046374 shutdown_connections 2021-12-17T18:26:13.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe1300a9700 1 -- 172.21.15.62:0/1543046374 wait complete. 2021-12-17T18:26:13.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe1300a9700 1 Processor -- start 2021-12-17T18:26:13.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe1300a9700 1 -- start start 2021-12-17T18:26:13.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe1300a9700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe1280a7bb0 0x7fe128065ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe1300a9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1280b1730 0x7fe128157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe1300a9700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe1280b21f0 0x7fe128064ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe1300a9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe128066820 con 0x7fe1280b1730 2021-12-17T18:26:13.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe1300a9700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe128157e30 con 0x7fe1280b21f0 2021-12-17T18:26:13.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe1300a9700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe128063c50 con 0x7fe1280a7bb0 2021-12-17T18:26:13.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.167+0000 7fe12d644700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1280b1730 0x7fe128157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.171+0000 7fe12d644700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1280b1730 0x7fe128157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54438/0 (socket says 172.21.15.62:54438) 2021-12-17T18:26:13.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.171+0000 7fe12d644700 1 -- 172.21.15.62:0/4185168122 learned_addr learned my addr 172.21.15.62:0/4185168122 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:13.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.171+0000 7fe12e646700 1 --2- 172.21.15.62:0/4185168122 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe1280b21f0 0x7fe128064ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.171+0000 7fe12de45700 1 --2- 172.21.15.62:0/4185168122 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe1280a7bb0 0x7fe128065ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.171+0000 7fe12d644700 1 -- 172.21.15.62:0/4185168122 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe1280a7bb0 msgr2=0x7fe128065ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:13.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.171+0000 7fe12d644700 1 --2- 172.21.15.62:0/4185168122 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe1280a7bb0 0x7fe128065ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.171+0000 7fe12d644700 1 -- 172.21.15.62:0/4185168122 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe1280b21f0 msgr2=0x7fe128064ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:13.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.171+0000 7fe12d644700 1 --2- 172.21.15.62:0/4185168122 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe1280b21f0 0x7fe128064ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.171+0000 7fe12d644700 1 -- 172.21.15.62:0/4185168122 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe120009530 con 0x7fe1280b1730 2021-12-17T18:26:13.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.171+0000 7fe12d644700 1 --2- 172.21.15.62:0/4185168122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1280b1730 0x7fe128157940 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fe128157fc0 tx=0x7fe124006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:13.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.171+0000 7fe116ffd700 1 -- 172.21.15.62:0/4185168122 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe124010780 con 0x7fe1280b1730 2021-12-17T18:26:13.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.171+0000 7fe116ffd700 1 -- 172.21.15.62:0/4185168122 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1240108e0 con 0x7fe1280b1730 2021-12-17T18:26:13.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.171+0000 7fe1300a9700 1 -- 172.21.15.62:0/4185168122 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe128063ef0 con 0x7fe1280b1730 2021-12-17T18:26:13.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.171+0000 7fe116ffd700 1 -- 172.21.15.62:0/4185168122 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe124010c40 con 0x7fe1280b1730 2021-12-17T18:26:13.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.171+0000 7fe1300a9700 1 -- 172.21.15.62:0/4185168122 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe128064190 con 0x7fe1280b1730 2021-12-17T18:26:13.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.171+0000 7fe1300a9700 1 -- 172.21.15.62:0/4185168122 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1281576e0 con 0x7fe1280b1730 2021-12-17T18:26:13.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.171+0000 7fe116ffd700 1 -- 172.21.15.62:0/4185168122 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe12401c460 con 0x7fe1280b1730 2021-12-17T18:26:13.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.175+0000 7fe116ffd700 1 --2- 172.21.15.62:0/4185168122 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe108053610 0x7fe108055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.175+0000 7fe116ffd700 1 -- 172.21.15.62:0/4185168122 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe12406bdc0 con 0x7fe1280b1730 2021-12-17T18:26:13.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.175+0000 7fe12de45700 1 --2- 172.21.15.62:0/4185168122 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe108053610 0x7fe108055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.175+0000 7fe12de45700 1 --2- 172.21.15.62:0/4185168122 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe108053610 0x7fe108055ad0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fe11800b000 tx=0x7fe118006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:13.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.179+0000 7fe116ffd700 1 -- 172.21.15.62:0/4185168122 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe124042ec0 con 0x7fe1280b1730 2021-12-17T18:26:13.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.347+0000 7fe1300a9700 1 -- 172.21.15.62:0/4185168122 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1280573d0 con 0x7fe1280b1730 2021-12-17T18:26:13.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.351+0000 7fe116ffd700 1 -- 172.21.15.62:0/4185168122 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fe1240464e0 con 0x7fe1280b1730 2021-12-17T18:26:13.356 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:13.356 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":49,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/965882605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":965882605},{"type":"v1","addr":"172.21.15.109:6835","nonce":965882605}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:26:10.256074+0000","modified":"2021-12-17T18:26:11.259115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1972867454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1972867454},{"type":"v1","addr":"172.21.15.62:6833","nonce":1972867454}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-12-17T18:26:13.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.351+0000 7fe1300a9700 1 -- 172.21.15.62:0/4185168122 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe108053610 msgr2=0x7fe108055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:13.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.351+0000 7fe1300a9700 1 --2- 172.21.15.62:0/4185168122 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe108053610 0x7fe108055ad0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fe11800b000 tx=0x7fe118006df0).stop 2021-12-17T18:26:13.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.351+0000 7fe1300a9700 1 -- 172.21.15.62:0/4185168122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1280b1730 msgr2=0x7fe128157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:13.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.351+0000 7fe1300a9700 1 --2- 172.21.15.62:0/4185168122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1280b1730 0x7fe128157940 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fe128157fc0 tx=0x7fe124006df0).stop 2021-12-17T18:26:13.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.351+0000 7fe1300a9700 1 -- 172.21.15.62:0/4185168122 shutdown_connections 2021-12-17T18:26:13.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.351+0000 7fe1300a9700 1 --2- 172.21.15.62:0/4185168122 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe108053610 0x7fe108055ad0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.351+0000 7fe1300a9700 1 --2- 172.21.15.62:0/4185168122 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe1280b21f0 0x7fe128064ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.351+0000 7fe1300a9700 1 --2- 172.21.15.62:0/4185168122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1280b1730 0x7fe128157940 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.351+0000 7fe1300a9700 1 --2- 172.21.15.62:0/4185168122 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe1280a7bb0 0x7fe128065ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.351+0000 7fe1300a9700 1 -- 172.21.15.62:0/4185168122 >> 172.21.15.62:0/4185168122 conn(0x7fe12805f730 msgr2=0x7fe1280b3610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:13.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.351+0000 7fe1300a9700 1 -- 172.21.15.62:0/4185168122 shutdown_connections 2021-12-17T18:26:13.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.351+0000 7fe1300a9700 1 -- 172.21.15.62:0/4185168122 wait complete. 2021-12-17T18:26:13.361 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 49 2021-12-17T18:26:13.570 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:26:10.256074+0000', 'modified': '2021-12-17T18:26:11.259115+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7365': {'gid': 7365, 'name': 'a', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/1972867454', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 1972867454}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 1972867454}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:26:13.571 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:26:13.571 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:26:13.693 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":7365,"want_state":"up:active","state":"up:active","rank_uptime":3.4222478980000002,"mdsmap_epoch":49,"osdmap_epoch":102,"osdmap_epoch_barrier":101,"uptime":8.1250470870000004} 2021-12-17T18:26:13.694 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 7365, "mdsmap_epoch": 49, "osdmap_epoch": 102, "osdmap_epoch_barrier": 101, "rank_uptime": 3.422247898, "state": "up:active", "uptime": 8.125047087, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:26:13.694 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:26:13.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.795+0000 7fc09ee6b700 1 Processor -- start 2021-12-17T18:26:13.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.795+0000 7fc09ee6b700 1 -- start start 2021-12-17T18:26:13.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.795+0000 7fc09ee6b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc0980b5b20 0x7fc0980b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.795+0000 7fc09ee6b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0981458d0 0x7fc098145d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.795+0000 7fc09ee6b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0980b5f00 con 0x7fc0980b3760 2021-12-17T18:26:13.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.795+0000 7fc09ee6b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0980b3020 con 0x7fc0980b5b20 2021-12-17T18:26:13.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.795+0000 7fc09ee6b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0980b32c0 con 0x7fc0981458d0 2021-12-17T18:26:13.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.795+0000 7fc09d668700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc0980b3760 0x7fc0980b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38024/0 (socket says 172.21.15.62:38024) 2021-12-17T18:26:13.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.795+0000 7fc09d668700 1 -- 172.21.15.62:0/1758221386 learned_addr learned my addr 172.21.15.62:0/1758221386 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:13.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.795+0000 7fc09de69700 1 --2- 172.21.15.62:0/1758221386 >> v2:172.21.15.62:3300/0 conn(0x7fc0980b5b20 0x7fc0980b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.795+0000 7fc09e66a700 1 --2- 172.21.15.62:0/1758221386 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0981458d0 0x7fc098145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.795+0000 7fc09ce67700 1 -- 172.21.15.62:0/1758221386 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252896359 0 0) 0x7fc0980b5f00 con 0x7fc0980b3760 2021-12-17T18:26:13.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.795+0000 7fc09ce67700 1 -- 172.21.15.62:0/1758221386 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc080003260 con 0x7fc0980b3760 2021-12-17T18:26:13.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09de69700 1 -- 172.21.15.62:0/1758221386 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0981458d0 msgr2=0x7fc098145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:13.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09de69700 1 --2- 172.21.15.62:0/1758221386 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0981458d0 0x7fc098145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09de69700 1 -- 172.21.15.62:0/1758221386 >> v1:172.21.15.62:6789/0 conn(0x7fc0980b3760 legacy=0x7fc0980b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:13.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09de69700 1 -- 172.21.15.62:0/1758221386 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0980b6e90 con 0x7fc0980b5b20 2021-12-17T18:26:13.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09de69700 1 --2- 172.21.15.62:0/1758221386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0980b5b20 0x7fc0980b6290 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fc094002f70 tx=0x7fc094006df0).ready entity=mon.0 client_cookie=3bedd9dc093ed85 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:13.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09ce67700 1 -- 172.21.15.62:0/1758221386 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc09400d4a0 con 0x7fc0980b5b20 2021-12-17T18:26:13.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09ce67700 1 -- 172.21.15.62:0/1758221386 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc094000e90 con 0x7fc0980b5b20 2021-12-17T18:26:13.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09ce67700 1 -- 172.21.15.62:0/1758221386 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc09400d7f0 con 0x7fc0980b5b20 2021-12-17T18:26:13.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09ee6b700 1 -- 172.21.15.62:0/1758221386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0980b5b20 msgr2=0x7fc0980b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:13.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09ee6b700 1 --2- 172.21.15.62:0/1758221386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0980b5b20 0x7fc0980b6290 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fc094002f70 tx=0x7fc094006df0).stop 2021-12-17T18:26:13.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09ee6b700 1 -- 172.21.15.62:0/1758221386 shutdown_connections 2021-12-17T18:26:13.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09ee6b700 1 --2- 172.21.15.62:0/1758221386 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0981458d0 0x7fc098145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09ee6b700 1 --2- 172.21.15.62:0/1758221386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0980b5b20 0x7fc0980b6290 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09ee6b700 1 -- 172.21.15.62:0/1758221386 >> 172.21.15.62:0/1758221386 conn(0x7fc09805c750 msgr2=0x7fc09805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:13.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09ee6b700 1 -- 172.21.15.62:0/1758221386 shutdown_connections 2021-12-17T18:26:13.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09ee6b700 1 -- 172.21.15.62:0/1758221386 wait complete. 2021-12-17T18:26:13.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09ee6b700 1 Processor -- start 2021-12-17T18:26:13.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.799+0000 7fc09ee6b700 1 -- start start 2021-12-17T18:26:13.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09ee6b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0980b5b20 0x7fc098155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09ee6b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0981458d0 0x7fc0980b9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09ee6b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc098066130 0x7fc098147500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09ee6b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc098147110 con 0x7fc0980b5b20 2021-12-17T18:26:13.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09ee6b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc098064fa0 con 0x7fc098066130 2021-12-17T18:26:13.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09ee6b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc098065240 con 0x7fc0981458d0 2021-12-17T18:26:13.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09de69700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0980b5b20 0x7fc098155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09de69700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0980b5b20 0x7fc098155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54450/0 (socket says 172.21.15.62:54450) 2021-12-17T18:26:13.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09de69700 1 -- 172.21.15.62:0/3418604815 learned_addr learned my addr 172.21.15.62:0/3418604815 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:13.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09d668700 1 --2- 172.21.15.62:0/3418604815 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0981458d0 0x7fc0980b9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09e66a700 1 --2- 172.21.15.62:0/3418604815 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc098066130 0x7fc098147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09de69700 1 -- 172.21.15.62:0/3418604815 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0981458d0 msgr2=0x7fc0980b9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:13.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09de69700 1 --2- 172.21.15.62:0/3418604815 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0981458d0 0x7fc0980b9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09de69700 1 -- 172.21.15.62:0/3418604815 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc098066130 msgr2=0x7fc098147500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:13.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09de69700 1 --2- 172.21.15.62:0/3418604815 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc098066130 0x7fc098147500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09de69700 1 -- 172.21.15.62:0/3418604815 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09400b180 con 0x7fc0980b5b20 2021-12-17T18:26:13.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09d668700 1 --2- 172.21.15.62:0/3418604815 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0981458d0 0x7fc0980b9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:13.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09e66a700 1 --2- 172.21.15.62:0/3418604815 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc098066130 0x7fc098147500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:13.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09de69700 1 --2- 172.21.15.62:0/3418604815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0980b5b20 0x7fc098155ac0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fc094002f70 tx=0x7fc094014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:13.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc086ffd700 1 -- 172.21.15.62:0/3418604815 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc094012930 con 0x7fc0980b5b20 2021-12-17T18:26:13.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc086ffd700 1 -- 172.21.15.62:0/3418604815 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc094012a90 con 0x7fc0980b5b20 2021-12-17T18:26:13.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09ee6b700 1 -- 172.21.15.62:0/3418604815 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0980654e0 con 0x7fc0980b5b20 2021-12-17T18:26:13.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc086ffd700 1 -- 172.21.15.62:0/3418604815 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc094012df0 con 0x7fc0980b5b20 2021-12-17T18:26:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.803+0000 7fc09ee6b700 1 -- 172.21.15.62:0/3418604815 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0980674f0 con 0x7fc0980b5b20 2021-12-17T18:26:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.807+0000 7fc09ee6b700 1 -- 172.21.15.62:0/3418604815 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0980656a0 con 0x7fc0980b5b20 2021-12-17T18:26:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.807+0000 7fc086ffd700 1 -- 172.21.15.62:0/3418604815 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc09401c070 con 0x7fc0980b5b20 2021-12-17T18:26:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.807+0000 7fc086ffd700 1 --2- 172.21.15.62:0/3418604815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc078053580 0x7fc078055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.807+0000 7fc086ffd700 1 -- 172.21.15.62:0/3418604815 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc09406c3e0 con 0x7fc0980b5b20 2021-12-17T18:26:13.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.807+0000 7fc09d668700 1 --2- 172.21.15.62:0/3418604815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc078053580 0x7fc078055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:13.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.807+0000 7fc09d668700 1 --2- 172.21.15.62:0/3418604815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc078053580 0x7fc078055a40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fc08800d000 tx=0x7fc088009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:13.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.811+0000 7fc086ffd700 1 -- 172.21.15.62:0/3418604815 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc0940433b0 con 0x7fc0980b5b20 2021-12-17T18:26:13.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.939+0000 7fc09ee6b700 1 -- 172.21.15.62:0/3418604815 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0980674f0 con 0x7fc0980b5b20 2021-12-17T18:26:13.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.939+0000 7fc086ffd700 1 -- 172.21.15.62:0/3418604815 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16097 (secure 0 0 0) 0x7fc09402ff00 con 0x7fc0980b5b20 2021-12-17T18:26:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:13.947 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":102,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:26:11.259910+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:26:08.360156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-12-17T18:26:09.261212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:26:13.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.943+0000 7fc09ee6b700 1 -- 172.21.15.62:0/3418604815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc078053580 msgr2=0x7fc078055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:13.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.943+0000 7fc09ee6b700 1 --2- 172.21.15.62:0/3418604815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc078053580 0x7fc078055a40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fc08800d000 tx=0x7fc088009040).stop 2021-12-17T18:26:13.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.943+0000 7fc09ee6b700 1 -- 172.21.15.62:0/3418604815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0980b5b20 msgr2=0x7fc098155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:13.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.943+0000 7fc09ee6b700 1 --2- 172.21.15.62:0/3418604815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0980b5b20 0x7fc098155ac0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fc094002f70 tx=0x7fc094014000).stop 2021-12-17T18:26:13.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.943+0000 7fc09ee6b700 1 -- 172.21.15.62:0/3418604815 shutdown_connections 2021-12-17T18:26:13.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.943+0000 7fc09ee6b700 1 --2- 172.21.15.62:0/3418604815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc078053580 0x7fc078055a40 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.943+0000 7fc09ee6b700 1 --2- 172.21.15.62:0/3418604815 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc098066130 0x7fc098147500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.943+0000 7fc09ee6b700 1 --2- 172.21.15.62:0/3418604815 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc0981458d0 0x7fc0980b9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.943+0000 7fc09ee6b700 1 --2- 172.21.15.62:0/3418604815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0980b5b20 0x7fc098155ac0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:13.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.943+0000 7fc09ee6b700 1 -- 172.21.15.62:0/3418604815 >> 172.21.15.62:0/3418604815 conn(0x7fc09805c750 msgr2=0x7fc098144cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:13.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.943+0000 7fc09ee6b700 1 -- 172.21.15.62:0/3418604815 shutdown_connections 2021-12-17T18:26:13.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:13.943+0000 7fc09ee6b700 1 -- 172.21.15.62:0/3418604815 wait complete. 2021-12-17T18:26:13.960 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:26:08.360156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:26:09.261212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:26:13.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:26:14.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.063+0000 7fa9fd8b3700 1 Processor -- start 2021-12-17T18:26:14.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.063+0000 7fa9fd8b3700 1 -- start start 2021-12-17T18:26:14.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.063+0000 7fa9fd8b3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa9f80b1260 0x7fa9f8063ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.063+0000 7fa9fd8b3700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa9f8061670 0x7fa9f80621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.063+0000 7fa9fd8b3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f8143dc0 con 0x7fa9f8063b00 2021-12-17T18:26:14.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.063+0000 7fa9fd8b3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f8061b20 con 0x7fa9f80b1260 2021-12-17T18:26:14.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.063+0000 7fa9fd8b3700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f80b1b90 con 0x7fa9f8061670 2021-12-17T18:26:14.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.063+0000 7fa9f7fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa9f80b1260 0x7fa9f8063ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.063+0000 7fa9f7fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa9f80b1260 0x7fa9f8063ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54460/0 (socket says 172.21.15.62:54460) 2021-12-17T18:26:14.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.063+0000 7fa9f7fff700 1 -- 172.21.15.62:0/309134555 learned_addr learned my addr 172.21.15.62:0/309134555 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:14.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.063+0000 7fa9fd0b2700 1 --2- 172.21.15.62:0/309134555 >> v2:172.21.15.109:3300/0 conn(0x7fa9f8061670 0x7fa9f80621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.067+0000 7fa9f7fff700 1 -- 172.21.15.62:0/309134555 >> v2:172.21.15.109:3300/0 conn(0x7fa9f8061670 msgr2=0x7fa9f80621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:14.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.067+0000 7fa9f7fff700 1 --2- 172.21.15.62:0/309134555 >> v2:172.21.15.109:3300/0 conn(0x7fa9f8061670 0x7fa9f80621a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.067+0000 7fa9f7fff700 1 -- 172.21.15.62:0/309134555 >> v1:172.21.15.62:6789/0 conn(0x7fa9f8063b00 legacy=0x7fa9f813cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.067+0000 7fa9f7fff700 1 -- 172.21.15.62:0/309134555 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f8061d00 con 0x7fa9f80b1260 2021-12-17T18:26:14.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.067+0000 7fa9f7fff700 1 --2- 172.21.15.62:0/309134555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f80b1260 0x7fa9f8063ee0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7fa9ec002f70 tx=0x7fa9ec006eb0).ready entity=mon.0 client_cookie=9e71bb037f954794 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:14.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.067+0000 7fa9f77fe700 1 -- 172.21.15.62:0/309134555 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9ec00d5c0 con 0x7fa9f80b1260 2021-12-17T18:26:14.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.067+0000 7fa9f77fe700 1 -- 172.21.15.62:0/309134555 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ec000e90 con 0x7fa9f80b1260 2021-12-17T18:26:14.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.067+0000 7fa9f77fe700 1 -- 172.21.15.62:0/309134555 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9ec00d950 con 0x7fa9f80b1260 2021-12-17T18:26:14.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.067+0000 7fa9fd8b3700 1 -- 172.21.15.62:0/309134555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f80b1260 msgr2=0x7fa9f8063ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.067+0000 7fa9fd8b3700 1 --2- 172.21.15.62:0/309134555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f80b1260 0x7fa9f8063ee0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7fa9ec002f70 tx=0x7fa9ec006eb0).stop 2021-12-17T18:26:14.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.067+0000 7fa9fd8b3700 1 -- 172.21.15.62:0/309134555 shutdown_connections 2021-12-17T18:26:14.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.067+0000 7fa9fd8b3700 1 --2- 172.21.15.62:0/309134555 >> v2:172.21.15.109:3300/0 conn(0x7fa9f8061670 0x7fa9f80621a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.067+0000 7fa9fd8b3700 1 --2- 172.21.15.62:0/309134555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f80b1260 0x7fa9f8063ee0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.067+0000 7fa9fd8b3700 1 -- 172.21.15.62:0/309134555 >> 172.21.15.62:0/309134555 conn(0x7fa9f8060a50 msgr2=0x7fa9f805bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:14.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.067+0000 7fa9fd8b3700 1 -- 172.21.15.62:0/309134555 shutdown_connections 2021-12-17T18:26:14.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.067+0000 7fa9fd8b3700 1 -- 172.21.15.62:0/309134555 wait complete. 2021-12-17T18:26:14.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fd8b3700 1 Processor -- start 2021-12-17T18:26:14.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fd8b3700 1 -- start start 2021-12-17T18:26:14.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fd8b3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8061670 0x7fa9f80b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fd8b3700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa9f8063b00 0x7fa9f8155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fd8b3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa9f80b1260 0x7fa9f81520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fd8b3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f8155710 con 0x7fa9f8061670 2021-12-17T18:26:14.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fd8b3700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f81559b0 con 0x7fa9f8063b00 2021-12-17T18:26:14.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fd8b3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f8145aa0 con 0x7fa9f80b1260 2021-12-17T18:26:14.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fc8b1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8061670 0x7fa9f80b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fc8b1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8061670 0x7fa9f80b6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54464/0 (socket says 172.21.15.62:54464) 2021-12-17T18:26:14.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fc8b1700 1 -- 172.21.15.62:0/3695249588 learned_addr learned my addr 172.21.15.62:0/3695249588 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:14.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9f7fff700 1 --2- 172.21.15.62:0/3695249588 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa9f8063b00 0x7fa9f8155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fd0b2700 1 --2- 172.21.15.62:0/3695249588 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa9f80b1260 0x7fa9f81520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fc8b1700 1 -- 172.21.15.62:0/3695249588 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa9f80b1260 msgr2=0x7fa9f81520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fc8b1700 1 --2- 172.21.15.62:0/3695249588 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa9f80b1260 0x7fa9f81520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fc8b1700 1 -- 172.21.15.62:0/3695249588 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa9f8063b00 msgr2=0x7fa9f8155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fc8b1700 1 --2- 172.21.15.62:0/3695249588 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa9f8063b00 0x7fa9f8155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fc8b1700 1 -- 172.21.15.62:0/3695249588 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec00b1e0 con 0x7fa9f8061670 2021-12-17T18:26:14.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fc8b1700 1 --2- 172.21.15.62:0/3695249588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8061670 0x7fa9f80b6b60 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7fa9f80603a0 tx=0x7fa9e8007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:14.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9f5ffb700 1 -- 172.21.15.62:0/3695249588 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9e8012400 con 0x7fa9f8061670 2021-12-17T18:26:14.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9f5ffb700 1 -- 172.21.15.62:0/3695249588 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e8012560 con 0x7fa9f8061670 2021-12-17T18:26:14.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9fd8b3700 1 -- 172.21.15.62:0/3695249588 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f8147220 con 0x7fa9f8061670 2021-12-17T18:26:14.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.071+0000 7fa9f5ffb700 1 -- 172.21.15.62:0/3695249588 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9e80128c0 con 0x7fa9f8061670 2021-12-17T18:26:14.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.075+0000 7fa9fd8b3700 1 -- 172.21.15.62:0/3695249588 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f8145870 con 0x7fa9f8061670 2021-12-17T18:26:14.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.075+0000 7fa9f5ffb700 1 -- 172.21.15.62:0/3695249588 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa9e8019030 con 0x7fa9f8061670 2021-12-17T18:26:14.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.075+0000 7fa9fd8b3700 1 -- 172.21.15.62:0/3695249588 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f8155bb0 con 0x7fa9f8061670 2021-12-17T18:26:14.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.075+0000 7fa9f5ffb700 1 --2- 172.21.15.62:0/3695249588 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa9d80536a0 0x7fa9d8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.075+0000 7fa9f5ffb700 1 -- 172.21.15.62:0/3695249588 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa9e806ac70 con 0x7fa9f8061670 2021-12-17T18:26:14.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.075+0000 7fa9f7fff700 1 --2- 172.21.15.62:0/3695249588 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa9d80536a0 0x7fa9d8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.075+0000 7fa9f7fff700 1 --2- 172.21.15.62:0/3695249588 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa9d80536a0 0x7fa9d8055b60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fa9ec01c000 tx=0x7fa9ec015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:14.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.083+0000 7fa9f5ffb700 1 -- 172.21.15.62:0/3695249588 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa9f8155bb0 con 0x7fa9f8061670 2021-12-17T18:26:14.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.211+0000 7fa9fd8b3700 1 -- 172.21.15.62:0/3695249588 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa9f8155bb0 con 0x7fa9f8061670 2021-12-17T18:26:14.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.211+0000 7fa9f5ffb700 1 -- 172.21.15.62:0/3695249588 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v102) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa9f8155bb0 con 0x7fa9f8061670 2021-12-17T18:26:14.218 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:26:14.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.211+0000 7fa9fd8b3700 1 -- 172.21.15.62:0/3695249588 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa9d80536a0 msgr2=0x7fa9d8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.211+0000 7fa9fd8b3700 1 --2- 172.21.15.62:0/3695249588 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa9d80536a0 0x7fa9d8055b60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fa9ec01c000 tx=0x7fa9ec015000).stop 2021-12-17T18:26:14.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.211+0000 7fa9fd8b3700 1 -- 172.21.15.62:0/3695249588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8061670 msgr2=0x7fa9f80b6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.211+0000 7fa9fd8b3700 1 --2- 172.21.15.62:0/3695249588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8061670 0x7fa9f80b6b60 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7fa9f80603a0 tx=0x7fa9e8007c50).stop 2021-12-17T18:26:14.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.211+0000 7fa9fd8b3700 1 -- 172.21.15.62:0/3695249588 shutdown_connections 2021-12-17T18:26:14.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.211+0000 7fa9fd8b3700 1 --2- 172.21.15.62:0/3695249588 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa9d80536a0 0x7fa9d8055b60 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.211+0000 7fa9fd8b3700 1 --2- 172.21.15.62:0/3695249588 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa9f80b1260 0x7fa9f81520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.211+0000 7fa9fd8b3700 1 --2- 172.21.15.62:0/3695249588 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa9f8063b00 0x7fa9f8155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.211+0000 7fa9fd8b3700 1 --2- 172.21.15.62:0/3695249588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f8061670 0x7fa9f80b6b60 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.211+0000 7fa9fd8b3700 1 -- 172.21.15.62:0/3695249588 >> 172.21.15.62:0/3695249588 conn(0x7fa9f8060a50 msgr2=0x7fa9f80b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:14.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.215+0000 7fa9fd8b3700 1 -- 172.21.15.62:0/3695249588 shutdown_connections 2021-12-17T18:26:14.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.215+0000 7fa9fd8b3700 1 -- 172.21.15.62:0/3695249588 wait complete. 2021-12-17T18:26:14.232 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:26:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.335+0000 7f70930b6700 1 Processor -- start 2021-12-17T18:26:14.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.335+0000 7f70930b6700 1 -- start start 2021-12-17T18:26:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70930b6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f708c05ca90 0x7f708c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70930b6700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f708c0b3540 0x7f708c0b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70930b6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f708c0b4230 0x7f708c0b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70930b6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708c05ce70 con 0x7f708c05ca90 2021-12-17T18:26:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70930b6700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708c0b1bc0 con 0x7f708c0b3540 2021-12-17T18:26:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70930b6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708c0b1e60 con 0x7f708c0b4230 2021-12-17T18:26:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70920b4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f708c05ca90 0x7f708c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70920b4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f708c05ca90 0x7f708c0b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54472/0 (socket says 172.21.15.62:54472) 2021-12-17T18:26:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70920b4700 1 -- 172.21.15.62:0/419467910 learned_addr learned my addr 172.21.15.62:0/419467910 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70928b5700 1 --2- 172.21.15.62:0/419467910 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f708c0b4230 0x7f708c0b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70918b3700 1 --2- 172.21.15.62:0/419467910 >> v2:172.21.15.109:3300/0 conn(0x7f708c0b3540 0x7f708c0b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70920b4700 1 -- 172.21.15.62:0/419467910 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f708c0b4230 msgr2=0x7f708c0b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70920b4700 1 --2- 172.21.15.62:0/419467910 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f708c0b4230 0x7f708c0b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70920b4700 1 -- 172.21.15.62:0/419467910 >> v2:172.21.15.109:3300/0 conn(0x7f708c0b3540 msgr2=0x7f708c0b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70920b4700 1 --2- 172.21.15.62:0/419467910 >> v2:172.21.15.109:3300/0 conn(0x7f708c0b3540 0x7f708c0b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70920b4700 1 -- 172.21.15.62:0/419467910 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c0b2100 con 0x7f708c05ca90 2021-12-17T18:26:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70920b4700 1 --2- 172.21.15.62:0/419467910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f708c05ca90 0x7f708c0b25a0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f707c002f70 tx=0x7f707c006eb0).ready entity=mon.0 client_cookie=1713d111cfb6fe87 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70910b2700 1 -- 172.21.15.62:0/419467910 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f707c00d570 con 0x7f708c05ca90 2021-12-17T18:26:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70910b2700 1 -- 172.21.15.62:0/419467910 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c000e90 con 0x7f708c05ca90 2021-12-17T18:26:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70910b2700 1 -- 172.21.15.62:0/419467910 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f707c00d900 con 0x7f708c05ca90 2021-12-17T18:26:14.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70930b6700 1 -- 172.21.15.62:0/419467910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f708c05ca90 msgr2=0x7f708c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70930b6700 1 --2- 172.21.15.62:0/419467910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f708c05ca90 0x7f708c0b25a0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f707c002f70 tx=0x7f707c006eb0).stop 2021-12-17T18:26:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70930b6700 1 -- 172.21.15.62:0/419467910 shutdown_connections 2021-12-17T18:26:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70930b6700 1 --2- 172.21.15.62:0/419467910 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f708c0b4230 0x7f708c0b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70930b6700 1 --2- 172.21.15.62:0/419467910 >> v2:172.21.15.109:3300/0 conn(0x7f708c0b3540 0x7f708c0b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70930b6700 1 --2- 172.21.15.62:0/419467910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f708c05ca90 0x7f708c0b25a0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70930b6700 1 -- 172.21.15.62:0/419467910 >> 172.21.15.62:0/419467910 conn(0x7f708c05bcd0 msgr2=0x7f708c062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70930b6700 1 -- 172.21.15.62:0/419467910 shutdown_connections 2021-12-17T18:26:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.339+0000 7f70930b6700 1 -- 172.21.15.62:0/419467910 wait complete. 2021-12-17T18:26:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70930b6700 1 Processor -- start 2021-12-17T18:26:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70930b6700 1 -- start start 2021-12-17T18:26:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70930b6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f708c05ca90 0x7f708c1490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70930b6700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f708c0b3540 0x7f708c0af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70930b6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f708c0b4230 0x7f708c0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70930b6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c0a2de0 con 0x7f708c05ca90 2021-12-17T18:26:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70930b6700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c147770 con 0x7f708c0b3540 2021-12-17T18:26:14.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70930b6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708c0a3010 con 0x7f708c0b4230 2021-12-17T18:26:14.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70920b4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f708c05ca90 0x7f708c1490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70920b4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f708c05ca90 0x7f708c1490c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54478/0 (socket says 172.21.15.62:54478) 2021-12-17T18:26:14.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70920b4700 1 -- 172.21.15.62:0/1042773621 learned_addr learned my addr 172.21.15.62:0/1042773621 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:14.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70918b3700 1 --2- 172.21.15.62:0/1042773621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f708c0b3540 0x7f708c0af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70928b5700 1 --2- 172.21.15.62:0/1042773621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f708c0b4230 0x7f708c0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70920b4700 1 -- 172.21.15.62:0/1042773621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f708c0b4230 msgr2=0x7f708c0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70920b4700 1 --2- 172.21.15.62:0/1042773621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f708c0b4230 0x7f708c0afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70920b4700 1 -- 172.21.15.62:0/1042773621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f708c0b3540 msgr2=0x7f708c0af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70920b4700 1 --2- 172.21.15.62:0/1042773621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f708c0b3540 0x7f708c0af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70920b4700 1 -- 172.21.15.62:0/1042773621 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c00b1e0 con 0x7f708c05ca90 2021-12-17T18:26:14.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70918b3700 1 --2- 172.21.15.62:0/1042773621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f708c0b3540 0x7f708c0af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:14.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70928b5700 1 --2- 172.21.15.62:0/1042773621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f708c0b4230 0x7f708c0afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f70920b4700 1 --2- 172.21.15.62:0/1042773621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f708c05ca90 0x7f708c1490c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f707c002f70 tx=0x7f707c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f707b7fe700 1 -- 172.21.15.62:0/1042773621 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f707c011760 con 0x7f708c05ca90 2021-12-17T18:26:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f707b7fe700 1 -- 172.21.15.62:0/1042773621 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c0118c0 con 0x7f708c05ca90 2021-12-17T18:26:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.343+0000 7f707b7fe700 1 -- 172.21.15.62:0/1042773621 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f707c011c20 con 0x7f708c05ca90 2021-12-17T18:26:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.347+0000 7f70930b6700 1 -- 172.21.15.62:0/1042773621 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f708c0aff60 con 0x7f708c05ca90 2021-12-17T18:26:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.347+0000 7f70930b6700 1 -- 172.21.15.62:0/1042773621 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708c066cd0 con 0x7f708c05ca90 2021-12-17T18:26:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.347+0000 7f70930b6700 1 -- 172.21.15.62:0/1042773621 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708c0603f0 con 0x7f708c05ca90 2021-12-17T18:26:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.347+0000 7f707b7fe700 1 -- 172.21.15.62:0/1042773621 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f707c01a040 con 0x7f708c05ca90 2021-12-17T18:26:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.347+0000 7f707b7fe700 1 --2- 172.21.15.62:0/1042773621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f706c053640 0x7f706c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.347+0000 7f707b7fe700 1 -- 172.21.15.62:0/1042773621 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f707c06c5a0 con 0x7f708c05ca90 2021-12-17T18:26:14.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.347+0000 7f70918b3700 1 --2- 172.21.15.62:0/1042773621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f706c053640 0x7f706c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.347+0000 7f70918b3700 1 --2- 172.21.15.62:0/1042773621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f706c053640 0x7f706c055b00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f7088006000 tx=0x7f7088006d90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:14.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.351+0000 7f707b7fe700 1 -- 172.21.15.62:0/1042773621 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f707c0437c0 con 0x7f708c05ca90 2021-12-17T18:26:14.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.475+0000 7f70930b6700 1 -- 172.21.15.62:0/1042773621 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f708c0573d0 con 0x7f708c05ca90 2021-12-17T18:26:14.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.475+0000 7f707b7fe700 1 -- 172.21.15.62:0/1042773621 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v102) v1 ==== 92+0+10 (secure 0 0 0) 0x7f707c0230a0 con 0x7f708c05ca90 2021-12-17T18:26:14.483 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:26:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.479+0000 7f70930b6700 1 -- 172.21.15.62:0/1042773621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f706c053640 msgr2=0x7f706c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.479+0000 7f70930b6700 1 --2- 172.21.15.62:0/1042773621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f706c053640 0x7f706c055b00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f7088006000 tx=0x7f7088006d90).stop 2021-12-17T18:26:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.479+0000 7f70930b6700 1 -- 172.21.15.62:0/1042773621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f708c05ca90 msgr2=0x7f708c1490c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.479+0000 7f70930b6700 1 --2- 172.21.15.62:0/1042773621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f708c05ca90 0x7f708c1490c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f707c002f70 tx=0x7f707c015000).stop 2021-12-17T18:26:14.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.479+0000 7f70930b6700 1 -- 172.21.15.62:0/1042773621 shutdown_connections 2021-12-17T18:26:14.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.479+0000 7f70930b6700 1 --2- 172.21.15.62:0/1042773621 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f706c053640 0x7f706c055b00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.479+0000 7f70930b6700 1 --2- 172.21.15.62:0/1042773621 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f708c0b4230 0x7f708c0afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.479+0000 7f70930b6700 1 --2- 172.21.15.62:0/1042773621 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f708c0b3540 0x7f708c0af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.479+0000 7f70930b6700 1 --2- 172.21.15.62:0/1042773621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f708c05ca90 0x7f708c1490c0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.479+0000 7f70930b6700 1 -- 172.21.15.62:0/1042773621 >> 172.21.15.62:0/1042773621 conn(0x7f708c05bcd0 msgr2=0x7f708c062350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.479+0000 7f70930b6700 1 -- 172.21.15.62:0/1042773621 shutdown_connections 2021-12-17T18:26:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.479+0000 7f70930b6700 1 -- 172.21.15.62:0/1042773621 wait complete. 2021-12-17T18:26:14.496 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:26:14.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.595+0000 7f69c33c6700 1 Processor -- start 2021-12-17T18:26:14.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.595+0000 7f69c33c6700 1 -- start start 2021-12-17T18:26:14.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.595+0000 7f69c33c6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69bc05ca90 0x7f69bc0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.595+0000 7f69c33c6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f69bc0b47c0 0x7f69bc0b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c33c6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69bc0b0870 con 0x7f69bc0b5be0 2021-12-17T18:26:14.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c33c6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69bc05ce70 con 0x7f69bc0b47c0 2021-12-17T18:26:14.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c33c6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc0b05d0 con 0x7f69bc05ca90 2021-12-17T18:26:14.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c1bc3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f69bc0b47c0 0x7f69bc0b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c2bc5700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f69bc0b5be0 0x7f69bc143ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38070/0 (socket says 172.21.15.62:38070) 2021-12-17T18:26:14.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c2bc5700 1 -- 172.21.15.62:0/4145410711 learned_addr learned my addr 172.21.15.62:0/4145410711 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:14.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c23c4700 1 --2- 172.21.15.62:0/4145410711 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69bc05ca90 0x7f69bc0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c1bc3700 1 -- 172.21.15.62:0/4145410711 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69bc05ca90 msgr2=0x7f69bc0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:14.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c1bc3700 1 --2- 172.21.15.62:0/4145410711 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69bc05ca90 0x7f69bc0b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c1bc3700 1 -- 172.21.15.62:0/4145410711 >> v1:172.21.15.62:6789/0 conn(0x7f69bc0b5be0 legacy=0x7f69bc143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c1bc3700 1 -- 172.21.15.62:0/4145410711 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc0b5250 con 0x7f69bc0b47c0 2021-12-17T18:26:14.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c13c2700 1 -- 172.21.15.62:0/4145410711 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112613584 0 0) 0x7f69bc0b0870 con 0x7f69bc0b5be0 2021-12-17T18:26:14.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c23c4700 1 --2- 172.21.15.62:0/4145410711 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69bc05ca90 0x7f69bc0b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:14.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c1bc3700 1 --2- 172.21.15.62:0/4145410711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69bc0b47c0 0x7f69bc0b56f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f69b0002f70 tx=0x7f69b0006df0).ready entity=mon.0 client_cookie=9f58068a1acd3287 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:14.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c13c2700 1 -- 172.21.15.62:0/4145410711 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69b000d570 con 0x7f69bc0b47c0 2021-12-17T18:26:14.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c13c2700 1 -- 172.21.15.62:0/4145410711 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b0000e90 con 0x7f69bc0b47c0 2021-12-17T18:26:14.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c13c2700 1 -- 172.21.15.62:0/4145410711 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69b000d8c0 con 0x7f69bc0b47c0 2021-12-17T18:26:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c33c6700 1 -- 172.21.15.62:0/4145410711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69bc0b47c0 msgr2=0x7f69bc0b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c33c6700 1 --2- 172.21.15.62:0/4145410711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69bc0b47c0 0x7f69bc0b56f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f69b0002f70 tx=0x7f69b0006df0).stop 2021-12-17T18:26:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c33c6700 1 -- 172.21.15.62:0/4145410711 shutdown_connections 2021-12-17T18:26:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c33c6700 1 --2- 172.21.15.62:0/4145410711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69bc0b47c0 0x7f69bc0b56f0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c33c6700 1 --2- 172.21.15.62:0/4145410711 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69bc05ca90 0x7f69bc0b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c33c6700 1 -- 172.21.15.62:0/4145410711 >> 172.21.15.62:0/4145410711 conn(0x7f69bc05bcd0 msgr2=0x7f69bc062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:14.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c33c6700 1 -- 172.21.15.62:0/4145410711 shutdown_connections 2021-12-17T18:26:14.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c33c6700 1 -- 172.21.15.62:0/4145410711 wait complete. 2021-12-17T18:26:14.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.599+0000 7f69c33c6700 1 Processor -- start 2021-12-17T18:26:14.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c33c6700 1 -- start start 2021-12-17T18:26:14.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c33c6700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f69bc05ca90 0x7f69bc0b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c33c6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69bc0b47c0 0x7f69bc152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c33c6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69bc0b5be0 0x7f69bc152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c33c6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc1473b0 con 0x7f69bc0b5be0 2021-12-17T18:26:14.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c33c6700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc145850 con 0x7f69bc05ca90 2021-12-17T18:26:14.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c33c6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc0647c0 con 0x7f69bc0b47c0 2021-12-17T18:26:14.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c2bc5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69bc0b5be0 0x7f69bc152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c2bc5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69bc0b5be0 0x7f69bc152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54496/0 (socket says 172.21.15.62:54496) 2021-12-17T18:26:14.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c2bc5700 1 -- 172.21.15.62:0/1918723989 learned_addr learned my addr 172.21.15.62:0/1918723989 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:14.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c23c4700 1 --2- 172.21.15.62:0/1918723989 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f69bc05ca90 0x7f69bc0b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c1bc3700 1 --2- 172.21.15.62:0/1918723989 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69bc0b47c0 0x7f69bc152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c2bc5700 1 -- 172.21.15.62:0/1918723989 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69bc0b47c0 msgr2=0x7f69bc152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c2bc5700 1 --2- 172.21.15.62:0/1918723989 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69bc0b47c0 0x7f69bc152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c2bc5700 1 -- 172.21.15.62:0/1918723989 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f69bc05ca90 msgr2=0x7f69bc0b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c2bc5700 1 --2- 172.21.15.62:0/1918723989 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f69bc05ca90 0x7f69bc0b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c2bc5700 1 -- 172.21.15.62:0/1918723989 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b000b180 con 0x7f69bc0b5be0 2021-12-17T18:26:14.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c2bc5700 1 --2- 172.21.15.62:0/1918723989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69bc0b5be0 0x7f69bc152920 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f69b4001250 tx=0x7f69b4001380).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:14.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69af7fe700 1 -- 172.21.15.62:0/1918723989 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69b4005b60 con 0x7f69bc0b5be0 2021-12-17T18:26:14.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69af7fe700 1 -- 172.21.15.62:0/1918723989 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b4005cc0 con 0x7f69bc0b5be0 2021-12-17T18:26:14.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69af7fe700 1 -- 172.21.15.62:0/1918723989 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69b4004a90 con 0x7f69bc0b5be0 2021-12-17T18:26:14.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c33c6700 1 -- 172.21.15.62:0/1918723989 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69bc064a60 con 0x7f69bc0b5be0 2021-12-17T18:26:14.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.603+0000 7f69c33c6700 1 -- 172.21.15.62:0/1918723989 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69bc144b90 con 0x7f69bc0b5be0 2021-12-17T18:26:14.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.607+0000 7f69c33c6700 1 -- 172.21.15.62:0/1918723989 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69bc1448f0 con 0x7f69bc0b5be0 2021-12-17T18:26:14.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.607+0000 7f69af7fe700 1 -- 172.21.15.62:0/1918723989 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f69b4004bf0 con 0x7f69bc0b5be0 2021-12-17T18:26:14.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.607+0000 7f69af7fe700 1 --2- 172.21.15.62:0/1918723989 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f699c0536a0 0x7f699c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.607+0000 7f69af7fe700 1 -- 172.21.15.62:0/1918723989 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f69b406b5e0 con 0x7f69bc0b5be0 2021-12-17T18:26:14.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.607+0000 7f69c23c4700 1 --2- 172.21.15.62:0/1918723989 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f699c0536a0 0x7f699c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.607+0000 7f69c23c4700 1 --2- 172.21.15.62:0/1918723989 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f699c0536a0 0x7f699c055b60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f69b800c000 tx=0x7f69b8008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:14.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.611+0000 7f69af7fe700 1 -- 172.21.15.62:0/1918723989 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f69bc1448f0 con 0x7f69bc0b5be0 2021-12-17T18:26:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.739+0000 7f69c33c6700 1 -- 172.21.15.62:0/1918723989 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f69bc1448f0 con 0x7f69bc0b5be0 2021-12-17T18:26:14.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.739+0000 7f69af7fe700 1 -- 172.21.15.62:0/1918723989 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+10 (secure 0 0 0) 0x7f69bc1448f0 con 0x7f69bc0b5be0 2021-12-17T18:26:14.746 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:26:14.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.739+0000 7f69c33c6700 1 -- 172.21.15.62:0/1918723989 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f699c0536a0 msgr2=0x7f699c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.739+0000 7f69c33c6700 1 --2- 172.21.15.62:0/1918723989 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f699c0536a0 0x7f699c055b60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f69b800c000 tx=0x7f69b8008040).stop 2021-12-17T18:26:14.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.739+0000 7f69c33c6700 1 -- 172.21.15.62:0/1918723989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69bc0b5be0 msgr2=0x7f69bc152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.739+0000 7f69c33c6700 1 --2- 172.21.15.62:0/1918723989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69bc0b5be0 0x7f69bc152920 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f69b4001250 tx=0x7f69b4001380).stop 2021-12-17T18:26:14.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.743+0000 7f69c33c6700 1 -- 172.21.15.62:0/1918723989 shutdown_connections 2021-12-17T18:26:14.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.743+0000 7f69c33c6700 1 --2- 172.21.15.62:0/1918723989 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f699c0536a0 0x7f699c055b60 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.743+0000 7f69c33c6700 1 --2- 172.21.15.62:0/1918723989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69bc0b5be0 0x7f69bc152920 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.743+0000 7f69c33c6700 1 --2- 172.21.15.62:0/1918723989 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f69bc0b47c0 0x7f69bc152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.743+0000 7f69c33c6700 1 --2- 172.21.15.62:0/1918723989 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f69bc05ca90 0x7f69bc0b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.743+0000 7f69c33c6700 1 -- 172.21.15.62:0/1918723989 >> 172.21.15.62:0/1918723989 conn(0x7f69bc05bcd0 msgr2=0x7f69bc0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:14.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.743+0000 7f69c33c6700 1 -- 172.21.15.62:0/1918723989 shutdown_connections 2021-12-17T18:26:14.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.743+0000 7f69c33c6700 1 -- 172.21.15.62:0/1918723989 wait complete. 2021-12-17T18:26:14.759 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:26:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.859+0000 7f660ec41700 1 Processor -- start 2021-12-17T18:26:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.859+0000 7f660ec41700 1 -- start start 2021-12-17T18:26:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660ec41700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f66080b2540 0x7f66080b2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660ec41700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66080b04b0 0x7f6608146d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660ec41700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66080b2320 con 0x7f660805bcd0 2021-12-17T18:26:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660ec41700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66080ad410 con 0x7f66080b04b0 2021-12-17T18:26:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660ec41700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66081437f0 con 0x7f66080b2540 2021-12-17T18:26:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660e440700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66080b04b0 0x7f6608146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660e440700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66080b04b0 0x7f6608146d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54504/0 (socket says 172.21.15.62:54504) 2021-12-17T18:26:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660e440700 1 -- 172.21.15.62:0/2938674598 learned_addr learned my addr 172.21.15.62:0/2938674598 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660dc3f700 1 --2- 172.21.15.62:0/2938674598 >> v2:172.21.15.109:3300/0 conn(0x7f66080b2540 0x7f66080b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660e440700 1 -- 172.21.15.62:0/2938674598 >> v2:172.21.15.109:3300/0 conn(0x7f66080b2540 msgr2=0x7f66080b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660e440700 1 --2- 172.21.15.62:0/2938674598 >> v2:172.21.15.109:3300/0 conn(0x7f66080b2540 0x7f66080b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660e440700 1 -- 172.21.15.62:0/2938674598 >> v1:172.21.15.109:6789/0 conn(0x7f660805bcd0 legacy=0x7f66081430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660e440700 1 -- 172.21.15.62:0/2938674598 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66080b11a0 con 0x7f66080b04b0 2021-12-17T18:26:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660e440700 1 --2- 172.21.15.62:0/2938674598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66080b04b0 0x7f6608146d20 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f66000032f0 tx=0x7f6600009290).ready entity=mon.0 client_cookie=f508470410bf60a2 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:14.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660cc3d700 1 -- 172.21.15.62:0/2938674598 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f660000b870 con 0x7f66080b04b0 2021-12-17T18:26:14.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660cc3d700 1 -- 172.21.15.62:0/2938674598 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660000b9d0 con 0x7f66080b04b0 2021-12-17T18:26:14.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660cc3d700 1 -- 172.21.15.62:0/2938674598 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f660000bb40 con 0x7f66080b04b0 2021-12-17T18:26:14.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660ec41700 1 -- 172.21.15.62:0/2938674598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66080b04b0 msgr2=0x7f6608146d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660ec41700 1 --2- 172.21.15.62:0/2938674598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66080b04b0 0x7f6608146d20 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f66000032f0 tx=0x7f6600009290).stop 2021-12-17T18:26:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660ec41700 1 -- 172.21.15.62:0/2938674598 shutdown_connections 2021-12-17T18:26:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660ec41700 1 --2- 172.21.15.62:0/2938674598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66080b04b0 0x7f6608146d20 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660ec41700 1 --2- 172.21.15.62:0/2938674598 >> v2:172.21.15.109:3300/0 conn(0x7f66080b2540 0x7f66080b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660ec41700 1 -- 172.21.15.62:0/2938674598 >> 172.21.15.62:0/2938674598 conn(0x7f660805c750 msgr2=0x7f660805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660ec41700 1 -- 172.21.15.62:0/2938674598 shutdown_connections 2021-12-17T18:26:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.863+0000 7f660ec41700 1 -- 172.21.15.62:0/2938674598 wait complete. 2021-12-17T18:26:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660ec41700 1 Processor -- start 2021-12-17T18:26:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660ec41700 1 -- start start 2021-12-17T18:26:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660ec41700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f660805bcd0 0x7f6608141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660ec41700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66080b04b0 0x7f660813e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660ec41700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66080b2540 0x7f660813eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660ec41700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6608063de0 con 0x7f66080b04b0 2021-12-17T18:26:14.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660ec41700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66080b3ff0 con 0x7f660805bcd0 2021-12-17T18:26:14.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660ec41700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66080b3cc0 con 0x7f66080b2540 2021-12-17T18:26:14.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660d43e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66080b04b0 0x7f660813e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660dc3f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f660805bcd0 0x7f6608141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660d43e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66080b04b0 0x7f660813e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54508/0 (socket says 172.21.15.62:54508) 2021-12-17T18:26:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660d43e700 1 -- 172.21.15.62:0/817946213 learned_addr learned my addr 172.21.15.62:0/817946213 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660e440700 1 --2- 172.21.15.62:0/817946213 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66080b2540 0x7f660813eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660d43e700 1 -- 172.21.15.62:0/817946213 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66080b2540 msgr2=0x7f660813eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660d43e700 1 --2- 172.21.15.62:0/817946213 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66080b2540 0x7f660813eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660d43e700 1 -- 172.21.15.62:0/817946213 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f660805bcd0 msgr2=0x7f6608141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660d43e700 1 --2- 172.21.15.62:0/817946213 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f660805bcd0 0x7f6608141940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660d43e700 1 -- 172.21.15.62:0/817946213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6600009530 con 0x7f66080b04b0 2021-12-17T18:26:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660d43e700 1 --2- 172.21.15.62:0/817946213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66080b04b0 0x7f660813e690 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f66080b4130 tx=0x7f65fc007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:14.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f65faffd700 1 -- 172.21.15.62:0/817946213 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65fc007030 con 0x7f66080b04b0 2021-12-17T18:26:14.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f65faffd700 1 -- 172.21.15.62:0/817946213 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65fc007190 con 0x7f66080b04b0 2021-12-17T18:26:14.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660ec41700 1 -- 172.21.15.62:0/817946213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660813f070 con 0x7f66080b04b0 2021-12-17T18:26:14.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f65faffd700 1 -- 172.21.15.62:0/817946213 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65fc006510 con 0x7f66080b04b0 2021-12-17T18:26:14.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660ec41700 1 -- 172.21.15.62:0/817946213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66080b3940 con 0x7f66080b04b0 2021-12-17T18:26:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.867+0000 7f660ec41700 1 -- 172.21.15.62:0/817946213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6608146880 con 0x7f66080b04b0 2021-12-17T18:26:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.871+0000 7f65faffd700 1 -- 172.21.15.62:0/817946213 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f65fc010030 con 0x7f66080b04b0 2021-12-17T18:26:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.871+0000 7f65faffd700 1 --2- 172.21.15.62:0/817946213 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f65e8053640 0x7f65e8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.871+0000 7f65faffd700 1 -- 172.21.15.62:0/817946213 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f65fc06b3b0 con 0x7f66080b04b0 2021-12-17T18:26:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.871+0000 7f660dc3f700 1 --2- 172.21.15.62:0/817946213 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f65e8053640 0x7f65e8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.871+0000 7f660dc3f700 1 --2- 172.21.15.62:0/817946213 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f65e8053640 0x7f65e8055b00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f660400c000 tx=0x7f6604008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.875+0000 7f65faffd700 1 -- 172.21.15.62:0/817946213 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f65fc042470 con 0x7f66080b04b0 2021-12-17T18:26:15.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.999+0000 7f660ec41700 1 -- 172.21.15.62:0/817946213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f66080b4520 con 0x7f66080b04b0 2021-12-17T18:26:15.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:14.999+0000 7f65faffd700 1 -- 172.21.15.62:0/817946213 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+10 (secure 0 0 0) 0x7f65fc045a90 con 0x7f66080b04b0 2021-12-17T18:26:15.007 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:26:15.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.003+0000 7f660ec41700 1 -- 172.21.15.62:0/817946213 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f65e8053640 msgr2=0x7f65e8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:15.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.003+0000 7f660ec41700 1 --2- 172.21.15.62:0/817946213 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f65e8053640 0x7f65e8055b00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f660400c000 tx=0x7f6604008040).stop 2021-12-17T18:26:15.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.003+0000 7f660ec41700 1 -- 172.21.15.62:0/817946213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66080b04b0 msgr2=0x7f660813e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:15.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.003+0000 7f660ec41700 1 --2- 172.21.15.62:0/817946213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66080b04b0 0x7f660813e690 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f66080b4130 tx=0x7f65fc007c10).stop 2021-12-17T18:26:15.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.003+0000 7f660ec41700 1 -- 172.21.15.62:0/817946213 shutdown_connections 2021-12-17T18:26:15.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.003+0000 7f660ec41700 1 --2- 172.21.15.62:0/817946213 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f65e8053640 0x7f65e8055b00 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:15.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.003+0000 7f660ec41700 1 --2- 172.21.15.62:0/817946213 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66080b2540 0x7f660813eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:15.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.003+0000 7f660ec41700 1 --2- 172.21.15.62:0/817946213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66080b04b0 0x7f660813e690 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:15.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.003+0000 7f660ec41700 1 --2- 172.21.15.62:0/817946213 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f660805bcd0 0x7f6608141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:15.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.003+0000 7f660ec41700 1 -- 172.21.15.62:0/817946213 >> 172.21.15.62:0/817946213 conn(0x7f660805c750 msgr2=0x7f66081430e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:15.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.003+0000 7f660ec41700 1 -- 172.21.15.62:0/817946213 shutdown_connections 2021-12-17T18:26:15.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.003+0000 7f660ec41700 1 -- 172.21.15.62:0/817946213 wait complete. 2021-12-17T18:26:15.020 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:26:15.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:26:15.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.115+0000 7fd697589700 1 Processor -- start 2021-12-17T18:26:15.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.115+0000 7fd697589700 1 -- start start 2021-12-17T18:26:15.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd697589700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd6900b5b20 0x7fd6900b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:15.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd697589700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6901458d0 0x7fd690145d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd697589700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6900b5f00 con 0x7fd6900b3760 2021-12-17T18:26:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd697589700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6900b3020 con 0x7fd6900b5b20 2021-12-17T18:26:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd697589700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6900b32c0 con 0x7fd6901458d0 2021-12-17T18:26:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd696587700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd6900b5b20 0x7fd6900b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:15.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd695d86700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd6900b3760 0x7fd6900b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38096/0 (socket says 172.21.15.62:38096) 2021-12-17T18:26:15.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd695d86700 1 -- 172.21.15.62:0/3656815240 learned_addr learned my addr 172.21.15.62:0/3656815240 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:15.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd696d88700 1 --2- 172.21.15.62:0/3656815240 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6901458d0 0x7fd690145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd695585700 1 -- 172.21.15.62:0/3656815240 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961623755 0 0) 0x7fd6900b5f00 con 0x7fd6900b3760 2021-12-17T18:26:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd695585700 1 -- 172.21.15.62:0/3656815240 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd678003260 con 0x7fd6900b3760 2021-12-17T18:26:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd696587700 1 -- 172.21.15.62:0/3656815240 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6901458d0 msgr2=0x7fd690145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd696587700 1 --2- 172.21.15.62:0/3656815240 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6901458d0 0x7fd690145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd696587700 1 -- 172.21.15.62:0/3656815240 >> v1:172.21.15.62:6789/0 conn(0x7fd6900b3760 legacy=0x7fd6900b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd696587700 1 -- 172.21.15.62:0/3656815240 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6900b6e90 con 0x7fd6900b5b20 2021-12-17T18:26:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd696587700 1 --2- 172.21.15.62:0/3656815240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6900b5b20 0x7fd6900b6290 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7fd680002f70 tx=0x7fd680006df0).ready entity=mon.0 client_cookie=8f910e45ba3e0f65 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd695585700 1 -- 172.21.15.62:0/3656815240 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd68000d4a0 con 0x7fd6900b5b20 2021-12-17T18:26:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd695585700 1 -- 172.21.15.62:0/3656815240 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd680000e90 con 0x7fd6900b5b20 2021-12-17T18:26:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd695585700 1 -- 172.21.15.62:0/3656815240 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd68000d7f0 con 0x7fd6900b5b20 2021-12-17T18:26:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd697589700 1 -- 172.21.15.62:0/3656815240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6900b5b20 msgr2=0x7fd6900b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd697589700 1 --2- 172.21.15.62:0/3656815240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6900b5b20 0x7fd6900b6290 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7fd680002f70 tx=0x7fd680006df0).stop 2021-12-17T18:26:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd697589700 1 -- 172.21.15.62:0/3656815240 shutdown_connections 2021-12-17T18:26:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd697589700 1 --2- 172.21.15.62:0/3656815240 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6901458d0 0x7fd690145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd697589700 1 --2- 172.21.15.62:0/3656815240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6900b5b20 0x7fd6900b6290 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.119+0000 7fd697589700 1 -- 172.21.15.62:0/3656815240 >> 172.21.15.62:0/3656815240 conn(0x7fd69005c750 msgr2=0x7fd69005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:15.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.123+0000 7fd697589700 1 -- 172.21.15.62:0/3656815240 shutdown_connections 2021-12-17T18:26:15.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.123+0000 7fd697589700 1 -- 172.21.15.62:0/3656815240 wait complete. 2021-12-17T18:26:15.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.123+0000 7fd697589700 1 Processor -- start 2021-12-17T18:26:15.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.123+0000 7fd697589700 1 -- start start 2021-12-17T18:26:15.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.123+0000 7fd697589700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6900b5b20 0x7fd690066820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:15.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.123+0000 7fd697589700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6901458d0 0x7fd6900b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:15.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.123+0000 7fd697589700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6900b9240 0x7fd6901406a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:15.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.123+0000 7fd697589700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6900644d0 con 0x7fd6901458d0 2021-12-17T18:26:15.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.123+0000 7fd697589700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd690064770 con 0x7fd6900b5b20 2021-12-17T18:26:15.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.123+0000 7fd697589700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd690064a10 con 0x7fd6900b9240 2021-12-17T18:26:15.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.123+0000 7fd695d86700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6901458d0 0x7fd6900b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:15.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.123+0000 7fd695d86700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6901458d0 0x7fd6900b8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54522/0 (socket says 172.21.15.62:54522) 2021-12-17T18:26:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.123+0000 7fd695d86700 1 -- 172.21.15.62:0/2778474313 learned_addr learned my addr 172.21.15.62:0/2778474313 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.123+0000 7fd696d88700 1 --2- 172.21.15.62:0/2778474313 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6900b9240 0x7fd6901406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.123+0000 7fd696587700 1 --2- 172.21.15.62:0/2778474313 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6900b5b20 0x7fd690066820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.127+0000 7fd695d86700 1 -- 172.21.15.62:0/2778474313 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6900b9240 msgr2=0x7fd6901406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.127+0000 7fd695d86700 1 --2- 172.21.15.62:0/2778474313 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6900b9240 0x7fd6901406a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.127+0000 7fd695d86700 1 -- 172.21.15.62:0/2778474313 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6900b5b20 msgr2=0x7fd690066820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.127+0000 7fd695d86700 1 --2- 172.21.15.62:0/2778474313 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6900b5b20 0x7fd690066820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:15.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.127+0000 7fd695d86700 1 -- 172.21.15.62:0/2778474313 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68000b180 con 0x7fd6901458d0 2021-12-17T18:26:15.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.127+0000 7fd695d86700 1 --2- 172.21.15.62:0/2778474313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6901458d0 0x7fd6900b8d50 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7fd68c001490 tx=0x7fd68c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:15.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.127+0000 7fd67f7fe700 1 -- 172.21.15.62:0/2778474313 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd68c005c70 con 0x7fd6901458d0 2021-12-17T18:26:15.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.127+0000 7fd67f7fe700 1 -- 172.21.15.62:0/2778474313 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c005dd0 con 0x7fd6901458d0 2021-12-17T18:26:15.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.127+0000 7fd697589700 1 -- 172.21.15.62:0/2778474313 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd690065570 con 0x7fd6901458d0 2021-12-17T18:26:15.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.127+0000 7fd67f7fe700 1 -- 172.21.15.62:0/2778474313 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd68c0072c0 con 0x7fd6901458d0 2021-12-17T18:26:15.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.127+0000 7fd697589700 1 -- 172.21.15.62:0/2778474313 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6900657c0 con 0x7fd6901458d0 2021-12-17T18:26:15.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.127+0000 7fd697589700 1 -- 172.21.15.62:0/2778474313 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6900573d0 con 0x7fd6901458d0 2021-12-17T18:26:15.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.127+0000 7fd67f7fe700 1 -- 172.21.15.62:0/2778474313 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd68c010070 con 0x7fd6901458d0 2021-12-17T18:26:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.127+0000 7fd67f7fe700 1 --2- 172.21.15.62:0/2778474313 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd670053580 0x7fd670055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.127+0000 7fd67f7fe700 1 -- 172.21.15.62:0/2778474313 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd68c06b470 con 0x7fd6901458d0 2021-12-17T18:26:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.127+0000 7fd696587700 1 --2- 172.21.15.62:0/2778474313 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd670053580 0x7fd670055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:15.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.131+0000 7fd696587700 1 --2- 172.21.15.62:0/2778474313 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd670053580 0x7fd670055a40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fd68001a000 tx=0x7fd680014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:15.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.135+0000 7fd67f7fe700 1 -- 172.21.15.62:0/2778474313 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd68c0424c0 con 0x7fd6901458d0 2021-12-17T18:26:15.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.303+0000 7fd697589700 1 -- 172.21.15.62:0/2778474313 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd690068f30 con 0x7fd6901458d0 2021-12-17T18:26:15.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.303+0000 7fd67f7fe700 1 -- 172.21.15.62:0/2778474313 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fd68c045ae0 con 0x7fd6901458d0 2021-12-17T18:26:15.311 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:15.312 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":49,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/965882605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":965882605},{"type":"v1","addr":"172.21.15.109:6835","nonce":965882605}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:26:10.256074+0000","modified":"2021-12-17T18:26:11.259115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1972867454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1972867454},{"type":"v1","addr":"172.21.15.62:6833","nonce":1972867454}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-12-17T18:26:15.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.307+0000 7fd697589700 1 -- 172.21.15.62:0/2778474313 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd670053580 msgr2=0x7fd670055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:15.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.307+0000 7fd697589700 1 --2- 172.21.15.62:0/2778474313 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd670053580 0x7fd670055a40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fd68001a000 tx=0x7fd680014000).stop 2021-12-17T18:26:15.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.307+0000 7fd697589700 1 -- 172.21.15.62:0/2778474313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6901458d0 msgr2=0x7fd6900b8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:15.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.307+0000 7fd697589700 1 --2- 172.21.15.62:0/2778474313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6901458d0 0x7fd6900b8d50 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7fd68c001490 tx=0x7fd68c007de0).stop 2021-12-17T18:26:15.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.307+0000 7fd697589700 1 -- 172.21.15.62:0/2778474313 shutdown_connections 2021-12-17T18:26:15.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.307+0000 7fd697589700 1 --2- 172.21.15.62:0/2778474313 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd670053580 0x7fd670055a40 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:15.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.307+0000 7fd697589700 1 --2- 172.21.15.62:0/2778474313 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd6900b9240 0x7fd6901406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:15.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.307+0000 7fd697589700 1 --2- 172.21.15.62:0/2778474313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6901458d0 0x7fd6900b8d50 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:15.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.307+0000 7fd697589700 1 --2- 172.21.15.62:0/2778474313 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd6900b5b20 0x7fd690066820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:15.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.307+0000 7fd697589700 1 -- 172.21.15.62:0/2778474313 >> 172.21.15.62:0/2778474313 conn(0x7fd69005c750 msgr2=0x7fd6900aec50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:15.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.307+0000 7fd697589700 1 -- 172.21.15.62:0/2778474313 shutdown_connections 2021-12-17T18:26:15.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:15.307+0000 7fd697589700 1 -- 172.21.15.62:0/2778474313 wait complete. 2021-12-17T18:26:15.319 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 49 2021-12-17T18:26:15.531 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:26:10.256074+0000', 'modified': '2021-12-17T18:26:11.259115+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7365': {'gid': 7365, 'name': 'a', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/1972867454', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 1972867454}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 1972867454}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:26:15.532 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:26:15.533 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:26:15.652 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":7365,"want_state":"up:active","state":"up:active","rank_uptime":5.3816993169999998,"mdsmap_epoch":49,"osdmap_epoch":102,"osdmap_epoch_barrier":101,"uptime":10.084500156000001} 2021-12-17T18:26:15.653 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 7365, "mdsmap_epoch": 49, "osdmap_epoch": 102, "osdmap_epoch_barrier": 101, "rank_uptime": 5.381699317, "state": "up:active", "uptime": 10.084500156, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:26:15.654 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:26:15.654 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-12-17T18:26:15.655 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-12-17T18:26:15.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:15.656 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:15.664 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:26:15.725 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:26:15.726 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:26:15.739 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:26:15.740 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:26:15.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:15.742 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:26:15.748 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:26:15.748 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:15.793 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:26:15.811 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:26:15.812 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:26:15.822 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:26:15.823 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:26:15.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:15.824 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:26:15.868 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2021-12-17T18:26:15.863+0000 7f8cfdbef080 -1 init, newargv = 0x5600236b7b50 newargc=9ceph-fuse[14859]: starting ceph client 2021-12-17T18:26:15.869 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr: 2021-12-17T18:26:15.879 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14859]: starting fuse 2021-12-17T18:26:16.931 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:26:16.950 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:26:16.951 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:26:17.007 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:26:17.008 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:26:17.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:17.009 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:26:17.014 INFO:teuthology.orchestra.run.smithi125.stdout:52 2021-12-17T18:26:17.014 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:26:17.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:17.015 DEBUG:teuthology.orchestra.run.smithi125:> sudo python3 -c ' 2021-12-17T18:26:17.016 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2021-12-17T18:26:17.016 DEBUG:teuthology.orchestra.run.smithi125:> import re 2021-12-17T18:26:17.017 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:26:17.017 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2021-12-17T18:26:17.018 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:26:17.018 DEBUG:teuthology.orchestra.run.smithi125:> def find_socket(client_name): 2021-12-17T18:26:17.018 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-12-17T18:26:17.019 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2021-12-17T18:26:17.019 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:26:17.020 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2021-12-17T18:26:17.020 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2021-12-17T18:26:17.020 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2021-12-17T18:26:17.021 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2021-12-17T18:26:17.021 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:26:17.022 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2021-12-17T18:26:17.022 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:26:17.023 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:26:17.023 DEBUG:teuthology.orchestra.run.smithi125:> return f 2021-12-17T18:26:17.023 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:26:17.024 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:26:17.024 DEBUG:teuthology.orchestra.run.smithi125:> print(find_socket("client.0")) 2021-12-17T18:26:17.025 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:26:17.064 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.14859.asok 2021-12-17T18:26:17.069 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14859.asok 2021-12-17T18:26:17.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:17.070 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14859.asok status 2021-12-17T18:26:17.202 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2021-12-17T18:26:17.203 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2021-12-17T18:26:17.203 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:26:17.203 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:26:17.203 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2021-12-17T18:26:17.203 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2021-12-17T18:26:17.204 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-12-17T18:26:17.204 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "14859", 2021-12-17T18:26:17.204 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2021-12-17T18:26:17.204 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:26:17.205 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2021-12-17T18:26:17.205 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2021-12-17T18:26:17.205 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 7384, 2021-12-17T18:26:17.205 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2021-12-17T18:26:17.205 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2021-12-17T18:26:17.206 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2021-12-17T18:26:17.206 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 7384 2021-12-17T18:26:17.206 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:26:17.206 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:26:17.207 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:26:17.207 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:26:17.207 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 1165506167 2021-12-17T18:26:17.207 INFO:teuthology.orchestra.run.smithi125.stdout: } 2021-12-17T18:26:17.207 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:26:17.208 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:26:17.208 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:26:17.208 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:26:17.208 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 1165506167 2021-12-17T18:26:17.209 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:26:17.209 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.7384 172.21.15.125:0/1165506167", 2021-12-17T18:26:17.209 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "172.21.15.125:0/1165506167", 2021-12-17T18:26:17.209 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2021-12-17T18:26:17.209 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 49, 2021-12-17T18:26:17.210 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 102, 2021-12-17T18:26:17.210 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:26:17.210 INFO:teuthology.orchestra.run.smithi125.stdout: "blacklisted": false, 2021-12-17T18:26:17.210 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2021-12-17T18:26:17.211 INFO:teuthology.orchestra.run.smithi125.stdout:} 2021-12-17T18:26:17.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:17.212 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:17.213 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:17.220 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:26:17.221 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:26:17.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:17.222 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:17.281 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:26:17.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.383+0000 7fd258cc8700 1 Processor -- start 2021-12-17T18:26:17.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.383+0000 7fd258cc8700 1 -- start start 2021-12-17T18:26:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.383+0000 7fd258cc8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd254143780 0x7fd254143b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.383+0000 7fd258cc8700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd2540b1260 0x7fd2540b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.383+0000 7fd258cc8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2540ad7f0 con 0x7fd254067120 2021-12-17T18:26:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.383+0000 7fd258cc8700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2540ada90 con 0x7fd254143780 2021-12-17T18:26:17.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.383+0000 7fd258cc8700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2540add30 con 0x7fd2540b1260 2021-12-17T18:26:17.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd25259c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd254143780 0x7fd254143b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:17.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd251d9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd254067120 0x7fd2540675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38108/0 (socket says 172.21.15.62:38108) 2021-12-17T18:26:17.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd251d9b700 1 -- 172.21.15.62:0/1530385554 learned_addr learned my addr 172.21.15.62:0/1530385554 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:17.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd252d9d700 1 --2- 172.21.15.62:0/1530385554 >> v2:172.21.15.109:3300/0 conn(0x7fd2540b1260 0x7fd2540b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:17.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd25259c700 1 -- 172.21.15.62:0/1530385554 >> v2:172.21.15.109:3300/0 conn(0x7fd2540b1260 msgr2=0x7fd2540b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:17.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd25259c700 1 --2- 172.21.15.62:0/1530385554 >> v2:172.21.15.109:3300/0 conn(0x7fd2540b1260 0x7fd2540b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd25259c700 1 -- 172.21.15.62:0/1530385554 >> v1:172.21.15.62:6789/0 conn(0x7fd254067120 legacy=0x7fd2540675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:17.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd25159a700 1 -- 172.21.15.62:0/1530385554 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589719635 0 0) 0x7fd2540ad7f0 con 0x7fd254067120 2021-12-17T18:26:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd25259c700 1 -- 172.21.15.62:0/1530385554 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd254067cb0 con 0x7fd254143780 2021-12-17T18:26:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd25259c700 1 --2- 172.21.15.62:0/1530385554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd254143780 0x7fd254143b60 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7fd244002f70 tx=0x7fd244006df0).ready entity=mon.0 client_cookie=456c36fef16db085 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd25159a700 1 -- 172.21.15.62:0/1530385554 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd24400d570 con 0x7fd254143780 2021-12-17T18:26:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd25159a700 1 -- 172.21.15.62:0/1530385554 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd244000e90 con 0x7fd254143780 2021-12-17T18:26:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd25159a700 1 -- 172.21.15.62:0/1530385554 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd24400d8c0 con 0x7fd254143780 2021-12-17T18:26:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd258cc8700 1 -- 172.21.15.62:0/1530385554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd254143780 msgr2=0x7fd254143b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd258cc8700 1 --2- 172.21.15.62:0/1530385554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd254143780 0x7fd254143b60 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7fd244002f70 tx=0x7fd244006df0).stop 2021-12-17T18:26:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd258cc8700 1 -- 172.21.15.62:0/1530385554 shutdown_connections 2021-12-17T18:26:17.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd258cc8700 1 --2- 172.21.15.62:0/1530385554 >> v2:172.21.15.109:3300/0 conn(0x7fd2540b1260 0x7fd2540b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd258cc8700 1 --2- 172.21.15.62:0/1530385554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd254143780 0x7fd254143b60 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd258cc8700 1 -- 172.21.15.62:0/1530385554 >> 172.21.15.62:0/1530385554 conn(0x7fd25405f730 msgr2=0x7fd25405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:17.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd258cc8700 1 -- 172.21.15.62:0/1530385554 shutdown_connections 2021-12-17T18:26:17.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd258cc8700 1 -- 172.21.15.62:0/1530385554 wait complete. 2021-12-17T18:26:17.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd258cc8700 1 Processor -- start 2021-12-17T18:26:17.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.387+0000 7fd258cc8700 1 -- start start 2021-12-17T18:26:17.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd258cc8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd254067120 0x7fd254066820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:17.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd258cc8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2540b1260 0x7fd254139790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:17.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd258cc8700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd254143780 0x7fd254139c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:17.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd258cc8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2541402e0 con 0x7fd254067120 2021-12-17T18:26:17.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd258cc8700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25413dbe0 con 0x7fd254143780 2021-12-17T18:26:17.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd258cc8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd254140040 con 0x7fd2540b1260 2021-12-17T18:26:17.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd25259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd254067120 0x7fd254066820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:17.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd25259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd254067120 0x7fd254066820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54536/0 (socket says 172.21.15.62:54536) 2021-12-17T18:26:17.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd25259c700 1 -- 172.21.15.62:0/3489064343 learned_addr learned my addr 172.21.15.62:0/3489064343 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:17.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd252d9d700 1 --2- 172.21.15.62:0/3489064343 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd254143780 0x7fd254139c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:17.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd251d9b700 1 --2- 172.21.15.62:0/3489064343 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2540b1260 0x7fd254139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:17.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd25259c700 1 -- 172.21.15.62:0/3489064343 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2540b1260 msgr2=0x7fd254139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:17.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd25259c700 1 --2- 172.21.15.62:0/3489064343 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2540b1260 0x7fd254139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd25259c700 1 -- 172.21.15.62:0/3489064343 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd254143780 msgr2=0x7fd254139c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:17.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd25259c700 1 --2- 172.21.15.62:0/3489064343 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd254143780 0x7fd254139c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd25259c700 1 -- 172.21.15.62:0/3489064343 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24400b180 con 0x7fd254067120 2021-12-17T18:26:17.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd252d9d700 1 --2- 172.21.15.62:0/3489064343 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd254143780 0x7fd254139c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:17.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd25259c700 1 --2- 172.21.15.62:0/3489064343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd254067120 0x7fd254066820 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7fd244002f70 tx=0x7fd244014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:17.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd2437fe700 1 -- 172.21.15.62:0/3489064343 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd244016070 con 0x7fd254067120 2021-12-17T18:26:17.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd2437fe700 1 -- 172.21.15.62:0/3489064343 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd244013a70 con 0x7fd254067120 2021-12-17T18:26:17.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd258cc8700 1 -- 172.21.15.62:0/3489064343 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd254063b80 con 0x7fd254067120 2021-12-17T18:26:17.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd2437fe700 1 -- 172.21.15.62:0/3489064343 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd244013dd0 con 0x7fd254067120 2021-12-17T18:26:17.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.391+0000 7fd258cc8700 1 -- 172.21.15.62:0/3489064343 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25413a170 con 0x7fd254067120 2021-12-17T18:26:17.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.395+0000 7fd2437fe700 1 -- 172.21.15.62:0/3489064343 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd24400f030 con 0x7fd254067120 2021-12-17T18:26:17.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.395+0000 7fd258cc8700 1 -- 172.21.15.62:0/3489064343 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2540573d0 con 0x7fd254067120 2021-12-17T18:26:17.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.395+0000 7fd2437fe700 1 --2- 172.21.15.62:0/3489064343 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd2300534f0 0x7fd2300559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:17.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.395+0000 7fd2437fe700 1 -- 172.21.15.62:0/3489064343 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd24406c540 con 0x7fd254067120 2021-12-17T18:26:17.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.395+0000 7fd251d9b700 1 --2- 172.21.15.62:0/3489064343 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd2300534f0 0x7fd2300559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:17.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.395+0000 7fd251d9b700 1 --2- 172.21.15.62:0/3489064343 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd2300534f0 0x7fd2300559b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fd24800b000 tx=0x7fd248009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:17.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.399+0000 7fd2437fe700 1 -- 172.21.15.62:0/3489064343 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd2440436b0 con 0x7fd254067120 2021-12-17T18:26:17.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.531+0000 7fd258cc8700 1 -- 172.21.15.62:0/3489064343 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd254063d10 con 0x7fd254067120 2021-12-17T18:26:17.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.531+0000 7fd2437fe700 1 -- 172.21.15.62:0/3489064343 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16097 (secure 0 0 0) 0x7fd24402ff00 con 0x7fd254067120 2021-12-17T18:26:17.537 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:17.538 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":102,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:26:11.259910+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:26:08.360156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-12-17T18:26:09.261212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:26:17.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.535+0000 7fd258cc8700 1 -- 172.21.15.62:0/3489064343 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd2300534f0 msgr2=0x7fd2300559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:17.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.535+0000 7fd258cc8700 1 --2- 172.21.15.62:0/3489064343 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd2300534f0 0x7fd2300559b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fd24800b000 tx=0x7fd248009040).stop 2021-12-17T18:26:17.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.535+0000 7fd258cc8700 1 -- 172.21.15.62:0/3489064343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd254067120 msgr2=0x7fd254066820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.535+0000 7fd258cc8700 1 --2- 172.21.15.62:0/3489064343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd254067120 0x7fd254066820 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7fd244002f70 tx=0x7fd244014000).stop 2021-12-17T18:26:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.535+0000 7fd258cc8700 1 -- 172.21.15.62:0/3489064343 shutdown_connections 2021-12-17T18:26:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.535+0000 7fd258cc8700 1 --2- 172.21.15.62:0/3489064343 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd2300534f0 0x7fd2300559b0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.535+0000 7fd258cc8700 1 --2- 172.21.15.62:0/3489064343 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd254143780 0x7fd254139c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.535+0000 7fd258cc8700 1 --2- 172.21.15.62:0/3489064343 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2540b1260 0x7fd254139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.535+0000 7fd258cc8700 1 --2- 172.21.15.62:0/3489064343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd254067120 0x7fd254066820 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.535+0000 7fd258cc8700 1 -- 172.21.15.62:0/3489064343 >> 172.21.15.62:0/3489064343 conn(0x7fd25405f730 msgr2=0x7fd254142c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:17.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.535+0000 7fd258cc8700 1 -- 172.21.15.62:0/3489064343 shutdown_connections 2021-12-17T18:26:17.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.535+0000 7fd258cc8700 1 -- 172.21.15.62:0/3489064343 wait complete. 2021-12-17T18:26:17.556 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:26:08.360156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:26:09.261212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:26:17.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:26:17.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.659+0000 7f83495fa700 1 Processor -- start 2021-12-17T18:26:17.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.659+0000 7f83495fa700 1 -- start start 2021-12-17T18:26:17.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f83495fa700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8344149b40 0x7f834414bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:17.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f83495fa700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f834405ce70 con 0x7f834405ca90 2021-12-17T18:26:17.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f83495fa700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83440af520 con 0x7f83440b06b0 2021-12-17T18:26:17.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f83495fa700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83440643b0 con 0x7f8344149b40 2021-12-17T18:26:17.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f8348df9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8344149b40 0x7f834414bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:17.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f8343fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f834405ca90 0x7f8344063590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38124/0 (socket says 172.21.15.62:38124) 2021-12-17T18:26:17.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f8343fff700 1 -- 172.21.15.62:0/4293290380 learned_addr learned my addr 172.21.15.62:0/4293290380 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:17.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f83437fe700 1 -- 172.21.15.62:0/4293290380 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879272201 0 0) 0x7f83440af520 con 0x7f83440b06b0 2021-12-17T18:26:17.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f8348df9700 1 -- 172.21.15.62:0/4293290380 >> v1:172.21.15.109:6789/0 conn(0x7f83440b06b0 legacy=0x7f8344063ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:17.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f8348df9700 1 -- 172.21.15.62:0/4293290380 >> v1:172.21.15.62:6789/0 conn(0x7f834405ca90 legacy=0x7f8344063590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:17.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f8348df9700 1 -- 172.21.15.62:0/4293290380 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834405f730 con 0x7f8344149b40 2021-12-17T18:26:17.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f8348df9700 1 --2- 172.21.15.62:0/4293290380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8344149b40 0x7f834414bf30 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f8334001110 tx=0x7f833c0091d0).ready entity=mon.0 client_cookie=f556e19c60941a88 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:17.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f83437fe700 1 -- 172.21.15.62:0/4293290380 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f833c009ea0 con 0x7f8344149b40 2021-12-17T18:26:17.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f83437fe700 1 -- 172.21.15.62:0/4293290380 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833c00b760 con 0x7f8344149b40 2021-12-17T18:26:17.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f83437fe700 1 -- 172.21.15.62:0/4293290380 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f833c00b8d0 con 0x7f8344149b40 2021-12-17T18:26:17.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f83495fa700 1 -- 172.21.15.62:0/4293290380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8344149b40 msgr2=0x7f834414bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:17.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f83495fa700 1 --2- 172.21.15.62:0/4293290380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8344149b40 0x7f834414bf30 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f8334001110 tx=0x7f833c0091d0).stop 2021-12-17T18:26:17.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f83495fa700 1 -- 172.21.15.62:0/4293290380 shutdown_connections 2021-12-17T18:26:17.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f83495fa700 1 --2- 172.21.15.62:0/4293290380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8344149b40 0x7f834414bf30 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f83495fa700 1 -- 172.21.15.62:0/4293290380 >> 172.21.15.62:0/4293290380 conn(0x7f834405c070 msgr2=0x7f8344062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:17.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f83495fa700 1 -- 172.21.15.62:0/4293290380 shutdown_connections 2021-12-17T18:26:17.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.663+0000 7f83495fa700 1 -- 172.21.15.62:0/4293290380 wait complete. 2021-12-17T18:26:17.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f83495fa700 1 Processor -- start 2021-12-17T18:26:17.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f83495fa700 1 -- start start 2021-12-17T18:26:17.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f83495fa700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f834405ca90 0x7f83440acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:17.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f83495fa700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83440b06b0 0x7f8344140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:17.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f83495fa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8344149b40 0x7f8344065810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:17.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f83495fa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8344065470 con 0x7f8344149b40 2021-12-17T18:26:17.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f83495fa700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83440ad200 con 0x7f834405ca90 2021-12-17T18:26:17.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f83495fa700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8344140e80 con 0x7f83440b06b0 2021-12-17T18:26:17.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f8348df9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8344149b40 0x7f8344065810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:17.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f8348df9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8344149b40 0x7f8344065810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54552/0 (socket says 172.21.15.62:54552) 2021-12-17T18:26:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f8348df9700 1 -- 172.21.15.62:0/3794714174 learned_addr learned my addr 172.21.15.62:0/3794714174 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f8343fff700 1 --2- 172.21.15.62:0/3794714174 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f834405ca90 0x7f83440acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f833b7fe700 1 --2- 172.21.15.62:0/3794714174 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83440b06b0 0x7f8344140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f8348df9700 1 -- 172.21.15.62:0/3794714174 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83440b06b0 msgr2=0x7f8344140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f8348df9700 1 --2- 172.21.15.62:0/3794714174 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83440b06b0 0x7f8344140990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f8348df9700 1 -- 172.21.15.62:0/3794714174 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f834405ca90 msgr2=0x7f83440acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:17.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f8348df9700 1 --2- 172.21.15.62:0/3794714174 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f834405ca90 0x7f83440acbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f8348df9700 1 -- 172.21.15.62:0/3794714174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c009470 con 0x7f8344149b40 2021-12-17T18:26:17.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f833b7fe700 1 --2- 172.21.15.62:0/3794714174 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83440b06b0 0x7f8344140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.667+0000 7f8348df9700 1 --2- 172.21.15.62:0/3794714174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8344149b40 0x7f8344065810 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f8334001110 tx=0x7f833c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.671+0000 7f8341ffb700 1 -- 172.21.15.62:0/3794714174 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f833c00b8d0 con 0x7f8344149b40 2021-12-17T18:26:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.671+0000 7f8341ffb700 1 -- 172.21.15.62:0/3794714174 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833c01f5e0 con 0x7f8344149b40 2021-12-17T18:26:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.671+0000 7f83495fa700 1 -- 172.21.15.62:0/3794714174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8344140000 con 0x7f8344149b40 2021-12-17T18:26:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.671+0000 7f8341ffb700 1 -- 172.21.15.62:0/3794714174 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f833c009ea0 con 0x7f8344149b40 2021-12-17T18:26:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.671+0000 7f83495fa700 1 -- 172.21.15.62:0/3794714174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8344065ea0 con 0x7f8344149b40 2021-12-17T18:26:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.671+0000 7f83495fa700 1 -- 172.21.15.62:0/3794714174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83441407a0 con 0x7f8344149b40 2021-12-17T18:26:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.671+0000 7f8341ffb700 1 -- 172.21.15.62:0/3794714174 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f833c026030 con 0x7f8344149b40 2021-12-17T18:26:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.671+0000 7f8341ffb700 1 --2- 172.21.15.62:0/3794714174 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83280536a0 0x7f8328055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:17.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.671+0000 7f8341ffb700 1 -- 172.21.15.62:0/3794714174 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f833c06c4d0 con 0x7f8344149b40 2021-12-17T18:26:17.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.671+0000 7f8343fff700 1 --2- 172.21.15.62:0/3794714174 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83280536a0 0x7f8328055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:17.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.675+0000 7f8343fff700 1 --2- 172.21.15.62:0/3794714174 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83280536a0 0x7f8328055b60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f833400b000 tx=0x7f8334009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:17.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.679+0000 7f8341ffb700 1 -- 172.21.15.62:0/3794714174 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f83441407a0 con 0x7f8344149b40 2021-12-17T18:26:17.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.803+0000 7f83495fa700 1 -- 172.21.15.62:0/3794714174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f83441407a0 con 0x7f8344149b40 2021-12-17T18:26:17.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.803+0000 7f8341ffb700 1 -- 172.21.15.62:0/3794714174 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v102) v1 ==== 110+0+10 (secure 0 0 0) 0x7f83441407a0 con 0x7f8344149b40 2021-12-17T18:26:17.812 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:26:17.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.807+0000 7f83495fa700 1 -- 172.21.15.62:0/3794714174 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83280536a0 msgr2=0x7f8328055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:17.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.807+0000 7f83495fa700 1 --2- 172.21.15.62:0/3794714174 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83280536a0 0x7f8328055b60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f833400b000 tx=0x7f8334009040).stop 2021-12-17T18:26:17.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.807+0000 7f83495fa700 1 -- 172.21.15.62:0/3794714174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8344149b40 msgr2=0x7f8344065810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:17.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.807+0000 7f83495fa700 1 --2- 172.21.15.62:0/3794714174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8344149b40 0x7f8344065810 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f8334001110 tx=0x7f833c016000).stop 2021-12-17T18:26:17.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.807+0000 7f83495fa700 1 -- 172.21.15.62:0/3794714174 shutdown_connections 2021-12-17T18:26:17.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.807+0000 7f83495fa700 1 --2- 172.21.15.62:0/3794714174 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83280536a0 0x7f8328055b60 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.807+0000 7f83495fa700 1 --2- 172.21.15.62:0/3794714174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8344149b40 0x7f8344065810 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.807+0000 7f83495fa700 1 --2- 172.21.15.62:0/3794714174 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83440b06b0 0x7f8344140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.807+0000 7f83495fa700 1 --2- 172.21.15.62:0/3794714174 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f834405ca90 0x7f83440acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.807+0000 7f83495fa700 1 -- 172.21.15.62:0/3794714174 >> 172.21.15.62:0/3794714174 conn(0x7f834405c070 msgr2=0x7f83440ab320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:17.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.807+0000 7f83495fa700 1 -- 172.21.15.62:0/3794714174 shutdown_connections 2021-12-17T18:26:17.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.807+0000 7f83495fa700 1 -- 172.21.15.62:0/3794714174 wait complete. 2021-12-17T18:26:17.830 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:26:17.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.935+0000 7f0b93fff700 1 Processor -- start 2021-12-17T18:26:17.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.935+0000 7f0b93fff700 1 -- start start 2021-12-17T18:26:17.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.935+0000 7f0b93fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f0b9405fa70 0x7f0b941432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:17.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.935+0000 7f0b93fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0b94143ec0 0x7f0b941402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:17.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.935+0000 7f0b93fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9405fe50 con 0x7f0b940afbd0 2021-12-17T18:26:17.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.935+0000 7f0b93fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b940aef70 con 0x7f0b94143ec0 2021-12-17T18:26:17.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.935+0000 7f0b93fff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b940af1f0 con 0x7f0b9405fa70 2021-12-17T18:26:17.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.935+0000 7f0b937fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0b94143ec0 0x7f0b941402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:17.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b937fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0b94143ec0 0x7f0b941402a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54560/0 (socket says 172.21.15.62:54560) 2021-12-17T18:26:17.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b937fe700 1 -- 172.21.15.62:0/3806795132 learned_addr learned my addr 172.21.15.62:0/3806795132 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:17.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b92ffd700 1 --2- 172.21.15.62:0/3806795132 >> v2:172.21.15.109:3300/0 conn(0x7f0b9405fa70 0x7f0b941432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:17.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b937fe700 1 -- 172.21.15.62:0/3806795132 >> v2:172.21.15.109:3300/0 conn(0x7f0b9405fa70 msgr2=0x7f0b941432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:17.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b937fe700 1 --2- 172.21.15.62:0/3806795132 >> v2:172.21.15.109:3300/0 conn(0x7f0b9405fa70 0x7f0b941432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b937fe700 1 -- 172.21.15.62:0/3806795132 >> v1:172.21.15.62:6789/0 conn(0x7f0b940afbd0 legacy=0x7f0b941437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:17.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b937fe700 1 -- 172.21.15.62:0/3806795132 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b940af490 con 0x7f0b94143ec0 2021-12-17T18:26:17.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b937fe700 1 --2- 172.21.15.62:0/3806795132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b94143ec0 0x7f0b941402a0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f0b8c0032f0 tx=0x7f0b8c009290).ready entity=mon.0 client_cookie=86c9dc86c234e82e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:17.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b91ffb700 1 -- 172.21.15.62:0/3806795132 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b8c00b870 con 0x7f0b94143ec0 2021-12-17T18:26:17.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b91ffb700 1 -- 172.21.15.62:0/3806795132 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8c00b9d0 con 0x7f0b94143ec0 2021-12-17T18:26:17.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b91ffb700 1 -- 172.21.15.62:0/3806795132 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b8c00bb40 con 0x7f0b94143ec0 2021-12-17T18:26:17.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b93fff700 1 -- 172.21.15.62:0/3806795132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b94143ec0 msgr2=0x7f0b941402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:17.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b93fff700 1 --2- 172.21.15.62:0/3806795132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b94143ec0 0x7f0b941402a0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f0b8c0032f0 tx=0x7f0b8c009290).stop 2021-12-17T18:26:17.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b93fff700 1 -- 172.21.15.62:0/3806795132 shutdown_connections 2021-12-17T18:26:17.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b93fff700 1 --2- 172.21.15.62:0/3806795132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b94143ec0 0x7f0b941402a0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b93fff700 1 --2- 172.21.15.62:0/3806795132 >> v2:172.21.15.109:3300/0 conn(0x7f0b9405fa70 0x7f0b941432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b93fff700 1 -- 172.21.15.62:0/3806795132 >> 172.21.15.62:0/3806795132 conn(0x7f0b9405c750 msgr2=0x7f0b9405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b93fff700 1 -- 172.21.15.62:0/3806795132 shutdown_connections 2021-12-17T18:26:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.939+0000 7f0b93fff700 1 -- 172.21.15.62:0/3806795132 wait complete. 2021-12-17T18:26:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b93fff700 1 Processor -- start 2021-12-17T18:26:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b93fff700 1 -- start start 2021-12-17T18:26:17.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b93fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0b9405fa70 0x7f0b94065b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:17.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b93fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b940afbd0 0x7f0b940b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:17.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b93fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0b94143ec0 0x7f0b940b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:17.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b93fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9413c930 con 0x7f0b940afbd0 2021-12-17T18:26:17.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b93fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9413b940 con 0x7f0b9405fa70 2021-12-17T18:26:17.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b93fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b94139040 con 0x7f0b94143ec0 2021-12-17T18:26:17.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b927fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b940afbd0 0x7f0b940b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:17.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b92ffd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0b9405fa70 0x7f0b94065b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:17.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b927fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b940afbd0 0x7f0b940b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54564/0 (socket says 172.21.15.62:54564) 2021-12-17T18:26:17.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b927fc700 1 -- 172.21.15.62:0/1432091420 learned_addr learned my addr 172.21.15.62:0/1432091420 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:17.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b937fe700 1 --2- 172.21.15.62:0/1432091420 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0b94143ec0 0x7f0b940b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:17.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b927fc700 1 -- 172.21.15.62:0/1432091420 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0b94143ec0 msgr2=0x7f0b940b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:17.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b927fc700 1 --2- 172.21.15.62:0/1432091420 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0b94143ec0 0x7f0b940b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b927fc700 1 -- 172.21.15.62:0/1432091420 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0b9405fa70 msgr2=0x7f0b94065b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:17.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b927fc700 1 --2- 172.21.15.62:0/1432091420 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0b9405fa70 0x7f0b94065b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:17.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b927fc700 1 -- 172.21.15.62:0/1432091420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c009530 con 0x7f0b940afbd0 2021-12-17T18:26:17.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b927fc700 1 --2- 172.21.15.62:0/1432091420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b940afbd0 0x7f0b940b1470 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f0b940acbf0 tx=0x7f0b88007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:17.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b83fff700 1 -- 172.21.15.62:0/1432091420 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b88007030 con 0x7f0b940afbd0 2021-12-17T18:26:17.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b83fff700 1 -- 172.21.15.62:0/1432091420 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b88007190 con 0x7f0b940afbd0 2021-12-17T18:26:17.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b93fff700 1 -- 172.21.15.62:0/1432091420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9413c420 con 0x7f0b940afbd0 2021-12-17T18:26:17.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b83fff700 1 -- 172.21.15.62:0/1432091420 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b88006510 con 0x7f0b940afbd0 2021-12-17T18:26:17.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.943+0000 7f0b93fff700 1 -- 172.21.15.62:0/1432091420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b940b1b00 con 0x7f0b940afbd0 2021-12-17T18:26:17.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.947+0000 7f0b93fff700 1 -- 172.21.15.62:0/1432091420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b9413c5b0 con 0x7f0b940afbd0 2021-12-17T18:26:17.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.947+0000 7f0b83fff700 1 -- 172.21.15.62:0/1432091420 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0b8801b070 con 0x7f0b940afbd0 2021-12-17T18:26:17.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.947+0000 7f0b83fff700 1 --2- 172.21.15.62:0/1432091420 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0b70053640 0x7f0b70055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:17.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.947+0000 7f0b83fff700 1 -- 172.21.15.62:0/1432091420 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0b8806ae00 con 0x7f0b940afbd0 2021-12-17T18:26:17.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.947+0000 7f0b92ffd700 1 --2- 172.21.15.62:0/1432091420 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0b70053640 0x7f0b70055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:17.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.951+0000 7f0b92ffd700 1 --2- 172.21.15.62:0/1432091420 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0b70053640 0x7f0b70055b00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f0b8400c000 tx=0x7f0b84008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:17.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:17.955+0000 7f0b83fff700 1 -- 172.21.15.62:0/1432091420 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0b88041f60 con 0x7f0b940afbd0 2021-12-17T18:26:18.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.079+0000 7f0b93fff700 1 -- 172.21.15.62:0/1432091420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0b9413d700 con 0x7f0b940afbd0 2021-12-17T18:26:18.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.079+0000 7f0b83fff700 1 -- 172.21.15.62:0/1432091420 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v102) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0b88019020 con 0x7f0b940afbd0 2021-12-17T18:26:18.093 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:26:18.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.083+0000 7f0b93fff700 1 -- 172.21.15.62:0/1432091420 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0b70053640 msgr2=0x7f0b70055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.083+0000 7f0b93fff700 1 --2- 172.21.15.62:0/1432091420 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0b70053640 0x7f0b70055b00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f0b8400c000 tx=0x7f0b84008040).stop 2021-12-17T18:26:18.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.083+0000 7f0b93fff700 1 -- 172.21.15.62:0/1432091420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b940afbd0 msgr2=0x7f0b940b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.083+0000 7f0b93fff700 1 --2- 172.21.15.62:0/1432091420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b940afbd0 0x7f0b940b1470 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f0b940acbf0 tx=0x7f0b88007c00).stop 2021-12-17T18:26:18.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.083+0000 7f0b93fff700 1 -- 172.21.15.62:0/1432091420 shutdown_connections 2021-12-17T18:26:18.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.083+0000 7f0b93fff700 1 --2- 172.21.15.62:0/1432091420 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0b70053640 0x7f0b70055b00 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.083+0000 7f0b93fff700 1 --2- 172.21.15.62:0/1432091420 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0b94143ec0 0x7f0b940b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.083+0000 7f0b93fff700 1 --2- 172.21.15.62:0/1432091420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b940afbd0 0x7f0b940b1470 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.083+0000 7f0b93fff700 1 --2- 172.21.15.62:0/1432091420 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0b9405fa70 0x7f0b94065b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.083+0000 7f0b93fff700 1 -- 172.21.15.62:0/1432091420 >> 172.21.15.62:0/1432091420 conn(0x7f0b9405c750 msgr2=0x7f0b9405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:18.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.083+0000 7f0b93fff700 1 -- 172.21.15.62:0/1432091420 shutdown_connections 2021-12-17T18:26:18.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.083+0000 7f0b93fff700 1 -- 172.21.15.62:0/1432091420 wait complete. 2021-12-17T18:26:18.101 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:26:18.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.207+0000 7fbabbfff700 1 Processor -- start 2021-12-17T18:26:18.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.207+0000 7fbabbfff700 1 -- start start 2021-12-17T18:26:18.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.207+0000 7fbabbfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fbabc0b4b40 0x7fbabc140c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:18.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.207+0000 7fbabbfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbabc05ce70 con 0x7fbabc05ca90 2021-12-17T18:26:18.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.207+0000 7fbabbfff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbabc05ffd0 con 0x7fbabc0b46d0 2021-12-17T18:26:18.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.207+0000 7fbabbfff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbabc0b31e0 con 0x7fbabc0b4b40 2021-12-17T18:26:18.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.207+0000 7fbabaffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbabc05ca90 0x7fbabc05f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38150/0 (socket says 172.21.15.62:38150) 2021-12-17T18:26:18.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.207+0000 7fbabaffd700 1 -- 172.21.15.62:0/2162183741 learned_addr learned my addr 172.21.15.62:0/2162183741 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:18.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbabb7fe700 1 --2- 172.21.15.62:0/2162183741 >> v2:172.21.15.109:3300/0 conn(0x7fbabc0b4b40 0x7fbabc140c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:18.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbaba7fc700 1 -- 172.21.15.62:0/2162183741 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240606847 0 0) 0x7fbabc05ce70 con 0x7fbabc05ca90 2021-12-17T18:26:18.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbaba7fc700 1 -- 172.21.15.62:0/2162183741 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba9c003260 con 0x7fbabc05ca90 2021-12-17T18:26:18.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbaba7fc700 1 -- 172.21.15.62:0/2162183741 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109831705 0 0) 0x7fbabc05ffd0 con 0x7fbabc0b46d0 2021-12-17T18:26:18.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbaba7fc700 1 -- 172.21.15.62:0/2162183741 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbabc05ce70 con 0x7fbabc0b46d0 2021-12-17T18:26:18.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbabb7fe700 1 -- 172.21.15.62:0/2162183741 >> v1:172.21.15.109:6789/0 conn(0x7fbabc0b46d0 legacy=0x7fbabc140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbabb7fe700 1 -- 172.21.15.62:0/2162183741 >> v1:172.21.15.62:6789/0 conn(0x7fbabc05ca90 legacy=0x7fbabc05f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbabb7fe700 1 -- 172.21.15.62:0/2162183741 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbabc0b3f90 con 0x7fbabc0b4b40 2021-12-17T18:26:18.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbabb7fe700 1 --2- 172.21.15.62:0/2162183741 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbabc0b4b40 0x7fbabc140c60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fbab40032f0 tx=0x7fbab40091d0).ready entity=mon.1 client_cookie=b3b4fa720e7b807a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:18.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbaba7fc700 1 -- 172.21.15.62:0/2162183741 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbab400b600 con 0x7fbabc0b4b40 2021-12-17T18:26:18.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbaba7fc700 1 -- 172.21.15.62:0/2162183741 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab400b760 con 0x7fbabc0b4b40 2021-12-17T18:26:18.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbaba7fc700 1 -- 172.21.15.62:0/2162183741 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbab400b8d0 con 0x7fbabc0b4b40 2021-12-17T18:26:18.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbabbfff700 1 -- 172.21.15.62:0/2162183741 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbabc0b4b40 msgr2=0x7fbabc140c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbabbfff700 1 --2- 172.21.15.62:0/2162183741 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbabc0b4b40 0x7fbabc140c60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fbab40032f0 tx=0x7fbab40091d0).stop 2021-12-17T18:26:18.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbabbfff700 1 -- 172.21.15.62:0/2162183741 shutdown_connections 2021-12-17T18:26:18.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbabbfff700 1 --2- 172.21.15.62:0/2162183741 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbabc0b4b40 0x7fbabc140c60 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbabbfff700 1 -- 172.21.15.62:0/2162183741 >> 172.21.15.62:0/2162183741 conn(0x7fbabc05bcd0 msgr2=0x7fbabc062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:18.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbabbfff700 1 -- 172.21.15.62:0/2162183741 shutdown_connections 2021-12-17T18:26:18.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.211+0000 7fbabbfff700 1 -- 172.21.15.62:0/2162183741 wait complete. 2021-12-17T18:26:18.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbabbfff700 1 Processor -- start 2021-12-17T18:26:18.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbabbfff700 1 -- start start 2021-12-17T18:26:18.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbabbfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbabc05ca90 0x7fbabc13c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:18.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbabbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbabc0b46d0 0x7fbabc0b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:18.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbabbfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbabc0b4b40 0x7fbabc144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:18.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbabbfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc0b06c0 con 0x7fbabc0b46d0 2021-12-17T18:26:18.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbabbfff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc13c140 con 0x7fbabc05ca90 2021-12-17T18:26:18.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbabbfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc13c3e0 con 0x7fbabc0b4b40 2021-12-17T18:26:18.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbab27fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbabc0b46d0 0x7fbabc0b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:18.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbab27fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbabc0b46d0 0x7fbabc0b0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54578/0 (socket says 172.21.15.62:54578) 2021-12-17T18:26:18.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbab27fc700 1 -- 172.21.15.62:0/1566665230 learned_addr learned my addr 172.21.15.62:0/1566665230 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:18.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbabaffd700 1 --2- 172.21.15.62:0/1566665230 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbabc05ca90 0x7fbabc13c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:18.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbabb7fe700 1 --2- 172.21.15.62:0/1566665230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbabc0b4b40 0x7fbabc144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:18.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbab27fc700 1 -- 172.21.15.62:0/1566665230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbabc0b4b40 msgr2=0x7fbabc144980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbab27fc700 1 --2- 172.21.15.62:0/1566665230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbabc0b4b40 0x7fbabc144980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbab27fc700 1 -- 172.21.15.62:0/1566665230 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbabc05ca90 msgr2=0x7fbabc13c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbab27fc700 1 --2- 172.21.15.62:0/1566665230 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbabc05ca90 0x7fbabc13c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbab27fc700 1 -- 172.21.15.62:0/1566665230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab4009470 con 0x7fbabc0b46d0 2021-12-17T18:26:18.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbabaffd700 1 --2- 172.21.15.62:0/1566665230 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbabc05ca90 0x7fbabc13c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:18.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbab27fc700 1 --2- 172.21.15.62:0/1566665230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbabc0b46d0 0x7fbabc0b0090 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7fbaac001110 tx=0x7fbaac007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:18.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbab8ff9700 1 -- 172.21.15.62:0/1566665230 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbaac00ce50 con 0x7fbabc0b46d0 2021-12-17T18:26:18.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbab8ff9700 1 -- 172.21.15.62:0/1566665230 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac00f470 con 0x7fbabc0b46d0 2021-12-17T18:26:18.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.215+0000 7fbabbfff700 1 -- 172.21.15.62:0/1566665230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbabc145400 con 0x7fbabc0b46d0 2021-12-17T18:26:18.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.219+0000 7fbab8ff9700 1 -- 172.21.15.62:0/1566665230 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbaac00f7d0 con 0x7fbabc0b46d0 2021-12-17T18:26:18.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.219+0000 7fbabbfff700 1 -- 172.21.15.62:0/1566665230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbabc0b0b40 con 0x7fbabc0b46d0 2021-12-17T18:26:18.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.219+0000 7fbabbfff700 1 -- 172.21.15.62:0/1566665230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbabc0b4230 con 0x7fbabc0b46d0 2021-12-17T18:26:18.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.219+0000 7fbab8ff9700 1 -- 172.21.15.62:0/1566665230 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbaac019030 con 0x7fbabc0b46d0 2021-12-17T18:26:18.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.219+0000 7fbab8ff9700 1 --2- 172.21.15.62:0/1566665230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbaa0053610 0x7fbaa0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:18.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.219+0000 7fbab8ff9700 1 -- 172.21.15.62:0/1566665230 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbaac06ae70 con 0x7fbabc0b46d0 2021-12-17T18:26:18.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.219+0000 7fbabaffd700 1 --2- 172.21.15.62:0/1566665230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbaa0053610 0x7fbaa0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:18.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.223+0000 7fbabaffd700 1 --2- 172.21.15.62:0/1566665230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbaa0053610 0x7fbaa0055ad0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fbaa400b000 tx=0x7fbaa4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:18.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.227+0000 7fbab8ff9700 1 -- 172.21.15.62:0/1566665230 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbaac041ec0 con 0x7fbabc0b46d0 2021-12-17T18:26:18.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.351+0000 7fbabbfff700 1 -- 172.21.15.62:0/1566665230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbabc13c5a0 con 0x7fbabc0b46d0 2021-12-17T18:26:18.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.351+0000 7fbab8ff9700 1 -- 172.21.15.62:0/1566665230 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+10 (secure 0 0 0) 0x7fbaac0454e0 con 0x7fbabc0b46d0 2021-12-17T18:26:18.359 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:26:18.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.355+0000 7fbabbfff700 1 -- 172.21.15.62:0/1566665230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbaa0053610 msgr2=0x7fbaa0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.355+0000 7fbabbfff700 1 --2- 172.21.15.62:0/1566665230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbaa0053610 0x7fbaa0055ad0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fbaa400b000 tx=0x7fbaa4009040).stop 2021-12-17T18:26:18.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.355+0000 7fbabbfff700 1 -- 172.21.15.62:0/1566665230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbabc0b46d0 msgr2=0x7fbabc0b0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.355+0000 7fbabbfff700 1 --2- 172.21.15.62:0/1566665230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbabc0b46d0 0x7fbabc0b0090 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7fbaac001110 tx=0x7fbaac007ae0).stop 2021-12-17T18:26:18.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.355+0000 7fbabbfff700 1 -- 172.21.15.62:0/1566665230 shutdown_connections 2021-12-17T18:26:18.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.355+0000 7fbabbfff700 1 --2- 172.21.15.62:0/1566665230 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbaa0053610 0x7fbaa0055ad0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.355+0000 7fbabbfff700 1 --2- 172.21.15.62:0/1566665230 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbabc0b4b40 0x7fbabc144980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.355+0000 7fbabbfff700 1 --2- 172.21.15.62:0/1566665230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbabc0b46d0 0x7fbabc0b0090 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.355+0000 7fbabbfff700 1 --2- 172.21.15.62:0/1566665230 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbabc05ca90 0x7fbabc13c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.355+0000 7fbabbfff700 1 -- 172.21.15.62:0/1566665230 >> 172.21.15.62:0/1566665230 conn(0x7fbabc05bcd0 msgr2=0x7fbabc139eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:18.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.355+0000 7fbabbfff700 1 -- 172.21.15.62:0/1566665230 shutdown_connections 2021-12-17T18:26:18.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.355+0000 7fbabbfff700 1 -- 172.21.15.62:0/1566665230 wait complete. 2021-12-17T18:26:18.377 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:26:18.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158ebc9700 1 Processor -- start 2021-12-17T18:26:18.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158ebc9700 1 -- start start 2021-12-17T18:26:18.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158ebc9700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1588062910 0x7f1588140430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:18.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158ebc9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158813fd30 con 0x7f15880b2fb0 2021-12-17T18:26:18.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158ebc9700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158813ff90 con 0x7f1588140920 2021-12-17T18:26:18.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158ebc9700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15880653d0 con 0x7f1588062910 2021-12-17T18:26:18.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158dbc7700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f15880b2fb0 0x7f1588061390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38164/0 (socket says 172.21.15.62:38164) 2021-12-17T18:26:18.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158dbc7700 1 -- 172.21.15.62:0/76634165 learned_addr learned my addr 172.21.15.62:0/76634165 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:18.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158d3c6700 1 --2- 172.21.15.62:0/76634165 >> v2:172.21.15.109:3300/0 conn(0x7f1588062910 0x7f1588140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:18.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158cbc5700 1 -- 172.21.15.62:0/76634165 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825773517 0 0) 0x7f158813fd30 con 0x7f15880b2fb0 2021-12-17T18:26:18.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158cbc5700 1 -- 172.21.15.62:0/76634165 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f156c003260 con 0x7f15880b2fb0 2021-12-17T18:26:18.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158cbc5700 1 -- 172.21.15.62:0/76634165 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030970922 0 0) 0x7f158813ff90 con 0x7f1588140920 2021-12-17T18:26:18.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158cbc5700 1 -- 172.21.15.62:0/76634165 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f158813fd30 con 0x7f1588140920 2021-12-17T18:26:18.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158d3c6700 1 -- 172.21.15.62:0/76634165 >> v1:172.21.15.109:6789/0 conn(0x7f1588140920 legacy=0x7f1588128700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158d3c6700 1 -- 172.21.15.62:0/76634165 >> v1:172.21.15.62:6789/0 conn(0x7f15880b2fb0 legacy=0x7f1588061390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158d3c6700 1 -- 172.21.15.62:0/76634165 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15880656a0 con 0x7f1588062910 2021-12-17T18:26:18.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158d3c6700 1 --2- 172.21.15.62:0/76634165 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1588062910 0x7f1588140430 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f1578002f70 tx=0x7f1578006df0).ready entity=mon.1 client_cookie=235c97291a1e546c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:18.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158cbc5700 1 -- 172.21.15.62:0/76634165 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1578014070 con 0x7f1588062910 2021-12-17T18:26:18.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158cbc5700 1 -- 172.21.15.62:0/76634165 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1578000e90 con 0x7f1588062910 2021-12-17T18:26:18.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158cbc5700 1 -- 172.21.15.62:0/76634165 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f157800fb30 con 0x7f1588062910 2021-12-17T18:26:18.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158ebc9700 1 -- 172.21.15.62:0/76634165 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1588062910 msgr2=0x7f1588140430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.483+0000 7f158ebc9700 1 --2- 172.21.15.62:0/76634165 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1588062910 0x7f1588140430 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f1578002f70 tx=0x7f1578006df0).stop 2021-12-17T18:26:18.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158ebc9700 1 -- 172.21.15.62:0/76634165 shutdown_connections 2021-12-17T18:26:18.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158ebc9700 1 --2- 172.21.15.62:0/76634165 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1588062910 0x7f1588140430 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158ebc9700 1 -- 172.21.15.62:0/76634165 >> 172.21.15.62:0/76634165 conn(0x7f1588063510 msgr2=0x7f15880638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:18.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158ebc9700 1 -- 172.21.15.62:0/76634165 shutdown_connections 2021-12-17T18:26:18.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158ebc9700 1 -- 172.21.15.62:0/76634165 wait complete. 2021-12-17T18:26:18.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158ebc9700 1 Processor -- start 2021-12-17T18:26:18.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158ebc9700 1 -- start start 2021-12-17T18:26:18.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158ebc9700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1588062910 0x7f1588066e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:18.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158ebc9700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f15880b2fb0 0x7f1588126040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:18.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158ebc9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1588140920 0x7f1588142610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:18.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158ebc9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1588145110 con 0x7f1588140920 2021-12-17T18:26:18.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158ebc9700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1588144e70 con 0x7f1588062910 2021-12-17T18:26:18.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158ebc9700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1588126530 con 0x7f15880b2fb0 2021-12-17T18:26:18.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158e3c8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1588140920 0x7f1588142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:18.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158e3c8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1588140920 0x7f1588142610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54594/0 (socket says 172.21.15.62:54594) 2021-12-17T18:26:18.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158e3c8700 1 -- 172.21.15.62:0/387335220 learned_addr learned my addr 172.21.15.62:0/387335220 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:18.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158dbc7700 1 --2- 172.21.15.62:0/387335220 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1588062910 0x7f1588066e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:18.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.487+0000 7f158d3c6700 1 --2- 172.21.15.62:0/387335220 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f15880b2fb0 0x7f1588126040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:18.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.491+0000 7f158e3c8700 1 -- 172.21.15.62:0/387335220 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f15880b2fb0 msgr2=0x7f1588126040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.491+0000 7f158e3c8700 1 --2- 172.21.15.62:0/387335220 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f15880b2fb0 0x7f1588126040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.491+0000 7f158e3c8700 1 -- 172.21.15.62:0/387335220 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1588062910 msgr2=0x7f1588066e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.491+0000 7f158e3c8700 1 --2- 172.21.15.62:0/387335220 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1588062910 0x7f1588066e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.491+0000 7f158e3c8700 1 -- 172.21.15.62:0/387335220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157800b180 con 0x7f1588140920 2021-12-17T18:26:18.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.491+0000 7f158e3c8700 1 --2- 172.21.15.62:0/387335220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1588140920 0x7f1588142610 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f1580001490 tx=0x7f1580007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:18.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.491+0000 7f157effd700 1 -- 172.21.15.62:0/387335220 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1580002310 con 0x7f1588140920 2021-12-17T18:26:18.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.491+0000 7f157effd700 1 -- 172.21.15.62:0/387335220 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1580002470 con 0x7f1588140920 2021-12-17T18:26:18.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.491+0000 7f158ebc9700 1 -- 172.21.15.62:0/387335220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15881419a0 con 0x7f1588140920 2021-12-17T18:26:18.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.491+0000 7f157effd700 1 -- 172.21.15.62:0/387335220 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15800017a0 con 0x7f1588140920 2021-12-17T18:26:18.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.491+0000 7f158ebc9700 1 -- 172.21.15.62:0/387335220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1588142100 con 0x7f1588140920 2021-12-17T18:26:18.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.491+0000 7f158ebc9700 1 -- 172.21.15.62:0/387335220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1588144cb0 con 0x7f1588140920 2021-12-17T18:26:18.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.491+0000 7f157effd700 1 -- 172.21.15.62:0/387335220 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1580010030 con 0x7f1588140920 2021-12-17T18:26:18.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.491+0000 7f157effd700 1 --2- 172.21.15.62:0/387335220 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f15700536a0 0x7f1570055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:18.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.491+0000 7f157effd700 1 -- 172.21.15.62:0/387335220 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f158006b7c0 con 0x7f1588140920 2021-12-17T18:26:18.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.491+0000 7f158dbc7700 1 --2- 172.21.15.62:0/387335220 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f15700536a0 0x7f1570055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:18.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.495+0000 7f158dbc7700 1 --2- 172.21.15.62:0/387335220 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f15700536a0 0x7f1570055b60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f158400d000 tx=0x7f1584009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:18.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.499+0000 7f157effd700 1 -- 172.21.15.62:0/387335220 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1580042920 con 0x7f1588140920 2021-12-17T18:26:18.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.627+0000 7f158ebc9700 1 -- 172.21.15.62:0/387335220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1588142300 con 0x7f1588140920 2021-12-17T18:26:18.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.631+0000 7f157effd700 1 -- 172.21.15.62:0/387335220 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1580045f40 con 0x7f1588140920 2021-12-17T18:26:18.637 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:26:18.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.631+0000 7f158ebc9700 1 -- 172.21.15.62:0/387335220 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f15700536a0 msgr2=0x7f1570055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.631+0000 7f158ebc9700 1 --2- 172.21.15.62:0/387335220 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f15700536a0 0x7f1570055b60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f158400d000 tx=0x7f1584009040).stop 2021-12-17T18:26:18.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.631+0000 7f158ebc9700 1 -- 172.21.15.62:0/387335220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1588140920 msgr2=0x7f1588142610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.631+0000 7f158ebc9700 1 --2- 172.21.15.62:0/387335220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1588140920 0x7f1588142610 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f1580001490 tx=0x7f1580007dd0).stop 2021-12-17T18:26:18.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.631+0000 7f158ebc9700 1 -- 172.21.15.62:0/387335220 shutdown_connections 2021-12-17T18:26:18.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.631+0000 7f158ebc9700 1 --2- 172.21.15.62:0/387335220 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f15700536a0 0x7f1570055b60 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.631+0000 7f158ebc9700 1 --2- 172.21.15.62:0/387335220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1588140920 0x7f1588142610 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.631+0000 7f158ebc9700 1 --2- 172.21.15.62:0/387335220 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f15880b2fb0 0x7f1588126040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.631+0000 7f158ebc9700 1 --2- 172.21.15.62:0/387335220 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1588062910 0x7f1588066e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.631+0000 7f158ebc9700 1 -- 172.21.15.62:0/387335220 >> 172.21.15.62:0/387335220 conn(0x7f1588063510 msgr2=0x7f15880b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:18.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.631+0000 7f158ebc9700 1 -- 172.21.15.62:0/387335220 shutdown_connections 2021-12-17T18:26:18.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.631+0000 7f158ebc9700 1 -- 172.21.15.62:0/387335220 wait complete. 2021-12-17T18:26:18.651 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:26:18.651 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:26:18.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.747+0000 7fe0c9a43700 1 Processor -- start 2021-12-17T18:26:18.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.747+0000 7fe0c9a43700 1 -- start start 2021-12-17T18:26:18.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.747+0000 7fe0c9a43700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe0c40a8e10 0x7fe0c4147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:18.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.747+0000 7fe0c9a43700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0c40a71e0 0x7fe0c40a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:18.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c9a43700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c40b6270 con 0x7fe0c4141480 2021-12-17T18:26:18.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c9a43700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c4147610 con 0x7fe0c40a8e10 2021-12-17T18:26:18.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c9a43700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c41478b0 con 0x7fe0c40a71e0 2021-12-17T18:26:18.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c3fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe0c40a8e10 0x7fe0c4147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:18.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c9242700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0c40a71e0 0x7fe0c40a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:18.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c3fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe0c40a8e10 0x7fe0c4147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:32916/0 (socket says 172.21.15.62:32916) 2021-12-17T18:26:18.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c3fff700 1 -- 172.21.15.62:0/3711252268 learned_addr learned my addr 172.21.15.62:0/3711252268 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:18.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c8a41700 1 --1- 172.21.15.62:0/3711252268 >> v1:172.21.15.109:6789/0 conn(0x7fe0c4141480 0x7fe0c40b5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:54500/0 (socket says 172.21.15.62:54500) 2021-12-17T18:26:18.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c3fff700 1 -- 172.21.15.62:0/3711252268 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0c40a71e0 msgr2=0x7fe0c40a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:18.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c3fff700 1 --2- 172.21.15.62:0/3711252268 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0c40a71e0 0x7fe0c40a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c3fff700 1 -- 172.21.15.62:0/3711252268 >> v1:172.21.15.109:6789/0 conn(0x7fe0c4141480 legacy=0x7fe0c40b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c37fe700 1 -- 172.21.15.62:0/3711252268 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274600508 0 0) 0x7fe0c40b6270 con 0x7fe0c4141480 2021-12-17T18:26:18.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c3fff700 1 -- 172.21.15.62:0/3711252268 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c4147b50 con 0x7fe0c40a8e10 2021-12-17T18:26:18.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c3fff700 1 --2- 172.21.15.62:0/3711252268 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0c40a8e10 0x7fe0c4147ff0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fe0b0002f70 tx=0x7fe0b0006eb0).ready entity=mon.1 client_cookie=350f17b30f7e2c77 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:18.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c37fe700 1 -- 172.21.15.62:0/3711252268 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b000d570 con 0x7fe0c40a8e10 2021-12-17T18:26:18.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c37fe700 1 -- 172.21.15.62:0/3711252268 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b0000e90 con 0x7fe0c40a8e10 2021-12-17T18:26:18.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c37fe700 1 -- 172.21.15.62:0/3711252268 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b000d8c0 con 0x7fe0c40a8e10 2021-12-17T18:26:18.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c9a43700 1 -- 172.21.15.62:0/3711252268 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0c40a8e10 msgr2=0x7fe0c4147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c9a43700 1 --2- 172.21.15.62:0/3711252268 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0c40a8e10 0x7fe0c4147ff0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fe0b0002f70 tx=0x7fe0b0006eb0).stop 2021-12-17T18:26:18.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c9a43700 1 -- 172.21.15.62:0/3711252268 shutdown_connections 2021-12-17T18:26:18.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c9a43700 1 --2- 172.21.15.62:0/3711252268 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0c40a71e0 0x7fe0c40a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c9a43700 1 --2- 172.21.15.62:0/3711252268 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0c40a8e10 0x7fe0c4147ff0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c9a43700 1 -- 172.21.15.62:0/3711252268 >> 172.21.15.62:0/3711252268 conn(0x7fe0c405d220 msgr2=0x7fe0c40b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:18.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c9a43700 1 -- 172.21.15.62:0/3711252268 shutdown_connections 2021-12-17T18:26:18.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c9a43700 1 -- 172.21.15.62:0/3711252268 wait complete. 2021-12-17T18:26:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.751+0000 7fe0c9a43700 1 Processor -- start 2021-12-17T18:26:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c9a43700 1 -- start start 2021-12-17T18:26:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c9a43700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0c40a71e0 0x7fe0c4149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c9a43700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0c40a8e10 0x7fe0c40b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:18.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c9a43700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0c4141480 0x7fe0c413d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:18.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c9a43700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c414a1a0 con 0x7fe0c40a8e10 2021-12-17T18:26:18.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c9a43700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c414a990 con 0x7fe0c4141480 2021-12-17T18:26:18.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c9a43700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c414ac30 con 0x7fe0c40a71e0 2021-12-17T18:26:18.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0c40a8e10 0x7fe0c40b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:18.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c9242700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0c4141480 0x7fe0c413d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:18.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c8a41700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0c40a71e0 0x7fe0c4149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:18.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0c40a8e10 0x7fe0c40b4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54606/0 (socket says 172.21.15.62:54606) 2021-12-17T18:26:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c3fff700 1 -- 172.21.15.62:0/949986298 learned_addr learned my addr 172.21.15.62:0/949986298 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c3fff700 1 -- 172.21.15.62:0/949986298 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0c40a71e0 msgr2=0x7fe0c4149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c3fff700 1 --2- 172.21.15.62:0/949986298 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0c40a71e0 0x7fe0c4149b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c3fff700 1 -- 172.21.15.62:0/949986298 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0c4141480 msgr2=0x7fe0c413d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c3fff700 1 --2- 172.21.15.62:0/949986298 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0c4141480 0x7fe0c413d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c3fff700 1 -- 172.21.15.62:0/949986298 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b000b1e0 con 0x7fe0c40a8e10 2021-12-17T18:26:18.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c3fff700 1 --2- 172.21.15.62:0/949986298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0c40a8e10 0x7fe0c40b4bd0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7fe0b0002f70 tx=0x7fe0b0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:18.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c1ffb700 1 -- 172.21.15.62:0/949986298 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b00116e0 con 0x7fe0c40a8e10 2021-12-17T18:26:18.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c1ffb700 1 -- 172.21.15.62:0/949986298 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b0011840 con 0x7fe0c40a8e10 2021-12-17T18:26:18.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c1ffb700 1 -- 172.21.15.62:0/949986298 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b0011ba0 con 0x7fe0c40a8e10 2021-12-17T18:26:18.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c9a43700 1 -- 172.21.15.62:0/949986298 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c414b0d0 con 0x7fe0c40a8e10 2021-12-17T18:26:18.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c9a43700 1 -- 172.21.15.62:0/949986298 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c414b710 con 0x7fe0c40a8e10 2021-12-17T18:26:18.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.755+0000 7fe0c9a43700 1 -- 172.21.15.62:0/949986298 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c40af870 con 0x7fe0c40a8e10 2021-12-17T18:26:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.759+0000 7fe0c1ffb700 1 -- 172.21.15.62:0/949986298 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe0b0025030 con 0x7fe0c40a8e10 2021-12-17T18:26:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.759+0000 7fe0c1ffb700 1 --2- 172.21.15.62:0/949986298 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe0a4053640 0x7fe0a4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.759+0000 7fe0c1ffb700 1 -- 172.21.15.62:0/949986298 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe0b006ca10 con 0x7fe0c40a8e10 2021-12-17T18:26:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.759+0000 7fe0c8a41700 1 --2- 172.21.15.62:0/949986298 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe0a4053640 0x7fe0a4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:18.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.759+0000 7fe0c8a41700 1 --2- 172.21.15.62:0/949986298 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe0a4053640 0x7fe0a4055b00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fe0b800d000 tx=0x7fe0b8007bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:18.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.763+0000 7fe0c1ffb700 1 -- 172.21.15.62:0/949986298 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe0b0043b10 con 0x7fe0c40a8e10 2021-12-17T18:26:18.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.923+0000 7fe0c9a43700 1 -- 172.21.15.62:0/949986298 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0c414adf0 con 0x7fe0c40a8e10 2021-12-17T18:26:18.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.927+0000 7fe0c1ffb700 1 -- 172.21.15.62:0/949986298 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fe0b0023070 con 0x7fe0c40a8e10 2021-12-17T18:26:18.932 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:18.933 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":49,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/965882605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":965882605},{"type":"v1","addr":"172.21.15.109:6835","nonce":965882605}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:26:10.256074+0000","modified":"2021-12-17T18:26:11.259115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1972867454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1972867454},{"type":"v1","addr":"172.21.15.62:6833","nonce":1972867454}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-12-17T18:26:18.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.927+0000 7fe0c9a43700 1 -- 172.21.15.62:0/949986298 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe0a4053640 msgr2=0x7fe0a4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.927+0000 7fe0c9a43700 1 --2- 172.21.15.62:0/949986298 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe0a4053640 0x7fe0a4055b00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fe0b800d000 tx=0x7fe0b8007bc0).stop 2021-12-17T18:26:18.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.927+0000 7fe0c9a43700 1 -- 172.21.15.62:0/949986298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0c40a8e10 msgr2=0x7fe0c40b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:18.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.927+0000 7fe0c9a43700 1 --2- 172.21.15.62:0/949986298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0c40a8e10 0x7fe0c40b4bd0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7fe0b0002f70 tx=0x7fe0b0015000).stop 2021-12-17T18:26:18.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.927+0000 7fe0c9a43700 1 -- 172.21.15.62:0/949986298 shutdown_connections 2021-12-17T18:26:18.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.927+0000 7fe0c9a43700 1 --2- 172.21.15.62:0/949986298 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe0a4053640 0x7fe0a4055b00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.927+0000 7fe0c9a43700 1 --2- 172.21.15.62:0/949986298 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0c4141480 0x7fe0c413d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.927+0000 7fe0c9a43700 1 --2- 172.21.15.62:0/949986298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0c40a8e10 0x7fe0c40b4bd0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.927+0000 7fe0c9a43700 1 --2- 172.21.15.62:0/949986298 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0c40a71e0 0x7fe0c4149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:18.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.927+0000 7fe0c9a43700 1 -- 172.21.15.62:0/949986298 >> 172.21.15.62:0/949986298 conn(0x7fe0c405d220 msgr2=0x7fe0c41450d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:18.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.927+0000 7fe0c9a43700 1 -- 172.21.15.62:0/949986298 shutdown_connections 2021-12-17T18:26:18.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:18.927+0000 7fe0c9a43700 1 -- 172.21.15.62:0/949986298 wait complete. 2021-12-17T18:26:18.937 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 49 2021-12-17T18:26:19.147 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:26:10.256074+0000', 'modified': '2021-12-17T18:26:11.259115+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7365': {'gid': 7365, 'name': 'a', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/1972867454', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 1972867454}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 1972867454}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:26:19.148 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:26:19.149 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:26:19.267 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":7365,"want_state":"up:active","state":"up:active","rank_uptime":8.9966379750000005,"mdsmap_epoch":49,"osdmap_epoch":102,"osdmap_epoch_barrier":101,"uptime":13.699439611000001} 2021-12-17T18:26:19.268 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 7365, "mdsmap_epoch": 49, "osdmap_epoch": 102, "osdmap_epoch_barrier": 101, "rank_uptime": 8.996637975, "state": "up:active", "uptime": 13.699439611, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:26:19.269 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:26:19.269 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-12-17T18:26:19.269 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi158.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-12-17T18:26:19.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:19.270 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:19.279 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:26:19.295 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:26:19.296 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:26:19.307 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:26:19.308 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:26:19.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:19.309 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:26:19.358 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:26:19.359 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:19.362 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:26:19.379 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:26:19.379 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:26:19.398 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:26:19.398 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:26:19.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:19.400 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:26:19.436 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:2021-12-17T18:26:19.428+0000 7fcdb5ce6080 -1 init, newargv = 0x561e7f1ec0e0 newargc=9ceph-fuse[14308]: starting ceph client 2021-12-17T18:26:19.436 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr: 2021-12-17T18:26:19.447 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14308]: starting fuse 2021-12-17T18:26:20.543 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:26:20.561 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:26:20.562 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:26:20.619 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:26:20.620 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:26:20.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:20.621 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:26:20.626 INFO:teuthology.orchestra.run.smithi158.stdout:52 2021-12-17T18:26:20.627 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:26:20.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:20.628 DEBUG:teuthology.orchestra.run.smithi158:> sudo python3 -c ' 2021-12-17T18:26:20.628 DEBUG:teuthology.orchestra.run.smithi158:> import glob 2021-12-17T18:26:20.629 DEBUG:teuthology.orchestra.run.smithi158:> import re 2021-12-17T18:26:20.629 DEBUG:teuthology.orchestra.run.smithi158:> import os 2021-12-17T18:26:20.630 DEBUG:teuthology.orchestra.run.smithi158:> import subprocess 2021-12-17T18:26:20.630 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:26:20.630 DEBUG:teuthology.orchestra.run.smithi158:> def find_socket(client_name): 2021-12-17T18:26:20.631 DEBUG:teuthology.orchestra.run.smithi158:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-12-17T18:26:20.631 DEBUG:teuthology.orchestra.run.smithi158:> files = glob.glob(asok_path) 2021-12-17T18:26:20.632 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:26:20.632 DEBUG:teuthology.orchestra.run.smithi158:> # Given a non-glob path, it better be there 2021-12-17T18:26:20.633 DEBUG:teuthology.orchestra.run.smithi158:> if "*" not in asok_path: 2021-12-17T18:26:20.633 DEBUG:teuthology.orchestra.run.smithi158:> assert(len(files) == 1) 2021-12-17T18:26:20.633 DEBUG:teuthology.orchestra.run.smithi158:> return files[0] 2021-12-17T18:26:20.634 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:26:20.634 DEBUG:teuthology.orchestra.run.smithi158:> for f in files: 2021-12-17T18:26:20.635 DEBUG:teuthology.orchestra.run.smithi158:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:26:20.635 DEBUG:teuthology.orchestra.run.smithi158:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:26:20.636 DEBUG:teuthology.orchestra.run.smithi158:> return f 2021-12-17T18:26:20.636 DEBUG:teuthology.orchestra.run.smithi158:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:26:20.637 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:26:20.637 DEBUG:teuthology.orchestra.run.smithi158:> print(find_socket("client.1")) 2021-12-17T18:26:20.637 DEBUG:teuthology.orchestra.run.smithi158:> ' 2021-12-17T18:26:20.711 INFO:teuthology.orchestra.run.smithi158.stdout:/var/run/ceph/ceph-client.1.14308.asok 2021-12-17T18:26:20.716 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14308.asok 2021-12-17T18:26:20.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:20.717 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14308.asok status 2021-12-17T18:26:20.806 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2021-12-17T18:26:20.807 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": { 2021-12-17T18:26:20.807 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:26:20.807 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:26:20.807 INFO:teuthology.orchestra.run.smithi158.stdout: "entity_id": "1", 2021-12-17T18:26:20.808 INFO:teuthology.orchestra.run.smithi158.stdout: "hostname": "smithi158", 2021-12-17T18:26:20.808 INFO:teuthology.orchestra.run.smithi158.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-12-17T18:26:20.808 INFO:teuthology.orchestra.run.smithi158.stdout: "pid": "14308", 2021-12-17T18:26:20.808 INFO:teuthology.orchestra.run.smithi158.stdout: "root": "/" 2021-12-17T18:26:20.809 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:26:20.809 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_count": 0, 2021-12-17T18:26:20.809 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_pinned_count": 0, 2021-12-17T18:26:20.809 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 7438, 2021-12-17T18:26:20.810 INFO:teuthology.orchestra.run.smithi158.stdout: "inst": { 2021-12-17T18:26:20.810 INFO:teuthology.orchestra.run.smithi158.stdout: "name": { 2021-12-17T18:26:20.810 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "client", 2021-12-17T18:26:20.810 INFO:teuthology.orchestra.run.smithi158.stdout: "num": 7438 2021-12-17T18:26:20.811 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:26:20.811 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:26:20.811 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:26:20.811 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:26:20.812 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 3139271603 2021-12-17T18:26:20.812 INFO:teuthology.orchestra.run.smithi158.stdout: } 2021-12-17T18:26:20.812 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:26:20.812 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:26:20.813 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:26:20.813 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:26:20.813 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 3139271603 2021-12-17T18:26:20.814 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:26:20.814 INFO:teuthology.orchestra.run.smithi158.stdout: "inst_str": "client.7438 172.21.15.158:0/3139271603", 2021-12-17T18:26:20.814 INFO:teuthology.orchestra.run.smithi158.stdout: "addr_str": "172.21.15.158:0/3139271603", 2021-12-17T18:26:20.814 INFO:teuthology.orchestra.run.smithi158.stdout: "inode_count": 1, 2021-12-17T18:26:20.815 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_epoch": 49, 2021-12-17T18:26:20.815 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch": 102, 2021-12-17T18:26:20.815 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:26:20.815 INFO:teuthology.orchestra.run.smithi158.stdout: "blacklisted": false, 2021-12-17T18:26:20.816 INFO:teuthology.orchestra.run.smithi158.stdout: "fs_name": "cephfs" 2021-12-17T18:26:20.816 INFO:teuthology.orchestra.run.smithi158.stdout:} 2021-12-17T18:26:20.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:20.818 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:20.818 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:20.825 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:26:20.826 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:26:20.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:20.827 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:20.887 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-12-17T18:26:20.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9b71700 1 Processor -- start 2021-12-17T18:26:20.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9b71700 1 -- start start 2021-12-17T18:26:21.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9b71700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4f40a8010 0x7ff4f4147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:21.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9b71700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f40b6270 con 0x7ff4f4141480 2021-12-17T18:26:21.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9b71700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f4147610 con 0x7ff4f40a8e10 2021-12-17T18:26:21.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9b71700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f41478b0 con 0x7ff4f40a8010 2021-12-17T18:26:21.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f8b6f700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff4f4141480 0x7ff4f40b5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38192/0 (socket says 172.21.15.62:38192) 2021-12-17T18:26:21.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f8b6f700 1 -- 172.21.15.62:0/1720567772 learned_addr learned my addr 172.21.15.62:0/1720567772 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:21.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9370700 1 --2- 172.21.15.62:0/1720567772 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4f40a8010 0x7ff4f4147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:21.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4eb7fe700 1 -- 172.21.15.62:0/1720567772 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330998535 0 0) 0x7ff4f40b6270 con 0x7ff4f4141480 2021-12-17T18:26:21.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4eb7fe700 1 -- 172.21.15.62:0/1720567772 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4e0003260 con 0x7ff4f4141480 2021-12-17T18:26:21.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4eb7fe700 1 -- 172.21.15.62:0/1720567772 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054623695 0 0) 0x7ff4f4147610 con 0x7ff4f40a8e10 2021-12-17T18:26:21.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4eb7fe700 1 -- 172.21.15.62:0/1720567772 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f40b6270 con 0x7ff4f40a8e10 2021-12-17T18:26:21.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9370700 1 -- 172.21.15.62:0/1720567772 >> v1:172.21.15.109:6789/0 conn(0x7ff4f40a8e10 legacy=0x7ff4f40a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:21.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9370700 1 -- 172.21.15.62:0/1720567772 >> v1:172.21.15.62:6789/0 conn(0x7ff4f4141480 legacy=0x7ff4f40b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:21.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9370700 1 -- 172.21.15.62:0/1720567772 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f4147b50 con 0x7ff4f40a8010 2021-12-17T18:26:21.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9370700 1 --2- 172.21.15.62:0/1720567772 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4f40a8010 0x7ff4f4147ff0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7ff4ec0032f0 tx=0x7ff4ec0091d0).ready entity=mon.2 client_cookie=d412c4f468397633 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:21.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4eb7fe700 1 -- 172.21.15.62:0/1720567772 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4ec00b640 con 0x7ff4f40a8010 2021-12-17T18:26:21.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4eb7fe700 1 -- 172.21.15.62:0/1720567772 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec00b7a0 con 0x7ff4f40a8010 2021-12-17T18:26:21.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4eb7fe700 1 -- 172.21.15.62:0/1720567772 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4ec00b910 con 0x7ff4f40a8010 2021-12-17T18:26:21.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9b71700 1 -- 172.21.15.62:0/1720567772 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4f40a8010 msgr2=0x7ff4f4147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:21.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9b71700 1 --2- 172.21.15.62:0/1720567772 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4f40a8010 0x7ff4f4147ff0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7ff4ec0032f0 tx=0x7ff4ec0091d0).stop 2021-12-17T18:26:21.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9b71700 1 -- 172.21.15.62:0/1720567772 shutdown_connections 2021-12-17T18:26:21.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9b71700 1 --2- 172.21.15.62:0/1720567772 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4f40a8010 0x7ff4f4147ff0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:21.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9b71700 1 -- 172.21.15.62:0/1720567772 >> 172.21.15.62:0/1720567772 conn(0x7ff4f405d220 msgr2=0x7ff4f40b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:21.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9b71700 1 -- 172.21.15.62:0/1720567772 shutdown_connections 2021-12-17T18:26:21.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.991+0000 7ff4f9b71700 1 -- 172.21.15.62:0/1720567772 wait complete. 2021-12-17T18:26:21.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9b71700 1 Processor -- start 2021-12-17T18:26:21.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9b71700 1 -- start start 2021-12-17T18:26:21.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9b71700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff4f40a8010 0x7ff4f414a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:21.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9b71700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4f40a8e10 0x7ff4f40acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:21.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9b71700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4f4141480 0x7ff4f415a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:21.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9b71700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40aeed0 con 0x7ff4f4141480 2021-12-17T18:26:21.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9b71700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40af740 con 0x7ff4f40a8010 2021-12-17T18:26:21.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9b71700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40abe10 con 0x7ff4f40a8e10 2021-12-17T18:26:21.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9370700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4f4141480 0x7ff4f415a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:21.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9370700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4f4141480 0x7ff4f415a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54622/0 (socket says 172.21.15.62:54622) 2021-12-17T18:26:21.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9370700 1 -- 172.21.15.62:0/974172679 learned_addr learned my addr 172.21.15.62:0/974172679 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:21.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f8b6f700 1 --2- 172.21.15.62:0/974172679 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff4f40a8010 0x7ff4f414a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4ebfff700 1 --2- 172.21.15.62:0/974172679 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4f40a8e10 0x7ff4f40acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9370700 1 -- 172.21.15.62:0/974172679 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4f40a8e10 msgr2=0x7ff4f40acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9370700 1 --2- 172.21.15.62:0/974172679 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4f40a8e10 0x7ff4f40acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:21.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9370700 1 -- 172.21.15.62:0/974172679 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff4f40a8010 msgr2=0x7ff4f414a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9370700 1 --2- 172.21.15.62:0/974172679 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff4f40a8010 0x7ff4f414a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9370700 1 -- 172.21.15.62:0/974172679 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec009470 con 0x7ff4f4141480 2021-12-17T18:26:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9370700 1 --2- 172.21.15.62:0/974172679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4f4141480 0x7ff4f415a570 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7ff4ec0032f0 tx=0x7ff4ec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:21.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4e9ffb700 1 -- 172.21.15.62:0/974172679 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4ec00b910 con 0x7ff4f4141480 2021-12-17T18:26:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4e9ffb700 1 -- 172.21.15.62:0/974172679 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec01f3f0 con 0x7ff4f4141480 2021-12-17T18:26:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9b71700 1 -- 172.21.15.62:0/974172679 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f40af2d0 con 0x7ff4f4141480 2021-12-17T18:26:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4e9ffb700 1 -- 172.21.15.62:0/974172679 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4ec00b640 con 0x7ff4f4141480 2021-12-17T18:26:21.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.995+0000 7ff4f9b71700 1 -- 172.21.15.62:0/974172679 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f40ac7c0 con 0x7ff4f4141480 2021-12-17T18:26:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.999+0000 7ff4f9b71700 1 -- 172.21.15.62:0/974172679 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f40ac240 con 0x7ff4f4141480 2021-12-17T18:26:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.999+0000 7ff4e9ffb700 1 -- 172.21.15.62:0/974172679 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff4ec026030 con 0x7ff4f4141480 2021-12-17T18:26:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.999+0000 7ff4e9ffb700 1 --2- 172.21.15.62:0/974172679 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4d4053580 0x7ff4d4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:21.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.999+0000 7ff4e9ffb700 1 -- 172.21.15.62:0/974172679 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff4ec06c400 con 0x7ff4f4141480 2021-12-17T18:26:21.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.999+0000 7ff4f8b6f700 1 --2- 172.21.15.62:0/974172679 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4d4053580 0x7ff4d4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:21.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:20.999+0000 7ff4f8b6f700 1 --2- 172.21.15.62:0/974172679 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4d4053580 0x7ff4d4055a40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7ff4f000d000 tx=0x7ff4f0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:21.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.007+0000 7ff4e9ffb700 1 -- 172.21.15.62:0/974172679 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff4ec043450 con 0x7ff4f4141480 2021-12-17T18:26:21.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.175+0000 7ff4f9b71700 1 -- 172.21.15.62:0/974172679 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7ff4f40b1b90 con 0x7ff4f4141480 2021-12-17T18:26:21.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.175+0000 7ff4e9ffb700 1 -- 172.21.15.62:0/974172679 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1936 (secure 0 0 0) 0x7ff4ec0247a0 con 0x7ff4f4141480 2021-12-17T18:26:21.183 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:21.183 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:26:21.184 INFO:teuthology.orchestra.run.smithi062.stdout: "stats": { 2021-12-17T18:26:21.184 INFO:teuthology.orchestra.run.smithi062.stdout: "total_bytes": 773094113280, 2021-12-17T18:26:21.184 INFO:teuthology.orchestra.run.smithi062.stdout: "total_avail_bytes": 764493860864, 2021-12-17T18:26:21.184 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_bytes": 10317824, 2021-12-17T18:26:21.184 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_raw_bytes": 8600252416, 2021-12-17T18:26:21.185 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_raw_ratio": 0.011124457232654095, 2021-12-17T18:26:21.185 INFO:teuthology.orchestra.run.smithi062.stdout: "num_osds": 8, 2021-12-17T18:26:21.185 INFO:teuthology.orchestra.run.smithi062.stdout: "num_per_pool_osds": 8, 2021-12-17T18:26:21.185 INFO:teuthology.orchestra.run.smithi062.stdout: "num_per_pool_omap_osds": 8 2021-12-17T18:26:21.186 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:21.186 INFO:teuthology.orchestra.run.smithi062.stdout: "stats_by_class": { 2021-12-17T18:26:21.186 INFO:teuthology.orchestra.run.smithi062.stdout: "ssd": { 2021-12-17T18:26:21.186 INFO:teuthology.orchestra.run.smithi062.stdout: "total_bytes": 773094113280, 2021-12-17T18:26:21.187 INFO:teuthology.orchestra.run.smithi062.stdout: "total_avail_bytes": 764493860864, 2021-12-17T18:26:21.187 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_bytes": 10317824, 2021-12-17T18:26:21.187 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_raw_bytes": 8600252416, 2021-12-17T18:26:21.187 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_raw_ratio": 0.011124457232654095 2021-12-17T18:26:21.188 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:21.188 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:21.188 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:26:21.188 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:21.188 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "device_health_metrics", 2021-12-17T18:26:21.189 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 1, 2021-12-17T18:26:21.189 INFO:teuthology.orchestra.run.smithi062.stdout: "stats": { 2021-12-17T18:26:21.189 INFO:teuthology.orchestra.run.smithi062.stdout: "stored": 0, 2021-12-17T18:26:21.189 INFO:teuthology.orchestra.run.smithi062.stdout: "objects": 2, 2021-12-17T18:26:21.190 INFO:teuthology.orchestra.run.smithi062.stdout: "kb_used": 0, 2021-12-17T18:26:21.190 INFO:teuthology.orchestra.run.smithi062.stdout: "bytes_used": 0, 2021-12-17T18:26:21.190 INFO:teuthology.orchestra.run.smithi062.stdout: "percent_used": 0, 2021-12-17T18:26:21.190 INFO:teuthology.orchestra.run.smithi062.stdout: "max_avail": 362919526400 2021-12-17T18:26:21.191 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:21.191 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:21.191 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:21.191 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rbd", 2021-12-17T18:26:21.192 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 2, 2021-12-17T18:26:21.192 INFO:teuthology.orchestra.run.smithi062.stdout: "stats": { 2021-12-17T18:26:21.192 INFO:teuthology.orchestra.run.smithi062.stdout: "stored": 0, 2021-12-17T18:26:21.192 INFO:teuthology.orchestra.run.smithi062.stdout: "objects": 0, 2021-12-17T18:26:21.193 INFO:teuthology.orchestra.run.smithi062.stdout: "kb_used": 0, 2021-12-17T18:26:21.193 INFO:teuthology.orchestra.run.smithi062.stdout: "bytes_used": 0, 2021-12-17T18:26:21.193 INFO:teuthology.orchestra.run.smithi062.stdout: "percent_used": 0, 2021-12-17T18:26:21.193 INFO:teuthology.orchestra.run.smithi062.stdout: "max_avail": 362919526400 2021-12-17T18:26:21.193 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:21.194 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:21.194 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:21.194 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cephfs_metadata", 2021-12-17T18:26:21.194 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 19, 2021-12-17T18:26:21.195 INFO:teuthology.orchestra.run.smithi062.stdout: "stats": { 2021-12-17T18:26:21.195 INFO:teuthology.orchestra.run.smithi062.stdout: "stored": 2304, 2021-12-17T18:26:21.195 INFO:teuthology.orchestra.run.smithi062.stdout: "objects": 22, 2021-12-17T18:26:21.195 INFO:teuthology.orchestra.run.smithi062.stdout: "kb_used": 64, 2021-12-17T18:26:21.195 INFO:teuthology.orchestra.run.smithi062.stdout: "bytes_used": 65536, 2021-12-17T18:26:21.196 INFO:teuthology.orchestra.run.smithi062.stdout: "percent_used": 9.0289979937097087e-08, 2021-12-17T18:26:21.196 INFO:teuthology.orchestra.run.smithi062.stdout: "max_avail": 362919526400 2021-12-17T18:26:21.196 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:21.196 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:21.197 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:21.197 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cephfs_data", 2021-12-17T18:26:21.197 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 20, 2021-12-17T18:26:21.197 INFO:teuthology.orchestra.run.smithi062.stdout: "stats": { 2021-12-17T18:26:21.197 INFO:teuthology.orchestra.run.smithi062.stdout: "stored": 0, 2021-12-17T18:26:21.198 INFO:teuthology.orchestra.run.smithi062.stdout: "objects": 0, 2021-12-17T18:26:21.198 INFO:teuthology.orchestra.run.smithi062.stdout: "kb_used": 0, 2021-12-17T18:26:21.198 INFO:teuthology.orchestra.run.smithi062.stdout: "bytes_used": 0, 2021-12-17T18:26:21.198 INFO:teuthology.orchestra.run.smithi062.stdout: "percent_used": 0, 2021-12-17T18:26:21.199 INFO:teuthology.orchestra.run.smithi062.stdout: "max_avail": 362919526400 2021-12-17T18:26:21.199 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:21.199 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:21.199 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:21.200 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:26:21.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.179+0000 7ff4f9b71700 1 -- 172.21.15.62:0/974172679 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4d4053580 msgr2=0x7ff4d4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:21.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.179+0000 7ff4f9b71700 1 --2- 172.21.15.62:0/974172679 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4d4053580 0x7ff4d4055a40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7ff4f000d000 tx=0x7ff4f0009040).stop 2021-12-17T18:26:21.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.179+0000 7ff4f9b71700 1 -- 172.21.15.62:0/974172679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4f4141480 msgr2=0x7ff4f415a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:21.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.179+0000 7ff4f9b71700 1 --2- 172.21.15.62:0/974172679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4f4141480 0x7ff4f415a570 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7ff4ec0032f0 tx=0x7ff4ec016000).stop 2021-12-17T18:26:21.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.179+0000 7ff4f9b71700 1 -- 172.21.15.62:0/974172679 shutdown_connections 2021-12-17T18:26:21.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.179+0000 7ff4f9b71700 1 --2- 172.21.15.62:0/974172679 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4d4053580 0x7ff4d4055a40 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:21.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.179+0000 7ff4f9b71700 1 --2- 172.21.15.62:0/974172679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4f4141480 0x7ff4f415a570 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:21.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.179+0000 7ff4f9b71700 1 --2- 172.21.15.62:0/974172679 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4f40a8e10 0x7ff4f40acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:21.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.179+0000 7ff4f9b71700 1 --2- 172.21.15.62:0/974172679 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff4f40a8010 0x7ff4f414a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:21.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.179+0000 7ff4f9b71700 1 -- 172.21.15.62:0/974172679 >> 172.21.15.62:0/974172679 conn(0x7ff4f405d220 msgr2=0x7ff4f413fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:21.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.179+0000 7ff4f9b71700 1 -- 172.21.15.62:0/974172679 shutdown_connections 2021-12-17T18:26:21.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.179+0000 7ff4f9b71700 1 -- 172.21.15.62:0/974172679 wait complete. 2021-12-17T18:26:21.205 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data size -f json-pretty 2021-12-17T18:26:21.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7f4e3700 1 Processor -- start 2021-12-17T18:26:21.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7f4e3700 1 -- start start 2021-12-17T18:26:21.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7f4e3700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7eff7805ca90 0x7eff7814b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:21.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7f4e3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff780ac040 0x7eff781475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:21.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7f4e3700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff78060750 con 0x7eff78147ab0 2021-12-17T18:26:21.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7f4e3700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff7814ac00 con 0x7eff7805ca90 2021-12-17T18:26:21.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7f4e3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7814aea0 con 0x7eff780ac040 2021-12-17T18:26:21.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7e4e1700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7eff7805ca90 0x7eff7814b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:21.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7dce0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff780ac040 0x7eff781475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:21.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7dce0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff780ac040 0x7eff781475c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:48332/0 (socket says 172.21.15.62:48332) 2021-12-17T18:26:21.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7e4e1700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7eff7805ca90 0x7eff7814b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:32944/0 (socket says 172.21.15.62:32944) 2021-12-17T18:26:21.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7dce0700 1 -- 172.21.15.62:0/1655393812 learned_addr learned my addr 172.21.15.62:0/1655393812 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:21.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7ece2700 1 --1- 172.21.15.62:0/1655393812 >> v1:172.21.15.109:6789/0 conn(0x7eff78147ab0 0x7eff780b1ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:54528/0 (socket says 172.21.15.62:54528) 2021-12-17T18:26:21.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7dce0700 1 -- 172.21.15.62:0/1655393812 >> v2:172.21.15.109:3300/0 conn(0x7eff7805ca90 msgr2=0x7eff7814b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:21.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7dce0700 1 --2- 172.21.15.62:0/1655393812 >> v2:172.21.15.109:3300/0 conn(0x7eff7805ca90 0x7eff7814b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:21.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7dce0700 1 -- 172.21.15.62:0/1655393812 >> v1:172.21.15.109:6789/0 conn(0x7eff78147ab0 legacy=0x7eff780b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:21.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7dce0700 1 -- 172.21.15.62:0/1655393812 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7805ce70 con 0x7eff780ac040 2021-12-17T18:26:21.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7dce0700 1 --2- 172.21.15.62:0/1655393812 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff780ac040 0x7eff781475c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7eff74002f70 tx=0x7eff74006eb0).ready entity=mon.2 client_cookie=f9b120a250ea68bb server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:21.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7d4df700 1 -- 172.21.15.62:0/1655393812 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff7400d570 con 0x7eff780ac040 2021-12-17T18:26:21.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7d4df700 1 -- 172.21.15.62:0/1655393812 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff74000e90 con 0x7eff780ac040 2021-12-17T18:26:21.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.307+0000 7eff7d4df700 1 -- 172.21.15.62:0/1655393812 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff7400d900 con 0x7eff780ac040 2021-12-17T18:26:21.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7f4e3700 1 -- 172.21.15.62:0/1655393812 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff780ac040 msgr2=0x7eff781475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:21.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7f4e3700 1 --2- 172.21.15.62:0/1655393812 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff780ac040 0x7eff781475c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7eff74002f70 tx=0x7eff74006eb0).stop 2021-12-17T18:26:21.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7f4e3700 1 -- 172.21.15.62:0/1655393812 shutdown_connections 2021-12-17T18:26:21.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7f4e3700 1 --2- 172.21.15.62:0/1655393812 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff780ac040 0x7eff781475c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:21.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7f4e3700 1 --2- 172.21.15.62:0/1655393812 >> v2:172.21.15.109:3300/0 conn(0x7eff7805ca90 0x7eff7814b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:21.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7f4e3700 1 -- 172.21.15.62:0/1655393812 >> 172.21.15.62:0/1655393812 conn(0x7eff7805be70 msgr2=0x7eff78062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:21.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7f4e3700 1 -- 172.21.15.62:0/1655393812 shutdown_connections 2021-12-17T18:26:21.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7f4e3700 1 -- 172.21.15.62:0/1655393812 wait complete. 2021-12-17T18:26:21.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7f4e3700 1 Processor -- start 2021-12-17T18:26:21.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7f4e3700 1 -- start start 2021-12-17T18:26:21.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7f4e3700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7eff7805ca90 0x7eff780a1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:21.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7f4e3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff780ac040 0x7eff780a2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:21.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7f4e3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff78147ab0 0x7eff780b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:21.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7f4e3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7809fe90 con 0x7eff780ac040 2021-12-17T18:26:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7f4e3700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff780643b0 con 0x7eff7805ca90 2021-12-17T18:26:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7f4e3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff780a00c0 con 0x7eff78147ab0 2021-12-17T18:26:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7dce0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff780ac040 0x7eff780a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:21.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7ece2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff78147ab0 0x7eff780b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7e4e1700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7eff7805ca90 0x7eff780a1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7ece2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff78147ab0 0x7eff780b0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:48336/0 (socket says 172.21.15.62:48336) 2021-12-17T18:26:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7e4e1700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7eff7805ca90 0x7eff780a1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:32950/0 (socket says 172.21.15.62:32950) 2021-12-17T18:26:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7ece2700 1 -- 172.21.15.62:0/2356755400 learned_addr learned my addr 172.21.15.62:0/2356755400 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:21.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.311+0000 7eff7dce0700 1 --2- 172.21.15.62:0/2356755400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff780ac040 0x7eff780a2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54636/0 (socket says 172.21.15.62:54636) 2021-12-17T18:26:21.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.315+0000 7eff7ece2700 1 -- 172.21.15.62:0/2356755400 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7eff7805ca90 msgr2=0x7eff780a1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:21.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.315+0000 7eff7ece2700 1 --2- 172.21.15.62:0/2356755400 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7eff7805ca90 0x7eff780a1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:21.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.315+0000 7eff7ece2700 1 -- 172.21.15.62:0/2356755400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff780ac040 msgr2=0x7eff780a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:21.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.315+0000 7eff7ece2700 1 --2- 172.21.15.62:0/2356755400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff780ac040 0x7eff780a2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:21.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.315+0000 7eff7ece2700 1 -- 172.21.15.62:0/2356755400 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7400b1e0 con 0x7eff78147ab0 2021-12-17T18:26:21.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.315+0000 7eff7e4e1700 1 --2- 172.21.15.62:0/2356755400 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7eff7805ca90 0x7eff780a1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:21.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.315+0000 7eff7ece2700 1 --2- 172.21.15.62:0/2356755400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff78147ab0 0x7eff780b0160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7eff78156d10 tx=0x7eff70007f40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:21.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.315+0000 7eff677fe700 1 -- 172.21.15.62:0/2356755400 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff70004ab0 con 0x7eff78147ab0 2021-12-17T18:26:21.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.315+0000 7eff677fe700 1 -- 172.21.15.62:0/2356755400 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff70004c10 con 0x7eff78147ab0 2021-12-17T18:26:21.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.315+0000 7eff7f4e3700 1 -- 172.21.15.62:0/2356755400 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff780a0360 con 0x7eff78147ab0 2021-12-17T18:26:21.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.315+0000 7eff677fe700 1 -- 172.21.15.62:0/2356755400 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff70007170 con 0x7eff78147ab0 2021-12-17T18:26:21.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.315+0000 7eff7f4e3700 1 -- 172.21.15.62:0/2356755400 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7815a3d0 con 0x7eff78147ab0 2021-12-17T18:26:21.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.315+0000 7eff7f4e3700 1 -- 172.21.15.62:0/2356755400 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff78064520 con 0x7eff78147ab0 2021-12-17T18:26:21.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.315+0000 7eff677fe700 1 -- 172.21.15.62:0/2356755400 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7eff700072d0 con 0x7eff78147ab0 2021-12-17T18:26:21.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.319+0000 7eff677fe700 1 --2- 172.21.15.62:0/2356755400 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7eff580534f0 0x7eff580559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:21.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.319+0000 7eff677fe700 1 -- 172.21.15.62:0/2356755400 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7eff7006bac0 con 0x7eff78147ab0 2021-12-17T18:26:21.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.319+0000 7eff7e4e1700 1 --2- 172.21.15.62:0/2356755400 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7eff580534f0 0x7eff580559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:21.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.319+0000 7eff7e4e1700 1 --2- 172.21.15.62:0/2356755400 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7eff580534f0 0x7eff580559b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7eff6800b000 tx=0x7eff68006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:21.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.327+0000 7eff677fe700 1 -- 172.21.15.62:0/2356755400 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7eff70042bc0 con 0x7eff78147ab0 2021-12-17T18:26:21.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.455+0000 7eff7f4e3700 1 -- 172.21.15.62:0/2356755400 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"} v 0) v1 -- 0x7eff78064520 con 0x7eff78147ab0 2021-12-17T18:26:21.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.455+0000 7eff677fe700 1 -- 172.21.15.62:0/2356755400 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"}]=0 v102) v1 ==== 123+0+64 (secure 0 0 0) 0x7eff78064520 con 0x7eff78147ab0 2021-12-17T18:26:21.463 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:21.464 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:26:21.464 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": "cephfs_data", 2021-12-17T18:26:21.464 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_id": 20, 2021-12-17T18:26:21.464 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2 2021-12-17T18:26:21.465 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:26:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.459+0000 7eff7f4e3700 1 -- 172.21.15.62:0/2356755400 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7eff580534f0 msgr2=0x7eff580559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.459+0000 7eff7f4e3700 1 --2- 172.21.15.62:0/2356755400 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7eff580534f0 0x7eff580559b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7eff6800b000 tx=0x7eff68006df0).stop 2021-12-17T18:26:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.459+0000 7eff7f4e3700 1 -- 172.21.15.62:0/2356755400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff78147ab0 msgr2=0x7eff780b0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.459+0000 7eff7f4e3700 1 --2- 172.21.15.62:0/2356755400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff78147ab0 0x7eff780b0160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7eff78156d10 tx=0x7eff70007f40).stop 2021-12-17T18:26:21.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.459+0000 7eff7f4e3700 1 -- 172.21.15.62:0/2356755400 shutdown_connections 2021-12-17T18:26:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.459+0000 7eff7f4e3700 1 --2- 172.21.15.62:0/2356755400 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7eff580534f0 0x7eff580559b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.459+0000 7eff7f4e3700 1 --2- 172.21.15.62:0/2356755400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7eff78147ab0 0x7eff780b0160 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.459+0000 7eff7f4e3700 1 --2- 172.21.15.62:0/2356755400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff780ac040 0x7eff780a2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:21.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.459+0000 7eff7f4e3700 1 --2- 172.21.15.62:0/2356755400 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7eff7805ca90 0x7eff780a1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.459+0000 7eff7f4e3700 1 -- 172.21.15.62:0/2356755400 >> 172.21.15.62:0/2356755400 conn(0x7eff7805be70 msgr2=0x7eff78149dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.459+0000 7eff7f4e3700 1 -- 172.21.15.62:0/2356755400 shutdown_connections 2021-12-17T18:26:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:21.459+0000 7eff7f4e3700 1 -- 172.21.15.62:0/2356755400 wait complete. 2021-12-17T18:26:21.477 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-12-17T18:26:21.478 DEBUG:teuthology.orchestra.run.smithi125:> cd /home/ubuntu/cephtest/mnt.0 && sudo df . 2021-12-17T18:26:21.510 INFO:teuthology.orchestra.run.smithi125.stdout:Filesystem 1K-blocks Used Available Use% Mounted on 2021-12-17T18:26:21.510 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-fuse 354410496 0 354410496 0% /home/ubuntu/cephtest/mnt.0 2021-12-17T18:26:21.511 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:26:21.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:26:21.533 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:26:21.556 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:26:21.575 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:26:21.597 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:26:21.618 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:26:21.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:21.620 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:21.620 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:21.628 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:26:21.630 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:26:21.630 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:26:21.630 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:26:21.631 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:21.646 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14859]: fuse finished with error 0 and tester_r 0 2021-12-17T18:26:21.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:21.649 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:21.650 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:21.698 INFO:teuthology.orchestra.run.smithi125.stdout:ext2/ext3 2021-12-17T18:26:21.699 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:26:21.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:26:21.818 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:21.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:21.828 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:21.828 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:21.836 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:26:21.837 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:26:21.838 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi158.front.sepia.ceph.com... 2021-12-17T18:26:21.838 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:26:21.839 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:21.895 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14308]: fuse finished with error 0 and tester_r 0 2021-12-17T18:26:21.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:21.899 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:21.900 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:21.907 INFO:teuthology.orchestra.run.smithi158.stdout:ext2/ext3 2021-12-17T18:26:21.909 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:26:22.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:26:22.025 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:22.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:22.075 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:22.076 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:26:22.083 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:26:22.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:26:22.085 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:26:22.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:26:22.086 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:26:22.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:26:22.137 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:26:22.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:26:22.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21de6eb700 1 Processor -- start 2021-12-17T18:26:22.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21de6eb700 1 -- start start 2021-12-17T18:26:22.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21de6eb700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f21d80b21f0 0x7f21d814aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:22.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21de6eb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d80b2ce0 con 0x7f21d80b1730 2021-12-17T18:26:22.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21de6eb700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d80aca60 con 0x7f21d80a7bb0 2021-12-17T18:26:22.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21de6eb700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d8147870 con 0x7f21d80b21f0 2021-12-17T18:26:22.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21cf7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f21d80b1730 0x7f21d80ace90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38220/0 (socket says 172.21.15.62:38220) 2021-12-17T18:26:22.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21cf7fe700 1 -- 172.21.15.62:0/993710448 learned_addr learned my addr 172.21.15.62:0/993710448 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:22.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21d7fff700 1 --2- 172.21.15.62:0/993710448 >> v2:172.21.15.109:3300/0 conn(0x7f21d80b21f0 0x7f21d814aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:22.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21d77fe700 1 -- 172.21.15.62:0/993710448 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708460494 0 0) 0x7f21d80b2ce0 con 0x7f21d80b1730 2021-12-17T18:26:22.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21d77fe700 1 -- 172.21.15.62:0/993710448 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b8003260 con 0x7f21d80b1730 2021-12-17T18:26:22.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21d77fe700 1 -- 172.21.15.62:0/993710448 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163059194 0 0) 0x7f21d80aca60 con 0x7f21d80a7bb0 2021-12-17T18:26:22.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21d77fe700 1 -- 172.21.15.62:0/993710448 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21d80b2ce0 con 0x7f21d80a7bb0 2021-12-17T18:26:22.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21d7fff700 1 -- 172.21.15.62:0/993710448 >> v1:172.21.15.109:6789/0 conn(0x7f21d80a7bb0 legacy=0x7f21d8067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:22.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21d7fff700 1 -- 172.21.15.62:0/993710448 >> v1:172.21.15.62:6789/0 conn(0x7f21d80b1730 legacy=0x7f21d80ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:22.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21d77fe700 1 -- 172.21.15.62:0/993710448 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3630827214 0 0) 0x7f21b8003260 con 0x7f21d80b1730 2021-12-17T18:26:22.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21d7fff700 1 -- 172.21.15.62:0/993710448 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d80b2f10 con 0x7f21d80b21f0 2021-12-17T18:26:22.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21d7fff700 1 --2- 172.21.15.62:0/993710448 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f21d80b21f0 0x7f21d814aea0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f21c0001110 tx=0x7f21c8006df0).ready entity=mon.1 client_cookie=65b2d411e837f21e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:22.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21d77fe700 1 -- 172.21.15.62:0/993710448 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21c0001660 con 0x7f21d80b21f0 2021-12-17T18:26:22.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21d77fe700 1 -- 172.21.15.62:0/993710448 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c8000e90 con 0x7f21d80b21f0 2021-12-17T18:26:22.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21d77fe700 1 -- 172.21.15.62:0/993710448 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21c8012460 con 0x7f21d80b21f0 2021-12-17T18:26:22.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21de6eb700 1 -- 172.21.15.62:0/993710448 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f21d80b21f0 msgr2=0x7f21d814aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:22.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21de6eb700 1 --2- 172.21.15.62:0/993710448 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f21d80b21f0 0x7f21d814aea0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f21c0001110 tx=0x7f21c8006df0).stop 2021-12-17T18:26:22.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21de6eb700 1 -- 172.21.15.62:0/993710448 shutdown_connections 2021-12-17T18:26:22.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21de6eb700 1 --2- 172.21.15.62:0/993710448 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f21d80b21f0 0x7f21d814aea0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:22.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21de6eb700 1 -- 172.21.15.62:0/993710448 >> 172.21.15.62:0/993710448 conn(0x7f21d805f730 msgr2=0x7f21d805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:22.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.247+0000 7f21de6eb700 1 -- 172.21.15.62:0/993710448 shutdown_connections 2021-12-17T18:26:22.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21de6eb700 1 -- 172.21.15.62:0/993710448 wait complete. 2021-12-17T18:26:22.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21de6eb700 1 Processor -- start 2021-12-17T18:26:22.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21de6eb700 1 -- start start 2021-12-17T18:26:22.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21de6eb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21d80a7bb0 0x7f21d80b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:22.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21de6eb700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f21d80b1730 0x7f21d814c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:22.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21de6eb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f21d80b21f0 0x7f21d814c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:22.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21de6eb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d814b580 con 0x7f21d80a7bb0 2021-12-17T18:26:22.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21de6eb700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80aa570 con 0x7f21d80b1730 2021-12-17T18:26:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21de6eb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d814b7b0 con 0x7f21d80b21f0 2021-12-17T18:26:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21d7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21d80a7bb0 0x7f21d80b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21d7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21d80a7bb0 0x7f21d80b4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54648/0 (socket says 172.21.15.62:54648) 2021-12-17T18:26:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21d7fff700 1 -- 172.21.15.62:0/1524343416 learned_addr learned my addr 172.21.15.62:0/1524343416 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:22.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21dcc88700 1 --2- 172.21.15.62:0/1524343416 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f21d80b21f0 0x7f21d814c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21cf7fe700 1 --2- 172.21.15.62:0/1524343416 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f21d80b1730 0x7f21d814c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21d7fff700 1 -- 172.21.15.62:0/1524343416 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f21d80b21f0 msgr2=0x7f21d814c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21d7fff700 1 --2- 172.21.15.62:0/1524343416 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f21d80b21f0 0x7f21d814c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:22.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21d7fff700 1 -- 172.21.15.62:0/1524343416 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f21d80b1730 msgr2=0x7f21d814c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:22.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21d7fff700 1 --2- 172.21.15.62:0/1524343416 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f21d80b1730 0x7f21d814c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:22.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21d7fff700 1 -- 172.21.15.62:0/1524343416 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c800b180 con 0x7f21d80a7bb0 2021-12-17T18:26:22.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21cf7fe700 1 --2- 172.21.15.62:0/1524343416 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f21d80b1730 0x7f21d814c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:22.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21d7fff700 1 --2- 172.21.15.62:0/1524343416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21d80a7bb0 0x7f21d80b4280 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f21c0001110 tx=0x7f21c8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:22.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21d5ffb700 1 -- 172.21.15.62:0/1524343416 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21c800da20 con 0x7f21d80a7bb0 2021-12-17T18:26:22.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21d5ffb700 1 -- 172.21.15.62:0/1524343416 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c800db80 con 0x7f21d80a7bb0 2021-12-17T18:26:22.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21de6eb700 1 -- 172.21.15.62:0/1524343416 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d80aa120 con 0x7f21d80a7bb0 2021-12-17T18:26:22.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21d5ffb700 1 -- 172.21.15.62:0/1524343416 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21c801e400 con 0x7f21d80a7bb0 2021-12-17T18:26:22.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.251+0000 7f21de6eb700 1 -- 172.21.15.62:0/1524343416 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d814be60 con 0x7f21d80a7bb0 2021-12-17T18:26:22.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.255+0000 7f21de6eb700 1 -- 172.21.15.62:0/1524343416 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d80573d0 con 0x7f21d80a7bb0 2021-12-17T18:26:22.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.255+0000 7f21d5ffb700 1 -- 172.21.15.62:0/1524343416 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f21c8025030 con 0x7f21d80a7bb0 2021-12-17T18:26:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.255+0000 7f21d5ffb700 1 --2- 172.21.15.62:0/1524343416 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f21bc053610 0x7f21bc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:22.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.255+0000 7f21d5ffb700 1 -- 172.21.15.62:0/1524343416 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f21c806c4e0 con 0x7f21d80a7bb0 2021-12-17T18:26:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.255+0000 7f21cf7fe700 1 --2- 172.21.15.62:0/1524343416 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f21bc053610 0x7f21bc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:22.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.255+0000 7f21cf7fe700 1 --2- 172.21.15.62:0/1524343416 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f21bc053610 0x7f21bc055ad0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f21c000b000 tx=0x7f21c0000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:22.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.259+0000 7f21d5ffb700 1 -- 172.21.15.62:0/1524343416 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f21c8043640 con 0x7f21d80a7bb0 2021-12-17T18:26:22.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.387+0000 7f21de6eb700 1 -- 172.21.15.62:0/1524343416 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f21d80af860 con 0x7f21d80a7bb0 2021-12-17T18:26:22.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.391+0000 7f21d5ffb700 1 -- 172.21.15.62:0/1524343416 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v102) v1 ==== 81+0+33704 (secure 0 0 0) 0x7f21c8023020 con 0x7f21d80a7bb0 2021-12-17T18:26:22.400 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:22.400 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:26:22.400 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 102, 2021-12-17T18:26:22.401 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:26:22.401 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:26:22.401 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:26:11.259910+0000", 2021-12-17T18:26:22.401 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:26:22.402 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:26:22.402 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:26:22.402 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:26:22.403 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:26:22.403 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:26:22.403 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:26:22.404 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:26:22.404 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:26:22.404 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:26:22.404 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:26:22.404 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:26:22.405 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:26:22.405 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:26:22.405 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:26:22.405 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 20, 2021-12-17T18:26:22.406 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:26:22.406 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:26:22.406 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:26:22.406 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:26:22.407 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:26:22.407 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.407 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:26:22.407 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:26:22.408 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:26:22.408 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:26:22.408 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:26:22.408 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:26:22.409 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:26:22.409 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:26:22.409 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:26:22.409 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:26:22.409 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:26:22.410 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:26:22.410 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:26:22.410 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:26:22.410 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:26:22.411 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:26:22.411 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:26:22.411 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:26:22.411 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:26:22.412 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:26:22.412 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:26:22.412 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:26:22.412 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:26:22.413 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.413 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:26:22.413 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:26:22.414 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:26:22.414 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:26:22.414 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:26:22.414 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:26:22.415 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:26:22.415 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:26:22.415 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:26:22.415 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:26:22.416 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:26:22.416 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:26:22.416 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:26:22.416 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:26:22.417 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:26:22.417 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:26:22.417 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:26:22.417 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:26:22.417 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:26:22.418 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:26:22.418 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:26:22.418 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:26:22.418 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:26:22.419 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:26:22.419 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:26:22.419 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:26:22.419 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:26:22.420 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.420 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:26:22.420 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:26:22.420 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:26:22.420 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:26:22.421 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:26:22.421 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:26:22.421 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:26:22.421 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:26:22.422 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:26:22.422 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:26:22.422 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:26:22.422 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:26:22.423 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:26:22.423 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.423 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:26:22.424 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:26:22.424 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.424 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.424 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.425 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:26:22.425 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:26:22.425 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:26:22.425 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:26:22.426 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:26:22.426 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:26:22.426 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:26:22.426 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:26:22.427 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:26:22.427 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:26:22.427 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:26:22.427 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:26:22.427 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:26:22.428 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:26:22.428 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:26:22.428 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:26:22.428 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:26:22.429 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:26:22.429 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:26:22.429 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:26:22.429 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:26:22.429 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:26:22.430 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:26:22.430 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.430 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:26:22.430 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:26:22.431 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:26:22.431 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:26:22.431 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:26:22.431 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:26:22.432 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:26:22.432 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:26:22.432 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:26:22.432 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:26:22.432 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:26:22.433 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:26:22.433 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:26:22.433 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:26:22.434 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:26:22.434 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:26:22.434 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:26:22.434 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:26:22.435 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:26:22.435 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:26:22.435 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:26:22.435 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:26:22.436 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:26:22.436 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:26:22.436 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:26:22.436 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:26:22.437 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:26:22.437 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.437 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:26:22.437 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:26:22.437 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:26:22.438 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:26:22.438 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:26:22.438 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:26:22.438 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:26:22.439 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:26:22.439 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:26:22.439 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:26:22.439 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:26:22.440 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:26:22.440 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:26:22.440 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:26:22.440 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.440 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.441 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.441 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 19, 2021-12-17T18:26:22.441 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2021-12-17T18:26:22.441 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:26:08.360156+0000", 2021-12-17T18:26:22.442 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:26:22.442 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:26:22.442 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:26:22.442 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:26:22.443 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:26:22.443 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:26:22.443 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:26:22.443 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:26:22.444 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:26:22.444 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:26:22.444 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:26:22.444 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:26:22.445 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:26:22.445 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:26:22.445 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:26:22.445 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:26:22.446 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:26:22.446 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:26:22.446 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:26:22.446 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:26:22.447 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.447 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "101", 2021-12-17T18:26:22.447 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:26:22.447 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:26:22.448 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:26:22.448 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:26:22.448 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:26:22.448 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:26:22.448 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:26:22.449 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:26:22.449 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:26:22.449 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:26:22.449 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:26:22.450 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:26:22.450 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:26:22.450 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:26:22.450 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:26:22.451 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:26:22.451 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:26:22.451 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:26:22.451 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:26:22.451 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:26:22.452 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:26:22.452 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:26:22.452 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:26:22.452 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:26:22.453 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:26:22.453 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:26:22.453 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.453 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:26:22.454 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:26:22.454 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:26:22.454 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:26:22.454 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:26:22.455 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:26:22.455 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:26:22.455 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:26:22.455 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:26:22.455 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:26:22.456 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:26:22.456 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:26:22.456 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2021-12-17T18:26:22.456 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2021-12-17T18:26:22.457 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2021-12-17T18:26:22.457 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.457 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:26:22.457 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:26:22.457 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2021-12-17T18:26:22.458 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.458 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.458 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.458 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.459 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 20, 2021-12-17T18:26:22.459 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2021-12-17T18:26:22.459 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:26:09.261212+0000", 2021-12-17T18:26:22.459 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:26:22.460 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:26:22.460 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:26:22.460 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:26:22.460 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:26:22.461 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:26:22.461 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:26:22.461 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:26:22.461 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:26:22.461 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:26:22.462 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:26:22.462 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:26:22.462 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:26:22.462 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:26:22.463 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:26:22.463 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:26:22.463 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:26:22.463 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:26:22.463 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:26:22.464 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:26:22.464 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.464 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "102", 2021-12-17T18:26:22.464 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:26:22.465 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:26:22.465 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:26:22.465 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:26:22.465 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:26:22.466 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:26:22.466 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:26:22.466 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:26:22.466 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:26:22.467 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:26:22.467 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:26:22.467 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:26:22.467 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:26:22.467 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:26:22.468 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:26:22.468 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:26:22.468 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:26:22.468 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:26:22.469 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:26:22.469 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:26:22.469 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:26:22.469 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:26:22.470 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:26:22.470 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:26:22.470 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:26:22.470 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:26:22.470 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.471 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:26:22.471 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:26:22.471 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:26:22.471 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:26:22.472 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:26:22.472 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:26:22.472 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:26:22.472 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:26:22.473 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:26:22.473 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:26:22.473 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:26:22.473 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:26:22.473 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:26:22.474 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:26:22.474 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2021-12-17T18:26:22.474 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.474 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.475 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.475 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:26:22.475 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:26:22.475 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.475 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:26:22.476 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:26:22.476 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:22.476 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:22.476 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:22.477 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:22.477 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:22.477 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:22.477 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:22.478 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 100, 2021-12-17T18:26:22.478 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:22.478 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:22.478 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:22.478 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.479 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.479 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.479 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:26:22.479 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:22.480 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.480 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.480 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.480 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:26:22.480 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:22.481 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.481 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.481 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.481 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:22.482 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.482 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.482 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.482 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:26:22.483 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:22.483 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.483 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.483 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.483 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:26:22.484 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:22.484 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.484 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.484 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.485 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:22.485 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.485 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.486 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.486 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:26:22.486 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:22.486 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.487 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.487 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.487 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:26:22.487 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:22.487 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.488 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.488 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.488 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:22.488 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.489 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.489 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.489 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:26:22.489 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:22.490 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.490 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.490 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.490 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:26:22.490 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:22.491 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.491 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.491 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.491 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:26:22.492 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:26:22.492 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:26:22.492 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:26:22.492 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:22.493 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:22.493 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:22.493 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.493 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.493 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.494 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:26:22.494 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:26:22.494 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:22.494 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:22.495 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:22.495 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:22.495 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:22.495 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:22.496 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:22.496 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 100, 2021-12-17T18:26:22.496 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:22.496 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:22.496 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:22.497 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.497 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.497 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.497 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:26:22.498 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:22.498 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.498 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.498 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.499 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:26:22.499 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:22.499 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.499 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.500 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.500 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:22.500 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.500 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.500 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.501 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:26:22.501 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:22.501 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.501 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.502 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.502 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:26:22.502 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:22.502 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.503 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.503 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.503 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:22.503 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.503 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.504 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.504 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:26:22.504 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:22.504 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.505 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.505 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.505 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:26:22.505 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:22.506 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.506 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.506 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.506 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:22.507 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.507 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.507 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.508 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:26:22.508 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:22.508 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.508 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.509 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.509 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:26:22.509 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:22.509 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.509 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.510 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.510 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:26:22.510 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:26:22.511 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:26:22.511 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:26:22.511 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:22.511 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:22.512 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:22.512 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.512 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.512 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.513 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:26:22.513 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:26:22.513 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:22.513 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:22.514 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:22.514 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:22.514 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:22.514 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:22.514 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:22.515 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 99, 2021-12-17T18:26:22.515 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:22.515 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:22.515 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:22.516 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.516 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.516 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.516 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:26:22.517 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:22.517 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.517 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.517 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.517 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:26:22.518 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:22.518 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.518 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.518 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.519 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:22.519 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.519 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.519 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.520 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:26:22.520 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:22.520 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.520 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.520 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.521 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:26:22.521 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:22.521 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.521 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.522 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.522 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:22.522 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.522 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.523 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.523 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:26:22.523 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:22.523 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.523 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.524 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.524 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:26:22.524 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:22.524 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.525 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.525 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.525 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:22.525 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.525 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.526 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.526 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:26:22.526 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:22.526 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.527 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.527 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.527 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:26:22.527 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:22.528 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.528 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.528 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.528 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:26:22.528 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:26:22.529 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:26:22.529 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:26:22.529 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:22.529 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:22.530 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:22.530 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.530 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.530 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.531 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:26:22.531 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:26:22.531 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:22.531 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:22.531 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:22.532 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:22.532 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:22.532 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:22.532 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:22.533 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 100, 2021-12-17T18:26:22.533 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:22.533 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:22.533 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:22.534 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.534 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.534 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.534 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:26:22.535 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:22.535 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.535 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.535 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.536 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:26:22.536 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:22.536 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.536 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.536 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.537 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:22.537 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.537 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.537 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.538 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:26:22.538 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:22.538 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.538 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.538 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.539 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:26:22.539 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:22.539 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.539 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.540 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.540 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:22.540 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.540 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.541 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.541 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:26:22.541 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:22.541 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.541 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.542 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.542 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:26:22.542 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:22.542 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.543 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.543 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.543 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:22.543 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.544 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.544 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.544 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:26:22.544 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:22.544 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.545 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.545 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:26:22.545 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:22.546 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.546 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.546 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.546 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:26:22.547 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:26:22.547 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:26:22.547 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:26:22.547 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:22.547 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:22.548 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:22.548 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.548 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.548 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.549 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:26:22.549 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:26:22.549 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:22.549 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:22.549 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:22.550 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:22.550 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:22.550 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:22.550 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:22.551 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 99, 2021-12-17T18:26:22.551 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:22.551 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:22.551 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:22.552 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.552 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.552 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.552 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:26:22.552 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:22.553 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.553 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.553 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.553 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:26:22.554 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:22.554 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.554 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.554 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.555 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:22.555 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.555 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.555 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.556 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:26:22.556 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:22.556 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.556 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.557 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.557 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:26:22.557 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:22.557 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.558 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.558 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.558 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:22.558 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.559 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.559 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.559 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:26:22.559 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:22.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.560 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.560 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.560 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:26:22.561 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:22.561 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.561 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.562 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:22.562 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.562 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.562 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.563 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:26:22.563 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:22.563 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.563 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.563 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.564 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:26:22.564 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:22.564 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.565 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.565 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.565 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:26:22.565 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:26:22.566 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:26:22.566 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:26:22.566 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:22.566 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:22.567 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:22.567 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.567 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.567 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.568 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:26:22.568 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:26:22.568 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:22.568 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:22.569 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:22.569 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:22.569 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:22.569 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:22.569 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:22.570 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 99, 2021-12-17T18:26:22.570 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:22.570 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:22.570 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:22.571 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.571 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.571 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.571 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:26:22.571 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:22.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.572 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.572 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.572 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:26:22.573 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:22.573 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.573 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.573 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.573 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:22.574 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.574 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.574 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.574 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:26:22.575 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:22.575 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.575 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.575 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.576 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:26:22.576 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:22.576 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.576 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.577 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:22.577 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.577 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.577 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.578 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:26:22.578 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:22.578 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.578 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.579 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.579 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:26:22.579 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:22.579 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.580 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.580 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:22.580 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.580 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.581 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.581 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:26:22.581 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:22.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.582 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.582 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.582 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:26:22.582 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:22.582 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.583 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.583 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.583 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:26:22.583 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:26:22.584 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:26:22.584 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:26:22.584 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:22.584 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:22.585 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:22.585 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.585 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.585 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:26:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:26:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:22.587 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:22.587 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:22.587 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:22.587 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:22.587 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 100, 2021-12-17T18:26:22.588 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:22.588 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:22.588 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:22.588 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.589 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.589 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.589 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:26:22.589 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:26:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:22.592 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.592 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.592 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.592 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:26:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:26:22.594 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:22.594 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.594 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.595 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:22.595 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.595 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.595 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.595 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:26:22.596 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:22.596 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.596 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.596 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.597 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:26:22.597 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:22.597 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.597 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.598 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:22.598 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.598 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.598 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.599 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:26:22.599 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:22.599 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.599 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.600 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.600 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:26:22.600 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:22.600 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.601 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.601 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.601 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:26:22.601 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:26:22.601 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:26:22.602 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:26:22.602 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:22.602 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:22.602 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:22.603 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.603 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.603 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.603 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:26:22.604 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:26:22.604 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:22.604 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:22.604 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:22.604 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:22.605 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:22.605 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:22.605 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:22.605 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 100, 2021-12-17T18:26:22.606 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:22.606 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:22.606 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:22.606 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.607 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.607 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.607 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:26:22.607 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:22.607 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.608 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.608 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.608 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:26:22.608 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:22.609 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.609 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.609 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:22.610 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.610 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.610 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.610 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:26:22.610 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:22.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.611 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.611 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.611 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:26:22.612 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:22.612 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.612 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.612 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.613 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:22.613 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.613 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.613 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.613 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:26:22.614 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:22.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.614 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.614 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.615 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:26:22.615 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:22.615 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.615 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.616 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:22.616 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:22.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.616 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:22.617 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:26:22.617 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:22.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.617 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:22.618 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:26:22.618 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:22.618 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.619 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.619 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.619 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:26:22.619 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:26:22.619 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:26:22.620 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:26:22.620 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:22.620 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:22.620 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:22.621 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:22.621 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.621 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:26:22.621 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:26:22.621 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.622 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:26:22.622 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:22.622 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:22.622 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:22.623 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:22.623 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:22.623 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:26:22.623 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:22.624 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.624 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.624 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:26:22.624 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:22.625 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:22.625 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:22.625 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:22.626 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:22.626 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:26:22.626 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:22.626 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.626 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.627 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:26:22.627 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:22.627 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:22.627 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:22.628 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:22.628 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:22.628 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:26:22.628 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:22.629 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.629 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.629 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:26:22.629 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:22.630 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:22.630 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:22.630 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:22.630 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:22.631 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:26:22.631 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:22.631 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.631 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.631 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:26:22.632 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:22.632 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:22.632 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:22.632 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:22.633 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:22.633 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:26:22.633 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:22.633 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.634 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.634 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:26:22.634 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:22.634 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:22.634 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:22.635 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:22.635 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:22.635 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:26:22.635 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:22.636 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.636 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.636 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:26:22.636 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:22.636 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:22.637 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:22.637 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:22.637 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:22.637 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:26:22.638 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:22.638 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.638 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:22.638 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:26:22.639 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:22.639 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:22.639 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:22.639 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:22.639 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:22.640 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:26:22.640 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:22.640 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.640 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:26:22.641 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:26:22.641 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:26:22.641 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:26:22.641 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:26:22.641 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": {}, 2021-12-17T18:26:22.642 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:26:22.642 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:26:22.642 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:26:22.642 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:26:22.643 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:26:22.643 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:26:22.643 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:26:22.643 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:26:22.643 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:22.644 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:22.644 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:26:22.644 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:26:22.644 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:26:22.644 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:26:22.645 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:26:22.645 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:26:22.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.391+0000 7f21de6eb700 1 -- 172.21.15.62:0/1524343416 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f21bc053610 msgr2=0x7f21bc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:22.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.391+0000 7f21de6eb700 1 --2- 172.21.15.62:0/1524343416 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f21bc053610 0x7f21bc055ad0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f21c000b000 tx=0x7f21c0000bc0).stop 2021-12-17T18:26:22.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.391+0000 7f21de6eb700 1 -- 172.21.15.62:0/1524343416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21d80a7bb0 msgr2=0x7f21d80b4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:22.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.391+0000 7f21de6eb700 1 --2- 172.21.15.62:0/1524343416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21d80a7bb0 0x7f21d80b4280 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f21c0001110 tx=0x7f21c8014000).stop 2021-12-17T18:26:22.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.391+0000 7f21de6eb700 1 -- 172.21.15.62:0/1524343416 shutdown_connections 2021-12-17T18:26:22.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.391+0000 7f21de6eb700 1 --2- 172.21.15.62:0/1524343416 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f21bc053610 0x7f21bc055ad0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:22.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.391+0000 7f21de6eb700 1 --2- 172.21.15.62:0/1524343416 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f21d80b21f0 0x7f21d814c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:22.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.391+0000 7f21de6eb700 1 --2- 172.21.15.62:0/1524343416 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f21d80b1730 0x7f21d814c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:22.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.391+0000 7f21de6eb700 1 --2- 172.21.15.62:0/1524343416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21d80a7bb0 0x7f21d80b4280 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:22.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.391+0000 7f21de6eb700 1 -- 172.21.15.62:0/1524343416 >> 172.21.15.62:0/1524343416 conn(0x7f21d805f730 msgr2=0x7f21d805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:22.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.395+0000 7f21de6eb700 1 -- 172.21.15.62:0/1524343416 shutdown_connections 2021-12-17T18:26:22.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.395+0000 7f21de6eb700 1 -- 172.21.15.62:0/1524343416 wait complete. 2021-12-17T18:26:22.650 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:26:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd412f700 1 Processor -- start 2021-12-17T18:26:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd412f700 1 -- start start 2021-12-17T18:26:22.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd412f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1fcc0b21f0 0x7f1fcc14aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:22.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd412f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc0b1730 0x7f1fcc0ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:22.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd412f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fcc0b2ce0 con 0x7f1fcc0a7bb0 2021-12-17T18:26:22.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd412f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fcc147870 con 0x7f1fcc0b21f0 2021-12-17T18:26:22.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd412f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc0b2f10 con 0x7f1fcc0b1730 2021-12-17T18:26:22.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd26cc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1fcc0a7bb0 0x7f1fcc067120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38238/0 (socket says 172.21.15.62:38238) 2021-12-17T18:26:22.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd26cc700 1 -- 172.21.15.62:0/3586462087 learned_addr learned my addr 172.21.15.62:0/3586462087 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:22.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd1ecb700 1 --2- 172.21.15.62:0/3586462087 >> v2:172.21.15.109:3300/0 conn(0x7f1fcc0b21f0 0x7f1fcc14aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:22.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd16ca700 1 --2- 172.21.15.62:0/3586462087 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc0b1730 0x7f1fcc0ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:22.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd0ec9700 1 -- 172.21.15.62:0/3586462087 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032433112 0 0) 0x7f1fcc0b2ce0 con 0x7f1fcc0a7bb0 2021-12-17T18:26:22.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd0ec9700 1 -- 172.21.15.62:0/3586462087 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fb8003260 con 0x7f1fcc0a7bb0 2021-12-17T18:26:22.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd1ecb700 1 -- 172.21.15.62:0/3586462087 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc0b1730 msgr2=0x7f1fcc0ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:22.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd1ecb700 1 --2- 172.21.15.62:0/3586462087 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc0b1730 0x7f1fcc0ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:22.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd1ecb700 1 -- 172.21.15.62:0/3586462087 >> v1:172.21.15.62:6789/0 conn(0x7f1fcc0a7bb0 legacy=0x7f1fcc067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:22.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd1ecb700 1 -- 172.21.15.62:0/3586462087 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc0aca60 con 0x7f1fcc0b21f0 2021-12-17T18:26:22.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd1ecb700 1 --2- 172.21.15.62:0/3586462087 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fcc0b21f0 0x7f1fcc14aea0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f1fc40032f0 tx=0x7f1fc40091d0).ready entity=mon.1 client_cookie=55b0007cd52179a0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:22.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd0ec9700 1 -- 172.21.15.62:0/3586462087 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fc400b600 con 0x7f1fcc0b21f0 2021-12-17T18:26:22.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd0ec9700 1 -- 172.21.15.62:0/3586462087 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc400b760 con 0x7f1fcc0b21f0 2021-12-17T18:26:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.759+0000 7f1fd0ec9700 1 -- 172.21.15.62:0/3586462087 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fc400b8d0 con 0x7f1fcc0b21f0 2021-12-17T18:26:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd412f700 1 -- 172.21.15.62:0/3586462087 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fcc0b21f0 msgr2=0x7f1fcc14aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd412f700 1 --2- 172.21.15.62:0/3586462087 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fcc0b21f0 0x7f1fcc14aea0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f1fc40032f0 tx=0x7f1fc40091d0).stop 2021-12-17T18:26:22.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd412f700 1 -- 172.21.15.62:0/3586462087 shutdown_connections 2021-12-17T18:26:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd412f700 1 --2- 172.21.15.62:0/3586462087 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc0b1730 0x7f1fcc0ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd412f700 1 --2- 172.21.15.62:0/3586462087 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fcc0b21f0 0x7f1fcc14aea0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd412f700 1 -- 172.21.15.62:0/3586462087 >> 172.21.15.62:0/3586462087 conn(0x7f1fcc05f730 msgr2=0x7f1fcc05fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd412f700 1 -- 172.21.15.62:0/3586462087 shutdown_connections 2021-12-17T18:26:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd412f700 1 -- 172.21.15.62:0/3586462087 wait complete. 2021-12-17T18:26:22.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd412f700 1 Processor -- start 2021-12-17T18:26:22.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd412f700 1 -- start start 2021-12-17T18:26:22.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd412f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fcc0a7bb0 0x7f1fcc14b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:22.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd412f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b1730 0x7f1fcc0b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:22.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd412f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc0b21f0 0x7f1fcc146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:22.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd412f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc157760 con 0x7f1fcc0b1730 2021-12-17T18:26:22.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd412f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc157a00 con 0x7f1fcc0a7bb0 2021-12-17T18:26:22.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd412f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc14eee0 con 0x7f1fcc0b21f0 2021-12-17T18:26:22.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd16ca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b1730 0x7f1fcc0b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:22.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd16ca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b1730 0x7f1fcc0b4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54662/0 (socket says 172.21.15.62:54662) 2021-12-17T18:26:22.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd16ca700 1 -- 172.21.15.62:0/2597234976 learned_addr learned my addr 172.21.15.62:0/2597234976 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:22.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd1ecb700 1 --2- 172.21.15.62:0/2597234976 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fcc0a7bb0 0x7f1fcc14b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:22.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.763+0000 7f1fd26cc700 1 --2- 172.21.15.62:0/2597234976 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc0b21f0 0x7f1fcc146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:22.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.767+0000 7f1fd16ca700 1 -- 172.21.15.62:0/2597234976 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc0b21f0 msgr2=0x7f1fcc146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:22.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.767+0000 7f1fd16ca700 1 --2- 172.21.15.62:0/2597234976 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc0b21f0 0x7f1fcc146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:22.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.767+0000 7f1fd16ca700 1 -- 172.21.15.62:0/2597234976 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fcc0a7bb0 msgr2=0x7f1fcc14b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:22.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.767+0000 7f1fd16ca700 1 --2- 172.21.15.62:0/2597234976 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fcc0a7bb0 0x7f1fcc14b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:22.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.767+0000 7f1fd16ca700 1 -- 172.21.15.62:0/2597234976 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc4009470 con 0x7f1fcc0b1730 2021-12-17T18:26:22.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.767+0000 7f1fd26cc700 1 --2- 172.21.15.62:0/2597234976 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc0b21f0 0x7f1fcc146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:22.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.767+0000 7f1fd16ca700 1 --2- 172.21.15.62:0/2597234976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b1730 0x7f1fcc0b4000 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f1fc000c000 tx=0x7f1fc0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:22.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.767+0000 7f1fcaffd700 1 -- 172.21.15.62:0/2597234976 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fc0010780 con 0x7f1fcc0b1730 2021-12-17T18:26:22.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.767+0000 7f1fcaffd700 1 -- 172.21.15.62:0/2597234976 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc00108e0 con 0x7f1fcc0b1730 2021-12-17T18:26:22.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.767+0000 7f1fd412f700 1 -- 172.21.15.62:0/2597234976 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fcc14bd20 con 0x7f1fcc0b1730 2021-12-17T18:26:22.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.767+0000 7f1fcaffd700 1 -- 172.21.15.62:0/2597234976 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fc0010c40 con 0x7f1fcc0b1730 2021-12-17T18:26:22.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.767+0000 7f1fd412f700 1 -- 172.21.15.62:0/2597234976 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fcc14f380 con 0x7f1fcc0b1730 2021-12-17T18:26:22.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.767+0000 7f1fcaffd700 1 -- 172.21.15.62:0/2597234976 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1fc001c460 con 0x7f1fcc0b1730 2021-12-17T18:26:22.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.767+0000 7f1fcaffd700 1 --2- 172.21.15.62:0/2597234976 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fac053610 0x7f1fac055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:22.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.767+0000 7f1fd412f700 1 -- 172.21.15.62:0/2597234976 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fcc0573d0 con 0x7f1fcc0b1730 2021-12-17T18:26:22.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.767+0000 7f1fcaffd700 1 -- 172.21.15.62:0/2597234976 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1fc006be00 con 0x7f1fcc0b1730 2021-12-17T18:26:22.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.767+0000 7f1fd1ecb700 1 --2- 172.21.15.62:0/2597234976 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fac053610 0x7f1fac055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:22.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.771+0000 7f1fd1ecb700 1 --2- 172.21.15.62:0/2597234976 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fac053610 0x7f1fac055ad0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f1fc401b000 tx=0x7f1fc4016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:22.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.775+0000 7f1fcaffd700 1 -- 172.21.15.62:0/2597234976 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1fc0042e60 con 0x7f1fcc0b1730 2021-12-17T18:26:22.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.939+0000 7f1fd412f700 1 -- 172.21.15.62:0/2597234976 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1fcc0af860 con 0x7f1fcc0b1730 2021-12-17T18:26:22.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.943+0000 7f1fcaffd700 1 -- 172.21.15.62:0/2597234976 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f1fc0046480 con 0x7f1fcc0b1730 2021-12-17T18:26:22.949 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:22.949 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":49,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/965882605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":965882605},{"type":"v1","addr":"172.21.15.109:6835","nonce":965882605}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:26:10.256074+0000","modified":"2021-12-17T18:26:11.259115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/1972867454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1972867454},{"type":"v1","addr":"172.21.15.62:6833","nonce":1972867454}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-12-17T18:26:22.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.943+0000 7f1fd412f700 1 -- 172.21.15.62:0/2597234976 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fac053610 msgr2=0x7f1fac055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:22.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.943+0000 7f1fd412f700 1 --2- 172.21.15.62:0/2597234976 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fac053610 0x7f1fac055ad0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f1fc401b000 tx=0x7f1fc4016000).stop 2021-12-17T18:26:22.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.943+0000 7f1fd412f700 1 -- 172.21.15.62:0/2597234976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b1730 msgr2=0x7f1fcc0b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:22.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.943+0000 7f1fd412f700 1 --2- 172.21.15.62:0/2597234976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b1730 0x7f1fcc0b4000 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f1fc000c000 tx=0x7f1fc0006df0).stop 2021-12-17T18:26:22.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.943+0000 7f1fd412f700 1 -- 172.21.15.62:0/2597234976 shutdown_connections 2021-12-17T18:26:22.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.943+0000 7f1fd412f700 1 --2- 172.21.15.62:0/2597234976 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fac053610 0x7f1fac055ad0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:22.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.943+0000 7f1fd412f700 1 --2- 172.21.15.62:0/2597234976 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc0b21f0 0x7f1fcc146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:22.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.943+0000 7f1fd412f700 1 --2- 172.21.15.62:0/2597234976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b1730 0x7f1fcc0b4000 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:22.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.943+0000 7f1fd412f700 1 --2- 172.21.15.62:0/2597234976 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fcc0a7bb0 0x7f1fcc14b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:22.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.943+0000 7f1fd412f700 1 -- 172.21.15.62:0/2597234976 >> 172.21.15.62:0/2597234976 conn(0x7f1fcc05f730 msgr2=0x7f1fcc0ad470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:22.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.943+0000 7f1fd412f700 1 -- 172.21.15.62:0/2597234976 shutdown_connections 2021-12-17T18:26:22.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:22.943+0000 7f1fd412f700 1 -- 172.21.15.62:0/2597234976 wait complete. 2021-12-17T18:26:22.955 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 49 2021-12-17T18:26:22.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-12-17T18:26:23.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.055+0000 7f87c69ac700 1 Processor -- start 2021-12-17T18:26:23.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.055+0000 7f87c69ac700 1 -- start start 2021-12-17T18:26:23.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87c69ac700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f87c0067830 0x7f87c0146940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:23.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87c69ac700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c0067c10 con 0x7f87c00aca60 2021-12-17T18:26:23.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87c69ac700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c0060520 con 0x7f87c0147540 2021-12-17T18:26:23.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87c69ac700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00acf00 con 0x7f87c0067830 2021-12-17T18:26:23.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87bf7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f87c00aca60 0x7f87c0146e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38248/0 (socket says 172.21.15.62:38248) 2021-12-17T18:26:23.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87bf7fe700 1 -- 172.21.15.62:0/1664758937 learned_addr learned my addr 172.21.15.62:0/1664758937 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:23.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87bffff700 1 --2- 172.21.15.62:0/1664758937 >> v2:172.21.15.109:3300/0 conn(0x7f87c0067830 0x7f87c0146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:23.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 -- 172.21.15.62:0/1664758937 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407852481 0 0) 0x7f87c0067c10 con 0x7f87c00aca60 2021-12-17T18:26:23.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 -- 172.21.15.62:0/1664758937 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87ac003260 con 0x7f87c00aca60 2021-12-17T18:26:23.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 -- 172.21.15.62:0/1664758937 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893295310 0 0) 0x7f87c0060520 con 0x7f87c0147540 2021-12-17T18:26:23.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 -- 172.21.15.62:0/1664758937 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87c0067c10 con 0x7f87c0147540 2021-12-17T18:26:23.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 -- 172.21.15.62:0/1664758937 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3146939590 0 0) 0x7f87ac003260 con 0x7f87c00aca60 2021-12-17T18:26:23.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 -- 172.21.15.62:0/1664758937 >> v2:172.21.15.109:3300/0 conn(0x7f87c0067830 msgr2=0x7f87c0146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:23.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 --2- 172.21.15.62:0/1664758937 >> v2:172.21.15.109:3300/0 conn(0x7f87c0067830 0x7f87c0146940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:23.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 -- 172.21.15.62:0/1664758937 >> v1:172.21.15.109:6789/0 conn(0x7f87c0147540 legacy=0x7f87c00b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:23.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 -- 172.21.15.62:0/1664758937 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c00b12a0 con 0x7f87c00aca60 2021-12-17T18:26:23.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 -- 172.21.15.62:0/1664758937 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f87b00019e0 con 0x7f87c00aca60 2021-12-17T18:26:23.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 -- 172.21.15.62:0/1664758937 >> v1:172.21.15.62:6789/0 conn(0x7f87c00aca60 legacy=0x7f87c0146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:23.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 --2- 172.21.15.62:0/1664758937 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f87ac0038e0 0x7f87ac003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:23.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 --2- 172.21.15.62:0/1664758937 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f87ac004500 0x7f87ac004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:23.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 --2- 172.21.15.62:0/1664758937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87ac004e70 0x7f87ac00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:23.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 -- 172.21.15.62:0/1664758937 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00acf00 con 0x7f87ac004e70 2021-12-17T18:26:23.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 -- 172.21.15.62:0/1664758937 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac00bcf0 con 0x7f87ac0038e0 2021-12-17T18:26:23.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 -- 172.21.15.62:0/1664758937 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac00beb0 con 0x7f87ac004500 2021-12-17T18:26:23.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87c4f49700 1 --2- 172.21.15.62:0/1664758937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87ac004e70 0x7f87ac00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:23.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87bffff700 1 --2- 172.21.15.62:0/1664758937 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f87ac0038e0 0x7f87ac003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:23.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87bf7fe700 1 --2- 172.21.15.62:0/1664758937 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f87ac004500 0x7f87ac004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:23.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87c4f49700 1 -- 172.21.15.62:0/1664758937 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f87ac004500 msgr2=0x7f87ac004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:23.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87c4f49700 1 --2- 172.21.15.62:0/1664758937 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f87ac004500 0x7f87ac004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:23.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87c4f49700 1 -- 172.21.15.62:0/1664758937 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f87ac0038e0 msgr2=0x7f87ac003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:23.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87c4f49700 1 --2- 172.21.15.62:0/1664758937 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f87ac0038e0 0x7f87ac003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:23.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87c4f49700 1 -- 172.21.15.62:0/1664758937 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac003260 con 0x7f87ac004e70 2021-12-17T18:26:23.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87bffff700 1 --2- 172.21.15.62:0/1664758937 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f87ac0038e0 0x7f87ac003ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:23.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87c4f49700 1 -- 172.21.15.62:0/1664758937 reap_dead start 2021-12-17T18:26:23.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87c4f49700 1 --2- 172.21.15.62:0/1664758937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87ac004e70 0x7f87ac00b750 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f87b8001110 tx=0x7f87b8007a00).ready entity=mon.0 client_cookie=26b7d0ebc10b9196 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:23.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 -- 172.21.15.62:0/1664758937 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87b8007030 con 0x7f87ac004e70 2021-12-17T18:26:23.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 -- 172.21.15.62:0/1664758937 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b8007190 con 0x7f87ac004e70 2021-12-17T18:26:23.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87beffd700 1 -- 172.21.15.62:0/1664758937 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87b8006510 con 0x7f87ac004e70 2021-12-17T18:26:23.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87c69ac700 1 -- 172.21.15.62:0/1664758937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87ac004e70 msgr2=0x7f87ac00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:23.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.059+0000 7f87c69ac700 1 --2- 172.21.15.62:0/1664758937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87ac004e70 0x7f87ac00b750 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f87b8001110 tx=0x7f87b8007a00).stop 2021-12-17T18:26:23.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.063+0000 7f87c69ac700 1 -- 172.21.15.62:0/1664758937 shutdown_connections 2021-12-17T18:26:23.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.063+0000 7f87c69ac700 1 --2- 172.21.15.62:0/1664758937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87ac004e70 0x7f87ac00b750 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:23.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.063+0000 7f87c69ac700 1 -- 172.21.15.62:0/1664758937 >> 172.21.15.62:0/1664758937 conn(0x7f87c005f730 msgr2=0x7f87c005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:23.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.063+0000 7f87c69ac700 1 -- 172.21.15.62:0/1664758937 shutdown_connections 2021-12-17T18:26:23.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.063+0000 7f87c69ac700 1 -- 172.21.15.62:0/1664758937 wait complete. 2021-12-17T18:26:23.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.063+0000 7f87c69ac700 1 Processor -- start 2021-12-17T18:26:23.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.063+0000 7f87c69ac700 1 -- start start 2021-12-17T18:26:23.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87c69ac700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87ac004e70 0x7f87c009e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:23.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87c69ac700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f87c009fe80 0x7f87c00abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:23.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87c69ac700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f87c00a1bf0 0x7f87c00a2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:23.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87c69ac700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00a0300 con 0x7f87ac004e70 2021-12-17T18:26:23.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87c69ac700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00a2540 con 0x7f87c00a1bf0 2021-12-17T18:26:23.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87c69ac700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c009f000 con 0x7f87c009fe80 2021-12-17T18:26:23.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87bffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87ac004e70 0x7f87c009e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:23.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87bffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87ac004e70 0x7f87c009e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54680/0 (socket says 172.21.15.62:54680) 2021-12-17T18:26:23.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87bffff700 1 -- 172.21.15.62:0/1363364764 learned_addr learned my addr 172.21.15.62:0/1363364764 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:23.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87bf7fe700 1 --2- 172.21.15.62:0/1363364764 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f87c009fe80 0x7f87c00abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:23.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87c4f49700 1 --2- 172.21.15.62:0/1363364764 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f87c00a1bf0 0x7f87c00a2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:23.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87bffff700 1 -- 172.21.15.62:0/1363364764 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f87c009fe80 msgr2=0x7f87c00abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:23.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87bffff700 1 --2- 172.21.15.62:0/1363364764 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f87c009fe80 0x7f87c00abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:23.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87bffff700 1 -- 172.21.15.62:0/1363364764 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f87c00a1bf0 msgr2=0x7f87c00a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:23.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87bffff700 1 --2- 172.21.15.62:0/1363364764 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f87c00a1bf0 0x7f87c00a2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:23.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87bffff700 1 -- 172.21.15.62:0/1363364764 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c009f2a0 con 0x7f87ac004e70 2021-12-17T18:26:23.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87bffff700 1 --2- 172.21.15.62:0/1363364764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87ac004e70 0x7f87c009e9d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f87c00a1ad0 tx=0x7f87b4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:23.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87bd7fa700 1 -- 172.21.15.62:0/1363364764 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87b40136b0 con 0x7f87ac004e70 2021-12-17T18:26:23.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87bd7fa700 1 -- 172.21.15.62:0/1363364764 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b4013810 con 0x7f87ac004e70 2021-12-17T18:26:23.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87c69ac700 1 -- 172.21.15.62:0/1363364764 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c00a1750 con 0x7f87ac004e70 2021-12-17T18:26:23.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87bd7fa700 1 -- 172.21.15.62:0/1363364764 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87b4013b70 con 0x7f87ac004e70 2021-12-17T18:26:23.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87c69ac700 1 -- 172.21.15.62:0/1363364764 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c0155e60 con 0x7f87ac004e70 2021-12-17T18:26:23.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.067+0000 7f87c69ac700 1 -- 172.21.15.62:0/1363364764 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c00a18e0 con 0x7f87ac004e70 2021-12-17T18:26:23.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.071+0000 7f87bd7fa700 1 -- 172.21.15.62:0/1363364764 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f87b4013cd0 con 0x7f87ac004e70 2021-12-17T18:26:23.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.071+0000 7f87bd7fa700 1 --2- 172.21.15.62:0/1363364764 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f87a00536a0 0x7f87a0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:23.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.071+0000 7f87bd7fa700 1 -- 172.21.15.62:0/1363364764 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f87b406c1d0 con 0x7f87ac004e70 2021-12-17T18:26:23.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.071+0000 7f87bf7fe700 1 --2- 172.21.15.62:0/1363364764 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f87a00536a0 0x7f87a0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:23.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.071+0000 7f87bf7fe700 1 --2- 172.21.15.62:0/1363364764 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f87a00536a0 0x7f87a0055b60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f87b000d000 tx=0x7f87b0007040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:23.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.075+0000 7f87bd7fa700 1 -- 172.21.15.62:0/1363364764 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f87b4043330 con 0x7f87ac004e70 2021-12-17T18:26:23.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.235+0000 7f87c69ac700 1 -- 172.21.15.62:0/1363364764 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f87c00b0fb0 con 0x7f87ac004e70 2021-12-17T18:26:23.725 INFO:tasks.ceph.mon.a.smithi062.stderr:2021-12-17T18:26:23.719+0000 7f8d3b366700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-12-17T18:26:23.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.735+0000 7f87bd7fa700 1 -- 172.21.15.62:0/1363364764 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7f87b4046950 con 0x7f87ac004e70 2021-12-17T18:26:23.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.739+0000 7f87c69ac700 1 -- 172.21.15.62:0/1363364764 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f87a00536a0 msgr2=0x7f87a0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:23.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.739+0000 7f87c69ac700 1 --2- 172.21.15.62:0/1363364764 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f87a00536a0 0x7f87a0055b60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f87b000d000 tx=0x7f87b0007040).stop 2021-12-17T18:26:23.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.739+0000 7f87c69ac700 1 -- 172.21.15.62:0/1363364764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87ac004e70 msgr2=0x7f87c009e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:23.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.739+0000 7f87c69ac700 1 --2- 172.21.15.62:0/1363364764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87ac004e70 0x7f87c009e9d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f87c00a1ad0 tx=0x7f87b4008040).stop 2021-12-17T18:26:23.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.739+0000 7f87c69ac700 1 -- 172.21.15.62:0/1363364764 shutdown_connections 2021-12-17T18:26:23.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.739+0000 7f87c69ac700 1 --2- 172.21.15.62:0/1363364764 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f87a00536a0 0x7f87a0055b60 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:23.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.739+0000 7f87c69ac700 1 --2- 172.21.15.62:0/1363364764 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f87c00a1bf0 0x7f87c00a2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:23.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.739+0000 7f87c69ac700 1 --2- 172.21.15.62:0/1363364764 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f87c009fe80 0x7f87c00abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:23.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.739+0000 7f87c69ac700 1 --2- 172.21.15.62:0/1363364764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87ac004e70 0x7f87c009e9d0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:23.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.739+0000 7f87c69ac700 1 -- 172.21.15.62:0/1363364764 >> 172.21.15.62:0/1363364764 conn(0x7f87c005f730 msgr2=0x7f87c00b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:23.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.739+0000 7f87c69ac700 1 -- 172.21.15.62:0/1363364764 shutdown_connections 2021-12-17T18:26:23.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.739+0000 7f87c69ac700 1 -- 172.21.15.62:0/1363364764 wait complete. 2021-12-17T18:26:23.751 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-12-17T18:26:23.766 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:26:23.769 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:26:23.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb441b700 1 Processor -- start 2021-12-17T18:26:23.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb441b700 1 -- start start 2021-12-17T18:26:23.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb441b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bac0b21f0 0x7f7bac14aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:23.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb441b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7bac0a7bb0 0x7f7bac067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:23.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb441b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bac0b2ce0 con 0x7f7bac0b1730 2021-12-17T18:26:23.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb441b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bac147870 con 0x7f7bac0a7bb0 2021-12-17T18:26:23.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb441b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac0b2f10 con 0x7f7bac0b21f0 2021-12-17T18:26:23.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb29b8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7bac0a7bb0 0x7f7bac067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:23.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb19b6700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7bac0b1730 0x7f7bac0ace90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38280/0 (socket says 172.21.15.62:38280) 2021-12-17T18:26:23.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb19b6700 1 -- 172.21.15.62:0/1731033948 learned_addr learned my addr 172.21.15.62:0/1731033948 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:23.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb21b7700 1 --2- 172.21.15.62:0/1731033948 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bac0b21f0 0x7f7bac14aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:23.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb29b8700 1 -- 172.21.15.62:0/1731033948 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bac0b21f0 msgr2=0x7f7bac14aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:23.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb29b8700 1 --2- 172.21.15.62:0/1731033948 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bac0b21f0 0x7f7bac14aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:23.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb29b8700 1 -- 172.21.15.62:0/1731033948 >> v1:172.21.15.62:6789/0 conn(0x7f7bac0b1730 legacy=0x7f7bac0ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:23.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb29b8700 1 -- 172.21.15.62:0/1731033948 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bac0aca60 con 0x7f7bac0a7bb0 2021-12-17T18:26:23.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb29b8700 1 --2- 172.21.15.62:0/1731033948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0a7bb0 0x7f7bac067120 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f7ba40032f0 tx=0x7f7ba40091d0).ready entity=mon.0 client_cookie=a4534d9f20cf82b5 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:23.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb11b5700 1 -- 172.21.15.62:0/1731033948 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ba400b6c0 con 0x7f7bac0a7bb0 2021-12-17T18:26:23.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb11b5700 1 -- 172.21.15.62:0/1731033948 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba400b820 con 0x7f7bac0a7bb0 2021-12-17T18:26:23.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb11b5700 1 -- 172.21.15.62:0/1731033948 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ba400b990 con 0x7f7bac0a7bb0 2021-12-17T18:26:23.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb441b700 1 -- 172.21.15.62:0/1731033948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0a7bb0 msgr2=0x7f7bac067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:23.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.871+0000 7f7bb441b700 1 --2- 172.21.15.62:0/1731033948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0a7bb0 0x7f7bac067120 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f7ba40032f0 tx=0x7f7ba40091d0).stop 2021-12-17T18:26:23.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.875+0000 7f7bb441b700 1 -- 172.21.15.62:0/1731033948 shutdown_connections 2021-12-17T18:26:23.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.875+0000 7f7bb441b700 1 --2- 172.21.15.62:0/1731033948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0a7bb0 0x7f7bac067120 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:23.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.875+0000 7f7bb441b700 1 --2- 172.21.15.62:0/1731033948 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bac0b21f0 0x7f7bac14aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:23.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.875+0000 7f7bb441b700 1 -- 172.21.15.62:0/1731033948 >> 172.21.15.62:0/1731033948 conn(0x7f7bac05f730 msgr2=0x7f7bac05fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:23.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.875+0000 7f7bb441b700 1 -- 172.21.15.62:0/1731033948 shutdown_connections 2021-12-17T18:26:23.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.875+0000 7f7bb441b700 1 -- 172.21.15.62:0/1731033948 wait complete. 2021-12-17T18:26:23.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.875+0000 7f7bb441b700 1 Processor -- start 2021-12-17T18:26:23.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.875+0000 7f7bb441b700 1 -- start start 2021-12-17T18:26:23.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb441b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bac0a7bb0 0x7f7bac0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:23.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb441b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bac0b1730 0x7f7bac15a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:23.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb441b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0b21f0 0x7f7bac063a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:23.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb441b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac0a95b0 con 0x7f7bac0b21f0 2021-12-17T18:26:23.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb441b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac0a9850 con 0x7f7bac0b1730 2021-12-17T18:26:23.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb441b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac0635a0 con 0x7f7bac0a7bb0 2021-12-17T18:26:23.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb29b8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0b21f0 0x7f7bac063a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:23.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb29b8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0b21f0 0x7f7bac063a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54710/0 (socket says 172.21.15.62:54710) 2021-12-17T18:26:23.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb29b8700 1 -- 172.21.15.62:0/1069167146 learned_addr learned my addr 172.21.15.62:0/1069167146 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:23.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb21b7700 1 --2- 172.21.15.62:0/1069167146 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bac0a7bb0 0x7f7bac0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:23.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb19b6700 1 --2- 172.21.15.62:0/1069167146 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bac0b1730 0x7f7bac15a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:23.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb29b8700 1 -- 172.21.15.62:0/1069167146 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bac0a7bb0 msgr2=0x7f7bac0b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:23.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb29b8700 1 --2- 172.21.15.62:0/1069167146 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bac0a7bb0 0x7f7bac0b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:23.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb29b8700 1 -- 172.21.15.62:0/1069167146 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bac0b1730 msgr2=0x7f7bac15a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:23.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb29b8700 1 --2- 172.21.15.62:0/1069167146 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bac0b1730 0x7f7bac15a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:23.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb29b8700 1 -- 172.21.15.62:0/1069167146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba4009470 con 0x7f7bac0b21f0 2021-12-17T18:26:23.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb21b7700 1 --2- 172.21.15.62:0/1069167146 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bac0a7bb0 0x7f7bac0b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:23.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb19b6700 1 --2- 172.21.15.62:0/1069167146 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bac0b1730 0x7f7bac15a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:23.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb29b8700 1 --2- 172.21.15.62:0/1069167146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0b21f0 0x7f7bac063a40 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f7ba40032f0 tx=0x7f7ba4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:23.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7b9b7fe700 1 -- 172.21.15.62:0/1069167146 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ba400b6c0 con 0x7f7bac0b21f0 2021-12-17T18:26:23.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7b9b7fe700 1 -- 172.21.15.62:0/1069167146 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba40107a0 con 0x7f7bac0b21f0 2021-12-17T18:26:23.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb441b700 1 -- 172.21.15.62:0/1069167146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bac14d840 con 0x7f7bac0b21f0 2021-12-17T18:26:23.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7b9b7fe700 1 -- 172.21.15.62:0/1069167146 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ba4010b00 con 0x7f7bac0b21f0 2021-12-17T18:26:23.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb441b700 1 -- 172.21.15.62:0/1069167146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bac0ab420 con 0x7f7bac0b21f0 2021-12-17T18:26:23.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7bb441b700 1 -- 172.21.15.62:0/1069167146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bac063760 con 0x7f7bac0b21f0 2021-12-17T18:26:23.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.879+0000 7f7b9b7fe700 1 -- 172.21.15.62:0/1069167146 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7ba4027020 con 0x7f7bac0b21f0 2021-12-17T18:26:23.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.883+0000 7f7b9b7fe700 1 --2- 172.21.15.62:0/1069167146 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b8c053610 0x7f7b8c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:23.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.883+0000 7f7b9b7fe700 1 -- 172.21.15.62:0/1069167146 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f7ba406cf10 con 0x7f7bac0b21f0 2021-12-17T18:26:23.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.883+0000 7f7bb21b7700 1 --2- 172.21.15.62:0/1069167146 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b8c053610 0x7f7b8c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:23.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.883+0000 7f7bb21b7700 1 --2- 172.21.15.62:0/1069167146 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b8c053610 0x7f7b8c055ad0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f7b9c00b000 tx=0x7f7b9c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:23.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:23.887+0000 7f7b9b7fe700 1 -- 172.21.15.62:0/1069167146 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7ba4044020 con 0x7f7bac0b21f0 2021-12-17T18:26:24.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.055+0000 7f7bb441b700 1 -- 172.21.15.62:0/1069167146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bac0573d0 con 0x7f7bac0b21f0 2021-12-17T18:26:24.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.055+0000 7f7b9b7fe700 1 -- 172.21.15.62:0/1069167146 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+1780 (secure 0 0 0) 0x7f7ba4015090 con 0x7f7bac0b21f0 2021-12-17T18:26:24.062 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:24.062 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":50,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/965882605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":965882605},{"type":"v1","addr":"172.21.15.109:6835","nonce":965882605}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":50,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:26:10.256074+0000","modified":"2021-12-17T18:26:23.723173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-12-17T18:26:24.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.055+0000 7f7bb441b700 1 -- 172.21.15.62:0/1069167146 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b8c053610 msgr2=0x7f7b8c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:24.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.055+0000 7f7bb441b700 1 --2- 172.21.15.62:0/1069167146 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b8c053610 0x7f7b8c055ad0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f7b9c00b000 tx=0x7f7b9c008040).stop 2021-12-17T18:26:24.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.055+0000 7f7bb441b700 1 -- 172.21.15.62:0/1069167146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0b21f0 msgr2=0x7f7bac063a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:24.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.055+0000 7f7bb441b700 1 --2- 172.21.15.62:0/1069167146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0b21f0 0x7f7bac063a40 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f7ba40032f0 tx=0x7f7ba4016000).stop 2021-12-17T18:26:24.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.055+0000 7f7bb441b700 1 -- 172.21.15.62:0/1069167146 shutdown_connections 2021-12-17T18:26:24.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.055+0000 7f7bb441b700 1 --2- 172.21.15.62:0/1069167146 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7b8c053610 0x7f7b8c055ad0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:24.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.055+0000 7f7bb441b700 1 --2- 172.21.15.62:0/1069167146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0b21f0 0x7f7bac063a40 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:24.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.055+0000 7f7bb441b700 1 --2- 172.21.15.62:0/1069167146 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bac0b1730 0x7f7bac15a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:24.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.055+0000 7f7bb441b700 1 --2- 172.21.15.62:0/1069167146 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bac0a7bb0 0x7f7bac0b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:24.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.055+0000 7f7bb441b700 1 -- 172.21.15.62:0/1069167146 >> 172.21.15.62:0/1069167146 conn(0x7f7bac05f730 msgr2=0x7f7bac05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:24.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.055+0000 7f7bb441b700 1 -- 172.21.15.62:0/1069167146 shutdown_connections 2021-12-17T18:26:24.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.059+0000 7f7bb441b700 1 -- 172.21.15.62:0/1069167146 wait complete. 2021-12-17T18:26:24.068 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 50 2021-12-17T18:26:24.075 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-12-17T18:26:24.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.179+0000 7fe68080b700 1 Processor -- start 2021-12-17T18:26:24.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.179+0000 7fe68080b700 1 -- start start 2021-12-17T18:26:24.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe68080b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe67c0b1220 0x7fe67c146680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:24.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe68080b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe67c0afdd0 0x7fe67c12b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:24.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe68080b700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe67c0b2580 con 0x7fe67c0b21a0 2021-12-17T18:26:24.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe68080b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67c0632f0 con 0x7fe67c0afdd0 2021-12-17T18:26:24.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe68080b700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67c0af2d0 con 0x7fe67c0b1220 2021-12-17T18:26:24.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe67b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe67c0afdd0 0x7fe67c12b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:24.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe67b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe67c0afdd0 0x7fe67c12b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54718/0 (socket says 172.21.15.62:54718) 2021-12-17T18:26:24.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe67b59e700 1 -- 172.21.15.62:0/3524682386 learned_addr learned my addr 172.21.15.62:0/3524682386 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:24.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe67a59c700 1 --2- 172.21.15.62:0/3524682386 >> v2:172.21.15.109:3300/0 conn(0x7fe67c0b1220 0x7fe67c146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:24.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe67b59e700 1 -- 172.21.15.62:0/3524682386 >> v2:172.21.15.109:3300/0 conn(0x7fe67c0b1220 msgr2=0x7fe67c146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:24.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe67b59e700 1 --2- 172.21.15.62:0/3524682386 >> v2:172.21.15.109:3300/0 conn(0x7fe67c0b1220 0x7fe67c146680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:24.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe67b59e700 1 -- 172.21.15.62:0/3524682386 >> v1:172.21.15.109:6789/0 conn(0x7fe67c0b21a0 legacy=0x7fe67c0b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:24.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe67b59e700 1 -- 172.21.15.62:0/3524682386 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67c0af570 con 0x7fe67c0afdd0 2021-12-17T18:26:24.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe67a59c700 1 --2- 172.21.15.62:0/3524682386 >> v2:172.21.15.109:3300/0 conn(0x7fe67c0b1220 0x7fe67c146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:24.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe67b59e700 1 --2- 172.21.15.62:0/3524682386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe67c0afdd0 0x7fe67c12b2a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7fe6740032f0 tx=0x7fe674009290).ready entity=mon.0 client_cookie=438b52c451a18489 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:24.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe679d9b700 1 -- 172.21.15.62:0/3524682386 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe67400b870 con 0x7fe67c0afdd0 2021-12-17T18:26:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe679d9b700 1 -- 172.21.15.62:0/3524682386 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67400b9d0 con 0x7fe67c0afdd0 2021-12-17T18:26:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe679d9b700 1 -- 172.21.15.62:0/3524682386 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe67400bb40 con 0x7fe67c0afdd0 2021-12-17T18:26:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe68080b700 1 -- 172.21.15.62:0/3524682386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe67c0afdd0 msgr2=0x7fe67c12b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe68080b700 1 --2- 172.21.15.62:0/3524682386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe67c0afdd0 0x7fe67c12b2a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7fe6740032f0 tx=0x7fe674009290).stop 2021-12-17T18:26:24.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe68080b700 1 -- 172.21.15.62:0/3524682386 shutdown_connections 2021-12-17T18:26:24.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe68080b700 1 --2- 172.21.15.62:0/3524682386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe67c0afdd0 0x7fe67c12b2a0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:24.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe68080b700 1 --2- 172.21.15.62:0/3524682386 >> v2:172.21.15.109:3300/0 conn(0x7fe67c0b1220 0x7fe67c146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:24.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe68080b700 1 -- 172.21.15.62:0/3524682386 >> 172.21.15.62:0/3524682386 conn(0x7fe67c05c750 msgr2=0x7fe67c05cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:24.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe68080b700 1 -- 172.21.15.62:0/3524682386 shutdown_connections 2021-12-17T18:26:24.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.183+0000 7fe68080b700 1 -- 172.21.15.62:0/3524682386 wait complete. 2021-12-17T18:26:24.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe68080b700 1 Processor -- start 2021-12-17T18:26:24.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe68080b700 1 -- start start 2021-12-17T18:26:24.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe68080b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe67c0afdd0 0x7fe67c064f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:24.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe68080b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe67c0b1220 0x7fe67c156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:24.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe68080b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe67c0b21a0 0x7fe67c152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:24.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe68080b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c129dd0 con 0x7fe67c0b1220 2021-12-17T18:26:24.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe68080b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c153560 con 0x7fe67c0b21a0 2021-12-17T18:26:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe68080b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c12fb50 con 0x7fe67c0afdd0 2021-12-17T18:26:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe67a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe67c0b1220 0x7fe67c156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe67b59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe67c0b21a0 0x7fe67c152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe67b59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe67c0b21a0 0x7fe67c152540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:33042/0 (socket says 172.21.15.62:33042) 2021-12-17T18:26:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe67a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe67c0b1220 0x7fe67c156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54722/0 (socket says 172.21.15.62:54722) 2021-12-17T18:26:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe67b59e700 1 -- 172.21.15.62:0/3429595663 learned_addr learned my addr 172.21.15.62:0/3429595663 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe67ad9d700 1 --2- 172.21.15.62:0/3429595663 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe67c0afdd0 0x7fe67c064f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe67a59c700 1 -- 172.21.15.62:0/3429595663 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe67c0afdd0 msgr2=0x7fe67c064f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe67a59c700 1 --2- 172.21.15.62:0/3429595663 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe67c0afdd0 0x7fe67c064f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:24.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe67a59c700 1 -- 172.21.15.62:0/3429595663 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe67c0b21a0 msgr2=0x7fe67c152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe67a59c700 1 --2- 172.21.15.62:0/3429595663 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe67c0b21a0 0x7fe67c152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe67a59c700 1 -- 172.21.15.62:0/3429595663 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66400b180 con 0x7fe67c0b1220 2021-12-17T18:26:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe67a59c700 1 --2- 172.21.15.62:0/3429595663 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe67c0b1220 0x7fe67c156360 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7fe67c155b40 tx=0x7fe664006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe673fff700 1 -- 172.21.15.62:0/3429595663 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe664010780 con 0x7fe67c0b1220 2021-12-17T18:26:24.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe673fff700 1 -- 172.21.15.62:0/3429595663 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6640108e0 con 0x7fe67c0b1220 2021-12-17T18:26:24.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe68080b700 1 -- 172.21.15.62:0/3429595663 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe674009530 con 0x7fe67c0b1220 2021-12-17T18:26:24.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe673fff700 1 -- 172.21.15.62:0/3429595663 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe664010c40 con 0x7fe67c0b1220 2021-12-17T18:26:24.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.187+0000 7fe68080b700 1 -- 172.21.15.62:0/3429595663 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67c12b830 con 0x7fe67c0b1220 2021-12-17T18:26:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.191+0000 7fe68080b700 1 -- 172.21.15.62:0/3429595663 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe67c0b0650 con 0x7fe67c0b1220 2021-12-17T18:26:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.191+0000 7fe673fff700 1 -- 172.21.15.62:0/3429595663 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe66401c460 con 0x7fe67c0b1220 2021-12-17T18:26:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.191+0000 7fe673fff700 1 --2- 172.21.15.62:0/3429595663 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe660053580 0x7fe660055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.191+0000 7fe673fff700 1 -- 172.21.15.62:0/3429595663 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe66406bda0 con 0x7fe67c0b1220 2021-12-17T18:26:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.191+0000 7fe67ad9d700 1 --2- 172.21.15.62:0/3429595663 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe660053580 0x7fe660055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.191+0000 7fe67ad9d700 1 --2- 172.21.15.62:0/3429595663 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe660053580 0x7fe660055a40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fe66c00d000 tx=0x7fe66c007b70).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.199+0000 7fe673fff700 1 -- 172.21.15.62:0/3429595663 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe664042e50 con 0x7fe67c0b1220 2021-12-17T18:26:24.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:24.363+0000 7fe68080b700 1 -- 172.21.15.62:0/3429595663 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe67c0573d0 con 0x7fe67c0b1220 2021-12-17T18:26:25.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.247+0000 7fe673fff700 1 -- 172.21.15.62:0/3429595663 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe664046470 con 0x7fe67c0b1220 2021-12-17T18:26:25.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.251+0000 7fe68080b700 1 -- 172.21.15.62:0/3429595663 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe660053580 msgr2=0x7fe660055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:25.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.251+0000 7fe68080b700 1 --2- 172.21.15.62:0/3429595663 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe660053580 0x7fe660055a40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fe66c00d000 tx=0x7fe66c007b70).stop 2021-12-17T18:26:25.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.251+0000 7fe68080b700 1 -- 172.21.15.62:0/3429595663 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe67c0b1220 msgr2=0x7fe67c156360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:25.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.251+0000 7fe68080b700 1 --2- 172.21.15.62:0/3429595663 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe67c0b1220 0x7fe67c156360 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7fe67c155b40 tx=0x7fe664006df0).stop 2021-12-17T18:26:25.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.251+0000 7fe68080b700 1 -- 172.21.15.62:0/3429595663 shutdown_connections 2021-12-17T18:26:25.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.251+0000 7fe68080b700 1 --2- 172.21.15.62:0/3429595663 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe660053580 0x7fe660055a40 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:25.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.251+0000 7fe68080b700 1 --2- 172.21.15.62:0/3429595663 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe67c0b21a0 0x7fe67c152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:25.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.251+0000 7fe68080b700 1 --2- 172.21.15.62:0/3429595663 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe67c0b1220 0x7fe67c156360 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:25.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.251+0000 7fe68080b700 1 --2- 172.21.15.62:0/3429595663 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe67c0afdd0 0x7fe67c064f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:25.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.251+0000 7fe68080b700 1 -- 172.21.15.62:0/3429595663 >> 172.21.15.62:0/3429595663 conn(0x7fe67c05c750 msgr2=0x7fe67c12a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:25.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.251+0000 7fe68080b700 1 -- 172.21.15.62:0/3429595663 shutdown_connections 2021-12-17T18:26:25.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.251+0000 7fe68080b700 1 -- 172.21.15.62:0/3429595663 wait complete. 2021-12-17T18:26:25.275 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-12-17T18:26:25.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.383+0000 7f948ab37700 1 Processor -- start 2021-12-17T18:26:25.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.383+0000 7f948ab37700 1 -- start start 2021-12-17T18:26:25.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f948ab37700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f9484142d70 0x7f94841471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:25.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f948ab37700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f94840b51a0 0x7f94840b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:25.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f948ab37700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94840b09e0 con 0x7f94840b4340 2021-12-17T18:26:25.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f948ab37700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94841467d0 con 0x7f9484142d70 2021-12-17T18:26:25.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f948ab37700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9484146a70 con 0x7f94840b51a0 2021-12-17T18:26:25.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f94890d4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f94840b51a0 0x7f94840b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:25.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f9483fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f9484142d70 0x7f94841471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:25.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f94890d4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f94840b51a0 0x7f94840b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:48434/0 (socket says 172.21.15.62:48434) 2021-12-17T18:26:25.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f94890d4700 1 -- 172.21.15.62:0/1571272627 learned_addr learned my addr 172.21.15.62:0/1571272627 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:25.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f94888d3700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f94840b4340 0x7f9484142660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:54628/0 (socket says 172.21.15.62:54628) 2021-12-17T18:26:25.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f94890d4700 1 -- 172.21.15.62:0/1571272627 >> v2:172.21.15.109:3300/0 conn(0x7f9484142d70 msgr2=0x7f94841471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:25.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f94890d4700 1 --2- 172.21.15.62:0/1571272627 >> v2:172.21.15.109:3300/0 conn(0x7f9484142d70 0x7f94841471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:25.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f94890d4700 1 -- 172.21.15.62:0/1571272627 >> v1:172.21.15.109:6789/0 conn(0x7f94840b4340 legacy=0x7f9484142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:25.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f94890d4700 1 -- 172.21.15.62:0/1571272627 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9484146d10 con 0x7f94840b51a0 2021-12-17T18:26:25.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f9483fff700 1 --2- 172.21.15.62:0/1571272627 >> v2:172.21.15.109:3300/0 conn(0x7f9484142d70 0x7f94841471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:25.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f94890d4700 1 --2- 172.21.15.62:0/1571272627 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f94840b51a0 0x7f94840b28f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f947c0032f0 tx=0x7f947c009290).ready entity=mon.2 client_cookie=f621397a26081b9 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:25.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f94837fe700 1 -- 172.21.15.62:0/1571272627 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f947c00b8a0 con 0x7f94840b51a0 2021-12-17T18:26:25.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f94837fe700 1 -- 172.21.15.62:0/1571272627 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c00ba00 con 0x7f94840b51a0 2021-12-17T18:26:25.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.387+0000 7f94837fe700 1 -- 172.21.15.62:0/1571272627 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f947c00bb70 con 0x7f94840b51a0 2021-12-17T18:26:25.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.391+0000 7f948ab37700 1 -- 172.21.15.62:0/1571272627 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f94840b51a0 msgr2=0x7f94840b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:25.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.391+0000 7f948ab37700 1 --2- 172.21.15.62:0/1571272627 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f94840b51a0 0x7f94840b28f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f947c0032f0 tx=0x7f947c009290).stop 2021-12-17T18:26:25.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.391+0000 7f948ab37700 1 -- 172.21.15.62:0/1571272627 shutdown_connections 2021-12-17T18:26:25.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.391+0000 7f948ab37700 1 --2- 172.21.15.62:0/1571272627 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f94840b51a0 0x7f94840b28f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:25.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.391+0000 7f948ab37700 1 --2- 172.21.15.62:0/1571272627 >> v2:172.21.15.109:3300/0 conn(0x7f9484142d70 0x7f94841471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:25.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.391+0000 7f948ab37700 1 -- 172.21.15.62:0/1571272627 >> 172.21.15.62:0/1571272627 conn(0x7f948405c750 msgr2=0x7f948405cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:25.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.391+0000 7f948ab37700 1 -- 172.21.15.62:0/1571272627 shutdown_connections 2021-12-17T18:26:25.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.391+0000 7f948ab37700 1 -- 172.21.15.62:0/1571272627 wait complete. 2021-12-17T18:26:25.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.391+0000 7f948ab37700 1 Processor -- start 2021-12-17T18:26:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.391+0000 7f948ab37700 1 -- start start 2021-12-17T18:26:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.391+0000 7f948ab37700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f94840b4340 0x7f9484140cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.391+0000 7f948ab37700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f94840b51a0 0x7f9484065520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.391+0000 7f948ab37700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9484142d70 0x7f9484066a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f948ab37700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94840b92b0 con 0x7f9484142d70 2021-12-17T18:26:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f948ab37700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9484065a10 con 0x7f94840b51a0 2021-12-17T18:26:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f948ab37700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94840b94e0 con 0x7f94840b4340 2021-12-17T18:26:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f94890d4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9484142d70 0x7f9484066a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f94890d4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9484142d70 0x7f9484066a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54738/0 (socket says 172.21.15.62:54738) 2021-12-17T18:26:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f9483fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f94840b51a0 0x7f9484065520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f94890d4700 1 -- 172.21.15.62:0/577485676 learned_addr learned my addr 172.21.15.62:0/577485676 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:25.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f94888d3700 1 --2- 172.21.15.62:0/577485676 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f94840b4340 0x7f9484140cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:25.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f94890d4700 1 -- 172.21.15.62:0/577485676 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f94840b4340 msgr2=0x7f9484140cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:25.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f94890d4700 1 --2- 172.21.15.62:0/577485676 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f94840b4340 0x7f9484140cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:25.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f94890d4700 1 -- 172.21.15.62:0/577485676 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f94840b51a0 msgr2=0x7f9484065520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:25.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f94890d4700 1 --2- 172.21.15.62:0/577485676 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f94840b51a0 0x7f9484065520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:25.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f94890d4700 1 -- 172.21.15.62:0/577485676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c00b180 con 0x7f9484142d70 2021-12-17T18:26:25.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f9483fff700 1 --2- 172.21.15.62:0/577485676 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f94840b51a0 0x7f9484065520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:25.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f94890d4700 1 --2- 172.21.15.62:0/577485676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9484142d70 0x7f9484066a00 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f9484065ba0 tx=0x7f947c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:25.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f9481ffb700 1 -- 172.21.15.62:0/577485676 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f947c00b8a0 con 0x7f9484142d70 2021-12-17T18:26:25.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f9481ffb700 1 -- 172.21.15.62:0/577485676 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c021480 con 0x7f9484142d70 2021-12-17T18:26:25.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f948ab37700 1 -- 172.21.15.62:0/577485676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947c009530 con 0x7f9484142d70 2021-12-17T18:26:25.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f9481ffb700 1 -- 172.21.15.62:0/577485676 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f947c0217e0 con 0x7f9484142d70 2021-12-17T18:26:25.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f948ab37700 1 -- 172.21.15.62:0/577485676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9484063e70 con 0x7f9484142d70 2021-12-17T18:26:25.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.395+0000 7f948ab37700 1 -- 172.21.15.62:0/577485676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94840b4720 con 0x7f9484142d70 2021-12-17T18:26:25.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.399+0000 7f9481ffb700 1 -- 172.21.15.62:0/577485676 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f947c028070 con 0x7f9484142d70 2021-12-17T18:26:25.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.399+0000 7f9481ffb700 1 --2- 172.21.15.62:0/577485676 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9468053610 0x7f9468055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:25.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.399+0000 7f9481ffb700 1 -- 172.21.15.62:0/577485676 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f947c06c640 con 0x7f9484142d70 2021-12-17T18:26:25.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.399+0000 7f94888d3700 1 --2- 172.21.15.62:0/577485676 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9468053610 0x7f9468055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:25.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.399+0000 7f94888d3700 1 --2- 172.21.15.62:0/577485676 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9468053610 0x7f9468055ad0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f947400d000 tx=0x7f9474007b80).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:25.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.403+0000 7f9481ffb700 1 -- 172.21.15.62:0/577485676 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f947c043750 con 0x7f9484142d70 2021-12-17T18:26:25.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:25.531+0000 7f948ab37700 1 -- 172.21.15.62:0/577485676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f94840573d0 con 0x7f9484142d70 2021-12-17T18:26:26.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.258+0000 7f9481ffb700 1 -- 172.21.15.62:0/577485676 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v104) v1 ==== 185+0+0 (secure 0 0 0) 0x7f947c015070 con 0x7f9484142d70 2021-12-17T18:26:26.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.258+0000 7f948ab37700 1 -- 172.21.15.62:0/577485676 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9468053610 msgr2=0x7f9468055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:26.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.258+0000 7f948ab37700 1 --2- 172.21.15.62:0/577485676 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9468053610 0x7f9468055ad0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f947400d000 tx=0x7f9474007b80).stop 2021-12-17T18:26:26.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.258+0000 7f948ab37700 1 -- 172.21.15.62:0/577485676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9484142d70 msgr2=0x7f9484066a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:26.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.258+0000 7f948ab37700 1 --2- 172.21.15.62:0/577485676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9484142d70 0x7f9484066a00 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f9484065ba0 tx=0x7f947c016000).stop 2021-12-17T18:26:26.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.258+0000 7f948ab37700 1 -- 172.21.15.62:0/577485676 shutdown_connections 2021-12-17T18:26:26.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.258+0000 7f948ab37700 1 --2- 172.21.15.62:0/577485676 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9468053610 0x7f9468055ad0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:26.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.258+0000 7f948ab37700 1 --2- 172.21.15.62:0/577485676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9484142d70 0x7f9484066a00 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:26.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.258+0000 7f948ab37700 1 --2- 172.21.15.62:0/577485676 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f94840b51a0 0x7f9484065520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:26.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.258+0000 7f948ab37700 1 --2- 172.21.15.62:0/577485676 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f94840b4340 0x7f9484140cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:26.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.258+0000 7f948ab37700 1 -- 172.21.15.62:0/577485676 >> 172.21.15.62:0/577485676 conn(0x7f948405c750 msgr2=0x7f94840b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:26.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.262+0000 7f948ab37700 1 -- 172.21.15.62:0/577485676 shutdown_connections 2021-12-17T18:26:26.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.262+0000 7f948ab37700 1 -- 172.21.15.62:0/577485676 wait complete. 2021-12-17T18:26:26.271 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2021-12-17T18:26:26.283 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-12-17T18:26:26.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.390+0000 7f2249b68700 1 Processor -- start 2021-12-17T18:26:26.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.390+0000 7f2249b68700 1 -- start start 2021-12-17T18:26:26.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2249b68700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22440b4340 0x7f22441471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:26.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2249b68700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f22440b51a0 0x7f22440b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:26.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2249b68700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2244142660 0x7f2244142af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:26.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2249b68700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22440b09e0 con 0x7f2244142660 2021-12-17T18:26:26.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2249b68700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2244142fe0 con 0x7f22440b51a0 2021-12-17T18:26:26.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2249b68700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22441467d0 con 0x7f22440b4340 2021-12-17T18:26:26.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2243fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2244142660 0x7f2244142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:26.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2243fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2244142660 0x7f2244142af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54742/0 (socket says 172.21.15.62:54742) 2021-12-17T18:26:26.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2243fff700 1 -- 172.21.15.62:0/335397945 learned_addr learned my addr 172.21.15.62:0/335397945 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:26.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f22437fe700 1 --2- 172.21.15.62:0/335397945 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22440b4340 0x7f22441471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:26.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f223bfff700 1 --2- 172.21.15.62:0/335397945 >> v2:172.21.15.109:3300/0 conn(0x7f22440b51a0 0x7f22440b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:26.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2243fff700 1 -- 172.21.15.62:0/335397945 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22440b4340 msgr2=0x7f22441471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:26.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2243fff700 1 --2- 172.21.15.62:0/335397945 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22440b4340 0x7f22441471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:26.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2243fff700 1 -- 172.21.15.62:0/335397945 >> v2:172.21.15.109:3300/0 conn(0x7f22440b51a0 msgr2=0x7f22440b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:26.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2243fff700 1 --2- 172.21.15.62:0/335397945 >> v2:172.21.15.109:3300/0 conn(0x7f22440b51a0 0x7f22440b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2243fff700 1 -- 172.21.15.62:0/335397945 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2244146a70 con 0x7f2244142660 2021-12-17T18:26:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2243fff700 1 --2- 172.21.15.62:0/335397945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2244142660 0x7f2244142af0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f22440b1610 tx=0x7f223c009290).ready entity=mon.0 client_cookie=bf88b83f53d09283 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2242ffd700 1 -- 172.21.15.62:0/335397945 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f223c00b830 con 0x7f2244142660 2021-12-17T18:26:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2242ffd700 1 -- 172.21.15.62:0/335397945 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c00b990 con 0x7f2244142660 2021-12-17T18:26:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2242ffd700 1 -- 172.21.15.62:0/335397945 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f223c00bb00 con 0x7f2244142660 2021-12-17T18:26:26.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2249b68700 1 -- 172.21.15.62:0/335397945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2244142660 msgr2=0x7f2244142af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:26.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2249b68700 1 --2- 172.21.15.62:0/335397945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2244142660 0x7f2244142af0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f22440b1610 tx=0x7f223c009290).stop 2021-12-17T18:26:26.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2249b68700 1 -- 172.21.15.62:0/335397945 shutdown_connections 2021-12-17T18:26:26.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2249b68700 1 --2- 172.21.15.62:0/335397945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2244142660 0x7f2244142af0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:26.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2249b68700 1 --2- 172.21.15.62:0/335397945 >> v2:172.21.15.109:3300/0 conn(0x7f22440b51a0 0x7f22440b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:26.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2249b68700 1 --2- 172.21.15.62:0/335397945 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22440b4340 0x7f22441471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:26.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2249b68700 1 -- 172.21.15.62:0/335397945 >> 172.21.15.62:0/335397945 conn(0x7f224405c750 msgr2=0x7f224405cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:26.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2249b68700 1 -- 172.21.15.62:0/335397945 shutdown_connections 2021-12-17T18:26:26.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.394+0000 7f2249b68700 1 -- 172.21.15.62:0/335397945 wait complete. 2021-12-17T18:26:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2249b68700 1 Processor -- start 2021-12-17T18:26:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2249b68700 1 -- start start 2021-12-17T18:26:26.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2249b68700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22440b4340 0x7f2244152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:26.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2249b68700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f22440b51a0 0x7f22440ba020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:26.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2249b68700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2244142660 0x7f2244152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:26.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2249b68700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22440b7630 con 0x7f2244142660 2021-12-17T18:26:26.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2249b68700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22440b7b00 con 0x7f22440b51a0 2021-12-17T18:26:26.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2249b68700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224413fac0 con 0x7f22440b4340 2021-12-17T18:26:26.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2243fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2244142660 0x7f2244152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2243fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2244142660 0x7f2244152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54752/0 (socket says 172.21.15.62:54752) 2021-12-17T18:26:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2243fff700 1 -- 172.21.15.62:0/3210121134 learned_addr learned my addr 172.21.15.62:0/3210121134 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f22437fe700 1 --2- 172.21.15.62:0/3210121134 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22440b4340 0x7f2244152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f223bfff700 1 --2- 172.21.15.62:0/3210121134 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f22440b51a0 0x7f22440ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2243fff700 1 -- 172.21.15.62:0/3210121134 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22440b4340 msgr2=0x7f2244152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2243fff700 1 --2- 172.21.15.62:0/3210121134 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22440b4340 0x7f2244152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2243fff700 1 -- 172.21.15.62:0/3210121134 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f22440b51a0 msgr2=0x7f22440ba020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2243fff700 1 --2- 172.21.15.62:0/3210121134 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f22440b51a0 0x7f22440ba020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:26.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2243fff700 1 -- 172.21.15.62:0/3210121134 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c009530 con 0x7f2244142660 2021-12-17T18:26:26.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2243fff700 1 --2- 172.21.15.62:0/3210121134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2244142660 0x7f2244152be0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f22440b1610 tx=0x7f223c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:26.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f22417fa700 1 -- 172.21.15.62:0/3210121134 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f223c00b830 con 0x7f2244142660 2021-12-17T18:26:26.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f22417fa700 1 -- 172.21.15.62:0/3210121134 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c021630 con 0x7f2244142660 2021-12-17T18:26:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f2249b68700 1 -- 172.21.15.62:0/3210121134 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22440b7860 con 0x7f2244142660 2021-12-17T18:26:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.398+0000 7f22417fa700 1 -- 172.21.15.62:0/3210121134 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f223c021990 con 0x7f2244142660 2021-12-17T18:26:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.402+0000 7f2249b68700 1 -- 172.21.15.62:0/3210121134 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2244066f50 con 0x7f2244142660 2021-12-17T18:26:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.402+0000 7f2249b68700 1 -- 172.21.15.62:0/3210121134 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2244146d10 con 0x7f2244142660 2021-12-17T18:26:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.402+0000 7f22417fa700 1 -- 172.21.15.62:0/3210121134 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f223c027020 con 0x7f2244142660 2021-12-17T18:26:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.402+0000 7f22417fa700 1 --2- 172.21.15.62:0/3210121134 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22280536a0 0x7f2228055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.402+0000 7f22417fa700 1 -- 172.21.15.62:0/3210121134 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f223c06caf0 con 0x7f2244142660 2021-12-17T18:26:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.402+0000 7f22437fe700 1 --2- 172.21.15.62:0/3210121134 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22280536a0 0x7f2228055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.406+0000 7f22437fe700 1 --2- 172.21.15.62:0/3210121134 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22280536a0 0x7f2228055b60 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f223400c000 tx=0x7f2234008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.410+0000 7f22417fa700 1 -- 172.21.15.62:0/3210121134 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f223c043d90 con 0x7f2244142660 2021-12-17T18:26:26.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:26.534+0000 7f2249b68700 1 -- 172.21.15.62:0/3210121134 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f22440573d0 con 0x7f2244142660 2021-12-17T18:26:27.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.262+0000 7f22417fa700 1 -- 172.21.15.62:0/3210121134 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v105) v1 ==== 173+0+0 (secure 0 0 0) 0x7f223c015070 con 0x7f2244142660 2021-12-17T18:26:27.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.266+0000 7f2249b68700 1 -- 172.21.15.62:0/3210121134 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22280536a0 msgr2=0x7f2228055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:27.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.266+0000 7f2249b68700 1 --2- 172.21.15.62:0/3210121134 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22280536a0 0x7f2228055b60 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f223400c000 tx=0x7f2234008040).stop 2021-12-17T18:26:27.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.266+0000 7f2249b68700 1 -- 172.21.15.62:0/3210121134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2244142660 msgr2=0x7f2244152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.266+0000 7f2249b68700 1 --2- 172.21.15.62:0/3210121134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2244142660 0x7f2244152be0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f22440b1610 tx=0x7f223c016000).stop 2021-12-17T18:26:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.266+0000 7f2249b68700 1 -- 172.21.15.62:0/3210121134 shutdown_connections 2021-12-17T18:26:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.266+0000 7f2249b68700 1 --2- 172.21.15.62:0/3210121134 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22280536a0 0x7f2228055b60 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.266+0000 7f2249b68700 1 --2- 172.21.15.62:0/3210121134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2244142660 0x7f2244152be0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.266+0000 7f2249b68700 1 --2- 172.21.15.62:0/3210121134 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f22440b51a0 0x7f22440ba020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.266+0000 7f2249b68700 1 --2- 172.21.15.62:0/3210121134 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22440b4340 0x7f2244152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.266+0000 7f2249b68700 1 -- 172.21.15.62:0/3210121134 >> 172.21.15.62:0/3210121134 conn(0x7f224405c750 msgr2=0x7f22440b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.266+0000 7f2249b68700 1 -- 172.21.15.62:0/3210121134 shutdown_connections 2021-12-17T18:26:27.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.266+0000 7f2249b68700 1 -- 172.21.15.62:0/3210121134 wait complete. 2021-12-17T18:26:27.276 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2021-12-17T18:26:27.288 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-12-17T18:26:27.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.394+0000 7f7dfbfff700 1 Processor -- start 2021-12-17T18:26:27.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.394+0000 7f7dfbfff700 1 -- start start 2021-12-17T18:26:27.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfbfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7dfc066dc0 0x7f7dfc0631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:27.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfbfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7dfc0b1860 0x7f7dfc0af450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:27.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfbfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dfc060880 con 0x7f7dfc0671a0 2021-12-17T18:26:27.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfbfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dfc05fe40 con 0x7f7dfc066dc0 2021-12-17T18:26:27.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfbfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc060340 con 0x7f7dfc0b1860 2021-12-17T18:26:27.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfaffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7dfc066dc0 0x7f7dfc0631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:27.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7df3fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7dfc0671a0 0x7f7dfc05f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38336/0 (socket says 172.21.15.62:38336) 2021-12-17T18:26:27.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7df3fff700 1 -- 172.21.15.62:0/4108385548 learned_addr learned my addr 172.21.15.62:0/4108385548 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:27.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfb7fe700 1 --2- 172.21.15.62:0/4108385548 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7dfc0b1860 0x7f7dfc0af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:27.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfa7fc700 1 -- 172.21.15.62:0/4108385548 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509795881 0 0) 0x7f7dfc060880 con 0x7f7dfc0671a0 2021-12-17T18:26:27.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfaffd700 1 -- 172.21.15.62:0/4108385548 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7dfc0b1860 msgr2=0x7f7dfc0af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:27.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfaffd700 1 --2- 172.21.15.62:0/4108385548 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7dfc0b1860 0x7f7dfc0af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfaffd700 1 -- 172.21.15.62:0/4108385548 >> v1:172.21.15.62:6789/0 conn(0x7f7dfc0671a0 legacy=0x7f7dfc05f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:27.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfaffd700 1 -- 172.21.15.62:0/4108385548 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dfc0605e0 con 0x7f7dfc066dc0 2021-12-17T18:26:27.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfaffd700 1 --2- 172.21.15.62:0/4108385548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dfc066dc0 0x7f7dfc0631c0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f7dfc0af330 tx=0x7f7dec006df0).ready entity=mon.0 client_cookie=1ebf58b0cdb2975b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:27.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfa7fc700 1 -- 172.21.15.62:0/4108385548 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dec00d570 con 0x7f7dfc066dc0 2021-12-17T18:26:27.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfa7fc700 1 -- 172.21.15.62:0/4108385548 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec000e90 con 0x7f7dfc066dc0 2021-12-17T18:26:27.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfa7fc700 1 -- 172.21.15.62:0/4108385548 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dec00d8c0 con 0x7f7dfc066dc0 2021-12-17T18:26:27.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfbfff700 1 -- 172.21.15.62:0/4108385548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dfc066dc0 msgr2=0x7f7dfc0631c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:27.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfbfff700 1 --2- 172.21.15.62:0/4108385548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dfc066dc0 0x7f7dfc0631c0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f7dfc0af330 tx=0x7f7dec006df0).stop 2021-12-17T18:26:27.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfbfff700 1 -- 172.21.15.62:0/4108385548 shutdown_connections 2021-12-17T18:26:27.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfbfff700 1 --2- 172.21.15.62:0/4108385548 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7dfc0b1860 0x7f7dfc0af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfbfff700 1 --2- 172.21.15.62:0/4108385548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dfc066dc0 0x7f7dfc0631c0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfbfff700 1 -- 172.21.15.62:0/4108385548 >> 172.21.15.62:0/4108385548 conn(0x7f7dfc062430 msgr2=0x7f7dfc062840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:27.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfbfff700 1 -- 172.21.15.62:0/4108385548 shutdown_connections 2021-12-17T18:26:27.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.398+0000 7f7dfbfff700 1 -- 172.21.15.62:0/4108385548 wait complete. 2021-12-17T18:26:27.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.402+0000 7f7dfbfff700 1 Processor -- start 2021-12-17T18:26:27.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.402+0000 7f7dfbfff700 1 -- start start 2021-12-17T18:26:27.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dfc066dc0 0x7f7dfc1531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:27.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfbfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7dfc0671a0 0x7f7dfc13d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:27.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfbfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7dfc0b1860 0x7f7dfc138e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:27.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfbfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc066180 con 0x7f7dfc066dc0 2021-12-17T18:26:27.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfbfff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc153690 con 0x7f7dfc0671a0 2021-12-17T18:26:27.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfbfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc1527c0 con 0x7f7dfc0b1860 2021-12-17T18:26:27.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dfc066dc0 0x7f7dfc1531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:27.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dfc066dc0 0x7f7dfc1531a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54762/0 (socket says 172.21.15.62:54762) 2021-12-17T18:26:27.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfaffd700 1 -- 172.21.15.62:0/781422742 learned_addr learned my addr 172.21.15.62:0/781422742 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:27.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7df3fff700 1 --2- 172.21.15.62:0/781422742 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7dfc0671a0 0x7f7dfc13d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:27.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfb7fe700 1 --2- 172.21.15.62:0/781422742 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7dfc0b1860 0x7f7dfc138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:27.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfaffd700 1 -- 172.21.15.62:0/781422742 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7dfc0b1860 msgr2=0x7f7dfc138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:27.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfaffd700 1 --2- 172.21.15.62:0/781422742 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7dfc0b1860 0x7f7dfc138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfaffd700 1 -- 172.21.15.62:0/781422742 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7dfc0671a0 msgr2=0x7f7dfc13d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:27.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfaffd700 1 --2- 172.21.15.62:0/781422742 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7dfc0671a0 0x7f7dfc13d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfaffd700 1 -- 172.21.15.62:0/781422742 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec00b180 con 0x7f7dfc066dc0 2021-12-17T18:26:27.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfaffd700 1 --2- 172.21.15.62:0/781422742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dfc066dc0 0x7f7dfc1531a0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7f7dfc153820 tx=0x7f7dec014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:27.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7df8ff9700 1 -- 172.21.15.62:0/781422742 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dec00dea0 con 0x7f7dfc066dc0 2021-12-17T18:26:27.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7df8ff9700 1 -- 172.21.15.62:0/781422742 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec013da0 con 0x7f7dfc066dc0 2021-12-17T18:26:27.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfbfff700 1 -- 172.21.15.62:0/781422742 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dfc152a60 con 0x7f7dfc066dc0 2021-12-17T18:26:27.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7df8ff9700 1 -- 172.21.15.62:0/781422742 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dec01e5f0 con 0x7f7dfc066dc0 2021-12-17T18:26:27.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfbfff700 1 -- 172.21.15.62:0/781422742 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dfc0b4350 con 0x7f7dfc066dc0 2021-12-17T18:26:27.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.406+0000 7f7dfbfff700 1 -- 172.21.15.62:0/781422742 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dfc0b1f00 con 0x7f7dfc066dc0 2021-12-17T18:26:27.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.410+0000 7f7df8ff9700 1 -- 172.21.15.62:0/781422742 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7dec025030 con 0x7f7dfc066dc0 2021-12-17T18:26:27.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.410+0000 7f7df8ff9700 1 --2- 172.21.15.62:0/781422742 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7de0053610 0x7f7de0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:27.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.410+0000 7f7df8ff9700 1 -- 172.21.15.62:0/781422742 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f7dec06c290 con 0x7f7dfc066dc0 2021-12-17T18:26:27.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.410+0000 7f7df3fff700 1 --2- 172.21.15.62:0/781422742 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7de0053610 0x7f7de0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:27.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.410+0000 7f7df3fff700 1 --2- 172.21.15.62:0/781422742 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7de0053610 0x7f7de0055ad0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f7de400d000 tx=0x7f7de4007a00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:27.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.418+0000 7f7df8ff9700 1 -- 172.21.15.62:0/781422742 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7dec0436d0 con 0x7f7dfc066dc0 2021-12-17T18:26:27.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.546+0000 7f7dfbfff700 1 -- 172.21.15.62:0/781422742 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7dfc0573d0 con 0x7f7dfc066dc0 2021-12-17T18:26:27.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.554+0000 7f7df8ff9700 1 -- 172.21.15.62:0/781422742 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7dec0230a0 con 0x7f7dfc066dc0 2021-12-17T18:26:27.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.558+0000 7f7dfbfff700 1 -- 172.21.15.62:0/781422742 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7de0053610 msgr2=0x7f7de0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:27.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.558+0000 7f7dfbfff700 1 --2- 172.21.15.62:0/781422742 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7de0053610 0x7f7de0055ad0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f7de400d000 tx=0x7f7de4007a00).stop 2021-12-17T18:26:27.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.558+0000 7f7dfbfff700 1 -- 172.21.15.62:0/781422742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dfc066dc0 msgr2=0x7f7dfc1531a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:27.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.558+0000 7f7dfbfff700 1 --2- 172.21.15.62:0/781422742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dfc066dc0 0x7f7dfc1531a0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7f7dfc153820 tx=0x7f7dec014000).stop 2021-12-17T18:26:27.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.558+0000 7f7dfbfff700 1 -- 172.21.15.62:0/781422742 shutdown_connections 2021-12-17T18:26:27.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.558+0000 7f7dfbfff700 1 --2- 172.21.15.62:0/781422742 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7de0053610 0x7f7de0055ad0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.558+0000 7f7dfbfff700 1 --2- 172.21.15.62:0/781422742 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7dfc0b1860 0x7f7dfc138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.558+0000 7f7dfbfff700 1 --2- 172.21.15.62:0/781422742 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7dfc0671a0 0x7f7dfc13d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.558+0000 7f7dfbfff700 1 --2- 172.21.15.62:0/781422742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dfc066dc0 0x7f7dfc1531a0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.558+0000 7f7dfbfff700 1 -- 172.21.15.62:0/781422742 >> 172.21.15.62:0/781422742 conn(0x7f7dfc062430 msgr2=0x7f7dfc0b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:27.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.558+0000 7f7dfbfff700 1 -- 172.21.15.62:0/781422742 shutdown_connections 2021-12-17T18:26:27.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.558+0000 7f7dfbfff700 1 -- 172.21.15.62:0/781422742 wait complete. 2021-12-17T18:26:27.579 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-12-17T18:26:27.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.678+0000 7f4666e42700 1 Processor -- start 2021-12-17T18:26:27.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.678+0000 7f4666e42700 1 -- start start 2021-12-17T18:26:27.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.678+0000 7f4666e42700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f46600b0f10 0x7f466013d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:27.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.678+0000 7f4666e42700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f46600628d0 0x7f4660142fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:27.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.678+0000 7f4666e42700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46601465b0 con 0x7f46600b3a60 2021-12-17T18:26:27.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.678+0000 7f4666e42700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4660143f80 con 0x7f46600628d0 2021-12-17T18:26:27.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.678+0000 7f4666e42700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46600b3e40 con 0x7f46600b0f10 2021-12-17T18:26:27.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f4666641700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f46600628d0 0x7f4660142fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:27.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f4666641700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f46600628d0 0x7f4660142fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:33090/0 (socket says 172.21.15.62:33090) 2021-12-17T18:26:27.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f4666641700 1 -- 172.21.15.62:0/1727500571 learned_addr learned my addr 172.21.15.62:0/1727500571 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:27.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f4665e40700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f46600b3a60 0x7f466013ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:54670/0 (socket says 172.21.15.62:54670) 2021-12-17T18:26:27.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f466563f700 1 --2- 172.21.15.62:0/1727500571 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f46600b0f10 0x7f466013d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:27.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f466563f700 1 -- 172.21.15.62:0/1727500571 >> v2:172.21.15.109:3300/0 conn(0x7f46600628d0 msgr2=0x7f4660142fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:27.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f466563f700 1 --2- 172.21.15.62:0/1727500571 >> v2:172.21.15.109:3300/0 conn(0x7f46600628d0 0x7f4660142fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f466563f700 1 -- 172.21.15.62:0/1727500571 >> v1:172.21.15.109:6789/0 conn(0x7f46600b3a60 legacy=0x7f466013ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:27.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f466563f700 1 -- 172.21.15.62:0/1727500571 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46600af0f0 con 0x7f46600b0f10 2021-12-17T18:26:27.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f4666641700 1 --2- 172.21.15.62:0/1727500571 >> v2:172.21.15.109:3300/0 conn(0x7f46600628d0 0x7f4660142fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:27.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f4664e3e700 1 -- 172.21.15.62:0/1727500571 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757232383 0 0) 0x7f46601465b0 con 0x7f46600b3a60 2021-12-17T18:26:27.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f466563f700 1 --2- 172.21.15.62:0/1727500571 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f46600b0f10 0x7f466013d140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f4650002f70 tx=0x7f4650006df0).ready entity=mon.2 client_cookie=164045fb526445ad server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:27.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f4664e3e700 1 -- 172.21.15.62:0/1727500571 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f465000d570 con 0x7f46600b0f10 2021-12-17T18:26:27.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f4664e3e700 1 -- 172.21.15.62:0/1727500571 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4650000e90 con 0x7f46600b0f10 2021-12-17T18:26:27.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f4664e3e700 1 -- 172.21.15.62:0/1727500571 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f465000d8c0 con 0x7f46600b0f10 2021-12-17T18:26:27.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f4666e42700 1 -- 172.21.15.62:0/1727500571 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f46600b0f10 msgr2=0x7f466013d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:27.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f4666e42700 1 --2- 172.21.15.62:0/1727500571 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f46600b0f10 0x7f466013d140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f4650002f70 tx=0x7f4650006df0).stop 2021-12-17T18:26:27.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f4666e42700 1 -- 172.21.15.62:0/1727500571 shutdown_connections 2021-12-17T18:26:27.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f4666e42700 1 --2- 172.21.15.62:0/1727500571 >> v2:172.21.15.109:3300/0 conn(0x7f46600628d0 0x7f4660142fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f4666e42700 1 --2- 172.21.15.62:0/1727500571 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f46600b0f10 0x7f466013d140 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f4666e42700 1 -- 172.21.15.62:0/1727500571 >> 172.21.15.62:0/1727500571 conn(0x7f46600b7040 msgr2=0x7f46600b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:27.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f4666e42700 1 -- 172.21.15.62:0/1727500571 shutdown_connections 2021-12-17T18:26:27.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.682+0000 7f4666e42700 1 -- 172.21.15.62:0/1727500571 wait complete. 2021-12-17T18:26:27.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f4666e42700 1 Processor -- start 2021-12-17T18:26:27.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f4666e42700 1 -- start start 2021-12-17T18:26:27.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f4666e42700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f46600628d0 0x7f46601406a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:27.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f4666e42700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600b0f10 0x7f46601106f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:27.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f4666e42700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f46600b3a60 0x7f4660116660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:27.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f4666e42700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4660112170 con 0x7f46600b0f10 2021-12-17T18:26:27.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f4666e42700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4660142f70 con 0x7f46600b3a60 2021-12-17T18:26:27.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f4666e42700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4660112ab0 con 0x7f46600628d0 2021-12-17T18:26:27.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f466563f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600b0f10 0x7f46601106f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:27.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f466563f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600b0f10 0x7f46601106f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54778/0 (socket says 172.21.15.62:54778) 2021-12-17T18:26:27.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f466563f700 1 -- 172.21.15.62:0/2070355410 learned_addr learned my addr 172.21.15.62:0/2070355410 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:27.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f4665e40700 1 --2- 172.21.15.62:0/2070355410 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f46600628d0 0x7f46601406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:27.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f4666641700 1 --2- 172.21.15.62:0/2070355410 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f46600b3a60 0x7f4660116660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:27.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f466563f700 1 -- 172.21.15.62:0/2070355410 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f46600628d0 msgr2=0x7f46601406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:27.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f466563f700 1 --2- 172.21.15.62:0/2070355410 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f46600628d0 0x7f46601406a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f466563f700 1 -- 172.21.15.62:0/2070355410 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f46600b3a60 msgr2=0x7f4660116660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:27.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f466563f700 1 --2- 172.21.15.62:0/2070355410 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f46600b3a60 0x7f4660116660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:27.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f466563f700 1 -- 172.21.15.62:0/2070355410 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4658009530 con 0x7f46600b0f10 2021-12-17T18:26:27.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.686+0000 7f466563f700 1 --2- 172.21.15.62:0/2070355410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600b0f10 0x7f46601106f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f4650002f70 tx=0x7f4650014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:27.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.690+0000 7f464effd700 1 -- 172.21.15.62:0/2070355410 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f465000dea0 con 0x7f46600b0f10 2021-12-17T18:26:27.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.690+0000 7f464effd700 1 -- 172.21.15.62:0/2070355410 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4650013de0 con 0x7f46600b0f10 2021-12-17T18:26:27.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.690+0000 7f4666e42700 1 -- 172.21.15.62:0/2070355410 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465000b180 con 0x7f46600b0f10 2021-12-17T18:26:27.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.690+0000 7f464effd700 1 -- 172.21.15.62:0/2070355410 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f465001e5f0 con 0x7f46600b0f10 2021-12-17T18:26:27.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.690+0000 7f4666e42700 1 -- 172.21.15.62:0/2070355410 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4660112ff0 con 0x7f46600b0f10 2021-12-17T18:26:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.690+0000 7f464effd700 1 -- 172.21.15.62:0/2070355410 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f465001c070 con 0x7f46600b0f10 2021-12-17T18:26:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.690+0000 7f4666e42700 1 -- 172.21.15.62:0/2070355410 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4660116400 con 0x7f46600b0f10 2021-12-17T18:26:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.690+0000 7f464effd700 1 --2- 172.21.15.62:0/2070355410 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4640053640 0x7f4640055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.690+0000 7f464effd700 1 -- 172.21.15.62:0/2070355410 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f465006c120 con 0x7f46600b0f10 2021-12-17T18:26:27.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.690+0000 7f4665e40700 1 --2- 172.21.15.62:0/2070355410 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4640053640 0x7f4640055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:27.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.694+0000 7f4665e40700 1 --2- 172.21.15.62:0/2070355410 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4640053640 0x7f4640055b00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f465c00d000 tx=0x7f465c007bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:27.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.702+0000 7f464effd700 1 -- 172.21.15.62:0/2070355410 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4650043450 con 0x7f46600b0f10 2021-12-17T18:26:27.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:27.870+0000 7f4666e42700 1 -- 172.21.15.62:0/2070355410 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7f46600af390 con 0x7f46600b0f10 2021-12-17T18:26:28.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.262+0000 7f464effd700 1 -- 172.21.15.62:0/2070355410 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v364) v1 ==== 127+0+0 (secure 0 0 0) 0x7f4650023020 con 0x7f46600b0f10 2021-12-17T18:26:28.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.266+0000 7f4666e42700 1 -- 172.21.15.62:0/2070355410 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4640053640 msgr2=0x7f4640055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:28.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.266+0000 7f4666e42700 1 --2- 172.21.15.62:0/2070355410 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4640053640 0x7f4640055b00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f465c00d000 tx=0x7f465c007bc0).stop 2021-12-17T18:26:28.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.266+0000 7f4666e42700 1 -- 172.21.15.62:0/2070355410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600b0f10 msgr2=0x7f46601106f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:28.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.266+0000 7f4666e42700 1 --2- 172.21.15.62:0/2070355410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600b0f10 0x7f46601106f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f4650002f70 tx=0x7f4650014000).stop 2021-12-17T18:26:28.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.266+0000 7f4666e42700 1 -- 172.21.15.62:0/2070355410 shutdown_connections 2021-12-17T18:26:28.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.266+0000 7f4666e42700 1 --2- 172.21.15.62:0/2070355410 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4640053640 0x7f4640055b00 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:28.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.266+0000 7f4666e42700 1 --2- 172.21.15.62:0/2070355410 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f46600b3a60 0x7f4660116660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:28.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.266+0000 7f4666e42700 1 --2- 172.21.15.62:0/2070355410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600b0f10 0x7f46601106f0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:28.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.266+0000 7f4666e42700 1 --2- 172.21.15.62:0/2070355410 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f46600628d0 0x7f46601406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:28.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.266+0000 7f4666e42700 1 -- 172.21.15.62:0/2070355410 >> 172.21.15.62:0/2070355410 conn(0x7f46600b7040 msgr2=0x7f4660141810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:28.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.266+0000 7f4666e42700 1 -- 172.21.15.62:0/2070355410 shutdown_connections 2021-12-17T18:26:28.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.266+0000 7f4666e42700 1 -- 172.21.15.62:0/2070355410 wait complete. 2021-12-17T18:26:28.290 INFO:tasks.cephfs_test_runner:test_filtered_df (tasks.cephfs.test_misc.TestMisc) ... ok 2021-12-17T18:26:28.291 INFO:tasks.cephfs_test_runner:Starting test: test_fs_new (tasks.cephfs.test_misc.TestMisc) 2021-12-17T18:26:28.291 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-12-17T18:26:28.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.394+0000 7fb5c6d74700 1 Processor -- start 2021-12-17T18:26:28.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.394+0000 7fb5c6d74700 1 -- start start 2021-12-17T18:26:28.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.394+0000 7fb5c6d74700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fb5c0067870 0x7fb5c013ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:28.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.394+0000 7fb5c6d74700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c00b3e20 con 0x7fb5c00b3a40 2021-12-17T18:26:28.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.394+0000 7fb5c6d74700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c00b09f0 con 0x7fb5c00628c0 2021-12-17T18:26:28.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.394+0000 7fb5c6d74700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c00af900 con 0x7fb5c0067870 2021-12-17T18:26:28.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.394+0000 7fb5c5d72700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb5c00b3a40 0x7fb5c00b02e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38366/0 (socket says 172.21.15.62:38366) 2021-12-17T18:26:28.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.394+0000 7fb5c5d72700 1 -- 172.21.15.62:0/1462176969 learned_addr learned my addr 172.21.15.62:0/1462176969 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:28.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.394+0000 7fb5c5571700 1 --2- 172.21.15.62:0/1462176969 >> v2:172.21.15.109:3300/0 conn(0x7fb5c0067870 0x7fb5c013ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:28.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.398+0000 7fb5c4d70700 1 -- 172.21.15.62:0/1462176969 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35505232 0 0) 0x7fb5c00b3e20 con 0x7fb5c00b3a40 2021-12-17T18:26:28.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.398+0000 7fb5c5571700 1 -- 172.21.15.62:0/1462176969 >> v1:172.21.15.109:6789/0 conn(0x7fb5c00628c0 legacy=0x7fb5c013f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:28.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.398+0000 7fb5c5571700 1 -- 172.21.15.62:0/1462176969 >> v1:172.21.15.62:6789/0 conn(0x7fb5c00b3a40 legacy=0x7fb5c00b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:28.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.398+0000 7fb5c5571700 1 -- 172.21.15.62:0/1462176969 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c00afba0 con 0x7fb5c0067870 2021-12-17T18:26:28.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.398+0000 7fb5c5571700 1 --2- 172.21.15.62:0/1462176969 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb5c0067870 0x7fb5c013ec90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fb5bc0032f0 tx=0x7fb5bc0091d0).ready entity=mon.1 client_cookie=90a9ce50b5ad41f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:28.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.398+0000 7fb5c4d70700 1 -- 172.21.15.62:0/1462176969 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5bc009ea0 con 0x7fb5c0067870 2021-12-17T18:26:28.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.398+0000 7fb5c4d70700 1 -- 172.21.15.62:0/1462176969 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc00b8a0 con 0x7fb5c0067870 2021-12-17T18:26:28.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.398+0000 7fb5c4d70700 1 -- 172.21.15.62:0/1462176969 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5bc00ba10 con 0x7fb5c0067870 2021-12-17T18:26:28.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.398+0000 7fb5c6d74700 1 -- 172.21.15.62:0/1462176969 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb5c0067870 msgr2=0x7fb5c013ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:28.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.398+0000 7fb5c6d74700 1 --2- 172.21.15.62:0/1462176969 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb5c0067870 0x7fb5c013ec90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fb5bc0032f0 tx=0x7fb5bc0091d0).stop 2021-12-17T18:26:28.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.398+0000 7fb5c6d74700 1 -- 172.21.15.62:0/1462176969 shutdown_connections 2021-12-17T18:26:28.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.398+0000 7fb5c6d74700 1 --2- 172.21.15.62:0/1462176969 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb5c0067870 0x7fb5c013ec90 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:28.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.398+0000 7fb5c6d74700 1 -- 172.21.15.62:0/1462176969 >> 172.21.15.62:0/1462176969 conn(0x7fb5c00b7020 msgr2=0x7fb5c00b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:28.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.398+0000 7fb5c6d74700 1 -- 172.21.15.62:0/1462176969 shutdown_connections 2021-12-17T18:26:28.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.398+0000 7fb5c6d74700 1 -- 172.21.15.62:0/1462176969 wait complete. 2021-12-17T18:26:28.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.398+0000 7fb5c6d74700 1 Processor -- start 2021-12-17T18:26:28.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.398+0000 7fb5c6d74700 1 -- start start 2021-12-17T18:26:28.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c6d74700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb5c00628c0 0x7fb5c0063e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:28.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c6d74700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5c0067870 0x7fb5c0153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:28.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c6d74700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb5c00b3a40 0x7fb5c012f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:28.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c6d74700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c013bf80 con 0x7fb5c0067870 2021-12-17T18:26:28.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c6d74700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0153800 con 0x7fb5c00b3a40 2021-12-17T18:26:28.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c6d74700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0152930 con 0x7fb5c00628c0 2021-12-17T18:26:28.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c5571700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5c0067870 0x7fb5c0153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:28.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c5571700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5c0067870 0x7fb5c0153310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54792/0 (socket says 172.21.15.62:54792) 2021-12-17T18:26:28.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c5571700 1 -- 172.21.15.62:0/550166996 learned_addr learned my addr 172.21.15.62:0/550166996 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:28.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c5d72700 1 --2- 172.21.15.62:0/550166996 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb5c00628c0 0x7fb5c0063e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:28.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c6573700 1 --2- 172.21.15.62:0/550166996 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb5c00b3a40 0x7fb5c012f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:28.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c5571700 1 -- 172.21.15.62:0/550166996 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb5c00628c0 msgr2=0x7fb5c0063e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:28.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c5571700 1 --2- 172.21.15.62:0/550166996 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb5c00628c0 0x7fb5c0063e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:28.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c5571700 1 -- 172.21.15.62:0/550166996 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb5c00b3a40 msgr2=0x7fb5c012f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:28.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c5571700 1 --2- 172.21.15.62:0/550166996 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb5c00b3a40 0x7fb5c012f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:28.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c5571700 1 -- 172.21.15.62:0/550166996 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc009470 con 0x7fb5c0067870 2021-12-17T18:26:28.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c5571700 1 --2- 172.21.15.62:0/550166996 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5c0067870 0x7fb5c0153310 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7fb5bc0032f0 tx=0x7fb5bc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:28.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5b6ffd700 1 -- 172.21.15.62:0/550166996 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5bc009ea0 con 0x7fb5c0067870 2021-12-17T18:26:28.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5b6ffd700 1 -- 172.21.15.62:0/550166996 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc01f3f0 con 0x7fb5c0067870 2021-12-17T18:26:28.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c6d74700 1 -- 172.21.15.62:0/550166996 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c0152bd0 con 0x7fb5c0067870 2021-12-17T18:26:28.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5b6ffd700 1 -- 172.21.15.62:0/550166996 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5bc011ea0 con 0x7fb5c0067870 2021-12-17T18:26:28.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.402+0000 7fb5c6d74700 1 -- 172.21.15.62:0/550166996 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c01525d0 con 0x7fb5c0067870 2021-12-17T18:26:28.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.406+0000 7fb5c6d74700 1 -- 172.21.15.62:0/550166996 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c00afe40 con 0x7fb5c0067870 2021-12-17T18:26:28.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.406+0000 7fb5b6ffd700 1 -- 172.21.15.62:0/550166996 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb5bc026030 con 0x7fb5c0067870 2021-12-17T18:26:28.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.406+0000 7fb5b6ffd700 1 --2- 172.21.15.62:0/550166996 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb5a0053640 0x7fb5a0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:28.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.406+0000 7fb5b6ffd700 1 -- 172.21.15.62:0/550166996 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fb5bc06c140 con 0x7fb5c0067870 2021-12-17T18:26:28.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.406+0000 7fb5c5d72700 1 --2- 172.21.15.62:0/550166996 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb5a0053640 0x7fb5a0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:28.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.406+0000 7fb5c5d72700 1 --2- 172.21.15.62:0/550166996 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb5a0053640 0x7fb5a0055b00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fb5b000d000 tx=0x7fb5b0007c00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:28.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.410+0000 7fb5b6ffd700 1 -- 172.21.15.62:0/550166996 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb5bc043580 con 0x7fb5c0067870 2021-12-17T18:26:28.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:28.574+0000 7fb5c6d74700 1 -- 172.21.15.62:0/550166996 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7fb5c00573d0 con 0x7fb5c0067870 2021-12-17T18:26:29.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.266+0000 7fb5b6ffd700 1 -- 172.21.15.62:0/550166996 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v365) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb5bc0150c0 con 0x7fb5c0067870 2021-12-17T18:26:29.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.270+0000 7fb5c6d74700 1 -- 172.21.15.62:0/550166996 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb5a0053640 msgr2=0x7fb5a0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:29.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.270+0000 7fb5c6d74700 1 --2- 172.21.15.62:0/550166996 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb5a0053640 0x7fb5a0055b00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fb5b000d000 tx=0x7fb5b0007c00).stop 2021-12-17T18:26:29.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.270+0000 7fb5c6d74700 1 -- 172.21.15.62:0/550166996 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5c0067870 msgr2=0x7fb5c0153310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:29.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.270+0000 7fb5c6d74700 1 --2- 172.21.15.62:0/550166996 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5c0067870 0x7fb5c0153310 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7fb5bc0032f0 tx=0x7fb5bc016000).stop 2021-12-17T18:26:29.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.270+0000 7fb5c6d74700 1 -- 172.21.15.62:0/550166996 shutdown_connections 2021-12-17T18:26:29.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.270+0000 7fb5c6d74700 1 --2- 172.21.15.62:0/550166996 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb5a0053640 0x7fb5a0055b00 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.270+0000 7fb5c6d74700 1 --2- 172.21.15.62:0/550166996 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb5c00b3a40 0x7fb5c012f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.270+0000 7fb5c6d74700 1 --2- 172.21.15.62:0/550166996 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5c0067870 0x7fb5c0153310 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.270+0000 7fb5c6d74700 1 --2- 172.21.15.62:0/550166996 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb5c00628c0 0x7fb5c0063e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.270+0000 7fb5c6d74700 1 -- 172.21.15.62:0/550166996 >> 172.21.15.62:0/550166996 conn(0x7fb5c00b7020 msgr2=0x7fb5c00b4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:29.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.270+0000 7fb5c6d74700 1 -- 172.21.15.62:0/550166996 shutdown_connections 2021-12-17T18:26:29.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.270+0000 7fb5c6d74700 1 -- 172.21.15.62:0/550166996 wait complete. 2021-12-17T18:26:29.294 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-12-17T18:26:29.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a2c0f4700 1 Processor -- start 2021-12-17T18:26:29.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a2c0f4700 1 -- start start 2021-12-17T18:26:29.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a2c0f4700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f3a240b0050 0x7f3a240b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:29.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a2c0f4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3a240b1b60 0x7f3a24142570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:29.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a2c0f4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a240b6b20 con 0x7f3a240b6740 2021-12-17T18:26:29.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a2c0f4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a240ad5d0 con 0x7f3a240b1b60 2021-12-17T18:26:29.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a2c0f4700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a240ae7b0 con 0x7f3a240b0050 2021-12-17T18:26:29.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a2a691700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3a240b1b60 0x7f3a24142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:29.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a2a691700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3a240b1b60 0x7f3a24142570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54802/0 (socket says 172.21.15.62:54802) 2021-12-17T18:26:29.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a2a691700 1 -- 172.21.15.62:0/3835252276 learned_addr learned my addr 172.21.15.62:0/3835252276 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:29.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a2968f700 1 --2- 172.21.15.62:0/3835252276 >> v2:172.21.15.109:3300/0 conn(0x7f3a240b0050 0x7f3a240b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:29.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a2a691700 1 -- 172.21.15.62:0/3835252276 >> v2:172.21.15.109:3300/0 conn(0x7f3a240b0050 msgr2=0x7f3a240b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:29.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a2a691700 1 --2- 172.21.15.62:0/3835252276 >> v2:172.21.15.109:3300/0 conn(0x7f3a240b0050 0x7f3a240b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a2a691700 1 -- 172.21.15.62:0/3835252276 >> v1:172.21.15.62:6789/0 conn(0x7f3a240b6740 legacy=0x7f3a240aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:29.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a2a691700 1 -- 172.21.15.62:0/3835252276 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a240aea50 con 0x7f3a240b1b60 2021-12-17T18:26:29.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a2a691700 1 --2- 172.21.15.62:0/3835252276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a240b1b60 0x7f3a24142570 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f3a1c0032f0 tx=0x7f3a1c009290).ready entity=mon.0 client_cookie=90cbc68a218261f5 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:29.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a28e8e700 1 -- 172.21.15.62:0/3835252276 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1c00b870 con 0x7f3a240b1b60 2021-12-17T18:26:29.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a28e8e700 1 -- 172.21.15.62:0/3835252276 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1c00b9d0 con 0x7f3a240b1b60 2021-12-17T18:26:29.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.410+0000 7f3a28e8e700 1 -- 172.21.15.62:0/3835252276 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1c00bb40 con 0x7f3a240b1b60 2021-12-17T18:26:29.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.414+0000 7f3a2c0f4700 1 -- 172.21.15.62:0/3835252276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a240b1b60 msgr2=0x7f3a24142570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:29.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.414+0000 7f3a2c0f4700 1 --2- 172.21.15.62:0/3835252276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a240b1b60 0x7f3a24142570 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f3a1c0032f0 tx=0x7f3a1c009290).stop 2021-12-17T18:26:29.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.414+0000 7f3a2c0f4700 1 -- 172.21.15.62:0/3835252276 shutdown_connections 2021-12-17T18:26:29.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.414+0000 7f3a2c0f4700 1 --2- 172.21.15.62:0/3835252276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a240b1b60 0x7f3a24142570 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.414+0000 7f3a2c0f4700 1 --2- 172.21.15.62:0/3835252276 >> v2:172.21.15.109:3300/0 conn(0x7f3a240b0050 0x7f3a240b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.414+0000 7f3a2c0f4700 1 -- 172.21.15.62:0/3835252276 >> 172.21.15.62:0/3835252276 conn(0x7f3a2405c8f0 msgr2=0x7f3a240b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:29.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.414+0000 7f3a2c0f4700 1 -- 172.21.15.62:0/3835252276 shutdown_connections 2021-12-17T18:26:29.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.414+0000 7f3a2c0f4700 1 -- 172.21.15.62:0/3835252276 wait complete. 2021-12-17T18:26:29.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.414+0000 7f3a2c0f4700 1 Processor -- start 2021-12-17T18:26:29.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.414+0000 7f3a2c0f4700 1 -- start start 2021-12-17T18:26:29.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.414+0000 7f3a2c0f4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3a240b0050 0x7f3a24142cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:29.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.414+0000 7f3a2c0f4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3a240b1b60 0x7f3a24155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:29.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.414+0000 7f3a2c0f4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a240b6740 0x7f3a24155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:29.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.414+0000 7f3a2c0f4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2409f410 con 0x7f3a240b6740 2021-12-17T18:26:29.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.414+0000 7f3a2c0f4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a240a07c0 con 0x7f3a240b1b60 2021-12-17T18:26:29.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.414+0000 7f3a2c0f4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a240a0a60 con 0x7f3a240b0050 2021-12-17T18:26:29.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a2a691700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a240b6740 0x7f3a24155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:29.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a2968f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3a240b1b60 0x7f3a24155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:29.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a2a691700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a240b6740 0x7f3a24155f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54808/0 (socket says 172.21.15.62:54808) 2021-12-17T18:26:29.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a2a691700 1 -- 172.21.15.62:0/1713090397 learned_addr learned my addr 172.21.15.62:0/1713090397 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:29.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a29e90700 1 --2- 172.21.15.62:0/1713090397 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3a240b0050 0x7f3a24142cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:29.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a2a691700 1 -- 172.21.15.62:0/1713090397 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3a240b0050 msgr2=0x7f3a24142cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:29.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a2a691700 1 --2- 172.21.15.62:0/1713090397 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3a240b0050 0x7f3a24142cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a2a691700 1 -- 172.21.15.62:0/1713090397 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3a240b1b60 msgr2=0x7f3a24155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:29.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a2a691700 1 --2- 172.21.15.62:0/1713090397 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3a240b1b60 0x7f3a24155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a2a691700 1 -- 172.21.15.62:0/1713090397 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c009530 con 0x7f3a240b6740 2021-12-17T18:26:29.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a2a691700 1 --2- 172.21.15.62:0/1713090397 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a240b6740 0x7f3a24155f10 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f3a1c0032f0 tx=0x7f3a1c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:29.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a12ffd700 1 -- 172.21.15.62:0/1713090397 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1c00b870 con 0x7f3a240b6740 2021-12-17T18:26:29.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a12ffd700 1 -- 172.21.15.62:0/1713090397 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1c021480 con 0x7f3a240b6740 2021-12-17T18:26:29.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a2c0f4700 1 -- 172.21.15.62:0/1713090397 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a240a0d00 con 0x7f3a240b6740 2021-12-17T18:26:29.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a12ffd700 1 -- 172.21.15.62:0/1713090397 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1c0217e0 con 0x7f3a240b6740 2021-12-17T18:26:29.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a2c0f4700 1 -- 172.21.15.62:0/1713090397 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a240a0440 con 0x7f3a240b6740 2021-12-17T18:26:29.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a2c0f4700 1 -- 172.21.15.62:0/1713090397 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a240b1fb0 con 0x7f3a240b6740 2021-12-17T18:26:29.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a12ffd700 1 -- 172.21.15.62:0/1713090397 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3a1c00f070 con 0x7f3a240b6740 2021-12-17T18:26:29.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.418+0000 7f3a12ffd700 1 --2- 172.21.15.62:0/1713090397 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3a04053580 0x7f3a04055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:29.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.422+0000 7f3a12ffd700 1 -- 172.21.15.62:0/1713090397 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f3a1c06c7f0 con 0x7f3a240b6740 2021-12-17T18:26:29.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.422+0000 7f3a29e90700 1 --2- 172.21.15.62:0/1713090397 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3a04053580 0x7f3a04055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:29.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.422+0000 7f3a29e90700 1 --2- 172.21.15.62:0/1713090397 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3a04053580 0x7f3a04055a40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f3a2000d000 tx=0x7f3a20007b70).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:29.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.426+0000 7f3a12ffd700 1 -- 172.21.15.62:0/1713090397 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3a1c043c30 con 0x7f3a240b6740 2021-12-17T18:26:29.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.554+0000 7f3a2c0f4700 1 -- 172.21.15.62:0/1713090397 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3a240a0e90 con 0x7f3a240b6740 2021-12-17T18:26:29.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.562+0000 7f3a12ffd700 1 -- 172.21.15.62:0/1713090397 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3a1c026070 con 0x7f3a240b6740 2021-12-17T18:26:29.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.562+0000 7f3a2c0f4700 1 -- 172.21.15.62:0/1713090397 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3a04053580 msgr2=0x7f3a04055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:29.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.562+0000 7f3a2c0f4700 1 --2- 172.21.15.62:0/1713090397 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3a04053580 0x7f3a04055a40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f3a2000d000 tx=0x7f3a20007b70).stop 2021-12-17T18:26:29.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.562+0000 7f3a2c0f4700 1 -- 172.21.15.62:0/1713090397 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a240b6740 msgr2=0x7f3a24155f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:29.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.562+0000 7f3a2c0f4700 1 --2- 172.21.15.62:0/1713090397 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a240b6740 0x7f3a24155f10 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f3a1c0032f0 tx=0x7f3a1c016000).stop 2021-12-17T18:26:29.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.562+0000 7f3a2c0f4700 1 -- 172.21.15.62:0/1713090397 shutdown_connections 2021-12-17T18:26:29.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.562+0000 7f3a2c0f4700 1 --2- 172.21.15.62:0/1713090397 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3a04053580 0x7f3a04055a40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.562+0000 7f3a2c0f4700 1 --2- 172.21.15.62:0/1713090397 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a240b6740 0x7f3a24155f10 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.562+0000 7f3a2c0f4700 1 --2- 172.21.15.62:0/1713090397 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3a240b1b60 0x7f3a24155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.562+0000 7f3a2c0f4700 1 --2- 172.21.15.62:0/1713090397 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3a240b0050 0x7f3a24142cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.562+0000 7f3a2c0f4700 1 -- 172.21.15.62:0/1713090397 >> 172.21.15.62:0/1713090397 conn(0x7f3a2405c8f0 msgr2=0x7f3a2413bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:29.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.562+0000 7f3a2c0f4700 1 -- 172.21.15.62:0/1713090397 shutdown_connections 2021-12-17T18:26:29.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.562+0000 7f3a2c0f4700 1 -- 172.21.15.62:0/1713090397 wait complete. 2021-12-17T18:26:29.583 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:26:29.584 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:26:29.598 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:26:29.618 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:26:29.639 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:26:29.660 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:26:29.681 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:26:29.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:29.683 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:29.683 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:29.691 INFO:teuthology.orchestra.run.smithi125.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-12-17T18:26:29.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:26:29.693 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-12-17T18:26:29.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:29.694 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:29.694 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:29.701 INFO:teuthology.orchestra.run.smithi158.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:26:29.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:26:29.703 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-12-17T18:26:29.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:29.704 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:29.704 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:26:29.712 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:26:29.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:26:29.714 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:26:29.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:26:29.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8faf16700 1 Processor -- start 2021-12-17T18:26:29.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8faf16700 1 -- start start 2021-12-17T18:26:29.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8faf16700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa8f40b3760 0x7fa8f40b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:29.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8faf16700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa8f41458d0 0x7fa8f4145d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:29.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8faf16700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f40b5f00 con 0x7fa8f40b5b20 2021-12-17T18:26:29.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8faf16700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f40b3020 con 0x7fa8f40b3760 2021-12-17T18:26:29.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8faf16700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40b32c0 con 0x7fa8f41458d0 2021-12-17T18:26:29.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8f9f14700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa8f40b5b20 0x7fa8f40b6290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38392/0 (socket says 172.21.15.62:38392) 2021-12-17T18:26:29.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8f9f14700 1 -- 172.21.15.62:0/118244954 learned_addr learned my addr 172.21.15.62:0/118244954 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:29.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8f9713700 1 --2- 172.21.15.62:0/118244954 >> v2:172.21.15.109:3300/0 conn(0x7fa8f40b3760 0x7fa8f40b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:29.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8fa715700 1 --2- 172.21.15.62:0/118244954 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa8f41458d0 0x7fa8f4145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:29.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8f8f12700 1 -- 172.21.15.62:0/118244954 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933717570 0 0) 0x7fa8f40b5f00 con 0x7fa8f40b5b20 2021-12-17T18:26:29.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8f8f12700 1 -- 172.21.15.62:0/118244954 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8d8003260 con 0x7fa8f40b5b20 2021-12-17T18:26:29.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8f9713700 1 -- 172.21.15.62:0/118244954 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa8f41458d0 msgr2=0x7fa8f4145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:29.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8f9713700 1 --2- 172.21.15.62:0/118244954 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa8f41458d0 0x7fa8f4145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8f9713700 1 -- 172.21.15.62:0/118244954 >> v1:172.21.15.62:6789/0 conn(0x7fa8f40b5b20 legacy=0x7fa8f40b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:29.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8f9713700 1 -- 172.21.15.62:0/118244954 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f40b6e90 con 0x7fa8f40b3760 2021-12-17T18:26:29.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8f9713700 1 --2- 172.21.15.62:0/118244954 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8f40b3760 0x7fa8f40b69a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fa8e8002f70 tx=0x7fa8e8006df0).ready entity=mon.1 client_cookie=44b3315f0e112f87 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:29.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8f8f12700 1 -- 172.21.15.62:0/118244954 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8e800d4a0 con 0x7fa8f40b3760 2021-12-17T18:26:29.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8f8f12700 1 -- 172.21.15.62:0/118244954 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e8000e90 con 0x7fa8f40b3760 2021-12-17T18:26:29.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.818+0000 7fa8f8f12700 1 -- 172.21.15.62:0/118244954 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8e800d7f0 con 0x7fa8f40b3760 2021-12-17T18:26:29.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8faf16700 1 -- 172.21.15.62:0/118244954 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8f40b3760 msgr2=0x7fa8f40b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:29.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8faf16700 1 --2- 172.21.15.62:0/118244954 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8f40b3760 0x7fa8f40b69a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fa8e8002f70 tx=0x7fa8e8006df0).stop 2021-12-17T18:26:29.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8faf16700 1 -- 172.21.15.62:0/118244954 shutdown_connections 2021-12-17T18:26:29.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8faf16700 1 --2- 172.21.15.62:0/118244954 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa8f41458d0 0x7fa8f4145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8faf16700 1 --2- 172.21.15.62:0/118244954 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8f40b3760 0x7fa8f40b69a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8faf16700 1 -- 172.21.15.62:0/118244954 >> 172.21.15.62:0/118244954 conn(0x7fa8f405c750 msgr2=0x7fa8f405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:29.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8faf16700 1 -- 172.21.15.62:0/118244954 shutdown_connections 2021-12-17T18:26:29.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8faf16700 1 -- 172.21.15.62:0/118244954 wait complete. 2021-12-17T18:26:29.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8faf16700 1 Processor -- start 2021-12-17T18:26:29.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8faf16700 1 -- start start 2021-12-17T18:26:29.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8faf16700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8f40b5b20 0x7fa8f40b9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:29.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8faf16700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8f41458d0 0x7fa8f40638d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:29.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8faf16700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa8f4147880 0x7fa8f41524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:29.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8faf16700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4147d20 con 0x7fa8f40b5b20 2021-12-17T18:26:29.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8faf16700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4063190 con 0x7fa8f41458d0 2021-12-17T18:26:29.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8faf16700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4063430 con 0x7fa8f4147880 2021-12-17T18:26:29.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8f9f14700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8f40b5b20 0x7fa8f40b9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:29.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8f9f14700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8f40b5b20 0x7fa8f40b9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54818/0 (socket says 172.21.15.62:54818) 2021-12-17T18:26:29.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8f9713700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8f41458d0 0x7fa8f40638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:29.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8f9f14700 1 -- 172.21.15.62:0/3789576315 learned_addr learned my addr 172.21.15.62:0/3789576315 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:29.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.822+0000 7fa8fa715700 1 --2- 172.21.15.62:0/3789576315 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa8f4147880 0x7fa8f41524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:29.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.826+0000 7fa8f9f14700 1 -- 172.21.15.62:0/3789576315 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa8f4147880 msgr2=0x7fa8f41524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:29.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.826+0000 7fa8f9f14700 1 --2- 172.21.15.62:0/3789576315 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa8f4147880 0x7fa8f41524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.826+0000 7fa8f9f14700 1 -- 172.21.15.62:0/3789576315 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8f41458d0 msgr2=0x7fa8f40638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:29.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.826+0000 7fa8f9f14700 1 --2- 172.21.15.62:0/3789576315 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8f41458d0 0x7fa8f40638d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:29.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.826+0000 7fa8f9f14700 1 -- 172.21.15.62:0/3789576315 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e800b180 con 0x7fa8f40b5b20 2021-12-17T18:26:29.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.826+0000 7fa8f9f14700 1 --2- 172.21.15.62:0/3789576315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8f40b5b20 0x7fa8f40b9880 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7fa8f0001110 tx=0x7fa8f0007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:29.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.826+0000 7fa8e77fe700 1 -- 172.21.15.62:0/3789576315 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f000ce80 con 0x7fa8f40b5b20 2021-12-17T18:26:29.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.826+0000 7fa8e77fe700 1 -- 172.21.15.62:0/3789576315 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f00070d0 con 0x7fa8f40b5b20 2021-12-17T18:26:29.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.826+0000 7fa8faf16700 1 -- 172.21.15.62:0/3789576315 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f40ba4e0 con 0x7fa8f40b5b20 2021-12-17T18:26:29.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.826+0000 7fa8e77fe700 1 -- 172.21.15.62:0/3789576315 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f0007430 con 0x7fa8f40b5b20 2021-12-17T18:26:29.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.826+0000 7fa8faf16700 1 -- 172.21.15.62:0/3789576315 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f4064850 con 0x7fa8f40b5b20 2021-12-17T18:26:29.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.826+0000 7fa8faf16700 1 -- 172.21.15.62:0/3789576315 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f40635f0 con 0x7fa8f40b5b20 2021-12-17T18:26:29.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.826+0000 7fa8e77fe700 1 -- 172.21.15.62:0/3789576315 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa8f0010070 con 0x7fa8f40b5b20 2021-12-17T18:26:29.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.830+0000 7fa8e77fe700 1 --2- 172.21.15.62:0/3789576315 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8d00534f0 0x7fa8d00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:29.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.830+0000 7fa8e77fe700 1 -- 172.21.15.62:0/3789576315 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fa8f006ac20 con 0x7fa8f40b5b20 2021-12-17T18:26:29.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.830+0000 7fa8f9713700 1 --2- 172.21.15.62:0/3789576315 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8d00534f0 0x7fa8d00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:29.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.830+0000 7fa8f9713700 1 --2- 172.21.15.62:0/3789576315 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8d00534f0 0x7fa8d00559b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fa8e801a000 tx=0x7fa8e8014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:29.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.834+0000 7fa8e77fe700 1 -- 172.21.15.62:0/3789576315 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa8f0042000 con 0x7fa8f40b5b20 2021-12-17T18:26:29.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.966+0000 7fa8faf16700 1 -- 172.21.15.62:0/3789576315 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa8f40573d0 con 0x7fa8f40b5b20 2021-12-17T18:26:29.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.970+0000 7fa8e77fe700 1 -- 172.21.15.62:0/3789576315 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v105) v1 ==== 81+0+28882 (secure 0 0 0) 0x7fa8f0045620 con 0x7fa8f40b5b20 2021-12-17T18:26:29.978 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:29.978 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:26:29.979 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 105, 2021-12-17T18:26:29.979 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:26:29.979 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:26:29.979 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:26:27.257205+0000", 2021-12-17T18:26:29.980 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:26:29.980 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:26:29.980 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:26:29.980 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:26:29.980 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:26:29.981 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:26:29.981 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:26:29.981 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:26:29.982 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:26:29.982 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:26:29.982 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:26:29.983 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:26:29.983 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:26:29.983 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:26:29.983 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:26:29.983 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 20, 2021-12-17T18:26:29.984 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:26:29.984 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:26:29.984 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:26:29.984 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:26:29.985 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:26:29.985 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:29.985 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:26:29.985 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:26:29.986 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:26:29.986 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:26:29.986 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:26:29.986 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:26:29.986 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:26:29.987 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:26:29.987 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:26:29.988 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:26:29.988 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:26:29.988 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:26:29.988 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:26:29.989 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:26:29.989 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:26:29.989 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:26:29.989 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:26:29.990 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:26:29.990 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:26:29.990 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:26:29.991 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:26:29.991 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:26:29.991 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:26:29.991 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:29.992 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:26:29.992 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:26:29.992 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:26:29.992 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:26:29.993 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:26:29.993 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:26:29.993 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:26:29.993 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:26:29.993 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:26:29.994 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:26:29.994 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:26:29.994 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:26:29.994 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:26:29.995 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:26:29.995 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:26:29.995 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:26:29.995 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:26:29.996 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:26:29.996 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:26:29.996 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:26:29.996 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:26:29.996 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:26:29.997 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:26:29.997 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:26:29.997 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:26:29.997 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:26:29.998 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:26:29.998 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:29.998 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:26:29.998 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:26:29.998 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:26:29.999 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:26:29.999 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:26:29.999 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:26:29.999 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:26:30.000 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:26:30.000 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:26:30.000 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:26:30.000 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:26:30.001 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:26:30.001 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:26:30.001 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.001 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:26:30.001 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:26:30.002 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.002 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.002 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.002 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:26:30.003 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:26:30.003 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:26:30.003 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:26:30.003 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:26:30.004 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:26:30.004 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:26:30.004 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:26:30.004 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:26:30.004 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:26:30.005 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:26:30.005 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:26:30.005 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:26:30.006 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:26:30.006 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:26:30.006 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:26:30.006 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:26:30.006 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:26:30.007 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:26:30.007 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:26:30.007 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:26:30.007 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:26:30.008 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:26:30.008 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.008 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:26:30.008 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:26:30.008 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:26:30.009 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:26:30.009 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:26:30.009 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:26:30.010 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:26:30.010 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:26:30.010 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:26:30.010 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:26:30.011 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:26:30.011 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:26:30.011 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:26:30.011 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:26:30.012 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:26:30.012 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:26:30.012 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:26:30.012 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:26:30.012 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:26:30.013 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:26:30.013 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:26:30.013 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:26:30.013 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:26:30.014 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:26:30.014 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:26:30.014 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:26:30.014 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:26:30.015 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.015 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:26:30.015 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:26:30.015 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:26:30.015 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:26:30.016 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:26:30.016 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:26:30.016 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:26:30.016 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:26:30.017 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:26:30.017 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:26:30.017 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:26:30.017 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:26:30.018 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:26:30.018 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:26:30.018 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.018 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.019 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:26:30.019 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:26:30.019 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.019 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:26:30.019 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:26:30.020 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:30.020 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:30.020 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:30.020 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:30.021 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:30.021 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:30.021 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:30.021 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 100, 2021-12-17T18:26:30.022 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:30.022 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:30.022 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:30.022 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.022 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:26:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.024 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.024 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.024 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:26:30.024 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:30.025 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.025 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.025 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.025 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:30.026 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.026 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.026 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.026 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:26:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:26:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.029 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:30.029 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.029 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.029 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.030 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:26:30.030 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:30.030 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.030 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.031 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.031 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:26:30.031 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:30.031 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.031 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.032 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.032 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:30.032 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.032 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.033 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.033 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:26:30.033 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:30.033 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.034 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.034 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.034 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:26:30.034 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:26:30.035 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.035 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.035 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.035 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:26:30.035 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:26:30.036 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:26:30.036 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:26:30.036 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:30.036 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:30.037 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:30.037 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.037 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.037 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.038 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:26:30.038 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:26:30.038 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:30.038 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:30.039 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:30.039 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:30.039 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:30.039 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:30.040 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:30.040 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 100, 2021-12-17T18:26:30.040 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:30.040 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:30.040 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:30.041 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.041 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.041 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.041 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:26:30.042 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:30.042 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.042 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.042 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.043 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:26:30.043 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:30.043 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.043 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.044 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.044 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:30.044 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.044 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.045 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.045 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:26:30.045 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:30.045 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.046 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.046 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.046 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:26:30.046 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:30.046 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.047 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.047 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.047 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:30.048 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.048 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.048 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.048 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:26:30.049 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:30.049 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.049 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.049 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.050 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:26:30.050 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:30.050 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.050 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.051 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.051 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:30.051 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.051 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.051 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.052 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:26:30.052 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:30.052 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.052 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.053 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.053 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:26:30.053 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:26:30.053 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.053 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.054 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.054 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:26:30.054 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:26:30.055 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:26:30.055 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:26:30.055 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:30.055 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:30.055 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:30.056 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.056 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.056 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.056 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:26:30.057 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:26:30.057 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:30.057 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:30.057 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:30.058 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:30.058 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:30.058 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:30.058 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:30.059 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 99, 2021-12-17T18:26:30.059 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:30.059 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:30.059 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:30.060 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.060 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.060 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.060 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:26:30.060 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:30.061 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.061 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.061 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.061 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:26:30.062 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:30.062 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.062 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.062 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.062 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:30.063 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.063 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.063 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.063 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:26:30.064 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:30.064 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.064 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.064 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.065 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:26:30.065 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:30.065 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.065 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.066 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:30.066 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.066 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.066 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.067 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:26:30.067 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:30.067 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.067 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.068 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.068 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:26:30.068 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:30.068 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.068 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.069 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.069 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:30.069 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.069 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.070 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.070 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:26:30.070 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:30.071 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.071 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.071 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.071 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:26:30.072 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:26:30.072 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.072 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.072 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.072 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:26:30.073 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:26:30.073 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:26:30.073 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:26:30.073 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:30.074 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:30.074 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:30.074 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.075 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.075 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:26:30.075 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:26:30.075 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:30.075 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:30.076 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:30.076 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:30.076 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:30.077 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:30.077 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:30.077 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 100, 2021-12-17T18:26:30.077 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:30.078 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:30.078 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:30.078 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.078 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.079 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.079 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:26:30.079 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:30.079 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.079 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.080 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.080 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:26:30.080 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:30.080 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.081 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.081 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.081 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:30.081 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.082 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.082 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.082 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:26:30.082 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:30.082 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.083 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.083 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.083 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:26:30.083 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:30.084 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.084 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.084 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.084 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:30.085 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.085 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.085 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.085 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:26:30.085 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:30.086 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.086 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.086 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.086 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:26:30.087 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:30.087 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.087 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.087 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.088 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:30.088 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.088 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.088 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.089 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:26:30.089 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:30.089 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.089 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.089 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.090 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:26:30.090 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:26:30.090 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.090 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.091 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.091 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:26:30.091 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:26:30.091 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:26:30.092 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:26:30.092 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:30.092 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:30.092 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:30.092 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.093 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.093 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.093 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:26:30.093 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:26:30.094 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:30.094 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:30.094 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:30.094 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:30.095 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:30.095 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:30.095 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:30.095 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 99, 2021-12-17T18:26:30.095 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:30.096 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:30.096 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:30.096 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.096 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.097 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.097 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:26:30.097 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:30.097 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.097 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.098 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.098 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:26:30.098 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:30.098 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.099 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.099 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.099 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:30.099 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.100 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.100 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.100 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:26:30.100 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:30.101 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.101 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.101 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.101 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:26:30.101 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:30.102 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.102 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.102 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.102 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:30.103 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.103 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.103 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.103 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:26:30.104 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:30.104 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.104 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.104 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.104 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:26:30.105 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:30.105 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.105 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.105 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.106 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:30.106 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.106 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.106 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.107 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:26:30.107 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:30.107 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.107 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.107 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.108 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:26:30.108 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:26:30.108 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.108 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.109 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.109 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:26:30.109 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:26:30.109 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:26:30.109 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:26:30.110 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:30.110 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:30.110 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:30.110 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.111 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.111 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.111 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:26:30.111 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:26:30.112 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:30.112 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:30.112 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:30.112 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:30.113 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:30.113 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:30.113 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:30.113 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 99, 2021-12-17T18:26:30.114 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:30.114 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:30.114 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:30.114 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.115 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.115 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.115 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:26:30.115 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:30.115 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.116 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.116 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.116 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:26:30.116 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:30.117 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.117 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.117 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.117 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:30.118 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.118 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.118 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.118 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:26:30.119 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:30.119 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.119 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.119 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.120 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:26:30.120 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:30.120 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.120 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.120 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.121 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:30.121 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.121 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.121 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.122 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:26:30.122 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:30.122 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.122 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.123 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.123 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:26:30.123 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:30.123 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.124 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.124 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.124 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:30.124 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.124 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.125 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.125 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:26:30.125 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:30.125 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.126 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.126 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.126 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:26:30.126 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:26:30.127 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.127 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.127 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.127 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:26:30.128 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:26:30.128 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:26:30.128 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:26:30.128 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:30.129 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:30.129 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:30.129 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.129 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.129 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.130 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:26:30.130 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:26:30.130 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:30.130 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:30.131 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:30.131 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:30.131 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:30.131 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:30.132 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:30.132 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 100, 2021-12-17T18:26:30.132 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:30.132 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:30.133 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:30.133 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.133 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.133 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.133 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:26:30.134 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:30.134 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.134 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.134 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.135 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:26:30.135 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:30.135 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.135 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.135 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.136 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:30.136 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.136 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.136 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.137 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:26:30.137 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:30.137 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.137 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.138 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.138 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:26:30.138 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:30.138 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.139 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.139 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.139 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:30.139 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.140 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.140 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.140 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:26:30.140 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:30.141 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.141 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.141 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.142 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:26:30.142 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:30.142 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.142 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.143 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.143 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:30.143 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.143 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.144 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.144 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:26:30.144 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:30.144 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.145 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.145 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.145 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:26:30.145 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:26:30.145 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.146 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.146 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.146 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:26:30.146 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:26:30.147 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:26:30.147 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:26:30.147 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:30.147 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:30.148 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:30.148 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.148 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.148 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.149 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:26:30.149 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:26:30.149 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:26:30.149 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:26:30.149 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:26:30.150 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:26:30.150 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:26:30.150 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:26:30.150 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:26:30.151 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 100, 2021-12-17T18:26:30.151 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:26:30.151 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:26:30.151 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:26:30.152 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.152 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.152 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.152 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:26:30.153 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:30.153 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.153 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.153 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.154 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:26:30.154 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:30.154 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.154 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.154 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.155 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:26:30.155 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.155 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.155 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.156 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:26:30.156 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:30.156 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.156 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.156 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.157 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:26:30.157 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:30.157 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.157 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.158 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.158 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:26:30.158 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.158 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.158 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.159 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:26:30.159 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:30.159 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.159 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.160 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.160 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:26:30.160 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:30.160 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.161 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.161 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.161 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:26:30.161 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:26:30.162 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.162 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:26:30.162 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:26:30.162 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:30.163 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.163 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.163 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:26:30.163 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:26:30.163 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:26:30.164 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.164 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.164 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.164 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:26:30.165 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:26:30.165 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:26:30.165 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:26:30.165 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:26:30.166 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:26:30.166 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:26:30.166 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:30.166 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.167 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:26:30.167 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:26:30.167 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.167 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:26:30.167 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:30.168 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:30.168 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:30.168 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:30.168 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:30.169 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:26:30.169 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:30.169 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.169 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.169 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:26:30.170 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:30.170 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:30.170 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:30.170 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:30.171 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:30.171 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:26:30.171 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:30.171 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.172 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.172 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:26:30.172 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:30.172 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:30.172 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:30.173 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:30.173 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:30.173 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:26:30.173 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:30.174 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.174 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.174 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:26:30.174 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:30.174 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:30.175 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:30.175 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:30.175 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:30.175 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:26:30.176 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:30.176 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.176 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.176 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:26:30.176 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:30.177 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:30.177 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:30.177 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:30.177 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:30.178 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:26:30.178 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:30.178 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.178 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.179 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:26:30.179 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:30.179 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:30.179 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:30.179 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:30.180 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:30.180 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:26:30.180 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:30.180 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.181 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.181 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:26:30.181 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:30.181 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:30.182 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:30.182 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:30.182 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:30.182 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:26:30.182 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:30.183 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.183 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:30.183 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:26:30.183 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:26:30.184 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:26:30.184 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:26:30.184 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:26:30.184 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:26:30.184 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:26:30.185 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:26:30.185 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.185 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:26:30.185 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:26:30.186 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:26:30.186 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:26:30.186 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:26:30.186 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": { 2021-12-17T18:26:30.186 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6833/1972867454": "2021-12-18T18:26:23.240251+0000", 2021-12-17T18:26:30.187 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6832/1972867454": "2021-12-18T18:26:23.240251+0000" 2021-12-17T18:26:30.187 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.187 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:26:30.187 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:26:30.188 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:26:30.188 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:26:30.188 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:26:30.188 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:26:30.189 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:26:30.189 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:26:30.189 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:30.189 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:30.190 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:26:30.190 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:26:30.190 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:26:30.190 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:26:30.190 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:26:30.191 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:26:30.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.970+0000 7fa8faf16700 1 -- 172.21.15.62:0/3789576315 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8d00534f0 msgr2=0x7fa8d00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.970+0000 7fa8faf16700 1 --2- 172.21.15.62:0/3789576315 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8d00534f0 0x7fa8d00559b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fa8e801a000 tx=0x7fa8e8014000).stop 2021-12-17T18:26:30.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.970+0000 7fa8faf16700 1 -- 172.21.15.62:0/3789576315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8f40b5b20 msgr2=0x7fa8f40b9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.970+0000 7fa8faf16700 1 --2- 172.21.15.62:0/3789576315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8f40b5b20 0x7fa8f40b9880 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7fa8f0001110 tx=0x7fa8f0007aa0).stop 2021-12-17T18:26:30.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.970+0000 7fa8faf16700 1 -- 172.21.15.62:0/3789576315 shutdown_connections 2021-12-17T18:26:30.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.970+0000 7fa8faf16700 1 --2- 172.21.15.62:0/3789576315 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8d00534f0 0x7fa8d00559b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.970+0000 7fa8faf16700 1 --2- 172.21.15.62:0/3789576315 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa8f4147880 0x7fa8f41524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.970+0000 7fa8faf16700 1 --2- 172.21.15.62:0/3789576315 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8f41458d0 0x7fa8f40638d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.970+0000 7fa8faf16700 1 --2- 172.21.15.62:0/3789576315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8f40b5b20 0x7fa8f40b9880 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.970+0000 7fa8faf16700 1 -- 172.21.15.62:0/3789576315 >> 172.21.15.62:0/3789576315 conn(0x7fa8f405c750 msgr2=0x7fa8f4144d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:30.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.970+0000 7fa8faf16700 1 -- 172.21.15.62:0/3789576315 shutdown_connections 2021-12-17T18:26:30.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:29.970+0000 7fa8faf16700 1 -- 172.21.15.62:0/3789576315 wait complete. 2021-12-17T18:26:30.196 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:26:30.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.298+0000 7f88fbfff700 1 Processor -- start 2021-12-17T18:26:30.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.298+0000 7f88fbfff700 1 -- start start 2021-12-17T18:26:30.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.298+0000 7f88fbfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f88fc0b5b20 0x7f88fc0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:30.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.298+0000 7f88fbfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88fc0b5f00 con 0x7f88fc1458d0 2021-12-17T18:26:30.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88fbfff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88fc0b3020 con 0x7f88fc0b3760 2021-12-17T18:26:30.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88fbfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88fc0b32c0 con 0x7f88fc0b5b20 2021-12-17T18:26:30.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88fb7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f88fc1458d0 0x7f88fc145cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38410/0 (socket says 172.21.15.62:38410) 2021-12-17T18:26:30.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88fb7fe700 1 -- 172.21.15.62:0/2644462039 learned_addr learned my addr 172.21.15.62:0/2644462039 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:30.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88faffd700 1 --2- 172.21.15.62:0/2644462039 >> v2:172.21.15.62:3300/0 conn(0x7f88fc0b5b20 0x7f88fc0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:30.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88f9ffb700 1 -- 172.21.15.62:0/2644462039 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314118287 0 0) 0x7f88fc0b5f00 con 0x7f88fc1458d0 2021-12-17T18:26:30.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88f9ffb700 1 -- 172.21.15.62:0/2644462039 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88e0003260 con 0x7f88fc1458d0 2021-12-17T18:26:30.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88f9ffb700 1 -- 172.21.15.62:0/2644462039 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814065800 0 0) 0x7f88fc0b3020 con 0x7f88fc0b3760 2021-12-17T18:26:30.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88f9ffb700 1 -- 172.21.15.62:0/2644462039 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88fc0b5f00 con 0x7f88fc0b3760 2021-12-17T18:26:30.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88faffd700 1 -- 172.21.15.62:0/2644462039 >> v1:172.21.15.109:6789/0 conn(0x7f88fc0b3760 legacy=0x7f88fc0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88faffd700 1 -- 172.21.15.62:0/2644462039 >> v1:172.21.15.62:6789/0 conn(0x7f88fc1458d0 legacy=0x7f88fc145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88faffd700 1 -- 172.21.15.62:0/2644462039 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc0b6e90 con 0x7f88fc0b5b20 2021-12-17T18:26:30.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88faffd700 1 --2- 172.21.15.62:0/2644462039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc0b5b20 0x7f88fc0b6290 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f88f0002f70 tx=0x7f88f0006df0).ready entity=mon.0 client_cookie=8e291ad7a0a06628 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:30.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88f9ffb700 1 -- 172.21.15.62:0/2644462039 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88f000d540 con 0x7f88fc0b5b20 2021-12-17T18:26:30.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88f9ffb700 1 -- 172.21.15.62:0/2644462039 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f0000e90 con 0x7f88fc0b5b20 2021-12-17T18:26:30.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88f9ffb700 1 -- 172.21.15.62:0/2644462039 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88f000d890 con 0x7f88fc0b5b20 2021-12-17T18:26:30.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88fbfff700 1 -- 172.21.15.62:0/2644462039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc0b5b20 msgr2=0x7f88fc0b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88fbfff700 1 --2- 172.21.15.62:0/2644462039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc0b5b20 0x7f88fc0b6290 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f88f0002f70 tx=0x7f88f0006df0).stop 2021-12-17T18:26:30.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88fbfff700 1 -- 172.21.15.62:0/2644462039 shutdown_connections 2021-12-17T18:26:30.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88fbfff700 1 --2- 172.21.15.62:0/2644462039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc0b5b20 0x7f88fc0b6290 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88fbfff700 1 -- 172.21.15.62:0/2644462039 >> 172.21.15.62:0/2644462039 conn(0x7f88fc05c750 msgr2=0x7f88fc05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:30.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88fbfff700 1 -- 172.21.15.62:0/2644462039 shutdown_connections 2021-12-17T18:26:30.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88fbfff700 1 -- 172.21.15.62:0/2644462039 wait complete. 2021-12-17T18:26:30.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88fbfff700 1 Processor -- start 2021-12-17T18:26:30.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.302+0000 7f88fbfff700 1 -- start start 2021-12-17T18:26:30.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fbfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88fc0b5b20 0x7f88fc1478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:30.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fbfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88fc1458d0 0x7f88fc0b9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:30.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc064cb0 0x7f88fc156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:30.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fbfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc1559b0 con 0x7f88fc064cb0 2021-12-17T18:26:30.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fbfff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc155c50 con 0x7f88fc1458d0 2021-12-17T18:26:30.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fbfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc155ef0 con 0x7f88fc0b5b20 2021-12-17T18:26:30.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc064cb0 0x7f88fc156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:30.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc064cb0 0x7f88fc156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54836/0 (socket says 172.21.15.62:54836) 2021-12-17T18:26:30.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fb7fe700 1 -- 172.21.15.62:0/3601436802 learned_addr learned my addr 172.21.15.62:0/3601436802 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:30.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88faffd700 1 --2- 172.21.15.62:0/3601436802 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88fc0b5b20 0x7f88fc1478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:30.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fa7fc700 1 --2- 172.21.15.62:0/3601436802 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88fc1458d0 0x7f88fc0b9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:30.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fb7fe700 1 -- 172.21.15.62:0/3601436802 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88fc0b5b20 msgr2=0x7f88fc1478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fb7fe700 1 --2- 172.21.15.62:0/3601436802 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88fc0b5b20 0x7f88fc1478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fb7fe700 1 -- 172.21.15.62:0/3601436802 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88fc1458d0 msgr2=0x7f88fc0b9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fb7fe700 1 --2- 172.21.15.62:0/3601436802 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88fc1458d0 0x7f88fc0b9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fb7fe700 1 -- 172.21.15.62:0/3601436802 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f000b180 con 0x7f88fc064cb0 2021-12-17T18:26:30.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fb7fe700 1 --2- 172.21.15.62:0/3601436802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc064cb0 0x7f88fc156390 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f88f4001490 tx=0x7f88f4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:30.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88ebfff700 1 -- 172.21.15.62:0/3601436802 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88f4005ba0 con 0x7f88fc064cb0 2021-12-17T18:26:30.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88ebfff700 1 -- 172.21.15.62:0/3601436802 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f4005d00 con 0x7f88fc064cb0 2021-12-17T18:26:30.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88ebfff700 1 -- 172.21.15.62:0/3601436802 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88f40072c0 con 0x7f88fc064cb0 2021-12-17T18:26:30.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fbfff700 1 -- 172.21.15.62:0/3601436802 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88fc064a80 con 0x7f88fc064cb0 2021-12-17T18:26:30.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.306+0000 7f88fbfff700 1 -- 172.21.15.62:0/3601436802 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88fc152680 con 0x7f88fc064cb0 2021-12-17T18:26:30.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.310+0000 7f88fbfff700 1 -- 172.21.15.62:0/3601436802 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88fc0573d0 con 0x7f88fc064cb0 2021-12-17T18:26:30.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.310+0000 7f88ebfff700 1 -- 172.21.15.62:0/3601436802 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f88f4010070 con 0x7f88fc064cb0 2021-12-17T18:26:30.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.310+0000 7f88ebfff700 1 --2- 172.21.15.62:0/3601436802 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88d8053610 0x7f88d8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:30.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.310+0000 7f88ebfff700 1 -- 172.21.15.62:0/3601436802 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f88f406aef0 con 0x7f88fc064cb0 2021-12-17T18:26:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.310+0000 7f88faffd700 1 --2- 172.21.15.62:0/3601436802 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88d8053610 0x7f88d8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.310+0000 7f88faffd700 1 --2- 172.21.15.62:0/3601436802 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88d8053610 0x7f88d8055ad0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f88f0018000 tx=0x7f88f0014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.314+0000 7f88ebfff700 1 -- 172.21.15.62:0/3601436802 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f88f4042330 con 0x7f88fc064cb0 2021-12-17T18:26:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.478+0000 7f88fbfff700 1 -- 172.21.15.62:0/3601436802 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88fc068f30 con 0x7f88fc064cb0 2021-12-17T18:26:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.482+0000 7f88ebfff700 1 -- 172.21.15.62:0/3601436802 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+1209 (secure 0 0 0) 0x7f88f4045950 con 0x7f88fc064cb0 2021-12-17T18:26:30.489 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:30.489 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":52,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/965882605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":965882605},{"type":"v1","addr":"172.21.15.109:6835","nonce":965882605}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47},{"gid":7486,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6833/3675464215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3675464215},{"type":"v1","addr":"172.21.15.62:6833","nonce":3675464215}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52}],"filesystems":[]} 2021-12-17T18:26:30.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.482+0000 7f88fbfff700 1 -- 172.21.15.62:0/3601436802 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88d8053610 msgr2=0x7f88d8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.482+0000 7f88fbfff700 1 --2- 172.21.15.62:0/3601436802 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88d8053610 0x7f88d8055ad0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f88f0018000 tx=0x7f88f0014000).stop 2021-12-17T18:26:30.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.482+0000 7f88fbfff700 1 -- 172.21.15.62:0/3601436802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc064cb0 msgr2=0x7f88fc156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.482+0000 7f88fbfff700 1 --2- 172.21.15.62:0/3601436802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc064cb0 0x7f88fc156390 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f88f4001490 tx=0x7f88f4007e00).stop 2021-12-17T18:26:30.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.482+0000 7f88fbfff700 1 -- 172.21.15.62:0/3601436802 shutdown_connections 2021-12-17T18:26:30.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.482+0000 7f88fbfff700 1 --2- 172.21.15.62:0/3601436802 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88d8053610 0x7f88d8055ad0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.482+0000 7f88fbfff700 1 --2- 172.21.15.62:0/3601436802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc064cb0 0x7f88fc156390 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.482+0000 7f88fbfff700 1 --2- 172.21.15.62:0/3601436802 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88fc1458d0 0x7f88fc0b9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.482+0000 7f88fbfff700 1 --2- 172.21.15.62:0/3601436802 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88fc0b5b20 0x7f88fc1478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.482+0000 7f88fbfff700 1 -- 172.21.15.62:0/3601436802 >> 172.21.15.62:0/3601436802 conn(0x7f88fc05c750 msgr2=0x7f88fc05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:30.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.482+0000 7f88fbfff700 1 -- 172.21.15.62:0/3601436802 shutdown_connections 2021-12-17T18:26:30.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.482+0000 7f88fbfff700 1 -- 172.21.15.62:0/3601436802 wait complete. 2021-12-17T18:26:30.495 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 52 2021-12-17T18:26:30.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:26:30.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.598+0000 7f6fe975f700 1 Processor -- start 2021-12-17T18:26:30.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.598+0000 7f6fe975f700 1 -- start start 2021-12-17T18:26:30.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe975f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6fe405fa70 0x7f6fe4147860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:30.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe975f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6fe40aefb0 0x7f6fe41467b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:30.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe975f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe405fe50 con 0x7f6fe40af7e0 2021-12-17T18:26:30.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe975f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe4148460 con 0x7f6fe405fa70 2021-12-17T18:26:30.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe975f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe40ae5d0 con 0x7f6fe40aefb0 2021-12-17T18:26:30.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe2ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6fe405fa70 0x7f6fe4147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:30.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe37fe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6fe40aefb0 0x7f6fe41467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:30.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe37fe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6fe40aefb0 0x7f6fe41467b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:33162/0 (socket says 172.21.15.62:33162) 2021-12-17T18:26:30.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe37fe700 1 -- 172.21.15.62:0/3138141060 learned_addr learned my addr 172.21.15.62:0/3138141060 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:30.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe37fe700 1 -- 172.21.15.62:0/3138141060 >> v2:172.21.15.62:3300/0 conn(0x7f6fe405fa70 msgr2=0x7f6fe4147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:30.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe37fe700 1 --2- 172.21.15.62:0/3138141060 >> v2:172.21.15.62:3300/0 conn(0x7f6fe405fa70 0x7f6fe4147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe37fe700 1 -- 172.21.15.62:0/3138141060 >> v1:172.21.15.109:6789/0 conn(0x7f6fe40af7e0 legacy=0x7f6fe4147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe37fe700 1 -- 172.21.15.62:0/3138141060 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe40ae870 con 0x7f6fe40aefb0 2021-12-17T18:26:30.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe2ffd700 1 --2- 172.21.15.62:0/3138141060 >> v2:172.21.15.62:3300/0 conn(0x7f6fe405fa70 0x7f6fe4147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:30.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe37fe700 1 --2- 172.21.15.62:0/3138141060 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6fe40aefb0 0x7f6fe41467b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f6fdc0032f0 tx=0x7f6fdc009290).ready entity=mon.1 client_cookie=823c15fde4a164e8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:30.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe1ffb700 1 -- 172.21.15.62:0/3138141060 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fdc00b870 con 0x7f6fe40aefb0 2021-12-17T18:26:30.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe1ffb700 1 -- 172.21.15.62:0/3138141060 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc00b9d0 con 0x7f6fe40aefb0 2021-12-17T18:26:30.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe1ffb700 1 -- 172.21.15.62:0/3138141060 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fdc00bb40 con 0x7f6fe40aefb0 2021-12-17T18:26:30.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe975f700 1 -- 172.21.15.62:0/3138141060 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6fe40aefb0 msgr2=0x7f6fe41467b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe975f700 1 --2- 172.21.15.62:0/3138141060 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6fe40aefb0 0x7f6fe41467b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f6fdc0032f0 tx=0x7f6fdc009290).stop 2021-12-17T18:26:30.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe975f700 1 -- 172.21.15.62:0/3138141060 shutdown_connections 2021-12-17T18:26:30.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe975f700 1 --2- 172.21.15.62:0/3138141060 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6fe40aefb0 0x7f6fe41467b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe975f700 1 --2- 172.21.15.62:0/3138141060 >> v2:172.21.15.62:3300/0 conn(0x7f6fe405fa70 0x7f6fe4147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe975f700 1 -- 172.21.15.62:0/3138141060 >> 172.21.15.62:0/3138141060 conn(0x7f6fe405c960 msgr2=0x7f6fe405cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:30.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe975f700 1 -- 172.21.15.62:0/3138141060 shutdown_connections 2021-12-17T18:26:30.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.602+0000 7f6fe975f700 1 -- 172.21.15.62:0/3138141060 wait complete. 2021-12-17T18:26:30.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.606+0000 7f6fe975f700 1 Processor -- start 2021-12-17T18:26:30.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.606+0000 7f6fe975f700 1 -- start start 2021-12-17T18:26:30.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe975f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6fe405fa70 0x7f6fe40b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:30.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe975f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fe40aefb0 0x7f6fe4065570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:30.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe975f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6fe40af7e0 0x7f6fe4065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:30.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe975f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe415ad30 con 0x7f6fe40aefb0 2021-12-17T18:26:30.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe975f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40b2ad0 con 0x7f6fe40af7e0 2021-12-17T18:26:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe975f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe415a350 con 0x7f6fe405fa70 2021-12-17T18:26:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe27fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fe40aefb0 0x7f6fe4065570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:30.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe27fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fe40aefb0 0x7f6fe4065570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54848/0 (socket says 172.21.15.62:54848) 2021-12-17T18:26:30.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe27fc700 1 -- 172.21.15.62:0/595131931 learned_addr learned my addr 172.21.15.62:0/595131931 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:30.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe37fe700 1 --2- 172.21.15.62:0/595131931 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6fe40af7e0 0x7f6fe4065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:30.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe2ffd700 1 --2- 172.21.15.62:0/595131931 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6fe405fa70 0x7f6fe40b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:30.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe27fc700 1 -- 172.21.15.62:0/595131931 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6fe405fa70 msgr2=0x7f6fe40b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe27fc700 1 --2- 172.21.15.62:0/595131931 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6fe405fa70 0x7f6fe40b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe27fc700 1 -- 172.21.15.62:0/595131931 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6fe40af7e0 msgr2=0x7f6fe4065a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe27fc700 1 --2- 172.21.15.62:0/595131931 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6fe40af7e0 0x7f6fe4065a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe27fc700 1 -- 172.21.15.62:0/595131931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd800b180 con 0x7f6fe40aefb0 2021-12-17T18:26:30.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe37fe700 1 --2- 172.21.15.62:0/595131931 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6fe40af7e0 0x7f6fe4065a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:30.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe27fc700 1 --2- 172.21.15.62:0/595131931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fe40aefb0 0x7f6fe4065570 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f6fe4060700 tx=0x7f6fd4007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:30.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fd3fff700 1 -- 172.21.15.62:0/595131931 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fd4007030 con 0x7f6fe40aefb0 2021-12-17T18:26:30.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fd3fff700 1 -- 172.21.15.62:0/595131931 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd4007190 con 0x7f6fe40aefb0 2021-12-17T18:26:30.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fd3fff700 1 -- 172.21.15.62:0/595131931 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fd4006510 con 0x7f6fe40aefb0 2021-12-17T18:26:30.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe975f700 1 -- 172.21.15.62:0/595131931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fdc009530 con 0x7f6fe40aefb0 2021-12-17T18:26:30.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe975f700 1 -- 172.21.15.62:0/595131931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe414c640 con 0x7f6fe40aefb0 2021-12-17T18:26:30.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.610+0000 7f6fe975f700 1 -- 172.21.15.62:0/595131931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe40aeb10 con 0x7f6fe40aefb0 2021-12-17T18:26:30.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.614+0000 7f6fd3fff700 1 -- 172.21.15.62:0/595131931 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6fd4010030 con 0x7f6fe40aefb0 2021-12-17T18:26:30.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.614+0000 7f6fd3fff700 1 --2- 172.21.15.62:0/595131931 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6fc00534f0 0x7f6fc00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:30.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.614+0000 7f6fd3fff700 1 -- 172.21.15.62:0/595131931 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f6fd406b1c0 con 0x7f6fe40aefb0 2021-12-17T18:26:30.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.614+0000 7f6fe2ffd700 1 --2- 172.21.15.62:0/595131931 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6fc00534f0 0x7f6fc00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:30.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.614+0000 7f6fe2ffd700 1 --2- 172.21.15.62:0/595131931 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6fc00534f0 0x7f6fc00559b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f6fd800b000 tx=0x7f6fd8008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:30.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.622+0000 7f6fd3fff700 1 -- 172.21.15.62:0/595131931 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6fd4042600 con 0x7f6fe40aefb0 2021-12-17T18:26:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.782+0000 7f6fe975f700 1 -- 172.21.15.62:0/595131931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fe40573d0 con 0x7f6fe40aefb0 2021-12-17T18:26:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.786+0000 7f6fd3fff700 1 -- 172.21.15.62:0/595131931 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+1209 (secure 0 0 0) 0x7f6fd4045c20 con 0x7f6fe40aefb0 2021-12-17T18:26:30.793 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:30.793 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":52,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/965882605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":965882605},{"type":"v1","addr":"172.21.15.109:6835","nonce":965882605}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47},{"gid":7486,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6833/3675464215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3675464215},{"type":"v1","addr":"172.21.15.62:6833","nonce":3675464215}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52}],"filesystems":[]} 2021-12-17T18:26:30.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.786+0000 7f6fe975f700 1 -- 172.21.15.62:0/595131931 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6fc00534f0 msgr2=0x7f6fc00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.786+0000 7f6fe975f700 1 --2- 172.21.15.62:0/595131931 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6fc00534f0 0x7f6fc00559b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f6fd800b000 tx=0x7f6fd8008040).stop 2021-12-17T18:26:30.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.786+0000 7f6fe975f700 1 -- 172.21.15.62:0/595131931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fe40aefb0 msgr2=0x7f6fe4065570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.786+0000 7f6fe975f700 1 --2- 172.21.15.62:0/595131931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fe40aefb0 0x7f6fe4065570 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f6fe4060700 tx=0x7f6fd4007c00).stop 2021-12-17T18:26:30.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.786+0000 7f6fe975f700 1 -- 172.21.15.62:0/595131931 shutdown_connections 2021-12-17T18:26:30.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.786+0000 7f6fe975f700 1 --2- 172.21.15.62:0/595131931 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6fc00534f0 0x7f6fc00559b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.786+0000 7f6fe975f700 1 --2- 172.21.15.62:0/595131931 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6fe40af7e0 0x7f6fe4065a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.786+0000 7f6fe975f700 1 --2- 172.21.15.62:0/595131931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fe40aefb0 0x7f6fe4065570 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.786+0000 7f6fe975f700 1 --2- 172.21.15.62:0/595131931 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6fe405fa70 0x7f6fe40b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.786+0000 7f6fe975f700 1 -- 172.21.15.62:0/595131931 >> 172.21.15.62:0/595131931 conn(0x7f6fe405c960 msgr2=0x7f6fe40b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:30.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.786+0000 7f6fe975f700 1 -- 172.21.15.62:0/595131931 shutdown_connections 2021-12-17T18:26:30.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.786+0000 7f6fe975f700 1 -- 172.21.15.62:0/595131931 wait complete. 2021-12-17T18:26:30.798 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 52 2021-12-17T18:26:30.806 INFO:tasks.ceph.mds.a:Restarting daemon 2021-12-17T18:26:30.806 INFO:tasks.ceph.mds.a:Stopping old one... 2021-12-17T18:26:30.806 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-12-17T18:26:30.807 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:26:30.807 INFO:tasks.ceph.mds.b:Restarting daemon 2021-12-17T18:26:30.807 INFO:tasks.ceph.mds.b:Stopping old one... 2021-12-17T18:26:30.808 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-12-17T18:26:30.808 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:26:30.817 INFO:tasks.ceph.mds.a:Stopped 2021-12-17T18:26:30.817 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-12-17T18:26:30.820 INFO:tasks.ceph.mds.a:Started 2021-12-17T18:26:30.820 DEBUG:teuthology.parallel:result is None 2021-12-17T18:26:30.823 INFO:tasks.ceph.mds.b:Stopped 2021-12-17T18:26:30.823 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-12-17T18:26:30.825 INFO:tasks.ceph.mds.b:Started 2021-12-17T18:26:30.826 DEBUG:teuthology.parallel:result is None 2021-12-17T18:26:30.826 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-12-17T18:26:30.891 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:26:30.900 INFO:tasks.ceph.mds.b.smithi109.stdout:starting mds.b at 2021-12-17T18:26:30.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e33f0700 1 Processor -- start 2021-12-17T18:26:30.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e33f0700 1 -- start start 2021-12-17T18:26:30.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e33f0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe5dc0aee10 0x7fe5dc0b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:30.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e33f0700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe5dc144fa0 0x7fe5dc1406d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:30.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e33f0700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5dc0a8e00 con 0x7fe5dc0aaca0 2021-12-17T18:26:30.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e33f0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5dc0a90a0 con 0x7fe5dc0aee10 2021-12-17T18:26:30.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e33f0700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5dc0af8b0 con 0x7fe5dc144fa0 2021-12-17T18:26:30.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e118c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe5dc0aee10 0x7fe5dc0b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:30.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e118c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe5dc0aee10 0x7fe5dc0b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54866/0 (socket says 172.21.15.62:54866) 2021-12-17T18:26:30.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e118c700 1 -- 172.21.15.62:0/1765564988 learned_addr learned my addr 172.21.15.62:0/1765564988 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:30.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e198d700 1 --2- 172.21.15.62:0/1765564988 >> v2:172.21.15.109:3300/0 conn(0x7fe5dc144fa0 0x7fe5dc1406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:30.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e118c700 1 -- 172.21.15.62:0/1765564988 >> v2:172.21.15.109:3300/0 conn(0x7fe5dc144fa0 msgr2=0x7fe5dc1406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:30.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e118c700 1 --2- 172.21.15.62:0/1765564988 >> v2:172.21.15.109:3300/0 conn(0x7fe5dc144fa0 0x7fe5dc1406d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e118c700 1 -- 172.21.15.62:0/1765564988 >> v1:172.21.15.109:6789/0 conn(0x7fe5dc0aaca0 legacy=0x7fe5dc144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:30.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e118c700 1 -- 172.21.15.62:0/1765564988 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5dc0b2da0 con 0x7fe5dc0aee10 2021-12-17T18:26:30.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e198d700 1 --2- 172.21.15.62:0/1765564988 >> v2:172.21.15.109:3300/0 conn(0x7fe5dc144fa0 0x7fe5dc1406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:26:30.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e118c700 1 --2- 172.21.15.62:0/1765564988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5dc0aee10 0x7fe5dc0b1610 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fe5dc061080 tx=0x7fe5cc009290).ready entity=mon.0 client_cookie=1126f77565e4fbb6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:30.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5dbfff700 1 -- 172.21.15.62:0/1765564988 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5cc00b830 con 0x7fe5dc0aee10 2021-12-17T18:26:30.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5dbfff700 1 -- 172.21.15.62:0/1765564988 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc00b990 con 0x7fe5dc0aee10 2021-12-17T18:26:30.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5dbfff700 1 -- 172.21.15.62:0/1765564988 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5cc00bb40 con 0x7fe5dc0aee10 2021-12-17T18:26:30.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e33f0700 1 -- 172.21.15.62:0/1765564988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5dc0aee10 msgr2=0x7fe5dc0b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e33f0700 1 --2- 172.21.15.62:0/1765564988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5dc0aee10 0x7fe5dc0b1610 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fe5dc061080 tx=0x7fe5cc009290).stop 2021-12-17T18:26:30.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e33f0700 1 -- 172.21.15.62:0/1765564988 shutdown_connections 2021-12-17T18:26:30.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e33f0700 1 --2- 172.21.15.62:0/1765564988 >> v2:172.21.15.109:3300/0 conn(0x7fe5dc144fa0 0x7fe5dc1406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e33f0700 1 --2- 172.21.15.62:0/1765564988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5dc0aee10 0x7fe5dc0b1610 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e33f0700 1 -- 172.21.15.62:0/1765564988 >> 172.21.15.62:0/1765564988 conn(0x7fe5dc05f730 msgr2=0x7fe5dc05fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:30.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e33f0700 1 -- 172.21.15.62:0/1765564988 shutdown_connections 2021-12-17T18:26:30.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.918+0000 7fe5e33f0700 1 -- 172.21.15.62:0/1765564988 wait complete. 2021-12-17T18:26:30.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e33f0700 1 Processor -- start 2021-12-17T18:26:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e33f0700 1 -- start start 2021-12-17T18:26:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e33f0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5dc0aaca0 0x7fe5dc064330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e33f0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe5dc0aee10 0x7fe5dc0a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:30.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e33f0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe5dc144fa0 0x7fe5dc0a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:30.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e33f0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc1405d0 con 0x7fe5dc0aaca0 2021-12-17T18:26:30.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e33f0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc066300 con 0x7fe5dc144fa0 2021-12-17T18:26:30.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e33f0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc0665a0 con 0x7fe5dc0aee10 2021-12-17T18:26:30.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e118c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5dc0aaca0 0x7fe5dc064330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:30.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e118c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5dc0aaca0 0x7fe5dc064330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54872/0 (socket says 172.21.15.62:54872) 2021-12-17T18:26:30.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e118c700 1 -- 172.21.15.62:0/697444108 learned_addr learned my addr 172.21.15.62:0/697444108 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:30.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e098b700 1 --2- 172.21.15.62:0/697444108 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe5dc0aee10 0x7fe5dc0a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:30.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e118c700 1 -- 172.21.15.62:0/697444108 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe5dc0aee10 msgr2=0x7fe5dc0a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e118c700 1 --2- 172.21.15.62:0/697444108 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe5dc0aee10 0x7fe5dc0a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e198d700 1 --2- 172.21.15.62:0/697444108 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe5dc144fa0 0x7fe5dc0a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:30.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e118c700 1 -- 172.21.15.62:0/697444108 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe5dc144fa0 msgr2=0x7fe5dc0a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:30.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e118c700 1 --2- 172.21.15.62:0/697444108 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe5dc144fa0 0x7fe5dc0a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:30.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e118c700 1 -- 172.21.15.62:0/697444108 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5cc009530 con 0x7fe5dc0aaca0 2021-12-17T18:26:30.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e098b700 1 --2- 172.21.15.62:0/697444108 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe5dc0aee10 0x7fe5dc0a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:26:30.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e198d700 1 --2- 172.21.15.62:0/697444108 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe5dc144fa0 0x7fe5dc0a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:26:30.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e118c700 1 --2- 172.21.15.62:0/697444108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5dc0aaca0 0x7fe5dc064330 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fe5dc061080 tx=0x7fe5cc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:30.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5da7fc700 1 -- 172.21.15.62:0/697444108 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5cc006b00 con 0x7fe5dc0aaca0 2021-12-17T18:26:30.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5da7fc700 1 -- 172.21.15.62:0/697444108 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc021440 con 0x7fe5dc0aaca0 2021-12-17T18:26:30.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e33f0700 1 -- 172.21.15.62:0/697444108 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5dc066840 con 0x7fe5dc0aaca0 2021-12-17T18:26:30.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5da7fc700 1 -- 172.21.15.62:0/697444108 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5cc0217a0 con 0x7fe5dc0aaca0 2021-12-17T18:26:30.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.922+0000 7fe5e33f0700 1 -- 172.21.15.62:0/697444108 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5dc0a2210 con 0x7fe5dc0aaca0 2021-12-17T18:26:30.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.926+0000 7fe5da7fc700 1 -- 172.21.15.62:0/697444108 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe5cc027020 con 0x7fe5dc0aaca0 2021-12-17T18:26:30.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.926+0000 7fe5e33f0700 1 -- 172.21.15.62:0/697444108 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5dc0a15d0 con 0x7fe5dc0aaca0 2021-12-17T18:26:30.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.926+0000 7fe5da7fc700 1 --2- 172.21.15.62:0/697444108 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5bc053610 0x7fe5bc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:30.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.926+0000 7fe5da7fc700 1 -- 172.21.15.62:0/697444108 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fe5cc06cd70 con 0x7fe5dc0aaca0 2021-12-17T18:26:30.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.926+0000 7fe5e098b700 1 --2- 172.21.15.62:0/697444108 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5bc053610 0x7fe5bc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:30.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.926+0000 7fe5e098b700 1 --2- 172.21.15.62:0/697444108 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5bc053610 0x7fe5bc055ad0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fe5d0008000 tx=0x7fe5d0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:30.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:30.930+0000 7fe5da7fc700 1 -- 172.21.15.62:0/697444108 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe5cc0441f0 con 0x7fe5dc0aaca0 2021-12-17T18:26:31.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:31.070+0000 7fe5e33f0700 1 -- 172.21.15.62:0/697444108 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fe5dc0573d0 con 0x7fe5dc0aaca0 2021-12-17T18:26:31.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:31.918+0000 7fe5da7fc700 1 -- 172.21.15.62:0/697444108 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v108) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe5cc015070 con 0x7fe5dc0aaca0 2021-12-17T18:26:31.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:31.922+0000 7fe5e33f0700 1 -- 172.21.15.62:0/697444108 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5bc053610 msgr2=0x7fe5bc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:31.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:31.922+0000 7fe5e33f0700 1 --2- 172.21.15.62:0/697444108 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5bc053610 0x7fe5bc055ad0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fe5d0008000 tx=0x7fe5d0009040).stop 2021-12-17T18:26:31.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:31.922+0000 7fe5e33f0700 1 -- 172.21.15.62:0/697444108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5dc0aaca0 msgr2=0x7fe5dc064330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:31.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:31.922+0000 7fe5e33f0700 1 --2- 172.21.15.62:0/697444108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5dc0aaca0 0x7fe5dc064330 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fe5dc061080 tx=0x7fe5cc016000).stop 2021-12-17T18:26:31.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:31.922+0000 7fe5e33f0700 1 -- 172.21.15.62:0/697444108 shutdown_connections 2021-12-17T18:26:31.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:31.922+0000 7fe5e33f0700 1 --2- 172.21.15.62:0/697444108 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5bc053610 0x7fe5bc055ad0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:31.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:31.922+0000 7fe5e33f0700 1 --2- 172.21.15.62:0/697444108 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe5dc144fa0 0x7fe5dc0a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:31.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:31.922+0000 7fe5e33f0700 1 --2- 172.21.15.62:0/697444108 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe5dc0aee10 0x7fe5dc0a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:31.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:31.922+0000 7fe5e33f0700 1 --2- 172.21.15.62:0/697444108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5dc0aaca0 0x7fe5dc064330 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:31.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:31.922+0000 7fe5e33f0700 1 -- 172.21.15.62:0/697444108 >> 172.21.15.62:0/697444108 conn(0x7fe5dc05f730 msgr2=0x7fe5dc140fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:31.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:31.922+0000 7fe5e33f0700 1 -- 172.21.15.62:0/697444108 shutdown_connections 2021-12-17T18:26:31.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:31.922+0000 7fe5e33f0700 1 -- 172.21.15.62:0/697444108 wait complete. 2021-12-17T18:26:31.935 INFO:teuthology.orchestra.run.smithi062.stderr: removed all blacklist entries 2021-12-17T18:26:31.948 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-12-17T18:26:31.949 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-12-17T18:26:32.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.054+0000 7f6e95ca4700 1 Processor -- start 2021-12-17T18:26:32.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.054+0000 7f6e95ca4700 1 -- start start 2021-12-17T18:26:32.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e95ca4700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6e90067830 0x7f6e900b1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e95ca4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6e9013cb30 0x7f6e9013cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e95ca4700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e900b2570 con 0x7f6e900b0690 2021-12-17T18:26:32.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e95ca4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e90067c10 con 0x7f6e9013cb30 2021-12-17T18:26:32.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e95ca4700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e90147520 con 0x7f6e90067830 2021-12-17T18:26:32.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e954a3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6e9013cb30 0x7f6e9013cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e954a3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6e9013cb30 0x7f6e9013cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54886/0 (socket says 172.21.15.62:54886) 2021-12-17T18:26:32.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e94ca2700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6e90067830 0x7f6e900b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e954a3700 1 -- 172.21.15.62:0/3927940887 learned_addr learned my addr 172.21.15.62:0/3927940887 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:32.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e94ca2700 1 -- 172.21.15.62:0/3927940887 >> v2:172.21.15.62:3300/0 conn(0x7f6e9013cb30 msgr2=0x7f6e9013cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:32.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e94ca2700 1 --2- 172.21.15.62:0/3927940887 >> v2:172.21.15.62:3300/0 conn(0x7f6e9013cb30 0x7f6e9013cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e94ca2700 1 -- 172.21.15.62:0/3927940887 >> v1:172.21.15.109:6789/0 conn(0x7f6e900b0690 legacy=0x7f6e901438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e94ca2700 1 -- 172.21.15.62:0/3927940887 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e90143420 con 0x7f6e90067830 2021-12-17T18:26:32.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e94ca2700 1 --2- 172.21.15.62:0/3927940887 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6e90067830 0x7f6e900b1360 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f6e84002f70 tx=0x7f6e84006df0).ready entity=mon.1 client_cookie=fc115ddfc0129772 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:32.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e8f7fe700 1 -- 172.21.15.62:0/3927940887 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e8400d570 con 0x7f6e90067830 2021-12-17T18:26:32.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e8f7fe700 1 -- 172.21.15.62:0/3927940887 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e84000e90 con 0x7f6e90067830 2021-12-17T18:26:32.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e8f7fe700 1 -- 172.21.15.62:0/3927940887 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e8400d8c0 con 0x7f6e90067830 2021-12-17T18:26:32.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e95ca4700 1 -- 172.21.15.62:0/3927940887 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6e90067830 msgr2=0x7f6e900b1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e95ca4700 1 --2- 172.21.15.62:0/3927940887 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6e90067830 0x7f6e900b1360 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f6e84002f70 tx=0x7f6e84006df0).stop 2021-12-17T18:26:32.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e95ca4700 1 -- 172.21.15.62:0/3927940887 shutdown_connections 2021-12-17T18:26:32.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e95ca4700 1 --2- 172.21.15.62:0/3927940887 >> v2:172.21.15.62:3300/0 conn(0x7f6e9013cb30 0x7f6e9013cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e95ca4700 1 --2- 172.21.15.62:0/3927940887 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6e90067830 0x7f6e900b1360 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e95ca4700 1 -- 172.21.15.62:0/3927940887 >> 172.21.15.62:0/3927940887 conn(0x7f6e9005c750 msgr2=0x7f6e9005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:32.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e95ca4700 1 -- 172.21.15.62:0/3927940887 shutdown_connections 2021-12-17T18:26:32.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.058+0000 7f6e95ca4700 1 -- 172.21.15.62:0/3927940887 wait complete. 2021-12-17T18:26:32.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e95ca4700 1 Processor -- start 2021-12-17T18:26:32.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e95ca4700 1 -- start start 2021-12-17T18:26:32.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e95ca4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6e90067830 0x7f6e900b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e95ca4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e900b0690 0x7f6e90141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e95ca4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6e9013cb30 0x7f6e9013f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e95ca4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9013f170 con 0x7f6e900b0690 2021-12-17T18:26:32.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e95ca4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9013dba0 con 0x7f6e9013cb30 2021-12-17T18:26:32.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e95ca4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e90141720 con 0x7f6e90067830 2021-12-17T18:26:32.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e8ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e900b0690 0x7f6e90141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e8ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e900b0690 0x7f6e90141230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54890/0 (socket says 172.21.15.62:54890) 2021-12-17T18:26:32.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e8ffff700 1 -- 172.21.15.62:0/467858606 learned_addr learned my addr 172.21.15.62:0/467858606 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:32.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e94ca2700 1 --2- 172.21.15.62:0/467858606 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6e90067830 0x7f6e900b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e954a3700 1 --2- 172.21.15.62:0/467858606 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6e9013cb30 0x7f6e9013f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e8ffff700 1 -- 172.21.15.62:0/467858606 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6e90067830 msgr2=0x7f6e900b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e8ffff700 1 --2- 172.21.15.62:0/467858606 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6e90067830 0x7f6e900b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e8ffff700 1 -- 172.21.15.62:0/467858606 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6e9013cb30 msgr2=0x7f6e9013f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e8ffff700 1 --2- 172.21.15.62:0/467858606 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6e9013cb30 0x7f6e9013f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e8ffff700 1 -- 172.21.15.62:0/467858606 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8400b180 con 0x7f6e900b0690 2021-12-17T18:26:32.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e8ffff700 1 --2- 172.21.15.62:0/467858606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e900b0690 0x7f6e90141230 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f6e900ae070 tx=0x7f6e7c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:32.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e8dffb700 1 -- 172.21.15.62:0/467858606 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e7c012400 con 0x7f6e900b0690 2021-12-17T18:26:32.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e8dffb700 1 -- 172.21.15.62:0/467858606 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c012560 con 0x7f6e900b0690 2021-12-17T18:26:32.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e95ca4700 1 -- 172.21.15.62:0/467858606 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9013de40 con 0x7f6e900b0690 2021-12-17T18:26:32.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e8dffb700 1 -- 172.21.15.62:0/467858606 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e7c0128c0 con 0x7f6e900b0690 2021-12-17T18:26:32.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.062+0000 7f6e95ca4700 1 -- 172.21.15.62:0/467858606 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e90142c60 con 0x7f6e900b0690 2021-12-17T18:26:32.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.066+0000 7f6e95ca4700 1 -- 172.21.15.62:0/467858606 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e9013f2e0 con 0x7f6e900b0690 2021-12-17T18:26:32.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.066+0000 7f6e8dffb700 1 -- 172.21.15.62:0/467858606 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6e7c019030 con 0x7f6e900b0690 2021-12-17T18:26:32.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.066+0000 7f6e8dffb700 1 --2- 172.21.15.62:0/467858606 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6e70053580 0x7f6e70055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.066+0000 7f6e8dffb700 1 -- 172.21.15.62:0/467858606 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6e7c06aa50 con 0x7f6e900b0690 2021-12-17T18:26:32.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.066+0000 7f6e94ca2700 1 --2- 172.21.15.62:0/467858606 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6e70053580 0x7f6e70055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.070+0000 7f6e94ca2700 1 --2- 172.21.15.62:0/467858606 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6e70053580 0x7f6e70055a40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f6e8401a000 tx=0x7f6e84014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:32.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.074+0000 7f6e8dffb700 1 -- 172.21.15.62:0/467858606 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6e9013f2e0 con 0x7f6e900b0690 2021-12-17T18:26:32.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.242+0000 7f6e95ca4700 1 -- 172.21.15.62:0/467858606 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6e9013f2b0 con 0x7f6e900b0690 2021-12-17T18:26:32.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.242+0000 7f6e8dffb700 1 -- 172.21.15.62:0/467858606 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v35) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f6e7c041d70 con 0x7f6e900b0690 2021-12-17T18:26:32.252 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:32.252 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:26:32.253 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_dump": [ 2021-12-17T18:26:32.253 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:32.253 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.a", 2021-12-17T18:26:32.253 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhxCS0LBAAtUlkgWYg4l3fQ2au7jMUDg==", 2021-12-17T18:26:32.254 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:32.254 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:26:32.254 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:32.254 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:32.255 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:32.255 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:32.255 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:32.255 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:32.255 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.b", 2021-12-17T18:26:32.256 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhoRJAMxAAP/NmDQRwJjYip2rxJsQlYg==", 2021-12-17T18:26:32.256 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:32.256 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:26:32.256 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:32.257 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:32.257 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:32.257 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:32.257 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:32.258 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:32.258 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.0", 2021-12-17T18:26:32.258 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBA1LxhJXzhKhAAUnxP3G5VuATkQLoDALFjVg==", 2021-12-17T18:26:32.259 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:32.259 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:32.259 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:32.260 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:32.260 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:32.260 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:32.260 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:32.261 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.1", 2021-12-17T18:26:32.261 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBD1LxhregUDhAABrxQ2jQ4BwXvuWh/D9SkbQ==", 2021-12-17T18:26:32.261 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:32.261 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:32.262 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:32.262 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:32.262 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:32.262 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:32.263 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:32.263 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.2", 2021-12-17T18:26:32.263 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBF1LxhOo/SLhAAhQQLW/VKFx1sgm8chnD5tw==", 2021-12-17T18:26:32.263 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:32.264 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:32.264 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:32.264 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:32.264 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:32.265 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:32.265 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:32.265 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.3", 2021-12-17T18:26:32.266 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBI1LxhT2ZQExAA999j8V5bJAJ2PuaQqSkUOw==", 2021-12-17T18:26:32.266 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:32.266 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:32.266 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:32.267 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:32.267 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:32.267 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:32.267 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:32.268 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.4", 2021-12-17T18:26:32.268 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBN1LxhKBDzFhAAKmPF0FXnnfXtweo+6z9nxg==", 2021-12-17T18:26:32.268 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:32.268 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:32.269 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:32.269 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:32.269 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:32.269 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:32.270 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:32.270 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.5", 2021-12-17T18:26:32.270 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBP1LxhtqkAORAAVaFLVNIUMs4Sytk8WRaGNA==", 2021-12-17T18:26:32.271 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:32.271 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:32.271 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:32.271 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:32.271 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:32.272 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:32.272 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:32.272 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.6", 2021-12-17T18:26:32.272 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBS1LxhNtncGhAAgG64g1ie54CDp9Y7uldKQA==", 2021-12-17T18:26:32.273 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:32.273 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:32.273 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:32.273 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:32.274 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:32.274 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:32.274 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:32.274 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.7", 2021-12-17T18:26:32.275 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBV1Lxh3DcDABAAHVskSVtoEJ8BxCCAs3ZDVA==", 2021-12-17T18:26:32.275 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:32.275 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:32.275 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:32.276 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:32.276 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:32.276 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:32.277 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:32.277 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.0", 2021-12-17T18:26:32.277 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxh9QhCNxAALkWTJorDpbt9yrikL7/NWg==", 2021-12-17T18:26:32.277 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:32.278 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:26:32.278 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:26:32.278 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:26:32.278 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:32.279 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:32.279 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:32.279 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.1", 2021-12-17T18:26:32.279 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxhxm52OxAAbqXVaqRDmt4Ezj9xyCEODQ==", 2021-12-17T18:26:32.280 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:32.280 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:26:32.280 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:26:32.280 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:26:32.281 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:32.281 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:32.281 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:32.281 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.2", 2021-12-17T18:26:32.282 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+1LxhXu08BBAATRcUAZvMNg9ou4PLszDtmA==", 2021-12-17T18:26:32.282 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:32.282 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:26:32.282 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:26:32.282 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:26:32.283 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:32.283 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:32.283 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:32.283 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.admin", 2021-12-17T18:26:32.284 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhyAGlDRAA2ggSG5yBBFbMgK2fCBk2mQ==", 2021-12-17T18:26:32.284 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:32.284 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:26:32.284 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:26:32.285 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:26:32.285 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:32.285 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:32.285 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:32.286 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:32.286 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.x", 2021-12-17T18:26:32.286 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhzvntKRAAFQlg69Z6d2nWX0GxSshsMw==", 2021-12-17T18:26:32.286 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:32.287 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:26:32.287 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:26:32.287 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:32.288 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:32.288 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:32.289 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:32.289 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.y", 2021-12-17T18:26:32.289 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhKdTGJRAArzUN3A1U5Efw0NG9Gw2Gcw==", 2021-12-17T18:26:32.290 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:26:32.290 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:26:32.290 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:26:32.291 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:26:32.291 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:32.292 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:32.292 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:32.293 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:26:32.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.246+0000 7f6e95ca4700 1 -- 172.21.15.62:0/467858606 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6e70053580 msgr2=0x7f6e70055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.246+0000 7f6e95ca4700 1 --2- 172.21.15.62:0/467858606 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6e70053580 0x7f6e70055a40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f6e8401a000 tx=0x7f6e84014000).stop 2021-12-17T18:26:32.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.246+0000 7f6e95ca4700 1 -- 172.21.15.62:0/467858606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e900b0690 msgr2=0x7f6e90141230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.246+0000 7f6e95ca4700 1 --2- 172.21.15.62:0/467858606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e900b0690 0x7f6e90141230 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f6e900ae070 tx=0x7f6e7c007c50).stop 2021-12-17T18:26:32.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.246+0000 7f6e95ca4700 1 -- 172.21.15.62:0/467858606 shutdown_connections 2021-12-17T18:26:32.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.246+0000 7f6e95ca4700 1 --2- 172.21.15.62:0/467858606 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6e70053580 0x7f6e70055a40 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.246+0000 7f6e95ca4700 1 --2- 172.21.15.62:0/467858606 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6e9013cb30 0x7f6e9013f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.246+0000 7f6e95ca4700 1 --2- 172.21.15.62:0/467858606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e900b0690 0x7f6e90141230 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.246+0000 7f6e95ca4700 1 --2- 172.21.15.62:0/467858606 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6e90067830 0x7f6e900b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.246+0000 7f6e95ca4700 1 -- 172.21.15.62:0/467858606 >> 172.21.15.62:0/467858606 conn(0x7f6e9005c750 msgr2=0x7f6e901445e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:32.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.246+0000 7f6e95ca4700 1 -- 172.21.15.62:0/467858606 shutdown_connections 2021-12-17T18:26:32.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.246+0000 7f6e95ca4700 1 -- 172.21.15.62:0/467858606 wait complete. 2021-12-17T18:26:32.300 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:26:32.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8c55e700 1 Processor -- start 2021-12-17T18:26:32.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8c55e700 1 -- start start 2021-12-17T18:26:32.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8c55e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2d840a7bb0 0x7f2d84067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8c55e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d840b2ce0 con 0x7f2d840b1730 2021-12-17T18:26:32.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8c55e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d840aca60 con 0x7f2d840b21f0 2021-12-17T18:26:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8c55e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d8414b5b0 con 0x7f2d840a7bb0 2021-12-17T18:26:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d89af9700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2d840b1730 0x7f2d840ace90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38476/0 (socket says 172.21.15.62:38476) 2021-12-17T18:26:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d89af9700 1 -- 172.21.15.62:0/3943186040 learned_addr learned my addr 172.21.15.62:0/3943186040 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:32.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8aafb700 1 --2- 172.21.15.62:0/3943186040 >> v2:172.21.15.62:3300/0 conn(0x7f2d840a7bb0 0x7f2d84067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d892f8700 1 -- 172.21.15.62:0/3943186040 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869104694 0 0) 0x7f2d840b2ce0 con 0x7f2d840b1730 2021-12-17T18:26:32.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8aafb700 1 -- 172.21.15.62:0/3943186040 >> v1:172.21.15.109:6789/0 conn(0x7f2d840b21f0 legacy=0x7f2d8414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:32.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8aafb700 1 -- 172.21.15.62:0/3943186040 >> v1:172.21.15.62:6789/0 conn(0x7f2d840b1730 legacy=0x7f2d840ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8aafb700 1 -- 172.21.15.62:0/3943186040 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d840b2f10 con 0x7f2d840a7bb0 2021-12-17T18:26:32.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8aafb700 1 --2- 172.21.15.62:0/3943186040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d840a7bb0 0x7f2d84067120 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f2d84061080 tx=0x7f2d7c0091d0).ready entity=mon.0 client_cookie=d21f4b254083515d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:32.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d892f8700 1 -- 172.21.15.62:0/3943186040 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d7c00b820 con 0x7f2d840a7bb0 2021-12-17T18:26:32.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d892f8700 1 -- 172.21.15.62:0/3943186040 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7c00b980 con 0x7f2d840a7bb0 2021-12-17T18:26:32.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d892f8700 1 -- 172.21.15.62:0/3943186040 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d7c00baf0 con 0x7f2d840a7bb0 2021-12-17T18:26:32.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8c55e700 1 -- 172.21.15.62:0/3943186040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d840a7bb0 msgr2=0x7f2d84067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8c55e700 1 --2- 172.21.15.62:0/3943186040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d840a7bb0 0x7f2d84067120 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f2d84061080 tx=0x7f2d7c0091d0).stop 2021-12-17T18:26:32.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8c55e700 1 -- 172.21.15.62:0/3943186040 shutdown_connections 2021-12-17T18:26:32.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8c55e700 1 --2- 172.21.15.62:0/3943186040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d840a7bb0 0x7f2d84067120 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8c55e700 1 -- 172.21.15.62:0/3943186040 >> 172.21.15.62:0/3943186040 conn(0x7f2d8405f730 msgr2=0x7f2d8405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:32.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8c55e700 1 -- 172.21.15.62:0/3943186040 shutdown_connections 2021-12-17T18:26:32.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.398+0000 7f2d8c55e700 1 -- 172.21.15.62:0/3943186040 wait complete. 2021-12-17T18:26:32.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d8c55e700 1 Processor -- start 2021-12-17T18:26:32.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d8c55e700 1 -- start start 2021-12-17T18:26:32.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d8c55e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2d840a7bb0 0x7f2d8414dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d8c55e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d840b1730 0x7f2d84156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d8c55e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2d840b21f0 0x7f2d841571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d8c55e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8414d230 con 0x7f2d840b1730 2021-12-17T18:26:32.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d8c55e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8414c400 con 0x7f2d840a7bb0 2021-12-17T18:26:32.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d8c55e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8414d460 con 0x7f2d840b21f0 2021-12-17T18:26:32.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d89af9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d840b1730 0x7f2d84156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d89af9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d840b1730 0x7f2d84156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54904/0 (socket says 172.21.15.62:54904) 2021-12-17T18:26:32.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d89af9700 1 -- 172.21.15.62:0/1255863535 learned_addr learned my addr 172.21.15.62:0/1255863535 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:32.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d8aafb700 1 --2- 172.21.15.62:0/1255863535 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2d840b21f0 0x7f2d841571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d8a2fa700 1 --2- 172.21.15.62:0/1255863535 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2d840a7bb0 0x7f2d8414dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d89af9700 1 -- 172.21.15.62:0/1255863535 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2d840b21f0 msgr2=0x7f2d841571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d89af9700 1 --2- 172.21.15.62:0/1255863535 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2d840b21f0 0x7f2d841571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d89af9700 1 -- 172.21.15.62:0/1255863535 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2d840a7bb0 msgr2=0x7f2d8414dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d89af9700 1 --2- 172.21.15.62:0/1255863535 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2d840a7bb0 0x7f2d8414dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d89af9700 1 -- 172.21.15.62:0/1255863535 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c009470 con 0x7f2d840b1730 2021-12-17T18:26:32.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d89af9700 1 --2- 172.21.15.62:0/1255863535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d840b1730 0x7f2d84156cd0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f2d80000ed0 tx=0x7f2d80007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:32.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d737fe700 1 -- 172.21.15.62:0/1255863535 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d800070d0 con 0x7f2d840b1730 2021-12-17T18:26:32.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d737fe700 1 -- 172.21.15.62:0/1255863535 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d80007230 con 0x7f2d840b1730 2021-12-17T18:26:32.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d8c55e700 1 -- 172.21.15.62:0/1255863535 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d840ac5a0 con 0x7f2d840b1730 2021-12-17T18:26:32.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d737fe700 1 -- 172.21.15.62:0/1255863535 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d80005610 con 0x7f2d840b1730 2021-12-17T18:26:32.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.402+0000 7f2d8c55e700 1 -- 172.21.15.62:0/1255863535 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d841576b0 con 0x7f2d840b1730 2021-12-17T18:26:32.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.406+0000 7f2d737fe700 1 -- 172.21.15.62:0/1255863535 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2d8001a060 con 0x7f2d840b1730 2021-12-17T18:26:32.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.406+0000 7f2d8c55e700 1 -- 172.21.15.62:0/1255863535 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d840ad5a0 con 0x7f2d840b1730 2021-12-17T18:26:32.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.406+0000 7f2d737fe700 1 --2- 172.21.15.62:0/1255863535 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2d640536a0 0x7f2d64055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.406+0000 7f2d737fe700 1 -- 172.21.15.62:0/1255863535 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f2d8006ae00 con 0x7f2d840b1730 2021-12-17T18:26:32.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.406+0000 7f2d8a2fa700 1 --2- 172.21.15.62:0/1255863535 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2d640536a0 0x7f2d64055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.406+0000 7f2d8a2fa700 1 --2- 172.21.15.62:0/1255863535 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2d640536a0 0x7f2d64055b60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f2d7400a000 tx=0x7f2d74008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:32.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.410+0000 7f2d737fe700 1 -- 172.21.15.62:0/1255863535 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2d80042290 con 0x7f2d840b1730 2021-12-17T18:26:32.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.538+0000 7f2d8c55e700 1 -- 172.21.15.62:0/1255863535 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d840573d0 con 0x7f2d840b1730 2021-12-17T18:26:32.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.538+0000 7f2d737fe700 1 -- 172.21.15.62:0/1255863535 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+13236 (secure 0 0 0) 0x7f2d80018070 con 0x7f2d840b1730 2021-12-17T18:26:32.547 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:32.547 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":108,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:26:31.915341+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:26:32.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.542+0000 7f2d8c55e700 1 -- 172.21.15.62:0/1255863535 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2d640536a0 msgr2=0x7f2d64055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.542+0000 7f2d8c55e700 1 --2- 172.21.15.62:0/1255863535 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2d640536a0 0x7f2d64055b60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f2d7400a000 tx=0x7f2d74008040).stop 2021-12-17T18:26:32.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.542+0000 7f2d8c55e700 1 -- 172.21.15.62:0/1255863535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d840b1730 msgr2=0x7f2d84156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.542+0000 7f2d8c55e700 1 --2- 172.21.15.62:0/1255863535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d840b1730 0x7f2d84156cd0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f2d80000ed0 tx=0x7f2d80007ac0).stop 2021-12-17T18:26:32.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.542+0000 7f2d8c55e700 1 -- 172.21.15.62:0/1255863535 shutdown_connections 2021-12-17T18:26:32.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.542+0000 7f2d8c55e700 1 --2- 172.21.15.62:0/1255863535 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2d640536a0 0x7f2d64055b60 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.542+0000 7f2d8c55e700 1 --2- 172.21.15.62:0/1255863535 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2d840b21f0 0x7f2d841571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.542+0000 7f2d8c55e700 1 --2- 172.21.15.62:0/1255863535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d840b1730 0x7f2d84156cd0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.542+0000 7f2d8c55e700 1 --2- 172.21.15.62:0/1255863535 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2d840a7bb0 0x7f2d8414dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.542+0000 7f2d8c55e700 1 -- 172.21.15.62:0/1255863535 >> 172.21.15.62:0/1255863535 conn(0x7f2d8405f730 msgr2=0x7f2d84148240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:32.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.542+0000 7f2d8c55e700 1 -- 172.21.15.62:0/1255863535 shutdown_connections 2021-12-17T18:26:32.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.542+0000 7f2d8c55e700 1 -- 172.21.15.62:0/1255863535 wait complete. 2021-12-17T18:26:32.560 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-12-17T18:26:32.561 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:26:32.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe63d1bf700 1 Processor -- start 2021-12-17T18:26:32.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe63d1bf700 1 -- start start 2021-12-17T18:26:32.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe63d1bf700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe6380b2070 0x7fe6380aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe63d1bf700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6380afeb0 0x7fe638143100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe63d1bf700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6380ac950 con 0x7fe6381435f0 2021-12-17T18:26:32.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe63d1bf700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63805ce60 con 0x7fe6380b2070 2021-12-17T18:26:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe63d1bf700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe638142ca0 con 0x7fe6380afeb0 2021-12-17T18:26:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe63c9be700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe6381435f0 0x7fe63805c750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38494/0 (socket says 172.21.15.62:38494) 2021-12-17T18:26:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe63c9be700 1 -- 172.21.15.62:0/2815235660 learned_addr learned my addr 172.21.15.62:0/2815235660 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:32.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe637fff700 1 --2- 172.21.15.62:0/2815235660 >> v2:172.21.15.109:3300/0 conn(0x7fe6380b2070 0x7fe6380aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe6377fe700 1 --2- 172.21.15.62:0/2815235660 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6380afeb0 0x7fe638143100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe636ffd700 1 -- 172.21.15.62:0/2815235660 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151244558 0 0) 0x7fe6380ac950 con 0x7fe6381435f0 2021-12-17T18:26:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe636ffd700 1 -- 172.21.15.62:0/2815235660 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe618003260 con 0x7fe6381435f0 2021-12-17T18:26:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe636ffd700 1 -- 172.21.15.62:0/2815235660 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3358855369 0 0) 0x7fe618003260 con 0x7fe6381435f0 2021-12-17T18:26:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe636ffd700 1 -- 172.21.15.62:0/2815235660 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6380afeb0 msgr2=0x7fe638143100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe636ffd700 1 --2- 172.21.15.62:0/2815235660 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6380afeb0 0x7fe638143100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe636ffd700 1 -- 172.21.15.62:0/2815235660 >> v2:172.21.15.109:3300/0 conn(0x7fe6380b2070 msgr2=0x7fe6380aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe636ffd700 1 --2- 172.21.15.62:0/2815235660 >> v2:172.21.15.109:3300/0 conn(0x7fe6380b2070 0x7fe6380aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe636ffd700 1 -- 172.21.15.62:0/2815235660 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6380b2450 con 0x7fe6381435f0 2021-12-17T18:26:32.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe636ffd700 1 -- 172.21.15.62:0/2815235660 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fe6300019e0 con 0x7fe6381435f0 2021-12-17T18:26:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.666+0000 7fe636ffd700 1 -- 172.21.15.62:0/2815235660 >> v1:172.21.15.62:6789/0 conn(0x7fe6381435f0 legacy=0x7fe63805c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe636ffd700 1 --2- 172.21.15.62:0/2815235660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe618003750 0x7fe618003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe636ffd700 1 --2- 172.21.15.62:0/2815235660 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe618004500 0x7fe618004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe636ffd700 1 --2- 172.21.15.62:0/2815235660 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6380afeb0 0x7fe618004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe636ffd700 1 -- 172.21.15.62:0/2815235660 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63805ce60 con 0x7fe618003750 2021-12-17T18:26:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe636ffd700 1 -- 172.21.15.62:0/2815235660 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe638142ca0 con 0x7fe618004500 2021-12-17T18:26:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe636ffd700 1 -- 172.21.15.62:0/2815235660 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61800d960 con 0x7fe6380afeb0 2021-12-17T18:26:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe637fff700 1 --2- 172.21.15.62:0/2815235660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe618003750 0x7fe618003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe6377fe700 1 --2- 172.21.15.62:0/2815235660 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe618004500 0x7fe618004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe63c9be700 1 --2- 172.21.15.62:0/2815235660 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6380afeb0 0x7fe618004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe637fff700 1 -- 172.21.15.62:0/2815235660 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6380afeb0 msgr2=0x7fe618004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe637fff700 1 --2- 172.21.15.62:0/2815235660 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6380afeb0 0x7fe618004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe637fff700 1 -- 172.21.15.62:0/2815235660 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe618004500 msgr2=0x7fe618004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe637fff700 1 --2- 172.21.15.62:0/2815235660 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe618004500 0x7fe618004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe637fff700 1 -- 172.21.15.62:0/2815235660 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe618003260 con 0x7fe618003750 2021-12-17T18:26:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe637fff700 1 --2- 172.21.15.62:0/2815235660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe618003750 0x7fe618003b70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fe62000c000 tx=0x7fe620006df0).ready entity=mon.0 client_cookie=1b1deb7da627e9e4 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe636ffd700 1 -- 172.21.15.62:0/2815235660 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe62000e830 con 0x7fe618003750 2021-12-17T18:26:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe636ffd700 1 -- 172.21.15.62:0/2815235660 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62000e990 con 0x7fe618003750 2021-12-17T18:26:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe636ffd700 1 -- 172.21.15.62:0/2815235660 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe62000ecf0 con 0x7fe618003750 2021-12-17T18:26:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe63d1bf700 1 -- 172.21.15.62:0/2815235660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe618003750 msgr2=0x7fe618003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe63d1bf700 1 --2- 172.21.15.62:0/2815235660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe618003750 0x7fe618003b70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fe62000c000 tx=0x7fe620006df0).stop 2021-12-17T18:26:32.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe63c9be700 1 -- 172.21.15.62:0/2815235660 reap_dead start 2021-12-17T18:26:32.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe63d1bf700 1 -- 172.21.15.62:0/2815235660 shutdown_connections 2021-12-17T18:26:32.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe63d1bf700 1 -- 172.21.15.62:0/2815235660 >> 172.21.15.62:0/2815235660 conn(0x7fe63805c070 msgr2=0x7fe638062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:32.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe63d1bf700 1 -- 172.21.15.62:0/2815235660 shutdown_connections 2021-12-17T18:26:32.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe63d1bf700 1 -- 172.21.15.62:0/2815235660 wait complete. 2021-12-17T18:26:32.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe63d1bf700 1 Processor -- start 2021-12-17T18:26:32.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.670+0000 7fe63d1bf700 1 -- start start 2021-12-17T18:26:32.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63d1bf700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe618003750 0x7fe638152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63d1bf700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6380ac080 0x7fe638147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63d1bf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe63814a330 0x7fe638152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63d1bf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe638143c00 con 0x7fe63814a330 2021-12-17T18:26:32.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63d1bf700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe638143ea0 con 0x7fe618003750 2021-12-17T18:26:32.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63d1bf700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63814a7b0 con 0x7fe6380ac080 2021-12-17T18:26:32.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63c9be700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe63814a330 0x7fe638152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63c9be700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe63814a330 0x7fe638152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54926/0 (socket says 172.21.15.62:54926) 2021-12-17T18:26:32.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63c9be700 1 -- 172.21.15.62:0/3521894157 learned_addr learned my addr 172.21.15.62:0/3521894157 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:32.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe6377fe700 1 --2- 172.21.15.62:0/3521894157 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6380ac080 0x7fe638147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe637fff700 1 --2- 172.21.15.62:0/3521894157 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe618003750 0x7fe638152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63c9be700 1 -- 172.21.15.62:0/3521894157 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6380ac080 msgr2=0x7fe638147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63c9be700 1 --2- 172.21.15.62:0/3521894157 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6380ac080 0x7fe638147e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63c9be700 1 -- 172.21.15.62:0/3521894157 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe618003750 msgr2=0x7fe638152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63c9be700 1 --2- 172.21.15.62:0/3521894157 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe618003750 0x7fe638152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63c9be700 1 -- 172.21.15.62:0/3521894157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe638153020 con 0x7fe63814a330 2021-12-17T18:26:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe6377fe700 1 --2- 172.21.15.62:0/3521894157 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6380ac080 0x7fe638147e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63c9be700 1 --2- 172.21.15.62:0/3521894157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe63814a330 0x7fe638152b30 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fe630000b60 tx=0x7fe638068620).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe6357fa700 1 -- 172.21.15.62:0/3521894157 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63000f8b0 con 0x7fe63814a330 2021-12-17T18:26:32.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe6357fa700 1 -- 172.21.15.62:0/3521894157 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63000fa10 con 0x7fe63814a330 2021-12-17T18:26:32.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63d1bf700 1 -- 172.21.15.62:0/3521894157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe638153270 con 0x7fe63814a330 2021-12-17T18:26:32.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe6357fa700 1 -- 172.21.15.62:0/3521894157 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63000fd70 con 0x7fe63814a330 2021-12-17T18:26:32.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63d1bf700 1 -- 172.21.15.62:0/3521894157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe638155ee0 con 0x7fe63814a330 2021-12-17T18:26:32.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe63d1bf700 1 -- 172.21.15.62:0/3521894157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6381440a0 con 0x7fe63814a330 2021-12-17T18:26:32.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe6357fa700 1 -- 172.21.15.62:0/3521894157 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe63001c360 con 0x7fe63814a330 2021-12-17T18:26:32.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe6357fa700 1 --2- 172.21.15.62:0/3521894157 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe61c0534f0 0x7fe61c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe6357fa700 1 -- 172.21.15.62:0/3521894157 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe63006af30 con 0x7fe63814a330 2021-12-17T18:26:32.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.674+0000 7fe637fff700 1 --2- 172.21.15.62:0/3521894157 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe61c0534f0 0x7fe61c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.678+0000 7fe637fff700 1 --2- 172.21.15.62:0/3521894157 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe61c0534f0 0x7fe61c0559b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fe62001c000 tx=0x7fe620019000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:32.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.682+0000 7fe6357fa700 1 -- 172.21.15.62:0/3521894157 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe6300422c0 con 0x7fe63814a330 2021-12-17T18:26:32.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.810+0000 7fe63d1bf700 1 -- 172.21.15.62:0/3521894157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe6380573d0 con 0x7fe63814a330 2021-12-17T18:26:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.810+0000 7fe6357fa700 1 -- 172.21.15.62:0/3521894157 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v108) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe630019030 con 0x7fe63814a330 2021-12-17T18:26:32.820 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:26:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.814+0000 7fe63d1bf700 1 -- 172.21.15.62:0/3521894157 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe61c0534f0 msgr2=0x7fe61c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.814+0000 7fe63d1bf700 1 --2- 172.21.15.62:0/3521894157 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe61c0534f0 0x7fe61c0559b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fe62001c000 tx=0x7fe620019000).stop 2021-12-17T18:26:32.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.814+0000 7fe63d1bf700 1 -- 172.21.15.62:0/3521894157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe63814a330 msgr2=0x7fe638152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.814+0000 7fe63d1bf700 1 --2- 172.21.15.62:0/3521894157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe63814a330 0x7fe638152b30 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fe630000b60 tx=0x7fe638068620).stop 2021-12-17T18:26:32.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.814+0000 7fe63d1bf700 1 -- 172.21.15.62:0/3521894157 shutdown_connections 2021-12-17T18:26:32.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.814+0000 7fe63d1bf700 1 --2- 172.21.15.62:0/3521894157 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe61c0534f0 0x7fe61c0559b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.814+0000 7fe63d1bf700 1 --2- 172.21.15.62:0/3521894157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe63814a330 0x7fe638152b30 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.814+0000 7fe63d1bf700 1 --2- 172.21.15.62:0/3521894157 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6380ac080 0x7fe638147e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.814+0000 7fe63d1bf700 1 --2- 172.21.15.62:0/3521894157 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe618003750 0x7fe638152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.814+0000 7fe63d1bf700 1 -- 172.21.15.62:0/3521894157 >> 172.21.15.62:0/3521894157 conn(0x7fe63805c070 msgr2=0x7fe6380b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:32.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.814+0000 7fe63d1bf700 1 -- 172.21.15.62:0/3521894157 shutdown_connections 2021-12-17T18:26:32.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.814+0000 7fe63d1bf700 1 -- 172.21.15.62:0/3521894157 wait complete. 2021-12-17T18:26:32.840 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:26:32.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb67d193700 1 Processor -- start 2021-12-17T18:26:32.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb67d193700 1 -- start start 2021-12-17T18:26:32.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb67d193700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fb67805c8f0 0x7fb6780b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb67d193700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67805f9d0 con 0x7fb678141890 2021-12-17T18:26:32.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb67d193700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6780abe60 con 0x7fb6780af3a0 2021-12-17T18:26:32.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb67d193700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67805ff60 con 0x7fb67805c8f0 2021-12-17T18:26:32.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb67c992700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb678141890 0x7fb6781445e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38514/0 (socket says 172.21.15.62:38514) 2021-12-17T18:26:32.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb67c992700 1 -- 172.21.15.62:0/3909452575 learned_addr learned my addr 172.21.15.62:0/3909452575 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:32.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb677fff700 1 --2- 172.21.15.62:0/3909452575 >> v2:172.21.15.109:3300/0 conn(0x7fb67805c8f0 0x7fb6780b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb676ffd700 1 -- 172.21.15.62:0/3909452575 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4137566596 0 0) 0x7fb67805f9d0 con 0x7fb678141890 2021-12-17T18:26:32.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb676ffd700 1 -- 172.21.15.62:0/3909452575 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb664003260 con 0x7fb678141890 2021-12-17T18:26:32.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb676ffd700 1 -- 172.21.15.62:0/3909452575 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3190678330 0 0) 0x7fb664003260 con 0x7fb678141890 2021-12-17T18:26:32.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb677fff700 1 -- 172.21.15.62:0/3909452575 >> v1:172.21.15.109:6789/0 conn(0x7fb6780af3a0 legacy=0x7fb678141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb677fff700 1 -- 172.21.15.62:0/3909452575 >> v1:172.21.15.62:6789/0 conn(0x7fb678141890 legacy=0x7fb6781445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb677fff700 1 -- 172.21.15.62:0/3909452575 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67805ccd0 con 0x7fb67805c8f0 2021-12-17T18:26:32.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb677fff700 1 --2- 172.21.15.62:0/3909452575 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb67805c8f0 0x7fb6780b0620 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fb670001b80 tx=0x7fb668006df0).ready entity=mon.1 client_cookie=a6b6d509bfe02971 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:32.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb676ffd700 1 -- 172.21.15.62:0/3909452575 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6700019e0 con 0x7fb67805c8f0 2021-12-17T18:26:32.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb676ffd700 1 -- 172.21.15.62:0/3909452575 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb668000e90 con 0x7fb67805c8f0 2021-12-17T18:26:32.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.950+0000 7fb676ffd700 1 -- 172.21.15.62:0/3909452575 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb668011400 con 0x7fb67805c8f0 2021-12-17T18:26:32.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67d193700 1 -- 172.21.15.62:0/3909452575 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb67805c8f0 msgr2=0x7fb6780b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67d193700 1 --2- 172.21.15.62:0/3909452575 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb67805c8f0 0x7fb6780b0620 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fb670001b80 tx=0x7fb668006df0).stop 2021-12-17T18:26:32.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67d193700 1 -- 172.21.15.62:0/3909452575 shutdown_connections 2021-12-17T18:26:32.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67d193700 1 --2- 172.21.15.62:0/3909452575 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb67805c8f0 0x7fb6780b0620 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67d193700 1 -- 172.21.15.62:0/3909452575 >> 172.21.15.62:0/3909452575 conn(0x7fb67805be70 msgr2=0x7fb678062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:32.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67d193700 1 -- 172.21.15.62:0/3909452575 shutdown_connections 2021-12-17T18:26:32.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67d193700 1 -- 172.21.15.62:0/3909452575 wait complete. 2021-12-17T18:26:32.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67d193700 1 Processor -- start 2021-12-17T18:26:32.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67d193700 1 -- start start 2021-12-17T18:26:32.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67d193700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb67805c8f0 0x7fb678063d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67d193700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6780af3a0 0x7fb678150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67d193700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb678141890 0x7fb6781537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67d193700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb678146030 con 0x7fb678141890 2021-12-17T18:26:32.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67d193700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780645d0 con 0x7fb67805c8f0 2021-12-17T18:26:32.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67d193700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6781430d0 con 0x7fb6780af3a0 2021-12-17T18:26:32.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67c992700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb678141890 0x7fb6781537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67c992700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb678141890 0x7fb6781537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54940/0 (socket says 172.21.15.62:54940) 2021-12-17T18:26:32.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67c992700 1 -- 172.21.15.62:0/3160695287 learned_addr learned my addr 172.21.15.62:0/3160695287 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:32.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb6777fe700 1 --2- 172.21.15.62:0/3160695287 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6780af3a0 0x7fb678150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb677fff700 1 --2- 172.21.15.62:0/3160695287 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb67805c8f0 0x7fb678063d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67c992700 1 -- 172.21.15.62:0/3160695287 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6780af3a0 msgr2=0x7fb678150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67c992700 1 --2- 172.21.15.62:0/3160695287 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6780af3a0 0x7fb678150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67c992700 1 -- 172.21.15.62:0/3160695287 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb67805c8f0 msgr2=0x7fb678063d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:32.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67c992700 1 --2- 172.21.15.62:0/3160695287 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb67805c8f0 0x7fb678063d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:32.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb67c992700 1 -- 172.21.15.62:0/3160695287 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66800b180 con 0x7fb678141890 2021-12-17T18:26:32.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.954+0000 7fb677fff700 1 --2- 172.21.15.62:0/3160695287 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb67805c8f0 0x7fb678063d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:32.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.958+0000 7fb67c992700 1 --2- 172.21.15.62:0/3160695287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb678141890 0x7fb6781537b0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7fb670001c40 tx=0x7fb670002100).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:32.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.958+0000 7fb6757fa700 1 -- 172.21.15.62:0/3160695287 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb670004ab0 con 0x7fb678141890 2021-12-17T18:26:32.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.958+0000 7fb6757fa700 1 -- 172.21.15.62:0/3160695287 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb670004c10 con 0x7fb678141890 2021-12-17T18:26:32.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.958+0000 7fb67d193700 1 -- 172.21.15.62:0/3160695287 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb678064200 con 0x7fb678141890 2021-12-17T18:26:32.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.958+0000 7fb6757fa700 1 -- 172.21.15.62:0/3160695287 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb670007170 con 0x7fb678141890 2021-12-17T18:26:32.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.958+0000 7fb67d193700 1 -- 172.21.15.62:0/3160695287 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb678143b60 con 0x7fb678141890 2021-12-17T18:26:32.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.958+0000 7fb67d193700 1 -- 172.21.15.62:0/3160695287 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb678143550 con 0x7fb678141890 2021-12-17T18:26:32.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.958+0000 7fb6757fa700 1 -- 172.21.15.62:0/3160695287 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb6700072d0 con 0x7fb678141890 2021-12-17T18:26:32.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.958+0000 7fb6757fa700 1 --2- 172.21.15.62:0/3160695287 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb658053610 0x7fb658055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:32.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.958+0000 7fb6757fa700 1 -- 172.21.15.62:0/3160695287 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb67006b280 con 0x7fb678141890 2021-12-17T18:26:32.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.958+0000 7fb677fff700 1 --2- 172.21.15.62:0/3160695287 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb658053610 0x7fb658055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:32.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.962+0000 7fb677fff700 1 --2- 172.21.15.62:0/3160695287 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb658053610 0x7fb658055ad0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fb668017000 tx=0x7fb668006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:32.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:32.966+0000 7fb6757fa700 1 -- 172.21.15.62:0/3160695287 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb678143550 con 0x7fb678141890 2021-12-17T18:26:33.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.090+0000 7fb67d193700 1 -- 172.21.15.62:0/3160695287 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb678143550 con 0x7fb678141890 2021-12-17T18:26:33.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.094+0000 7fb6757fa700 1 -- 172.21.15.62:0/3160695287 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v108) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb678143550 con 0x7fb678141890 2021-12-17T18:26:33.100 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:26:33.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.094+0000 7fb67d193700 1 -- 172.21.15.62:0/3160695287 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb658053610 msgr2=0x7fb658055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.094+0000 7fb67d193700 1 --2- 172.21.15.62:0/3160695287 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb658053610 0x7fb658055ad0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fb668017000 tx=0x7fb668006df0).stop 2021-12-17T18:26:33.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.094+0000 7fb67d193700 1 -- 172.21.15.62:0/3160695287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb678141890 msgr2=0x7fb6781537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.094+0000 7fb67d193700 1 --2- 172.21.15.62:0/3160695287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb678141890 0x7fb6781537b0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7fb670001c40 tx=0x7fb670002100).stop 2021-12-17T18:26:33.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.094+0000 7fb67d193700 1 -- 172.21.15.62:0/3160695287 shutdown_connections 2021-12-17T18:26:33.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.094+0000 7fb67d193700 1 --2- 172.21.15.62:0/3160695287 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb658053610 0x7fb658055ad0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.094+0000 7fb67d193700 1 --2- 172.21.15.62:0/3160695287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb678141890 0x7fb6781537b0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.094+0000 7fb67d193700 1 --2- 172.21.15.62:0/3160695287 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6780af3a0 0x7fb678150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.094+0000 7fb67d193700 1 --2- 172.21.15.62:0/3160695287 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb67805c8f0 0x7fb678063d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.094+0000 7fb67d193700 1 -- 172.21.15.62:0/3160695287 >> 172.21.15.62:0/3160695287 conn(0x7fb67805be70 msgr2=0x7fb67806ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:33.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.094+0000 7fb67d193700 1 -- 172.21.15.62:0/3160695287 shutdown_connections 2021-12-17T18:26:33.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.094+0000 7fb67d193700 1 -- 172.21.15.62:0/3160695287 wait complete. 2021-12-17T18:26:33.114 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-12-17T18:26:33.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.210+0000 7f48c0bc0700 1 Processor -- start 2021-12-17T18:26:33.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.210+0000 7f48c0bc0700 1 -- start start 2021-12-17T18:26:33.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.210+0000 7f48c0bc0700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f48bc0b6060 0x7f48bc13fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:33.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.210+0000 7f48c0bc0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f48bc0afcf0 0x7f48bc143280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:33.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.210+0000 7f48c0bc0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48bc0b1540 con 0x7f48bc0b5c80 2021-12-17T18:26:33.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.210+0000 7f48c0bc0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48bc0b0160 con 0x7f48bc0afcf0 2021-12-17T18:26:33.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.210+0000 7f48c0bc0700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48bc0af5b0 con 0x7f48bc0b6060 2021-12-17T18:26:33.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.210+0000 7f48bbfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f48bc0afcf0 0x7f48bc143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.210+0000 7f48bbfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f48bc0afcf0 0x7f48bc143280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54948/0 (socket says 172.21.15.62:54948) 2021-12-17T18:26:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.210+0000 7f48bbfff700 1 -- 172.21.15.62:0/2790337075 learned_addr learned my addr 172.21.15.62:0/2790337075 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48baffd700 1 --2- 172.21.15.62:0/2790337075 >> v2:172.21.15.109:3300/0 conn(0x7f48bc0b6060 0x7f48bc13fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48bbfff700 1 -- 172.21.15.62:0/2790337075 >> v2:172.21.15.109:3300/0 conn(0x7f48bc0b6060 msgr2=0x7f48bc13fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48bbfff700 1 --2- 172.21.15.62:0/2790337075 >> v2:172.21.15.109:3300/0 conn(0x7f48bc0b6060 0x7f48bc13fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48bbfff700 1 -- 172.21.15.62:0/2790337075 >> v1:172.21.15.62:6789/0 conn(0x7f48bc0b5c80 legacy=0x7f48bc142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48bbfff700 1 -- 172.21.15.62:0/2790337075 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0af850 con 0x7f48bc0afcf0 2021-12-17T18:26:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48bbfff700 1 --2- 172.21.15.62:0/2790337075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48bc0afcf0 0x7f48bc143280 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f48b4002f70 tx=0x7f48b4006eb0).ready entity=mon.0 client_cookie=758db9da8114497c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:33.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48ba7fc700 1 -- 172.21.15.62:0/2790337075 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48b400d5c0 con 0x7f48bc0afcf0 2021-12-17T18:26:33.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48ba7fc700 1 -- 172.21.15.62:0/2790337075 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b4000e90 con 0x7f48bc0afcf0 2021-12-17T18:26:33.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48ba7fc700 1 -- 172.21.15.62:0/2790337075 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48b400d950 con 0x7f48bc0afcf0 2021-12-17T18:26:33.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48c0bc0700 1 -- 172.21.15.62:0/2790337075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48bc0afcf0 msgr2=0x7f48bc143280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48c0bc0700 1 --2- 172.21.15.62:0/2790337075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48bc0afcf0 0x7f48bc143280 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f48b4002f70 tx=0x7f48b4006eb0).stop 2021-12-17T18:26:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48c0bc0700 1 -- 172.21.15.62:0/2790337075 shutdown_connections 2021-12-17T18:26:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48c0bc0700 1 --2- 172.21.15.62:0/2790337075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48bc0afcf0 0x7f48bc143280 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48c0bc0700 1 --2- 172.21.15.62:0/2790337075 >> v2:172.21.15.109:3300/0 conn(0x7f48bc0b6060 0x7f48bc13fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48c0bc0700 1 -- 172.21.15.62:0/2790337075 >> 172.21.15.62:0/2790337075 conn(0x7f48bc05c750 msgr2=0x7f48bc05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48c0bc0700 1 -- 172.21.15.62:0/2790337075 shutdown_connections 2021-12-17T18:26:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48c0bc0700 1 -- 172.21.15.62:0/2790337075 wait complete. 2021-12-17T18:26:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48c0bc0700 1 Processor -- start 2021-12-17T18:26:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.214+0000 7f48c0bc0700 1 -- start start 2021-12-17T18:26:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48c0bc0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f48bc0afcf0 0x7f48bc1376b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48c0bc0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48bc0b5c80 0x7f48bc1526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48c0bc0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48bc0b6060 0x7f48bc156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48c0bc0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc13f6f0 con 0x7f48bc0b5c80 2021-12-17T18:26:33.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48c0bc0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc155d30 con 0x7f48bc0afcf0 2021-12-17T18:26:33.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48c0bc0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc155fd0 con 0x7f48bc0b6060 2021-12-17T18:26:33.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48baffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48bc0b5c80 0x7f48bc1526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:33.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48baffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48bc0b5c80 0x7f48bc1526c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54952/0 (socket says 172.21.15.62:54952) 2021-12-17T18:26:33.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48baffd700 1 -- 172.21.15.62:0/1118533459 learned_addr learned my addr 172.21.15.62:0/1118533459 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:33.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48bb7fe700 1 --2- 172.21.15.62:0/1118533459 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f48bc0afcf0 0x7f48bc1376b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48bbfff700 1 --2- 172.21.15.62:0/1118533459 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48bc0b6060 0x7f48bc156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48baffd700 1 -- 172.21.15.62:0/1118533459 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48bc0b6060 msgr2=0x7f48bc156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48baffd700 1 --2- 172.21.15.62:0/1118533459 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48bc0b6060 0x7f48bc156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48baffd700 1 -- 172.21.15.62:0/1118533459 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f48bc0afcf0 msgr2=0x7f48bc1376b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48baffd700 1 --2- 172.21.15.62:0/1118533459 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f48bc0afcf0 0x7f48bc1376b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48baffd700 1 -- 172.21.15.62:0/1118533459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b400b1e0 con 0x7f48bc0b5c80 2021-12-17T18:26:33.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48bb7fe700 1 --2- 172.21.15.62:0/1118533459 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f48bc0afcf0 0x7f48bc1376b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:33.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48baffd700 1 --2- 172.21.15.62:0/1118533459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48bc0b5c80 0x7f48bc1526c0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f48a400c000 tx=0x7f48a4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:33.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48b8ff9700 1 -- 172.21.15.62:0/1118533459 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48a4010780 con 0x7f48bc0b5c80 2021-12-17T18:26:33.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48b8ff9700 1 -- 172.21.15.62:0/1118533459 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a40108e0 con 0x7f48bc0b5c80 2021-12-17T18:26:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48c0bc0700 1 -- 172.21.15.62:0/1118533459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48bc137ba0 con 0x7f48bc0b5c80 2021-12-17T18:26:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48b8ff9700 1 -- 172.21.15.62:0/1118533459 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48a4010c40 con 0x7f48bc0b5c80 2021-12-17T18:26:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48c0bc0700 1 -- 172.21.15.62:0/1118533459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48bc152bb0 con 0x7f48bc0b5c80 2021-12-17T18:26:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48c0bc0700 1 -- 172.21.15.62:0/1118533459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48bc156190 con 0x7f48bc0b5c80 2021-12-17T18:26:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.218+0000 7f48b8ff9700 1 -- 172.21.15.62:0/1118533459 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f48a401c460 con 0x7f48bc0b5c80 2021-12-17T18:26:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.222+0000 7f48b8ff9700 1 --2- 172.21.15.62:0/1118533459 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f48a0053610 0x7f48a0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.222+0000 7f48b8ff9700 1 -- 172.21.15.62:0/1118533459 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f48a406bbc0 con 0x7f48bc0b5c80 2021-12-17T18:26:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.222+0000 7f48bb7fe700 1 --2- 172.21.15.62:0/1118533459 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f48a0053610 0x7f48a0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.222+0000 7f48bb7fe700 1 --2- 172.21.15.62:0/1118533459 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f48a0053610 0x7f48a0055ad0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f48ac00b000 tx=0x7f48ac009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:33.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.226+0000 7f48b8ff9700 1 -- 172.21.15.62:0/1118533459 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f48a4042ee0 con 0x7f48bc0b5c80 2021-12-17T18:26:33.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.350+0000 7f48c0bc0700 1 -- 172.21.15.62:0/1118533459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f48bc0573d0 con 0x7f48bc0b5c80 2021-12-17T18:26:33.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.354+0000 7f48b8ff9700 1 -- 172.21.15.62:0/1118533459 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v108) v1 ==== 84+0+143 (secure 0 0 0) 0x7f48a4046500 con 0x7f48bc0b5c80 2021-12-17T18:26:33.361 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:33.362 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2021-12-17T18:26:33.362 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:33.362 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2021-12-17T18:26:33.362 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "device_health_metrics" 2021-12-17T18:26:33.363 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:33.363 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:33.363 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2021-12-17T18:26:33.363 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2021-12-17T18:26:33.364 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:33.364 INFO:teuthology.orchestra.run.smithi062.stdout:] 2021-12-17T18:26:33.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.354+0000 7f48c0bc0700 1 -- 172.21.15.62:0/1118533459 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f48a0053610 msgr2=0x7f48a0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.354+0000 7f48c0bc0700 1 --2- 172.21.15.62:0/1118533459 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f48a0053610 0x7f48a0055ad0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f48ac00b000 tx=0x7f48ac009040).stop 2021-12-17T18:26:33.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.354+0000 7f48c0bc0700 1 -- 172.21.15.62:0/1118533459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48bc0b5c80 msgr2=0x7f48bc1526c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.354+0000 7f48c0bc0700 1 --2- 172.21.15.62:0/1118533459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48bc0b5c80 0x7f48bc1526c0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f48a400c000 tx=0x7f48a4006df0).stop 2021-12-17T18:26:33.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.354+0000 7f48c0bc0700 1 -- 172.21.15.62:0/1118533459 shutdown_connections 2021-12-17T18:26:33.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.354+0000 7f48c0bc0700 1 --2- 172.21.15.62:0/1118533459 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f48a0053610 0x7f48a0055ad0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.354+0000 7f48c0bc0700 1 --2- 172.21.15.62:0/1118533459 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48bc0b6060 0x7f48bc156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.354+0000 7f48c0bc0700 1 --2- 172.21.15.62:0/1118533459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48bc0b5c80 0x7f48bc1526c0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.354+0000 7f48c0bc0700 1 --2- 172.21.15.62:0/1118533459 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f48bc0afcf0 0x7f48bc1376b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.354+0000 7f48c0bc0700 1 -- 172.21.15.62:0/1118533459 >> 172.21.15.62:0/1118533459 conn(0x7f48bc05c750 msgr2=0x7f48bc0b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:33.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.358+0000 7f48c0bc0700 1 -- 172.21.15.62:0/1118533459 shutdown_connections 2021-12-17T18:26:33.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.358+0000 7f48c0bc0700 1 -- 172.21.15.62:0/1118533459 wait complete. 2021-12-17T18:26:33.380 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-12-17T18:26:33.381 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-12-17T18:26:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.482+0000 7fd3eaa4b700 1 Processor -- start 2021-12-17T18:26:33.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.482+0000 7fd3eaa4b700 1 -- start start 2021-12-17T18:26:33.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3eaa4b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd3e405c8f0 0x7fd3e4146930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3eaa4b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd3e413cda0 0x7fd3e413d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3eaa4b700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e4066170 con 0x7fd3e405f730 2021-12-17T18:26:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3eaa4b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e40b31f0 con 0x7fd3e413cda0 2021-12-17T18:26:33.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3eaa4b700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e4066410 con 0x7fd3e405c8f0 2021-12-17T18:26:33.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3ea24a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd3e413cda0 0x7fd3e413d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:33.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3ea24a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd3e413cda0 0x7fd3e413d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54962/0 (socket says 172.21.15.62:54962) 2021-12-17T18:26:33.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3ea24a700 1 -- 172.21.15.62:0/1890348781 learned_addr learned my addr 172.21.15.62:0/1890348781 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:33.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3e9a49700 1 --2- 172.21.15.62:0/1890348781 >> v2:172.21.15.109:3300/0 conn(0x7fd3e405c8f0 0x7fd3e4146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:33.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3ea24a700 1 -- 172.21.15.62:0/1890348781 >> v2:172.21.15.109:3300/0 conn(0x7fd3e405c8f0 msgr2=0x7fd3e4146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:33.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3ea24a700 1 --2- 172.21.15.62:0/1890348781 >> v2:172.21.15.109:3300/0 conn(0x7fd3e405c8f0 0x7fd3e4146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3ea24a700 1 -- 172.21.15.62:0/1890348781 >> v1:172.21.15.109:6789/0 conn(0x7fd3e405f730 legacy=0x7fd3e40b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3ea24a700 1 -- 172.21.15.62:0/1890348781 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e40b1ec0 con 0x7fd3e413cda0 2021-12-17T18:26:33.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3ea24a700 1 --2- 172.21.15.62:0/1890348781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3e413cda0 0x7fd3e413d230 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7fd3dc0032f0 tx=0x7fd3dc009290).ready entity=mon.0 client_cookie=92ecedb13620ec10 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:33.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3e8a47700 1 -- 172.21.15.62:0/1890348781 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3dc00b870 con 0x7fd3e413cda0 2021-12-17T18:26:33.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3e8a47700 1 -- 172.21.15.62:0/1890348781 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc00b9d0 con 0x7fd3e413cda0 2021-12-17T18:26:33.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3e8a47700 1 -- 172.21.15.62:0/1890348781 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3dc00bb40 con 0x7fd3e413cda0 2021-12-17T18:26:33.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3eaa4b700 1 -- 172.21.15.62:0/1890348781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3e413cda0 msgr2=0x7fd3e413d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3eaa4b700 1 --2- 172.21.15.62:0/1890348781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3e413cda0 0x7fd3e413d230 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7fd3dc0032f0 tx=0x7fd3dc009290).stop 2021-12-17T18:26:33.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3eaa4b700 1 -- 172.21.15.62:0/1890348781 shutdown_connections 2021-12-17T18:26:33.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3eaa4b700 1 --2- 172.21.15.62:0/1890348781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3e413cda0 0x7fd3e413d230 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3eaa4b700 1 --2- 172.21.15.62:0/1890348781 >> v2:172.21.15.109:3300/0 conn(0x7fd3e405c8f0 0x7fd3e4146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3eaa4b700 1 -- 172.21.15.62:0/1890348781 >> 172.21.15.62:0/1890348781 conn(0x7fd3e405bcd0 msgr2=0x7fd3e4062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:33.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3eaa4b700 1 -- 172.21.15.62:0/1890348781 shutdown_connections 2021-12-17T18:26:33.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.486+0000 7fd3eaa4b700 1 -- 172.21.15.62:0/1890348781 wait complete. 2021-12-17T18:26:33.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.490+0000 7fd3eaa4b700 1 Processor -- start 2021-12-17T18:26:33.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.490+0000 7fd3eaa4b700 1 -- start start 2021-12-17T18:26:33.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.490+0000 7fd3eaa4b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd3e405c8f0 0x7fd3e40b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:33.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.490+0000 7fd3eaa4b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd3e405f730 0x7fd3e4156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:33.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.490+0000 7fd3eaa4b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3e413cda0 0x7fd3e4152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.490+0000 7fd3eaa4b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e413e840 con 0x7fd3e413cda0 2021-12-17T18:26:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.490+0000 7fd3eaa4b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e4155d00 con 0x7fd3e405f730 2021-12-17T18:26:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.490+0000 7fd3eaa4b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e4155fa0 con 0x7fd3e405c8f0 2021-12-17T18:26:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.490+0000 7fd3ea24a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3e413cda0 0x7fd3e4152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:33.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.490+0000 7fd3ea24a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3e413cda0 0x7fd3e4152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54968/0 (socket says 172.21.15.62:54968) 2021-12-17T18:26:33.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.490+0000 7fd3ea24a700 1 -- 172.21.15.62:0/466610963 learned_addr learned my addr 172.21.15.62:0/466610963 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:33.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.490+0000 7fd3e9248700 1 --2- 172.21.15.62:0/466610963 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd3e405f730 0x7fd3e4156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:33.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.490+0000 7fd3e9a49700 1 --2- 172.21.15.62:0/466610963 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd3e405c8f0 0x7fd3e40b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:33.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.494+0000 7fd3ea24a700 1 -- 172.21.15.62:0/466610963 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd3e405c8f0 msgr2=0x7fd3e40b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.494+0000 7fd3ea24a700 1 --2- 172.21.15.62:0/466610963 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd3e405c8f0 0x7fd3e40b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.494+0000 7fd3ea24a700 1 -- 172.21.15.62:0/466610963 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd3e405f730 msgr2=0x7fd3e4156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.494+0000 7fd3ea24a700 1 --2- 172.21.15.62:0/466610963 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd3e405f730 0x7fd3e4156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.494+0000 7fd3ea24a700 1 -- 172.21.15.62:0/466610963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc009530 con 0x7fd3e413cda0 2021-12-17T18:26:33.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.494+0000 7fd3ea24a700 1 --2- 172.21.15.62:0/466610963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3e413cda0 0x7fd3e4152650 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7fd3dc0032f0 tx=0x7fd3dc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:33.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.494+0000 7fd3d6ffd700 1 -- 172.21.15.62:0/466610963 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3dc00b870 con 0x7fd3e413cda0 2021-12-17T18:26:33.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.494+0000 7fd3d6ffd700 1 -- 172.21.15.62:0/466610963 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc021440 con 0x7fd3e413cda0 2021-12-17T18:26:33.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.494+0000 7fd3eaa4b700 1 -- 172.21.15.62:0/466610963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e4144f00 con 0x7fd3e413cda0 2021-12-17T18:26:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.494+0000 7fd3d6ffd700 1 -- 172.21.15.62:0/466610963 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3dc0217a0 con 0x7fd3e413cda0 2021-12-17T18:26:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.494+0000 7fd3eaa4b700 1 -- 172.21.15.62:0/466610963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e4156ad0 con 0x7fd3e413cda0 2021-12-17T18:26:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.494+0000 7fd3eaa4b700 1 -- 172.21.15.62:0/466610963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e4156160 con 0x7fd3e413cda0 2021-12-17T18:26:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.494+0000 7fd3d6ffd700 1 -- 172.21.15.62:0/466610963 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd3dc027020 con 0x7fd3e413cda0 2021-12-17T18:26:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.494+0000 7fd3d6ffd700 1 --2- 172.21.15.62:0/466610963 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd3c40536a0 0x7fd3c4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.494+0000 7fd3d6ffd700 1 -- 172.21.15.62:0/466610963 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd3dc06cb20 con 0x7fd3e413cda0 2021-12-17T18:26:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.494+0000 7fd3e9a49700 1 --2- 172.21.15.62:0/466610963 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd3c40536a0 0x7fd3c4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:33.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.498+0000 7fd3e9a49700 1 --2- 172.21.15.62:0/466610963 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd3c40536a0 0x7fd3c4055b60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fd3e000b000 tx=0x7fd3e0006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:33.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.502+0000 7fd3d6ffd700 1 -- 172.21.15.62:0/466610963 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd3dc043fb0 con 0x7fd3e413cda0 2021-12-17T18:26:33.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.622+0000 7fd3eaa4b700 1 -- 172.21.15.62:0/466610963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fd3e40b2a70 con 0x7fd3e413cda0 2021-12-17T18:26:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.706+0000 7fd3d6ffd700 1 -- 172.21.15.62:0/466610963 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v109) v1 ==== 133+0+0 (secure 0 0 0) 0x7fd3dc015070 con 0x7fd3e413cda0 2021-12-17T18:26:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.710+0000 7fd3eaa4b700 1 -- 172.21.15.62:0/466610963 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd3c40536a0 msgr2=0x7fd3c4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.710+0000 7fd3eaa4b700 1 --2- 172.21.15.62:0/466610963 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd3c40536a0 0x7fd3c4055b60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fd3e000b000 tx=0x7fd3e0006df0).stop 2021-12-17T18:26:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.710+0000 7fd3eaa4b700 1 -- 172.21.15.62:0/466610963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3e413cda0 msgr2=0x7fd3e4152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.710+0000 7fd3eaa4b700 1 --2- 172.21.15.62:0/466610963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3e413cda0 0x7fd3e4152650 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7fd3dc0032f0 tx=0x7fd3dc016000).stop 2021-12-17T18:26:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.710+0000 7fd3eaa4b700 1 -- 172.21.15.62:0/466610963 shutdown_connections 2021-12-17T18:26:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.710+0000 7fd3eaa4b700 1 --2- 172.21.15.62:0/466610963 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd3c40536a0 0x7fd3c4055b60 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.710+0000 7fd3eaa4b700 1 --2- 172.21.15.62:0/466610963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3e413cda0 0x7fd3e4152650 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.710+0000 7fd3eaa4b700 1 --2- 172.21.15.62:0/466610963 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd3e405f730 0x7fd3e4156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.710+0000 7fd3eaa4b700 1 --2- 172.21.15.62:0/466610963 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd3e405c8f0 0x7fd3e40b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.710+0000 7fd3eaa4b700 1 -- 172.21.15.62:0/466610963 >> 172.21.15.62:0/466610963 conn(0x7fd3e405bcd0 msgr2=0x7fd3e413a160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.710+0000 7fd3eaa4b700 1 -- 172.21.15.62:0/466610963 shutdown_connections 2021-12-17T18:26:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.710+0000 7fd3eaa4b700 1 -- 172.21.15.62:0/466610963 wait complete. 2021-12-17T18:26:33.723 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2021-12-17T18:26:33.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-12-17T18:26:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.834+0000 7f34a3fff700 1 Processor -- start 2021-12-17T18:26:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.834+0000 7f34a3fff700 1 -- start start 2021-12-17T18:26:33.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.834+0000 7f34a3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f34a405c8f0 0x7f34a4060440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:33.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.834+0000 7f34a3fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a40b4b60 con 0x7f34a4144b70 2021-12-17T18:26:33.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.834+0000 7f34a3fff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a4144fc0 con 0x7f34a4144730 2021-12-17T18:26:33.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.834+0000 7f34a3fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a40b25d0 con 0x7f34a405c8f0 2021-12-17T18:26:33.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.834+0000 7f34a2ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f34a405c8f0 0x7f34a4060440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.834+0000 7f34a37fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f34a4144b70 0x7f34a4147f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38554/0 (socket says 172.21.15.62:38554) 2021-12-17T18:26:33.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.834+0000 7f34a37fe700 1 -- 172.21.15.62:0/1134201241 learned_addr learned my addr 172.21.15.62:0/1134201241 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.834+0000 7f34a2ffd700 1 -- 172.21.15.62:0/1134201241 >> v1:172.21.15.109:6789/0 conn(0x7f34a4144730 legacy=0x7f34a4147820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.834+0000 7f34a2ffd700 1 -- 172.21.15.62:0/1134201241 >> v1:172.21.15.62:6789/0 conn(0x7f34a4144b70 legacy=0x7f34a4147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.834+0000 7f34a2ffd700 1 -- 172.21.15.62:0/1134201241 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a40b2870 con 0x7f34a405c8f0 2021-12-17T18:26:33.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.838+0000 7f34a2ffd700 1 --2- 172.21.15.62:0/1134201241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34a405c8f0 0x7f34a4060440 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f34940032f0 tx=0x7f34940091d0).ready entity=mon.0 client_cookie=2e8ac89e78c7cc5b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:33.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.838+0000 7f34a1ffb700 1 -- 172.21.15.62:0/1134201241 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3494009ea0 con 0x7f34a405c8f0 2021-12-17T18:26:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.838+0000 7f34a1ffb700 1 -- 172.21.15.62:0/1134201241 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349400b8a0 con 0x7f34a405c8f0 2021-12-17T18:26:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.838+0000 7f34a1ffb700 1 -- 172.21.15.62:0/1134201241 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f349400ba10 con 0x7f34a405c8f0 2021-12-17T18:26:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.838+0000 7f34a3fff700 1 -- 172.21.15.62:0/1134201241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34a405c8f0 msgr2=0x7f34a4060440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.838+0000 7f34a3fff700 1 --2- 172.21.15.62:0/1134201241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34a405c8f0 0x7f34a4060440 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f34940032f0 tx=0x7f34940091d0).stop 2021-12-17T18:26:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.838+0000 7f34a3fff700 1 -- 172.21.15.62:0/1134201241 shutdown_connections 2021-12-17T18:26:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.838+0000 7f34a3fff700 1 --2- 172.21.15.62:0/1134201241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34a405c8f0 0x7f34a4060440 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.838+0000 7f34a3fff700 1 -- 172.21.15.62:0/1134201241 >> 172.21.15.62:0/1134201241 conn(0x7f34a405bcd0 msgr2=0x7f34a4062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:33.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.838+0000 7f34a3fff700 1 -- 172.21.15.62:0/1134201241 shutdown_connections 2021-12-17T18:26:33.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.838+0000 7f34a3fff700 1 -- 172.21.15.62:0/1134201241 wait complete. 2021-12-17T18:26:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.838+0000 7f34a3fff700 1 Processor -- start 2021-12-17T18:26:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.838+0000 7f34a3fff700 1 -- start start 2021-12-17T18:26:33.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a3fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f34a405c8f0 0x7f34a414a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:33.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34a4144730 0x7f34a4084f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:33.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a3fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f34a4144b70 0x7f34a40b89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:33.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a3fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a4149f50 con 0x7f34a4144730 2021-12-17T18:26:33.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a3fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a414a1f0 con 0x7f34a4144b70 2021-12-17T18:26:33.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a3fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a414a490 con 0x7f34a405c8f0 2021-12-17T18:26:33.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a27fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34a4144730 0x7f34a4084f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:33.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a27fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34a4144730 0x7f34a4084f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54980/0 (socket says 172.21.15.62:54980) 2021-12-17T18:26:33.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a27fc700 1 -- 172.21.15.62:0/2245826104 learned_addr learned my addr 172.21.15.62:0/2245826104 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:33.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a2ffd700 1 --2- 172.21.15.62:0/2245826104 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f34a405c8f0 0x7f34a414a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a37fe700 1 --2- 172.21.15.62:0/2245826104 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f34a4144b70 0x7f34a40b89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:33.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a27fc700 1 -- 172.21.15.62:0/2245826104 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f34a405c8f0 msgr2=0x7f34a414a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a27fc700 1 --2- 172.21.15.62:0/2245826104 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f34a405c8f0 0x7f34a414a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a27fc700 1 -- 172.21.15.62:0/2245826104 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f34a4144b70 msgr2=0x7f34a40b89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:33.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a27fc700 1 --2- 172.21.15.62:0/2245826104 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f34a4144b70 0x7f34a40b89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a27fc700 1 -- 172.21.15.62:0/2245826104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3494009470 con 0x7f34a4144730 2021-12-17T18:26:33.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a27fc700 1 --2- 172.21.15.62:0/2245826104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34a4144730 0x7f34a4084f20 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f34a405d2e0 tx=0x7f348c007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:33.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f349bfff700 1 -- 172.21.15.62:0/2245826104 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f348c00ce30 con 0x7f34a4144730 2021-12-17T18:26:33.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f349bfff700 1 -- 172.21.15.62:0/2245826104 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c00f470 con 0x7f34a4144730 2021-12-17T18:26:33.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f349bfff700 1 -- 172.21.15.62:0/2245826104 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f348c00f7d0 con 0x7f34a4144730 2021-12-17T18:26:33.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a3fff700 1 -- 172.21.15.62:0/2245826104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a41489e0 con 0x7f34a4144730 2021-12-17T18:26:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a3fff700 1 -- 172.21.15.62:0/2245826104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a4081b50 con 0x7f34a4144730 2021-12-17T18:26:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a3fff700 1 -- 172.21.15.62:0/2245826104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a414a650 con 0x7f34a4144730 2021-12-17T18:26:33.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f349bfff700 1 -- 172.21.15.62:0/2245826104 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f348c019030 con 0x7f34a4144730 2021-12-17T18:26:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f349bfff700 1 --2- 172.21.15.62:0/2245826104 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f34880535b0 0x7f3488055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f349bfff700 1 -- 172.21.15.62:0/2245826104 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f348c06a990 con 0x7f34a4144730 2021-12-17T18:26:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.842+0000 7f34a2ffd700 1 --2- 172.21.15.62:0/2245826104 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f34880535b0 0x7f3488055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.846+0000 7f34a2ffd700 1 --2- 172.21.15.62:0/2245826104 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f34880535b0 0x7f3488055a70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f3494019000 tx=0x7f3494016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:33.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.850+0000 7f349bfff700 1 -- 172.21.15.62:0/2245826104 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f348c041cc0 con 0x7f34a4144730 2021-12-17T18:26:33.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:33.978+0000 7f34a3fff700 1 -- 172.21.15.62:0/2245826104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f34a4144fc0 con 0x7f34a4144730 2021-12-17T18:26:34.536 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:26:34.539 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:26:34.542 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:26:34.544 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:26:34.547 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:26:34.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.722+0000 7f349bfff700 1 -- 172.21.15.62:0/2245826104 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v110) v1 ==== 125+0+0 (secure 0 0 0) 0x7f34a4144fc0 con 0x7f34a4144730 2021-12-17T18:26:34.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.726+0000 7f34a3fff700 1 -- 172.21.15.62:0/2245826104 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f34880535b0 msgr2=0x7f3488055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:34.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.726+0000 7f34a3fff700 1 --2- 172.21.15.62:0/2245826104 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f34880535b0 0x7f3488055a70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f3494019000 tx=0x7f3494016000).stop 2021-12-17T18:26:34.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.726+0000 7f34a3fff700 1 -- 172.21.15.62:0/2245826104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34a4144730 msgr2=0x7f34a4084f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:34.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.726+0000 7f34a3fff700 1 --2- 172.21.15.62:0/2245826104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34a4144730 0x7f34a4084f20 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f34a405d2e0 tx=0x7f348c007c00).stop 2021-12-17T18:26:34.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.726+0000 7f34a3fff700 1 -- 172.21.15.62:0/2245826104 shutdown_connections 2021-12-17T18:26:34.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.726+0000 7f34a3fff700 1 --2- 172.21.15.62:0/2245826104 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f34880535b0 0x7f3488055a70 secure :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0x7f3494019000 tx=0x7f3494016000).stop 2021-12-17T18:26:34.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.726+0000 7f34a3fff700 1 --2- 172.21.15.62:0/2245826104 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f34a4144b70 0x7f34a40b89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:34.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.726+0000 7f34a3fff700 1 --2- 172.21.15.62:0/2245826104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34a4144730 0x7f34a4084f20 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:34.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.726+0000 7f34a3fff700 1 --2- 172.21.15.62:0/2245826104 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f34a405c8f0 0x7f34a414a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:34.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.726+0000 7f34a3fff700 1 -- 172.21.15.62:0/2245826104 >> 172.21.15.62:0/2245826104 conn(0x7f34a405bcd0 msgr2=0x7f34a40b1740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:34.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.730+0000 7f34a3fff700 1 -- 172.21.15.62:0/2245826104 shutdown_connections 2021-12-17T18:26:34.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.730+0000 7f34a3fff700 1 -- 172.21.15.62:0/2245826104 wait complete. 2021-12-17T18:26:34.739 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2021-12-17T18:26:34.751 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-12-17T18:26:34.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c3b53d700 1 Processor -- start 2021-12-17T18:26:34.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c3b53d700 1 -- start start 2021-12-17T18:26:34.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c3b53d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1c340626a0 0x7f1c34065d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:34.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c3b53d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c340b35a0 con 0x7f1c3413eb10 2021-12-17T18:26:34.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c3b53d700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c340661f0 con 0x7f1c340b31c0 2021-12-17T18:26:34.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c3b53d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c340653d0 con 0x7f1c340626a0 2021-12-17T18:26:34.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c3ad3c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1c3413eb10 0x7f1c3413ef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38570/0 (socket says 172.21.15.62:38570) 2021-12-17T18:26:34.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c3ad3c700 1 -- 172.21.15.62:0/2633482050 learned_addr learned my addr 172.21.15.62:0/2633482050 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:34.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39d3a700 1 --2- 172.21.15.62:0/2633482050 >> v2:172.21.15.109:3300/0 conn(0x7f1c340626a0 0x7f1c34065d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:34.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 -- 172.21.15.62:0/2633482050 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630850518 0 0) 0x7f1c340b35a0 con 0x7f1c3413eb10 2021-12-17T18:26:34.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 -- 172.21.15.62:0/2633482050 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c1c003260 con 0x7f1c3413eb10 2021-12-17T18:26:34.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 -- 172.21.15.62:0/2633482050 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3762106268 0 0) 0x7f1c1c003260 con 0x7f1c3413eb10 2021-12-17T18:26:34.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 -- 172.21.15.62:0/2633482050 >> v2:172.21.15.109:3300/0 conn(0x7f1c340626a0 msgr2=0x7f1c34065d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:34.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 --2- 172.21.15.62:0/2633482050 >> v2:172.21.15.109:3300/0 conn(0x7f1c340626a0 0x7f1c34065d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:34.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 -- 172.21.15.62:0/2633482050 >> v1:172.21.15.109:6789/0 conn(0x7f1c340b31c0 legacy=0x7f1c34143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:34.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 -- 172.21.15.62:0/2633482050 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c340655c0 con 0x7f1c3413eb10 2021-12-17T18:26:34.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 -- 172.21.15.62:0/2633482050 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f1c2c0019e0 con 0x7f1c3413eb10 2021-12-17T18:26:34.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 -- 172.21.15.62:0/2633482050 >> v1:172.21.15.62:6789/0 conn(0x7f1c3413eb10 legacy=0x7f1c3413ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:34.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 --2- 172.21.15.62:0/2633482050 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c1c003750 0x7f1c1c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:34.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 --2- 172.21.15.62:0/2633482050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c1c004500 0x7f1c1c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:34.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 --2- 172.21.15.62:0/2633482050 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c1c004e70 0x7f1c1c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:34.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 -- 172.21.15.62:0/2633482050 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c00bcf0 con 0x7f1c1c004500 2021-12-17T18:26:34.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 -- 172.21.15.62:0/2633482050 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c00be60 con 0x7f1c1c004e70 2021-12-17T18:26:34.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 -- 172.21.15.62:0/2633482050 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c00c020 con 0x7f1c1c003750 2021-12-17T18:26:34.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39d3a700 1 --2- 172.21.15.62:0/2633482050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c1c004500 0x7f1c1c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:34.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c3ad3c700 1 --2- 172.21.15.62:0/2633482050 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c1c004e70 0x7f1c1c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:34.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c3a53b700 1 --2- 172.21.15.62:0/2633482050 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c1c003750 0x7f1c1c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:34.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39d3a700 1 -- 172.21.15.62:0/2633482050 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c1c003750 msgr2=0x7f1c1c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:34.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39d3a700 1 --2- 172.21.15.62:0/2633482050 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c1c003750 0x7f1c1c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:34.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39d3a700 1 -- 172.21.15.62:0/2633482050 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c1c004e70 msgr2=0x7f1c1c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:34.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39d3a700 1 --2- 172.21.15.62:0/2633482050 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c1c004e70 0x7f1c1c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:34.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c3ad3c700 1 -- 172.21.15.62:0/2633482050 reap_dead start 2021-12-17T18:26:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39d3a700 1 -- 172.21.15.62:0/2633482050 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c003260 con 0x7f1c1c004500 2021-12-17T18:26:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c3a53b700 1 --2- 172.21.15.62:0/2633482050 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c1c003750 0x7f1c1c003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39d3a700 1 --2- 172.21.15.62:0/2633482050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c1c004500 0x7f1c1c004980 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f1c3000c000 tx=0x7f1c30006df0).ready entity=mon.0 client_cookie=cdac06877b149d20 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:34.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 -- 172.21.15.62:0/2633482050 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c3000e830 con 0x7f1c1c004500 2021-12-17T18:26:34.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 -- 172.21.15.62:0/2633482050 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3000e990 con 0x7f1c1c004500 2021-12-17T18:26:34.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.850+0000 7f1c39539700 1 -- 172.21.15.62:0/2633482050 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c3000ecf0 con 0x7f1c1c004500 2021-12-17T18:26:34.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3b53d700 1 -- 172.21.15.62:0/2633482050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c1c004500 msgr2=0x7f1c1c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:34.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3b53d700 1 --2- 172.21.15.62:0/2633482050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c1c004500 0x7f1c1c004980 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f1c3000c000 tx=0x7f1c30006df0).stop 2021-12-17T18:26:34.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3b53d700 1 -- 172.21.15.62:0/2633482050 shutdown_connections 2021-12-17T18:26:34.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3b53d700 1 --2- 172.21.15.62:0/2633482050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c1c004500 0x7f1c1c004980 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:34.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3b53d700 1 -- 172.21.15.62:0/2633482050 >> 172.21.15.62:0/2633482050 conn(0x7f1c3405bcd0 msgr2=0x7f1c34063510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:34.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3b53d700 1 -- 172.21.15.62:0/2633482050 shutdown_connections 2021-12-17T18:26:34.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3b53d700 1 -- 172.21.15.62:0/2633482050 wait complete. 2021-12-17T18:26:34.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3b53d700 1 Processor -- start 2021-12-17T18:26:34.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3b53d700 1 -- start start 2021-12-17T18:26:34.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3b53d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c1c004500 0x7f1c340670e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:34.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3b53d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c34152560 0x7f1c341529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:34.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3b53d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c34152ed0 0x7f1c34155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:34.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3b53d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3413b210 con 0x7f1c34152ed0 2021-12-17T18:26:34.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3b53d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c340ae8a0 con 0x7f1c1c004500 2021-12-17T18:26:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3b53d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c34141930 con 0x7f1c34152560 2021-12-17T18:26:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3ad3c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c34152ed0 0x7f1c34155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3ad3c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c34152ed0 0x7f1c34155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55002/0 (socket says 172.21.15.62:55002) 2021-12-17T18:26:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3ad3c700 1 -- 172.21.15.62:0/3378911042 learned_addr learned my addr 172.21.15.62:0/3378911042 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3a53b700 1 --2- 172.21.15.62:0/3378911042 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c1c004500 0x7f1c340670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c39d3a700 1 --2- 172.21.15.62:0/3378911042 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c34152560 0x7f1c341529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3ad3c700 1 -- 172.21.15.62:0/3378911042 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c34152560 msgr2=0x7f1c341529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3ad3c700 1 --2- 172.21.15.62:0/3378911042 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c34152560 0x7f1c341529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3ad3c700 1 -- 172.21.15.62:0/3378911042 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c1c004500 msgr2=0x7f1c340670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:34.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3ad3c700 1 --2- 172.21.15.62:0/3378911042 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c1c004500 0x7f1c340670e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:34.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3ad3c700 1 -- 172.21.15.62:0/3378911042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c34153350 con 0x7f1c34152ed0 2021-12-17T18:26:34.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3ad3c700 1 --2- 172.21.15.62:0/3378911042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c34152ed0 0x7f1c34155730 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f1c3413b350 tx=0x7f1c34065750).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:34.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c237fe700 1 -- 172.21.15.62:0/3378911042 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c2c00f880 con 0x7f1c34152ed0 2021-12-17T18:26:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c237fe700 1 -- 172.21.15.62:0/3378911042 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2c00f9e0 con 0x7f1c34152ed0 2021-12-17T18:26:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3b53d700 1 -- 172.21.15.62:0/3378911042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c341413f0 con 0x7f1c34152ed0 2021-12-17T18:26:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c237fe700 1 -- 172.21.15.62:0/3378911042 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c2c00fd40 con 0x7f1c34152ed0 2021-12-17T18:26:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.854+0000 7f1c3b53d700 1 -- 172.21.15.62:0/3378911042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c34141070 con 0x7f1c34152ed0 2021-12-17T18:26:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.858+0000 7f1c237fe700 1 -- 172.21.15.62:0/3378911042 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1c2c01b030 con 0x7f1c34152ed0 2021-12-17T18:26:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.858+0000 7f1c3b53d700 1 -- 172.21.15.62:0/3378911042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c34065860 con 0x7f1c34152ed0 2021-12-17T18:26:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.858+0000 7f1c237fe700 1 --2- 172.21.15.62:0/3378911042 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c14053610 0x7f1c14055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.858+0000 7f1c237fe700 1 -- 172.21.15.62:0/3378911042 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f1c2c06b5d0 con 0x7f1c34152ed0 2021-12-17T18:26:34.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.858+0000 7f1c3a53b700 1 --2- 172.21.15.62:0/3378911042 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c14053610 0x7f1c14055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:34.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.862+0000 7f1c3a53b700 1 --2- 172.21.15.62:0/3378911042 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c14053610 0x7f1c14055ad0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f1c2400d000 tx=0x7f1c24009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:34.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:34.862+0000 7f1c237fe700 1 -- 172.21.15.62:0/3378911042 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1c2c042690 con 0x7f1c34152ed0 2021-12-17T18:26:35.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.022+0000 7f1c3b53d700 1 -- 172.21.15.62:0/3378911042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f1c340573d0 con 0x7f1c34152ed0 2021-12-17T18:26:35.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.034+0000 7f1c237fe700 1 -- 172.21.15.62:0/3378911042 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 21 and data pool 22 v54) v1 ==== 189+0+0 (secure 0 0 0) 0x7f1c2c019030 con 0x7f1c34152ed0 2021-12-17T18:26:35.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.038+0000 7f1c3b53d700 1 -- 172.21.15.62:0/3378911042 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c14053610 msgr2=0x7f1c14055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:35.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.038+0000 7f1c3b53d700 1 --2- 172.21.15.62:0/3378911042 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c14053610 0x7f1c14055ad0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f1c2400d000 tx=0x7f1c24009040).stop 2021-12-17T18:26:35.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.038+0000 7f1c3b53d700 1 -- 172.21.15.62:0/3378911042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c34152ed0 msgr2=0x7f1c34155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:35.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.038+0000 7f1c3b53d700 1 --2- 172.21.15.62:0/3378911042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c34152ed0 0x7f1c34155730 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f1c3413b350 tx=0x7f1c34065750).stop 2021-12-17T18:26:35.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.038+0000 7f1c3b53d700 1 -- 172.21.15.62:0/3378911042 shutdown_connections 2021-12-17T18:26:35.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.038+0000 7f1c3b53d700 1 --2- 172.21.15.62:0/3378911042 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1c14053610 0x7f1c14055ad0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.038+0000 7f1c3b53d700 1 --2- 172.21.15.62:0/3378911042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c34152ed0 0x7f1c34155730 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.038+0000 7f1c3b53d700 1 --2- 172.21.15.62:0/3378911042 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1c34152560 0x7f1c341529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.038+0000 7f1c3b53d700 1 --2- 172.21.15.62:0/3378911042 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1c1c004500 0x7f1c340670e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.038+0000 7f1c3b53d700 1 -- 172.21.15.62:0/3378911042 >> 172.21.15.62:0/3378911042 conn(0x7f1c3405bcd0 msgr2=0x7f1c341403b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:35.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.038+0000 7f1c3b53d700 1 -- 172.21.15.62:0/3378911042 shutdown_connections 2021-12-17T18:26:35.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.038+0000 7f1c3b53d700 1 -- 172.21.15.62:0/3378911042 wait complete. 2021-12-17T18:26:35.050 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 21 and data pool 22 2021-12-17T18:26:35.062 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:26:35.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.150+0000 7fd2261c8700 1 Processor -- start 2021-12-17T18:26:35.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.150+0000 7fd2261c8700 1 -- start start 2021-12-17T18:26:35.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.150+0000 7fd2261c8700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd2200b6160 0x7fd220144c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.150+0000 7fd2261c8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2200af4e0 0x7fd220145160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.150+0000 7fd2261c8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd22005c0e0 0x7fd2200b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.150+0000 7fd2261c8700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2200b0be0 con 0x7fd22005c0e0 2021-12-17T18:26:35.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.150+0000 7fd2261c8700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd220144810 con 0x7fd2200b6160 2021-12-17T18:26:35.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.150+0000 7fd2261c8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200b6540 con 0x7fd2200af4e0 2021-12-17T18:26:35.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.150+0000 7fd21ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd22005c0e0 0x7fd2200b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.150+0000 7fd21ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd22005c0e0 0x7fd2200b28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55022/0 (socket says 172.21.15.62:55022) 2021-12-17T18:26:35.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.150+0000 7fd21ffff700 1 -- 172.21.15.62:0/2108262113 learned_addr learned my addr 172.21.15.62:0/2108262113 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:35.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.150+0000 7fd21f7fe700 1 --2- 172.21.15.62:0/2108262113 >> v2:172.21.15.109:3300/0 conn(0x7fd2200b6160 0x7fd220144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.150+0000 7fd216ffd700 1 --2- 172.21.15.62:0/2108262113 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2200af4e0 0x7fd220145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd21ffff700 1 -- 172.21.15.62:0/2108262113 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2200af4e0 msgr2=0x7fd220145160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd21ffff700 1 --2- 172.21.15.62:0/2108262113 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2200af4e0 0x7fd220145160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd21ffff700 1 -- 172.21.15.62:0/2108262113 >> v2:172.21.15.109:3300/0 conn(0x7fd2200b6160 msgr2=0x7fd220144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd21ffff700 1 --2- 172.21.15.62:0/2108262113 >> v2:172.21.15.109:3300/0 conn(0x7fd2200b6160 0x7fd220144c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd21ffff700 1 -- 172.21.15.62:0/2108262113 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2200afbf0 con 0x7fd22005c0e0 2021-12-17T18:26:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd21ffff700 1 --2- 172.21.15.62:0/2108262113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd22005c0e0 0x7fd2200b28c0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fd2180032f0 tx=0x7fd218009290).ready entity=mon.0 client_cookie=b94d1ea806fd9fd3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd21effd700 1 -- 172.21.15.62:0/2108262113 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd21800b680 con 0x7fd22005c0e0 2021-12-17T18:26:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd21effd700 1 -- 172.21.15.62:0/2108262113 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21800b7e0 con 0x7fd22005c0e0 2021-12-17T18:26:35.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd21effd700 1 -- 172.21.15.62:0/2108262113 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd21800b950 con 0x7fd22005c0e0 2021-12-17T18:26:35.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd2261c8700 1 -- 172.21.15.62:0/2108262113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd22005c0e0 msgr2=0x7fd2200b28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:35.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd2261c8700 1 --2- 172.21.15.62:0/2108262113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd22005c0e0 0x7fd2200b28c0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fd2180032f0 tx=0x7fd218009290).stop 2021-12-17T18:26:35.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd2261c8700 1 -- 172.21.15.62:0/2108262113 shutdown_connections 2021-12-17T18:26:35.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd2261c8700 1 --2- 172.21.15.62:0/2108262113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd22005c0e0 0x7fd2200b28c0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd2261c8700 1 --2- 172.21.15.62:0/2108262113 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd2200af4e0 0x7fd220145160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd2261c8700 1 --2- 172.21.15.62:0/2108262113 >> v2:172.21.15.109:3300/0 conn(0x7fd2200b6160 0x7fd220144c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd2261c8700 1 -- 172.21.15.62:0/2108262113 >> 172.21.15.62:0/2108262113 conn(0x7fd22005c750 msgr2=0x7fd2200630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:35.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd2261c8700 1 -- 172.21.15.62:0/2108262113 shutdown_connections 2021-12-17T18:26:35.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.154+0000 7fd2261c8700 1 -- 172.21.15.62:0/2108262113 wait complete. 2021-12-17T18:26:35.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd2261c8700 1 Processor -- start 2021-12-17T18:26:35.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd2261c8700 1 -- start start 2021-12-17T18:26:35.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd2261c8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd22005c0e0 0x7fd2201415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd2261c8700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd2200af4e0 0x7fd2200b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd2261c8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2200b6160 0x7fd2200b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd2261c8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd220064470 con 0x7fd2200b6160 2021-12-17T18:26:35.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd2261c8700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd220063f30 con 0x7fd2200af4e0 2021-12-17T18:26:35.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd2261c8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200641d0 con 0x7fd22005c0e0 2021-12-17T18:26:35.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd21ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2200b6160 0x7fd2200b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd21ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2200b6160 0x7fd2200b4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55028/0 (socket says 172.21.15.62:55028) 2021-12-17T18:26:35.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd21ffff700 1 -- 172.21.15.62:0/1403887172 learned_addr learned my addr 172.21.15.62:0/1403887172 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:35.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd21f7fe700 1 --2- 172.21.15.62:0/1403887172 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd22005c0e0 0x7fd2201415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd216ffd700 1 --2- 172.21.15.62:0/1403887172 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd2200af4e0 0x7fd2200b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd21ffff700 1 -- 172.21.15.62:0/1403887172 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd22005c0e0 msgr2=0x7fd2201415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:35.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd21ffff700 1 --2- 172.21.15.62:0/1403887172 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd22005c0e0 0x7fd2201415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd21ffff700 1 -- 172.21.15.62:0/1403887172 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd2200af4e0 msgr2=0x7fd2200b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:35.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd21ffff700 1 --2- 172.21.15.62:0/1403887172 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd2200af4e0 0x7fd2200b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd21ffff700 1 -- 172.21.15.62:0/1403887172 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd218009530 con 0x7fd2200b6160 2021-12-17T18:26:35.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd21ffff700 1 --2- 172.21.15.62:0/1403887172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2200b6160 0x7fd2200b4800 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fd2180032f0 tx=0x7fd218017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:35.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd21d7fa700 1 -- 172.21.15.62:0/1403887172 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd21800b680 con 0x7fd2200b6160 2021-12-17T18:26:35.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd21d7fa700 1 -- 172.21.15.62:0/1403887172 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21800bea0 con 0x7fd2200b6160 2021-12-17T18:26:35.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd2261c8700 1 -- 172.21.15.62:0/1403887172 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2200b4cf0 con 0x7fd2200b6160 2021-12-17T18:26:35.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd21d7fa700 1 -- 172.21.15.62:0/1403887172 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd21801b600 con 0x7fd2200b6160 2021-12-17T18:26:35.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.158+0000 7fd2261c8700 1 -- 172.21.15.62:0/1403887172 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2200b3cc0 con 0x7fd2200b6160 2021-12-17T18:26:35.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.162+0000 7fd2261c8700 1 -- 172.21.15.62:0/1403887172 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2200b0940 con 0x7fd2200b6160 2021-12-17T18:26:35.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.162+0000 7fd21d7fa700 1 -- 172.21.15.62:0/1403887172 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd21800f070 con 0x7fd2200b6160 2021-12-17T18:26:35.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.162+0000 7fd21d7fa700 1 --2- 172.21.15.62:0/1403887172 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd204053640 0x7fd204055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.162+0000 7fd21d7fa700 1 -- 172.21.15.62:0/1403887172 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd21806ccf0 con 0x7fd2200b6160 2021-12-17T18:26:35.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.162+0000 7fd21f7fe700 1 --2- 172.21.15.62:0/1403887172 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd204053640 0x7fd204055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.162+0000 7fd21f7fe700 1 --2- 172.21.15.62:0/1403887172 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd204053640 0x7fd204055b00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fd21000b000 tx=0x7fd210006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:35.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.170+0000 7fd21d7fa700 1 -- 172.21.15.62:0/1403887172 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd218043e90 con 0x7fd2200b6160 2021-12-17T18:26:35.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.298+0000 7fd2261c8700 1 -- 172.21.15.62:0/1403887172 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2200573d0 con 0x7fd2200b6160 2021-12-17T18:26:35.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.302+0000 7fd21d7fa700 1 -- 172.21.15.62:0/1403887172 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16113 (secure 0 0 0) 0x7fd21801f030 con 0x7fd2200b6160 2021-12-17T18:26:35.309 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:35.310 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":111,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:26:35.031014+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:26:33.681609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-12-17T18:26:34.037077+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:26:35.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.302+0000 7fd2261c8700 1 -- 172.21.15.62:0/1403887172 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd204053640 msgr2=0x7fd204055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:35.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.302+0000 7fd2261c8700 1 --2- 172.21.15.62:0/1403887172 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd204053640 0x7fd204055b00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fd21000b000 tx=0x7fd210006df0).stop 2021-12-17T18:26:35.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.302+0000 7fd2261c8700 1 -- 172.21.15.62:0/1403887172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2200b6160 msgr2=0x7fd2200b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:35.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.302+0000 7fd2261c8700 1 --2- 172.21.15.62:0/1403887172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2200b6160 0x7fd2200b4800 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fd2180032f0 tx=0x7fd218017000).stop 2021-12-17T18:26:35.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.302+0000 7fd2261c8700 1 -- 172.21.15.62:0/1403887172 shutdown_connections 2021-12-17T18:26:35.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.302+0000 7fd2261c8700 1 --2- 172.21.15.62:0/1403887172 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd204053640 0x7fd204055b00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.302+0000 7fd2261c8700 1 --2- 172.21.15.62:0/1403887172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2200b6160 0x7fd2200b4800 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.302+0000 7fd2261c8700 1 --2- 172.21.15.62:0/1403887172 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd2200af4e0 0x7fd2200b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.302+0000 7fd2261c8700 1 --2- 172.21.15.62:0/1403887172 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd22005c0e0 0x7fd2201415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.302+0000 7fd2261c8700 1 -- 172.21.15.62:0/1403887172 >> 172.21.15.62:0/1403887172 conn(0x7fd22005c750 msgr2=0x7fd2200b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:35.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.306+0000 7fd2261c8700 1 -- 172.21.15.62:0/1403887172 shutdown_connections 2021-12-17T18:26:35.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.306+0000 7fd2261c8700 1 -- 172.21.15.62:0/1403887172 wait complete. 2021-12-17T18:26:35.327 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:26:35.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.422+0000 7f45b1999700 1 Processor -- start 2021-12-17T18:26:35.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.422+0000 7f45b1999700 1 -- start start 2021-12-17T18:26:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45b1999700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45ac0b5b20 0x7f45ac0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45b1999700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f45ac0b3760 0x7f45ac0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45b1999700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ac0b5f00 con 0x7f45ac0b6c70 2021-12-17T18:26:35.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45b1999700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ac0b3020 con 0x7f45ac0b3760 2021-12-17T18:26:35.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45b1999700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0b32c0 con 0x7f45ac0b5b20 2021-12-17T18:26:35.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45a3fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f45ac0b3760 0x7f45ac0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45a3fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f45ac0b3760 0x7f45ac0b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:33352/0 (socket says 172.21.15.62:33352) 2021-12-17T18:26:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45b0997700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45ac0b5b20 0x7f45ac0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45a3fff700 1 -- 172.21.15.62:0/1200796596 learned_addr learned my addr 172.21.15.62:0/1200796596 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:35.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45b1198700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f45ac0b6c70 0x7f45ac146980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:54936/0 (socket says 172.21.15.62:54936) 2021-12-17T18:26:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45a3fff700 1 -- 172.21.15.62:0/1200796596 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45ac0b5b20 msgr2=0x7f45ac0b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45a3fff700 1 --2- 172.21.15.62:0/1200796596 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45ac0b5b20 0x7f45ac0b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45a3fff700 1 -- 172.21.15.62:0/1200796596 >> v1:172.21.15.109:6789/0 conn(0x7f45ac0b6c70 legacy=0x7f45ac146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:35.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45a3fff700 1 -- 172.21.15.62:0/1200796596 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac0b5440 con 0x7f45ac0b3760 2021-12-17T18:26:35.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45a3fff700 1 --2- 172.21.15.62:0/1200796596 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45ac0b3760 0x7f45ac0b6780 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f459c002f70 tx=0x7f459c006eb0).ready entity=mon.1 client_cookie=9a816607609fbeb2 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:35.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45a37fe700 1 -- 172.21.15.62:0/1200796596 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f459c00d570 con 0x7f45ac0b3760 2021-12-17T18:26:35.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45a37fe700 1 -- 172.21.15.62:0/1200796596 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c000e90 con 0x7f45ac0b3760 2021-12-17T18:26:35.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45a37fe700 1 -- 172.21.15.62:0/1200796596 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f459c00d900 con 0x7f45ac0b3760 2021-12-17T18:26:35.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45b1999700 1 -- 172.21.15.62:0/1200796596 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45ac0b3760 msgr2=0x7f45ac0b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:35.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45b1999700 1 --2- 172.21.15.62:0/1200796596 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45ac0b3760 0x7f45ac0b6780 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f459c002f70 tx=0x7f459c006eb0).stop 2021-12-17T18:26:35.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45b1999700 1 -- 172.21.15.62:0/1200796596 shutdown_connections 2021-12-17T18:26:35.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45b1999700 1 --2- 172.21.15.62:0/1200796596 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45ac0b3760 0x7f45ac0b6780 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45b1999700 1 --2- 172.21.15.62:0/1200796596 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45ac0b5b20 0x7f45ac0b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45b1999700 1 -- 172.21.15.62:0/1200796596 >> 172.21.15.62:0/1200796596 conn(0x7f45ac05c750 msgr2=0x7f45ac05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:35.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45b1999700 1 -- 172.21.15.62:0/1200796596 shutdown_connections 2021-12-17T18:26:35.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.426+0000 7f45b1999700 1 -- 172.21.15.62:0/1200796596 wait complete. 2021-12-17T18:26:35.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45b1999700 1 Processor -- start 2021-12-17T18:26:35.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45b1999700 1 -- start start 2021-12-17T18:26:35.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45b1999700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45ac0b5b20 0x7f45ac141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45b1999700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45ac0b6c70 0x7f45ac0ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45b1999700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45ac066db0 0x7f45ac1433c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45b1999700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac145250 con 0x7f45ac0b6c70 2021-12-17T18:26:35.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45b1999700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac1454f0 con 0x7f45ac066db0 2021-12-17T18:26:35.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45b1999700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac144f60 con 0x7f45ac0b5b20 2021-12-17T18:26:35.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45a3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45ac0b6c70 0x7f45ac0ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45a3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45ac0b6c70 0x7f45ac0ad9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55040/0 (socket says 172.21.15.62:55040) 2021-12-17T18:26:35.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45a3fff700 1 -- 172.21.15.62:0/1024777731 learned_addr learned my addr 172.21.15.62:0/1024777731 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:35.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45b0997700 1 --2- 172.21.15.62:0/1024777731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45ac0b5b20 0x7f45ac141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45b1198700 1 --2- 172.21.15.62:0/1024777731 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45ac066db0 0x7f45ac1433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45a3fff700 1 -- 172.21.15.62:0/1024777731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45ac0b5b20 msgr2=0x7f45ac141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:35.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45a3fff700 1 --2- 172.21.15.62:0/1024777731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45ac0b5b20 0x7f45ac141240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45a3fff700 1 -- 172.21.15.62:0/1024777731 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45ac066db0 msgr2=0x7f45ac1433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:35.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45a3fff700 1 --2- 172.21.15.62:0/1024777731 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45ac066db0 0x7f45ac1433c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45a3fff700 1 -- 172.21.15.62:0/1024777731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c00b1e0 con 0x7f45ac0b6c70 2021-12-17T18:26:35.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.430+0000 7f45b1198700 1 --2- 172.21.15.62:0/1024777731 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45ac066db0 0x7f45ac1433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:35.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.434+0000 7f45a3fff700 1 --2- 172.21.15.62:0/1024777731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45ac0b6c70 0x7f45ac0ad9e0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f459c002f70 tx=0x7f459c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:35.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.434+0000 7f45a1ffb700 1 -- 172.21.15.62:0/1024777731 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f459c0117e0 con 0x7f45ac0b6c70 2021-12-17T18:26:35.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.434+0000 7f45a1ffb700 1 -- 172.21.15.62:0/1024777731 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c011940 con 0x7f45ac0b6c70 2021-12-17T18:26:35.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.434+0000 7f45b1999700 1 -- 172.21.15.62:0/1024777731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ac0aded0 con 0x7f45ac0b6c70 2021-12-17T18:26:35.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.434+0000 7f45a1ffb700 1 -- 172.21.15.62:0/1024777731 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f459c011ca0 con 0x7f45ac0b6c70 2021-12-17T18:26:35.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.434+0000 7f45b1999700 1 -- 172.21.15.62:0/1024777731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ac143a50 con 0x7f45ac0b6c70 2021-12-17T18:26:35.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.434+0000 7f45b1999700 1 -- 172.21.15.62:0/1024777731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ac0af9b0 con 0x7f45ac0b6c70 2021-12-17T18:26:35.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.434+0000 7f45a1ffb700 1 -- 172.21.15.62:0/1024777731 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f459c01a040 con 0x7f45ac0b6c70 2021-12-17T18:26:35.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.434+0000 7f45a1ffb700 1 --2- 172.21.15.62:0/1024777731 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f458c053580 0x7f458c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.434+0000 7f45a1ffb700 1 -- 172.21.15.62:0/1024777731 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f459c06c7c0 con 0x7f45ac0b6c70 2021-12-17T18:26:35.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.434+0000 7f45b0997700 1 --2- 172.21.15.62:0/1024777731 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f458c053580 0x7f458c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.438+0000 7f45b0997700 1 --2- 172.21.15.62:0/1024777731 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f458c053580 0x7f458c055a40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f45a800b000 tx=0x7f45a8006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:35.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.438+0000 7f45a1ffb700 1 -- 172.21.15.62:0/1024777731 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f45ac0af9b0 con 0x7f45ac0b6c70 2021-12-17T18:26:35.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.566+0000 7f45b1999700 1 -- 172.21.15.62:0/1024777731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45ac145660 con 0x7f45ac0b6c70 2021-12-17T18:26:35.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.570+0000 7f45a1ffb700 1 -- 172.21.15.62:0/1024777731 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16113 (secure 0 0 0) 0x7f459c02ff10 con 0x7f45ac0b6c70 2021-12-17T18:26:35.576 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:35.577 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":111,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:26:35.031014+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:26:33.681609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-12-17T18:26:34.037077+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:26:35.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.570+0000 7f45b1999700 1 -- 172.21.15.62:0/1024777731 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f458c053580 msgr2=0x7f458c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:35.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.570+0000 7f45b1999700 1 --2- 172.21.15.62:0/1024777731 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f458c053580 0x7f458c055a40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f45a800b000 tx=0x7f45a8006df0).stop 2021-12-17T18:26:35.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.570+0000 7f45b1999700 1 -- 172.21.15.62:0/1024777731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45ac0b6c70 msgr2=0x7f45ac0ad9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.570+0000 7f45b1999700 1 --2- 172.21.15.62:0/1024777731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45ac0b6c70 0x7f45ac0ad9e0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f459c002f70 tx=0x7f459c015000).stop 2021-12-17T18:26:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.570+0000 7f45b1999700 1 -- 172.21.15.62:0/1024777731 shutdown_connections 2021-12-17T18:26:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.570+0000 7f45b1999700 1 --2- 172.21.15.62:0/1024777731 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f458c053580 0x7f458c055a40 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.570+0000 7f45b1999700 1 --2- 172.21.15.62:0/1024777731 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45ac066db0 0x7f45ac1433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.570+0000 7f45b1999700 1 --2- 172.21.15.62:0/1024777731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45ac0b6c70 0x7f45ac0ad9e0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.570+0000 7f45b1999700 1 --2- 172.21.15.62:0/1024777731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45ac0b5b20 0x7f45ac141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.570+0000 7f45b1999700 1 -- 172.21.15.62:0/1024777731 >> 172.21.15.62:0/1024777731 conn(0x7f45ac05c750 msgr2=0x7f45ac0afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:35.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.570+0000 7f45b1999700 1 -- 172.21.15.62:0/1024777731 shutdown_connections 2021-12-17T18:26:35.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.570+0000 7f45b1999700 1 -- 172.21.15.62:0/1024777731 wait complete. 2021-12-17T18:26:35.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-12-17T18:26:35.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.694+0000 7f0dc759e700 1 Processor -- start 2021-12-17T18:26:35.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.694+0000 7f0dc759e700 1 -- start start 2021-12-17T18:26:35.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.694+0000 7f0dc759e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f0dc8140d00 0x7f0dc813e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.694+0000 7f0dc759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0dc80b2360 0x7f0dc8144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.694+0000 7f0dc759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc80641e0 con 0x7f0dc8063e00 2021-12-17T18:26:35.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.694+0000 7f0dc759e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc805fdf0 con 0x7f0dc8140d00 2021-12-17T18:26:35.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.694+0000 7f0dc759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80b27b0 con 0x7f0dc80b2360 2021-12-17T18:26:35.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc659c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0dc8063e00 0x7f0dc813dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38628/0 (socket says 172.21.15.62:38628) 2021-12-17T18:26:35.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc659c700 1 -- 172.21.15.62:0/2398123065 learned_addr learned my addr 172.21.15.62:0/2398123065 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:35.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc6d9d700 1 --2- 172.21.15.62:0/2398123065 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0dc80b2360 0x7f0dc8144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dbffff700 1 --2- 172.21.15.62:0/2398123065 >> v2:172.21.15.109:3300/0 conn(0x7f0dc8140d00 0x7f0dc813e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc5d9b700 1 -- 172.21.15.62:0/2398123065 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26224993 0 0) 0x7f0dc80641e0 con 0x7f0dc8063e00 2021-12-17T18:26:35.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc5d9b700 1 -- 172.21.15.62:0/2398123065 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dac003260 con 0x7f0dc8063e00 2021-12-17T18:26:35.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc6d9d700 1 -- 172.21.15.62:0/2398123065 >> v2:172.21.15.109:3300/0 conn(0x7f0dc8140d00 msgr2=0x7f0dc813e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:35.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc6d9d700 1 --2- 172.21.15.62:0/2398123065 >> v2:172.21.15.109:3300/0 conn(0x7f0dc8140d00 0x7f0dc813e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc6d9d700 1 -- 172.21.15.62:0/2398123065 >> v1:172.21.15.62:6789/0 conn(0x7f0dc8063e00 legacy=0x7f0dc813dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:35.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc6d9d700 1 -- 172.21.15.62:0/2398123065 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc8141ee0 con 0x7f0dc80b2360 2021-12-17T18:26:35.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dbffff700 1 --2- 172.21.15.62:0/2398123065 >> v2:172.21.15.109:3300/0 conn(0x7f0dc8140d00 0x7f0dc813e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:35.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc6d9d700 1 --2- 172.21.15.62:0/2398123065 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0dc80b2360 0x7f0dc8144610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f0dc00032f0 tx=0x7f0dc00091d0).ready entity=mon.2 client_cookie=d28311b1ebf49be0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:35.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc5d9b700 1 -- 172.21.15.62:0/2398123065 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dc000b600 con 0x7f0dc80b2360 2021-12-17T18:26:35.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc5d9b700 1 -- 172.21.15.62:0/2398123065 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc000b760 con 0x7f0dc80b2360 2021-12-17T18:26:35.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc5d9b700 1 -- 172.21.15.62:0/2398123065 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dc000b8d0 con 0x7f0dc80b2360 2021-12-17T18:26:35.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc759e700 1 -- 172.21.15.62:0/2398123065 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0dc80b2360 msgr2=0x7f0dc8144610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:35.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc759e700 1 --2- 172.21.15.62:0/2398123065 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0dc80b2360 0x7f0dc8144610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f0dc00032f0 tx=0x7f0dc00091d0).stop 2021-12-17T18:26:35.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc759e700 1 -- 172.21.15.62:0/2398123065 shutdown_connections 2021-12-17T18:26:35.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc759e700 1 --2- 172.21.15.62:0/2398123065 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0dc80b2360 0x7f0dc8144610 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc759e700 1 --2- 172.21.15.62:0/2398123065 >> v2:172.21.15.109:3300/0 conn(0x7f0dc8140d00 0x7f0dc813e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc759e700 1 -- 172.21.15.62:0/2398123065 >> 172.21.15.62:0/2398123065 conn(0x7f0dc8060a50 msgr2=0x7f0dc805bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:35.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc759e700 1 -- 172.21.15.62:0/2398123065 shutdown_connections 2021-12-17T18:26:35.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.698+0000 7f0dc759e700 1 -- 172.21.15.62:0/2398123065 wait complete. 2021-12-17T18:26:35.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc759e700 1 Processor -- start 2021-12-17T18:26:35.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc759e700 1 -- start start 2021-12-17T18:26:35.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0dc8063e00 0x7f0dc8142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0dc80b2360 0x7f0dc813a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0dc8140d00 0x7f0dc813ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc81510f0 con 0x7f0dc8063e00 2021-12-17T18:26:35.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc813f0b0 con 0x7f0dc80b2360 2021-12-17T18:26:35.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc813f350 con 0x7f0dc8140d00 2021-12-17T18:26:35.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0dc8063e00 0x7f0dc8142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0dc8063e00 0x7f0dc8142370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55052/0 (socket says 172.21.15.62:55052) 2021-12-17T18:26:35.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc659c700 1 -- 172.21.15.62:0/1318965344 learned_addr learned my addr 172.21.15.62:0/1318965344 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:35.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dbffff700 1 --2- 172.21.15.62:0/1318965344 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0dc80b2360 0x7f0dc813a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc6d9d700 1 --2- 172.21.15.62:0/1318965344 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0dc8140d00 0x7f0dc813ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc659c700 1 -- 172.21.15.62:0/1318965344 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0dc8140d00 msgr2=0x7f0dc813ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc659c700 1 --2- 172.21.15.62:0/1318965344 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0dc8140d00 0x7f0dc813ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc659c700 1 -- 172.21.15.62:0/1318965344 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0dc80b2360 msgr2=0x7f0dc813a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc659c700 1 --2- 172.21.15.62:0/1318965344 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0dc80b2360 0x7f0dc813a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc659c700 1 -- 172.21.15.62:0/1318965344 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db000b180 con 0x7f0dc8063e00 2021-12-17T18:26:35.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc659c700 1 --2- 172.21.15.62:0/1318965344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0dc8063e00 0x7f0dc8142370 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f0db8001110 tx=0x7f0db8007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:35.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dbf7fe700 1 -- 172.21.15.62:0/1318965344 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0db800ce00 con 0x7f0dc8063e00 2021-12-17T18:26:35.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dbf7fe700 1 -- 172.21.15.62:0/1318965344 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db8007320 con 0x7f0dc8063e00 2021-12-17T18:26:35.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dbf7fe700 1 -- 172.21.15.62:0/1318965344 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0db8005220 con 0x7f0dc8063e00 2021-12-17T18:26:35.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc759e700 1 -- 172.21.15.62:0/1318965344 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc0009470 con 0x7f0dc8063e00 2021-12-17T18:26:35.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.702+0000 7f0dc759e700 1 -- 172.21.15.62:0/1318965344 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc8142e10 con 0x7f0dc8063e00 2021-12-17T18:26:35.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.706+0000 7f0dc759e700 1 -- 172.21.15.62:0/1318965344 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc805f8b0 con 0x7f0dc8063e00 2021-12-17T18:26:35.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.706+0000 7f0dbf7fe700 1 -- 172.21.15.62:0/1318965344 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0db801b070 con 0x7f0dc8063e00 2021-12-17T18:26:35.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.706+0000 7f0dbf7fe700 1 --2- 172.21.15.62:0/1318965344 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0da00535b0 0x7f0da0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:35.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.706+0000 7f0dbf7fe700 1 -- 172.21.15.62:0/1318965344 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0db806af30 con 0x7f0dc8063e00 2021-12-17T18:26:35.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.706+0000 7f0dbffff700 1 --2- 172.21.15.62:0/1318965344 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0da00535b0 0x7f0da0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:35.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.706+0000 7f0dbffff700 1 --2- 172.21.15.62:0/1318965344 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0da00535b0 0x7f0da0055a70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f0db000b000 tx=0x7f0db0008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:35.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.714+0000 7f0dbf7fe700 1 -- 172.21.15.62:0/1318965344 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0db8042090 con 0x7f0dc8063e00 2021-12-17T18:26:35.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:35.878+0000 7f0dc759e700 1 -- 172.21.15.62:0/1318965344 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0dc80573d0 con 0x7f0dc8063e00 2021-12-17T18:26:36.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.034+0000 7f0dbf7fe700 1 -- 172.21.15.62:0/1318965344 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0db80456b0 con 0x7f0dc8063e00 2021-12-17T18:26:36.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.038+0000 7f0dc759e700 1 -- 172.21.15.62:0/1318965344 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0da00535b0 msgr2=0x7f0da0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.038+0000 7f0dc759e700 1 --2- 172.21.15.62:0/1318965344 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0da00535b0 0x7f0da0055a70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f0db000b000 tx=0x7f0db0008040).stop 2021-12-17T18:26:36.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.038+0000 7f0dc759e700 1 -- 172.21.15.62:0/1318965344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0dc8063e00 msgr2=0x7f0dc8142370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.038+0000 7f0dc759e700 1 --2- 172.21.15.62:0/1318965344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0dc8063e00 0x7f0dc8142370 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f0db8001110 tx=0x7f0db8007a80).stop 2021-12-17T18:26:36.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.038+0000 7f0dc759e700 1 -- 172.21.15.62:0/1318965344 shutdown_connections 2021-12-17T18:26:36.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.038+0000 7f0dc759e700 1 --2- 172.21.15.62:0/1318965344 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0da00535b0 0x7f0da0055a70 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.038+0000 7f0dc759e700 1 --2- 172.21.15.62:0/1318965344 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0dc8140d00 0x7f0dc813ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.038+0000 7f0dc759e700 1 --2- 172.21.15.62:0/1318965344 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0dc80b2360 0x7f0dc813a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.038+0000 7f0dc759e700 1 --2- 172.21.15.62:0/1318965344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0dc8063e00 0x7f0dc8142370 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.038+0000 7f0dc759e700 1 -- 172.21.15.62:0/1318965344 >> 172.21.15.62:0/1318965344 conn(0x7f0dc8060a50 msgr2=0x7f0dc81443b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.038+0000 7f0dc759e700 1 -- 172.21.15.62:0/1318965344 shutdown_connections 2021-12-17T18:26:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.038+0000 7f0dc759e700 1 -- 172.21.15.62:0/1318965344 wait complete. 2021-12-17T18:26:36.064 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:26:36.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.162+0000 7f1d46542700 1 Processor -- start 2021-12-17T18:26:36.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.162+0000 7f1d46542700 1 -- start start 2021-12-17T18:26:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.162+0000 7f1d46542700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1d400b6160 0x7f1d40142690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.162+0000 7f1d46542700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d400b0830 0x7f1d40142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.162+0000 7f1d46542700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d400b6540 con 0x7f1d400af220 2021-12-17T18:26:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.162+0000 7f1d46542700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d400ae840 con 0x7f1d400b0830 2021-12-17T18:26:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.162+0000 7f1d46542700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d400aeae0 con 0x7f1d400b6160 2021-12-17T18:26:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.162+0000 7f1d3f7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d400b0830 0x7f1d40142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.162+0000 7f1d44adf700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1d400af220 0x7f1d400b2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38644/0 (socket says 172.21.15.62:38644) 2021-12-17T18:26:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.162+0000 7f1d44adf700 1 -- 172.21.15.62:0/3208586030 learned_addr learned my addr 172.21.15.62:0/3208586030 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.162+0000 7f1d3ffff700 1 --2- 172.21.15.62:0/3208586030 >> v2:172.21.15.109:3300/0 conn(0x7f1d400b6160 0x7f1d40142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.162+0000 7f1d3effd700 1 -- 172.21.15.62:0/3208586030 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468366269 0 0) 0x7f1d400b6540 con 0x7f1d400af220 2021-12-17T18:26:36.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.162+0000 7f1d3f7fe700 1 -- 172.21.15.62:0/3208586030 >> v2:172.21.15.109:3300/0 conn(0x7f1d400b6160 msgr2=0x7f1d40142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:36.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.162+0000 7f1d3f7fe700 1 --2- 172.21.15.62:0/3208586030 >> v2:172.21.15.109:3300/0 conn(0x7f1d400b6160 0x7f1d40142690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.162+0000 7f1d3f7fe700 1 -- 172.21.15.62:0/3208586030 >> v1:172.21.15.62:6789/0 conn(0x7f1d400af220 legacy=0x7f1d400b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.162+0000 7f1d3f7fe700 1 -- 172.21.15.62:0/3208586030 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d400aed80 con 0x7f1d400b0830 2021-12-17T18:26:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.166+0000 7f1d3f7fe700 1 --2- 172.21.15.62:0/3208586030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d400b0830 0x7f1d40142b80 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f1d34002f70 tx=0x7f1d34006df0).ready entity=mon.0 client_cookie=84f2fad7449adb10 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.166+0000 7f1d3effd700 1 -- 172.21.15.62:0/3208586030 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d3400d5c0 con 0x7f1d400b0830 2021-12-17T18:26:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.166+0000 7f1d3effd700 1 -- 172.21.15.62:0/3208586030 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d34000e90 con 0x7f1d400b0830 2021-12-17T18:26:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.166+0000 7f1d3effd700 1 -- 172.21.15.62:0/3208586030 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d3400d910 con 0x7f1d400b0830 2021-12-17T18:26:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.166+0000 7f1d46542700 1 -- 172.21.15.62:0/3208586030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d400b0830 msgr2=0x7f1d40142b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.166+0000 7f1d46542700 1 --2- 172.21.15.62:0/3208586030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d400b0830 0x7f1d40142b80 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f1d34002f70 tx=0x7f1d34006df0).stop 2021-12-17T18:26:36.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.166+0000 7f1d46542700 1 -- 172.21.15.62:0/3208586030 shutdown_connections 2021-12-17T18:26:36.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.166+0000 7f1d46542700 1 --2- 172.21.15.62:0/3208586030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d400b0830 0x7f1d40142b80 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.166+0000 7f1d46542700 1 --2- 172.21.15.62:0/3208586030 >> v2:172.21.15.109:3300/0 conn(0x7f1d400b6160 0x7f1d40142690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.166+0000 7f1d46542700 1 -- 172.21.15.62:0/3208586030 >> 172.21.15.62:0/3208586030 conn(0x7f1d4005c750 msgr2=0x7f1d400630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:36.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.166+0000 7f1d46542700 1 -- 172.21.15.62:0/3208586030 shutdown_connections 2021-12-17T18:26:36.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.166+0000 7f1d46542700 1 -- 172.21.15.62:0/3208586030 wait complete. 2021-12-17T18:26:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d46542700 1 Processor -- start 2021-12-17T18:26:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d46542700 1 -- start start 2021-12-17T18:26:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d46542700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d400af220 0x7f1d401416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d46542700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1d400b0830 0x7f1d40155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d46542700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d400b6160 0x7f1d40156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d46542700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40153460 con 0x7f1d400b6160 2021-12-17T18:26:36.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d46542700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40153700 con 0x7f1d400b0830 2021-12-17T18:26:36.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d46542700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40141ba0 con 0x7f1d400af220 2021-12-17T18:26:36.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d44adf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d400b6160 0x7f1d40156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d44adf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d400b6160 0x7f1d40156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55070/0 (socket says 172.21.15.62:55070) 2021-12-17T18:26:36.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d44adf700 1 -- 172.21.15.62:0/3553124910 learned_addr learned my addr 172.21.15.62:0/3553124910 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:36.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d3f7fe700 1 --2- 172.21.15.62:0/3553124910 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1d400b0830 0x7f1d40155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d3ffff700 1 --2- 172.21.15.62:0/3553124910 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d400af220 0x7f1d401416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d44adf700 1 -- 172.21.15.62:0/3553124910 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d400af220 msgr2=0x7f1d401416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d44adf700 1 --2- 172.21.15.62:0/3553124910 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d400af220 0x7f1d401416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d44adf700 1 -- 172.21.15.62:0/3553124910 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1d400b0830 msgr2=0x7f1d40155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d44adf700 1 --2- 172.21.15.62:0/3553124910 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1d400b0830 0x7f1d40155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d44adf700 1 -- 172.21.15.62:0/3553124910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3400b180 con 0x7f1d400b6160 2021-12-17T18:26:36.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d44adf700 1 --2- 172.21.15.62:0/3553124910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d400b6160 0x7f1d40156320 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f1d38000f40 tx=0x7f1d38007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.170+0000 7f1d3d7fa700 1 -- 172.21.15.62:0/3553124910 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d38005ba0 con 0x7f1d400b6160 2021-12-17T18:26:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.174+0000 7f1d3d7fa700 1 -- 172.21.15.62:0/3553124910 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d38005d00 con 0x7f1d400b6160 2021-12-17T18:26:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.174+0000 7f1d46542700 1 -- 172.21.15.62:0/3553124910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d40146db0 con 0x7f1d400b6160 2021-12-17T18:26:36.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.174+0000 7f1d3d7fa700 1 -- 172.21.15.62:0/3553124910 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d380072c0 con 0x7f1d400b6160 2021-12-17T18:26:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.174+0000 7f1d46542700 1 -- 172.21.15.62:0/3553124910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d400640f0 con 0x7f1d400b6160 2021-12-17T18:26:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.174+0000 7f1d3d7fa700 1 -- 172.21.15.62:0/3553124910 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1d3801a060 con 0x7f1d400b6160 2021-12-17T18:26:36.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.174+0000 7f1d46542700 1 -- 172.21.15.62:0/3553124910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d40143070 con 0x7f1d400b6160 2021-12-17T18:26:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.174+0000 7f1d3d7fa700 1 --2- 172.21.15.62:0/3553124910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1d200536a0 0x7f1d20055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.174+0000 7f1d3d7fa700 1 -- 172.21.15.62:0/3553124910 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1d3806b310 con 0x7f1d400b6160 2021-12-17T18:26:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.174+0000 7f1d3ffff700 1 --2- 172.21.15.62:0/3553124910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1d200536a0 0x7f1d20055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.174+0000 7f1d3ffff700 1 --2- 172.21.15.62:0/3553124910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1d200536a0 0x7f1d20055b60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f1d3000c000 tx=0x7f1d30008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.182+0000 7f1d3d7fa700 1 -- 172.21.15.62:0/3553124910 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1d38042470 con 0x7f1d400b6160 2021-12-17T18:26:36.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.350+0000 7f1d46542700 1 -- 172.21.15.62:0/3553124910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d400573d0 con 0x7f1d400b6160 2021-12-17T18:26:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.350+0000 7f1d3d7fa700 1 -- 172.21.15.62:0/3553124910 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f1d38018070 con 0x7f1d400b6160 2021-12-17T18:26:36.359 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:36.359 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":55,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6650,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3745112309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3745112309},{"type":"v1","addr":"172.21.15.109:6835","nonce":3745112309}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":53}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:26:35.031189+0000","modified":"2021-12-17T18:26:36.033870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7704":{"gid":7704,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/2418178754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2418178754},{"type":"v1","addr":"172.21.15.62:6833","nonce":2418178754}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-12-17T18:26:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.354+0000 7f1d46542700 1 -- 172.21.15.62:0/3553124910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1d200536a0 msgr2=0x7f1d20055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.354+0000 7f1d46542700 1 --2- 172.21.15.62:0/3553124910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1d200536a0 0x7f1d20055b60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f1d3000c000 tx=0x7f1d30008040).stop 2021-12-17T18:26:36.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.354+0000 7f1d46542700 1 -- 172.21.15.62:0/3553124910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d400b6160 msgr2=0x7f1d40156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.354+0000 7f1d46542700 1 --2- 172.21.15.62:0/3553124910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d400b6160 0x7f1d40156320 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f1d38000f40 tx=0x7f1d38007d80).stop 2021-12-17T18:26:36.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.354+0000 7f1d46542700 1 -- 172.21.15.62:0/3553124910 shutdown_connections 2021-12-17T18:26:36.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.354+0000 7f1d46542700 1 --2- 172.21.15.62:0/3553124910 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1d200536a0 0x7f1d20055b60 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.354+0000 7f1d46542700 1 --2- 172.21.15.62:0/3553124910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d400b6160 0x7f1d40156320 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.354+0000 7f1d46542700 1 --2- 172.21.15.62:0/3553124910 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1d400b0830 0x7f1d40155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.354+0000 7f1d46542700 1 --2- 172.21.15.62:0/3553124910 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d400af220 0x7f1d401416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.354+0000 7f1d46542700 1 -- 172.21.15.62:0/3553124910 >> 172.21.15.62:0/3553124910 conn(0x7f1d4005c750 msgr2=0x7f1d400b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:36.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.354+0000 7f1d46542700 1 -- 172.21.15.62:0/3553124910 shutdown_connections 2021-12-17T18:26:36.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.354+0000 7f1d46542700 1 -- 172.21.15.62:0/3553124910 wait complete. 2021-12-17T18:26:36.367 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 55 2021-12-17T18:26:36.373 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:26:36.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.466+0000 7f20e2d95700 1 Processor -- start 2021-12-17T18:26:36.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.466+0000 7f20e2d95700 1 -- start start 2021-12-17T18:26:36.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.466+0000 7f20e2d95700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f20dc0b0690 0x7f20dc1438c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.466+0000 7f20e2d95700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f20dc143db0 0x7f20dc13cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.466+0000 7f20e2d95700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20dc0b2570 con 0x7f20dc067830 2021-12-17T18:26:36.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.466+0000 7f20e2d95700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20dc067c10 con 0x7f20dc0b0690 2021-12-17T18:26:36.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.466+0000 7f20e2d95700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20dc147520 con 0x7f20dc143db0 2021-12-17T18:26:36.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.466+0000 7f20e1592700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f20dc0b0690 0x7f20dc1438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.466+0000 7f20e1592700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f20dc0b0690 0x7f20dc1438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55074/0 (socket says 172.21.15.62:55074) 2021-12-17T18:26:36.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.466+0000 7f20e1d93700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f20dc067830 0x7f20dc0b1360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38654/0 (socket says 172.21.15.62:38654) 2021-12-17T18:26:36.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.466+0000 7f20e1592700 1 -- 172.21.15.62:0/3977459148 learned_addr learned my addr 172.21.15.62:0/3977459148 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:36.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.466+0000 7f20e2594700 1 --2- 172.21.15.62:0/3977459148 >> v2:172.21.15.109:3300/0 conn(0x7f20dc143db0 0x7f20dc13cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.466+0000 7f20e1592700 1 -- 172.21.15.62:0/3977459148 >> v2:172.21.15.109:3300/0 conn(0x7f20dc143db0 msgr2=0x7f20dc13cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:36.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.466+0000 7f20e1592700 1 --2- 172.21.15.62:0/3977459148 >> v2:172.21.15.109:3300/0 conn(0x7f20dc143db0 0x7f20dc13cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.466+0000 7f20e1592700 1 -- 172.21.15.62:0/3977459148 >> v1:172.21.15.62:6789/0 conn(0x7f20dc067830 legacy=0x7f20dc0b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.466+0000 7f20e1592700 1 -- 172.21.15.62:0/3977459148 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc143420 con 0x7f20dc0b0690 2021-12-17T18:26:36.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e1592700 1 --2- 172.21.15.62:0/3977459148 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc0b0690 0x7f20dc1438c0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f20d8002f70 tx=0x7f20d8006eb0).ready entity=mon.0 client_cookie=f760d0da8cdffe8b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:36.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e0d91700 1 -- 172.21.15.62:0/3977459148 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20d800d610 con 0x7f20dc0b0690 2021-12-17T18:26:36.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e0d91700 1 -- 172.21.15.62:0/3977459148 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d8000e90 con 0x7f20dc0b0690 2021-12-17T18:26:36.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e0d91700 1 -- 172.21.15.62:0/3977459148 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20d800d9a0 con 0x7f20dc0b0690 2021-12-17T18:26:36.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e2d95700 1 -- 172.21.15.62:0/3977459148 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc0b0690 msgr2=0x7f20dc1438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e2d95700 1 --2- 172.21.15.62:0/3977459148 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc0b0690 0x7f20dc1438c0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f20d8002f70 tx=0x7f20d8006eb0).stop 2021-12-17T18:26:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e2d95700 1 -- 172.21.15.62:0/3977459148 shutdown_connections 2021-12-17T18:26:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e2d95700 1 --2- 172.21.15.62:0/3977459148 >> v2:172.21.15.109:3300/0 conn(0x7f20dc143db0 0x7f20dc13cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e2d95700 1 --2- 172.21.15.62:0/3977459148 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc0b0690 0x7f20dc1438c0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e2d95700 1 -- 172.21.15.62:0/3977459148 >> 172.21.15.62:0/3977459148 conn(0x7f20dc05c750 msgr2=0x7f20dc05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e2d95700 1 -- 172.21.15.62:0/3977459148 shutdown_connections 2021-12-17T18:26:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e2d95700 1 -- 172.21.15.62:0/3977459148 wait complete. 2021-12-17T18:26:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e2d95700 1 Processor -- start 2021-12-17T18:26:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e2d95700 1 -- start start 2021-12-17T18:26:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e2d95700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f20dc067830 0x7f20dc09ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e2d95700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc0b0690 0x7f20dc0a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e2d95700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f20dc143db0 0x7f20dc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e2d95700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc1426e0 con 0x7f20dc0b0690 2021-12-17T18:26:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e2d95700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc142ca0 con 0x7f20dc143db0 2021-12-17T18:26:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e2d95700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc0a04b0 con 0x7f20dc067830 2021-12-17T18:26:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e1592700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc0b0690 0x7f20dc0a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e1592700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc0b0690 0x7f20dc0a0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55082/0 (socket says 172.21.15.62:55082) 2021-12-17T18:26:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.470+0000 7f20e1592700 1 -- 172.21.15.62:0/3812441429 learned_addr learned my addr 172.21.15.62:0/3812441429 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20e1d93700 1 --2- 172.21.15.62:0/3812441429 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f20dc067830 0x7f20dc09ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20e2594700 1 --2- 172.21.15.62:0/3812441429 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f20dc143db0 0x7f20dc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20e1592700 1 -- 172.21.15.62:0/3812441429 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f20dc067830 msgr2=0x7f20dc09ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20e1592700 1 --2- 172.21.15.62:0/3812441429 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f20dc067830 0x7f20dc09ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20e1592700 1 -- 172.21.15.62:0/3812441429 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f20dc143db0 msgr2=0x7f20dc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20e1592700 1 --2- 172.21.15.62:0/3812441429 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f20dc143db0 0x7f20dc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20e1592700 1 -- 172.21.15.62:0/3812441429 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d800b1e0 con 0x7f20dc0b0690 2021-12-17T18:26:36.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20e2594700 1 --2- 172.21.15.62:0/3812441429 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f20dc143db0 0x7f20dc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:36.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20e1592700 1 --2- 172.21.15.62:0/3812441429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc0b0690 0x7f20dc0a0950 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f20d8002f70 tx=0x7f20d8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:36.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20caffd700 1 -- 172.21.15.62:0/3812441429 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20d800d990 con 0x7f20dc0b0690 2021-12-17T18:26:36.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20caffd700 1 -- 172.21.15.62:0/3812441429 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d8011bf0 con 0x7f20dc0b0690 2021-12-17T18:26:36.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20e2d95700 1 -- 172.21.15.62:0/3812441429 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20dc141830 con 0x7f20dc0b0690 2021-12-17T18:26:36.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20caffd700 1 -- 172.21.15.62:0/3812441429 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20d801e460 con 0x7f20dc0b0690 2021-12-17T18:26:36.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20e2d95700 1 -- 172.21.15.62:0/3812441429 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20dc140fd0 con 0x7f20dc0b0690 2021-12-17T18:26:36.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20e2d95700 1 -- 172.21.15.62:0/3812441429 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20dc0a0670 con 0x7f20dc0b0690 2021-12-17T18:26:36.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20caffd700 1 -- 172.21.15.62:0/3812441429 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f20d8025030 con 0x7f20dc0b0690 2021-12-17T18:26:36.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20caffd700 1 --2- 172.21.15.62:0/3812441429 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f20bc0536a0 0x7f20bc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20caffd700 1 -- 172.21.15.62:0/3812441429 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f20d806cb20 con 0x7f20dc0b0690 2021-12-17T18:26:36.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.474+0000 7f20e1d93700 1 --2- 172.21.15.62:0/3812441429 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f20bc0536a0 0x7f20bc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.478+0000 7f20e1d93700 1 --2- 172.21.15.62:0/3812441429 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f20bc0536a0 0x7f20bc055b60 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f20cc00d000 tx=0x7f20cc007b40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:36.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.486+0000 7f20caffd700 1 -- 172.21.15.62:0/3812441429 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f20d8043c80 con 0x7f20dc0b0690 2021-12-17T18:26:36.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.614+0000 7f20e2d95700 1 -- 172.21.15.62:0/3812441429 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20dc142a90 con 0x7f20dc0b0690 2021-12-17T18:26:36.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.614+0000 7f20caffd700 1 -- 172.21.15.62:0/3812441429 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f20d8023070 con 0x7f20dc0b0690 2021-12-17T18:26:36.623 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:36.624 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":112,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:26:36.034630+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:26:33.681609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-12-17T18:26:34.037077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:26:36.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.618+0000 7f20e2d95700 1 -- 172.21.15.62:0/3812441429 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f20bc0536a0 msgr2=0x7f20bc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.618+0000 7f20e2d95700 1 --2- 172.21.15.62:0/3812441429 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f20bc0536a0 0x7f20bc055b60 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f20cc00d000 tx=0x7f20cc007b40).stop 2021-12-17T18:26:36.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.618+0000 7f20e2d95700 1 -- 172.21.15.62:0/3812441429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc0b0690 msgr2=0x7f20dc0a0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.618+0000 7f20e2d95700 1 --2- 172.21.15.62:0/3812441429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc0b0690 0x7f20dc0a0950 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f20d8002f70 tx=0x7f20d8015000).stop 2021-12-17T18:26:36.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.618+0000 7f20e2d95700 1 -- 172.21.15.62:0/3812441429 shutdown_connections 2021-12-17T18:26:36.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.618+0000 7f20e2d95700 1 --2- 172.21.15.62:0/3812441429 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f20bc0536a0 0x7f20bc055b60 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.618+0000 7f20e2d95700 1 --2- 172.21.15.62:0/3812441429 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f20dc143db0 0x7f20dc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.618+0000 7f20e2d95700 1 --2- 172.21.15.62:0/3812441429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc0b0690 0x7f20dc0a0950 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.618+0000 7f20e2d95700 1 --2- 172.21.15.62:0/3812441429 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f20dc067830 0x7f20dc09ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.618+0000 7f20e2d95700 1 -- 172.21.15.62:0/3812441429 >> 172.21.15.62:0/3812441429 conn(0x7f20dc05c750 msgr2=0x7f20dc1447a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:36.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.618+0000 7f20e2d95700 1 -- 172.21.15.62:0/3812441429 shutdown_connections 2021-12-17T18:26:36.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.618+0000 7f20e2d95700 1 -- 172.21.15.62:0/3812441429 wait complete. 2021-12-17T18:26:36.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:26:36.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f486973d700 1 Processor -- start 2021-12-17T18:26:36.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f486973d700 1 -- start start 2021-12-17T18:26:36.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f486973d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48640b4410 0x7f4864144450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f486973d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48640ae6f0 con 0x7f48640ad430 2021-12-17T18:26:36.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f486973d700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48640b4c70 con 0x7f48640b4030 2021-12-17T18:26:36.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f486973d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48640b3180 con 0x7f48640b4410 2021-12-17T18:26:36.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f48627fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f48640ad430 0x7f4864065960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38670/0 (socket says 172.21.15.62:38670) 2021-12-17T18:26:36.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f48627fc700 1 -- 172.21.15.62:0/65976398 learned_addr learned my addr 172.21.15.62:0/65976398 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:36.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f48637fe700 1 --2- 172.21.15.62:0/65976398 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48640b4410 0x7f4864144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 -- 172.21.15.62:0/65976398 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402779137 0 0) 0x7f48640ae6f0 con 0x7f48640ad430 2021-12-17T18:26:36.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 -- 172.21.15.62:0/65976398 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4844003260 con 0x7f48640ad430 2021-12-17T18:26:36.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 -- 172.21.15.62:0/65976398 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995671116 0 0) 0x7f48640b4c70 con 0x7f48640b4030 2021-12-17T18:26:36.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 -- 172.21.15.62:0/65976398 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48640ae6f0 con 0x7f48640b4030 2021-12-17T18:26:36.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 -- 172.21.15.62:0/65976398 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 838054781 0 0) 0x7f4844003260 con 0x7f48640ad430 2021-12-17T18:26:36.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 -- 172.21.15.62:0/65976398 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48640b4410 msgr2=0x7f4864144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:36.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 --2- 172.21.15.62:0/65976398 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48640b4410 0x7f4864144450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 -- 172.21.15.62:0/65976398 >> v1:172.21.15.109:6789/0 conn(0x7f48640b4030 legacy=0x7f486413aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 -- 172.21.15.62:0/65976398 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48640b4f10 con 0x7f48640ad430 2021-12-17T18:26:36.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 -- 172.21.15.62:0/65976398 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f484c001660 con 0x7f48640ad430 2021-12-17T18:26:36.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 -- 172.21.15.62:0/65976398 >> v1:172.21.15.62:6789/0 conn(0x7f48640ad430 legacy=0x7f4864065960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 --2- 172.21.15.62:0/65976398 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4844003910 0x7f4844003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 --2- 172.21.15.62:0/65976398 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48640b4410 0x7f4844004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 --2- 172.21.15.62:0/65976398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48440049f0 0x7f4844004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 -- 172.21.15.62:0/65976398 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48640b3180 con 0x7f48440049f0 2021-12-17T18:26:36.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 -- 172.21.15.62:0/65976398 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484400fb90 con 0x7f4844003910 2021-12-17T18:26:36.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 -- 172.21.15.62:0/65976398 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484400fd50 con 0x7f48640b4410 2021-12-17T18:26:36.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f48637fe700 1 --2- 172.21.15.62:0/65976398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48440049f0 0x7f4844004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f48627fc700 1 --2- 172.21.15.62:0/65976398 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48640b4410 0x7f4844004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4862ffd700 1 --2- 172.21.15.62:0/65976398 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4844003910 0x7f4844003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f48637fe700 1 -- 172.21.15.62:0/65976398 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48640b4410 msgr2=0x7f4844004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:36.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f48637fe700 1 --2- 172.21.15.62:0/65976398 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48640b4410 0x7f4844004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f48637fe700 1 -- 172.21.15.62:0/65976398 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4844003910 msgr2=0x7f4844003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:36.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f48637fe700 1 --2- 172.21.15.62:0/65976398 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4844003910 0x7f4844003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f48637fe700 1 -- 172.21.15.62:0/65976398 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4844003260 con 0x7f48440049f0 2021-12-17T18:26:36.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4862ffd700 1 --2- 172.21.15.62:0/65976398 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4844003910 0x7f4844003d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:36.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f48637fe700 1 --2- 172.21.15.62:0/65976398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48440049f0 0x7f4844004e70 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f485c00c000 tx=0x7f485c006df0).ready entity=mon.0 client_cookie=1506425c47c4db75 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:36.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 -- 172.21.15.62:0/65976398 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f485c00e830 con 0x7f48440049f0 2021-12-17T18:26:36.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 -- 172.21.15.62:0/65976398 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c00e990 con 0x7f48440049f0 2021-12-17T18:26:36.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.746+0000 7f4861ffb700 1 -- 172.21.15.62:0/65976398 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f485c00ecf0 con 0x7f48440049f0 2021-12-17T18:26:36.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.750+0000 7f486973d700 1 -- 172.21.15.62:0/65976398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48440049f0 msgr2=0x7f4844004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.750+0000 7f486973d700 1 --2- 172.21.15.62:0/65976398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48440049f0 0x7f4844004e70 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f485c00c000 tx=0x7f485c006df0).stop 2021-12-17T18:26:36.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.750+0000 7f48637fe700 1 -- 172.21.15.62:0/65976398 reap_dead start 2021-12-17T18:26:36.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.750+0000 7f486973d700 1 -- 172.21.15.62:0/65976398 shutdown_connections 2021-12-17T18:26:36.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.750+0000 7f486973d700 1 -- 172.21.15.62:0/65976398 >> 172.21.15.62:0/65976398 conn(0x7f486405c960 msgr2=0x7f486405cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:36.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.750+0000 7f486973d700 1 -- 172.21.15.62:0/65976398 shutdown_connections 2021-12-17T18:26:36.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.750+0000 7f486973d700 1 -- 172.21.15.62:0/65976398 wait complete. 2021-12-17T18:26:36.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.750+0000 7f486973d700 1 Processor -- start 2021-12-17T18:26:36.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.750+0000 7f486973d700 1 -- start start 2021-12-17T18:26:36.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.750+0000 7f486973d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4864066430 0x7f4864143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.750+0000 7f486973d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4864064070 0x7f48640644d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.750+0000 7f486973d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48640649c0 0x7f486413ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.750+0000 7f486973d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48640ae970 con 0x7f4864066430 2021-12-17T18:26:36.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.750+0000 7f486973d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4864143f80 con 0x7f4864064070 2021-12-17T18:26:36.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.750+0000 7f486973d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4864066810 con 0x7f48640649c0 2021-12-17T18:26:36.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.750+0000 7f4862ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4864066430 0x7f4864143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.754+0000 7f4862ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4864066430 0x7f4864143030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55102/0 (socket says 172.21.15.62:55102) 2021-12-17T18:26:36.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.754+0000 7f4862ffd700 1 -- 172.21.15.62:0/4154147803 learned_addr learned my addr 172.21.15.62:0/4154147803 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.754+0000 7f48637fe700 1 --2- 172.21.15.62:0/4154147803 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48640649c0 0x7f486413ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.754+0000 7f48627fc700 1 --2- 172.21.15.62:0/4154147803 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4864064070 0x7f48640644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.754+0000 7f4862ffd700 1 -- 172.21.15.62:0/4154147803 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48640649c0 msgr2=0x7f486413ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.754+0000 7f4862ffd700 1 --2- 172.21.15.62:0/4154147803 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48640649c0 0x7f486413ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.754+0000 7f4862ffd700 1 -- 172.21.15.62:0/4154147803 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4864064070 msgr2=0x7f48640644d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.754+0000 7f4862ffd700 1 --2- 172.21.15.62:0/4154147803 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4864064070 0x7f48640644d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.754+0000 7f4862ffd700 1 -- 172.21.15.62:0/4154147803 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48640aeba0 con 0x7f4864066430 2021-12-17T18:26:36.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.754+0000 7f4862ffd700 1 --2- 172.21.15.62:0/4154147803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4864066430 0x7f4864143030 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f48540012d0 tx=0x7f4854009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:36.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.754+0000 7f485bfff700 1 -- 172.21.15.62:0/4154147803 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48540032c0 con 0x7f4864066430 2021-12-17T18:26:36.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.754+0000 7f485bfff700 1 -- 172.21.15.62:0/4154147803 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4854010040 con 0x7f4864066430 2021-12-17T18:26:36.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.754+0000 7f485bfff700 1 -- 172.21.15.62:0/4154147803 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48540018f0 con 0x7f4864066430 2021-12-17T18:26:36.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.754+0000 7f486973d700 1 -- 172.21.15.62:0/4154147803 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48640aee40 con 0x7f4864066430 2021-12-17T18:26:36.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.754+0000 7f486973d700 1 -- 172.21.15.62:0/4154147803 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4864064e50 con 0x7f4864066430 2021-12-17T18:26:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.754+0000 7f486973d700 1 -- 172.21.15.62:0/4154147803 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48640b2b00 con 0x7f4864066430 2021-12-17T18:26:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.758+0000 7f485bfff700 1 -- 172.21.15.62:0/4154147803 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4854001a50 con 0x7f4864066430 2021-12-17T18:26:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.758+0000 7f485bfff700 1 --2- 172.21.15.62:0/4154147803 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4848053640 0x7f4848055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.758+0000 7f485bfff700 1 -- 172.21.15.62:0/4154147803 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f485406b820 con 0x7f4864066430 2021-12-17T18:26:36.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.758+0000 7f48627fc700 1 --2- 172.21.15.62:0/4154147803 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4848053640 0x7f4848055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.758+0000 7f48627fc700 1 --2- 172.21.15.62:0/4154147803 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4848053640 0x7f4848055b00 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f484c005000 tx=0x7f48640ae880).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:36.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.762+0000 7f485bfff700 1 -- 172.21.15.62:0/4154147803 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4854042870 con 0x7f4864066430 2021-12-17T18:26:36.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.926+0000 7f486973d700 1 -- 172.21.15.62:0/4154147803 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f48640573d0 con 0x7f4864066430 2021-12-17T18:26:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.934+0000 7f485bfff700 1 -- 172.21.15.62:0/4154147803 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v36) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4854045e90 con 0x7f4864066430 2021-12-17T18:26:36.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.934+0000 7f486973d700 1 -- 172.21.15.62:0/4154147803 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4848053640 msgr2=0x7f4848055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.934+0000 7f486973d700 1 --2- 172.21.15.62:0/4154147803 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4848053640 0x7f4848055b00 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f484c005000 tx=0x7f48640ae880).stop 2021-12-17T18:26:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.934+0000 7f486973d700 1 -- 172.21.15.62:0/4154147803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4864066430 msgr2=0x7f4864143030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.934+0000 7f486973d700 1 --2- 172.21.15.62:0/4154147803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4864066430 0x7f4864143030 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f48540012d0 tx=0x7f4854009040).stop 2021-12-17T18:26:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.934+0000 7f486973d700 1 -- 172.21.15.62:0/4154147803 shutdown_connections 2021-12-17T18:26:36.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.934+0000 7f486973d700 1 --2- 172.21.15.62:0/4154147803 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4848053640 0x7f4848055b00 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.934+0000 7f486973d700 1 --2- 172.21.15.62:0/4154147803 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48640649c0 0x7f486413ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.934+0000 7f486973d700 1 --2- 172.21.15.62:0/4154147803 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4864064070 0x7f48640644d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.934+0000 7f486973d700 1 --2- 172.21.15.62:0/4154147803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4864066430 0x7f4864143030 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.934+0000 7f486973d700 1 -- 172.21.15.62:0/4154147803 >> 172.21.15.62:0/4154147803 conn(0x7f486405c960 msgr2=0x7f4864066c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:36.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.934+0000 7f486973d700 1 -- 172.21.15.62:0/4154147803 shutdown_connections 2021-12-17T18:26:36.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:36.934+0000 7f486973d700 1 -- 172.21.15.62:0/4154147803 wait complete. 2021-12-17T18:26:36.948 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.0 2021-12-17T18:26:36.960 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:26:37.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.066+0000 7fcc87fff700 1 Processor -- start 2021-12-17T18:26:37.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.066+0000 7fcc87fff700 1 -- start start 2021-12-17T18:26:37.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.066+0000 7fcc87fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fcc8805ca90 0x7fcc880b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:37.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.066+0000 7fcc87fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8805ce70 con 0x7fcc880b34b0 2021-12-17T18:26:37.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.066+0000 7fcc87fff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc880b2d70 con 0x7fcc880604b0 2021-12-17T18:26:37.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.066+0000 7fcc87fff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc880b3010 con 0x7fcc8805ca90 2021-12-17T18:26:37.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.066+0000 7fcc867fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcc880b34b0 0x7fcc88145b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38688/0 (socket says 172.21.15.62:38688) 2021-12-17T18:26:37.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.066+0000 7fcc867fc700 1 -- 172.21.15.62:0/1753650462 learned_addr learned my addr 172.21.15.62:0/1753650462 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:37.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.066+0000 7fcc86ffd700 1 --2- 172.21.15.62:0/1753650462 >> v2:172.21.15.109:3300/0 conn(0x7fcc8805ca90 0x7fcc880b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:37.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc85ffb700 1 -- 172.21.15.62:0/1753650462 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673261419 0 0) 0x7fcc8805ce70 con 0x7fcc880b34b0 2021-12-17T18:26:37.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc85ffb700 1 -- 172.21.15.62:0/1753650462 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc6c003260 con 0x7fcc880b34b0 2021-12-17T18:26:37.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc86ffd700 1 -- 172.21.15.62:0/1753650462 >> v1:172.21.15.109:6789/0 conn(0x7fcc880604b0 legacy=0x7fcc880b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc86ffd700 1 -- 172.21.15.62:0/1753650462 >> v1:172.21.15.62:6789/0 conn(0x7fcc880b34b0 legacy=0x7fcc88145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc86ffd700 1 -- 172.21.15.62:0/1753650462 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc880b2ab0 con 0x7fcc8805ca90 2021-12-17T18:26:37.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc86ffd700 1 --2- 172.21.15.62:0/1753650462 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc8805ca90 0x7fcc880b2470 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fcc78002f70 tx=0x7fcc78006df0).ready entity=mon.1 client_cookie=eb6f1e3e6a9c7d33 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:37.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc85ffb700 1 -- 172.21.15.62:0/1753650462 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc7800d610 con 0x7fcc8805ca90 2021-12-17T18:26:37.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc85ffb700 1 -- 172.21.15.62:0/1753650462 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc78000e90 con 0x7fcc8805ca90 2021-12-17T18:26:37.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc85ffb700 1 -- 172.21.15.62:0/1753650462 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc7800d960 con 0x7fcc8805ca90 2021-12-17T18:26:37.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc87fff700 1 -- 172.21.15.62:0/1753650462 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc8805ca90 msgr2=0x7fcc880b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc87fff700 1 --2- 172.21.15.62:0/1753650462 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc8805ca90 0x7fcc880b2470 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fcc78002f70 tx=0x7fcc78006df0).stop 2021-12-17T18:26:37.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc87fff700 1 -- 172.21.15.62:0/1753650462 shutdown_connections 2021-12-17T18:26:37.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc87fff700 1 --2- 172.21.15.62:0/1753650462 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc8805ca90 0x7fcc880b2470 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc87fff700 1 -- 172.21.15.62:0/1753650462 >> 172.21.15.62:0/1753650462 conn(0x7fcc8805bcd0 msgr2=0x7fcc88062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:37.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc87fff700 1 -- 172.21.15.62:0/1753650462 shutdown_connections 2021-12-17T18:26:37.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc87fff700 1 -- 172.21.15.62:0/1753650462 wait complete. 2021-12-17T18:26:37.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc87fff700 1 Processor -- start 2021-12-17T18:26:37.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.070+0000 7fcc87fff700 1 -- start start 2021-12-17T18:26:37.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc87fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc8805ca90 0x7fcc880a3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:37.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc87fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc880604b0 0x7fcc880a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:37.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc87fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc880b34b0 0x7fcc881419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:37.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc87fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc88066560 con 0x7fcc8805ca90 2021-12-17T18:26:37.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc87fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc880a3e10 con 0x7fcc880604b0 2021-12-17T18:26:37.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc87fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc88066ae0 con 0x7fcc880b34b0 2021-12-17T18:26:37.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc86ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc8805ca90 0x7fcc880a3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:37.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc86ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc8805ca90 0x7fcc880a3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55114/0 (socket says 172.21.15.62:55114) 2021-12-17T18:26:37.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc86ffd700 1 -- 172.21.15.62:0/3915607747 learned_addr learned my addr 172.21.15.62:0/3915607747 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:37.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc867fc700 1 --2- 172.21.15.62:0/3915607747 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc880604b0 0x7fcc880a6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:37.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc877fe700 1 --2- 172.21.15.62:0/3915607747 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc880b34b0 0x7fcc881419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:37.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc86ffd700 1 -- 172.21.15.62:0/3915607747 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc880b34b0 msgr2=0x7fcc881419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc86ffd700 1 --2- 172.21.15.62:0/3915607747 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc880b34b0 0x7fcc881419f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc86ffd700 1 -- 172.21.15.62:0/3915607747 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc880604b0 msgr2=0x7fcc880a6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc86ffd700 1 --2- 172.21.15.62:0/3915607747 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc880604b0 0x7fcc880a6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc86ffd700 1 -- 172.21.15.62:0/3915607747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7800b180 con 0x7fcc8805ca90 2021-12-17T18:26:37.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc86ffd700 1 --2- 172.21.15.62:0/3915607747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc8805ca90 0x7fcc880a3590 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7fcc78002f70 tx=0x7fcc78014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:37.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc77fff700 1 -- 172.21.15.62:0/3915607747 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc78016070 con 0x7fcc8805ca90 2021-12-17T18:26:37.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc77fff700 1 -- 172.21.15.62:0/3915607747 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7800de90 con 0x7fcc8805ca90 2021-12-17T18:26:37.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc77fff700 1 -- 172.21.15.62:0/3915607747 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc78013da0 con 0x7fcc8805ca90 2021-12-17T18:26:37.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc87fff700 1 -- 172.21.15.62:0/3915607747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc88066e70 con 0x7fcc8805ca90 2021-12-17T18:26:37.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc87fff700 1 -- 172.21.15.62:0/3915607747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc880b8f70 con 0x7fcc8805ca90 2021-12-17T18:26:37.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc87fff700 1 -- 172.21.15.62:0/3915607747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc880666d0 con 0x7fcc8805ca90 2021-12-17T18:26:37.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.074+0000 7fcc77fff700 1 -- 172.21.15.62:0/3915607747 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcc78024030 con 0x7fcc8805ca90 2021-12-17T18:26:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.078+0000 7fcc77fff700 1 --2- 172.21.15.62:0/3915607747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcc64053610 0x7fcc64055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.078+0000 7fcc77fff700 1 -- 172.21.15.62:0/3915607747 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcc7806c680 con 0x7fcc8805ca90 2021-12-17T18:26:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.078+0000 7fcc867fc700 1 --2- 172.21.15.62:0/3915607747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcc64053610 0x7fcc64055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.078+0000 7fcc867fc700 1 --2- 172.21.15.62:0/3915607747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcc64053610 0x7fcc64055ad0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fcc7c00d000 tx=0x7fcc7c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.082+0000 7fcc77fff700 1 -- 172.21.15.62:0/3915607747 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcc78043760 con 0x7fcc8805ca90 2021-12-17T18:26:37.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.250+0000 7fcc87fff700 1 -- 172.21.15.62:0/3915607747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fcc880b4500 con 0x7fcc8805ca90 2021-12-17T18:26:37.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.258+0000 7fcc77fff700 1 -- 172.21.15.62:0/3915607747 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v37) v1 ==== 184+0+0 (secure 0 0 0) 0x7fcc78022020 con 0x7fcc8805ca90 2021-12-17T18:26:37.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.258+0000 7fcc87fff700 1 -- 172.21.15.62:0/3915607747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcc64053610 msgr2=0x7fcc64055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.258+0000 7fcc87fff700 1 --2- 172.21.15.62:0/3915607747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcc64053610 0x7fcc64055ad0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fcc7c00d000 tx=0x7fcc7c009040).stop 2021-12-17T18:26:37.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.258+0000 7fcc87fff700 1 -- 172.21.15.62:0/3915607747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc8805ca90 msgr2=0x7fcc880a3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.258+0000 7fcc87fff700 1 --2- 172.21.15.62:0/3915607747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc8805ca90 0x7fcc880a3590 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7fcc78002f70 tx=0x7fcc78014000).stop 2021-12-17T18:26:37.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.258+0000 7fcc87fff700 1 -- 172.21.15.62:0/3915607747 shutdown_connections 2021-12-17T18:26:37.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.262+0000 7fcc87fff700 1 --2- 172.21.15.62:0/3915607747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcc64053610 0x7fcc64055ad0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.262+0000 7fcc87fff700 1 --2- 172.21.15.62:0/3915607747 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc880b34b0 0x7fcc881419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.262+0000 7fcc87fff700 1 --2- 172.21.15.62:0/3915607747 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc880604b0 0x7fcc880a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.262+0000 7fcc87fff700 1 --2- 172.21.15.62:0/3915607747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc8805ca90 0x7fcc880a3590 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.262+0000 7fcc87fff700 1 -- 172.21.15.62:0/3915607747 >> 172.21.15.62:0/3915607747 conn(0x7fcc8805bcd0 msgr2=0x7fcc880b9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:37.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.262+0000 7fcc87fff700 1 -- 172.21.15.62:0/3915607747 shutdown_connections 2021-12-17T18:26:37.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.262+0000 7fcc87fff700 1 -- 172.21.15.62:0/3915607747 wait complete. 2021-12-17T18:26:37.272 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.1 2021-12-17T18:26:37.283 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:26:37.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feece6fb700 1 Processor -- start 2021-12-17T18:26:37.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feece6fb700 1 -- start start 2021-12-17T18:26:37.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feece6fb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feec80b4340 0x7feec81471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:37.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feece6fb700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7feec8142d70 0x7feec80b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:37.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feece6fb700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec80b09e0 con 0x7feec80b51a0 2021-12-17T18:26:37.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feece6fb700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec81467d0 con 0x7feec8142d70 2021-12-17T18:26:37.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feece6fb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec8146a70 con 0x7feec80b4340 2021-12-17T18:26:37.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feec7fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feec80b4340 0x7feec81471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:37.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feec77fe700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7feec80b51a0 0x7feec8142660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:55024/0 (socket says 172.21.15.62:55024) 2021-12-17T18:26:37.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feec77fe700 1 -- 172.21.15.62:0/222559844 learned_addr learned my addr 172.21.15.62:0/222559844 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:37.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feeccc98700 1 --2- 172.21.15.62:0/222559844 >> v2:172.21.15.109:3300/0 conn(0x7feec8142d70 0x7feec80b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:37.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feeccc98700 1 -- 172.21.15.62:0/222559844 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feec80b4340 msgr2=0x7feec81471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:37.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feeccc98700 1 --2- 172.21.15.62:0/222559844 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feec80b4340 0x7feec81471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feeccc98700 1 -- 172.21.15.62:0/222559844 >> v1:172.21.15.109:6789/0 conn(0x7feec80b51a0 legacy=0x7feec8142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feeccc98700 1 -- 172.21.15.62:0/222559844 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8146d10 con 0x7feec8142d70 2021-12-17T18:26:37.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feeccc98700 1 --2- 172.21.15.62:0/222559844 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feec8142d70 0x7feec80b28f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7feec80b1610 tx=0x7feec0006df0).ready entity=mon.1 client_cookie=78002392c2418d2 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:37.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feec6ffd700 1 -- 172.21.15.62:0/222559844 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feec000d570 con 0x7feec8142d70 2021-12-17T18:26:37.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feec6ffd700 1 -- 172.21.15.62:0/222559844 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec0000e90 con 0x7feec8142d70 2021-12-17T18:26:37.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.390+0000 7feec6ffd700 1 -- 172.21.15.62:0/222559844 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feec000d8c0 con 0x7feec8142d70 2021-12-17T18:26:37.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.394+0000 7feece6fb700 1 -- 172.21.15.62:0/222559844 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feec8142d70 msgr2=0x7feec80b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.394+0000 7feece6fb700 1 --2- 172.21.15.62:0/222559844 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feec8142d70 0x7feec80b28f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7feec80b1610 tx=0x7feec0006df0).stop 2021-12-17T18:26:37.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.394+0000 7feece6fb700 1 -- 172.21.15.62:0/222559844 shutdown_connections 2021-12-17T18:26:37.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.394+0000 7feece6fb700 1 --2- 172.21.15.62:0/222559844 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feec8142d70 0x7feec80b28f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.394+0000 7feece6fb700 1 --2- 172.21.15.62:0/222559844 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feec80b4340 0x7feec81471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.394+0000 7feece6fb700 1 -- 172.21.15.62:0/222559844 >> 172.21.15.62:0/222559844 conn(0x7feec805c750 msgr2=0x7feec805cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:37.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.394+0000 7feece6fb700 1 -- 172.21.15.62:0/222559844 shutdown_connections 2021-12-17T18:26:37.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.394+0000 7feece6fb700 1 -- 172.21.15.62:0/222559844 wait complete. 2021-12-17T18:26:37.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.394+0000 7feece6fb700 1 Processor -- start 2021-12-17T18:26:37.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.394+0000 7feece6fb700 1 -- start start 2021-12-17T18:26:37.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feece6fb700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feec80b4340 0x7feec8141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:37.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feece6fb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec80b51a0 0x7feec8155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:37.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feece6fb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feec8142d70 0x7feec8155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:37.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feece6fb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec81556c0 con 0x7feec80b51a0 2021-12-17T18:26:37.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feece6fb700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec81490b0 con 0x7feec80b4340 2021-12-17T18:26:37.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feece6fb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec8149350 con 0x7feec8142d70 2021-12-17T18:26:37.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feec77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec80b51a0 0x7feec8155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:37.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feec7fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feec80b4340 0x7feec8141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:37.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feec77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec80b51a0 0x7feec8155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55130/0 (socket says 172.21.15.62:55130) 2021-12-17T18:26:37.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feec77fe700 1 -- 172.21.15.62:0/107717611 learned_addr learned my addr 172.21.15.62:0/107717611 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:37.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feec7fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feec80b4340 0x7feec8141220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:33446/0 (socket says 172.21.15.62:33446) 2021-12-17T18:26:37.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feeccc98700 1 --2- 172.21.15.62:0/107717611 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feec8142d70 0x7feec8155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:37.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feec77fe700 1 -- 172.21.15.62:0/107717611 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feec8142d70 msgr2=0x7feec8155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feec77fe700 1 --2- 172.21.15.62:0/107717611 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feec8142d70 0x7feec8155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feec77fe700 1 -- 172.21.15.62:0/107717611 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feec80b4340 msgr2=0x7feec8141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feec77fe700 1 --2- 172.21.15.62:0/107717611 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feec80b4340 0x7feec8141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feec77fe700 1 -- 172.21.15.62:0/107717611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec000b180 con 0x7feec80b51a0 2021-12-17T18:26:37.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feec7fff700 1 --2- 172.21.15.62:0/107717611 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feec80b4340 0x7feec8141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:37.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feeccc98700 1 --2- 172.21.15.62:0/107717611 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feec8142d70 0x7feec8155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:37.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feec77fe700 1 --2- 172.21.15.62:0/107717611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec80b51a0 0x7feec8155ab0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7feec80622d0 tx=0x7feebc00c890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:37.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feec57fa700 1 -- 172.21.15.62:0/107717611 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feebc005ba0 con 0x7feec80b51a0 2021-12-17T18:26:37.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feec57fa700 1 -- 172.21.15.62:0/107717611 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feebc005d00 con 0x7feec80b51a0 2021-12-17T18:26:37.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feece6fb700 1 -- 172.21.15.62:0/107717611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec81495f0 con 0x7feec80b51a0 2021-12-17T18:26:37.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feec57fa700 1 -- 172.21.15.62:0/107717611 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feebc0072c0 con 0x7feec80b51a0 2021-12-17T18:26:37.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feece6fb700 1 -- 172.21.15.62:0/107717611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec8063ec0 con 0x7feec80b51a0 2021-12-17T18:26:37.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.398+0000 7feece6fb700 1 -- 172.21.15.62:0/107717611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec81477d0 con 0x7feec80b51a0 2021-12-17T18:26:37.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.402+0000 7feec57fa700 1 -- 172.21.15.62:0/107717611 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feebc010070 con 0x7feec80b51a0 2021-12-17T18:26:37.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.402+0000 7feec57fa700 1 --2- 172.21.15.62:0/107717611 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feea80536a0 0x7feea8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:37.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.402+0000 7feec57fa700 1 -- 172.21.15.62:0/107717611 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feebc06b2c0 con 0x7feec80b51a0 2021-12-17T18:26:37.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.402+0000 7feec7fff700 1 --2- 172.21.15.62:0/107717611 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feea80536a0 0x7feea8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:37.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.402+0000 7feec7fff700 1 --2- 172.21.15.62:0/107717611 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feea80536a0 0x7feea8055b60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7feeb800b000 tx=0x7feeb8006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:37.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.410+0000 7feec57fa700 1 -- 172.21.15.62:0/107717611 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feebc042380 con 0x7feec80b51a0 2021-12-17T18:26:37.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.578+0000 7feece6fb700 1 -- 172.21.15.62:0/107717611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7feec80b4720 con 0x7feec80b51a0 2021-12-17T18:26:37.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.586+0000 7feec57fa700 1 -- 172.21.15.62:0/107717611 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v38) v1 ==== 184+0+0 (secure 0 0 0) 0x7feebc0459a0 con 0x7feec80b51a0 2021-12-17T18:26:37.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.586+0000 7feece6fb700 1 -- 172.21.15.62:0/107717611 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feea80536a0 msgr2=0x7feea8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.586+0000 7feece6fb700 1 --2- 172.21.15.62:0/107717611 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feea80536a0 0x7feea8055b60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7feeb800b000 tx=0x7feeb8006df0).stop 2021-12-17T18:26:37.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.586+0000 7feece6fb700 1 -- 172.21.15.62:0/107717611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec80b51a0 msgr2=0x7feec8155ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.586+0000 7feece6fb700 1 --2- 172.21.15.62:0/107717611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec80b51a0 0x7feec8155ab0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7feec80622d0 tx=0x7feebc00c890).stop 2021-12-17T18:26:37.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.586+0000 7feece6fb700 1 -- 172.21.15.62:0/107717611 shutdown_connections 2021-12-17T18:26:37.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.586+0000 7feece6fb700 1 --2- 172.21.15.62:0/107717611 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feea80536a0 0x7feea8055b60 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.586+0000 7feece6fb700 1 --2- 172.21.15.62:0/107717611 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feec8142d70 0x7feec8155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.586+0000 7feece6fb700 1 --2- 172.21.15.62:0/107717611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec80b51a0 0x7feec8155ab0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.586+0000 7feece6fb700 1 --2- 172.21.15.62:0/107717611 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feec80b4340 0x7feec8141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.586+0000 7feece6fb700 1 -- 172.21.15.62:0/107717611 >> 172.21.15.62:0/107717611 conn(0x7feec805c750 msgr2=0x7feec805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:37.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.586+0000 7feece6fb700 1 -- 172.21.15.62:0/107717611 shutdown_connections 2021-12-17T18:26:37.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.586+0000 7feece6fb700 1 -- 172.21.15.62:0/107717611 wait complete. 2021-12-17T18:26:37.599 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.2 2021-12-17T18:26:37.608 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:26:37.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd95f4700 1 Processor -- start 2021-12-17T18:26:37.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd95f4700 1 -- start start 2021-12-17T18:26:37.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd95f4700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1cd40b21f0 0x7f1cd414aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:37.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd95f4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1cd40b1730 0x7f1cd40ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:37.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd95f4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd40b2ce0 con 0x7f1cd40a7bb0 2021-12-17T18:26:37.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd95f4700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd4147870 con 0x7f1cd40b21f0 2021-12-17T18:26:37.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd95f4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40b2f10 con 0x7f1cd40b1730 2021-12-17T18:26:37.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd37fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1cd40a7bb0 0x7f1cd4067120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38718/0 (socket says 172.21.15.62:38718) 2021-12-17T18:26:37.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd37fe700 1 -- 172.21.15.62:0/1193818604 learned_addr learned my addr 172.21.15.62:0/1193818604 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:37.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd2ffd700 1 --2- 172.21.15.62:0/1193818604 >> v2:172.21.15.109:3300/0 conn(0x7f1cd40b21f0 0x7f1cd414aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:37.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd27fc700 1 --2- 172.21.15.62:0/1193818604 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1cd40b1730 0x7f1cd40ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:37.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd1ffb700 1 -- 172.21.15.62:0/1193818604 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848758149 0 0) 0x7f1cd40b2ce0 con 0x7f1cd40a7bb0 2021-12-17T18:26:37.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd1ffb700 1 -- 172.21.15.62:0/1193818604 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cb4003260 con 0x7f1cd40a7bb0 2021-12-17T18:26:37.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd2ffd700 1 -- 172.21.15.62:0/1193818604 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1cd40b1730 msgr2=0x7f1cd40ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:37.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd2ffd700 1 --2- 172.21.15.62:0/1193818604 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1cd40b1730 0x7f1cd40ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd2ffd700 1 -- 172.21.15.62:0/1193818604 >> v1:172.21.15.62:6789/0 conn(0x7f1cd40a7bb0 legacy=0x7f1cd4067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd2ffd700 1 -- 172.21.15.62:0/1193818604 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd40aca60 con 0x7f1cd40b21f0 2021-12-17T18:26:37.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd2ffd700 1 --2- 172.21.15.62:0/1193818604 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cd40b21f0 0x7f1cd414aea0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f1cc40032f0 tx=0x7f1cc40091d0).ready entity=mon.1 client_cookie=3d8644a4fdf1091a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:37.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd1ffb700 1 -- 172.21.15.62:0/1193818604 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cc400b600 con 0x7f1cd40b21f0 2021-12-17T18:26:37.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd1ffb700 1 -- 172.21.15.62:0/1193818604 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc400b760 con 0x7f1cd40b21f0 2021-12-17T18:26:37.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd1ffb700 1 -- 172.21.15.62:0/1193818604 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cc400b8d0 con 0x7f1cd40b21f0 2021-12-17T18:26:37.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd95f4700 1 -- 172.21.15.62:0/1193818604 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cd40b21f0 msgr2=0x7f1cd414aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd95f4700 1 --2- 172.21.15.62:0/1193818604 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cd40b21f0 0x7f1cd414aea0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f1cc40032f0 tx=0x7f1cc40091d0).stop 2021-12-17T18:26:37.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd95f4700 1 -- 172.21.15.62:0/1193818604 shutdown_connections 2021-12-17T18:26:37.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd95f4700 1 --2- 172.21.15.62:0/1193818604 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1cd40b1730 0x7f1cd40ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd95f4700 1 --2- 172.21.15.62:0/1193818604 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cd40b21f0 0x7f1cd414aea0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd95f4700 1 -- 172.21.15.62:0/1193818604 >> 172.21.15.62:0/1193818604 conn(0x7f1cd405f730 msgr2=0x7f1cd405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:37.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd95f4700 1 -- 172.21.15.62:0/1193818604 shutdown_connections 2021-12-17T18:26:37.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.706+0000 7f1cd95f4700 1 -- 172.21.15.62:0/1193818604 wait complete. 2021-12-17T18:26:37.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd95f4700 1 Processor -- start 2021-12-17T18:26:37.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd95f4700 1 -- start start 2021-12-17T18:26:37.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd95f4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cd40a7bb0 0x7f1cd40aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:37.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd95f4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cd40b1730 0x7f1cd4156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:37.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd95f4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1cd40b21f0 0x7f1cd4064090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:37.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd95f4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd414d050 con 0x7f1cd40a7bb0 2021-12-17T18:26:37.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd95f4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd414cdb0 con 0x7f1cd40b1730 2021-12-17T18:26:37.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd95f4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd4063bf0 con 0x7f1cd40b21f0 2021-12-17T18:26:37.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cd40a7bb0 0x7f1cd40aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:37.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cd40a7bb0 0x7f1cd40aaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55142/0 (socket says 172.21.15.62:55142) 2021-12-17T18:26:37.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd2ffd700 1 -- 172.21.15.62:0/1760229027 learned_addr learned my addr 172.21.15.62:0/1760229027 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:37.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd27fc700 1 --2- 172.21.15.62:0/1760229027 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cd40b1730 0x7f1cd4156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:37.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd37fe700 1 --2- 172.21.15.62:0/1760229027 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1cd40b21f0 0x7f1cd4064090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:37.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd2ffd700 1 -- 172.21.15.62:0/1760229027 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1cd40b21f0 msgr2=0x7f1cd4064090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd2ffd700 1 --2- 172.21.15.62:0/1760229027 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1cd40b21f0 0x7f1cd4064090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd2ffd700 1 -- 172.21.15.62:0/1760229027 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cd40b1730 msgr2=0x7f1cd4156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd2ffd700 1 --2- 172.21.15.62:0/1760229027 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cd40b1730 0x7f1cd4156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd2ffd700 1 -- 172.21.15.62:0/1760229027 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc4009470 con 0x7f1cd40a7bb0 2021-12-17T18:26:37.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd27fc700 1 --2- 172.21.15.62:0/1760229027 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cd40b1730 0x7f1cd4156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:37.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd2ffd700 1 --2- 172.21.15.62:0/1760229027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cd40a7bb0 0x7f1cd40aaf40 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f1cc40032f0 tx=0x7f1cc4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:37.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1ccbfff700 1 -- 172.21.15.62:0/1760229027 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cc400b8d0 con 0x7f1cd40a7bb0 2021-12-17T18:26:37.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1ccbfff700 1 -- 172.21.15.62:0/1760229027 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc40107a0 con 0x7f1cd40a7bb0 2021-12-17T18:26:37.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd95f4700 1 -- 172.21.15.62:0/1760229027 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd414ca30 con 0x7f1cd40a7bb0 2021-12-17T18:26:37.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1ccbfff700 1 -- 172.21.15.62:0/1760229027 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cc400b600 con 0x7f1cd40a7bb0 2021-12-17T18:26:37.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd95f4700 1 -- 172.21.15.62:0/1760229027 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd414e8f0 con 0x7f1cd40a7bb0 2021-12-17T18:26:37.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.710+0000 7f1cd95f4700 1 -- 172.21.15.62:0/1760229027 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd40573d0 con 0x7f1cd40a7bb0 2021-12-17T18:26:37.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.714+0000 7f1ccbfff700 1 -- 172.21.15.62:0/1760229027 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1cc4027020 con 0x7f1cd40a7bb0 2021-12-17T18:26:37.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.714+0000 7f1ccbfff700 1 --2- 172.21.15.62:0/1760229027 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cb80536d0 0x7f1cb8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:37.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.714+0000 7f1ccbfff700 1 -- 172.21.15.62:0/1760229027 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1cc406cef0 con 0x7f1cd40a7bb0 2021-12-17T18:26:37.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.714+0000 7f1cd27fc700 1 --2- 172.21.15.62:0/1760229027 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cb80536d0 0x7f1cb8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:37.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.714+0000 7f1cd27fc700 1 --2- 172.21.15.62:0/1760229027 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cb80536d0 0x7f1cb8055b90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f1cbc00b000 tx=0x7f1cbc008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:37.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.718+0000 7f1ccbfff700 1 -- 172.21.15.62:0/1760229027 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1cc4044050 con 0x7f1cd40a7bb0 2021-12-17T18:26:37.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.886+0000 7f1cd95f4700 1 -- 172.21.15.62:0/1760229027 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cd40af860 con 0x7f1cd40a7bb0 2021-12-17T18:26:37.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.890+0000 7f1ccbfff700 1 -- 172.21.15.62:0/1760229027 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f1cc4015090 con 0x7f1cd40a7bb0 2021-12-17T18:26:37.896 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:37.897 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":55,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6650,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3745112309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3745112309},{"type":"v1","addr":"172.21.15.109:6835","nonce":3745112309}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":53}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:26:35.031189+0000","modified":"2021-12-17T18:26:36.033870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7704":{"gid":7704,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/2418178754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2418178754},{"type":"v1","addr":"172.21.15.62:6833","nonce":2418178754}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-12-17T18:26:37.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.890+0000 7f1cd95f4700 1 -- 172.21.15.62:0/1760229027 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cb80536d0 msgr2=0x7f1cb8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.890+0000 7f1cd95f4700 1 --2- 172.21.15.62:0/1760229027 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cb80536d0 0x7f1cb8055b90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f1cbc00b000 tx=0x7f1cbc008040).stop 2021-12-17T18:26:37.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.890+0000 7f1cd95f4700 1 -- 172.21.15.62:0/1760229027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cd40a7bb0 msgr2=0x7f1cd40aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:37.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.890+0000 7f1cd95f4700 1 --2- 172.21.15.62:0/1760229027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cd40a7bb0 0x7f1cd40aaf40 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f1cc40032f0 tx=0x7f1cc4016000).stop 2021-12-17T18:26:37.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.890+0000 7f1cd95f4700 1 -- 172.21.15.62:0/1760229027 shutdown_connections 2021-12-17T18:26:37.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.890+0000 7f1cd95f4700 1 --2- 172.21.15.62:0/1760229027 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cb80536d0 0x7f1cb8055b90 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.890+0000 7f1cd95f4700 1 --2- 172.21.15.62:0/1760229027 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1cd40b21f0 0x7f1cd4064090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.890+0000 7f1cd95f4700 1 --2- 172.21.15.62:0/1760229027 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1cd40b1730 0x7f1cd4156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.890+0000 7f1cd95f4700 1 --2- 172.21.15.62:0/1760229027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cd40a7bb0 0x7f1cd40aaf40 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.890+0000 7f1cd95f4700 1 -- 172.21.15.62:0/1760229027 >> 172.21.15.62:0/1760229027 conn(0x7f1cd405f730 msgr2=0x7f1cd40ad470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.890+0000 7f1cd95f4700 1 -- 172.21.15.62:0/1760229027 shutdown_connections 2021-12-17T18:26:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:37.890+0000 7f1cd95f4700 1 -- 172.21.15.62:0/1760229027 wait complete. 2021-12-17T18:26:37.902 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 55 2021-12-17T18:26:38.111 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:26:35.031189+0000', 'modified': '2021-12-17T18:26:36.033870+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7704}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7704': {'gid': 7704, 'name': 'a', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/2418178754', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 2418178754}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 2418178754}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:26:38.112 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:26:38.112 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:26:38.237 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":7704,"want_state":"up:active","state":"up:active","rank_uptime":3.192009353,"mdsmap_epoch":55,"osdmap_epoch":112,"osdmap_epoch_barrier":111,"uptime":7.334999346} 2021-12-17T18:26:38.238 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 7704, "mdsmap_epoch": 55, "osdmap_epoch": 112, "osdmap_epoch_barrier": 111, "rank_uptime": 3.192009353, "state": "up:active", "uptime": 7.334999346, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:26:38.239 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:26:38.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.334+0000 7f41d8b4c700 1 Processor -- start 2021-12-17T18:26:38.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.334+0000 7f41d8b4c700 1 -- start start 2021-12-17T18:26:38.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.334+0000 7f41d8b4c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f41d40b1730 0x7f41d40ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.334+0000 7f41d8b4c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f41d40a7bb0 0x7f41d4067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.334+0000 7f41d8b4c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d40b2ce0 con 0x7f41d40b21f0 2021-12-17T18:26:38.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.334+0000 7f41d8b4c700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d414b5b0 con 0x7f41d40b1730 2021-12-17T18:26:38.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.334+0000 7f41d8b4c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d4147870 con 0x7f41d40a7bb0 2021-12-17T18:26:38.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d259c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f41d40b21f0 0x7f41d414aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38730/0 (socket says 172.21.15.62:38730) 2021-12-17T18:26:38.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d259c700 1 -- 172.21.15.62:0/747796303 learned_addr learned my addr 172.21.15.62:0/747796303 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:38.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d1d9b700 1 --2- 172.21.15.62:0/747796303 >> v2:172.21.15.109:3300/0 conn(0x7f41d40b1730 0x7f41d40ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d2d9d700 1 --2- 172.21.15.62:0/747796303 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f41d40a7bb0 0x7f41d4067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d159a700 1 -- 172.21.15.62:0/747796303 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392751478 0 0) 0x7f41d40b2ce0 con 0x7f41d40b21f0 2021-12-17T18:26:38.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d159a700 1 -- 172.21.15.62:0/747796303 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41b8003260 con 0x7f41d40b21f0 2021-12-17T18:26:38.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d2d9d700 1 -- 172.21.15.62:0/747796303 >> v2:172.21.15.109:3300/0 conn(0x7f41d40b1730 msgr2=0x7f41d40ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:38.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d2d9d700 1 --2- 172.21.15.62:0/747796303 >> v2:172.21.15.109:3300/0 conn(0x7f41d40b1730 0x7f41d40ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d2d9d700 1 -- 172.21.15.62:0/747796303 >> v1:172.21.15.62:6789/0 conn(0x7f41d40b21f0 legacy=0x7f41d414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:38.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d2d9d700 1 -- 172.21.15.62:0/747796303 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d40aca60 con 0x7f41d40a7bb0 2021-12-17T18:26:38.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d1d9b700 1 --2- 172.21.15.62:0/747796303 >> v2:172.21.15.109:3300/0 conn(0x7f41d40b1730 0x7f41d40ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:38.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d2d9d700 1 --2- 172.21.15.62:0/747796303 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f41d40a7bb0 0x7f41d4067120 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f41cc002f70 tx=0x7f41cc006df0).ready entity=mon.2 client_cookie=2e3b0bac140b1670 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:38.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d159a700 1 -- 172.21.15.62:0/747796303 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41cc00d4a0 con 0x7f41d40a7bb0 2021-12-17T18:26:38.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d159a700 1 -- 172.21.15.62:0/747796303 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc000e90 con 0x7f41d40a7bb0 2021-12-17T18:26:38.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d159a700 1 -- 172.21.15.62:0/747796303 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41cc00d7f0 con 0x7f41d40a7bb0 2021-12-17T18:26:38.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d8b4c700 1 -- 172.21.15.62:0/747796303 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f41d40a7bb0 msgr2=0x7f41d4067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:38.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d8b4c700 1 --2- 172.21.15.62:0/747796303 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f41d40a7bb0 0x7f41d4067120 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f41cc002f70 tx=0x7f41cc006df0).stop 2021-12-17T18:26:38.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d8b4c700 1 -- 172.21.15.62:0/747796303 shutdown_connections 2021-12-17T18:26:38.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d8b4c700 1 --2- 172.21.15.62:0/747796303 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f41d40a7bb0 0x7f41d4067120 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d8b4c700 1 --2- 172.21.15.62:0/747796303 >> v2:172.21.15.109:3300/0 conn(0x7f41d40b1730 0x7f41d40ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d8b4c700 1 -- 172.21.15.62:0/747796303 >> 172.21.15.62:0/747796303 conn(0x7f41d405f730 msgr2=0x7f41d405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:38.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d8b4c700 1 -- 172.21.15.62:0/747796303 shutdown_connections 2021-12-17T18:26:38.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d8b4c700 1 -- 172.21.15.62:0/747796303 wait complete. 2021-12-17T18:26:38.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d8b4c700 1 Processor -- start 2021-12-17T18:26:38.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.338+0000 7f41d8b4c700 1 -- start start 2021-12-17T18:26:38.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d8b4c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f41d40a7bb0 0x7f41d40aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d8b4c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f41d40b1730 0x7f41d4063920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d8b4c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41d40b21f0 0x7f41d40a9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d8b4c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40ab5d0 con 0x7f41d40b21f0 2021-12-17T18:26:38.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d8b4c700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40631e0 con 0x7f41d40b1730 2021-12-17T18:26:38.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d8b4c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d4063480 con 0x7f41d40a7bb0 2021-12-17T18:26:38.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d2d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41d40b21f0 0x7f41d40a9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d2d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41d40b21f0 0x7f41d40a9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55160/0 (socket says 172.21.15.62:55160) 2021-12-17T18:26:38.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d2d9d700 1 -- 172.21.15.62:0/1951024273 learned_addr learned my addr 172.21.15.62:0/1951024273 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:38.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d1d9b700 1 --2- 172.21.15.62:0/1951024273 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f41d40b1730 0x7f41d4063920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d259c700 1 --2- 172.21.15.62:0/1951024273 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f41d40a7bb0 0x7f41d40aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d2d9d700 1 -- 172.21.15.62:0/1951024273 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f41d40a7bb0 msgr2=0x7f41d40aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:38.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d2d9d700 1 --2- 172.21.15.62:0/1951024273 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f41d40a7bb0 0x7f41d40aafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d2d9d700 1 -- 172.21.15.62:0/1951024273 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f41d40b1730 msgr2=0x7f41d4063920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:38.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d2d9d700 1 --2- 172.21.15.62:0/1951024273 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f41d40b1730 0x7f41d4063920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d2d9d700 1 -- 172.21.15.62:0/1951024273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c4009470 con 0x7f41d40b21f0 2021-12-17T18:26:38.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d1d9b700 1 --2- 172.21.15.62:0/1951024273 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f41d40b1730 0x7f41d4063920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:38.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d2d9d700 1 --2- 172.21.15.62:0/1951024273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41d40b21f0 0x7f41d40a9500 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f41cc002f70 tx=0x7f41cc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:38.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41c37fe700 1 -- 172.21.15.62:0/1951024273 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41cc012930 con 0x7f41d40b21f0 2021-12-17T18:26:38.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41c37fe700 1 -- 172.21.15.62:0/1951024273 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc012a90 con 0x7f41d40b21f0 2021-12-17T18:26:38.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d8b4c700 1 -- 172.21.15.62:0/1951024273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41cc00b180 con 0x7f41d40b21f0 2021-12-17T18:26:38.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41c37fe700 1 -- 172.21.15.62:0/1951024273 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41cc012df0 con 0x7f41d40b21f0 2021-12-17T18:26:38.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d8b4c700 1 -- 172.21.15.62:0/1951024273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d4066c60 con 0x7f41d40b21f0 2021-12-17T18:26:38.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.342+0000 7f41d8b4c700 1 -- 172.21.15.62:0/1951024273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d4063640 con 0x7f41d40b21f0 2021-12-17T18:26:38.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.346+0000 7f41c37fe700 1 -- 172.21.15.62:0/1951024273 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f41cc01c070 con 0x7f41d40b21f0 2021-12-17T18:26:38.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.346+0000 7f41c37fe700 1 --2- 172.21.15.62:0/1951024273 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41b00536a0 0x7f41b0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.346+0000 7f41c37fe700 1 -- 172.21.15.62:0/1951024273 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f41cc06c2d0 con 0x7f41d40b21f0 2021-12-17T18:26:38.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.346+0000 7f41d259c700 1 --2- 172.21.15.62:0/1951024273 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41b00536a0 0x7f41b0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.346+0000 7f41d259c700 1 --2- 172.21.15.62:0/1951024273 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41b00536a0 0x7f41b0055b60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f41c800d000 tx=0x7f41c8009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:38.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.350+0000 7f41c37fe700 1 -- 172.21.15.62:0/1951024273 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f41cc0434e0 con 0x7f41d40b21f0 2021-12-17T18:26:38.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.482+0000 7f41d8b4c700 1 -- 172.21.15.62:0/1951024273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41d40b2f10 con 0x7f41d40b21f0 2021-12-17T18:26:38.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.482+0000 7f41c37fe700 1 -- 172.21.15.62:0/1951024273 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f41cc019090 con 0x7f41d40b21f0 2021-12-17T18:26:38.491 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:38.491 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":112,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:26:36.034630+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:26:33.681609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-12-17T18:26:34.037077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:26:38.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.482+0000 7f41d8b4c700 1 -- 172.21.15.62:0/1951024273 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41b00536a0 msgr2=0x7f41b0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:38.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.482+0000 7f41d8b4c700 1 --2- 172.21.15.62:0/1951024273 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41b00536a0 0x7f41b0055b60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f41c800d000 tx=0x7f41c8009040).stop 2021-12-17T18:26:38.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.482+0000 7f41d8b4c700 1 -- 172.21.15.62:0/1951024273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41d40b21f0 msgr2=0x7f41d40a9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:38.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.482+0000 7f41d8b4c700 1 --2- 172.21.15.62:0/1951024273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41d40b21f0 0x7f41d40a9500 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f41cc002f70 tx=0x7f41cc014000).stop 2021-12-17T18:26:38.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.486+0000 7f41d8b4c700 1 -- 172.21.15.62:0/1951024273 shutdown_connections 2021-12-17T18:26:38.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.486+0000 7f41d8b4c700 1 --2- 172.21.15.62:0/1951024273 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41b00536a0 0x7f41b0055b60 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.486+0000 7f41d8b4c700 1 --2- 172.21.15.62:0/1951024273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41d40b21f0 0x7f41d40a9500 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.486+0000 7f41d8b4c700 1 --2- 172.21.15.62:0/1951024273 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f41d40b1730 0x7f41d4063920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.486+0000 7f41d8b4c700 1 --2- 172.21.15.62:0/1951024273 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f41d40a7bb0 0x7f41d40aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.486+0000 7f41d8b4c700 1 -- 172.21.15.62:0/1951024273 >> 172.21.15.62:0/1951024273 conn(0x7f41d405f730 msgr2=0x7f41d40ad5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.486+0000 7f41d8b4c700 1 -- 172.21.15.62:0/1951024273 shutdown_connections 2021-12-17T18:26:38.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.486+0000 7f41d8b4c700 1 -- 172.21.15.62:0/1951024273 wait complete. 2021-12-17T18:26:38.504 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:26:33.681609+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:26:34.037077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:26:38.505 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:26:38.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.606+0000 7fd36747d700 1 Processor -- start 2021-12-17T18:26:38.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.606+0000 7fd36747d700 1 -- start start 2021-12-17T18:26:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.606+0000 7fd36747d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd36005ca90 0x7fd36014abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.606+0000 7fd36747d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd3600b06b0 0x7fd3600ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.606+0000 7fd36747d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3600b2860 con 0x7fd3600604d0 2021-12-17T18:26:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.606+0000 7fd36747d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3601475c0 con 0x7fd3600b06b0 2021-12-17T18:26:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.606+0000 7fd36747d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36005fa40 con 0x7fd36005ca90 2021-12-17T18:26:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.606+0000 7fd365c7a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd3600b06b0 0x7fd3600ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd366c7c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd3600604d0 0x7fd3600ab5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38748/0 (socket says 172.21.15.62:38748) 2021-12-17T18:26:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd366c7c700 1 -- 172.21.15.62:0/1037237742 learned_addr learned my addr 172.21.15.62:0/1037237742 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd36647b700 1 --2- 172.21.15.62:0/1037237742 >> v2:172.21.15.109:3300/0 conn(0x7fd36005ca90 0x7fd36014abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd365479700 1 -- 172.21.15.62:0/1037237742 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044502046 0 0) 0x7fd3600b2860 con 0x7fd3600604d0 2021-12-17T18:26:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd365479700 1 -- 172.21.15.62:0/1037237742 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd34c003260 con 0x7fd3600604d0 2021-12-17T18:26:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd365c7a700 1 -- 172.21.15.62:0/1037237742 >> v2:172.21.15.109:3300/0 conn(0x7fd36005ca90 msgr2=0x7fd36014abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd365c7a700 1 --2- 172.21.15.62:0/1037237742 >> v2:172.21.15.109:3300/0 conn(0x7fd36005ca90 0x7fd36014abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd365c7a700 1 -- 172.21.15.62:0/1037237742 >> v1:172.21.15.62:6789/0 conn(0x7fd3600604d0 legacy=0x7fd3600ab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd365c7a700 1 -- 172.21.15.62:0/1037237742 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3600ac740 con 0x7fd3600b06b0 2021-12-17T18:26:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd365c7a700 1 --2- 172.21.15.62:0/1037237742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3600b06b0 0x7fd3600ace40 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7fd3540032f0 tx=0x7fd3540091d0).ready entity=mon.0 client_cookie=4a51335908c0b58e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd365479700 1 -- 172.21.15.62:0/1037237742 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd35400b600 con 0x7fd3600b06b0 2021-12-17T18:26:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd365479700 1 -- 172.21.15.62:0/1037237742 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35400b760 con 0x7fd3600b06b0 2021-12-17T18:26:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd365479700 1 -- 172.21.15.62:0/1037237742 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd35400b8d0 con 0x7fd3600b06b0 2021-12-17T18:26:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd36747d700 1 -- 172.21.15.62:0/1037237742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3600b06b0 msgr2=0x7fd3600ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd36747d700 1 --2- 172.21.15.62:0/1037237742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3600b06b0 0x7fd3600ace40 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7fd3540032f0 tx=0x7fd3540091d0).stop 2021-12-17T18:26:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd36747d700 1 -- 172.21.15.62:0/1037237742 shutdown_connections 2021-12-17T18:26:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd36747d700 1 --2- 172.21.15.62:0/1037237742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3600b06b0 0x7fd3600ace40 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd36747d700 1 --2- 172.21.15.62:0/1037237742 >> v2:172.21.15.109:3300/0 conn(0x7fd36005ca90 0x7fd36014abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd36747d700 1 -- 172.21.15.62:0/1037237742 >> 172.21.15.62:0/1037237742 conn(0x7fd36005c070 msgr2=0x7fd360062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd36747d700 1 -- 172.21.15.62:0/1037237742 shutdown_connections 2021-12-17T18:26:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd36747d700 1 -- 172.21.15.62:0/1037237742 wait complete. 2021-12-17T18:26:38.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd36747d700 1 Processor -- start 2021-12-17T18:26:38.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.610+0000 7fd36747d700 1 -- start start 2021-12-17T18:26:38.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd36747d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd36005ca90 0x7fd3600acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd36747d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd3600604d0 0x7fd3601431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd36747d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3600b06b0 0x7fd3601436a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd36747d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd360157570 con 0x7fd3600b06b0 2021-12-17T18:26:38.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd36747d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3601565b0 con 0x7fd36005ca90 2021-12-17T18:26:38.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd36747d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36014a5d0 con 0x7fd3600604d0 2021-12-17T18:26:38.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd366c7c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3600b06b0 0x7fd3601436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd36647b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd36005ca90 0x7fd3600acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd365c7a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd3600604d0 0x7fd3601431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd366c7c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3600b06b0 0x7fd3601436a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55174/0 (socket says 172.21.15.62:55174) 2021-12-17T18:26:38.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd366c7c700 1 -- 172.21.15.62:0/3750955181 learned_addr learned my addr 172.21.15.62:0/3750955181 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:38.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd366c7c700 1 -- 172.21.15.62:0/3750955181 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd3600604d0 msgr2=0x7fd3601431b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:38.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd366c7c700 1 --2- 172.21.15.62:0/3750955181 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd3600604d0 0x7fd3601431b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd366c7c700 1 -- 172.21.15.62:0/3750955181 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd36005ca90 msgr2=0x7fd3600acf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:38.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd366c7c700 1 --2- 172.21.15.62:0/3750955181 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd36005ca90 0x7fd3600acf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd366c7c700 1 -- 172.21.15.62:0/3750955181 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd354009470 con 0x7fd3600b06b0 2021-12-17T18:26:38.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd36647b700 1 --2- 172.21.15.62:0/3750955181 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd36005ca90 0x7fd3600acf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:38.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd366c7c700 1 --2- 172.21.15.62:0/3750955181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3600b06b0 0x7fd3601436a0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7fd358001110 tx=0x7fd358007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:38.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd35f7fe700 1 -- 172.21.15.62:0/3750955181 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3580070d0 con 0x7fd3600b06b0 2021-12-17T18:26:38.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd35f7fe700 1 -- 172.21.15.62:0/3750955181 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd358007230 con 0x7fd3600b06b0 2021-12-17T18:26:38.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd36747d700 1 -- 172.21.15.62:0/3750955181 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36014a870 con 0x7fd3600b06b0 2021-12-17T18:26:38.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd35f7fe700 1 -- 172.21.15.62:0/3750955181 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd358005610 con 0x7fd3600b06b0 2021-12-17T18:26:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd36747d700 1 -- 172.21.15.62:0/3750955181 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3600ad3f0 con 0x7fd3600b06b0 2021-12-17T18:26:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.614+0000 7fd36747d700 1 -- 172.21.15.62:0/3750955181 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36014ad10 con 0x7fd3600b06b0 2021-12-17T18:26:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.618+0000 7fd35f7fe700 1 -- 172.21.15.62:0/3750955181 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd35801a060 con 0x7fd3600b06b0 2021-12-17T18:26:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.618+0000 7fd35f7fe700 1 --2- 172.21.15.62:0/3750955181 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd340053610 0x7fd340055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.618+0000 7fd35f7fe700 1 -- 172.21.15.62:0/3750955181 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd35806b1f0 con 0x7fd3600b06b0 2021-12-17T18:26:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.618+0000 7fd36647b700 1 --2- 172.21.15.62:0/3750955181 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd340053610 0x7fd340055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.618+0000 7fd36647b700 1 --2- 172.21.15.62:0/3750955181 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd340053610 0x7fd340055ad0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fd35000b000 tx=0x7fd350006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.622+0000 7fd35f7fe700 1 -- 172.21.15.62:0/3750955181 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd36014ad10 con 0x7fd3600b06b0 2021-12-17T18:26:38.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.746+0000 7fd36747d700 1 -- 172.21.15.62:0/3750955181 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd36014ad10 con 0x7fd3600b06b0 2021-12-17T18:26:38.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.746+0000 7fd35f7fe700 1 -- 172.21.15.62:0/3750955181 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v112) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd36014ad10 con 0x7fd3600b06b0 2021-12-17T18:26:38.756 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:26:38.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.750+0000 7fd36747d700 1 -- 172.21.15.62:0/3750955181 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd340053610 msgr2=0x7fd340055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:38.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.750+0000 7fd36747d700 1 --2- 172.21.15.62:0/3750955181 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd340053610 0x7fd340055ad0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fd35000b000 tx=0x7fd350006df0).stop 2021-12-17T18:26:38.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.750+0000 7fd36747d700 1 -- 172.21.15.62:0/3750955181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3600b06b0 msgr2=0x7fd3601436a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:38.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.750+0000 7fd36747d700 1 --2- 172.21.15.62:0/3750955181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3600b06b0 0x7fd3601436a0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7fd358001110 tx=0x7fd358007a80).stop 2021-12-17T18:26:38.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.750+0000 7fd36747d700 1 -- 172.21.15.62:0/3750955181 shutdown_connections 2021-12-17T18:26:38.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.750+0000 7fd36747d700 1 --2- 172.21.15.62:0/3750955181 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd340053610 0x7fd340055ad0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.750+0000 7fd36747d700 1 --2- 172.21.15.62:0/3750955181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3600b06b0 0x7fd3601436a0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.750+0000 7fd36747d700 1 --2- 172.21.15.62:0/3750955181 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd3600604d0 0x7fd3601431b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.750+0000 7fd36747d700 1 --2- 172.21.15.62:0/3750955181 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd36005ca90 0x7fd3600acf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.750+0000 7fd36747d700 1 -- 172.21.15.62:0/3750955181 >> 172.21.15.62:0/3750955181 conn(0x7fd36005c070 msgr2=0x7fd3601459b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:38.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.750+0000 7fd36747d700 1 -- 172.21.15.62:0/3750955181 shutdown_connections 2021-12-17T18:26:38.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.750+0000 7fd36747d700 1 -- 172.21.15.62:0/3750955181 wait complete. 2021-12-17T18:26:38.769 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:26:38.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.878+0000 7f2b152a4700 1 Processor -- start 2021-12-17T18:26:38.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.878+0000 7f2b152a4700 1 -- start start 2021-12-17T18:26:38.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.878+0000 7f2b152a4700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f2b10060260 0x7f2b1005cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.878+0000 7f2b152a4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b10142ff0 con 0x7f2b10146f70 2021-12-17T18:26:38.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.878+0000 7f2b152a4700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b10143290 con 0x7f2b1005c750 2021-12-17T18:26:38.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.878+0000 7f2b152a4700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b101473e0 con 0x7f2b10060260 2021-12-17T18:26:38.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2b10146f70 0x7f2b100b4c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38762/0 (socket says 172.21.15.62:38762) 2021-12-17T18:26:38.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0f7fe700 1 -- 172.21.15.62:0/700773649 learned_addr learned my addr 172.21.15.62:0/700773649 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:38.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0e7fc700 1 --2- 172.21.15.62:0/700773649 >> v2:172.21.15.109:3300/0 conn(0x7f2b10060260 0x7f2b1005cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 -- 172.21.15.62:0/700773649 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845799204 0 0) 0x7f2b10142ff0 con 0x7f2b10146f70 2021-12-17T18:26:38.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 -- 172.21.15.62:0/700773649 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2af0003260 con 0x7f2b10146f70 2021-12-17T18:26:38.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 -- 172.21.15.62:0/700773649 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120003965 0 0) 0x7f2b10143290 con 0x7f2b1005c750 2021-12-17T18:26:38.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 -- 172.21.15.62:0/700773649 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b10142ff0 con 0x7f2b1005c750 2021-12-17T18:26:38.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 -- 172.21.15.62:0/700773649 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2503569479 0 0) 0x7f2af0003260 con 0x7f2b10146f70 2021-12-17T18:26:38.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 -- 172.21.15.62:0/700773649 >> v2:172.21.15.109:3300/0 conn(0x7f2b10060260 msgr2=0x7f2b1005cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:38.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 --2- 172.21.15.62:0/700773649 >> v2:172.21.15.109:3300/0 conn(0x7f2b10060260 0x7f2b1005cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 -- 172.21.15.62:0/700773649 >> v1:172.21.15.109:6789/0 conn(0x7f2b1005c750 legacy=0x7f2b101439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:38.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 -- 172.21.15.62:0/700773649 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b10143530 con 0x7f2b10146f70 2021-12-17T18:26:38.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 -- 172.21.15.62:0/700773649 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f2b080019e0 con 0x7f2b10146f70 2021-12-17T18:26:38.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 -- 172.21.15.62:0/700773649 >> v1:172.21.15.62:6789/0 conn(0x7f2b10146f70 legacy=0x7f2b100b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:38.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 --2- 172.21.15.62:0/700773649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2af00038e0 0x7f2af0003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 --2- 172.21.15.62:0/700773649 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2af0004500 0x7f2af0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.897 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 --2- 172.21.15.62:0/700773649 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2af0004e70 0x7f2af000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 -- 172.21.15.62:0/700773649 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b101473e0 con 0x7f2af00038e0 2021-12-17T18:26:38.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 -- 172.21.15.62:0/700773649 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af000bcf0 con 0x7f2af0004e70 2021-12-17T18:26:38.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 -- 172.21.15.62:0/700773649 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af000beb0 con 0x7f2af0004500 2021-12-17T18:26:38.898 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0effd700 1 --2- 172.21.15.62:0/700773649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2af00038e0 0x7f2af0003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0f7fe700 1 --2- 172.21.15.62:0/700773649 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2af0004e70 0x7f2af000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0e7fc700 1 --2- 172.21.15.62:0/700773649 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2af0004500 0x7f2af0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0effd700 1 -- 172.21.15.62:0/700773649 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2af0004500 msgr2=0x7f2af0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:38.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0effd700 1 --2- 172.21.15.62:0/700773649 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2af0004500 0x7f2af0004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0effd700 1 -- 172.21.15.62:0/700773649 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2af0004e70 msgr2=0x7f2af000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:38.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0effd700 1 --2- 172.21.15.62:0/700773649 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2af0004e70 0x7f2af000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0effd700 1 -- 172.21.15.62:0/700773649 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b10143530 con 0x7f2af00038e0 2021-12-17T18:26:38.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0e7fc700 1 --2- 172.21.15.62:0/700773649 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2af0004500 0x7f2af0004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:26:38.900 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0f7fe700 1 --2- 172.21.15.62:0/700773649 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2af0004e70 0x7f2af000b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:26:38.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0f7fe700 1 -- 172.21.15.62:0/700773649 reap_dead start 2021-12-17T18:26:38.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0effd700 1 --2- 172.21.15.62:0/700773649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2af00038e0 0x7f2af0003ce0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f2af8001110 tx=0x7f2af8007a00).ready entity=mon.0 client_cookie=18bea1efb3f8fa69 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:38.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 -- 172.21.15.62:0/700773649 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2af8007d10 con 0x7f2af00038e0 2021-12-17T18:26:38.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 -- 172.21.15.62:0/700773649 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af8007070 con 0x7f2af00038e0 2021-12-17T18:26:38.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b0dffb700 1 -- 172.21.15.62:0/700773649 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2af80073d0 con 0x7f2af00038e0 2021-12-17T18:26:38.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b152a4700 1 -- 172.21.15.62:0/700773649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2af00038e0 msgr2=0x7f2af0003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:38.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b152a4700 1 --2- 172.21.15.62:0/700773649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2af00038e0 0x7f2af0003ce0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f2af8001110 tx=0x7f2af8007a00).stop 2021-12-17T18:26:38.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b152a4700 1 -- 172.21.15.62:0/700773649 shutdown_connections 2021-12-17T18:26:38.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b152a4700 1 --2- 172.21.15.62:0/700773649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2af00038e0 0x7f2af0003ce0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b152a4700 1 -- 172.21.15.62:0/700773649 >> 172.21.15.62:0/700773649 conn(0x7f2b10062430 msgr2=0x7f2b10062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:38.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b152a4700 1 -- 172.21.15.62:0/700773649 shutdown_connections 2021-12-17T18:26:38.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.882+0000 7f2b152a4700 1 -- 172.21.15.62:0/700773649 wait complete. 2021-12-17T18:26:38.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b152a4700 1 Processor -- start 2021-12-17T18:26:38.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b152a4700 1 -- start start 2021-12-17T18:26:38.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b152a4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2af00038e0 0x7f2b10152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b152a4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b100670d0 0x7f2b100b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b152a4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2b10065da0 0x7f2b10064850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b152a4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b10066b80 con 0x7f2b100670d0 2021-12-17T18:26:38.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b152a4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b10064420 con 0x7f2b10065da0 2021-12-17T18:26:38.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b152a4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b10066db0 con 0x7f2af00038e0 2021-12-17T18:26:38.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b0e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b100670d0 0x7f2b100b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b0e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b100670d0 0x7f2b100b6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55192/0 (socket says 172.21.15.62:55192) 2021-12-17T18:26:38.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b0e7fc700 1 -- 172.21.15.62:0/2753892023 learned_addr learned my addr 172.21.15.62:0/2753892023 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:38.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b0effd700 1 --2- 172.21.15.62:0/2753892023 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2af00038e0 0x7f2b10152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b0f7fe700 1 --2- 172.21.15.62:0/2753892023 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2b10065da0 0x7f2b10064850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b0e7fc700 1 -- 172.21.15.62:0/2753892023 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2af00038e0 msgr2=0x7f2b10152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:38.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b0e7fc700 1 --2- 172.21.15.62:0/2753892023 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2af00038e0 0x7f2b10152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b0e7fc700 1 -- 172.21.15.62:0/2753892023 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2b10065da0 msgr2=0x7f2b10064850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:38.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b0e7fc700 1 --2- 172.21.15.62:0/2753892023 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2b10065da0 0x7f2b10064850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:38.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b0e7fc700 1 -- 172.21.15.62:0/2753892023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b10065b50 con 0x7f2b100670d0 2021-12-17T18:26:38.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b0e7fc700 1 --2- 172.21.15.62:0/2753892023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b100670d0 0x7f2b100b6610 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f2b0000b000 tx=0x7f2b00008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:38.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b07fff700 1 -- 172.21.15.62:0/2753892023 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b00017070 con 0x7f2b100670d0 2021-12-17T18:26:38.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b07fff700 1 -- 172.21.15.62:0/2753892023 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b00000e90 con 0x7f2b100670d0 2021-12-17T18:26:38.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b07fff700 1 -- 172.21.15.62:0/2753892023 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b00012950 con 0x7f2b100670d0 2021-12-17T18:26:38.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b152a4700 1 -- 172.21.15.62:0/2753892023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b10064d40 con 0x7f2b100670d0 2021-12-17T18:26:38.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.886+0000 7f2b152a4700 1 -- 172.21.15.62:0/2753892023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b100651c0 con 0x7f2b100670d0 2021-12-17T18:26:38.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.890+0000 7f2b07fff700 1 -- 172.21.15.62:0/2753892023 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2b00012ab0 con 0x7f2b100670d0 2021-12-17T18:26:38.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.890+0000 7f2b152a4700 1 -- 172.21.15.62:0/2753892023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b100573d0 con 0x7f2b100670d0 2021-12-17T18:26:38.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.890+0000 7f2b07fff700 1 --2- 172.21.15.62:0/2753892023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2af4053520 0x7f2af40559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:38.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.890+0000 7f2b07fff700 1 -- 172.21.15.62:0/2753892023 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2b0006b980 con 0x7f2b100670d0 2021-12-17T18:26:38.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.890+0000 7f2b0effd700 1 --2- 172.21.15.62:0/2753892023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2af4053520 0x7f2af40559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:38.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.890+0000 7f2b0effd700 1 --2- 172.21.15.62:0/2753892023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2af4053520 0x7f2af40559e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f2af8019000 tx=0x7f2af8015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:38.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:38.894+0000 7f2b07fff700 1 -- 172.21.15.62:0/2753892023 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2b00042ae0 con 0x7f2b100670d0 2021-12-17T18:26:39.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.018+0000 7f2b152a4700 1 -- 172.21.15.62:0/2753892023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2b10142dd0 con 0x7f2b100670d0 2021-12-17T18:26:39.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.018+0000 7f2b07fff700 1 -- 172.21.15.62:0/2753892023 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v112) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2b00046100 con 0x7f2b100670d0 2021-12-17T18:26:39.027 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:26:39.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.022+0000 7f2b152a4700 1 -- 172.21.15.62:0/2753892023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2af4053520 msgr2=0x7f2af40559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.022+0000 7f2b152a4700 1 --2- 172.21.15.62:0/2753892023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2af4053520 0x7f2af40559e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f2af8019000 tx=0x7f2af8015000).stop 2021-12-17T18:26:39.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.022+0000 7f2b152a4700 1 -- 172.21.15.62:0/2753892023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b100670d0 msgr2=0x7f2b100b6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.022+0000 7f2b152a4700 1 --2- 172.21.15.62:0/2753892023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b100670d0 0x7f2b100b6610 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f2b0000b000 tx=0x7f2b00008040).stop 2021-12-17T18:26:39.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.022+0000 7f2b152a4700 1 -- 172.21.15.62:0/2753892023 shutdown_connections 2021-12-17T18:26:39.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.022+0000 7f2b152a4700 1 --2- 172.21.15.62:0/2753892023 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2af4053520 0x7f2af40559e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.022+0000 7f2b152a4700 1 --2- 172.21.15.62:0/2753892023 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2b10065da0 0x7f2b10064850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.022+0000 7f2b152a4700 1 --2- 172.21.15.62:0/2753892023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b100670d0 0x7f2b100b6610 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.022+0000 7f2b152a4700 1 --2- 172.21.15.62:0/2753892023 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2af00038e0 0x7f2b10152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.022+0000 7f2b152a4700 1 -- 172.21.15.62:0/2753892023 >> 172.21.15.62:0/2753892023 conn(0x7f2b10062430 msgr2=0x7f2b100b8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:39.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.022+0000 7f2b152a4700 1 -- 172.21.15.62:0/2753892023 shutdown_connections 2021-12-17T18:26:39.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.022+0000 7f2b152a4700 1 -- 172.21.15.62:0/2753892023 wait complete. 2021-12-17T18:26:39.039 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:26:39.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.142+0000 7ff986d9e700 1 Processor -- start 2021-12-17T18:26:39.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.142+0000 7ff986d9e700 1 -- start start 2021-12-17T18:26:39.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff986d9e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff9800b05b0 0x7ff980146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff986d9e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff9800b5dd0 0x7ff980146b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff986d9e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff980147070 0x7ff98005f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff986d9e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9800b2010 con 0x7ff9800b05b0 2021-12-17T18:26:39.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff986d9e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9800b0990 con 0x7ff9800b5dd0 2021-12-17T18:26:39.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff986d9e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800b2240 con 0x7ff980147070 2021-12-17T18:26:39.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff984b3a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff9800b05b0 0x7ff980146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff97ffff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff9800b5dd0 0x7ff980146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff984b3a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff9800b05b0 0x7ff980146690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55200/0 (socket says 172.21.15.62:55200) 2021-12-17T18:26:39.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff984b3a700 1 -- 172.21.15.62:0/948441567 learned_addr learned my addr 172.21.15.62:0/948441567 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:39.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff98533b700 1 --2- 172.21.15.62:0/948441567 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff980147070 0x7ff98005f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff97ffff700 1 -- 172.21.15.62:0/948441567 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff980147070 msgr2=0x7ff98005f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:39.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff97ffff700 1 --2- 172.21.15.62:0/948441567 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff980147070 0x7ff98005f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff97ffff700 1 -- 172.21.15.62:0/948441567 >> v2:172.21.15.62:3300/0 conn(0x7ff9800b05b0 msgr2=0x7ff980146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:39.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff97ffff700 1 --2- 172.21.15.62:0/948441567 >> v2:172.21.15.62:3300/0 conn(0x7ff9800b05b0 0x7ff980146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff97ffff700 1 -- 172.21.15.62:0/948441567 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9800b24e0 con 0x7ff9800b5dd0 2021-12-17T18:26:39.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff97ffff700 1 --2- 172.21.15.62:0/948441567 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff9800b5dd0 0x7ff980146b80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7ff974002f70 tx=0x7ff974006df0).ready entity=mon.1 client_cookie=1d98a750abbf306d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:39.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff97f7fe700 1 -- 172.21.15.62:0/948441567 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff97400d4a0 con 0x7ff9800b5dd0 2021-12-17T18:26:39.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff97f7fe700 1 -- 172.21.15.62:0/948441567 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff974000e90 con 0x7ff9800b5dd0 2021-12-17T18:26:39.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff97f7fe700 1 -- 172.21.15.62:0/948441567 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff97400d7f0 con 0x7ff9800b5dd0 2021-12-17T18:26:39.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff986d9e700 1 -- 172.21.15.62:0/948441567 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff9800b5dd0 msgr2=0x7ff980146b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff986d9e700 1 --2- 172.21.15.62:0/948441567 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff9800b5dd0 0x7ff980146b80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7ff974002f70 tx=0x7ff974006df0).stop 2021-12-17T18:26:39.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff986d9e700 1 -- 172.21.15.62:0/948441567 shutdown_connections 2021-12-17T18:26:39.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff986d9e700 1 --2- 172.21.15.62:0/948441567 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff980147070 0x7ff98005f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff986d9e700 1 --2- 172.21.15.62:0/948441567 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff9800b5dd0 0x7ff980146b80 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff986d9e700 1 --2- 172.21.15.62:0/948441567 >> v2:172.21.15.62:3300/0 conn(0x7ff9800b05b0 0x7ff980146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff986d9e700 1 -- 172.21.15.62:0/948441567 >> 172.21.15.62:0/948441567 conn(0x7ff980062510 msgr2=0x7ff9800628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:39.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff986d9e700 1 -- 172.21.15.62:0/948441567 shutdown_connections 2021-12-17T18:26:39.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.146+0000 7ff986d9e700 1 -- 172.21.15.62:0/948441567 wait complete. 2021-12-17T18:26:39.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff986d9e700 1 Processor -- start 2021-12-17T18:26:39.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff986d9e700 1 -- start start 2021-12-17T18:26:39.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff986d9e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9800b05b0 0x7ff9800a2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff986d9e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff9800b5dd0 0x7ff980060330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff986d9e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff9800670f0 0x7ff980152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff986d9e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff980152500 con 0x7ff9800b05b0 2021-12-17T18:26:39.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff986d9e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800669c0 con 0x7ff9800670f0 2021-12-17T18:26:39.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff986d9e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9801562c0 con 0x7ff9800b5dd0 2021-12-17T18:26:39.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff984b3a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9800b05b0 0x7ff9800a2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff984b3a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9800b05b0 0x7ff9800a2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55204/0 (socket says 172.21.15.62:55204) 2021-12-17T18:26:39.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff984b3a700 1 -- 172.21.15.62:0/558654935 learned_addr learned my addr 172.21.15.62:0/558654935 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:39.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff97ffff700 1 --2- 172.21.15.62:0/558654935 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff9800b5dd0 0x7ff980060330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff98533b700 1 --2- 172.21.15.62:0/558654935 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff9800670f0 0x7ff980152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff984b3a700 1 -- 172.21.15.62:0/558654935 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff9800b5dd0 msgr2=0x7ff980060330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff984b3a700 1 --2- 172.21.15.62:0/558654935 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff9800b5dd0 0x7ff980060330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff984b3a700 1 -- 172.21.15.62:0/558654935 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff9800670f0 msgr2=0x7ff980152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff984b3a700 1 --2- 172.21.15.62:0/558654935 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff9800670f0 0x7ff980152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff984b3a700 1 -- 172.21.15.62:0/558654935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97400b180 con 0x7ff9800b05b0 2021-12-17T18:26:39.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff97ffff700 1 --2- 172.21.15.62:0/558654935 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff9800b5dd0 0x7ff980060330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:39.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff984b3a700 1 --2- 172.21.15.62:0/558654935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9800b05b0 0x7ff9800a2ff0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7ff97000c000 tx=0x7ff970008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:39.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff97dffb700 1 -- 172.21.15.62:0/558654935 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff970013610 con 0x7ff9800b05b0 2021-12-17T18:26:39.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff97dffb700 1 -- 172.21.15.62:0/558654935 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff970013770 con 0x7ff9800b05b0 2021-12-17T18:26:39.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff986d9e700 1 -- 172.21.15.62:0/558654935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff980156550 con 0x7ff9800b05b0 2021-12-17T18:26:39.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff97dffb700 1 -- 172.21.15.62:0/558654935 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff970013ad0 con 0x7ff9800b05b0 2021-12-17T18:26:39.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.150+0000 7ff986d9e700 1 -- 172.21.15.62:0/558654935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9800662f0 con 0x7ff9800b05b0 2021-12-17T18:26:39.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.154+0000 7ff986d9e700 1 -- 172.21.15.62:0/558654935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff980152690 con 0x7ff9800b05b0 2021-12-17T18:26:39.171 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.154+0000 7ff97dffb700 1 -- 172.21.15.62:0/558654935 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff970013c30 con 0x7ff9800b05b0 2021-12-17T18:26:39.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.154+0000 7ff97dffb700 1 --2- 172.21.15.62:0/558654935 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff9600534f0 0x7ff9600559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.154+0000 7ff97dffb700 1 -- 172.21.15.62:0/558654935 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff97006bbc0 con 0x7ff9800b05b0 2021-12-17T18:26:39.172 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.154+0000 7ff97ffff700 1 --2- 172.21.15.62:0/558654935 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff9600534f0 0x7ff9600559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.158+0000 7ff97ffff700 1 --2- 172.21.15.62:0/558654935 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff9600534f0 0x7ff9600559b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7ff974018000 tx=0x7ff974014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:39.173 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.158+0000 7ff97dffb700 1 -- 172.21.15.62:0/558654935 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff980152690 con 0x7ff9800b05b0 2021-12-17T18:26:39.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.286+0000 7ff986d9e700 1 -- 172.21.15.62:0/558654935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff980152690 con 0x7ff9800b05b0 2021-12-17T18:26:39.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.286+0000 7ff97dffb700 1 -- 172.21.15.62:0/558654935 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff980152690 con 0x7ff9800b05b0 2021-12-17T18:26:39.295 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:26:39.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.290+0000 7ff986d9e700 1 -- 172.21.15.62:0/558654935 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff9600534f0 msgr2=0x7ff9600559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.290+0000 7ff986d9e700 1 --2- 172.21.15.62:0/558654935 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff9600534f0 0x7ff9600559b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7ff974018000 tx=0x7ff974014000).stop 2021-12-17T18:26:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.290+0000 7ff986d9e700 1 -- 172.21.15.62:0/558654935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9800b05b0 msgr2=0x7ff9800a2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.290+0000 7ff986d9e700 1 --2- 172.21.15.62:0/558654935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9800b05b0 0x7ff9800a2ff0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7ff97000c000 tx=0x7ff970008040).stop 2021-12-17T18:26:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.290+0000 7ff986d9e700 1 -- 172.21.15.62:0/558654935 shutdown_connections 2021-12-17T18:26:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.290+0000 7ff986d9e700 1 --2- 172.21.15.62:0/558654935 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff9600534f0 0x7ff9600559b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.290+0000 7ff986d9e700 1 --2- 172.21.15.62:0/558654935 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff9800670f0 0x7ff980152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.290+0000 7ff986d9e700 1 --2- 172.21.15.62:0/558654935 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff9800b5dd0 0x7ff980060330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.290+0000 7ff986d9e700 1 --2- 172.21.15.62:0/558654935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9800b05b0 0x7ff9800a2ff0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.290+0000 7ff986d9e700 1 -- 172.21.15.62:0/558654935 >> 172.21.15.62:0/558654935 conn(0x7ff980062510 msgr2=0x7ff9800b9030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.290+0000 7ff986d9e700 1 -- 172.21.15.62:0/558654935 shutdown_connections 2021-12-17T18:26:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.290+0000 7ff986d9e700 1 -- 172.21.15.62:0/558654935 wait complete. 2021-12-17T18:26:39.308 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:26:39.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.410+0000 7f22fe321700 1 Processor -- start 2021-12-17T18:26:39.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.410+0000 7f22fe321700 1 -- start start 2021-12-17T18:26:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22fe321700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22f805ce70 0x7f22f80b1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22fe321700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f80af810 con 0x7f22f80adb90 2021-12-17T18:26:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22fe321700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f80afef0 con 0x7f22f8143110 2021-12-17T18:26:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22fe321700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f813f320 con 0x7f22f805ce70 2021-12-17T18:26:39.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f77fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f22f80adb90 0x7f22f8142a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38792/0 (socket says 172.21.15.62:38792) 2021-12-17T18:26:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f77fe700 1 -- 172.21.15.62:0/3466290239 learned_addr learned my addr 172.21.15.62:0/3466290239 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:39.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f7fff700 1 --2- 172.21.15.62:0/3466290239 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22f805ce70 0x7f22f80b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 -- 172.21.15.62:0/3466290239 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655208801 0 0) 0x7f22e0001110 con 0x7f22f80adb90 2021-12-17T18:26:39.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 -- 172.21.15.62:0/3466290239 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22dc003260 con 0x7f22f80adb90 2021-12-17T18:26:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 -- 172.21.15.62:0/3466290239 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255458758 0 0) 0x7f22f80afef0 con 0x7f22f8143110 2021-12-17T18:26:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 -- 172.21.15.62:0/3466290239 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e0001110 con 0x7f22f8143110 2021-12-17T18:26:39.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 -- 172.21.15.62:0/3466290239 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1971791895 0 0) 0x7f22dc003260 con 0x7f22f80adb90 2021-12-17T18:26:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 -- 172.21.15.62:0/3466290239 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22f805ce70 msgr2=0x7f22f80b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 --2- 172.21.15.62:0/3466290239 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22f805ce70 0x7f22f80b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 -- 172.21.15.62:0/3466290239 >> v1:172.21.15.109:6789/0 conn(0x7f22f8143110 legacy=0x7f22f813e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 -- 172.21.15.62:0/3466290239 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f805d250 con 0x7f22f80adb90 2021-12-17T18:26:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 -- 172.21.15.62:0/3466290239 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f22e00017f0 con 0x7f22f80adb90 2021-12-17T18:26:39.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 -- 172.21.15.62:0/3466290239 >> v1:172.21.15.62:6789/0 conn(0x7f22f80adb90 legacy=0x7f22f8142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 --2- 172.21.15.62:0/3466290239 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f22dc003910 0x7f22dc003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 --2- 172.21.15.62:0/3466290239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22dc004500 0x7f22dc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 --2- 172.21.15.62:0/3466290239 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22dc004e70 0x7f22dc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 -- 172.21.15.62:0/3466290239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f813f320 con 0x7f22dc004500 2021-12-17T18:26:39.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 -- 172.21.15.62:0/3466290239 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc00deb0 con 0x7f22dc003910 2021-12-17T18:26:39.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 -- 172.21.15.62:0/3466290239 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc00e070 con 0x7f22dc004e70 2021-12-17T18:26:39.444 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f7fff700 1 --2- 172.21.15.62:0/3466290239 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22f805ce70 0x7f22f80b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:39.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f77fe700 1 --2- 172.21.15.62:0/3466290239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22dc004500 0x7f22dc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22fc8be700 1 --2- 172.21.15.62:0/3466290239 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22dc004e70 0x7f22dc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f7fff700 1 --2- 172.21.15.62:0/3466290239 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f22dc003910 0x7f22dc003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f77fe700 1 -- 172.21.15.62:0/3466290239 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22dc004e70 msgr2=0x7f22dc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f77fe700 1 --2- 172.21.15.62:0/3466290239 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22dc004e70 0x7f22dc00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f77fe700 1 -- 172.21.15.62:0/3466290239 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f22dc003910 msgr2=0x7f22dc003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:39.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f77fe700 1 --2- 172.21.15.62:0/3466290239 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f22dc003910 0x7f22dc003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f77fe700 1 -- 172.21.15.62:0/3466290239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc003260 con 0x7f22dc004500 2021-12-17T18:26:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f7fff700 1 --2- 172.21.15.62:0/3466290239 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f22dc003910 0x7f22dc003d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22fc8be700 1 --2- 172.21.15.62:0/3466290239 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22dc004e70 0x7f22dc00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f77fe700 1 --2- 172.21.15.62:0/3466290239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22dc004500 0x7f22dc004980 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f22e00015c0 tx=0x7f22f80b0190).ready entity=mon.0 client_cookie=40c7abb566968a5d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:39.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 -- 172.21.15.62:0/3466290239 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22e00070d0 con 0x7f22dc004500 2021-12-17T18:26:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 -- 172.21.15.62:0/3466290239 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e0007230 con 0x7f22dc004500 2021-12-17T18:26:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.414+0000 7f22f6ffd700 1 -- 172.21.15.62:0/3466290239 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22e000c8f0 con 0x7f22dc004500 2021-12-17T18:26:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.418+0000 7f22fe321700 1 -- 172.21.15.62:0/3466290239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22dc004500 msgr2=0x7f22dc004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.418+0000 7f22fe321700 1 --2- 172.21.15.62:0/3466290239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22dc004500 0x7f22dc004980 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f22e00015c0 tx=0x7f22f80b0190).stop 2021-12-17T18:26:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.418+0000 7f22fc8be700 1 -- 172.21.15.62:0/3466290239 reap_dead start 2021-12-17T18:26:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.418+0000 7f22fe321700 1 -- 172.21.15.62:0/3466290239 shutdown_connections 2021-12-17T18:26:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.418+0000 7f22fe321700 1 -- 172.21.15.62:0/3466290239 >> 172.21.15.62:0/3466290239 conn(0x7f22f805c750 msgr2=0x7f22f8062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.418+0000 7f22fe321700 1 -- 172.21.15.62:0/3466290239 shutdown_connections 2021-12-17T18:26:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.418+0000 7f22fe321700 1 -- 172.21.15.62:0/3466290239 wait complete. 2021-12-17T18:26:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.418+0000 7f22fe321700 1 Processor -- start 2021-12-17T18:26:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.418+0000 7f22fe321700 1 -- start start 2021-12-17T18:26:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.418+0000 7f22fe321700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22dc004500 0x7f22f8139c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.418+0000 7f22fe321700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f22f80656d0 0x7f22f8063a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.418+0000 7f22fe321700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22f8063ef0 0x7f22f814e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.418+0000 7f22fe321700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f813bec0 con 0x7f22f8063ef0 2021-12-17T18:26:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.418+0000 7f22fe321700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f8065340 con 0x7f22f80656d0 2021-12-17T18:26:39.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.418+0000 7f22fe321700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f813c0f0 con 0x7f22dc004500 2021-12-17T18:26:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22fc8be700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22f8063ef0 0x7f22f814e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22f7fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22dc004500 0x7f22f8139c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22fc8be700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22f8063ef0 0x7f22f814e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55228/0 (socket says 172.21.15.62:55228) 2021-12-17T18:26:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22fc8be700 1 -- 172.21.15.62:0/3327386726 learned_addr learned my addr 172.21.15.62:0/3327386726 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:39.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22f77fe700 1 --2- 172.21.15.62:0/3327386726 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f22f80656d0 0x7f22f8063a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22fc8be700 1 -- 172.21.15.62:0/3327386726 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22dc004500 msgr2=0x7f22f8139c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22fc8be700 1 --2- 172.21.15.62:0/3327386726 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22dc004500 0x7f22f8139c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22fc8be700 1 -- 172.21.15.62:0/3327386726 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f22f80656d0 msgr2=0x7f22f8063a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22fc8be700 1 --2- 172.21.15.62:0/3327386726 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f22f80656d0 0x7f22f8063a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22fc8be700 1 -- 172.21.15.62:0/3327386726 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f814f050 con 0x7f22f8063ef0 2021-12-17T18:26:39.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22f77fe700 1 --2- 172.21.15.62:0/3327386726 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f22f80656d0 0x7f22f8063a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:39.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22fc8be700 1 --2- 172.21.15.62:0/3327386726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22f8063ef0 0x7f22f814e0e0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f22f0001210 tx=0x7f22f0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:39.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22f57fa700 1 -- 172.21.15.62:0/3327386726 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22f0003220 con 0x7f22f8063ef0 2021-12-17T18:26:39.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22f57fa700 1 -- 172.21.15.62:0/3327386726 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f0003380 con 0x7f22f8063ef0 2021-12-17T18:26:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22fe321700 1 -- 172.21.15.62:0/3327386726 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f8063490 con 0x7f22f8063ef0 2021-12-17T18:26:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22f57fa700 1 -- 172.21.15.62:0/3327386726 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22f00016e0 con 0x7f22f8063ef0 2021-12-17T18:26:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22fe321700 1 -- 172.21.15.62:0/3327386726 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f8064f60 con 0x7f22f8063ef0 2021-12-17T18:26:39.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22fe321700 1 -- 172.21.15.62:0/3327386726 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f80654b0 con 0x7f22f8063ef0 2021-12-17T18:26:39.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22f57fa700 1 -- 172.21.15.62:0/3327386726 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f22f001e070 con 0x7f22f8063ef0 2021-12-17T18:26:39.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.422+0000 7f22f57fa700 1 --2- 172.21.15.62:0/3327386726 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22d0053520 0x7f22d00559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.426+0000 7f22f57fa700 1 -- 172.21.15.62:0/3327386726 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f22f006afa0 con 0x7f22f8063ef0 2021-12-17T18:26:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.426+0000 7f22f7fff700 1 --2- 172.21.15.62:0/3327386726 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22d0053520 0x7f22d00559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.426+0000 7f22f7fff700 1 --2- 172.21.15.62:0/3327386726 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22d0053520 0x7f22d00559e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f22e8008000 tx=0x7f22e8008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:39.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.430+0000 7f22f57fa700 1 -- 172.21.15.62:0/3327386726 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f22f80654b0 con 0x7f22f8063ef0 2021-12-17T18:26:39.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.554+0000 7f22fe321700 1 -- 172.21.15.62:0/3327386726 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f22f80654b0 con 0x7f22f8063ef0 2021-12-17T18:26:39.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.558+0000 7f22f57fa700 1 -- 172.21.15.62:0/3327386726 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+10 (secure 0 0 0) 0x7f22f80654b0 con 0x7f22f8063ef0 2021-12-17T18:26:39.565 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:26:39.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.558+0000 7f22fe321700 1 -- 172.21.15.62:0/3327386726 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22d0053520 msgr2=0x7f22d00559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.558+0000 7f22fe321700 1 --2- 172.21.15.62:0/3327386726 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22d0053520 0x7f22d00559e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f22e8008000 tx=0x7f22e8008040).stop 2021-12-17T18:26:39.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.558+0000 7f22fe321700 1 -- 172.21.15.62:0/3327386726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22f8063ef0 msgr2=0x7f22f814e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.558+0000 7f22fe321700 1 --2- 172.21.15.62:0/3327386726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22f8063ef0 0x7f22f814e0e0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f22f0001210 tx=0x7f22f0009040).stop 2021-12-17T18:26:39.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.558+0000 7f22fe321700 1 -- 172.21.15.62:0/3327386726 shutdown_connections 2021-12-17T18:26:39.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.558+0000 7f22fe321700 1 --2- 172.21.15.62:0/3327386726 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f22d0053520 0x7f22d00559e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.558+0000 7f22fe321700 1 --2- 172.21.15.62:0/3327386726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22f8063ef0 0x7f22f814e0e0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.558+0000 7f22fe321700 1 --2- 172.21.15.62:0/3327386726 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f22f80656d0 0x7f22f8063a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.558+0000 7f22fe321700 1 --2- 172.21.15.62:0/3327386726 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f22dc004500 0x7f22f8139c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.558+0000 7f22fe321700 1 -- 172.21.15.62:0/3327386726 >> 172.21.15.62:0/3327386726 conn(0x7f22f805c750 msgr2=0x7f22f8142910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:39.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.558+0000 7f22fe321700 1 -- 172.21.15.62:0/3327386726 shutdown_connections 2021-12-17T18:26:39.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.558+0000 7f22fe321700 1 -- 172.21.15.62:0/3327386726 wait complete. 2021-12-17T18:26:39.577 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:26:39.578 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:26:39.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.674+0000 7f86bf0d0700 1 Processor -- start 2021-12-17T18:26:39.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.674+0000 7f86bf0d0700 1 -- start start 2021-12-17T18:26:39.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bf0d0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f86b80b21f0 0x7f86b814aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bf0d0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b80b2ce0 con 0x7f86b80a7bb0 2021-12-17T18:26:39.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bf0d0700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b80aca60 con 0x7f86b80b1730 2021-12-17T18:26:39.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bf0d0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b8147870 con 0x7f86b80b21f0 2021-12-17T18:26:39.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bd66d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f86b80a7bb0 0x7f86b8067120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38816/0 (socket says 172.21.15.62:38816) 2021-12-17T18:26:39.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bd66d700 1 -- 172.21.15.62:0/1270908763 learned_addr learned my addr 172.21.15.62:0/1270908763 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:39.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bce6c700 1 --2- 172.21.15.62:0/1270908763 >> v2:172.21.15.62:3300/0 conn(0x7f86b80b21f0 0x7f86b814aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86b77fe700 1 -- 172.21.15.62:0/1270908763 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536204948 0 0) 0x7f86b80b2ce0 con 0x7f86b80a7bb0 2021-12-17T18:26:39.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86b77fe700 1 -- 172.21.15.62:0/1270908763 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86a4003260 con 0x7f86b80a7bb0 2021-12-17T18:26:39.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86b77fe700 1 -- 172.21.15.62:0/1270908763 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125260793 0 0) 0x7f86b80aca60 con 0x7f86b80b1730 2021-12-17T18:26:39.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86b77fe700 1 -- 172.21.15.62:0/1270908763 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86b80b2ce0 con 0x7f86b80b1730 2021-12-17T18:26:39.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bce6c700 1 -- 172.21.15.62:0/1270908763 >> v1:172.21.15.109:6789/0 conn(0x7f86b80b1730 legacy=0x7f86b80ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bce6c700 1 -- 172.21.15.62:0/1270908763 >> v1:172.21.15.62:6789/0 conn(0x7f86b80a7bb0 legacy=0x7f86b8067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bce6c700 1 -- 172.21.15.62:0/1270908763 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b80b2f10 con 0x7f86b80b21f0 2021-12-17T18:26:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bce6c700 1 --2- 172.21.15.62:0/1270908763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b80b21f0 0x7f86b814aea0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f86b80b1c00 tx=0x7f86ac006df0).ready entity=mon.0 client_cookie=cb78a7cd8ec20b1a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:39.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86b77fe700 1 -- 172.21.15.62:0/1270908763 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86ac00d610 con 0x7f86b80b21f0 2021-12-17T18:26:39.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86b77fe700 1 -- 172.21.15.62:0/1270908763 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac000e90 con 0x7f86b80b21f0 2021-12-17T18:26:39.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86b77fe700 1 -- 172.21.15.62:0/1270908763 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86ac00d960 con 0x7f86b80b21f0 2021-12-17T18:26:39.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bf0d0700 1 -- 172.21.15.62:0/1270908763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b80b21f0 msgr2=0x7f86b814aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bf0d0700 1 --2- 172.21.15.62:0/1270908763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b80b21f0 0x7f86b814aea0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f86b80b1c00 tx=0x7f86ac006df0).stop 2021-12-17T18:26:39.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bf0d0700 1 -- 172.21.15.62:0/1270908763 shutdown_connections 2021-12-17T18:26:39.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bf0d0700 1 --2- 172.21.15.62:0/1270908763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b80b21f0 0x7f86b814aea0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bf0d0700 1 -- 172.21.15.62:0/1270908763 >> 172.21.15.62:0/1270908763 conn(0x7f86b805f730 msgr2=0x7f86b805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:39.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bf0d0700 1 -- 172.21.15.62:0/1270908763 shutdown_connections 2021-12-17T18:26:39.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.678+0000 7f86bf0d0700 1 -- 172.21.15.62:0/1270908763 wait complete. 2021-12-17T18:26:39.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86bf0d0700 1 Processor -- start 2021-12-17T18:26:39.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86bf0d0700 1 -- start start 2021-12-17T18:26:39.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86bf0d0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f86b80a7bb0 0x7f86b8066b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86bf0d0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b80b1730 0x7f86b80ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86bf0d0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f86b80b21f0 0x7f86b8063270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86bf0d0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8065030 con 0x7f86b80b1730 2021-12-17T18:26:39.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86bf0d0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8157100 con 0x7f86b80b21f0 2021-12-17T18:26:39.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86bf0d0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b81573a0 con 0x7f86b80a7bb0 2021-12-17T18:26:39.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86b7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b80b1730 0x7f86b80ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86b7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b80b1730 0x7f86b80ab9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55240/0 (socket says 172.21.15.62:55240) 2021-12-17T18:26:39.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86b7fff700 1 -- 172.21.15.62:0/124272453 learned_addr learned my addr 172.21.15.62:0/124272453 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:39.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86bd66d700 1 --2- 172.21.15.62:0/124272453 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f86b80b21f0 0x7f86b8063270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86bce6c700 1 --2- 172.21.15.62:0/124272453 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f86b80a7bb0 0x7f86b8066b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86b7fff700 1 -- 172.21.15.62:0/124272453 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f86b80a7bb0 msgr2=0x7f86b8066b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86b7fff700 1 --2- 172.21.15.62:0/124272453 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f86b80a7bb0 0x7f86b8066b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86b7fff700 1 -- 172.21.15.62:0/124272453 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f86b80b21f0 msgr2=0x7f86b8063270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86b7fff700 1 --2- 172.21.15.62:0/124272453 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f86b80b21f0 0x7f86b8063270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86b7fff700 1 -- 172.21.15.62:0/124272453 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac00b180 con 0x7f86b80b1730 2021-12-17T18:26:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86b7fff700 1 --2- 172.21.15.62:0/124272453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b80b1730 0x7f86b80ab9a0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f86a8001110 tx=0x7f86a8007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:39.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86b5ffb700 1 -- 172.21.15.62:0/124272453 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86a8012400 con 0x7f86b80b1730 2021-12-17T18:26:39.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86b5ffb700 1 -- 172.21.15.62:0/124272453 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a8012560 con 0x7f86b80b1730 2021-12-17T18:26:39.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86bf0d0700 1 -- 172.21.15.62:0/124272453 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b81576a0 con 0x7f86b80b1730 2021-12-17T18:26:39.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86b5ffb700 1 -- 172.21.15.62:0/124272453 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86a80128c0 con 0x7f86b80b1730 2021-12-17T18:26:39.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.682+0000 7f86bf0d0700 1 -- 172.21.15.62:0/124272453 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b8157ae0 con 0x7f86b80b1730 2021-12-17T18:26:39.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.686+0000 7f86bf0d0700 1 -- 172.21.15.62:0/124272453 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b814b390 con 0x7f86b80b1730 2021-12-17T18:26:39.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.686+0000 7f86b5ffb700 1 -- 172.21.15.62:0/124272453 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f86a8019030 con 0x7f86b80b1730 2021-12-17T18:26:39.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.686+0000 7f86b5ffb700 1 --2- 172.21.15.62:0/124272453 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f86980536a0 0x7f8698055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:39.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.686+0000 7f86b5ffb700 1 -- 172.21.15.62:0/124272453 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f86a806ab80 con 0x7f86b80b1730 2021-12-17T18:26:39.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.686+0000 7f86bce6c700 1 --2- 172.21.15.62:0/124272453 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f86980536a0 0x7f8698055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:39.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.686+0000 7f86bce6c700 1 --2- 172.21.15.62:0/124272453 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f86980536a0 0x7f8698055b60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f86ac018000 tx=0x7f86ac014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:39.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.694+0000 7f86b5ffb700 1 -- 172.21.15.62:0/124272453 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f86a8041bd0 con 0x7f86b80b1730 2021-12-17T18:26:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.858+0000 7f86bf0d0700 1 -- 172.21.15.62:0/124272453 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86b80573d0 con 0x7f86b80b1730 2021-12-17T18:26:39.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.858+0000 7f86b5ffb700 1 -- 172.21.15.62:0/124272453 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f86a806ae60 con 0x7f86b80b1730 2021-12-17T18:26:39.869 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:39.869 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":55,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6650,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3745112309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3745112309},{"type":"v1","addr":"172.21.15.109:6835","nonce":3745112309}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":53}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:26:35.031189+0000","modified":"2021-12-17T18:26:36.033870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7704":{"gid":7704,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/2418178754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2418178754},{"type":"v1","addr":"172.21.15.62:6833","nonce":2418178754}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-12-17T18:26:39.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.862+0000 7f86bf0d0700 1 -- 172.21.15.62:0/124272453 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f86980536a0 msgr2=0x7f8698055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.862+0000 7f86bf0d0700 1 --2- 172.21.15.62:0/124272453 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f86980536a0 0x7f8698055b60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f86ac018000 tx=0x7f86ac014000).stop 2021-12-17T18:26:39.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.862+0000 7f86bf0d0700 1 -- 172.21.15.62:0/124272453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b80b1730 msgr2=0x7f86b80ab9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:39.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.862+0000 7f86bf0d0700 1 --2- 172.21.15.62:0/124272453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b80b1730 0x7f86b80ab9a0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f86a8001110 tx=0x7f86a8007a90).stop 2021-12-17T18:26:39.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.862+0000 7f86bf0d0700 1 -- 172.21.15.62:0/124272453 shutdown_connections 2021-12-17T18:26:39.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.862+0000 7f86bf0d0700 1 --2- 172.21.15.62:0/124272453 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f86980536a0 0x7f8698055b60 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.862+0000 7f86bf0d0700 1 --2- 172.21.15.62:0/124272453 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f86b80b21f0 0x7f86b8063270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.862+0000 7f86bf0d0700 1 --2- 172.21.15.62:0/124272453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b80b1730 0x7f86b80ab9a0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.862+0000 7f86bf0d0700 1 --2- 172.21.15.62:0/124272453 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f86b80a7bb0 0x7f86b8066b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.862+0000 7f86bf0d0700 1 -- 172.21.15.62:0/124272453 >> 172.21.15.62:0/124272453 conn(0x7f86b805f730 msgr2=0x7f86b8067540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.862+0000 7f86bf0d0700 1 -- 172.21.15.62:0/124272453 shutdown_connections 2021-12-17T18:26:39.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:39.862+0000 7f86bf0d0700 1 -- 172.21.15.62:0/124272453 wait complete. 2021-12-17T18:26:39.876 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 55 2021-12-17T18:26:40.083 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:26:35.031189+0000', 'modified': '2021-12-17T18:26:36.033870+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7704}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7704': {'gid': 7704, 'name': 'a', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/2418178754', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 2418178754}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 2418178754}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:26:40.084 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:26:40.084 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:26:40.199 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":7704,"want_state":"up:active","state":"up:active","rank_uptime":5.1536292289999999,"mdsmap_epoch":55,"osdmap_epoch":112,"osdmap_epoch_barrier":111,"uptime":9.2966180719999993} 2021-12-17T18:26:40.199 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 7704, "mdsmap_epoch": 55, "osdmap_epoch": 112, "osdmap_epoch_barrier": 111, "rank_uptime": 5.153629229, "state": "up:active", "uptime": 9.296618072, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:26:40.200 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:26:40.200 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-12-17T18:26:40.201 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-12-17T18:26:40.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:40.201 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:40.210 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:26:40.224 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:26:40.225 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:26:40.236 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:26:40.237 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:26:40.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:40.239 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:26:40.286 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:26:40.286 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:40.289 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:26:40.305 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:26:40.306 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:26:40.361 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:26:40.362 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:26:40.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:40.364 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:26:40.366 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2021-12-17T18:26:40.359+0000 7f420082d080 -1 init, newargv = 0x558e8e45b960 newargc=9 2021-12-17T18:26:40.367 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14946]: starting ceph client 2021-12-17T18:26:40.376 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14946]: starting fuse 2021-12-17T18:26:41.470 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:26:41.489 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:26:41.489 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:26:41.547 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:26:41.548 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:26:41.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:41.550 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:26:41.555 INFO:teuthology.orchestra.run.smithi125.stdout:52 2021-12-17T18:26:41.556 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:26:41.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:41.557 DEBUG:teuthology.orchestra.run.smithi125:> sudo python3 -c ' 2021-12-17T18:26:41.558 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2021-12-17T18:26:41.558 DEBUG:teuthology.orchestra.run.smithi125:> import re 2021-12-17T18:26:41.559 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:26:41.559 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2021-12-17T18:26:41.560 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:26:41.560 DEBUG:teuthology.orchestra.run.smithi125:> def find_socket(client_name): 2021-12-17T18:26:41.561 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-12-17T18:26:41.561 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2021-12-17T18:26:41.562 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:26:41.562 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2021-12-17T18:26:41.562 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2021-12-17T18:26:41.563 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2021-12-17T18:26:41.563 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2021-12-17T18:26:41.564 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:26:41.564 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2021-12-17T18:26:41.564 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:26:41.565 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:26:41.565 DEBUG:teuthology.orchestra.run.smithi125:> return f 2021-12-17T18:26:41.566 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:26:41.566 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:26:41.567 DEBUG:teuthology.orchestra.run.smithi125:> print(find_socket("client.0")) 2021-12-17T18:26:41.567 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:26:41.611 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.14946.asok 2021-12-17T18:26:41.616 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14946.asok 2021-12-17T18:26:41.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:41.617 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14946.asok status 2021-12-17T18:26:41.754 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2021-12-17T18:26:41.754 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2021-12-17T18:26:41.754 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:26:41.755 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:26:41.755 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2021-12-17T18:26:41.755 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2021-12-17T18:26:41.755 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-12-17T18:26:41.756 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "14946", 2021-12-17T18:26:41.756 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2021-12-17T18:26:41.756 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:26:41.756 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2021-12-17T18:26:41.757 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2021-12-17T18:26:41.757 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 6755, 2021-12-17T18:26:41.757 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2021-12-17T18:26:41.757 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2021-12-17T18:26:41.758 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2021-12-17T18:26:41.758 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 6755 2021-12-17T18:26:41.758 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:26:41.758 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:26:41.759 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:26:41.759 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:26:41.759 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 2824041705 2021-12-17T18:26:41.759 INFO:teuthology.orchestra.run.smithi125.stdout: } 2021-12-17T18:26:41.760 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:26:41.760 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:26:41.760 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:26:41.760 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:26:41.761 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 2824041705 2021-12-17T18:26:41.761 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:26:41.761 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.6755 172.21.15.125:0/2824041705", 2021-12-17T18:26:41.761 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "172.21.15.125:0/2824041705", 2021-12-17T18:26:41.762 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2021-12-17T18:26:41.762 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 55, 2021-12-17T18:26:41.762 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 112, 2021-12-17T18:26:41.762 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:26:41.763 INFO:teuthology.orchestra.run.smithi125.stdout: "blacklisted": false, 2021-12-17T18:26:41.763 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2021-12-17T18:26:41.763 INFO:teuthology.orchestra.run.smithi125.stdout:} 2021-12-17T18:26:41.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:41.765 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:41.766 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:41.773 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:26:41.774 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:26:41.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:41.775 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:41.790 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:26:41.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f57cec700 1 Processor -- start 2021-12-17T18:26:41.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f57cec700 1 -- start start 2021-12-17T18:26:41.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f57cec700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f8f500a7bb0 0x7f8f50067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:41.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f57cec700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f500b2ce0 con 0x7f8f500b21f0 2021-12-17T18:26:41.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f57cec700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f500aca60 con 0x7f8f500b1730 2021-12-17T18:26:41.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f57cec700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f5014b5b0 con 0x7f8f500a7bb0 2021-12-17T18:26:41.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f55a88700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8f500b21f0 0x7f8f5014aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38828/0 (socket says 172.21.15.62:38828) 2021-12-17T18:26:41.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f55a88700 1 -- 172.21.15.62:0/2749942974 learned_addr learned my addr 172.21.15.62:0/2749942974 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:41.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f56289700 1 --2- 172.21.15.62:0/2749942974 >> v2:172.21.15.109:3300/0 conn(0x7f8f500a7bb0 0x7f8f50067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:41.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f54a86700 1 -- 172.21.15.62:0/2749942974 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351370472 0 0) 0x7f8f500b2ce0 con 0x7f8f500b21f0 2021-12-17T18:26:41.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f54a86700 1 -- 172.21.15.62:0/2749942974 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f30003260 con 0x7f8f500b21f0 2021-12-17T18:26:41.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f54a86700 1 -- 172.21.15.62:0/2749942974 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260018602 0 0) 0x7f8f500aca60 con 0x7f8f500b1730 2021-12-17T18:26:41.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f54a86700 1 -- 172.21.15.62:0/2749942974 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f500b2ce0 con 0x7f8f500b1730 2021-12-17T18:26:41.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f56289700 1 -- 172.21.15.62:0/2749942974 >> v1:172.21.15.109:6789/0 conn(0x7f8f500b1730 legacy=0x7f8f500ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:41.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f56289700 1 -- 172.21.15.62:0/2749942974 >> v1:172.21.15.62:6789/0 conn(0x7f8f500b21f0 legacy=0x7f8f5014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:41.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f54a86700 1 -- 172.21.15.62:0/2749942974 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 280923154 0 0) 0x7f8f30003260 con 0x7f8f500b21f0 2021-12-17T18:26:41.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f56289700 1 -- 172.21.15.62:0/2749942974 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f500b2f10 con 0x7f8f500a7bb0 2021-12-17T18:26:41.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f56289700 1 --2- 172.21.15.62:0/2749942974 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f500a7bb0 0x7f8f50067120 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f8f38001110 tx=0x7f8f40006df0).ready entity=mon.1 client_cookie=f3bd0ee8b34b5681 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:41.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f54a86700 1 -- 172.21.15.62:0/2749942974 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f38001660 con 0x7f8f500a7bb0 2021-12-17T18:26:41.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f54a86700 1 -- 172.21.15.62:0/2749942974 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f40000e90 con 0x7f8f500a7bb0 2021-12-17T18:26:41.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.898+0000 7f8f54a86700 1 -- 172.21.15.62:0/2749942974 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f40012460 con 0x7f8f500a7bb0 2021-12-17T18:26:41.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f57cec700 1 -- 172.21.15.62:0/2749942974 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f500a7bb0 msgr2=0x7f8f50067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:41.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f57cec700 1 --2- 172.21.15.62:0/2749942974 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f500a7bb0 0x7f8f50067120 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f8f38001110 tx=0x7f8f40006df0).stop 2021-12-17T18:26:41.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f57cec700 1 -- 172.21.15.62:0/2749942974 shutdown_connections 2021-12-17T18:26:41.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f57cec700 1 --2- 172.21.15.62:0/2749942974 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f500a7bb0 0x7f8f50067120 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:41.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f57cec700 1 -- 172.21.15.62:0/2749942974 >> 172.21.15.62:0/2749942974 conn(0x7f8f5005f730 msgr2=0x7f8f5005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:41.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f57cec700 1 -- 172.21.15.62:0/2749942974 shutdown_connections 2021-12-17T18:26:41.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f57cec700 1 -- 172.21.15.62:0/2749942974 wait complete. 2021-12-17T18:26:41.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f57cec700 1 Processor -- start 2021-12-17T18:26:41.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f57cec700 1 -- start start 2021-12-17T18:26:41.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f57cec700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f500a7bb0 0x7f8f50065b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:41.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f57cec700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f500b1730 0x7f8f50066080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:41.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f57cec700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f500b21f0 0x7f8f50063060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:41.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f57cec700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f501577f0 con 0x7f8f500a7bb0 2021-12-17T18:26:41.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f57cec700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f50157a90 con 0x7f8f500b21f0 2021-12-17T18:26:41.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f57cec700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f50066570 con 0x7f8f500b1730 2021-12-17T18:26:41.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f55a88700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f500a7bb0 0x7f8f50065b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:41.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f55a88700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f500a7bb0 0x7f8f50065b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55252/0 (socket says 172.21.15.62:55252) 2021-12-17T18:26:41.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.902+0000 7f8f55a88700 1 -- 172.21.15.62:0/501330521 learned_addr learned my addr 172.21.15.62:0/501330521 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:41.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f55287700 1 --2- 172.21.15.62:0/501330521 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f500b1730 0x7f8f50066080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:41.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f56289700 1 --2- 172.21.15.62:0/501330521 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f500b21f0 0x7f8f50063060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:41.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f55a88700 1 -- 172.21.15.62:0/501330521 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f500b1730 msgr2=0x7f8f50066080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:41.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f55a88700 1 --2- 172.21.15.62:0/501330521 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f500b1730 0x7f8f50066080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:41.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f55a88700 1 -- 172.21.15.62:0/501330521 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f500b21f0 msgr2=0x7f8f50063060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:41.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f55a88700 1 --2- 172.21.15.62:0/501330521 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f500b21f0 0x7f8f50063060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:41.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f55a88700 1 -- 172.21.15.62:0/501330521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4000b180 con 0x7f8f500a7bb0 2021-12-17T18:26:41.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f56289700 1 --2- 172.21.15.62:0/501330521 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f500b21f0 0x7f8f50063060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:41.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f55a88700 1 --2- 172.21.15.62:0/501330521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f500a7bb0 0x7f8f50065b90 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f8f38001840 tx=0x7f8f38001720).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:41.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f4effd700 1 -- 172.21.15.62:0/501330521 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f38007170 con 0x7f8f500a7bb0 2021-12-17T18:26:41.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f4effd700 1 -- 172.21.15.62:0/501330521 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f380072d0 con 0x7f8f500a7bb0 2021-12-17T18:26:41.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f57cec700 1 -- 172.21.15.62:0/501330521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f50066a70 con 0x7f8f500a7bb0 2021-12-17T18:26:41.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f4effd700 1 -- 172.21.15.62:0/501330521 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f38004710 con 0x7f8f500a7bb0 2021-12-17T18:26:41.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f57cec700 1 -- 172.21.15.62:0/501330521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f500ac8b0 con 0x7f8f500a7bb0 2021-12-17T18:26:41.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f57cec700 1 -- 172.21.15.62:0/501330521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f500ad5a0 con 0x7f8f500a7bb0 2021-12-17T18:26:41.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f4effd700 1 -- 172.21.15.62:0/501330521 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8f3801b070 con 0x7f8f500a7bb0 2021-12-17T18:26:41.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f4effd700 1 --2- 172.21.15.62:0/501330521 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f340534f0 0x7f8f340559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:41.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f4effd700 1 -- 172.21.15.62:0/501330521 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8f3806af80 con 0x7f8f500a7bb0 2021-12-17T18:26:41.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.906+0000 7f8f55287700 1 --2- 172.21.15.62:0/501330521 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f340534f0 0x7f8f340559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:41.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.910+0000 7f8f55287700 1 --2- 172.21.15.62:0/501330521 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f340534f0 0x7f8f340559b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f8f4800d000 tx=0x7f8f48007da0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:41.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:41.914+0000 7f8f4effd700 1 -- 172.21.15.62:0/501330521 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8f380420e0 con 0x7f8f500a7bb0 2021-12-17T18:26:42.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.042+0000 7f8f57cec700 1 -- 172.21.15.62:0/501330521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f500573d0 con 0x7f8f500a7bb0 2021-12-17T18:26:42.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.042+0000 7f8f4effd700 1 -- 172.21.15.62:0/501330521 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f8f38045700 con 0x7f8f500a7bb0 2021-12-17T18:26:42.047 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:42.047 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":112,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:26:36.034630+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:26:33.681609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-12-17T18:26:34.037077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:26:42.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.042+0000 7f8f57cec700 1 -- 172.21.15.62:0/501330521 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f340534f0 msgr2=0x7f8f340559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.046+0000 7f8f57cec700 1 --2- 172.21.15.62:0/501330521 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f340534f0 0x7f8f340559b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f8f4800d000 tx=0x7f8f48007da0).stop 2021-12-17T18:26:42.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.046+0000 7f8f57cec700 1 -- 172.21.15.62:0/501330521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f500a7bb0 msgr2=0x7f8f50065b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.046+0000 7f8f57cec700 1 --2- 172.21.15.62:0/501330521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f500a7bb0 0x7f8f50065b90 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f8f38001840 tx=0x7f8f38001720).stop 2021-12-17T18:26:42.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.046+0000 7f8f57cec700 1 -- 172.21.15.62:0/501330521 shutdown_connections 2021-12-17T18:26:42.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.046+0000 7f8f57cec700 1 --2- 172.21.15.62:0/501330521 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f340534f0 0x7f8f340559b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.046+0000 7f8f57cec700 1 --2- 172.21.15.62:0/501330521 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f500b21f0 0x7f8f50063060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.046+0000 7f8f57cec700 1 --2- 172.21.15.62:0/501330521 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f500b1730 0x7f8f50066080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.046+0000 7f8f57cec700 1 --2- 172.21.15.62:0/501330521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f500a7bb0 0x7f8f50065b90 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.046+0000 7f8f57cec700 1 -- 172.21.15.62:0/501330521 >> 172.21.15.62:0/501330521 conn(0x7f8f5005f730 msgr2=0x7f8f50147970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:42.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.046+0000 7f8f57cec700 1 -- 172.21.15.62:0/501330521 shutdown_connections 2021-12-17T18:26:42.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.046+0000 7f8f57cec700 1 -- 172.21.15.62:0/501330521 wait complete. 2021-12-17T18:26:42.060 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:26:33.681609+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:26:34.037077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:26:42.061 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:26:42.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f41664e8700 1 Processor -- start 2021-12-17T18:26:42.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f41664e8700 1 -- start start 2021-12-17T18:26:42.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f41664e8700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f41600b41f0 0x7f4160146da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f41664e8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41600b2010 con 0x7f41600b5dd0 2021-12-17T18:26:42.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f41664e8700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41600b0990 con 0x7f41600b05b0 2021-12-17T18:26:42.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f41664e8700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4160147290 con 0x7f41600b41f0 2021-12-17T18:26:42.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f4157fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f41600b5dd0 0x7f4160141fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38840/0 (socket says 172.21.15.62:38840) 2021-12-17T18:26:42.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f4157fff700 1 -- 172.21.15.62:0/2571794294 learned_addr learned my addr 172.21.15.62:0/2571794294 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:42.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f4164a85700 1 --2- 172.21.15.62:0/2571794294 >> v2:172.21.15.109:3300/0 conn(0x7f41600b41f0 0x7f4160146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 -- 172.21.15.62:0/2571794294 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532354937 0 0) 0x7f41600b2010 con 0x7f41600b5dd0 2021-12-17T18:26:42.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 -- 172.21.15.62:0/2571794294 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4144003260 con 0x7f41600b5dd0 2021-12-17T18:26:42.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 -- 172.21.15.62:0/2571794294 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204603373 0 0) 0x7f41600b0990 con 0x7f41600b05b0 2021-12-17T18:26:42.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 -- 172.21.15.62:0/2571794294 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41600b2010 con 0x7f41600b05b0 2021-12-17T18:26:42.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 -- 172.21.15.62:0/2571794294 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 89820208 0 0) 0x7f4144003260 con 0x7f41600b5dd0 2021-12-17T18:26:42.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 -- 172.21.15.62:0/2571794294 >> v2:172.21.15.109:3300/0 conn(0x7f41600b41f0 msgr2=0x7f4160146da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:42.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 --2- 172.21.15.62:0/2571794294 >> v2:172.21.15.109:3300/0 conn(0x7f41600b41f0 0x7f4160146da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 -- 172.21.15.62:0/2571794294 >> v1:172.21.15.109:6789/0 conn(0x7f41600b05b0 legacy=0x7f4160146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 -- 172.21.15.62:0/2571794294 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41600b2240 con 0x7f41600b5dd0 2021-12-17T18:26:42.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 -- 172.21.15.62:0/2571794294 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f4150001660 con 0x7f41600b5dd0 2021-12-17T18:26:42.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 -- 172.21.15.62:0/2571794294 >> v1:172.21.15.62:6789/0 conn(0x7f41600b5dd0 legacy=0x7f4160141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 --2- 172.21.15.62:0/2571794294 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4144003910 0x7f4144003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 --2- 172.21.15.62:0/2571794294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4144004500 0x7f4144004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 --2- 172.21.15.62:0/2571794294 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4144004e70 0x7f414400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 -- 172.21.15.62:0/2571794294 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4160147290 con 0x7f4144004500 2021-12-17T18:26:42.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 -- 172.21.15.62:0/2571794294 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414400bd20 con 0x7f4144004e70 2021-12-17T18:26:42.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 -- 172.21.15.62:0/2571794294 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414400bee0 con 0x7f4144003910 2021-12-17T18:26:42.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f4157fff700 1 --2- 172.21.15.62:0/2571794294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4144004500 0x7f4144004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f4164a85700 1 --2- 172.21.15.62:0/2571794294 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4144004e70 0x7f414400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415ffff700 1 --2- 172.21.15.62:0/2571794294 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4144003910 0x7f4144003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f4157fff700 1 -- 172.21.15.62:0/2571794294 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4144003910 msgr2=0x7f4144003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:42.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f4157fff700 1 --2- 172.21.15.62:0/2571794294 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4144003910 0x7f4144003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f4157fff700 1 -- 172.21.15.62:0/2571794294 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4144004e70 msgr2=0x7f414400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:42.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f4157fff700 1 --2- 172.21.15.62:0/2571794294 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4144004e70 0x7f414400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f4157fff700 1 -- 172.21.15.62:0/2571794294 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4144003260 con 0x7f4144004500 2021-12-17T18:26:42.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f4164a85700 1 -- 172.21.15.62:0/2571794294 reap_dead start 2021-12-17T18:26:42.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415ffff700 1 --2- 172.21.15.62:0/2571794294 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4144003910 0x7f4144003d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:26:42.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f4157fff700 1 --2- 172.21.15.62:0/2571794294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4144004500 0x7f4144004980 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7f4150001430 tx=0x7f4150001dd0).ready entity=mon.0 client_cookie=8cb64e3e76bef572 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:42.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 -- 172.21.15.62:0/2571794294 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41500070d0 con 0x7f4144004500 2021-12-17T18:26:42.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 -- 172.21.15.62:0/2571794294 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4150007230 con 0x7f4144004500 2021-12-17T18:26:42.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.166+0000 7f415f7fe700 1 -- 172.21.15.62:0/2571794294 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f415000c8c0 con 0x7f4144004500 2021-12-17T18:26:42.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f41664e8700 1 -- 172.21.15.62:0/2571794294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4144004500 msgr2=0x7f4144004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f41664e8700 1 --2- 172.21.15.62:0/2571794294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4144004500 0x7f4144004980 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7f4150001430 tx=0x7f4150001dd0).stop 2021-12-17T18:26:42.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f41664e8700 1 -- 172.21.15.62:0/2571794294 shutdown_connections 2021-12-17T18:26:42.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f41664e8700 1 --2- 172.21.15.62:0/2571794294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4144004500 0x7f4144004980 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f41664e8700 1 -- 172.21.15.62:0/2571794294 >> 172.21.15.62:0/2571794294 conn(0x7f4160062510 msgr2=0x7f41600628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:42.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f41664e8700 1 -- 172.21.15.62:0/2571794294 shutdown_connections 2021-12-17T18:26:42.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f41664e8700 1 -- 172.21.15.62:0/2571794294 wait complete. 2021-12-17T18:26:42.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f41664e8700 1 Processor -- start 2021-12-17T18:26:42.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f41664e8700 1 -- start start 2021-12-17T18:26:42.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f41664e8700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4144004500 0x7f4160067160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f41664e8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416013eaf0 0x7f4160063700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f41664e8700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4160142370 0x7f41601427f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f41664e8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4160064ac0 con 0x7f416013eaf0 2021-12-17T18:26:42.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f41664e8700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4160065a40 con 0x7f4144004500 2021-12-17T18:26:42.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f41664e8700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41601466e0 con 0x7f4160142370 2021-12-17T18:26:42.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f4157fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416013eaf0 0x7f4160063700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f4157fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416013eaf0 0x7f4160063700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55274/0 (socket says 172.21.15.62:55274) 2021-12-17T18:26:42.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f4157fff700 1 -- 172.21.15.62:0/4016657811 learned_addr learned my addr 172.21.15.62:0/4016657811 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:42.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f415ffff700 1 --2- 172.21.15.62:0/4016657811 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4144004500 0x7f4160067160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f4164a85700 1 --2- 172.21.15.62:0/4016657811 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4160142370 0x7f41601427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f4157fff700 1 -- 172.21.15.62:0/4016657811 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4160142370 msgr2=0x7f41601427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f4157fff700 1 --2- 172.21.15.62:0/4016657811 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4160142370 0x7f41601427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f4157fff700 1 -- 172.21.15.62:0/4016657811 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4144004500 msgr2=0x7f4160067160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f4157fff700 1 --2- 172.21.15.62:0/4016657811 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4144004500 0x7f4160067160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f4157fff700 1 -- 172.21.15.62:0/4016657811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4160142ce0 con 0x7f416013eaf0 2021-12-17T18:26:42.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f4157fff700 1 --2- 172.21.15.62:0/4016657811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416013eaf0 0x7f4160063700 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f4150001430 tx=0x7f4150015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:42.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f415dffb700 1 -- 172.21.15.62:0/4016657811 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41500070d0 con 0x7f416013eaf0 2021-12-17T18:26:42.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f41664e8700 1 -- 172.21.15.62:0/4016657811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416013ef70 con 0x7f416013eaf0 2021-12-17T18:26:42.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f41664e8700 1 -- 172.21.15.62:0/4016657811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4160063d90 con 0x7f416013eaf0 2021-12-17T18:26:42.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f415dffb700 1 -- 172.21.15.62:0/4016657811 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415000c6a0 con 0x7f416013eaf0 2021-12-17T18:26:42.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.170+0000 7f415dffb700 1 -- 172.21.15.62:0/4016657811 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4150004520 con 0x7f416013eaf0 2021-12-17T18:26:42.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.174+0000 7f41664e8700 1 -- 172.21.15.62:0/4016657811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f413c003410 con 0x7f416013eaf0 2021-12-17T18:26:42.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.174+0000 7f415dffb700 1 -- 172.21.15.62:0/4016657811 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4150010070 con 0x7f416013eaf0 2021-12-17T18:26:42.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.174+0000 7f415dffb700 1 --2- 172.21.15.62:0/4016657811 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41380535b0 0x7f4138055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.174+0000 7f415dffb700 1 -- 172.21.15.62:0/4016657811 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f415006bfd0 con 0x7f416013eaf0 2021-12-17T18:26:42.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.174+0000 7f415ffff700 1 --2- 172.21.15.62:0/4016657811 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41380535b0 0x7f4138055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.174+0000 7f415ffff700 1 --2- 172.21.15.62:0/4016657811 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41380535b0 0x7f4138055a70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f414800c000 tx=0x7f4148009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:42.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.182+0000 7f415dffb700 1 -- 172.21.15.62:0/4016657811 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4150043090 con 0x7f416013eaf0 2021-12-17T18:26:42.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.302+0000 7f41664e8700 1 -- 172.21.15.62:0/4016657811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f413c003c40 con 0x7f416013eaf0 2021-12-17T18:26:42.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.306+0000 7f415dffb700 1 -- 172.21.15.62:0/4016657811 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v112) v1 ==== 110+0+10 (secure 0 0 0) 0x7f41500466b0 con 0x7f416013eaf0 2021-12-17T18:26:42.309 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:26:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.306+0000 7f41664e8700 1 -- 172.21.15.62:0/4016657811 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41380535b0 msgr2=0x7f4138055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.306+0000 7f41664e8700 1 --2- 172.21.15.62:0/4016657811 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41380535b0 0x7f4138055a70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f414800c000 tx=0x7f4148009040).stop 2021-12-17T18:26:42.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.306+0000 7f41664e8700 1 -- 172.21.15.62:0/4016657811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416013eaf0 msgr2=0x7f4160063700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.306+0000 7f41664e8700 1 --2- 172.21.15.62:0/4016657811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416013eaf0 0x7f4160063700 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f4150001430 tx=0x7f4150015000).stop 2021-12-17T18:26:42.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.306+0000 7f41664e8700 1 -- 172.21.15.62:0/4016657811 shutdown_connections 2021-12-17T18:26:42.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.306+0000 7f41664e8700 1 --2- 172.21.15.62:0/4016657811 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41380535b0 0x7f4138055a70 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.306+0000 7f41664e8700 1 --2- 172.21.15.62:0/4016657811 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4160142370 0x7f41601427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.306+0000 7f41664e8700 1 --2- 172.21.15.62:0/4016657811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416013eaf0 0x7f4160063700 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.306+0000 7f41664e8700 1 --2- 172.21.15.62:0/4016657811 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4144004500 0x7f4160067160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.306+0000 7f41664e8700 1 -- 172.21.15.62:0/4016657811 >> 172.21.15.62:0/4016657811 conn(0x7f4160062510 msgr2=0x7f4160143750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:42.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.306+0000 7f41664e8700 1 -- 172.21.15.62:0/4016657811 shutdown_connections 2021-12-17T18:26:42.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.306+0000 7f41664e8700 1 -- 172.21.15.62:0/4016657811 wait complete. 2021-12-17T18:26:42.322 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:26:42.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.426+0000 7efd0359e700 1 Processor -- start 2021-12-17T18:26:42.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0359e700 1 -- start start 2021-12-17T18:26:42.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efd040ac040 0x7efd041475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd04060750 con 0x7efd0405ca90 2021-12-17T18:26:42.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0359e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0414ac00 con 0x7efd04147ab0 2021-12-17T18:26:42.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0359e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0414ba50 con 0x7efd040ac040 2021-12-17T18:26:42.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0259c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7efd0405ca90 0x7efd0414b340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38860/0 (socket says 172.21.15.62:38860) 2021-12-17T18:26:42.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0259c700 1 -- 172.21.15.62:0/505022485 learned_addr learned my addr 172.21.15.62:0/505022485 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:42.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd01d9b700 1 --2- 172.21.15.62:0/505022485 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efd040ac040 0x7efd041475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0159a700 1 -- 172.21.15.62:0/505022485 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098105217 0 0) 0x7efd0414ac00 con 0x7efd04147ab0 2021-12-17T18:26:42.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0159a700 1 -- 172.21.15.62:0/505022485 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efce8003260 con 0x7efd04147ab0 2021-12-17T18:26:42.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0159a700 1 -- 172.21.15.62:0/505022485 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757089400 0 0) 0x7efd04060750 con 0x7efd0405ca90 2021-12-17T18:26:42.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0159a700 1 -- 172.21.15.62:0/505022485 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd0414ac00 con 0x7efd0405ca90 2021-12-17T18:26:42.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd01d9b700 1 -- 172.21.15.62:0/505022485 >> v1:172.21.15.109:6789/0 conn(0x7efd04147ab0 legacy=0x7efd04146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd01d9b700 1 -- 172.21.15.62:0/505022485 >> v1:172.21.15.62:6789/0 conn(0x7efd0405ca90 legacy=0x7efd0414b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd01d9b700 1 -- 172.21.15.62:0/505022485 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0414aea0 con 0x7efd040ac040 2021-12-17T18:26:42.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd01d9b700 1 --2- 172.21.15.62:0/505022485 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efd040ac040 0x7efd041475c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7efcf4002f70 tx=0x7efcf4006df0).ready entity=mon.2 client_cookie=5748d5cc8076d2be server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:42.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0159a700 1 -- 172.21.15.62:0/505022485 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcf400d5c0 con 0x7efd040ac040 2021-12-17T18:26:42.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0159a700 1 -- 172.21.15.62:0/505022485 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf4000e90 con 0x7efd040ac040 2021-12-17T18:26:42.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0159a700 1 -- 172.21.15.62:0/505022485 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcf400d910 con 0x7efd040ac040 2021-12-17T18:26:42.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0359e700 1 -- 172.21.15.62:0/505022485 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efd040ac040 msgr2=0x7efd041475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0359e700 1 --2- 172.21.15.62:0/505022485 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efd040ac040 0x7efd041475c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7efcf4002f70 tx=0x7efcf4006df0).stop 2021-12-17T18:26:42.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0359e700 1 -- 172.21.15.62:0/505022485 shutdown_connections 2021-12-17T18:26:42.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0359e700 1 --2- 172.21.15.62:0/505022485 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efd040ac040 0x7efd041475c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.430+0000 7efd0359e700 1 -- 172.21.15.62:0/505022485 >> 172.21.15.62:0/505022485 conn(0x7efd0405be70 msgr2=0x7efd04062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:42.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd0359e700 1 -- 172.21.15.62:0/505022485 shutdown_connections 2021-12-17T18:26:42.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd0359e700 1 -- 172.21.15.62:0/505022485 wait complete. 2021-12-17T18:26:42.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd0359e700 1 Processor -- start 2021-12-17T18:26:42.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd0359e700 1 -- start start 2021-12-17T18:26:42.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd0359e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efd0405ca90 0x7efd04145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd0359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efd040ac040 0x7efd041446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd0359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd04147ab0 0x7efd04144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd0359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd040a2840 con 0x7efd04147ab0 2021-12-17T18:26:42.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd0359e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd040a1e10 con 0x7efd0405ca90 2021-12-17T18:26:42.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd0359e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd040a23a0 con 0x7efd040ac040 2021-12-17T18:26:42.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd02d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd04147ab0 0x7efd04144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd02d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd04147ab0 0x7efd04144bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55288/0 (socket says 172.21.15.62:55288) 2021-12-17T18:26:42.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd02d9d700 1 -- 172.21.15.62:0/1441588918 learned_addr learned my addr 172.21.15.62:0/1441588918 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:42.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd01d9b700 1 --2- 172.21.15.62:0/1441588918 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efd040ac040 0x7efd041446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd0259c700 1 --2- 172.21.15.62:0/1441588918 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efd0405ca90 0x7efd04145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd02d9d700 1 -- 172.21.15.62:0/1441588918 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efd040ac040 msgr2=0x7efd041446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd02d9d700 1 --2- 172.21.15.62:0/1441588918 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efd040ac040 0x7efd041446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd02d9d700 1 -- 172.21.15.62:0/1441588918 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efd0405ca90 msgr2=0x7efd04145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd02d9d700 1 --2- 172.21.15.62:0/1441588918 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efd0405ca90 0x7efd04145b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd02d9d700 1 -- 172.21.15.62:0/1441588918 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf400b180 con 0x7efd04147ab0 2021-12-17T18:26:42.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.434+0000 7efd01d9b700 1 --2- 172.21.15.62:0/1441588918 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efd040ac040 0x7efd041446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:42.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.438+0000 7efd02d9d700 1 --2- 172.21.15.62:0/1441588918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd04147ab0 0x7efd04144bb0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7efcfc001490 tx=0x7efcfc007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:42.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.438+0000 7efcf37fe700 1 -- 172.21.15.62:0/1441588918 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcfc002310 con 0x7efd04147ab0 2021-12-17T18:26:42.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.438+0000 7efcf37fe700 1 -- 172.21.15.62:0/1441588918 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc002470 con 0x7efd04147ab0 2021-12-17T18:26:42.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.438+0000 7efcf37fe700 1 -- 172.21.15.62:0/1441588918 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcfc0017a0 con 0x7efd04147ab0 2021-12-17T18:26:42.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.438+0000 7efd0359e700 1 -- 172.21.15.62:0/1441588918 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd040a20e0 con 0x7efd04147ab0 2021-12-17T18:26:42.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.438+0000 7efd0359e700 1 -- 172.21.15.62:0/1441588918 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd041450a0 con 0x7efd04147ab0 2021-12-17T18:26:42.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.438+0000 7efd0359e700 1 -- 172.21.15.62:0/1441588918 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0405ce70 con 0x7efd04147ab0 2021-12-17T18:26:42.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.438+0000 7efcf37fe700 1 -- 172.21.15.62:0/1441588918 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efcfc010030 con 0x7efd04147ab0 2021-12-17T18:26:42.451 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.438+0000 7efcf37fe700 1 --2- 172.21.15.62:0/1441588918 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efce0053610 0x7efce0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.438+0000 7efcf37fe700 1 -- 172.21.15.62:0/1441588918 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efcfc06b9e0 con 0x7efd04147ab0 2021-12-17T18:26:42.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.438+0000 7efd0259c700 1 --2- 172.21.15.62:0/1441588918 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efce0053610 0x7efce0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.442+0000 7efd0259c700 1 --2- 172.21.15.62:0/1441588918 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efce0053610 0x7efce0055ad0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7efcf800b000 tx=0x7efcf8009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:42.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.442+0000 7efcf37fe700 1 -- 172.21.15.62:0/1441588918 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efcfc042a30 con 0x7efd04147ab0 2021-12-17T18:26:42.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.570+0000 7efd0359e700 1 -- 172.21.15.62:0/1441588918 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efd040573d0 con 0x7efd04147ab0 2021-12-17T18:26:42.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.570+0000 7efcf37fe700 1 -- 172.21.15.62:0/1441588918 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v112) v1 ==== 92+0+10 (secure 0 0 0) 0x7efcfc046050 con 0x7efd04147ab0 2021-12-17T18:26:42.574 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:26:42.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.570+0000 7efd0359e700 1 -- 172.21.15.62:0/1441588918 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efce0053610 msgr2=0x7efce0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.570+0000 7efd0359e700 1 --2- 172.21.15.62:0/1441588918 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efce0053610 0x7efce0055ad0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7efcf800b000 tx=0x7efcf8009040).stop 2021-12-17T18:26:42.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.570+0000 7efd0359e700 1 -- 172.21.15.62:0/1441588918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd04147ab0 msgr2=0x7efd04144bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.570+0000 7efd0359e700 1 --2- 172.21.15.62:0/1441588918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd04147ab0 0x7efd04144bb0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7efcfc001490 tx=0x7efcfc007dc0).stop 2021-12-17T18:26:42.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.570+0000 7efd0359e700 1 -- 172.21.15.62:0/1441588918 shutdown_connections 2021-12-17T18:26:42.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.570+0000 7efd0359e700 1 --2- 172.21.15.62:0/1441588918 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efce0053610 0x7efce0055ad0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.570+0000 7efd0359e700 1 --2- 172.21.15.62:0/1441588918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd04147ab0 0x7efd04144bb0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.570+0000 7efd0359e700 1 --2- 172.21.15.62:0/1441588918 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efd040ac040 0x7efd041446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.570+0000 7efd0359e700 1 --2- 172.21.15.62:0/1441588918 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efd0405ca90 0x7efd04145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.570+0000 7efd0359e700 1 -- 172.21.15.62:0/1441588918 >> 172.21.15.62:0/1441588918 conn(0x7efd0405be70 msgr2=0x7efd040afe20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:42.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.570+0000 7efd0359e700 1 -- 172.21.15.62:0/1441588918 shutdown_connections 2021-12-17T18:26:42.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.570+0000 7efd0359e700 1 -- 172.21.15.62:0/1441588918 wait complete. 2021-12-17T18:26:42.587 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:26:42.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.690+0000 7f118759e700 1 Processor -- start 2021-12-17T18:26:42.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.690+0000 7f118759e700 1 -- start start 2021-12-17T18:26:42.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.690+0000 7f118759e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f11880b6700 0x7f1188143200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.690+0000 7f118759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f11880ad630 0x7f118813f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.690+0000 7f118759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1188067840 con 0x7f1188064110 2021-12-17T18:26:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.690+0000 7f118759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1188066840 con 0x7f11880ad630 2021-12-17T18:26:42.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.690+0000 7f118759e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1188064b70 con 0x7f11880b6700 2021-12-17T18:26:42.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f1186d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f11880ad630 0x7f118813f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f1186d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f11880ad630 0x7f118813f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55294/0 (socket says 172.21.15.62:55294) 2021-12-17T18:26:42.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f1185d9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1188064110 0x7f118805f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38878/0 (socket says 172.21.15.62:38878) 2021-12-17T18:26:42.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f1186d9d700 1 -- 172.21.15.62:0/853325623 learned_addr learned my addr 172.21.15.62:0/853325623 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:42.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f118659c700 1 --2- 172.21.15.62:0/853325623 >> v2:172.21.15.109:3300/0 conn(0x7f11880b6700 0x7f1188143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f1186d9d700 1 -- 172.21.15.62:0/853325623 >> v2:172.21.15.109:3300/0 conn(0x7f11880b6700 msgr2=0x7f1188143200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:42.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f1186d9d700 1 --2- 172.21.15.62:0/853325623 >> v2:172.21.15.109:3300/0 conn(0x7f11880b6700 0x7f1188143200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f1186d9d700 1 -- 172.21.15.62:0/853325623 >> v1:172.21.15.62:6789/0 conn(0x7f1188064110 legacy=0x7f118805f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f1186d9d700 1 -- 172.21.15.62:0/853325623 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11880adac0 con 0x7f11880ad630 2021-12-17T18:26:42.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f118659c700 1 --2- 172.21.15.62:0/853325623 >> v2:172.21.15.109:3300/0 conn(0x7f11880b6700 0x7f1188143200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:26:42.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f1186d9d700 1 --2- 172.21.15.62:0/853325623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11880ad630 0x7f118813f590 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f11800032f0 tx=0x7f1180009290).ready entity=mon.0 client_cookie=a4e6c72f42a556ec server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:42.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f118559a700 1 -- 172.21.15.62:0/853325623 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f118000b870 con 0x7f11880ad630 2021-12-17T18:26:42.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f118559a700 1 -- 172.21.15.62:0/853325623 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118000b9d0 con 0x7f11880ad630 2021-12-17T18:26:42.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f118559a700 1 -- 172.21.15.62:0/853325623 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f118000bb40 con 0x7f11880ad630 2021-12-17T18:26:42.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f118759e700 1 -- 172.21.15.62:0/853325623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11880ad630 msgr2=0x7f118813f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f118759e700 1 --2- 172.21.15.62:0/853325623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11880ad630 0x7f118813f590 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f11800032f0 tx=0x7f1180009290).stop 2021-12-17T18:26:42.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f118759e700 1 -- 172.21.15.62:0/853325623 shutdown_connections 2021-12-17T18:26:42.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f118759e700 1 --2- 172.21.15.62:0/853325623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11880ad630 0x7f118813f590 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f118759e700 1 --2- 172.21.15.62:0/853325623 >> v2:172.21.15.109:3300/0 conn(0x7f11880b6700 0x7f1188143200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f118759e700 1 -- 172.21.15.62:0/853325623 >> 172.21.15.62:0/853325623 conn(0x7f118805c750 msgr2=0x7f11880b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:42.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f118759e700 1 -- 172.21.15.62:0/853325623 shutdown_connections 2021-12-17T18:26:42.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.694+0000 7f118759e700 1 -- 172.21.15.62:0/853325623 wait complete. 2021-12-17T18:26:42.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.698+0000 7f118759e700 1 Processor -- start 2021-12-17T18:26:42.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.698+0000 7f118759e700 1 -- start start 2021-12-17T18:26:42.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.698+0000 7f118759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1188064110 0x7f118813c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.698+0000 7f118759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11880ad630 0x7f1188155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.698+0000 7f118759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f11880b6700 0x7f11880af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.698+0000 7f118759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11880ae190 con 0x7f11880ad630 2021-12-17T18:26:42.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.698+0000 7f118759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1188155c30 con 0x7f1188064110 2021-12-17T18:26:42.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.698+0000 7f118759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1188140f60 con 0x7f11880b6700 2021-12-17T18:26:42.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.698+0000 7f1185d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11880ad630 0x7f1188155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.698+0000 7f1185d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11880ad630 0x7f1188155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55302/0 (socket says 172.21.15.62:55302) 2021-12-17T18:26:42.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.698+0000 7f1185d9b700 1 -- 172.21.15.62:0/1250103464 learned_addr learned my addr 172.21.15.62:0/1250103464 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:42.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.698+0000 7f1186d9d700 1 --2- 172.21.15.62:0/1250103464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f11880b6700 0x7f11880af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.698+0000 7f118659c700 1 --2- 172.21.15.62:0/1250103464 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1188064110 0x7f118813c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.702+0000 7f1185d9b700 1 -- 172.21.15.62:0/1250103464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f11880b6700 msgr2=0x7f11880af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.702+0000 7f1185d9b700 1 --2- 172.21.15.62:0/1250103464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f11880b6700 0x7f11880af380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.702+0000 7f1185d9b700 1 -- 172.21.15.62:0/1250103464 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1188064110 msgr2=0x7f118813c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.702+0000 7f1185d9b700 1 --2- 172.21.15.62:0/1250103464 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1188064110 0x7f118813c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.702+0000 7f1185d9b700 1 -- 172.21.15.62:0/1250103464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1180009530 con 0x7f11880ad630 2021-12-17T18:26:42.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.702+0000 7f1185d9b700 1 --2- 172.21.15.62:0/1250103464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11880ad630 0x7f1188155740 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f118813dac0 tx=0x7f1170007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:42.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.710+0000 7f117f7fe700 1 -- 172.21.15.62:0/1250103464 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11700070d0 con 0x7f11880ad630 2021-12-17T18:26:42.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.710+0000 7f117f7fe700 1 -- 172.21.15.62:0/1250103464 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1170007230 con 0x7f11880ad630 2021-12-17T18:26:42.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.710+0000 7f118759e700 1 -- 172.21.15.62:0/1250103464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1188141200 con 0x7f11880ad630 2021-12-17T18:26:42.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.710+0000 7f117f7fe700 1 -- 172.21.15.62:0/1250103464 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1170005740 con 0x7f11880ad630 2021-12-17T18:26:42.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.710+0000 7f118759e700 1 -- 172.21.15.62:0/1250103464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1188140820 con 0x7f11880ad630 2021-12-17T18:26:42.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.710+0000 7f118759e700 1 -- 172.21.15.62:0/1250103464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1188140d60 con 0x7f11880ad630 2021-12-17T18:26:42.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.710+0000 7f117f7fe700 1 -- 172.21.15.62:0/1250103464 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1170010070 con 0x7f11880ad630 2021-12-17T18:26:42.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.710+0000 7f117f7fe700 1 --2- 172.21.15.62:0/1250103464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f116c053640 0x7f116c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.710+0000 7f117f7fe700 1 -- 172.21.15.62:0/1250103464 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f117006ad80 con 0x7f11880ad630 2021-12-17T18:26:42.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.710+0000 7f118659c700 1 --2- 172.21.15.62:0/1250103464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f116c053640 0x7f116c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.714+0000 7f118659c700 1 --2- 172.21.15.62:0/1250103464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f116c053640 0x7f116c055b00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f117800d000 tx=0x7f1178008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:42.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.718+0000 7f117f7fe700 1 -- 172.21.15.62:0/1250103464 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1170041ee0 con 0x7f11880ad630 2021-12-17T18:26:42.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.850+0000 7f118759e700 1 -- 172.21.15.62:0/1250103464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1188067a70 con 0x7f11880ad630 2021-12-17T18:26:42.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.850+0000 7f117f7fe700 1 -- 172.21.15.62:0/1250103464 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+10 (secure 0 0 0) 0x7f117006c020 con 0x7f11880ad630 2021-12-17T18:26:42.855 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:26:42.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.854+0000 7f118759e700 1 -- 172.21.15.62:0/1250103464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f116c053640 msgr2=0x7f116c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.854+0000 7f118759e700 1 --2- 172.21.15.62:0/1250103464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f116c053640 0x7f116c055b00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f117800d000 tx=0x7f1178008040).stop 2021-12-17T18:26:42.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.854+0000 7f118759e700 1 -- 172.21.15.62:0/1250103464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11880ad630 msgr2=0x7f1188155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.854+0000 7f118759e700 1 --2- 172.21.15.62:0/1250103464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11880ad630 0x7f1188155740 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f118813dac0 tx=0x7f1170007c00).stop 2021-12-17T18:26:42.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.854+0000 7f118759e700 1 -- 172.21.15.62:0/1250103464 shutdown_connections 2021-12-17T18:26:42.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.854+0000 7f118759e700 1 --2- 172.21.15.62:0/1250103464 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f116c053640 0x7f116c055b00 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.854+0000 7f118759e700 1 --2- 172.21.15.62:0/1250103464 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f11880b6700 0x7f11880af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.854+0000 7f118759e700 1 --2- 172.21.15.62:0/1250103464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11880ad630 0x7f1188155740 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.854+0000 7f118759e700 1 --2- 172.21.15.62:0/1250103464 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1188064110 0x7f118813c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.854+0000 7f118759e700 1 -- 172.21.15.62:0/1250103464 >> 172.21.15.62:0/1250103464 conn(0x7f118805c750 msgr2=0x7f1188136810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:42.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.854+0000 7f118759e700 1 -- 172.21.15.62:0/1250103464 shutdown_connections 2021-12-17T18:26:42.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.854+0000 7f118759e700 1 -- 172.21.15.62:0/1250103464 wait complete. 2021-12-17T18:26:42.873 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:26:42.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.978+0000 7f4602b06700 1 Processor -- start 2021-12-17T18:26:42.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.978+0000 7f4602b06700 1 -- start start 2021-12-17T18:26:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.978+0000 7f4602b06700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f45fc05ca90 0x7f45fc0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.978+0000 7f4602b06700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0b3540 0x7f45fc0b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.978+0000 7f4602b06700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f45fc0b4230 0x7f45fc0b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.978+0000 7f4602b06700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45fc05ce70 con 0x7f45fc0b4230 2021-12-17T18:26:42.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.978+0000 7f4602b06700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45fc0b1bc0 con 0x7f45fc05ca90 2021-12-17T18:26:42.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.978+0000 7f4602b06700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0b1e60 con 0x7f45fc0b3540 2021-12-17T18:26:42.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.978+0000 7f4602305700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f45fc0b4230 0x7f45fc0b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.978+0000 7f4602305700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f45fc0b4230 0x7f45fc0b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55312/0 (socket says 172.21.15.62:55312) 2021-12-17T18:26:42.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.978+0000 7f4602305700 1 -- 172.21.15.62:0/4184541400 learned_addr learned my addr 172.21.15.62:0/4184541400 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:42.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4601303700 1 --2- 172.21.15.62:0/4184541400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0b3540 0x7f45fc0b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4601b04700 1 --2- 172.21.15.62:0/4184541400 >> v2:172.21.15.109:3300/0 conn(0x7f45fc05ca90 0x7f45fc0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:42.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602305700 1 -- 172.21.15.62:0/4184541400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0b3540 msgr2=0x7f45fc0b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:42.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602305700 1 --2- 172.21.15.62:0/4184541400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0b3540 0x7f45fc0b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602305700 1 -- 172.21.15.62:0/4184541400 >> v2:172.21.15.109:3300/0 conn(0x7f45fc05ca90 msgr2=0x7f45fc0b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:42.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602305700 1 --2- 172.21.15.62:0/4184541400 >> v2:172.21.15.109:3300/0 conn(0x7f45fc05ca90 0x7f45fc0b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602305700 1 -- 172.21.15.62:0/4184541400 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc0b2100 con 0x7f45fc0b4230 2021-12-17T18:26:42.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602305700 1 --2- 172.21.15.62:0/4184541400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc0b4230 0x7f45fc0b5460 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f45f40032f0 tx=0x7f45f4009290).ready entity=mon.0 client_cookie=a342fa23f75f6f10 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:42.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4600b02700 1 -- 172.21.15.62:0/4184541400 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f400b870 con 0x7f45fc0b4230 2021-12-17T18:26:42.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4600b02700 1 -- 172.21.15.62:0/4184541400 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f400b9d0 con 0x7f45fc0b4230 2021-12-17T18:26:42.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4600b02700 1 -- 172.21.15.62:0/4184541400 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f400bb40 con 0x7f45fc0b4230 2021-12-17T18:26:42.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602b06700 1 -- 172.21.15.62:0/4184541400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc0b4230 msgr2=0x7f45fc0b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:42.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602b06700 1 --2- 172.21.15.62:0/4184541400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc0b4230 0x7f45fc0b5460 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f45f40032f0 tx=0x7f45f4009290).stop 2021-12-17T18:26:42.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602b06700 1 -- 172.21.15.62:0/4184541400 shutdown_connections 2021-12-17T18:26:42.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602b06700 1 --2- 172.21.15.62:0/4184541400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc0b4230 0x7f45fc0b5460 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602b06700 1 --2- 172.21.15.62:0/4184541400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0b3540 0x7f45fc0b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602b06700 1 --2- 172.21.15.62:0/4184541400 >> v2:172.21.15.109:3300/0 conn(0x7f45fc05ca90 0x7f45fc0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:42.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602b06700 1 -- 172.21.15.62:0/4184541400 >> 172.21.15.62:0/4184541400 conn(0x7f45fc05bcd0 msgr2=0x7f45fc062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:42.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602b06700 1 -- 172.21.15.62:0/4184541400 shutdown_connections 2021-12-17T18:26:42.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602b06700 1 -- 172.21.15.62:0/4184541400 wait complete. 2021-12-17T18:26:42.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602b06700 1 Processor -- start 2021-12-17T18:26:42.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602b06700 1 -- start start 2021-12-17T18:26:42.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602b06700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45fc05ca90 0x7f45fc1562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602b06700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0b3540 0x7f45fc0a2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602b06700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc0b4230 0x7f45fc1414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:42.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602b06700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc1567e0 con 0x7f45fc0b4230 2021-12-17T18:26:42.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602b06700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc155910 con 0x7f45fc05ca90 2021-12-17T18:26:42.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602b06700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc155bb0 con 0x7f45fc0b3540 2021-12-17T18:26:42.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602305700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc0b4230 0x7f45fc1414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:43.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4601303700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0b3540 0x7f45fc0a2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:43.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602305700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc0b4230 0x7f45fc1414d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55318/0 (socket says 172.21.15.62:55318) 2021-12-17T18:26:43.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4602305700 1 -- 172.21.15.62:0/3261253392 learned_addr learned my addr 172.21.15.62:0/3261253392 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:43.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.982+0000 7f4601b04700 1 --2- 172.21.15.62:0/3261253392 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45fc05ca90 0x7f45fc1562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:43.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.986+0000 7f4602305700 1 -- 172.21.15.62:0/3261253392 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0b3540 msgr2=0x7f45fc0a2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:43.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.986+0000 7f4602305700 1 --2- 172.21.15.62:0/3261253392 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0b3540 0x7f45fc0a2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:43.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.986+0000 7f4602305700 1 -- 172.21.15.62:0/3261253392 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45fc05ca90 msgr2=0x7f45fc1562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:43.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.986+0000 7f4602305700 1 --2- 172.21.15.62:0/3261253392 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45fc05ca90 0x7f45fc1562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:43.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.986+0000 7f4602305700 1 -- 172.21.15.62:0/3261253392 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f4009530 con 0x7f45fc0b4230 2021-12-17T18:26:43.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.986+0000 7f4602305700 1 --2- 172.21.15.62:0/3261253392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc0b4230 0x7f45fc1414d0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f45f40032f0 tx=0x7f45f4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:43.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.986+0000 7f45eaffd700 1 -- 172.21.15.62:0/3261253392 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f400b870 con 0x7f45fc0b4230 2021-12-17T18:26:43.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.986+0000 7f45eaffd700 1 -- 172.21.15.62:0/3261253392 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f4021630 con 0x7f45fc0b4230 2021-12-17T18:26:43.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.986+0000 7f45eaffd700 1 -- 172.21.15.62:0/3261253392 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f4021990 con 0x7f45fc0b4230 2021-12-17T18:26:43.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.986+0000 7f4602b06700 1 -- 172.21.15.62:0/3261253392 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45fc155e50 con 0x7f45fc0b4230 2021-12-17T18:26:43.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.986+0000 7f4602b06700 1 -- 172.21.15.62:0/3261253392 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc1459a0 con 0x7f45fc0b4230 2021-12-17T18:26:43.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.986+0000 7f4602b06700 1 -- 172.21.15.62:0/3261253392 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc155fe0 con 0x7f45fc0b4230 2021-12-17T18:26:43.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.986+0000 7f45eaffd700 1 -- 172.21.15.62:0/3261253392 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f45f4029070 con 0x7f45fc0b4230 2021-12-17T18:26:43.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.986+0000 7f45eaffd700 1 --2- 172.21.15.62:0/3261253392 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45dc053580 0x7f45dc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:43.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.986+0000 7f45eaffd700 1 -- 172.21.15.62:0/3261253392 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f45f406c7e0 con 0x7f45fc0b4230 2021-12-17T18:26:43.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.986+0000 7f4601b04700 1 --2- 172.21.15.62:0/3261253392 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45dc053580 0x7f45dc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:43.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.990+0000 7f4601b04700 1 --2- 172.21.15.62:0/3261253392 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45dc053580 0x7f45dc055a40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f45ec00c000 tx=0x7f45ec008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:43.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:42.994+0000 7f45eaffd700 1 -- 172.21.15.62:0/3261253392 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f45f4043830 con 0x7f45fc0b4230 2021-12-17T18:26:43.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.118+0000 7f4602b06700 1 -- 172.21.15.62:0/3261253392 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45fc0603f0 con 0x7f45fc0b4230 2021-12-17T18:26:43.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.118+0000 7f45eaffd700 1 -- 172.21.15.62:0/3261253392 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+10 (secure 0 0 0) 0x7f45f4015020 con 0x7f45fc0b4230 2021-12-17T18:26:43.130 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:26:43.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.122+0000 7f4602b06700 1 -- 172.21.15.62:0/3261253392 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45dc053580 msgr2=0x7f45dc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:43.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.122+0000 7f4602b06700 1 --2- 172.21.15.62:0/3261253392 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45dc053580 0x7f45dc055a40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f45ec00c000 tx=0x7f45ec008040).stop 2021-12-17T18:26:43.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.122+0000 7f4602b06700 1 -- 172.21.15.62:0/3261253392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc0b4230 msgr2=0x7f45fc1414d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:43.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.122+0000 7f4602b06700 1 --2- 172.21.15.62:0/3261253392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc0b4230 0x7f45fc1414d0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f45f40032f0 tx=0x7f45f4016000).stop 2021-12-17T18:26:43.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.122+0000 7f4602b06700 1 -- 172.21.15.62:0/3261253392 shutdown_connections 2021-12-17T18:26:43.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.122+0000 7f4602b06700 1 --2- 172.21.15.62:0/3261253392 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f45dc053580 0x7f45dc055a40 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:43.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.122+0000 7f4602b06700 1 --2- 172.21.15.62:0/3261253392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc0b4230 0x7f45fc1414d0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:43.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.122+0000 7f4602b06700 1 --2- 172.21.15.62:0/3261253392 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f45fc0b3540 0x7f45fc0a2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:43.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.122+0000 7f4602b06700 1 --2- 172.21.15.62:0/3261253392 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f45fc05ca90 0x7f45fc1562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:43.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.122+0000 7f4602b06700 1 -- 172.21.15.62:0/3261253392 >> 172.21.15.62:0/3261253392 conn(0x7f45fc05bcd0 msgr2=0x7f45fc062410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:43.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.122+0000 7f4602b06700 1 -- 172.21.15.62:0/3261253392 shutdown_connections 2021-12-17T18:26:43.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.122+0000 7f4602b06700 1 -- 172.21.15.62:0/3261253392 wait complete. 2021-12-17T18:26:43.137 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:26:43.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:26:43.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f5154b0d700 1 Processor -- start 2021-12-17T18:26:43.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f5154b0d700 1 -- start start 2021-12-17T18:26:43.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f5154b0d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f51500b5fc0 0x7f515014ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:43.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f5154b0d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f51500b10f0 0x7f515014b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:43.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f5154b0d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51500af6d0 con 0x7f51500ad7a0 2021-12-17T18:26:43.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f5154b0d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51500b63a0 con 0x7f51500b10f0 2021-12-17T18:26:43.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f5154b0d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51500af900 con 0x7f51500b5fc0 2021-12-17T18:26:43.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f514effd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f51500b10f0 0x7f515014b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:43.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f514ffff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f51500ad7a0 0x7f515014ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38906/0 (socket says 172.21.15.62:38906) 2021-12-17T18:26:43.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f514ffff700 1 -- 172.21.15.62:0/432271659 learned_addr learned my addr 172.21.15.62:0/432271659 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:43.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f514f7fe700 1 --2- 172.21.15.62:0/432271659 >> v2:172.21.15.109:3300/0 conn(0x7f51500b5fc0 0x7f515014ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:43.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f514effd700 1 -- 172.21.15.62:0/432271659 >> v2:172.21.15.109:3300/0 conn(0x7f51500b5fc0 msgr2=0x7f515014ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:43.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f514effd700 1 --2- 172.21.15.62:0/432271659 >> v2:172.21.15.109:3300/0 conn(0x7f51500b5fc0 0x7f515014ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:43.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f514effd700 1 -- 172.21.15.62:0/432271659 >> v1:172.21.15.62:6789/0 conn(0x7f51500ad7a0 legacy=0x7f515014ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:43.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f514effd700 1 -- 172.21.15.62:0/432271659 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51500b0b40 con 0x7f51500b10f0 2021-12-17T18:26:43.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f514effd700 1 --2- 172.21.15.62:0/432271659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51500b10f0 0x7f515014b170 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f5138002f70 tx=0x7f5138006df0).ready entity=mon.0 client_cookie=3ddcee46efcbf847 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:43.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f514e7fc700 1 -- 172.21.15.62:0/432271659 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f513800d570 con 0x7f51500b10f0 2021-12-17T18:26:43.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f514e7fc700 1 -- 172.21.15.62:0/432271659 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5138000e90 con 0x7f51500b10f0 2021-12-17T18:26:43.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f514e7fc700 1 -- 172.21.15.62:0/432271659 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f513800d8c0 con 0x7f51500b10f0 2021-12-17T18:26:43.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f5154b0d700 1 -- 172.21.15.62:0/432271659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51500b10f0 msgr2=0x7f515014b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:43.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.238+0000 7f5154b0d700 1 --2- 172.21.15.62:0/432271659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51500b10f0 0x7f515014b170 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f5138002f70 tx=0x7f5138006df0).stop 2021-12-17T18:26:43.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f5154b0d700 1 -- 172.21.15.62:0/432271659 shutdown_connections 2021-12-17T18:26:43.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f5154b0d700 1 --2- 172.21.15.62:0/432271659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51500b10f0 0x7f515014b170 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:43.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f5154b0d700 1 --2- 172.21.15.62:0/432271659 >> v2:172.21.15.109:3300/0 conn(0x7f51500b5fc0 0x7f515014ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:43.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f5154b0d700 1 -- 172.21.15.62:0/432271659 >> 172.21.15.62:0/432271659 conn(0x7f515005c750 msgr2=0x7f515005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:43.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f5154b0d700 1 -- 172.21.15.62:0/432271659 shutdown_connections 2021-12-17T18:26:43.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f5154b0d700 1 -- 172.21.15.62:0/432271659 wait complete. 2021-12-17T18:26:43.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f5154b0d700 1 Processor -- start 2021-12-17T18:26:43.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f5154b0d700 1 -- start start 2021-12-17T18:26:43.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f5154b0d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51500ad7a0 0x7f51500aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:43.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f5154b0d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51500b10f0 0x7f51500a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:43.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f5154b0d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51500b5fc0 0x7f51500a8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:43.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f5154b0d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51500a9ce0 con 0x7f51500b5fc0 2021-12-17T18:26:43.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f5154b0d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51500ab870 con 0x7f51500ad7a0 2021-12-17T18:26:43.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f5154b0d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51500ab5d0 con 0x7f51500b10f0 2021-12-17T18:26:43.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f514ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51500b5fc0 0x7f51500a8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:43.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f514ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51500b5fc0 0x7f51500a8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55330/0 (socket says 172.21.15.62:55330) 2021-12-17T18:26:43.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f514ffff700 1 -- 172.21.15.62:0/1279904614 learned_addr learned my addr 172.21.15.62:0/1279904614 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:43.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f514f7fe700 1 --2- 172.21.15.62:0/1279904614 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51500ad7a0 0x7f51500aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:43.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f514effd700 1 --2- 172.21.15.62:0/1279904614 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51500b10f0 0x7f51500a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:43.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f514ffff700 1 -- 172.21.15.62:0/1279904614 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51500b10f0 msgr2=0x7f51500a7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:43.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f514ffff700 1 --2- 172.21.15.62:0/1279904614 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51500b10f0 0x7f51500a7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:43.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f514ffff700 1 -- 172.21.15.62:0/1279904614 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51500ad7a0 msgr2=0x7f51500aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:43.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f514ffff700 1 --2- 172.21.15.62:0/1279904614 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51500ad7a0 0x7f51500aad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:43.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f514ffff700 1 -- 172.21.15.62:0/1279904614 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513800b180 con 0x7f51500b5fc0 2021-12-17T18:26:43.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f514f7fe700 1 --2- 172.21.15.62:0/1279904614 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51500ad7a0 0x7f51500aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:43.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.242+0000 7f514ffff700 1 --2- 172.21.15.62:0/1279904614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51500b5fc0 0x7f51500a8340 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f5150062a60 tx=0x7f5148007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:43.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.246+0000 7f514cff9700 1 -- 172.21.15.62:0/1279904614 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51480070d0 con 0x7f51500b5fc0 2021-12-17T18:26:43.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.246+0000 7f514cff9700 1 -- 172.21.15.62:0/1279904614 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5148007230 con 0x7f51500b5fc0 2021-12-17T18:26:43.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.246+0000 7f5154b0d700 1 -- 172.21.15.62:0/1279904614 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51500ab270 con 0x7f51500b5fc0 2021-12-17T18:26:43.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.246+0000 7f514cff9700 1 -- 172.21.15.62:0/1279904614 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5148005610 con 0x7f51500b5fc0 2021-12-17T18:26:43.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.246+0000 7f5154b0d700 1 -- 172.21.15.62:0/1279904614 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51500a78f0 con 0x7f51500b5fc0 2021-12-17T18:26:43.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.246+0000 7f5154b0d700 1 -- 172.21.15.62:0/1279904614 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512c003410 con 0x7f51500b5fc0 2021-12-17T18:26:43.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.246+0000 7f514cff9700 1 -- 172.21.15.62:0/1279904614 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f514801a070 con 0x7f51500b5fc0 2021-12-17T18:26:43.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.246+0000 7f514cff9700 1 --2- 172.21.15.62:0/1279904614 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5128053580 0x7f5128055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:43.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.246+0000 7f514cff9700 1 -- 172.21.15.62:0/1279904614 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f514806aa60 con 0x7f51500b5fc0 2021-12-17T18:26:43.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.246+0000 7f514f7fe700 1 --2- 172.21.15.62:0/1279904614 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5128053580 0x7f5128055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:43.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.246+0000 7f514f7fe700 1 --2- 172.21.15.62:0/1279904614 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5128053580 0x7f5128055a40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f514000b000 tx=0x7f51400091d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:43.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.254+0000 7f514cff9700 1 -- 172.21.15.62:0/1279904614 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5148041bc0 con 0x7f51500b5fc0 2021-12-17T18:26:43.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.418+0000 7f5154b0d700 1 -- 172.21.15.62:0/1279904614 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f512c003c40 con 0x7f51500b5fc0 2021-12-17T18:26:43.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.422+0000 7f514cff9700 1 -- 172.21.15.62:0/1279904614 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f51480451e0 con 0x7f51500b5fc0 2021-12-17T18:26:43.425 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:43.425 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":55,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6650,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3745112309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3745112309},{"type":"v1","addr":"172.21.15.109:6835","nonce":3745112309}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":53}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:26:35.031189+0000","modified":"2021-12-17T18:26:36.033870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7704":{"gid":7704,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/2418178754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2418178754},{"type":"v1","addr":"172.21.15.62:6833","nonce":2418178754}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-12-17T18:26:43.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.422+0000 7f5154b0d700 1 -- 172.21.15.62:0/1279904614 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5128053580 msgr2=0x7f5128055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:43.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.422+0000 7f5154b0d700 1 --2- 172.21.15.62:0/1279904614 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5128053580 0x7f5128055a40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f514000b000 tx=0x7f51400091d0).stop 2021-12-17T18:26:43.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.422+0000 7f5154b0d700 1 -- 172.21.15.62:0/1279904614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51500b5fc0 msgr2=0x7f51500a8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:43.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.422+0000 7f5154b0d700 1 --2- 172.21.15.62:0/1279904614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51500b5fc0 0x7f51500a8340 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f5150062a60 tx=0x7f5148007bc0).stop 2021-12-17T18:26:43.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.422+0000 7f5154b0d700 1 -- 172.21.15.62:0/1279904614 shutdown_connections 2021-12-17T18:26:43.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.422+0000 7f5154b0d700 1 --2- 172.21.15.62:0/1279904614 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5128053580 0x7f5128055a40 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:43.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.422+0000 7f5154b0d700 1 --2- 172.21.15.62:0/1279904614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51500b5fc0 0x7f51500a8340 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:43.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.422+0000 7f5154b0d700 1 --2- 172.21.15.62:0/1279904614 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51500b10f0 0x7f51500a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:43.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.422+0000 7f5154b0d700 1 --2- 172.21.15.62:0/1279904614 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51500ad7a0 0x7f51500aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:43.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.422+0000 7f5154b0d700 1 -- 172.21.15.62:0/1279904614 >> 172.21.15.62:0/1279904614 conn(0x7f515005c750 msgr2=0x7f51500b4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:43.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.422+0000 7f5154b0d700 1 -- 172.21.15.62:0/1279904614 shutdown_connections 2021-12-17T18:26:43.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:43.422+0000 7f5154b0d700 1 -- 172.21.15.62:0/1279904614 wait complete. 2021-12-17T18:26:43.430 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 55 2021-12-17T18:26:43.641 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:26:35.031189+0000', 'modified': '2021-12-17T18:26:36.033870+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7704}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7704': {'gid': 7704, 'name': 'a', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/2418178754', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 2418178754}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 2418178754}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:26:43.690 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:26:43.691 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:26:43.823 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":7704,"want_state":"up:active","state":"up:active","rank_uptime":8.7776028690000008,"mdsmap_epoch":55,"osdmap_epoch":112,"osdmap_epoch_barrier":111,"uptime":12.920592130999999} 2021-12-17T18:26:43.824 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 7704, "mdsmap_epoch": 55, "osdmap_epoch": 112, "osdmap_epoch_barrier": 111, "rank_uptime": 8.777602869, "state": "up:active", "uptime": 12.920592131, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:26:43.825 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:26:43.825 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-12-17T18:26:43.825 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi158.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-12-17T18:26:43.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:43.826 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:43.838 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:26:43.900 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:26:43.901 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:26:43.912 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:26:43.913 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:26:43.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:43.914 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:26:43.966 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:26:43.966 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:43.973 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:26:43.994 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:26:43.995 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:26:44.051 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:2021-12-17T18:26:44.044+0000 7f211bc12080 -1 init, newargv = 0x563555364050 newargc=9ceph-fuse[ 2021-12-17T18:26:44.051 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:14393]: starting ceph client 2021-12-17T18:26:44.052 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:26:44.053 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:26:44.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:44.054 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:26:44.061 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14393]: starting fuse 2021-12-17T18:26:44.069 INFO:teuthology.orchestra.run.smithi158.stdout:52 2021-12-17T18:26:44.069 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:26:44.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:44.070 DEBUG:teuthology.orchestra.run.smithi158:> sudo python3 -c ' 2021-12-17T18:26:44.070 DEBUG:teuthology.orchestra.run.smithi158:> import glob 2021-12-17T18:26:44.071 DEBUG:teuthology.orchestra.run.smithi158:> import re 2021-12-17T18:26:44.071 DEBUG:teuthology.orchestra.run.smithi158:> import os 2021-12-17T18:26:44.072 DEBUG:teuthology.orchestra.run.smithi158:> import subprocess 2021-12-17T18:26:44.072 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:26:44.073 DEBUG:teuthology.orchestra.run.smithi158:> def find_socket(client_name): 2021-12-17T18:26:44.073 DEBUG:teuthology.orchestra.run.smithi158:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-12-17T18:26:44.074 DEBUG:teuthology.orchestra.run.smithi158:> files = glob.glob(asok_path) 2021-12-17T18:26:44.074 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:26:44.075 DEBUG:teuthology.orchestra.run.smithi158:> # Given a non-glob path, it better be there 2021-12-17T18:26:44.075 DEBUG:teuthology.orchestra.run.smithi158:> if "*" not in asok_path: 2021-12-17T18:26:44.075 DEBUG:teuthology.orchestra.run.smithi158:> assert(len(files) == 1) 2021-12-17T18:26:44.076 DEBUG:teuthology.orchestra.run.smithi158:> return files[0] 2021-12-17T18:26:44.076 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:26:44.077 DEBUG:teuthology.orchestra.run.smithi158:> for f in files: 2021-12-17T18:26:44.077 DEBUG:teuthology.orchestra.run.smithi158:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:26:44.078 DEBUG:teuthology.orchestra.run.smithi158:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:26:44.078 DEBUG:teuthology.orchestra.run.smithi158:> return f 2021-12-17T18:26:44.078 DEBUG:teuthology.orchestra.run.smithi158:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:26:44.079 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:26:44.079 DEBUG:teuthology.orchestra.run.smithi158:> print(find_socket("client.1")) 2021-12-17T18:26:44.080 DEBUG:teuthology.orchestra.run.smithi158:> ' 2021-12-17T18:26:44.152 INFO:teuthology.orchestra.run.smithi158.stdout:/var/run/ceph/ceph-client.1.14393.asok 2021-12-17T18:26:44.156 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14393.asok 2021-12-17T18:26:44.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:44.157 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14393.asok status 2021-12-17T18:26:44.238 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2021-12-17T18:26:44.239 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": { 2021-12-17T18:26:44.239 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:26:44.239 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:26:44.240 INFO:teuthology.orchestra.run.smithi158.stdout: "entity_id": "1", 2021-12-17T18:26:44.240 INFO:teuthology.orchestra.run.smithi158.stdout: "hostname": "smithi158", 2021-12-17T18:26:44.240 INFO:teuthology.orchestra.run.smithi158.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-12-17T18:26:44.240 INFO:teuthology.orchestra.run.smithi158.stdout: "pid": "14393", 2021-12-17T18:26:44.241 INFO:teuthology.orchestra.run.smithi158.stdout: "root": "/" 2021-12-17T18:26:44.241 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:26:44.241 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_count": 0, 2021-12-17T18:26:44.241 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_pinned_count": 0, 2021-12-17T18:26:44.242 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 7774, 2021-12-17T18:26:44.242 INFO:teuthology.orchestra.run.smithi158.stdout: "inst": { 2021-12-17T18:26:44.242 INFO:teuthology.orchestra.run.smithi158.stdout: "name": { 2021-12-17T18:26:44.242 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "client", 2021-12-17T18:26:44.242 INFO:teuthology.orchestra.run.smithi158.stdout: "num": 7774 2021-12-17T18:26:44.243 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:26:44.243 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:26:44.243 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:26:44.243 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:26:44.244 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 3673608933 2021-12-17T18:26:44.244 INFO:teuthology.orchestra.run.smithi158.stdout: } 2021-12-17T18:26:44.244 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:26:44.244 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:26:44.245 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:26:44.245 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:26:44.245 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 3673608933 2021-12-17T18:26:44.245 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:26:44.245 INFO:teuthology.orchestra.run.smithi158.stdout: "inst_str": "client.7774 172.21.15.158:0/3673608933", 2021-12-17T18:26:44.246 INFO:teuthology.orchestra.run.smithi158.stdout: "addr_str": "172.21.15.158:0/3673608933", 2021-12-17T18:26:44.246 INFO:teuthology.orchestra.run.smithi158.stdout: "inode_count": 1, 2021-12-17T18:26:44.246 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_epoch": 55, 2021-12-17T18:26:44.246 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch": 112, 2021-12-17T18:26:44.247 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:26:44.247 INFO:teuthology.orchestra.run.smithi158.stdout: "blacklisted": false, 2021-12-17T18:26:44.247 INFO:teuthology.orchestra.run.smithi158.stdout: "fs_name": "cephfs" 2021-12-17T18:26:44.247 INFO:teuthology.orchestra.run.smithi158.stdout:} 2021-12-17T18:26:44.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:44.249 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:44.249 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:44.257 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:26:44.258 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:26:44.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:44.259 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:44.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:44.278 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:44.278 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:44.287 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:26:44.289 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:26:44.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:44.290 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:44.290 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:44.298 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:26:44.300 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:26:44.301 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:26:44.301 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:26:44.301 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:44.317 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[14946]: fuse finished with error 0 and tester_r 0 2021-12-17T18:26:44.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:44.320 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:44.321 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:44.409 INFO:teuthology.orchestra.run.smithi125.stdout:ext2/ext3 2021-12-17T18:26:44.411 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:26:44.411 INFO:teuthology.orchestra.run:waiting for 900 2021-12-17T18:26:44.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:26:44.413 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:26:44.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:44.420 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:44.421 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:44.429 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:26:44.430 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:26:44.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:44.431 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:44.431 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:44.480 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:26:44.481 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:26:44.481 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi158.front.sepia.ceph.com... 2021-12-17T18:26:44.482 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:26:44.482 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:44.496 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14393]: fuse finished with error 0 and tester_r 0 2021-12-17T18:26:44.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:26:44.499 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:26:44.499 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:44.506 INFO:teuthology.orchestra.run.smithi158.stdout:ext2/ext3 2021-12-17T18:26:44.507 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:26:44.508 INFO:teuthology.orchestra.run:waiting for 900 2021-12-17T18:26:50.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:26:50.610 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:26:50.619 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-12-17T18:26:50.619 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:26:50.620 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-12-17T18:26:50.620 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:26:50.635 INFO:tasks.ceph.mds.a:Stopped 2021-12-17T18:26:50.636 DEBUG:teuthology.parallel:result is None 2021-12-17T18:26:50.637 INFO:tasks.ceph.mds.b:Stopped 2021-12-17T18:26:50.637 DEBUG:teuthology.parallel:result is None 2021-12-17T18:26:50.638 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2021-12-17T18:26:50.639 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2021-12-17T18:26:50.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.774+0000 7fd83a975700 1 Processor -- start 2021-12-17T18:26:50.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.774+0000 7fd83a975700 1 -- start start 2021-12-17T18:26:50.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd83a975700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd8340b6160 0x7fd834142690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:50.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd83a975700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd8340b0830 0x7fd834142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:50.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd83a975700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8340af220 0x7fd8340b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:50.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd83a975700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8340b6540 con 0x7fd8340b6160 2021-12-17T18:26:50.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd83a975700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8340ae840 con 0x7fd8340b0830 2021-12-17T18:26:50.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd83a975700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340aeae0 con 0x7fd8340af220 2021-12-17T18:26:50.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd833fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd8340b6160 0x7fd834142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:50.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd833fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd8340b6160 0x7fd834142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55336/0 (socket says 172.21.15.62:55336) 2021-12-17T18:26:50.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd833fff700 1 -- 172.21.15.62:0/2011864636 learned_addr learned my addr 172.21.15.62:0/2011864636 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:50.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd8337fe700 1 --2- 172.21.15.62:0/2011864636 >> v2:172.21.15.109:3300/0 conn(0x7fd8340b0830 0x7fd834142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:50.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd838f12700 1 --2- 172.21.15.62:0/2011864636 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8340af220 0x7fd8340b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:50.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd833fff700 1 -- 172.21.15.62:0/2011864636 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8340af220 msgr2=0x7fd8340b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:50.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd833fff700 1 --2- 172.21.15.62:0/2011864636 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8340af220 0x7fd8340b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:50.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd833fff700 1 -- 172.21.15.62:0/2011864636 >> v2:172.21.15.109:3300/0 conn(0x7fd8340b0830 msgr2=0x7fd834142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:50.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd833fff700 1 --2- 172.21.15.62:0/2011864636 >> v2:172.21.15.109:3300/0 conn(0x7fd8340b0830 0x7fd834142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:50.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd833fff700 1 -- 172.21.15.62:0/2011864636 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340aed80 con 0x7fd8340b6160 2021-12-17T18:26:50.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd838f12700 1 --2- 172.21.15.62:0/2011864636 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8340af220 0x7fd8340b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:26:50.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd833fff700 1 --2- 172.21.15.62:0/2011864636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8340b6160 0x7fd834142690 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7fd824002f70 tx=0x7fd824006eb0).ready entity=mon.0 client_cookie=dbc12beedf5571fd server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:50.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd832ffd700 1 -- 172.21.15.62:0/2011864636 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd82400d570 con 0x7fd8340b6160 2021-12-17T18:26:50.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd832ffd700 1 -- 172.21.15.62:0/2011864636 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd824000e90 con 0x7fd8340b6160 2021-12-17T18:26:50.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.778+0000 7fd832ffd700 1 -- 172.21.15.62:0/2011864636 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd82400d900 con 0x7fd8340b6160 2021-12-17T18:26:50.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd83a975700 1 -- 172.21.15.62:0/2011864636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8340b6160 msgr2=0x7fd834142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:50.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd83a975700 1 --2- 172.21.15.62:0/2011864636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8340b6160 0x7fd834142690 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7fd824002f70 tx=0x7fd824006eb0).stop 2021-12-17T18:26:50.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd83a975700 1 -- 172.21.15.62:0/2011864636 shutdown_connections 2021-12-17T18:26:50.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd83a975700 1 --2- 172.21.15.62:0/2011864636 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8340af220 0x7fd8340b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:50.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd83a975700 1 --2- 172.21.15.62:0/2011864636 >> v2:172.21.15.109:3300/0 conn(0x7fd8340b0830 0x7fd834142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:50.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd83a975700 1 --2- 172.21.15.62:0/2011864636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8340b6160 0x7fd834142690 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:50.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd83a975700 1 -- 172.21.15.62:0/2011864636 >> 172.21.15.62:0/2011864636 conn(0x7fd83405c750 msgr2=0x7fd8340630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:50.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd83a975700 1 -- 172.21.15.62:0/2011864636 shutdown_connections 2021-12-17T18:26:50.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd83a975700 1 -- 172.21.15.62:0/2011864636 wait complete. 2021-12-17T18:26:50.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd83a975700 1 Processor -- start 2021-12-17T18:26:50.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd83a975700 1 -- start start 2021-12-17T18:26:50.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd83a975700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8340af220 0x7fd834155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:50.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd83a975700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8340b0830 0x7fd8340b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:50.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd83a975700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8340b6160 0x7fd834065d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:50.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd83a975700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd834063ec0 con 0x7fd8340b6160 2021-12-17T18:26:50.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd83a975700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd834064160 con 0x7fd8340af220 2021-12-17T18:26:50.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd83a975700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd834064400 con 0x7fd8340b0830 2021-12-17T18:26:50.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd838f12700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8340b6160 0x7fd834065d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:50.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd838f12700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8340b6160 0x7fd834065d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55344/0 (socket says 172.21.15.62:55344) 2021-12-17T18:26:50.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd838f12700 1 -- 172.21.15.62:0/1225478083 learned_addr learned my addr 172.21.15.62:0/1225478083 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:50.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd833fff700 1 --2- 172.21.15.62:0/1225478083 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8340af220 0x7fd834155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:50.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd8337fe700 1 --2- 172.21.15.62:0/1225478083 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8340b0830 0x7fd8340b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:50.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7f465abd4700 1 Processor -- start 2021-12-17T18:26:50.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd838f12700 1 -- 172.21.15.62:0/1225478083 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8340b0830 msgr2=0x7fd8340b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:50.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7f465abd4700 1 -- start start 2021-12-17T18:26:50.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd838f12700 1 --2- 172.21.15.62:0/1225478083 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8340b0830 0x7fd8340b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:50.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd838f12700 1 -- 172.21.15.62:0/1225478083 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8340af220 msgr2=0x7fd834155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:50.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd838f12700 1 --2- 172.21.15.62:0/1225478083 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8340af220 0x7fd834155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:50.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd838f12700 1 -- 172.21.15.62:0/1225478083 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82400b1e0 con 0x7fd8340b6160 2021-12-17T18:26:50.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd838f12700 1 --2- 172.21.15.62:0/1225478083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8340b6160 0x7fd834065d60 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7fd82c007000 tx=0x7fd82c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:50.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.782+0000 7fd8317fa700 1 -- 172.21.15.62:0/1225478083 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd82c010580 con 0x7fd8340b6160 2021-12-17T18:26:50.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7fd8317fa700 1 -- 172.21.15.62:0/1225478083 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c0106e0 con 0x7fd8340b6160 2021-12-17T18:26:50.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7fd83a975700 1 -- 172.21.15.62:0/1225478083 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8340b16f0 con 0x7fd8340b6160 2021-12-17T18:26:50.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7fd8317fa700 1 -- 172.21.15.62:0/1225478083 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd82c010850 con 0x7fd8340b6160 2021-12-17T18:26:50.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7fd83a975700 1 -- 172.21.15.62:0/1225478083 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd834140520 con 0x7fd8340b6160 2021-12-17T18:26:50.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f465abd4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f465405fa70 0x7f4654143890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:50.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f465abd4700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f46540b1a50 0x7f465413ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:50.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f465abd4700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4654061aa0 con 0x7f46540b2910 2021-12-17T18:26:50.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f465abd4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465405fe50 con 0x7f465405fa70 2021-12-17T18:26:50.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f465abd4700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46540b1310 con 0x7f46540b1a50 2021-12-17T18:26:50.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f4658970700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f465405fa70 0x7f4654143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:50.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f4658970700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f465405fa70 0x7f4654143890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55348/0 (socket says 172.21.15.62:55348) 2021-12-17T18:26:50.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f4658970700 1 -- 172.21.15.62:0/3637246604 learned_addr learned my addr 172.21.15.62:0/3637246604 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:50.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f4659171700 1 --2- 172.21.15.62:0/3637246604 >> v2:172.21.15.109:3300/0 conn(0x7f46540b1a50 0x7f465413ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:50.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f4658970700 1 -- 172.21.15.62:0/3637246604 >> v2:172.21.15.109:3300/0 conn(0x7f46540b1a50 msgr2=0x7f465413ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:50.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f4658970700 1 --2- 172.21.15.62:0/3637246604 >> v2:172.21.15.109:3300/0 conn(0x7f46540b1a50 0x7f465413ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:50.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f4658970700 1 -- 172.21.15.62:0/3637246604 >> v1:172.21.15.109:6789/0 conn(0x7f46540b2910 legacy=0x7f4654061390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:50.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f4658970700 1 -- 172.21.15.62:0/3637246604 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46540b15b0 con 0x7f465405fa70 2021-12-17T18:26:50.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7fd8317fa700 1 -- 172.21.15.62:0/1225478083 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd82c0109b0 con 0x7fd8340b6160 2021-12-17T18:26:50.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7fd83a975700 1 -- 172.21.15.62:0/1225478083 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd834140e80 con 0x7fd8340b6160 2021-12-17T18:26:50.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f4658970700 1 --2- 172.21.15.62:0/3637246604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f465405fa70 0x7f4654143890 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f464c0032f0 tx=0x7f464c009290).ready entity=mon.0 client_cookie=7088dd2a90be6976 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:50.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f46537fe700 1 -- 172.21.15.62:0/3637246604 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f464c00b870 con 0x7f465405fa70 2021-12-17T18:26:50.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f46537fe700 1 -- 172.21.15.62:0/3637246604 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c00b9d0 con 0x7f465405fa70 2021-12-17T18:26:50.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7fd8317fa700 1 --2- 172.21.15.62:0/1225478083 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd814053520 0x7fd8140559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:50.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f46537fe700 1 -- 172.21.15.62:0/3637246604 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f464c00bb40 con 0x7f465405fa70 2021-12-17T18:26:50.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7fd8317fa700 1 -- 172.21.15.62:0/1225478083 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd82c06b820 con 0x7fd8340b6160 2021-12-17T18:26:50.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7fd833fff700 1 --2- 172.21.15.62:0/1225478083 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd814053520 0x7fd8140559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:50.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f465abd4700 1 -- 172.21.15.62:0/3637246604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f465405fa70 msgr2=0x7f4654143890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:50.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f465abd4700 1 --2- 172.21.15.62:0/3637246604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f465405fa70 0x7f4654143890 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f464c0032f0 tx=0x7f464c009290).stop 2021-12-17T18:26:50.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f465abd4700 1 -- 172.21.15.62:0/3637246604 shutdown_connections 2021-12-17T18:26:50.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f465abd4700 1 --2- 172.21.15.62:0/3637246604 >> v2:172.21.15.109:3300/0 conn(0x7f46540b1a50 0x7f465413ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:50.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f465abd4700 1 --2- 172.21.15.62:0/3637246604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f465405fa70 0x7f4654143890 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:50.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f465abd4700 1 -- 172.21.15.62:0/3637246604 >> 172.21.15.62:0/3637246604 conn(0x7f46540b64d0 msgr2=0x7f46540b68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:50.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f465abd4700 1 -- 172.21.15.62:0/3637246604 shutdown_connections 2021-12-17T18:26:50.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7fd833fff700 1 --2- 172.21.15.62:0/1225478083 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd814053520 0x7fd8140559e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fd82401c000 tx=0x7fd824015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:50.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.786+0000 7f465abd4700 1 -- 172.21.15.62:0/3637246604 wait complete. 2021-12-17T18:26:50.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f465abd4700 1 Processor -- start 2021-12-17T18:26:50.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f465abd4700 1 -- start start 2021-12-17T18:26:50.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f465abd4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f465405fa70 0x7f46541455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:50.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f465abd4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46540b1a50 0x7f4654152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:50.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f465abd4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f46540b2910 0x7f46541557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:50.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f465abd4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4654145ae0 con 0x7f46540b1a50 2021-12-17T18:26:50.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f465abd4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4654140bb0 con 0x7f46540b2910 2021-12-17T18:26:50.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f465abd4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4654145d20 con 0x7f465405fa70 2021-12-17T18:26:50.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f4653fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46540b1a50 0x7f4654152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:50.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f4653fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46540b1a50 0x7f4654152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55358/0 (socket says 172.21.15.62:55358) 2021-12-17T18:26:50.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f4653fff700 1 -- 172.21.15.62:0/1443542529 learned_addr learned my addr 172.21.15.62:0/1443542529 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:50.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f4659171700 1 --2- 172.21.15.62:0/1443542529 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f46540b2910 0x7f46541557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:50.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f4658970700 1 --2- 172.21.15.62:0/1443542529 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f465405fa70 0x7f46541455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:50.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f4653fff700 1 -- 172.21.15.62:0/1443542529 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f465405fa70 msgr2=0x7f46541455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:50.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f4653fff700 1 --2- 172.21.15.62:0/1443542529 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f465405fa70 0x7f46541455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:50.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f4653fff700 1 -- 172.21.15.62:0/1443542529 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f46540b2910 msgr2=0x7f46541557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:50.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f4653fff700 1 --2- 172.21.15.62:0/1443542529 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f46540b2910 0x7f46541557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:50.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f4653fff700 1 -- 172.21.15.62:0/1443542529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c009530 con 0x7f46540b1a50 2021-12-17T18:26:50.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f4659171700 1 --2- 172.21.15.62:0/1443542529 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f46540b2910 0x7f46541557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:50.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f4658970700 1 --2- 172.21.15.62:0/1443542529 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f465405fa70 0x7f46541455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:50.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f4653fff700 1 --2- 172.21.15.62:0/1443542529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46540b1a50 0x7f4654152c30 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f465405d5c0 tx=0x7f4648007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:50.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7fd8317fa700 1 -- 172.21.15.62:0/1225478083 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd834140e80 con 0x7fd8340b6160 2021-12-17T18:26:50.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f4651ffb700 1 -- 172.21.15.62:0/1443542529 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f464800ce30 con 0x7f46540b1a50 2021-12-17T18:26:50.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f4651ffb700 1 -- 172.21.15.62:0/1443542529 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464800f470 con 0x7f46540b1a50 2021-12-17T18:26:50.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f465abd4700 1 -- 172.21.15.62:0/1443542529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4654153120 con 0x7f46540b1a50 2021-12-17T18:26:50.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f4651ffb700 1 -- 172.21.15.62:0/1443542529 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f464800f7d0 con 0x7f46540b1a50 2021-12-17T18:26:50.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.790+0000 7f465abd4700 1 -- 172.21.15.62:0/1443542529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46541406f0 con 0x7f46540b1a50 2021-12-17T18:26:50.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.794+0000 7f4651ffb700 1 -- 172.21.15.62:0/1443542529 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4648019030 con 0x7f46540b1a50 2021-12-17T18:26:50.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.794+0000 7f465abd4700 1 -- 172.21.15.62:0/1443542529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4654145080 con 0x7f46540b1a50 2021-12-17T18:26:50.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.794+0000 7f4651ffb700 1 --2- 172.21.15.62:0/1443542529 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4634053640 0x7f4634055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:50.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.794+0000 7f4651ffb700 1 -- 172.21.15.62:0/1443542529 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f464806ac80 con 0x7f46540b1a50 2021-12-17T18:26:50.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.794+0000 7f4658970700 1 --2- 172.21.15.62:0/1443542529 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4634053640 0x7f4634055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:50.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.794+0000 7f4658970700 1 --2- 172.21.15.62:0/1443542529 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4634053640 0x7f4634055b00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f464c019000 tx=0x7f464c016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:50.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.798+0000 7f4651ffb700 1 -- 172.21.15.62:0/1443542529 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4654145080 con 0x7f46540b1a50 2021-12-17T18:26:50.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.966+0000 7fd83a975700 1 -- 172.21.15.62:0/1225478083 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7fd834140e80 con 0x7fd8340b6160 2021-12-17T18:26:50.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:50.982+0000 7f465abd4700 1 -- 172.21.15.62:0/1443542529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f4654140a10 con 0x7f46540b1a50 2021-12-17T18:26:51.782 INFO:tasks.ceph.mon.a.smithi062.stderr:2021-12-17T18:26:51.778+0000 7f8d3b366700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-12-17T18:26:51.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.790+0000 7fd8317fa700 1 -- 172.21.15.62:0/1225478083 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7704 v56) v1 ==== 95+0+0 (secure 0 0 0) 0x7fd834140e80 con 0x7fd8340b6160 2021-12-17T18:26:51.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.790+0000 7f4651ffb700 1 -- 172.21.15.62:0/1443542529 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6650 v56) v1 ==== 95+0+0 (secure 0 0 0) 0x7f4654140a10 con 0x7f46540b1a50 2021-12-17T18:26:51.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7fd83a975700 1 -- 172.21.15.62:0/1225478083 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd814053520 msgr2=0x7fd8140559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:51.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7fd83a975700 1 --2- 172.21.15.62:0/1225478083 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd814053520 0x7fd8140559e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fd82401c000 tx=0x7fd824015000).stop 2021-12-17T18:26:51.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7fd83a975700 1 -- 172.21.15.62:0/1225478083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8340b6160 msgr2=0x7fd834065d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:51.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7f465abd4700 1 -- 172.21.15.62:0/1443542529 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4634053640 msgr2=0x7f4634055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:51.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7f465abd4700 1 --2- 172.21.15.62:0/1443542529 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4634053640 0x7f4634055b00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f464c019000 tx=0x7f464c016000).stop 2021-12-17T18:26:51.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7fd83a975700 1 --2- 172.21.15.62:0/1225478083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8340b6160 0x7fd834065d60 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7fd82c007000 tx=0x7fd82c008040).stop 2021-12-17T18:26:51.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7f465abd4700 1 -- 172.21.15.62:0/1443542529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46540b1a50 msgr2=0x7f4654152c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:51.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7f465abd4700 1 --2- 172.21.15.62:0/1443542529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46540b1a50 0x7f4654152c30 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f465405d5c0 tx=0x7f4648007c50).stop 2021-12-17T18:26:51.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7fd83a975700 1 -- 172.21.15.62:0/1225478083 shutdown_connections 2021-12-17T18:26:51.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7fd83a975700 1 --2- 172.21.15.62:0/1225478083 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd814053520 0x7fd8140559e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:51.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7fd83a975700 1 --2- 172.21.15.62:0/1225478083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8340b6160 0x7fd834065d60 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:51.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7fd83a975700 1 --2- 172.21.15.62:0/1225478083 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd8340b0830 0x7fd8340b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:51.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7fd83a975700 1 --2- 172.21.15.62:0/1225478083 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd8340af220 0x7fd834155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:51.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7fd83a975700 1 -- 172.21.15.62:0/1225478083 >> 172.21.15.62:0/1225478083 conn(0x7fd83405c750 msgr2=0x7fd83413c550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:51.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7f465abd4700 1 -- 172.21.15.62:0/1443542529 shutdown_connections 2021-12-17T18:26:51.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7f465abd4700 1 --2- 172.21.15.62:0/1443542529 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4634053640 0x7f4634055b00 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:51.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7f465abd4700 1 --2- 172.21.15.62:0/1443542529 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f46540b2910 0x7f46541557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:51.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7f465abd4700 1 --2- 172.21.15.62:0/1443542529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46540b1a50 0x7f4654152c30 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:51.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7f465abd4700 1 --2- 172.21.15.62:0/1443542529 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f465405fa70 0x7f46541455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:51.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7fd83a975700 1 -- 172.21.15.62:0/1225478083 shutdown_connections 2021-12-17T18:26:51.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7f465abd4700 1 -- 172.21.15.62:0/1443542529 >> 172.21.15.62:0/1443542529 conn(0x7f46540b64d0 msgr2=0x7f46540b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:51.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.794+0000 7fd83a975700 1 -- 172.21.15.62:0/1225478083 wait complete. 2021-12-17T18:26:51.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.798+0000 7f465abd4700 1 -- 172.21.15.62:0/1443542529 shutdown_connections 2021-12-17T18:26:51.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.798+0000 7f465abd4700 1 -- 172.21.15.62:0/1443542529 wait complete. 2021-12-17T18:26:51.809 INFO:teuthology.orchestra.run.smithi062.stderr:failed mds gid 7704 2021-12-17T18:26:51.809 INFO:teuthology.orchestra.run.smithi062.stderr:failed mds gid 6650 2021-12-17T18:26:51.815 DEBUG:teuthology.parallel:result is '' 2021-12-17T18:26:51.817 DEBUG:teuthology.parallel:result is '' 2021-12-17T18:26:51.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-12-17T18:26:51.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fd1374700 1 Processor -- start 2021-12-17T18:26:51.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fd1374700 1 -- start start 2021-12-17T18:26:51.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fd1374700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1fcc0b65b0 0x7f1fcc13ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:51.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fd1374700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc0b41e0 0x7f1fcc0b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:51.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fd1374700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fcc0b6ee0 con 0x7f1fcc060950 2021-12-17T18:26:51.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fd1374700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fcc0b1c40 con 0x7f1fcc0b65b0 2021-12-17T18:26:51.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fd1374700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc0b6990 con 0x7f1fcc0b41e0 2021-12-17T18:26:51.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fcbfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1fcc0b65b0 0x7f1fcc13ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:51.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fc37fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1fcc060950 0x7f1fcc140420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38948/0 (socket says 172.21.15.62:38948) 2021-12-17T18:26:51.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fc37fe700 1 -- 172.21.15.62:0/3592802122 learned_addr learned my addr 172.21.15.62:0/3592802122 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:51.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fd0b73700 1 --2- 172.21.15.62:0/3592802122 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc0b41e0 0x7f1fcc0b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:51.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fcbfff700 1 -- 172.21.15.62:0/3592802122 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc0b41e0 msgr2=0x7f1fcc0b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:51.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fcbfff700 1 --2- 172.21.15.62:0/3592802122 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc0b41e0 0x7f1fcc0b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:51.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fcbfff700 1 -- 172.21.15.62:0/3592802122 >> v1:172.21.15.62:6789/0 conn(0x7f1fcc060950 legacy=0x7f1fcc140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:51.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fcb7fe700 1 -- 172.21.15.62:0/3592802122 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387727460 0 0) 0x7f1fcc0b6ee0 con 0x7f1fcc060950 2021-12-17T18:26:51.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fcbfff700 1 -- 172.21.15.62:0/3592802122 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc0b5e20 con 0x7f1fcc0b65b0 2021-12-17T18:26:51.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fcbfff700 1 --2- 172.21.15.62:0/3592802122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b65b0 0x7f1fcc13ff30 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f1fbc002f70 tx=0x7f1fbc006df0).ready entity=mon.0 client_cookie=92bea92a7bb007da server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:51.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.930+0000 7f1fcb7fe700 1 -- 172.21.15.62:0/3592802122 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fbc00d570 con 0x7f1fcc0b65b0 2021-12-17T18:26:51.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.934+0000 7f1fcb7fe700 1 -- 172.21.15.62:0/3592802122 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fbc000e90 con 0x7f1fcc0b65b0 2021-12-17T18:26:51.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.934+0000 7f1fcb7fe700 1 -- 172.21.15.62:0/3592802122 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fbc00d8c0 con 0x7f1fcc0b65b0 2021-12-17T18:26:51.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.934+0000 7f1fd1374700 1 -- 172.21.15.62:0/3592802122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b65b0 msgr2=0x7f1fcc13ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:51.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.934+0000 7f1fd1374700 1 --2- 172.21.15.62:0/3592802122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b65b0 0x7f1fcc13ff30 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f1fbc002f70 tx=0x7f1fbc006df0).stop 2021-12-17T18:26:51.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.934+0000 7f1fd1374700 1 -- 172.21.15.62:0/3592802122 shutdown_connections 2021-12-17T18:26:51.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.934+0000 7f1fd1374700 1 --2- 172.21.15.62:0/3592802122 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc0b41e0 0x7f1fcc0b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:51.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.934+0000 7f1fd1374700 1 --2- 172.21.15.62:0/3592802122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b65b0 0x7f1fcc13ff30 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:51.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.934+0000 7f1fd1374700 1 -- 172.21.15.62:0/3592802122 >> 172.21.15.62:0/3592802122 conn(0x7f1fcc05c750 msgr2=0x7f1fcc05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:51.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.934+0000 7f1fd1374700 1 -- 172.21.15.62:0/3592802122 shutdown_connections 2021-12-17T18:26:51.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.934+0000 7f1fd1374700 1 -- 172.21.15.62:0/3592802122 wait complete. 2021-12-17T18:26:51.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.934+0000 7f1fd1374700 1 Processor -- start 2021-12-17T18:26:51.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.934+0000 7f1fd1374700 1 -- start start 2021-12-17T18:26:51.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fd1374700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc060950 0x7f1fcc064240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:51.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fd1374700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b41e0 0x7f1fcc152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:51.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fd1374700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fcc0b65b0 0x7f1fcc152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:51.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fd1374700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc142840 con 0x7f1fcc0b41e0 2021-12-17T18:26:51.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fd1374700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc147a80 con 0x7f1fcc0b65b0 2021-12-17T18:26:51.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fd1374700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc064900 con 0x7f1fcc060950 2021-12-17T18:26:51.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fc37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b41e0 0x7f1fcc152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:51.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fc37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b41e0 0x7f1fcc152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55372/0 (socket says 172.21.15.62:55372) 2021-12-17T18:26:51.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fc37fe700 1 -- 172.21.15.62:0/3624032896 learned_addr learned my addr 172.21.15.62:0/3624032896 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:51.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fd0b73700 1 --2- 172.21.15.62:0/3624032896 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fcc0b65b0 0x7f1fcc152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:51.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fcbfff700 1 --2- 172.21.15.62:0/3624032896 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc060950 0x7f1fcc064240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:51.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fc37fe700 1 -- 172.21.15.62:0/3624032896 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc060950 msgr2=0x7f1fcc064240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:51.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fc37fe700 1 --2- 172.21.15.62:0/3624032896 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc060950 0x7f1fcc064240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:51.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fc37fe700 1 -- 172.21.15.62:0/3624032896 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fcc0b65b0 msgr2=0x7f1fcc152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:51.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fc37fe700 1 --2- 172.21.15.62:0/3624032896 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fcc0b65b0 0x7f1fcc152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:51.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fc37fe700 1 -- 172.21.15.62:0/3624032896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc00b180 con 0x7f1fcc0b41e0 2021-12-17T18:26:51.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fcbfff700 1 --2- 172.21.15.62:0/3624032896 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc060950 0x7f1fcc064240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:51.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fd0b73700 1 --2- 172.21.15.62:0/3624032896 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fcc0b65b0 0x7f1fcc152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:26:51.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fc37fe700 1 --2- 172.21.15.62:0/3624032896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b41e0 0x7f1fcc152280 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7f1fb4000bc0 tx=0x7f1fb4007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:51.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fc9ffb700 1 -- 172.21.15.62:0/3624032896 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fb4001d30 con 0x7f1fcc0b41e0 2021-12-17T18:26:51.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fc9ffb700 1 -- 172.21.15.62:0/3624032896 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb40072e0 con 0x7f1fcc0b41e0 2021-12-17T18:26:51.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fd1374700 1 -- 172.21.15.62:0/3624032896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fcc147770 con 0x7f1fcc0b41e0 2021-12-17T18:26:51.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fc9ffb700 1 -- 172.21.15.62:0/3624032896 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fb4005800 con 0x7f1fcc0b41e0 2021-12-17T18:26:51.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.938+0000 7f1fd1374700 1 -- 172.21.15.62:0/3624032896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fcc141f70 con 0x7f1fcc0b41e0 2021-12-17T18:26:51.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.942+0000 7f1fd1374700 1 -- 172.21.15.62:0/3624032896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fcc064760 con 0x7f1fcc0b41e0 2021-12-17T18:26:51.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.942+0000 7f1fc9ffb700 1 -- 172.21.15.62:0/3624032896 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1fb401a060 con 0x7f1fcc0b41e0 2021-12-17T18:26:51.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.942+0000 7f1fc9ffb700 1 --2- 172.21.15.62:0/3624032896 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fb00534f0 0x7f1fb00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:51.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.942+0000 7f1fc9ffb700 1 -- 172.21.15.62:0/3624032896 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1fb406b210 con 0x7f1fcc0b41e0 2021-12-17T18:26:51.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.942+0000 7f1fcbfff700 1 --2- 172.21.15.62:0/3624032896 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fb00534f0 0x7f1fb00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:51.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.942+0000 7f1fcbfff700 1 --2- 172.21.15.62:0/3624032896 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fb00534f0 0x7f1fb00559b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f1fbc018000 tx=0x7f1fbc014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:51.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:51.950+0000 7f1fc9ffb700 1 -- 172.21.15.62:0/3624032896 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1fcc064760 con 0x7f1fcc0b41e0 2021-12-17T18:26:52.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:52.114+0000 7f1fd1374700 1 -- 172.21.15.62:0/3624032896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1fcc064760 con 0x7f1fcc0b41e0 2021-12-17T18:26:52.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:52.994+0000 7f1fc9ffb700 1 -- 172.21.15.62:0/3624032896 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1fcc064760 con 0x7f1fcc0b41e0 2021-12-17T18:26:53.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:52.998+0000 7f1fd1374700 1 -- 172.21.15.62:0/3624032896 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fb00534f0 msgr2=0x7f1fb00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:53.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:52.998+0000 7f1fd1374700 1 --2- 172.21.15.62:0/3624032896 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fb00534f0 0x7f1fb00559b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f1fbc018000 tx=0x7f1fbc014000).stop 2021-12-17T18:26:53.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:52.998+0000 7f1fd1374700 1 -- 172.21.15.62:0/3624032896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b41e0 msgr2=0x7f1fcc152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:53.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:52.998+0000 7f1fd1374700 1 --2- 172.21.15.62:0/3624032896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b41e0 0x7f1fcc152280 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7f1fb4000bc0 tx=0x7f1fb4007c60).stop 2021-12-17T18:26:53.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:52.998+0000 7f1fd1374700 1 -- 172.21.15.62:0/3624032896 shutdown_connections 2021-12-17T18:26:53.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:52.998+0000 7f1fd1374700 1 --2- 172.21.15.62:0/3624032896 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fb00534f0 0x7f1fb00559b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:53.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:52.998+0000 7f1fd1374700 1 --2- 172.21.15.62:0/3624032896 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1fcc0b65b0 0x7f1fcc152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:53.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:52.998+0000 7f1fd1374700 1 --2- 172.21.15.62:0/3624032896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fcc0b41e0 0x7f1fcc152280 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:53.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:52.998+0000 7f1fd1374700 1 --2- 172.21.15.62:0/3624032896 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1fcc060950 0x7f1fcc064240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:53.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:52.998+0000 7f1fd1374700 1 -- 172.21.15.62:0/3624032896 >> 172.21.15.62:0/3624032896 conn(0x7f1fcc05c750 msgr2=0x7f1fcc1430d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:53.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:52.998+0000 7f1fd1374700 1 -- 172.21.15.62:0/3624032896 shutdown_connections 2021-12-17T18:26:53.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:52.998+0000 7f1fd1374700 1 -- 172.21.15.62:0/3624032896 wait complete. 2021-12-17T18:26:53.018 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-12-17T18:26:53.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.130+0000 7f3decf38700 1 Processor -- start 2021-12-17T18:26:53.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.130+0000 7f3decf38700 1 -- start start 2021-12-17T18:26:53.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3decf38700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3de80ac0a0 0x7f3de8143a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3decf38700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f3de8143f80 0x7f3de813fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3decf38700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de80afa60 con 0x7f3de80b2060 2021-12-17T18:26:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3decf38700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de80b27d0 con 0x7f3de8143f80 2021-12-17T18:26:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3decf38700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de80b2440 con 0x7f3de80ac0a0 2021-12-17T18:26:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3de5d9b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3de80ac0a0 0x7f3de8143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3de6d9d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f3de8143f80 0x7f3de813fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3de659c700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f3de80b2060 0x7f3de8143380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:55278/0 (socket says 172.21.15.62:55278) 2021-12-17T18:26:53.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3de659c700 1 -- 172.21.15.62:0/4158021240 learned_addr learned my addr 172.21.15.62:0/4158021240 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:53.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3de6d9d700 1 -- 172.21.15.62:0/4158021240 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3de80ac0a0 msgr2=0x7f3de8143a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:53.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3de6d9d700 1 --2- 172.21.15.62:0/4158021240 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3de80ac0a0 0x7f3de8143a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:53.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3de6d9d700 1 -- 172.21.15.62:0/4158021240 >> v1:172.21.15.109:6789/0 conn(0x7f3de80b2060 legacy=0x7f3de8143380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3de6d9d700 1 -- 172.21.15.62:0/4158021240 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de80af7c0 con 0x7f3de8143f80 2021-12-17T18:26:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3de5d9b700 1 --2- 172.21.15.62:0/4158021240 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3de80ac0a0 0x7f3de8143a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3de6d9d700 1 --2- 172.21.15.62:0/4158021240 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3de8143f80 0x7f3de813fdb0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f3de00032f0 tx=0x7f3de00091d0).ready entity=mon.1 client_cookie=7f68aec3e5b29b97 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3de559a700 1 -- 172.21.15.62:0/4158021240 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3de000b6c0 con 0x7f3de8143f80 2021-12-17T18:26:53.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3de559a700 1 -- 172.21.15.62:0/4158021240 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de000b820 con 0x7f3de8143f80 2021-12-17T18:26:53.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3de559a700 1 -- 172.21.15.62:0/4158021240 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3de000b990 con 0x7f3de8143f80 2021-12-17T18:26:53.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3decf38700 1 -- 172.21.15.62:0/4158021240 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3de8143f80 msgr2=0x7f3de813fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:53.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3decf38700 1 --2- 172.21.15.62:0/4158021240 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3de8143f80 0x7f3de813fdb0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f3de00032f0 tx=0x7f3de00091d0).stop 2021-12-17T18:26:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3decf38700 1 -- 172.21.15.62:0/4158021240 shutdown_connections 2021-12-17T18:26:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3decf38700 1 --2- 172.21.15.62:0/4158021240 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3de8143f80 0x7f3de813fdb0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3decf38700 1 --2- 172.21.15.62:0/4158021240 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3de80ac0a0 0x7f3de8143a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3decf38700 1 -- 172.21.15.62:0/4158021240 >> 172.21.15.62:0/4158021240 conn(0x7f3de8062430 msgr2=0x7f3de8062840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:53.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3decf38700 1 -- 172.21.15.62:0/4158021240 shutdown_connections 2021-12-17T18:26:53.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.134+0000 7f3decf38700 1 -- 172.21.15.62:0/4158021240 wait complete. 2021-12-17T18:26:53.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3decf38700 1 Processor -- start 2021-12-17T18:26:53.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3decf38700 1 -- start start 2021-12-17T18:26:53.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3decf38700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3de80ac0a0 0x7f3de8142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:53.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3decf38700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3de80b2060 0x7f3de813dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:53.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3decf38700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de8143f80 0x7f3de813f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:53.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3decf38700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de813b4f0 con 0x7f3de8143f80 2021-12-17T18:26:53.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3decf38700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de813a140 con 0x7f3de80ac0a0 2021-12-17T18:26:53.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3decf38700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de8135ce0 con 0x7f3de80b2060 2021-12-17T18:26:53.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3de6d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de8143f80 0x7f3de813f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:53.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3de6d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de8143f80 0x7f3de813f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55388/0 (socket says 172.21.15.62:55388) 2021-12-17T18:26:53.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3de6d9d700 1 -- 172.21.15.62:0/1492002594 learned_addr learned my addr 172.21.15.62:0/1492002594 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:53.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3de5d9b700 1 --2- 172.21.15.62:0/1492002594 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3de80b2060 0x7f3de813dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:53.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3de659c700 1 --2- 172.21.15.62:0/1492002594 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3de80ac0a0 0x7f3de8142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:53.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3de6d9d700 1 -- 172.21.15.62:0/1492002594 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3de80b2060 msgr2=0x7f3de813dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:53.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3de6d9d700 1 --2- 172.21.15.62:0/1492002594 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3de80b2060 0x7f3de813dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:53.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3de6d9d700 1 -- 172.21.15.62:0/1492002594 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3de80ac0a0 msgr2=0x7f3de8142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:53.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3de6d9d700 1 --2- 172.21.15.62:0/1492002594 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3de80ac0a0 0x7f3de8142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:53.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.138+0000 7f3de6d9d700 1 -- 172.21.15.62:0/1492002594 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc00b180 con 0x7f3de8143f80 2021-12-17T18:26:53.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.142+0000 7f3de6d9d700 1 --2- 172.21.15.62:0/1492002594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de8143f80 0x7f3de813f710 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7f3de00032f0 tx=0x7f3de0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:53.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.142+0000 7f3dd77fe700 1 -- 172.21.15.62:0/1492002594 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3de000b6c0 con 0x7f3de8143f80 2021-12-17T18:26:53.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.142+0000 7f3dd77fe700 1 -- 172.21.15.62:0/1492002594 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de0021630 con 0x7f3de8143f80 2021-12-17T18:26:53.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.142+0000 7f3decf38700 1 -- 172.21.15.62:0/1492002594 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de0009470 con 0x7f3de8143f80 2021-12-17T18:26:53.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.142+0000 7f3dd77fe700 1 -- 172.21.15.62:0/1492002594 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3de0021990 con 0x7f3de8143f80 2021-12-17T18:26:53.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.142+0000 7f3decf38700 1 -- 172.21.15.62:0/1492002594 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de8139dc0 con 0x7f3de8143f80 2021-12-17T18:26:53.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.142+0000 7f3decf38700 1 -- 172.21.15.62:0/1492002594 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de8139f80 con 0x7f3de8143f80 2021-12-17T18:26:53.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.142+0000 7f3dd77fe700 1 -- 172.21.15.62:0/1492002594 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3de0027020 con 0x7f3de8143f80 2021-12-17T18:26:53.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.146+0000 7f3dd77fe700 1 --2- 172.21.15.62:0/1492002594 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3dc4053610 0x7f3dc4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:53.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.146+0000 7f3dd77fe700 1 -- 172.21.15.62:0/1492002594 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3de006cca0 con 0x7f3de8143f80 2021-12-17T18:26:53.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.146+0000 7f3de659c700 1 --2- 172.21.15.62:0/1492002594 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3dc4053610 0x7f3dc4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:53.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.146+0000 7f3de659c700 1 --2- 172.21.15.62:0/1492002594 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3dc4053610 0x7f3dc4055ad0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f3dd800d000 tx=0x7f3dd8009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:53.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.150+0000 7f3dd77fe700 1 -- 172.21.15.62:0/1492002594 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3de0043ca0 con 0x7f3de8143f80 2021-12-17T18:26:53.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:53.278+0000 7f3decf38700 1 -- 172.21.15.62:0/1492002594 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3de8139dc0 con 0x7f3de8143f80 2021-12-17T18:26:54.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.002+0000 7f3dd77fe700 1 -- 172.21.15.62:0/1492002594 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v115) v1 ==== 185+0+0 (secure 0 0 0) 0x7f3de8139dc0 con 0x7f3de8143f80 2021-12-17T18:26:54.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.006+0000 7f3decf38700 1 -- 172.21.15.62:0/1492002594 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3dc4053610 msgr2=0x7f3dc4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:54.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.006+0000 7f3decf38700 1 --2- 172.21.15.62:0/1492002594 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3dc4053610 0x7f3dc4055ad0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f3dd800d000 tx=0x7f3dd8009040).stop 2021-12-17T18:26:54.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.006+0000 7f3decf38700 1 -- 172.21.15.62:0/1492002594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de8143f80 msgr2=0x7f3de813f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:54.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.006+0000 7f3decf38700 1 --2- 172.21.15.62:0/1492002594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de8143f80 0x7f3de813f710 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7f3de00032f0 tx=0x7f3de0016000).stop 2021-12-17T18:26:54.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.006+0000 7f3decf38700 1 -- 172.21.15.62:0/1492002594 shutdown_connections 2021-12-17T18:26:54.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.006+0000 7f3decf38700 1 --2- 172.21.15.62:0/1492002594 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3dc4053610 0x7f3dc4055ad0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:54.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.006+0000 7f3decf38700 1 --2- 172.21.15.62:0/1492002594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de8143f80 0x7f3de813f710 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:54.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.006+0000 7f3decf38700 1 --2- 172.21.15.62:0/1492002594 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3de80b2060 0x7f3de813dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:54.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.006+0000 7f3decf38700 1 --2- 172.21.15.62:0/1492002594 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3de80ac0a0 0x7f3de8142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:54.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.006+0000 7f3decf38700 1 -- 172.21.15.62:0/1492002594 >> 172.21.15.62:0/1492002594 conn(0x7f3de8062430 msgr2=0x7f3de80ad270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:54.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.010+0000 7f3decf38700 1 -- 172.21.15.62:0/1492002594 shutdown_connections 2021-12-17T18:26:54.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.010+0000 7f3decf38700 1 -- 172.21.15.62:0/1492002594 wait complete. 2021-12-17T18:26:54.016 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2021-12-17T18:26:54.027 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-12-17T18:26:54.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f855a3c0700 1 Processor -- start 2021-12-17T18:26:54.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f855a3c0700 1 -- start start 2021-12-17T18:26:54.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f855a3c0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85540b5dd0 0x7f8554146da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:54.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f855a3c0700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f85540b41f0 0x7f8554141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:54.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f855a3c0700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85540b2010 con 0x7f85540b05b0 2021-12-17T18:26:54.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f855a3c0700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85540b0990 con 0x7f85540b41f0 2021-12-17T18:26:54.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f855a3c0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8554147290 con 0x7f85540b5dd0 2021-12-17T18:26:54.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f855895d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f85540b41f0 0x7f8554141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:54.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f85537fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85540b5dd0 0x7f8554146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:54.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f8553fff700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f85540b05b0 0x7f8554146690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:55292/0 (socket says 172.21.15.62:55292) 2021-12-17T18:26:54.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f8553fff700 1 -- 172.21.15.62:0/412512347 learned_addr learned my addr 172.21.15.62:0/412512347 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:26:54.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f85537fe700 1 -- 172.21.15.62:0/412512347 >> v2:172.21.15.109:3300/0 conn(0x7f85540b41f0 msgr2=0x7f8554141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:54.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f85537fe700 1 --2- 172.21.15.62:0/412512347 >> v2:172.21.15.109:3300/0 conn(0x7f85540b41f0 0x7f8554141fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:54.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f85537fe700 1 -- 172.21.15.62:0/412512347 >> v1:172.21.15.109:6789/0 conn(0x7f85540b05b0 legacy=0x7f8554146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:54.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f85537fe700 1 -- 172.21.15.62:0/412512347 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540b2240 con 0x7f85540b5dd0 2021-12-17T18:26:54.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f855895d700 1 --2- 172.21.15.62:0/412512347 >> v2:172.21.15.109:3300/0 conn(0x7f85540b41f0 0x7f8554141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:54.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f85537fe700 1 --2- 172.21.15.62:0/412512347 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85540b5dd0 0x7f8554146da0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f8548002f70 tx=0x7f8548006df0).ready entity=mon.2 client_cookie=22b79480fa0f9733 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:54.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f8552ffd700 1 -- 172.21.15.62:0/412512347 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f854800d570 con 0x7f85540b5dd0 2021-12-17T18:26:54.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f8552ffd700 1 -- 172.21.15.62:0/412512347 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8548000e90 con 0x7f85540b5dd0 2021-12-17T18:26:54.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.138+0000 7f8552ffd700 1 -- 172.21.15.62:0/412512347 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f854800d8c0 con 0x7f85540b5dd0 2021-12-17T18:26:54.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855a3c0700 1 -- 172.21.15.62:0/412512347 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85540b5dd0 msgr2=0x7f8554146da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:54.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855a3c0700 1 --2- 172.21.15.62:0/412512347 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85540b5dd0 0x7f8554146da0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f8548002f70 tx=0x7f8548006df0).stop 2021-12-17T18:26:54.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855a3c0700 1 -- 172.21.15.62:0/412512347 shutdown_connections 2021-12-17T18:26:54.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855a3c0700 1 --2- 172.21.15.62:0/412512347 >> v2:172.21.15.109:3300/0 conn(0x7f85540b41f0 0x7f8554141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:54.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855a3c0700 1 --2- 172.21.15.62:0/412512347 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85540b5dd0 0x7f8554146da0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:54.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855a3c0700 1 -- 172.21.15.62:0/412512347 >> 172.21.15.62:0/412512347 conn(0x7f8554062510 msgr2=0x7f85540628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:54.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855a3c0700 1 -- 172.21.15.62:0/412512347 shutdown_connections 2021-12-17T18:26:54.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855a3c0700 1 -- 172.21.15.62:0/412512347 wait complete. 2021-12-17T18:26:54.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855a3c0700 1 Processor -- start 2021-12-17T18:26:54.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855a3c0700 1 -- start start 2021-12-17T18:26:54.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855a3c0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85540b05b0 0x7f85540668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:54.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855a3c0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f85540b41f0 0x7f8554152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:54.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855a3c0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b5dd0 0x7f85540a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:54.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855a3c0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8554152d00 con 0x7f85540b5dd0 2021-12-17T18:26:54.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855a3c0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8554152f20 con 0x7f85540b41f0 2021-12-17T18:26:54.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855a3c0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85541531c0 con 0x7f85540b05b0 2021-12-17T18:26:54.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855895d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b5dd0 0x7f85540a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:54.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855895d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b5dd0 0x7f85540a5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55400/0 (socket says 172.21.15.62:55400) 2021-12-17T18:26:54.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f855895d700 1 -- 172.21.15.62:0/758391809 learned_addr learned my addr 172.21.15.62:0/758391809 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:54.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f85537fe700 1 --2- 172.21.15.62:0/758391809 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f85540b41f0 0x7f8554152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:54.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.142+0000 7f8553fff700 1 --2- 172.21.15.62:0/758391809 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85540b05b0 0x7f85540668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:54.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.146+0000 7f855895d700 1 -- 172.21.15.62:0/758391809 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85540b05b0 msgr2=0x7f85540668d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:54.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.146+0000 7f855895d700 1 --2- 172.21.15.62:0/758391809 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85540b05b0 0x7f85540668d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:54.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.146+0000 7f855895d700 1 -- 172.21.15.62:0/758391809 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f85540b41f0 msgr2=0x7f8554152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:54.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.146+0000 7f855895d700 1 --2- 172.21.15.62:0/758391809 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f85540b41f0 0x7f8554152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:54.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.146+0000 7f855895d700 1 -- 172.21.15.62:0/758391809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c009470 con 0x7f85540b5dd0 2021-12-17T18:26:54.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.146+0000 7f855895d700 1 --2- 172.21.15.62:0/758391809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b5dd0 0x7f85540a5840 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f854c00c000 tx=0x7f854c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:54.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.146+0000 7f85517fa700 1 -- 172.21.15.62:0/758391809 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f854c00c850 con 0x7f85540b5dd0 2021-12-17T18:26:54.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.146+0000 7f855a3c0700 1 -- 172.21.15.62:0/758391809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854800b180 con 0x7f85540b5dd0 2021-12-17T18:26:54.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.146+0000 7f85517fa700 1 -- 172.21.15.62:0/758391809 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c00c9b0 con 0x7f85540b5dd0 2021-12-17T18:26:54.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.146+0000 7f85517fa700 1 -- 172.21.15.62:0/758391809 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f854c00cd10 con 0x7f85540b5dd0 2021-12-17T18:26:54.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.146+0000 7f855a3c0700 1 -- 172.21.15.62:0/758391809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85540a5d30 con 0x7f85540b5dd0 2021-12-17T18:26:54.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.146+0000 7f855a3c0700 1 -- 172.21.15.62:0/758391809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85540b24e0 con 0x7f85540b5dd0 2021-12-17T18:26:54.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.146+0000 7f85517fa700 1 -- 172.21.15.62:0/758391809 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f854c022070 con 0x7f85540b5dd0 2021-12-17T18:26:54.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.146+0000 7f85517fa700 1 --2- 172.21.15.62:0/758391809 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85340534f0 0x7f85340559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:54.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.146+0000 7f85517fa700 1 -- 172.21.15.62:0/758391809 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f854c06bf90 con 0x7f85540b5dd0 2021-12-17T18:26:54.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.150+0000 7f8553fff700 1 --2- 172.21.15.62:0/758391809 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85340534f0 0x7f85340559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:54.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.150+0000 7f8553fff700 1 --2- 172.21.15.62:0/758391809 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85340534f0 0x7f85340559b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f854400d000 tx=0x7f8544009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:54.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.154+0000 7f85517fa700 1 -- 172.21.15.62:0/758391809 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f854c0431b0 con 0x7f85540b5dd0 2021-12-17T18:26:54.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:54.282+0000 7f855a3c0700 1 -- 172.21.15.62:0/758391809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f85540573d0 con 0x7f85540b5dd0 2021-12-17T18:26:55.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:55.006+0000 7f85517fa700 1 -- 172.21.15.62:0/758391809 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v116) v1 ==== 133+0+0 (secure 0 0 0) 0x7f854c0160a0 con 0x7f85540b5dd0 2021-12-17T18:26:55.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:55.014+0000 7f855a3c0700 1 -- 172.21.15.62:0/758391809 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85340534f0 msgr2=0x7f85340559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:55.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:55.014+0000 7f855a3c0700 1 --2- 172.21.15.62:0/758391809 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85340534f0 0x7f85340559b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f854400d000 tx=0x7f8544009040).stop 2021-12-17T18:26:55.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:55.014+0000 7f855a3c0700 1 -- 172.21.15.62:0/758391809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b5dd0 msgr2=0x7f85540a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:55.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:55.014+0000 7f855a3c0700 1 --2- 172.21.15.62:0/758391809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b5dd0 0x7f85540a5840 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f854c00c000 tx=0x7f854c0091d0).stop 2021-12-17T18:26:55.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:55.014+0000 7f855a3c0700 1 -- 172.21.15.62:0/758391809 shutdown_connections 2021-12-17T18:26:55.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:55.014+0000 7f855a3c0700 1 --2- 172.21.15.62:0/758391809 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85340534f0 0x7f85340559b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:55.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:55.014+0000 7f855a3c0700 1 --2- 172.21.15.62:0/758391809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b5dd0 0x7f85540a5840 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:55.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:55.014+0000 7f855a3c0700 1 --2- 172.21.15.62:0/758391809 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f85540b41f0 0x7f8554152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:55.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:55.014+0000 7f855a3c0700 1 --2- 172.21.15.62:0/758391809 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85540b05b0 0x7f85540668d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:55.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:55.014+0000 7f855a3c0700 1 -- 172.21.15.62:0/758391809 >> 172.21.15.62:0/758391809 conn(0x7f8554062510 msgr2=0x7f85540b97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:55.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:55.014+0000 7f855a3c0700 1 -- 172.21.15.62:0/758391809 shutdown_connections 2021-12-17T18:26:55.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:55.014+0000 7f855a3c0700 1 -- 172.21.15.62:0/758391809 wait complete. 2021-12-17T18:26:55.020 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2021-12-17T18:26:55.030 DEBUG:teuthology.orchestra.run.smithi125:> sudo rados -p cephfs_metadata put key /etc/fstab 2021-12-17T18:26:55.078 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.066+0000 7efd13693b80 1 Processor -- start 2021-12-17T18:26:55.078 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.066+0000 7efd13693b80 1 -- start start 2021-12-17T18:26:55.078 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.066+0000 7efd13693b80 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x55759dfc9ba0 0x55759e05f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:55.078 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.066+0000 7efd13693b80 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x55759dfca470 0x55759e05f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:55.079 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.066+0000 7efd13693b80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55759e060bd0 0x55759e05fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:55.079 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.066+0000 7efd13693b80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55759e052800 con 0x55759e060bd0 2021-12-17T18:26:55.079 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.066+0000 7efd13693b80 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x55759e06bcc0 con 0x55759dfca470 2021-12-17T18:26:55.079 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.066+0000 7efd13693b80 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x55759e06be80 con 0x55759dfc9ba0 2021-12-17T18:26:55.080 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.066+0000 7efd112d0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x55759dfca470 0x55759e05f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:55.080 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.066+0000 7efd11ad1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x55759dfc9ba0 0x55759e05f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:55.080 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.066+0000 7efd122d2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55759e060bd0 0x55759e05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:55.080 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.066+0000 7efd112d0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x55759dfca470 0x55759e05f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.125:44740/0 (socket says 172.21.15.125:44740) 2021-12-17T18:26:55.081 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.066+0000 7efd112d0700 1 -- 172.21.15.125:0/4069864013 learned_addr learned my addr 172.21.15.125:0/4069864013 (peer_addr_for_me v2:172.21.15.125:0/0) 2021-12-17T18:26:55.081 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.066+0000 7efd11ad1700 1 -- 172.21.15.125:0/4069864013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x55759dfca470 msgr2=0x55759e05f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:55.081 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.066+0000 7efd11ad1700 1 --2- 172.21.15.125:0/4069864013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x55759dfca470 0x55759e05f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:55.081 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.066+0000 7efd11ad1700 1 -- 172.21.15.125:0/4069864013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55759e060bd0 msgr2=0x55759e05fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:55.082 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.066+0000 7efd11ad1700 1 --2- 172.21.15.125:0/4069864013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55759e060bd0 0x55759e05fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:55.082 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd11ad1700 1 -- 172.21.15.125:0/4069864013 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc005cd0 con 0x55759dfc9ba0 2021-12-17T18:26:55.082 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd11ad1700 1 --2- 172.21.15.125:0/4069864013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x55759dfc9ba0 0x55759e05f280 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7efd040032f0 tx=0x7efd04013000).ready entity=mon.2 client_cookie=49120bb75b375972 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:55.082 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd0b7fe700 1 -- 172.21.15.125:0/4069864013 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd040056b0 con 0x55759dfc9ba0 2021-12-17T18:26:55.083 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd0b7fe700 1 -- 172.21.15.125:0/4069864013 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0400c770 con 0x55759dfc9ba0 2021-12-17T18:26:55.083 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd0b7fe700 1 -- 172.21.15.125:0/4069864013 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd0400cad0 con 0x55759dfc9ba0 2021-12-17T18:26:55.083 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 -- 172.21.15.125:0/4069864013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x55759dfc9ba0 msgr2=0x55759e05f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:55.083 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 --2- 172.21.15.125:0/4069864013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x55759dfc9ba0 0x55759e05f280 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7efd040032f0 tx=0x7efd04013000).stop 2021-12-17T18:26:55.084 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 -- 172.21.15.125:0/4069864013 shutdown_connections 2021-12-17T18:26:55.084 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 --2- 172.21.15.125:0/4069864013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55759e060bd0 0x55759e05fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:55.084 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 --2- 172.21.15.125:0/4069864013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x55759dfca470 0x55759e05f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:55.084 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 --2- 172.21.15.125:0/4069864013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x55759dfc9ba0 0x55759e05f280 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:55.084 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 -- 172.21.15.125:0/4069864013 >> 172.21.15.125:0/4069864013 conn(0x55759e04ff40 msgr2=0x55759e058a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:55.085 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 -- 172.21.15.125:0/4069864013 shutdown_connections 2021-12-17T18:26:55.085 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 -- 172.21.15.125:0/4069864013 wait complete. 2021-12-17T18:26:55.085 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 Processor -- start 2021-12-17T18:26:55.085 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 -- start start 2021-12-17T18:26:55.091 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55759dfc9ba0 0x55759e06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:55.091 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x55759dfca470 0x55759e066670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:55.092 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x55759e060bd0 0x55759e066b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:55.092 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55759e066530 con 0x55759dfc9ba0 2021-12-17T18:26:55.093 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x55759e0671e0 con 0x55759e060bd0 2021-12-17T18:26:55.093 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x55759e0673a0 con 0x55759dfca470 2021-12-17T18:26:55.094 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd11ad1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55759dfc9ba0 0x55759e06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:55.094 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd11ad1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55759dfc9ba0 0x55759e06b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.125:54568/0 (socket says 172.21.15.125:54568) 2021-12-17T18:26:55.095 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd11ad1700 1 -- 172.21.15.125:0/3791537079 learned_addr learned my addr 172.21.15.125:0/3791537079 (peer_addr_for_me v2:172.21.15.125:0/0) 2021-12-17T18:26:55.095 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd112d0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x55759dfca470 0x55759e066670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:55.095 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd122d2700 1 --2- 172.21.15.125:0/3791537079 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x55759e060bd0 0x55759e066b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:55.096 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd11ad1700 1 -- 172.21.15.125:0/3791537079 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x55759dfca470 msgr2=0x55759e066670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:55.096 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd11ad1700 1 --2- 172.21.15.125:0/3791537079 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x55759dfca470 0x55759e066670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:55.097 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd11ad1700 1 -- 172.21.15.125:0/3791537079 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x55759e060bd0 msgr2=0x55759e066b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:55.097 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd11ad1700 1 --2- 172.21.15.125:0/3791537079 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x55759e060bd0 0x55759e066b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:55.098 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd11ad1700 1 -- 172.21.15.125:0/3791537079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55759df657c0 con 0x55759dfc9ba0 2021-12-17T18:26:55.098 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd11ad1700 1 --2- 172.21.15.125:0/3791537079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55759dfc9ba0 0x55759e06b420 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7efd040032f0 tx=0x7efd0401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:55.098 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd0affd700 1 -- 172.21.15.125:0/3791537079 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd04024070 con 0x55759dfc9ba0 2021-12-17T18:26:55.099 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd0affd700 1 -- 172.21.15.125:0/3791537079 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0401fbf0 con 0x55759dfc9ba0 2021-12-17T18:26:55.099 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 -- 172.21.15.125:0/3791537079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0400a160 con 0x55759dfc9ba0 2021-12-17T18:26:55.099 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd0affd700 1 -- 172.21.15.125:0/3791537079 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd04029460 con 0x55759dfc9ba0 2021-12-17T18:26:55.100 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.070+0000 7efd13693b80 1 -- 172.21.15.125:0/3791537079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55759df6e4b0 con 0x55759dfc9ba0 2021-12-17T18:26:55.100 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.074+0000 7efd0affd700 1 -- 172.21.15.125:0/3791537079 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efd0400e030 con 0x55759dfc9ba0 2021-12-17T18:26:55.100 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.074+0000 7efd0affd700 1 --2- 172.21.15.125:0/3791537079 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efcf4052190 0x7efcf4054650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:55.100 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.074+0000 7efd0affd700 1 -- 172.21.15.125:0/3791537079 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6075+0+0 (secure 0 0 0) 0x7efd0406ceb0 con 0x55759dfc9ba0 2021-12-17T18:26:55.101 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.074+0000 7efd112d0700 1 --2- 172.21.15.125:0/3791537079 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efcf4052190 0x7efcf4054650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:55.101 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.074+0000 7efd13693b80 1 --2- 172.21.15.125:0/3791537079 >> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] conn(0x55759e074020 0x55759e076410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:55.101 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.074+0000 7efd13693b80 1 -- 172.21.15.125:0/3791537079 --> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] -- osd_op(unknown.0.0:1 23.0 23:0620e6f9:::key:head [writefull 0~617 in=617b] snapc 0=[] ondisk+write+known_if_redirected e116) v8 -- 0x55759e076900 con 0x55759e074020 2021-12-17T18:26:55.101 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.078+0000 7efd122d2700 1 --2- 172.21.15.125:0/3791537079 >> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] conn(0x55759e074020 0x55759e076410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:55.102 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.078+0000 7efd112d0700 1 --2- 172.21.15.125:0/3791537079 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efcf4052190 0x7efcf4054650 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7efcfc00a000 tx=0x7efcfc00c040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:55.102 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:55.078+0000 7efd122d2700 1 --2- 172.21.15.125:0/3791537079 >> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] conn(0x55759e074020 0x55759e076410 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:56.407 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:56.402+0000 7efd0affd700 1 -- 172.21.15.125:0/3791537079 <== osd.0 v2:172.21.15.62:6800/14759 1 ==== osd_map(117..117 src has 1..117) v4 ==== 320+0+0 (crc 0 0 0) 0x7efd0c009c80 con 0x55759e074020 2021-12-17T18:26:56.413 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:56.410+0000 7efd122d2700 1 -- 172.21.15.125:0/3791537079 <== osd.0 v2:172.21.15.62:6800/14759 2 ==== osd_op_reply(1 key [writefull 0~617] v117'1 uv1 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7efd0c012040 con 0x55759e074020 2021-12-17T18:26:56.415 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:56.410+0000 7efd13693b80 1 -- 172.21.15.125:0/3791537079 >> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] conn(0x55759e074020 msgr2=0x55759e076410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:56.415 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:56.410+0000 7efd13693b80 1 --2- 172.21.15.125:0/3791537079 >> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] conn(0x55759e074020 0x55759e076410 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:56.415 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:56.410+0000 7efd13693b80 1 -- 172.21.15.125:0/3791537079 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efcf4052190 msgr2=0x7efcf4054650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:56.416 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:56.410+0000 7efd13693b80 1 --2- 172.21.15.125:0/3791537079 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efcf4052190 0x7efcf4054650 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7efcfc00a000 tx=0x7efcfc00c040).stop 2021-12-17T18:26:56.416 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:56.410+0000 7efd13693b80 1 -- 172.21.15.125:0/3791537079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55759dfc9ba0 msgr2=0x55759e06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:56.416 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:56.410+0000 7efd13693b80 1 --2- 172.21.15.125:0/3791537079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55759dfc9ba0 0x55759e06b420 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7efd040032f0 tx=0x7efd0401a000).stop 2021-12-17T18:26:56.417 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:56.410+0000 7efd122d2700 1 -- 172.21.15.125:0/3791537079 reap_dead start 2021-12-17T18:26:56.417 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:56.410+0000 7efd13693b80 1 -- 172.21.15.125:0/3791537079 shutdown_connections 2021-12-17T18:26:56.417 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:56.410+0000 7efd13693b80 1 -- 172.21.15.125:0/3791537079 >> 172.21.15.125:0/3791537079 conn(0x55759e04ff40 msgr2=0x55759e058680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:56.417 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:56.410+0000 7efd13693b80 1 -- 172.21.15.125:0/3791537079 shutdown_connections 2021-12-17T18:26:56.418 INFO:teuthology.orchestra.run.smithi125.stderr:2021-12-17T18:26:56.410+0000 7efd13693b80 1 -- 172.21.15.125:0/3791537079 wait complete. 2021-12-17T18:26:56.419 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-12-17T18:26:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.526+0000 7ff3d2407700 1 Processor -- start 2021-12-17T18:26:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.526+0000 7ff3d2407700 1 -- start start 2021-12-17T18:26:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.526+0000 7ff3d2407700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff3cc0b2a40 0x7ff3cc0afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d2407700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3cc13cd40 0x7ff3cc13d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d2407700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff3cc13fe00 0x7ff3cc140220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d2407700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3cc0b2e20 con 0x7ff3cc13fe00 2021-12-17T18:26:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d2407700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3cc0ae860 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d2407700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc143800 con 0x7ff3cc13cd40 2021-12-17T18:26:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d1c06700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff3cc13fe00 0x7ff3cc140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d1c06700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff3cc13fe00 0x7ff3cc140220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55410/0 (socket says 172.21.15.62:55410) 2021-12-17T18:26:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d1c06700 1 -- 172.21.15.62:0/1113783454 learned_addr learned my addr 172.21.15.62:0/1113783454 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d1405700 1 --2- 172.21.15.62:0/1113783454 >> v2:172.21.15.109:3300/0 conn(0x7ff3cc0b2a40 0x7ff3cc0afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d0c04700 1 --2- 172.21.15.62:0/1113783454 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3cc13cd40 0x7ff3cc13d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:56.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d1405700 1 -- 172.21.15.62:0/1113783454 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3cc13cd40 msgr2=0x7ff3cc13d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:56.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d1405700 1 --2- 172.21.15.62:0/1113783454 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3cc13cd40 0x7ff3cc13d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:56.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d1405700 1 -- 172.21.15.62:0/1113783454 >> v2:172.21.15.62:3300/0 conn(0x7ff3cc13fe00 msgr2=0x7ff3cc140220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:26:56.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d1405700 1 --2- 172.21.15.62:0/1113783454 >> v2:172.21.15.62:3300/0 conn(0x7ff3cc13fe00 0x7ff3cc140220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:56.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d1405700 1 -- 172.21.15.62:0/1113783454 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc143aa0 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d1c06700 1 --2- 172.21.15.62:0/1113783454 >> v2:172.21.15.62:3300/0 conn(0x7ff3cc13fe00 0x7ff3cc140220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:56.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d1405700 1 --2- 172.21.15.62:0/1113783454 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3cc0b2a40 0x7ff3cc0afcf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7ff3c8002f70 tx=0x7ff3c8006df0).ready entity=mon.1 client_cookie=7a555f5e0c7c70e6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:56.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3bbfff700 1 -- 172.21.15.62:0/1113783454 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3c800d4a0 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3bbfff700 1 -- 172.21.15.62:0/1113783454 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c8000e90 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3bbfff700 1 -- 172.21.15.62:0/1113783454 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3c800d7f0 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d2407700 1 -- 172.21.15.62:0/1113783454 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3cc0b2a40 msgr2=0x7ff3cc0afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:56.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d2407700 1 --2- 172.21.15.62:0/1113783454 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3cc0b2a40 0x7ff3cc0afcf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7ff3c8002f70 tx=0x7ff3c8006df0).stop 2021-12-17T18:26:56.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d2407700 1 -- 172.21.15.62:0/1113783454 shutdown_connections 2021-12-17T18:26:56.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d2407700 1 --2- 172.21.15.62:0/1113783454 >> v2:172.21.15.62:3300/0 conn(0x7ff3cc13fe00 0x7ff3cc140220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:56.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d2407700 1 --2- 172.21.15.62:0/1113783454 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3cc13cd40 0x7ff3cc13d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:56.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d2407700 1 --2- 172.21.15.62:0/1113783454 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3cc0b2a40 0x7ff3cc0afcf0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:56.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d2407700 1 -- 172.21.15.62:0/1113783454 >> 172.21.15.62:0/1113783454 conn(0x7ff3cc05c750 msgr2=0x7ff3cc05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:56.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d2407700 1 -- 172.21.15.62:0/1113783454 shutdown_connections 2021-12-17T18:26:56.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.530+0000 7ff3d2407700 1 -- 172.21.15.62:0/1113783454 wait complete. 2021-12-17T18:26:56.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.534+0000 7ff3d2407700 1 Processor -- start 2021-12-17T18:26:56.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.534+0000 7ff3d2407700 1 -- start start 2021-12-17T18:26:56.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.534+0000 7ff3d2407700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3cc0b2a40 0x7ff3cc0b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:56.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.534+0000 7ff3d2407700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3cc13cd40 0x7ff3cc067330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:56.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.534+0000 7ff3d2407700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3cc13fe00 0x7ff3cc14ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:56.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.534+0000 7ff3d2407700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc1544a0 con 0x7ff3cc13fe00 2021-12-17T18:26:56.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.534+0000 7ff3d2407700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc153f90 con 0x7ff3cc13cd40 2021-12-17T18:26:56.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.534+0000 7ff3d2407700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc154200 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d1c06700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3cc13fe00 0x7ff3cc14ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d1405700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3cc0b2a40 0x7ff3cc0b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d0c04700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3cc13cd40 0x7ff3cc067330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d1405700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3cc0b2a40 0x7ff3cc0b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:49114/0 (socket says 172.21.15.62:49114) 2021-12-17T18:26:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d0c04700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3cc13cd40 0x7ff3cc067330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:33732/0 (socket says 172.21.15.62:33732) 2021-12-17T18:26:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d1405700 1 -- 172.21.15.62:0/126945808 learned_addr learned my addr 172.21.15.62:0/126945808 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:26:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d1c06700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3cc13fe00 0x7ff3cc14ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55414/0 (socket says 172.21.15.62:55414) 2021-12-17T18:26:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d1405700 1 -- 172.21.15.62:0/126945808 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3cc13cd40 msgr2=0x7ff3cc067330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d1405700 1 --2- 172.21.15.62:0/126945808 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3cc13cd40 0x7ff3cc067330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d1405700 1 -- 172.21.15.62:0/126945808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3cc13fe00 msgr2=0x7ff3cc14ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d1405700 1 --2- 172.21.15.62:0/126945808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3cc13fe00 0x7ff3cc14ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d1405700 1 -- 172.21.15.62:0/126945808 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c4009530 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d1c06700 1 --2- 172.21.15.62:0/126945808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3cc13fe00 0x7ff3cc14ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d0c04700 1 --2- 172.21.15.62:0/126945808 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3cc13cd40 0x7ff3cc067330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:26:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d1405700 1 --2- 172.21.15.62:0/126945808 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3cc0b2a40 0x7ff3cc0b6030 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ff3c8002f70 tx=0x7ff3c8014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3ba7fc700 1 -- 172.21.15.62:0/126945808 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3c8013ca0 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3ba7fc700 1 -- 172.21.15.62:0/126945808 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c8013e00 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d2407700 1 -- 172.21.15.62:0/126945808 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c800b180 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3ba7fc700 1 -- 172.21.15.62:0/126945808 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3c801e5f0 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d2407700 1 -- 172.21.15.62:0/126945808 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3cc151190 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3d2407700 1 -- 172.21.15.62:0/126945808 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3cc067090 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.538+0000 7ff3ba7fc700 1 -- 172.21.15.62:0/126945808 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff3c8025030 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.542+0000 7ff3ba7fc700 1 --2- 172.21.15.62:0/126945808 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff3ac0534f0 0x7ff3ac0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:26:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.542+0000 7ff3ba7fc700 1 -- 172.21.15.62:0/126945808 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6075+0+0 (secure 0 0 0) 0x7ff3c806c640 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.542+0000 7ff3d0c04700 1 --2- 172.21.15.62:0/126945808 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff3ac0534f0 0x7ff3ac0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:26:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.542+0000 7ff3d0c04700 1 --2- 172.21.15.62:0/126945808 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff3ac0534f0 0x7ff3ac0559b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7ff3bc00b000 tx=0x7ff3bc006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:26:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.550+0000 7ff3ba7fc700 1 -- 172.21.15.62:0/126945808 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff3cc067090 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.718+0000 7ff3d2407700 1 -- 172.21.15.62:0/126945808 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7ff3cc067090 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.722+0000 7ff3ba7fc700 1 -- 172.21.15.62:0/126945808 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1906 (secure 0 0 0) 0x7ff3cc067090 con 0x7ff3cc0b2a40 2021-12-17T18:26:56.725 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:26:56.725 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:26:56.725 INFO:teuthology.orchestra.run.smithi062.stdout: "stats": { 2021-12-17T18:26:56.726 INFO:teuthology.orchestra.run.smithi062.stdout: "total_bytes": 773094113280, 2021-12-17T18:26:56.726 INFO:teuthology.orchestra.run.smithi062.stdout: "total_avail_bytes": 764492546048, 2021-12-17T18:26:56.726 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_bytes": 11632640, 2021-12-17T18:26:56.726 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_raw_bytes": 8601567232, 2021-12-17T18:26:56.727 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_raw_ratio": 0.011126157827675343, 2021-12-17T18:26:56.727 INFO:teuthology.orchestra.run.smithi062.stdout: "num_osds": 8, 2021-12-17T18:26:56.727 INFO:teuthology.orchestra.run.smithi062.stdout: "num_per_pool_osds": 8, 2021-12-17T18:26:56.727 INFO:teuthology.orchestra.run.smithi062.stdout: "num_per_pool_omap_osds": 8 2021-12-17T18:26:56.728 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:56.728 INFO:teuthology.orchestra.run.smithi062.stdout: "stats_by_class": { 2021-12-17T18:26:56.728 INFO:teuthology.orchestra.run.smithi062.stdout: "ssd": { 2021-12-17T18:26:56.728 INFO:teuthology.orchestra.run.smithi062.stdout: "total_bytes": 773094113280, 2021-12-17T18:26:56.729 INFO:teuthology.orchestra.run.smithi062.stdout: "total_avail_bytes": 764492546048, 2021-12-17T18:26:56.729 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_bytes": 11632640, 2021-12-17T18:26:56.729 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_raw_bytes": 8601567232, 2021-12-17T18:26:56.729 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_raw_ratio": 0.011126157827675343 2021-12-17T18:26:56.730 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:56.730 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:56.730 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:26:56.730 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:56.731 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "device_health_metrics", 2021-12-17T18:26:56.731 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 1, 2021-12-17T18:26:56.731 INFO:teuthology.orchestra.run.smithi062.stdout: "stats": { 2021-12-17T18:26:56.731 INFO:teuthology.orchestra.run.smithi062.stdout: "stored": 0, 2021-12-17T18:26:56.731 INFO:teuthology.orchestra.run.smithi062.stdout: "objects": 2, 2021-12-17T18:26:56.732 INFO:teuthology.orchestra.run.smithi062.stdout: "kb_used": 0, 2021-12-17T18:26:56.732 INFO:teuthology.orchestra.run.smithi062.stdout: "bytes_used": 0, 2021-12-17T18:26:56.732 INFO:teuthology.orchestra.run.smithi062.stdout: "percent_used": 0, 2021-12-17T18:26:56.732 INFO:teuthology.orchestra.run.smithi062.stdout: "max_avail": 362918871040 2021-12-17T18:26:56.733 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:56.733 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:56.733 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:56.733 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rbd", 2021-12-17T18:26:56.734 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 2, 2021-12-17T18:26:56.734 INFO:teuthology.orchestra.run.smithi062.stdout: "stats": { 2021-12-17T18:26:56.734 INFO:teuthology.orchestra.run.smithi062.stdout: "stored": 0, 2021-12-17T18:26:56.734 INFO:teuthology.orchestra.run.smithi062.stdout: "objects": 0, 2021-12-17T18:26:56.734 INFO:teuthology.orchestra.run.smithi062.stdout: "kb_used": 0, 2021-12-17T18:26:56.735 INFO:teuthology.orchestra.run.smithi062.stdout: "bytes_used": 0, 2021-12-17T18:26:56.735 INFO:teuthology.orchestra.run.smithi062.stdout: "percent_used": 0, 2021-12-17T18:26:56.735 INFO:teuthology.orchestra.run.smithi062.stdout: "max_avail": 362918871040 2021-12-17T18:26:56.735 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:56.736 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:56.736 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:56.736 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cephfs_data", 2021-12-17T18:26:56.736 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 22, 2021-12-17T18:26:56.736 INFO:teuthology.orchestra.run.smithi062.stdout: "stats": { 2021-12-17T18:26:56.737 INFO:teuthology.orchestra.run.smithi062.stdout: "stored": 0, 2021-12-17T18:26:56.737 INFO:teuthology.orchestra.run.smithi062.stdout: "objects": 0, 2021-12-17T18:26:56.737 INFO:teuthology.orchestra.run.smithi062.stdout: "kb_used": 0, 2021-12-17T18:26:56.737 INFO:teuthology.orchestra.run.smithi062.stdout: "bytes_used": 0, 2021-12-17T18:26:56.738 INFO:teuthology.orchestra.run.smithi062.stdout: "percent_used": 0, 2021-12-17T18:26:56.738 INFO:teuthology.orchestra.run.smithi062.stdout: "max_avail": 362918871040 2021-12-17T18:26:56.738 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:56.738 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:26:56.738 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:26:56.739 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cephfs_metadata", 2021-12-17T18:26:56.739 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 23, 2021-12-17T18:26:56.739 INFO:teuthology.orchestra.run.smithi062.stdout: "stats": { 2021-12-17T18:26:56.739 INFO:teuthology.orchestra.run.smithi062.stdout: "stored": 0, 2021-12-17T18:26:56.740 INFO:teuthology.orchestra.run.smithi062.stdout: "objects": 0, 2021-12-17T18:26:56.740 INFO:teuthology.orchestra.run.smithi062.stdout: "kb_used": 0, 2021-12-17T18:26:56.740 INFO:teuthology.orchestra.run.smithi062.stdout: "bytes_used": 0, 2021-12-17T18:26:56.740 INFO:teuthology.orchestra.run.smithi062.stdout: "percent_used": 0, 2021-12-17T18:26:56.741 INFO:teuthology.orchestra.run.smithi062.stdout: "max_avail": 362918871040 2021-12-17T18:26:56.741 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:56.741 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:26:56.741 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:26:56.741 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:26:56.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.722+0000 7ff3d2407700 1 -- 172.21.15.62:0/126945808 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff3ac0534f0 msgr2=0x7ff3ac0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:56.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.722+0000 7ff3d2407700 1 --2- 172.21.15.62:0/126945808 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff3ac0534f0 0x7ff3ac0559b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7ff3bc00b000 tx=0x7ff3bc006df0).stop 2021-12-17T18:26:56.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.722+0000 7ff3d2407700 1 -- 172.21.15.62:0/126945808 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3cc0b2a40 msgr2=0x7ff3cc0b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:26:56.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.722+0000 7ff3d2407700 1 --2- 172.21.15.62:0/126945808 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3cc0b2a40 0x7ff3cc0b6030 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ff3c8002f70 tx=0x7ff3c8014000).stop 2021-12-17T18:26:56.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.722+0000 7ff3d2407700 1 -- 172.21.15.62:0/126945808 shutdown_connections 2021-12-17T18:26:56.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.722+0000 7ff3d2407700 1 --2- 172.21.15.62:0/126945808 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff3ac0534f0 0x7ff3ac0559b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:56.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.722+0000 7ff3d2407700 1 --2- 172.21.15.62:0/126945808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3cc13fe00 0x7ff3cc14ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:56.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.722+0000 7ff3d2407700 1 --2- 172.21.15.62:0/126945808 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3cc13cd40 0x7ff3cc067330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:56.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.722+0000 7ff3d2407700 1 --2- 172.21.15.62:0/126945808 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3cc0b2a40 0x7ff3cc0b6030 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:26:56.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.722+0000 7ff3d2407700 1 -- 172.21.15.62:0/126945808 >> 172.21.15.62:0/126945808 conn(0x7ff3cc05c750 msgr2=0x7ff3cc05fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:26:56.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.722+0000 7ff3d2407700 1 -- 172.21.15.62:0/126945808 shutdown_connections 2021-12-17T18:26:56.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:26:56.726+0000 7ff3d2407700 1 -- 172.21.15.62:0/126945808 wait complete. 2021-12-17T18:26:56.747 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30)... 2021-12-17T18:27:01.748 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-12-17T18:27:01.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f123a384700 1 Processor -- start 2021-12-17T18:27:01.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f123a384700 1 -- start start 2021-12-17T18:27:01.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f123a384700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f12340b10f0 0x7f123414b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:01.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f123a384700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12340af6d0 con 0x7f12340b5fc0 2021-12-17T18:27:01.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f123a384700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12340b63a0 con 0x7f123414b880 2021-12-17T18:27:01.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f123a384700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12340af900 con 0x7f12340b10f0 2021-12-17T18:27:01.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f1239382700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f12340b5fc0 0x7f123414ac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39000/0 (socket says 172.21.15.62:39000) 2021-12-17T18:27:01.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f1239382700 1 -- 172.21.15.62:0/1812828396 learned_addr learned my addr 172.21.15.62:0/1812828396 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:01.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f1238b81700 1 --2- 172.21.15.62:0/1812828396 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f12340b10f0 0x7f123414b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:01.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f1227fff700 1 -- 172.21.15.62:0/1812828396 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555674451 0 0) 0x7f12340af6d0 con 0x7f12340b5fc0 2021-12-17T18:27:01.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f1227fff700 1 -- 172.21.15.62:0/1812828396 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1218003260 con 0x7f12340b5fc0 2021-12-17T18:27:01.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f1227fff700 1 -- 172.21.15.62:0/1812828396 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547625607 0 0) 0x7f12340b63a0 con 0x7f123414b880 2021-12-17T18:27:01.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f1227fff700 1 -- 172.21.15.62:0/1812828396 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12340af6d0 con 0x7f123414b880 2021-12-17T18:27:01.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f1238b81700 1 -- 172.21.15.62:0/1812828396 >> v1:172.21.15.109:6789/0 conn(0x7f123414b880 legacy=0x7f1234150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:01.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f1238b81700 1 -- 172.21.15.62:0/1812828396 >> v1:172.21.15.62:6789/0 conn(0x7f12340b5fc0 legacy=0x7f123414ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:01.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f1238b81700 1 -- 172.21.15.62:0/1812828396 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12340b0b40 con 0x7f12340b10f0 2021-12-17T18:27:01.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f1238b81700 1 --2- 172.21.15.62:0/1812828396 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f12340b10f0 0x7f123414b390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f1230002f70 tx=0x7f1230006df0).ready entity=mon.2 client_cookie=206450b6324d1b22 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:01.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f1227fff700 1 -- 172.21.15.62:0/1812828396 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f123000d5c0 con 0x7f12340b10f0 2021-12-17T18:27:01.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f1227fff700 1 -- 172.21.15.62:0/1812828396 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1230000e90 con 0x7f12340b10f0 2021-12-17T18:27:01.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f1227fff700 1 -- 172.21.15.62:0/1812828396 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f123000d910 con 0x7f12340b10f0 2021-12-17T18:27:01.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f123a384700 1 -- 172.21.15.62:0/1812828396 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f12340b10f0 msgr2=0x7f123414b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:01.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f123a384700 1 --2- 172.21.15.62:0/1812828396 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f12340b10f0 0x7f123414b390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f1230002f70 tx=0x7f1230006df0).stop 2021-12-17T18:27:01.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f123a384700 1 -- 172.21.15.62:0/1812828396 shutdown_connections 2021-12-17T18:27:01.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f123a384700 1 --2- 172.21.15.62:0/1812828396 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f12340b10f0 0x7f123414b390 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:01.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f123a384700 1 -- 172.21.15.62:0/1812828396 >> 172.21.15.62:0/1812828396 conn(0x7f123405c750 msgr2=0x7f123405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:01.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f123a384700 1 -- 172.21.15.62:0/1812828396 shutdown_connections 2021-12-17T18:27:01.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.870+0000 7f123a384700 1 -- 172.21.15.62:0/1812828396 wait complete. 2021-12-17T18:27:01.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f123a384700 1 Processor -- start 2021-12-17T18:27:01.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f123a384700 1 -- start start 2021-12-17T18:27:01.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f123a384700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f12340b10f0 0x7f12340b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:01.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f123a384700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f12340b5fc0 0x7f123414c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:01.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f123a384700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f123414b880 0x7f123414c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:01.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f123a384700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1234065ed0 con 0x7f123414b880 2021-12-17T18:27:01.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f123a384700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123414d480 con 0x7f12340b10f0 2021-12-17T18:27:01.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f123a384700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123414d080 con 0x7f12340b5fc0 2021-12-17T18:27:01.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f1239b83700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f123414b880 0x7f123414c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:01.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f1239b83700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f123414b880 0x7f123414c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55430/0 (socket says 172.21.15.62:55430) 2021-12-17T18:27:01.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f1239b83700 1 -- 172.21.15.62:0/239619548 learned_addr learned my addr 172.21.15.62:0/239619548 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:01.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f1238b81700 1 --2- 172.21.15.62:0/239619548 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f12340b5fc0 0x7f123414c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:01.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f1239382700 1 --2- 172.21.15.62:0/239619548 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f12340b10f0 0x7f12340b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:01.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f1239b83700 1 -- 172.21.15.62:0/239619548 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f12340b5fc0 msgr2=0x7f123414c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:01.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f1239b83700 1 --2- 172.21.15.62:0/239619548 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f12340b5fc0 0x7f123414c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:01.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f1239b83700 1 -- 172.21.15.62:0/239619548 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f12340b10f0 msgr2=0x7f12340b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:01.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f1239b83700 1 --2- 172.21.15.62:0/239619548 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f12340b10f0 0x7f12340b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:01.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f1239b83700 1 -- 172.21.15.62:0/239619548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123000b180 con 0x7f123414b880 2021-12-17T18:27:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f1239382700 1 --2- 172.21.15.62:0/239619548 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f12340b10f0 0x7f12340b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f1239b83700 1 --2- 172.21.15.62:0/239619548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f123414b880 0x7f123414c550 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f1228001110 tx=0x7f1228007a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f1226ffd700 1 -- 172.21.15.62:0/239619548 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f122800ce30 con 0x7f123414b880 2021-12-17T18:27:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f123a384700 1 -- 172.21.15.62:0/239619548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12340b5430 con 0x7f123414b880 2021-12-17T18:27:01.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f123a384700 1 -- 172.21.15.62:0/239619548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123414cbe0 con 0x7f123414b880 2021-12-17T18:27:01.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f1226ffd700 1 -- 172.21.15.62:0/239619548 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1228012400 con 0x7f123414b880 2021-12-17T18:27:01.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f1226ffd700 1 -- 172.21.15.62:0/239619548 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12280127a0 con 0x7f123414b880 2021-12-17T18:27:01.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.874+0000 7f123a384700 1 -- 172.21.15.62:0/239619548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1234065d20 con 0x7f123414b880 2021-12-17T18:27:01.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.878+0000 7f1226ffd700 1 -- 172.21.15.62:0/239619548 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1228010070 con 0x7f123414b880 2021-12-17T18:27:01.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.878+0000 7f1226ffd700 1 --2- 172.21.15.62:0/239619548 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12100534f0 0x7f12100559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:01.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.878+0000 7f1226ffd700 1 -- 172.21.15.62:0/239619548 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6075+0+0 (secure 0 0 0) 0x7f122806a9b0 con 0x7f123414b880 2021-12-17T18:27:01.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.878+0000 7f1239382700 1 --2- 172.21.15.62:0/239619548 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12100534f0 0x7f12100559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:01.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.878+0000 7f1239382700 1 --2- 172.21.15.62:0/239619548 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12100534f0 0x7f12100559b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f122c00b000 tx=0x7f122c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:01.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:01.882+0000 7f1226ffd700 1 -- 172.21.15.62:0/239619548 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1228041a70 con 0x7f123414b880 2021-12-17T18:27:02.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.050+0000 7f123a384700 1 -- 172.21.15.62:0/239619548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f12340b5620 con 0x7f123414b880 2021-12-17T18:27:02.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.050+0000 7f1226ffd700 1 -- 172.21.15.62:0/239619548 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1930 (secure 0 0 0) 0x7f1228045090 con 0x7f123414b880 2021-12-17T18:27:02.055 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:02.055 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:27:02.055 INFO:teuthology.orchestra.run.smithi062.stdout: "stats": { 2021-12-17T18:27:02.056 INFO:teuthology.orchestra.run.smithi062.stdout: "total_bytes": 773094113280, 2021-12-17T18:27:02.056 INFO:teuthology.orchestra.run.smithi062.stdout: "total_avail_bytes": 764492259328, 2021-12-17T18:27:02.056 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_bytes": 11919360, 2021-12-17T18:27:02.056 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_raw_bytes": 8601853952, 2021-12-17T18:27:02.057 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_raw_ratio": 0.01112652849406004, 2021-12-17T18:27:02.057 INFO:teuthology.orchestra.run.smithi062.stdout: "num_osds": 8, 2021-12-17T18:27:02.057 INFO:teuthology.orchestra.run.smithi062.stdout: "num_per_pool_osds": 8, 2021-12-17T18:27:02.057 INFO:teuthology.orchestra.run.smithi062.stdout: "num_per_pool_omap_osds": 8 2021-12-17T18:27:02.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:02.058 INFO:teuthology.orchestra.run.smithi062.stdout: "stats_by_class": { 2021-12-17T18:27:02.058 INFO:teuthology.orchestra.run.smithi062.stdout: "ssd": { 2021-12-17T18:27:02.058 INFO:teuthology.orchestra.run.smithi062.stdout: "total_bytes": 773094113280, 2021-12-17T18:27:02.059 INFO:teuthology.orchestra.run.smithi062.stdout: "total_avail_bytes": 764492259328, 2021-12-17T18:27:02.059 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_bytes": 11919360, 2021-12-17T18:27:02.059 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_raw_bytes": 8601853952, 2021-12-17T18:27:02.059 INFO:teuthology.orchestra.run.smithi062.stdout: "total_used_raw_ratio": 0.01112652849406004 2021-12-17T18:27:02.060 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:02.060 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:02.060 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:27:02.060 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:02.061 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "device_health_metrics", 2021-12-17T18:27:02.061 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 1, 2021-12-17T18:27:02.061 INFO:teuthology.orchestra.run.smithi062.stdout: "stats": { 2021-12-17T18:27:02.061 INFO:teuthology.orchestra.run.smithi062.stdout: "stored": 0, 2021-12-17T18:27:02.062 INFO:teuthology.orchestra.run.smithi062.stdout: "objects": 2, 2021-12-17T18:27:02.062 INFO:teuthology.orchestra.run.smithi062.stdout: "kb_used": 0, 2021-12-17T18:27:02.062 INFO:teuthology.orchestra.run.smithi062.stdout: "bytes_used": 0, 2021-12-17T18:27:02.062 INFO:teuthology.orchestra.run.smithi062.stdout: "percent_used": 0, 2021-12-17T18:27:02.063 INFO:teuthology.orchestra.run.smithi062.stdout: "max_avail": 362918772736 2021-12-17T18:27:02.063 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:02.063 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:02.063 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:02.064 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rbd", 2021-12-17T18:27:02.064 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 2, 2021-12-17T18:27:02.064 INFO:teuthology.orchestra.run.smithi062.stdout: "stats": { 2021-12-17T18:27:02.064 INFO:teuthology.orchestra.run.smithi062.stdout: "stored": 0, 2021-12-17T18:27:02.065 INFO:teuthology.orchestra.run.smithi062.stdout: "objects": 0, 2021-12-17T18:27:02.065 INFO:teuthology.orchestra.run.smithi062.stdout: "kb_used": 0, 2021-12-17T18:27:02.065 INFO:teuthology.orchestra.run.smithi062.stdout: "bytes_used": 0, 2021-12-17T18:27:02.065 INFO:teuthology.orchestra.run.smithi062.stdout: "percent_used": 0, 2021-12-17T18:27:02.065 INFO:teuthology.orchestra.run.smithi062.stdout: "max_avail": 362918772736 2021-12-17T18:27:02.066 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:02.066 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:02.066 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:02.066 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cephfs_data", 2021-12-17T18:27:02.067 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 22, 2021-12-17T18:27:02.067 INFO:teuthology.orchestra.run.smithi062.stdout: "stats": { 2021-12-17T18:27:02.067 INFO:teuthology.orchestra.run.smithi062.stdout: "stored": 0, 2021-12-17T18:27:02.067 INFO:teuthology.orchestra.run.smithi062.stdout: "objects": 0, 2021-12-17T18:27:02.068 INFO:teuthology.orchestra.run.smithi062.stdout: "kb_used": 0, 2021-12-17T18:27:02.068 INFO:teuthology.orchestra.run.smithi062.stdout: "bytes_used": 0, 2021-12-17T18:27:02.068 INFO:teuthology.orchestra.run.smithi062.stdout: "percent_used": 0, 2021-12-17T18:27:02.068 INFO:teuthology.orchestra.run.smithi062.stdout: "max_avail": 362918772736 2021-12-17T18:27:02.069 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:02.069 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:02.069 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:02.069 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cephfs_metadata", 2021-12-17T18:27:02.070 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 23, 2021-12-17T18:27:02.070 INFO:teuthology.orchestra.run.smithi062.stdout: "stats": { 2021-12-17T18:27:02.070 INFO:teuthology.orchestra.run.smithi062.stdout: "stored": 617, 2021-12-17T18:27:02.070 INFO:teuthology.orchestra.run.smithi062.stdout: "objects": 1, 2021-12-17T18:27:02.071 INFO:teuthology.orchestra.run.smithi062.stdout: "kb_used": 8, 2021-12-17T18:27:02.071 INFO:teuthology.orchestra.run.smithi062.stdout: "bytes_used": 8192, 2021-12-17T18:27:02.071 INFO:teuthology.orchestra.run.smithi062.stdout: "percent_used": 1.1286272361132887e-08, 2021-12-17T18:27:02.071 INFO:teuthology.orchestra.run.smithi062.stdout: "max_avail": 362918772736 2021-12-17T18:27:02.072 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:02.072 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:02.072 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:02.072 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:27:02.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.050+0000 7f123a384700 1 -- 172.21.15.62:0/239619548 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12100534f0 msgr2=0x7f12100559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:02.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.050+0000 7f123a384700 1 --2- 172.21.15.62:0/239619548 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12100534f0 0x7f12100559b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f122c00b000 tx=0x7f122c009040).stop 2021-12-17T18:27:02.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.054+0000 7f123a384700 1 -- 172.21.15.62:0/239619548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f123414b880 msgr2=0x7f123414c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:02.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.054+0000 7f123a384700 1 --2- 172.21.15.62:0/239619548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f123414b880 0x7f123414c550 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f1228001110 tx=0x7f1228007a50).stop 2021-12-17T18:27:02.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.054+0000 7f123a384700 1 -- 172.21.15.62:0/239619548 shutdown_connections 2021-12-17T18:27:02.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.054+0000 7f123a384700 1 --2- 172.21.15.62:0/239619548 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12100534f0 0x7f12100559b0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.054+0000 7f123a384700 1 --2- 172.21.15.62:0/239619548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f123414b880 0x7f123414c550 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.054+0000 7f123a384700 1 --2- 172.21.15.62:0/239619548 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f12340b5fc0 0x7f123414c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.054+0000 7f123a384700 1 --2- 172.21.15.62:0/239619548 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f12340b10f0 0x7f12340b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.054+0000 7f123a384700 1 -- 172.21.15.62:0/239619548 >> 172.21.15.62:0/239619548 conn(0x7f123405c750 msgr2=0x7f12340aeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:02.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.054+0000 7f123a384700 1 -- 172.21.15.62:0/239619548 shutdown_connections 2021-12-17T18:27:02.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.054+0000 7f123a384700 1 -- 172.21.15.62:0/239619548 wait complete. 2021-12-17T18:27:02.078 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s 2021-12-17T18:27:02.079 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-12-17T18:27:02.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.190+0000 7fb032705700 1 Processor -- start 2021-12-17T18:27:02.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.190+0000 7fb032705700 1 -- start start 2021-12-17T18:27:02.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.190+0000 7fb032705700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb02c05f730 0x7fb02c0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:02.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.190+0000 7fb032705700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c066170 con 0x7fb02c05c8f0 2021-12-17T18:27:02.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb032705700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c066410 con 0x7fb02c0b2850 2021-12-17T18:27:02.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb032705700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02c147040 con 0x7fb02c05f730 2021-12-17T18:27:02.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb030f02700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb02c05f730 0x7fb02c0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:02.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb031703700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb02c05c8f0 0x7fb02c146930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39014/0 (socket says 172.21.15.62:39014) 2021-12-17T18:27:02.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb031703700 1 -- 172.21.15.62:0/2428927447 learned_addr learned my addr 172.21.15.62:0/2428927447 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:02.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb01bfff700 1 -- 172.21.15.62:0/2428927447 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643562453 0 0) 0x7fb02c066170 con 0x7fb02c05c8f0 2021-12-17T18:27:02.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb01bfff700 1 -- 172.21.15.62:0/2428927447 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb014003260 con 0x7fb02c05c8f0 2021-12-17T18:27:02.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb01bfff700 1 -- 172.21.15.62:0/2428927447 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984515423 0 0) 0x7fb02c066410 con 0x7fb02c0b2850 2021-12-17T18:27:02.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb01bfff700 1 -- 172.21.15.62:0/2428927447 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb02c066170 con 0x7fb02c0b2850 2021-12-17T18:27:02.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb030f02700 1 -- 172.21.15.62:0/2428927447 >> v1:172.21.15.109:6789/0 conn(0x7fb02c0b2850 legacy=0x7fb02c13cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:02.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb030f02700 1 -- 172.21.15.62:0/2428927447 >> v1:172.21.15.62:6789/0 conn(0x7fb02c05c8f0 legacy=0x7fb02c146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:02.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb030f02700 1 -- 172.21.15.62:0/2428927447 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0b1ec0 con 0x7fb02c05f730 2021-12-17T18:27:02.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb030f02700 1 --2- 172.21.15.62:0/2428927447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb02c05f730 0x7fb02c0b2360 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7fb01c002f70 tx=0x7fb01c006df0).ready entity=mon.0 client_cookie=ed00bae9e1df8ae2 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:02.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb01bfff700 1 -- 172.21.15.62:0/2428927447 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb01c00d540 con 0x7fb02c05f730 2021-12-17T18:27:02.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb01bfff700 1 -- 172.21.15.62:0/2428927447 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c000e90 con 0x7fb02c05f730 2021-12-17T18:27:02.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb01bfff700 1 -- 172.21.15.62:0/2428927447 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb01c00d890 con 0x7fb02c05f730 2021-12-17T18:27:02.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb032705700 1 -- 172.21.15.62:0/2428927447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb02c05f730 msgr2=0x7fb02c0b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:02.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb032705700 1 --2- 172.21.15.62:0/2428927447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb02c05f730 0x7fb02c0b2360 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7fb01c002f70 tx=0x7fb01c006df0).stop 2021-12-17T18:27:02.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb032705700 1 -- 172.21.15.62:0/2428927447 shutdown_connections 2021-12-17T18:27:02.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb032705700 1 --2- 172.21.15.62:0/2428927447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb02c05f730 0x7fb02c0b2360 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb032705700 1 -- 172.21.15.62:0/2428927447 >> 172.21.15.62:0/2428927447 conn(0x7fb02c05bcd0 msgr2=0x7fb02c062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:02.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb032705700 1 -- 172.21.15.62:0/2428927447 shutdown_connections 2021-12-17T18:27:02.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.194+0000 7fb032705700 1 -- 172.21.15.62:0/2428927447 wait complete. 2021-12-17T18:27:02.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb032705700 1 Processor -- start 2021-12-17T18:27:02.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb032705700 1 -- start start 2021-12-17T18:27:02.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb032705700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb02c05c8f0 0x7fb02c143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:02.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb032705700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb02c05f730 0x7fb02c156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:02.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb032705700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb02c0b2850 0x7fb02c156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:02.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb032705700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c156d20 con 0x7fb02c05f730 2021-12-17T18:27:02.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb032705700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c13ed60 con 0x7fb02c0b2850 2021-12-17T18:27:02.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb032705700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c13bf50 con 0x7fb02c05c8f0 2021-12-17T18:27:02.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb030f02700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb02c05f730 0x7fb02c156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:02.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb030f02700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb02c05f730 0x7fb02c156340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55442/0 (socket says 172.21.15.62:55442) 2021-12-17T18:27:02.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb030f02700 1 -- 172.21.15.62:0/1958458974 learned_addr learned my addr 172.21.15.62:0/1958458974 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:02.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb031f04700 1 --2- 172.21.15.62:0/1958458974 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb02c0b2850 0x7fb02c156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:02.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb031703700 1 --2- 172.21.15.62:0/1958458974 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb02c05c8f0 0x7fb02c143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:02.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb031f04700 1 -- 172.21.15.62:0/1958458974 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb02c05c8f0 msgr2=0x7fb02c143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:02.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb031f04700 1 --2- 172.21.15.62:0/1958458974 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb02c05c8f0 0x7fb02c143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb031f04700 1 -- 172.21.15.62:0/1958458974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb02c05f730 msgr2=0x7fb02c156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:02.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb031f04700 1 --2- 172.21.15.62:0/1958458974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb02c05f730 0x7fb02c156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb031f04700 1 -- 172.21.15.62:0/1958458974 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c00b180 con 0x7fb02c0b2850 2021-12-17T18:27:02.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb030f02700 1 --2- 172.21.15.62:0/1958458974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb02c05f730 0x7fb02c156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:02.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.198+0000 7fb031f04700 1 --2- 172.21.15.62:0/1958458974 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb02c0b2850 0x7fb02c156830 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fb024001490 tx=0x7fb024007cd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:02.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.202+0000 7fb01a7fc700 1 -- 172.21.15.62:0/1958458974 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb024012400 con 0x7fb02c0b2850 2021-12-17T18:27:02.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.202+0000 7fb01a7fc700 1 -- 172.21.15.62:0/1958458974 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb024012560 con 0x7fb02c0b2850 2021-12-17T18:27:02.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.202+0000 7fb032705700 1 -- 172.21.15.62:0/1958458974 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c0b8300 con 0x7fb02c0b2850 2021-12-17T18:27:02.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.202+0000 7fb01a7fc700 1 -- 172.21.15.62:0/1958458974 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0240128c0 con 0x7fb02c0b2850 2021-12-17T18:27:02.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.202+0000 7fb032705700 1 -- 172.21.15.62:0/1958458974 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c13dfb0 con 0x7fb02c0b2850 2021-12-17T18:27:02.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.202+0000 7fb032705700 1 -- 172.21.15.62:0/1958458974 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c05fd80 con 0x7fb02c0b2850 2021-12-17T18:27:02.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.202+0000 7fb01a7fc700 1 -- 172.21.15.62:0/1958458974 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb024019030 con 0x7fb02c0b2850 2021-12-17T18:27:02.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.202+0000 7fb01a7fc700 1 --2- 172.21.15.62:0/1958458974 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb00c053520 0x7fb00c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:02.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.202+0000 7fb01a7fc700 1 -- 172.21.15.62:0/1958458974 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6075+0+0 (secure 0 0 0) 0x7fb02406af00 con 0x7fb02c0b2850 2021-12-17T18:27:02.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.202+0000 7fb031703700 1 --2- 172.21.15.62:0/1958458974 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb00c053520 0x7fb00c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:02.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.206+0000 7fb031703700 1 --2- 172.21.15.62:0/1958458974 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb00c053520 0x7fb00c0559e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fb02800d000 tx=0x7fb028009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:02.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.214+0000 7fb01a7fc700 1 -- 172.21.15.62:0/1958458974 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb024041f50 con 0x7fb02c0b2850 2021-12-17T18:27:02.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.378+0000 7fb032705700 1 -- 172.21.15.62:0/1958458974 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb02c0573d0 con 0x7fb02c0b2850 2021-12-17T18:27:02.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.382+0000 7fb01a7fc700 1 -- 172.21.15.62:0/1958458974 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=-22 pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. v57) v1 ==== 209+0+0 (secure 0 0 0) 0x7fb024045570 con 0x7fb02c0b2850 2021-12-17T18:27:02.387 INFO:teuthology.orchestra.run.smithi062.stderr:Error EINVAL: pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. 2021-12-17T18:27:02.391 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-12-17T18:27:02.393 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-12-17T18:27:02.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.494+0000 7f71641a1700 1 Processor -- start 2021-12-17T18:27:02.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.494+0000 7f71641a1700 1 -- start start 2021-12-17T18:27:02.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.494+0000 7f71641a1700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f715c0acbe0 0x7f715c13f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:02.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.494+0000 7f71641a1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f715c060650 0x7f715c05f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:02.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.494+0000 7f71641a1700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715c05fe40 con 0x7f715c13fda0 2021-12-17T18:27:02.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.494+0000 7f71641a1700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715c0ad5c0 con 0x7f715c060650 2021-12-17T18:27:02.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.494+0000 7f71641a1700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715c05fc20 con 0x7f715c0acbe0 2021-12-17T18:27:02.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.494+0000 7f716173c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f715c060650 0x7f715c05f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:02.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.494+0000 7f716173c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f715c060650 0x7f715c05f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55448/0 (socket says 172.21.15.62:55448) 2021-12-17T18:27:02.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.494+0000 7f716173c700 1 -- 172.21.15.62:0/2394935373 learned_addr learned my addr 172.21.15.62:0/2394935373 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:02.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.494+0000 7f7161f3d700 1 --2- 172.21.15.62:0/2394935373 >> v2:172.21.15.109:3300/0 conn(0x7f715c0acbe0 0x7f715c13f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:02.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.494+0000 7f716173c700 1 -- 172.21.15.62:0/2394935373 >> v2:172.21.15.109:3300/0 conn(0x7f715c0acbe0 msgr2=0x7f715c13f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:02.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.494+0000 7f716173c700 1 --2- 172.21.15.62:0/2394935373 >> v2:172.21.15.109:3300/0 conn(0x7f715c0acbe0 0x7f715c13f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.494+0000 7f716173c700 1 -- 172.21.15.62:0/2394935373 >> v1:172.21.15.109:6789/0 conn(0x7f715c13fda0 legacy=0x7f715c140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:02.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.494+0000 7f716173c700 1 -- 172.21.15.62:0/2394935373 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c0600e0 con 0x7f715c060650 2021-12-17T18:27:02.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.494+0000 7f716173c700 1 --2- 172.21.15.62:0/2394935373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f715c060650 0x7f715c05f730 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f71580032f0 tx=0x7f7158009290).ready entity=mon.0 client_cookie=b1d921fa8529c587 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:02.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.494+0000 7f7160f3b700 1 -- 172.21.15.62:0/2394935373 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f715800b870 con 0x7f715c060650 2021-12-17T18:27:02.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f7160f3b700 1 -- 172.21.15.62:0/2394935373 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715800b9d0 con 0x7f715c060650 2021-12-17T18:27:02.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f7160f3b700 1 -- 172.21.15.62:0/2394935373 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f715800bb40 con 0x7f715c060650 2021-12-17T18:27:02.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f71641a1700 1 -- 172.21.15.62:0/2394935373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f715c060650 msgr2=0x7f715c05f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:02.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f71641a1700 1 --2- 172.21.15.62:0/2394935373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f715c060650 0x7f715c05f730 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f71580032f0 tx=0x7f7158009290).stop 2021-12-17T18:27:02.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f71641a1700 1 -- 172.21.15.62:0/2394935373 shutdown_connections 2021-12-17T18:27:02.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f71641a1700 1 --2- 172.21.15.62:0/2394935373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f715c060650 0x7f715c05f730 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f71641a1700 1 --2- 172.21.15.62:0/2394935373 >> v2:172.21.15.109:3300/0 conn(0x7f715c0acbe0 0x7f715c13f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f71641a1700 1 -- 172.21.15.62:0/2394935373 >> 172.21.15.62:0/2394935373 conn(0x7f715c062430 msgr2=0x7f715c062840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:02.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f71641a1700 1 -- 172.21.15.62:0/2394935373 shutdown_connections 2021-12-17T18:27:02.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f71641a1700 1 -- 172.21.15.62:0/2394935373 wait complete. 2021-12-17T18:27:02.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f71641a1700 1 Processor -- start 2021-12-17T18:27:02.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f71641a1700 1 -- start start 2021-12-17T18:27:02.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f71641a1700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f715c060650 0x7f715c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:02.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f71641a1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f715c0acbe0 0x7f715c152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:02.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f71641a1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f715c13fda0 0x7f715c152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:02.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f71641a1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c13c3f0 con 0x7f715c0acbe0 2021-12-17T18:27:02.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f71641a1700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0a0060 con 0x7f715c060650 2021-12-17T18:27:02.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f71641a1700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715c145e50 con 0x7f715c13fda0 2021-12-17T18:27:02.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f716173c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f715c0acbe0 0x7f715c152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:02.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f716173c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f715c0acbe0 0x7f715c152790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55456/0 (socket says 172.21.15.62:55456) 2021-12-17T18:27:02.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.498+0000 7f716173c700 1 -- 172.21.15.62:0/1804505893 learned_addr learned my addr 172.21.15.62:0/1804505893 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:02.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.502+0000 7f7161f3d700 1 --2- 172.21.15.62:0/1804505893 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f715c060650 0x7f715c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:02.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.502+0000 7f716273e700 1 --2- 172.21.15.62:0/1804505893 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f715c13fda0 0x7f715c152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:02.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.502+0000 7f716173c700 1 -- 172.21.15.62:0/1804505893 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f715c13fda0 msgr2=0x7f715c152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:02.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.502+0000 7f716173c700 1 --2- 172.21.15.62:0/1804505893 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f715c13fda0 0x7f715c152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.502+0000 7f716173c700 1 -- 172.21.15.62:0/1804505893 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f715c060650 msgr2=0x7f715c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:02.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.502+0000 7f716173c700 1 --2- 172.21.15.62:0/1804505893 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f715c060650 0x7f715c0b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.502+0000 7f716173c700 1 -- 172.21.15.62:0/1804505893 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7158009530 con 0x7f715c0acbe0 2021-12-17T18:27:02.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.502+0000 7f716173c700 1 --2- 172.21.15.62:0/1804505893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f715c0acbe0 0x7f715c152790 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f71580032f0 tx=0x7f7158016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:02.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.502+0000 7f714affd700 1 -- 172.21.15.62:0/1804505893 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7158021440 con 0x7f715c0acbe0 2021-12-17T18:27:02.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.502+0000 7f714affd700 1 -- 172.21.15.62:0/1804505893 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71580215a0 con 0x7f715c0acbe0 2021-12-17T18:27:02.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.502+0000 7f714affd700 1 -- 172.21.15.62:0/1804505893 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7158021900 con 0x7f715c0acbe0 2021-12-17T18:27:02.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.502+0000 7f71641a1700 1 -- 172.21.15.62:0/1804505893 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715c1460f0 con 0x7f715c0acbe0 2021-12-17T18:27:02.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.502+0000 7f71641a1700 1 -- 172.21.15.62:0/1804505893 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715c153170 con 0x7f715c0acbe0 2021-12-17T18:27:02.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.502+0000 7f71641a1700 1 -- 172.21.15.62:0/1804505893 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715c146280 con 0x7f715c0acbe0 2021-12-17T18:27:02.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.502+0000 7f714affd700 1 -- 172.21.15.62:0/1804505893 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7158029070 con 0x7f715c0acbe0 2021-12-17T18:27:02.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.502+0000 7f714affd700 1 --2- 172.21.15.62:0/1804505893 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f713c053610 0x7f713c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:02.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.502+0000 7f714affd700 1 -- 172.21.15.62:0/1804505893 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6075+0+0 (secure 0 0 0) 0x7f715806cda0 con 0x7f715c0acbe0 2021-12-17T18:27:02.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.506+0000 7f7161f3d700 1 --2- 172.21.15.62:0/1804505893 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f713c053610 0x7f713c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:02.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.506+0000 7f7161f3d700 1 --2- 172.21.15.62:0/1804505893 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f713c053610 0x7f713c055ad0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f714c00c000 tx=0x7f714c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:02.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.510+0000 7f714affd700 1 -- 172.21.15.62:0/1804505893 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7158043f00 con 0x7f715c0acbe0 2021-12-17T18:27:02.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.674+0000 7f71641a1700 1 -- 172.21.15.62:0/1804505893 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f715c09fe50 con 0x7f715c0acbe0 2021-12-17T18:27:02.679 INFO:tasks.ceph.mon.a.smithi062.stderr:2021-12-17T18:27:02.674+0000 7f8d38b61700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-12-17T18:27:02.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.682+0000 7f714affd700 1 -- 172.21.15.62:0/1804505893 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 23 and data pool 22 v58) v1 ==== 189+0+0 (secure 0 0 0) 0x7f7158015030 con 0x7f715c0acbe0 2021-12-17T18:27:02.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.686+0000 7f71641a1700 1 -- 172.21.15.62:0/1804505893 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f713c053610 msgr2=0x7f713c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.686+0000 7f71641a1700 1 --2- 172.21.15.62:0/1804505893 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f713c053610 0x7f713c055ad0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f714c00c000 tx=0x7f714c008040).stop 2021-12-17T18:27:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.686+0000 7f71641a1700 1 -- 172.21.15.62:0/1804505893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f715c0acbe0 msgr2=0x7f715c152790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.686+0000 7f71641a1700 1 --2- 172.21.15.62:0/1804505893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f715c0acbe0 0x7f715c152790 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f71580032f0 tx=0x7f7158016000).stop 2021-12-17T18:27:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.686+0000 7f71641a1700 1 -- 172.21.15.62:0/1804505893 shutdown_connections 2021-12-17T18:27:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.686+0000 7f71641a1700 1 --2- 172.21.15.62:0/1804505893 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f713c053610 0x7f713c055ad0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.686+0000 7f71641a1700 1 --2- 172.21.15.62:0/1804505893 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f715c13fda0 0x7f715c152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.686+0000 7f71641a1700 1 --2- 172.21.15.62:0/1804505893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f715c0acbe0 0x7f715c152790 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.686+0000 7f71641a1700 1 --2- 172.21.15.62:0/1804505893 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f715c060650 0x7f715c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.686+0000 7f71641a1700 1 -- 172.21.15.62:0/1804505893 >> 172.21.15.62:0/1804505893 conn(0x7f715c062430 msgr2=0x7f715c066370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.686+0000 7f71641a1700 1 -- 172.21.15.62:0/1804505893 shutdown_connections 2021-12-17T18:27:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.686+0000 7f71641a1700 1 -- 172.21.15.62:0/1804505893 wait complete. 2021-12-17T18:27:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 23 and data pool 22 2021-12-17T18:27:02.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-12-17T18:27:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.806+0000 7fcaba2af700 1 Processor -- start 2021-12-17T18:27:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.806+0000 7fcaba2af700 1 -- start start 2021-12-17T18:27:02.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcaba2af700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcab40b65b0 0x7fcab413ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:02.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcaba2af700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcab40b41e0 0x7fcab40b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcaba2af700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab40b6ee0 con 0x7fcab4060950 2021-12-17T18:27:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcaba2af700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab40b1c40 con 0x7fcab40b65b0 2021-12-17T18:27:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcaba2af700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab40b6990 con 0x7fcab40b41e0 2021-12-17T18:27:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcab92ad700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcab40b65b0 0x7fcab413ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcab9aae700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcab40b41e0 0x7fcab40b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcab8aac700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7fcab4060950 0x7fcab4140420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:55362/0 (socket says 172.21.15.62:55362) 2021-12-17T18:27:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcab92ad700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcab40b65b0 0x7fcab413ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55462/0 (socket says 172.21.15.62:55462) 2021-12-17T18:27:02.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcab8aac700 1 -- 172.21.15.62:0/669340793 learned_addr learned my addr 172.21.15.62:0/669340793 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:02.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcab92ad700 1 -- 172.21.15.62:0/669340793 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcab40b41e0 msgr2=0x7fcab40b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:02.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcab92ad700 1 --2- 172.21.15.62:0/669340793 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcab40b41e0 0x7fcab40b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcab92ad700 1 -- 172.21.15.62:0/669340793 >> v1:172.21.15.109:6789/0 conn(0x7fcab4060950 legacy=0x7fcab4140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:02.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcab92ad700 1 -- 172.21.15.62:0/669340793 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab40b5e20 con 0x7fcab40b65b0 2021-12-17T18:27:02.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcab92ad700 1 --2- 172.21.15.62:0/669340793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab40b65b0 0x7fcab413ff30 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7fcaac002f70 tx=0x7fcaac006df0).ready entity=mon.0 client_cookie=7bf7af719461d45c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:02.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcab3fff700 1 -- 172.21.15.62:0/669340793 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaac00d570 con 0x7fcab40b65b0 2021-12-17T18:27:02.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcab3fff700 1 -- 172.21.15.62:0/669340793 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac000e90 con 0x7fcab40b65b0 2021-12-17T18:27:02.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcab3fff700 1 -- 172.21.15.62:0/669340793 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaac00d8c0 con 0x7fcab40b65b0 2021-12-17T18:27:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcaba2af700 1 -- 172.21.15.62:0/669340793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab40b65b0 msgr2=0x7fcab413ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcaba2af700 1 --2- 172.21.15.62:0/669340793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab40b65b0 0x7fcab413ff30 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7fcaac002f70 tx=0x7fcaac006df0).stop 2021-12-17T18:27:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcaba2af700 1 -- 172.21.15.62:0/669340793 shutdown_connections 2021-12-17T18:27:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcaba2af700 1 --2- 172.21.15.62:0/669340793 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcab40b41e0 0x7fcab40b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcaba2af700 1 --2- 172.21.15.62:0/669340793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab40b65b0 0x7fcab413ff30 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcaba2af700 1 -- 172.21.15.62:0/669340793 >> 172.21.15.62:0/669340793 conn(0x7fcab405c750 msgr2=0x7fcab405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcaba2af700 1 -- 172.21.15.62:0/669340793 shutdown_connections 2021-12-17T18:27:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.810+0000 7fcaba2af700 1 -- 172.21.15.62:0/669340793 wait complete. 2021-12-17T18:27:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcaba2af700 1 Processor -- start 2021-12-17T18:27:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcaba2af700 1 -- start start 2021-12-17T18:27:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcaba2af700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab4060950 0x7fcab4063920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcaba2af700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcab40b41e0 0x7fcab405f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcaba2af700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcab40b65b0 0x7fcab4143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcaba2af700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab4155de0 con 0x7fcab4060950 2021-12-17T18:27:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcaba2af700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab405fd60 con 0x7fcab40b41e0 2021-12-17T18:27:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcaba2af700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab4060000 con 0x7fcab40b65b0 2021-12-17T18:27:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcab92ad700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab4060950 0x7fcab4063920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcab9aae700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcab40b65b0 0x7fcab4143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcab8aac700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcab40b41e0 0x7fcab405f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcab92ad700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab4060950 0x7fcab4063920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55470/0 (socket says 172.21.15.62:55470) 2021-12-17T18:27:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcab92ad700 1 -- 172.21.15.62:0/1351401958 learned_addr learned my addr 172.21.15.62:0/1351401958 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcab92ad700 1 -- 172.21.15.62:0/1351401958 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcab40b65b0 msgr2=0x7fcab4143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcab92ad700 1 --2- 172.21.15.62:0/1351401958 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcab40b65b0 0x7fcab4143aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcab92ad700 1 -- 172.21.15.62:0/1351401958 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcab40b41e0 msgr2=0x7fcab405f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcab92ad700 1 --2- 172.21.15.62:0/1351401958 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcab40b41e0 0x7fcab405f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcab92ad700 1 -- 172.21.15.62:0/1351401958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac00b180 con 0x7fcab4060950 2021-12-17T18:27:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcab92ad700 1 --2- 172.21.15.62:0/1351401958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab4060950 0x7fcab4063920 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7fcaac002f70 tx=0x7fcaac014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcab27fc700 1 -- 172.21.15.62:0/1351401958 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaac00dea0 con 0x7fcab4060950 2021-12-17T18:27:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcab27fc700 1 -- 172.21.15.62:0/1351401958 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac013e90 con 0x7fcab4060950 2021-12-17T18:27:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcaba2af700 1 -- 172.21.15.62:0/1351401958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab4066f50 con 0x7fcab4060950 2021-12-17T18:27:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcab27fc700 1 -- 172.21.15.62:0/1351401958 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaac01e5f0 con 0x7fcab4060950 2021-12-17T18:27:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.814+0000 7fcaba2af700 1 -- 172.21.15.62:0/1351401958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab4156210 con 0x7fcab4060950 2021-12-17T18:27:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.818+0000 7fcaba2af700 1 -- 172.21.15.62:0/1351401958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab40573d0 con 0x7fcab4060950 2021-12-17T18:27:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.818+0000 7fcab27fc700 1 -- 172.21.15.62:0/1351401958 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcaac025030 con 0x7fcab4060950 2021-12-17T18:27:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.818+0000 7fcab27fc700 1 --2- 172.21.15.62:0/1351401958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fca940534f0 0x7fca940559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:02.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.818+0000 7fcab27fc700 1 -- 172.21.15.62:0/1351401958 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fcaac06c900 con 0x7fcab4060950 2021-12-17T18:27:02.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.818+0000 7fcab8aac700 1 --2- 172.21.15.62:0/1351401958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fca940534f0 0x7fca940559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:02.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.818+0000 7fcab8aac700 1 --2- 172.21.15.62:0/1351401958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fca940534f0 0x7fca940559b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fcaa400d000 tx=0x7fcaa4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:02.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.822+0000 7fcab27fc700 1 -- 172.21.15.62:0/1351401958 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcaac043940 con 0x7fcab4060950 2021-12-17T18:27:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:02.986+0000 7fcaba2af700 1 -- 172.21.15.62:0/1351401958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcab4146410 con 0x7fcab4060950 2021-12-17T18:27:03.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.822+0000 7fcab27fc700 1 -- 172.21.15.62:0/1351401958 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v59) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcaac046f20 con 0x7fcab4060950 2021-12-17T18:27:03.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.826+0000 7fcaba2af700 1 -- 172.21.15.62:0/1351401958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fca940534f0 msgr2=0x7fca940559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:03.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.826+0000 7fcaba2af700 1 --2- 172.21.15.62:0/1351401958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fca940534f0 0x7fca940559b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fcaa400d000 tx=0x7fcaa4009040).stop 2021-12-17T18:27:03.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.826+0000 7fcaba2af700 1 -- 172.21.15.62:0/1351401958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab4060950 msgr2=0x7fcab4063920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:03.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.826+0000 7fcaba2af700 1 --2- 172.21.15.62:0/1351401958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab4060950 0x7fcab4063920 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7fcaac002f70 tx=0x7fcaac014000).stop 2021-12-17T18:27:03.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.826+0000 7fcaba2af700 1 -- 172.21.15.62:0/1351401958 shutdown_connections 2021-12-17T18:27:03.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.826+0000 7fcaba2af700 1 --2- 172.21.15.62:0/1351401958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fca940534f0 0x7fca940559b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:03.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.826+0000 7fcaba2af700 1 --2- 172.21.15.62:0/1351401958 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcab40b65b0 0x7fcab4143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:03.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.826+0000 7fcaba2af700 1 --2- 172.21.15.62:0/1351401958 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcab40b41e0 0x7fcab405f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:03.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.826+0000 7fcaba2af700 1 --2- 172.21.15.62:0/1351401958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab4060950 0x7fcab4063920 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:03.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.826+0000 7fcaba2af700 1 -- 172.21.15.62:0/1351401958 >> 172.21.15.62:0/1351401958 conn(0x7fcab405c750 msgr2=0x7fcab4140170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:03.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.826+0000 7fcaba2af700 1 -- 172.21.15.62:0/1351401958 shutdown_connections 2021-12-17T18:27:03.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.826+0000 7fcaba2af700 1 -- 172.21.15.62:0/1351401958 wait complete. 2021-12-17T18:27:03.847 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-12-17T18:27:03.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.962+0000 7fbc86384700 1 Processor -- start 2021-12-17T18:27:03.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.962+0000 7fbc86384700 1 -- start start 2021-12-17T18:27:03.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.962+0000 7fbc86384700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbc80060540 0x7fbc8005f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:03.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.962+0000 7fbc86384700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbc800ad150 0x7fbc800b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:03.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.962+0000 7fbc86384700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8005ce70 con 0x7fbc8005ca90 2021-12-17T18:27:03.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.962+0000 7fbc86384700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc800afc70 con 0x7fbc800ad150 2021-12-17T18:27:03.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.962+0000 7fbc86384700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800abf30 con 0x7fbc80060540 2021-12-17T18:27:03.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.962+0000 7fbc85b83700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbc800ad150 0x7fbc800b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:03.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc85b83700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbc800ad150 0x7fbc800b1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55480/0 (socket says 172.21.15.62:55480) 2021-12-17T18:27:03.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc85b83700 1 -- 172.21.15.62:0/378586699 learned_addr learned my addr 172.21.15.62:0/378586699 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:03.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc85382700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbc8005ca90 0x7fbc800aca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39056/0 (socket says 172.21.15.62:39056) 2021-12-17T18:27:03.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc84b81700 1 --2- 172.21.15.62:0/378586699 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbc80060540 0x7fbc8005f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:03.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc85b83700 1 -- 172.21.15.62:0/378586699 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbc80060540 msgr2=0x7fbc8005f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:03.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc85b83700 1 --2- 172.21.15.62:0/378586699 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbc80060540 0x7fbc8005f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:03.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc85b83700 1 -- 172.21.15.62:0/378586699 >> v1:172.21.15.62:6789/0 conn(0x7fbc8005ca90 legacy=0x7fbc800aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:03.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc85b83700 1 -- 172.21.15.62:0/378586699 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc800ac1d0 con 0x7fbc800ad150 2021-12-17T18:27:03.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc85b83700 1 --2- 172.21.15.62:0/378586699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc800ad150 0x7fbc800b1bf0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7fbc780032f0 tx=0x7fbc78009290).ready entity=mon.0 client_cookie=44f47dad0afd2856 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:03.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc77fff700 1 -- 172.21.15.62:0/378586699 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc7800b8a0 con 0x7fbc800ad150 2021-12-17T18:27:03.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc77fff700 1 -- 172.21.15.62:0/378586699 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7800ba00 con 0x7fbc800ad150 2021-12-17T18:27:03.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc77fff700 1 -- 172.21.15.62:0/378586699 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc7800bb70 con 0x7fbc800ad150 2021-12-17T18:27:03.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc86384700 1 -- 172.21.15.62:0/378586699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc800ad150 msgr2=0x7fbc800b1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:03.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc86384700 1 --2- 172.21.15.62:0/378586699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc800ad150 0x7fbc800b1bf0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7fbc780032f0 tx=0x7fbc78009290).stop 2021-12-17T18:27:03.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc86384700 1 -- 172.21.15.62:0/378586699 shutdown_connections 2021-12-17T18:27:03.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc86384700 1 --2- 172.21.15.62:0/378586699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc800ad150 0x7fbc800b1bf0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:03.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc86384700 1 --2- 172.21.15.62:0/378586699 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbc80060540 0x7fbc8005f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:03.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc86384700 1 -- 172.21.15.62:0/378586699 >> 172.21.15.62:0/378586699 conn(0x7fbc8005be70 msgr2=0x7fbc80062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:03.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc86384700 1 -- 172.21.15.62:0/378586699 shutdown_connections 2021-12-17T18:27:03.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.966+0000 7fbc86384700 1 -- 172.21.15.62:0/378586699 wait complete. 2021-12-17T18:27:03.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc86384700 1 Processor -- start 2021-12-17T18:27:03.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc86384700 1 -- start start 2021-12-17T18:27:03.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc86384700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbc8005ca90 0x7fbc80145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:03.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc86384700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc80060540 0x7fbc80143470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:03.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc86384700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbc800ad150 0x7fbc80143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:03.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc86384700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc80065d40 con 0x7fbc80060540 2021-12-17T18:27:03.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc86384700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc80065fe0 con 0x7fbc8005ca90 2021-12-17T18:27:03.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc86384700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc80066280 con 0x7fbc800ad150 2021-12-17T18:27:03.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc84b81700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc80060540 0x7fbc80143470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:03.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc84b81700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc80060540 0x7fbc80143470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55486/0 (socket says 172.21.15.62:55486) 2021-12-17T18:27:03.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc84b81700 1 -- 172.21.15.62:0/1833478330 learned_addr learned my addr 172.21.15.62:0/1833478330 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:03.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc85382700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbc8005ca90 0x7fbc80145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:03.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc85b83700 1 --2- 172.21.15.62:0/1833478330 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbc800ad150 0x7fbc80143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:03.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc84b81700 1 -- 172.21.15.62:0/1833478330 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbc800ad150 msgr2=0x7fbc80143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:03.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc84b81700 1 --2- 172.21.15.62:0/1833478330 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbc800ad150 0x7fbc80143960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:03.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc84b81700 1 -- 172.21.15.62:0/1833478330 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbc8005ca90 msgr2=0x7fbc80145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:03.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc84b81700 1 --2- 172.21.15.62:0/1833478330 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbc8005ca90 0x7fbc80145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:03.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc84b81700 1 -- 172.21.15.62:0/1833478330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc78009530 con 0x7fbc80060540 2021-12-17T18:27:03.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc84b81700 1 --2- 172.21.15.62:0/1833478330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc80060540 0x7fbc80143470 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7fbc700030b0 tx=0x7fbc70008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:03.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc767fc700 1 -- 172.21.15.62:0/1833478330 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc70011780 con 0x7fbc80060540 2021-12-17T18:27:03.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc767fc700 1 -- 172.21.15.62:0/1833478330 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc700118e0 con 0x7fbc80060540 2021-12-17T18:27:03.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc86384700 1 -- 172.21.15.62:0/1833478330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc800aeb00 con 0x7fbc80060540 2021-12-17T18:27:03.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc767fc700 1 -- 172.21.15.62:0/1833478330 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc70011c40 con 0x7fbc80060540 2021-12-17T18:27:03.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.970+0000 7fbc86384700 1 -- 172.21.15.62:0/1833478330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc800671a0 con 0x7fbc80060540 2021-12-17T18:27:03.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.974+0000 7fbc86384700 1 -- 172.21.15.62:0/1833478330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc80065b90 con 0x7fbc80060540 2021-12-17T18:27:03.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.974+0000 7fbc767fc700 1 -- 172.21.15.62:0/1833478330 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbc70012420 con 0x7fbc80060540 2021-12-17T18:27:03.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.974+0000 7fbc767fc700 1 --2- 172.21.15.62:0/1833478330 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbc680536a0 0x7fbc68055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:03.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.974+0000 7fbc767fc700 1 -- 172.21.15.62:0/1833478330 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fbc7006b8e0 con 0x7fbc80060540 2021-12-17T18:27:03.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.974+0000 7fbc85382700 1 --2- 172.21.15.62:0/1833478330 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbc680536a0 0x7fbc68055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:03.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.974+0000 7fbc85382700 1 --2- 172.21.15.62:0/1833478330 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbc680536a0 0x7fbc68055b60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fbc7c00d000 tx=0x7fbc7c007b80).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:03.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:03.982+0000 7fbc767fc700 1 -- 172.21.15.62:0/1833478330 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbc70042800 con 0x7fbc80060540 2021-12-17T18:27:04.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.110+0000 7fbc86384700 1 -- 172.21.15.62:0/1833478330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbc80066440 con 0x7fbc80060540 2021-12-17T18:27:04.615 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:27:04.618 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:27:04.621 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:27:04.623 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:27:04.626 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:27:04.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.826+0000 7fbc767fc700 1 -- 172.21.15.62:0/1833478330 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) v1 ==== 185+0+0 (secure 0 0 0) 0x7fbc70045e20 con 0x7fbc80060540 2021-12-17T18:27:04.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.830+0000 7fbc86384700 1 -- 172.21.15.62:0/1833478330 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbc680536a0 msgr2=0x7fbc68055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:04.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.830+0000 7fbc86384700 1 --2- 172.21.15.62:0/1833478330 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbc680536a0 0x7fbc68055b60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fbc7c00d000 tx=0x7fbc7c007b80).stop 2021-12-17T18:27:04.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.830+0000 7fbc86384700 1 -- 172.21.15.62:0/1833478330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc80060540 msgr2=0x7fbc80143470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:04.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.830+0000 7fbc86384700 1 --2- 172.21.15.62:0/1833478330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc80060540 0x7fbc80143470 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7fbc700030b0 tx=0x7fbc70008040).stop 2021-12-17T18:27:04.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.830+0000 7fbc86384700 1 -- 172.21.15.62:0/1833478330 shutdown_connections 2021-12-17T18:27:04.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.830+0000 7fbc86384700 1 --2- 172.21.15.62:0/1833478330 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fbc680536a0 0x7fbc68055b60 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:04.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.830+0000 7fbc86384700 1 --2- 172.21.15.62:0/1833478330 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fbc800ad150 0x7fbc80143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:04.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.830+0000 7fbc86384700 1 --2- 172.21.15.62:0/1833478330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc80060540 0x7fbc80143470 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:04.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.830+0000 7fbc86384700 1 --2- 172.21.15.62:0/1833478330 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fbc8005ca90 0x7fbc80145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:04.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.830+0000 7fbc86384700 1 -- 172.21.15.62:0/1833478330 >> 172.21.15.62:0/1833478330 conn(0x7fbc8005be70 msgr2=0x7fbc80148990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:04.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.830+0000 7fbc86384700 1 -- 172.21.15.62:0/1833478330 shutdown_connections 2021-12-17T18:27:04.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.830+0000 7fbc86384700 1 -- 172.21.15.62:0/1833478330 wait complete. 2021-12-17T18:27:04.837 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2021-12-17T18:27:04.847 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-12-17T18:27:04.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.958+0000 7f1e3bfff700 1 Processor -- start 2021-12-17T18:27:04.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.958+0000 7f1e3bfff700 1 -- start start 2021-12-17T18:27:04.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1e3c143810 0x7f1e3c0aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:04.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3bfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e3c0afeb0 0x7f1e3c0b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:04.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3bfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c0ac950 con 0x7f1e3c0b2070 2021-12-17T18:27:04.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3bfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c142ca0 con 0x7f1e3c143810 2021-12-17T18:27:04.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3bfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0b2450 con 0x7f1e3c0afeb0 2021-12-17T18:27:04.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e327fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1e3c143810 0x7f1e3c0aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:04.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e327fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1e3c143810 0x7f1e3c0aeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55490/0 (socket says 172.21.15.62:55490) 2021-12-17T18:27:04.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3affd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1e3c0b2070 0x7f1e3c143100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39070/0 (socket says 172.21.15.62:39070) 2021-12-17T18:27:04.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e327fc700 1 -- 172.21.15.62:0/1379127896 learned_addr learned my addr 172.21.15.62:0/1379127896 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:04.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3b7fe700 1 --2- 172.21.15.62:0/1379127896 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e3c0afeb0 0x7f1e3c0b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:04.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e327fc700 1 -- 172.21.15.62:0/1379127896 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e3c0afeb0 msgr2=0x7f1e3c0b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:04.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e327fc700 1 --2- 172.21.15.62:0/1379127896 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e3c0afeb0 0x7f1e3c0b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:04.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e327fc700 1 -- 172.21.15.62:0/1379127896 >> v1:172.21.15.62:6789/0 conn(0x7f1e3c0b2070 legacy=0x7f1e3c143100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:04.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e327fc700 1 -- 172.21.15.62:0/1379127896 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c0ace20 con 0x7f1e3c143810 2021-12-17T18:27:04.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3a7fc700 1 -- 172.21.15.62:0/1379127896 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725143350 0 0) 0x7f1e3c0ac950 con 0x7f1e3c0b2070 2021-12-17T18:27:04.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e327fc700 1 --2- 172.21.15.62:0/1379127896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e3c143810 0x7f1e3c0aeac0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f1e24002f70 tx=0x7f1e24006eb0).ready entity=mon.0 client_cookie=600b98ceb28d81f4 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:04.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3a7fc700 1 -- 172.21.15.62:0/1379127896 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e2400d570 con 0x7f1e3c143810 2021-12-17T18:27:04.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3a7fc700 1 -- 172.21.15.62:0/1379127896 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e24000e90 con 0x7f1e3c143810 2021-12-17T18:27:04.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3a7fc700 1 -- 172.21.15.62:0/1379127896 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e2400d8c0 con 0x7f1e3c143810 2021-12-17T18:27:04.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3bfff700 1 -- 172.21.15.62:0/1379127896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e3c143810 msgr2=0x7f1e3c0aeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:04.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3bfff700 1 --2- 172.21.15.62:0/1379127896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e3c143810 0x7f1e3c0aeac0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f1e24002f70 tx=0x7f1e24006eb0).stop 2021-12-17T18:27:04.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3bfff700 1 -- 172.21.15.62:0/1379127896 shutdown_connections 2021-12-17T18:27:04.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3bfff700 1 --2- 172.21.15.62:0/1379127896 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e3c0afeb0 0x7f1e3c0b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:04.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3bfff700 1 --2- 172.21.15.62:0/1379127896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e3c143810 0x7f1e3c0aeac0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:04.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3bfff700 1 -- 172.21.15.62:0/1379127896 >> 172.21.15.62:0/1379127896 conn(0x7f1e3c05c070 msgr2=0x7f1e3c062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:04.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3bfff700 1 -- 172.21.15.62:0/1379127896 shutdown_connections 2021-12-17T18:27:04.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.962+0000 7f1e3bfff700 1 -- 172.21.15.62:0/1379127896 wait complete. 2021-12-17T18:27:04.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e3bfff700 1 Processor -- start 2021-12-17T18:27:04.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e3bfff700 1 -- start start 2021-12-17T18:27:04.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e3bfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1e3c0afeb0 0x7f1e3c09eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:04.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e3bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e3c0b2070 0x7f1e3c09f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:04.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e3bfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e3c143810 0x7f1e3c0a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e3bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c13d420 con 0x7f1e3c0b2070 2021-12-17T18:27:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e3bfff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0a0a60 con 0x7f1e3c0afeb0 2021-12-17T18:27:04.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e3bfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0ab2f0 con 0x7f1e3c143810 2021-12-17T18:27:04.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e327fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e3c0b2070 0x7f1e3c09f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:04.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e327fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e3c0b2070 0x7f1e3c09f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55498/0 (socket says 172.21.15.62:55498) 2021-12-17T18:27:04.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e3b7fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e3c143810 0x7f1e3c0a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:04.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e327fc700 1 -- 172.21.15.62:0/4162730226 learned_addr learned my addr 172.21.15.62:0/4162730226 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:04.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e3affd700 1 --2- 172.21.15.62:0/4162730226 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1e3c0afeb0 0x7f1e3c09eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:04.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e327fc700 1 -- 172.21.15.62:0/4162730226 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e3c143810 msgr2=0x7f1e3c0a0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:04.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e327fc700 1 --2- 172.21.15.62:0/4162730226 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e3c143810 0x7f1e3c0a0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:04.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e327fc700 1 -- 172.21.15.62:0/4162730226 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1e3c0afeb0 msgr2=0x7f1e3c09eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:04.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e327fc700 1 --2- 172.21.15.62:0/4162730226 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1e3c0afeb0 0x7f1e3c09eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:04.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e327fc700 1 -- 172.21.15.62:0/4162730226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2400b1e0 con 0x7f1e3c0b2070 2021-12-17T18:27:04.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e3affd700 1 --2- 172.21.15.62:0/4162730226 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1e3c0afeb0 0x7f1e3c09eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:04.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e327fc700 1 --2- 172.21.15.62:0/4162730226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e3c0b2070 0x7f1e3c09f290 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f1e24002f70 tx=0x7f1e24015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:04.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e38ff9700 1 -- 172.21.15.62:0/4162730226 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e24006b60 con 0x7f1e3c0b2070 2021-12-17T18:27:04.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e38ff9700 1 -- 172.21.15.62:0/4162730226 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2400d910 con 0x7f1e3c0b2070 2021-12-17T18:27:04.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e3bfff700 1 -- 172.21.15.62:0/4162730226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3c0ab590 con 0x7f1e3c0b2070 2021-12-17T18:27:04.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e38ff9700 1 -- 172.21.15.62:0/4162730226 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e24011e20 con 0x7f1e3c0b2070 2021-12-17T18:27:04.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.966+0000 7f1e3bfff700 1 -- 172.21.15.62:0/4162730226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c066760 con 0x7f1e3c0b2070 2021-12-17T18:27:04.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.970+0000 7f1e38ff9700 1 -- 172.21.15.62:0/4162730226 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1e24025030 con 0x7f1e3c0b2070 2021-12-17T18:27:04.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.970+0000 7f1e3bfff700 1 -- 172.21.15.62:0/4162730226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3c0673e0 con 0x7f1e3c0b2070 2021-12-17T18:27:04.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.970+0000 7f1e38ff9700 1 --2- 172.21.15.62:0/4162730226 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e20053580 0x7f1e20055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:04.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.970+0000 7f1e38ff9700 1 -- 172.21.15.62:0/4162730226 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f1e2406c810 con 0x7f1e3c0b2070 2021-12-17T18:27:04.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.970+0000 7f1e3affd700 1 --2- 172.21.15.62:0/4162730226 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e20053580 0x7f1e20055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:04.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.970+0000 7f1e3affd700 1 --2- 172.21.15.62:0/4162730226 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e20053580 0x7f1e20055a40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f1e2c00d000 tx=0x7f1e2c007a00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:04.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:04.978+0000 7f1e38ff9700 1 -- 172.21.15.62:0/4162730226 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1e24043ad0 con 0x7f1e3c0b2070 2021-12-17T18:27:05.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.106+0000 7f1e3bfff700 1 -- 172.21.15.62:0/4162730226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f1e3c0acb80 con 0x7f1e3c0b2070 2021-12-17T18:27:05.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.838+0000 7f1e38ff9700 1 -- 172.21.15.62:0/4162730226 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v121) v1 ==== 133+0+0 (secure 0 0 0) 0x7f1e24023020 con 0x7f1e3c0b2070 2021-12-17T18:27:05.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.842+0000 7f1e3bfff700 1 -- 172.21.15.62:0/4162730226 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e20053580 msgr2=0x7f1e20055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:05.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.842+0000 7f1e3bfff700 1 --2- 172.21.15.62:0/4162730226 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e20053580 0x7f1e20055a40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f1e2c00d000 tx=0x7f1e2c007a00).stop 2021-12-17T18:27:05.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.842+0000 7f1e3bfff700 1 -- 172.21.15.62:0/4162730226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e3c0b2070 msgr2=0x7f1e3c09f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:05.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.842+0000 7f1e3bfff700 1 --2- 172.21.15.62:0/4162730226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e3c0b2070 0x7f1e3c09f290 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f1e24002f70 tx=0x7f1e24015000).stop 2021-12-17T18:27:05.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.846+0000 7f1e3bfff700 1 -- 172.21.15.62:0/4162730226 shutdown_connections 2021-12-17T18:27:05.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.846+0000 7f1e3bfff700 1 --2- 172.21.15.62:0/4162730226 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1e20053580 0x7f1e20055a40 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:05.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.846+0000 7f1e3bfff700 1 --2- 172.21.15.62:0/4162730226 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1e3c143810 0x7f1e3c0a0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:05.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.846+0000 7f1e3bfff700 1 --2- 172.21.15.62:0/4162730226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e3c0b2070 0x7f1e3c09f290 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:05.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.846+0000 7f1e3bfff700 1 --2- 172.21.15.62:0/4162730226 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1e3c0afeb0 0x7f1e3c09eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:05.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.846+0000 7f1e3bfff700 1 -- 172.21.15.62:0/4162730226 >> 172.21.15.62:0/4162730226 conn(0x7f1e3c05c070 msgr2=0x7f1e3c05c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:05.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.846+0000 7f1e3bfff700 1 -- 172.21.15.62:0/4162730226 shutdown_connections 2021-12-17T18:27:05.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.846+0000 7f1e3bfff700 1 -- 172.21.15.62:0/4162730226 wait complete. 2021-12-17T18:27:05.853 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2021-12-17T18:27:05.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-12-17T18:27:05.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.974+0000 7fad0adeb700 1 Processor -- start 2021-12-17T18:27:05.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.974+0000 7fad0adeb700 1 -- start start 2021-12-17T18:27:05.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.974+0000 7fad0adeb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fad040b2d00 0x7fad040b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:05.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.974+0000 7fad0adeb700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fad040625b0 0x7fad0413fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:05.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.974+0000 7fad0adeb700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad04140140 con 0x7fad04062b60 2021-12-17T18:27:05.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.974+0000 7fad0adeb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad04140e60 con 0x7fad040b2d00 2021-12-17T18:27:05.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.974+0000 7fad0adeb700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad040aecb0 con 0x7fad040625b0 2021-12-17T18:27:05.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.974+0000 7fad09de9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fad040b2d00 0x7fad040b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:05.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.974+0000 7fad09de9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fad040b2d00 0x7fad040b30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55504/0 (socket says 172.21.15.62:55504) 2021-12-17T18:27:05.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.974+0000 7fad09de9700 1 -- 172.21.15.62:0/4157156499 learned_addr learned my addr 172.21.15.62:0/4157156499 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:05.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.974+0000 7fad0a5ea700 1 --2- 172.21.15.62:0/4157156499 >> v2:172.21.15.109:3300/0 conn(0x7fad040625b0 0x7fad0413fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:05.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad09de9700 1 -- 172.21.15.62:0/4157156499 >> v2:172.21.15.109:3300/0 conn(0x7fad040625b0 msgr2=0x7fad0413fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:05.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad09de9700 1 --2- 172.21.15.62:0/4157156499 >> v2:172.21.15.109:3300/0 conn(0x7fad040625b0 0x7fad0413fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:05.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad09de9700 1 -- 172.21.15.62:0/4157156499 >> v1:172.21.15.109:6789/0 conn(0x7fad04062b60 legacy=0x7fad04139870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:05.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad09de9700 1 -- 172.21.15.62:0/4157156499 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040aef50 con 0x7fad040b2d00 2021-12-17T18:27:05.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad09de9700 1 --2- 172.21.15.62:0/4157156499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad040b2d00 0x7fad040b30e0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fad00002f70 tx=0x7fad00006eb0).ready entity=mon.0 client_cookie=ed6c26caf920dd5a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:05.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad08de7700 1 -- 172.21.15.62:0/4157156499 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad0000d5c0 con 0x7fad040b2d00 2021-12-17T18:27:05.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad08de7700 1 -- 172.21.15.62:0/4157156499 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad00000e90 con 0x7fad040b2d00 2021-12-17T18:27:05.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad08de7700 1 -- 172.21.15.62:0/4157156499 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad0000d950 con 0x7fad040b2d00 2021-12-17T18:27:05.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad0adeb700 1 -- 172.21.15.62:0/4157156499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad040b2d00 msgr2=0x7fad040b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:05.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad0adeb700 1 --2- 172.21.15.62:0/4157156499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad040b2d00 0x7fad040b30e0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fad00002f70 tx=0x7fad00006eb0).stop 2021-12-17T18:27:05.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad0adeb700 1 -- 172.21.15.62:0/4157156499 shutdown_connections 2021-12-17T18:27:05.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad0adeb700 1 --2- 172.21.15.62:0/4157156499 >> v2:172.21.15.109:3300/0 conn(0x7fad040625b0 0x7fad0413fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:05.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad0adeb700 1 --2- 172.21.15.62:0/4157156499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad040b2d00 0x7fad040b30e0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:05.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad0adeb700 1 -- 172.21.15.62:0/4157156499 >> 172.21.15.62:0/4157156499 conn(0x7fad04060a50 msgr2=0x7fad0405bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:05.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad0adeb700 1 -- 172.21.15.62:0/4157156499 shutdown_connections 2021-12-17T18:27:05.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad0adeb700 1 -- 172.21.15.62:0/4157156499 wait complete. 2021-12-17T18:27:05.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad0adeb700 1 Processor -- start 2021-12-17T18:27:05.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad0adeb700 1 -- start start 2021-12-17T18:27:05.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad0adeb700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fad040625b0 0x7fad04142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:05.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad0adeb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad04062b60 0x7fad04066c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:05.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad0adeb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fad040b2d00 0x7fad040b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:05.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad0adeb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0413a1d0 con 0x7fad04062b60 2021-12-17T18:27:05.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad0adeb700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0413a470 con 0x7fad040625b0 2021-12-17T18:27:05.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad0adeb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad040645d0 con 0x7fad040b2d00 2021-12-17T18:27:05.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad095e8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad04062b60 0x7fad04066c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:05.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad09de9700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fad040625b0 0x7fad04142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:05.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad095e8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad04062b60 0x7fad04066c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55514/0 (socket says 172.21.15.62:55514) 2021-12-17T18:27:05.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad09de9700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fad040625b0 0x7fad04142c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:33828/0 (socket says 172.21.15.62:33828) 2021-12-17T18:27:05.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad095e8700 1 -- 172.21.15.62:0/1712035714 learned_addr learned my addr 172.21.15.62:0/1712035714 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:05.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.978+0000 7fad0a5ea700 1 --2- 172.21.15.62:0/1712035714 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fad040b2d00 0x7fad040b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:05.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.982+0000 7fad095e8700 1 -- 172.21.15.62:0/1712035714 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fad040b2d00 msgr2=0x7fad040b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:05.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.982+0000 7fad095e8700 1 --2- 172.21.15.62:0/1712035714 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fad040b2d00 0x7fad040b4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:05.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.982+0000 7fad095e8700 1 -- 172.21.15.62:0/1712035714 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fad040625b0 msgr2=0x7fad04142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:05.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.982+0000 7fad095e8700 1 --2- 172.21.15.62:0/1712035714 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fad040625b0 0x7fad04142c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:05.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.982+0000 7fad095e8700 1 -- 172.21.15.62:0/1712035714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0000b1e0 con 0x7fad04062b60 2021-12-17T18:27:05.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.982+0000 7fad09de9700 1 --2- 172.21.15.62:0/1712035714 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fad040625b0 0x7fad04142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:05.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.982+0000 7fad095e8700 1 --2- 172.21.15.62:0/1712035714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad04062b60 0x7fad04066c10 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7fad040b0890 tx=0x7facf4007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:05.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.982+0000 7facf2ffd700 1 -- 172.21.15.62:0/1712035714 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facf4012400 con 0x7fad04062b60 2021-12-17T18:27:05.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.982+0000 7facf2ffd700 1 -- 172.21.15.62:0/1712035714 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf4012560 con 0x7fad04062b60 2021-12-17T18:27:05.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.982+0000 7fad0adeb700 1 -- 172.21.15.62:0/1712035714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad04064850 con 0x7fad04062b60 2021-12-17T18:27:05.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.982+0000 7facf2ffd700 1 -- 172.21.15.62:0/1712035714 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facf40128c0 con 0x7fad04062b60 2021-12-17T18:27:05.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.982+0000 7fad0adeb700 1 -- 172.21.15.62:0/1712035714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad04150190 con 0x7fad04062b60 2021-12-17T18:27:05.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.982+0000 7fad0adeb700 1 -- 172.21.15.62:0/1712035714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0413a630 con 0x7fad04062b60 2021-12-17T18:27:05.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.986+0000 7facf2ffd700 1 -- 172.21.15.62:0/1712035714 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7facf4019030 con 0x7fad04062b60 2021-12-17T18:27:05.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.986+0000 7facf2ffd700 1 --2- 172.21.15.62:0/1712035714 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7face4053610 0x7face4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:05.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.986+0000 7facf2ffd700 1 -- 172.21.15.62:0/1712035714 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6075+0+0 (secure 0 0 0) 0x7facf406aab0 con 0x7fad04062b60 2021-12-17T18:27:05.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.986+0000 7fad09de9700 1 --2- 172.21.15.62:0/1712035714 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7face4053610 0x7face4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:05.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.986+0000 7fad09de9700 1 --2- 172.21.15.62:0/1712035714 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7face4053610 0x7face4055ad0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fad0001c000 tx=0x7fad00015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:05.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:05.994+0000 7facf2ffd700 1 -- 172.21.15.62:0/1712035714 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7facf4041bb0 con 0x7fad04062b60 2021-12-17T18:27:06.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.150+0000 7fad0adeb700 1 -- 172.21.15.62:0/1712035714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fad04140140 con 0x7fad04062b60 2021-12-17T18:27:06.156 INFO:tasks.ceph.mon.a.smithi062.stderr:2021-12-17T18:27:06.150+0000 7f8d38b61700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-12-17T18:27:06.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.162+0000 7facf2ffd700 1 -- 172.21.15.62:0/1712035714 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 22 v60) v1 ==== 174+0+0 (secure 0 0 0) 0x7fad04140140 con 0x7fad04062b60 2021-12-17T18:27:06.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.162+0000 7fad0adeb700 1 -- 172.21.15.62:0/1712035714 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7face4053610 msgr2=0x7face4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:06.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.162+0000 7fad0adeb700 1 --2- 172.21.15.62:0/1712035714 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7face4053610 0x7face4055ad0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fad0001c000 tx=0x7fad00015000).stop 2021-12-17T18:27:06.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.162+0000 7fad0adeb700 1 -- 172.21.15.62:0/1712035714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad04062b60 msgr2=0x7fad04066c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:06.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.162+0000 7fad0adeb700 1 --2- 172.21.15.62:0/1712035714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad04062b60 0x7fad04066c10 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7fad040b0890 tx=0x7facf4007c50).stop 2021-12-17T18:27:06.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.162+0000 7fad0adeb700 1 -- 172.21.15.62:0/1712035714 shutdown_connections 2021-12-17T18:27:06.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.162+0000 7fad0adeb700 1 --2- 172.21.15.62:0/1712035714 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7face4053610 0x7face4055ad0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:06.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.162+0000 7fad0adeb700 1 --2- 172.21.15.62:0/1712035714 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fad040b2d00 0x7fad040b4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:06.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.162+0000 7fad0adeb700 1 --2- 172.21.15.62:0/1712035714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad04062b60 0x7fad04066c10 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:06.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.162+0000 7fad0adeb700 1 --2- 172.21.15.62:0/1712035714 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fad040625b0 0x7fad04142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:06.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.162+0000 7fad0adeb700 1 -- 172.21.15.62:0/1712035714 >> 172.21.15.62:0/1712035714 conn(0x7fad04060a50 msgr2=0x7fad041404f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:06.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.166+0000 7fad0adeb700 1 -- 172.21.15.62:0/1712035714 shutdown_connections 2021-12-17T18:27:06.170 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.166+0000 7fad0adeb700 1 -- 172.21.15.62:0/1712035714 wait complete. 2021-12-17T18:27:06.171 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 24 and data pool 22 2021-12-17T18:27:06.181 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:27:06.182 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:06.196 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:06.212 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:06.233 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:06.254 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:06.275 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:27:06.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:06.276 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:06.276 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:06.283 INFO:teuthology.orchestra.run.smithi125.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-12-17T18:27:06.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:27:06.285 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-12-17T18:27:06.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:27:06.286 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:06.292 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-12-17T18:27:06.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:27:06.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:06.294 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:06.294 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:06.303 INFO:teuthology.orchestra.run.smithi158.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:27:06.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:27:06.304 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-12-17T18:27:06.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:27:06.305 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:06.311 INFO:teuthology.orchestra.run.smithi158.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:27:06.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:27:06.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:06.313 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:06.314 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:27:06.324 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:27:06.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:27:06.325 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:27:06.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:27:06.326 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:27:06.333 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:27:06.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:27:06.334 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:27:06.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4878665700 1 Processor -- start 2021-12-17T18:27:06.445 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4878665700 1 -- start start 2021-12-17T18:27:06.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4878665700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f48700ad360 0x7f48700679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:06.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4878665700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48700b2e90 con 0x7f48700b57e0 2021-12-17T18:27:06.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4878665700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48700b4b70 con 0x7f487005ffe0 2021-12-17T18:27:06.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4878665700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48700b4e10 con 0x7f48700ad360 2021-12-17T18:27:06.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4876c02700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f48700b57e0 0x7f48701438a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39102/0 (socket says 172.21.15.62:39102) 2021-12-17T18:27:06.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4876c02700 1 -- 172.21.15.62:0/1596414169 learned_addr learned my addr 172.21.15.62:0/1596414169 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:06.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4875c00700 1 --2- 172.21.15.62:0/1596414169 >> v2:172.21.15.109:3300/0 conn(0x7f48700ad360 0x7f48700679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:06.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4875c00700 1 -- 172.21.15.62:0/1596414169 >> v1:172.21.15.109:6789/0 conn(0x7f487005ffe0 legacy=0x7f48700b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:06.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4875c00700 1 -- 172.21.15.62:0/1596414169 >> v1:172.21.15.62:6789/0 conn(0x7f48700b57e0 legacy=0x7f48701438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:06.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4875c00700 1 -- 172.21.15.62:0/1596414169 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48700b52b0 con 0x7f48700ad360 2021-12-17T18:27:06.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f48753ff700 1 -- 172.21.15.62:0/1596414169 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034280564 0 0) 0x7f48700b2e90 con 0x7f48700b57e0 2021-12-17T18:27:06.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4875c00700 1 --2- 172.21.15.62:0/1596414169 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f48700ad360 0x7f48700679c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f486c002f70 tx=0x7f486c006df0).ready entity=mon.1 client_cookie=4d79f43fcd3eb092 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:06.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f48753ff700 1 -- 172.21.15.62:0/1596414169 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f486c00d610 con 0x7f48700ad360 2021-12-17T18:27:06.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f48753ff700 1 -- 172.21.15.62:0/1596414169 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c000e90 con 0x7f48700ad360 2021-12-17T18:27:06.450 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f48753ff700 1 -- 172.21.15.62:0/1596414169 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f486c00d960 con 0x7f48700ad360 2021-12-17T18:27:06.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4878665700 1 -- 172.21.15.62:0/1596414169 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f48700ad360 msgr2=0x7f48700679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:06.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4878665700 1 --2- 172.21.15.62:0/1596414169 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f48700ad360 0x7f48700679c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f486c002f70 tx=0x7f486c006df0).stop 2021-12-17T18:27:06.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4878665700 1 -- 172.21.15.62:0/1596414169 shutdown_connections 2021-12-17T18:27:06.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4878665700 1 --2- 172.21.15.62:0/1596414169 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f48700ad360 0x7f48700679c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:06.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4878665700 1 -- 172.21.15.62:0/1596414169 >> 172.21.15.62:0/1596414169 conn(0x7f48700626d0 msgr2=0x7f487005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:06.454 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4878665700 1 -- 172.21.15.62:0/1596414169 shutdown_connections 2021-12-17T18:27:06.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.442+0000 7f4878665700 1 -- 172.21.15.62:0/1596414169 wait complete. 2021-12-17T18:27:06.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4878665700 1 Processor -- start 2021-12-17T18:27:06.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4878665700 1 -- start start 2021-12-17T18:27:06.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4878665700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f487005ffe0 0x7f48700a3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:06.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4878665700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48700ad360 0x7f4870066150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:06.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4878665700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48700b57e0 0x7f4870153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:06.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4878665700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4870065930 con 0x7f48700b57e0 2021-12-17T18:27:06.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4878665700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48700a5660 con 0x7f487005ffe0 2021-12-17T18:27:06.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4878665700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4870152b40 con 0x7f48700ad360 2021-12-17T18:27:06.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4876c02700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48700b57e0 0x7f4870153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:06.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4876c02700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48700b57e0 0x7f4870153280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55528/0 (socket says 172.21.15.62:55528) 2021-12-17T18:27:06.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4876c02700 1 -- 172.21.15.62:0/4226050260 learned_addr learned my addr 172.21.15.62:0/4226050260 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:06.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4875c00700 1 --2- 172.21.15.62:0/4226050260 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48700ad360 0x7f4870066150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:06.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4876401700 1 --2- 172.21.15.62:0/4226050260 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f487005ffe0 0x7f48700a3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:06.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4876c02700 1 -- 172.21.15.62:0/4226050260 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48700ad360 msgr2=0x7f4870066150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:06.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4876c02700 1 --2- 172.21.15.62:0/4226050260 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48700ad360 0x7f4870066150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:06.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4876c02700 1 -- 172.21.15.62:0/4226050260 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f487005ffe0 msgr2=0x7f48700a3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:06.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4876c02700 1 --2- 172.21.15.62:0/4226050260 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f487005ffe0 0x7f48700a3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:06.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4876c02700 1 -- 172.21.15.62:0/4226050260 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486c00b180 con 0x7f48700b57e0 2021-12-17T18:27:06.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4876c02700 1 --2- 172.21.15.62:0/4226050260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48700b57e0 0x7f4870153280 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f4868000f40 tx=0x7f4868001360).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:06.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f485f7fe700 1 -- 172.21.15.62:0/4226050260 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4868005c70 con 0x7f48700b57e0 2021-12-17T18:27:06.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f485f7fe700 1 -- 172.21.15.62:0/4226050260 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4868005dd0 con 0x7f48700b57e0 2021-12-17T18:27:06.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4878665700 1 -- 172.21.15.62:0/4226050260 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4870152de0 con 0x7f48700b57e0 2021-12-17T18:27:06.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f485f7fe700 1 -- 172.21.15.62:0/4226050260 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48680072c0 con 0x7f48700b57e0 2021-12-17T18:27:06.460 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.446+0000 7f4878665700 1 -- 172.21.15.62:0/4226050260 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48700a52e0 con 0x7f48700b57e0 2021-12-17T18:27:06.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.450+0000 7f485f7fe700 1 -- 172.21.15.62:0/4226050260 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f486801a060 con 0x7f48700b57e0 2021-12-17T18:27:06.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.450+0000 7f4878665700 1 -- 172.21.15.62:0/4226050260 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48700573d0 con 0x7f48700b57e0 2021-12-17T18:27:06.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.450+0000 7f485f7fe700 1 --2- 172.21.15.62:0/4226050260 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4850053690 0x7f4850055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:06.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.450+0000 7f485f7fe700 1 -- 172.21.15.62:0/4226050260 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f486806b1b0 con 0x7f48700b57e0 2021-12-17T18:27:06.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.450+0000 7f4876401700 1 --2- 172.21.15.62:0/4226050260 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4850053690 0x7f4850055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:06.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.450+0000 7f4876401700 1 --2- 172.21.15.62:0/4226050260 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4850053690 0x7f4850055b50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f486000b000 tx=0x7f4860009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:06.463 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.458+0000 7f485f7fe700 1 -- 172.21.15.62:0/4226050260 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f48680421b0 con 0x7f48700b57e0 2021-12-17T18:27:06.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.586+0000 7f4878665700 1 -- 172.21.15.62:0/4226050260 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4870152f70 con 0x7f48700b57e0 2021-12-17T18:27:06.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.586+0000 7f485f7fe700 1 -- 172.21.15.62:0/4226050260 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v122) v1 ==== 81+0+33874 (secure 0 0 0) 0x7f4868018020 con 0x7f48700b57e0 2021-12-17T18:27:06.592 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:06.593 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:27:06.593 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 122, 2021-12-17T18:27:06.593 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:27:06.593 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:27:06.594 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:27:06.153929+0000", 2021-12-17T18:27:06.594 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:27:06.594 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:27:06.594 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:27:06.595 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:27:06.595 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:27:06.595 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:27:06.595 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:27:06.595 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:27:06.596 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:27:06.596 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:06.596 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:27:06.596 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:27:06.597 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:27:06.597 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:27:06.597 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:27:06.597 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 24, 2021-12-17T18:27:06.597 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:27:06.598 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:27:06.598 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:27:06.598 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:27:06.598 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:27:06.599 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.599 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:27:06.599 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:27:06.599 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:27:06.600 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:27:06.600 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:27:06.600 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:27:06.600 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:27:06.600 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:27:06.601 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:27:06.601 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:27:06.601 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:27:06.601 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:27:06.602 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:27:06.602 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:27:06.602 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:27:06.602 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:27:06.602 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:27:06.603 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:27:06.603 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:27:06.603 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:27:06.603 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:27:06.604 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:27:06.604 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:27:06.604 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.604 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:27:06.604 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:27:06.605 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:27:06.605 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:27:06.605 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:27:06.605 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:27:06.606 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:27:06.606 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:27:06.606 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:27:06.606 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:27:06.606 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:27:06.607 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:27:06.607 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:27:06.607 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:27:06.607 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:27:06.608 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:27:06.608 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:27:06.608 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:27:06.608 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:27:06.609 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:27:06.609 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:27:06.609 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:27:06.609 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:27:06.609 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:27:06.610 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:27:06.610 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:27:06.610 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:27:06.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.611 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:27:06.611 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:27:06.611 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:27:06.611 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:27:06.611 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:27:06.612 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:27:06.612 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:27:06.612 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:27:06.612 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:27:06.613 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:27:06.613 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:27:06.613 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:27:06.613 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:27:06.613 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.614 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:27:06.614 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:27:06.614 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.615 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.615 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:27:06.615 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:27:06.615 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:27:06.616 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:27:06.616 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:27:06.616 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:27:06.616 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:27:06.616 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:27:06.617 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:27:06.617 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:27:06.617 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:27:06.617 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:27:06.618 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:27:06.618 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:27:06.618 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:27:06.618 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:27:06.618 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:27:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:27:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:27:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:27:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:27:06.620 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:27:06.620 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:27:06.620 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.620 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:27:06.620 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:27:06.621 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:27:06.621 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:27:06.621 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:27:06.621 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:27:06.622 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:27:06.622 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:27:06.622 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:27:06.622 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:27:06.622 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:27:06.623 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:27:06.623 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:27:06.623 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:27:06.623 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:27:06.624 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:27:06.624 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:27:06.624 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:27:06.624 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:27:06.624 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:27:06.625 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:27:06.625 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:27:06.625 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:27:06.625 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:27:06.626 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:27:06.626 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:27:06.626 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:27:06.626 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.627 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:27:06.627 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:27:06.627 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:27:06.627 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:27:06.628 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:27:06.628 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:27:06.628 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:27:06.628 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:27:06.629 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:27:06.629 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:27:06.629 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:27:06.629 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:27:06.629 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:27:06.630 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:27:06.630 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.630 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.630 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.631 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 22, 2021-12-17T18:27:06.631 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2021-12-17T18:27:06.631 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:26:34.037077+0000", 2021-12-17T18:27:06.631 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:27:06.632 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:27:06.632 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:27:06.632 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:27:06.632 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:27:06.632 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:27:06.633 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:27:06.633 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:27:06.633 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:27:06.633 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:27:06.633 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:27:06.634 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:27:06.634 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:27:06.634 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:27:06.634 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:27:06.635 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:27:06.635 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:27:06.635 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:27:06.635 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:27:06.635 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:27:06.636 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.636 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "122", 2021-12-17T18:27:06.636 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:27:06.636 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:27:06.637 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:27:06.637 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:27:06.637 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:27:06.637 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:27:06.638 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:27:06.638 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:27:06.638 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:27:06.638 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:27:06.639 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:27:06.639 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:27:06.639 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:27:06.639 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:27:06.639 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:27:06.640 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:27:06.640 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:27:06.640 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:27:06.640 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:27:06.641 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:27:06.641 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:27:06.641 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:27:06.641 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:27:06.642 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:27:06.642 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:27:06.642 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:27:06.642 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.642 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:27:06.643 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:27:06.643 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:27:06.643 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:27:06.643 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:27:06.643 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:27:06.644 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:27:06.644 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:27:06.644 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:27:06.644 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:27:06.645 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:27:06.645 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:27:06.645 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:27:06.645 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:27:06.645 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2021-12-17T18:27:06.646 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.646 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.646 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.646 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.647 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 24, 2021-12-17T18:27:06.647 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2021-12-17T18:27:06.647 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:27:05.158132+0000", 2021-12-17T18:27:06.647 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 32769, 2021-12-17T18:27:06.647 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool,creating", 2021-12-17T18:27:06.648 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:27:06.648 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:27:06.648 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:27:06.648 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:27:06.649 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:27:06.649 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:27:06.649 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:27:06.649 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:27:06.649 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:27:06.650 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:27:06.650 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:27:06.650 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:27:06.650 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:27:06.651 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:27:06.651 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:27:06.651 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:27:06.651 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:27:06.651 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:27:06.652 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.652 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "122", 2021-12-17T18:27:06.652 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:27:06.652 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:27:06.652 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:27:06.653 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:27:06.653 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:27:06.653 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:27:06.653 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:27:06.654 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:27:06.654 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:27:06.654 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:27:06.654 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:27:06.654 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:27:06.655 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:27:06.655 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:27:06.655 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:27:06.655 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:27:06.656 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:27:06.656 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:27:06.656 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:27:06.656 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:27:06.656 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:27:06.657 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:27:06.657 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:27:06.657 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:27:06.657 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:27:06.657 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:27:06.658 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.658 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:27:06.658 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:27:06.658 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:27:06.659 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:27:06.659 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:27:06.659 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:27:06.659 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:27:06.660 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:27:06.660 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:27:06.660 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:27:06.660 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:27:06.660 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:27:06.661 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2021-12-17T18:27:06.661 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2021-12-17T18:27:06.661 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2021-12-17T18:27:06.661 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.662 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:27:06.662 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:27:06.662 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2021-12-17T18:27:06.662 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.662 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.663 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.663 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:06.663 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:27:06.663 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.663 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:27:06.664 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:27:06.664 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:06.664 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:06.664 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:06.665 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:06.665 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:06.665 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:06.665 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:06.665 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 121, 2021-12-17T18:27:06.666 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:06.666 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:06.666 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:06.666 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.667 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.667 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.667 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:27:06.667 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:06.667 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.668 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.668 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.668 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:27:06.668 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:06.669 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.669 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.669 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.669 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:06.669 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.670 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.670 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.670 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:27:06.670 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:06.671 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.671 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.671 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.671 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:27:06.671 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:06.672 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.672 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.672 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.672 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:06.673 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.673 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.673 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.673 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:27:06.673 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:06.674 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.674 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.674 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.674 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:27:06.675 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:06.675 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.675 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.675 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.675 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:06.676 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.676 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.676 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.676 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:27:06.676 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:06.677 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.677 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.677 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.677 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:27:06.678 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:06.678 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.678 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.678 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.678 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:27:06.679 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:27:06.679 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:27:06.679 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:27:06.679 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:06.680 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:06.680 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:06.680 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.680 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.680 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.681 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:27:06.681 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:27:06.681 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:06.681 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:06.682 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:06.682 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:06.682 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:06.682 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:06.682 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:06.683 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 121, 2021-12-17T18:27:06.683 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:06.683 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:06.683 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:06.684 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.684 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.684 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.684 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:27:06.684 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:06.685 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.685 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.685 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.685 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:27:06.686 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:06.686 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.686 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.686 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.686 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:06.687 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.687 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.687 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.687 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:27:06.688 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:06.688 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.688 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.688 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.688 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:27:06.689 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:06.689 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.689 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.689 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.690 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:06.690 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.690 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.690 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.690 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:27:06.691 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:06.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.691 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.692 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:27:06.692 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:06.692 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.692 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.692 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.693 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:06.693 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.693 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.693 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.694 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:27:06.694 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:06.694 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.694 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.694 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.695 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:27:06.695 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:06.695 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.695 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.696 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.696 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:27:06.696 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:27:06.696 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:27:06.696 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:27:06.697 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:06.697 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:06.697 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:06.697 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.697 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.698 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:27:06.698 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:27:06.698 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:06.699 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:06.699 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:06.699 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:06.699 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:06.700 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:06.700 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:06.700 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 116, 2021-12-17T18:27:06.700 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:06.700 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:06.701 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:06.701 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.701 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.701 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.701 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:27:06.702 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:06.702 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.702 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.702 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.703 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:27:06.703 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:06.703 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.703 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.703 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.704 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:06.704 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.704 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.704 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.705 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:27:06.705 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:06.705 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.705 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.705 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.706 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:27:06.706 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:06.706 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.706 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:27:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.709 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.709 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:27:06.709 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:06.709 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.709 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.710 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.710 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:06.710 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.710 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.711 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.711 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:27:06.711 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:06.711 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.712 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.712 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.712 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:27:06.712 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:06.712 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.713 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.713 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.713 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:27:06.713 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:27:06.713 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:27:06.714 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:27:06.714 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:06.714 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:06.714 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:06.715 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.715 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.715 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.715 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:27:06.715 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:27:06.716 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:06.716 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:06.716 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:06.716 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:06.717 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:06.717 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:06.717 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:06.717 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 116, 2021-12-17T18:27:06.717 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:06.718 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:06.718 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:06.718 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.718 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.719 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.719 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:27:06.719 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:06.719 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.719 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.720 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.720 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:27:06.720 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:06.720 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.721 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.721 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.721 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:06.721 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.721 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.722 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.722 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:27:06.722 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:06.722 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.723 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.723 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.723 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:27:06.723 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:06.724 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.724 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.724 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.724 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:06.724 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.725 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.725 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.725 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:27:06.725 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:06.726 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.726 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.726 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.726 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:27:06.726 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:06.727 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.727 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.727 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.728 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:06.728 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.728 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.728 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.729 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:27:06.729 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:06.729 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.729 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.730 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.730 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:27:06.730 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:06.730 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.730 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.731 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.731 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:27:06.731 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:27:06.731 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:27:06.732 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:27:06.732 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:06.732 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:06.732 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:06.732 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.733 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.733 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.733 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:27:06.733 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:27:06.733 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:06.734 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:06.734 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:06.734 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:06.734 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:06.735 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:06.735 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:06.735 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 116, 2021-12-17T18:27:06.735 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:06.735 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:06.736 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:06.736 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.736 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.736 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.737 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:27:06.737 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:06.737 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.737 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.737 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.738 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:27:06.738 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:06.738 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.738 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.739 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.739 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:06.739 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.739 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.739 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.740 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:27:06.740 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:06.740 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.740 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.741 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.741 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:27:06.741 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:06.741 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.741 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.742 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.742 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:06.742 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.742 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.743 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.743 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:27:06.743 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:06.743 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.743 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.744 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.744 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:27:06.744 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:06.744 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.745 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.745 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.745 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:06.745 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.745 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.746 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.746 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:27:06.746 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:06.746 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.747 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.747 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.747 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:27:06.747 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:06.748 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.748 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.748 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.748 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:27:06.748 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:27:06.749 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:27:06.749 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:27:06.749 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:06.749 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:06.749 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:06.750 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.750 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.750 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.750 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:27:06.751 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:27:06.751 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:06.751 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:06.751 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:06.751 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:06.752 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:06.752 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:06.752 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:06.752 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 121, 2021-12-17T18:27:06.753 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:06.753 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:06.753 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:06.753 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.753 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.754 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.754 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:27:06.754 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:06.754 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.754 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.755 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.755 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:27:06.755 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:06.755 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.756 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.756 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.756 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:06.756 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.756 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.757 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.757 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:27:06.757 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:06.757 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.757 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.758 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.758 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:27:06.758 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:06.758 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.759 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.759 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.759 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:06.759 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.760 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.760 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.760 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:27:06.760 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:06.761 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.761 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.761 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.761 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:27:06.761 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:06.762 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.762 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.762 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.762 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:06.763 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.763 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.763 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.763 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:27:06.763 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:06.764 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.764 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.764 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.764 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:27:06.765 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:06.765 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.765 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.765 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.765 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:27:06.766 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:27:06.766 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:27:06.766 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:27:06.766 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:06.767 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:06.767 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:06.767 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.767 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.767 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.768 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:27:06.768 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:27:06.768 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:06.768 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:06.768 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:06.769 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:06.769 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:06.769 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:06.769 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:06.770 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 110, 2021-12-17T18:27:06.770 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:06.770 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:06.770 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:06.770 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.771 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.771 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.771 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:27:06.771 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:06.772 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.772 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.772 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.772 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:27:06.772 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:06.773 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.773 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.773 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.773 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:06.773 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.774 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.774 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.774 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:27:06.774 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:06.775 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.775 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.775 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.775 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:27:06.775 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:06.776 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.776 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.776 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.776 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:06.777 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.777 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.777 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.777 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:27:06.777 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:06.778 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.778 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.778 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.778 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:27:06.778 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:06.779 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.779 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.779 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.779 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:06.780 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.780 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.780 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.780 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:27:06.780 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:06.781 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.781 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.781 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.781 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:27:06.782 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:06.782 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.782 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.782 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.782 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:27:06.783 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:27:06.783 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:27:06.783 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:27:06.783 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:06.784 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:06.784 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:06.784 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.784 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.784 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.785 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:27:06.785 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:27:06.785 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:06.785 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:06.785 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:06.786 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:06.786 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:06.786 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:06.786 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:06.787 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 121, 2021-12-17T18:27:06.787 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:06.787 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:06.787 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:06.787 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.788 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.788 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.788 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:27:06.788 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:06.789 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.789 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.789 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.789 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:27:06.790 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:06.790 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.790 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.790 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.790 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:06.791 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.791 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.791 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.791 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:27:06.791 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:06.792 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.792 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.792 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.792 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:27:06.793 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:06.793 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.793 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.793 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.793 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:06.794 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.794 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.794 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.794 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:27:06.795 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:06.795 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.795 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.795 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.795 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:27:06.796 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:06.796 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.796 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.796 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.797 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:06.797 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:06.797 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.797 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:06.797 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:27:06.798 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:06.798 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.798 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.798 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:06.798 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:27:06.799 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:06.799 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.799 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.799 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.800 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:27:06.800 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:27:06.800 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:27:06.800 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:27:06.800 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:06.801 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:06.801 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:06.801 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:06.801 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.802 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:06.802 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:27:06.802 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.802 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:27:06.802 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:06.803 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:06.803 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:06.803 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:06.803 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:06.804 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:27:06.804 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:06.804 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.804 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.804 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:27:06.805 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:06.805 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:06.805 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:06.805 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:06.806 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:06.806 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:27:06.806 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:06.807 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.807 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.807 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:27:06.807 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:06.807 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:06.808 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:06.808 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:06.808 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:06.808 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:27:06.809 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:06.809 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.809 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.809 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:27:06.809 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:06.810 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:06.810 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:06.810 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:06.810 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:06.811 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:27:06.811 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:06.811 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.811 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.812 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:27:06.812 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:06.812 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:06.812 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:06.813 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:06.813 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:06.813 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:27:06.813 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:06.813 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.814 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.814 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:27:06.814 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:06.814 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:06.815 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:06.815 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:06.815 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:06.815 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:27:06.816 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:06.816 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.816 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.816 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:27:06.816 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:06.817 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:06.817 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:06.817 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:06.817 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:06.817 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:27:06.818 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:06.818 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.818 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:06.818 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:27:06.819 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:06.819 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:06.819 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:06.819 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:06.819 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:06.820 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:27:06.820 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:06.820 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.820 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:06.821 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:27:06.821 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:27:06.821 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:27:06.821 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:27:06.822 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": { 2021-12-17T18:27:06.822 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6833/2418178754": "2021-12-18T18:26:50.968176+0000", 2021-12-17T18:27:06.822 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6832/2418178754": "2021-12-18T18:26:50.968176+0000" 2021-12-17T18:27:06.822 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.822 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:27:06.823 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:27:06.823 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:27:06.823 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:27:06.823 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:27:06.824 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:27:06.824 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:27:06.824 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:27:06.824 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:06.825 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:06.825 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:27:06.825 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:27:06.825 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:27:06.826 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:27:06.826 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:27:06.826 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:27:06.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.590+0000 7f4878665700 1 -- 172.21.15.62:0/4226050260 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4850053690 msgr2=0x7f4850055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:06.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.590+0000 7f4878665700 1 --2- 172.21.15.62:0/4226050260 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4850053690 0x7f4850055b50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f486000b000 tx=0x7f4860009040).stop 2021-12-17T18:27:06.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.590+0000 7f4878665700 1 -- 172.21.15.62:0/4226050260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48700b57e0 msgr2=0x7f4870153280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:06.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.590+0000 7f4878665700 1 --2- 172.21.15.62:0/4226050260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48700b57e0 0x7f4870153280 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f4868000f40 tx=0x7f4868001360).stop 2021-12-17T18:27:06.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.590+0000 7f4878665700 1 -- 172.21.15.62:0/4226050260 shutdown_connections 2021-12-17T18:27:06.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.590+0000 7f4878665700 1 --2- 172.21.15.62:0/4226050260 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4850053690 0x7f4850055b50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:06.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.590+0000 7f4878665700 1 --2- 172.21.15.62:0/4226050260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48700b57e0 0x7f4870153280 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:06.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.590+0000 7f4878665700 1 --2- 172.21.15.62:0/4226050260 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f48700ad360 0x7f4870066150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:06.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.590+0000 7f4878665700 1 --2- 172.21.15.62:0/4226050260 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f487005ffe0 0x7f48700a3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:06.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.590+0000 7f4878665700 1 -- 172.21.15.62:0/4226050260 >> 172.21.15.62:0/4226050260 conn(0x7f48700626d0 msgr2=0x7f4870144b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:06.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.590+0000 7f4878665700 1 -- 172.21.15.62:0/4226050260 shutdown_connections 2021-12-17T18:27:06.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.590+0000 7f4878665700 1 -- 172.21.15.62:0/4226050260 wait complete. 2021-12-17T18:27:06.832 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:06.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.942+0000 7fdb68a0e700 1 Processor -- start 2021-12-17T18:27:06.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.942+0000 7fdb68a0e700 1 -- start start 2021-12-17T18:27:06.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb68a0e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdb640682c0 0x7fdb640afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:06.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb68a0e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdb640b02e0 0x7fdb640b0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:06.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb68a0e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb640b0c60 con 0x7fdb640b5ea0 2021-12-17T18:27:06.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb68a0e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb640ad8e0 con 0x7fdb640b02e0 2021-12-17T18:27:06.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb68a0e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640b6280 con 0x7fdb640682c0 2021-12-17T18:27:06.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb6359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdb640b02e0 0x7fdb640b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:06.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb6359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdb640b02e0 0x7fdb640b0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55536/0 (socket says 172.21.15.62:55536) 2021-12-17T18:27:06.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb6359e700 1 -- 172.21.15.62:0/937900687 learned_addr learned my addr 172.21.15.62:0/937900687 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:06.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb6259c700 1 --2- 172.21.15.62:0/937900687 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdb640682c0 0x7fdb640afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:06.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb6359e700 1 -- 172.21.15.62:0/937900687 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdb640682c0 msgr2=0x7fdb640afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:06.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb6359e700 1 --2- 172.21.15.62:0/937900687 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdb640682c0 0x7fdb640afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:06.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb6359e700 1 -- 172.21.15.62:0/937900687 >> v1:172.21.15.109:6789/0 conn(0x7fdb640b5ea0 legacy=0x7fdb64140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:06.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb6359e700 1 -- 172.21.15.62:0/937900687 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb640ad310 con 0x7fdb640b02e0 2021-12-17T18:27:06.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb6359e700 1 --2- 172.21.15.62:0/937900687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb640b02e0 0x7fdb640b0770 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fdb5c0032f0 tx=0x7fdb5c009290).ready entity=mon.0 client_cookie=c0dc348cee8e6c6d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:06.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb61d9b700 1 -- 172.21.15.62:0/937900687 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb5c00b8a0 con 0x7fdb640b02e0 2021-12-17T18:27:06.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb61d9b700 1 -- 172.21.15.62:0/937900687 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c00ba00 con 0x7fdb640b02e0 2021-12-17T18:27:06.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb61d9b700 1 -- 172.21.15.62:0/937900687 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb5c00bb70 con 0x7fdb640b02e0 2021-12-17T18:27:06.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb68a0e700 1 -- 172.21.15.62:0/937900687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb640b02e0 msgr2=0x7fdb640b0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:06.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb68a0e700 1 --2- 172.21.15.62:0/937900687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb640b02e0 0x7fdb640b0770 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fdb5c0032f0 tx=0x7fdb5c009290).stop 2021-12-17T18:27:06.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb68a0e700 1 -- 172.21.15.62:0/937900687 shutdown_connections 2021-12-17T18:27:06.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb68a0e700 1 --2- 172.21.15.62:0/937900687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb640b02e0 0x7fdb640b0770 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:06.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb68a0e700 1 --2- 172.21.15.62:0/937900687 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdb640682c0 0x7fdb640afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:06.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb68a0e700 1 -- 172.21.15.62:0/937900687 >> 172.21.15.62:0/937900687 conn(0x7fdb6405d220 msgr2=0x7fdb640b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:06.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb68a0e700 1 -- 172.21.15.62:0/937900687 shutdown_connections 2021-12-17T18:27:06.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.946+0000 7fdb68a0e700 1 -- 172.21.15.62:0/937900687 wait complete. 2021-12-17T18:27:06.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb68a0e700 1 Processor -- start 2021-12-17T18:27:06.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb68a0e700 1 -- start start 2021-12-17T18:27:06.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb68a0e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdb640682c0 0x7fdb64152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:06.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb68a0e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdb640b02e0 0x7fdb64140810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:06.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb68a0e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb640b5ea0 0x7fdb641419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:06.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb68a0e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb64152890 con 0x7fdb640b5ea0 2021-12-17T18:27:06.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb68a0e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb64152b30 con 0x7fdb640b02e0 2021-12-17T18:27:06.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb68a0e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640b5120 con 0x7fdb640682c0 2021-12-17T18:27:06.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb6359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb640b5ea0 0x7fdb641419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:06.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb6359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb640b5ea0 0x7fdb641419c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55542/0 (socket says 172.21.15.62:55542) 2021-12-17T18:27:06.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb6359e700 1 -- 172.21.15.62:0/538148567 learned_addr learned my addr 172.21.15.62:0/538148567 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:06.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb62d9d700 1 --2- 172.21.15.62:0/538148567 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdb640682c0 0x7fdb64152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb6259c700 1 --2- 172.21.15.62:0/538148567 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdb640b02e0 0x7fdb64140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb6359e700 1 -- 172.21.15.62:0/538148567 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdb640682c0 msgr2=0x7fdb64152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb6359e700 1 --2- 172.21.15.62:0/538148567 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdb640682c0 0x7fdb64152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb6359e700 1 -- 172.21.15.62:0/538148567 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdb640b02e0 msgr2=0x7fdb64140810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:06.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb6359e700 1 --2- 172.21.15.62:0/538148567 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdb640b02e0 0x7fdb64140810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:06.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb6359e700 1 -- 172.21.15.62:0/538148567 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c009530 con 0x7fdb640b5ea0 2021-12-17T18:27:06.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb6359e700 1 --2- 172.21.15.62:0/538148567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb640b5ea0 0x7fdb641419c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fdb5c0032f0 tx=0x7fdb5c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:06.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb53fff700 1 -- 172.21.15.62:0/538148567 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb5c00b8a0 con 0x7fdb640b5ea0 2021-12-17T18:27:06.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.950+0000 7fdb53fff700 1 -- 172.21.15.62:0/538148567 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c021440 con 0x7fdb640b5ea0 2021-12-17T18:27:06.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.954+0000 7fdb68a0e700 1 -- 172.21.15.62:0/538148567 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb641534c0 con 0x7fdb640b5ea0 2021-12-17T18:27:06.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.954+0000 7fdb53fff700 1 -- 172.21.15.62:0/538148567 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb5c0217a0 con 0x7fdb640b5ea0 2021-12-17T18:27:06.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.954+0000 7fdb68a0e700 1 -- 172.21.15.62:0/538148567 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb64140d00 con 0x7fdb640b5ea0 2021-12-17T18:27:06.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.954+0000 7fdb68a0e700 1 -- 172.21.15.62:0/538148567 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb640ac930 con 0x7fdb640b5ea0 2021-12-17T18:27:06.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.954+0000 7fdb53fff700 1 -- 172.21.15.62:0/538148567 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdb5c027020 con 0x7fdb640b5ea0 2021-12-17T18:27:06.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.954+0000 7fdb53fff700 1 --2- 172.21.15.62:0/538148567 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdb40053610 0x7fdb40055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:06.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.954+0000 7fdb53fff700 1 -- 172.21.15.62:0/538148567 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fdb5c06cf60 con 0x7fdb640b5ea0 2021-12-17T18:27:06.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.954+0000 7fdb62d9d700 1 --2- 172.21.15.62:0/538148567 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdb40053610 0x7fdb40055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:06.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.958+0000 7fdb62d9d700 1 --2- 172.21.15.62:0/538148567 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdb40053610 0x7fdb40055ad0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fdb5400d000 tx=0x7fdb54007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:06.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:06.962+0000 7fdb53fff700 1 -- 172.21.15.62:0/538148567 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdb5c043f60 con 0x7fdb640b5ea0 2021-12-17T18:27:07.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.130+0000 7fdb68a0e700 1 -- 172.21.15.62:0/538148567 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb640afb00 con 0x7fdb640b5ea0 2021-12-17T18:27:07.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.134+0000 7fdb53fff700 1 -- 172.21.15.62:0/538148567 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+1426 (secure 0 0 0) 0x7fdb5c015070 con 0x7fdb640b5ea0 2021-12-17T18:27:07.137 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:07.138 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":60,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:27:06.154150+0000","modified":"2021-12-17T18:27:06.154230+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-12-17T18:27:07.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.134+0000 7fdb68a0e700 1 -- 172.21.15.62:0/538148567 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdb40053610 msgr2=0x7fdb40055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:07.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.134+0000 7fdb68a0e700 1 --2- 172.21.15.62:0/538148567 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdb40053610 0x7fdb40055ad0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fdb5400d000 tx=0x7fdb54007b90).stop 2021-12-17T18:27:07.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.134+0000 7fdb68a0e700 1 -- 172.21.15.62:0/538148567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb640b5ea0 msgr2=0x7fdb641419c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:07.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.134+0000 7fdb68a0e700 1 --2- 172.21.15.62:0/538148567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb640b5ea0 0x7fdb641419c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fdb5c0032f0 tx=0x7fdb5c016000).stop 2021-12-17T18:27:07.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.134+0000 7fdb68a0e700 1 -- 172.21.15.62:0/538148567 shutdown_connections 2021-12-17T18:27:07.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.134+0000 7fdb68a0e700 1 --2- 172.21.15.62:0/538148567 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdb40053610 0x7fdb40055ad0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:07.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.134+0000 7fdb68a0e700 1 --2- 172.21.15.62:0/538148567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb640b5ea0 0x7fdb641419c0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:07.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.134+0000 7fdb68a0e700 1 --2- 172.21.15.62:0/538148567 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdb640b02e0 0x7fdb64140810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:07.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.134+0000 7fdb68a0e700 1 --2- 172.21.15.62:0/538148567 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdb640682c0 0x7fdb64152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:07.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.134+0000 7fdb68a0e700 1 -- 172.21.15.62:0/538148567 >> 172.21.15.62:0/538148567 conn(0x7fdb6405d220 msgr2=0x7fdb64148b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:07.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.134+0000 7fdb68a0e700 1 -- 172.21.15.62:0/538148567 shutdown_connections 2021-12-17T18:27:07.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.134+0000 7fdb68a0e700 1 -- 172.21.15.62:0/538148567 wait complete. 2021-12-17T18:27:07.142 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 60 2021-12-17T18:27:07.151 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-12-17T18:27:07.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.250+0000 7f7c3506d700 1 Processor -- start 2021-12-17T18:27:07.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.250+0000 7f7c3506d700 1 -- start start 2021-12-17T18:27:07.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.250+0000 7f7c3506d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c300b6160 0x7f7c30142690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:07.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.250+0000 7f7c3506d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7c300b0830 0x7f7c30142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:07.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c3506d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7c300af220 0x7f7c300b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:07.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c3506d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c300b6540 con 0x7f7c300af220 2021-12-17T18:27:07.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c3506d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c300ae840 con 0x7f7c300b0830 2021-12-17T18:27:07.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c3506d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c300aeae0 con 0x7f7c300b6160 2021-12-17T18:27:07.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c2f59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7c300af220 0x7f7c300b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:07.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c2f59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7c300af220 0x7f7c300b2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55550/0 (socket says 172.21.15.62:55550) 2021-12-17T18:27:07.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c2f59e700 1 -- 172.21.15.62:0/3715499337 learned_addr learned my addr 172.21.15.62:0/3715499337 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:07.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c2e59c700 1 --2- 172.21.15.62:0/3715499337 >> v2:172.21.15.109:3300/0 conn(0x7f7c300b0830 0x7f7c30142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:07.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c2ed9d700 1 --2- 172.21.15.62:0/3715499337 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c300b6160 0x7f7c30142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:07.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c2ed9d700 1 -- 172.21.15.62:0/3715499337 >> v2:172.21.15.109:3300/0 conn(0x7f7c300b0830 msgr2=0x7f7c30142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:07.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c2ed9d700 1 --2- 172.21.15.62:0/3715499337 >> v2:172.21.15.109:3300/0 conn(0x7f7c300b0830 0x7f7c30142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:07.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c2ed9d700 1 -- 172.21.15.62:0/3715499337 >> v2:172.21.15.62:3300/0 conn(0x7f7c300af220 msgr2=0x7f7c300b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:07.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c2ed9d700 1 --2- 172.21.15.62:0/3715499337 >> v2:172.21.15.62:3300/0 conn(0x7f7c300af220 0x7f7c300b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:07.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c2ed9d700 1 -- 172.21.15.62:0/3715499337 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c300aed80 con 0x7f7c300b6160 2021-12-17T18:27:07.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c2e59c700 1 --2- 172.21.15.62:0/3715499337 >> v2:172.21.15.109:3300/0 conn(0x7f7c300b0830 0x7f7c30142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:07.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c2ed9d700 1 --2- 172.21.15.62:0/3715499337 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c300b6160 0x7f7c30142690 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f7c30062ce0 tx=0x7f7c20006df0).ready entity=mon.2 client_cookie=9a3258e8d60f5810 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:07.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c2dd9b700 1 -- 172.21.15.62:0/3715499337 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c2000d4a0 con 0x7f7c300b6160 2021-12-17T18:27:07.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c2dd9b700 1 -- 172.21.15.62:0/3715499337 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c20000e90 con 0x7f7c300b6160 2021-12-17T18:27:07.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c2dd9b700 1 -- 172.21.15.62:0/3715499337 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c2000d7f0 con 0x7f7c300b6160 2021-12-17T18:27:07.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c3506d700 1 -- 172.21.15.62:0/3715499337 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c300b6160 msgr2=0x7f7c30142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:07.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c3506d700 1 --2- 172.21.15.62:0/3715499337 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c300b6160 0x7f7c30142690 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f7c30062ce0 tx=0x7f7c20006df0).stop 2021-12-17T18:27:07.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c3506d700 1 -- 172.21.15.62:0/3715499337 shutdown_connections 2021-12-17T18:27:07.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c3506d700 1 --2- 172.21.15.62:0/3715499337 >> v2:172.21.15.62:3300/0 conn(0x7f7c300af220 0x7f7c300b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:07.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c3506d700 1 --2- 172.21.15.62:0/3715499337 >> v2:172.21.15.109:3300/0 conn(0x7f7c300b0830 0x7f7c30142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:07.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c3506d700 1 --2- 172.21.15.62:0/3715499337 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c300b6160 0x7f7c30142690 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:07.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c3506d700 1 -- 172.21.15.62:0/3715499337 >> 172.21.15.62:0/3715499337 conn(0x7f7c3005c750 msgr2=0x7f7c300630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:07.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c3506d700 1 -- 172.21.15.62:0/3715499337 shutdown_connections 2021-12-17T18:27:07.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.254+0000 7f7c3506d700 1 -- 172.21.15.62:0/3715499337 wait complete. 2021-12-17T18:27:07.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.258+0000 7f7c3506d700 1 Processor -- start 2021-12-17T18:27:07.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.258+0000 7f7c3506d700 1 -- start start 2021-12-17T18:27:07.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.258+0000 7f7c3506d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7c300af220 0x7f7c30067650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:07.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.258+0000 7f7c3506d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c300b0830 0x7f7c30155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:07.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.258+0000 7f7c3506d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c300b6160 0x7f7c30156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:07.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.258+0000 7f7c3506d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c30141250 con 0x7f7c300b0830 2021-12-17T18:27:07.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.258+0000 7f7c3506d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c30141480 con 0x7f7c300af220 2021-12-17T18:27:07.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.258+0000 7f7c3506d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c30141720 con 0x7f7c300b6160 2021-12-17T18:27:07.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.258+0000 7f7c2e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c300b0830 0x7f7c30155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:07.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.258+0000 7f7c2e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c300b0830 0x7f7c30155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55554/0 (socket says 172.21.15.62:55554) 2021-12-17T18:27:07.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.258+0000 7f7c2e59c700 1 -- 172.21.15.62:0/3397433966 learned_addr learned my addr 172.21.15.62:0/3397433966 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:07.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.258+0000 7f7c2ed9d700 1 --2- 172.21.15.62:0/3397433966 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7c300af220 0x7f7c30067650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:07.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.258+0000 7f7c2f59e700 1 --2- 172.21.15.62:0/3397433966 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c300b6160 0x7f7c30156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:07.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.262+0000 7f7c2e59c700 1 -- 172.21.15.62:0/3397433966 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c300b6160 msgr2=0x7f7c30156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:07.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.262+0000 7f7c2e59c700 1 --2- 172.21.15.62:0/3397433966 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c300b6160 0x7f7c30156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:07.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.262+0000 7f7c2e59c700 1 -- 172.21.15.62:0/3397433966 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7c300af220 msgr2=0x7f7c30067650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:07.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.262+0000 7f7c2e59c700 1 --2- 172.21.15.62:0/3397433966 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7c300af220 0x7f7c30067650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:07.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.262+0000 7f7c2e59c700 1 -- 172.21.15.62:0/3397433966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2400b180 con 0x7f7c300b0830 2021-12-17T18:27:07.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.262+0000 7f7c2e59c700 1 --2- 172.21.15.62:0/3397433966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c300b0830 0x7f7c30155d20 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f7c2400c000 tx=0x7f7c24006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:07.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.262+0000 7f7c1ffff700 1 -- 172.21.15.62:0/3397433966 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c24010780 con 0x7f7c300b0830 2021-12-17T18:27:07.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.262+0000 7f7c1ffff700 1 -- 172.21.15.62:0/3397433966 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c240108e0 con 0x7f7c300b0830 2021-12-17T18:27:07.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.262+0000 7f7c3506d700 1 -- 172.21.15.62:0/3397433966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2000b180 con 0x7f7c300b0830 2021-12-17T18:27:07.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.262+0000 7f7c1ffff700 1 -- 172.21.15.62:0/3397433966 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c24010c40 con 0x7f7c300b0830 2021-12-17T18:27:07.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.262+0000 7f7c3506d700 1 -- 172.21.15.62:0/3397433966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c30156700 con 0x7f7c300b0830 2021-12-17T18:27:07.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.262+0000 7f7c3506d700 1 -- 172.21.15.62:0/3397433966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c30143070 con 0x7f7c300b0830 2021-12-17T18:27:07.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.262+0000 7f7c1ffff700 1 -- 172.21.15.62:0/3397433966 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7c2401c460 con 0x7f7c300b0830 2021-12-17T18:27:07.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.262+0000 7f7c1ffff700 1 --2- 172.21.15.62:0/3397433966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7c0c053580 0x7f7c0c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:07.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.262+0000 7f7c1ffff700 1 -- 172.21.15.62:0/3397433966 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f7c2406bf50 con 0x7f7c300b0830 2021-12-17T18:27:07.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.262+0000 7f7c2ed9d700 1 --2- 172.21.15.62:0/3397433966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7c0c053580 0x7f7c0c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:07.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.262+0000 7f7c2ed9d700 1 --2- 172.21.15.62:0/3397433966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7c0c053580 0x7f7c0c055a40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f7c2001a000 tx=0x7f7c20014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:07.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.266+0000 7f7c1ffff700 1 -- 172.21.15.62:0/3397433966 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7c24042f00 con 0x7f7c300b0830 2021-12-17T18:27:07.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:07.430+0000 7f7c3506d700 1 -- 172.21.15.62:0/3397433966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7c300573d0 con 0x7f7c300b0830 2021-12-17T18:27:08.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.170+0000 7f7c1ffff700 1 -- 172.21.15.62:0/3397433966 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7c24046520 con 0x7f7c300b0830 2021-12-17T18:27:08.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.174+0000 7f7c3506d700 1 -- 172.21.15.62:0/3397433966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7c0c053580 msgr2=0x7f7c0c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:08.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.174+0000 7f7c3506d700 1 --2- 172.21.15.62:0/3397433966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7c0c053580 0x7f7c0c055a40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f7c2001a000 tx=0x7f7c20014000).stop 2021-12-17T18:27:08.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.174+0000 7f7c3506d700 1 -- 172.21.15.62:0/3397433966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c300b0830 msgr2=0x7f7c30155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:08.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.174+0000 7f7c3506d700 1 --2- 172.21.15.62:0/3397433966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c300b0830 0x7f7c30155d20 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f7c2400c000 tx=0x7f7c24006df0).stop 2021-12-17T18:27:08.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.174+0000 7f7c3506d700 1 -- 172.21.15.62:0/3397433966 shutdown_connections 2021-12-17T18:27:08.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.174+0000 7f7c3506d700 1 --2- 172.21.15.62:0/3397433966 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7c0c053580 0x7f7c0c055a40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.174+0000 7f7c3506d700 1 --2- 172.21.15.62:0/3397433966 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7c300b6160 0x7f7c30156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.174+0000 7f7c3506d700 1 --2- 172.21.15.62:0/3397433966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c300b0830 0x7f7c30155d20 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.174+0000 7f7c3506d700 1 --2- 172.21.15.62:0/3397433966 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7c300af220 0x7f7c30067650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.174+0000 7f7c3506d700 1 -- 172.21.15.62:0/3397433966 >> 172.21.15.62:0/3397433966 conn(0x7f7c3005c750 msgr2=0x7f7c3013d680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:08.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.174+0000 7f7c3506d700 1 -- 172.21.15.62:0/3397433966 shutdown_connections 2021-12-17T18:27:08.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.174+0000 7f7c3506d700 1 -- 172.21.15.62:0/3397433966 wait complete. 2021-12-17T18:27:08.183 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-12-17T18:27:08.194 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:08.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d24461700 1 Processor -- start 2021-12-17T18:27:08.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d24461700 1 -- start start 2021-12-17T18:27:08.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d24461700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d1c0ad610 0x7f5d1c0b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:08.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d24461700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5d1c13f470 0x7f5d1c143000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:08.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d24461700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d1c0ad9f0 con 0x7f5d1c0b0e00 2021-12-17T18:27:08.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d24461700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d1c0ad010 con 0x7f5d1c13f470 2021-12-17T18:27:08.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d24461700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c0b19e0 con 0x7f5d1c0ad610 2021-12-17T18:27:08.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d219fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5d1c0b0e00 0x7f5d1c13ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39140/0 (socket says 172.21.15.62:39140) 2021-12-17T18:27:08.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d219fc700 1 -- 172.21.15.62:0/640436775 learned_addr learned my addr 172.21.15.62:0/640436775 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:08.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d229fe700 1 --2- 172.21.15.62:0/640436775 >> v2:172.21.15.62:3300/0 conn(0x7f5d1c13f470 0x7f5d1c143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:08.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d221fd700 1 --2- 172.21.15.62:0/640436775 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d1c0ad610 0x7f5d1c0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:08.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d211fb700 1 -- 172.21.15.62:0/640436775 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1417183250 0 0) 0x7f5d1c0ad9f0 con 0x7f5d1c0b0e00 2021-12-17T18:27:08.306 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d211fb700 1 -- 172.21.15.62:0/640436775 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d08003260 con 0x7f5d1c0b0e00 2021-12-17T18:27:08.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d229fe700 1 -- 172.21.15.62:0/640436775 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d1c0ad610 msgr2=0x7f5d1c0b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:08.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d229fe700 1 --2- 172.21.15.62:0/640436775 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d1c0ad610 0x7f5d1c0b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d229fe700 1 -- 172.21.15.62:0/640436775 >> v1:172.21.15.62:6789/0 conn(0x7f5d1c0b0e00 legacy=0x7f5d1c13ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:08.307 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d229fe700 1 -- 172.21.15.62:0/640436775 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c0b1c80 con 0x7f5d1c13f470 2021-12-17T18:27:08.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d229fe700 1 --2- 172.21.15.62:0/640436775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d1c13f470 0x7f5d1c143000 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f5d14002f70 tx=0x7f5d14006df0).ready entity=mon.0 client_cookie=7cb9b33e9468d565 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:08.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d211fb700 1 -- 172.21.15.62:0/640436775 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d1400d4a0 con 0x7f5d1c13f470 2021-12-17T18:27:08.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d211fb700 1 -- 172.21.15.62:0/640436775 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d14000e90 con 0x7f5d1c13f470 2021-12-17T18:27:08.308 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.298+0000 7f5d211fb700 1 -- 172.21.15.62:0/640436775 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d1400d7f0 con 0x7f5d1c13f470 2021-12-17T18:27:08.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d24461700 1 -- 172.21.15.62:0/640436775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d1c13f470 msgr2=0x7f5d1c143000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:08.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d24461700 1 --2- 172.21.15.62:0/640436775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d1c13f470 0x7f5d1c143000 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f5d14002f70 tx=0x7f5d14006df0).stop 2021-12-17T18:27:08.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d24461700 1 -- 172.21.15.62:0/640436775 shutdown_connections 2021-12-17T18:27:08.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d24461700 1 --2- 172.21.15.62:0/640436775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d1c13f470 0x7f5d1c143000 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d24461700 1 --2- 172.21.15.62:0/640436775 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d1c0ad610 0x7f5d1c0b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d24461700 1 -- 172.21.15.62:0/640436775 >> 172.21.15.62:0/640436775 conn(0x7f5d1c05c750 msgr2=0x7f5d1c0630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:08.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d24461700 1 -- 172.21.15.62:0/640436775 shutdown_connections 2021-12-17T18:27:08.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d24461700 1 -- 172.21.15.62:0/640436775 wait complete. 2021-12-17T18:27:08.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d24461700 1 Processor -- start 2021-12-17T18:27:08.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d24461700 1 -- start start 2021-12-17T18:27:08.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d24461700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d1c0ad610 0x7f5d1c13e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:08.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d24461700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d1c0b0e00 0x7f5d1c12da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:08.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d24461700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d1c13f470 0x7f5d1c12c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:08.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d24461700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c153900 con 0x7f5d1c13f470 2021-12-17T18:27:08.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d24461700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c1533f0 con 0x7f5d1c0b0e00 2021-12-17T18:27:08.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d24461700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c153660 con 0x7f5d1c0ad610 2021-12-17T18:27:08.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d229fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d1c13f470 0x7f5d1c12c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:08.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d229fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d1c13f470 0x7f5d1c12c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55570/0 (socket says 172.21.15.62:55570) 2021-12-17T18:27:08.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d229fe700 1 -- 172.21.15.62:0/2498317591 learned_addr learned my addr 172.21.15.62:0/2498317591 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:08.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d221fd700 1 --2- 172.21.15.62:0/2498317591 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d1c0ad610 0x7f5d1c13e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:08.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.302+0000 7f5d219fc700 1 --2- 172.21.15.62:0/2498317591 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d1c0b0e00 0x7f5d1c12da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:08.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.306+0000 7f5d229fe700 1 -- 172.21.15.62:0/2498317591 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d1c0ad610 msgr2=0x7f5d1c13e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:08.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.306+0000 7f5d229fe700 1 --2- 172.21.15.62:0/2498317591 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d1c0ad610 0x7f5d1c13e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.306+0000 7f5d229fe700 1 -- 172.21.15.62:0/2498317591 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d1c0b0e00 msgr2=0x7f5d1c12da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:08.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.306+0000 7f5d229fe700 1 --2- 172.21.15.62:0/2498317591 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d1c0b0e00 0x7f5d1c12da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.306+0000 7f5d229fe700 1 -- 172.21.15.62:0/2498317591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1400b180 con 0x7f5d1c13f470 2021-12-17T18:27:08.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.306+0000 7f5d229fe700 1 --2- 172.21.15.62:0/2498317591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d1c13f470 0x7f5d1c12c4e0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f5d1c153580 tx=0x7f5d14014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:08.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.306+0000 7f5d137fe700 1 -- 172.21.15.62:0/2498317591 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d14016070 con 0x7f5d1c13f470 2021-12-17T18:27:08.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.306+0000 7f5d137fe700 1 -- 172.21.15.62:0/2498317591 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d14013850 con 0x7f5d1c13f470 2021-12-17T18:27:08.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.306+0000 7f5d24461700 1 -- 172.21.15.62:0/2498317591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d1c14f650 con 0x7f5d1c13f470 2021-12-17T18:27:08.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.306+0000 7f5d137fe700 1 -- 172.21.15.62:0/2498317591 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d14013bb0 con 0x7f5d1c13f470 2021-12-17T18:27:08.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.306+0000 7f5d24461700 1 -- 172.21.15.62:0/2498317591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d1c065250 con 0x7f5d1c13f470 2021-12-17T18:27:08.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.306+0000 7f5d24461700 1 -- 172.21.15.62:0/2498317591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d1c064b10 con 0x7f5d1c13f470 2021-12-17T18:27:08.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.310+0000 7f5d137fe700 1 -- 172.21.15.62:0/2498317591 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5d14025030 con 0x7f5d1c13f470 2021-12-17T18:27:08.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.310+0000 7f5d137fe700 1 --2- 172.21.15.62:0/2498317591 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5cfc053610 0x7f5cfc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:08.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.310+0000 7f5d137fe700 1 -- 172.21.15.62:0/2498317591 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f5d1406d0c0 con 0x7f5d1c13f470 2021-12-17T18:27:08.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.310+0000 7f5d221fd700 1 --2- 172.21.15.62:0/2498317591 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5cfc053610 0x7f5cfc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:08.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.310+0000 7f5d221fd700 1 --2- 172.21.15.62:0/2498317591 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5cfc053610 0x7f5cfc055ad0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f5d1800b000 tx=0x7f5d18006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:08.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.314+0000 7f5d137fe700 1 -- 172.21.15.62:0/2498317591 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5d14044280 con 0x7f5d1c13f470 2021-12-17T18:27:08.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.478+0000 7f5d24461700 1 -- 172.21.15.62:0/2498317591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d1c14f850 con 0x7f5d1c13f470 2021-12-17T18:27:08.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.478+0000 7f5d137fe700 1 -- 172.21.15.62:0/2498317591 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+1426 (secure 0 0 0) 0x7f5d1c14f850 con 0x7f5d1c13f470 2021-12-17T18:27:08.483 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:08.484 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":61,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":61,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:27:06.154150+0000","modified":"2021-12-17T18:27:08.160549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-12-17T18:27:08.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.482+0000 7f5d24461700 1 -- 172.21.15.62:0/2498317591 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5cfc053610 msgr2=0x7f5cfc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:08.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.482+0000 7f5d24461700 1 --2- 172.21.15.62:0/2498317591 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5cfc053610 0x7f5cfc055ad0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f5d1800b000 tx=0x7f5d18006df0).stop 2021-12-17T18:27:08.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.482+0000 7f5d24461700 1 -- 172.21.15.62:0/2498317591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d1c13f470 msgr2=0x7f5d1c12c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:08.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.482+0000 7f5d24461700 1 --2- 172.21.15.62:0/2498317591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d1c13f470 0x7f5d1c12c4e0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f5d1c153580 tx=0x7f5d14014000).stop 2021-12-17T18:27:08.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.482+0000 7f5d24461700 1 -- 172.21.15.62:0/2498317591 shutdown_connections 2021-12-17T18:27:08.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.482+0000 7f5d24461700 1 --2- 172.21.15.62:0/2498317591 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5cfc053610 0x7f5cfc055ad0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.482+0000 7f5d24461700 1 --2- 172.21.15.62:0/2498317591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d1c13f470 0x7f5d1c12c4e0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.482+0000 7f5d24461700 1 --2- 172.21.15.62:0/2498317591 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d1c0b0e00 0x7f5d1c12da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.482+0000 7f5d24461700 1 --2- 172.21.15.62:0/2498317591 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d1c0ad610 0x7f5d1c13e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.482+0000 7f5d24461700 1 -- 172.21.15.62:0/2498317591 >> 172.21.15.62:0/2498317591 conn(0x7f5d1c05c750 msgr2=0x7f5d1c0b5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:08.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.482+0000 7f5d24461700 1 -- 172.21.15.62:0/2498317591 shutdown_connections 2021-12-17T18:27:08.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.482+0000 7f5d24461700 1 -- 172.21.15.62:0/2498317591 wait complete. 2021-12-17T18:27:08.489 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 61 2021-12-17T18:27:08.497 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-12-17T18:27:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51b0910700 1 Processor -- start 2021-12-17T18:27:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51b0910700 1 -- start start 2021-12-17T18:27:08.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51b0910700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51ac0b65b0 0x7f51ac13ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:08.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51b0910700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f51ac0b41e0 0x7f51ac0b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:08.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51b0910700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac0b6ee0 con 0x7f51ac060950 2021-12-17T18:27:08.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51b0910700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ac0b1c40 con 0x7f51ac0b41e0 2021-12-17T18:27:08.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51b0910700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac0b6990 con 0x7f51ac0b65b0 2021-12-17T18:27:08.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51abfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f51ac0b41e0 0x7f51ac0b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:08.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51abfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f51ac0b41e0 0x7f51ac0b2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55574/0 (socket says 172.21.15.62:55574) 2021-12-17T18:27:08.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51abfff700 1 -- 172.21.15.62:0/742557809 learned_addr learned my addr 172.21.15.62:0/742557809 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:08.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51ab7fe700 1 --2- 172.21.15.62:0/742557809 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51ac0b65b0 0x7f51ac13ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:08.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51abfff700 1 -- 172.21.15.62:0/742557809 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51ac0b65b0 msgr2=0x7f51ac13ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:08.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51abfff700 1 --2- 172.21.15.62:0/742557809 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51ac0b65b0 0x7f51ac13ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51abfff700 1 -- 172.21.15.62:0/742557809 >> v1:172.21.15.109:6789/0 conn(0x7f51ac060950 legacy=0x7f51ac140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:08.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51abfff700 1 -- 172.21.15.62:0/742557809 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac0b5e20 con 0x7f51ac0b41e0 2021-12-17T18:27:08.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51abfff700 1 --2- 172.21.15.62:0/742557809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0b41e0 0x7f51ac0b2d10 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f51a40032f0 tx=0x7f51a4009290).ready entity=mon.0 client_cookie=4ccc028e9848fe10 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:08.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51aaffd700 1 -- 172.21.15.62:0/742557809 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51a400b8a0 con 0x7f51ac0b41e0 2021-12-17T18:27:08.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51aaffd700 1 -- 172.21.15.62:0/742557809 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a400ba00 con 0x7f51ac0b41e0 2021-12-17T18:27:08.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.602+0000 7f51aaffd700 1 -- 172.21.15.62:0/742557809 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51a400bb70 con 0x7f51ac0b41e0 2021-12-17T18:27:08.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51b0910700 1 -- 172.21.15.62:0/742557809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0b41e0 msgr2=0x7f51ac0b2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:08.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51b0910700 1 --2- 172.21.15.62:0/742557809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0b41e0 0x7f51ac0b2d10 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f51a40032f0 tx=0x7f51a4009290).stop 2021-12-17T18:27:08.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51b0910700 1 -- 172.21.15.62:0/742557809 shutdown_connections 2021-12-17T18:27:08.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51b0910700 1 --2- 172.21.15.62:0/742557809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0b41e0 0x7f51ac0b2d10 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51b0910700 1 --2- 172.21.15.62:0/742557809 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51ac0b65b0 0x7f51ac13ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51b0910700 1 -- 172.21.15.62:0/742557809 >> 172.21.15.62:0/742557809 conn(0x7f51ac05c750 msgr2=0x7f51ac05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:08.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51b0910700 1 -- 172.21.15.62:0/742557809 shutdown_connections 2021-12-17T18:27:08.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51b0910700 1 -- 172.21.15.62:0/742557809 wait complete. 2021-12-17T18:27:08.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51b0910700 1 Processor -- start 2021-12-17T18:27:08.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51b0910700 1 -- start start 2021-12-17T18:27:08.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51b0910700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51ac060950 0x7f51ac141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:08.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51b0910700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0b41e0 0x7f51ac13d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:08.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51b0910700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51ac0b65b0 0x7f51ac13d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:08.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51b0910700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac13dd80 con 0x7f51ac0b41e0 2021-12-17T18:27:08.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51b0910700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac065040 con 0x7f51ac0b65b0 2021-12-17T18:27:08.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51b0910700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac145c20 con 0x7f51ac060950 2021-12-17T18:27:08.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51a2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0b41e0 0x7f51ac13d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:08.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51a2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0b41e0 0x7f51ac13d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55580/0 (socket says 172.21.15.62:55580) 2021-12-17T18:27:08.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51a2ffd700 1 -- 172.21.15.62:0/1588829386 learned_addr learned my addr 172.21.15.62:0/1588829386 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:08.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51ab7fe700 1 --2- 172.21.15.62:0/1588829386 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51ac060950 0x7f51ac141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:08.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51abfff700 1 --2- 172.21.15.62:0/1588829386 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51ac0b65b0 0x7f51ac13d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:08.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51a2ffd700 1 -- 172.21.15.62:0/1588829386 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51ac060950 msgr2=0x7f51ac141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:08.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51a2ffd700 1 --2- 172.21.15.62:0/1588829386 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51ac060950 0x7f51ac141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51a2ffd700 1 -- 172.21.15.62:0/1588829386 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51ac0b65b0 msgr2=0x7f51ac13d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:08.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51a2ffd700 1 --2- 172.21.15.62:0/1588829386 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51ac0b65b0 0x7f51ac13d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:08.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51a2ffd700 1 -- 172.21.15.62:0/1588829386 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a4009530 con 0x7f51ac0b41e0 2021-12-17T18:27:08.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.606+0000 7f51a2ffd700 1 --2- 172.21.15.62:0/1588829386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0b41e0 0x7f51ac13d3a0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f51ac067b40 tx=0x7f5194007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:08.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.610+0000 7f51a97fa700 1 -- 172.21.15.62:0/1588829386 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f519400ce30 con 0x7f51ac0b41e0 2021-12-17T18:27:08.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.610+0000 7f51a97fa700 1 -- 172.21.15.62:0/1588829386 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519400f470 con 0x7f51ac0b41e0 2021-12-17T18:27:08.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.610+0000 7f51b0910700 1 -- 172.21.15.62:0/1588829386 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ac145ec0 con 0x7f51ac0b41e0 2021-12-17T18:27:08.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.610+0000 7f51a97fa700 1 -- 172.21.15.62:0/1588829386 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f519400f7d0 con 0x7f51ac0b41e0 2021-12-17T18:27:08.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.610+0000 7f51b0910700 1 -- 172.21.15.62:0/1588829386 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac064cc0 con 0x7f51ac0b41e0 2021-12-17T18:27:08.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.610+0000 7f51a97fa700 1 -- 172.21.15.62:0/1588829386 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5194019030 con 0x7f51ac0b41e0 2021-12-17T18:27:08.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.610+0000 7f51a97fa700 1 --2- 172.21.15.62:0/1588829386 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51900534f0 0x7f51900559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:08.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.610+0000 7f51b0910700 1 -- 172.21.15.62:0/1588829386 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ac141760 con 0x7f51ac0b41e0 2021-12-17T18:27:08.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.610+0000 7f51a97fa700 1 -- 172.21.15.62:0/1588829386 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f519406ad80 con 0x7f51ac0b41e0 2021-12-17T18:27:08.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.610+0000 7f51ab7fe700 1 --2- 172.21.15.62:0/1588829386 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51900534f0 0x7f51900559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:08.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.610+0000 7f51ab7fe700 1 --2- 172.21.15.62:0/1588829386 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51900534f0 0x7f51900559b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f519c00c000 tx=0x7f519c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:08.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.614+0000 7f51a97fa700 1 -- 172.21.15.62:0/1588829386 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f51ac141760 con 0x7f51ac0b41e0 2021-12-17T18:27:08.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:08.782+0000 7f51b0910700 1 -- 172.21.15.62:0/1588829386 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f51ac141760 con 0x7f51ac0b41e0 2021-12-17T18:27:09.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.173+0000 7f51a97fa700 1 -- 172.21.15.62:0/1588829386 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v62) v1 ==== 104+0+0 (secure 0 0 0) 0x7f51ac141760 con 0x7f51ac0b41e0 2021-12-17T18:27:09.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.173+0000 7f51b0910700 1 -- 172.21.15.62:0/1588829386 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51900534f0 msgr2=0x7f51900559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:09.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.173+0000 7f51b0910700 1 --2- 172.21.15.62:0/1588829386 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51900534f0 0x7f51900559b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f519c00c000 tx=0x7f519c008040).stop 2021-12-17T18:27:09.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.173+0000 7f51b0910700 1 -- 172.21.15.62:0/1588829386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0b41e0 msgr2=0x7f51ac13d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:09.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.173+0000 7f51b0910700 1 --2- 172.21.15.62:0/1588829386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0b41e0 0x7f51ac13d3a0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f51ac067b40 tx=0x7f5194007c50).stop 2021-12-17T18:27:09.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.173+0000 7f51b0910700 1 -- 172.21.15.62:0/1588829386 shutdown_connections 2021-12-17T18:27:09.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.173+0000 7f51b0910700 1 --2- 172.21.15.62:0/1588829386 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f51900534f0 0x7f51900559b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:09.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.173+0000 7f51b0910700 1 --2- 172.21.15.62:0/1588829386 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51ac0b65b0 0x7f51ac13d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:09.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.173+0000 7f51b0910700 1 --2- 172.21.15.62:0/1588829386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0b41e0 0x7f51ac13d3a0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:09.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.173+0000 7f51b0910700 1 --2- 172.21.15.62:0/1588829386 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51ac060950 0x7f51ac141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:09.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.177+0000 7f51b0910700 1 -- 172.21.15.62:0/1588829386 >> 172.21.15.62:0/1588829386 conn(0x7f51ac05c750 msgr2=0x7f51ac1400c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:09.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.177+0000 7f51b0910700 1 -- 172.21.15.62:0/1588829386 shutdown_connections 2021-12-17T18:27:09.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.177+0000 7f51b0910700 1 -- 172.21.15.62:0/1588829386 wait complete. 2021-12-17T18:27:09.197 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-12-17T18:27:09.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.309+0000 7fec20283700 1 Processor -- start 2021-12-17T18:27:09.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.309+0000 7fec20283700 1 -- start start 2021-12-17T18:27:09.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.309+0000 7fec20283700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fec180b66c0 0x7fec1805f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:09.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.309+0000 7fec20283700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec180b2240 0x7fec1805fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:09.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.309+0000 7fec20283700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec180b6aa0 con 0x7fec180b13e0 2021-12-17T18:27:09.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.309+0000 7fec20283700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec180ad9c0 con 0x7fec180b2240 2021-12-17T18:27:09.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.309+0000 7fec20283700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec180afb10 con 0x7fec180b66c0 2021-12-17T18:27:09.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec1d81e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec180b2240 0x7fec1805fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:09.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec1d81e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec180b2240 0x7fec1805fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55588/0 (socket says 172.21.15.62:55588) 2021-12-17T18:27:09.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec1d81e700 1 -- 172.21.15.62:0/2970315773 learned_addr learned my addr 172.21.15.62:0/2970315773 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:09.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec1e01f700 1 --2- 172.21.15.62:0/2970315773 >> v2:172.21.15.109:3300/0 conn(0x7fec180b66c0 0x7fec1805f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:09.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec1d81e700 1 -- 172.21.15.62:0/2970315773 >> v2:172.21.15.109:3300/0 conn(0x7fec180b66c0 msgr2=0x7fec1805f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:09.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec1d81e700 1 --2- 172.21.15.62:0/2970315773 >> v2:172.21.15.109:3300/0 conn(0x7fec180b66c0 0x7fec1805f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:09.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec1d81e700 1 -- 172.21.15.62:0/2970315773 >> v1:172.21.15.109:6789/0 conn(0x7fec180b13e0 legacy=0x7fec1814ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:09.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec1d81e700 1 -- 172.21.15.62:0/2970315773 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec180ad4b0 con 0x7fec180b2240 2021-12-17T18:27:09.320 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec1d81e700 1 --2- 172.21.15.62:0/2970315773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec180b2240 0x7fec1805fc20 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7fec08002f70 tx=0x7fec08006eb0).ready entity=mon.0 client_cookie=b79b6c5e1b6436b2 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:09.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec1d01d700 1 -- 172.21.15.62:0/2970315773 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec0800d5c0 con 0x7fec180b2240 2021-12-17T18:27:09.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec1d01d700 1 -- 172.21.15.62:0/2970315773 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec08000e90 con 0x7fec180b2240 2021-12-17T18:27:09.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec1d01d700 1 -- 172.21.15.62:0/2970315773 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec0800d950 con 0x7fec180b2240 2021-12-17T18:27:09.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec20283700 1 -- 172.21.15.62:0/2970315773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec180b2240 msgr2=0x7fec1805fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:09.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec20283700 1 --2- 172.21.15.62:0/2970315773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec180b2240 0x7fec1805fc20 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7fec08002f70 tx=0x7fec08006eb0).stop 2021-12-17T18:27:09.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec20283700 1 -- 172.21.15.62:0/2970315773 shutdown_connections 2021-12-17T18:27:09.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec20283700 1 --2- 172.21.15.62:0/2970315773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec180b2240 0x7fec1805fc20 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:09.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec20283700 1 --2- 172.21.15.62:0/2970315773 >> v2:172.21.15.109:3300/0 conn(0x7fec180b66c0 0x7fec1805f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:09.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec20283700 1 -- 172.21.15.62:0/2970315773 >> 172.21.15.62:0/2970315773 conn(0x7fec1805d220 msgr2=0x7fec180b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:09.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec20283700 1 -- 172.21.15.62:0/2970315773 shutdown_connections 2021-12-17T18:27:09.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec20283700 1 -- 172.21.15.62:0/2970315773 wait complete. 2021-12-17T18:27:09.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec20283700 1 Processor -- start 2021-12-17T18:27:09.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.313+0000 7fec20283700 1 -- start start 2021-12-17T18:27:09.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec20283700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fec180b13e0 0x7fec18067230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:09.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec20283700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fec180b2240 0x7fec18149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:09.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec20283700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec180b66c0 0x7fec18149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:09.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec20283700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec181469d0 con 0x7fec180b66c0 2021-12-17T18:27:09.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec20283700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec180ac160 con 0x7fec180b13e0 2021-12-17T18:27:09.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec20283700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec18146080 con 0x7fec180b2240 2021-12-17T18:27:09.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec1e820700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec180b66c0 0x7fec18149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:09.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec1e01f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fec180b13e0 0x7fec18067230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:09.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec1e820700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec180b66c0 0x7fec18149b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55596/0 (socket says 172.21.15.62:55596) 2021-12-17T18:27:09.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec1d81e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fec180b2240 0x7fec18149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:09.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec1e820700 1 -- 172.21.15.62:0/1356121715 learned_addr learned my addr 172.21.15.62:0/1356121715 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:09.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec1e01f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fec180b13e0 0x7fec18067230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:33910/0 (socket says 172.21.15.62:33910) 2021-12-17T18:27:09.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec1e820700 1 -- 172.21.15.62:0/1356121715 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fec180b2240 msgr2=0x7fec18149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:09.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec1e820700 1 --2- 172.21.15.62:0/1356121715 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fec180b2240 0x7fec18149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:09.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec1e820700 1 -- 172.21.15.62:0/1356121715 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fec180b13e0 msgr2=0x7fec18067230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:09.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec1e820700 1 --2- 172.21.15.62:0/1356121715 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fec180b13e0 0x7fec18067230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:09.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec1e820700 1 -- 172.21.15.62:0/1356121715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0800b1e0 con 0x7fec180b66c0 2021-12-17T18:27:09.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec1e820700 1 --2- 172.21.15.62:0/1356121715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec180b66c0 0x7fec18149b80 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7fec18067ca0 tx=0x7fec10007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:09.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec077fe700 1 -- 172.21.15.62:0/1356121715 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1000f470 con 0x7fec180b66c0 2021-12-17T18:27:09.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec20283700 1 -- 172.21.15.62:0/1356121715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec180a71e0 con 0x7fec180b66c0 2021-12-17T18:27:09.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec077fe700 1 -- 172.21.15.62:0/1356121715 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1000f5d0 con 0x7fec180b66c0 2021-12-17T18:27:09.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec20283700 1 -- 172.21.15.62:0/1356121715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec180abbe0 con 0x7fec180b66c0 2021-12-17T18:27:09.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.317+0000 7fec077fe700 1 -- 172.21.15.62:0/1356121715 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1000f930 con 0x7fec180b66c0 2021-12-17T18:27:09.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.321+0000 7fec20283700 1 -- 172.21.15.62:0/1356121715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec181466e0 con 0x7fec180b66c0 2021-12-17T18:27:09.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.321+0000 7fec077fe700 1 -- 172.21.15.62:0/1356121715 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fec10019030 con 0x7fec180b66c0 2021-12-17T18:27:09.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.321+0000 7fec077fe700 1 --2- 172.21.15.62:0/1356121715 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7febf8053610 0x7febf8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:09.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.321+0000 7fec077fe700 1 -- 172.21.15.62:0/1356121715 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fec1006b070 con 0x7fec180b66c0 2021-12-17T18:27:09.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.321+0000 7fec1e01f700 1 --2- 172.21.15.62:0/1356121715 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7febf8053610 0x7febf8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:09.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.321+0000 7fec1e01f700 1 --2- 172.21.15.62:0/1356121715 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7febf8053610 0x7febf8055ad0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fec1400b000 tx=0x7fec14006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:09.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.329+0000 7fec077fe700 1 -- 172.21.15.62:0/1356121715 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fec100420e0 con 0x7fec180b66c0 2021-12-17T18:27:09.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:09.449+0000 7fec20283700 1 -- 172.21.15.62:0/1356121715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fec180b0e10 con 0x7fec180b66c0 2021-12-17T18:27:10.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.181+0000 7fec077fe700 1 -- 172.21.15.62:0/1356121715 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v125) v1 ==== 185+0+0 (secure 0 0 0) 0x7fec10045700 con 0x7fec180b66c0 2021-12-17T18:27:10.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.185+0000 7fec20283700 1 -- 172.21.15.62:0/1356121715 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7febf8053610 msgr2=0x7febf8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:10.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.185+0000 7fec20283700 1 --2- 172.21.15.62:0/1356121715 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7febf8053610 0x7febf8055ad0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fec1400b000 tx=0x7fec14006df0).stop 2021-12-17T18:27:10.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.185+0000 7fec20283700 1 -- 172.21.15.62:0/1356121715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec180b66c0 msgr2=0x7fec18149b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:10.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.185+0000 7fec20283700 1 --2- 172.21.15.62:0/1356121715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec180b66c0 0x7fec18149b80 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7fec18067ca0 tx=0x7fec10007f40).stop 2021-12-17T18:27:10.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.185+0000 7fec20283700 1 -- 172.21.15.62:0/1356121715 shutdown_connections 2021-12-17T18:27:10.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.185+0000 7fec20283700 1 --2- 172.21.15.62:0/1356121715 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7febf8053610 0x7febf8055ad0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:10.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.185+0000 7fec20283700 1 --2- 172.21.15.62:0/1356121715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec180b66c0 0x7fec18149b80 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:10.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.185+0000 7fec20283700 1 --2- 172.21.15.62:0/1356121715 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fec180b2240 0x7fec18149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:10.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.185+0000 7fec20283700 1 --2- 172.21.15.62:0/1356121715 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fec180b13e0 0x7fec18067230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:10.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.185+0000 7fec20283700 1 -- 172.21.15.62:0/1356121715 >> 172.21.15.62:0/1356121715 conn(0x7fec1805d220 msgr2=0x7fec18063690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:10.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.185+0000 7fec20283700 1 -- 172.21.15.62:0/1356121715 shutdown_connections 2021-12-17T18:27:10.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.185+0000 7fec20283700 1 -- 172.21.15.62:0/1356121715 wait complete. 2021-12-17T18:27:10.195 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2021-12-17T18:27:10.206 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-12-17T18:27:10.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.321+0000 7f72ee17a700 1 Processor -- start 2021-12-17T18:27:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.321+0000 7f72ee17a700 1 -- start start 2021-12-17T18:27:10.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72ee17a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72e8142d70 0x7f72e81471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:10.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72ee17a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e80b09e0 con 0x7f72e80b4340 2021-12-17T18:27:10.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72ee17a700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e81467d0 con 0x7f72e80b51a0 2021-12-17T18:27:10.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72ee17a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8146a70 con 0x7f72e8142d70 2021-12-17T18:27:10.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72e77fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f72e80b4340 0x7f72e8142660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39180/0 (socket says 172.21.15.62:39180) 2021-12-17T18:27:10.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72e77fe700 1 -- 172.21.15.62:0/1981426755 learned_addr learned my addr 172.21.15.62:0/1981426755 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:10.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72deffd700 1 --2- 172.21.15.62:0/1981426755 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72e8142d70 0x7f72e81471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:10.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72e6ffd700 1 -- 172.21.15.62:0/1981426755 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336426439 0 0) 0x7f72e80b09e0 con 0x7f72e80b4340 2021-12-17T18:27:10.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72e6ffd700 1 -- 172.21.15.62:0/1981426755 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c8003260 con 0x7f72e80b4340 2021-12-17T18:27:10.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72deffd700 1 -- 172.21.15.62:0/1981426755 >> v1:172.21.15.109:6789/0 conn(0x7f72e80b51a0 legacy=0x7f72e80b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:10.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72e6ffd700 1 -- 172.21.15.62:0/1981426755 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538561323 0 0) 0x7f72e81467d0 con 0x7f72e80b51a0 2021-12-17T18:27:10.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72deffd700 1 -- 172.21.15.62:0/1981426755 >> v1:172.21.15.62:6789/0 conn(0x7f72e80b4340 legacy=0x7f72e8142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:10.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72deffd700 1 -- 172.21.15.62:0/1981426755 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e8146d10 con 0x7f72e8142d70 2021-12-17T18:27:10.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72deffd700 1 --2- 172.21.15.62:0/1981426755 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72e8142d70 0x7f72e81471b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f72d0002f70 tx=0x7f72d0006df0).ready entity=mon.2 client_cookie=87df4aab89c3aefd server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:10.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72e6ffd700 1 -- 172.21.15.62:0/1981426755 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d000d570 con 0x7f72e8142d70 2021-12-17T18:27:10.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72e6ffd700 1 -- 172.21.15.62:0/1981426755 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d0000e90 con 0x7f72e8142d70 2021-12-17T18:27:10.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72e6ffd700 1 -- 172.21.15.62:0/1981426755 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d000d8c0 con 0x7f72e8142d70 2021-12-17T18:27:10.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72ee17a700 1 -- 172.21.15.62:0/1981426755 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72e8142d70 msgr2=0x7f72e81471b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:10.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72ee17a700 1 --2- 172.21.15.62:0/1981426755 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72e8142d70 0x7f72e81471b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f72d0002f70 tx=0x7f72d0006df0).stop 2021-12-17T18:27:10.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72ee17a700 1 -- 172.21.15.62:0/1981426755 shutdown_connections 2021-12-17T18:27:10.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72ee17a700 1 --2- 172.21.15.62:0/1981426755 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72e8142d70 0x7f72e81471b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:10.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72ee17a700 1 -- 172.21.15.62:0/1981426755 >> 172.21.15.62:0/1981426755 conn(0x7f72e805c750 msgr2=0x7f72e805cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:10.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72ee17a700 1 -- 172.21.15.62:0/1981426755 shutdown_connections 2021-12-17T18:27:10.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.325+0000 7f72ee17a700 1 -- 172.21.15.62:0/1981426755 wait complete. 2021-12-17T18:27:10.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72ee17a700 1 Processor -- start 2021-12-17T18:27:10.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72ee17a700 1 -- start start 2021-12-17T18:27:10.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72ee17a700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72e80b4340 0x7f72e80b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:10.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72ee17a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72e80b51a0 0x7f72e8152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:10.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72ee17a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72e8142d70 0x7f72e8144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:10.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72ee17a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e80b1ba0 con 0x7f72e80b51a0 2021-12-17T18:27:10.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72ee17a700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8153200 con 0x7f72e80b4340 2021-12-17T18:27:10.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72ee17a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8152330 con 0x7f72e8142d70 2021-12-17T18:27:10.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72deffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72e80b51a0 0x7f72e8152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:10.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72deffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72e80b51a0 0x7f72e8152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55606/0 (socket says 172.21.15.62:55606) 2021-12-17T18:27:10.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72deffd700 1 -- 172.21.15.62:0/132244069 learned_addr learned my addr 172.21.15.62:0/132244069 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:10.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72e7fff700 1 --2- 172.21.15.62:0/132244069 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72e8142d70 0x7f72e8144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:10.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72e77fe700 1 --2- 172.21.15.62:0/132244069 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72e80b4340 0x7f72e80b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:10.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72deffd700 1 -- 172.21.15.62:0/132244069 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72e8142d70 msgr2=0x7f72e8144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:10.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72deffd700 1 --2- 172.21.15.62:0/132244069 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72e8142d70 0x7f72e8144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:10.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72deffd700 1 -- 172.21.15.62:0/132244069 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72e80b4340 msgr2=0x7f72e80b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:10.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72deffd700 1 --2- 172.21.15.62:0/132244069 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72e80b4340 0x7f72e80b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:10.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72deffd700 1 -- 172.21.15.62:0/132244069 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d000b180 con 0x7f72e80b51a0 2021-12-17T18:27:10.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72deffd700 1 --2- 172.21.15.62:0/132244069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72e80b51a0 0x7f72e8152d10 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f72e8064920 tx=0x7f72d0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:10.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72e57fa700 1 -- 172.21.15.62:0/132244069 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d0013d60 con 0x7f72e80b51a0 2021-12-17T18:27:10.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72e57fa700 1 -- 172.21.15.62:0/132244069 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d001e400 con 0x7f72e80b51a0 2021-12-17T18:27:10.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72ee17a700 1 -- 172.21.15.62:0/132244069 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e81525d0 con 0x7f72e80b51a0 2021-12-17T18:27:10.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72e57fa700 1 -- 172.21.15.62:0/132244069 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d001e760 con 0x7f72e80b51a0 2021-12-17T18:27:10.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.329+0000 7f72ee17a700 1 -- 172.21.15.62:0/132244069 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e8151fc0 con 0x7f72e80b51a0 2021-12-17T18:27:10.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.333+0000 7f72ee17a700 1 -- 172.21.15.62:0/132244069 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e8152a70 con 0x7f72e80b51a0 2021-12-17T18:27:10.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.333+0000 7f72e57fa700 1 -- 172.21.15.62:0/132244069 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f72d0025030 con 0x7f72e80b51a0 2021-12-17T18:27:10.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.333+0000 7f72e57fa700 1 --2- 172.21.15.62:0/132244069 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f72cc053610 0x7f72cc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:10.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.333+0000 7f72e57fa700 1 -- 172.21.15.62:0/132244069 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f72d006c430 con 0x7f72e80b51a0 2021-12-17T18:27:10.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.333+0000 7f72e77fe700 1 --2- 172.21.15.62:0/132244069 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f72cc053610 0x7f72cc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:10.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.333+0000 7f72e77fe700 1 --2- 172.21.15.62:0/132244069 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f72cc053610 0x7f72cc055ad0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f72d800d000 tx=0x7f72d8009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:10.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.337+0000 7f72e57fa700 1 -- 172.21.15.62:0/132244069 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f72e8152a70 con 0x7f72e80b51a0 2021-12-17T18:27:10.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:10.465+0000 7f72ee17a700 1 -- 172.21.15.62:0/132244069 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f72e8152a70 con 0x7f72e80b51a0 2021-12-17T18:27:11.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.185+0000 7f72e57fa700 1 -- 172.21.15.62:0/132244069 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v126) v1 ==== 173+0+0 (secure 0 0 0) 0x7f72e8152a70 con 0x7f72e80b51a0 2021-12-17T18:27:11.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.189+0000 7f72ee17a700 1 -- 172.21.15.62:0/132244069 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f72cc053610 msgr2=0x7f72cc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:11.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.189+0000 7f72ee17a700 1 --2- 172.21.15.62:0/132244069 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f72cc053610 0x7f72cc055ad0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f72d800d000 tx=0x7f72d8009040).stop 2021-12-17T18:27:11.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.189+0000 7f72ee17a700 1 -- 172.21.15.62:0/132244069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72e80b51a0 msgr2=0x7f72e8152d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:11.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.189+0000 7f72ee17a700 1 --2- 172.21.15.62:0/132244069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72e80b51a0 0x7f72e8152d10 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f72e8064920 tx=0x7f72d0014000).stop 2021-12-17T18:27:11.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.189+0000 7f72ee17a700 1 -- 172.21.15.62:0/132244069 shutdown_connections 2021-12-17T18:27:11.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.189+0000 7f72ee17a700 1 --2- 172.21.15.62:0/132244069 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f72cc053610 0x7f72cc055ad0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.189+0000 7f72ee17a700 1 --2- 172.21.15.62:0/132244069 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72e8142d70 0x7f72e8144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.189+0000 7f72ee17a700 1 --2- 172.21.15.62:0/132244069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72e80b51a0 0x7f72e8152d10 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.189+0000 7f72ee17a700 1 --2- 172.21.15.62:0/132244069 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72e80b4340 0x7f72e80b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.189+0000 7f72ee17a700 1 -- 172.21.15.62:0/132244069 >> 172.21.15.62:0/132244069 conn(0x7f72e805c750 msgr2=0x7f72e8142210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:11.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.189+0000 7f72ee17a700 1 -- 172.21.15.62:0/132244069 shutdown_connections 2021-12-17T18:27:11.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.189+0000 7f72ee17a700 1 -- 172.21.15.62:0/132244069 wait complete. 2021-12-17T18:27:11.198 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2021-12-17T18:27:11.210 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-12-17T18:27:11.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.317+0000 7f309359e700 1 Processor -- start 2021-12-17T18:27:11.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.317+0000 7f309359e700 1 -- start start 2021-12-17T18:27:11.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309359e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f30940b21d0 0x7f3094140e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:11.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30940afe00 0x7f30940b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:11.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30941443d0 con 0x7f3094144800 2021-12-17T18:27:11.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309359e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30940b2aa0 con 0x7f30940b21d0 2021-12-17T18:27:11.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309359e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3094060140 con 0x7f30940afe00 2021-12-17T18:27:11.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f3092d9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3094144800 0x7f3094144cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39196/0 (socket says 172.21.15.62:39196) 2021-12-17T18:27:11.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f3092d9d700 1 -- 172.21.15.62:0/3091975826 learned_addr learned my addr 172.21.15.62:0/3091975826 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:11.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309259c700 1 --2- 172.21.15.62:0/3091975826 >> v2:172.21.15.109:3300/0 conn(0x7f30940b21d0 0x7f3094140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:11.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f3091d9b700 1 --2- 172.21.15.62:0/3091975826 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30940afe00 0x7f30940b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:11.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309159a700 1 -- 172.21.15.62:0/3091975826 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839365214 0 0) 0x7f30941443d0 con 0x7f3094144800 2021-12-17T18:27:11.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309159a700 1 -- 172.21.15.62:0/3091975826 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3074003260 con 0x7f3094144800 2021-12-17T18:27:11.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309259c700 1 -- 172.21.15.62:0/3091975826 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30940afe00 msgr2=0x7f30940b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:11.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309259c700 1 --2- 172.21.15.62:0/3091975826 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30940afe00 0x7f30940b25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309259c700 1 -- 172.21.15.62:0/3091975826 >> v1:172.21.15.62:6789/0 conn(0x7f3094144800 legacy=0x7f3094144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:11.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309259c700 1 -- 172.21.15.62:0/3091975826 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30940603e0 con 0x7f30940b21d0 2021-12-17T18:27:11.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309259c700 1 --2- 172.21.15.62:0/3091975826 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30940b21d0 0x7f3094140e00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f307c002f70 tx=0x7f307c006df0).ready entity=mon.1 client_cookie=bf8fd805fb22556b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:11.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309159a700 1 -- 172.21.15.62:0/3091975826 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f307c00d4a0 con 0x7f30940b21d0 2021-12-17T18:27:11.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309159a700 1 -- 172.21.15.62:0/3091975826 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307c000e90 con 0x7f30940b21d0 2021-12-17T18:27:11.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309159a700 1 -- 172.21.15.62:0/3091975826 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f307c00d7f0 con 0x7f30940b21d0 2021-12-17T18:27:11.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309359e700 1 -- 172.21.15.62:0/3091975826 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30940b21d0 msgr2=0x7f3094140e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:11.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309359e700 1 --2- 172.21.15.62:0/3091975826 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30940b21d0 0x7f3094140e00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f307c002f70 tx=0x7f307c006df0).stop 2021-12-17T18:27:11.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309359e700 1 -- 172.21.15.62:0/3091975826 shutdown_connections 2021-12-17T18:27:11.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309359e700 1 --2- 172.21.15.62:0/3091975826 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30940afe00 0x7f30940b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309359e700 1 --2- 172.21.15.62:0/3091975826 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30940b21d0 0x7f3094140e00 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309359e700 1 -- 172.21.15.62:0/3091975826 >> 172.21.15.62:0/3091975826 conn(0x7f3094062430 msgr2=0x7f3094062840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:11.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309359e700 1 -- 172.21.15.62:0/3091975826 shutdown_connections 2021-12-17T18:27:11.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.321+0000 7f309359e700 1 -- 172.21.15.62:0/3091975826 wait complete. 2021-12-17T18:27:11.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f309359e700 1 Processor -- start 2021-12-17T18:27:11.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f309359e700 1 -- start start 2021-12-17T18:27:11.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f309359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30940afe00 0x7f309413f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:11.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f309359e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30940b21d0 0x7f3094140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:11.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f309359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3094144800 0x7f3094153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:11.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f309359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309410ebf0 con 0x7f3094144800 2021-12-17T18:27:11.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f309359e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309410fa30 con 0x7f30940b21d0 2021-12-17T18:27:11.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f309359e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309410fcd0 con 0x7f30940afe00 2021-12-17T18:27:11.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f3092d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3094144800 0x7f3094153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:11.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f3092d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3094144800 0x7f3094153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55622/0 (socket says 172.21.15.62:55622) 2021-12-17T18:27:11.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f3092d9d700 1 -- 172.21.15.62:0/2007353349 learned_addr learned my addr 172.21.15.62:0/2007353349 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:11.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f309259c700 1 --2- 172.21.15.62:0/2007353349 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30940afe00 0x7f309413f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:11.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f3091d9b700 1 --2- 172.21.15.62:0/2007353349 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30940b21d0 0x7f3094140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:11.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f3092d9d700 1 -- 172.21.15.62:0/2007353349 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30940afe00 msgr2=0x7f309413f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:11.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f3092d9d700 1 --2- 172.21.15.62:0/2007353349 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30940afe00 0x7f309413f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f3092d9d700 1 -- 172.21.15.62:0/2007353349 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30940b21d0 msgr2=0x7f3094140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:11.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f3092d9d700 1 --2- 172.21.15.62:0/2007353349 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30940b21d0 0x7f3094140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.325+0000 7f3092d9d700 1 -- 172.21.15.62:0/2007353349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307c00b180 con 0x7f3094144800 2021-12-17T18:27:11.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.329+0000 7f3092d9d700 1 --2- 172.21.15.62:0/2007353349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3094144800 0x7f3094153590 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f308c001490 tx=0x7f308c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:11.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.329+0000 7f308b7fe700 1 -- 172.21.15.62:0/2007353349 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f308c005ba0 con 0x7f3094144800 2021-12-17T18:27:11.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.329+0000 7f308b7fe700 1 -- 172.21.15.62:0/2007353349 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308c005d00 con 0x7f3094144800 2021-12-17T18:27:11.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.329+0000 7f308b7fe700 1 -- 172.21.15.62:0/2007353349 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f308c0072c0 con 0x7f3094144800 2021-12-17T18:27:11.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.329+0000 7f309359e700 1 -- 172.21.15.62:0/2007353349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309410ff70 con 0x7f3094144800 2021-12-17T18:27:11.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.329+0000 7f309359e700 1 -- 172.21.15.62:0/2007353349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309413e9b0 con 0x7f3094144800 2021-12-17T18:27:11.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.329+0000 7f309359e700 1 -- 172.21.15.62:0/2007353349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3094110100 con 0x7f3094144800 2021-12-17T18:27:11.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.333+0000 7f308b7fe700 1 -- 172.21.15.62:0/2007353349 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f308c010070 con 0x7f3094144800 2021-12-17T18:27:11.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.333+0000 7f308b7fe700 1 --2- 172.21.15.62:0/2007353349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3078057a50 0x7f3078059f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:11.343 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.333+0000 7f308b7fe700 1 -- 172.21.15.62:0/2007353349 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f308c06af40 con 0x7f3094144800 2021-12-17T18:27:11.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.333+0000 7f309259c700 1 --2- 172.21.15.62:0/2007353349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3078057a50 0x7f3078059f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:11.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.333+0000 7f309259c700 1 --2- 172.21.15.62:0/2007353349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3078057a50 0x7f3078059f10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f307c01a000 tx=0x7f307c014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:11.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.337+0000 7f308b7fe700 1 -- 172.21.15.62:0/2007353349 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f308c042270 con 0x7f3094144800 2021-12-17T18:27:11.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.457+0000 7f309359e700 1 -- 172.21.15.62:0/2007353349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f30940b1c40 con 0x7f3094144800 2021-12-17T18:27:11.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.465+0000 7f308b7fe700 1 -- 172.21.15.62:0/2007353349 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f308c018070 con 0x7f3094144800 2021-12-17T18:27:11.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.465+0000 7f309359e700 1 -- 172.21.15.62:0/2007353349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3078057a50 msgr2=0x7f3078059f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:11.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.465+0000 7f309359e700 1 --2- 172.21.15.62:0/2007353349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3078057a50 0x7f3078059f10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f307c01a000 tx=0x7f307c014000).stop 2021-12-17T18:27:11.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.465+0000 7f309359e700 1 -- 172.21.15.62:0/2007353349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3094144800 msgr2=0x7f3094153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:11.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.465+0000 7f309359e700 1 --2- 172.21.15.62:0/2007353349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3094144800 0x7f3094153590 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f308c001490 tx=0x7f308c007e00).stop 2021-12-17T18:27:11.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.465+0000 7f309359e700 1 -- 172.21.15.62:0/2007353349 shutdown_connections 2021-12-17T18:27:11.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.465+0000 7f309359e700 1 --2- 172.21.15.62:0/2007353349 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3078057a50 0x7f3078059f10 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.465+0000 7f309359e700 1 --2- 172.21.15.62:0/2007353349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3094144800 0x7f3094153590 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.465+0000 7f309359e700 1 --2- 172.21.15.62:0/2007353349 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f30940b21d0 0x7f3094140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.465+0000 7f309359e700 1 --2- 172.21.15.62:0/2007353349 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f30940afe00 0x7f309413f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.465+0000 7f309359e700 1 -- 172.21.15.62:0/2007353349 >> 172.21.15.62:0/2007353349 conn(0x7f3094062430 msgr2=0x7f3094144cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:11.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.465+0000 7f309359e700 1 -- 172.21.15.62:0/2007353349 shutdown_connections 2021-12-17T18:27:11.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.465+0000 7f309359e700 1 -- 172.21.15.62:0/2007353349 wait complete. 2021-12-17T18:27:11.485 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-12-17T18:27:11.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f5954918700 1 Processor -- start 2021-12-17T18:27:11.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f5954918700 1 -- start start 2021-12-17T18:27:11.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f5954918700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f59500b21f0 0x7f595014aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:11.592 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f5954918700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f59500a7bb0 0x7f5950067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:11.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f5954918700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59500b2ce0 con 0x7f59500b1730 2021-12-17T18:27:11.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f5954918700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5950147870 con 0x7f59500a7bb0 2021-12-17T18:27:11.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f5954918700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59500b2f10 con 0x7f59500b21f0 2021-12-17T18:27:11.593 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f594ed9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f59500a7bb0 0x7f5950067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:11.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f594dd9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f59500b1730 0x7f59500ace90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39208/0 (socket says 172.21.15.62:39208) 2021-12-17T18:27:11.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f594dd9b700 1 -- 172.21.15.62:0/2582376700 learned_addr learned my addr 172.21.15.62:0/2582376700 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:11.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f594e59c700 1 --2- 172.21.15.62:0/2582376700 >> v2:172.21.15.109:3300/0 conn(0x7f59500b21f0 0x7f595014aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:11.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f594ed9d700 1 -- 172.21.15.62:0/2582376700 >> v2:172.21.15.109:3300/0 conn(0x7f59500b21f0 msgr2=0x7f595014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:11.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f594ed9d700 1 --2- 172.21.15.62:0/2582376700 >> v2:172.21.15.109:3300/0 conn(0x7f59500b21f0 0x7f595014aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f594ed9d700 1 -- 172.21.15.62:0/2582376700 >> v1:172.21.15.62:6789/0 conn(0x7f59500b1730 legacy=0x7f59500ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:11.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f594ed9d700 1 -- 172.21.15.62:0/2582376700 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59500aca60 con 0x7f59500a7bb0 2021-12-17T18:27:11.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f594d59a700 1 -- 172.21.15.62:0/2582376700 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714810197 0 0) 0x7f59500b2ce0 con 0x7f59500b1730 2021-12-17T18:27:11.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f594ed9d700 1 --2- 172.21.15.62:0/2582376700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59500a7bb0 0x7f5950067120 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f59500b1c00 tx=0x7f59480091d0).ready entity=mon.0 client_cookie=958c687c14100cc9 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:11.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f594d59a700 1 -- 172.21.15.62:0/2582376700 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5948009ea0 con 0x7f59500a7bb0 2021-12-17T18:27:11.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f594d59a700 1 -- 172.21.15.62:0/2582376700 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594800b860 con 0x7f59500a7bb0 2021-12-17T18:27:11.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f594d59a700 1 -- 172.21.15.62:0/2582376700 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f594800b9d0 con 0x7f59500a7bb0 2021-12-17T18:27:11.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f5954918700 1 -- 172.21.15.62:0/2582376700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59500a7bb0 msgr2=0x7f5950067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:11.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f5954918700 1 --2- 172.21.15.62:0/2582376700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59500a7bb0 0x7f5950067120 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f59500b1c00 tx=0x7f59480091d0).stop 2021-12-17T18:27:11.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f5954918700 1 -- 172.21.15.62:0/2582376700 shutdown_connections 2021-12-17T18:27:11.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f5954918700 1 --2- 172.21.15.62:0/2582376700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59500a7bb0 0x7f5950067120 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f5954918700 1 --2- 172.21.15.62:0/2582376700 >> v2:172.21.15.109:3300/0 conn(0x7f59500b21f0 0x7f595014aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f5954918700 1 -- 172.21.15.62:0/2582376700 >> 172.21.15.62:0/2582376700 conn(0x7f595005f730 msgr2=0x7f595005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:11.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f5954918700 1 -- 172.21.15.62:0/2582376700 shutdown_connections 2021-12-17T18:27:11.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.585+0000 7f5954918700 1 -- 172.21.15.62:0/2582376700 wait complete. 2021-12-17T18:27:11.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f5954918700 1 Processor -- start 2021-12-17T18:27:11.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f5954918700 1 -- start start 2021-12-17T18:27:11.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f5954918700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f59500a7bb0 0x7f59500aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:11.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f5954918700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f59500b1730 0x7f595015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:11.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f5954918700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59500b21f0 0x7f595014d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:11.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f5954918700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595015a230 con 0x7f59500b21f0 2021-12-17T18:27:11.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f5954918700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595015a460 con 0x7f59500a7bb0 2021-12-17T18:27:11.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f5954918700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595015b090 con 0x7f59500b1730 2021-12-17T18:27:11.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f594ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59500b21f0 0x7f595014d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:11.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f594e59c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f59500a7bb0 0x7f59500aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:11.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f594ed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59500b21f0 0x7f595014d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55638/0 (socket says 172.21.15.62:55638) 2021-12-17T18:27:11.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f594ed9d700 1 -- 172.21.15.62:0/2056887262 learned_addr learned my addr 172.21.15.62:0/2056887262 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:11.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f594dd9b700 1 --2- 172.21.15.62:0/2056887262 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f59500b1730 0x7f595015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:11.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f594ed9d700 1 -- 172.21.15.62:0/2056887262 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f59500b1730 msgr2=0x7f595015aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:11.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f594ed9d700 1 --2- 172.21.15.62:0/2056887262 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f59500b1730 0x7f595015aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f594ed9d700 1 -- 172.21.15.62:0/2056887262 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f59500a7bb0 msgr2=0x7f59500aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:11.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f594ed9d700 1 --2- 172.21.15.62:0/2056887262 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f59500a7bb0 0x7f59500aad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:11.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f594ed9d700 1 -- 172.21.15.62:0/2056887262 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5948009470 con 0x7f59500b21f0 2021-12-17T18:27:11.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f594ed9d700 1 --2- 172.21.15.62:0/2056887262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59500b21f0 0x7f595014d670 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f59500b1c00 tx=0x7f5948016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:11.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f593f7fe700 1 -- 172.21.15.62:0/2056887262 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59480032f0 con 0x7f59500b21f0 2021-12-17T18:27:11.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f593f7fe700 1 -- 172.21.15.62:0/2056887262 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594800b9d0 con 0x7f59500b21f0 2021-12-17T18:27:11.606 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f5954918700 1 -- 172.21.15.62:0/2056887262 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59500ac570 con 0x7f59500b21f0 2021-12-17T18:27:11.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.589+0000 7f593f7fe700 1 -- 172.21.15.62:0/2056887262 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f594801f5e0 con 0x7f59500b21f0 2021-12-17T18:27:11.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.593+0000 7f5954918700 1 -- 172.21.15.62:0/2056887262 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5950063780 con 0x7f59500b21f0 2021-12-17T18:27:11.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.593+0000 7f5954918700 1 -- 172.21.15.62:0/2056887262 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59500ad5a0 con 0x7f59500b21f0 2021-12-17T18:27:11.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.593+0000 7f593f7fe700 1 -- 172.21.15.62:0/2056887262 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5948026030 con 0x7f59500b21f0 2021-12-17T18:27:11.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.593+0000 7f593f7fe700 1 --2- 172.21.15.62:0/2056887262 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f592c0536a0 0x7f592c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:11.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.593+0000 7f593f7fe700 1 -- 172.21.15.62:0/2056887262 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f594806c230 con 0x7f59500b21f0 2021-12-17T18:27:11.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.593+0000 7f594e59c700 1 --2- 172.21.15.62:0/2056887262 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f592c0536a0 0x7f592c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:11.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.597+0000 7f594e59c700 1 --2- 172.21.15.62:0/2056887262 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f592c0536a0 0x7f592c055b60 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f594400c000 tx=0x7f5944008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:11.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.597+0000 7f593f7fe700 1 -- 172.21.15.62:0/2056887262 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5948043670 con 0x7f59500b21f0 2021-12-17T18:27:11.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:11.761+0000 7f5954918700 1 -- 172.21.15.62:0/2056887262 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7f59500573d0 con 0x7f59500b21f0 2021-12-17T18:27:12.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.189+0000 7f593f7fe700 1 -- 172.21.15.62:0/2056887262 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v401) v1 ==== 122+0+0 (secure 0 0 0) 0x7f59480150c0 con 0x7f59500b21f0 2021-12-17T18:27:12.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.193+0000 7f5954918700 1 -- 172.21.15.62:0/2056887262 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f592c0536a0 msgr2=0x7f592c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:12.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.193+0000 7f5954918700 1 --2- 172.21.15.62:0/2056887262 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f592c0536a0 0x7f592c055b60 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f594400c000 tx=0x7f5944008040).stop 2021-12-17T18:27:12.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.193+0000 7f5954918700 1 -- 172.21.15.62:0/2056887262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59500b21f0 msgr2=0x7f595014d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:12.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.193+0000 7f5954918700 1 --2- 172.21.15.62:0/2056887262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59500b21f0 0x7f595014d670 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f59500b1c00 tx=0x7f5948016000).stop 2021-12-17T18:27:12.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.193+0000 7f5954918700 1 -- 172.21.15.62:0/2056887262 shutdown_connections 2021-12-17T18:27:12.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.193+0000 7f5954918700 1 --2- 172.21.15.62:0/2056887262 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f592c0536a0 0x7f592c055b60 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:12.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.193+0000 7f5954918700 1 --2- 172.21.15.62:0/2056887262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59500b21f0 0x7f595014d670 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:12.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.193+0000 7f5954918700 1 --2- 172.21.15.62:0/2056887262 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f59500b1730 0x7f595015aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:12.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.193+0000 7f5954918700 1 --2- 172.21.15.62:0/2056887262 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f59500a7bb0 0x7f59500aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:12.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.193+0000 7f5954918700 1 -- 172.21.15.62:0/2056887262 >> 172.21.15.62:0/2056887262 conn(0x7f595005f730 msgr2=0x7f59500adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:12.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.193+0000 7f5954918700 1 -- 172.21.15.62:0/2056887262 shutdown_connections 2021-12-17T18:27:12.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.197+0000 7f5954918700 1 -- 172.21.15.62:0/2056887262 wait complete. 2021-12-17T18:27:12.214 INFO:tasks.cephfs_test_runner:test_fs_new (tasks.cephfs.test_misc.TestMisc) ... ok 2021-12-17T18:27:12.215 INFO:tasks.cephfs_test_runner:Starting test: test_getattr_caps (tasks.cephfs.test_misc.TestMisc) 2021-12-17T18:27:12.215 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-12-17T18:27:12.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f3918912700 1 Processor -- start 2021-12-17T18:27:12.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f3918912700 1 -- start start 2021-12-17T18:27:12.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f3918912700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f39140a8e10 0x7f3914147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:12.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f3918912700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39140a71e0 0x7f39140a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:12.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f3918912700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39140b6270 con 0x7f3914141480 2021-12-17T18:27:12.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f3918912700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3914147610 con 0x7f39140a8e10 2021-12-17T18:27:12.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f3918912700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39141478b0 con 0x7f39140a71e0 2021-12-17T18:27:12.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f391259c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f39140a8e10 0x7f3914147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:12.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f391359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39140a71e0 0x7f39140a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:12.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f3912d9d700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f3914141480 0x7f39140b5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:55542/0 (socket says 172.21.15.62:55542) 2021-12-17T18:27:12.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f3912d9d700 1 -- 172.21.15.62:0/820208044 learned_addr learned my addr 172.21.15.62:0/820208044 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:12.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f391259c700 1 -- 172.21.15.62:0/820208044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39140a71e0 msgr2=0x7f39140a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:12.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f391259c700 1 --2- 172.21.15.62:0/820208044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39140a71e0 0x7f39140a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:12.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f391259c700 1 -- 172.21.15.62:0/820208044 >> v1:172.21.15.109:6789/0 conn(0x7f3914141480 legacy=0x7f39140b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:12.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f391259c700 1 -- 172.21.15.62:0/820208044 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3914147b50 con 0x7f39140a8e10 2021-12-17T18:27:12.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f391259c700 1 --2- 172.21.15.62:0/820208044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f39140a8e10 0x7f3914147ff0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f39040032f0 tx=0x7f39040091d0).ready entity=mon.1 client_cookie=9c8a80381faa733 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:12.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f3911d9b700 1 -- 172.21.15.62:0/820208044 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f390400b6c0 con 0x7f39140a8e10 2021-12-17T18:27:12.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f3911d9b700 1 -- 172.21.15.62:0/820208044 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390400b820 con 0x7f39140a8e10 2021-12-17T18:27:12.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f3911d9b700 1 -- 172.21.15.62:0/820208044 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f390400b990 con 0x7f39140a8e10 2021-12-17T18:27:12.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f3918912700 1 -- 172.21.15.62:0/820208044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f39140a8e10 msgr2=0x7f3914147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:12.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.317+0000 7f3918912700 1 --2- 172.21.15.62:0/820208044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f39140a8e10 0x7f3914147ff0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f39040032f0 tx=0x7f39040091d0).stop 2021-12-17T18:27:12.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3918912700 1 -- 172.21.15.62:0/820208044 shutdown_connections 2021-12-17T18:27:12.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3918912700 1 --2- 172.21.15.62:0/820208044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39140a71e0 0x7f39140a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:12.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3918912700 1 --2- 172.21.15.62:0/820208044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f39140a8e10 0x7f3914147ff0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:12.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3918912700 1 -- 172.21.15.62:0/820208044 >> 172.21.15.62:0/820208044 conn(0x7f391405d220 msgr2=0x7f39140b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:12.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3918912700 1 -- 172.21.15.62:0/820208044 shutdown_connections 2021-12-17T18:27:12.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3918912700 1 -- 172.21.15.62:0/820208044 wait complete. 2021-12-17T18:27:12.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3918912700 1 Processor -- start 2021-12-17T18:27:12.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3918912700 1 -- start start 2021-12-17T18:27:12.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3918912700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f39140a71e0 0x7f39140ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:12.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3918912700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39140a8e10 0x7f39140ab030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:12.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3918912700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3914141480 0x7f391414b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:12.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3918912700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3914144b20 con 0x7f3914141480 2021-12-17T18:27:12.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3918912700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391414ac20 con 0x7f39140a71e0 2021-12-17T18:27:12.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3918912700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3914144d50 con 0x7f39140a8e10 2021-12-17T18:27:12.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f391359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3914141480 0x7f391414b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:12.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f391359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3914141480 0x7f391414b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55652/0 (socket says 172.21.15.62:55652) 2021-12-17T18:27:12.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3912d9d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f39140a71e0 0x7f39140ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:12.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f391259c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39140a8e10 0x7f39140ab030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:12.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f391359e700 1 -- 172.21.15.62:0/3860155055 learned_addr learned my addr 172.21.15.62:0/3860155055 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:12.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f391259c700 1 -- 172.21.15.62:0/3860155055 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f39140a71e0 msgr2=0x7f39140ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:12.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f391259c700 1 --2- 172.21.15.62:0/3860155055 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f39140a71e0 0x7f39140ae600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:12.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f391259c700 1 -- 172.21.15.62:0/3860155055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3914141480 msgr2=0x7f391414b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:12.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f391259c700 1 --2- 172.21.15.62:0/3860155055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3914141480 0x7f391414b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:12.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f391259c700 1 -- 172.21.15.62:0/3860155055 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3904009470 con 0x7f39140a8e10 2021-12-17T18:27:12.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f391359e700 1 --2- 172.21.15.62:0/3860155055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3914141480 0x7f391414b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:12.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3912d9d700 1 --2- 172.21.15.62:0/3860155055 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f39140a71e0 0x7f39140ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:12.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f391259c700 1 --2- 172.21.15.62:0/3860155055 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39140a8e10 0x7f39140ab030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f391414a6d0 tx=0x7f3904016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:12.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f390bfff700 1 -- 172.21.15.62:0/3860155055 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3904011d30 con 0x7f39140a8e10 2021-12-17T18:27:12.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3918912700 1 -- 172.21.15.62:0/3860155055 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3914149ed0 con 0x7f39140a8e10 2021-12-17T18:27:12.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f390bfff700 1 -- 172.21.15.62:0/3860155055 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3904011e90 con 0x7f39140a8e10 2021-12-17T18:27:12.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f390bfff700 1 -- 172.21.15.62:0/3860155055 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3904021630 con 0x7f39140a8e10 2021-12-17T18:27:12.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.321+0000 7f3918912700 1 -- 172.21.15.62:0/3860155055 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39140ab6c0 con 0x7f39140a8e10 2021-12-17T18:27:12.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.325+0000 7f3918912700 1 -- 172.21.15.62:0/3860155055 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391414ad90 con 0x7f39140a8e10 2021-12-17T18:27:12.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.325+0000 7f390bfff700 1 -- 172.21.15.62:0/3860155055 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3904028070 con 0x7f39140a8e10 2021-12-17T18:27:12.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.325+0000 7f390bfff700 1 --2- 172.21.15.62:0/3860155055 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38f80536a0 0x7f38f8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:12.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.325+0000 7f390bfff700 1 -- 172.21.15.62:0/3860155055 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f390406c730 con 0x7f39140a8e10 2021-12-17T18:27:12.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.325+0000 7f3912d9d700 1 --2- 172.21.15.62:0/3860155055 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38f80536a0 0x7f38f8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:12.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.325+0000 7f3912d9d700 1 --2- 172.21.15.62:0/3860155055 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38f80536a0 0x7f38f8055b60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f38fc00d000 tx=0x7f38fc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:12.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.333+0000 7f390bfff700 1 -- 172.21.15.62:0/3860155055 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3904043b70 con 0x7f39140a8e10 2021-12-17T18:27:12.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:12.501+0000 7f3918912700 1 -- 172.21.15.62:0/3860155055 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f39140b1b90 con 0x7f39140a8e10 2021-12-17T18:27:13.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.193+0000 7f390bfff700 1 -- 172.21.15.62:0/3860155055 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v402) v1 ==== 131+0+0 (secure 0 0 0) 0x7f3904015030 con 0x7f39140a8e10 2021-12-17T18:27:13.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.197+0000 7f3918912700 1 -- 172.21.15.62:0/3860155055 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38f80536a0 msgr2=0x7f38f8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:13.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.197+0000 7f3918912700 1 --2- 172.21.15.62:0/3860155055 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38f80536a0 0x7f38f8055b60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f38fc00d000 tx=0x7f38fc009040).stop 2021-12-17T18:27:13.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.197+0000 7f3918912700 1 -- 172.21.15.62:0/3860155055 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39140a8e10 msgr2=0x7f39140ab030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:13.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.197+0000 7f3918912700 1 --2- 172.21.15.62:0/3860155055 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39140a8e10 0x7f39140ab030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f391414a6d0 tx=0x7f3904016000).stop 2021-12-17T18:27:13.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.197+0000 7f3918912700 1 -- 172.21.15.62:0/3860155055 shutdown_connections 2021-12-17T18:27:13.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.197+0000 7f3918912700 1 --2- 172.21.15.62:0/3860155055 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38f80536a0 0x7f38f8055b60 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.197+0000 7f3918912700 1 --2- 172.21.15.62:0/3860155055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3914141480 0x7f391414b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.197+0000 7f3918912700 1 --2- 172.21.15.62:0/3860155055 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39140a8e10 0x7f39140ab030 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.197+0000 7f3918912700 1 --2- 172.21.15.62:0/3860155055 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f39140a71e0 0x7f39140ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.197+0000 7f3918912700 1 -- 172.21.15.62:0/3860155055 >> 172.21.15.62:0/3860155055 conn(0x7f391405d220 msgr2=0x7f39141450d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:13.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.197+0000 7f3918912700 1 -- 172.21.15.62:0/3860155055 shutdown_connections 2021-12-17T18:27:13.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.197+0000 7f3918912700 1 -- 172.21.15.62:0/3860155055 wait complete. 2021-12-17T18:27:13.218 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-12-17T18:27:13.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.329+0000 7fa8e759e700 1 Processor -- start 2021-12-17T18:27:13.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.329+0000 7fa8e759e700 1 -- start start 2021-12-17T18:27:13.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.329+0000 7fa8e759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa8e805ca90 0x7fa8e814abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:13.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.329+0000 7fa8e759e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa8e80b06b0 0x7fa8e80ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:13.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.329+0000 7fa8e759e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e80b2860 con 0x7fa8e80604d0 2021-12-17T18:27:13.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.329+0000 7fa8e759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e81475c0 con 0x7fa8e805ca90 2021-12-17T18:27:13.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.329+0000 7fa8e759e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e805fa40 con 0x7fa8e80b06b0 2021-12-17T18:27:13.338 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.329+0000 7fa8e659c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa8e805ca90 0x7fa8e814abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:13.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e5d9b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa8e80b06b0 0x7fa8e80ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:13.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e659c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa8e805ca90 0x7fa8e814abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55658/0 (socket says 172.21.15.62:55658) 2021-12-17T18:27:13.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e659c700 1 -- 172.21.15.62:0/3161634331 learned_addr learned my addr 172.21.15.62:0/3161634331 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:13.339 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e659c700 1 -- 172.21.15.62:0/3161634331 >> v2:172.21.15.109:3300/0 conn(0x7fa8e80b06b0 msgr2=0x7fa8e80ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:13.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e659c700 1 --2- 172.21.15.62:0/3161634331 >> v2:172.21.15.109:3300/0 conn(0x7fa8e80b06b0 0x7fa8e80ace40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e659c700 1 -- 172.21.15.62:0/3161634331 >> v1:172.21.15.109:6789/0 conn(0x7fa8e80604d0 legacy=0x7fa8e80ab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:13.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e659c700 1 -- 172.21.15.62:0/3161634331 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e80ac740 con 0x7fa8e805ca90 2021-12-17T18:27:13.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e659c700 1 --2- 172.21.15.62:0/3161634331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e805ca90 0x7fa8e814abf0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7fa8dc002f70 tx=0x7fa8dc006eb0).ready entity=mon.0 client_cookie=9b3e495abf8d3017 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:13.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e559a700 1 -- 172.21.15.62:0/3161634331 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8dc00d5c0 con 0x7fa8e805ca90 2021-12-17T18:27:13.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e559a700 1 -- 172.21.15.62:0/3161634331 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8dc000e90 con 0x7fa8e805ca90 2021-12-17T18:27:13.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e559a700 1 -- 172.21.15.62:0/3161634331 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8dc00d950 con 0x7fa8e805ca90 2021-12-17T18:27:13.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e759e700 1 -- 172.21.15.62:0/3161634331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e805ca90 msgr2=0x7fa8e814abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:13.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e759e700 1 --2- 172.21.15.62:0/3161634331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e805ca90 0x7fa8e814abf0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7fa8dc002f70 tx=0x7fa8dc006eb0).stop 2021-12-17T18:27:13.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e759e700 1 -- 172.21.15.62:0/3161634331 shutdown_connections 2021-12-17T18:27:13.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e759e700 1 --2- 172.21.15.62:0/3161634331 >> v2:172.21.15.109:3300/0 conn(0x7fa8e80b06b0 0x7fa8e80ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e759e700 1 --2- 172.21.15.62:0/3161634331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e805ca90 0x7fa8e814abf0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e759e700 1 -- 172.21.15.62:0/3161634331 >> 172.21.15.62:0/3161634331 conn(0x7fa8e805c070 msgr2=0x7fa8e8062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:13.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e759e700 1 -- 172.21.15.62:0/3161634331 shutdown_connections 2021-12-17T18:27:13.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e759e700 1 -- 172.21.15.62:0/3161634331 wait complete. 2021-12-17T18:27:13.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e759e700 1 Processor -- start 2021-12-17T18:27:13.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e759e700 1 -- start start 2021-12-17T18:27:13.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa8e805ca90 0x7fa8e814b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:13.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.333+0000 7fa8e759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e80604d0 0x7fa8e8149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:13.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8e80b06b0 0x7fa8e814a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:13.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e8140340 con 0x7fa8e80604d0 2021-12-17T18:27:13.348 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e8149040 con 0x7fa8e80b06b0 2021-12-17T18:27:13.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e814de80 con 0x7fa8e805ca90 2021-12-17T18:27:13.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e5d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e80604d0 0x7fa8e8149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:13.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e5d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e80604d0 0x7fa8e8149fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55662/0 (socket says 172.21.15.62:55662) 2021-12-17T18:27:13.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e5d9b700 1 -- 172.21.15.62:0/2300636531 learned_addr learned my addr 172.21.15.62:0/2300636531 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:13.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e6d9d700 1 --2- 172.21.15.62:0/2300636531 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8e80b06b0 0x7fa8e814a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:13.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e659c700 1 --2- 172.21.15.62:0/2300636531 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa8e805ca90 0x7fa8e814b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:13.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e5d9b700 1 -- 172.21.15.62:0/2300636531 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa8e805ca90 msgr2=0x7fa8e814b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:13.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e5d9b700 1 --2- 172.21.15.62:0/2300636531 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa8e805ca90 0x7fa8e814b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e5d9b700 1 -- 172.21.15.62:0/2300636531 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8e80b06b0 msgr2=0x7fa8e814a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:13.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e5d9b700 1 --2- 172.21.15.62:0/2300636531 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8e80b06b0 0x7fa8e814a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e5d9b700 1 -- 172.21.15.62:0/2300636531 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc00b1e0 con 0x7fa8e80604d0 2021-12-17T18:27:13.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e5d9b700 1 --2- 172.21.15.62:0/2300636531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e80604d0 0x7fa8e8149fd0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7fa8d800c000 tx=0x7fa8d80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:13.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8d77fe700 1 -- 172.21.15.62:0/2300636531 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8d8012600 con 0x7fa8e80604d0 2021-12-17T18:27:13.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8d77fe700 1 -- 172.21.15.62:0/2300636531 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d8012760 con 0x7fa8e80604d0 2021-12-17T18:27:13.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e759e700 1 -- 172.21.15.62:0/2300636531 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e814e120 con 0x7fa8e80604d0 2021-12-17T18:27:13.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8d77fe700 1 -- 172.21.15.62:0/2300636531 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8d8012ac0 con 0x7fa8e80604d0 2021-12-17T18:27:13.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e759e700 1 -- 172.21.15.62:0/2300636531 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e814a9b0 con 0x7fa8e80604d0 2021-12-17T18:27:13.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8e759e700 1 -- 172.21.15.62:0/2300636531 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e80b2a90 con 0x7fa8e80604d0 2021-12-17T18:27:13.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8d77fe700 1 -- 172.21.15.62:0/2300636531 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa8d8022070 con 0x7fa8e80604d0 2021-12-17T18:27:13.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8d77fe700 1 --2- 172.21.15.62:0/2300636531 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8c4053610 0x7fa8c4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:13.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.337+0000 7fa8d77fe700 1 -- 172.21.15.62:0/2300636531 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fa8d806bce0 con 0x7fa8e80604d0 2021-12-17T18:27:13.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.341+0000 7fa8e659c700 1 --2- 172.21.15.62:0/2300636531 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8c4053610 0x7fa8c4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:13.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.341+0000 7fa8e659c700 1 --2- 172.21.15.62:0/2300636531 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8c4053610 0x7fa8c4055ad0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fa8dc01c000 tx=0x7fa8dc015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:13.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.345+0000 7fa8d77fe700 1 -- 172.21.15.62:0/2300636531 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa8d8043080 con 0x7fa8e80604d0 2021-12-17T18:27:13.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.469+0000 7fa8e759e700 1 -- 172.21.15.62:0/2300636531 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa8e80573d0 con 0x7fa8e80604d0 2021-12-17T18:27:13.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.481+0000 7fa8d77fe700 1 -- 172.21.15.62:0/2300636531 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa8d80466a0 con 0x7fa8e80604d0 2021-12-17T18:27:13.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.481+0000 7fa8e759e700 1 -- 172.21.15.62:0/2300636531 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8c4053610 msgr2=0x7fa8c4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:13.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.481+0000 7fa8e759e700 1 --2- 172.21.15.62:0/2300636531 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8c4053610 0x7fa8c4055ad0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fa8dc01c000 tx=0x7fa8dc015000).stop 2021-12-17T18:27:13.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.481+0000 7fa8e759e700 1 -- 172.21.15.62:0/2300636531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e80604d0 msgr2=0x7fa8e8149fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:13.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.481+0000 7fa8e759e700 1 --2- 172.21.15.62:0/2300636531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e80604d0 0x7fa8e8149fd0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7fa8d800c000 tx=0x7fa8d80091d0).stop 2021-12-17T18:27:13.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.481+0000 7fa8e759e700 1 -- 172.21.15.62:0/2300636531 shutdown_connections 2021-12-17T18:27:13.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.481+0000 7fa8e759e700 1 --2- 172.21.15.62:0/2300636531 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa8c4053610 0x7fa8c4055ad0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.481+0000 7fa8e759e700 1 --2- 172.21.15.62:0/2300636531 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa8e80b06b0 0x7fa8e814a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.481+0000 7fa8e759e700 1 --2- 172.21.15.62:0/2300636531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e80604d0 0x7fa8e8149fd0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.481+0000 7fa8e759e700 1 --2- 172.21.15.62:0/2300636531 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa8e805ca90 0x7fa8e814b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.481+0000 7fa8e759e700 1 -- 172.21.15.62:0/2300636531 >> 172.21.15.62:0/2300636531 conn(0x7fa8e805c070 msgr2=0x7fa8e80ab5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:13.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.481+0000 7fa8e759e700 1 -- 172.21.15.62:0/2300636531 shutdown_connections 2021-12-17T18:27:13.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.481+0000 7fa8e759e700 1 -- 172.21.15.62:0/2300636531 wait complete. 2021-12-17T18:27:13.499 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:27:13.499 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:13.519 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:13.540 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:13.561 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:13.583 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:13.604 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:27:13.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:13.604 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:13.605 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:13.612 INFO:teuthology.orchestra.run.smithi125.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-12-17T18:27:13.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:27:13.613 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-12-17T18:27:13.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:13.614 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:13.615 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:13.631 INFO:teuthology.orchestra.run.smithi158.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:27:13.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:27:13.632 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-12-17T18:27:13.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:13.633 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:13.634 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:27:13.642 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:27:13.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:27:13.643 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:27:13.644 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:27:13.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce18b5d700 1 Processor -- start 2021-12-17T18:27:13.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce18b5d700 1 -- start start 2021-12-17T18:27:13.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce18b5d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fce140b21f0 0x7fce1414aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:13.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce18b5d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fce140b1730 0x7fce140ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:13.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce18b5d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce140b2ce0 con 0x7fce140a7bb0 2021-12-17T18:27:13.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce18b5d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce14147870 con 0x7fce140b1730 2021-12-17T18:27:13.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce18b5d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce140b2f10 con 0x7fce140b21f0 2021-12-17T18:27:13.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce11d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fce140b1730 0x7fce140ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:13.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce11d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fce140b1730 0x7fce140ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55670/0 (socket says 172.21.15.62:55670) 2021-12-17T18:27:13.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce11d9b700 1 -- 172.21.15.62:0/1438531246 learned_addr learned my addr 172.21.15.62:0/1438531246 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:13.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce1259c700 1 --2- 172.21.15.62:0/1438531246 >> v2:172.21.15.109:3300/0 conn(0x7fce140b21f0 0x7fce1414aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:13.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce11d9b700 1 -- 172.21.15.62:0/1438531246 >> v2:172.21.15.109:3300/0 conn(0x7fce140b21f0 msgr2=0x7fce1414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:13.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce11d9b700 1 --2- 172.21.15.62:0/1438531246 >> v2:172.21.15.109:3300/0 conn(0x7fce140b21f0 0x7fce1414aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce11d9b700 1 -- 172.21.15.62:0/1438531246 >> v1:172.21.15.62:6789/0 conn(0x7fce140a7bb0 legacy=0x7fce14067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:13.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce11d9b700 1 -- 172.21.15.62:0/1438531246 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce140aca60 con 0x7fce140b1730 2021-12-17T18:27:13.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce11d9b700 1 --2- 172.21.15.62:0/1438531246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce140b1730 0x7fce140ace90 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7fce140b1c00 tx=0x7fcdfc006eb0).ready entity=mon.0 client_cookie=6dbb3be407c6b4b5 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:13.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce1159a700 1 -- 172.21.15.62:0/1438531246 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdfc00d610 con 0x7fce140b1730 2021-12-17T18:27:13.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce1159a700 1 -- 172.21.15.62:0/1438531246 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc000e90 con 0x7fce140b1730 2021-12-17T18:27:13.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce1159a700 1 -- 172.21.15.62:0/1438531246 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdfc00d960 con 0x7fce140b1730 2021-12-17T18:27:13.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce18b5d700 1 -- 172.21.15.62:0/1438531246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce140b1730 msgr2=0x7fce140ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:13.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce18b5d700 1 --2- 172.21.15.62:0/1438531246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce140b1730 0x7fce140ace90 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7fce140b1c00 tx=0x7fcdfc006eb0).stop 2021-12-17T18:27:13.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce18b5d700 1 -- 172.21.15.62:0/1438531246 shutdown_connections 2021-12-17T18:27:13.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce18b5d700 1 --2- 172.21.15.62:0/1438531246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce140b1730 0x7fce140ace90 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce18b5d700 1 --2- 172.21.15.62:0/1438531246 >> v2:172.21.15.109:3300/0 conn(0x7fce140b21f0 0x7fce1414aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce18b5d700 1 -- 172.21.15.62:0/1438531246 >> 172.21.15.62:0/1438531246 conn(0x7fce1405f730 msgr2=0x7fce1405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:13.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce18b5d700 1 -- 172.21.15.62:0/1438531246 shutdown_connections 2021-12-17T18:27:13.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.753+0000 7fce18b5d700 1 -- 172.21.15.62:0/1438531246 wait complete. 2021-12-17T18:27:13.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce18b5d700 1 Processor -- start 2021-12-17T18:27:13.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce18b5d700 1 -- start start 2021-12-17T18:27:13.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce18b5d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fce140a7bb0 0x7fce140b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:13.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce18b5d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce140b1730 0x7fce14066b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:13.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce18b5d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fce140b21f0 0x7fce14157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:13.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce18b5d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce140abed0 con 0x7fce140b1730 2021-12-17T18:27:13.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce18b5d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce140ac170 con 0x7fce140a7bb0 2021-12-17T18:27:13.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce18b5d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce140ac410 con 0x7fce140b21f0 2021-12-17T18:27:13.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce11d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce140b1730 0x7fce14066b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:13.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce11d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce140b1730 0x7fce14066b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55678/0 (socket says 172.21.15.62:55678) 2021-12-17T18:27:13.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce11d9b700 1 -- 172.21.15.62:0/92294753 learned_addr learned my addr 172.21.15.62:0/92294753 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:13.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce1259c700 1 --2- 172.21.15.62:0/92294753 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fce140a7bb0 0x7fce140b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:13.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce12d9d700 1 --2- 172.21.15.62:0/92294753 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fce140b21f0 0x7fce14157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:13.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce11d9b700 1 -- 172.21.15.62:0/92294753 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fce140b21f0 msgr2=0x7fce14157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:13.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce11d9b700 1 --2- 172.21.15.62:0/92294753 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fce140b21f0 0x7fce14157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce11d9b700 1 -- 172.21.15.62:0/92294753 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fce140a7bb0 msgr2=0x7fce140b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:13.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce11d9b700 1 --2- 172.21.15.62:0/92294753 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fce140a7bb0 0x7fce140b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:13.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce11d9b700 1 -- 172.21.15.62:0/92294753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc00b1e0 con 0x7fce140b1730 2021-12-17T18:27:13.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce1259c700 1 --2- 172.21.15.62:0/92294753 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fce140a7bb0 0x7fce140b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:13.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce12d9d700 1 --2- 172.21.15.62:0/92294753 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fce140b21f0 0x7fce14157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:27:13.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce11d9b700 1 --2- 172.21.15.62:0/92294753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce140b1730 0x7fce14066b30 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7fce140b1c00 tx=0x7fcdfc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:13.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce0b7fe700 1 -- 172.21.15.62:0/92294753 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdfc011790 con 0x7fce140b1730 2021-12-17T18:27:13.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce0b7fe700 1 -- 172.21.15.62:0/92294753 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc0118f0 con 0x7fce140b1730 2021-12-17T18:27:13.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce18b5d700 1 -- 172.21.15.62:0/92294753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce14063060 con 0x7fce140b1730 2021-12-17T18:27:13.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce0b7fe700 1 -- 172.21.15.62:0/92294753 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdfc011c50 con 0x7fce140b1730 2021-12-17T18:27:13.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.757+0000 7fce18b5d700 1 -- 172.21.15.62:0/92294753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce14156f70 con 0x7fce140b1730 2021-12-17T18:27:13.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.761+0000 7fce18b5d700 1 -- 172.21.15.62:0/92294753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce1415a350 con 0x7fce140b1730 2021-12-17T18:27:13.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.761+0000 7fce0b7fe700 1 -- 172.21.15.62:0/92294753 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcdfc025030 con 0x7fce140b1730 2021-12-17T18:27:13.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.761+0000 7fce0b7fe700 1 --2- 172.21.15.62:0/92294753 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcdf80536a0 0x7fcdf8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:13.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.761+0000 7fce0b7fe700 1 -- 172.21.15.62:0/92294753 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fcdfc06ca00 con 0x7fce140b1730 2021-12-17T18:27:13.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.761+0000 7fce1259c700 1 --2- 172.21.15.62:0/92294753 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcdf80536a0 0x7fcdf8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:13.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.761+0000 7fce1259c700 1 --2- 172.21.15.62:0/92294753 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcdf80536a0 0x7fcdf8055b60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fce0400c000 tx=0x7fce04008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:13.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.769+0000 7fce0b7fe700 1 -- 172.21.15.62:0/92294753 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcdfc043d30 con 0x7fce140b1730 2021-12-17T18:27:13.901 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.897+0000 7fce18b5d700 1 -- 172.21.15.62:0/92294753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fce140631f0 con 0x7fce140b1730 2021-12-17T18:27:13.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.897+0000 7fce0b7fe700 1 -- 172.21.15.62:0/92294753 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v126) v1 ==== 81+0+28885 (secure 0 0 0) 0x7fcdfc023020 con 0x7fce140b1730 2021-12-17T18:27:13.913 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:13.913 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:27:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 126, 2021-12-17T18:27:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:27:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:27:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:27:11.179704+0000", 2021-12-17T18:27:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:27:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:27:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:27:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:27:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:27:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:27:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:27:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:27:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:27:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:27:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:27:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:27:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:27:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:27:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 24, 2021-12-17T18:27:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:27:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:27:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:27:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:27:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:27:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:27:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:27:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:27:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:27:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:27:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:27:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:27:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:27:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:27:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:27:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:27:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:27:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:27:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:27:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:27:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:27:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:27:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:27:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:27:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:27:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:27:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:27:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:27:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:27:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:27:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:27:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:27:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:27:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:27:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:27:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:27:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:27:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:27:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:27:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:27:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:27:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:27:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:27:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:27:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:27:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:27:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:27:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:27:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:27:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:27:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:27:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:27:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:27:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:27:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:27:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:27:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:27:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:27:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:27:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:27:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:27:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:27:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:27:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:27:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:27:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:27:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:27:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:27:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:27:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:27:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:27:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:27:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:27:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:27:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:27:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:27:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:27:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:27:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:27:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:27:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:27:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:27:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:27:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:27:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:27:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:27:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:27:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:27:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:27:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:27:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:27:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:27:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:27:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:27:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:27:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:27:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:27:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:27:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:27:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:27:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:27:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:27:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:27:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:27:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:27:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:27:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:27:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:27:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:27:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:27:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:27:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:27:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:27:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:27:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:27:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:27:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:27:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:27:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:27:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:27:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:27:13.950 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:27:13.950 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:27:13.950 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:27:13.950 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:27:13.951 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:27:13.951 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:27:13.951 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:27:13.951 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:27:13.951 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:27:13.952 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:27:13.952 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:27:13.952 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:27:13.952 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:27:13.952 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:13.953 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:13.953 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:13.953 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:27:13.953 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.954 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:27:13.954 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:27:13.954 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:13.954 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:13.955 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:13.955 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:13.955 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:13.955 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:13.955 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:13.956 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 121, 2021-12-17T18:27:13.956 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:13.956 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:13.956 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:13.957 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:13.957 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.957 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:13.957 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:27:13.957 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:13.958 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.958 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.958 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:13.958 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:27:13.958 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:13.959 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:13.959 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:13.959 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.959 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:13.959 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:13.960 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.960 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:13.960 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:27:13.960 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:13.961 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.961 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.961 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:13.961 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:27:13.961 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:13.962 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:13.962 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:13.962 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.962 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:13.963 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:13.963 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.963 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:13.963 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:27:13.964 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:13.964 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.964 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.964 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:13.965 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:27:13.965 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:13.965 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:13.965 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:13.965 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.966 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:13.966 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:13.966 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.966 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:13.966 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:27:13.967 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:13.967 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.967 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.967 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:13.968 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:27:13.968 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:13.968 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:13.968 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:13.969 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.969 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:27:13.969 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:27:13.969 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:27:13.969 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:27:13.970 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:13.970 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:13.970 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:13.970 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:13.970 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.971 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.971 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:27:13.971 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:27:13.971 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:13.972 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:13.972 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:13.972 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:13.972 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:13.973 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:13.973 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:13.973 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 121, 2021-12-17T18:27:13.973 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:13.973 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:13.974 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:13.974 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:13.974 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.974 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:13.975 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:27:13.975 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:13.975 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.975 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.975 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:13.976 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:27:13.976 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:13.976 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:13.976 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:13.977 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.977 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:13.977 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:13.977 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.978 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:13.978 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:27:13.978 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:13.978 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.978 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.979 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:13.979 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:27:13.979 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:13.979 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:13.980 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:13.980 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.980 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:13.980 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:13.980 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.981 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:13.981 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:27:13.981 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:13.981 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.982 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.982 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:13.982 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:27:13.982 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:13.983 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:13.983 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:13.983 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.983 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:13.983 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:13.984 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.984 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:13.984 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:27:13.984 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:13.985 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.985 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.985 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:13.985 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:27:13.986 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:13.986 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:13.986 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:13.986 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.986 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:27:13.987 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:27:13.987 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:27:13.987 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:27:13.987 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:13.987 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:13.988 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:13.988 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:13.988 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.988 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:27:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:27:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:13.989 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:13.990 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:13.991 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 116, 2021-12-17T18:27:13.991 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:13.991 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:13.991 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:13.991 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:27:13.992 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:27:13.993 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:13.994 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:13.994 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:13.994 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.994 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:13.995 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:13.995 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.995 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:13.995 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:27:13.995 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:27:13.996 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:13.997 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:27:13.998 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:13.999 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:13.999 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:13.999 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:13.999 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:27:13.999 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:14.000 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.001 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.001 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.001 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:27:14.001 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.002 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:27:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.003 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:27:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:27:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:27:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:27:14.004 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.005 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.006 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:27:14.006 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:27:14.006 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:14.006 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:14.006 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:14.007 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:14.007 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:14.007 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:14.007 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 122, 2021-12-17T18:27:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:14.008 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.009 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.009 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.009 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:27:14.009 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:14.010 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.010 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.010 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.010 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:27:14.010 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:14.011 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.011 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.011 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.011 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:14.011 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.012 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.012 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.012 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:27:14.013 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:14.013 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.013 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.013 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.013 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:27:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.014 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.015 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:27:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.016 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.017 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:27:14.017 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:14.017 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.017 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.017 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.018 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:14.018 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.018 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.018 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:27:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:27:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.020 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:27:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:27:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:27:14.021 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:27:14.022 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:14.022 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:14.022 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:14.022 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:27:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:27:14.023 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:14.024 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:14.024 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:14.024 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:14.024 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:14.024 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:14.025 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:14.025 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 116, 2021-12-17T18:27:14.025 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:14.025 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:14.026 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:14.026 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.026 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.026 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.026 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:27:14.027 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:14.027 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.027 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.027 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.028 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:27:14.028 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:14.028 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.028 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.028 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.029 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:27:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.030 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.031 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:27:14.031 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:14.031 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.031 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.032 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:27:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.033 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.034 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:27:14.034 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:14.034 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.034 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.035 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.035 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:14.035 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.035 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.035 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.036 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:27:14.036 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:14.036 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.036 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:27:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.038 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.038 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:27:14.038 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:27:14.038 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:27:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:27:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:14.039 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:27:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:27:14.040 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:14.041 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:14.042 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:14.042 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:14.042 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 121, 2021-12-17T18:27:14.042 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.044 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:27:14.044 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:14.044 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.044 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:27:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.045 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.046 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.046 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:14.046 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.046 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.047 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.047 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:27:14.047 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:14.047 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.048 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.048 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.048 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:27:14.048 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:14.048 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.049 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.049 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.049 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:14.049 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.050 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.050 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.050 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:27:14.050 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:14.050 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.051 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.051 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.051 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:27:14.051 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:14.052 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.052 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.052 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.052 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:14.052 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.053 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.053 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.053 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:27:14.053 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:14.054 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.054 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.054 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.054 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:27:14.055 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:14.055 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.055 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.055 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.056 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:27:14.056 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:27:14.056 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:27:14.056 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:27:14.057 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:14.057 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:14.057 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:14.057 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.058 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.058 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:27:14.058 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:27:14.059 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:14.059 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:14.059 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:14.059 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:14.059 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:14.060 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:14.060 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:14.060 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 122, 2021-12-17T18:27:14.060 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:14.061 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:14.061 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:14.061 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.061 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.062 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.062 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:27:14.062 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:14.062 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.062 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.063 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.063 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:27:14.063 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:14.063 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.064 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.064 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.064 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:14.064 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.064 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.065 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.065 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:27:14.065 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:14.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.066 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.066 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.066 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:27:14.066 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:14.067 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.067 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.067 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.067 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:14.067 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.068 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.068 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.068 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:27:14.068 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:14.069 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.069 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.069 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.069 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:27:14.069 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:14.070 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.070 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.070 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.070 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:14.071 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.071 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.071 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.071 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:27:14.071 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:14.072 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.072 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.072 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.072 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:27:14.073 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:14.073 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.073 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.073 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.074 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:27:14.074 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:27:14.074 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:27:14.074 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:27:14.074 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:14.075 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:14.075 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:14.075 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.075 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.076 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.076 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:27:14.076 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:27:14.076 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:14.076 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:14.077 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:14.077 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:14.077 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:14.077 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:14.078 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:14.078 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 121, 2021-12-17T18:27:14.078 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:14.078 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:14.079 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:14.079 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.079 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.079 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.079 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:27:14.080 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:14.080 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.080 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.080 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.080 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:27:14.081 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:14.081 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.081 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.081 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.082 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:14.082 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.082 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.082 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.083 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:27:14.083 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:14.083 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.083 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.083 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.084 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:27:14.084 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:14.084 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.084 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.085 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.085 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:14.085 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.085 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.085 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.086 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:27:14.086 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:14.086 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.086 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.087 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.087 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:27:14.087 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:14.087 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.088 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.088 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.088 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:14.088 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:14.088 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.089 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:14.089 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:27:14.089 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:14.089 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.090 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.090 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:14.090 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:27:14.090 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:14.090 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.091 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.091 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.091 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:27:14.091 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:27:14.092 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:27:14.092 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:27:14.092 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:14.092 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:14.092 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:14.093 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:14.093 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.093 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:14.093 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:27:14.093 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.094 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:27:14.094 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:14.094 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:14.094 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:14.095 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:14.095 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:14.095 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:27:14.095 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:14.095 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.096 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.096 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:27:14.096 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:14.096 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:14.097 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:14.097 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:14.097 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:14.097 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:27:14.098 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:14.098 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.098 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.098 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:27:14.098 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:14.099 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:14.099 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:14.099 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:14.099 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:14.100 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:27:14.100 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:14.100 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.100 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.100 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:27:14.101 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:14.101 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:14.101 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:14.101 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:14.102 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:14.102 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:27:14.102 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:14.102 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.102 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.103 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:27:14.103 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:14.103 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:14.103 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:14.104 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:14.104 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:14.104 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:27:14.104 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:14.105 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.105 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.105 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:27:14.105 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:14.105 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:14.106 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:14.106 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:14.106 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:14.106 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:27:14.106 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:14.107 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.107 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.107 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:27:14.107 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:14.108 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:14.108 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:14.108 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:14.108 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:14.108 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:27:14.109 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:14.109 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.109 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:14.109 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:27:14.110 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:14.110 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:14.110 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:14.110 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:14.110 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:14.111 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:27:14.111 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:14.111 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.111 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:14.111 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:27:14.112 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:27:14.112 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:27:14.112 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:27:14.112 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": { 2021-12-17T18:27:14.113 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6833/2418178754": "2021-12-18T18:26:50.968176+0000", 2021-12-17T18:27:14.113 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.62:6832/2418178754": "2021-12-18T18:26:50.968176+0000" 2021-12-17T18:27:14.113 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.113 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:27:14.113 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:27:14.114 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:27:14.114 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:27:14.114 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:27:14.114 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:27:14.115 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:27:14.115 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:27:14.115 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:14.115 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:14.115 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:27:14.116 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:27:14.116 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:27:14.116 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:27:14.116 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:27:14.116 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:27:14.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.901+0000 7fce18b5d700 1 -- 172.21.15.62:0/92294753 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcdf80536a0 msgr2=0x7fcdf8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.901+0000 7fce18b5d700 1 --2- 172.21.15.62:0/92294753 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcdf80536a0 0x7fcdf8055b60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fce0400c000 tx=0x7fce04008040).stop 2021-12-17T18:27:14.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.901+0000 7fce18b5d700 1 -- 172.21.15.62:0/92294753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce140b1730 msgr2=0x7fce14066b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.901+0000 7fce18b5d700 1 --2- 172.21.15.62:0/92294753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce140b1730 0x7fce14066b30 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7fce140b1c00 tx=0x7fcdfc015000).stop 2021-12-17T18:27:14.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.901+0000 7fce18b5d700 1 -- 172.21.15.62:0/92294753 shutdown_connections 2021-12-17T18:27:14.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.901+0000 7fce18b5d700 1 --2- 172.21.15.62:0/92294753 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcdf80536a0 0x7fcdf8055b60 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.901+0000 7fce18b5d700 1 --2- 172.21.15.62:0/92294753 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fce140b21f0 0x7fce14157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.901+0000 7fce18b5d700 1 --2- 172.21.15.62:0/92294753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce140b1730 0x7fce14066b30 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.901+0000 7fce18b5d700 1 --2- 172.21.15.62:0/92294753 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fce140a7bb0 0x7fce140b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.901+0000 7fce18b5d700 1 -- 172.21.15.62:0/92294753 >> 172.21.15.62:0/92294753 conn(0x7fce1405f730 msgr2=0x7fce140ad410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:14.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.901+0000 7fce18b5d700 1 -- 172.21.15.62:0/92294753 shutdown_connections 2021-12-17T18:27:14.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:13.901+0000 7fce18b5d700 1 -- 172.21.15.62:0/92294753 wait complete. 2021-12-17T18:27:14.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:14.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb36dc17700 1 Processor -- start 2021-12-17T18:27:14.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb36dc17700 1 -- start start 2021-12-17T18:27:14.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb36dc17700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fb3680b21f0 0x7fb36814aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:14.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb36dc17700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3680b2ce0 con 0x7fb3680a7bb0 2021-12-17T18:27:14.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb36dc17700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3680aca60 con 0x7fb3680b1730 2021-12-17T18:27:14.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb36dc17700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb368147870 con 0x7fb3680b21f0 2021-12-17T18:27:14.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb367fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb3680a7bb0 0x7fb368067120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39268/0 (socket says 172.21.15.62:39268) 2021-12-17T18:27:14.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb367fff700 1 -- 172.21.15.62:0/328539950 learned_addr learned my addr 172.21.15.62:0/328539950 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:14.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb3677fe700 1 --2- 172.21.15.62:0/328539950 >> v2:172.21.15.109:3300/0 conn(0x7fb3680b21f0 0x7fb36814aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:14.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb3667fc700 1 -- 172.21.15.62:0/328539950 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968094769 0 0) 0x7fb3680b2ce0 con 0x7fb3680a7bb0 2021-12-17T18:27:14.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb3667fc700 1 -- 172.21.15.62:0/328539950 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb34c003260 con 0x7fb3680a7bb0 2021-12-17T18:27:14.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb3677fe700 1 -- 172.21.15.62:0/328539950 >> v1:172.21.15.109:6789/0 conn(0x7fb3680b1730 legacy=0x7fb3680ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb3677fe700 1 -- 172.21.15.62:0/328539950 >> v1:172.21.15.62:6789/0 conn(0x7fb3680a7bb0 legacy=0x7fb368067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb3677fe700 1 -- 172.21.15.62:0/328539950 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3680b2f10 con 0x7fb3680b21f0 2021-12-17T18:27:14.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb3677fe700 1 --2- 172.21.15.62:0/328539950 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3680b21f0 0x7fb36814aea0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fb3680b1c00 tx=0x7fb358006df0).ready entity=mon.1 client_cookie=c82eb836c5c88114 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:14.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb3667fc700 1 -- 172.21.15.62:0/328539950 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb35800d610 con 0x7fb3680b21f0 2021-12-17T18:27:14.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb3667fc700 1 -- 172.21.15.62:0/328539950 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb358000e90 con 0x7fb3680b21f0 2021-12-17T18:27:14.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb3667fc700 1 -- 172.21.15.62:0/328539950 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb35800d960 con 0x7fb3680b21f0 2021-12-17T18:27:14.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb36dc17700 1 -- 172.21.15.62:0/328539950 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3680b21f0 msgr2=0x7fb36814aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb36dc17700 1 --2- 172.21.15.62:0/328539950 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3680b21f0 0x7fb36814aea0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fb3680b1c00 tx=0x7fb358006df0).stop 2021-12-17T18:27:14.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb36dc17700 1 -- 172.21.15.62:0/328539950 shutdown_connections 2021-12-17T18:27:14.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb36dc17700 1 --2- 172.21.15.62:0/328539950 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3680b21f0 0x7fb36814aea0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb36dc17700 1 -- 172.21.15.62:0/328539950 >> 172.21.15.62:0/328539950 conn(0x7fb36805f730 msgr2=0x7fb36805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:14.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb36dc17700 1 -- 172.21.15.62:0/328539950 shutdown_connections 2021-12-17T18:27:14.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.229+0000 7fb36dc17700 1 -- 172.21.15.62:0/328539950 wait complete. 2021-12-17T18:27:14.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb36dc17700 1 Processor -- start 2021-12-17T18:27:14.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb36dc17700 1 -- start start 2021-12-17T18:27:14.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb36dc17700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3680a7bb0 0x7fb36814a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:14.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb36dc17700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3680b1730 0x7fb368156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:14.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb36dc17700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3680b21f0 0x7fb36815a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:14.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb36dc17700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb368157e70 con 0x7fb3680a7bb0 2021-12-17T18:27:14.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb36dc17700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb368063c30 con 0x7fb3680b1730 2021-12-17T18:27:14.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb36dc17700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb368063ed0 con 0x7fb3680b21f0 2021-12-17T18:27:14.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb3677fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3680a7bb0 0x7fb36814a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:14.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb3677fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3680a7bb0 0x7fb36814a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55692/0 (socket says 172.21.15.62:55692) 2021-12-17T18:27:14.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb3677fe700 1 -- 172.21.15.62:0/2614855312 learned_addr learned my addr 172.21.15.62:0/2614855312 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:14.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb367fff700 1 --2- 172.21.15.62:0/2614855312 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3680b21f0 0x7fb36815a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:14.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb366ffd700 1 --2- 172.21.15.62:0/2614855312 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3680b1730 0x7fb368156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:14.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb3677fe700 1 -- 172.21.15.62:0/2614855312 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3680b21f0 msgr2=0x7fb36815a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb3677fe700 1 --2- 172.21.15.62:0/2614855312 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3680b21f0 0x7fb36815a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb3677fe700 1 -- 172.21.15.62:0/2614855312 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3680b1730 msgr2=0x7fb368156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb3677fe700 1 --2- 172.21.15.62:0/2614855312 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3680b1730 0x7fb368156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb3677fe700 1 -- 172.21.15.62:0/2614855312 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35800b180 con 0x7fb3680a7bb0 2021-12-17T18:27:14.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb366ffd700 1 --2- 172.21.15.62:0/2614855312 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3680b1730 0x7fb368156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:14.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb3677fe700 1 --2- 172.21.15.62:0/2614855312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3680a7bb0 0x7fb36814a070 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7fb3680b1c00 tx=0x7fb358014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:14.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb364ff9700 1 -- 172.21.15.62:0/2614855312 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb35800d290 con 0x7fb3680a7bb0 2021-12-17T18:27:14.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb364ff9700 1 -- 172.21.15.62:0/2614855312 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb358013e90 con 0x7fb3680a7bb0 2021-12-17T18:27:14.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb36dc17700 1 -- 172.21.15.62:0/2614855312 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb36815a200 con 0x7fb3680a7bb0 2021-12-17T18:27:14.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb364ff9700 1 -- 172.21.15.62:0/2614855312 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb35801e5f0 con 0x7fb3680a7bb0 2021-12-17T18:27:14.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.233+0000 7fb36dc17700 1 -- 172.21.15.62:0/2614855312 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3680a9720 con 0x7fb3680a7bb0 2021-12-17T18:27:14.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.237+0000 7fb364ff9700 1 -- 172.21.15.62:0/2614855312 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb358025030 con 0x7fb3680a7bb0 2021-12-17T18:27:14.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.237+0000 7fb36dc17700 1 -- 172.21.15.62:0/2614855312 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3680b50b0 con 0x7fb3680a7bb0 2021-12-17T18:27:14.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.237+0000 7fb364ff9700 1 --2- 172.21.15.62:0/2614855312 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb3400535b0 0x7fb340055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:14.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.237+0000 7fb364ff9700 1 -- 172.21.15.62:0/2614855312 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fb35806c330 con 0x7fb3680a7bb0 2021-12-17T18:27:14.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.237+0000 7fb366ffd700 1 --2- 172.21.15.62:0/2614855312 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb3400535b0 0x7fb340055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:14.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.237+0000 7fb366ffd700 1 --2- 172.21.15.62:0/2614855312 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb3400535b0 0x7fb340055a70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fb36000b000 tx=0x7fb360009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:14.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.245+0000 7fb364ff9700 1 -- 172.21.15.62:0/2614855312 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb3680b50b0 con 0x7fb3680a7bb0 2021-12-17T18:27:14.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.409+0000 7fb36dc17700 1 -- 172.21.15.62:0/2614855312 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3680b50b0 con 0x7fb3680a7bb0 2021-12-17T18:27:14.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.409+0000 7fb364ff9700 1 -- 172.21.15.62:0/2614855312 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+504 (secure 0 0 0) 0x7fb3680b50b0 con 0x7fb3680a7bb0 2021-12-17T18:27:14.416 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:14.416 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":62,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2021-12-17T18:27:14.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.413+0000 7fb36dc17700 1 -- 172.21.15.62:0/2614855312 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb3400535b0 msgr2=0x7fb340055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.413+0000 7fb36dc17700 1 --2- 172.21.15.62:0/2614855312 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb3400535b0 0x7fb340055a70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fb36000b000 tx=0x7fb360009040).stop 2021-12-17T18:27:14.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.413+0000 7fb36dc17700 1 -- 172.21.15.62:0/2614855312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3680a7bb0 msgr2=0x7fb36814a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.413+0000 7fb36dc17700 1 --2- 172.21.15.62:0/2614855312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3680a7bb0 0x7fb36814a070 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7fb3680b1c00 tx=0x7fb358014000).stop 2021-12-17T18:27:14.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.413+0000 7fb36dc17700 1 -- 172.21.15.62:0/2614855312 shutdown_connections 2021-12-17T18:27:14.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.413+0000 7fb36dc17700 1 --2- 172.21.15.62:0/2614855312 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb3400535b0 0x7fb340055a70 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.413+0000 7fb36dc17700 1 --2- 172.21.15.62:0/2614855312 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb3680b21f0 0x7fb36815a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.413+0000 7fb36dc17700 1 --2- 172.21.15.62:0/2614855312 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb3680b1730 0x7fb368156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.413+0000 7fb36dc17700 1 --2- 172.21.15.62:0/2614855312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3680a7bb0 0x7fb36814a070 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.413+0000 7fb36dc17700 1 -- 172.21.15.62:0/2614855312 >> 172.21.15.62:0/2614855312 conn(0x7fb36805f730 msgr2=0x7fb368067450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:14.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.413+0000 7fb36dc17700 1 -- 172.21.15.62:0/2614855312 shutdown_connections 2021-12-17T18:27:14.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.413+0000 7fb36dc17700 1 -- 172.21.15.62:0/2614855312 wait complete. 2021-12-17T18:27:14.421 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 62 2021-12-17T18:27:14.429 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:14.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.521+0000 7f37c60f4700 1 Processor -- start 2021-12-17T18:27:14.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.521+0000 7f37c60f4700 1 -- start start 2021-12-17T18:27:14.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37c60f4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37c00b1730 0x7f37c00ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:14.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37c60f4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f37c00a7bb0 0x7f37c0067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:14.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37c60f4700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c00b2ce0 con 0x7f37c00b21f0 2021-12-17T18:27:14.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37c60f4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c014b5b0 con 0x7f37c00a7bb0 2021-12-17T18:27:14.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37c60f4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0147870 con 0x7f37c00b1730 2021-12-17T18:27:14.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37bffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f37c00a7bb0 0x7f37c0067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:14.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37bffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f37c00a7bb0 0x7f37c0067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55702/0 (socket says 172.21.15.62:55702) 2021-12-17T18:27:14.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37bffff700 1 -- 172.21.15.62:0/2526632081 learned_addr learned my addr 172.21.15.62:0/2526632081 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:14.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37beffd700 1 --2- 172.21.15.62:0/2526632081 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37c00b1730 0x7f37c00ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:14.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37bffff700 1 -- 172.21.15.62:0/2526632081 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37c00b1730 msgr2=0x7f37c00ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:14.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37bffff700 1 --2- 172.21.15.62:0/2526632081 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37c00b1730 0x7f37c00ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37bffff700 1 -- 172.21.15.62:0/2526632081 >> v1:172.21.15.109:6789/0 conn(0x7f37c00b21f0 legacy=0x7f37c014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37bffff700 1 -- 172.21.15.62:0/2526632081 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c00aca60 con 0x7f37c00a7bb0 2021-12-17T18:27:14.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37beffd700 1 --2- 172.21.15.62:0/2526632081 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37c00b1730 0x7f37c00ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:14.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37bffff700 1 --2- 172.21.15.62:0/2526632081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37c00a7bb0 0x7f37c0067120 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f37b80032f0 tx=0x7f37b8009290).ready entity=mon.0 client_cookie=834d048e5d9a4d45 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:14.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37be7fc700 1 -- 172.21.15.62:0/2526632081 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b800b8a0 con 0x7f37c00a7bb0 2021-12-17T18:27:14.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37be7fc700 1 -- 172.21.15.62:0/2526632081 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b800ba00 con 0x7f37c00a7bb0 2021-12-17T18:27:14.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37be7fc700 1 -- 172.21.15.62:0/2526632081 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b800bb70 con 0x7f37c00a7bb0 2021-12-17T18:27:14.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37c60f4700 1 -- 172.21.15.62:0/2526632081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37c00a7bb0 msgr2=0x7f37c0067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37c60f4700 1 --2- 172.21.15.62:0/2526632081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37c00a7bb0 0x7f37c0067120 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f37b80032f0 tx=0x7f37b8009290).stop 2021-12-17T18:27:14.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37c60f4700 1 -- 172.21.15.62:0/2526632081 shutdown_connections 2021-12-17T18:27:14.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37c60f4700 1 --2- 172.21.15.62:0/2526632081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37c00a7bb0 0x7f37c0067120 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37c60f4700 1 --2- 172.21.15.62:0/2526632081 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37c00b1730 0x7f37c00ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37c60f4700 1 -- 172.21.15.62:0/2526632081 >> 172.21.15.62:0/2526632081 conn(0x7f37c005f730 msgr2=0x7f37c005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:14.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37c60f4700 1 -- 172.21.15.62:0/2526632081 shutdown_connections 2021-12-17T18:27:14.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.525+0000 7f37c60f4700 1 -- 172.21.15.62:0/2526632081 wait complete. 2021-12-17T18:27:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37c60f4700 1 Processor -- start 2021-12-17T18:27:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37c60f4700 1 -- start start 2021-12-17T18:27:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37c60f4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37c00a7bb0 0x7f37c00ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37c60f4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37c00b1730 0x7f37c0157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37c60f4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37c00b21f0 0x7f37c0157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37c60f4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0065300 con 0x7f37c00b1730 2021-12-17T18:27:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37c60f4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c015a9c0 con 0x7f37c00a7bb0 2021-12-17T18:27:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37c60f4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00ab520 con 0x7f37c00b21f0 2021-12-17T18:27:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37beffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37c00b1730 0x7f37c0157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37beffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37c00b1730 0x7f37c0157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55706/0 (socket says 172.21.15.62:55706) 2021-12-17T18:27:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37beffd700 1 -- 172.21.15.62:0/736748043 learned_addr learned my addr 172.21.15.62:0/736748043 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37bffff700 1 --2- 172.21.15.62:0/736748043 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37c00b21f0 0x7f37c0157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:14.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37bf7fe700 1 --2- 172.21.15.62:0/736748043 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37c00a7bb0 0x7f37c00ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:14.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37beffd700 1 -- 172.21.15.62:0/736748043 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37c00b21f0 msgr2=0x7f37c0157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37beffd700 1 --2- 172.21.15.62:0/736748043 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37c00b21f0 0x7f37c0157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37beffd700 1 -- 172.21.15.62:0/736748043 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37c00a7bb0 msgr2=0x7f37c00ac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37beffd700 1 --2- 172.21.15.62:0/736748043 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37c00a7bb0 0x7f37c00ac260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.529+0000 7f37beffd700 1 -- 172.21.15.62:0/736748043 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b8009530 con 0x7f37c00b1730 2021-12-17T18:27:14.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.533+0000 7f37beffd700 1 --2- 172.21.15.62:0/736748043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37c00b1730 0x7f37c0157470 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f37b0006940 tx=0x7f37b0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:14.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.533+0000 7f37bcff9700 1 -- 172.21.15.62:0/736748043 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b0011780 con 0x7f37c00b1730 2021-12-17T18:27:14.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.533+0000 7f37bcff9700 1 -- 172.21.15.62:0/736748043 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b00118e0 con 0x7f37c00b1730 2021-12-17T18:27:14.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.533+0000 7f37c60f4700 1 -- 172.21.15.62:0/736748043 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c015ac50 con 0x7f37c00b1730 2021-12-17T18:27:14.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.533+0000 7f37bcff9700 1 -- 172.21.15.62:0/736748043 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b0011c40 con 0x7f37c00b1730 2021-12-17T18:27:14.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.533+0000 7f37c60f4700 1 -- 172.21.15.62:0/736748043 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c00630e0 con 0x7f37c00b1730 2021-12-17T18:27:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.533+0000 7f37c60f4700 1 -- 172.21.15.62:0/736748043 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c00b2f10 con 0x7f37c00b1730 2021-12-17T18:27:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.533+0000 7f37bcff9700 1 -- 172.21.15.62:0/736748043 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f37b0012420 con 0x7f37c00b1730 2021-12-17T18:27:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.533+0000 7f37bcff9700 1 --2- 172.21.15.62:0/736748043 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37a00536d0 0x7f37a0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.533+0000 7f37bcff9700 1 -- 172.21.15.62:0/736748043 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f37b006b3c0 con 0x7f37c00b1730 2021-12-17T18:27:14.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.533+0000 7f37bf7fe700 1 --2- 172.21.15.62:0/736748043 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37a00536d0 0x7f37a0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:14.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.533+0000 7f37bf7fe700 1 --2- 172.21.15.62:0/736748043 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37a00536d0 0x7f37a0055b90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f37b400d000 tx=0x7f37b4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:14.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.537+0000 7f37bcff9700 1 -- 172.21.15.62:0/736748043 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f37b0042690 con 0x7f37c00b1730 2021-12-17T18:27:14.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.701+0000 7f37c60f4700 1 -- 172.21.15.62:0/736748043 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37c00573d0 con 0x7f37c00b1730 2021-12-17T18:27:14.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.701+0000 7f37bcff9700 1 -- 172.21.15.62:0/736748043 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+504 (secure 0 0 0) 0x7f37b0045cb0 con 0x7f37c00b1730 2021-12-17T18:27:14.708 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:14.708 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":62,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2021-12-17T18:27:14.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.705+0000 7f37c60f4700 1 -- 172.21.15.62:0/736748043 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37a00536d0 msgr2=0x7f37a0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.705+0000 7f37c60f4700 1 --2- 172.21.15.62:0/736748043 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37a00536d0 0x7f37a0055b90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f37b400d000 tx=0x7f37b4009040).stop 2021-12-17T18:27:14.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.705+0000 7f37c60f4700 1 -- 172.21.15.62:0/736748043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37c00b1730 msgr2=0x7f37c0157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.705+0000 7f37c60f4700 1 --2- 172.21.15.62:0/736748043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37c00b1730 0x7f37c0157470 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f37b0006940 tx=0x7f37b0008040).stop 2021-12-17T18:27:14.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.705+0000 7f37c60f4700 1 -- 172.21.15.62:0/736748043 shutdown_connections 2021-12-17T18:27:14.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.705+0000 7f37c60f4700 1 --2- 172.21.15.62:0/736748043 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f37a00536d0 0x7f37a0055b90 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.705+0000 7f37c60f4700 1 --2- 172.21.15.62:0/736748043 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f37c00b21f0 0x7f37c0157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.705+0000 7f37c60f4700 1 --2- 172.21.15.62:0/736748043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37c00b1730 0x7f37c0157470 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.705+0000 7f37c60f4700 1 --2- 172.21.15.62:0/736748043 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f37c00a7bb0 0x7f37c00ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.705+0000 7f37c60f4700 1 -- 172.21.15.62:0/736748043 >> 172.21.15.62:0/736748043 conn(0x7f37c005f730 msgr2=0x7f37c00afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:14.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.705+0000 7f37c60f4700 1 -- 172.21.15.62:0/736748043 shutdown_connections 2021-12-17T18:27:14.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.705+0000 7f37c60f4700 1 -- 172.21.15.62:0/736748043 wait complete. 2021-12-17T18:27:14.714 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 62 2021-12-17T18:27:14.725 INFO:tasks.ceph.mds.a:Restarting daemon 2021-12-17T18:27:14.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-12-17T18:27:14.726 INFO:tasks.ceph.mds.b:Restarting daemon 2021-12-17T18:27:14.726 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-12-17T18:27:14.728 INFO:tasks.ceph.mds.a:Started 2021-12-17T18:27:14.729 DEBUG:teuthology.parallel:result is None 2021-12-17T18:27:14.737 INFO:tasks.ceph.mds.b:Started 2021-12-17T18:27:14.737 DEBUG:teuthology.parallel:result is None 2021-12-17T18:27:14.738 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-12-17T18:27:14.811 INFO:tasks.ceph.mds.b.smithi109.stdout:starting mds.b at 2021-12-17T18:27:14.812 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:27:14.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86b3fff700 1 Processor -- start 2021-12-17T18:27:14.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86b3fff700 1 -- start start 2021-12-17T18:27:14.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86b3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f86b412c460 0x7f86b40b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:14.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86b3fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f86b4146fb0 0x7f86b4143520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:14.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86b3fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b4067c10 con 0x7f86b4067830 2021-12-17T18:27:14.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86b3fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b40b06c0 con 0x7f86b412c460 2021-12-17T18:27:14.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86b3fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40b0960 con 0x7f86b4146fb0 2021-12-17T18:27:14.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86abfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f86b412c460 0x7f86b40b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:14.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86abfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f86b412c460 0x7f86b40b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55726/0 (socket says 172.21.15.62:55726) 2021-12-17T18:27:14.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86b2ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f86b4067830 0x7f86b412bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39304/0 (socket says 172.21.15.62:39304) 2021-12-17T18:27:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86abfff700 1 -- 172.21.15.62:0/1753136797 learned_addr learned my addr 172.21.15.62:0/1753136797 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86b37fe700 1 --2- 172.21.15.62:0/1753136797 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f86b4146fb0 0x7f86b4143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86abfff700 1 -- 172.21.15.62:0/1753136797 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f86b4146fb0 msgr2=0x7f86b4143520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86abfff700 1 --2- 172.21.15.62:0/1753136797 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f86b4146fb0 0x7f86b4143520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86abfff700 1 -- 172.21.15.62:0/1753136797 >> v1:172.21.15.62:6789/0 conn(0x7f86b4067830 legacy=0x7f86b412bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86abfff700 1 -- 172.21.15.62:0/1753136797 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b4147440 con 0x7f86b412c460 2021-12-17T18:27:14.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86abfff700 1 --2- 172.21.15.62:0/1753136797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b412c460 0x7f86b40b0c90 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f869c002f70 tx=0x7f869c006eb0).ready entity=mon.0 client_cookie=1c0ba84312798c6f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:14.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86b27fc700 1 -- 172.21.15.62:0/1753136797 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f869c00d5c0 con 0x7f86b412c460 2021-12-17T18:27:14.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86b27fc700 1 -- 172.21.15.62:0/1753136797 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c000e90 con 0x7f86b412c460 2021-12-17T18:27:14.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.849+0000 7f86b27fc700 1 -- 172.21.15.62:0/1753136797 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f869c00d950 con 0x7f86b412c460 2021-12-17T18:27:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.853+0000 7f86b3fff700 1 -- 172.21.15.62:0/1753136797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b412c460 msgr2=0x7f86b40b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.853+0000 7f86b3fff700 1 --2- 172.21.15.62:0/1753136797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b412c460 0x7f86b40b0c90 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f869c002f70 tx=0x7f869c006eb0).stop 2021-12-17T18:27:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.853+0000 7f86b3fff700 1 -- 172.21.15.62:0/1753136797 shutdown_connections 2021-12-17T18:27:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.853+0000 7f86b3fff700 1 --2- 172.21.15.62:0/1753136797 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f86b4146fb0 0x7f86b4143520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.853+0000 7f86b3fff700 1 --2- 172.21.15.62:0/1753136797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b412c460 0x7f86b40b0c90 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.853+0000 7f86b3fff700 1 -- 172.21.15.62:0/1753136797 >> 172.21.15.62:0/1753136797 conn(0x7f86b405d1c0 msgr2=0x7f86b40b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.853+0000 7f86b3fff700 1 -- 172.21.15.62:0/1753136797 shutdown_connections 2021-12-17T18:27:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.853+0000 7f86b3fff700 1 -- 172.21.15.62:0/1753136797 wait complete. 2021-12-17T18:27:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.853+0000 7f86b3fff700 1 Processor -- start 2021-12-17T18:27:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.853+0000 7f86b3fff700 1 -- start start 2021-12-17T18:27:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b3fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f86b4067830 0x7f86b4142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b3fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f86b412c460 0x7f86b4141200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b4146fb0 0x7f86b41416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b3fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40a24c0 con 0x7f86b4146fb0 2021-12-17T18:27:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b3fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40a5ed0 con 0x7f86b4067830 2021-12-17T18:27:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b3fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40a5c30 con 0x7f86b412c460 2021-12-17T18:27:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b4146fb0 0x7f86b41416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b4146fb0 0x7f86b41416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55734/0 (socket says 172.21.15.62:55734) 2021-12-17T18:27:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b37fe700 1 -- 172.21.15.62:0/3850653664 learned_addr learned my addr 172.21.15.62:0/3850653664 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b2ffd700 1 --2- 172.21.15.62:0/3850653664 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f86b4067830 0x7f86b4142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86abfff700 1 --2- 172.21.15.62:0/3850653664 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f86b412c460 0x7f86b4141200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b37fe700 1 -- 172.21.15.62:0/3850653664 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f86b412c460 msgr2=0x7f86b4141200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b37fe700 1 --2- 172.21.15.62:0/3850653664 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f86b412c460 0x7f86b4141200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b37fe700 1 -- 172.21.15.62:0/3850653664 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f86b4067830 msgr2=0x7f86b4142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b37fe700 1 --2- 172.21.15.62:0/3850653664 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f86b4067830 0x7f86b4142510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b37fe700 1 -- 172.21.15.62:0/3850653664 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c00b1e0 con 0x7f86b4146fb0 2021-12-17T18:27:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86abfff700 1 --2- 172.21.15.62:0/3850653664 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f86b412c460 0x7f86b4141200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:27:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b2ffd700 1 --2- 172.21.15.62:0/3850653664 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f86b4067830 0x7f86b4142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b37fe700 1 --2- 172.21.15.62:0/3850653664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b4146fb0 0x7f86b41416f0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7f86ac00a000 tx=0x7f86ac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b0ff9700 1 -- 172.21.15.62:0/3850653664 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86ac0127e0 con 0x7f86b4146fb0 2021-12-17T18:27:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b0ff9700 1 -- 172.21.15.62:0/3850653664 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac012940 con 0x7f86b4146fb0 2021-12-17T18:27:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b0ff9700 1 -- 172.21.15.62:0/3850653664 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86ac012ca0 con 0x7f86b4146fb0 2021-12-17T18:27:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b3fff700 1 -- 172.21.15.62:0/3850653664 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b40a26f0 con 0x7f86b4146fb0 2021-12-17T18:27:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b3fff700 1 -- 172.21.15.62:0/3850653664 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b412bd20 con 0x7f86b4146fb0 2021-12-17T18:27:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.857+0000 7f86b3fff700 1 -- 172.21.15.62:0/3850653664 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b40573d0 con 0x7f86b4146fb0 2021-12-17T18:27:14.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.861+0000 7f86b0ff9700 1 -- 172.21.15.62:0/3850653664 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f86ac013480 con 0x7f86b4146fb0 2021-12-17T18:27:14.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.861+0000 7f86b0ff9700 1 --2- 172.21.15.62:0/3850653664 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8698053610 0x7f8698055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.861+0000 7f86b0ff9700 1 -- 172.21.15.62:0/3850653664 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f86ac06baf0 con 0x7f86b4146fb0 2021-12-17T18:27:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.861+0000 7f86b2ffd700 1 --2- 172.21.15.62:0/3850653664 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8698053610 0x7f8698055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.861+0000 7f86b2ffd700 1 --2- 172.21.15.62:0/3850653664 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8698053610 0x7f8698055ad0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f86a400b000 tx=0x7f86a40070e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:14.869+0000 7f86b0ff9700 1 -- 172.21.15.62:0/3850653664 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f86ac042ed0 con 0x7f86b4146fb0 2021-12-17T18:27:15.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.001+0000 7f86b3fff700 1 -- 172.21.15.62:0/3850653664 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f86b40608a0 con 0x7f86b4146fb0 2021-12-17T18:27:15.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.825+0000 7f86b0ff9700 1 -- 172.21.15.62:0/3850653664 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v127) v1 ==== 97+0+0 (secure 0 0 0) 0x7f86ac012e00 con 0x7f86b4146fb0 2021-12-17T18:27:15.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.829+0000 7f86b3fff700 1 -- 172.21.15.62:0/3850653664 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8698053610 msgr2=0x7f8698055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:15.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.829+0000 7f86b3fff700 1 --2- 172.21.15.62:0/3850653664 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8698053610 0x7f8698055ad0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f86a400b000 tx=0x7f86a40070e0).stop 2021-12-17T18:27:15.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.829+0000 7f86b3fff700 1 -- 172.21.15.62:0/3850653664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b4146fb0 msgr2=0x7f86b41416f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:15.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.829+0000 7f86b3fff700 1 --2- 172.21.15.62:0/3850653664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b4146fb0 0x7f86b41416f0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7f86ac00a000 tx=0x7f86ac008040).stop 2021-12-17T18:27:15.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.829+0000 7f86b3fff700 1 -- 172.21.15.62:0/3850653664 shutdown_connections 2021-12-17T18:27:15.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.829+0000 7f86b3fff700 1 --2- 172.21.15.62:0/3850653664 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8698053610 0x7f8698055ad0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:15.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.829+0000 7f86b3fff700 1 --2- 172.21.15.62:0/3850653664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86b4146fb0 0x7f86b41416f0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:15.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.829+0000 7f86b3fff700 1 --2- 172.21.15.62:0/3850653664 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f86b412c460 0x7f86b4141200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:15.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.829+0000 7f86b3fff700 1 --2- 172.21.15.62:0/3850653664 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f86b4067830 0x7f86b4142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:15.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.829+0000 7f86b3fff700 1 -- 172.21.15.62:0/3850653664 >> 172.21.15.62:0/3850653664 conn(0x7f86b405d1c0 msgr2=0x7f86b40b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:15.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.829+0000 7f86b3fff700 1 -- 172.21.15.62:0/3850653664 shutdown_connections 2021-12-17T18:27:15.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.829+0000 7f86b3fff700 1 -- 172.21.15.62:0/3850653664 wait complete. 2021-12-17T18:27:15.836 INFO:teuthology.orchestra.run.smithi062.stderr: removed all blacklist entries 2021-12-17T18:27:15.849 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-12-17T18:27:15.850 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-12-17T18:27:15.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.953+0000 7f433359e700 1 Processor -- start 2021-12-17T18:27:15.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.953+0000 7f433359e700 1 -- start start 2021-12-17T18:27:15.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.953+0000 7f433359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f43340a8e10 0x7f4334147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:15.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.953+0000 7f433359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f43340a71e0 0x7f43340a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:15.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.953+0000 7f433359e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43340b6270 con 0x7f4334141480 2021-12-17T18:27:15.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.953+0000 7f433359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4334147610 con 0x7f43340a71e0 2021-12-17T18:27:15.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.953+0000 7f433359e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43341478b0 con 0x7f43340a8e10 2021-12-17T18:27:15.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.953+0000 7f4332d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f43340a71e0 0x7f43340a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:15.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.953+0000 7f4332d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f43340a71e0 0x7f43340a7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55742/0 (socket says 172.21.15.62:55742) 2021-12-17T18:27:15.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.953+0000 7f4332d9d700 1 -- 172.21.15.62:0/2305182957 learned_addr learned my addr 172.21.15.62:0/2305182957 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:15.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.953+0000 7f4331d9b700 1 --2- 172.21.15.62:0/2305182957 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f43340a8e10 0x7f4334147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:15.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f4332d9d700 1 -- 172.21.15.62:0/2305182957 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f43340a8e10 msgr2=0x7f4334147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:15.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f433159a700 1 -- 172.21.15.62:0/2305182957 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465557170 0 0) 0x7f43340b6270 con 0x7f4334141480 2021-12-17T18:27:15.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f4332d9d700 1 --2- 172.21.15.62:0/2305182957 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f43340a8e10 0x7f4334147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:15.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f4332d9d700 1 -- 172.21.15.62:0/2305182957 >> v1:172.21.15.109:6789/0 conn(0x7f4334141480 legacy=0x7f43340b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:15.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f4332d9d700 1 -- 172.21.15.62:0/2305182957 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4334147b50 con 0x7f43340a71e0 2021-12-17T18:27:15.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f4331d9b700 1 --2- 172.21.15.62:0/2305182957 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f43340a8e10 0x7f4334147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:15.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f4332d9d700 1 --2- 172.21.15.62:0/2305182957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43340a71e0 0x7f43340a7900 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7f432c0032f0 tx=0x7f432c009290).ready entity=mon.0 client_cookie=b2b5e0113a3e7e10 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:15.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f433159a700 1 -- 172.21.15.62:0/2305182957 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f432c00b8a0 con 0x7f43340a71e0 2021-12-17T18:27:15.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f433159a700 1 -- 172.21.15.62:0/2305182957 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c00ba00 con 0x7f43340a71e0 2021-12-17T18:27:15.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f433159a700 1 -- 172.21.15.62:0/2305182957 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f432c00bb70 con 0x7f43340a71e0 2021-12-17T18:27:15.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f433359e700 1 -- 172.21.15.62:0/2305182957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43340a71e0 msgr2=0x7f43340a7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:15.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f433359e700 1 --2- 172.21.15.62:0/2305182957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43340a71e0 0x7f43340a7900 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7f432c0032f0 tx=0x7f432c009290).stop 2021-12-17T18:27:15.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f433359e700 1 -- 172.21.15.62:0/2305182957 shutdown_connections 2021-12-17T18:27:15.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f433359e700 1 --2- 172.21.15.62:0/2305182957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43340a71e0 0x7f43340a7900 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:15.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f433359e700 1 --2- 172.21.15.62:0/2305182957 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f43340a8e10 0x7f4334147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:15.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f433359e700 1 -- 172.21.15.62:0/2305182957 >> 172.21.15.62:0/2305182957 conn(0x7f433405d220 msgr2=0x7f43340b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:15.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f433359e700 1 -- 172.21.15.62:0/2305182957 shutdown_connections 2021-12-17T18:27:15.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f433359e700 1 -- 172.21.15.62:0/2305182957 wait complete. 2021-12-17T18:27:15.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f433359e700 1 Processor -- start 2021-12-17T18:27:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f433359e700 1 -- start start 2021-12-17T18:27:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.957+0000 7f433359e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f43340a71e0 0x7f43340aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f433359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43340a8e10 0x7f43341357b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f433359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4334141480 0x7f4334135ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f433359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43340b4070 con 0x7f43340a8e10 2021-12-17T18:27:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f433359e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43340b3d30 con 0x7f43340a71e0 2021-12-17T18:27:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f433359e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433414a8c0 con 0x7f4334141480 2021-12-17T18:27:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f4331d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43340a8e10 0x7f43341357b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f4331d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43340a8e10 0x7f43341357b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55746/0 (socket says 172.21.15.62:55746) 2021-12-17T18:27:15.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f4331d9b700 1 -- 172.21.15.62:0/878004044 learned_addr learned my addr 172.21.15.62:0/878004044 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:15.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f433259c700 1 --2- 172.21.15.62:0/878004044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f43340a71e0 0x7f43340aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:15.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f4332d9d700 1 --2- 172.21.15.62:0/878004044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4334141480 0x7f4334135ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:15.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f4331d9b700 1 -- 172.21.15.62:0/878004044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4334141480 msgr2=0x7f4334135ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:15.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f4331d9b700 1 --2- 172.21.15.62:0/878004044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4334141480 0x7f4334135ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:15.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f4331d9b700 1 -- 172.21.15.62:0/878004044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f43340a71e0 msgr2=0x7f43340aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:15.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f4331d9b700 1 --2- 172.21.15.62:0/878004044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f43340a71e0 0x7f43340aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:15.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f4331d9b700 1 -- 172.21.15.62:0/878004044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c009530 con 0x7f43340a8e10 2021-12-17T18:27:15.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f4332d9d700 1 --2- 172.21.15.62:0/878004044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4334141480 0x7f4334135ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:15.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f4331d9b700 1 --2- 172.21.15.62:0/878004044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43340a8e10 0x7f43341357b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f432400a000 tx=0x7f4324008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:15.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f43237fe700 1 -- 172.21.15.62:0/878004044 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4324011780 con 0x7f43340a8e10 2021-12-17T18:27:15.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f43237fe700 1 -- 172.21.15.62:0/878004044 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43240118e0 con 0x7f43340a8e10 2021-12-17T18:27:15.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f433359e700 1 -- 172.21.15.62:0/878004044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433414ab60 con 0x7f43340a8e10 2021-12-17T18:27:15.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f43237fe700 1 -- 172.21.15.62:0/878004044 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4324011c40 con 0x7f43340a8e10 2021-12-17T18:27:15.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f433359e700 1 -- 172.21.15.62:0/878004044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4334156d90 con 0x7f43340a8e10 2021-12-17T18:27:15.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f433359e700 1 -- 172.21.15.62:0/878004044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43340b1b90 con 0x7f43340a8e10 2021-12-17T18:27:15.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f43237fe700 1 -- 172.21.15.62:0/878004044 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f432401c460 con 0x7f43340a8e10 2021-12-17T18:27:15.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.961+0000 7f43237fe700 1 --2- 172.21.15.62:0/878004044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f43100536a0 0x7f4310055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:15.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.965+0000 7f43237fe700 1 -- 172.21.15.62:0/878004044 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f432406b9b0 con 0x7f43340a8e10 2021-12-17T18:27:15.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.965+0000 7f433259c700 1 --2- 172.21.15.62:0/878004044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f43100536a0 0x7f4310055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:15.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.965+0000 7f433259c700 1 --2- 172.21.15.62:0/878004044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f43100536a0 0x7f4310055b60 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f432800d000 tx=0x7f4328009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:15.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:15.973+0000 7f43237fe700 1 -- 172.21.15.62:0/878004044 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4324042de0 con 0x7f43340a8e10 2021-12-17T18:27:16.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.141+0000 7f433359e700 1 -- 172.21.15.62:0/878004044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f43340b61b0 con 0x7f43340a8e10 2021-12-17T18:27:16.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.141+0000 7f43237fe700 1 -- 172.21.15.62:0/878004044 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v38) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f4324046400 con 0x7f43340a8e10 2021-12-17T18:27:16.147 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:16.147 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:27:16.148 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_dump": [ 2021-12-17T18:27:16.148 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:16.148 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.a", 2021-12-17T18:27:16.148 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhxCS0LBAAtUlkgWYg4l3fQ2au7jMUDg==", 2021-12-17T18:27:16.148 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:16.149 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:27:16.149 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:16.149 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:16.150 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:16.150 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:16.150 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:16.150 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:16.151 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.b", 2021-12-17T18:27:16.151 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhoRJAMxAAP/NmDQRwJjYip2rxJsQlYg==", 2021-12-17T18:27:16.151 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:16.151 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:27:16.152 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:16.152 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:16.152 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:16.152 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:16.152 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:16.153 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:16.153 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.0", 2021-12-17T18:27:16.153 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBA1LxhJXzhKhAAUnxP3G5VuATkQLoDALFjVg==", 2021-12-17T18:27:16.153 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:16.154 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:16.154 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:16.154 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:16.155 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:16.155 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:16.155 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:16.156 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.1", 2021-12-17T18:27:16.156 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBD1LxhregUDhAABrxQ2jQ4BwXvuWh/D9SkbQ==", 2021-12-17T18:27:16.156 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:16.156 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:16.157 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:16.157 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:16.157 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:16.157 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:16.158 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:16.158 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.2", 2021-12-17T18:27:16.158 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBF1LxhOo/SLhAAhQQLW/VKFx1sgm8chnD5tw==", 2021-12-17T18:27:16.159 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:16.159 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:16.159 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:16.159 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:16.159 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:16.160 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:16.160 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:16.160 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.3", 2021-12-17T18:27:16.160 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBI1LxhT2ZQExAA999j8V5bJAJ2PuaQqSkUOw==", 2021-12-17T18:27:16.161 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:16.161 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:16.161 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:16.161 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:16.162 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:16.162 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:16.162 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:16.162 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.4", 2021-12-17T18:27:16.163 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBN1LxhKBDzFhAAKmPF0FXnnfXtweo+6z9nxg==", 2021-12-17T18:27:16.163 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:16.163 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:16.163 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:16.164 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:16.164 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:16.164 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:16.165 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:16.165 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.5", 2021-12-17T18:27:16.165 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBP1LxhtqkAORAAVaFLVNIUMs4Sytk8WRaGNA==", 2021-12-17T18:27:16.166 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:16.166 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:16.166 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:16.166 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:16.167 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:16.167 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:16.167 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:16.167 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.6", 2021-12-17T18:27:16.168 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBS1LxhNtncGhAAgG64g1ie54CDp9Y7uldKQA==", 2021-12-17T18:27:16.168 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:16.168 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:16.168 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:16.168 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:16.169 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:16.169 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:16.169 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:16.169 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.7", 2021-12-17T18:27:16.170 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBV1Lxh3DcDABAAHVskSVtoEJ8BxCCAs3ZDVA==", 2021-12-17T18:27:16.170 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:16.170 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:16.170 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:16.170 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:16.171 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:16.171 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:16.171 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:16.171 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.0", 2021-12-17T18:27:16.172 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxh9QhCNxAALkWTJorDpbt9yrikL7/NWg==", 2021-12-17T18:27:16.172 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:16.172 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:27:16.172 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:27:16.173 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:27:16.173 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:16.173 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:16.174 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:16.174 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.1", 2021-12-17T18:27:16.174 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxhxm52OxAAbqXVaqRDmt4Ezj9xyCEODQ==", 2021-12-17T18:27:16.174 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:16.175 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:27:16.175 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:27:16.175 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:27:16.175 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:16.176 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:16.176 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:16.176 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.2", 2021-12-17T18:27:16.176 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+1LxhXu08BBAATRcUAZvMNg9ou4PLszDtmA==", 2021-12-17T18:27:16.177 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:16.177 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:27:16.177 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:27:16.177 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:27:16.177 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:16.178 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:16.178 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:16.178 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.admin", 2021-12-17T18:27:16.178 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhyAGlDRAA2ggSG5yBBFbMgK2fCBk2mQ==", 2021-12-17T18:27:16.179 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:16.179 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:27:16.179 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:16.179 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:16.179 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:16.180 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:16.180 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:16.180 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:16.180 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.x", 2021-12-17T18:27:16.181 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhzvntKRAAFQlg69Z6d2nWX0GxSshsMw==", 2021-12-17T18:27:16.181 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:16.181 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:27:16.181 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:27:16.182 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:16.182 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:16.182 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:16.182 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:16.183 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.y", 2021-12-17T18:27:16.183 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhKdTGJRAArzUN3A1U5Efw0NG9Gw2Gcw==", 2021-12-17T18:27:16.183 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:16.183 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:27:16.184 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:27:16.184 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:16.184 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:16.185 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:16.185 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:16.185 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:27:16.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.145+0000 7f433359e700 1 -- 172.21.15.62:0/878004044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f43100536a0 msgr2=0x7f4310055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.145+0000 7f433359e700 1 --2- 172.21.15.62:0/878004044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f43100536a0 0x7f4310055b60 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f432800d000 tx=0x7f4328009040).stop 2021-12-17T18:27:16.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.145+0000 7f433359e700 1 -- 172.21.15.62:0/878004044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43340a8e10 msgr2=0x7f43341357b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.145+0000 7f433359e700 1 --2- 172.21.15.62:0/878004044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43340a8e10 0x7f43341357b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f432400a000 tx=0x7f4324008040).stop 2021-12-17T18:27:16.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.145+0000 7f433359e700 1 -- 172.21.15.62:0/878004044 shutdown_connections 2021-12-17T18:27:16.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.145+0000 7f433359e700 1 --2- 172.21.15.62:0/878004044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f43100536a0 0x7f4310055b60 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.145+0000 7f433359e700 1 --2- 172.21.15.62:0/878004044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4334141480 0x7f4334135ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.145+0000 7f433359e700 1 --2- 172.21.15.62:0/878004044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43340a8e10 0x7f43341357b0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.145+0000 7f433359e700 1 --2- 172.21.15.62:0/878004044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f43340a71e0 0x7f43340aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.145+0000 7f433359e700 1 -- 172.21.15.62:0/878004044 >> 172.21.15.62:0/878004044 conn(0x7f433405d220 msgr2=0x7f43341450d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:16.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.145+0000 7f433359e700 1 -- 172.21.15.62:0/878004044 shutdown_connections 2021-12-17T18:27:16.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.145+0000 7f433359e700 1 -- 172.21.15.62:0/878004044 wait complete. 2021-12-17T18:27:16.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:27:16.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff64a8be700 1 Processor -- start 2021-12-17T18:27:16.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff64a8be700 1 -- start start 2021-12-17T18:27:16.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff64a8be700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff6440a7bb0 0x7ff644067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff64a8be700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6440b2ce0 con 0x7ff6440b1730 2021-12-17T18:27:16.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff64a8be700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6440aca60 con 0x7ff6440b21f0 2021-12-17T18:27:16.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff64a8be700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64414b5b0 con 0x7ff6440a7bb0 2021-12-17T18:27:16.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff6437fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff6440b1730 0x7ff6440ace90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39334/0 (socket says 172.21.15.62:39334) 2021-12-17T18:27:16.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff6437fe700 1 -- 172.21.15.62:0/512951491 learned_addr learned my addr 172.21.15.62:0/512951491 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:16.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff648e5b700 1 --2- 172.21.15.62:0/512951491 >> v2:172.21.15.109:3300/0 conn(0x7ff6440a7bb0 0x7ff644067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff642ffd700 1 -- 172.21.15.62:0/512951491 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208312809 0 0) 0x7ff6440b2ce0 con 0x7ff6440b1730 2021-12-17T18:27:16.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff642ffd700 1 -- 172.21.15.62:0/512951491 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff624003260 con 0x7ff6440b1730 2021-12-17T18:27:16.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff642ffd700 1 -- 172.21.15.62:0/512951491 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309832773 0 0) 0x7ff6440aca60 con 0x7ff6440b21f0 2021-12-17T18:27:16.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff642ffd700 1 -- 172.21.15.62:0/512951491 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6440b2ce0 con 0x7ff6440b21f0 2021-12-17T18:27:16.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff642ffd700 1 -- 172.21.15.62:0/512951491 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1215177256 0 0) 0x7ff624003260 con 0x7ff6440b1730 2021-12-17T18:27:16.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff642ffd700 1 -- 172.21.15.62:0/512951491 >> v2:172.21.15.109:3300/0 conn(0x7ff6440a7bb0 msgr2=0x7ff644067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:16.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff642ffd700 1 --2- 172.21.15.62:0/512951491 >> v2:172.21.15.109:3300/0 conn(0x7ff6440a7bb0 0x7ff644067120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff642ffd700 1 -- 172.21.15.62:0/512951491 >> v1:172.21.15.109:6789/0 conn(0x7ff6440b21f0 legacy=0x7ff64414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff642ffd700 1 -- 172.21.15.62:0/512951491 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6440b2f10 con 0x7ff6440b1730 2021-12-17T18:27:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff642ffd700 1 -- 172.21.15.62:0/512951491 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7ff62c001660 con 0x7ff6440b1730 2021-12-17T18:27:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff642ffd700 1 -- 172.21.15.62:0/512951491 >> v1:172.21.15.62:6789/0 conn(0x7ff6440b1730 legacy=0x7ff6440ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff642ffd700 1 --2- 172.21.15.62:0/512951491 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff624003910 0x7ff624003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff642ffd700 1 --2- 172.21.15.62:0/512951491 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff624004500 0x7ff624004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff642ffd700 1 --2- 172.21.15.62:0/512951491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff624004e70 0x7ff62400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff642ffd700 1 -- 172.21.15.62:0/512951491 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64414b5b0 con 0x7ff624004e70 2021-12-17T18:27:16.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff642ffd700 1 -- 172.21.15.62:0/512951491 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62400bd20 con 0x7ff624003910 2021-12-17T18:27:16.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff642ffd700 1 -- 172.21.15.62:0/512951491 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62400bee0 con 0x7ff624004500 2021-12-17T18:27:16.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff648e5b700 1 --2- 172.21.15.62:0/512951491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff624004e70 0x7ff62400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff643fff700 1 --2- 172.21.15.62:0/512951491 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff624003910 0x7ff624003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff6437fe700 1 --2- 172.21.15.62:0/512951491 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff624004500 0x7ff624004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff648e5b700 1 -- 172.21.15.62:0/512951491 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff624004500 msgr2=0x7ff624004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:16.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff648e5b700 1 --2- 172.21.15.62:0/512951491 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff624004500 0x7ff624004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff648e5b700 1 -- 172.21.15.62:0/512951491 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff624003910 msgr2=0x7ff624003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:16.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff648e5b700 1 --2- 172.21.15.62:0/512951491 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff624003910 0x7ff624003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.289+0000 7ff648e5b700 1 -- 172.21.15.62:0/512951491 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff624003260 con 0x7ff624004e70 2021-12-17T18:27:16.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.293+0000 7ff6437fe700 1 --2- 172.21.15.62:0/512951491 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff624004500 0x7ff624004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:16.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.293+0000 7ff648e5b700 1 -- 172.21.15.62:0/512951491 reap_dead start 2021-12-17T18:27:16.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.293+0000 7ff648e5b700 1 --2- 172.21.15.62:0/512951491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff624004e70 0x7ff62400b750 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7ff63400c000 tx=0x7ff634006df0).ready entity=mon.0 client_cookie=3e45c25a329f40d6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:16.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.293+0000 7ff642ffd700 1 -- 172.21.15.62:0/512951491 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff634016070 con 0x7ff624004e70 2021-12-17T18:27:16.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.293+0000 7ff642ffd700 1 -- 172.21.15.62:0/512951491 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63400e5f0 con 0x7ff624004e70 2021-12-17T18:27:16.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.293+0000 7ff642ffd700 1 -- 172.21.15.62:0/512951491 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff63400e950 con 0x7ff624004e70 2021-12-17T18:27:16.309 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.293+0000 7ff64a8be700 1 -- 172.21.15.62:0/512951491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff624004e70 msgr2=0x7ff62400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.293+0000 7ff64a8be700 1 --2- 172.21.15.62:0/512951491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff624004e70 0x7ff62400b750 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7ff63400c000 tx=0x7ff634006df0).stop 2021-12-17T18:27:16.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.293+0000 7ff64a8be700 1 -- 172.21.15.62:0/512951491 shutdown_connections 2021-12-17T18:27:16.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.293+0000 7ff64a8be700 1 --2- 172.21.15.62:0/512951491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff624004e70 0x7ff62400b750 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.310 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.293+0000 7ff64a8be700 1 -- 172.21.15.62:0/512951491 >> 172.21.15.62:0/512951491 conn(0x7ff64405f730 msgr2=0x7ff64405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:16.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.293+0000 7ff64a8be700 1 -- 172.21.15.62:0/512951491 shutdown_connections 2021-12-17T18:27:16.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.293+0000 7ff64a8be700 1 -- 172.21.15.62:0/512951491 wait complete. 2021-12-17T18:27:16.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.293+0000 7ff64a8be700 1 Processor -- start 2021-12-17T18:27:16.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.293+0000 7ff64a8be700 1 -- start start 2021-12-17T18:27:16.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff64a8be700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff624004e70 0x7ff64414df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff64a8be700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff64414c920 0x7ff6440666e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff64a8be700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff64414d590 0x7ff644066bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff64a8be700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6440ac500 con 0x7ff624004e70 2021-12-17T18:27:16.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff64a8be700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff644064210 con 0x7ff64414d590 2021-12-17T18:27:16.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff64a8be700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff644063f70 con 0x7ff64414c920 2021-12-17T18:27:16.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff643fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff624004e70 0x7ff64414df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff643fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff624004e70 0x7ff64414df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55766/0 (socket says 172.21.15.62:55766) 2021-12-17T18:27:16.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff643fff700 1 -- 172.21.15.62:0/4019815296 learned_addr learned my addr 172.21.15.62:0/4019815296 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:16.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff648e5b700 1 --2- 172.21.15.62:0/4019815296 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff64414d590 0x7ff644066bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff6437fe700 1 --2- 172.21.15.62:0/4019815296 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff64414c920 0x7ff6440666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff643fff700 1 -- 172.21.15.62:0/4019815296 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff64414c920 msgr2=0x7ff6440666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff643fff700 1 --2- 172.21.15.62:0/4019815296 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff64414c920 0x7ff6440666e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff643fff700 1 -- 172.21.15.62:0/4019815296 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff64414d590 msgr2=0x7ff644066bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff643fff700 1 --2- 172.21.15.62:0/4019815296 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff64414d590 0x7ff644066bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff643fff700 1 -- 172.21.15.62:0/4019815296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64414c120 con 0x7ff624004e70 2021-12-17T18:27:16.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff648e5b700 1 --2- 172.21.15.62:0/4019815296 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff64414d590 0x7ff644066bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:16.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff643fff700 1 --2- 172.21.15.62:0/4019815296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff624004e70 0x7ff64414df90 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7ff63c00d000 tx=0x7ff63c007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:16.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff6417fa700 1 -- 172.21.15.62:0/4019815296 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff63c012780 con 0x7ff624004e70 2021-12-17T18:27:16.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff6417fa700 1 -- 172.21.15.62:0/4019815296 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c0128e0 con 0x7ff624004e70 2021-12-17T18:27:16.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff64a8be700 1 -- 172.21.15.62:0/4019815296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64414c5c0 con 0x7ff624004e70 2021-12-17T18:27:16.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff6417fa700 1 -- 172.21.15.62:0/4019815296 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff63c012c40 con 0x7ff624004e70 2021-12-17T18:27:16.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.297+0000 7ff64a8be700 1 -- 172.21.15.62:0/4019815296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff644156e60 con 0x7ff624004e70 2021-12-17T18:27:16.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.301+0000 7ff64a8be700 1 -- 172.21.15.62:0/4019815296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64414c2b0 con 0x7ff624004e70 2021-12-17T18:27:16.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.301+0000 7ff6417fa700 1 -- 172.21.15.62:0/4019815296 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff63c01d460 con 0x7ff624004e70 2021-12-17T18:27:16.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.301+0000 7ff6417fa700 1 --2- 172.21.15.62:0/4019815296 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6280536d0 0x7ff628055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.301+0000 7ff6417fa700 1 -- 172.21.15.62:0/4019815296 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff63c06bb90 con 0x7ff624004e70 2021-12-17T18:27:16.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.301+0000 7ff6437fe700 1 --2- 172.21.15.62:0/4019815296 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6280536d0 0x7ff628055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.318 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.301+0000 7ff6437fe700 1 --2- 172.21.15.62:0/4019815296 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6280536d0 0x7ff628055b90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7ff62c00d000 tx=0x7ff62c007040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:16.319 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.305+0000 7ff6417fa700 1 -- 172.21.15.62:0/4019815296 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff63c042f20 con 0x7ff624004e70 2021-12-17T18:27:16.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.433+0000 7ff64a8be700 1 -- 172.21.15.62:0/4019815296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6440573d0 con 0x7ff624004e70 2021-12-17T18:27:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.433+0000 7ff6417fa700 1 -- 172.21.15.62:0/4019815296 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+13239 (secure 0 0 0) 0x7ff63c046540 con 0x7ff624004e70 2021-12-17T18:27:16.439 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:16.439 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":127,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:27:15.817572+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:27:16.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.433+0000 7ff64a8be700 1 -- 172.21.15.62:0/4019815296 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6280536d0 msgr2=0x7ff628055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.433+0000 7ff64a8be700 1 --2- 172.21.15.62:0/4019815296 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6280536d0 0x7ff628055b90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7ff62c00d000 tx=0x7ff62c007040).stop 2021-12-17T18:27:16.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.433+0000 7ff64a8be700 1 -- 172.21.15.62:0/4019815296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff624004e70 msgr2=0x7ff64414df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.433+0000 7ff64a8be700 1 --2- 172.21.15.62:0/4019815296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff624004e70 0x7ff64414df90 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7ff63c00d000 tx=0x7ff63c007d80).stop 2021-12-17T18:27:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.437+0000 7ff64a8be700 1 -- 172.21.15.62:0/4019815296 shutdown_connections 2021-12-17T18:27:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.437+0000 7ff64a8be700 1 --2- 172.21.15.62:0/4019815296 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff6280536d0 0x7ff628055b90 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.437+0000 7ff64a8be700 1 --2- 172.21.15.62:0/4019815296 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff64414d590 0x7ff644066bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.437+0000 7ff64a8be700 1 --2- 172.21.15.62:0/4019815296 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff64414c920 0x7ff6440666e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.437+0000 7ff64a8be700 1 --2- 172.21.15.62:0/4019815296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff624004e70 0x7ff64414df90 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.437+0000 7ff64a8be700 1 -- 172.21.15.62:0/4019815296 >> 172.21.15.62:0/4019815296 conn(0x7ff64405f730 msgr2=0x7ff6440b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:16.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.437+0000 7ff64a8be700 1 -- 172.21.15.62:0/4019815296 shutdown_connections 2021-12-17T18:27:16.443 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.437+0000 7ff64a8be700 1 -- 172.21.15.62:0/4019815296 wait complete. 2021-12-17T18:27:16.456 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-12-17T18:27:16.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:27:16.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa67b2b7700 1 Processor -- start 2021-12-17T18:27:16.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa67b2b7700 1 -- start start 2021-12-17T18:27:16.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa67b2b7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6740b5330 0x7fa6740b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa67b2b7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa674147440 0x7fa67405fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa67b2b7700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6740606e0 con 0x7fa6740b07c0 2021-12-17T18:27:16.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa67b2b7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa674141950 con 0x7fa674147440 2021-12-17T18:27:16.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa67b2b7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67405fa10 con 0x7fa6740b5330 2021-12-17T18:27:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa678852700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa6740b07c0 0x7fa674147b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39354/0 (socket says 172.21.15.62:39354) 2021-12-17T18:27:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa678852700 1 -- 172.21.15.62:0/1555000805 learned_addr learned my addr 172.21.15.62:0/1555000805 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa679854700 1 --2- 172.21.15.62:0/1555000805 >> v2:172.21.15.62:3300/0 conn(0x7fa674147440 0x7fa67405fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa679053700 1 --2- 172.21.15.62:0/1555000805 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6740b5330 0x7fa6740b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa66bfff700 1 -- 172.21.15.62:0/1555000805 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320803167 0 0) 0x7fa6740606e0 con 0x7fa6740b07c0 2021-12-17T18:27:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa66bfff700 1 -- 172.21.15.62:0/1555000805 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa658003260 con 0x7fa6740b07c0 2021-12-17T18:27:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa679053700 1 -- 172.21.15.62:0/1555000805 >> v2:172.21.15.62:3300/0 conn(0x7fa674147440 msgr2=0x7fa67405fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:16.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa679053700 1 --2- 172.21.15.62:0/1555000805 >> v2:172.21.15.62:3300/0 conn(0x7fa674147440 0x7fa67405fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa679053700 1 -- 172.21.15.62:0/1555000805 >> v1:172.21.15.62:6789/0 conn(0x7fa6740b07c0 legacy=0x7fa674147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa66bfff700 1 -- 172.21.15.62:0/1555000805 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 201544725 0 0) 0x7fa658003260 con 0x7fa6740b07c0 2021-12-17T18:27:16.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa679053700 1 -- 172.21.15.62:0/1555000805 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa674060980 con 0x7fa6740b5330 2021-12-17T18:27:16.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa679854700 1 --2- 172.21.15.62:0/1555000805 >> v2:172.21.15.62:3300/0 conn(0x7fa674147440 0x7fa67405fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:16.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa679053700 1 --2- 172.21.15.62:0/1555000805 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6740b5330 0x7fa6740b5710 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fa664001800 tx=0x7fa670006df0).ready entity=mon.2 client_cookie=af916b44a9efd094 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:16.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa66bfff700 1 -- 172.21.15.62:0/1555000805 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa664001660 con 0x7fa6740b5330 2021-12-17T18:27:16.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa66bfff700 1 -- 172.21.15.62:0/1555000805 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa670000e90 con 0x7fa6740b5330 2021-12-17T18:27:16.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.561+0000 7fa66bfff700 1 -- 172.21.15.62:0/1555000805 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa670012460 con 0x7fa6740b5330 2021-12-17T18:27:16.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa67b2b7700 1 -- 172.21.15.62:0/1555000805 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6740b5330 msgr2=0x7fa6740b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa67b2b7700 1 --2- 172.21.15.62:0/1555000805 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6740b5330 0x7fa6740b5710 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fa664001800 tx=0x7fa670006df0).stop 2021-12-17T18:27:16.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa67b2b7700 1 -- 172.21.15.62:0/1555000805 shutdown_connections 2021-12-17T18:27:16.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa67b2b7700 1 --2- 172.21.15.62:0/1555000805 >> v2:172.21.15.62:3300/0 conn(0x7fa674147440 0x7fa67405fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa67b2b7700 1 --2- 172.21.15.62:0/1555000805 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6740b5330 0x7fa6740b5710 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa67b2b7700 1 -- 172.21.15.62:0/1555000805 >> 172.21.15.62:0/1555000805 conn(0x7fa67405c750 msgr2=0x7fa67405cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:16.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa67b2b7700 1 -- 172.21.15.62:0/1555000805 shutdown_connections 2021-12-17T18:27:16.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa67b2b7700 1 -- 172.21.15.62:0/1555000805 wait complete. 2021-12-17T18:27:16.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa67b2b7700 1 Processor -- start 2021-12-17T18:27:16.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa67b2b7700 1 -- start start 2021-12-17T18:27:16.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa67b2b7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6740b07c0 0x7fa6741449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa67b2b7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6740b5330 0x7fa674141dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa67b2b7700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa674147440 0x7fa674143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa67b2b7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa674146da0 con 0x7fa6740b07c0 2021-12-17T18:27:16.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa67b2b7700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa674143930 con 0x7fa674147440 2021-12-17T18:27:16.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa67b2b7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa674143b30 con 0x7fa6740b5330 2021-12-17T18:27:16.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa679053700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6740b07c0 0x7fa6741449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa679053700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6740b07c0 0x7fa6741449f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55778/0 (socket says 172.21.15.62:55778) 2021-12-17T18:27:16.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.565+0000 7fa679053700 1 -- 172.21.15.62:0/3987760820 learned_addr learned my addr 172.21.15.62:0/3987760820 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:16.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa678852700 1 --2- 172.21.15.62:0/3987760820 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6740b5330 0x7fa674141dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa679854700 1 --2- 172.21.15.62:0/3987760820 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa674147440 0x7fa674143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.584 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa679053700 1 -- 172.21.15.62:0/3987760820 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6740b5330 msgr2=0x7fa674141dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa679053700 1 --2- 172.21.15.62:0/3987760820 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6740b5330 0x7fa674141dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa679053700 1 -- 172.21.15.62:0/3987760820 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa674147440 msgr2=0x7fa674143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa679053700 1 --2- 172.21.15.62:0/3987760820 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa674147440 0x7fa674143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa679053700 1 -- 172.21.15.62:0/3987760820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c009470 con 0x7fa6740b07c0 2021-12-17T18:27:16.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa678852700 1 --2- 172.21.15.62:0/3987760820 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6740b5330 0x7fa674141dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:27:16.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa679854700 1 --2- 172.21.15.62:0/3987760820 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa674147440 0x7fa674143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:27:16.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa679053700 1 --2- 172.21.15.62:0/3987760820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6740b07c0 0x7fa6741449f0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7fa664001800 tx=0x7fa670014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:16.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa66a7fc700 1 -- 172.21.15.62:0/3987760820 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa670016070 con 0x7fa6740b07c0 2021-12-17T18:27:16.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa66a7fc700 1 -- 172.21.15.62:0/3987760820 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67000bec0 con 0x7fa6740b07c0 2021-12-17T18:27:16.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa67b2b7700 1 -- 172.21.15.62:0/3987760820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67000b180 con 0x7fa6740b07c0 2021-12-17T18:27:16.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa66a7fc700 1 -- 172.21.15.62:0/3987760820 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa67000dea0 con 0x7fa6740b07c0 2021-12-17T18:27:16.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa67b2b7700 1 -- 172.21.15.62:0/3987760820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa674140600 con 0x7fa6740b07c0 2021-12-17T18:27:16.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa67b2b7700 1 -- 172.21.15.62:0/3987760820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa674143cf0 con 0x7fa6740b07c0 2021-12-17T18:27:16.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa66a7fc700 1 -- 172.21.15.62:0/3987760820 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa670025030 con 0x7fa6740b07c0 2021-12-17T18:27:16.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.569+0000 7fa66a7fc700 1 --2- 172.21.15.62:0/3987760820 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa65c0536d0 0x7fa65c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.573+0000 7fa66a7fc700 1 -- 172.21.15.62:0/3987760820 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa67006c5f0 con 0x7fa6740b07c0 2021-12-17T18:27:16.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.573+0000 7fa678852700 1 --2- 172.21.15.62:0/3987760820 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa65c0536d0 0x7fa65c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.573+0000 7fa678852700 1 --2- 172.21.15.62:0/3987760820 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa65c0536d0 0x7fa65c055b90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fa664008000 tx=0x7fa664009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:16.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.577+0000 7fa66a7fc700 1 -- 172.21.15.62:0/3987760820 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa674143cf0 con 0x7fa6740b07c0 2021-12-17T18:27:16.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.701+0000 7fa67b2b7700 1 -- 172.21.15.62:0/3987760820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa674143cf0 con 0x7fa6740b07c0 2021-12-17T18:27:16.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.705+0000 7fa66a7fc700 1 -- 172.21.15.62:0/3987760820 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v127) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa674143cf0 con 0x7fa6740b07c0 2021-12-17T18:27:16.710 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:27:16.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.705+0000 7fa67b2b7700 1 -- 172.21.15.62:0/3987760820 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa65c0536d0 msgr2=0x7fa65c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.705+0000 7fa67b2b7700 1 --2- 172.21.15.62:0/3987760820 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa65c0536d0 0x7fa65c055b90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fa664008000 tx=0x7fa664009040).stop 2021-12-17T18:27:16.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.705+0000 7fa67b2b7700 1 -- 172.21.15.62:0/3987760820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6740b07c0 msgr2=0x7fa6741449f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.705+0000 7fa67b2b7700 1 --2- 172.21.15.62:0/3987760820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6740b07c0 0x7fa6741449f0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7fa664001800 tx=0x7fa670014000).stop 2021-12-17T18:27:16.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.705+0000 7fa67b2b7700 1 -- 172.21.15.62:0/3987760820 shutdown_connections 2021-12-17T18:27:16.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.705+0000 7fa67b2b7700 1 --2- 172.21.15.62:0/3987760820 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa65c0536d0 0x7fa65c055b90 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.705+0000 7fa67b2b7700 1 --2- 172.21.15.62:0/3987760820 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa674147440 0x7fa674143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.705+0000 7fa67b2b7700 1 --2- 172.21.15.62:0/3987760820 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa6740b5330 0x7fa674141dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.709+0000 7fa67b2b7700 1 --2- 172.21.15.62:0/3987760820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6740b07c0 0x7fa6741449f0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.709+0000 7fa67b2b7700 1 -- 172.21.15.62:0/3987760820 >> 172.21.15.62:0/3987760820 conn(0x7fa67405c750 msgr2=0x7fa674149d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:16.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.709+0000 7fa67b2b7700 1 -- 172.21.15.62:0/3987760820 shutdown_connections 2021-12-17T18:27:16.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.709+0000 7fa67b2b7700 1 -- 172.21.15.62:0/3987760820 wait complete. 2021-12-17T18:27:16.727 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:27:16.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92f59e700 1 Processor -- start 2021-12-17T18:27:16.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92f59e700 1 -- start start 2021-12-17T18:27:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92f59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb93005ca90 0x7fb9300b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9300b3540 0x7fb9300b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92f59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93005ce70 con 0x7fb9300b4230 2021-12-17T18:27:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92f59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9300b1bc0 con 0x7fb93005ca90 2021-12-17T18:27:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9300b1e60 con 0x7fb9300b3540 2021-12-17T18:27:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92ed9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb9300b4230 0x7fb9300b5460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39370/0 (socket says 172.21.15.62:39370) 2021-12-17T18:27:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92ed9d700 1 -- 172.21.15.62:0/4239800987 learned_addr learned my addr 172.21.15.62:0/4239800987 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:16.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92e59c700 1 --2- 172.21.15.62:0/4239800987 >> v2:172.21.15.62:3300/0 conn(0x7fb93005ca90 0x7fb9300b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92dd9b700 1 --2- 172.21.15.62:0/4239800987 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9300b3540 0x7fb9300b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92d59a700 1 -- 172.21.15.62:0/4239800987 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445775059 0 0) 0x7fb93005ce70 con 0x7fb9300b4230 2021-12-17T18:27:16.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92d59a700 1 -- 172.21.15.62:0/4239800987 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb910003260 con 0x7fb9300b4230 2021-12-17T18:27:16.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92d59a700 1 -- 172.21.15.62:0/4239800987 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2018859455 0 0) 0x7fb910003260 con 0x7fb9300b4230 2021-12-17T18:27:16.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92d59a700 1 -- 172.21.15.62:0/4239800987 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9300b3540 msgr2=0x7fb9300b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:16.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92d59a700 1 --2- 172.21.15.62:0/4239800987 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9300b3540 0x7fb9300b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92d59a700 1 -- 172.21.15.62:0/4239800987 >> v2:172.21.15.62:3300/0 conn(0x7fb93005ca90 msgr2=0x7fb9300b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:16.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92d59a700 1 --2- 172.21.15.62:0/4239800987 >> v2:172.21.15.62:3300/0 conn(0x7fb93005ca90 0x7fb9300b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92d59a700 1 -- 172.21.15.62:0/4239800987 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9300b2100 con 0x7fb9300b4230 2021-12-17T18:27:16.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92d59a700 1 -- 172.21.15.62:0/4239800987 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fb9280019e0 con 0x7fb9300b4230 2021-12-17T18:27:16.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92d59a700 1 -- 172.21.15.62:0/4239800987 >> v1:172.21.15.62:6789/0 conn(0x7fb9300b4230 legacy=0x7fb9300b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.829+0000 7fb92d59a700 1 --2- 172.21.15.62:0/4239800987 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9300b3540 0x7fb910003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92d59a700 1 --2- 172.21.15.62:0/4239800987 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb910003c80 0x7fb910004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92d59a700 1 --2- 172.21.15.62:0/4239800987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9100049f0 0x7fb910004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92d59a700 1 -- 172.21.15.62:0/4239800987 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9300b1bc0 con 0x7fb9100049f0 2021-12-17T18:27:16.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92d59a700 1 -- 172.21.15.62:0/4239800987 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9300b1e60 con 0x7fb910003c80 2021-12-17T18:27:16.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92d59a700 1 -- 172.21.15.62:0/4239800987 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91000b750 con 0x7fb9300b3540 2021-12-17T18:27:16.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92e59c700 1 --2- 172.21.15.62:0/4239800987 >> v2:172.21.15.62:3300/0 conn(0x7fb93005ca90 0x7fb9300b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:16.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92ed9d700 1 --2- 172.21.15.62:0/4239800987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9100049f0 0x7fb910004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92dd9b700 1 --2- 172.21.15.62:0/4239800987 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb910003c80 0x7fb910004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92ed9d700 1 -- 172.21.15.62:0/4239800987 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9300b3540 msgr2=0x7fb910003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:16.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92ed9d700 1 --2- 172.21.15.62:0/4239800987 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9300b3540 0x7fb910003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-12-17T18:27:16.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92ed9d700 1 -- 172.21.15.62:0/4239800987 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb910003c80 msgr2=0x7fb910004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:16.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92ed9d700 1 --2- 172.21.15.62:0/4239800987 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb910003c80 0x7fb910004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92ed9d700 1 -- 172.21.15.62:0/4239800987 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb910003260 con 0x7fb9100049f0 2021-12-17T18:27:16.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92dd9b700 1 --2- 172.21.15.62:0/4239800987 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb910003c80 0x7fb910004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:16.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92ed9d700 1 --2- 172.21.15.62:0/4239800987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9100049f0 0x7fb910004e70 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7fb9100054d0 tx=0x7fb9280021d0).ready entity=mon.0 client_cookie=6e38f551020115b8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:16.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92d59a700 1 -- 172.21.15.62:0/4239800987 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb92800cc70 con 0x7fb9100049f0 2021-12-17T18:27:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92d59a700 1 -- 172.21.15.62:0/4239800987 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92800cdd0 con 0x7fb9100049f0 2021-12-17T18:27:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92d59a700 1 -- 172.21.15.62:0/4239800987 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb928005b80 con 0x7fb9100049f0 2021-12-17T18:27:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92f59e700 1 -- 172.21.15.62:0/4239800987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9100049f0 msgr2=0x7fb910004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92f59e700 1 --2- 172.21.15.62:0/4239800987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9100049f0 0x7fb910004e70 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7fb9100054d0 tx=0x7fb9280021d0).stop 2021-12-17T18:27:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92ed9d700 1 -- 172.21.15.62:0/4239800987 reap_dead start 2021-12-17T18:27:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92f59e700 1 -- 172.21.15.62:0/4239800987 shutdown_connections 2021-12-17T18:27:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92f59e700 1 -- 172.21.15.62:0/4239800987 >> 172.21.15.62:0/4239800987 conn(0x7fb93005bcd0 msgr2=0x7fb930062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92f59e700 1 -- 172.21.15.62:0/4239800987 shutdown_connections 2021-12-17T18:27:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92f59e700 1 -- 172.21.15.62:0/4239800987 wait complete. 2021-12-17T18:27:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92f59e700 1 Processor -- start 2021-12-17T18:27:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.833+0000 7fb92f59e700 1 -- start start 2021-12-17T18:27:16.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92f59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9100049f0 0x7fb930143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb930145810 0x7fb930147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9300668f0 0x7fb930066d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9301462d0 con 0x7fb930145810 2021-12-17T18:27:16.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92f59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9300664c0 con 0x7fb9100049f0 2021-12-17T18:27:16.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb930148120 con 0x7fb9300668f0 2021-12-17T18:27:16.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb930145810 0x7fb930147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb930145810 0x7fb930147c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55800/0 (socket says 172.21.15.62:55800) 2021-12-17T18:27:16.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92dd9b700 1 -- 172.21.15.62:0/1593808194 learned_addr learned my addr 172.21.15.62:0/1593808194 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92e59c700 1 --2- 172.21.15.62:0/1593808194 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9100049f0 0x7fb930143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92ed9d700 1 --2- 172.21.15.62:0/1593808194 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9300668f0 0x7fb930066d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92dd9b700 1 -- 172.21.15.62:0/1593808194 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9300668f0 msgr2=0x7fb930066d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92dd9b700 1 --2- 172.21.15.62:0/1593808194 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9300668f0 0x7fb930066d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92dd9b700 1 -- 172.21.15.62:0/1593808194 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9100049f0 msgr2=0x7fb930143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92dd9b700 1 --2- 172.21.15.62:0/1593808194 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9100049f0 0x7fb930143f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92dd9b700 1 -- 172.21.15.62:0/1593808194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb930145d90 con 0x7fb930145810 2021-12-17T18:27:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92dd9b700 1 --2- 172.21.15.62:0/1593808194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb930145810 0x7fb930147c30 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7fb920006000 tx=0x7fb920008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:16.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb9277fe700 1 -- 172.21.15.62:0/1593808194 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb920012610 con 0x7fb930145810 2021-12-17T18:27:16.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92f59e700 1 -- 172.21.15.62:0/1593808194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb930146030 con 0x7fb930145810 2021-12-17T18:27:16.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb9277fe700 1 -- 172.21.15.62:0/1593808194 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb920012770 con 0x7fb930145810 2021-12-17T18:27:16.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92f59e700 1 -- 172.21.15.62:0/1593808194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb930155980 con 0x7fb930145810 2021-12-17T18:27:16.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb9277fe700 1 -- 172.21.15.62:0/1593808194 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb920012ad0 con 0x7fb930145810 2021-12-17T18:27:16.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb92f59e700 1 -- 172.21.15.62:0/1593808194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9300603f0 con 0x7fb930145810 2021-12-17T18:27:16.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.837+0000 7fb9277fe700 1 -- 172.21.15.62:0/1593808194 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb920012c30 con 0x7fb930145810 2021-12-17T18:27:16.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.841+0000 7fb9277fe700 1 --2- 172.21.15.62:0/1593808194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb914053610 0x7fb914055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:16.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.841+0000 7fb9277fe700 1 -- 172.21.15.62:0/1593808194 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb92006c0a0 con 0x7fb930145810 2021-12-17T18:27:16.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.841+0000 7fb92e59c700 1 --2- 172.21.15.62:0/1593808194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb914053610 0x7fb914055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:16.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.841+0000 7fb92e59c700 1 --2- 172.21.15.62:0/1593808194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb914053610 0x7fb914055ad0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fb91800b000 tx=0x7fb918008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:16.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.845+0000 7fb9277fe700 1 -- 172.21.15.62:0/1593808194 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb920043430 con 0x7fb930145810 2021-12-17T18:27:16.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.977+0000 7fb92f59e700 1 -- 172.21.15.62:0/1593808194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb9300573d0 con 0x7fb930145810 2021-12-17T18:27:16.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.977+0000 7fb9277fe700 1 -- 172.21.15.62:0/1593808194 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v127) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb920046a50 con 0x7fb930145810 2021-12-17T18:27:16.984 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:27:16.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.981+0000 7fb92f59e700 1 -- 172.21.15.62:0/1593808194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb914053610 msgr2=0x7fb914055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.981+0000 7fb92f59e700 1 --2- 172.21.15.62:0/1593808194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb914053610 0x7fb914055ad0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fb91800b000 tx=0x7fb918008040).stop 2021-12-17T18:27:16.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.981+0000 7fb92f59e700 1 -- 172.21.15.62:0/1593808194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb930145810 msgr2=0x7fb930147c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:16.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.981+0000 7fb92f59e700 1 --2- 172.21.15.62:0/1593808194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb930145810 0x7fb930147c30 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7fb920006000 tx=0x7fb920008040).stop 2021-12-17T18:27:16.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.981+0000 7fb92f59e700 1 -- 172.21.15.62:0/1593808194 shutdown_connections 2021-12-17T18:27:16.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.981+0000 7fb92f59e700 1 --2- 172.21.15.62:0/1593808194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb914053610 0x7fb914055ad0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.981+0000 7fb92f59e700 1 --2- 172.21.15.62:0/1593808194 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9300668f0 0x7fb930066d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.981+0000 7fb92f59e700 1 --2- 172.21.15.62:0/1593808194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb930145810 0x7fb930147c30 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.981+0000 7fb92f59e700 1 --2- 172.21.15.62:0/1593808194 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9100049f0 0x7fb930143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:16.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.981+0000 7fb92f59e700 1 -- 172.21.15.62:0/1593808194 >> 172.21.15.62:0/1593808194 conn(0x7fb93005bcd0 msgr2=0x7fb9300b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:16.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.981+0000 7fb92f59e700 1 -- 172.21.15.62:0/1593808194 shutdown_connections 2021-12-17T18:27:16.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:16.981+0000 7fb92f59e700 1 -- 172.21.15.62:0/1593808194 wait complete. 2021-12-17T18:27:16.996 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-12-17T18:27:17.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.089+0000 7fc54f59e700 1 Processor -- start 2021-12-17T18:27:17.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.089+0000 7fc54f59e700 1 -- start start 2021-12-17T18:27:17.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54f59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc5500b5b20 0x7fc5500b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:17.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5501458d0 0x7fc550145d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:17.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54f59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5500b5f00 con 0x7fc5500b3760 2021-12-17T18:27:17.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54f59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5500b3020 con 0x7fc5500b5b20 2021-12-17T18:27:17.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5500b32c0 con 0x7fc5501458d0 2021-12-17T18:27:17.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54dd9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc5500b3760 0x7fc5500b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39390/0 (socket says 172.21.15.62:39390) 2021-12-17T18:27:17.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54e59c700 1 --2- 172.21.15.62:0/842042554 >> v2:172.21.15.109:3300/0 conn(0x7fc5500b5b20 0x7fc5500b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:17.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54dd9b700 1 -- 172.21.15.62:0/842042554 learned_addr learned my addr 172.21.15.62:0/842042554 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:17.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54ed9d700 1 --2- 172.21.15.62:0/842042554 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5501458d0 0x7fc550145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54d59a700 1 -- 172.21.15.62:0/842042554 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988775095 0 0) 0x7fc5500b5f00 con 0x7fc5500b3760 2021-12-17T18:27:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54d59a700 1 -- 172.21.15.62:0/842042554 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc534003260 con 0x7fc5500b3760 2021-12-17T18:27:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54ed9d700 1 -- 172.21.15.62:0/842042554 >> v2:172.21.15.109:3300/0 conn(0x7fc5500b5b20 msgr2=0x7fc5500b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54ed9d700 1 --2- 172.21.15.62:0/842042554 >> v2:172.21.15.109:3300/0 conn(0x7fc5500b5b20 0x7fc5500b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54ed9d700 1 -- 172.21.15.62:0/842042554 >> v1:172.21.15.62:6789/0 conn(0x7fc5500b3760 legacy=0x7fc5500b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54ed9d700 1 -- 172.21.15.62:0/842042554 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5500b6e90 con 0x7fc5501458d0 2021-12-17T18:27:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54e59c700 1 --2- 172.21.15.62:0/842042554 >> v2:172.21.15.109:3300/0 conn(0x7fc5500b5b20 0x7fc5500b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54ed9d700 1 --2- 172.21.15.62:0/842042554 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5501458d0 0x7fc550145d20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fc5480032f0 tx=0x7fc5480091d0).ready entity=mon.2 client_cookie=902e9dc90839d68a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:17.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54d59a700 1 -- 172.21.15.62:0/842042554 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc54800b600 con 0x7fc5501458d0 2021-12-17T18:27:17.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54d59a700 1 -- 172.21.15.62:0/842042554 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54800b760 con 0x7fc5501458d0 2021-12-17T18:27:17.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54d59a700 1 -- 172.21.15.62:0/842042554 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc54800b8d0 con 0x7fc5501458d0 2021-12-17T18:27:17.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54f59e700 1 -- 172.21.15.62:0/842042554 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5501458d0 msgr2=0x7fc550145d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:17.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.093+0000 7fc54f59e700 1 --2- 172.21.15.62:0/842042554 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5501458d0 0x7fc550145d20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fc5480032f0 tx=0x7fc5480091d0).stop 2021-12-17T18:27:17.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.097+0000 7fc54f59e700 1 -- 172.21.15.62:0/842042554 shutdown_connections 2021-12-17T18:27:17.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.097+0000 7fc54f59e700 1 --2- 172.21.15.62:0/842042554 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5501458d0 0x7fc550145d20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:17.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.097+0000 7fc54f59e700 1 --2- 172.21.15.62:0/842042554 >> v2:172.21.15.109:3300/0 conn(0x7fc5500b5b20 0x7fc5500b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:17.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.097+0000 7fc54f59e700 1 -- 172.21.15.62:0/842042554 >> 172.21.15.62:0/842042554 conn(0x7fc55005c750 msgr2=0x7fc55005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:17.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.097+0000 7fc54f59e700 1 -- 172.21.15.62:0/842042554 shutdown_connections 2021-12-17T18:27:17.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.097+0000 7fc54f59e700 1 -- 172.21.15.62:0/842042554 wait complete. 2021-12-17T18:27:17.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.097+0000 7fc54f59e700 1 Processor -- start 2021-12-17T18:27:17.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.097+0000 7fc54f59e700 1 -- start start 2021-12-17T18:27:17.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.097+0000 7fc54f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5500b5b20 0x7fc5500b99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:17.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.097+0000 7fc54f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5501458d0 0x7fc550152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:17.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.097+0000 7fc54f59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc5500635e0 0x7fc550063a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:17.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.097+0000 7fc54f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5500ba6d0 con 0x7fc5500b5b20 2021-12-17T18:27:17.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.097+0000 7fc54f59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc550152740 con 0x7fc5500635e0 2021-12-17T18:27:17.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.097+0000 7fc54f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5500631b0 con 0x7fc5501458d0 2021-12-17T18:27:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.097+0000 7fc54e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5500b5b20 0x7fc5500b99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc54e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5500b5b20 0x7fc5500b99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55812/0 (socket says 172.21.15.62:55812) 2021-12-17T18:27:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc54e59c700 1 -- 172.21.15.62:0/1586183302 learned_addr learned my addr 172.21.15.62:0/1586183302 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc54ed9d700 1 --2- 172.21.15.62:0/1586183302 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc5500635e0 0x7fc550063a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc54dd9b700 1 --2- 172.21.15.62:0/1586183302 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5501458d0 0x7fc550152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:17.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc54e59c700 1 -- 172.21.15.62:0/1586183302 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5501458d0 msgr2=0x7fc550152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:17.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc54e59c700 1 --2- 172.21.15.62:0/1586183302 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5501458d0 0x7fc550152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:17.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc54e59c700 1 -- 172.21.15.62:0/1586183302 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc5500635e0 msgr2=0x7fc550063a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:17.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc54e59c700 1 --2- 172.21.15.62:0/1586183302 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc5500635e0 0x7fc550063a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc54e59c700 1 -- 172.21.15.62:0/1586183302 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54000b180 con 0x7fc5500b5b20 2021-12-17T18:27:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc54dd9b700 1 --2- 172.21.15.62:0/1586183302 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5501458d0 0x7fc550152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc54e59c700 1 --2- 172.21.15.62:0/1586183302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5500b5b20 0x7fc5500b99f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fc54000c000 tx=0x7fc540006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc53f7fe700 1 -- 172.21.15.62:0/1586183302 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc54000c7e0 con 0x7fc5500b5b20 2021-12-17T18:27:17.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc53f7fe700 1 -- 172.21.15.62:0/1586183302 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54000c940 con 0x7fc5500b5b20 2021-12-17T18:27:17.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc53f7fe700 1 -- 172.21.15.62:0/1586183302 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc54000cca0 con 0x7fc5500b5b20 2021-12-17T18:27:17.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc54f59e700 1 -- 172.21.15.62:0/1586183302 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc548009470 con 0x7fc5500b5b20 2021-12-17T18:27:17.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc54f59e700 1 -- 172.21.15.62:0/1586183302 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc550063f50 con 0x7fc5500b5b20 2021-12-17T18:27:17.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc54f59e700 1 -- 172.21.15.62:0/1586183302 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5500632f0 con 0x7fc5500b5b20 2021-12-17T18:27:17.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.101+0000 7fc53f7fe700 1 -- 172.21.15.62:0/1586183302 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc54001c460 con 0x7fc5500b5b20 2021-12-17T18:27:17.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.105+0000 7fc53f7fe700 1 --2- 172.21.15.62:0/1586183302 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc52c053520 0x7fc52c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:17.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.105+0000 7fc53f7fe700 1 -- 172.21.15.62:0/1586183302 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc54006bc40 con 0x7fc5500b5b20 2021-12-17T18:27:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.105+0000 7fc54dd9b700 1 --2- 172.21.15.62:0/1586183302 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc52c053520 0x7fc52c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.105+0000 7fc54dd9b700 1 --2- 172.21.15.62:0/1586183302 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc52c053520 0x7fc52c0559e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fc54400d000 tx=0x7fc544009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:17.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.113+0000 7fc53f7fe700 1 -- 172.21.15.62:0/1586183302 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc540042f60 con 0x7fc5500b5b20 2021-12-17T18:27:17.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.241+0000 7fc54f59e700 1 -- 172.21.15.62:0/1586183302 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc5500573d0 con 0x7fc5500b5b20 2021-12-17T18:27:17.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.245+0000 7fc53f7fe700 1 -- 172.21.15.62:0/1586183302 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v127) v1 ==== 84+0+143 (secure 0 0 0) 0x7fc540046580 con 0x7fc5500b5b20 2021-12-17T18:27:17.249 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:17.249 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2021-12-17T18:27:17.249 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:17.249 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2021-12-17T18:27:17.250 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "device_health_metrics" 2021-12-17T18:27:17.250 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:17.250 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:17.250 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2021-12-17T18:27:17.251 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2021-12-17T18:27:17.251 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:17.251 INFO:teuthology.orchestra.run.smithi062.stdout:] 2021-12-17T18:27:17.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.245+0000 7fc54f59e700 1 -- 172.21.15.62:0/1586183302 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc52c053520 msgr2=0x7fc52c0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:17.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.245+0000 7fc54f59e700 1 --2- 172.21.15.62:0/1586183302 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc52c053520 0x7fc52c0559e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fc54400d000 tx=0x7fc544009040).stop 2021-12-17T18:27:17.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.245+0000 7fc54f59e700 1 -- 172.21.15.62:0/1586183302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5500b5b20 msgr2=0x7fc5500b99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:17.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.245+0000 7fc54f59e700 1 --2- 172.21.15.62:0/1586183302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5500b5b20 0x7fc5500b99f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fc54000c000 tx=0x7fc540006df0).stop 2021-12-17T18:27:17.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.245+0000 7fc54f59e700 1 -- 172.21.15.62:0/1586183302 shutdown_connections 2021-12-17T18:27:17.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.245+0000 7fc54f59e700 1 --2- 172.21.15.62:0/1586183302 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc52c053520 0x7fc52c0559e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:17.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.245+0000 7fc54f59e700 1 --2- 172.21.15.62:0/1586183302 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc5500635e0 0x7fc550063a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:17.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.245+0000 7fc54f59e700 1 --2- 172.21.15.62:0/1586183302 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc5501458d0 0x7fc550152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:17.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.245+0000 7fc54f59e700 1 --2- 172.21.15.62:0/1586183302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5500b5b20 0x7fc5500b99f0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:17.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.245+0000 7fc54f59e700 1 -- 172.21.15.62:0/1586183302 >> 172.21.15.62:0/1586183302 conn(0x7fc55005c750 msgr2=0x7fc5500b60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:17.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.245+0000 7fc54f59e700 1 -- 172.21.15.62:0/1586183302 shutdown_connections 2021-12-17T18:27:17.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.245+0000 7fc54f59e700 1 -- 172.21.15.62:0/1586183302 wait complete. 2021-12-17T18:27:17.262 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-12-17T18:27:17.262 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-12-17T18:27:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.365+0000 7f54377b3700 1 Processor -- start 2021-12-17T18:27:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.365+0000 7f54377b3700 1 -- start start 2021-12-17T18:27:17.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f54377b3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54300b3a40 0x7f54300aabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:17.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f54377b3700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f54300b2ee0 0x7f5430142410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:17.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f54377b3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5430063c60 con 0x7f5430063880 2021-12-17T18:27:17.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f54377b3700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5430146840 con 0x7f54300b2ee0 2021-12-17T18:27:17.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f54377b3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54300b6e50 con 0x7f54300b3a40 2021-12-17T18:27:17.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f543554f700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5430063880 0x7f54300aa4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39400/0 (socket says 172.21.15.62:39400) 2021-12-17T18:27:17.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f543554f700 1 -- 172.21.15.62:0/3600466090 learned_addr learned my addr 172.21.15.62:0/3600466090 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:17.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f5434d4e700 1 --2- 172.21.15.62:0/3600466090 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54300b3a40 0x7f54300aabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:17.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f5435d50700 1 --2- 172.21.15.62:0/3600466090 >> v2:172.21.15.109:3300/0 conn(0x7f54300b2ee0 0x7f5430142410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:17.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f541bfff700 1 -- 172.21.15.62:0/3600466090 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607634227 0 0) 0x7f5430063c60 con 0x7f5430063880 2021-12-17T18:27:17.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f541bfff700 1 -- 172.21.15.62:0/3600466090 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5414003260 con 0x7f5430063880 2021-12-17T18:27:17.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f5434d4e700 1 -- 172.21.15.62:0/3600466090 >> v2:172.21.15.109:3300/0 conn(0x7f54300b2ee0 msgr2=0x7f5430142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:17.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f5434d4e700 1 --2- 172.21.15.62:0/3600466090 >> v2:172.21.15.109:3300/0 conn(0x7f54300b2ee0 0x7f5430142410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:17.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f5434d4e700 1 -- 172.21.15.62:0/3600466090 >> v1:172.21.15.62:6789/0 conn(0x7f5430063880 legacy=0x7f54300aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:17.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f5434d4e700 1 -- 172.21.15.62:0/3600466090 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54300b70f0 con 0x7f54300b3a40 2021-12-17T18:27:17.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f5435d50700 1 --2- 172.21.15.62:0/3600466090 >> v2:172.21.15.109:3300/0 conn(0x7f54300b2ee0 0x7f5430142410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:17.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f5434d4e700 1 --2- 172.21.15.62:0/3600466090 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54300b3a40 0x7f54300aabb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f5424002f70 tx=0x7f5424006df0).ready entity=mon.2 client_cookie=1b106fa9bbe4a28e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:17.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f541bfff700 1 -- 172.21.15.62:0/3600466090 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542400d4a0 con 0x7f54300b3a40 2021-12-17T18:27:17.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f541bfff700 1 -- 172.21.15.62:0/3600466090 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5424000e90 con 0x7f54300b3a40 2021-12-17T18:27:17.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f541bfff700 1 -- 172.21.15.62:0/3600466090 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542400d7f0 con 0x7f54300b3a40 2021-12-17T18:27:17.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f54377b3700 1 -- 172.21.15.62:0/3600466090 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54300b3a40 msgr2=0x7f54300aabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:17.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f54377b3700 1 --2- 172.21.15.62:0/3600466090 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54300b3a40 0x7f54300aabb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f5424002f70 tx=0x7f5424006df0).stop 2021-12-17T18:27:17.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f54377b3700 1 -- 172.21.15.62:0/3600466090 shutdown_connections 2021-12-17T18:27:17.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f54377b3700 1 --2- 172.21.15.62:0/3600466090 >> v2:172.21.15.109:3300/0 conn(0x7f54300b2ee0 0x7f5430142410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:17.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f54377b3700 1 --2- 172.21.15.62:0/3600466090 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54300b3a40 0x7f54300aabb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:17.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f54377b3700 1 -- 172.21.15.62:0/3600466090 >> 172.21.15.62:0/3600466090 conn(0x7f54300625b0 msgr2=0x7f5430062990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:17.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f54377b3700 1 -- 172.21.15.62:0/3600466090 shutdown_connections 2021-12-17T18:27:17.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.369+0000 7f54377b3700 1 -- 172.21.15.62:0/3600466090 wait complete. 2021-12-17T18:27:17.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f54377b3700 1 Processor -- start 2021-12-17T18:27:17.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f54377b3700 1 -- start start 2021-12-17T18:27:17.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f54377b3700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5430063880 0x7f54300ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:17.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f54377b3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54300b2ee0 0x7f54300aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:17.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f54377b3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54300b3a40 0x7f54300ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:17.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f54377b3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54300ae090 con 0x7f54300b3a40 2021-12-17T18:27:17.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f54377b3700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54301567a0 con 0x7f5430063880 2021-12-17T18:27:17.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f54377b3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5430152400 con 0x7f54300b2ee0 2021-12-17T18:27:17.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f5435d50700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54300b3a40 0x7f54300ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:17.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f5435d50700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54300b3a40 0x7f54300ae470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55830/0 (socket says 172.21.15.62:55830) 2021-12-17T18:27:17.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f5435d50700 1 -- 172.21.15.62:0/2022712549 learned_addr learned my addr 172.21.15.62:0/2022712549 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:17.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f5434d4e700 1 --2- 172.21.15.62:0/2022712549 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54300b2ee0 0x7f54300aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:17.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f543554f700 1 --2- 172.21.15.62:0/2022712549 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5430063880 0x7f54300ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:17.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f5435d50700 1 -- 172.21.15.62:0/2022712549 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54300b2ee0 msgr2=0x7f54300aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:17.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f5435d50700 1 --2- 172.21.15.62:0/2022712549 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54300b2ee0 0x7f54300aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:17.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f5435d50700 1 -- 172.21.15.62:0/2022712549 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5430063880 msgr2=0x7f54300ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:17.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f5435d50700 1 --2- 172.21.15.62:0/2022712549 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5430063880 0x7f54300ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:17.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f5435d50700 1 -- 172.21.15.62:0/2022712549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5428009470 con 0x7f54300b3a40 2021-12-17T18:27:17.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f5434d4e700 1 --2- 172.21.15.62:0/2022712549 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54300b2ee0 0x7f54300aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:17.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f5435d50700 1 --2- 172.21.15.62:0/2022712549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54300b3a40 0x7f54300ae470 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f542800c000 tx=0x7f54280091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:17.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f5422ffd700 1 -- 172.21.15.62:0/2022712549 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542800c9d0 con 0x7f54300b3a40 2021-12-17T18:27:17.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f5422ffd700 1 -- 172.21.15.62:0/2022712549 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542800cb30 con 0x7f54300b3a40 2021-12-17T18:27:17.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f54377b3700 1 -- 172.21.15.62:0/2022712549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542400b180 con 0x7f54300b3a40 2021-12-17T18:27:17.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f5422ffd700 1 -- 172.21.15.62:0/2022712549 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542800ce90 con 0x7f54300b3a40 2021-12-17T18:27:17.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.373+0000 7f54377b3700 1 -- 172.21.15.62:0/2022712549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54300ae960 con 0x7f54300b3a40 2021-12-17T18:27:17.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.377+0000 7f5422ffd700 1 -- 172.21.15.62:0/2022712549 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5428022070 con 0x7f54300b3a40 2021-12-17T18:27:17.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.377+0000 7f54377b3700 1 -- 172.21.15.62:0/2022712549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5430156610 con 0x7f54300b3a40 2021-12-17T18:27:17.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.377+0000 7f5422ffd700 1 --2- 172.21.15.62:0/2022712549 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f540c0536a0 0x7f540c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:17.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.377+0000 7f5422ffd700 1 -- 172.21.15.62:0/2022712549 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f542806bf10 con 0x7f54300b3a40 2021-12-17T18:27:17.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.377+0000 7f543554f700 1 --2- 172.21.15.62:0/2022712549 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f540c0536a0 0x7f540c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:17.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.377+0000 7f543554f700 1 --2- 172.21.15.62:0/2022712549 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f540c0536a0 0x7f540c055b60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f542c00b000 tx=0x7f542c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:17.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.385+0000 7f5422ffd700 1 -- 172.21.15.62:0/2022712549 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f54280433a0 con 0x7f54300b3a40 2021-12-17T18:27:17.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:17.513+0000 7f54377b3700 1 -- 172.21.15.62:0/2022712549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f54300b1ac0 con 0x7f54300b3a40 2021-12-17T18:27:18.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.509+0000 7f5422ffd700 1 -- 172.21.15.62:0/2022712549 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v128) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5428016020 con 0x7f54300b3a40 2021-12-17T18:27:18.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.513+0000 7f54377b3700 1 -- 172.21.15.62:0/2022712549 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f540c0536a0 msgr2=0x7f540c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:18.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.513+0000 7f54377b3700 1 --2- 172.21.15.62:0/2022712549 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f540c0536a0 0x7f540c055b60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f542c00b000 tx=0x7f542c009040).stop 2021-12-17T18:27:18.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.513+0000 7f54377b3700 1 -- 172.21.15.62:0/2022712549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54300b3a40 msgr2=0x7f54300ae470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:18.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.513+0000 7f54377b3700 1 --2- 172.21.15.62:0/2022712549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54300b3a40 0x7f54300ae470 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f542800c000 tx=0x7f54280091d0).stop 2021-12-17T18:27:18.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.513+0000 7f54377b3700 1 -- 172.21.15.62:0/2022712549 shutdown_connections 2021-12-17T18:27:18.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.513+0000 7f54377b3700 1 --2- 172.21.15.62:0/2022712549 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f540c0536a0 0x7f540c055b60 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:18.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.513+0000 7f54377b3700 1 --2- 172.21.15.62:0/2022712549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54300b3a40 0x7f54300ae470 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:18.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.513+0000 7f54377b3700 1 --2- 172.21.15.62:0/2022712549 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54300b2ee0 0x7f54300aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:18.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.513+0000 7f54377b3700 1 --2- 172.21.15.62:0/2022712549 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5430063880 0x7f54300ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:18.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.513+0000 7f54377b3700 1 -- 172.21.15.62:0/2022712549 >> 172.21.15.62:0/2022712549 conn(0x7f54300625b0 msgr2=0x7f5430148200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:18.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.517+0000 7f54377b3700 1 -- 172.21.15.62:0/2022712549 shutdown_connections 2021-12-17T18:27:18.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.517+0000 7f54377b3700 1 -- 172.21.15.62:0/2022712549 wait complete. 2021-12-17T18:27:18.524 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2021-12-17T18:27:18.534 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-12-17T18:27:18.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b67591700 1 Processor -- start 2021-12-17T18:27:18.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b67591700 1 -- start start 2021-12-17T18:27:18.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b67591700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0b60060440 0x7f0b60147820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:18.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b67591700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0b60147d10 0x7f0b601481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:18.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b67591700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b600b4b60 con 0x7f0b6005c8f0 2021-12-17T18:27:18.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b67591700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b600b25d0 con 0x7f0b60060440 2021-12-17T18:27:18.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b67591700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600b2870 con 0x7f0b60147d10 2021-12-17T18:27:18.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b65d8e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0b60060440 0x7f0b60147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:18.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b65d8e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0b60060440 0x7f0b60147820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55836/0 (socket says 172.21.15.62:55836) 2021-12-17T18:27:18.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b65d8e700 1 -- 172.21.15.62:0/3904221632 learned_addr learned my addr 172.21.15.62:0/3904221632 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:18.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b66d90700 1 --2- 172.21.15.62:0/3904221632 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0b60147d10 0x7f0b601481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:18.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b65d8e700 1 -- 172.21.15.62:0/3904221632 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0b60147d10 msgr2=0x7f0b601481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:18.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b65d8e700 1 --2- 172.21.15.62:0/3904221632 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0b60147d10 0x7f0b601481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:18.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b65d8e700 1 -- 172.21.15.62:0/3904221632 >> v1:172.21.15.109:6789/0 conn(0x7f0b6005c8f0 legacy=0x7f0b60144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:18.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b65d8e700 1 -- 172.21.15.62:0/3904221632 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b600b47e0 con 0x7f0b60060440 2021-12-17T18:27:18.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b65d8e700 1 --2- 172.21.15.62:0/3904221632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b60060440 0x7f0b60147820 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f0b50002f70 tx=0x7f0b50006e50).ready entity=mon.0 client_cookie=8b570ce052c2f4de server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:18.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b6558d700 1 -- 172.21.15.62:0/3904221632 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b5000d5c0 con 0x7f0b60060440 2021-12-17T18:27:18.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b6558d700 1 -- 172.21.15.62:0/3904221632 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b50000e90 con 0x7f0b60060440 2021-12-17T18:27:18.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.641+0000 7f0b6558d700 1 -- 172.21.15.62:0/3904221632 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b5000d950 con 0x7f0b60060440 2021-12-17T18:27:18.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 -- 172.21.15.62:0/3904221632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b60060440 msgr2=0x7f0b60147820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:18.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 --2- 172.21.15.62:0/3904221632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b60060440 0x7f0b60147820 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f0b50002f70 tx=0x7f0b50006e50).stop 2021-12-17T18:27:18.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 -- 172.21.15.62:0/3904221632 shutdown_connections 2021-12-17T18:27:18.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 --2- 172.21.15.62:0/3904221632 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0b60147d10 0x7f0b601481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:18.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 --2- 172.21.15.62:0/3904221632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b60060440 0x7f0b60147820 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:18.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 -- 172.21.15.62:0/3904221632 >> 172.21.15.62:0/3904221632 conn(0x7f0b6005bcd0 msgr2=0x7f0b60062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:18.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 -- 172.21.15.62:0/3904221632 shutdown_connections 2021-12-17T18:27:18.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 -- 172.21.15.62:0/3904221632 wait complete. 2021-12-17T18:27:18.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 Processor -- start 2021-12-17T18:27:18.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 -- start start 2021-12-17T18:27:18.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b6005c8f0 0x7f0b60146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:18.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0b60060440 0x7f0b60156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:18.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0b60147d10 0x7f0b60156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:18.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600814f0 con 0x7f0b6005c8f0 2021-12-17T18:27:18.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b60081720 con 0x7f0b60060440 2021-12-17T18:27:18.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600819c0 con 0x7f0b60147d10 2021-12-17T18:27:18.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b6658f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b6005c8f0 0x7f0b60146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:18.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b6658f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b6005c8f0 0x7f0b60146b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55840/0 (socket says 172.21.15.62:55840) 2021-12-17T18:27:18.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b6658f700 1 -- 172.21.15.62:0/4083144848 learned_addr learned my addr 172.21.15.62:0/4083144848 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:18.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b65d8e700 1 --2- 172.21.15.62:0/4083144848 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0b60060440 0x7f0b60156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:18.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b66d90700 1 --2- 172.21.15.62:0/4083144848 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0b60147d10 0x7f0b60156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:18.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b66d90700 1 -- 172.21.15.62:0/4083144848 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0b60060440 msgr2=0x7f0b60156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:18.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b66d90700 1 --2- 172.21.15.62:0/4083144848 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0b60060440 0x7f0b60156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:18.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b66d90700 1 -- 172.21.15.62:0/4083144848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b6005c8f0 msgr2=0x7f0b60146b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:18.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b66d90700 1 --2- 172.21.15.62:0/4083144848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b6005c8f0 0x7f0b60146b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:18.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b66d90700 1 -- 172.21.15.62:0/4083144848 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5000b1e0 con 0x7f0b60147d10 2021-12-17T18:27:18.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b6658f700 1 --2- 172.21.15.62:0/4083144848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b6005c8f0 0x7f0b60146b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:18.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b66d90700 1 --2- 172.21.15.62:0/4083144848 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0b60147d10 0x7f0b60156f50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f0b5800c000 tx=0x7f0b580091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:18.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b4f7fe700 1 -- 172.21.15.62:0/4083144848 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b58012600 con 0x7f0b60147d10 2021-12-17T18:27:18.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b4f7fe700 1 -- 172.21.15.62:0/4083144848 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b58012760 con 0x7f0b60147d10 2021-12-17T18:27:18.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 -- 172.21.15.62:0/4083144848 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b60081c60 con 0x7f0b60147d10 2021-12-17T18:27:18.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b4f7fe700 1 -- 172.21.15.62:0/4083144848 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b58012ac0 con 0x7f0b60147d10 2021-12-17T18:27:18.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.645+0000 7f0b67591700 1 -- 172.21.15.62:0/4083144848 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b60157660 con 0x7f0b60147d10 2021-12-17T18:27:18.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.649+0000 7f0b67591700 1 -- 172.21.15.62:0/4083144848 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b60081df0 con 0x7f0b60147d10 2021-12-17T18:27:18.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.649+0000 7f0b4f7fe700 1 -- 172.21.15.62:0/4083144848 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0b58022070 con 0x7f0b60147d10 2021-12-17T18:27:18.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.649+0000 7f0b4f7fe700 1 --2- 172.21.15.62:0/4083144848 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0b40053640 0x7f0b40055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:18.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.649+0000 7f0b4f7fe700 1 -- 172.21.15.62:0/4083144848 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f0b5806bcc0 con 0x7f0b60147d10 2021-12-17T18:27:18.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.649+0000 7f0b6658f700 1 --2- 172.21.15.62:0/4083144848 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0b40053640 0x7f0b40055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:18.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.649+0000 7f0b6658f700 1 --2- 172.21.15.62:0/4083144848 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0b40053640 0x7f0b40055b00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f0b5c00d000 tx=0x7f0b5c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:18.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.661+0000 7f0b4f7fe700 1 -- 172.21.15.62:0/4083144848 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0b58042e90 con 0x7f0b60147d10 2021-12-17T18:27:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:18.789+0000 7f0b67591700 1 -- 172.21.15.62:0/4083144848 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f0b600573d0 con 0x7f0b60147d10 2021-12-17T18:27:19.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.525+0000 7f0b4f7fe700 1 -- 172.21.15.62:0/4083144848 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v129) v1 ==== 125+0+0 (secure 0 0 0) 0x7f0b58016020 con 0x7f0b60147d10 2021-12-17T18:27:19.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.529+0000 7f0b67591700 1 -- 172.21.15.62:0/4083144848 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0b40053640 msgr2=0x7f0b40055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:19.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.529+0000 7f0b67591700 1 --2- 172.21.15.62:0/4083144848 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0b40053640 0x7f0b40055b00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f0b5c00d000 tx=0x7f0b5c009040).stop 2021-12-17T18:27:19.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.529+0000 7f0b67591700 1 -- 172.21.15.62:0/4083144848 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0b60147d10 msgr2=0x7f0b60156f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:19.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.529+0000 7f0b67591700 1 --2- 172.21.15.62:0/4083144848 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0b60147d10 0x7f0b60156f50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f0b5800c000 tx=0x7f0b580091d0).stop 2021-12-17T18:27:19.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.529+0000 7f0b67591700 1 -- 172.21.15.62:0/4083144848 shutdown_connections 2021-12-17T18:27:19.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.529+0000 7f0b67591700 1 --2- 172.21.15.62:0/4083144848 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0b40053640 0x7f0b40055b00 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.529+0000 7f0b67591700 1 --2- 172.21.15.62:0/4083144848 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0b60147d10 0x7f0b60156f50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.529+0000 7f0b67591700 1 --2- 172.21.15.62:0/4083144848 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0b60060440 0x7f0b60156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.529+0000 7f0b67591700 1 --2- 172.21.15.62:0/4083144848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b6005c8f0 0x7f0b60146b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.529+0000 7f0b67591700 1 -- 172.21.15.62:0/4083144848 >> 172.21.15.62:0/4083144848 conn(0x7f0b6005bcd0 msgr2=0x7f0b600b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:19.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.529+0000 7f0b67591700 1 -- 172.21.15.62:0/4083144848 shutdown_connections 2021-12-17T18:27:19.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.529+0000 7f0b67591700 1 -- 172.21.15.62:0/4083144848 wait complete. 2021-12-17T18:27:19.537 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2021-12-17T18:27:19.548 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-12-17T18:27:19.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.645+0000 7feb19420700 1 Processor -- start 2021-12-17T18:27:19.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.645+0000 7feb19420700 1 -- start start 2021-12-17T18:27:19.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb19420700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feb1405ca90 0x7feb140b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:19.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb19420700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7feb140604b0 0x7feb14146230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:19.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb19420700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1405ce70 con 0x7feb140b34b0 2021-12-17T18:27:19.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb19420700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb140b2d70 con 0x7feb1405ca90 2021-12-17T18:27:19.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb19420700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb140b3010 con 0x7feb140604b0 2021-12-17T18:27:19.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb13fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feb1405ca90 0x7feb140b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:19.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb13fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feb1405ca90 0x7feb140b2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55850/0 (socket says 172.21.15.62:55850) 2021-12-17T18:27:19.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb13fff700 1 -- 172.21.15.62:0/3143355584 learned_addr learned my addr 172.21.15.62:0/3143355584 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:19.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb18c1f700 1 --2- 172.21.15.62:0/3143355584 >> v2:172.21.15.109:3300/0 conn(0x7feb140604b0 0x7feb14146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:19.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb13fff700 1 -- 172.21.15.62:0/3143355584 >> v2:172.21.15.109:3300/0 conn(0x7feb140604b0 msgr2=0x7feb14146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:19.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb13fff700 1 --2- 172.21.15.62:0/3143355584 >> v2:172.21.15.109:3300/0 conn(0x7feb140604b0 0x7feb14146230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb13fff700 1 -- 172.21.15.62:0/3143355584 >> v1:172.21.15.109:6789/0 conn(0x7feb140b34b0 legacy=0x7feb14145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:19.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb13fff700 1 -- 172.21.15.62:0/3143355584 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb140b2ab0 con 0x7feb1405ca90 2021-12-17T18:27:19.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb13fff700 1 --2- 172.21.15.62:0/3143355584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb1405ca90 0x7feb140b2470 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7feb080032f0 tx=0x7feb08009290).ready entity=mon.0 client_cookie=bef697d962ff0271 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:19.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb12ffd700 1 -- 172.21.15.62:0/3143355584 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb0800b870 con 0x7feb1405ca90 2021-12-17T18:27:19.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb12ffd700 1 -- 172.21.15.62:0/3143355584 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0800b9d0 con 0x7feb1405ca90 2021-12-17T18:27:19.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb12ffd700 1 -- 172.21.15.62:0/3143355584 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb0800bb40 con 0x7feb1405ca90 2021-12-17T18:27:19.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb19420700 1 -- 172.21.15.62:0/3143355584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb1405ca90 msgr2=0x7feb140b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:19.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb19420700 1 --2- 172.21.15.62:0/3143355584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb1405ca90 0x7feb140b2470 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7feb080032f0 tx=0x7feb08009290).stop 2021-12-17T18:27:19.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb19420700 1 -- 172.21.15.62:0/3143355584 shutdown_connections 2021-12-17T18:27:19.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb19420700 1 --2- 172.21.15.62:0/3143355584 >> v2:172.21.15.109:3300/0 conn(0x7feb140604b0 0x7feb14146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb19420700 1 --2- 172.21.15.62:0/3143355584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb1405ca90 0x7feb140b2470 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb19420700 1 -- 172.21.15.62:0/3143355584 >> 172.21.15.62:0/3143355584 conn(0x7feb1405bcd0 msgr2=0x7feb14062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:19.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb19420700 1 -- 172.21.15.62:0/3143355584 shutdown_connections 2021-12-17T18:27:19.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb19420700 1 -- 172.21.15.62:0/3143355584 wait complete. 2021-12-17T18:27:19.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb19420700 1 Processor -- start 2021-12-17T18:27:19.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.649+0000 7feb19420700 1 -- start start 2021-12-17T18:27:19.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb19420700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feb1405ca90 0x7feb140b8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:19.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb19420700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb140604b0 0x7feb14141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:19.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb19420700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feb140b34b0 0x7feb14141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:19.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb19420700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb14066960 con 0x7feb140604b0 2021-12-17T18:27:19.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb19420700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb140b8c90 con 0x7feb1405ca90 2021-12-17T18:27:19.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb19420700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb14066b90 con 0x7feb140b34b0 2021-12-17T18:27:19.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb137fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb140604b0 0x7feb14141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:19.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb137fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb140604b0 0x7feb14141ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55858/0 (socket says 172.21.15.62:55858) 2021-12-17T18:27:19.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb137fe700 1 -- 172.21.15.62:0/1047536091 learned_addr learned my addr 172.21.15.62:0/1047536091 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:19.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb13fff700 1 --2- 172.21.15.62:0/1047536091 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feb1405ca90 0x7feb140b8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:19.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb18c1f700 1 --2- 172.21.15.62:0/1047536091 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feb140b34b0 0x7feb14141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:19.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb137fe700 1 -- 172.21.15.62:0/1047536091 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feb140b34b0 msgr2=0x7feb14141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:19.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb137fe700 1 --2- 172.21.15.62:0/1047536091 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feb140b34b0 0x7feb14141fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb137fe700 1 -- 172.21.15.62:0/1047536091 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feb1405ca90 msgr2=0x7feb140b8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:19.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb137fe700 1 --2- 172.21.15.62:0/1047536091 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feb1405ca90 0x7feb140b8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb137fe700 1 -- 172.21.15.62:0/1047536091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb08009530 con 0x7feb140604b0 2021-12-17T18:27:19.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb137fe700 1 --2- 172.21.15.62:0/1047536091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb140604b0 0x7feb14141ae0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7feb140b3390 tx=0x7feb04007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:19.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb117fa700 1 -- 172.21.15.62:0/1047536091 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb04007e40 con 0x7feb140604b0 2021-12-17T18:27:19.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb117fa700 1 -- 172.21.15.62:0/1047536091 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb04007030 con 0x7feb140604b0 2021-12-17T18:27:19.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb117fa700 1 -- 172.21.15.62:0/1047536091 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb04007390 con 0x7feb140604b0 2021-12-17T18:27:19.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb19420700 1 -- 172.21.15.62:0/1047536091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb140a57f0 con 0x7feb140604b0 2021-12-17T18:27:19.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb19420700 1 -- 172.21.15.62:0/1047536091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb14067360 con 0x7feb140604b0 2021-12-17T18:27:19.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb19420700 1 -- 172.21.15.62:0/1047536091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb141429d0 con 0x7feb140604b0 2021-12-17T18:27:19.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.653+0000 7feb117fa700 1 -- 172.21.15.62:0/1047536091 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feb04010030 con 0x7feb140604b0 2021-12-17T18:27:19.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.657+0000 7feb117fa700 1 --2- 172.21.15.62:0/1047536091 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feaf40536a0 0x7feaf4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:19.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.657+0000 7feb117fa700 1 -- 172.21.15.62:0/1047536091 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5957+0+0 (secure 0 0 0) 0x7feb0406b2c0 con 0x7feb140604b0 2021-12-17T18:27:19.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.657+0000 7feb13fff700 1 --2- 172.21.15.62:0/1047536091 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feaf40536a0 0x7feaf4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:19.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.657+0000 7feb13fff700 1 --2- 172.21.15.62:0/1047536091 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feaf40536a0 0x7feaf4055b60 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7feb0801b000 tx=0x7feb08016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:19.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.665+0000 7feb117fa700 1 -- 172.21.15.62:0/1047536091 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feb04042490 con 0x7feb140604b0 2021-12-17T18:27:19.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.825+0000 7feb19420700 1 -- 172.21.15.62:0/1047536091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7feb140b4500 con 0x7feb140604b0 2021-12-17T18:27:19.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.837+0000 7feb117fa700 1 -- 172.21.15.62:0/1047536091 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 25 and data pool 26 v65) v1 ==== 189+0+0 (secure 0 0 0) 0x7feb04045ab0 con 0x7feb140604b0 2021-12-17T18:27:19.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.841+0000 7feb19420700 1 -- 172.21.15.62:0/1047536091 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feaf40536a0 msgr2=0x7feaf4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:19.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.841+0000 7feb19420700 1 --2- 172.21.15.62:0/1047536091 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feaf40536a0 0x7feaf4055b60 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7feb0801b000 tx=0x7feb08016000).stop 2021-12-17T18:27:19.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.841+0000 7feb19420700 1 -- 172.21.15.62:0/1047536091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb140604b0 msgr2=0x7feb14141ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:19.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.841+0000 7feb19420700 1 --2- 172.21.15.62:0/1047536091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb140604b0 0x7feb14141ae0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7feb140b3390 tx=0x7feb04007bd0).stop 2021-12-17T18:27:19.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.841+0000 7feb19420700 1 -- 172.21.15.62:0/1047536091 shutdown_connections 2021-12-17T18:27:19.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.841+0000 7feb19420700 1 --2- 172.21.15.62:0/1047536091 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7feaf40536a0 0x7feaf4055b60 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.841+0000 7feb19420700 1 --2- 172.21.15.62:0/1047536091 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7feb140b34b0 0x7feb14141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.841+0000 7feb19420700 1 --2- 172.21.15.62:0/1047536091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb140604b0 0x7feb14141ae0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.841+0000 7feb19420700 1 --2- 172.21.15.62:0/1047536091 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7feb1405ca90 0x7feb140b8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.841+0000 7feb19420700 1 -- 172.21.15.62:0/1047536091 >> 172.21.15.62:0/1047536091 conn(0x7feb1405bcd0 msgr2=0x7feb141458f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:19.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.845+0000 7feb19420700 1 -- 172.21.15.62:0/1047536091 shutdown_connections 2021-12-17T18:27:19.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.845+0000 7feb19420700 1 -- 172.21.15.62:0/1047536091 wait complete. 2021-12-17T18:27:19.850 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 25 and data pool 26 2021-12-17T18:27:19.863 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:27:19.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.953+0000 7f67a9cdc700 1 Processor -- start 2021-12-17T18:27:19.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.953+0000 7f67a9cdc700 1 -- start start 2021-12-17T18:27:19.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.953+0000 7f67a9cdc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67a4141480 0x7f67a4147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:19.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.953+0000 7f67a9cdc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f67a40a8e10 0x7f67a40b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:19.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.953+0000 7f67a9cdc700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a4147610 con 0x7f67a40b6050 2021-12-17T18:27:19.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.953+0000 7f67a9cdc700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a41478b0 con 0x7f67a40a8e10 2021-12-17T18:27:19.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.953+0000 7f67a9cdc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a4147b50 con 0x7f67a4141480 2021-12-17T18:27:19.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.953+0000 7f67a8cda700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67a4141480 0x7f67a4147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:19.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.953+0000 7f67a3fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f67a40a8e10 0x7f67a40b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:19.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.953+0000 7f67a94db700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f67a40b6050 0x7f67a40a7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:55766/0 (socket says 172.21.15.62:55766) 2021-12-17T18:27:19.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.953+0000 7f67a8cda700 1 --2- 172.21.15.62:0/31398136 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67a4141480 0x7f67a4147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:49566/0 (socket says 172.21.15.62:49566) 2021-12-17T18:27:19.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.953+0000 7f67a94db700 1 -- 172.21.15.62:0/31398136 learned_addr learned my addr 172.21.15.62:0/31398136 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:19.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a8cda700 1 -- 172.21.15.62:0/31398136 >> v2:172.21.15.109:3300/0 conn(0x7f67a40a8e10 msgr2=0x7f67a40b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:19.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a8cda700 1 --2- 172.21.15.62:0/31398136 >> v2:172.21.15.109:3300/0 conn(0x7f67a40a8e10 0x7f67a40b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a8cda700 1 -- 172.21.15.62:0/31398136 >> v1:172.21.15.109:6789/0 conn(0x7f67a40b6050 legacy=0x7f67a40a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:19.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a8cda700 1 -- 172.21.15.62:0/31398136 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a40b1b90 con 0x7f67a4141480 2021-12-17T18:27:19.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a8cda700 1 --2- 172.21.15.62:0/31398136 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67a4141480 0x7f67a4147ff0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f679c0032f0 tx=0x7f679c0091d0).ready entity=mon.2 client_cookie=45d8fb98b97911d3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:19.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a37fe700 1 -- 172.21.15.62:0/31398136 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f679c00b6c0 con 0x7f67a4141480 2021-12-17T18:27:19.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a37fe700 1 -- 172.21.15.62:0/31398136 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c00b820 con 0x7f67a4141480 2021-12-17T18:27:19.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a37fe700 1 -- 172.21.15.62:0/31398136 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f679c00b990 con 0x7f67a4141480 2021-12-17T18:27:19.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a9cdc700 1 -- 172.21.15.62:0/31398136 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67a4141480 msgr2=0x7f67a4147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:19.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a9cdc700 1 --2- 172.21.15.62:0/31398136 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67a4141480 0x7f67a4147ff0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f679c0032f0 tx=0x7f679c0091d0).stop 2021-12-17T18:27:19.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a9cdc700 1 -- 172.21.15.62:0/31398136 shutdown_connections 2021-12-17T18:27:19.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a9cdc700 1 --2- 172.21.15.62:0/31398136 >> v2:172.21.15.109:3300/0 conn(0x7f67a40a8e10 0x7f67a40b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a9cdc700 1 --2- 172.21.15.62:0/31398136 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67a4141480 0x7f67a4147ff0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a9cdc700 1 -- 172.21.15.62:0/31398136 >> 172.21.15.62:0/31398136 conn(0x7f67a405d220 msgr2=0x7f67a40b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:19.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a9cdc700 1 -- 172.21.15.62:0/31398136 shutdown_connections 2021-12-17T18:27:19.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a9cdc700 1 -- 172.21.15.62:0/31398136 wait complete. 2021-12-17T18:27:19.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a9cdc700 1 Processor -- start 2021-12-17T18:27:19.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a9cdc700 1 -- start start 2021-12-17T18:27:19.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.957+0000 7f67a9cdc700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f67a40a8e10 0x7f67a4149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:19.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a9cdc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67a40b6050 0x7f67a413d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:19.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a9cdc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67a4141480 0x7f67a413de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:19.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a9cdc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a4157050 con 0x7f67a4141480 2021-12-17T18:27:19.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a9cdc700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a414a620 con 0x7f67a40a8e10 2021-12-17T18:27:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a9cdc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a414a380 con 0x7f67a40b6050 2021-12-17T18:27:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a94db700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67a4141480 0x7f67a413de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a94db700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67a4141480 0x7f67a413de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55872/0 (socket says 172.21.15.62:55872) 2021-12-17T18:27:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a8cda700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f67a40a8e10 0x7f67a4149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a94db700 1 -- 172.21.15.62:0/1912499251 learned_addr learned my addr 172.21.15.62:0/1912499251 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a3fff700 1 --2- 172.21.15.62:0/1912499251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67a40b6050 0x7f67a413d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a94db700 1 -- 172.21.15.62:0/1912499251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67a40b6050 msgr2=0x7f67a413d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a94db700 1 --2- 172.21.15.62:0/1912499251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67a40b6050 0x7f67a413d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a94db700 1 -- 172.21.15.62:0/1912499251 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f67a40a8e10 msgr2=0x7f67a4149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:19.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a94db700 1 --2- 172.21.15.62:0/1912499251 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f67a40a8e10 0x7f67a4149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:19.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a94db700 1 -- 172.21.15.62:0/1912499251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679c009470 con 0x7f67a4141480 2021-12-17T18:27:19.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a94db700 1 --2- 172.21.15.62:0/1912499251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67a4141480 0x7f67a413de20 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f67a4063060 tx=0x7f6794007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:19.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a1ffb700 1 -- 172.21.15.62:0/1912499251 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67940070d0 con 0x7f67a4141480 2021-12-17T18:27:19.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a1ffb700 1 -- 172.21.15.62:0/1912499251 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6794007230 con 0x7f67a4141480 2021-12-17T18:27:19.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a9cdc700 1 -- 172.21.15.62:0/1912499251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a413e310 con 0x7f67a4141480 2021-12-17T18:27:19.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a1ffb700 1 -- 172.21.15.62:0/1912499251 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6794005610 con 0x7f67a4141480 2021-12-17T18:27:19.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a9cdc700 1 -- 172.21.15.62:0/1912499251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a40a9a20 con 0x7f67a4141480 2021-12-17T18:27:19.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.961+0000 7f67a9cdc700 1 -- 172.21.15.62:0/1912499251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a4156ea0 con 0x7f67a4141480 2021-12-17T18:27:19.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.965+0000 7f67a1ffb700 1 -- 172.21.15.62:0/1912499251 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f679401a070 con 0x7f67a4141480 2021-12-17T18:27:19.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.965+0000 7f67a1ffb700 1 --2- 172.21.15.62:0/1912499251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6784053610 0x7f6784055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:19.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.965+0000 7f67a1ffb700 1 -- 172.21.15.62:0/1912499251 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f679406a850 con 0x7f67a4141480 2021-12-17T18:27:19.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.965+0000 7f67a8cda700 1 --2- 172.21.15.62:0/1912499251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6784053610 0x7f6784055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:19.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.965+0000 7f67a8cda700 1 --2- 172.21.15.62:0/1912499251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6784053610 0x7f6784055ad0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f679c01c000 tx=0x7f679c016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:19.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:19.969+0000 7f67a1ffb700 1 -- 172.21.15.62:0/1912499251 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f67940419b0 con 0x7f67a4141480 2021-12-17T18:27:20.102 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.097+0000 7f67a9cdc700 1 -- 172.21.15.62:0/1912499251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67a4157190 con 0x7f67a4141480 2021-12-17T18:27:20.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.097+0000 7f67a1ffb700 1 -- 172.21.15.62:0/1912499251 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16126 (secure 0 0 0) 0x7f6794044fd0 con 0x7f67a4141480 2021-12-17T18:27:20.104 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:20.105 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":130,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:27:19.829977+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:27:17.568635+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-12-17T18:27:18.849290+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:27:20.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.101+0000 7f67a9cdc700 1 -- 172.21.15.62:0/1912499251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6784053610 msgr2=0x7f6784055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.101+0000 7f67a9cdc700 1 --2- 172.21.15.62:0/1912499251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6784053610 0x7f6784055ad0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f679c01c000 tx=0x7f679c016000).stop 2021-12-17T18:27:20.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.101+0000 7f67a9cdc700 1 -- 172.21.15.62:0/1912499251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67a4141480 msgr2=0x7f67a413de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.101+0000 7f67a9cdc700 1 --2- 172.21.15.62:0/1912499251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67a4141480 0x7f67a413de20 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f67a4063060 tx=0x7f6794007bc0).stop 2021-12-17T18:27:20.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.101+0000 7f67a9cdc700 1 -- 172.21.15.62:0/1912499251 shutdown_connections 2021-12-17T18:27:20.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.101+0000 7f67a9cdc700 1 --2- 172.21.15.62:0/1912499251 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6784053610 0x7f6784055ad0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.101+0000 7f67a9cdc700 1 --2- 172.21.15.62:0/1912499251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67a4141480 0x7f67a413de20 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.101+0000 7f67a9cdc700 1 --2- 172.21.15.62:0/1912499251 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f67a40b6050 0x7f67a413d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.101+0000 7f67a9cdc700 1 --2- 172.21.15.62:0/1912499251 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f67a40a8e10 0x7f67a4149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.101+0000 7f67a9cdc700 1 -- 172.21.15.62:0/1912499251 >> 172.21.15.62:0/1912499251 conn(0x7f67a405d220 msgr2=0x7f67a40b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:20.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.101+0000 7f67a9cdc700 1 -- 172.21.15.62:0/1912499251 shutdown_connections 2021-12-17T18:27:20.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.101+0000 7f67a9cdc700 1 -- 172.21.15.62:0/1912499251 wait complete. 2021-12-17T18:27:20.118 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:27:20.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.213+0000 7fc223fff700 1 Processor -- start 2021-12-17T18:27:20.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc223fff700 1 -- start start 2021-12-17T18:27:20.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc223fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc2240b5b20 0x7fc2240b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:20.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc223fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc2241458d0 0x7fc224145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:20.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc223fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2240b5f00 con 0x7fc2240b3760 2021-12-17T18:27:20.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc223fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2240b3020 con 0x7fc2241458d0 2021-12-17T18:27:20.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc223fff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2240b32c0 con 0x7fc2240b5b20 2021-12-17T18:27:20.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc2227fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc2240b3760 0x7fc2240b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39458/0 (socket says 172.21.15.62:39458) 2021-12-17T18:27:20.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc2227fc700 1 -- 172.21.15.62:0/839887685 learned_addr learned my addr 172.21.15.62:0/839887685 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:20.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc2237fe700 1 --2- 172.21.15.62:0/839887685 >> v2:172.21.15.62:3300/0 conn(0x7fc2241458d0 0x7fc224145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:20.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc222ffd700 1 --2- 172.21.15.62:0/839887685 >> v2:172.21.15.109:3300/0 conn(0x7fc2240b5b20 0x7fc2240b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:20.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc221ffb700 1 -- 172.21.15.62:0/839887685 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679269691 0 0) 0x7fc2240b5f00 con 0x7fc2240b3760 2021-12-17T18:27:20.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc221ffb700 1 -- 172.21.15.62:0/839887685 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc208003260 con 0x7fc2240b3760 2021-12-17T18:27:20.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc221ffb700 1 -- 172.21.15.62:0/839887685 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4112996905 0 0) 0x7fc208003260 con 0x7fc2240b3760 2021-12-17T18:27:20.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc2237fe700 1 -- 172.21.15.62:0/839887685 >> v2:172.21.15.109:3300/0 conn(0x7fc2240b5b20 msgr2=0x7fc2240b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:20.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc2237fe700 1 --2- 172.21.15.62:0/839887685 >> v2:172.21.15.109:3300/0 conn(0x7fc2240b5b20 0x7fc2240b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc2237fe700 1 -- 172.21.15.62:0/839887685 >> v1:172.21.15.62:6789/0 conn(0x7fc2240b3760 legacy=0x7fc2240b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc2237fe700 1 -- 172.21.15.62:0/839887685 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2240b6e90 con 0x7fc2241458d0 2021-12-17T18:27:20.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc2237fe700 1 --2- 172.21.15.62:0/839887685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2241458d0 0x7fc224145cd0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fc218001800 tx=0x7fc21c0091d0).ready entity=mon.0 client_cookie=5e6fedb292feb636 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:20.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc221ffb700 1 -- 172.21.15.62:0/839887685 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc218001660 con 0x7fc2241458d0 2021-12-17T18:27:20.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc221ffb700 1 -- 172.21.15.62:0/839887685 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21c00f510 con 0x7fc2241458d0 2021-12-17T18:27:20.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc221ffb700 1 -- 172.21.15.62:0/839887685 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc21c00f680 con 0x7fc2241458d0 2021-12-17T18:27:20.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc223fff700 1 -- 172.21.15.62:0/839887685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2241458d0 msgr2=0x7fc224145cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc223fff700 1 --2- 172.21.15.62:0/839887685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2241458d0 0x7fc224145cd0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fc218001800 tx=0x7fc21c0091d0).stop 2021-12-17T18:27:20.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc223fff700 1 -- 172.21.15.62:0/839887685 shutdown_connections 2021-12-17T18:27:20.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc223fff700 1 --2- 172.21.15.62:0/839887685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2241458d0 0x7fc224145cd0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc223fff700 1 --2- 172.21.15.62:0/839887685 >> v2:172.21.15.109:3300/0 conn(0x7fc2240b5b20 0x7fc2240b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc223fff700 1 -- 172.21.15.62:0/839887685 >> 172.21.15.62:0/839887685 conn(0x7fc22405c750 msgr2=0x7fc22405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:20.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc223fff700 1 -- 172.21.15.62:0/839887685 shutdown_connections 2021-12-17T18:27:20.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.217+0000 7fc223fff700 1 -- 172.21.15.62:0/839887685 wait complete. 2021-12-17T18:27:20.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc223fff700 1 Processor -- start 2021-12-17T18:27:20.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc223fff700 1 -- start start 2021-12-17T18:27:20.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc223fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc2240b5b20 0x7fc2240b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:20.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc223fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2241458d0 0x7fc224155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:20.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc223fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc224066060 0x7fc2240a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:20.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc223fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2240a3f90 con 0x7fc2241458d0 2021-12-17T18:27:20.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc223fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc224064ff0 con 0x7fc224066060 2021-12-17T18:27:20.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc223fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc224064d50 con 0x7fc2240b5b20 2021-12-17T18:27:20.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc2227fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2241458d0 0x7fc224155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:20.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc2227fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2241458d0 0x7fc224155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55886/0 (socket says 172.21.15.62:55886) 2021-12-17T18:27:20.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc2227fc700 1 -- 172.21.15.62:0/1069416254 learned_addr learned my addr 172.21.15.62:0/1069416254 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:20.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc222ffd700 1 --2- 172.21.15.62:0/1069416254 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc2240b5b20 0x7fc2240b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:20.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc2237fe700 1 --2- 172.21.15.62:0/1069416254 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc224066060 0x7fc2240a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:20.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc2227fc700 1 -- 172.21.15.62:0/1069416254 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc2240b5b20 msgr2=0x7fc2240b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc2227fc700 1 --2- 172.21.15.62:0/1069416254 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc2240b5b20 0x7fc2240b9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc2227fc700 1 -- 172.21.15.62:0/1069416254 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc224066060 msgr2=0x7fc2240a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc2227fc700 1 --2- 172.21.15.62:0/1069416254 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc224066060 0x7fc2240a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc2227fc700 1 -- 172.21.15.62:0/1069416254 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c009470 con 0x7fc2241458d0 2021-12-17T18:27:20.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc2237fe700 1 --2- 172.21.15.62:0/1069416254 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc224066060 0x7fc2240a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:20.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc222ffd700 1 --2- 172.21.15.62:0/1069416254 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc2240b5b20 0x7fc2240b9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:20.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc2227fc700 1 --2- 172.21.15.62:0/1069416254 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2241458d0 0x7fc224155770 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7fc2180018c0 tx=0x7fc218001a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:20.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc213fff700 1 -- 172.21.15.62:0/1069416254 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2180072e0 con 0x7fc2241458d0 2021-12-17T18:27:20.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc213fff700 1 -- 172.21.15.62:0/1069416254 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc218007440 con 0x7fc2241458d0 2021-12-17T18:27:20.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc223fff700 1 -- 172.21.15.62:0/1069416254 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc224155c60 con 0x7fc2241458d0 2021-12-17T18:27:20.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc213fff700 1 -- 172.21.15.62:0/1069416254 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc218005800 con 0x7fc2241458d0 2021-12-17T18:27:20.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.221+0000 7fc223fff700 1 -- 172.21.15.62:0/1069416254 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc224067300 con 0x7fc2241458d0 2021-12-17T18:27:20.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.225+0000 7fc223fff700 1 -- 172.21.15.62:0/1069416254 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2240573d0 con 0x7fc2241458d0 2021-12-17T18:27:20.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.225+0000 7fc213fff700 1 -- 172.21.15.62:0/1069416254 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc218010070 con 0x7fc2241458d0 2021-12-17T18:27:20.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.225+0000 7fc213fff700 1 --2- 172.21.15.62:0/1069416254 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc200053720 0x7fc200055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:20.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.225+0000 7fc213fff700 1 -- 172.21.15.62:0/1069416254 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc21806b3b0 con 0x7fc2241458d0 2021-12-17T18:27:20.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.225+0000 7fc222ffd700 1 --2- 172.21.15.62:0/1069416254 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc200053720 0x7fc200055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:20.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.229+0000 7fc222ffd700 1 --2- 172.21.15.62:0/1069416254 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc200053720 0x7fc200055be0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fc21400b000 tx=0x7fc214008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:20.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.229+0000 7fc213fff700 1 -- 172.21.15.62:0/1069416254 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc218042510 con 0x7fc2241458d0 2021-12-17T18:27:20.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.353+0000 7fc223fff700 1 -- 172.21.15.62:0/1069416254 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2240a40d0 con 0x7fc2241458d0 2021-12-17T18:27:20.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.357+0000 7fc213fff700 1 -- 172.21.15.62:0/1069416254 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16126 (secure 0 0 0) 0x7fc218045b30 con 0x7fc2241458d0 2021-12-17T18:27:20.362 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:20.362 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":130,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:27:19.829977+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:27:17.568635+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-12-17T18:27:18.849290+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:27:20.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.357+0000 7fc223fff700 1 -- 172.21.15.62:0/1069416254 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc200053720 msgr2=0x7fc200055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.357+0000 7fc223fff700 1 --2- 172.21.15.62:0/1069416254 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc200053720 0x7fc200055be0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fc21400b000 tx=0x7fc214008040).stop 2021-12-17T18:27:20.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.357+0000 7fc223fff700 1 -- 172.21.15.62:0/1069416254 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2241458d0 msgr2=0x7fc224155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.357+0000 7fc223fff700 1 --2- 172.21.15.62:0/1069416254 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2241458d0 0x7fc224155770 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7fc2180018c0 tx=0x7fc218001a80).stop 2021-12-17T18:27:20.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.357+0000 7fc223fff700 1 -- 172.21.15.62:0/1069416254 shutdown_connections 2021-12-17T18:27:20.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.357+0000 7fc223fff700 1 --2- 172.21.15.62:0/1069416254 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc200053720 0x7fc200055be0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.357+0000 7fc223fff700 1 --2- 172.21.15.62:0/1069416254 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc224066060 0x7fc2240a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.357+0000 7fc223fff700 1 --2- 172.21.15.62:0/1069416254 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2241458d0 0x7fc224155770 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.357+0000 7fc223fff700 1 --2- 172.21.15.62:0/1069416254 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc2240b5b20 0x7fc2240b9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.357+0000 7fc223fff700 1 -- 172.21.15.62:0/1069416254 >> 172.21.15.62:0/1069416254 conn(0x7fc22405c750 msgr2=0x7fc22405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:20.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.357+0000 7fc223fff700 1 -- 172.21.15.62:0/1069416254 shutdown_connections 2021-12-17T18:27:20.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.357+0000 7fc223fff700 1 -- 172.21.15.62:0/1069416254 wait complete. 2021-12-17T18:27:20.375 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-12-17T18:27:20.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.481+0000 7f83f1200700 1 Processor -- start 2021-12-17T18:27:20.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.481+0000 7f83f1200700 1 -- start start 2021-12-17T18:27:20.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.481+0000 7f83f1200700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83ec149b40 0x7f83ec14bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:20.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.481+0000 7f83f1200700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ec05ce70 con 0x7f83ec05ca90 2021-12-17T18:27:20.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.481+0000 7f83f1200700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ec0af520 con 0x7f83ec0b06b0 2021-12-17T18:27:20.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.481+0000 7f83f1200700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec0643b0 con 0x7f83ec149b40 2021-12-17T18:27:20.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.481+0000 7f83ebfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f83ec05ca90 0x7f83ec063590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39472/0 (socket says 172.21.15.62:39472) 2021-12-17T18:27:20.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.481+0000 7f83ebfff700 1 -- 172.21.15.62:0/971841939 learned_addr learned my addr 172.21.15.62:0/971841939 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:20.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.481+0000 7f83f09ff700 1 --2- 172.21.15.62:0/971841939 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83ec149b40 0x7f83ec14bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:20.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.481+0000 7f83eb7fe700 1 -- 172.21.15.62:0/971841939 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2811090973 0 0) 0x7f83ec05ce70 con 0x7f83ec05ca90 2021-12-17T18:27:20.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.481+0000 7f83eb7fe700 1 -- 172.21.15.62:0/971841939 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83cc003260 con 0x7f83ec05ca90 2021-12-17T18:27:20.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.481+0000 7f83f09ff700 1 -- 172.21.15.62:0/971841939 >> v1:172.21.15.109:6789/0 conn(0x7f83ec0b06b0 legacy=0x7f83ec063ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.481+0000 7f83eb7fe700 1 -- 172.21.15.62:0/971841939 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808395482 0 0) 0x7f83ec0af520 con 0x7f83ec0b06b0 2021-12-17T18:27:20.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.481+0000 7f83f09ff700 1 -- 172.21.15.62:0/971841939 >> v1:172.21.15.62:6789/0 conn(0x7f83ec05ca90 legacy=0x7f83ec063590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.481+0000 7f83f09ff700 1 -- 172.21.15.62:0/971841939 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec05f730 con 0x7f83ec149b40 2021-12-17T18:27:20.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.481+0000 7f83f09ff700 1 --2- 172.21.15.62:0/971841939 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83ec149b40 0x7f83ec14bf30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f83e40032f0 tx=0x7f83e40091d0).ready entity=mon.2 client_cookie=ff28cdd623241b5f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:20.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.485+0000 7f83eb7fe700 1 -- 172.21.15.62:0/971841939 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83e400b6c0 con 0x7f83ec149b40 2021-12-17T18:27:20.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.485+0000 7f83eb7fe700 1 -- 172.21.15.62:0/971841939 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e400b820 con 0x7f83ec149b40 2021-12-17T18:27:20.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.485+0000 7f83eb7fe700 1 -- 172.21.15.62:0/971841939 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83e400b990 con 0x7f83ec149b40 2021-12-17T18:27:20.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.485+0000 7f83f1200700 1 -- 172.21.15.62:0/971841939 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83ec149b40 msgr2=0x7f83ec14bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.485+0000 7f83f1200700 1 --2- 172.21.15.62:0/971841939 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83ec149b40 0x7f83ec14bf30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f83e40032f0 tx=0x7f83e40091d0).stop 2021-12-17T18:27:20.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.485+0000 7f83f1200700 1 -- 172.21.15.62:0/971841939 shutdown_connections 2021-12-17T18:27:20.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.485+0000 7f83f1200700 1 --2- 172.21.15.62:0/971841939 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83ec149b40 0x7f83ec14bf30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.485+0000 7f83f1200700 1 -- 172.21.15.62:0/971841939 >> 172.21.15.62:0/971841939 conn(0x7f83ec05c070 msgr2=0x7f83ec062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:20.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.485+0000 7f83f1200700 1 -- 172.21.15.62:0/971841939 shutdown_connections 2021-12-17T18:27:20.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.485+0000 7f83f1200700 1 -- 172.21.15.62:0/971841939 wait complete. 2021-12-17T18:27:20.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.485+0000 7f83f1200700 1 Processor -- start 2021-12-17T18:27:20.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.485+0000 7f83f1200700 1 -- start start 2021-12-17T18:27:20.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83f1200700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f83ec05ca90 0x7f83ec1429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:20.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83f1200700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec0b06b0 0x7f83ec13f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:20.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83f1200700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83ec149b40 0x7f83ec143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:20.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83f1200700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec13ff10 con 0x7f83ec0b06b0 2021-12-17T18:27:20.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83f1200700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec0650a0 con 0x7f83ec05ca90 2021-12-17T18:27:20.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83f1200700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec065340 con 0x7f83ec149b40 2021-12-17T18:27:20.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83e3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec0b06b0 0x7f83ec13f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:20.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83e3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec0b06b0 0x7f83ec13f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55900/0 (socket says 172.21.15.62:55900) 2021-12-17T18:27:20.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83e3fff700 1 -- 172.21.15.62:0/2397325747 learned_addr learned my addr 172.21.15.62:0/2397325747 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:20.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83f09ff700 1 --2- 172.21.15.62:0/2397325747 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83ec149b40 0x7f83ec143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:20.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83ebfff700 1 --2- 172.21.15.62:0/2397325747 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f83ec05ca90 0x7f83ec1429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:20.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83e3fff700 1 -- 172.21.15.62:0/2397325747 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83ec149b40 msgr2=0x7f83ec143d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83e3fff700 1 --2- 172.21.15.62:0/2397325747 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83ec149b40 0x7f83ec143d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83e3fff700 1 -- 172.21.15.62:0/2397325747 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f83ec05ca90 msgr2=0x7f83ec1429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83e3fff700 1 --2- 172.21.15.62:0/2397325747 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f83ec05ca90 0x7f83ec1429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83e3fff700 1 -- 172.21.15.62:0/2397325747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e4009470 con 0x7f83ec0b06b0 2021-12-17T18:27:20.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83ebfff700 1 --2- 172.21.15.62:0/2397325747 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f83ec05ca90 0x7f83ec1429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:20.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83e3fff700 1 --2- 172.21.15.62:0/2397325747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec0b06b0 0x7f83ec13f2d0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f83d4000bc0 tx=0x7f83d4007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:20.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83e9ffb700 1 -- 172.21.15.62:0/2397325747 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d4012400 con 0x7f83ec0b06b0 2021-12-17T18:27:20.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83e9ffb700 1 -- 172.21.15.62:0/2397325747 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d4012560 con 0x7f83ec0b06b0 2021-12-17T18:27:20.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83e9ffb700 1 -- 172.21.15.62:0/2397325747 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d40128c0 con 0x7f83ec0b06b0 2021-12-17T18:27:20.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83f1200700 1 -- 172.21.15.62:0/2397325747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ec142500 con 0x7f83ec0b06b0 2021-12-17T18:27:20.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83f1200700 1 -- 172.21.15.62:0/2397325747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83ec0665b0 con 0x7f83ec0b06b0 2021-12-17T18:27:20.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.489+0000 7f83f1200700 1 -- 172.21.15.62:0/2397325747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83ec145080 con 0x7f83ec0b06b0 2021-12-17T18:27:20.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.493+0000 7f83e9ffb700 1 -- 172.21.15.62:0/2397325747 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f83d4019030 con 0x7f83ec0b06b0 2021-12-17T18:27:20.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.493+0000 7f83e9ffb700 1 --2- 172.21.15.62:0/2397325747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83d00536a0 0x7f83d0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:20.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.493+0000 7f83e9ffb700 1 -- 172.21.15.62:0/2397325747 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f83d406aba0 con 0x7f83ec0b06b0 2021-12-17T18:27:20.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.493+0000 7f83ebfff700 1 --2- 172.21.15.62:0/2397325747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83d00536a0 0x7f83d0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:20.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.493+0000 7f83ebfff700 1 --2- 172.21.15.62:0/2397325747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83d00536a0 0x7f83d0055b60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f83dc00b000 tx=0x7f83dc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:20.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.501+0000 7f83e9ffb700 1 -- 172.21.15.62:0/2397325747 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f83d4041db0 con 0x7f83ec0b06b0 2021-12-17T18:27:20.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.661+0000 7f83f1200700 1 -- 172.21.15.62:0/2397325747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f83ec142690 con 0x7f83ec0b06b0 2021-12-17T18:27:20.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.837+0000 7f83e9ffb700 1 -- 172.21.15.62:0/2397325747 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v66) v1 ==== 118+0+0 (secure 0 0 0) 0x7f83d40453d0 con 0x7f83ec0b06b0 2021-12-17T18:27:20.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.841+0000 7f83f1200700 1 -- 172.21.15.62:0/2397325747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83d00536a0 msgr2=0x7f83d0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.841+0000 7f83f1200700 1 --2- 172.21.15.62:0/2397325747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83d00536a0 0x7f83d0055b60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f83dc00b000 tx=0x7f83dc009040).stop 2021-12-17T18:27:20.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.841+0000 7f83f1200700 1 -- 172.21.15.62:0/2397325747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec0b06b0 msgr2=0x7f83ec13f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.841+0000 7f83f1200700 1 --2- 172.21.15.62:0/2397325747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec0b06b0 0x7f83ec13f2d0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f83d4000bc0 tx=0x7f83d4007a70).stop 2021-12-17T18:27:20.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.841+0000 7f83f1200700 1 -- 172.21.15.62:0/2397325747 shutdown_connections 2021-12-17T18:27:20.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.841+0000 7f83f1200700 1 --2- 172.21.15.62:0/2397325747 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f83d00536a0 0x7f83d0055b60 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.841+0000 7f83f1200700 1 --2- 172.21.15.62:0/2397325747 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f83ec149b40 0x7f83ec143d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.841+0000 7f83f1200700 1 --2- 172.21.15.62:0/2397325747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec0b06b0 0x7f83ec13f2d0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.841+0000 7f83f1200700 1 --2- 172.21.15.62:0/2397325747 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f83ec05ca90 0x7f83ec1429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.841+0000 7f83f1200700 1 -- 172.21.15.62:0/2397325747 >> 172.21.15.62:0/2397325747 conn(0x7f83ec05c070 msgr2=0x7f83ec0636d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:20.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.841+0000 7f83f1200700 1 -- 172.21.15.62:0/2397325747 shutdown_connections 2021-12-17T18:27:20.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.841+0000 7f83f1200700 1 -- 172.21.15.62:0/2397325747 wait complete. 2021-12-17T18:27:20.863 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:20.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f9247f700 1 Processor -- start 2021-12-17T18:27:20.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f9247f700 1 -- start start 2021-12-17T18:27:20.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f9247f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f9f8c05fa70 0x7f9f8c146a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:20.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f9247f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9f8c0b2e70 0x7f9f8c0ae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:20.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f9247f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8c0b35b0 con 0x7f9f8c0b10e0 2021-12-17T18:27:20.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f9247f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8c0aa290 con 0x7f9f8c0b2e70 2021-12-17T18:27:20.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f9247f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8c146f40 con 0x7f9f8c05fa70 2021-12-17T18:27:20.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f8b7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9f8c0b2e70 0x7f9f8c0ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:20.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f8b7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9f8c0b2e70 0x7f9f8c0ae860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55908/0 (socket says 172.21.15.62:55908) 2021-12-17T18:27:20.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f8b7fe700 1 -- 172.21.15.62:0/2509829309 learned_addr learned my addr 172.21.15.62:0/2509829309 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:20.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f8bfff700 1 --2- 172.21.15.62:0/2509829309 >> v2:172.21.15.109:3300/0 conn(0x7f9f8c05fa70 0x7f9f8c146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:20.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f8b7fe700 1 -- 172.21.15.62:0/2509829309 >> v2:172.21.15.109:3300/0 conn(0x7f9f8c05fa70 msgr2=0x7f9f8c146a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:20.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f8b7fe700 1 --2- 172.21.15.62:0/2509829309 >> v2:172.21.15.109:3300/0 conn(0x7f9f8c05fa70 0x7f9f8c146a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f8b7fe700 1 -- 172.21.15.62:0/2509829309 >> v1:172.21.15.109:6789/0 conn(0x7f9f8c0b10e0 legacy=0x7f9f8c0b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f8b7fe700 1 -- 172.21.15.62:0/2509829309 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c0ae400 con 0x7f9f8c0b2e70 2021-12-17T18:27:20.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f8bfff700 1 --2- 172.21.15.62:0/2509829309 >> v2:172.21.15.109:3300/0 conn(0x7f9f8c05fa70 0x7f9f8c146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:20.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f8b7fe700 1 --2- 172.21.15.62:0/2509829309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c0b2e70 0x7f9f8c0ae860 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f9f80002f70 tx=0x7f9f80006eb0).ready entity=mon.0 client_cookie=22041e2f70a36cc6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:20.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f8affd700 1 -- 172.21.15.62:0/2509829309 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f8000d610 con 0x7f9f8c0b2e70 2021-12-17T18:27:20.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f8affd700 1 -- 172.21.15.62:0/2509829309 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f80000e90 con 0x7f9f8c0b2e70 2021-12-17T18:27:20.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.965+0000 7f9f8affd700 1 -- 172.21.15.62:0/2509829309 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f8000d9a0 con 0x7f9f8c0b2e70 2021-12-17T18:27:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.969+0000 7f9f9247f700 1 -- 172.21.15.62:0/2509829309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c0b2e70 msgr2=0x7f9f8c0ae860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.969+0000 7f9f9247f700 1 --2- 172.21.15.62:0/2509829309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c0b2e70 0x7f9f8c0ae860 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f9f80002f70 tx=0x7f9f80006eb0).stop 2021-12-17T18:27:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.969+0000 7f9f9247f700 1 -- 172.21.15.62:0/2509829309 shutdown_connections 2021-12-17T18:27:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.969+0000 7f9f9247f700 1 --2- 172.21.15.62:0/2509829309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c0b2e70 0x7f9f8c0ae860 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.969+0000 7f9f9247f700 1 --2- 172.21.15.62:0/2509829309 >> v2:172.21.15.109:3300/0 conn(0x7f9f8c05fa70 0x7f9f8c146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.969+0000 7f9f9247f700 1 -- 172.21.15.62:0/2509829309 >> 172.21.15.62:0/2509829309 conn(0x7f9f8c05bcd0 msgr2=0x7f9f8c0638c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:20.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.969+0000 7f9f9247f700 1 -- 172.21.15.62:0/2509829309 shutdown_connections 2021-12-17T18:27:20.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.969+0000 7f9f9247f700 1 -- 172.21.15.62:0/2509829309 wait complete. 2021-12-17T18:27:20.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.969+0000 7f9f9247f700 1 Processor -- start 2021-12-17T18:27:20.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.969+0000 7f9f9247f700 1 -- start start 2021-12-17T18:27:20.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.969+0000 7f9f9247f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c05fa70 0x7f9f8c149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:20.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.969+0000 7f9f9247f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f8c0b10e0 0x7f9f8c0661e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:20.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f9247f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9f8c067680 0x7f9f8c155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:20.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f9247f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c064c70 con 0x7f9f8c05fa70 2021-12-17T18:27:20.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f9247f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c067220 con 0x7f9f8c067680 2021-12-17T18:27:20.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f9247f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c064ea0 con 0x7f9f8c0b10e0 2021-12-17T18:27:20.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f8bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c05fa70 0x7f9f8c149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:20.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f8b7fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f8c0b10e0 0x7f9f8c0661e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:20.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f8bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c05fa70 0x7f9f8c149080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55914/0 (socket says 172.21.15.62:55914) 2021-12-17T18:27:20.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f8bfff700 1 -- 172.21.15.62:0/2989824137 learned_addr learned my addr 172.21.15.62:0/2989824137 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:20.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f90a1c700 1 --2- 172.21.15.62:0/2989824137 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9f8c067680 0x7f9f8c155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:20.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f8bfff700 1 -- 172.21.15.62:0/2989824137 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f8c0b10e0 msgr2=0x7f9f8c0661e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f8bfff700 1 --2- 172.21.15.62:0/2989824137 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f8c0b10e0 0x7f9f8c0661e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f8bfff700 1 -- 172.21.15.62:0/2989824137 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9f8c067680 msgr2=0x7f9f8c155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:20.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f8bfff700 1 --2- 172.21.15.62:0/2989824137 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9f8c067680 0x7f9f8c155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:20.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f8bfff700 1 -- 172.21.15.62:0/2989824137 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8000b1e0 con 0x7f9f8c05fa70 2021-12-17T18:27:20.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f90a1c700 1 --2- 172.21.15.62:0/2989824137 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9f8c067680 0x7f9f8c155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:20.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f8bfff700 1 --2- 172.21.15.62:0/2989824137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c05fa70 0x7f9f8c149080 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f9f7c006940 tx=0x7f9f7c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:20.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f897fa700 1 -- 172.21.15.62:0/2989824137 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f7c011850 con 0x7f9f8c05fa70 2021-12-17T18:27:20.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f897fa700 1 -- 172.21.15.62:0/2989824137 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c0119b0 con 0x7f9f8c05fa70 2021-12-17T18:27:20.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f9247f700 1 -- 172.21.15.62:0/2989824137 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8c0b72f0 con 0x7f9f8c05fa70 2021-12-17T18:27:20.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f897fa700 1 -- 172.21.15.62:0/2989824137 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f7c011d10 con 0x7f9f8c05fa70 2021-12-17T18:27:20.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f9247f700 1 -- 172.21.15.62:0/2989824137 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8c0666d0 con 0x7f9f8c05fa70 2021-12-17T18:27:20.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f9247f700 1 -- 172.21.15.62:0/2989824137 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8c0b37e0 con 0x7f9f8c05fa70 2021-12-17T18:27:20.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.973+0000 7f9f897fa700 1 -- 172.21.15.62:0/2989824137 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9f7c01c460 con 0x7f9f8c05fa70 2021-12-17T18:27:20.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.977+0000 7f9f897fa700 1 --2- 172.21.15.62:0/2989824137 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f6c0536d0 0x7f9f6c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:20.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.977+0000 7f9f897fa700 1 -- 172.21.15.62:0/2989824137 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9f7c06bc50 con 0x7f9f8c05fa70 2021-12-17T18:27:20.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.977+0000 7f9f8b7fe700 1 --2- 172.21.15.62:0/2989824137 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f6c0536d0 0x7f9f6c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:20.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.977+0000 7f9f8b7fe700 1 --2- 172.21.15.62:0/2989824137 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f6c0536d0 0x7f9f6c055b90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f9f8001c000 tx=0x7f9f80015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:20.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:20.981+0000 7f9f897fa700 1 -- 172.21.15.62:0/2989824137 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9f7c042d50 con 0x7f9f8c05fa70 2021-12-17T18:27:21.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.149+0000 7f9f9247f700 1 -- 172.21.15.62:0/2989824137 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f8c0573d0 con 0x7f9f8c05fa70 2021-12-17T18:27:21.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.149+0000 7f9f897fa700 1 -- 172.21.15.62:0/2989824137 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f9f7c046370 con 0x7f9f8c05fa70 2021-12-17T18:27:21.154 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:21.154 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7957,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6833/3542826349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3542826349},{"type":"v1","addr":"172.21.15.62:6833","nonce":3542826349}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:27:19.830173+0000","modified":"2021-12-17T18:27:20.832915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/570760267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":570760267},{"type":"v1","addr":"172.21.15.109:6835","nonce":570760267}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-12-17T18:27:21.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.153+0000 7f9f9247f700 1 -- 172.21.15.62:0/2989824137 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f6c0536d0 msgr2=0x7f9f6c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.153+0000 7f9f9247f700 1 --2- 172.21.15.62:0/2989824137 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f6c0536d0 0x7f9f6c055b90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f9f8001c000 tx=0x7f9f80015000).stop 2021-12-17T18:27:21.157 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.153+0000 7f9f9247f700 1 -- 172.21.15.62:0/2989824137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c05fa70 msgr2=0x7f9f8c149080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.153+0000 7f9f9247f700 1 --2- 172.21.15.62:0/2989824137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c05fa70 0x7f9f8c149080 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f9f7c006940 tx=0x7f9f7c008040).stop 2021-12-17T18:27:21.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.153+0000 7f9f9247f700 1 -- 172.21.15.62:0/2989824137 shutdown_connections 2021-12-17T18:27:21.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.153+0000 7f9f9247f700 1 --2- 172.21.15.62:0/2989824137 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9f6c0536d0 0x7f9f6c055b90 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.153+0000 7f9f9247f700 1 --2- 172.21.15.62:0/2989824137 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9f8c067680 0x7f9f8c155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.153+0000 7f9f9247f700 1 --2- 172.21.15.62:0/2989824137 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9f8c0b10e0 0x7f9f8c0661e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.153+0000 7f9f9247f700 1 --2- 172.21.15.62:0/2989824137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f8c05fa70 0x7f9f8c149080 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.153+0000 7f9f9247f700 1 -- 172.21.15.62:0/2989824137 >> 172.21.15.62:0/2989824137 conn(0x7f9f8c05bcd0 msgr2=0x7f9f8c0b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.153+0000 7f9f9247f700 1 -- 172.21.15.62:0/2989824137 shutdown_connections 2021-12-17T18:27:21.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.153+0000 7f9f9247f700 1 -- 172.21.15.62:0/2989824137 wait complete. 2021-12-17T18:27:21.160 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 66 2021-12-17T18:27:21.171 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:27:21.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.269+0000 7fe6ad627700 1 Processor -- start 2021-12-17T18:27:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.269+0000 7fe6ad627700 1 -- start start 2021-12-17T18:27:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6ad627700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6a8141480 0x7fe6a8147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6ad627700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe6a80a8e10 0x7fe6a80b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6ad627700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a8147610 con 0x7fe6a80b6050 2021-12-17T18:27:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6ad627700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a81478b0 con 0x7fe6a80a8e10 2021-12-17T18:27:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6ad627700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a8147b50 con 0x7fe6a8141480 2021-12-17T18:27:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6a7fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6a8141480 0x7fe6a8147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6a77fe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe6a80a8e10 0x7fe6a80b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6a7fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6a8141480 0x7fe6a8147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:49622/0 (socket says 172.21.15.62:49622) 2021-12-17T18:27:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6ace26700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7fe6a80b6050 0x7fe6a80a7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:55822/0 (socket says 172.21.15.62:55822) 2021-12-17T18:27:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6a7fff700 1 -- 172.21.15.62:0/1823356947 learned_addr learned my addr 172.21.15.62:0/1823356947 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6a6ffd700 1 -- 172.21.15.62:0/1823356947 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252411846 0 0) 0x7fe6a8147610 con 0x7fe6a80b6050 2021-12-17T18:27:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6a6ffd700 1 -- 172.21.15.62:0/1823356947 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe694003260 con 0x7fe6a80b6050 2021-12-17T18:27:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6a7fff700 1 -- 172.21.15.62:0/1823356947 >> v2:172.21.15.109:3300/0 conn(0x7fe6a80a8e10 msgr2=0x7fe6a80b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6a7fff700 1 --2- 172.21.15.62:0/1823356947 >> v2:172.21.15.109:3300/0 conn(0x7fe6a80a8e10 0x7fe6a80b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6a7fff700 1 -- 172.21.15.62:0/1823356947 >> v1:172.21.15.109:6789/0 conn(0x7fe6a80b6050 legacy=0x7fe6a80a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6a7fff700 1 -- 172.21.15.62:0/1823356947 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a80b1b90 con 0x7fe6a8141480 2021-12-17T18:27:21.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6a7fff700 1 --2- 172.21.15.62:0/1823356947 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6a8141480 0x7fe6a8147ff0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fe6a00032f0 tx=0x7fe6a0009290).ready entity=mon.2 client_cookie=f6f6e68dbb5d1e82 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:21.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6a6ffd700 1 -- 172.21.15.62:0/1823356947 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6a000b6c0 con 0x7fe6a8141480 2021-12-17T18:27:21.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6a6ffd700 1 -- 172.21.15.62:0/1823356947 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a000b820 con 0x7fe6a8141480 2021-12-17T18:27:21.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6a6ffd700 1 -- 172.21.15.62:0/1823356947 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6a000b990 con 0x7fe6a8141480 2021-12-17T18:27:21.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6ad627700 1 -- 172.21.15.62:0/1823356947 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6a8141480 msgr2=0x7fe6a8147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6ad627700 1 --2- 172.21.15.62:0/1823356947 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6a8141480 0x7fe6a8147ff0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fe6a00032f0 tx=0x7fe6a0009290).stop 2021-12-17T18:27:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6ad627700 1 -- 172.21.15.62:0/1823356947 shutdown_connections 2021-12-17T18:27:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6ad627700 1 --2- 172.21.15.62:0/1823356947 >> v2:172.21.15.109:3300/0 conn(0x7fe6a80a8e10 0x7fe6a80b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6ad627700 1 --2- 172.21.15.62:0/1823356947 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6a8141480 0x7fe6a8147ff0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6ad627700 1 -- 172.21.15.62:0/1823356947 >> 172.21.15.62:0/1823356947 conn(0x7fe6a805d220 msgr2=0x7fe6a80b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:21.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6ad627700 1 -- 172.21.15.62:0/1823356947 shutdown_connections 2021-12-17T18:27:21.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.273+0000 7fe6ad627700 1 -- 172.21.15.62:0/1823356947 wait complete. 2021-12-17T18:27:21.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ad627700 1 Processor -- start 2021-12-17T18:27:21.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ad627700 1 -- start start 2021-12-17T18:27:21.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ad627700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6a80a8e10 0x7fe6a80af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ad627700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6a80b6050 0x7fe6a80a95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ad627700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6a8149910 0x7fe6a8149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ad627700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a813c450 con 0x7fe6a80a8e10 2021-12-17T18:27:21.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ad627700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a8157d00 con 0x7fe6a80b6050 2021-12-17T18:27:21.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ad627700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a814b3d0 con 0x7fe6a8149910 2021-12-17T18:27:21.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6a7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6a80a8e10 0x7fe6a80af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ace26700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6a8149910 0x7fe6a8149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6a7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6a80a8e10 0x7fe6a80af360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55930/0 (socket says 172.21.15.62:55930) 2021-12-17T18:27:21.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ace26700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6a8149910 0x7fe6a8149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:49630/0 (socket says 172.21.15.62:49630) 2021-12-17T18:27:21.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6a7fff700 1 -- 172.21.15.62:0/2320156995 learned_addr learned my addr 172.21.15.62:0/2320156995 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:21.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6a77fe700 1 --2- 172.21.15.62:0/2320156995 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6a80b6050 0x7fe6a80a95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ace26700 1 -- 172.21.15.62:0/2320156995 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6a80b6050 msgr2=0x7fe6a80a95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ace26700 1 --2- 172.21.15.62:0/2320156995 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6a80b6050 0x7fe6a80a95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ace26700 1 -- 172.21.15.62:0/2320156995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6a80a8e10 msgr2=0x7fe6a80af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ace26700 1 --2- 172.21.15.62:0/2320156995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6a80a8e10 0x7fe6a80af360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ace26700 1 -- 172.21.15.62:0/2320156995 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a0009530 con 0x7fe6a8149910 2021-12-17T18:27:21.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ace26700 1 --2- 172.21.15.62:0/2320156995 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6a8149910 0x7fe6a8149dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fe6a813c590 tx=0x7fe6980079a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:21.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6a57fa700 1 -- 172.21.15.62:0/2320156995 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe69800cda0 con 0x7fe6a8149910 2021-12-17T18:27:21.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6a57fa700 1 -- 172.21.15.62:0/2320156995 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6980070d0 con 0x7fe6a8149910 2021-12-17T18:27:21.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ad627700 1 -- 172.21.15.62:0/2320156995 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a8157a80 con 0x7fe6a8149910 2021-12-17T18:27:21.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6a57fa700 1 -- 172.21.15.62:0/2320156995 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe698005550 con 0x7fe6a8149910 2021-12-17T18:27:21.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.277+0000 7fe6ad627700 1 -- 172.21.15.62:0/2320156995 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a814b0d0 con 0x7fe6a8149910 2021-12-17T18:27:21.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.281+0000 7fe6ad627700 1 -- 172.21.15.62:0/2320156995 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a8158160 con 0x7fe6a8149910 2021-12-17T18:27:21.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.281+0000 7fe6a57fa700 1 -- 172.21.15.62:0/2320156995 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe698010070 con 0x7fe6a8149910 2021-12-17T18:27:21.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.281+0000 7fe6a57fa700 1 --2- 172.21.15.62:0/2320156995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe6880536a0 0x7fe688055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.281+0000 7fe6a57fa700 1 -- 172.21.15.62:0/2320156995 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe69806adf0 con 0x7fe6a8149910 2021-12-17T18:27:21.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.281+0000 7fe6a7fff700 1 --2- 172.21.15.62:0/2320156995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe6880536a0 0x7fe688055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.281+0000 7fe6a7fff700 1 --2- 172.21.15.62:0/2320156995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe6880536a0 0x7fe688055b60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fe6a001b000 tx=0x7fe6a0016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:21.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.289+0000 7fe6a57fa700 1 -- 172.21.15.62:0/2320156995 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe6a8158160 con 0x7fe6a8149910 2021-12-17T18:27:21.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.421+0000 7fe6ad627700 1 -- 172.21.15.62:0/2320156995 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6a8158160 con 0x7fe6a8149910 2021-12-17T18:27:21.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.421+0000 7fe6a57fa700 1 -- 172.21.15.62:0/2320156995 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16113 (secure 0 0 0) 0x7fe6a8158160 con 0x7fe6a8149910 2021-12-17T18:27:21.428 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:21.428 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":131,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:27:20.833557+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:27:17.568635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-12-17T18:27:18.849290+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:27:21.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.425+0000 7fe6ad627700 1 -- 172.21.15.62:0/2320156995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe6880536a0 msgr2=0x7fe688055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.425+0000 7fe6ad627700 1 --2- 172.21.15.62:0/2320156995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe6880536a0 0x7fe688055b60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fe6a001b000 tx=0x7fe6a0016000).stop 2021-12-17T18:27:21.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.425+0000 7fe6ad627700 1 -- 172.21.15.62:0/2320156995 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6a8149910 msgr2=0x7fe6a8149dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.425+0000 7fe6ad627700 1 --2- 172.21.15.62:0/2320156995 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6a8149910 0x7fe6a8149dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fe6a813c590 tx=0x7fe6980079a0).stop 2021-12-17T18:27:21.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.425+0000 7fe6ad627700 1 -- 172.21.15.62:0/2320156995 shutdown_connections 2021-12-17T18:27:21.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.425+0000 7fe6ad627700 1 --2- 172.21.15.62:0/2320156995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe6880536a0 0x7fe688055b60 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.425+0000 7fe6ad627700 1 --2- 172.21.15.62:0/2320156995 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe6a8149910 0x7fe6a8149dc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.425+0000 7fe6ad627700 1 --2- 172.21.15.62:0/2320156995 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6a80b6050 0x7fe6a80a95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.425+0000 7fe6ad627700 1 --2- 172.21.15.62:0/2320156995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6a80a8e10 0x7fe6a80af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.425+0000 7fe6ad627700 1 -- 172.21.15.62:0/2320156995 >> 172.21.15.62:0/2320156995 conn(0x7fe6a805d220 msgr2=0x7fe6a80b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:21.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.425+0000 7fe6ad627700 1 -- 172.21.15.62:0/2320156995 shutdown_connections 2021-12-17T18:27:21.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.425+0000 7fe6ad627700 1 -- 172.21.15.62:0/2320156995 wait complete. 2021-12-17T18:27:21.446 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:27:21.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.553+0000 7faabed76700 1 Processor -- start 2021-12-17T18:27:21.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.553+0000 7faabed76700 1 -- start start 2021-12-17T18:27:21.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.553+0000 7faabed76700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faab81405f0 0x7faab8061390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.553+0000 7faabed76700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7faab8064de0 0x7faab8062450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.553+0000 7faabed76700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab805fe50 con 0x7faab805fa70 2021-12-17T18:27:21.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.553+0000 7faabed76700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab80646a0 con 0x7faab81405f0 2021-12-17T18:27:21.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.553+0000 7faabed76700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab8064940 con 0x7faab8064de0 2021-12-17T18:27:21.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabd573700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faab81405f0 0x7faab8061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabd573700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faab81405f0 0x7faab8061390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55936/0 (socket says 172.21.15.62:55936) 2021-12-17T18:27:21.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabd573700 1 -- 172.21.15.62:0/2523640075 learned_addr learned my addr 172.21.15.62:0/2523640075 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:21.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabdd74700 1 --1- 172.21.15.62:0/2523640075 >> v1:172.21.15.62:6789/0 conn(0x7faab805fa70 0x7faab813fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39514/0 (socket says 172.21.15.62:39514) 2021-12-17T18:27:21.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabe575700 1 --2- 172.21.15.62:0/2523640075 >> v2:172.21.15.109:3300/0 conn(0x7faab8064de0 0x7faab8062450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabd573700 1 -- 172.21.15.62:0/2523640075 >> v2:172.21.15.109:3300/0 conn(0x7faab8064de0 msgr2=0x7faab8062450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:21.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabd573700 1 --2- 172.21.15.62:0/2523640075 >> v2:172.21.15.109:3300/0 conn(0x7faab8064de0 0x7faab8062450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabd573700 1 -- 172.21.15.62:0/2523640075 >> v1:172.21.15.62:6789/0 conn(0x7faab805fa70 legacy=0x7faab813fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.564 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabd573700 1 -- 172.21.15.62:0/2523640075 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab8142e50 con 0x7faab81405f0 2021-12-17T18:27:21.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabe575700 1 --2- 172.21.15.62:0/2523640075 >> v2:172.21.15.109:3300/0 conn(0x7faab8064de0 0x7faab8062450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:21.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabd573700 1 --2- 172.21.15.62:0/2523640075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab81405f0 0x7faab8061390 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7faab4002f70 tx=0x7faab4006eb0).ready entity=mon.0 client_cookie=c2f51fd6ca294ff8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:21.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabcd72700 1 -- 172.21.15.62:0/2523640075 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faab400d610 con 0x7faab81405f0 2021-12-17T18:27:21.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabcd72700 1 -- 172.21.15.62:0/2523640075 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab4000e90 con 0x7faab81405f0 2021-12-17T18:27:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabcd72700 1 -- 172.21.15.62:0/2523640075 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faab400d9a0 con 0x7faab81405f0 2021-12-17T18:27:21.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabed76700 1 -- 172.21.15.62:0/2523640075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab81405f0 msgr2=0x7faab8061390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabed76700 1 --2- 172.21.15.62:0/2523640075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab81405f0 0x7faab8061390 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7faab4002f70 tx=0x7faab4006eb0).stop 2021-12-17T18:27:21.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabed76700 1 -- 172.21.15.62:0/2523640075 shutdown_connections 2021-12-17T18:27:21.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabed76700 1 --2- 172.21.15.62:0/2523640075 >> v2:172.21.15.109:3300/0 conn(0x7faab8064de0 0x7faab8062450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabed76700 1 --2- 172.21.15.62:0/2523640075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab81405f0 0x7faab8061390 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabed76700 1 -- 172.21.15.62:0/2523640075 >> 172.21.15.62:0/2523640075 conn(0x7faab805bcd0 msgr2=0x7faab8063510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:21.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabed76700 1 -- 172.21.15.62:0/2523640075 shutdown_connections 2021-12-17T18:27:21.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabed76700 1 -- 172.21.15.62:0/2523640075 wait complete. 2021-12-17T18:27:21.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.557+0000 7faabed76700 1 Processor -- start 2021-12-17T18:27:21.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabed76700 1 -- start start 2021-12-17T18:27:21.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabed76700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faab805fa70 0x7faab80b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabed76700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faab8064de0 0x7faab8144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabed76700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab81405f0 0x7faab80ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabed76700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab8145110 con 0x7faab81405f0 2021-12-17T18:27:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabed76700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab81444e0 con 0x7faab8064de0 2021-12-17T18:27:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabed76700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab8144780 con 0x7faab805fa70 2021-12-17T18:27:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabe575700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab81405f0 0x7faab80ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabd573700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faab8064de0 0x7faab8144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabe575700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab81405f0 0x7faab80ae780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55944/0 (socket says 172.21.15.62:55944) 2021-12-17T18:27:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabdd74700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faab805fa70 0x7faab80b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabe575700 1 -- 172.21.15.62:0/3571295973 learned_addr learned my addr 172.21.15.62:0/3571295973 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabe575700 1 -- 172.21.15.62:0/3571295973 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faab805fa70 msgr2=0x7faab80b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabe575700 1 --2- 172.21.15.62:0/3571295973 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faab805fa70 0x7faab80b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabe575700 1 -- 172.21.15.62:0/3571295973 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faab8064de0 msgr2=0x7faab8144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabe575700 1 --2- 172.21.15.62:0/3571295973 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faab8064de0 0x7faab8144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabe575700 1 -- 172.21.15.62:0/3571295973 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab400b1e0 con 0x7faab81405f0 2021-12-17T18:27:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabd573700 1 --2- 172.21.15.62:0/3571295973 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faab8064de0 0x7faab8144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabdd74700 1 --2- 172.21.15.62:0/3571295973 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faab805fa70 0x7faab80b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabe575700 1 --2- 172.21.15.62:0/3571295973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab81405f0 0x7faab80ae780 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7faab0006cc0 tx=0x7faab0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faaa6ffd700 1 -- 172.21.15.62:0/3571295973 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faab0013620 con 0x7faab81405f0 2021-12-17T18:27:21.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faaa6ffd700 1 -- 172.21.15.62:0/3571295973 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab0013780 con 0x7faab81405f0 2021-12-17T18:27:21.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabed76700 1 -- 172.21.15.62:0/3571295973 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab8066b10 con 0x7faab81405f0 2021-12-17T18:27:21.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faaa6ffd700 1 -- 172.21.15.62:0/3571295973 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faab0013ae0 con 0x7faab81405f0 2021-12-17T18:27:21.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.561+0000 7faabed76700 1 -- 172.21.15.62:0/3571295973 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab8145e10 con 0x7faab81405f0 2021-12-17T18:27:21.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.565+0000 7faabed76700 1 -- 172.21.15.62:0/3571295973 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab8144940 con 0x7faab81405f0 2021-12-17T18:27:21.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.565+0000 7faaa6ffd700 1 -- 172.21.15.62:0/3571295973 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faab0013c40 con 0x7faab81405f0 2021-12-17T18:27:21.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.565+0000 7faaa6ffd700 1 --2- 172.21.15.62:0/3571295973 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faa980536d0 0x7faa98055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.565+0000 7faaa6ffd700 1 -- 172.21.15.62:0/3571295973 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faab006b830 con 0x7faab81405f0 2021-12-17T18:27:21.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.565+0000 7faabdd74700 1 --2- 172.21.15.62:0/3571295973 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faa980536d0 0x7faa98055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.565+0000 7faabdd74700 1 --2- 172.21.15.62:0/3571295973 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faa980536d0 0x7faa98055b90 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7faaa800d000 tx=0x7faaa8007b80).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:21.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.569+0000 7faaa6ffd700 1 -- 172.21.15.62:0/3571295973 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faab0042880 con 0x7faab81405f0 2021-12-17T18:27:21.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.737+0000 7faabed76700 1 -- 172.21.15.62:0/3571295973 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7faab80573d0 con 0x7faab81405f0 2021-12-17T18:27:21.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.745+0000 7faaa6ffd700 1 -- 172.21.15.62:0/3571295973 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v39) v1 ==== 184+0+0 (secure 0 0 0) 0x7faab000f040 con 0x7faab81405f0 2021-12-17T18:27:21.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.749+0000 7faabed76700 1 -- 172.21.15.62:0/3571295973 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faa980536d0 msgr2=0x7faa98055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.749+0000 7faabed76700 1 --2- 172.21.15.62:0/3571295973 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faa980536d0 0x7faa98055b90 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7faaa800d000 tx=0x7faaa8007b80).stop 2021-12-17T18:27:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.749+0000 7faabed76700 1 -- 172.21.15.62:0/3571295973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab81405f0 msgr2=0x7faab80ae780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.749+0000 7faabed76700 1 --2- 172.21.15.62:0/3571295973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab81405f0 0x7faab80ae780 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7faab0006cc0 tx=0x7faab0008040).stop 2021-12-17T18:27:21.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.749+0000 7faabed76700 1 -- 172.21.15.62:0/3571295973 shutdown_connections 2021-12-17T18:27:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.749+0000 7faabed76700 1 --2- 172.21.15.62:0/3571295973 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7faa980536d0 0x7faa98055b90 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.749+0000 7faabed76700 1 --2- 172.21.15.62:0/3571295973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab81405f0 0x7faab80ae780 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.749+0000 7faabed76700 1 --2- 172.21.15.62:0/3571295973 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7faab8064de0 0x7faab8144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.749+0000 7faabed76700 1 --2- 172.21.15.62:0/3571295973 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7faab805fa70 0x7faab80b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.749+0000 7faabed76700 1 -- 172.21.15.62:0/3571295973 >> 172.21.15.62:0/3571295973 conn(0x7faab805bcd0 msgr2=0x7faab80b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:21.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.749+0000 7faabed76700 1 -- 172.21.15.62:0/3571295973 shutdown_connections 2021-12-17T18:27:21.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.749+0000 7faabed76700 1 -- 172.21.15.62:0/3571295973 wait complete. 2021-12-17T18:27:21.758 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.0 2021-12-17T18:27:21.765 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:27:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.869+0000 7f7bff18b700 1 Processor -- start 2021-12-17T18:27:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.869+0000 7f7bff18b700 1 -- start start 2021-12-17T18:27:21.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bff18b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7bf8060540 0x7f7bf805f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bff18b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7bf80ad150 0x7f7bf80b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bff18b700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf805ce70 con 0x7f7bf805ca90 2021-12-17T18:27:21.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bff18b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf80afc70 con 0x7f7bf8060540 2021-12-17T18:27:21.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bff18b700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf80abf30 con 0x7f7bf80ad150 2021-12-17T18:27:21.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bfd988700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7bf8060540 0x7f7bf805f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bfd988700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7bf8060540 0x7f7bf805f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55950/0 (socket says 172.21.15.62:55950) 2021-12-17T18:27:21.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bfd988700 1 -- 172.21.15.62:0/2795549844 learned_addr learned my addr 172.21.15.62:0/2795549844 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:21.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bfe98a700 1 --2- 172.21.15.62:0/2795549844 >> v2:172.21.15.109:3300/0 conn(0x7f7bf80ad150 0x7f7bf80b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bfd988700 1 -- 172.21.15.62:0/2795549844 >> v2:172.21.15.109:3300/0 conn(0x7f7bf80ad150 msgr2=0x7f7bf80b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:21.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bfd988700 1 --2- 172.21.15.62:0/2795549844 >> v2:172.21.15.109:3300/0 conn(0x7f7bf80ad150 0x7f7bf80b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bfd988700 1 -- 172.21.15.62:0/2795549844 >> v1:172.21.15.109:6789/0 conn(0x7f7bf805ca90 legacy=0x7f7bf80aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bfd988700 1 -- 172.21.15.62:0/2795549844 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf80ac1d0 con 0x7f7bf8060540 2021-12-17T18:27:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bfd988700 1 --2- 172.21.15.62:0/2795549844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf8060540 0x7f7bf805f730 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f7bec002f70 tx=0x7f7bec006eb0).ready entity=mon.0 client_cookie=6c3725ff00642ff5 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bfd187700 1 -- 172.21.15.62:0/2795549844 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bec00d610 con 0x7f7bf8060540 2021-12-17T18:27:21.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bfd187700 1 -- 172.21.15.62:0/2795549844 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec000e90 con 0x7f7bf8060540 2021-12-17T18:27:21.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bfd187700 1 -- 172.21.15.62:0/2795549844 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bec00d9a0 con 0x7f7bf8060540 2021-12-17T18:27:21.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bff18b700 1 -- 172.21.15.62:0/2795549844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf8060540 msgr2=0x7f7bf805f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bff18b700 1 --2- 172.21.15.62:0/2795549844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf8060540 0x7f7bf805f730 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f7bec002f70 tx=0x7f7bec006eb0).stop 2021-12-17T18:27:21.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bff18b700 1 -- 172.21.15.62:0/2795549844 shutdown_connections 2021-12-17T18:27:21.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bff18b700 1 --2- 172.21.15.62:0/2795549844 >> v2:172.21.15.109:3300/0 conn(0x7f7bf80ad150 0x7f7bf80b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bff18b700 1 --2- 172.21.15.62:0/2795549844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf8060540 0x7f7bf805f730 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bff18b700 1 -- 172.21.15.62:0/2795549844 >> 172.21.15.62:0/2795549844 conn(0x7f7bf805be70 msgr2=0x7f7bf8062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:21.884 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bff18b700 1 -- 172.21.15.62:0/2795549844 shutdown_connections 2021-12-17T18:27:21.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bff18b700 1 -- 172.21.15.62:0/2795549844 wait complete. 2021-12-17T18:27:21.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bff18b700 1 Processor -- start 2021-12-17T18:27:21.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.873+0000 7f7bff18b700 1 -- start start 2021-12-17T18:27:21.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bff18b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf805ca90 0x7f7bf81480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bff18b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bf8060540 0x7f7bf80b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bff18b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bf80ad150 0x7f7bf8156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bff18b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf815aea0 con 0x7f7bf805ca90 2021-12-17T18:27:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bff18b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf80670a0 con 0x7f7bf80ad150 2021-12-17T18:27:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bff18b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf8067340 con 0x7f7bf8060540 2021-12-17T18:27:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bfe189700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf805ca90 0x7f7bf81480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bfe189700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf805ca90 0x7f7bf81480f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55954/0 (socket says 172.21.15.62:55954) 2021-12-17T18:27:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bfe189700 1 -- 172.21.15.62:0/689511713 learned_addr learned my addr 172.21.15.62:0/689511713 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bfe98a700 1 --2- 172.21.15.62:0/689511713 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bf80ad150 0x7f7bf8156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bfd988700 1 --2- 172.21.15.62:0/689511713 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bf8060540 0x7f7bf80b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bfe189700 1 -- 172.21.15.62:0/689511713 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bf8060540 msgr2=0x7f7bf80b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bfe189700 1 --2- 172.21.15.62:0/689511713 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bf8060540 0x7f7bf80b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bfe189700 1 -- 172.21.15.62:0/689511713 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bf80ad150 msgr2=0x7f7bf8156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bfe189700 1 --2- 172.21.15.62:0/689511713 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bf80ad150 0x7f7bf8156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bfe189700 1 -- 172.21.15.62:0/689511713 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec00b1e0 con 0x7f7bf805ca90 2021-12-17T18:27:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bfd988700 1 --2- 172.21.15.62:0/689511713 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bf8060540 0x7f7bf80b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:27:21.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bfe98a700 1 --2- 172.21.15.62:0/689511713 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bf80ad150 0x7f7bf8156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:27:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bfe189700 1 --2- 172.21.15.62:0/689511713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf805ca90 0x7f7bf81480f0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f7bf805d160 tx=0x7f7bf00014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bf77fe700 1 -- 172.21.15.62:0/689511713 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bf0010510 con 0x7f7bf805ca90 2021-12-17T18:27:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bf77fe700 1 -- 172.21.15.62:0/689511713 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf0010670 con 0x7f7bf805ca90 2021-12-17T18:27:21.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bf77fe700 1 -- 172.21.15.62:0/689511713 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bf00107e0 con 0x7f7bf805ca90 2021-12-17T18:27:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bff18b700 1 -- 172.21.15.62:0/689511713 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf81485e0 con 0x7f7bf805ca90 2021-12-17T18:27:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bff18b700 1 -- 172.21.15.62:0/689511713 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf80b4a20 con 0x7f7bf805ca90 2021-12-17T18:27:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bff18b700 1 -- 172.21.15.62:0/689511713 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf8144ab0 con 0x7f7bf805ca90 2021-12-17T18:27:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bf77fe700 1 -- 172.21.15.62:0/689511713 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7bf0010070 con 0x7f7bf805ca90 2021-12-17T18:27:21.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bf77fe700 1 --2- 172.21.15.62:0/689511713 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7bd80536a0 0x7f7bd8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:21.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bf77fe700 1 -- 172.21.15.62:0/689511713 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7bf006b650 con 0x7f7bf805ca90 2021-12-17T18:27:21.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.877+0000 7f7bfd988700 1 --2- 172.21.15.62:0/689511713 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7bd80536a0 0x7f7bd8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:21.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.881+0000 7f7bfd988700 1 --2- 172.21.15.62:0/689511713 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7bd80536a0 0x7f7bd8055b60 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f7bec017000 tx=0x7f7bec015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:21.896 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:21.885+0000 7f7bf77fe700 1 -- 172.21.15.62:0/689511713 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7bf8144ab0 con 0x7f7bf805ca90 2021-12-17T18:27:22.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.053+0000 7f7bff18b700 1 -- 172.21.15.62:0/689511713 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7bf8144ab0 con 0x7f7bf805ca90 2021-12-17T18:27:22.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.061+0000 7f7bf77fe700 1 -- 172.21.15.62:0/689511713 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v40) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7bf8144ab0 con 0x7f7bf805ca90 2021-12-17T18:27:22.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.061+0000 7f7bff18b700 1 -- 172.21.15.62:0/689511713 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7bd80536a0 msgr2=0x7f7bd8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:22.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.061+0000 7f7bff18b700 1 --2- 172.21.15.62:0/689511713 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7bd80536a0 0x7f7bd8055b60 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f7bec017000 tx=0x7f7bec015000).stop 2021-12-17T18:27:22.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.061+0000 7f7bff18b700 1 -- 172.21.15.62:0/689511713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf805ca90 msgr2=0x7f7bf81480f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:22.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.061+0000 7f7bff18b700 1 --2- 172.21.15.62:0/689511713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf805ca90 0x7f7bf81480f0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f7bf805d160 tx=0x7f7bf00014a0).stop 2021-12-17T18:27:22.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.061+0000 7f7bff18b700 1 -- 172.21.15.62:0/689511713 shutdown_connections 2021-12-17T18:27:22.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.061+0000 7f7bff18b700 1 --2- 172.21.15.62:0/689511713 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7bd80536a0 0x7f7bd8055b60 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.061+0000 7f7bff18b700 1 --2- 172.21.15.62:0/689511713 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7bf80ad150 0x7f7bf8156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.061+0000 7f7bff18b700 1 --2- 172.21.15.62:0/689511713 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7bf8060540 0x7f7bf80b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.061+0000 7f7bff18b700 1 --2- 172.21.15.62:0/689511713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf805ca90 0x7f7bf81480f0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.061+0000 7f7bff18b700 1 -- 172.21.15.62:0/689511713 >> 172.21.15.62:0/689511713 conn(0x7f7bf805be70 msgr2=0x7f7bf80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:22.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.061+0000 7f7bff18b700 1 -- 172.21.15.62:0/689511713 shutdown_connections 2021-12-17T18:27:22.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.061+0000 7f7bff18b700 1 -- 172.21.15.62:0/689511713 wait complete. 2021-12-17T18:27:22.072 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.1 2021-12-17T18:27:22.082 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:27:22.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.189+0000 7f9ee305f700 1 Processor -- start 2021-12-17T18:27:22.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.189+0000 7f9ee305f700 1 -- start start 2021-12-17T18:27:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.189+0000 7f9ee305f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9edc0b4340 0x7f9edc1471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.189+0000 7f9ee305f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f9edc142d70 0x7f9edc0b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.189+0000 7f9ee305f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc0b09e0 con 0x7f9edc0b51a0 2021-12-17T18:27:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.189+0000 7f9ee305f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9edc1467d0 con 0x7f9edc0b4340 2021-12-17T18:27:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.189+0000 7f9ee305f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9edc146a70 con 0x7f9edc142d70 2021-12-17T18:27:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.189+0000 7f9ee0dfb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9edc0b4340 0x7f9edc1471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.189+0000 7f9ee0dfb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9edc0b4340 0x7f9edc1471b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55964/0 (socket says 172.21.15.62:55964) 2021-12-17T18:27:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.189+0000 7f9ee0dfb700 1 -- 172.21.15.62:0/3138608052 learned_addr learned my addr 172.21.15.62:0/3138608052 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.189+0000 7f9ee15fc700 1 --2- 172.21.15.62:0/3138608052 >> v2:172.21.15.109:3300/0 conn(0x7f9edc142d70 0x7f9edc0b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:22.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.189+0000 7f9ee0dfb700 1 -- 172.21.15.62:0/3138608052 >> v2:172.21.15.109:3300/0 conn(0x7f9edc142d70 msgr2=0x7f9edc0b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:22.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee0dfb700 1 --2- 172.21.15.62:0/3138608052 >> v2:172.21.15.109:3300/0 conn(0x7f9edc142d70 0x7f9edc0b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee0dfb700 1 -- 172.21.15.62:0/3138608052 >> v1:172.21.15.109:6789/0 conn(0x7f9edc0b51a0 legacy=0x7f9edc142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:22.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9edb7fe700 1 -- 172.21.15.62:0/3138608052 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542682788 0 0) 0x7f9edc0b09e0 con 0x7f9edc0b51a0 2021-12-17T18:27:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee0dfb700 1 -- 172.21.15.62:0/3138608052 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc146d10 con 0x7f9edc0b4340 2021-12-17T18:27:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee0dfb700 1 --2- 172.21.15.62:0/3138608052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9edc0b4340 0x7f9edc1471b0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f9ec4002f70 tx=0x7f9ec4006eb0).ready entity=mon.0 client_cookie=c6fafe57f4b7ea08 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9edb7fe700 1 -- 172.21.15.62:0/3138608052 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ec400d5c0 con 0x7f9edc0b4340 2021-12-17T18:27:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9edb7fe700 1 -- 172.21.15.62:0/3138608052 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec4000e90 con 0x7f9edc0b4340 2021-12-17T18:27:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9edb7fe700 1 -- 172.21.15.62:0/3138608052 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ec400d910 con 0x7f9edc0b4340 2021-12-17T18:27:22.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee305f700 1 -- 172.21.15.62:0/3138608052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9edc0b4340 msgr2=0x7f9edc1471b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:22.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee305f700 1 --2- 172.21.15.62:0/3138608052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9edc0b4340 0x7f9edc1471b0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f9ec4002f70 tx=0x7f9ec4006eb0).stop 2021-12-17T18:27:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee305f700 1 -- 172.21.15.62:0/3138608052 shutdown_connections 2021-12-17T18:27:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee305f700 1 --2- 172.21.15.62:0/3138608052 >> v2:172.21.15.109:3300/0 conn(0x7f9edc142d70 0x7f9edc0b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee305f700 1 --2- 172.21.15.62:0/3138608052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9edc0b4340 0x7f9edc1471b0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee305f700 1 -- 172.21.15.62:0/3138608052 >> 172.21.15.62:0/3138608052 conn(0x7f9edc05c750 msgr2=0x7f9edc05cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:22.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee305f700 1 -- 172.21.15.62:0/3138608052 shutdown_connections 2021-12-17T18:27:22.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee305f700 1 -- 172.21.15.62:0/3138608052 wait complete. 2021-12-17T18:27:22.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee305f700 1 Processor -- start 2021-12-17T18:27:22.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee305f700 1 -- start start 2021-12-17T18:27:22.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee305f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9edc0b51a0 0x7f9edc1425f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee305f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9edc142d70 0x7f9edc0660e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee305f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9edc0b7f40 0x7f9edc0634b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee305f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0659a0 con 0x7f9edc142d70 2021-12-17T18:27:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee305f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc065c40 con 0x7f9edc0b7f40 2021-12-17T18:27:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee305f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0665d0 con 0x7f9edc0b51a0 2021-12-17T18:27:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9edbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9edc142d70 0x7f9edc0660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9edbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9edc142d70 0x7f9edc0660e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55972/0 (socket says 172.21.15.62:55972) 2021-12-17T18:27:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9edbfff700 1 -- 172.21.15.62:0/2809170037 learned_addr learned my addr 172.21.15.62:0/2809170037 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee15fc700 1 --2- 172.21.15.62:0/2809170037 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9edc0b7f40 0x7f9edc0634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.193+0000 7f9ee0dfb700 1 --2- 172.21.15.62:0/2809170037 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9edc0b51a0 0x7f9edc1425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.197+0000 7f9edbfff700 1 -- 172.21.15.62:0/2809170037 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9edc0b51a0 msgr2=0x7f9edc1425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:22.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.197+0000 7f9edbfff700 1 --2- 172.21.15.62:0/2809170037 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9edc0b51a0 0x7f9edc1425f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.197+0000 7f9edbfff700 1 -- 172.21.15.62:0/2809170037 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9edc0b7f40 msgr2=0x7f9edc0634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:22.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.197+0000 7f9edbfff700 1 --2- 172.21.15.62:0/2809170037 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9edc0b7f40 0x7f9edc0634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.197+0000 7f9edbfff700 1 -- 172.21.15.62:0/2809170037 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec400b1e0 con 0x7f9edc142d70 2021-12-17T18:27:22.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.197+0000 7f9ee15fc700 1 --2- 172.21.15.62:0/2809170037 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9edc0b7f40 0x7f9edc0634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:22.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.197+0000 7f9edbfff700 1 --2- 172.21.15.62:0/2809170037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9edc142d70 0x7f9edc0660e0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f9ecc000ed0 tx=0x7f9ecc007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:22.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.197+0000 7f9ed9ffb700 1 -- 172.21.15.62:0/2809170037 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ecc012400 con 0x7f9edc142d70 2021-12-17T18:27:22.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.197+0000 7f9ee305f700 1 -- 172.21.15.62:0/2809170037 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc148cf0 con 0x7f9edc142d70 2021-12-17T18:27:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.197+0000 7f9ed9ffb700 1 -- 172.21.15.62:0/2809170037 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc012560 con 0x7f9edc142d70 2021-12-17T18:27:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.197+0000 7f9ed9ffb700 1 -- 172.21.15.62:0/2809170037 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ecc0128c0 con 0x7f9edc142d70 2021-12-17T18:27:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.197+0000 7f9ee305f700 1 -- 172.21.15.62:0/2809170037 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc0639a0 con 0x7f9edc142d70 2021-12-17T18:27:22.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.197+0000 7f9ee305f700 1 -- 172.21.15.62:0/2809170037 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc065e00 con 0x7f9edc142d70 2021-12-17T18:27:22.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.197+0000 7f9ed9ffb700 1 -- 172.21.15.62:0/2809170037 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9ecc019030 con 0x7f9edc142d70 2021-12-17T18:27:22.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.197+0000 7f9ed9ffb700 1 --2- 172.21.15.62:0/2809170037 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ec0053580 0x7f9ec0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:22.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.201+0000 7f9ed9ffb700 1 -- 172.21.15.62:0/2809170037 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9ecc06abc0 con 0x7f9edc142d70 2021-12-17T18:27:22.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.201+0000 7f9ee0dfb700 1 --2- 172.21.15.62:0/2809170037 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ec0053580 0x7f9ec0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:22.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.201+0000 7f9ee0dfb700 1 --2- 172.21.15.62:0/2809170037 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ec0053580 0x7f9ec0055a40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f9ec401c000 tx=0x7f9ec4015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:22.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.205+0000 7f9ed9ffb700 1 -- 172.21.15.62:0/2809170037 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ecc041cd0 con 0x7f9edc142d70 2021-12-17T18:27:22.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.377+0000 7f9ee305f700 1 -- 172.21.15.62:0/2809170037 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9edc0b4720 con 0x7f9edc142d70 2021-12-17T18:27:22.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.385+0000 7f9ed9ffb700 1 -- 172.21.15.62:0/2809170037 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v41) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9ecc0452f0 con 0x7f9edc142d70 2021-12-17T18:27:22.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.389+0000 7f9ee305f700 1 -- 172.21.15.62:0/2809170037 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ec0053580 msgr2=0x7f9ec0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:22.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.389+0000 7f9ee305f700 1 --2- 172.21.15.62:0/2809170037 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ec0053580 0x7f9ec0055a40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f9ec401c000 tx=0x7f9ec4015000).stop 2021-12-17T18:27:22.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.389+0000 7f9ee305f700 1 -- 172.21.15.62:0/2809170037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9edc142d70 msgr2=0x7f9edc0660e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:22.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.389+0000 7f9ee305f700 1 --2- 172.21.15.62:0/2809170037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9edc142d70 0x7f9edc0660e0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f9ecc000ed0 tx=0x7f9ecc007ac0).stop 2021-12-17T18:27:22.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.389+0000 7f9ee305f700 1 -- 172.21.15.62:0/2809170037 shutdown_connections 2021-12-17T18:27:22.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.389+0000 7f9ee305f700 1 --2- 172.21.15.62:0/2809170037 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ec0053580 0x7f9ec0055a40 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.389+0000 7f9ee305f700 1 --2- 172.21.15.62:0/2809170037 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9edc0b7f40 0x7f9edc0634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.389+0000 7f9ee305f700 1 --2- 172.21.15.62:0/2809170037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9edc142d70 0x7f9edc0660e0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.389+0000 7f9ee305f700 1 --2- 172.21.15.62:0/2809170037 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9edc0b51a0 0x7f9edc1425f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.389+0000 7f9ee305f700 1 -- 172.21.15.62:0/2809170037 >> 172.21.15.62:0/2809170037 conn(0x7f9edc05c750 msgr2=0x7f9edc0601b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:22.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.389+0000 7f9ee305f700 1 -- 172.21.15.62:0/2809170037 shutdown_connections 2021-12-17T18:27:22.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.389+0000 7f9ee305f700 1 -- 172.21.15.62:0/2809170037 wait complete. 2021-12-17T18:27:22.397 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.2 2021-12-17T18:27:22.407 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:22.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429ca9b700 1 Processor -- start 2021-12-17T18:27:22.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429ca9b700 1 -- start start 2021-12-17T18:27:22.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429ca9b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f42980ad360 0x7f42980679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:22.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429ca9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42980b57e0 0x7f42980b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:22.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429ca9b700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42980b2e90 con 0x7f429805ffe0 2021-12-17T18:27:22.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429ca9b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42980b4b70 con 0x7f42980b57e0 2021-12-17T18:27:22.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429ca9b700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42980b4e10 con 0x7f42980ad360 2021-12-17T18:27:22.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f4296d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42980b57e0 0x7f42980b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:22.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f4296d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42980b57e0 0x7f42980b39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55980/0 (socket says 172.21.15.62:55980) 2021-12-17T18:27:22.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f4296d9d700 1 -- 172.21.15.62:0/3095746595 learned_addr learned my addr 172.21.15.62:0/3095746595 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:22.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f4295d9b700 1 --2- 172.21.15.62:0/3095746595 >> v2:172.21.15.109:3300/0 conn(0x7f42980ad360 0x7f42980679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:22.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f4296d9d700 1 -- 172.21.15.62:0/3095746595 >> v2:172.21.15.109:3300/0 conn(0x7f42980ad360 msgr2=0x7f42980679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:22.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f4296d9d700 1 --2- 172.21.15.62:0/3095746595 >> v2:172.21.15.109:3300/0 conn(0x7f42980ad360 0x7f42980679c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f4296d9d700 1 -- 172.21.15.62:0/3095746595 >> v1:172.21.15.109:6789/0 conn(0x7f429805ffe0 legacy=0x7f42980b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:22.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f4296d9d700 1 -- 172.21.15.62:0/3095746595 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980b52b0 con 0x7f42980b57e0 2021-12-17T18:27:22.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f4296d9d700 1 --2- 172.21.15.62:0/3095746595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42980b57e0 0x7f42980b39d0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f4288002f70 tx=0x7f4288006eb0).ready entity=mon.0 client_cookie=4fbd66b5f8502b00 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:22.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429559a700 1 -- 172.21.15.62:0/3095746595 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f428800d5c0 con 0x7f42980b57e0 2021-12-17T18:27:22.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429559a700 1 -- 172.21.15.62:0/3095746595 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4288000e90 con 0x7f42980b57e0 2021-12-17T18:27:22.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429559a700 1 -- 172.21.15.62:0/3095746595 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f428800d950 con 0x7f42980b57e0 2021-12-17T18:27:22.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429ca9b700 1 -- 172.21.15.62:0/3095746595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42980b57e0 msgr2=0x7f42980b39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:22.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429ca9b700 1 --2- 172.21.15.62:0/3095746595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42980b57e0 0x7f42980b39d0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f4288002f70 tx=0x7f4288006eb0).stop 2021-12-17T18:27:22.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429ca9b700 1 -- 172.21.15.62:0/3095746595 shutdown_connections 2021-12-17T18:27:22.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429ca9b700 1 --2- 172.21.15.62:0/3095746595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42980b57e0 0x7f42980b39d0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429ca9b700 1 --2- 172.21.15.62:0/3095746595 >> v2:172.21.15.109:3300/0 conn(0x7f42980ad360 0x7f42980679c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429ca9b700 1 -- 172.21.15.62:0/3095746595 >> 172.21.15.62:0/3095746595 conn(0x7f42980626d0 msgr2=0x7f429805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:22.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429ca9b700 1 -- 172.21.15.62:0/3095746595 shutdown_connections 2021-12-17T18:27:22.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.505+0000 7f429ca9b700 1 -- 172.21.15.62:0/3095746595 wait complete. 2021-12-17T18:27:22.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f429ca9b700 1 Processor -- start 2021-12-17T18:27:22.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f429ca9b700 1 -- start start 2021-12-17T18:27:22.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f429ca9b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f429805ffe0 0x7f42980aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:22.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f429ca9b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42980ad360 0x7f4298064bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:22.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f429ca9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42980b57e0 0x7f4298156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:22.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f429ca9b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4298142a50 con 0x7f42980b57e0 2021-12-17T18:27:22.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f429ca9b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42980a4690 con 0x7f42980ad360 2021-12-17T18:27:22.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f429ca9b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42980a39e0 con 0x7f429805ffe0 2021-12-17T18:27:22.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f4296d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42980b57e0 0x7f4298156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:22.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f4296d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42980b57e0 0x7f4298156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55986/0 (socket says 172.21.15.62:55986) 2021-12-17T18:27:22.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f4296d9d700 1 -- 172.21.15.62:0/2324299026 learned_addr learned my addr 172.21.15.62:0/2324299026 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:22.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f4295d9b700 1 --2- 172.21.15.62:0/2324299026 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42980ad360 0x7f4298064bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:22.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f429659c700 1 --2- 172.21.15.62:0/2324299026 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f429805ffe0 0x7f42980aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:22.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f4296d9d700 1 -- 172.21.15.62:0/2324299026 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f429805ffe0 msgr2=0x7f42980aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:22.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f4296d9d700 1 --2- 172.21.15.62:0/2324299026 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f429805ffe0 0x7f42980aff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f4296d9d700 1 -- 172.21.15.62:0/2324299026 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42980ad360 msgr2=0x7f4298064bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:22.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f4296d9d700 1 --2- 172.21.15.62:0/2324299026 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42980ad360 0x7f4298064bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f4296d9d700 1 -- 172.21.15.62:0/2324299026 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428800b1e0 con 0x7f42980b57e0 2021-12-17T18:27:22.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f4296d9d700 1 --2- 172.21.15.62:0/2324299026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42980b57e0 0x7f4298156380 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f4288002f70 tx=0x7f4288015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:22.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f428f7fe700 1 -- 172.21.15.62:0/2324299026 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42880116e0 con 0x7f42980b57e0 2021-12-17T18:27:22.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f428f7fe700 1 -- 172.21.15.62:0/2324299026 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4288011840 con 0x7f42980b57e0 2021-12-17T18:27:22.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f428f7fe700 1 -- 172.21.15.62:0/2324299026 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4288011ba0 con 0x7f42980b57e0 2021-12-17T18:27:22.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.509+0000 7f429ca9b700 1 -- 172.21.15.62:0/2324299026 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4298155ee0 con 0x7f42980b57e0 2021-12-17T18:27:22.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.513+0000 7f429ca9b700 1 -- 172.21.15.62:0/2324299026 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42980650e0 con 0x7f42980b57e0 2021-12-17T18:27:22.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.513+0000 7f429ca9b700 1 -- 172.21.15.62:0/2324299026 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4298156070 con 0x7f42980b57e0 2021-12-17T18:27:22.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.513+0000 7f428f7fe700 1 -- 172.21.15.62:0/2324299026 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4288025030 con 0x7f42980b57e0 2021-12-17T18:27:22.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.513+0000 7f428f7fe700 1 --2- 172.21.15.62:0/2324299026 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f427c053610 0x7f427c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:22.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.513+0000 7f428f7fe700 1 -- 172.21.15.62:0/2324299026 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f428806c9b0 con 0x7f42980b57e0 2021-12-17T18:27:22.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.513+0000 7f429659c700 1 --2- 172.21.15.62:0/2324299026 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f427c053610 0x7f427c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:22.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.513+0000 7f429659c700 1 --2- 172.21.15.62:0/2324299026 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f427c053610 0x7f427c055ad0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f428000d000 tx=0x7f4280007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:22.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.521+0000 7f428f7fe700 1 -- 172.21.15.62:0/2324299026 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4288043b10 con 0x7f42980b57e0 2021-12-17T18:27:22.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.685+0000 7f429ca9b700 1 -- 172.21.15.62:0/2324299026 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42980573d0 con 0x7f42980b57e0 2021-12-17T18:27:22.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.685+0000 7f428f7fe700 1 -- 172.21.15.62:0/2324299026 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f4288023020 con 0x7f42980b57e0 2021-12-17T18:27:22.690 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:22.691 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7957,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6833/3542826349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3542826349},{"type":"v1","addr":"172.21.15.62:6833","nonce":3542826349}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:27:19.830173+0000","modified":"2021-12-17T18:27:20.832915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/570760267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":570760267},{"type":"v1","addr":"172.21.15.109:6835","nonce":570760267}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-12-17T18:27:22.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.685+0000 7f429ca9b700 1 -- 172.21.15.62:0/2324299026 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f427c053610 msgr2=0x7f427c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:22.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.685+0000 7f429ca9b700 1 --2- 172.21.15.62:0/2324299026 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f427c053610 0x7f427c055ad0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f428000d000 tx=0x7f4280007b90).stop 2021-12-17T18:27:22.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.685+0000 7f429ca9b700 1 -- 172.21.15.62:0/2324299026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42980b57e0 msgr2=0x7f4298156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:22.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.685+0000 7f429ca9b700 1 --2- 172.21.15.62:0/2324299026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42980b57e0 0x7f4298156380 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f4288002f70 tx=0x7f4288015000).stop 2021-12-17T18:27:22.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.685+0000 7f429ca9b700 1 -- 172.21.15.62:0/2324299026 shutdown_connections 2021-12-17T18:27:22.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.685+0000 7f429ca9b700 1 --2- 172.21.15.62:0/2324299026 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f427c053610 0x7f427c055ad0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.685+0000 7f429ca9b700 1 --2- 172.21.15.62:0/2324299026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42980b57e0 0x7f4298156380 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.685+0000 7f429ca9b700 1 --2- 172.21.15.62:0/2324299026 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42980ad360 0x7f4298064bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.685+0000 7f429ca9b700 1 --2- 172.21.15.62:0/2324299026 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f429805ffe0 0x7f42980aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:22.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.685+0000 7f429ca9b700 1 -- 172.21.15.62:0/2324299026 >> 172.21.15.62:0/2324299026 conn(0x7f42980626d0 msgr2=0x7f42980b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:22.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.685+0000 7f429ca9b700 1 -- 172.21.15.62:0/2324299026 shutdown_connections 2021-12-17T18:27:22.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:22.689+0000 7f429ca9b700 1 -- 172.21.15.62:0/2324299026 wait complete. 2021-12-17T18:27:22.696 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 66 2021-12-17T18:27:22.905 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:27:19.830173+0000', 'modified': '2021-12-17T18:27:20.832915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8127}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8127': {'gid': 8127, 'name': 'b', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.109:6835/570760267', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.109:6834', 'nonce': 570760267}, {'type': 'v1', 'addr': '172.21.15.109:6835', 'nonce': 570760267}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:27:22.905 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:27:22.906 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-12-17T18:27:23.021 INFO:teuthology.orchestra.run.smithi109.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":8127,"want_state":"up:active","state":"up:active","rank_uptime":3.1754315219999998,"mdsmap_epoch":66,"osdmap_epoch":132,"osdmap_epoch_barrier":130,"uptime":8.1968026940000005} 2021-12-17T18:27:23.021 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 8127, "mdsmap_epoch": 66, "osdmap_epoch": 132, "osdmap_epoch_barrier": 130, "rank_uptime": 3.175431522, "state": "up:active", "uptime": 8.196802694, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:27:23.022 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:27:23.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00ce01f700 1 Processor -- start 2021-12-17T18:27:23.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00ce01f700 1 -- start start 2021-12-17T18:27:23.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00ce01f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f00c80aca60 0x7f00c8147050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00ce01f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c8067c10 con 0x7f00c8067830 2021-12-17T18:27:23.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00ce01f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c8060520 con 0x7f00c8147540 2021-12-17T18:27:23.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00ce01f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c80acf00 con 0x7f00c80aca60 2021-12-17T18:27:23.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00bffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f00c80aca60 0x7f00c8147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00c77fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f00c8067830 0x7f00c8146940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39570/0 (socket says 172.21.15.62:39570) 2021-12-17T18:27:23.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00c77fe700 1 -- 172.21.15.62:0/77296953 learned_addr learned my addr 172.21.15.62:0/77296953 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:23.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00c6ffd700 1 -- 172.21.15.62:0/77296953 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531612137 0 0) 0x7f00c8067c10 con 0x7f00c8067830 2021-12-17T18:27:23.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00c6ffd700 1 -- 172.21.15.62:0/77296953 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00a8003260 con 0x7f00c8067830 2021-12-17T18:27:23.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00bffff700 1 -- 172.21.15.62:0/77296953 >> v1:172.21.15.109:6789/0 conn(0x7f00c8147540 legacy=0x7f00c80b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00bffff700 1 -- 172.21.15.62:0/77296953 >> v1:172.21.15.62:6789/0 conn(0x7f00c8067830 legacy=0x7f00c8146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00c6ffd700 1 -- 172.21.15.62:0/77296953 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 464821681 0 0) 0x7f00a8003260 con 0x7f00c8067830 2021-12-17T18:27:23.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00bffff700 1 -- 172.21.15.62:0/77296953 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c80b12a0 con 0x7f00c80aca60 2021-12-17T18:27:23.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00bffff700 1 --2- 172.21.15.62:0/77296953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c80aca60 0x7f00c8147050 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f00b8001800 tx=0x7f00b0006df0).ready entity=mon.0 client_cookie=478fc2043fd77128 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:23.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00c6ffd700 1 -- 172.21.15.62:0/77296953 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00b8001660 con 0x7f00c80aca60 2021-12-17T18:27:23.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00c6ffd700 1 -- 172.21.15.62:0/77296953 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b0000e90 con 0x7f00c80aca60 2021-12-17T18:27:23.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00c6ffd700 1 -- 172.21.15.62:0/77296953 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00b000d4f0 con 0x7f00c80aca60 2021-12-17T18:27:23.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00ce01f700 1 -- 172.21.15.62:0/77296953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c80aca60 msgr2=0x7f00c8147050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00ce01f700 1 --2- 172.21.15.62:0/77296953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c80aca60 0x7f00c8147050 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f00b8001800 tx=0x7f00b0006df0).stop 2021-12-17T18:27:23.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00ce01f700 1 -- 172.21.15.62:0/77296953 shutdown_connections 2021-12-17T18:27:23.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00ce01f700 1 --2- 172.21.15.62:0/77296953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c80aca60 0x7f00c8147050 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00ce01f700 1 -- 172.21.15.62:0/77296953 >> 172.21.15.62:0/77296953 conn(0x7f00c805f730 msgr2=0x7f00c805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:23.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00ce01f700 1 -- 172.21.15.62:0/77296953 shutdown_connections 2021-12-17T18:27:23.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.129+0000 7f00ce01f700 1 -- 172.21.15.62:0/77296953 wait complete. 2021-12-17T18:27:23.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00ce01f700 1 Processor -- start 2021-12-17T18:27:23.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00ce01f700 1 -- start start 2021-12-17T18:27:23.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00ce01f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f00c8067830 0x7f00c80abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00ce01f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c80aca60 0x7f00c80a8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00ce01f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c8147540 0x7f00c80a8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00ce01f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c80aa220 con 0x7f00c8147540 2021-12-17T18:27:23.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00ce01f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c80ab4f0 con 0x7f00c8067830 2021-12-17T18:27:23.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00ce01f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c80aa450 con 0x7f00c80aca60 2021-12-17T18:27:23.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00c7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c8147540 0x7f00c80a8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00c77fe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f00c8067830 0x7f00c80abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00c7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c8147540 0x7f00c80a8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56000/0 (socket says 172.21.15.62:56000) 2021-12-17T18:27:23.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00c7fff700 1 -- 172.21.15.62:0/640449916 learned_addr learned my addr 172.21.15.62:0/640449916 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:23.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00c77fe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f00c8067830 0x7f00c80abbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:34314/0 (socket says 172.21.15.62:34314) 2021-12-17T18:27:23.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00bffff700 1 --2- 172.21.15.62:0/640449916 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c80aca60 0x7f00c80a8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00c7fff700 1 -- 172.21.15.62:0/640449916 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c80aca60 msgr2=0x7f00c80a8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00c7fff700 1 --2- 172.21.15.62:0/640449916 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c80aca60 0x7f00c80a8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00c7fff700 1 -- 172.21.15.62:0/640449916 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f00c8067830 msgr2=0x7f00c80abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00c7fff700 1 --2- 172.21.15.62:0/640449916 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f00c8067830 0x7f00c80abbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00c7fff700 1 -- 172.21.15.62:0/640449916 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b000b180 con 0x7f00c8147540 2021-12-17T18:27:23.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00bffff700 1 --2- 172.21.15.62:0/640449916 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c80aca60 0x7f00c80a8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:23.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00c7fff700 1 --2- 172.21.15.62:0/640449916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c8147540 0x7f00c80a8560 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f00c8062100 tx=0x7f00c0001330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:23.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00c57fa700 1 -- 172.21.15.62:0/640449916 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c000f470 con 0x7f00c8147540 2021-12-17T18:27:23.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.133+0000 7f00c57fa700 1 -- 172.21.15.62:0/640449916 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c000f5d0 con 0x7f00c8147540 2021-12-17T18:27:23.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.137+0000 7f00ce01f700 1 -- 172.21.15.62:0/640449916 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c80ab250 con 0x7f00c8147540 2021-12-17T18:27:23.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.137+0000 7f00c57fa700 1 -- 172.21.15.62:0/640449916 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c000f930 con 0x7f00c8147540 2021-12-17T18:27:23.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.137+0000 7f00ce01f700 1 -- 172.21.15.62:0/640449916 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c80a8a50 con 0x7f00c8147540 2021-12-17T18:27:23.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.137+0000 7f00ce01f700 1 -- 172.21.15.62:0/640449916 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c80a0c40 con 0x7f00c8147540 2021-12-17T18:27:23.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.137+0000 7f00c57fa700 1 -- 172.21.15.62:0/640449916 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f00c0019030 con 0x7f00c8147540 2021-12-17T18:27:23.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.137+0000 7f00c57fa700 1 --2- 172.21.15.62:0/640449916 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00ac053640 0x7f00ac055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.137+0000 7f00c57fa700 1 -- 172.21.15.62:0/640449916 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f00c006afa0 con 0x7f00c8147540 2021-12-17T18:27:23.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.137+0000 7f00c77fe700 1 --2- 172.21.15.62:0/640449916 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00ac053640 0x7f00ac055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.137+0000 7f00c77fe700 1 --2- 172.21.15.62:0/640449916 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00ac053640 0x7f00ac055b00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f00b800d000 tx=0x7f00b8001e40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:23.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.141+0000 7f00c57fa700 1 -- 172.21.15.62:0/640449916 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f00c0041ff0 con 0x7f00c8147540 2021-12-17T18:27:23.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.269+0000 7f00ce01f700 1 -- 172.21.15.62:0/640449916 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00c80a0840 con 0x7f00c8147540 2021-12-17T18:27:23.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.273+0000 7f00c57fa700 1 -- 172.21.15.62:0/640449916 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f00c0045610 con 0x7f00c8147540 2021-12-17T18:27:23.278 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:23.278 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":132,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:27:21.842977+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:27:17.568635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-12-17T18:27:18.849290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:27:23.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.273+0000 7f00ce01f700 1 -- 172.21.15.62:0/640449916 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00ac053640 msgr2=0x7f00ac055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.273+0000 7f00ce01f700 1 --2- 172.21.15.62:0/640449916 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00ac053640 0x7f00ac055b00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f00b800d000 tx=0x7f00b8001e40).stop 2021-12-17T18:27:23.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.273+0000 7f00ce01f700 1 -- 172.21.15.62:0/640449916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c8147540 msgr2=0x7f00c80a8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.273+0000 7f00ce01f700 1 --2- 172.21.15.62:0/640449916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c8147540 0x7f00c80a8560 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f00c8062100 tx=0x7f00c0001330).stop 2021-12-17T18:27:23.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.273+0000 7f00ce01f700 1 -- 172.21.15.62:0/640449916 shutdown_connections 2021-12-17T18:27:23.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.273+0000 7f00ce01f700 1 --2- 172.21.15.62:0/640449916 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00ac053640 0x7f00ac055b00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.273+0000 7f00ce01f700 1 --2- 172.21.15.62:0/640449916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00c8147540 0x7f00c80a8560 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.273+0000 7f00ce01f700 1 --2- 172.21.15.62:0/640449916 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f00c80aca60 0x7f00c80a8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.273+0000 7f00ce01f700 1 --2- 172.21.15.62:0/640449916 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f00c8067830 0x7f00c80abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.273+0000 7f00ce01f700 1 -- 172.21.15.62:0/640449916 >> 172.21.15.62:0/640449916 conn(0x7f00c805f730 msgr2=0x7f00c80b4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:23.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.273+0000 7f00ce01f700 1 -- 172.21.15.62:0/640449916 shutdown_connections 2021-12-17T18:27:23.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.273+0000 7f00ce01f700 1 -- 172.21.15.62:0/640449916 wait complete. 2021-12-17T18:27:23.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:27:17.568635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:27:18.849290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:27:23.292 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:27:23.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f629cda2700 1 Processor -- start 2021-12-17T18:27:23.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f629cda2700 1 -- start start 2021-12-17T18:27:23.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f629cda2700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f629805ca90 0x7f629805f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f629cda2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629805ce70 con 0x7f62980b4b40 2021-12-17T18:27:23.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f629cda2700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6298145550 con 0x7f62980b46d0 2021-12-17T18:27:23.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f629cda2700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62980b31e0 con 0x7f629805ca90 2021-12-17T18:27:23.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f6297fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f62980b4b40 0x7f6298144e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39588/0 (socket says 172.21.15.62:39588) 2021-12-17T18:27:23.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f6297fff700 1 -- 172.21.15.62:0/3326357387 learned_addr learned my addr 172.21.15.62:0/3326357387 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:23.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f62977fe700 1 --2- 172.21.15.62:0/3326357387 >> v2:172.21.15.109:3300/0 conn(0x7f629805ca90 0x7f629805f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f62967fc700 1 -- 172.21.15.62:0/3326357387 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831383028 0 0) 0x7f629805ce70 con 0x7f62980b4b40 2021-12-17T18:27:23.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f62967fc700 1 -- 172.21.15.62:0/3326357387 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6278003260 con 0x7f62980b4b40 2021-12-17T18:27:23.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f62977fe700 1 -- 172.21.15.62:0/3326357387 >> v1:172.21.15.109:6789/0 conn(0x7f62980b46d0 legacy=0x7f6298144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f62967fc700 1 -- 172.21.15.62:0/3326357387 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3799792137 0 0) 0x7f6278003260 con 0x7f62980b4b40 2021-12-17T18:27:23.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f62977fe700 1 -- 172.21.15.62:0/3326357387 >> v1:172.21.15.62:6789/0 conn(0x7f62980b4b40 legacy=0x7f6298144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f62977fe700 1 -- 172.21.15.62:0/3326357387 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629805ffd0 con 0x7f629805ca90 2021-12-17T18:27:23.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f62977fe700 1 --2- 172.21.15.62:0/3326357387 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f629805ca90 0x7f629805f730 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f6288001b80 tx=0x7f6290006df0).ready entity=mon.1 client_cookie=c23f14eb6df3a4aa server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:23.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f62967fc700 1 -- 172.21.15.62:0/3326357387 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62880019e0 con 0x7f629805ca90 2021-12-17T18:27:23.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f62967fc700 1 -- 172.21.15.62:0/3326357387 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6290000e90 con 0x7f629805ca90 2021-12-17T18:27:23.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f62967fc700 1 -- 172.21.15.62:0/3326357387 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f629000d4f0 con 0x7f629805ca90 2021-12-17T18:27:23.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f629cda2700 1 -- 172.21.15.62:0/3326357387 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f629805ca90 msgr2=0x7f629805f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f629cda2700 1 --2- 172.21.15.62:0/3326357387 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f629805ca90 0x7f629805f730 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f6288001b80 tx=0x7f6290006df0).stop 2021-12-17T18:27:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f629cda2700 1 -- 172.21.15.62:0/3326357387 shutdown_connections 2021-12-17T18:27:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f629cda2700 1 --2- 172.21.15.62:0/3326357387 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f629805ca90 0x7f629805f730 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f629cda2700 1 -- 172.21.15.62:0/3326357387 >> 172.21.15.62:0/3326357387 conn(0x7f629805bcd0 msgr2=0x7f6298062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f629cda2700 1 -- 172.21.15.62:0/3326357387 shutdown_connections 2021-12-17T18:27:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.405+0000 7f629cda2700 1 -- 172.21.15.62:0/3326357387 wait complete. 2021-12-17T18:27:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f629cda2700 1 Processor -- start 2021-12-17T18:27:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f629cda2700 1 -- start start 2021-12-17T18:27:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f629cda2700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f629805ca90 0x7f62980634b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f629cda2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62980b46d0 0x7f6298152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f629cda2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62980b4b40 0x7f629813cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f629cda2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629813cb80 con 0x7f62980b46d0 2021-12-17T18:27:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f629cda2700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62980b11f0 con 0x7f629805ca90 2021-12-17T18:27:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f629cda2700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629813b700 con 0x7f62980b4b40 2021-12-17T18:27:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f6296ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62980b46d0 0x7f6298152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f6296ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62980b46d0 0x7f6298152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56012/0 (socket says 172.21.15.62:56012) 2021-12-17T18:27:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f6296ffd700 1 -- 172.21.15.62:0/717954448 learned_addr learned my addr 172.21.15.62:0/717954448 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f62977fe700 1 --2- 172.21.15.62:0/717954448 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f629805ca90 0x7f62980634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f6297fff700 1 --2- 172.21.15.62:0/717954448 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62980b4b40 0x7f629813cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f6296ffd700 1 -- 172.21.15.62:0/717954448 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62980b4b40 msgr2=0x7f629813cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f6296ffd700 1 --2- 172.21.15.62:0/717954448 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62980b4b40 0x7f629813cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f6296ffd700 1 -- 172.21.15.62:0/717954448 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f629805ca90 msgr2=0x7f62980634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f6296ffd700 1 --2- 172.21.15.62:0/717954448 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f629805ca90 0x7f62980634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f6296ffd700 1 -- 172.21.15.62:0/717954448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629000b180 con 0x7f62980b46d0 2021-12-17T18:27:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f6296ffd700 1 --2- 172.21.15.62:0/717954448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62980b46d0 0x7f6298152d80 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f62980645c0 tx=0x7f6280007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:23.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f6294ff9700 1 -- 172.21.15.62:0/717954448 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6280012400 con 0x7f62980b46d0 2021-12-17T18:27:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f6294ff9700 1 -- 172.21.15.62:0/717954448 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6280012560 con 0x7f62980b46d0 2021-12-17T18:27:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f629cda2700 1 -- 172.21.15.62:0/717954448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629813b460 con 0x7f62980b46d0 2021-12-17T18:27:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f6294ff9700 1 -- 172.21.15.62:0/717954448 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62800128c0 con 0x7f62980b46d0 2021-12-17T18:27:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.409+0000 7f629cda2700 1 -- 172.21.15.62:0/717954448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629813aee0 con 0x7f62980b46d0 2021-12-17T18:27:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.413+0000 7f629cda2700 1 -- 172.21.15.62:0/717954448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62980b4230 con 0x7f62980b46d0 2021-12-17T18:27:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.413+0000 7f6294ff9700 1 -- 172.21.15.62:0/717954448 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6280019030 con 0x7f62980b46d0 2021-12-17T18:27:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.413+0000 7f6294ff9700 1 --2- 172.21.15.62:0/717954448 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f627c0534f0 0x7f627c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.413+0000 7f6294ff9700 1 -- 172.21.15.62:0/717954448 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f628006ad80 con 0x7f62980b46d0 2021-12-17T18:27:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.413+0000 7f62977fe700 1 --2- 172.21.15.62:0/717954448 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f627c0534f0 0x7f627c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.413+0000 7f62977fe700 1 --2- 172.21.15.62:0/717954448 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f627c0534f0 0x7f627c0559b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f629001a000 tx=0x7f6290014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.417+0000 7f6294ff9700 1 -- 172.21.15.62:0/717954448 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6280041d70 con 0x7f62980b46d0 2021-12-17T18:27:23.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.541+0000 7f629cda2700 1 -- 172.21.15.62:0/717954448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f62980573d0 con 0x7f62980b46d0 2021-12-17T18:27:23.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.541+0000 7f6294ff9700 1 -- 172.21.15.62:0/717954448 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v132) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6280045390 con 0x7f62980b46d0 2021-12-17T18:27:23.549 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:27:23.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.545+0000 7f629cda2700 1 -- 172.21.15.62:0/717954448 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f627c0534f0 msgr2=0x7f627c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.545+0000 7f629cda2700 1 --2- 172.21.15.62:0/717954448 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f627c0534f0 0x7f627c0559b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f629001a000 tx=0x7f6290014000).stop 2021-12-17T18:27:23.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.545+0000 7f629cda2700 1 -- 172.21.15.62:0/717954448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62980b46d0 msgr2=0x7f6298152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.545+0000 7f629cda2700 1 --2- 172.21.15.62:0/717954448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62980b46d0 0x7f6298152d80 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f62980645c0 tx=0x7f6280007c50).stop 2021-12-17T18:27:23.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.545+0000 7f629cda2700 1 -- 172.21.15.62:0/717954448 shutdown_connections 2021-12-17T18:27:23.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.545+0000 7f629cda2700 1 --2- 172.21.15.62:0/717954448 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f627c0534f0 0x7f627c0559b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.545+0000 7f629cda2700 1 --2- 172.21.15.62:0/717954448 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f62980b4b40 0x7f629813cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.545+0000 7f629cda2700 1 --2- 172.21.15.62:0/717954448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62980b46d0 0x7f6298152d80 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.545+0000 7f629cda2700 1 --2- 172.21.15.62:0/717954448 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f629805ca90 0x7f62980634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.545+0000 7f629cda2700 1 -- 172.21.15.62:0/717954448 >> 172.21.15.62:0/717954448 conn(0x7f629805bcd0 msgr2=0x7f6298144640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:23.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.545+0000 7f629cda2700 1 -- 172.21.15.62:0/717954448 shutdown_connections 2021-12-17T18:27:23.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.545+0000 7f629cda2700 1 -- 172.21.15.62:0/717954448 wait complete. 2021-12-17T18:27:23.564 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:27:23.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.665+0000 7f8d98e76700 1 Processor -- start 2021-12-17T18:27:23.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.665+0000 7f8d98e76700 1 -- start start 2021-12-17T18:27:23.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d98e76700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8d9405ca90 0x7f8d9414b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d98e76700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8d9405f730 0x7f8d94146510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d98e76700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d94060750 con 0x7f8d940ac040 2021-12-17T18:27:23.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d98e76700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d9414ac00 con 0x7f8d9405ca90 2021-12-17T18:27:23.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d98e76700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9414aea0 con 0x7f8d9405f730 2021-12-17T18:27:23.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d937fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8d9405ca90 0x7f8d9414b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d92ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8d940ac040 0x7f8d941475c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39598/0 (socket says 172.21.15.62:39598) 2021-12-17T18:27:23.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d92ffd700 1 -- 172.21.15.62:0/3207854607 learned_addr learned my addr 172.21.15.62:0/3207854607 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:23.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d93fff700 1 --2- 172.21.15.62:0/3207854607 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8d9405f730 0x7f8d94146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d927fc700 1 -- 172.21.15.62:0/3207854607 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270831786 0 0) 0x7f8d94060750 con 0x7f8d940ac040 2021-12-17T18:27:23.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d927fc700 1 -- 172.21.15.62:0/3207854607 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d80003260 con 0x7f8d940ac040 2021-12-17T18:27:23.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d937fe700 1 -- 172.21.15.62:0/3207854607 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8d9405f730 msgr2=0x7f8d94146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:23.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d937fe700 1 --2- 172.21.15.62:0/3207854607 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8d9405f730 0x7f8d94146510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d937fe700 1 -- 172.21.15.62:0/3207854607 >> v1:172.21.15.62:6789/0 conn(0x7f8d940ac040 legacy=0x7f8d941475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d937fe700 1 -- 172.21.15.62:0/3207854607 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9405ce70 con 0x7f8d9405ca90 2021-12-17T18:27:23.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d937fe700 1 --2- 172.21.15.62:0/3207854607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9405ca90 0x7f8d9414b340 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f8d88002f70 tx=0x7f8d88006df0).ready entity=mon.0 client_cookie=d2bf2f54407f5497 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:23.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d927fc700 1 -- 172.21.15.62:0/3207854607 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d8800d4a0 con 0x7f8d9405ca90 2021-12-17T18:27:23.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d927fc700 1 -- 172.21.15.62:0/3207854607 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d88000e90 con 0x7f8d9405ca90 2021-12-17T18:27:23.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d927fc700 1 -- 172.21.15.62:0/3207854607 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d8800d830 con 0x7f8d9405ca90 2021-12-17T18:27:23.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d98e76700 1 -- 172.21.15.62:0/3207854607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9405ca90 msgr2=0x7f8d9414b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d98e76700 1 --2- 172.21.15.62:0/3207854607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9405ca90 0x7f8d9414b340 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f8d88002f70 tx=0x7f8d88006df0).stop 2021-12-17T18:27:23.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d98e76700 1 -- 172.21.15.62:0/3207854607 shutdown_connections 2021-12-17T18:27:23.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d98e76700 1 --2- 172.21.15.62:0/3207854607 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8d9405f730 0x7f8d94146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d98e76700 1 --2- 172.21.15.62:0/3207854607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9405ca90 0x7f8d9414b340 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d98e76700 1 -- 172.21.15.62:0/3207854607 >> 172.21.15.62:0/3207854607 conn(0x7f8d9405be70 msgr2=0x7f8d94062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:23.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d98e76700 1 -- 172.21.15.62:0/3207854607 shutdown_connections 2021-12-17T18:27:23.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.669+0000 7f8d98e76700 1 -- 172.21.15.62:0/3207854607 wait complete. 2021-12-17T18:27:23.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d98e76700 1 Processor -- start 2021-12-17T18:27:23.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d98e76700 1 -- start start 2021-12-17T18:27:23.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d98e76700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8d9405ca90 0x7f8d940aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d98e76700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9405f730 0x7f8d9414e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d98e76700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8d940ac040 0x7f8d9415a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d98e76700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9414cea0 con 0x7f8d9405f730 2021-12-17T18:27:23.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d98e76700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d94159dc0 con 0x7f8d9405ca90 2021-12-17T18:27:23.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d98e76700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9415a060 con 0x7f8d940ac040 2021-12-17T18:27:23.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d92ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9405f730 0x7f8d9414e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d92ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9405f730 0x7f8d9414e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56026/0 (socket says 172.21.15.62:56026) 2021-12-17T18:27:23.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d92ffd700 1 -- 172.21.15.62:0/641200353 learned_addr learned my addr 172.21.15.62:0/641200353 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:23.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d937fe700 1 --2- 172.21.15.62:0/641200353 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8d9405ca90 0x7f8d940aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d93fff700 1 --2- 172.21.15.62:0/641200353 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8d940ac040 0x7f8d9415a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d92ffd700 1 -- 172.21.15.62:0/641200353 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8d940ac040 msgr2=0x7f8d9415a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d92ffd700 1 --2- 172.21.15.62:0/641200353 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8d940ac040 0x7f8d9415a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d92ffd700 1 -- 172.21.15.62:0/641200353 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8d9405ca90 msgr2=0x7f8d940aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d92ffd700 1 --2- 172.21.15.62:0/641200353 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8d9405ca90 0x7f8d940aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d92ffd700 1 -- 172.21.15.62:0/641200353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8800b180 con 0x7f8d9405f730 2021-12-17T18:27:23.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d92ffd700 1 --2- 172.21.15.62:0/641200353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9405f730 0x7f8d9414e060 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f8d84001490 tx=0x7f8d84007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:23.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d90ff9700 1 -- 172.21.15.62:0/641200353 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d84005c70 con 0x7f8d9405f730 2021-12-17T18:27:23.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d90ff9700 1 -- 172.21.15.62:0/641200353 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d84005dd0 con 0x7f8d9405f730 2021-12-17T18:27:23.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d98e76700 1 -- 172.21.15.62:0/641200353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9414cae0 con 0x7f8d9405f730 2021-12-17T18:27:23.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d90ff9700 1 -- 172.21.15.62:0/641200353 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d84004a90 con 0x7f8d9405f730 2021-12-17T18:27:23.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.673+0000 7f8d98e76700 1 -- 172.21.15.62:0/641200353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9415a9f0 con 0x7f8d9405f730 2021-12-17T18:27:23.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.677+0000 7f8d90ff9700 1 -- 172.21.15.62:0/641200353 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8d8401b070 con 0x7f8d9405f730 2021-12-17T18:27:23.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.677+0000 7f8d98e76700 1 -- 172.21.15.62:0/641200353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9415aca0 con 0x7f8d9405f730 2021-12-17T18:27:23.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.677+0000 7f8d90ff9700 1 --2- 172.21.15.62:0/641200353 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8d74053610 0x7f8d74055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.677+0000 7f8d90ff9700 1 -- 172.21.15.62:0/641200353 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8d8406b1f0 con 0x7f8d9405f730 2021-12-17T18:27:23.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.677+0000 7f8d937fe700 1 --2- 172.21.15.62:0/641200353 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8d74053610 0x7f8d74055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.677+0000 7f8d937fe700 1 --2- 172.21.15.62:0/641200353 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8d74053610 0x7f8d74055ad0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f8d8801a000 tx=0x7f8d88014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:23.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.681+0000 7f8d90ff9700 1 -- 172.21.15.62:0/641200353 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8d84042350 con 0x7f8d9405f730 2021-12-17T18:27:23.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.805+0000 7f8d98e76700 1 -- 172.21.15.62:0/641200353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8d9415a220 con 0x7f8d9405f730 2021-12-17T18:27:23.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.805+0000 7f8d90ff9700 1 -- 172.21.15.62:0/641200353 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v132) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8d84045970 con 0x7f8d9405f730 2021-12-17T18:27:23.813 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:27:23.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.809+0000 7f8d98e76700 1 -- 172.21.15.62:0/641200353 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8d74053610 msgr2=0x7f8d74055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.809+0000 7f8d98e76700 1 --2- 172.21.15.62:0/641200353 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8d74053610 0x7f8d74055ad0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f8d8801a000 tx=0x7f8d88014000).stop 2021-12-17T18:27:23.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.809+0000 7f8d98e76700 1 -- 172.21.15.62:0/641200353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9405f730 msgr2=0x7f8d9414e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.809+0000 7f8d98e76700 1 --2- 172.21.15.62:0/641200353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9405f730 0x7f8d9414e060 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f8d84001490 tx=0x7f8d84007e00).stop 2021-12-17T18:27:23.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.809+0000 7f8d98e76700 1 -- 172.21.15.62:0/641200353 shutdown_connections 2021-12-17T18:27:23.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.809+0000 7f8d98e76700 1 --2- 172.21.15.62:0/641200353 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8d74053610 0x7f8d74055ad0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.809+0000 7f8d98e76700 1 --2- 172.21.15.62:0/641200353 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8d940ac040 0x7f8d9415a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.809+0000 7f8d98e76700 1 --2- 172.21.15.62:0/641200353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9405f730 0x7f8d9414e060 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.809+0000 7f8d98e76700 1 --2- 172.21.15.62:0/641200353 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8d9405ca90 0x7f8d940aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.809+0000 7f8d98e76700 1 -- 172.21.15.62:0/641200353 >> 172.21.15.62:0/641200353 conn(0x7f8d9405be70 msgr2=0x7f8d940b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:23.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.809+0000 7f8d98e76700 1 -- 172.21.15.62:0/641200353 shutdown_connections 2021-12-17T18:27:23.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.809+0000 7f8d98e76700 1 -- 172.21.15.62:0/641200353 wait complete. 2021-12-17T18:27:23.830 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:27:23.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.933+0000 7f8f4197c700 1 Processor -- start 2021-12-17T18:27:23.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.933+0000 7f8f4197c700 1 -- start start 2021-12-17T18:27:23.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f4197c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8f3c0b05b0 0x7f8f3c146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f4197c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f8f3c0b5dd0 0x7f8f3c146b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f4197c700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3c0b2010 con 0x7f8f3c147070 2021-12-17T18:27:23.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f4197c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3c0b0990 con 0x7f8f3c0b05b0 2021-12-17T18:27:23.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f4197c700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3c0b2240 con 0x7f8f3c0b5dd0 2021-12-17T18:27:23.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f3affd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8f3c0b05b0 0x7f8f3c146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f3affd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8f3c0b05b0 0x7f8f3c146690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56036/0 (socket says 172.21.15.62:56036) 2021-12-17T18:27:23.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f3affd700 1 -- 172.21.15.62:0/4171950946 learned_addr learned my addr 172.21.15.62:0/4171950946 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:23.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f327fc700 1 --2- 172.21.15.62:0/4171950946 >> v2:172.21.15.109:3300/0 conn(0x7f8f3c0b5dd0 0x7f8f3c146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f3affd700 1 -- 172.21.15.62:0/4171950946 >> v2:172.21.15.109:3300/0 conn(0x7f8f3c0b5dd0 msgr2=0x7f8f3c146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:23.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f3affd700 1 --2- 172.21.15.62:0/4171950946 >> v2:172.21.15.109:3300/0 conn(0x7f8f3c0b5dd0 0x7f8f3c146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f3affd700 1 -- 172.21.15.62:0/4171950946 >> v1:172.21.15.109:6789/0 conn(0x7f8f3c147070 legacy=0x7f8f3c05f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f3affd700 1 -- 172.21.15.62:0/4171950946 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c0b24e0 con 0x7f8f3c0b05b0 2021-12-17T18:27:23.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f3affd700 1 --2- 172.21.15.62:0/4171950946 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f3c0b05b0 0x7f8f3c146690 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f8f2c002f70 tx=0x7f8f2c006eb0).ready entity=mon.0 client_cookie=15ac33b5623e318 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:23.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f3a7fc700 1 -- 172.21.15.62:0/4171950946 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f2c00d5c0 con 0x7f8f3c0b05b0 2021-12-17T18:27:23.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f3a7fc700 1 -- 172.21.15.62:0/4171950946 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c000e90 con 0x7f8f3c0b05b0 2021-12-17T18:27:23.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f3a7fc700 1 -- 172.21.15.62:0/4171950946 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f2c00d950 con 0x7f8f3c0b05b0 2021-12-17T18:27:23.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f4197c700 1 -- 172.21.15.62:0/4171950946 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f3c0b05b0 msgr2=0x7f8f3c146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f4197c700 1 --2- 172.21.15.62:0/4171950946 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f3c0b05b0 0x7f8f3c146690 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f8f2c002f70 tx=0x7f8f2c006eb0).stop 2021-12-17T18:27:23.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f4197c700 1 -- 172.21.15.62:0/4171950946 shutdown_connections 2021-12-17T18:27:23.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f4197c700 1 --2- 172.21.15.62:0/4171950946 >> v2:172.21.15.109:3300/0 conn(0x7f8f3c0b5dd0 0x7f8f3c146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f4197c700 1 --2- 172.21.15.62:0/4171950946 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f3c0b05b0 0x7f8f3c146690 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f4197c700 1 -- 172.21.15.62:0/4171950946 >> 172.21.15.62:0/4171950946 conn(0x7f8f3c062510 msgr2=0x7f8f3c0628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:23.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f4197c700 1 -- 172.21.15.62:0/4171950946 shutdown_connections 2021-12-17T18:27:23.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.937+0000 7f8f4197c700 1 -- 172.21.15.62:0/4171950946 wait complete. 2021-12-17T18:27:23.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f4197c700 1 Processor -- start 2021-12-17T18:27:23.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f4197c700 1 -- start start 2021-12-17T18:27:23.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f4197c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f3c0b05b0 0x7f8f3c063780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f4197c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f3c0b5dd0 0x7f8f3c0643a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f4197c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f3c067070 0x7f8f3c064890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f4197c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c153480 con 0x7f8f3c067070 2021-12-17T18:27:23.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f4197c700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c066e90 con 0x7f8f3c0b05b0 2021-12-17T18:27:23.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f4197c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c066bf0 con 0x7f8f3c0b5dd0 2021-12-17T18:27:23.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f3b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f3c067070 0x7f8f3c064890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f3b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f3c067070 0x7f8f3c064890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56040/0 (socket says 172.21.15.62:56040) 2021-12-17T18:27:23.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f3b7fe700 1 -- 172.21.15.62:0/3054892402 learned_addr learned my addr 172.21.15.62:0/3054892402 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:23.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f3affd700 1 --2- 172.21.15.62:0/3054892402 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f3c0b05b0 0x7f8f3c063780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f327fc700 1 --2- 172.21.15.62:0/3054892402 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f3c0b5dd0 0x7f8f3c0643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f3b7fe700 1 -- 172.21.15.62:0/3054892402 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f3c0b5dd0 msgr2=0x7f8f3c0643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f3b7fe700 1 --2- 172.21.15.62:0/3054892402 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f3c0b5dd0 0x7f8f3c0643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f3b7fe700 1 -- 172.21.15.62:0/3054892402 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f3c0b05b0 msgr2=0x7f8f3c063780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f3b7fe700 1 --2- 172.21.15.62:0/3054892402 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f3c0b05b0 0x7f8f3c063780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f3b7fe700 1 -- 172.21.15.62:0/3054892402 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c00b1e0 con 0x7f8f3c067070 2021-12-17T18:27:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f3affd700 1 --2- 172.21.15.62:0/3054892402 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f3c0b05b0 0x7f8f3c063780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f3b7fe700 1 --2- 172.21.15.62:0/3054892402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f3c067070 0x7f8f3c064890 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f8f3c0ba230 tx=0x7f8f34007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:23.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f38ff9700 1 -- 172.21.15.62:0/3054892402 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f34006aa0 con 0x7f8f3c067070 2021-12-17T18:27:23.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f38ff9700 1 -- 172.21.15.62:0/3054892402 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f34006c00 con 0x7f8f3c067070 2021-12-17T18:27:23.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f38ff9700 1 -- 172.21.15.62:0/3054892402 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f34007030 con 0x7f8f3c067070 2021-12-17T18:27:23.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f4197c700 1 -- 172.21.15.62:0/3054892402 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3c1410e0 con 0x7f8f3c067070 2021-12-17T18:27:23.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f4197c700 1 -- 172.21.15.62:0/3054892402 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3c063c70 con 0x7f8f3c067070 2021-12-17T18:27:23.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.941+0000 7f8f4197c700 1 -- 172.21.15.62:0/3054892402 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3c066a40 con 0x7f8f3c067070 2021-12-17T18:27:23.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.945+0000 7f8f38ff9700 1 -- 172.21.15.62:0/3054892402 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8f34010030 con 0x7f8f3c067070 2021-12-17T18:27:23.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.945+0000 7f8f38ff9700 1 --2- 172.21.15.62:0/3054892402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f20053640 0x7f8f20055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:23.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.945+0000 7f8f38ff9700 1 -- 172.21.15.62:0/3054892402 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8f3406b7e0 con 0x7f8f3c067070 2021-12-17T18:27:23.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.945+0000 7f8f3affd700 1 --2- 172.21.15.62:0/3054892402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f20053640 0x7f8f20055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:23.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.945+0000 7f8f3affd700 1 --2- 172.21.15.62:0/3054892402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f20053640 0x7f8f20055b00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f8f2c01a000 tx=0x7f8f2c015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:23.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:23.949+0000 7f8f38ff9700 1 -- 172.21.15.62:0/3054892402 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8f340428e0 con 0x7f8f3c067070 2021-12-17T18:27:24.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.077+0000 7f8f4197c700 1 -- 172.21.15.62:0/3054892402 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f3c141270 con 0x7f8f3c067070 2021-12-17T18:27:24.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.077+0000 7f8f38ff9700 1 -- 172.21.15.62:0/3054892402 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v132) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8f34045f00 con 0x7f8f3c067070 2021-12-17T18:27:24.084 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:27:24.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.081+0000 7f8f4197c700 1 -- 172.21.15.62:0/3054892402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f20053640 msgr2=0x7f8f20055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:24.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.081+0000 7f8f4197c700 1 --2- 172.21.15.62:0/3054892402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f20053640 0x7f8f20055b00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f8f2c01a000 tx=0x7f8f2c015000).stop 2021-12-17T18:27:24.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.081+0000 7f8f4197c700 1 -- 172.21.15.62:0/3054892402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f3c067070 msgr2=0x7f8f3c064890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:24.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.081+0000 7f8f4197c700 1 --2- 172.21.15.62:0/3054892402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f3c067070 0x7f8f3c064890 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f8f3c0ba230 tx=0x7f8f34007f70).stop 2021-12-17T18:27:24.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.081+0000 7f8f4197c700 1 -- 172.21.15.62:0/3054892402 shutdown_connections 2021-12-17T18:27:24.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.081+0000 7f8f4197c700 1 --2- 172.21.15.62:0/3054892402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f20053640 0x7f8f20055b00 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.081+0000 7f8f4197c700 1 --2- 172.21.15.62:0/3054892402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f3c067070 0x7f8f3c064890 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.081+0000 7f8f4197c700 1 --2- 172.21.15.62:0/3054892402 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f3c0b5dd0 0x7f8f3c0643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.081+0000 7f8f4197c700 1 --2- 172.21.15.62:0/3054892402 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f3c0b05b0 0x7f8f3c063780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.081+0000 7f8f4197c700 1 -- 172.21.15.62:0/3054892402 >> 172.21.15.62:0/3054892402 conn(0x7f8f3c062510 msgr2=0x7f8f3c13e080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:24.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.081+0000 7f8f4197c700 1 -- 172.21.15.62:0/3054892402 shutdown_connections 2021-12-17T18:27:24.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.081+0000 7f8f4197c700 1 -- 172.21.15.62:0/3054892402 wait complete. 2021-12-17T18:27:24.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:27:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4ae48aa700 1 Processor -- start 2021-12-17T18:27:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4ae48aa700 1 -- start start 2021-12-17T18:27:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4ae48aa700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4ae005ca90 0x7f4ae00b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4ae48aa700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ae00b4230 0x7f4ae00b5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4ae48aa700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae005ce70 con 0x7f4ae00b3540 2021-12-17T18:27:24.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4ae48aa700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae00b1bc0 con 0x7f4ae005ca90 2021-12-17T18:27:24.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4ae48aa700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00b1e60 con 0x7f4ae00b4230 2021-12-17T18:27:24.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4ade59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4ae00b3540 0x7f4ae00b4f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39628/0 (socket says 172.21.15.62:39628) 2021-12-17T18:27:24.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4ade59c700 1 -- 172.21.15.62:0/2436195989 learned_addr learned my addr 172.21.15.62:0/2436195989 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:24.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4aded9d700 1 --2- 172.21.15.62:0/2436195989 >> v2:172.21.15.62:3300/0 conn(0x7f4ae005ca90 0x7f4ae00b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:24.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4adf59e700 1 --2- 172.21.15.62:0/2436195989 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ae00b4230 0x7f4ae00b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:24.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4addd9b700 1 -- 172.21.15.62:0/2436195989 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210516746 0 0) 0x7f4ae005ce70 con 0x7f4ae00b3540 2021-12-17T18:27:24.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4addd9b700 1 -- 172.21.15.62:0/2436195989 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ac4003260 con 0x7f4ae00b3540 2021-12-17T18:27:24.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4aded9d700 1 -- 172.21.15.62:0/2436195989 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ae00b4230 msgr2=0x7f4ae00b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:24.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4aded9d700 1 --2- 172.21.15.62:0/2436195989 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ae00b4230 0x7f4ae00b5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4aded9d700 1 -- 172.21.15.62:0/2436195989 >> v1:172.21.15.62:6789/0 conn(0x7f4ae00b3540 legacy=0x7f4ae00b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:24.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4aded9d700 1 -- 172.21.15.62:0/2436195989 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae00b2100 con 0x7f4ae005ca90 2021-12-17T18:27:24.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.201+0000 7f4aded9d700 1 --2- 172.21.15.62:0/2436195989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ae005ca90 0x7f4ae00b25a0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f4ad4002f70 tx=0x7f4ad4006df0).ready entity=mon.0 client_cookie=62837f13c40b636e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:24.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.205+0000 7f4addd9b700 1 -- 172.21.15.62:0/2436195989 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ad400d570 con 0x7f4ae005ca90 2021-12-17T18:27:24.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.205+0000 7f4addd9b700 1 -- 172.21.15.62:0/2436195989 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad4000e90 con 0x7f4ae005ca90 2021-12-17T18:27:24.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.205+0000 7f4addd9b700 1 -- 172.21.15.62:0/2436195989 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ad400d8c0 con 0x7f4ae005ca90 2021-12-17T18:27:24.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.205+0000 7f4ae48aa700 1 -- 172.21.15.62:0/2436195989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ae005ca90 msgr2=0x7f4ae00b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:24.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.205+0000 7f4ae48aa700 1 --2- 172.21.15.62:0/2436195989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ae005ca90 0x7f4ae00b25a0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f4ad4002f70 tx=0x7f4ad4006df0).stop 2021-12-17T18:27:24.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.205+0000 7f4ae48aa700 1 -- 172.21.15.62:0/2436195989 shutdown_connections 2021-12-17T18:27:24.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.205+0000 7f4ae48aa700 1 --2- 172.21.15.62:0/2436195989 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ae00b4230 0x7f4ae00b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.205+0000 7f4ae48aa700 1 --2- 172.21.15.62:0/2436195989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ae005ca90 0x7f4ae00b25a0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.205+0000 7f4ae48aa700 1 -- 172.21.15.62:0/2436195989 >> 172.21.15.62:0/2436195989 conn(0x7f4ae005bcd0 msgr2=0x7f4ae0062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:24.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.205+0000 7f4ae48aa700 1 -- 172.21.15.62:0/2436195989 shutdown_connections 2021-12-17T18:27:24.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.205+0000 7f4ae48aa700 1 -- 172.21.15.62:0/2436195989 wait complete. 2021-12-17T18:27:24.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.205+0000 7f4ae48aa700 1 Processor -- start 2021-12-17T18:27:24.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.205+0000 7f4ae48aa700 1 -- start start 2021-12-17T18:27:24.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4ae48aa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ae005ca90 0x7f4ae00a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:24.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4ae48aa700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4ae00b3540 0x7f4ae00a6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:24.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4ae48aa700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ae00b4230 0x7f4ae01430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4ae48aa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00a7c90 con 0x7f4ae005ca90 2021-12-17T18:27:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4ae48aa700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00aaad0 con 0x7f4ae00b3540 2021-12-17T18:27:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4ae48aa700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00aad70 con 0x7f4ae00b4230 2021-12-17T18:27:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4aded9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ae005ca90 0x7f4ae00a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4aded9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ae005ca90 0x7f4ae00a84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56052/0 (socket says 172.21.15.62:56052) 2021-12-17T18:27:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4aded9d700 1 -- 172.21.15.62:0/1130575030 learned_addr learned my addr 172.21.15.62:0/1130575030 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4adf59e700 1 --2- 172.21.15.62:0/1130575030 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ae00b4230 0x7f4ae01430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4ade59c700 1 --2- 172.21.15.62:0/1130575030 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4ae00b3540 0x7f4ae00a6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4aded9d700 1 -- 172.21.15.62:0/1130575030 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ae00b4230 msgr2=0x7f4ae01430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4aded9d700 1 --2- 172.21.15.62:0/1130575030 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ae00b4230 0x7f4ae01430d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4aded9d700 1 -- 172.21.15.62:0/1130575030 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4ae00b3540 msgr2=0x7f4ae00a6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4aded9d700 1 --2- 172.21.15.62:0/1130575030 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4ae00b3540 0x7f4ae00a6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4aded9d700 1 -- 172.21.15.62:0/1130575030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad400b180 con 0x7f4ae005ca90 2021-12-17T18:27:24.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4aded9d700 1 --2- 172.21.15.62:0/1130575030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ae005ca90 0x7f4ae00a84f0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f4ad4002f70 tx=0x7f4ad4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:24.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4acffff700 1 -- 172.21.15.62:0/1130575030 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ad4016070 con 0x7f4ae005ca90 2021-12-17T18:27:24.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4acffff700 1 -- 172.21.15.62:0/1130575030 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad40138d0 con 0x7f4ae005ca90 2021-12-17T18:27:24.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4acffff700 1 -- 172.21.15.62:0/1130575030 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ad4013c30 con 0x7f4ae005ca90 2021-12-17T18:27:24.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4ae48aa700 1 -- 172.21.15.62:0/1130575030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae00aafa0 con 0x7f4ae005ca90 2021-12-17T18:27:24.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4ae48aa700 1 -- 172.21.15.62:0/1130575030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae00a5900 con 0x7f4ae005ca90 2021-12-17T18:27:24.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.209+0000 7f4ae48aa700 1 -- 172.21.15.62:0/1130575030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae00a7ab0 con 0x7f4ae005ca90 2021-12-17T18:27:24.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.213+0000 7f4acffff700 1 -- 172.21.15.62:0/1130575030 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4ad400f030 con 0x7f4ae005ca90 2021-12-17T18:27:24.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.213+0000 7f4acffff700 1 --2- 172.21.15.62:0/1130575030 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4abc053580 0x7f4abc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:24.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.213+0000 7f4acffff700 1 -- 172.21.15.62:0/1130575030 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4ad406c380 con 0x7f4ae005ca90 2021-12-17T18:27:24.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.213+0000 7f4ade59c700 1 --2- 172.21.15.62:0/1130575030 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4abc053580 0x7f4abc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:24.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.213+0000 7f4ade59c700 1 --2- 172.21.15.62:0/1130575030 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4abc053580 0x7f4abc055a40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f4ad000d000 tx=0x7f4ad00027f0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:24.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.217+0000 7f4acffff700 1 -- 172.21.15.62:0/1130575030 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4ad4043410 con 0x7f4ae005ca90 2021-12-17T18:27:24.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.345+0000 7f4ae48aa700 1 -- 172.21.15.62:0/1130575030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ae00603f0 con 0x7f4ae005ca90 2021-12-17T18:27:24.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.349+0000 7f4acffff700 1 -- 172.21.15.62:0/1130575030 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v132) v1 ==== 100+0+10 (secure 0 0 0) 0x7f4ad4022020 con 0x7f4ae005ca90 2021-12-17T18:27:24.354 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:27:24.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.349+0000 7f4ae48aa700 1 -- 172.21.15.62:0/1130575030 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4abc053580 msgr2=0x7f4abc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:24.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.349+0000 7f4ae48aa700 1 --2- 172.21.15.62:0/1130575030 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4abc053580 0x7f4abc055a40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f4ad000d000 tx=0x7f4ad00027f0).stop 2021-12-17T18:27:24.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.349+0000 7f4ae48aa700 1 -- 172.21.15.62:0/1130575030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ae005ca90 msgr2=0x7f4ae00a84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:24.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.349+0000 7f4ae48aa700 1 --2- 172.21.15.62:0/1130575030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ae005ca90 0x7f4ae00a84f0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f4ad4002f70 tx=0x7f4ad4014000).stop 2021-12-17T18:27:24.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.349+0000 7f4ae48aa700 1 -- 172.21.15.62:0/1130575030 shutdown_connections 2021-12-17T18:27:24.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.349+0000 7f4ae48aa700 1 --2- 172.21.15.62:0/1130575030 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4abc053580 0x7f4abc055a40 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.349+0000 7f4ae48aa700 1 --2- 172.21.15.62:0/1130575030 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4ae00b4230 0x7f4ae01430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.349+0000 7f4ae48aa700 1 --2- 172.21.15.62:0/1130575030 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4ae00b3540 0x7f4ae00a6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.349+0000 7f4ae48aa700 1 --2- 172.21.15.62:0/1130575030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ae005ca90 0x7f4ae00a84f0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.349+0000 7f4ae48aa700 1 -- 172.21.15.62:0/1130575030 >> 172.21.15.62:0/1130575030 conn(0x7f4ae005bcd0 msgr2=0x7f4ae00b9210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:24.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.349+0000 7f4ae48aa700 1 -- 172.21.15.62:0/1130575030 shutdown_connections 2021-12-17T18:27:24.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.349+0000 7f4ae48aa700 1 -- 172.21.15.62:0/1130575030 wait complete. 2021-12-17T18:27:24.366 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:27:24.367 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:24.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.465+0000 7f2590896700 1 Processor -- start 2021-12-17T18:27:24.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.465+0000 7f2590896700 1 -- start start 2021-12-17T18:27:24.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f2590896700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f258c0b5ea0 0x7f258c140860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:24.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f2590896700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f258c140d50 0x7f258c0b0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:24.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f2590896700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258c0ad8e0 con 0x7f258c0682c0 2021-12-17T18:27:24.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f2590896700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f258c1411a0 con 0x7f258c0b5ea0 2021-12-17T18:27:24.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f2590896700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f258c0b6280 con 0x7f258c140d50 2021-12-17T18:27:24.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f258b7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f258c0b5ea0 0x7f258c140860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:24.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f258affd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f258c0682c0 0x7f258c0afdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39644/0 (socket says 172.21.15.62:39644) 2021-12-17T18:27:24.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f258affd700 1 -- 172.21.15.62:0/2209134465 learned_addr learned my addr 172.21.15.62:0/2209134465 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:24.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f258bfff700 1 --2- 172.21.15.62:0/2209134465 >> v2:172.21.15.109:3300/0 conn(0x7f258c140d50 0x7f258c0b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:24.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f258b7fe700 1 -- 172.21.15.62:0/2209134465 >> v2:172.21.15.109:3300/0 conn(0x7f258c140d50 msgr2=0x7f258c0b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:24.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f258b7fe700 1 --2- 172.21.15.62:0/2209134465 >> v2:172.21.15.109:3300/0 conn(0x7f258c140d50 0x7f258c0b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f258b7fe700 1 -- 172.21.15.62:0/2209134465 >> v1:172.21.15.62:6789/0 conn(0x7f258c0682c0 legacy=0x7f258c0afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:24.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f258b7fe700 1 -- 172.21.15.62:0/2209134465 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c0ad310 con 0x7f258c0b5ea0 2021-12-17T18:27:24.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f258b7fe700 1 --2- 172.21.15.62:0/2209134465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f258c0b5ea0 0x7f258c140860 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f257c002f70 tx=0x7f257c006df0).ready entity=mon.0 client_cookie=6ca6dc1b4adf287f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:24.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f258a7fc700 1 -- 172.21.15.62:0/2209134465 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f257c00d570 con 0x7f258c0b5ea0 2021-12-17T18:27:24.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f258a7fc700 1 -- 172.21.15.62:0/2209134465 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257c000e90 con 0x7f258c0b5ea0 2021-12-17T18:27:24.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f258a7fc700 1 -- 172.21.15.62:0/2209134465 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f257c00d8c0 con 0x7f258c0b5ea0 2021-12-17T18:27:24.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f2590896700 1 -- 172.21.15.62:0/2209134465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f258c0b5ea0 msgr2=0x7f258c140860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:24.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f2590896700 1 --2- 172.21.15.62:0/2209134465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f258c0b5ea0 0x7f258c140860 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f257c002f70 tx=0x7f257c006df0).stop 2021-12-17T18:27:24.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f2590896700 1 -- 172.21.15.62:0/2209134465 shutdown_connections 2021-12-17T18:27:24.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f2590896700 1 --2- 172.21.15.62:0/2209134465 >> v2:172.21.15.109:3300/0 conn(0x7f258c140d50 0x7f258c0b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f2590896700 1 --2- 172.21.15.62:0/2209134465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f258c0b5ea0 0x7f258c140860 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f2590896700 1 -- 172.21.15.62:0/2209134465 >> 172.21.15.62:0/2209134465 conn(0x7f258c05d220 msgr2=0x7f258c0b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:24.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f2590896700 1 -- 172.21.15.62:0/2209134465 shutdown_connections 2021-12-17T18:27:24.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.469+0000 7f2590896700 1 -- 172.21.15.62:0/2209134465 wait complete. 2021-12-17T18:27:24.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.473+0000 7f2590896700 1 Processor -- start 2021-12-17T18:27:24.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.473+0000 7f2590896700 1 -- start start 2021-12-17T18:27:24.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.473+0000 7f2590896700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f258c0682c0 0x7f258c13ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:24.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.473+0000 7f2590896700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f258c0b5ea0 0x7f258c1412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:24.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.473+0000 7f2590896700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f258c140d50 0x7f258c1417d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:24.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.473+0000 7f2590896700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c0670d0 con 0x7f258c0682c0 2021-12-17T18:27:24.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.473+0000 7f2590896700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c143060 con 0x7f258c0b5ea0 2021-12-17T18:27:24.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.473+0000 7f2590896700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258c066c40 con 0x7f258c140d50 2021-12-17T18:27:24.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.473+0000 7f258b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f258c0682c0 0x7f258c13ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:24.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.473+0000 7f258b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f258c0682c0 0x7f258c13ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56066/0 (socket says 172.21.15.62:56066) 2021-12-17T18:27:24.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.473+0000 7f258b7fe700 1 -- 172.21.15.62:0/2000727605 learned_addr learned my addr 172.21.15.62:0/2000727605 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:24.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.473+0000 7f258affd700 1 --2- 172.21.15.62:0/2000727605 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f258c0b5ea0 0x7f258c1412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:24.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.473+0000 7f258bfff700 1 --2- 172.21.15.62:0/2000727605 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f258c140d50 0x7f258c1417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:24.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.477+0000 7f258b7fe700 1 -- 172.21.15.62:0/2000727605 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f258c140d50 msgr2=0x7f258c1417d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:24.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.477+0000 7f258b7fe700 1 --2- 172.21.15.62:0/2000727605 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f258c140d50 0x7f258c1417d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.477+0000 7f258b7fe700 1 -- 172.21.15.62:0/2000727605 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f258c0b5ea0 msgr2=0x7f258c1412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:24.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.477+0000 7f258b7fe700 1 --2- 172.21.15.62:0/2000727605 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f258c0b5ea0 0x7f258c1412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.477+0000 7f258b7fe700 1 -- 172.21.15.62:0/2000727605 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c00b180 con 0x7f258c0682c0 2021-12-17T18:27:24.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.477+0000 7f258b7fe700 1 --2- 172.21.15.62:0/2000727605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f258c0682c0 0x7f258c13ff10 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f257c002f70 tx=0x7f257c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:24.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.477+0000 7f2588ff9700 1 -- 172.21.15.62:0/2000727605 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f257c016070 con 0x7f258c0682c0 2021-12-17T18:27:24.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.477+0000 7f2588ff9700 1 -- 172.21.15.62:0/2000727605 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257c00d8f0 con 0x7f258c0682c0 2021-12-17T18:27:24.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.477+0000 7f2588ff9700 1 -- 172.21.15.62:0/2000727605 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f257c013da0 con 0x7f258c0682c0 2021-12-17T18:27:24.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.477+0000 7f2590896700 1 -- 172.21.15.62:0/2000727605 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258c0642e0 con 0x7f258c0682c0 2021-12-17T18:27:24.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.477+0000 7f2590896700 1 -- 172.21.15.62:0/2000727605 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f258c064880 con 0x7f258c0682c0 2021-12-17T18:27:24.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.477+0000 7f2590896700 1 -- 172.21.15.62:0/2000727605 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258c066e30 con 0x7f258c0682c0 2021-12-17T18:27:24.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.477+0000 7f2588ff9700 1 -- 172.21.15.62:0/2000727605 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f257c00f030 con 0x7f258c0682c0 2021-12-17T18:27:24.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.477+0000 7f2588ff9700 1 --2- 172.21.15.62:0/2000727605 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f256c053610 0x7f256c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:24.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.477+0000 7f2588ff9700 1 -- 172.21.15.62:0/2000727605 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f257c06c480 con 0x7f258c0682c0 2021-12-17T18:27:24.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.477+0000 7f258affd700 1 --2- 172.21.15.62:0/2000727605 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f256c053610 0x7f256c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:24.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.481+0000 7f258affd700 1 --2- 172.21.15.62:0/2000727605 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f256c053610 0x7f256c055ad0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f258000d000 tx=0x7f2580009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:24.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.485+0000 7f2588ff9700 1 -- 172.21.15.62:0/2000727605 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f258c066e30 con 0x7f258c0682c0 2021-12-17T18:27:24.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.645+0000 7f2590896700 1 -- 172.21.15.62:0/2000727605 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f258c066e00 con 0x7f258c0682c0 2021-12-17T18:27:24.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.649+0000 7f2588ff9700 1 -- 172.21.15.62:0/2000727605 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f257c023020 con 0x7f258c0682c0 2021-12-17T18:27:24.653 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:24.654 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7957,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6833/3542826349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3542826349},{"type":"v1","addr":"172.21.15.62:6833","nonce":3542826349}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:27:19.830173+0000","modified":"2021-12-17T18:27:20.832915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/570760267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":570760267},{"type":"v1","addr":"172.21.15.109:6835","nonce":570760267}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-12-17T18:27:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.649+0000 7f2590896700 1 -- 172.21.15.62:0/2000727605 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f256c053610 msgr2=0x7f256c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.649+0000 7f2590896700 1 --2- 172.21.15.62:0/2000727605 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f256c053610 0x7f256c055ad0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f258000d000 tx=0x7f2580009040).stop 2021-12-17T18:27:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.649+0000 7f2590896700 1 -- 172.21.15.62:0/2000727605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f258c0682c0 msgr2=0x7f258c13ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.649+0000 7f2590896700 1 --2- 172.21.15.62:0/2000727605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f258c0682c0 0x7f258c13ff10 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f257c002f70 tx=0x7f257c014000).stop 2021-12-17T18:27:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.649+0000 7f2590896700 1 -- 172.21.15.62:0/2000727605 shutdown_connections 2021-12-17T18:27:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.649+0000 7f2590896700 1 --2- 172.21.15.62:0/2000727605 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f256c053610 0x7f256c055ad0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.649+0000 7f2590896700 1 --2- 172.21.15.62:0/2000727605 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f258c140d50 0x7f258c1417d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.649+0000 7f2590896700 1 --2- 172.21.15.62:0/2000727605 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f258c0b5ea0 0x7f258c1412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.649+0000 7f2590896700 1 --2- 172.21.15.62:0/2000727605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f258c0682c0 0x7f258c13ff10 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.649+0000 7f2590896700 1 -- 172.21.15.62:0/2000727605 >> 172.21.15.62:0/2000727605 conn(0x7f258c05d220 msgr2=0x7f258c0b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.649+0000 7f2590896700 1 -- 172.21.15.62:0/2000727605 shutdown_connections 2021-12-17T18:27:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:24.649+0000 7f2590896700 1 -- 172.21.15.62:0/2000727605 wait complete. 2021-12-17T18:27:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 66 2021-12-17T18:27:24.868 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:27:19.830173+0000', 'modified': '2021-12-17T18:27:20.832915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8127}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8127': {'gid': 8127, 'name': 'b', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.109:6835/570760267', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.109:6834', 'nonce': 570760267}, {'type': 'v1', 'addr': '172.21.15.109:6835', 'nonce': 570760267}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:27:24.869 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:27:24.869 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-12-17T18:27:24.989 INFO:teuthology.orchestra.run.smithi109.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":8127,"want_state":"up:active","state":"up:active","rank_uptime":5.144441606,"mdsmap_epoch":66,"osdmap_epoch":132,"osdmap_epoch_barrier":130,"uptime":10.165811808000001} 2021-12-17T18:27:24.990 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 8127, "mdsmap_epoch": 66, "osdmap_epoch": 132, "osdmap_epoch_barrier": 130, "rank_uptime": 5.144441606, "state": "up:active", "uptime": 10.165811808, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:27:24.990 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:27:24.991 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-12-17T18:27:24.991 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-12-17T18:27:24.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:24.992 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:25.001 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:27:25.018 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:27:25.019 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:27:25.074 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:27:25.074 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:27:25.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:25.076 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:27:25.082 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:27:25.083 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:25.085 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:27:25.102 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:27:25.102 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:27:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:27:25.160 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:27:25.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:25.162 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:27:25.162 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2021-12-17T18:27:25.154+0000 7f883d42d080 -1 init, newargv = 0x557ae057ffe0 newargc=9 2021-12-17T18:27:25.163 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[15062]: starting ceph client 2021-12-17T18:27:25.170 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[15062]: starting fuse 2021-12-17T18:27:26.268 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:27:26.288 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:27:26.289 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:27:26.344 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:27:26.345 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:27:26.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:26.347 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:27:26.352 INFO:teuthology.orchestra.run.smithi125.stdout:52 2021-12-17T18:27:26.353 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:27:26.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:26.354 DEBUG:teuthology.orchestra.run.smithi125:> sudo python3 -c ' 2021-12-17T18:27:26.355 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2021-12-17T18:27:26.356 DEBUG:teuthology.orchestra.run.smithi125:> import re 2021-12-17T18:27:26.356 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:27:26.357 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2021-12-17T18:27:26.358 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:27:26.359 DEBUG:teuthology.orchestra.run.smithi125:> def find_socket(client_name): 2021-12-17T18:27:26.359 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-12-17T18:27:26.360 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2021-12-17T18:27:26.361 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:27:26.362 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2021-12-17T18:27:26.363 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2021-12-17T18:27:26.363 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2021-12-17T18:27:26.364 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2021-12-17T18:27:26.365 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:27:26.366 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2021-12-17T18:27:26.366 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:27:26.367 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:27:26.368 DEBUG:teuthology.orchestra.run.smithi125:> return f 2021-12-17T18:27:26.369 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:27:26.369 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:27:26.370 DEBUG:teuthology.orchestra.run.smithi125:> print(find_socket("client.0")) 2021-12-17T18:27:26.371 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:27:26.415 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.15062.asok 2021-12-17T18:27:26.420 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15062.asok 2021-12-17T18:27:26.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:26.422 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15062.asok status 2021-12-17T18:27:26.558 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2021-12-17T18:27:26.559 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2021-12-17T18:27:26.559 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:27:26.559 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:27:26.559 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2021-12-17T18:27:26.560 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2021-12-17T18:27:26.560 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-12-17T18:27:26.560 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "15062", 2021-12-17T18:27:26.560 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2021-12-17T18:27:26.561 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:27:26.561 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2021-12-17T18:27:26.561 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2021-12-17T18:27:26.561 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 8116, 2021-12-17T18:27:26.562 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2021-12-17T18:27:26.562 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2021-12-17T18:27:26.562 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2021-12-17T18:27:26.562 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 8116 2021-12-17T18:27:26.563 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:27:26.563 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:27:26.563 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:27:26.563 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:27:26.564 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 118856462 2021-12-17T18:27:26.564 INFO:teuthology.orchestra.run.smithi125.stdout: } 2021-12-17T18:27:26.564 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:27:26.564 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:27:26.564 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:27:26.565 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:27:26.565 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 118856462 2021-12-17T18:27:26.565 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:27:26.566 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.8116 172.21.15.125:0/118856462", 2021-12-17T18:27:26.566 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "172.21.15.125:0/118856462", 2021-12-17T18:27:26.566 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2021-12-17T18:27:26.566 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 66, 2021-12-17T18:27:26.567 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 132, 2021-12-17T18:27:26.567 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:27:26.567 INFO:teuthology.orchestra.run.smithi125.stdout: "blacklisted": false, 2021-12-17T18:27:26.568 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2021-12-17T18:27:26.568 INFO:teuthology.orchestra.run.smithi125.stdout:} 2021-12-17T18:27:26.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:26.571 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:26.572 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:26.580 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:27:26.582 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:27:26.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:26.583 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:26.602 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:27:26.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.709+0000 7f88ebfff700 1 Processor -- start 2021-12-17T18:27:26.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88ebfff700 1 -- start start 2021-12-17T18:27:26.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88ebfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88ec0b5c80 0x7f88ec0b6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:26.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88ebfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f88ec0afcf0 0x7f88ec142b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:26.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88ebfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ec0b1540 con 0x7f88ec143060 2021-12-17T18:27:26.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88ebfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ec0af5b0 con 0x7f88ec0afcf0 2021-12-17T18:27:26.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88ebfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0af850 con 0x7f88ec0b5c80 2021-12-17T18:27:26.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88e3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f88ec0afcf0 0x7f88ec142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:26.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88eb7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f88ec143060 0x7f88ec143460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39656/0 (socket says 172.21.15.62:39656) 2021-12-17T18:27:26.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88eb7fe700 1 -- 172.21.15.62:0/846533002 learned_addr learned my addr 172.21.15.62:0/846533002 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:26.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88eaffd700 1 --2- 172.21.15.62:0/846533002 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88ec0b5c80 0x7f88ec0b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:26.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88e3fff700 1 -- 172.21.15.62:0/846533002 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88ec0b5c80 msgr2=0x7f88ec0b6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:26.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88e3fff700 1 --2- 172.21.15.62:0/846533002 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88ec0b5c80 0x7f88ec0b6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:26.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88e3fff700 1 -- 172.21.15.62:0/846533002 >> v1:172.21.15.62:6789/0 conn(0x7f88ec143060 legacy=0x7f88ec143460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:26.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88ea7fc700 1 -- 172.21.15.62:0/846533002 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326700300 0 0) 0x7f88ec0b1540 con 0x7f88ec143060 2021-12-17T18:27:26.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88e3fff700 1 -- 172.21.15.62:0/846533002 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec0b0110 con 0x7f88ec0afcf0 2021-12-17T18:27:26.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88e3fff700 1 --2- 172.21.15.62:0/846533002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec0afcf0 0x7f88ec142b70 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f88d4002f70 tx=0x7f88d4006df0).ready entity=mon.0 client_cookie=999607c0ab5869e0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:26.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88ea7fc700 1 -- 172.21.15.62:0/846533002 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d4014070 con 0x7f88ec0afcf0 2021-12-17T18:27:26.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88ea7fc700 1 -- 172.21.15.62:0/846533002 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d4000e90 con 0x7f88ec0afcf0 2021-12-17T18:27:26.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.713+0000 7f88ea7fc700 1 -- 172.21.15.62:0/846533002 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d400fb60 con 0x7f88ec0afcf0 2021-12-17T18:27:26.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.717+0000 7f88ebfff700 1 -- 172.21.15.62:0/846533002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec0afcf0 msgr2=0x7f88ec142b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:26.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.717+0000 7f88ebfff700 1 --2- 172.21.15.62:0/846533002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec0afcf0 0x7f88ec142b70 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f88d4002f70 tx=0x7f88d4006df0).stop 2021-12-17T18:27:26.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.717+0000 7f88ebfff700 1 -- 172.21.15.62:0/846533002 shutdown_connections 2021-12-17T18:27:26.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.717+0000 7f88ebfff700 1 --2- 172.21.15.62:0/846533002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec0afcf0 0x7f88ec142b70 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:26.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.717+0000 7f88ebfff700 1 --2- 172.21.15.62:0/846533002 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88ec0b5c80 0x7f88ec0b6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:26.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.717+0000 7f88ebfff700 1 -- 172.21.15.62:0/846533002 >> 172.21.15.62:0/846533002 conn(0x7f88ec05c750 msgr2=0x7f88ec05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:26.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.717+0000 7f88ebfff700 1 -- 172.21.15.62:0/846533002 shutdown_connections 2021-12-17T18:27:26.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.717+0000 7f88ebfff700 1 -- 172.21.15.62:0/846533002 wait complete. 2021-12-17T18:27:26.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.717+0000 7f88ebfff700 1 Processor -- start 2021-12-17T18:27:26.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.717+0000 7f88ebfff700 1 -- start start 2021-12-17T18:27:26.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.717+0000 7f88ebfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88ec0afcf0 0x7f88ec146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:26.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.717+0000 7f88ebfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88ec0b5c80 0x7f88ec13cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:26.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.717+0000 7f88ebfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec143060 0x7f88ec13d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:26.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.717+0000 7f88ebfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec153210 con 0x7f88ec143060 2021-12-17T18:27:26.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.717+0000 7f88ebfff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec1534b0 con 0x7f88ec0b5c80 2021-12-17T18:27:26.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.717+0000 7f88ebfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec13d740 con 0x7f88ec0afcf0 2021-12-17T18:27:26.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88eb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec143060 0x7f88ec13d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:26.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88eb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec143060 0x7f88ec13d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56082/0 (socket says 172.21.15.62:56082) 2021-12-17T18:27:26.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88eb7fe700 1 -- 172.21.15.62:0/410828175 learned_addr learned my addr 172.21.15.62:0/410828175 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:26.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88eaffd700 1 --2- 172.21.15.62:0/410828175 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88ec0afcf0 0x7f88ec146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:26.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88e3fff700 1 --2- 172.21.15.62:0/410828175 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88ec0b5c80 0x7f88ec13cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:26.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88eb7fe700 1 -- 172.21.15.62:0/410828175 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88ec0afcf0 msgr2=0x7f88ec146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:26.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88eb7fe700 1 --2- 172.21.15.62:0/410828175 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88ec0afcf0 0x7f88ec146160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:26.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88eb7fe700 1 -- 172.21.15.62:0/410828175 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88ec0b5c80 msgr2=0x7f88ec13cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:26.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88eb7fe700 1 --2- 172.21.15.62:0/410828175 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88ec0b5c80 0x7f88ec13cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:26.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88eb7fe700 1 -- 172.21.15.62:0/410828175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d400b180 con 0x7f88ec143060 2021-12-17T18:27:26.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88e3fff700 1 --2- 172.21.15.62:0/410828175 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88ec0b5c80 0x7f88ec13cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:26.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88eb7fe700 1 --2- 172.21.15.62:0/410828175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec143060 0x7f88ec13d250 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f88e4001250 tx=0x7f88e4001360).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:26.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88e8ff9700 1 -- 172.21.15.62:0/410828175 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88e4005ba0 con 0x7f88ec143060 2021-12-17T18:27:26.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88e8ff9700 1 -- 172.21.15.62:0/410828175 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e4005d00 con 0x7f88ec143060 2021-12-17T18:27:26.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88ebfff700 1 -- 172.21.15.62:0/410828175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ec0ac960 con 0x7f88ec143060 2021-12-17T18:27:26.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88e8ff9700 1 -- 172.21.15.62:0/410828175 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88e4004a90 con 0x7f88ec143060 2021-12-17T18:27:26.736 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88ebfff700 1 -- 172.21.15.62:0/410828175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ec152f10 con 0x7f88ec143060 2021-12-17T18:27:26.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88ebfff700 1 -- 172.21.15.62:0/410828175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ec09ed10 con 0x7f88ec143060 2021-12-17T18:27:26.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88e8ff9700 1 -- 172.21.15.62:0/410828175 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f88e4004bf0 con 0x7f88ec143060 2021-12-17T18:27:26.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88e8ff9700 1 --2- 172.21.15.62:0/410828175 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88d00536a0 0x7f88d0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:26.737 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.721+0000 7f88e8ff9700 1 -- 172.21.15.62:0/410828175 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f88e406b6b0 con 0x7f88ec143060 2021-12-17T18:27:26.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.725+0000 7f88eaffd700 1 --2- 172.21.15.62:0/410828175 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88d00536a0 0x7f88d0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:26.738 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.725+0000 7f88eaffd700 1 --2- 172.21.15.62:0/410828175 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88d00536a0 0x7f88d0055b60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f88dc00b000 tx=0x7f88dc006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:26.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.733+0000 7f88e8ff9700 1 -- 172.21.15.62:0/410828175 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f88ec09ed10 con 0x7f88ec143060 2021-12-17T18:27:26.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.857+0000 7f88ebfff700 1 -- 172.21.15.62:0/410828175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88ec0acb50 con 0x7f88ec143060 2021-12-17T18:27:26.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.861+0000 7f88e8ff9700 1 -- 172.21.15.62:0/410828175 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f88ec0acb50 con 0x7f88ec143060 2021-12-17T18:27:26.865 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:26.865 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":132,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:27:21.842977+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:27:17.568635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-12-17T18:27:18.849290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:27:26.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.861+0000 7f88ebfff700 1 -- 172.21.15.62:0/410828175 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88d00536a0 msgr2=0x7f88d0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:26.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.861+0000 7f88ebfff700 1 --2- 172.21.15.62:0/410828175 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88d00536a0 0x7f88d0055b60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f88dc00b000 tx=0x7f88dc006df0).stop 2021-12-17T18:27:26.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.861+0000 7f88ebfff700 1 -- 172.21.15.62:0/410828175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec143060 msgr2=0x7f88ec13d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:26.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.861+0000 7f88ebfff700 1 --2- 172.21.15.62:0/410828175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec143060 0x7f88ec13d250 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f88e4001250 tx=0x7f88e4001360).stop 2021-12-17T18:27:26.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.861+0000 7f88ebfff700 1 -- 172.21.15.62:0/410828175 shutdown_connections 2021-12-17T18:27:26.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.861+0000 7f88ebfff700 1 --2- 172.21.15.62:0/410828175 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f88d00536a0 0x7f88d0055b60 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:26.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.861+0000 7f88ebfff700 1 --2- 172.21.15.62:0/410828175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec143060 0x7f88ec13d250 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:26.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.861+0000 7f88ebfff700 1 --2- 172.21.15.62:0/410828175 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f88ec0b5c80 0x7f88ec13cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:26.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.861+0000 7f88ebfff700 1 --2- 172.21.15.62:0/410828175 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f88ec0afcf0 0x7f88ec146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:26.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.861+0000 7f88ebfff700 1 -- 172.21.15.62:0/410828175 >> 172.21.15.62:0/410828175 conn(0x7f88ec05c750 msgr2=0x7f88ec0b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:26.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.861+0000 7f88ebfff700 1 -- 172.21.15.62:0/410828175 shutdown_connections 2021-12-17T18:27:26.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.861+0000 7f88ebfff700 1 -- 172.21.15.62:0/410828175 wait complete. 2021-12-17T18:27:26.877 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:27:17.568635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:27:18.849290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:27:26.878 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:27:26.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d71dd6700 1 Processor -- start 2021-12-17T18:27:26.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d71dd6700 1 -- start start 2021-12-17T18:27:26.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d71dd6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d6c0b05b0 0x7f1d6c146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:26.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d71dd6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d6c0b5dd0 0x7f1d6c146b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:26.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d71dd6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d6c0b2010 con 0x7f1d6c147070 2021-12-17T18:27:26.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d71dd6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6c0b0990 con 0x7f1d6c0b05b0 2021-12-17T18:27:26.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d71dd6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c0b2240 con 0x7f1d6c0b5dd0 2021-12-17T18:27:26.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d6b7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d6c0b05b0 0x7f1d6c146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:26.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d6b7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d6c0b05b0 0x7f1d6c146690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56088/0 (socket says 172.21.15.62:56088) 2021-12-17T18:27:26.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d6b7fe700 1 -- 172.21.15.62:0/3669246564 learned_addr learned my addr 172.21.15.62:0/3669246564 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:26.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d6affd700 1 --2- 172.21.15.62:0/3669246564 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d6c0b5dd0 0x7f1d6c146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:26.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d6b7fe700 1 -- 172.21.15.62:0/3669246564 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d6c0b5dd0 msgr2=0x7f1d6c146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:26.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d6b7fe700 1 --2- 172.21.15.62:0/3669246564 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d6c0b5dd0 0x7f1d6c146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:26.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d6b7fe700 1 -- 172.21.15.62:0/3669246564 >> v1:172.21.15.62:6789/0 conn(0x7f1d6c147070 legacy=0x7f1d6c05f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:26.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d6b7fe700 1 -- 172.21.15.62:0/3669246564 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c0b24e0 con 0x7f1d6c0b05b0 2021-12-17T18:27:26.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d6b7fe700 1 --2- 172.21.15.62:0/3669246564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d6c0b05b0 0x7f1d6c146690 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f1d60002f70 tx=0x7f1d60006eb0).ready entity=mon.0 client_cookie=c532c23d7a14f90b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:26.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d6a7fc700 1 -- 172.21.15.62:0/3669246564 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d6000d5c0 con 0x7f1d6c0b05b0 2021-12-17T18:27:26.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d6a7fc700 1 -- 172.21.15.62:0/3669246564 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d60000e90 con 0x7f1d6c0b05b0 2021-12-17T18:27:26.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d6a7fc700 1 -- 172.21.15.62:0/3669246564 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d6000d950 con 0x7f1d6c0b05b0 2021-12-17T18:27:26.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d71dd6700 1 -- 172.21.15.62:0/3669246564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d6c0b05b0 msgr2=0x7f1d6c146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:26.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d71dd6700 1 --2- 172.21.15.62:0/3669246564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d6c0b05b0 0x7f1d6c146690 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f1d60002f70 tx=0x7f1d60006eb0).stop 2021-12-17T18:27:26.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d71dd6700 1 -- 172.21.15.62:0/3669246564 shutdown_connections 2021-12-17T18:27:26.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d71dd6700 1 --2- 172.21.15.62:0/3669246564 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d6c0b5dd0 0x7f1d6c146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:26.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d71dd6700 1 --2- 172.21.15.62:0/3669246564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d6c0b05b0 0x7f1d6c146690 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:26.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d71dd6700 1 -- 172.21.15.62:0/3669246564 >> 172.21.15.62:0/3669246564 conn(0x7f1d6c062510 msgr2=0x7f1d6c0628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:26.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d71dd6700 1 -- 172.21.15.62:0/3669246564 shutdown_connections 2021-12-17T18:27:26.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.981+0000 7f1d71dd6700 1 -- 172.21.15.62:0/3669246564 wait complete. 2021-12-17T18:27:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d71dd6700 1 Processor -- start 2021-12-17T18:27:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d71dd6700 1 -- start start 2021-12-17T18:27:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d71dd6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d6c0b05b0 0x7f1d6c064740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d71dd6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d6c0b5dd0 0x7f1d6c0aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d71dd6700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1d6c0670b0 0x7f1d6c0af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d71dd6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c065c40 con 0x7f1d6c0b05b0 2021-12-17T18:27:27.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d71dd6700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c0659a0 con 0x7f1d6c0670b0 2021-12-17T18:27:27.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d71dd6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c063ac0 con 0x7f1d6c0b5dd0 2021-12-17T18:27:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d6b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d6c0b05b0 0x7f1d6c064740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d6b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d6c0b05b0 0x7f1d6c064740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56092/0 (socket says 172.21.15.62:56092) 2021-12-17T18:27:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d6b7fe700 1 -- 172.21.15.62:0/1488266227 learned_addr learned my addr 172.21.15.62:0/1488266227 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:27.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d6bfff700 1 --2- 172.21.15.62:0/1488266227 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1d6c0670b0 0x7f1d6c0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d6affd700 1 --2- 172.21.15.62:0/1488266227 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d6c0b5dd0 0x7f1d6c0aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d6b7fe700 1 -- 172.21.15.62:0/1488266227 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d6c0b5dd0 msgr2=0x7f1d6c0aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d6b7fe700 1 --2- 172.21.15.62:0/1488266227 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d6c0b5dd0 0x7f1d6c0aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d6b7fe700 1 -- 172.21.15.62:0/1488266227 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1d6c0670b0 msgr2=0x7f1d6c0af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d6b7fe700 1 --2- 172.21.15.62:0/1488266227 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1d6c0670b0 0x7f1d6c0af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d6b7fe700 1 -- 172.21.15.62:0/1488266227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6000b1e0 con 0x7f1d6c0b05b0 2021-12-17T18:27:27.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d6b7fe700 1 --2- 172.21.15.62:0/1488266227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d6c0b05b0 0x7f1d6c064740 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f1d60002f70 tx=0x7f1d60015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:27.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d68ff9700 1 -- 172.21.15.62:0/1488266227 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d60011950 con 0x7f1d6c0b05b0 2021-12-17T18:27:27.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d68ff9700 1 -- 172.21.15.62:0/1488266227 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d60011ab0 con 0x7f1d6c0b05b0 2021-12-17T18:27:27.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d71dd6700 1 -- 172.21.15.62:0/1488266227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d6c153570 con 0x7f1d6c0b05b0 2021-12-17T18:27:27.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d68ff9700 1 -- 172.21.15.62:0/1488266227 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d60011e10 con 0x7f1d6c0b05b0 2021-12-17T18:27:27.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.985+0000 7f1d71dd6700 1 -- 172.21.15.62:0/1488266227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6c063620 con 0x7f1d6c0b05b0 2021-12-17T18:27:27.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.989+0000 7f1d71dd6700 1 -- 172.21.15.62:0/1488266227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6c063c80 con 0x7f1d6c0b05b0 2021-12-17T18:27:27.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.989+0000 7f1d68ff9700 1 -- 172.21.15.62:0/1488266227 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1d60025030 con 0x7f1d6c0b05b0 2021-12-17T18:27:27.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.989+0000 7f1d68ff9700 1 --2- 172.21.15.62:0/1488266227 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1d4c053640 0x7f1d4c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.989+0000 7f1d68ff9700 1 -- 172.21.15.62:0/1488266227 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1d6006cc00 con 0x7f1d6c0b05b0 2021-12-17T18:27:27.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.989+0000 7f1d6affd700 1 --2- 172.21.15.62:0/1488266227 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1d4c053640 0x7f1d4c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.989+0000 7f1d6affd700 1 --2- 172.21.15.62:0/1488266227 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1d4c053640 0x7f1d4c055b00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f1d5c00c000 tx=0x7f1d5c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:27.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:26.997+0000 7f1d68ff9700 1 -- 172.21.15.62:0/1488266227 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1d60072020 con 0x7f1d6c0b05b0 2021-12-17T18:27:27.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.121+0000 7f1d71dd6700 1 -- 172.21.15.62:0/1488266227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1d6c0b2780 con 0x7f1d6c0b05b0 2021-12-17T18:27:27.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.125+0000 7f1d68ff9700 1 -- 172.21.15.62:0/1488266227 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v132) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1d60043d60 con 0x7f1d6c0b05b0 2021-12-17T18:27:27.129 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:27:27.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.125+0000 7f1d71dd6700 1 -- 172.21.15.62:0/1488266227 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1d4c053640 msgr2=0x7f1d4c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.125+0000 7f1d71dd6700 1 --2- 172.21.15.62:0/1488266227 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1d4c053640 0x7f1d4c055b00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f1d5c00c000 tx=0x7f1d5c008040).stop 2021-12-17T18:27:27.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.125+0000 7f1d71dd6700 1 -- 172.21.15.62:0/1488266227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d6c0b05b0 msgr2=0x7f1d6c064740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.125+0000 7f1d71dd6700 1 --2- 172.21.15.62:0/1488266227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d6c0b05b0 0x7f1d6c064740 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f1d60002f70 tx=0x7f1d60015000).stop 2021-12-17T18:27:27.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.125+0000 7f1d71dd6700 1 -- 172.21.15.62:0/1488266227 shutdown_connections 2021-12-17T18:27:27.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.125+0000 7f1d71dd6700 1 --2- 172.21.15.62:0/1488266227 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1d4c053640 0x7f1d4c055b00 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.125+0000 7f1d71dd6700 1 --2- 172.21.15.62:0/1488266227 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1d6c0670b0 0x7f1d6c0af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.125+0000 7f1d71dd6700 1 --2- 172.21.15.62:0/1488266227 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d6c0b5dd0 0x7f1d6c0aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.125+0000 7f1d71dd6700 1 --2- 172.21.15.62:0/1488266227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d6c0b05b0 0x7f1d6c064740 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.125+0000 7f1d71dd6700 1 -- 172.21.15.62:0/1488266227 >> 172.21.15.62:0/1488266227 conn(0x7f1d6c062510 msgr2=0x7f1d6c0b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:27.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.125+0000 7f1d71dd6700 1 -- 172.21.15.62:0/1488266227 shutdown_connections 2021-12-17T18:27:27.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.125+0000 7f1d71dd6700 1 -- 172.21.15.62:0/1488266227 wait complete. 2021-12-17T18:27:27.142 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:27:27.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c7cd59700 1 Processor -- start 2021-12-17T18:27:27.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c7cd59700 1 -- start start 2021-12-17T18:27:27.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c7cd59700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8c780adad0 0x7f8c7813fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c7cd59700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c780b01e0 con 0x7f8c780b0440 2021-12-17T18:27:27.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c7cd59700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c780b1760 con 0x7f8c780b2330 2021-12-17T18:27:27.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c7cd59700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c780b2e20 con 0x7f8c780adad0 2021-12-17T18:27:27.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c6dd9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8c780b0440 0x7f8c78139960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39682/0 (socket says 172.21.15.62:39682) 2021-12-17T18:27:27.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c76d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8c780adad0 0x7f8c7813fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c6dd9b700 1 -- 172.21.15.62:0/2612369843 learned_addr learned my addr 172.21.15.62:0/2612369843 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:27.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c75d9b700 1 -- 172.21.15.62:0/2612369843 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056519094 0 0) 0x7f8c780b01e0 con 0x7f8c780b0440 2021-12-17T18:27:27.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c75d9b700 1 -- 172.21.15.62:0/2612369843 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c58003260 con 0x7f8c780b0440 2021-12-17T18:27:27.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c75d9b700 1 -- 172.21.15.62:0/2612369843 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270061495 0 0) 0x7f8c780b1760 con 0x7f8c780b2330 2021-12-17T18:27:27.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c76d9d700 1 -- 172.21.15.62:0/2612369843 >> v1:172.21.15.109:6789/0 conn(0x7f8c780b2330 legacy=0x7f8c780b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c76d9d700 1 -- 172.21.15.62:0/2612369843 >> v1:172.21.15.62:6789/0 conn(0x7f8c780b0440 legacy=0x7f8c78139960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c76d9d700 1 -- 172.21.15.62:0/2612369843 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780b1a00 con 0x7f8c780adad0 2021-12-17T18:27:27.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c76d9d700 1 --2- 172.21.15.62:0/2612369843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c780adad0 0x7f8c7813fc20 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f8c700032f0 tx=0x7f8c700091d0).ready entity=mon.0 client_cookie=a4e6f7acdb8393b3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:27.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c75d9b700 1 -- 172.21.15.62:0/2612369843 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c7000b6c0 con 0x7f8c780adad0 2021-12-17T18:27:27.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c75d9b700 1 -- 172.21.15.62:0/2612369843 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7000b820 con 0x7f8c780adad0 2021-12-17T18:27:27.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.253+0000 7f8c75d9b700 1 -- 172.21.15.62:0/2612369843 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c7000b990 con 0x7f8c780adad0 2021-12-17T18:27:27.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7cd59700 1 -- 172.21.15.62:0/2612369843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c780adad0 msgr2=0x7f8c7813fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7cd59700 1 --2- 172.21.15.62:0/2612369843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c780adad0 0x7f8c7813fc20 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f8c700032f0 tx=0x7f8c700091d0).stop 2021-12-17T18:27:27.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7cd59700 1 -- 172.21.15.62:0/2612369843 shutdown_connections 2021-12-17T18:27:27.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7cd59700 1 --2- 172.21.15.62:0/2612369843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c780adad0 0x7f8c7813fc20 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7cd59700 1 -- 172.21.15.62:0/2612369843 >> 172.21.15.62:0/2612369843 conn(0x7f8c780b64d0 msgr2=0x7f8c780b68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:27.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7cd59700 1 -- 172.21.15.62:0/2612369843 shutdown_connections 2021-12-17T18:27:27.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7cd59700 1 -- 172.21.15.62:0/2612369843 wait complete. 2021-12-17T18:27:27.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7cd59700 1 Processor -- start 2021-12-17T18:27:27.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7cd59700 1 -- start start 2021-12-17T18:27:27.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7cd59700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c780adad0 0x7f8c78061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7cd59700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c780b0440 0x7f8c78152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7cd59700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c780b2330 0x7f8c78155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7cd59700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c781533f0 con 0x7f8c780adad0 2021-12-17T18:27:27.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7cd59700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7813aff0 con 0x7f8c780b2330 2021-12-17T18:27:27.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7cd59700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c78155b40 con 0x7f8c780b0440 2021-12-17T18:27:27.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c780adad0 0x7f8c78061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c780adad0 0x7f8c78061be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56108/0 (socket says 172.21.15.62:56108) 2021-12-17T18:27:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.257+0000 7f8c7659c700 1 -- 172.21.15.62:0/1338668533 learned_addr learned my addr 172.21.15.62:0/1338668533 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.261+0000 7f8c6dd9b700 1 --2- 172.21.15.62:0/1338668533 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c780b0440 0x7f8c78152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.261+0000 7f8c76d9d700 1 --2- 172.21.15.62:0/1338668533 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c780b2330 0x7f8c78155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.261+0000 7f8c7659c700 1 -- 172.21.15.62:0/1338668533 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c780b0440 msgr2=0x7f8c78152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.261+0000 7f8c7659c700 1 --2- 172.21.15.62:0/1338668533 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c780b0440 0x7f8c78152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.261+0000 7f8c7659c700 1 -- 172.21.15.62:0/1338668533 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c780b2330 msgr2=0x7f8c78155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.261+0000 7f8c7659c700 1 --2- 172.21.15.62:0/1338668533 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c780b2330 0x7f8c78155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.261+0000 7f8c7659c700 1 -- 172.21.15.62:0/1338668533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c70009470 con 0x7f8c780adad0 2021-12-17T18:27:27.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.261+0000 7f8c7659c700 1 --2- 172.21.15.62:0/1338668533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c780adad0 0x7f8c78061be0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f8c68000bc0 tx=0x7f8c68007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.261+0000 7f8c6ffff700 1 -- 172.21.15.62:0/1338668533 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c68001d70 con 0x7f8c780adad0 2021-12-17T18:27:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.261+0000 7f8c6ffff700 1 -- 172.21.15.62:0/1338668533 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c68007030 con 0x7f8c780adad0 2021-12-17T18:27:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.261+0000 7f8c7cd59700 1 -- 172.21.15.62:0/1338668533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c781528f0 con 0x7f8c780adad0 2021-12-17T18:27:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.261+0000 7f8c6ffff700 1 -- 172.21.15.62:0/1338668533 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c68007390 con 0x7f8c780adad0 2021-12-17T18:27:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.261+0000 7f8c7cd59700 1 -- 172.21.15.62:0/1338668533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7813a6b0 con 0x7f8c780adad0 2021-12-17T18:27:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.261+0000 7f8c7cd59700 1 -- 172.21.15.62:0/1338668533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7813ae10 con 0x7f8c780adad0 2021-12-17T18:27:27.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.261+0000 7f8c6ffff700 1 -- 172.21.15.62:0/1338668533 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8c68010030 con 0x7f8c780adad0 2021-12-17T18:27:27.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.261+0000 7f8c6ffff700 1 --2- 172.21.15.62:0/1338668533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c5c053640 0x7f8c5c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.265+0000 7f8c6ffff700 1 -- 172.21.15.62:0/1338668533 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8c6806b3e0 con 0x7f8c780adad0 2021-12-17T18:27:27.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.265+0000 7f8c6dd9b700 1 --2- 172.21.15.62:0/1338668533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c5c053640 0x7f8c5c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.265+0000 7f8c6dd9b700 1 --2- 172.21.15.62:0/1338668533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c5c053640 0x7f8c5c055b00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f8c6000d000 tx=0x7f8c60009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:27.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.273+0000 7f8c6ffff700 1 -- 172.21.15.62:0/1338668533 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8c68042540 con 0x7f8c780adad0 2021-12-17T18:27:27.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.401+0000 7f8c7cd59700 1 -- 172.21.15.62:0/1338668533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8c7813b1b0 con 0x7f8c780adad0 2021-12-17T18:27:27.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.401+0000 7f8c6ffff700 1 -- 172.21.15.62:0/1338668533 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v132) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8c68045b60 con 0x7f8c780adad0 2021-12-17T18:27:27.407 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:27:27.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.401+0000 7f8c7cd59700 1 -- 172.21.15.62:0/1338668533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c5c053640 msgr2=0x7f8c5c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.401+0000 7f8c7cd59700 1 --2- 172.21.15.62:0/1338668533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c5c053640 0x7f8c5c055b00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f8c6000d000 tx=0x7f8c60009040).stop 2021-12-17T18:27:27.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.405+0000 7f8c7cd59700 1 -- 172.21.15.62:0/1338668533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c780adad0 msgr2=0x7f8c78061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.405+0000 7f8c7cd59700 1 --2- 172.21.15.62:0/1338668533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c780adad0 0x7f8c78061be0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f8c68000bc0 tx=0x7f8c68007c30).stop 2021-12-17T18:27:27.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.405+0000 7f8c7cd59700 1 -- 172.21.15.62:0/1338668533 shutdown_connections 2021-12-17T18:27:27.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.405+0000 7f8c7cd59700 1 --2- 172.21.15.62:0/1338668533 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8c5c053640 0x7f8c5c055b00 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.405+0000 7f8c7cd59700 1 --2- 172.21.15.62:0/1338668533 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8c780b2330 0x7f8c78155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.405+0000 7f8c7cd59700 1 --2- 172.21.15.62:0/1338668533 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8c780b0440 0x7f8c78152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.405+0000 7f8c7cd59700 1 --2- 172.21.15.62:0/1338668533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c780adad0 0x7f8c78061be0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.405+0000 7f8c7cd59700 1 -- 172.21.15.62:0/1338668533 >> 172.21.15.62:0/1338668533 conn(0x7f8c780b64d0 msgr2=0x7f8c780b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:27.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.405+0000 7f8c7cd59700 1 -- 172.21.15.62:0/1338668533 shutdown_connections 2021-12-17T18:27:27.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.405+0000 7f8c7cd59700 1 -- 172.21.15.62:0/1338668533 wait complete. 2021-12-17T18:27:27.420 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:27:27.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.521+0000 7fe58f326700 1 Processor -- start 2021-12-17T18:27:27.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.521+0000 7fe58f326700 1 -- start start 2021-12-17T18:27:27.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.521+0000 7fe58f326700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe5880b47c0 0x7fe5880b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.521+0000 7fe58f326700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe5880b5be0 0x7fe588143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.521+0000 7fe58f326700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5880b0870 con 0x7fe58805ca90 2021-12-17T18:27:27.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.521+0000 7fe58f326700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58805ce70 con 0x7fe5880b5be0 2021-12-17T18:27:27.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.521+0000 7fe58f326700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5880b05d0 con 0x7fe5880b47c0 2021-12-17T18:27:27.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.521+0000 7fe58eb25700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe5880b5be0 0x7fe588143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.521+0000 7fe58e324700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe58805ca90 0x7fe5880b1d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39694/0 (socket says 172.21.15.62:39694) 2021-12-17T18:27:27.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.521+0000 7fe58e324700 1 -- 172.21.15.62:0/3201813737 learned_addr learned my addr 172.21.15.62:0/3201813737 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:27.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.521+0000 7fe58db23700 1 --2- 172.21.15.62:0/3201813737 >> v2:172.21.15.109:3300/0 conn(0x7fe5880b47c0 0x7fe5880b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.521+0000 7fe58eb25700 1 -- 172.21.15.62:0/3201813737 >> v2:172.21.15.109:3300/0 conn(0x7fe5880b47c0 msgr2=0x7fe5880b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:27.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.521+0000 7fe58eb25700 1 --2- 172.21.15.62:0/3201813737 >> v2:172.21.15.109:3300/0 conn(0x7fe5880b47c0 0x7fe5880b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.521+0000 7fe58eb25700 1 -- 172.21.15.62:0/3201813737 >> v1:172.21.15.62:6789/0 conn(0x7fe58805ca90 legacy=0x7fe5880b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.521+0000 7fe58eb25700 1 -- 172.21.15.62:0/3201813737 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5880b5250 con 0x7fe5880b5be0 2021-12-17T18:27:27.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.521+0000 7fe58d322700 1 -- 172.21.15.62:0/3201813737 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940231196 0 0) 0x7fe5880b0870 con 0x7fe58805ca90 2021-12-17T18:27:27.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.525+0000 7fe58eb25700 1 --2- 172.21.15.62:0/3201813737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5880b5be0 0x7fe588143ba0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7fe5800032f0 tx=0x7fe5800091d0).ready entity=mon.0 client_cookie=35c15787f9ae9fc0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:27.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.525+0000 7fe58d322700 1 -- 172.21.15.62:0/3201813737 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe58000b680 con 0x7fe5880b5be0 2021-12-17T18:27:27.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.525+0000 7fe58d322700 1 -- 172.21.15.62:0/3201813737 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58000b7e0 con 0x7fe5880b5be0 2021-12-17T18:27:27.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.525+0000 7fe58d322700 1 -- 172.21.15.62:0/3201813737 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe58000b950 con 0x7fe5880b5be0 2021-12-17T18:27:27.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.525+0000 7fe58f326700 1 -- 172.21.15.62:0/3201813737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5880b5be0 msgr2=0x7fe588143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.525+0000 7fe58f326700 1 --2- 172.21.15.62:0/3201813737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5880b5be0 0x7fe588143ba0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7fe5800032f0 tx=0x7fe5800091d0).stop 2021-12-17T18:27:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.525+0000 7fe58f326700 1 -- 172.21.15.62:0/3201813737 shutdown_connections 2021-12-17T18:27:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.525+0000 7fe58f326700 1 --2- 172.21.15.62:0/3201813737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5880b5be0 0x7fe588143ba0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.525+0000 7fe58f326700 1 --2- 172.21.15.62:0/3201813737 >> v2:172.21.15.109:3300/0 conn(0x7fe5880b47c0 0x7fe5880b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.525+0000 7fe58f326700 1 -- 172.21.15.62:0/3201813737 >> 172.21.15.62:0/3201813737 conn(0x7fe58805bcd0 msgr2=0x7fe588062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:27.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.525+0000 7fe58f326700 1 -- 172.21.15.62:0/3201813737 shutdown_connections 2021-12-17T18:27:27.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.525+0000 7fe58f326700 1 -- 172.21.15.62:0/3201813737 wait complete. 2021-12-17T18:27:27.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.525+0000 7fe58f326700 1 Processor -- start 2021-12-17T18:27:27.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.525+0000 7fe58f326700 1 -- start start 2021-12-17T18:27:27.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58f326700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe58805ca90 0x7fe588147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58f326700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe5880b47c0 0x7fe5880a3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58f326700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5880b5be0 0x7fe588152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58f326700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe588064d10 con 0x7fe5880b5be0 2021-12-17T18:27:27.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58f326700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880a3740 con 0x7fe58805ca90 2021-12-17T18:27:27.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58f326700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880a39e0 con 0x7fe5880b47c0 2021-12-17T18:27:27.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58eb25700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5880b5be0 0x7fe588152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58eb25700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5880b5be0 0x7fe588152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56124/0 (socket says 172.21.15.62:56124) 2021-12-17T18:27:27.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58eb25700 1 -- 172.21.15.62:0/139868031 learned_addr learned my addr 172.21.15.62:0/139868031 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:27.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58e324700 1 --2- 172.21.15.62:0/139868031 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe58805ca90 0x7fe588147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58db23700 1 --2- 172.21.15.62:0/139868031 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe5880b47c0 0x7fe5880a3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58eb25700 1 -- 172.21.15.62:0/139868031 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe5880b47c0 msgr2=0x7fe5880a3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58eb25700 1 --2- 172.21.15.62:0/139868031 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe5880b47c0 0x7fe5880a3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58eb25700 1 -- 172.21.15.62:0/139868031 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe58805ca90 msgr2=0x7fe588147df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58eb25700 1 --2- 172.21.15.62:0/139868031 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe58805ca90 0x7fe588147df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58eb25700 1 -- 172.21.15.62:0/139868031 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe580009470 con 0x7fe5880b5be0 2021-12-17T18:27:27.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58eb25700 1 --2- 172.21.15.62:0/139868031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5880b5be0 0x7fe588152530 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7fe5800032f0 tx=0x7fe580016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:27.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe5777fe700 1 -- 172.21.15.62:0/139868031 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe58000b950 con 0x7fe5880b5be0 2021-12-17T18:27:27.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe5777fe700 1 -- 172.21.15.62:0/139868031 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe580021630 con 0x7fe5880b5be0 2021-12-17T18:27:27.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58f326700 1 -- 172.21.15.62:0/139868031 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5880a4370 con 0x7fe5880b5be0 2021-12-17T18:27:27.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe5777fe700 1 -- 172.21.15.62:0/139868031 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe58000b680 con 0x7fe5880b5be0 2021-12-17T18:27:27.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.529+0000 7fe58f326700 1 -- 172.21.15.62:0/139868031 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe588066070 con 0x7fe5880b5be0 2021-12-17T18:27:27.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.533+0000 7fe5777fe700 1 -- 172.21.15.62:0/139868031 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe580027020 con 0x7fe5880b5be0 2021-12-17T18:27:27.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.533+0000 7fe58f326700 1 -- 172.21.15.62:0/139868031 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5880a3ba0 con 0x7fe5880b5be0 2021-12-17T18:27:27.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.533+0000 7fe5777fe700 1 --2- 172.21.15.62:0/139868031 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5680536a0 0x7fe568055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.533+0000 7fe5777fe700 1 -- 172.21.15.62:0/139868031 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe58006cda0 con 0x7fe5880b5be0 2021-12-17T18:27:27.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.533+0000 7fe58e324700 1 --2- 172.21.15.62:0/139868031 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5680536a0 0x7fe568055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.533+0000 7fe58e324700 1 --2- 172.21.15.62:0/139868031 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5680536a0 0x7fe568055b60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fe58400d000 tx=0x7fe5840011a0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:27.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.541+0000 7fe5777fe700 1 -- 172.21.15.62:0/139868031 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe580043df0 con 0x7fe5880b5be0 2021-12-17T18:27:27.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.665+0000 7fe58f326700 1 -- 172.21.15.62:0/139868031 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe5880b3980 con 0x7fe5880b5be0 2021-12-17T18:27:27.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.665+0000 7fe5777fe700 1 -- 172.21.15.62:0/139868031 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v132) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe580047410 con 0x7fe5880b5be0 2021-12-17T18:27:27.673 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:27:27.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.669+0000 7fe58f326700 1 -- 172.21.15.62:0/139868031 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5680536a0 msgr2=0x7fe568055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.675 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.669+0000 7fe58f326700 1 --2- 172.21.15.62:0/139868031 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5680536a0 0x7fe568055b60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fe58400d000 tx=0x7fe5840011a0).stop 2021-12-17T18:27:27.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.669+0000 7fe58f326700 1 -- 172.21.15.62:0/139868031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5880b5be0 msgr2=0x7fe588152530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.669+0000 7fe58f326700 1 --2- 172.21.15.62:0/139868031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5880b5be0 0x7fe588152530 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7fe5800032f0 tx=0x7fe580016000).stop 2021-12-17T18:27:27.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.669+0000 7fe58f326700 1 -- 172.21.15.62:0/139868031 shutdown_connections 2021-12-17T18:27:27.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.669+0000 7fe58f326700 1 --2- 172.21.15.62:0/139868031 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe5680536a0 0x7fe568055b60 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.669+0000 7fe58f326700 1 --2- 172.21.15.62:0/139868031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5880b5be0 0x7fe588152530 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.669+0000 7fe58f326700 1 --2- 172.21.15.62:0/139868031 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe5880b47c0 0x7fe5880a3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.669+0000 7fe58f326700 1 --2- 172.21.15.62:0/139868031 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe58805ca90 0x7fe588147df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.669+0000 7fe58f326700 1 -- 172.21.15.62:0/139868031 >> 172.21.15.62:0/139868031 conn(0x7fe58805bcd0 msgr2=0x7fe58805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:27.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.669+0000 7fe58f326700 1 -- 172.21.15.62:0/139868031 shutdown_connections 2021-12-17T18:27:27.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.669+0000 7fe58f326700 1 -- 172.21.15.62:0/139868031 wait complete. 2021-12-17T18:27:27.686 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:27:27.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92df112700 1 Processor -- start 2021-12-17T18:27:27.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92df112700 1 -- start start 2021-12-17T18:27:27.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92df112700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92d805c8f0 0x7f92d80b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92df112700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f92d80af3a0 0x7f92d8141180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92df112700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d805f9d0 con 0x7f92d8141670 2021-12-17T18:27:27.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92df112700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d80abe60 con 0x7f92d80af3a0 2021-12-17T18:27:27.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92df112700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d805ff60 con 0x7f92d805c8f0 2021-12-17T18:27:27.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92dd90f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f92d80af3a0 0x7f92d8141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92de110700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92d805c8f0 0x7f92d80b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92dd90f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f92d80af3a0 0x7f92d8141180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:34446/0 (socket says 172.21.15.62:34446) 2021-12-17T18:27:27.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92de911700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f92d8141670 0x7f92d80b1c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:56032/0 (socket says 172.21.15.62:56032) 2021-12-17T18:27:27.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92dd90f700 1 -- 172.21.15.62:0/1431754850 learned_addr learned my addr 172.21.15.62:0/1431754850 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:27.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92dd10e700 1 -- 172.21.15.62:0/1431754850 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819091152 0 0) 0x7f92d805f9d0 con 0x7f92d8141670 2021-12-17T18:27:27.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92dd10e700 1 -- 172.21.15.62:0/1431754850 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92c0003260 con 0x7f92d8141670 2021-12-17T18:27:27.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92de110700 1 -- 172.21.15.62:0/1431754850 >> v2:172.21.15.109:3300/0 conn(0x7f92d80af3a0 msgr2=0x7f92d8141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:27.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92de110700 1 --2- 172.21.15.62:0/1431754850 >> v2:172.21.15.109:3300/0 conn(0x7f92d80af3a0 0x7f92d8141180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92de110700 1 -- 172.21.15.62:0/1431754850 >> v1:172.21.15.109:6789/0 conn(0x7f92d8141670 legacy=0x7f92d80b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92de110700 1 -- 172.21.15.62:0/1431754850 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d805ccd0 con 0x7f92d805c8f0 2021-12-17T18:27:27.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92de110700 1 --2- 172.21.15.62:0/1431754850 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92d805c8f0 0x7f92d80b0620 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f92cc002f70 tx=0x7f92cc006df0).ready entity=mon.2 client_cookie=7dec7dfb6ad5e69c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:27.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92dd10e700 1 -- 172.21.15.62:0/1431754850 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92cc00d4a0 con 0x7f92d805c8f0 2021-12-17T18:27:27.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92dd10e700 1 -- 172.21.15.62:0/1431754850 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92cc000e90 con 0x7f92d805c8f0 2021-12-17T18:27:27.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.801+0000 7f92dd10e700 1 -- 172.21.15.62:0/1431754850 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92cc00d7f0 con 0x7f92d805c8f0 2021-12-17T18:27:27.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92df112700 1 -- 172.21.15.62:0/1431754850 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92d805c8f0 msgr2=0x7f92d80b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92df112700 1 --2- 172.21.15.62:0/1431754850 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92d805c8f0 0x7f92d80b0620 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f92cc002f70 tx=0x7f92cc006df0).stop 2021-12-17T18:27:27.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92df112700 1 -- 172.21.15.62:0/1431754850 shutdown_connections 2021-12-17T18:27:27.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92df112700 1 --2- 172.21.15.62:0/1431754850 >> v2:172.21.15.109:3300/0 conn(0x7f92d80af3a0 0x7f92d8141180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92df112700 1 --2- 172.21.15.62:0/1431754850 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92d805c8f0 0x7f92d80b0620 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92df112700 1 -- 172.21.15.62:0/1431754850 >> 172.21.15.62:0/1431754850 conn(0x7f92d805be70 msgr2=0x7f92d8062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:27.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92df112700 1 -- 172.21.15.62:0/1431754850 shutdown_connections 2021-12-17T18:27:27.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92df112700 1 -- 172.21.15.62:0/1431754850 wait complete. 2021-12-17T18:27:27.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92df112700 1 Processor -- start 2021-12-17T18:27:27.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92df112700 1 -- start start 2021-12-17T18:27:27.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92df112700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92d805c8f0 0x7f92d8065450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92df112700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f92d80af3a0 0x7f92d8143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92df112700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92d8141670 0x7f92d813fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92df112700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d8064d10 con 0x7f92d805c8f0 2021-12-17T18:27:27.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92df112700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d8064fb0 con 0x7f92d80af3a0 2021-12-17T18:27:27.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92df112700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d8064a40 con 0x7f92d8141670 2021-12-17T18:27:27.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92de110700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92d805c8f0 0x7f92d8065450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92de110700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92d805c8f0 0x7f92d8065450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56136/0 (socket says 172.21.15.62:56136) 2021-12-17T18:27:27.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92de110700 1 -- 172.21.15.62:0/391912006 learned_addr learned my addr 172.21.15.62:0/391912006 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:27.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92dd90f700 1 --2- 172.21.15.62:0/391912006 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f92d80af3a0 0x7f92d8143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.805+0000 7f92de911700 1 --2- 172.21.15.62:0/391912006 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92d8141670 0x7f92d813fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.809+0000 7f92de110700 1 -- 172.21.15.62:0/391912006 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92d8141670 msgr2=0x7f92d813fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.809+0000 7f92de110700 1 --2- 172.21.15.62:0/391912006 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92d8141670 0x7f92d813fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.809+0000 7f92de110700 1 -- 172.21.15.62:0/391912006 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f92d80af3a0 msgr2=0x7f92d8143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.809+0000 7f92de110700 1 --2- 172.21.15.62:0/391912006 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f92d80af3a0 0x7f92d8143b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.809+0000 7f92de110700 1 -- 172.21.15.62:0/391912006 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc00b180 con 0x7f92d805c8f0 2021-12-17T18:27:27.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.809+0000 7f92de110700 1 --2- 172.21.15.62:0/391912006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92d805c8f0 0x7f92d8065450 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f92cc002f70 tx=0x7f92cc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:27.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.809+0000 7f92cb7fe700 1 -- 172.21.15.62:0/391912006 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92cc016070 con 0x7f92d805c8f0 2021-12-17T18:27:27.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.809+0000 7f92cb7fe700 1 -- 172.21.15.62:0/391912006 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92cc013800 con 0x7f92d805c8f0 2021-12-17T18:27:27.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.809+0000 7f92cb7fe700 1 -- 172.21.15.62:0/391912006 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92cc0067e0 con 0x7f92d805c8f0 2021-12-17T18:27:27.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.809+0000 7f92df112700 1 -- 172.21.15.62:0/391912006 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d8144020 con 0x7f92d805c8f0 2021-12-17T18:27:27.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.809+0000 7f92df112700 1 -- 172.21.15.62:0/391912006 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d8140a70 con 0x7f92d805c8f0 2021-12-17T18:27:27.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.809+0000 7f92df112700 1 -- 172.21.15.62:0/391912006 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d813fa90 con 0x7f92d805c8f0 2021-12-17T18:27:27.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.809+0000 7f92cb7fe700 1 -- 172.21.15.62:0/391912006 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f92cc025030 con 0x7f92d805c8f0 2021-12-17T18:27:27.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.809+0000 7f92cb7fe700 1 --2- 172.21.15.62:0/391912006 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f92b8053580 0x7f92b8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:27.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.813+0000 7f92cb7fe700 1 -- 172.21.15.62:0/391912006 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f92cc06c7a0 con 0x7f92d805c8f0 2021-12-17T18:27:27.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.813+0000 7f92dd90f700 1 --2- 172.21.15.62:0/391912006 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f92b8053580 0x7f92b8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:27.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.813+0000 7f92dd90f700 1 --2- 172.21.15.62:0/391912006 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f92b8053580 0x7f92b8055a40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f92d4008000 tx=0x7f92d4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:27.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.817+0000 7f92cb7fe700 1 -- 172.21.15.62:0/391912006 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f92cc043900 con 0x7f92d805c8f0 2021-12-17T18:27:27.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.941+0000 7f92df112700 1 -- 172.21.15.62:0/391912006 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f92d8065170 con 0x7f92d805c8f0 2021-12-17T18:27:27.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.941+0000 7f92cb7fe700 1 -- 172.21.15.62:0/391912006 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v132) v1 ==== 100+0+10 (secure 0 0 0) 0x7f92cc023020 con 0x7f92d805c8f0 2021-12-17T18:27:27.947 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:27:27.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.941+0000 7f92df112700 1 -- 172.21.15.62:0/391912006 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f92b8053580 msgr2=0x7f92b8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.941+0000 7f92df112700 1 --2- 172.21.15.62:0/391912006 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f92b8053580 0x7f92b8055a40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f92d4008000 tx=0x7f92d4008040).stop 2021-12-17T18:27:27.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.941+0000 7f92df112700 1 -- 172.21.15.62:0/391912006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92d805c8f0 msgr2=0x7f92d8065450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:27.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.941+0000 7f92df112700 1 --2- 172.21.15.62:0/391912006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92d805c8f0 0x7f92d8065450 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f92cc002f70 tx=0x7f92cc014000).stop 2021-12-17T18:27:27.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.945+0000 7f92df112700 1 -- 172.21.15.62:0/391912006 shutdown_connections 2021-12-17T18:27:27.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.945+0000 7f92df112700 1 --2- 172.21.15.62:0/391912006 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f92b8053580 0x7f92b8055a40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.945+0000 7f92df112700 1 --2- 172.21.15.62:0/391912006 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f92d8141670 0x7f92d813fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.945+0000 7f92df112700 1 --2- 172.21.15.62:0/391912006 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f92d80af3a0 0x7f92d8143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.945+0000 7f92df112700 1 --2- 172.21.15.62:0/391912006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92d805c8f0 0x7f92d8065450 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:27.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.945+0000 7f92df112700 1 -- 172.21.15.62:0/391912006 >> 172.21.15.62:0/391912006 conn(0x7f92d805be70 msgr2=0x7f92d813b670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:27.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.945+0000 7f92df112700 1 -- 172.21.15.62:0/391912006 shutdown_connections 2021-12-17T18:27:27.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:27.945+0000 7f92df112700 1 -- 172.21.15.62:0/391912006 wait complete. 2021-12-17T18:27:27.960 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:27:27.960 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:28.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.057+0000 7f1ddf587700 1 Processor -- start 2021-12-17T18:27:28.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.057+0000 7f1ddf587700 1 -- start start 2021-12-17T18:27:28.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.057+0000 7f1ddf587700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1dd80a8e10 0x7f1dd8147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:28.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.057+0000 7f1ddf587700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd80b6270 con 0x7f1dd80a71e0 2021-12-17T18:27:28.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.057+0000 7f1ddf587700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd8147610 con 0x7f1dd8141480 2021-12-17T18:27:28.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.057+0000 7f1ddf587700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd81478b0 con 0x7f1dd80a8e10 2021-12-17T18:27:28.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1dded86700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1dd80a71e0 0x7f1dd80a7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39726/0 (socket says 172.21.15.62:39726) 2021-12-17T18:27:28.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1dded86700 1 -- 172.21.15.62:0/959450627 learned_addr learned my addr 172.21.15.62:0/959450627 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:28.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1dddd84700 1 --2- 172.21.15.62:0/959450627 >> v2:172.21.15.109:3300/0 conn(0x7f1dd80a8e10 0x7f1dd8147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:28.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1ddd583700 1 -- 172.21.15.62:0/959450627 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809919733 0 0) 0x7f1dd80b6270 con 0x7f1dd80a71e0 2021-12-17T18:27:28.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1ddd583700 1 -- 172.21.15.62:0/959450627 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dc0003260 con 0x7f1dd80a71e0 2021-12-17T18:27:28.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1dddd84700 1 -- 172.21.15.62:0/959450627 >> v1:172.21.15.109:6789/0 conn(0x7f1dd8141480 legacy=0x7f1dd80b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:28.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1dddd84700 1 -- 172.21.15.62:0/959450627 >> v1:172.21.15.62:6789/0 conn(0x7f1dd80a71e0 legacy=0x7f1dd80a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:28.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1dddd84700 1 -- 172.21.15.62:0/959450627 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd8147b50 con 0x7f1dd80a8e10 2021-12-17T18:27:28.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1dddd84700 1 --2- 172.21.15.62:0/959450627 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1dd80a8e10 0x7f1dd8147ff0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f1dc8002f70 tx=0x7f1dc8006df0).ready entity=mon.1 client_cookie=87868755842635c6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:28.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1ddd583700 1 -- 172.21.15.62:0/959450627 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc800d610 con 0x7f1dd80a8e10 2021-12-17T18:27:28.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1ddd583700 1 -- 172.21.15.62:0/959450627 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc8000e90 con 0x7f1dd80a8e10 2021-12-17T18:27:28.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1ddd583700 1 -- 172.21.15.62:0/959450627 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc800d960 con 0x7f1dd80a8e10 2021-12-17T18:27:28.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1ddf587700 1 -- 172.21.15.62:0/959450627 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1dd80a8e10 msgr2=0x7f1dd8147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:28.081 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1ddf587700 1 --2- 172.21.15.62:0/959450627 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1dd80a8e10 0x7f1dd8147ff0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f1dc8002f70 tx=0x7f1dc8006df0).stop 2021-12-17T18:27:28.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1ddf587700 1 -- 172.21.15.62:0/959450627 shutdown_connections 2021-12-17T18:27:28.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1ddf587700 1 --2- 172.21.15.62:0/959450627 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1dd80a8e10 0x7f1dd8147ff0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:28.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1ddf587700 1 -- 172.21.15.62:0/959450627 >> 172.21.15.62:0/959450627 conn(0x7f1dd805d220 msgr2=0x7f1dd80b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:28.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1ddf587700 1 -- 172.21.15.62:0/959450627 shutdown_connections 2021-12-17T18:27:28.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1ddf587700 1 -- 172.21.15.62:0/959450627 wait complete. 2021-12-17T18:27:28.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1ddf587700 1 Processor -- start 2021-12-17T18:27:28.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.061+0000 7f1ddf587700 1 -- start start 2021-12-17T18:27:28.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1ddf587700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1dd80a71e0 0x7f1dd815aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:28.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1ddf587700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1dd80a8e10 0x7f1dd813dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:28.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1ddf587700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd8141480 0x7f1dd8156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:28.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1ddf587700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd813c450 con 0x7f1dd8141480 2021-12-17T18:27:28.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1ddf587700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd814b3d0 con 0x7f1dd80a8e10 2021-12-17T18:27:28.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1ddf587700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd80ac2a0 con 0x7f1dd80a71e0 2021-12-17T18:27:28.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1dded86700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd8141480 0x7f1dd8156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:28.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1dddd84700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1dd80a8e10 0x7f1dd813dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:28.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1dde585700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1dd80a71e0 0x7f1dd815aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:28.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1dddd84700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1dd80a8e10 0x7f1dd813dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:34468/0 (socket says 172.21.15.62:34468) 2021-12-17T18:27:28.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1dddd84700 1 -- 172.21.15.62:0/1215662868 learned_addr learned my addr 172.21.15.62:0/1215662868 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:28.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1dded86700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd8141480 0x7f1dd8156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56152/0 (socket says 172.21.15.62:56152) 2021-12-17T18:27:28.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1dddd84700 1 -- 172.21.15.62:0/1215662868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1dd80a71e0 msgr2=0x7f1dd815aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:28.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1dddd84700 1 --2- 172.21.15.62:0/1215662868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1dd80a71e0 0x7f1dd815aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:28.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1dddd84700 1 -- 172.21.15.62:0/1215662868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd8141480 msgr2=0x7f1dd8156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:28.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1dddd84700 1 --2- 172.21.15.62:0/1215662868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd8141480 0x7f1dd8156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:28.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1dddd84700 1 -- 172.21.15.62:0/1215662868 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc800b180 con 0x7f1dd80a8e10 2021-12-17T18:27:28.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1dddd84700 1 --2- 172.21.15.62:0/1215662868 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1dd80a8e10 0x7f1dd813dec0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f1dc8002f70 tx=0x7f1dc8014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:28.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1dc77fe700 1 -- 172.21.15.62:0/1215662868 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc8016070 con 0x7f1dd80a8e10 2021-12-17T18:27:28.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1dc77fe700 1 -- 172.21.15.62:0/1215662868 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc800de90 con 0x7f1dd80a8e10 2021-12-17T18:27:28.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1ddf587700 1 -- 172.21.15.62:0/1215662868 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd8144d60 con 0x7f1dd80a8e10 2021-12-17T18:27:28.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1dc77fe700 1 -- 172.21.15.62:0/1215662868 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc8013da0 con 0x7f1dd80a8e10 2021-12-17T18:27:28.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1ddf587700 1 -- 172.21.15.62:0/1215662868 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd80add40 con 0x7f1dd80a8e10 2021-12-17T18:27:28.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.065+0000 7f1ddf587700 1 -- 172.21.15.62:0/1215662868 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd8148400 con 0x7f1dd80a8e10 2021-12-17T18:27:28.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.069+0000 7f1dc77fe700 1 -- 172.21.15.62:0/1215662868 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1dc8025030 con 0x7f1dd80a8e10 2021-12-17T18:27:28.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.069+0000 7f1dc77fe700 1 --2- 172.21.15.62:0/1215662868 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1db8053580 0x7f1db8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:28.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.069+0000 7f1dc77fe700 1 -- 172.21.15.62:0/1215662868 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1dc806cf10 con 0x7f1dd80a8e10 2021-12-17T18:27:28.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.069+0000 7f1dde585700 1 --2- 172.21.15.62:0/1215662868 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1db8053580 0x7f1db8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:28.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.069+0000 7f1dde585700 1 --2- 172.21.15.62:0/1215662868 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1db8053580 0x7f1db8055a40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f1dd000d000 tx=0x7f1dd0007f10).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:28.100 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.077+0000 7f1dc77fe700 1 -- 172.21.15.62:0/1215662868 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1dc8044070 con 0x7f1dd80a8e10 2021-12-17T18:27:28.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.237+0000 7f1ddf587700 1 -- 172.21.15.62:0/1215662868 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dd80b1b90 con 0x7f1dd80a8e10 2021-12-17T18:27:28.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.237+0000 7f1dc77fe700 1 -- 172.21.15.62:0/1215662868 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f1dc8023070 con 0x7f1dd80a8e10 2021-12-17T18:27:28.244 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:28.245 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7957,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6833/3542826349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3542826349},{"type":"v1","addr":"172.21.15.62:6833","nonce":3542826349}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:27:19.830173+0000","modified":"2021-12-17T18:27:20.832915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/570760267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":570760267},{"type":"v1","addr":"172.21.15.109:6835","nonce":570760267}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-12-17T18:27:28.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.241+0000 7f1ddf587700 1 -- 172.21.15.62:0/1215662868 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1db8053580 msgr2=0x7f1db8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:28.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.241+0000 7f1ddf587700 1 --2- 172.21.15.62:0/1215662868 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1db8053580 0x7f1db8055a40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f1dd000d000 tx=0x7f1dd0007f10).stop 2021-12-17T18:27:28.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.241+0000 7f1ddf587700 1 -- 172.21.15.62:0/1215662868 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1dd80a8e10 msgr2=0x7f1dd813dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:28.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.241+0000 7f1ddf587700 1 --2- 172.21.15.62:0/1215662868 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1dd80a8e10 0x7f1dd813dec0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f1dc8002f70 tx=0x7f1dc8014000).stop 2021-12-17T18:27:28.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.241+0000 7f1ddf587700 1 -- 172.21.15.62:0/1215662868 shutdown_connections 2021-12-17T18:27:28.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.241+0000 7f1ddf587700 1 --2- 172.21.15.62:0/1215662868 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1db8053580 0x7f1db8055a40 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:28.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.241+0000 7f1ddf587700 1 --2- 172.21.15.62:0/1215662868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd8141480 0x7f1dd8156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:28.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.241+0000 7f1ddf587700 1 --2- 172.21.15.62:0/1215662868 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1dd80a8e10 0x7f1dd813dec0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:28.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.241+0000 7f1ddf587700 1 --2- 172.21.15.62:0/1215662868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1dd80a71e0 0x7f1dd815aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:28.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.241+0000 7f1ddf587700 1 -- 172.21.15.62:0/1215662868 >> 172.21.15.62:0/1215662868 conn(0x7f1dd805d220 msgr2=0x7f1dd80b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:28.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.241+0000 7f1ddf587700 1 -- 172.21.15.62:0/1215662868 shutdown_connections 2021-12-17T18:27:28.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:28.241+0000 7f1ddf587700 1 -- 172.21.15.62:0/1215662868 wait complete. 2021-12-17T18:27:28.249 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 66 2021-12-17T18:27:28.457 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:27:19.830173+0000', 'modified': '2021-12-17T18:27:20.832915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8127}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8127': {'gid': 8127, 'name': 'b', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.109:6835/570760267', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.109:6834', 'nonce': 570760267}, {'type': 'v1', 'addr': '172.21.15.109:6835', 'nonce': 570760267}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:27:28.458 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:27:28.459 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-12-17T18:27:28.574 INFO:teuthology.orchestra.run.smithi109.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":8127,"want_state":"up:active","state":"up:active","rank_uptime":8.7298447360000004,"mdsmap_epoch":66,"osdmap_epoch":132,"osdmap_epoch_barrier":130,"uptime":13.751215538} 2021-12-17T18:27:28.575 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 8127, "mdsmap_epoch": 66, "osdmap_epoch": 132, "osdmap_epoch_barrier": 130, "rank_uptime": 8.729844736, "state": "up:active", "uptime": 13.751215538, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:27:28.575 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:27:28.576 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-12-17T18:27:28.576 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi158.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-12-17T18:27:28.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:28.577 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:28.586 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:27:28.645 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:27:28.646 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:27:28.662 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:27:28.662 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:27:28.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:28.664 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:27:28.671 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:27:28.671 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:28.674 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:27:28.690 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:27:28.691 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:27:28.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:2021-12-17T18:27:28.735+0000 7f023b2de080 -1 init, newargv = 0x559d7110eec0 newargc=9 2021-12-17T18:27:28.744 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14479]: starting ceph client 2021-12-17T18:27:28.754 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14479]: starting fuse 2021-12-17T18:27:28.755 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:27:28.756 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:27:28.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:28.758 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:27:28.763 INFO:teuthology.orchestra.run.smithi158.stdout:52 2021-12-17T18:27:28.764 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:27:28.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:28.765 DEBUG:teuthology.orchestra.run.smithi158:> sudo python3 -c ' 2021-12-17T18:27:28.765 DEBUG:teuthology.orchestra.run.smithi158:> import glob 2021-12-17T18:27:28.766 DEBUG:teuthology.orchestra.run.smithi158:> import re 2021-12-17T18:27:28.766 DEBUG:teuthology.orchestra.run.smithi158:> import os 2021-12-17T18:27:28.766 DEBUG:teuthology.orchestra.run.smithi158:> import subprocess 2021-12-17T18:27:28.767 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:27:28.767 DEBUG:teuthology.orchestra.run.smithi158:> def find_socket(client_name): 2021-12-17T18:27:28.768 DEBUG:teuthology.orchestra.run.smithi158:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-12-17T18:27:28.768 DEBUG:teuthology.orchestra.run.smithi158:> files = glob.glob(asok_path) 2021-12-17T18:27:28.769 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:27:28.769 DEBUG:teuthology.orchestra.run.smithi158:> # Given a non-glob path, it better be there 2021-12-17T18:27:28.770 DEBUG:teuthology.orchestra.run.smithi158:> if "*" not in asok_path: 2021-12-17T18:27:28.770 DEBUG:teuthology.orchestra.run.smithi158:> assert(len(files) == 1) 2021-12-17T18:27:28.771 DEBUG:teuthology.orchestra.run.smithi158:> return files[0] 2021-12-17T18:27:28.771 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:27:28.771 DEBUG:teuthology.orchestra.run.smithi158:> for f in files: 2021-12-17T18:27:28.772 DEBUG:teuthology.orchestra.run.smithi158:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:27:28.772 DEBUG:teuthology.orchestra.run.smithi158:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:27:28.773 DEBUG:teuthology.orchestra.run.smithi158:> return f 2021-12-17T18:27:28.773 DEBUG:teuthology.orchestra.run.smithi158:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:27:28.773 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:27:28.774 DEBUG:teuthology.orchestra.run.smithi158:> print(find_socket("client.1")) 2021-12-17T18:27:28.774 DEBUG:teuthology.orchestra.run.smithi158:> ' 2021-12-17T18:27:28.815 INFO:teuthology.orchestra.run.smithi158.stdout:/var/run/ceph/ceph-client.1.14479.asok 2021-12-17T18:27:28.820 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14479.asok 2021-12-17T18:27:28.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:28.821 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14479.asok status 2021-12-17T18:27:28.952 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2021-12-17T18:27:28.953 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": { 2021-12-17T18:27:28.953 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:27:28.953 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:27:28.954 INFO:teuthology.orchestra.run.smithi158.stdout: "entity_id": "1", 2021-12-17T18:27:28.954 INFO:teuthology.orchestra.run.smithi158.stdout: "hostname": "smithi158", 2021-12-17T18:27:28.954 INFO:teuthology.orchestra.run.smithi158.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-12-17T18:27:28.955 INFO:teuthology.orchestra.run.smithi158.stdout: "pid": "14479", 2021-12-17T18:27:28.955 INFO:teuthology.orchestra.run.smithi158.stdout: "root": "/" 2021-12-17T18:27:28.955 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:27:28.956 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_count": 0, 2021-12-17T18:27:28.956 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_pinned_count": 0, 2021-12-17T18:27:28.956 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 7067, 2021-12-17T18:27:28.957 INFO:teuthology.orchestra.run.smithi158.stdout: "inst": { 2021-12-17T18:27:28.957 INFO:teuthology.orchestra.run.smithi158.stdout: "name": { 2021-12-17T18:27:28.957 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "client", 2021-12-17T18:27:28.957 INFO:teuthology.orchestra.run.smithi158.stdout: "num": 7067 2021-12-17T18:27:28.958 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:27:28.958 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:27:28.958 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:27:28.958 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:27:28.959 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 1964978794 2021-12-17T18:27:28.959 INFO:teuthology.orchestra.run.smithi158.stdout: } 2021-12-17T18:27:28.959 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:27:28.959 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:27:28.959 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:27:28.960 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:27:28.960 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 1964978794 2021-12-17T18:27:28.960 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:27:28.960 INFO:teuthology.orchestra.run.smithi158.stdout: "inst_str": "client.7067 172.21.15.158:0/1964978794", 2021-12-17T18:27:28.961 INFO:teuthology.orchestra.run.smithi158.stdout: "addr_str": "172.21.15.158:0/1964978794", 2021-12-17T18:27:28.961 INFO:teuthology.orchestra.run.smithi158.stdout: "inode_count": 1, 2021-12-17T18:27:28.961 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_epoch": 66, 2021-12-17T18:27:28.961 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch": 132, 2021-12-17T18:27:28.962 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:27:28.962 INFO:teuthology.orchestra.run.smithi158.stdout: "blacklisted": false, 2021-12-17T18:27:28.962 INFO:teuthology.orchestra.run.smithi158.stdout: "fs_name": "cephfs" 2021-12-17T18:27:28.962 INFO:teuthology.orchestra.run.smithi158.stdout:} 2021-12-17T18:27:28.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:28.964 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:28.965 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:28.973 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:27:28.974 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:27:28.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:28.975 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:28.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:28.991 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:28.992 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:29.040 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:27:29.041 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:27:29.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:29.042 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:29.042 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:29.050 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:27:29.051 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:27:29.052 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi158.front.sepia.ceph.com... 2021-12-17T18:27:29.052 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:27:29.053 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:29.069 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14479]: fuse finished with error 0 and tester_r 0 2021-12-17T18:27:29.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:29.072 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:29.072 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:29.119 INFO:teuthology.orchestra.run.smithi158.stdout:ext2/ext3 2021-12-17T18:27:29.120 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:27:29.121 INFO:teuthology.orchestra.run:waiting for 900 2021-12-17T18:27:29.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:27:29.138 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:29.147 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-12-17T18:27:29.150 DEBUG:teuthology.orchestra.run.smithi109:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-12-17T18:27:29.152 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-12-17T18:27:29.155 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-12-17T18:27:29.191 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-12-17T18:27:29.196 INFO:teuthology.orchestra.run.smithi125.stdout:[global] 2021-12-17T18:27:29.196 INFO:teuthology.orchestra.run.smithi125.stdout: chdir = "" 2021-12-17T18:27:29.197 INFO:teuthology.orchestra.run.smithi125.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-12-17T18:27:29.197 INFO:teuthology.orchestra.run.smithi125.stdout: auth supported = cephx 2021-12-17T18:27:29.197 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.197 INFO:teuthology.orchestra.run.smithi125.stdout: filestore xattr use omap = true 2021-12-17T18:27:29.198 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.198 INFO:teuthology.orchestra.run.smithi125.stdout: mon clock drift allowed = 1.000 2021-12-17T18:27:29.198 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.198 INFO:teuthology.orchestra.run.smithi125.stdout: osd crush chooseleaf type = 0 2021-12-17T18:27:29.198 INFO:teuthology.orchestra.run.smithi125.stdout: auth debug = true 2021-12-17T18:27:29.199 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.199 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on old message = true 2021-12-17T18:27:29.199 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on bug = true 2021-12-17T18:27:29.199 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.200 INFO:teuthology.orchestra.run.smithi125.stdout: mon max pg per osd = 10000 # >= luminous 2021-12-17T18:27:29.200 INFO:teuthology.orchestra.run.smithi125.stdout: mon pg warn max object skew = 0 2021-12-17T18:27:29.200 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.200 INFO:teuthology.orchestra.run.smithi125.stdout: # disable pg_autoscaler by default for new pools 2021-12-17T18:27:29.200 INFO:teuthology.orchestra.run.smithi125.stdout: osd_pool_default_pg_autoscale_mode = off 2021-12-17T18:27:29.201 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.201 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default size = 2 2021-12-17T18:27:29.201 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.201 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow primary affinity = true 2021-12-17T18:27:29.201 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow pg remap = true 2021-12-17T18:27:29.202 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on legacy crush tunables = false 2021-12-17T18:27:29.202 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on crush straw calc version zero = false 2021-12-17T18:27:29.202 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on no sortbitwise = false 2021-12-17T18:27:29.202 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on osd down out interval zero = false 2021-12-17T18:27:29.202 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on too few osds = false 2021-12-17T18:27:29.203 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-12-17T18:27:29.203 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_no_redundancy = false 2021-12-17T18:27:29.203 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.203 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-12-17T18:27:29.203 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.204 INFO:teuthology.orchestra.run.smithi125.stdout: osd default data pool replay window = 5 2021-12-17T18:27:29.204 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.204 INFO:teuthology.orchestra.run.smithi125.stdout: mon allow pool delete = true 2021-12-17T18:27:29.204 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.205 INFO:teuthology.orchestra.run.smithi125.stdout: mon cluster log file level = debug 2021-12-17T18:27:29.205 INFO:teuthology.orchestra.run.smithi125.stdout: debug asserts on shutdown = true 2021-12-17T18:27:29.205 INFO:teuthology.orchestra.run.smithi125.stdout: mon health detail to clog = false 2021-12-17T18:27:29.205 INFO:teuthology.orchestra.run.smithi125.stdout: mon host = "172.21.15.62,172.21.15.109,[v2:172.21.15.109:3301,v1:172.21.15.109:6790]" 2021-12-17T18:27:29.206 INFO:teuthology.orchestra.run.smithi125.stdout: fsid = bd870ae2-2b3b-4717-8d94-b4a425d11882 2021-12-17T18:27:29.206 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.206 INFO:teuthology.orchestra.run.smithi125.stdout:[osd] 2021-12-17T18:27:29.206 INFO:teuthology.orchestra.run.smithi125.stdout: osd journal size = 100 2021-12-17T18:27:29.206 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.207 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub load threshold = 5.0 2021-12-17T18:27:29.207 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub max interval = 600 2021-12-17T18:27:29.207 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.207 INFO:teuthology.orchestra.run.smithi125.stdout: osd recover clone overlap = true 2021-12-17T18:27:29.208 INFO:teuthology.orchestra.run.smithi125.stdout: osd recovery max chunk = 1048576 2021-12-17T18:27:29.208 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.208 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug shutdown = true 2021-12-17T18:27:29.208 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug op order = true 2021-12-17T18:27:29.209 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug verify stray on activate = true 2021-12-17T18:27:29.209 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.209 INFO:teuthology.orchestra.run.smithi125.stdout: osd open classes on start = true 2021-12-17T18:27:29.209 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug pg log writeout = true 2021-12-17T18:27:29.210 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.210 INFO:teuthology.orchestra.run.smithi125.stdout: osd deep scrub update digest min age = 30 2021-12-17T18:27:29.210 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.210 INFO:teuthology.orchestra.run.smithi125.stdout: osd map max advance = 10 2021-12-17T18:27:29.211 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.211 INFO:teuthology.orchestra.run.smithi125.stdout: journal zero on create = true 2021-12-17T18:27:29.211 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.211 INFO:teuthology.orchestra.run.smithi125.stdout: filestore ondisk finisher threads = 3 2021-12-17T18:27:29.212 INFO:teuthology.orchestra.run.smithi125.stdout: filestore apply finisher threads = 3 2021-12-17T18:27:29.212 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.212 INFO:teuthology.orchestra.run.smithi125.stdout: bdev debug aio = true 2021-12-17T18:27:29.212 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug misdirected ops = true 2021-12-17T18:27:29.213 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore block size = 96636764160 2021-12-17T18:27:29.213 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore compression mode = aggressive 2021-12-17T18:27:29.213 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore fsck on mount = True 2021-12-17T18:27:29.213 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluefs = 20 2021-12-17T18:27:29.213 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluestore = 20 2021-12-17T18:27:29.214 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2021-12-17T18:27:29.214 INFO:teuthology.orchestra.run.smithi125.stdout: debug osd = 20 2021-12-17T18:27:29.214 INFO:teuthology.orchestra.run.smithi125.stdout: debug rocksdb = 10 2021-12-17T18:27:29.214 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd backfillfull_ratio = 0.85 2021-12-17T18:27:29.215 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd full ratio = 0.9 2021-12-17T18:27:29.215 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd nearfull ratio = 0.8 2021-12-17T18:27:29.215 INFO:teuthology.orchestra.run.smithi125.stdout: osd failsafe full ratio = 0.95 2021-12-17T18:27:29.215 INFO:teuthology.orchestra.run.smithi125.stdout: osd objectstore = bluestore 2021-12-17T18:27:29.215 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2021-12-17T18:27:29.216 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.216 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr] 2021-12-17T18:27:29.216 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2021-12-17T18:27:29.216 INFO:teuthology.orchestra.run.smithi125.stdout: debug mgr = 20 2021-12-17T18:27:29.217 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2021-12-17T18:27:29.217 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2021-12-17T18:27:29.217 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:29.217 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:29.217 INFO:teuthology.orchestra.run.smithi125.stdout: mgr/telemetry/nag = false 2021-12-17T18:27:29.218 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.218 INFO:teuthology.orchestra.run.smithi125.stdout:[mon] 2021-12-17T18:27:29.218 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2021-12-17T18:27:29.218 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2021-12-17T18:27:29.218 INFO:teuthology.orchestra.run.smithi125.stdout: debug paxos = 20 2021-12-17T18:27:29.219 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2021-12-17T18:27:29.219 INFO:teuthology.orchestra.run.smithi125.stdout: mon data avail warn = 5 2021-12-17T18:27:29.219 INFO:teuthology.orchestra.run.smithi125.stdout: mon mgr mkfs grace = 240 2021-12-17T18:27:29.219 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:29.220 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd reporter subtree level = osd 2021-12-17T18:27:29.220 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd prime pg temp = true 2021-12-17T18:27:29.220 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:29.220 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.220 INFO:teuthology.orchestra.run.smithi125.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-12-17T18:27:29.221 INFO:teuthology.orchestra.run.smithi125.stdout: auth mon ticket ttl = 660 # 11m 2021-12-17T18:27:29.221 INFO:teuthology.orchestra.run.smithi125.stdout: auth service ticket ttl = 240 # 4m 2021-12-17T18:27:29.221 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.221 INFO:teuthology.orchestra.run.smithi125.stdout: # don't complain about insecure global_id in the test suite 2021-12-17T18:27:29.221 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-12-17T18:27:29.222 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-12-17T18:27:29.222 INFO:teuthology.orchestra.run.smithi125.stdout: mon op complaint time = 120 2021-12-17T18:27:29.222 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:29.222 INFO:teuthology.orchestra.run.smithi125.stdout:[client] 2021-12-17T18:27:29.223 INFO:teuthology.orchestra.run.smithi125.stdout: rgw cache enabled = true 2021-12-17T18:27:29.223 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable ops log = true 2021-12-17T18:27:29.223 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable usage log = true 2021-12-17T18:27:29.223 INFO:teuthology.orchestra.run.smithi125.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-12-17T18:27:29.223 INFO:teuthology.orchestra.run.smithi125.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-12-17T18:27:29.224 INFO:teuthology.orchestra.run.smithi125.stdout: client mount timeout = 600 2021-12-17T18:27:29.224 INFO:teuthology.orchestra.run.smithi125.stdout: debug client = 20 2021-12-17T18:27:29.224 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2021-12-17T18:27:29.224 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 15m 2021-12-17T18:27:29.225 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 15m 2021-12-17T18:27:29.225 INFO:teuthology.orchestra.run.smithi125.stdout: client debug getattr caps = true 2021-12-17T18:27:29.225 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.a] 2021-12-17T18:27:29.225 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.b] 2021-12-17T18:27:29.225 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.c] 2021-12-17T18:27:29.226 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.a] 2021-12-17T18:27:29.226 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.b] 2021-12-17T18:27:29.226 INFO:teuthology.orchestra.run.smithi125.stdout:[mds] 2021-12-17T18:27:29.226 INFO:teuthology.orchestra.run.smithi125.stdout: debug mds = 20 2021-12-17T18:27:29.226 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2021-12-17T18:27:29.227 INFO:teuthology.orchestra.run.smithi125.stdout: mds bal frag = True 2021-12-17T18:27:29.227 INFO:teuthology.orchestra.run.smithi125.stdout: mds bal fragment size max = 10000 2021-12-17T18:27:29.227 INFO:teuthology.orchestra.run.smithi125.stdout: mds bal merge size = 5 2021-12-17T18:27:29.227 INFO:teuthology.orchestra.run.smithi125.stdout: mds bal split bits = 3 2021-12-17T18:27:29.228 INFO:teuthology.orchestra.run.smithi125.stdout: mds bal split size = 100 2021-12-17T18:27:29.228 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug frag = True 2021-12-17T18:27:29.228 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug scatterstat = True 2021-12-17T18:27:29.228 INFO:teuthology.orchestra.run.smithi125.stdout: mds op complaint time = 180 2021-12-17T18:27:29.228 INFO:teuthology.orchestra.run.smithi125.stdout: mds verify scatter = True 2021-12-17T18:27:29.229 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2021-12-17T18:27:29.229 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 15m 2021-12-17T18:27:29.229 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 15m 2021-12-17T18:27:29.229 INFO:teuthology.orchestra.run.smithi109.stdout:[global] 2021-12-17T18:27:29.229 INFO:teuthology.orchestra.run.smithi109.stdout: chdir = "" 2021-12-17T18:27:29.230 INFO:teuthology.orchestra.run.smithi109.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-12-17T18:27:29.230 INFO:teuthology.orchestra.run.smithi109.stdout: auth supported = cephx 2021-12-17T18:27:29.230 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.230 INFO:teuthology.orchestra.run.smithi109.stdout: filestore xattr use omap = true 2021-12-17T18:27:29.231 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.231 INFO:teuthology.orchestra.run.smithi109.stdout: mon clock drift allowed = 1.000 2021-12-17T18:27:29.231 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.231 INFO:teuthology.orchestra.run.smithi109.stdout: osd crush chooseleaf type = 0 2021-12-17T18:27:29.231 INFO:teuthology.orchestra.run.smithi109.stdout: auth debug = true 2021-12-17T18:27:29.232 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.232 INFO:teuthology.orchestra.run.smithi109.stdout: ms die on old message = true 2021-12-17T18:27:29.232 INFO:teuthology.orchestra.run.smithi109.stdout: ms die on bug = true 2021-12-17T18:27:29.232 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.232 INFO:teuthology.orchestra.run.smithi109.stdout: mon max pg per osd = 10000 # >= luminous 2021-12-17T18:27:29.233 INFO:teuthology.orchestra.run.smithi109.stdout: mon pg warn max object skew = 0 2021-12-17T18:27:29.233 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.233 INFO:teuthology.orchestra.run.smithi109.stdout: # disable pg_autoscaler by default for new pools 2021-12-17T18:27:29.233 INFO:teuthology.orchestra.run.smithi109.stdout: osd_pool_default_pg_autoscale_mode = off 2021-12-17T18:27:29.234 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.234 INFO:teuthology.orchestra.run.smithi109.stdout: osd pool default size = 2 2021-12-17T18:27:29.234 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.234 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd allow primary affinity = true 2021-12-17T18:27:29.234 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd allow pg remap = true 2021-12-17T18:27:29.235 INFO:teuthology.orchestra.run.smithi109.stdout: mon warn on legacy crush tunables = false 2021-12-17T18:27:29.235 INFO:teuthology.orchestra.run.smithi109.stdout: mon warn on crush straw calc version zero = false 2021-12-17T18:27:29.235 INFO:teuthology.orchestra.run.smithi109.stdout: mon warn on no sortbitwise = false 2021-12-17T18:27:29.235 INFO:teuthology.orchestra.run.smithi109.stdout: mon warn on osd down out interval zero = false 2021-12-17T18:27:29.235 INFO:teuthology.orchestra.run.smithi109.stdout: mon warn on too few osds = false 2021-12-17T18:27:29.236 INFO:teuthology.orchestra.run.smithi109.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-12-17T18:27:29.236 INFO:teuthology.orchestra.run.smithi109.stdout: mon_warn_on_pool_no_redundancy = false 2021-12-17T18:27:29.236 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.236 INFO:teuthology.orchestra.run.smithi109.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-12-17T18:27:29.237 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.237 INFO:teuthology.orchestra.run.smithi109.stdout: osd default data pool replay window = 5 2021-12-17T18:27:29.237 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.237 INFO:teuthology.orchestra.run.smithi109.stdout: mon allow pool delete = true 2021-12-17T18:27:29.237 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.238 INFO:teuthology.orchestra.run.smithi109.stdout: mon cluster log file level = debug 2021-12-17T18:27:29.238 INFO:teuthology.orchestra.run.smithi109.stdout: debug asserts on shutdown = true 2021-12-17T18:27:29.238 INFO:teuthology.orchestra.run.smithi109.stdout: mon health detail to clog = false 2021-12-17T18:27:29.238 INFO:teuthology.orchestra.run.smithi109.stdout: mon host = "172.21.15.62,172.21.15.109,[v2:172.21.15.109:3301,v1:172.21.15.109:6790]" 2021-12-17T18:27:29.238 INFO:teuthology.orchestra.run.smithi109.stdout: fsid = bd870ae2-2b3b-4717-8d94-b4a425d11882 2021-12-17T18:27:29.239 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.239 INFO:teuthology.orchestra.run.smithi109.stdout:[osd] 2021-12-17T18:27:29.239 INFO:teuthology.orchestra.run.smithi109.stdout: osd journal size = 100 2021-12-17T18:27:29.239 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.240 INFO:teuthology.orchestra.run.smithi109.stdout: osd scrub load threshold = 5.0 2021-12-17T18:27:29.240 INFO:teuthology.orchestra.run.smithi109.stdout: osd scrub max interval = 600 2021-12-17T18:27:29.240 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.240 INFO:teuthology.orchestra.run.smithi109.stdout: osd recover clone overlap = true 2021-12-17T18:27:29.240 INFO:teuthology.orchestra.run.smithi109.stdout: osd recovery max chunk = 1048576 2021-12-17T18:27:29.241 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.241 INFO:teuthology.orchestra.run.smithi109.stdout: osd debug shutdown = true 2021-12-17T18:27:29.241 INFO:teuthology.orchestra.run.smithi109.stdout: osd debug op order = true 2021-12-17T18:27:29.241 INFO:teuthology.orchestra.run.smithi109.stdout: osd debug verify stray on activate = true 2021-12-17T18:27:29.242 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.242 INFO:teuthology.orchestra.run.smithi109.stdout: osd open classes on start = true 2021-12-17T18:27:29.242 INFO:teuthology.orchestra.run.smithi109.stdout: osd debug pg log writeout = true 2021-12-17T18:27:29.242 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.243 INFO:teuthology.orchestra.run.smithi109.stdout: osd deep scrub update digest min age = 30 2021-12-17T18:27:29.243 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.243 INFO:teuthology.orchestra.run.smithi109.stdout: osd map max advance = 10 2021-12-17T18:27:29.243 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.243 INFO:teuthology.orchestra.run.smithi109.stdout: journal zero on create = true 2021-12-17T18:27:29.244 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.244 INFO:teuthology.orchestra.run.smithi109.stdout: filestore ondisk finisher threads = 3 2021-12-17T18:27:29.244 INFO:teuthology.orchestra.run.smithi109.stdout: filestore apply finisher threads = 3 2021-12-17T18:27:29.244 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.245 INFO:teuthology.orchestra.run.smithi109.stdout: bdev debug aio = true 2021-12-17T18:27:29.245 INFO:teuthology.orchestra.run.smithi109.stdout: osd debug misdirected ops = true 2021-12-17T18:27:29.245 INFO:teuthology.orchestra.run.smithi109.stdout: bluestore block size = 96636764160 2021-12-17T18:27:29.245 INFO:teuthology.orchestra.run.smithi109.stdout: bluestore compression mode = aggressive 2021-12-17T18:27:29.245 INFO:teuthology.orchestra.run.smithi109.stdout: bluestore fsck on mount = True 2021-12-17T18:27:29.246 INFO:teuthology.orchestra.run.smithi109.stdout: debug bluefs = 20 2021-12-17T18:27:29.246 INFO:teuthology.orchestra.run.smithi109.stdout: debug bluestore = 20 2021-12-17T18:27:29.246 INFO:teuthology.orchestra.run.smithi109.stdout: debug ms = 1 2021-12-17T18:27:29.246 INFO:teuthology.orchestra.run.smithi109.stdout: debug osd = 20 2021-12-17T18:27:29.247 INFO:teuthology.orchestra.run.smithi109.stdout: debug rocksdb = 10 2021-12-17T18:27:29.247 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd backfillfull_ratio = 0.85 2021-12-17T18:27:29.247 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd full ratio = 0.9 2021-12-17T18:27:29.247 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd nearfull ratio = 0.8 2021-12-17T18:27:29.248 INFO:teuthology.orchestra.run.smithi109.stdout: osd failsafe full ratio = 0.95 2021-12-17T18:27:29.248 INFO:teuthology.orchestra.run.smithi109.stdout: osd objectstore = bluestore 2021-12-17T18:27:29.248 INFO:teuthology.orchestra.run.smithi109.stdout: osd op complaint time = 180 2021-12-17T18:27:29.248 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.248 INFO:teuthology.orchestra.run.smithi109.stdout:[mgr] 2021-12-17T18:27:29.249 INFO:teuthology.orchestra.run.smithi109.stdout: debug ms = 1 2021-12-17T18:27:29.249 INFO:teuthology.orchestra.run.smithi109.stdout: debug mgr = 20 2021-12-17T18:27:29.249 INFO:teuthology.orchestra.run.smithi109.stdout: debug mon = 20 2021-12-17T18:27:29.249 INFO:teuthology.orchestra.run.smithi109.stdout: debug auth = 20 2021-12-17T18:27:29.249 INFO:teuthology.orchestra.run.smithi109.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:29.250 INFO:teuthology.orchestra.run.smithi109.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:29.250 INFO:teuthology.orchestra.run.smithi109.stdout: mgr/telemetry/nag = false 2021-12-17T18:27:29.250 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.250 INFO:teuthology.orchestra.run.smithi109.stdout:[mon] 2021-12-17T18:27:29.250 INFO:teuthology.orchestra.run.smithi109.stdout: debug ms = 1 2021-12-17T18:27:29.251 INFO:teuthology.orchestra.run.smithi109.stdout: debug mon = 20 2021-12-17T18:27:29.251 INFO:teuthology.orchestra.run.smithi109.stdout: debug paxos = 20 2021-12-17T18:27:29.251 INFO:teuthology.orchestra.run.smithi109.stdout: debug auth = 20 2021-12-17T18:27:29.251 INFO:teuthology.orchestra.run.smithi109.stdout: mon data avail warn = 5 2021-12-17T18:27:29.252 INFO:teuthology.orchestra.run.smithi109.stdout: mon mgr mkfs grace = 240 2021-12-17T18:27:29.252 INFO:teuthology.orchestra.run.smithi109.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:29.252 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd reporter subtree level = osd 2021-12-17T18:27:29.252 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd prime pg temp = true 2021-12-17T18:27:29.252 INFO:teuthology.orchestra.run.smithi109.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:29.253 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.253 INFO:teuthology.orchestra.run.smithi109.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-12-17T18:27:29.253 INFO:teuthology.orchestra.run.smithi109.stdout: auth mon ticket ttl = 660 # 11m 2021-12-17T18:27:29.253 INFO:teuthology.orchestra.run.smithi109.stdout: auth service ticket ttl = 240 # 4m 2021-12-17T18:27:29.253 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.254 INFO:teuthology.orchestra.run.smithi109.stdout: # don't complain about insecure global_id in the test suite 2021-12-17T18:27:29.254 INFO:teuthology.orchestra.run.smithi109.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-12-17T18:27:29.254 INFO:teuthology.orchestra.run.smithi109.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-12-17T18:27:29.254 INFO:teuthology.orchestra.run.smithi109.stdout: mon op complaint time = 120 2021-12-17T18:27:29.255 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:29.255 INFO:teuthology.orchestra.run.smithi109.stdout:[client] 2021-12-17T18:27:29.255 INFO:teuthology.orchestra.run.smithi109.stdout: rgw cache enabled = true 2021-12-17T18:27:29.255 INFO:teuthology.orchestra.run.smithi109.stdout: rgw enable ops log = true 2021-12-17T18:27:29.255 INFO:teuthology.orchestra.run.smithi109.stdout: rgw enable usage log = true 2021-12-17T18:27:29.256 INFO:teuthology.orchestra.run.smithi109.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-12-17T18:27:29.256 INFO:teuthology.orchestra.run.smithi109.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-12-17T18:27:29.256 INFO:teuthology.orchestra.run.smithi109.stdout: client mount timeout = 600 2021-12-17T18:27:29.256 INFO:teuthology.orchestra.run.smithi109.stdout: debug client = 20 2021-12-17T18:27:29.256 INFO:teuthology.orchestra.run.smithi109.stdout: debug ms = 1 2021-12-17T18:27:29.257 INFO:teuthology.orchestra.run.smithi109.stdout: rados mon op timeout = 15m 2021-12-17T18:27:29.257 INFO:teuthology.orchestra.run.smithi109.stdout: rados osd op timeout = 15m 2021-12-17T18:27:29.257 INFO:teuthology.orchestra.run.smithi109.stdout: client debug getattr caps = true 2021-12-17T18:27:29.257 INFO:teuthology.orchestra.run.smithi109.stdout:[mon.a] 2021-12-17T18:27:29.258 INFO:teuthology.orchestra.run.smithi109.stdout:[mon.b] 2021-12-17T18:27:29.258 INFO:teuthology.orchestra.run.smithi109.stdout:[mon.c] 2021-12-17T18:27:29.258 INFO:teuthology.orchestra.run.smithi109.stdout:[mds.a] 2021-12-17T18:27:29.258 INFO:teuthology.orchestra.run.smithi109.stdout:[mds.b] 2021-12-17T18:27:29.258 INFO:teuthology.orchestra.run.smithi109.stdout:[mds] 2021-12-17T18:27:29.259 INFO:teuthology.orchestra.run.smithi109.stdout: debug mds = 20 2021-12-17T18:27:29.259 INFO:teuthology.orchestra.run.smithi109.stdout: debug ms = 1 2021-12-17T18:27:29.259 INFO:teuthology.orchestra.run.smithi109.stdout: mds bal frag = True 2021-12-17T18:27:29.259 INFO:teuthology.orchestra.run.smithi109.stdout: mds bal fragment size max = 10000 2021-12-17T18:27:29.260 INFO:teuthology.orchestra.run.smithi109.stdout: mds bal merge size = 5 2021-12-17T18:27:29.260 INFO:teuthology.orchestra.run.smithi109.stdout: mds bal split bits = 3 2021-12-17T18:27:29.260 INFO:teuthology.orchestra.run.smithi109.stdout: mds bal split size = 100 2021-12-17T18:27:29.260 INFO:teuthology.orchestra.run.smithi109.stdout: mds debug frag = True 2021-12-17T18:27:29.260 INFO:teuthology.orchestra.run.smithi109.stdout: mds debug scatterstat = True 2021-12-17T18:27:29.261 INFO:teuthology.orchestra.run.smithi109.stdout: mds op complaint time = 180 2021-12-17T18:27:29.261 INFO:teuthology.orchestra.run.smithi109.stdout: mds verify scatter = True 2021-12-17T18:27:29.261 INFO:teuthology.orchestra.run.smithi109.stdout: osd op complaint time = 180 2021-12-17T18:27:29.261 INFO:teuthology.orchestra.run.smithi109.stdout: rados mon op timeout = 15m 2021-12-17T18:27:29.261 INFO:teuthology.orchestra.run.smithi109.stdout: rados osd op timeout = 15m 2021-12-17T18:27:29.262 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2021-12-17T18:27:29.262 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2021-12-17T18:27:29.262 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-12-17T18:27:29.262 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2021-12-17T18:27:29.263 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.263 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2021-12-17T18:27:29.263 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.263 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2021-12-17T18:27:29.263 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.264 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2021-12-17T18:27:29.264 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2021-12-17T18:27:29.264 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.264 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2021-12-17T18:27:29.264 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2021-12-17T18:27:29.265 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.265 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2021-12-17T18:27:29.265 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2021-12-17T18:27:29.265 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.265 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2021-12-17T18:27:29.266 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2021-12-17T18:27:29.266 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.266 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2021-12-17T18:27:29.266 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.267 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2021-12-17T18:27:29.267 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2021-12-17T18:27:29.267 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2021-12-17T18:27:29.267 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2021-12-17T18:27:29.267 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2021-12-17T18:27:29.268 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2021-12-17T18:27:29.268 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2021-12-17T18:27:29.268 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-12-17T18:27:29.268 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2021-12-17T18:27:29.269 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.269 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-12-17T18:27:29.269 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.269 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2021-12-17T18:27:29.269 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.270 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2021-12-17T18:27:29.270 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.270 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2021-12-17T18:27:29.270 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2021-12-17T18:27:29.270 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2021-12-17T18:27:29.271 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.62,172.21.15.109,[v2:172.21.15.109:3301,v1:172.21.15.109:6790]" 2021-12-17T18:27:29.271 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = bd870ae2-2b3b-4717-8d94-b4a425d11882 2021-12-17T18:27:29.271 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.271 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2021-12-17T18:27:29.271 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2021-12-17T18:27:29.272 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.272 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2021-12-17T18:27:29.272 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2021-12-17T18:27:29.272 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.272 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2021-12-17T18:27:29.273 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2021-12-17T18:27:29.273 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.273 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2021-12-17T18:27:29.273 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2021-12-17T18:27:29.273 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2021-12-17T18:27:29.274 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.274 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2021-12-17T18:27:29.274 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2021-12-17T18:27:29.274 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.275 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2021-12-17T18:27:29.275 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.275 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2021-12-17T18:27:29.275 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.275 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2021-12-17T18:27:29.276 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.276 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2021-12-17T18:27:29.276 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2021-12-17T18:27:29.276 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.277 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2021-12-17T18:27:29.277 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2021-12-17T18:27:29.277 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2021-12-17T18:27:29.277 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore compression mode = aggressive 2021-12-17T18:27:29.277 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2021-12-17T18:27:29.278 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 20 2021-12-17T18:27:29.278 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 20 2021-12-17T18:27:29.278 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-12-17T18:27:29.278 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2021-12-17T18:27:29.278 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 10 2021-12-17T18:27:29.279 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2021-12-17T18:27:29.279 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2021-12-17T18:27:29.279 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2021-12-17T18:27:29.279 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2021-12-17T18:27:29.279 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2021-12-17T18:27:29.280 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2021-12-17T18:27:29.280 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.280 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2021-12-17T18:27:29.280 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-12-17T18:27:29.280 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2021-12-17T18:27:29.281 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2021-12-17T18:27:29.281 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2021-12-17T18:27:29.281 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:29.281 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:29.282 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2021-12-17T18:27:29.282 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.282 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2021-12-17T18:27:29.282 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-12-17T18:27:29.282 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2021-12-17T18:27:29.283 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2021-12-17T18:27:29.283 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2021-12-17T18:27:29.283 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2021-12-17T18:27:29.283 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2021-12-17T18:27:29.283 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:29.284 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2021-12-17T18:27:29.284 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2021-12-17T18:27:29.284 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:29.284 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.284 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-12-17T18:27:29.285 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2021-12-17T18:27:29.285 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2021-12-17T18:27:29.285 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.285 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2021-12-17T18:27:29.285 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-12-17T18:27:29.286 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-12-17T18:27:29.286 INFO:teuthology.orchestra.run.smithi062.stdout: mon op complaint time = 120 2021-12-17T18:27:29.286 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.286 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2021-12-17T18:27:29.287 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2021-12-17T18:27:29.287 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2021-12-17T18:27:29.287 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2021-12-17T18:27:29.287 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-12-17T18:27:29.287 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-12-17T18:27:29.288 INFO:teuthology.orchestra.run.smithi062.stdout: client mount timeout = 600 2021-12-17T18:27:29.288 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2021-12-17T18:27:29.288 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-12-17T18:27:29.288 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 15m 2021-12-17T18:27:29.288 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 15m 2021-12-17T18:27:29.289 INFO:teuthology.orchestra.run.smithi062.stdout: client debug getattr caps = true 2021-12-17T18:27:29.289 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2021-12-17T18:27:29.289 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2021-12-17T18:27:29.289 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2021-12-17T18:27:29.289 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2021-12-17T18:27:29.290 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2021-12-17T18:27:29.290 INFO:teuthology.orchestra.run.smithi062.stdout:[mds] 2021-12-17T18:27:29.290 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds = 20 2021-12-17T18:27:29.290 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-12-17T18:27:29.291 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal frag = True 2021-12-17T18:27:29.291 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal fragment size max = 10000 2021-12-17T18:27:29.291 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal merge size = 5 2021-12-17T18:27:29.291 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split bits = 3 2021-12-17T18:27:29.291 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split size = 100 2021-12-17T18:27:29.292 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug frag = True 2021-12-17T18:27:29.292 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug scatterstat = True 2021-12-17T18:27:29.292 INFO:teuthology.orchestra.run.smithi062.stdout: mds op complaint time = 180 2021-12-17T18:27:29.292 INFO:teuthology.orchestra.run.smithi062.stdout: mds verify scatter = True 2021-12-17T18:27:29.292 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2021-12-17T18:27:29.293 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 15m 2021-12-17T18:27:29.293 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 15m 2021-12-17T18:27:29.296 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2021-12-17T18:27:29.296 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2021-12-17T18:27:29.297 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-12-17T18:27:29.297 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2021-12-17T18:27:29.297 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.297 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2021-12-17T18:27:29.298 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.298 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2021-12-17T18:27:29.298 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.298 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2021-12-17T18:27:29.298 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2021-12-17T18:27:29.299 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.299 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2021-12-17T18:27:29.299 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2021-12-17T18:27:29.299 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.299 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2021-12-17T18:27:29.300 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2021-12-17T18:27:29.300 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.300 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2021-12-17T18:27:29.300 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2021-12-17T18:27:29.300 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.301 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2021-12-17T18:27:29.301 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.301 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2021-12-17T18:27:29.301 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2021-12-17T18:27:29.301 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2021-12-17T18:27:29.302 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2021-12-17T18:27:29.302 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2021-12-17T18:27:29.302 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2021-12-17T18:27:29.302 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2021-12-17T18:27:29.303 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-12-17T18:27:29.303 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2021-12-17T18:27:29.303 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.303 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-12-17T18:27:29.304 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.304 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2021-12-17T18:27:29.304 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.304 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2021-12-17T18:27:29.304 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.305 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2021-12-17T18:27:29.305 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2021-12-17T18:27:29.305 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2021-12-17T18:27:29.305 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = "172.21.15.62,172.21.15.109,[v2:172.21.15.109:3301,v1:172.21.15.109:6790]" 2021-12-17T18:27:29.306 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = bd870ae2-2b3b-4717-8d94-b4a425d11882 2021-12-17T18:27:29.306 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.306 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2021-12-17T18:27:29.306 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2021-12-17T18:27:29.306 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.307 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2021-12-17T18:27:29.307 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2021-12-17T18:27:29.307 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.307 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2021-12-17T18:27:29.308 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2021-12-17T18:27:29.308 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.308 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2021-12-17T18:27:29.308 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2021-12-17T18:27:29.308 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2021-12-17T18:27:29.309 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.309 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2021-12-17T18:27:29.309 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2021-12-17T18:27:29.309 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.310 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2021-12-17T18:27:29.310 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.310 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2021-12-17T18:27:29.310 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.310 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2021-12-17T18:27:29.311 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.311 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2021-12-17T18:27:29.311 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2021-12-17T18:27:29.311 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.311 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2021-12-17T18:27:29.312 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2021-12-17T18:27:29.312 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore block size = 96636764160 2021-12-17T18:27:29.312 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore compression mode = aggressive 2021-12-17T18:27:29.312 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore fsck on mount = True 2021-12-17T18:27:29.313 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluefs = 20 2021-12-17T18:27:29.313 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluestore = 20 2021-12-17T18:27:29.313 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2021-12-17T18:27:29.313 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 20 2021-12-17T18:27:29.313 INFO:teuthology.orchestra.run.smithi192.stdout: debug rocksdb = 10 2021-12-17T18:27:29.314 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull_ratio = 0.85 2021-12-17T18:27:29.314 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.9 2021-12-17T18:27:29.314 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.8 2021-12-17T18:27:29.314 INFO:teuthology.orchestra.run.smithi192.stdout: osd failsafe full ratio = 0.95 2021-12-17T18:27:29.315 INFO:teuthology.orchestra.run.smithi192.stdout: osd objectstore = bluestore 2021-12-17T18:27:29.315 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2021-12-17T18:27:29.315 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.315 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2021-12-17T18:27:29.315 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2021-12-17T18:27:29.316 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2021-12-17T18:27:29.316 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2021-12-17T18:27:29.316 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2021-12-17T18:27:29.316 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:29.316 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:29.317 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2021-12-17T18:27:29.317 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.317 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2021-12-17T18:27:29.317 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2021-12-17T18:27:29.317 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2021-12-17T18:27:29.318 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2021-12-17T18:27:29.318 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2021-12-17T18:27:29.318 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2021-12-17T18:27:29.318 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2021-12-17T18:27:29.318 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:29.319 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2021-12-17T18:27:29.319 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2021-12-17T18:27:29.319 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:29.319 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.319 INFO:teuthology.orchestra.run.smithi192.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-12-17T18:27:29.320 INFO:teuthology.orchestra.run.smithi192.stdout: auth mon ticket ttl = 660 # 11m 2021-12-17T18:27:29.320 INFO:teuthology.orchestra.run.smithi192.stdout: auth service ticket ttl = 240 # 4m 2021-12-17T18:27:29.320 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.320 INFO:teuthology.orchestra.run.smithi192.stdout: # don't complain about insecure global_id in the test suite 2021-12-17T18:27:29.321 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-12-17T18:27:29.321 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-12-17T18:27:29.321 INFO:teuthology.orchestra.run.smithi192.stdout: mon op complaint time = 120 2021-12-17T18:27:29.321 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:29.321 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2021-12-17T18:27:29.322 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2021-12-17T18:27:29.322 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2021-12-17T18:27:29.322 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2021-12-17T18:27:29.322 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-12-17T18:27:29.322 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-12-17T18:27:29.323 INFO:teuthology.orchestra.run.smithi192.stdout: client mount timeout = 600 2021-12-17T18:27:29.323 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2021-12-17T18:27:29.323 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2021-12-17T18:27:29.323 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 15m 2021-12-17T18:27:29.323 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 15m 2021-12-17T18:27:29.324 INFO:teuthology.orchestra.run.smithi192.stdout: client debug getattr caps = true 2021-12-17T18:27:29.324 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2021-12-17T18:27:29.324 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.b] 2021-12-17T18:27:29.324 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.c] 2021-12-17T18:27:29.324 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2021-12-17T18:27:29.325 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2021-12-17T18:27:29.325 INFO:teuthology.orchestra.run.smithi192.stdout:[mds] 2021-12-17T18:27:29.325 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds = 20 2021-12-17T18:27:29.325 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2021-12-17T18:27:29.326 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal frag = True 2021-12-17T18:27:29.326 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal fragment size max = 10000 2021-12-17T18:27:29.326 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal merge size = 5 2021-12-17T18:27:29.326 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal split bits = 3 2021-12-17T18:27:29.326 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal split size = 100 2021-12-17T18:27:29.327 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug frag = True 2021-12-17T18:27:29.327 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug scatterstat = True 2021-12-17T18:27:29.327 INFO:teuthology.orchestra.run.smithi192.stdout: mds op complaint time = 180 2021-12-17T18:27:29.327 INFO:teuthology.orchestra.run.smithi192.stdout: mds verify scatter = True 2021-12-17T18:27:29.327 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2021-12-17T18:27:29.328 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 15m 2021-12-17T18:27:29.328 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 15m 2021-12-17T18:27:29.328 INFO:teuthology.orchestra.run.smithi158.stdout:[global] 2021-12-17T18:27:29.328 INFO:teuthology.orchestra.run.smithi158.stdout: chdir = "" 2021-12-17T18:27:29.329 INFO:teuthology.orchestra.run.smithi158.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-12-17T18:27:29.329 INFO:teuthology.orchestra.run.smithi158.stdout: auth supported = cephx 2021-12-17T18:27:29.329 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.329 INFO:teuthology.orchestra.run.smithi158.stdout: filestore xattr use omap = true 2021-12-17T18:27:29.329 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.330 INFO:teuthology.orchestra.run.smithi158.stdout: mon clock drift allowed = 1.000 2021-12-17T18:27:29.330 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.330 INFO:teuthology.orchestra.run.smithi158.stdout: osd crush chooseleaf type = 0 2021-12-17T18:27:29.330 INFO:teuthology.orchestra.run.smithi158.stdout: auth debug = true 2021-12-17T18:27:29.331 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.331 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on old message = true 2021-12-17T18:27:29.331 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on bug = true 2021-12-17T18:27:29.331 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.331 INFO:teuthology.orchestra.run.smithi158.stdout: mon max pg per osd = 10000 # >= luminous 2021-12-17T18:27:29.332 INFO:teuthology.orchestra.run.smithi158.stdout: mon pg warn max object skew = 0 2021-12-17T18:27:29.332 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.332 INFO:teuthology.orchestra.run.smithi158.stdout: # disable pg_autoscaler by default for new pools 2021-12-17T18:27:29.332 INFO:teuthology.orchestra.run.smithi158.stdout: osd_pool_default_pg_autoscale_mode = off 2021-12-17T18:27:29.332 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.333 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default size = 2 2021-12-17T18:27:29.333 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.333 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow primary affinity = true 2021-12-17T18:27:29.333 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow pg remap = true 2021-12-17T18:27:29.333 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on legacy crush tunables = false 2021-12-17T18:27:29.334 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on crush straw calc version zero = false 2021-12-17T18:27:29.334 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on no sortbitwise = false 2021-12-17T18:27:29.334 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on osd down out interval zero = false 2021-12-17T18:27:29.334 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on too few osds = false 2021-12-17T18:27:29.335 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-12-17T18:27:29.335 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_no_redundancy = false 2021-12-17T18:27:29.335 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.335 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-12-17T18:27:29.335 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.336 INFO:teuthology.orchestra.run.smithi158.stdout: osd default data pool replay window = 5 2021-12-17T18:27:29.336 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.336 INFO:teuthology.orchestra.run.smithi158.stdout: mon allow pool delete = true 2021-12-17T18:27:29.336 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.336 INFO:teuthology.orchestra.run.smithi158.stdout: mon cluster log file level = debug 2021-12-17T18:27:29.337 INFO:teuthology.orchestra.run.smithi158.stdout: debug asserts on shutdown = true 2021-12-17T18:27:29.337 INFO:teuthology.orchestra.run.smithi158.stdout: mon health detail to clog = false 2021-12-17T18:27:29.337 INFO:teuthology.orchestra.run.smithi158.stdout: mon host = "172.21.15.62,172.21.15.109,[v2:172.21.15.109:3301,v1:172.21.15.109:6790]" 2021-12-17T18:27:29.337 INFO:teuthology.orchestra.run.smithi158.stdout: fsid = bd870ae2-2b3b-4717-8d94-b4a425d11882 2021-12-17T18:27:29.338 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.338 INFO:teuthology.orchestra.run.smithi158.stdout:[osd] 2021-12-17T18:27:29.338 INFO:teuthology.orchestra.run.smithi158.stdout: osd journal size = 100 2021-12-17T18:27:29.338 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.339 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub load threshold = 5.0 2021-12-17T18:27:29.339 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub max interval = 600 2021-12-17T18:27:29.339 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.339 INFO:teuthology.orchestra.run.smithi158.stdout: osd recover clone overlap = true 2021-12-17T18:27:29.339 INFO:teuthology.orchestra.run.smithi158.stdout: osd recovery max chunk = 1048576 2021-12-17T18:27:29.340 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.340 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug shutdown = true 2021-12-17T18:27:29.340 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug op order = true 2021-12-17T18:27:29.340 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug verify stray on activate = true 2021-12-17T18:27:29.340 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.341 INFO:teuthology.orchestra.run.smithi158.stdout: osd open classes on start = true 2021-12-17T18:27:29.341 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug pg log writeout = true 2021-12-17T18:27:29.341 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.341 INFO:teuthology.orchestra.run.smithi158.stdout: osd deep scrub update digest min age = 30 2021-12-17T18:27:29.342 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.342 INFO:teuthology.orchestra.run.smithi158.stdout: osd map max advance = 10 2021-12-17T18:27:29.342 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.342 INFO:teuthology.orchestra.run.smithi158.stdout: journal zero on create = true 2021-12-17T18:27:29.342 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.343 INFO:teuthology.orchestra.run.smithi158.stdout: filestore ondisk finisher threads = 3 2021-12-17T18:27:29.343 INFO:teuthology.orchestra.run.smithi158.stdout: filestore apply finisher threads = 3 2021-12-17T18:27:29.343 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.343 INFO:teuthology.orchestra.run.smithi158.stdout: bdev debug aio = true 2021-12-17T18:27:29.343 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug misdirected ops = true 2021-12-17T18:27:29.344 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore block size = 96636764160 2021-12-17T18:27:29.344 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore compression mode = aggressive 2021-12-17T18:27:29.344 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore fsck on mount = True 2021-12-17T18:27:29.344 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluefs = 20 2021-12-17T18:27:29.345 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluestore = 20 2021-12-17T18:27:29.345 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2021-12-17T18:27:29.345 INFO:teuthology.orchestra.run.smithi158.stdout: debug osd = 20 2021-12-17T18:27:29.345 INFO:teuthology.orchestra.run.smithi158.stdout: debug rocksdb = 10 2021-12-17T18:27:29.345 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd backfillfull_ratio = 0.85 2021-12-17T18:27:29.346 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd full ratio = 0.9 2021-12-17T18:27:29.346 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd nearfull ratio = 0.8 2021-12-17T18:27:29.346 INFO:teuthology.orchestra.run.smithi158.stdout: osd failsafe full ratio = 0.95 2021-12-17T18:27:29.346 INFO:teuthology.orchestra.run.smithi158.stdout: osd objectstore = bluestore 2021-12-17T18:27:29.347 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2021-12-17T18:27:29.347 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.347 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr] 2021-12-17T18:27:29.347 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2021-12-17T18:27:29.347 INFO:teuthology.orchestra.run.smithi158.stdout: debug mgr = 20 2021-12-17T18:27:29.348 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2021-12-17T18:27:29.348 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2021-12-17T18:27:29.348 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:29.348 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:29.348 INFO:teuthology.orchestra.run.smithi158.stdout: mgr/telemetry/nag = false 2021-12-17T18:27:29.349 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.349 INFO:teuthology.orchestra.run.smithi158.stdout:[mon] 2021-12-17T18:27:29.349 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2021-12-17T18:27:29.349 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2021-12-17T18:27:29.349 INFO:teuthology.orchestra.run.smithi158.stdout: debug paxos = 20 2021-12-17T18:27:29.350 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2021-12-17T18:27:29.350 INFO:teuthology.orchestra.run.smithi158.stdout: mon data avail warn = 5 2021-12-17T18:27:29.350 INFO:teuthology.orchestra.run.smithi158.stdout: mon mgr mkfs grace = 240 2021-12-17T18:27:29.350 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:29.351 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd reporter subtree level = osd 2021-12-17T18:27:29.351 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd prime pg temp = true 2021-12-17T18:27:29.351 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:29.351 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.351 INFO:teuthology.orchestra.run.smithi158.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-12-17T18:27:29.352 INFO:teuthology.orchestra.run.smithi158.stdout: auth mon ticket ttl = 660 # 11m 2021-12-17T18:27:29.352 INFO:teuthology.orchestra.run.smithi158.stdout: auth service ticket ttl = 240 # 4m 2021-12-17T18:27:29.352 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.352 INFO:teuthology.orchestra.run.smithi158.stdout: # don't complain about insecure global_id in the test suite 2021-12-17T18:27:29.352 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-12-17T18:27:29.353 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-12-17T18:27:29.353 INFO:teuthology.orchestra.run.smithi158.stdout: mon op complaint time = 120 2021-12-17T18:27:29.353 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:29.353 INFO:teuthology.orchestra.run.smithi158.stdout:[client] 2021-12-17T18:27:29.354 INFO:teuthology.orchestra.run.smithi158.stdout: rgw cache enabled = true 2021-12-17T18:27:29.354 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable ops log = true 2021-12-17T18:27:29.354 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable usage log = true 2021-12-17T18:27:29.354 INFO:teuthology.orchestra.run.smithi158.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-12-17T18:27:29.354 INFO:teuthology.orchestra.run.smithi158.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-12-17T18:27:29.355 INFO:teuthology.orchestra.run.smithi158.stdout: client mount timeout = 600 2021-12-17T18:27:29.355 INFO:teuthology.orchestra.run.smithi158.stdout: debug client = 20 2021-12-17T18:27:29.355 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2021-12-17T18:27:29.355 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 15m 2021-12-17T18:27:29.355 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 15m 2021-12-17T18:27:29.356 INFO:teuthology.orchestra.run.smithi158.stdout: client debug getattr caps = true 2021-12-17T18:27:29.356 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.a] 2021-12-17T18:27:29.356 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.b] 2021-12-17T18:27:29.356 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.c] 2021-12-17T18:27:29.356 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.a] 2021-12-17T18:27:29.357 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.b] 2021-12-17T18:27:29.357 INFO:teuthology.orchestra.run.smithi158.stdout:[mds] 2021-12-17T18:27:29.357 INFO:teuthology.orchestra.run.smithi158.stdout: debug mds = 20 2021-12-17T18:27:29.357 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2021-12-17T18:27:29.358 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal frag = True 2021-12-17T18:27:29.358 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal fragment size max = 10000 2021-12-17T18:27:29.358 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal merge size = 5 2021-12-17T18:27:29.358 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal split bits = 3 2021-12-17T18:27:29.358 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal split size = 100 2021-12-17T18:27:29.359 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug frag = True 2021-12-17T18:27:29.359 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug scatterstat = True 2021-12-17T18:27:29.359 INFO:teuthology.orchestra.run.smithi158.stdout: mds op complaint time = 180 2021-12-17T18:27:29.359 INFO:teuthology.orchestra.run.smithi158.stdout: mds verify scatter = True 2021-12-17T18:27:29.359 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2021-12-17T18:27:29.360 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 15m 2021-12-17T18:27:29.360 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 15m 2021-12-17T18:27:29.360 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:27:29.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.469+0000 7f8dfdcc6700 1 Processor -- start 2021-12-17T18:27:29.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.469+0000 7f8dfdcc6700 1 -- start start 2021-12-17T18:27:29.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8dfdcc6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8df814b470 0x7f8df814b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:29.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8dfdcc6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df80b6460 con 0x7f8df80ab9c0 2021-12-17T18:27:29.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8dfdcc6700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df80ac060 con 0x7f8df80b6080 2021-12-17T18:27:29.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8dfdcc6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df80ac300 con 0x7f8df814b470 2021-12-17T18:27:29.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df6ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8df80ab9c0 0x7f8df8147ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39736/0 (socket says 172.21.15.62:39736) 2021-12-17T18:27:29.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df6ffd700 1 -- 172.21.15.62:0/1176469804 learned_addr learned my addr 172.21.15.62:0/1176469804 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:29.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df7fff700 1 --2- 172.21.15.62:0/1176469804 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8df814b470 0x7f8df814b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:29.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 -- 172.21.15.62:0/1176469804 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756766910 0 0) 0x7f8df80b6460 con 0x7f8df80ab9c0 2021-12-17T18:27:29.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 -- 172.21.15.62:0/1176469804 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8de4003260 con 0x7f8df80ab9c0 2021-12-17T18:27:29.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 -- 172.21.15.62:0/1176469804 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2100315909 0 0) 0x7f8de4003260 con 0x7f8df80ab9c0 2021-12-17T18:27:29.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 -- 172.21.15.62:0/1176469804 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8df814b470 msgr2=0x7f8df814b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:29.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 --2- 172.21.15.62:0/1176469804 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8df814b470 0x7f8df814b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:29.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 -- 172.21.15.62:0/1176469804 >> v1:172.21.15.109:6789/0 conn(0x7f8df80b6080 legacy=0x7f8df814ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:29.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 -- 172.21.15.62:0/1176469804 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df80ac5a0 con 0x7f8df80ab9c0 2021-12-17T18:27:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 -- 172.21.15.62:0/1176469804 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f8de8001660 con 0x7f8df80ab9c0 2021-12-17T18:27:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 -- 172.21.15.62:0/1176469804 >> v1:172.21.15.62:6789/0 conn(0x7f8df80ab9c0 legacy=0x7f8df8147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 --2- 172.21.15.62:0/1176469804 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de4003780 0x7f8de4003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 --2- 172.21.15.62:0/1176469804 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8df814b470 0x7f8de4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 --2- 172.21.15.62:0/1176469804 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8de40049f0 0x7f8de4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:29.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 -- 172.21.15.62:0/1176469804 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df80ac300 con 0x7f8de4003780 2021-12-17T18:27:29.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 -- 172.21.15.62:0/1176469804 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de400b800 con 0x7f8de40049f0 2021-12-17T18:27:29.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 -- 172.21.15.62:0/1176469804 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de400b9c0 con 0x7f8df814b470 2021-12-17T18:27:29.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df77fe700 1 --2- 172.21.15.62:0/1176469804 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de4003780 0x7f8de4003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:29.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df6ffd700 1 --2- 172.21.15.62:0/1176469804 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8df814b470 0x7f8de4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:29.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df7fff700 1 --2- 172.21.15.62:0/1176469804 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8de40049f0 0x7f8de4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:29.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df77fe700 1 -- 172.21.15.62:0/1176469804 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8df814b470 msgr2=0x7f8de4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:29.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df77fe700 1 --2- 172.21.15.62:0/1176469804 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8df814b470 0x7f8de4004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:29.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df77fe700 1 -- 172.21.15.62:0/1176469804 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8de40049f0 msgr2=0x7f8de4004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:29.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df77fe700 1 --2- 172.21.15.62:0/1176469804 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8de40049f0 0x7f8de4004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:29.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df77fe700 1 -- 172.21.15.62:0/1176469804 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de4003260 con 0x7f8de4003780 2021-12-17T18:27:29.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df77fe700 1 --2- 172.21.15.62:0/1176469804 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de4003780 0x7f8de4003ba0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f8df8069d10 tx=0x7f8dec007a00).ready entity=mon.0 client_cookie=24e3bd8e33d51e2f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:29.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 -- 172.21.15.62:0/1176469804 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dec007d10 con 0x7f8de4003780 2021-12-17T18:27:29.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 -- 172.21.15.62:0/1176469804 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dec007030 con 0x7f8de4003780 2021-12-17T18:27:29.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.473+0000 7f8df67fc700 1 -- 172.21.15.62:0/1176469804 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dec007390 con 0x7f8de4003780 2021-12-17T18:27:29.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.477+0000 7f8dfdcc6700 1 -- 172.21.15.62:0/1176469804 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de4003780 msgr2=0x7f8de4003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:29.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.477+0000 7f8dfdcc6700 1 --2- 172.21.15.62:0/1176469804 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de4003780 0x7f8de4003ba0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f8df8069d10 tx=0x7f8dec007a00).stop 2021-12-17T18:27:29.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.477+0000 7f8df7fff700 1 -- 172.21.15.62:0/1176469804 reap_dead start 2021-12-17T18:27:29.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.477+0000 7f8dfdcc6700 1 -- 172.21.15.62:0/1176469804 shutdown_connections 2021-12-17T18:27:29.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.477+0000 7f8dfdcc6700 1 -- 172.21.15.62:0/1176469804 >> 172.21.15.62:0/1176469804 conn(0x7f8df80b2bc0 msgr2=0x7f8df80b5630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:29.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.477+0000 7f8dfdcc6700 1 -- 172.21.15.62:0/1176469804 shutdown_connections 2021-12-17T18:27:29.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.477+0000 7f8dfdcc6700 1 -- 172.21.15.62:0/1176469804 wait complete. 2021-12-17T18:27:29.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.477+0000 7f8dfdcc6700 1 Processor -- start 2021-12-17T18:27:29.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.477+0000 7f8dfdcc6700 1 -- start start 2021-12-17T18:27:29.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8dfdcc6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de4003780 0x7f8df80664c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:29.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8dfdcc6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8df8157c50 0x7f8df814d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:29.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8dfdcc6700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8df814dd10 0x7f8df80634a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:29.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8dfdcc6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df80677a0 con 0x7f8de4003780 2021-12-17T18:27:29.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8dfdcc6700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df8157820 con 0x7f8df814dd10 2021-12-17T18:27:29.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8dfdcc6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df8066d10 con 0x7f8df8157c50 2021-12-17T18:27:29.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8df77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de4003780 0x7f8df80664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:29.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8df6ffd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8df8157c50 0x7f8df814d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:29.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8df7fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8df814dd10 0x7f8df80634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:29.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8df77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de4003780 0x7f8df80664c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56170/0 (socket says 172.21.15.62:56170) 2021-12-17T18:27:29.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8df77fe700 1 -- 172.21.15.62:0/3802153424 learned_addr learned my addr 172.21.15.62:0/3802153424 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:29.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8df6ffd700 1 -- 172.21.15.62:0/3802153424 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8df814dd10 msgr2=0x7f8df80634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:29.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8df6ffd700 1 --2- 172.21.15.62:0/3802153424 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8df814dd10 0x7f8df80634a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:29.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8df6ffd700 1 -- 172.21.15.62:0/3802153424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de4003780 msgr2=0x7f8df80664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:29.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8df6ffd700 1 --2- 172.21.15.62:0/3802153424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de4003780 0x7f8df80664c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:29.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8df6ffd700 1 -- 172.21.15.62:0/3802153424 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df814e1c0 con 0x7f8df8157c50 2021-12-17T18:27:29.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8df6ffd700 1 --2- 172.21.15.62:0/3802153424 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8df8157c50 0x7f8df814d820 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f8df8156d30 tx=0x7f8df8061de0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:29.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8df4ff9700 1 -- 172.21.15.62:0/3802153424 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8de80116b0 con 0x7f8df8157c50 2021-12-17T18:27:29.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8df4ff9700 1 -- 172.21.15.62:0/3802153424 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de8011810 con 0x7f8df8157c50 2021-12-17T18:27:29.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8dfdcc6700 1 -- 172.21.15.62:0/3802153424 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df80669b0 con 0x7f8df8157c50 2021-12-17T18:27:29.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8df4ff9700 1 -- 172.21.15.62:0/3802153424 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8de8011b70 con 0x7f8df8157c50 2021-12-17T18:27:29.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8dfdcc6700 1 -- 172.21.15.62:0/3802153424 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df8067170 con 0x7f8df8157c50 2021-12-17T18:27:29.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.481+0000 7f8dfdcc6700 1 -- 172.21.15.62:0/3802153424 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df80573d0 con 0x7f8df8157c50 2021-12-17T18:27:29.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.485+0000 7f8df4ff9700 1 -- 172.21.15.62:0/3802153424 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8de801b030 con 0x7f8df8157c50 2021-12-17T18:27:29.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.485+0000 7f8df4ff9700 1 --2- 172.21.15.62:0/3802153424 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8dd8053640 0x7f8dd8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:29.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.485+0000 7f8df4ff9700 1 -- 172.21.15.62:0/3802153424 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8de806b210 con 0x7f8df8157c50 2021-12-17T18:27:29.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.485+0000 7f8df77fe700 1 --2- 172.21.15.62:0/3802153424 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8dd8053640 0x7f8dd8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:29.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.485+0000 7f8df77fe700 1 --2- 172.21.15.62:0/3802153424 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8dd8053640 0x7f8dd8055b00 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f8dec01b000 tx=0x7f8dec015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:29.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.493+0000 7f8df4ff9700 1 -- 172.21.15.62:0/3802153424 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8de8042200 con 0x7f8df8157c50 2021-12-17T18:27:29.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.629+0000 7f8dfdcc6700 1 -- 172.21.15.62:0/3802153424 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8df8157960 con 0x7f8df8157c50 2021-12-17T18:27:29.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.629+0000 7f8df4ff9700 1 -- 172.21.15.62:0/3802153424 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f8de8019030 con 0x7f8df8157c50 2021-12-17T18:27:29.636 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:29.636 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":132,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:27:21.842977+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:27:17.568635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-12-17T18:27:18.849290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:27:29.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.633+0000 7f8dfdcc6700 1 -- 172.21.15.62:0/3802153424 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8dd8053640 msgr2=0x7f8dd8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:29.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.633+0000 7f8dfdcc6700 1 --2- 172.21.15.62:0/3802153424 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8dd8053640 0x7f8dd8055b00 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f8dec01b000 tx=0x7f8dec015000).stop 2021-12-17T18:27:29.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.633+0000 7f8dfdcc6700 1 -- 172.21.15.62:0/3802153424 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8df8157c50 msgr2=0x7f8df814d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:29.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.633+0000 7f8dfdcc6700 1 --2- 172.21.15.62:0/3802153424 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8df8157c50 0x7f8df814d820 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f8df8156d30 tx=0x7f8df8061de0).stop 2021-12-17T18:27:29.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.633+0000 7f8dfdcc6700 1 -- 172.21.15.62:0/3802153424 shutdown_connections 2021-12-17T18:27:29.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.633+0000 7f8dfdcc6700 1 --2- 172.21.15.62:0/3802153424 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8dd8053640 0x7f8dd8055b00 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:29.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.633+0000 7f8dfdcc6700 1 --2- 172.21.15.62:0/3802153424 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8df814dd10 0x7f8df80634a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:29.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.633+0000 7f8dfdcc6700 1 --2- 172.21.15.62:0/3802153424 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8df8157c50 0x7f8df814d820 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:29.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.633+0000 7f8dfdcc6700 1 --2- 172.21.15.62:0/3802153424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de4003780 0x7f8df80664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:29.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.633+0000 7f8dfdcc6700 1 -- 172.21.15.62:0/3802153424 >> 172.21.15.62:0/3802153424 conn(0x7f8df80b2bc0 msgr2=0x7f8df80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:29.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.633+0000 7f8dfdcc6700 1 -- 172.21.15.62:0/3802153424 shutdown_connections 2021-12-17T18:27:29.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.633+0000 7f8dfdcc6700 1 -- 172.21.15.62:0/3802153424 wait complete. 2021-12-17T18:27:29.649 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:27:17.568635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:27:18.849290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:27:29.650 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:27:29.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.757+0000 7f51abfff700 1 Processor -- start 2021-12-17T18:27:29.764 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.757+0000 7f51abfff700 1 -- start start 2021-12-17T18:27:29.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51abfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f51ac0b0cb0 0x7f51ac0afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:29.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51abfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac0b1090 con 0x7f51ac0acbd0 2021-12-17T18:27:29.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51abfff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac0b1300 con 0x7f51ac0af950 2021-12-17T18:27:29.766 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51abfff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ac148830 con 0x7f51ac0b0cb0 2021-12-17T18:27:29.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51ab7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f51ac0acbd0 0x7f51ac146a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39760/0 (socket says 172.21.15.62:39760) 2021-12-17T18:27:29.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51ab7fe700 1 -- 172.21.15.62:0/3287967359 learned_addr learned my addr 172.21.15.62:0/3287967359 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:29.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51aaffd700 1 --2- 172.21.15.62:0/3287967359 >> v2:172.21.15.109:3300/0 conn(0x7f51ac0b0cb0 0x7f51ac0afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:29.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51a9ffb700 1 -- 172.21.15.62:0/3287967359 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724889003 0 0) 0x7f51ac0b1090 con 0x7f51ac0acbd0 2021-12-17T18:27:29.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51a9ffb700 1 -- 172.21.15.62:0/3287967359 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5190003260 con 0x7f51ac0acbd0 2021-12-17T18:27:29.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51aaffd700 1 -- 172.21.15.62:0/3287967359 >> v1:172.21.15.109:6789/0 conn(0x7f51ac0af950 legacy=0x7f51ac148120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:29.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51aaffd700 1 -- 172.21.15.62:0/3287967359 >> v1:172.21.15.62:6789/0 conn(0x7f51ac0acbd0 legacy=0x7f51ac146a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:29.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51a9ffb700 1 -- 172.21.15.62:0/3287967359 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281172959 0 0) 0x7f51ac0b1300 con 0x7f51ac0af950 2021-12-17T18:27:29.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51aaffd700 1 -- 172.21.15.62:0/3287967359 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac0b15a0 con 0x7f51ac0b0cb0 2021-12-17T18:27:29.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51aaffd700 1 --2- 172.21.15.62:0/3287967359 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51ac0b0cb0 0x7f51ac0afea0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f51a4002f70 tx=0x7f51a4006df0).ready entity=mon.1 client_cookie=7ffec4f5de709ca5 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:29.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51a9ffb700 1 -- 172.21.15.62:0/3287967359 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51a400d610 con 0x7f51ac0b0cb0 2021-12-17T18:27:29.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51a9ffb700 1 -- 172.21.15.62:0/3287967359 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a4000e90 con 0x7f51ac0b0cb0 2021-12-17T18:27:29.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51a9ffb700 1 -- 172.21.15.62:0/3287967359 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51a400d960 con 0x7f51ac0b0cb0 2021-12-17T18:27:29.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51abfff700 1 -- 172.21.15.62:0/3287967359 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51ac0b0cb0 msgr2=0x7f51ac0afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:29.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51abfff700 1 --2- 172.21.15.62:0/3287967359 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51ac0b0cb0 0x7f51ac0afea0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f51a4002f70 tx=0x7f51a4006df0).stop 2021-12-17T18:27:29.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51abfff700 1 -- 172.21.15.62:0/3287967359 shutdown_connections 2021-12-17T18:27:29.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51abfff700 1 --2- 172.21.15.62:0/3287967359 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51ac0b0cb0 0x7f51ac0afea0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:29.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51abfff700 1 -- 172.21.15.62:0/3287967359 >> 172.21.15.62:0/3287967359 conn(0x7f51ac0b5480 msgr2=0x7f51ac0b5890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:29.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51abfff700 1 -- 172.21.15.62:0/3287967359 shutdown_connections 2021-12-17T18:27:29.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.761+0000 7f51abfff700 1 -- 172.21.15.62:0/3287967359 wait complete. 2021-12-17T18:27:29.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51abfff700 1 Processor -- start 2021-12-17T18:27:29.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51abfff700 1 -- start start 2021-12-17T18:27:29.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51abfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51ac0acbd0 0x7f51ac13dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:29.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51abfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0af950 0x7f51ac148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51abfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51ac0b0cb0 0x7f51ac149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51abfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac066d40 con 0x7f51ac0af950 2021-12-17T18:27:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51abfff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac05c990 con 0x7f51ac0acbd0 2021-12-17T18:27:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51abfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac064230 con 0x7f51ac0b0cb0 2021-12-17T18:27:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51aa7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0af950 0x7f51ac148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51aa7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0af950 0x7f51ac148f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56184/0 (socket says 172.21.15.62:56184) 2021-12-17T18:27:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51aa7fc700 1 -- 172.21.15.62:0/3922261568 learned_addr learned my addr 172.21.15.62:0/3922261568 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51ab7fe700 1 --2- 172.21.15.62:0/3922261568 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51ac0b0cb0 0x7f51ac149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51aaffd700 1 --2- 172.21.15.62:0/3922261568 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51ac0acbd0 0x7f51ac13dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:29.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51aa7fc700 1 -- 172.21.15.62:0/3922261568 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51ac0b0cb0 msgr2=0x7f51ac149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:29.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51aa7fc700 1 --2- 172.21.15.62:0/3922261568 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51ac0b0cb0 0x7f51ac149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:29.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51aa7fc700 1 -- 172.21.15.62:0/3922261568 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51ac0acbd0 msgr2=0x7f51ac13dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:29.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51aa7fc700 1 --2- 172.21.15.62:0/3922261568 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51ac0acbd0 0x7f51ac13dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51aa7fc700 1 -- 172.21.15.62:0/3922261568 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a400b180 con 0x7f51ac0af950 2021-12-17T18:27:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51aa7fc700 1 --2- 172.21.15.62:0/3922261568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0af950 0x7f51ac148f30 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f5194000fe0 tx=0x7f5194007b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51a3fff700 1 -- 172.21.15.62:0/3922261568 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5194012400 con 0x7f51ac0af950 2021-12-17T18:27:29.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51a3fff700 1 -- 172.21.15.62:0/3922261568 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5194012560 con 0x7f51ac0af950 2021-12-17T18:27:29.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51a3fff700 1 -- 172.21.15.62:0/3922261568 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51940128c0 con 0x7f51ac0af950 2021-12-17T18:27:29.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51abfff700 1 -- 172.21.15.62:0/3922261568 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ac05c250 con 0x7f51ac0af950 2021-12-17T18:27:29.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.765+0000 7f51abfff700 1 -- 172.21.15.62:0/3922261568 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac063eb0 con 0x7f51ac0af950 2021-12-17T18:27:29.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.769+0000 7f51abfff700 1 -- 172.21.15.62:0/3922261568 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ac0ad1e0 con 0x7f51ac0af950 2021-12-17T18:27:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.769+0000 7f51a3fff700 1 -- 172.21.15.62:0/3922261568 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5194019030 con 0x7f51ac0af950 2021-12-17T18:27:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.769+0000 7f51a3fff700 1 --2- 172.21.15.62:0/3922261568 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5184053640 0x7f5184055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.769+0000 7f51a3fff700 1 -- 172.21.15.62:0/3922261568 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f519406ac60 con 0x7f51ac0af950 2021-12-17T18:27:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.769+0000 7f51aaffd700 1 --2- 172.21.15.62:0/3922261568 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5184053640 0x7f5184055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:29.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.773+0000 7f51aaffd700 1 --2- 172.21.15.62:0/3922261568 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5184053640 0x7f5184055b00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f51a401a000 tx=0x7f51a4014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:29.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.773+0000 7f51a3fff700 1 -- 172.21.15.62:0/3922261568 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5194041df0 con 0x7f51ac0af950 2021-12-17T18:27:29.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.901+0000 7f51abfff700 1 -- 172.21.15.62:0/3922261568 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f51ac0573d0 con 0x7f51ac0af950 2021-12-17T18:27:29.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.901+0000 7f51a3fff700 1 -- 172.21.15.62:0/3922261568 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v132) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5194045410 con 0x7f51ac0af950 2021-12-17T18:27:29.908 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:27:29.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.905+0000 7f51abfff700 1 -- 172.21.15.62:0/3922261568 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5184053640 msgr2=0x7f5184055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:29.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.905+0000 7f51abfff700 1 --2- 172.21.15.62:0/3922261568 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5184053640 0x7f5184055b00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f51a401a000 tx=0x7f51a4014000).stop 2021-12-17T18:27:29.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.905+0000 7f51abfff700 1 -- 172.21.15.62:0/3922261568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0af950 msgr2=0x7f51ac148f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:29.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.905+0000 7f51abfff700 1 --2- 172.21.15.62:0/3922261568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0af950 0x7f51ac148f30 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f5194000fe0 tx=0x7f5194007b20).stop 2021-12-17T18:27:29.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.905+0000 7f51abfff700 1 -- 172.21.15.62:0/3922261568 shutdown_connections 2021-12-17T18:27:29.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.905+0000 7f51abfff700 1 --2- 172.21.15.62:0/3922261568 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5184053640 0x7f5184055b00 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:29.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.905+0000 7f51abfff700 1 --2- 172.21.15.62:0/3922261568 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f51ac0b0cb0 0x7f51ac149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:29.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.905+0000 7f51abfff700 1 --2- 172.21.15.62:0/3922261568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ac0af950 0x7f51ac148f30 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:29.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.905+0000 7f51abfff700 1 --2- 172.21.15.62:0/3922261568 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f51ac0acbd0 0x7f51ac13dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:29.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.905+0000 7f51abfff700 1 -- 172.21.15.62:0/3922261568 >> 172.21.15.62:0/3922261568 conn(0x7f51ac0b5480 msgr2=0x7f51ac146800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:29.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.905+0000 7f51abfff700 1 -- 172.21.15.62:0/3922261568 shutdown_connections 2021-12-17T18:27:29.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:29.905+0000 7f51abfff700 1 -- 172.21.15.62:0/3922261568 wait complete. 2021-12-17T18:27:29.926 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:27:30.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.033+0000 7f6a37db9700 1 Processor -- start 2021-12-17T18:27:30.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.033+0000 7f6a37db9700 1 -- start start 2021-12-17T18:27:30.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.033+0000 7f6a37db9700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6a300b6590 0x7f6a300b6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.033+0000 7f6a37db9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6a30143c80 0x7f6a3013d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.033+0000 7f6a37db9700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a300b51b0 con 0x7f6a300b4590 2021-12-17T18:27:30.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.033+0000 7f6a37db9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a30144680 con 0x7f6a30143c80 2021-12-17T18:27:30.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.033+0000 7f6a37db9700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a30146d10 con 0x7f6a300b6590 2021-12-17T18:27:30.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.033+0000 7f6a36356700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6a30143c80 0x7f6a3013d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.033+0000 7f6a36356700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6a30143c80 0x7f6a3013d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56194/0 (socket says 172.21.15.62:56194) 2021-12-17T18:27:30.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.033+0000 7f6a36356700 1 -- 172.21.15.62:0/1141244624 learned_addr learned my addr 172.21.15.62:0/1141244624 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:30.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.033+0000 7f6a35b55700 1 --2- 172.21.15.62:0/1141244624 >> v2:172.21.15.109:3300/0 conn(0x7f6a300b6590 0x7f6a300b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.033+0000 7f6a36356700 1 -- 172.21.15.62:0/1141244624 >> v2:172.21.15.109:3300/0 conn(0x7f6a300b6590 msgr2=0x7f6a300b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:30.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.033+0000 7f6a36356700 1 --2- 172.21.15.62:0/1141244624 >> v2:172.21.15.109:3300/0 conn(0x7f6a300b6590 0x7f6a300b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.037+0000 7f6a36356700 1 -- 172.21.15.62:0/1141244624 >> v1:172.21.15.109:6789/0 conn(0x7f6a300b4590 legacy=0x7f6a300b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.037+0000 7f6a36356700 1 -- 172.21.15.62:0/1141244624 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a30143540 con 0x7f6a30143c80 2021-12-17T18:27:30.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.037+0000 7f6a36356700 1 --2- 172.21.15.62:0/1141244624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a30143c80 0x7f6a3013d080 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f6a280032f0 tx=0x7f6a28009290).ready entity=mon.0 client_cookie=8a9caf433efc4c17 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:30.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.037+0000 7f6a34b53700 1 -- 172.21.15.62:0/1141244624 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a2800b870 con 0x7f6a30143c80 2021-12-17T18:27:30.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.037+0000 7f6a34b53700 1 -- 172.21.15.62:0/1141244624 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2800b9d0 con 0x7f6a30143c80 2021-12-17T18:27:30.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.037+0000 7f6a34b53700 1 -- 172.21.15.62:0/1141244624 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a2800bb40 con 0x7f6a30143c80 2021-12-17T18:27:30.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.037+0000 7f6a37db9700 1 -- 172.21.15.62:0/1141244624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a30143c80 msgr2=0x7f6a3013d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.037+0000 7f6a37db9700 1 --2- 172.21.15.62:0/1141244624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a30143c80 0x7f6a3013d080 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f6a280032f0 tx=0x7f6a28009290).stop 2021-12-17T18:27:30.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.037+0000 7f6a37db9700 1 -- 172.21.15.62:0/1141244624 shutdown_connections 2021-12-17T18:27:30.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.037+0000 7f6a37db9700 1 --2- 172.21.15.62:0/1141244624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a30143c80 0x7f6a3013d080 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.037+0000 7f6a37db9700 1 --2- 172.21.15.62:0/1141244624 >> v2:172.21.15.109:3300/0 conn(0x7f6a300b6590 0x7f6a300b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.037+0000 7f6a37db9700 1 -- 172.21.15.62:0/1141244624 >> 172.21.15.62:0/1141244624 conn(0x7f6a30061b20 msgr2=0x7f6a30061f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:30.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.037+0000 7f6a37db9700 1 -- 172.21.15.62:0/1141244624 shutdown_connections 2021-12-17T18:27:30.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.037+0000 7f6a37db9700 1 -- 172.21.15.62:0/1141244624 wait complete. 2021-12-17T18:27:30.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.037+0000 7f6a37db9700 1 Processor -- start 2021-12-17T18:27:30.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.037+0000 7f6a37db9700 1 -- start start 2021-12-17T18:27:30.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.037+0000 7f6a37db9700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a300b4590 0x7f6a300ad570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a37db9700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6a300b6590 0x7f6a30152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a37db9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a30143c80 0x7f6a30141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a37db9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300b0430 con 0x7f6a30143c80 2021-12-17T18:27:30.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a37db9700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300b0190 con 0x7f6a300b6590 2021-12-17T18:27:30.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a37db9700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300ada60 con 0x7f6a300b4590 2021-12-17T18:27:30.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a36356700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a30143c80 0x7f6a30141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a36356700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a30143c80 0x7f6a30141000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56200/0 (socket says 172.21.15.62:56200) 2021-12-17T18:27:30.053 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a36356700 1 -- 172.21.15.62:0/2239488164 learned_addr learned my addr 172.21.15.62:0/2239488164 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:30.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a35b55700 1 --2- 172.21.15.62:0/2239488164 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a300b4590 0x7f6a300ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a35354700 1 --2- 172.21.15.62:0/2239488164 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6a300b6590 0x7f6a30152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a36356700 1 -- 172.21.15.62:0/2239488164 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a300b4590 msgr2=0x7f6a300ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a36356700 1 --2- 172.21.15.62:0/2239488164 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a300b4590 0x7f6a300ad570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a36356700 1 -- 172.21.15.62:0/2239488164 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6a300b6590 msgr2=0x7f6a30152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a36356700 1 --2- 172.21.15.62:0/2239488164 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6a300b6590 0x7f6a30152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a36356700 1 -- 172.21.15.62:0/2239488164 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a28009530 con 0x7f6a30143c80 2021-12-17T18:27:30.055 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a36356700 1 --2- 172.21.15.62:0/2239488164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a30143c80 0x7f6a30141000 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f6a280032f0 tx=0x7f6a28016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:30.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a22ffd700 1 -- 172.21.15.62:0/2239488164 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a2800b870 con 0x7f6a30143c80 2021-12-17T18:27:30.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a22ffd700 1 -- 172.21.15.62:0/2239488164 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a28021440 con 0x7f6a30143c80 2021-12-17T18:27:30.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a37db9700 1 -- 172.21.15.62:0/2239488164 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a30152e80 con 0x7f6a30143c80 2021-12-17T18:27:30.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a22ffd700 1 -- 172.21.15.62:0/2239488164 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a280217a0 con 0x7f6a30143c80 2021-12-17T18:27:30.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a37db9700 1 -- 172.21.15.62:0/2239488164 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a300b3900 con 0x7f6a30143c80 2021-12-17T18:27:30.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a22ffd700 1 -- 172.21.15.62:0/2239488164 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6a28027020 con 0x7f6a30143c80 2021-12-17T18:27:30.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a37db9700 1 -- 172.21.15.62:0/2239488164 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a300affc0 con 0x7f6a30143c80 2021-12-17T18:27:30.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a22ffd700 1 --2- 172.21.15.62:0/2239488164 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6a100536a0 0x7f6a10055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a22ffd700 1 -- 172.21.15.62:0/2239488164 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6a2806ce60 con 0x7f6a30143c80 2021-12-17T18:27:30.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.041+0000 7f6a35b55700 1 --2- 172.21.15.62:0/2239488164 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6a100536a0 0x7f6a10055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.045+0000 7f6a35b55700 1 --2- 172.21.15.62:0/2239488164 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6a100536a0 0x7f6a10055b60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f6a2c00c000 tx=0x7f6a2c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:30.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.049+0000 7f6a22ffd700 1 -- 172.21.15.62:0/2239488164 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6a28044070 con 0x7f6a30143c80 2021-12-17T18:27:30.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.177+0000 7f6a37db9700 1 -- 172.21.15.62:0/2239488164 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6a301437e0 con 0x7f6a30143c80 2021-12-17T18:27:30.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.177+0000 7f6a22ffd700 1 -- 172.21.15.62:0/2239488164 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v132) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6a28015070 con 0x7f6a30143c80 2021-12-17T18:27:30.184 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:27:30.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.181+0000 7f6a37db9700 1 -- 172.21.15.62:0/2239488164 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6a100536a0 msgr2=0x7f6a10055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.181+0000 7f6a37db9700 1 --2- 172.21.15.62:0/2239488164 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6a100536a0 0x7f6a10055b60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f6a2c00c000 tx=0x7f6a2c008040).stop 2021-12-17T18:27:30.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.181+0000 7f6a37db9700 1 -- 172.21.15.62:0/2239488164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a30143c80 msgr2=0x7f6a30141000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.181+0000 7f6a37db9700 1 --2- 172.21.15.62:0/2239488164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a30143c80 0x7f6a30141000 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f6a280032f0 tx=0x7f6a28016000).stop 2021-12-17T18:27:30.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.181+0000 7f6a37db9700 1 -- 172.21.15.62:0/2239488164 shutdown_connections 2021-12-17T18:27:30.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.181+0000 7f6a37db9700 1 --2- 172.21.15.62:0/2239488164 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6a100536a0 0x7f6a10055b60 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.181+0000 7f6a37db9700 1 --2- 172.21.15.62:0/2239488164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a30143c80 0x7f6a30141000 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.181+0000 7f6a37db9700 1 --2- 172.21.15.62:0/2239488164 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6a300b6590 0x7f6a30152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.181+0000 7f6a37db9700 1 --2- 172.21.15.62:0/2239488164 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6a300b4590 0x7f6a300ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.181+0000 7f6a37db9700 1 -- 172.21.15.62:0/2239488164 >> 172.21.15.62:0/2239488164 conn(0x7f6a30061b20 msgr2=0x7f6a30145f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:30.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.181+0000 7f6a37db9700 1 -- 172.21.15.62:0/2239488164 shutdown_connections 2021-12-17T18:27:30.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.181+0000 7f6a37db9700 1 -- 172.21.15.62:0/2239488164 wait complete. 2021-12-17T18:27:30.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:27:30.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.305+0000 7ff4c8005700 1 Processor -- start 2021-12-17T18:27:30.312 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.305+0000 7ff4c8005700 1 -- start start 2021-12-17T18:27:30.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c8005700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff4c0061ac0 0x7ff4c013ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c8005700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c0147620 con 0x7ff4c00ae6f0 2021-12-17T18:27:30.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c8005700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c005cb90 con 0x7ff4c013d330 2021-12-17T18:27:30.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c8005700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c00adc20 con 0x7ff4c0061ac0 2021-12-17T18:27:30.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c65a2700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff4c00ae6f0 0x7ff4c005c480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39788/0 (socket says 172.21.15.62:39788) 2021-12-17T18:27:30.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c65a2700 1 -- 172.21.15.62:0/998905807 learned_addr learned my addr 172.21.15.62:0/998905807 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:30.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c5da1700 1 --2- 172.21.15.62:0/998905807 >> v2:172.21.15.62:3300/0 conn(0x7ff4c0061ac0 0x7ff4c013ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.315 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c4d9f700 1 -- 172.21.15.62:0/998905807 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553074975 0 0) 0x7ff4c0147620 con 0x7ff4c00ae6f0 2021-12-17T18:27:30.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c4d9f700 1 -- 172.21.15.62:0/998905807 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a8003260 con 0x7ff4c00ae6f0 2021-12-17T18:27:30.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c5da1700 1 -- 172.21.15.62:0/998905807 >> v1:172.21.15.109:6789/0 conn(0x7ff4c013d330 legacy=0x7ff4c005bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c4d9f700 1 -- 172.21.15.62:0/998905807 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1270429607 0 0) 0x7ff4a8003260 con 0x7ff4c00ae6f0 2021-12-17T18:27:30.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c5da1700 1 -- 172.21.15.62:0/998905807 >> v1:172.21.15.62:6789/0 conn(0x7ff4c00ae6f0 legacy=0x7ff4c005c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c5da1700 1 -- 172.21.15.62:0/998905807 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c0146c40 con 0x7ff4c0061ac0 2021-12-17T18:27:30.317 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c5da1700 1 --2- 172.21.15.62:0/998905807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4c0061ac0 0x7ff4c013ce40 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7ff4b8001b80 tx=0x7ff4bc006df0).ready entity=mon.0 client_cookie=5af6c83193c896b6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:30.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c4d9f700 1 -- 172.21.15.62:0/998905807 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4b80019e0 con 0x7ff4c0061ac0 2021-12-17T18:27:30.321 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c4d9f700 1 -- 172.21.15.62:0/998905807 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc000e90 con 0x7ff4c0061ac0 2021-12-17T18:27:30.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c4d9f700 1 -- 172.21.15.62:0/998905807 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4bc00d4f0 con 0x7ff4c0061ac0 2021-12-17T18:27:30.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c8005700 1 -- 172.21.15.62:0/998905807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4c0061ac0 msgr2=0x7ff4c013ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c8005700 1 --2- 172.21.15.62:0/998905807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4c0061ac0 0x7ff4c013ce40 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7ff4b8001b80 tx=0x7ff4bc006df0).stop 2021-12-17T18:27:30.322 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c8005700 1 -- 172.21.15.62:0/998905807 shutdown_connections 2021-12-17T18:27:30.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c8005700 1 --2- 172.21.15.62:0/998905807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4c0061ac0 0x7ff4c013ce40 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c8005700 1 -- 172.21.15.62:0/998905807 >> 172.21.15.62:0/998905807 conn(0x7ff4c00b99b0 msgr2=0x7ff4c00b9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:30.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c8005700 1 -- 172.21.15.62:0/998905807 shutdown_connections 2021-12-17T18:27:30.323 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.309+0000 7ff4c8005700 1 -- 172.21.15.62:0/998905807 wait complete. 2021-12-17T18:27:30.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c8005700 1 Processor -- start 2021-12-17T18:27:30.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c8005700 1 -- start start 2021-12-17T18:27:30.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c8005700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4c0061ac0 0x7ff4c0153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.324 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c8005700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff4c00ae6f0 0x7ff4c0141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c8005700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4c013d330 0x7ff4c013df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c8005700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c0152660 con 0x7ff4c013d330 2021-12-17T18:27:30.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c8005700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c0152900 con 0x7ff4c00ae6f0 2021-12-17T18:27:30.325 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c8005700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c0152ba0 con 0x7ff4c0061ac0 2021-12-17T18:27:30.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c65a2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4c013d330 0x7ff4c013df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c65a2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4c013d330 0x7ff4c013df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56210/0 (socket says 172.21.15.62:56210) 2021-12-17T18:27:30.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c65a2700 1 -- 172.21.15.62:0/2238684814 learned_addr learned my addr 172.21.15.62:0/2238684814 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:30.326 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c5da1700 1 --2- 172.21.15.62:0/2238684814 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4c0061ac0 0x7ff4c0153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c55a0700 1 --2- 172.21.15.62:0/2238684814 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff4c00ae6f0 0x7ff4c0141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c65a2700 1 -- 172.21.15.62:0/2238684814 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4c0061ac0 msgr2=0x7ff4c0153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c65a2700 1 --2- 172.21.15.62:0/2238684814 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4c0061ac0 0x7ff4c0153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c65a2700 1 -- 172.21.15.62:0/2238684814 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff4c00ae6f0 msgr2=0x7ff4c0141810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c65a2700 1 --2- 172.21.15.62:0/2238684814 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff4c00ae6f0 0x7ff4c0141810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c65a2700 1 -- 172.21.15.62:0/2238684814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc00b180 con 0x7ff4c013d330 2021-12-17T18:27:30.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c65a2700 1 --2- 172.21.15.62:0/2238684814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4c013d330 0x7ff4c013df70 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7ff4b8001c40 tx=0x7ff4b8001640).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:30.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4b2ffd700 1 -- 172.21.15.62:0/2238684814 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4b8004ab0 con 0x7ff4c013d330 2021-12-17T18:27:30.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4b2ffd700 1 -- 172.21.15.62:0/2238684814 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b8004c10 con 0x7ff4c013d330 2021-12-17T18:27:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c8005700 1 -- 172.21.15.62:0/2238684814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c013e460 con 0x7ff4c013d330 2021-12-17T18:27:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4b2ffd700 1 -- 172.21.15.62:0/2238684814 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4b8007170 con 0x7ff4c013d330 2021-12-17T18:27:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c8005700 1 -- 172.21.15.62:0/2238684814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c01518a0 con 0x7ff4c013d330 2021-12-17T18:27:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4b2ffd700 1 -- 172.21.15.62:0/2238684814 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff4b801b060 con 0x7ff4c013d330 2021-12-17T18:27:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.313+0000 7ff4c8005700 1 -- 172.21.15.62:0/2238684814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c0152d60 con 0x7ff4c013d330 2021-12-17T18:27:30.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.317+0000 7ff4b2ffd700 1 --2- 172.21.15.62:0/2238684814 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4a0053610 0x7ff4a0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.317+0000 7ff4b2ffd700 1 -- 172.21.15.62:0/2238684814 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff4b806b610 con 0x7ff4c013d330 2021-12-17T18:27:30.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.317+0000 7ff4c5da1700 1 --2- 172.21.15.62:0/2238684814 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4a0053610 0x7ff4a0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.317+0000 7ff4c5da1700 1 --2- 172.21.15.62:0/2238684814 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4a0053610 0x7ff4a0055ad0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7ff4bc018000 tx=0x7ff4bc014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.321+0000 7ff4b2ffd700 1 -- 172.21.15.62:0/2238684814 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff4b8042770 con 0x7ff4c013d330 2021-12-17T18:27:30.452 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.449+0000 7ff4c8005700 1 -- 172.21.15.62:0/2238684814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4c0146ee0 con 0x7ff4c013d330 2021-12-17T18:27:30.453 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.449+0000 7ff4b2ffd700 1 -- 172.21.15.62:0/2238684814 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v132) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff4b8019070 con 0x7ff4c013d330 2021-12-17T18:27:30.454 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:27:30.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.449+0000 7ff4c8005700 1 -- 172.21.15.62:0/2238684814 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4a0053610 msgr2=0x7ff4a0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.455 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.449+0000 7ff4c8005700 1 --2- 172.21.15.62:0/2238684814 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4a0053610 0x7ff4a0055ad0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7ff4bc018000 tx=0x7ff4bc014000).stop 2021-12-17T18:27:30.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.449+0000 7ff4c8005700 1 -- 172.21.15.62:0/2238684814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4c013d330 msgr2=0x7ff4c013df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.449+0000 7ff4c8005700 1 --2- 172.21.15.62:0/2238684814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4c013d330 0x7ff4c013df70 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7ff4b8001c40 tx=0x7ff4b8001640).stop 2021-12-17T18:27:30.456 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.449+0000 7ff4c8005700 1 -- 172.21.15.62:0/2238684814 shutdown_connections 2021-12-17T18:27:30.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.449+0000 7ff4c8005700 1 --2- 172.21.15.62:0/2238684814 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff4a0053610 0x7ff4a0055ad0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.449+0000 7ff4c8005700 1 --2- 172.21.15.62:0/2238684814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4c013d330 0x7ff4c013df70 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.449+0000 7ff4c8005700 1 --2- 172.21.15.62:0/2238684814 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff4c00ae6f0 0x7ff4c0141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.449+0000 7ff4c8005700 1 --2- 172.21.15.62:0/2238684814 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4c0061ac0 0x7ff4c0153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.449+0000 7ff4c8005700 1 -- 172.21.15.62:0/2238684814 >> 172.21.15.62:0/2238684814 conn(0x7ff4c00b99b0 msgr2=0x7ff4c00b8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:30.458 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.449+0000 7ff4c8005700 1 -- 172.21.15.62:0/2238684814 shutdown_connections 2021-12-17T18:27:30.459 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.449+0000 7ff4c8005700 1 -- 172.21.15.62:0/2238684814 wait complete. 2021-12-17T18:27:30.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:27:30.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.577+0000 7f5c0ffff700 1 Processor -- start 2021-12-17T18:27:30.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.577+0000 7f5c0ffff700 1 -- start start 2021-12-17T18:27:30.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.577+0000 7f5c0ffff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5c100af3a0 0x7f5c100af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.577+0000 7f5c0ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5c100afea0 0x7f5c1014ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.577+0000 7f5c0ffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c100aea60 con 0x7f5c1014b180 2021-12-17T18:27:30.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.577+0000 7f5c0ffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c100b18b0 con 0x7f5c100afea0 2021-12-17T18:27:30.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.577+0000 7f5c0ffff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c101476d0 con 0x7f5c100af3a0 2021-12-17T18:27:30.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.577+0000 7f5c0e7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5c100afea0 0x7f5c1014ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.577+0000 7f5c0f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5c1014b180 0x7f5c1014b590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39802/0 (socket says 172.21.15.62:39802) 2021-12-17T18:27:30.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.577+0000 7f5c0f7fe700 1 -- 172.21.15.62:0/2207000161 learned_addr learned my addr 172.21.15.62:0/2207000161 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:30.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.577+0000 7f5c0e7fc700 1 -- 172.21.15.62:0/2207000161 >> v2:172.21.15.109:3300/0 conn(0x7f5c100af3a0 msgr2=0x7f5c100af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:30.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.577+0000 7f5c0e7fc700 1 --2- 172.21.15.62:0/2207000161 >> v2:172.21.15.109:3300/0 conn(0x7f5c100af3a0 0x7f5c100af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-12-17T18:27:30.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.577+0000 7f5c0e7fc700 1 -- 172.21.15.62:0/2207000161 >> v1:172.21.15.62:6789/0 conn(0x7f5c1014b180 legacy=0x7f5c1014b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.577+0000 7f5c0e7fc700 1 -- 172.21.15.62:0/2207000161 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c100aec90 con 0x7f5c100afea0 2021-12-17T18:27:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.577+0000 7f5c0e7fc700 1 --2- 172.21.15.62:0/2207000161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c100afea0 0x7f5c1014ac90 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f5c00002f70 tx=0x7f5c00006df0).ready entity=mon.0 client_cookie=2fb166d610e7f014 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.577+0000 7f5c0dffb700 1 -- 172.21.15.62:0/2207000161 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c0000d5c0 con 0x7f5c100afea0 2021-12-17T18:27:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0dffb700 1 -- 172.21.15.62:0/2207000161 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c00000e90 con 0x7f5c100afea0 2021-12-17T18:27:30.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0dffb700 1 -- 172.21.15.62:0/2207000161 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c0000d910 con 0x7f5c100afea0 2021-12-17T18:27:30.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 -- 172.21.15.62:0/2207000161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c100afea0 msgr2=0x7f5c1014ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 --2- 172.21.15.62:0/2207000161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c100afea0 0x7f5c1014ac90 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f5c00002f70 tx=0x7f5c00006df0).stop 2021-12-17T18:27:30.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 -- 172.21.15.62:0/2207000161 shutdown_connections 2021-12-17T18:27:30.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 --2- 172.21.15.62:0/2207000161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c100afea0 0x7f5c1014ac90 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 --2- 172.21.15.62:0/2207000161 >> v2:172.21.15.109:3300/0 conn(0x7f5c100af3a0 0x7f5c100af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-12-17T18:27:30.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 -- 172.21.15.62:0/2207000161 >> 172.21.15.62:0/2207000161 conn(0x7f5c100b5480 msgr2=0x7f5c100b5890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:30.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 -- 172.21.15.62:0/2207000161 shutdown_connections 2021-12-17T18:27:30.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 -- 172.21.15.62:0/2207000161 wait complete. 2021-12-17T18:27:30.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 Processor -- start 2021-12-17T18:27:30.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 -- start start 2021-12-17T18:27:30.594 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c100af3a0 0x7f5c10141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c100afea0 0x7f5c1005cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c1014b180 0x7f5c100a9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100ac1b0 con 0x7f5c100af3a0 2021-12-17T18:27:30.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100ac450 con 0x7f5c100afea0 2021-12-17T18:27:30.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c101404d0 con 0x7f5c1014b180 2021-12-17T18:27:30.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c100af3a0 0x7f5c10141440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c100af3a0 0x7f5c10141440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56224/0 (socket says 172.21.15.62:56224) 2021-12-17T18:27:30.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0effd700 1 -- 172.21.15.62:0/2583988203 learned_addr learned my addr 172.21.15.62:0/2583988203 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:30.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0f7fe700 1 --2- 172.21.15.62:0/2583988203 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c1014b180 0x7f5c100a9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0e7fc700 1 --2- 172.21.15.62:0/2583988203 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c100afea0 0x7f5c1005cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0effd700 1 -- 172.21.15.62:0/2583988203 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c1014b180 msgr2=0x7f5c100a9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0effd700 1 --2- 172.21.15.62:0/2583988203 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c1014b180 0x7f5c100a9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0effd700 1 -- 172.21.15.62:0/2583988203 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c100afea0 msgr2=0x7f5c1005cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0effd700 1 --2- 172.21.15.62:0/2583988203 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c100afea0 0x7f5c1005cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0effd700 1 -- 172.21.15.62:0/2583988203 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0000b180 con 0x7f5c100af3a0 2021-12-17T18:27:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0e7fc700 1 --2- 172.21.15.62:0/2583988203 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c100afea0 0x7f5c1005cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0effd700 1 --2- 172.21.15.62:0/2583988203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c100af3a0 0x7f5c10141440 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f5c04002f70 tx=0x7f5c04006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:30.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5bfffff700 1 -- 172.21.15.62:0/2583988203 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c04013460 con 0x7f5c100af3a0 2021-12-17T18:27:30.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5bfffff700 1 -- 172.21.15.62:0/2583988203 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c040135c0 con 0x7f5c100af3a0 2021-12-17T18:27:30.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5bfffff700 1 -- 172.21.15.62:0/2583988203 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c04013920 con 0x7f5c100af3a0 2021-12-17T18:27:30.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 -- 172.21.15.62:0/2583988203 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c100a9740 con 0x7f5c100af3a0 2021-12-17T18:27:30.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.581+0000 7f5c0ffff700 1 -- 172.21.15.62:0/2583988203 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c100a8e60 con 0x7f5c100af3a0 2021-12-17T18:27:30.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.585+0000 7f5c0ffff700 1 -- 172.21.15.62:0/2583988203 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c100ac020 con 0x7f5c100af3a0 2021-12-17T18:27:30.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.585+0000 7f5bfffff700 1 -- 172.21.15.62:0/2583988203 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5c0400f070 con 0x7f5c100af3a0 2021-12-17T18:27:30.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.585+0000 7f5bfffff700 1 --2- 172.21.15.62:0/2583988203 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bec053610 0x7f5bec055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.585+0000 7f5bfffff700 1 -- 172.21.15.62:0/2583988203 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5c0406b2a0 con 0x7f5c100af3a0 2021-12-17T18:27:30.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.585+0000 7f5c0e7fc700 1 --2- 172.21.15.62:0/2583988203 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bec053610 0x7f5bec055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.589+0000 7f5c0e7fc700 1 --2- 172.21.15.62:0/2583988203 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bec053610 0x7f5bec055ad0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f5c00018000 tx=0x7f5c00014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:30.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.593+0000 7f5bfffff700 1 -- 172.21.15.62:0/2583988203 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5c04042400 con 0x7f5c100af3a0 2021-12-17T18:27:30.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.717+0000 7f5c0ffff700 1 -- 172.21.15.62:0/2583988203 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c10140690 con 0x7f5c100af3a0 2021-12-17T18:27:30.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.721+0000 7f5bfffff700 1 -- 172.21.15.62:0/2583988203 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v132) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5c04045a20 con 0x7f5c100af3a0 2021-12-17T18:27:30.725 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:27:30.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.721+0000 7f5c0ffff700 1 -- 172.21.15.62:0/2583988203 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bec053610 msgr2=0x7f5bec055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.721+0000 7f5c0ffff700 1 --2- 172.21.15.62:0/2583988203 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bec053610 0x7f5bec055ad0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f5c00018000 tx=0x7f5c00014000).stop 2021-12-17T18:27:30.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.721+0000 7f5c0ffff700 1 -- 172.21.15.62:0/2583988203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c100af3a0 msgr2=0x7f5c10141440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.721+0000 7f5c0ffff700 1 --2- 172.21.15.62:0/2583988203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c100af3a0 0x7f5c10141440 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f5c04002f70 tx=0x7f5c04006ec0).stop 2021-12-17T18:27:30.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.721+0000 7f5c0ffff700 1 -- 172.21.15.62:0/2583988203 shutdown_connections 2021-12-17T18:27:30.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.721+0000 7f5c0ffff700 1 --2- 172.21.15.62:0/2583988203 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5bec053610 0x7f5bec055ad0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.721+0000 7f5c0ffff700 1 --2- 172.21.15.62:0/2583988203 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c1014b180 0x7f5c100a9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.721+0000 7f5c0ffff700 1 --2- 172.21.15.62:0/2583988203 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c100afea0 0x7f5c1005cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.721+0000 7f5c0ffff700 1 --2- 172.21.15.62:0/2583988203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c100af3a0 0x7f5c10141440 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.721+0000 7f5c0ffff700 1 -- 172.21.15.62:0/2583988203 >> 172.21.15.62:0/2583988203 conn(0x7f5c100b5480 msgr2=0x7f5c100b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:30.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.721+0000 7f5c0ffff700 1 -- 172.21.15.62:0/2583988203 shutdown_connections 2021-12-17T18:27:30.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.721+0000 7f5c0ffff700 1 -- 172.21.15.62:0/2583988203 wait complete. 2021-12-17T18:27:30.738 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:27:30.739 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:30.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff879204700 1 Processor -- start 2021-12-17T18:27:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff879204700 1 -- start start 2021-12-17T18:27:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff879204700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff8740afea0 0x7ff8740af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff879204700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff8740ae6f0 0x7ff8741465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff879204700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8740ad0e0 con 0x7ff8740acd00 2021-12-17T18:27:30.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff879204700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8740b0540 con 0x7ff8740afea0 2021-12-17T18:27:30.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff879204700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740b0bd0 con 0x7ff8740ae6f0 2021-12-17T18:27:30.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff873fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff8740acd00 0x7ff8740adfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39812/0 (socket says 172.21.15.62:39812) 2021-12-17T18:27:30.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff873fff700 1 -- 172.21.15.62:0/3667387307 learned_addr learned my addr 172.21.15.62:0/3667387307 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff8737fe700 1 --2- 172.21.15.62:0/3667387307 >> v2:172.21.15.109:3300/0 conn(0x7ff8740afea0 0x7ff8740af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff878a03700 1 --2- 172.21.15.62:0/3667387307 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff8740ae6f0 0x7ff8741465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff872ffd700 1 -- 172.21.15.62:0/3667387307 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853812840 0 0) 0x7ff8740ad0e0 con 0x7ff8740acd00 2021-12-17T18:27:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff872ffd700 1 -- 172.21.15.62:0/3667387307 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff860003260 con 0x7ff8740acd00 2021-12-17T18:27:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff8737fe700 1 -- 172.21.15.62:0/3667387307 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff8740ae6f0 msgr2=0x7ff8741465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff8737fe700 1 --2- 172.21.15.62:0/3667387307 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff8740ae6f0 0x7ff8741465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff8737fe700 1 -- 172.21.15.62:0/3667387307 >> v1:172.21.15.62:6789/0 conn(0x7ff8740acd00 legacy=0x7ff8740adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff8737fe700 1 -- 172.21.15.62:0/3667387307 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8740af090 con 0x7ff8740afea0 2021-12-17T18:27:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff878a03700 1 --2- 172.21.15.62:0/3667387307 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff8740ae6f0 0x7ff8741465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.837+0000 7ff8737fe700 1 --2- 172.21.15.62:0/3667387307 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff8740afea0 0x7ff8740af7d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7ff8640032f0 tx=0x7ff8640091d0).ready entity=mon.1 client_cookie=c4eaf1fd260265 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff872ffd700 1 -- 172.21.15.62:0/3667387307 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff86400b600 con 0x7ff8740afea0 2021-12-17T18:27:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff872ffd700 1 -- 172.21.15.62:0/3667387307 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86400b760 con 0x7ff8740afea0 2021-12-17T18:27:30.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff872ffd700 1 -- 172.21.15.62:0/3667387307 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff86400b8d0 con 0x7ff8740afea0 2021-12-17T18:27:30.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff879204700 1 -- 172.21.15.62:0/3667387307 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff8740afea0 msgr2=0x7ff8740af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff879204700 1 --2- 172.21.15.62:0/3667387307 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff8740afea0 0x7ff8740af7d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7ff8640032f0 tx=0x7ff8640091d0).stop 2021-12-17T18:27:30.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff879204700 1 -- 172.21.15.62:0/3667387307 shutdown_connections 2021-12-17T18:27:30.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff879204700 1 --2- 172.21.15.62:0/3667387307 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff8740ae6f0 0x7ff8741465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff879204700 1 --2- 172.21.15.62:0/3667387307 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff8740afea0 0x7ff8740af7d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff879204700 1 -- 172.21.15.62:0/3667387307 >> 172.21.15.62:0/3667387307 conn(0x7ff8740b5480 msgr2=0x7ff8740b5890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:30.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff879204700 1 -- 172.21.15.62:0/3667387307 shutdown_connections 2021-12-17T18:27:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff879204700 1 -- 172.21.15.62:0/3667387307 wait complete. 2021-12-17T18:27:30.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff879204700 1 Processor -- start 2021-12-17T18:27:30.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff879204700 1 -- start start 2021-12-17T18:27:30.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff879204700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff8740acd00 0x7ff8741492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff879204700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff8740ae6f0 0x7ff8740a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff879204700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8740afea0 0x7ff874156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff879204700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87414aa80 con 0x7ff8740afea0 2021-12-17T18:27:30.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff879204700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87414ad20 con 0x7ff8740ae6f0 2021-12-17T18:27:30.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff879204700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740a76a0 con 0x7ff8740acd00 2021-12-17T18:27:30.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff878a03700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8740afea0 0x7ff874156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff878a03700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8740afea0 0x7ff874156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56242/0 (socket says 172.21.15.62:56242) 2021-12-17T18:27:30.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff878a03700 1 -- 172.21.15.62:0/3120066699 learned_addr learned my addr 172.21.15.62:0/3120066699 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:30.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff873fff700 1 --2- 172.21.15.62:0/3120066699 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff8740acd00 0x7ff8741492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.841+0000 7ff8737fe700 1 --2- 172.21.15.62:0/3120066699 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff8740ae6f0 0x7ff8740a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.845+0000 7ff873fff700 1 -- 172.21.15.62:0/3120066699 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff8740ae6f0 msgr2=0x7ff8740a7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.845+0000 7ff873fff700 1 --2- 172.21.15.62:0/3120066699 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff8740ae6f0 0x7ff8740a7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.845+0000 7ff873fff700 1 -- 172.21.15.62:0/3120066699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8740afea0 msgr2=0x7ff874156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:30.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.845+0000 7ff873fff700 1 --2- 172.21.15.62:0/3120066699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8740afea0 0x7ff874156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.845+0000 7ff873fff700 1 -- 172.21.15.62:0/3120066699 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c00b180 con 0x7ff8740acd00 2021-12-17T18:27:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.845+0000 7ff878a03700 1 --2- 172.21.15.62:0/3120066699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8740afea0 0x7ff874156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.845+0000 7ff873fff700 1 --2- 172.21.15.62:0/3120066699 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff8740acd00 0x7ff8741492d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7ff868001110 tx=0x7ff868007ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.845+0000 7ff8717fa700 1 -- 172.21.15.62:0/3120066699 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8680070d0 con 0x7ff8740acd00 2021-12-17T18:27:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.845+0000 7ff8717fa700 1 -- 172.21.15.62:0/3120066699 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff868007230 con 0x7ff8740acd00 2021-12-17T18:27:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.845+0000 7ff879204700 1 -- 172.21.15.62:0/3120066699 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff864009470 con 0x7ff8740acd00 2021-12-17T18:27:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.845+0000 7ff8717fa700 1 -- 172.21.15.62:0/3120066699 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff868005610 con 0x7ff8740acd00 2021-12-17T18:27:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.845+0000 7ff879204700 1 -- 172.21.15.62:0/3120066699 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8740a82d0 con 0x7ff8740acd00 2021-12-17T18:27:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.845+0000 7ff879204700 1 -- 172.21.15.62:0/3120066699 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff874064aa0 con 0x7ff8740acd00 2021-12-17T18:27:30.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.845+0000 7ff8717fa700 1 -- 172.21.15.62:0/3120066699 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff868010070 con 0x7ff8740acd00 2021-12-17T18:27:30.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.845+0000 7ff8717fa700 1 --2- 172.21.15.62:0/3120066699 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff854053610 0x7ff854055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:30.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.845+0000 7ff8717fa700 1 -- 172.21.15.62:0/3120066699 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff86806b050 con 0x7ff8740acd00 2021-12-17T18:27:30.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.845+0000 7ff8737fe700 1 --2- 172.21.15.62:0/3120066699 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff854053610 0x7ff854055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:30.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.849+0000 7ff8737fe700 1 --2- 172.21.15.62:0/3120066699 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff854053610 0x7ff854055ad0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7ff86401c000 tx=0x7ff864016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:30.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:30.857+0000 7ff8717fa700 1 -- 172.21.15.62:0/3120066699 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff868042110 con 0x7ff8740acd00 2021-12-17T18:27:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:31.021+0000 7ff879204700 1 -- 172.21.15.62:0/3120066699 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8740573d0 con 0x7ff8740acd00 2021-12-17T18:27:31.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:31.021+0000 7ff8717fa700 1 -- 172.21.15.62:0/3120066699 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2142 (secure 0 0 0) 0x7ff868045730 con 0x7ff8740acd00 2021-12-17T18:27:31.029 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:31.029 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7957,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6833/3542826349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3542826349},{"type":"v1","addr":"172.21.15.62:6833","nonce":3542826349}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:27:19.830173+0000","modified":"2021-12-17T18:27:20.832915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/570760267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":570760267},{"type":"v1","addr":"172.21.15.109:6835","nonce":570760267}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-12-17T18:27:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:31.025+0000 7ff879204700 1 -- 172.21.15.62:0/3120066699 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff854053610 msgr2=0x7ff854055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:31.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:31.025+0000 7ff879204700 1 --2- 172.21.15.62:0/3120066699 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff854053610 0x7ff854055ad0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7ff86401c000 tx=0x7ff864016000).stop 2021-12-17T18:27:31.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:31.025+0000 7ff879204700 1 -- 172.21.15.62:0/3120066699 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff8740acd00 msgr2=0x7ff8741492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:31.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:31.025+0000 7ff879204700 1 --2- 172.21.15.62:0/3120066699 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff8740acd00 0x7ff8741492d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7ff868001110 tx=0x7ff868007ac0).stop 2021-12-17T18:27:31.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:31.025+0000 7ff879204700 1 -- 172.21.15.62:0/3120066699 shutdown_connections 2021-12-17T18:27:31.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:31.025+0000 7ff879204700 1 --2- 172.21.15.62:0/3120066699 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff854053610 0x7ff854055ad0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:31.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:31.025+0000 7ff879204700 1 --2- 172.21.15.62:0/3120066699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8740afea0 0x7ff874156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:31.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:31.025+0000 7ff879204700 1 --2- 172.21.15.62:0/3120066699 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff8740ae6f0 0x7ff8740a7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:31.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:31.025+0000 7ff879204700 1 --2- 172.21.15.62:0/3120066699 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff8740acd00 0x7ff8741492d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:31.025+0000 7ff879204700 1 -- 172.21.15.62:0/3120066699 >> 172.21.15.62:0/3120066699 conn(0x7ff8740b5480 msgr2=0x7ff8740b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:31.025+0000 7ff879204700 1 -- 172.21.15.62:0/3120066699 shutdown_connections 2021-12-17T18:27:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:31.025+0000 7ff879204700 1 -- 172.21.15.62:0/3120066699 wait complete. 2021-12-17T18:27:31.036 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 66 2021-12-17T18:27:31.243 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:27:19.830173+0000', 'modified': '2021-12-17T18:27:20.832915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8127}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8127': {'gid': 8127, 'name': 'b', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.109:6835/570760267', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.109:6834', 'nonce': 570760267}, {'type': 'v1', 'addr': '172.21.15.109:6835', 'nonce': 570760267}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:27:31.244 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:27:31.245 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-12-17T18:27:31.360 INFO:teuthology.orchestra.run.smithi109.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":8127,"want_state":"up:active","state":"up:active","rank_uptime":11.514267385,"mdsmap_epoch":66,"osdmap_epoch":132,"osdmap_epoch_barrier":130,"uptime":16.535639936999999} 2021-12-17T18:27:31.361 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 8127, "mdsmap_epoch": 66, "osdmap_epoch": 132, "osdmap_epoch_barrier": 130, "rank_uptime": 11.514267385, "state": "up:active", "uptime": 16.535639937, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:27:31.362 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:27:31.362 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-12-17T18:27:31.363 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi158.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-12-17T18:27:31.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:31.364 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:31.372 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:27:31.431 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:27:31.432 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:27:31.445 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:27:31.446 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:27:31.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:31.448 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:27:31.453 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:27:31.453 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:31.499 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:27:31.515 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:27:31.516 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:27:31.525 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:27:31.526 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:27:31.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:31.528 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:27:31.573 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:2021-12-17T18:27:31.567+0000 7f188aefb080 -1 init, newargv = 0x555678fc3f00 newargc=9ceph-fuse[ 2021-12-17T18:27:31.574 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:14559]: starting ceph client 2021-12-17T18:27:31.584 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14559]: starting fuse 2021-12-17T18:27:32.635 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:27:32.653 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:27:32.654 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:27:32.712 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:27:32.713 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:27:32.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:32.714 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:27:32.719 INFO:teuthology.orchestra.run.smithi158.stdout:52 2021-12-17T18:27:32.720 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:27:32.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:32.721 DEBUG:teuthology.orchestra.run.smithi158:> sudo python3 -c ' 2021-12-17T18:27:32.721 DEBUG:teuthology.orchestra.run.smithi158:> import glob 2021-12-17T18:27:32.721 DEBUG:teuthology.orchestra.run.smithi158:> import re 2021-12-17T18:27:32.722 DEBUG:teuthology.orchestra.run.smithi158:> import os 2021-12-17T18:27:32.722 DEBUG:teuthology.orchestra.run.smithi158:> import subprocess 2021-12-17T18:27:32.723 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:27:32.723 DEBUG:teuthology.orchestra.run.smithi158:> def find_socket(client_name): 2021-12-17T18:27:32.724 DEBUG:teuthology.orchestra.run.smithi158:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-12-17T18:27:32.724 DEBUG:teuthology.orchestra.run.smithi158:> files = glob.glob(asok_path) 2021-12-17T18:27:32.724 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:27:32.725 DEBUG:teuthology.orchestra.run.smithi158:> # Given a non-glob path, it better be there 2021-12-17T18:27:32.725 DEBUG:teuthology.orchestra.run.smithi158:> if "*" not in asok_path: 2021-12-17T18:27:32.726 DEBUG:teuthology.orchestra.run.smithi158:> assert(len(files) == 1) 2021-12-17T18:27:32.726 DEBUG:teuthology.orchestra.run.smithi158:> return files[0] 2021-12-17T18:27:32.726 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:27:32.727 DEBUG:teuthology.orchestra.run.smithi158:> for f in files: 2021-12-17T18:27:32.727 DEBUG:teuthology.orchestra.run.smithi158:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:27:32.728 DEBUG:teuthology.orchestra.run.smithi158:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:27:32.728 DEBUG:teuthology.orchestra.run.smithi158:> return f 2021-12-17T18:27:32.729 DEBUG:teuthology.orchestra.run.smithi158:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:27:32.729 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:27:32.729 DEBUG:teuthology.orchestra.run.smithi158:> print(find_socket("client.1")) 2021-12-17T18:27:32.730 DEBUG:teuthology.orchestra.run.smithi158:> ' 2021-12-17T18:27:32.769 INFO:teuthology.orchestra.run.smithi158.stdout:/var/run/ceph/ceph-client.1.14559.asok 2021-12-17T18:27:32.774 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14559.asok 2021-12-17T18:27:32.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:32.775 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14559.asok status 2021-12-17T18:27:32.910 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2021-12-17T18:27:32.910 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": { 2021-12-17T18:27:32.910 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:27:32.911 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:27:32.911 INFO:teuthology.orchestra.run.smithi158.stdout: "entity_id": "1", 2021-12-17T18:27:32.911 INFO:teuthology.orchestra.run.smithi158.stdout: "hostname": "smithi158", 2021-12-17T18:27:32.911 INFO:teuthology.orchestra.run.smithi158.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-12-17T18:27:32.912 INFO:teuthology.orchestra.run.smithi158.stdout: "pid": "14559", 2021-12-17T18:27:32.912 INFO:teuthology.orchestra.run.smithi158.stdout: "root": "/" 2021-12-17T18:27:32.912 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:27:32.912 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_count": 0, 2021-12-17T18:27:32.913 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_pinned_count": 0, 2021-12-17T18:27:32.913 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 7097, 2021-12-17T18:27:32.913 INFO:teuthology.orchestra.run.smithi158.stdout: "inst": { 2021-12-17T18:27:32.913 INFO:teuthology.orchestra.run.smithi158.stdout: "name": { 2021-12-17T18:27:32.914 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "client", 2021-12-17T18:27:32.914 INFO:teuthology.orchestra.run.smithi158.stdout: "num": 7097 2021-12-17T18:27:32.914 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:27:32.914 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:27:32.914 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:27:32.915 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:27:32.915 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 2783396570 2021-12-17T18:27:32.915 INFO:teuthology.orchestra.run.smithi158.stdout: } 2021-12-17T18:27:32.915 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:27:32.916 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:27:32.916 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:27:32.916 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:27:32.916 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 2783396570 2021-12-17T18:27:32.916 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:27:32.917 INFO:teuthology.orchestra.run.smithi158.stdout: "inst_str": "client.7097 172.21.15.158:0/2783396570", 2021-12-17T18:27:32.917 INFO:teuthology.orchestra.run.smithi158.stdout: "addr_str": "172.21.15.158:0/2783396570", 2021-12-17T18:27:32.917 INFO:teuthology.orchestra.run.smithi158.stdout: "inode_count": 1, 2021-12-17T18:27:32.917 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_epoch": 66, 2021-12-17T18:27:32.918 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch": 132, 2021-12-17T18:27:32.918 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:27:32.918 INFO:teuthology.orchestra.run.smithi158.stdout: "blacklisted": false, 2021-12-17T18:27:32.919 INFO:teuthology.orchestra.run.smithi158.stdout: "fs_name": "cephfs" 2021-12-17T18:27:32.919 INFO:teuthology.orchestra.run.smithi158.stdout:} 2021-12-17T18:27:32.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:32.924 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:32.924 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:32.932 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:27:32.933 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:27:32.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:32.934 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:32.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:32.951 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:32.951 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:32.960 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:27:32.961 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:27:32.962 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-12-17T18:27:32.962 DEBUG:teuthology.orchestra.run.smithi125:> import time 2021-12-17T18:27:32.963 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:27:32.963 DEBUG:teuthology.orchestra.run.smithi125:> with open("/home/ubuntu/cephtest/mnt.0/testfile", '"'"'w'"'"') as f: 2021-12-17T18:27:32.963 DEBUG:teuthology.orchestra.run.smithi125:> f.write('"'"'content'"'"') 2021-12-17T18:27:32.964 DEBUG:teuthology.orchestra.run.smithi125:> f.flush() 2021-12-17T18:27:32.964 DEBUG:teuthology.orchestra.run.smithi125:> f.write('"'"'content2'"'"') 2021-12-17T18:27:32.964 DEBUG:teuthology.orchestra.run.smithi125:> while True: 2021-12-17T18:27:32.965 DEBUG:teuthology.orchestra.run.smithi125:> time.sleep(1) 2021-12-17T18:27:32.965 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:27:33.007 DEBUG:teuthology.orchestra.run.smithi125:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-12-17T18:27:33.029 INFO:teuthology.orchestra.run.smithi125.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/testfile': No such file or directory 2021-12-17T18:27:33.030 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-12-17T18:27:34.031 DEBUG:teuthology.orchestra.run.smithi125:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-12-17T18:27:34.048 INFO:teuthology.orchestra.run.smithi125.stdout:/home/ubuntu/cephtest/mnt.0/testfile 2021-12-17T18:27:34.049 DEBUG:tasks.cephfs.mount:File testfile became visible from 0 after 1s 2021-12-17T18:27:34.049 DEBUG:teuthology.orchestra.run.smithi158:> sudo ls /home/ubuntu/cephtest/mnt.1/testfile 2021-12-17T18:27:34.087 INFO:teuthology.orchestra.run.smithi158.stdout:/home/ubuntu/cephtest/mnt.1/testfile 2021-12-17T18:27:34.089 DEBUG:tasks.cephfs.mount:File testfile became visible from 1 after 0s 2021-12-17T18:27:34.089 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-12-17T18:27:34.090 DEBUG:teuthology.orchestra.run.smithi158:> cd /home/ubuntu/cephtest/mnt.1 && sudo cat testfile 2021-12-17T18:27:34.176 INFO:teuthology.orchestra.run.smithi158.stdout:content 2021-12-17T18:27:34.192 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:27:34.192 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:34.214 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:34.235 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:34.257 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:34.278 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:34.299 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:27:34.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:34.300 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:34.301 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:34.309 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:27:34.310 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:27:34.311 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:27:34.311 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:27:34.312 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:34.367 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[15062]: fuse finished with error 0 and tester_r 0 2021-12-17T18:27:34.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:34.371 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:34.371 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:34.379 INFO:teuthology.orchestra.run.smithi125.stdout:ext2/ext3 2021-12-17T18:27:34.380 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:27:34.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:27:34.504 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:34.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:34.512 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:34.512 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:34.520 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:27:34.522 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:27:34.522 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi158.front.sepia.ceph.com... 2021-12-17T18:27:34.523 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:27:34.523 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:34.539 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14559]: fuse finished with error 0 and tester_r 0 2021-12-17T18:27:34.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:34.542 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:34.542 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:34.548 INFO:teuthology.orchestra.run.smithi158.stdout:ext2/ext3 2021-12-17T18:27:34.549 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:27:34.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:27:34.569 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:34.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:34.576 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:34.576 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:27:34.583 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:27:34.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:27:34.585 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:27:34.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:27:34.586 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:27:34.592 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:27:34.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:27:34.594 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:27:34.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.701+0000 7fa55759e700 1 Processor -- start 2021-12-17T18:27:34.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.701+0000 7fa55759e700 1 -- start start 2021-12-17T18:27:34.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.701+0000 7fa55759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5580b1c50 0x7fa5580add60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:34.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.701+0000 7fa55759e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa55805c110 0x7fa55813f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:34.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.701+0000 7fa55759e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5580ae250 con 0x7fa558067910 2021-12-17T18:27:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.701+0000 7fa55759e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa558067cf0 con 0x7fa55805c110 2021-12-17T18:27:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.701+0000 7fa55759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5580b6420 con 0x7fa5580b1c50 2021-12-17T18:27:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.701+0000 7fa54dd9b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5580b1c50 0x7fa5580add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.701+0000 7fa556d9d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa55805c110 0x7fa55813f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.701+0000 7fa54dd9b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5580b1c50 0x7fa5580add60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:49950/0 (socket says 172.21.15.62:49950) 2021-12-17T18:27:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.701+0000 7fa556d9d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa55805c110 0x7fa55813f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:34568/0 (socket says 172.21.15.62:34568) 2021-12-17T18:27:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.701+0000 7fa54dd9b700 1 -- 172.21.15.62:0/2564852816 learned_addr learned my addr 172.21.15.62:0/2564852816 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.701+0000 7fa55659c700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7fa558067910 0x7fa5580ad650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:56146/0 (socket says 172.21.15.62:56146) 2021-12-17T18:27:34.711 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:27:34.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa555d9b700 1 -- 172.21.15.62:0/2564852816 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228194368 0 0) 0x7fa5580ae250 con 0x7fa558067910 2021-12-17T18:27:34.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa555d9b700 1 -- 172.21.15.62:0/2564852816 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa538003260 con 0x7fa558067910 2021-12-17T18:27:34.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa54dd9b700 1 -- 172.21.15.62:0/2564852816 >> v2:172.21.15.109:3300/0 conn(0x7fa55805c110 msgr2=0x7fa55813f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:34.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa54dd9b700 1 --2- 172.21.15.62:0/2564852816 >> v2:172.21.15.109:3300/0 conn(0x7fa55805c110 0x7fa55813f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:34.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa54dd9b700 1 -- 172.21.15.62:0/2564852816 >> v1:172.21.15.109:6789/0 conn(0x7fa558067910 legacy=0x7fa5580ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:34.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa54dd9b700 1 -- 172.21.15.62:0/2564852816 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5580b66c0 con 0x7fa5580b1c50 2021-12-17T18:27:34.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa556d9d700 1 --2- 172.21.15.62:0/2564852816 >> v2:172.21.15.109:3300/0 conn(0x7fa55805c110 0x7fa55813f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:34.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa54dd9b700 1 --2- 172.21.15.62:0/2564852816 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5580b1c50 0x7fa5580add60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fa540002f70 tx=0x7fa540006f40).ready entity=mon.2 client_cookie=e00e555199d11605 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa555d9b700 1 -- 172.21.15.62:0/2564852816 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa54000d9a0 con 0x7fa5580b1c50 2021-12-17T18:27:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa555d9b700 1 -- 172.21.15.62:0/2564852816 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa540000e90 con 0x7fa5580b1c50 2021-12-17T18:27:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa555d9b700 1 -- 172.21.15.62:0/2564852816 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa54000dd30 con 0x7fa5580b1c50 2021-12-17T18:27:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa55759e700 1 -- 172.21.15.62:0/2564852816 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5580b1c50 msgr2=0x7fa5580add60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa55759e700 1 --2- 172.21.15.62:0/2564852816 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5580b1c50 0x7fa5580add60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fa540002f70 tx=0x7fa540006f40).stop 2021-12-17T18:27:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa55759e700 1 -- 172.21.15.62:0/2564852816 shutdown_connections 2021-12-17T18:27:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa55759e700 1 --2- 172.21.15.62:0/2564852816 >> v2:172.21.15.109:3300/0 conn(0x7fa55805c110 0x7fa55813f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:34.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa55759e700 1 --2- 172.21.15.62:0/2564852816 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5580b1c50 0x7fa5580add60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa55759e700 1 -- 172.21.15.62:0/2564852816 >> 172.21.15.62:0/2564852816 conn(0x7fa55805d090 msgr2=0x7fa5580b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa55759e700 1 -- 172.21.15.62:0/2564852816 shutdown_connections 2021-12-17T18:27:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.705+0000 7fa55759e700 1 -- 172.21.15.62:0/2564852816 wait complete. 2021-12-17T18:27:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa55759e700 1 Processor -- start 2021-12-17T18:27:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa55759e700 1 -- start start 2021-12-17T18:27:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa55759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa55805c110 0x7fa55813d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa55759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa558067910 0x7fa55813ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa55759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5580b1c50 0x7fa55813bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa55759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55810f990 con 0x7fa558067910 2021-12-17T18:27:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa55759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa558143b80 con 0x7fa55805c110 2021-12-17T18:27:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa55759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa558143640 con 0x7fa5580b1c50 2021-12-17T18:27:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa54dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa558067910 0x7fa55813ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:34.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa54dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa558067910 0x7fa55813ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56254/0 (socket says 172.21.15.62:56254) 2021-12-17T18:27:34.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa54dd9b700 1 -- 172.21.15.62:0/177035211 learned_addr learned my addr 172.21.15.62:0/177035211 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:34.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa55659c700 1 --2- 172.21.15.62:0/177035211 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa55805c110 0x7fa55813d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:34.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa556d9d700 1 --2- 172.21.15.62:0/177035211 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5580b1c50 0x7fa55813bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:34.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa54dd9b700 1 -- 172.21.15.62:0/177035211 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5580b1c50 msgr2=0x7fa55813bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:34.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa54dd9b700 1 --2- 172.21.15.62:0/177035211 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5580b1c50 0x7fa55813bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:34.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa54dd9b700 1 -- 172.21.15.62:0/177035211 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa55805c110 msgr2=0x7fa55813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:34.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa54dd9b700 1 --2- 172.21.15.62:0/177035211 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa55805c110 0x7fa55813d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:34.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa54dd9b700 1 -- 172.21.15.62:0/177035211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa550009470 con 0x7fa558067910 2021-12-17T18:27:34.725 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:27:34.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa54dd9b700 1 --2- 172.21.15.62:0/177035211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa558067910 0x7fa55813ba10 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7fa540002f70 tx=0x7fa540006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:34.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa54ffff700 1 -- 172.21.15.62:0/177035211 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa54000dee0 con 0x7fa558067910 2021-12-17T18:27:34.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa54ffff700 1 -- 172.21.15.62:0/177035211 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa540024450 con 0x7fa558067910 2021-12-17T18:27:34.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa55759e700 1 -- 172.21.15.62:0/177035211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54000b460 con 0x7fa558067910 2021-12-17T18:27:34.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa54ffff700 1 -- 172.21.15.62:0/177035211 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5400247b0 con 0x7fa558067910 2021-12-17T18:27:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.709+0000 7fa55759e700 1 -- 172.21.15.62:0/177035211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5581432c0 con 0x7fa558067910 2021-12-17T18:27:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.713+0000 7fa55759e700 1 -- 172.21.15.62:0/177035211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5580b6960 con 0x7fa558067910 2021-12-17T18:27:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.713+0000 7fa54ffff700 1 -- 172.21.15.62:0/177035211 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa540021070 con 0x7fa558067910 2021-12-17T18:27:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.713+0000 7fa54ffff700 1 --2- 172.21.15.62:0/177035211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa53c0536a0 0x7fa53c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:34.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.713+0000 7fa54ffff700 1 -- 172.21.15.62:0/177035211 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa54006f220 con 0x7fa558067910 2021-12-17T18:27:34.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.713+0000 7fa55659c700 1 --2- 172.21.15.62:0/177035211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa53c0536a0 0x7fa53c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:34.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.713+0000 7fa55659c700 1 --2- 172.21.15.62:0/177035211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa53c0536a0 0x7fa53c055b60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fa54800d000 tx=0x7fa548007ab0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:34.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.721+0000 7fa54ffff700 1 -- 172.21.15.62:0/177035211 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa540046430 con 0x7fa558067910 2021-12-17T18:27:34.732 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:27:34.735 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:27:34.737 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:27:34.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.849+0000 7fa55759e700 1 -- 172.21.15.62:0/177035211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa5580573d0 con 0x7fa558067910 2021-12-17T18:27:34.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.849+0000 7fa54ffff700 1 -- 172.21.15.62:0/177035211 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v132) v1 ==== 81+0+33707 (secure 0 0 0) 0x7fa540029070 con 0x7fa558067910 2021-12-17T18:27:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:34.857 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:27:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 132, 2021-12-17T18:27:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:27:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:27:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:27:21.842977+0000", 2021-12-17T18:27:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:27:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:27:34.859 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:27:34.859 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:27:34.859 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:27:34.859 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:27:34.859 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:27:34.860 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:27:34.860 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:27:34.860 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:34.860 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:27:34.861 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:27:34.861 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:27:34.861 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:27:34.861 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:27:34.862 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 26, 2021-12-17T18:27:34.862 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:27:34.862 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:27:34.862 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:27:34.863 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:27:34.863 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:27:34.863 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.863 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:27:34.864 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:27:34.864 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:27:34.864 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:27:34.864 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:27:34.865 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:27:34.865 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:27:34.865 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:27:34.865 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:27:34.865 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:27:34.866 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:27:34.866 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:27:34.866 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:27:34.866 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:27:34.867 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:27:34.867 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:27:34.867 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:27:34.867 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:27:34.868 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:27:34.868 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:27:34.868 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:27:34.868 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:27:34.869 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:27:34.869 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.869 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:27:34.869 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:27:34.869 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:27:34.870 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:27:34.870 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:27:34.870 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:27:34.870 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:27:34.871 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:27:34.871 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:27:34.871 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:27:34.871 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:27:34.872 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:27:34.872 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:27:34.872 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:27:34.872 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:27:34.873 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:27:34.873 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:27:34.873 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:27:34.873 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:27:34.873 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:27:34.874 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:27:34.874 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:27:34.874 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:27:34.874 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:27:34.875 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:27:34.875 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:27:34.875 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:27:34.875 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.876 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:27:34.876 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:27:34.876 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:27:34.876 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:27:34.876 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:27:34.877 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:27:34.877 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:27:34.877 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:27:34.877 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:27:34.878 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:27:34.878 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:27:34.878 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:27:34.878 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:27:34.879 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.879 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:27:34.879 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:27:34.879 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.880 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.880 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.880 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:27:34.880 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:27:34.881 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:27:34.881 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:27:34.881 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:27:34.881 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:27:34.881 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:27:34.882 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:27:34.882 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:27:34.882 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:27:34.882 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:27:34.883 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:27:34.883 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:27:34.883 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:27:34.883 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:27:34.884 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:27:34.884 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:27:34.884 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:27:34.884 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:27:34.884 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:27:34.885 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:27:34.885 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:27:34.885 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:27:34.885 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.886 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:27:34.886 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:27:34.886 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:27:34.886 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:27:34.887 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:27:34.887 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:27:34.887 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:27:34.887 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:27:34.887 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:27:34.888 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:27:34.888 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:27:34.888 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:27:34.888 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:27:34.889 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:27:34.889 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:27:34.889 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:27:34.889 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:27:34.890 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:27:34.890 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:27:34.890 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:27:34.890 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:27:34.890 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:27:34.891 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:27:34.891 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:27:34.891 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:27:34.891 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:27:34.892 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:27:34.892 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.892 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:27:34.892 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:27:34.893 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:27:34.893 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:27:34.893 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:27:34.893 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:27:34.894 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:27:34.894 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:27:34.894 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:27:34.894 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:27:34.894 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:27:34.895 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:27:34.895 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:27:34.895 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:27:34.895 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.896 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.896 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.896 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 25, 2021-12-17T18:27:34.896 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2021-12-17T18:27:34.897 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:27:17.568635+0000", 2021-12-17T18:27:34.897 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:27:34.897 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:27:34.897 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:27:34.898 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:27:34.898 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:27:34.898 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:27:34.898 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:27:34.898 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:27:34.899 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:27:34.899 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:27:34.899 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:27:34.899 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:27:34.900 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:27:34.900 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:27:34.900 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:27:34.900 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:27:34.901 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:27:34.901 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:27:34.901 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:27:34.901 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:27:34.901 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.902 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "131", 2021-12-17T18:27:34.902 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:27:34.902 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:27:34.902 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:27:34.903 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:27:34.903 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:27:34.903 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:27:34.903 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:27:34.904 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:27:34.904 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:27:34.904 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:27:34.904 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:27:34.905 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:27:34.905 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:27:34.905 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:27:34.905 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:27:34.905 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:27:34.906 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:27:34.906 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:27:34.906 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:27:34.907 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:27:34.907 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:27:34.907 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:27:34.907 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:27:34.908 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:27:34.908 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:27:34.908 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:27:34.908 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.908 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:27:34.909 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:27:34.909 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:27:34.909 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:27:34.909 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:27:34.910 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:27:34.910 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:27:34.910 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:27:34.910 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:27:34.911 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:27:34.911 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:27:34.911 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:27:34.911 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2021-12-17T18:27:34.912 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2021-12-17T18:27:34.912 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2021-12-17T18:27:34.912 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.912 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:27:34.913 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:27:34.913 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2021-12-17T18:27:34.913 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.913 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.914 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.914 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.914 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 26, 2021-12-17T18:27:34.914 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2021-12-17T18:27:34.914 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:27:18.849290+0000", 2021-12-17T18:27:34.915 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:27:34.915 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:27:34.915 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:27:34.915 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:27:34.916 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:27:34.916 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:27:34.916 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:27:34.916 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:27:34.917 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:27:34.917 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:27:34.917 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:27:34.917 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:27:34.918 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:27:34.918 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:27:34.918 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:27:34.918 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:27:34.919 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:27:34.919 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:27:34.919 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:27:34.919 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:27:34.919 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.920 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "132", 2021-12-17T18:27:34.920 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:27:34.920 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:27:34.920 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:27:34.921 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:27:34.921 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:27:34.921 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:27:34.921 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:27:34.922 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:27:34.922 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:27:34.922 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:27:34.922 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:27:34.923 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:27:34.923 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:27:34.923 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:27:34.923 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:27:34.923 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:27:34.924 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:27:34.924 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:27:34.924 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:27:34.924 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:27:34.925 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:27:34.925 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:27:34.925 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:27:34.925 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:27:34.926 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:27:34.926 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:27:34.926 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.926 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:27:34.927 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:27:34.927 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:27:34.927 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:27:34.927 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:27:34.928 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:27:34.928 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:27:34.928 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:27:34.928 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:27:34.928 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:27:34.929 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:27:34.929 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:27:34.929 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:27:34.929 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:27:34.930 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2021-12-17T18:27:34.930 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.930 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.930 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.931 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:34.931 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:27:34.931 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.931 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:27:34.931 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:27:34.932 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:34.932 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:34.932 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:34.932 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:34.933 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:34.933 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:34.933 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:34.933 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 128, 2021-12-17T18:27:34.934 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:34.934 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:34.934 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:34.934 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:34.934 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.935 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:34.935 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:27:34.935 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:34.935 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.936 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.936 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:34.936 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:27:34.936 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:34.937 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.937 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.937 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.937 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:34.938 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:34.938 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.938 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:34.938 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:27:34.938 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:34.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.939 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.939 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:34.939 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:27:34.940 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:34.940 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.940 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.940 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.940 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:34.941 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:34.941 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.941 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:34.941 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:27:34.942 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:34.942 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.942 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.942 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:34.943 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:27:34.943 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:34.943 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.943 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.944 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.944 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:34.944 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:34.944 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.944 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:34.945 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:27:34.945 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:34.945 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.945 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.946 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:34.946 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:27:34.946 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:34.946 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.947 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.947 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.947 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:27:34.947 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:27:34.948 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:27:34.948 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:27:34.948 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:34.948 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:34.948 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:34.949 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.949 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.949 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.949 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:27:34.950 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:27:34.950 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:34.950 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:34.950 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:34.950 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:34.951 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:34.951 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:34.951 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:34.951 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 129, 2021-12-17T18:27:34.952 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:34.952 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:34.952 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:34.952 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:34.953 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.953 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:34.953 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:27:34.953 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:34.954 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.954 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.954 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:34.954 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:27:34.955 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:34.955 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.955 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.955 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.956 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:34.956 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:34.956 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.956 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:34.956 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:27:34.957 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:34.957 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.957 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.957 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:34.958 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:27:34.958 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:34.958 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.958 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.959 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.959 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:34.959 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:34.959 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.960 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:34.960 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:27:34.960 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:34.960 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.960 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.961 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:34.961 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:27:34.961 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:34.961 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.962 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.962 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.962 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:34.962 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:34.963 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.963 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:34.963 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:27:34.963 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:34.963 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.964 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.964 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:34.964 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:27:34.964 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:34.965 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.965 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.965 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.965 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:27:34.966 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:27:34.966 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:27:34.966 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:27:34.966 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:34.967 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:34.967 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:34.967 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.967 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.968 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.968 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:27:34.968 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:27:34.968 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:34.968 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:34.969 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:34.969 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:34.969 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:34.969 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:34.970 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:34.970 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 129, 2021-12-17T18:27:34.970 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:34.970 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:34.971 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:34.971 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:34.971 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.971 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:34.972 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:27:34.972 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:34.972 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.972 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.973 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:34.973 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:27:34.973 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:34.973 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.974 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.974 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.974 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:34.974 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:34.974 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.975 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:34.975 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:27:34.975 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:34.975 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.976 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.976 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:34.976 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:27:34.976 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:34.977 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.977 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.977 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.977 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:34.978 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:34.978 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.978 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:34.978 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:27:34.979 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:34.979 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.979 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.979 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:34.979 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:27:34.980 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:34.980 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.980 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.980 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.981 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:34.981 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:34.981 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.981 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:34.982 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:27:34.982 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:34.982 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.982 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.983 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:34.983 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:27:34.983 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:34.983 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.983 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.984 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.984 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:27:34.984 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:27:34.984 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:27:34.985 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:27:34.985 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:34.985 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:34.985 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:34.985 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.986 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.986 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.986 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:27:34.986 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:27:34.987 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:34.987 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:34.987 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:34.987 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:34.988 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:34.988 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:34.988 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:34.988 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 128, 2021-12-17T18:27:34.988 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:34.989 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:34.989 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:34.989 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:34.989 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.990 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:34.990 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:27:34.990 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:34.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.991 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.991 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:34.991 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:27:34.991 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:34.991 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.992 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.992 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.992 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:34.992 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:34.993 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.993 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:34.993 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:27:34.993 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:34.994 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.994 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.994 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:34.994 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:27:34.994 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:34.995 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.995 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.995 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.995 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:34.996 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:34.996 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.996 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:34.996 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:27:34.997 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:34.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.997 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.997 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:34.997 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:27:34.998 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:34.998 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:34.998 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:34.998 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:34.999 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:34.999 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:34.999 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:34.999 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:35.000 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:27:35.000 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:35.000 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.000 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.001 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:35.001 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:27:35.001 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:35.001 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.001 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.002 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.002 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:27:35.002 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:27:35.002 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:27:35.003 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:27:35.003 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:35.003 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:35.003 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:35.004 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.004 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.004 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.004 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:27:35.005 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:27:35.005 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:35.005 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:35.005 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:35.005 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:35.006 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:35.006 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:35.006 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:35.006 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 130, 2021-12-17T18:27:35.007 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:35.007 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:35.007 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:35.007 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:35.008 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.008 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:35.008 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:27:35.008 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:35.009 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.009 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.009 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:35.009 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:27:35.009 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:35.010 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.010 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.010 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.011 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:35.011 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:35.011 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.011 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:35.012 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:27:35.012 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:35.012 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.012 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.013 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:35.013 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:27:35.013 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:35.013 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.013 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.014 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.014 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:35.014 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:35.014 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.015 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:35.015 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:27:35.015 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:35.015 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.016 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.016 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:35.016 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:27:35.016 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:35.017 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.017 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.017 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.017 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:35.017 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:35.018 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.018 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:35.018 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:27:35.018 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:35.019 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.019 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.019 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:35.019 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:27:35.019 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:35.020 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.020 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.020 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.020 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:27:35.021 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:27:35.021 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:27:35.021 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:27:35.021 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:35.021 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:35.022 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:35.022 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.022 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.022 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.023 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:27:35.023 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:27:35.023 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:35.023 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:35.024 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:35.024 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:35.024 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:35.024 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:35.025 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:35.025 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 121, 2021-12-17T18:27:35.025 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:35.025 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:35.025 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:35.026 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:35.026 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.026 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:35.026 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:27:35.027 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:35.027 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.027 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.027 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:35.028 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:27:35.028 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:35.028 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.028 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.029 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.029 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:35.029 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:35.029 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.030 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:35.030 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:27:35.030 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:35.030 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.030 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.031 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:35.031 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:27:35.031 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:35.031 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.032 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.032 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.032 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:35.032 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:35.033 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.033 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:35.033 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:27:35.033 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:35.034 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.034 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.034 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:35.034 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:27:35.035 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:35.035 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.035 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.035 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.035 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:35.036 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:35.036 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.036 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:35.036 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:27:35.037 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:35.037 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.037 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.037 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:35.038 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:27:35.038 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:35.038 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.038 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.038 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.039 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:27:35.039 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:27:35.039 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:27:35.039 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:27:35.040 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:35.040 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:35.040 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:35.040 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.041 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.041 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.041 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:27:35.041 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:27:35.042 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:35.042 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:35.042 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:35.042 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:35.042 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:35.043 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:35.043 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:35.043 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 129, 2021-12-17T18:27:35.043 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:35.044 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:35.044 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:35.044 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:35.044 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.044 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:35.045 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:27:35.045 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:35.045 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.045 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.046 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:35.046 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:27:35.046 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:35.046 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.047 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.047 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.047 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:35.047 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:35.047 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.048 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:35.048 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:27:35.048 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:35.048 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.049 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.049 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:35.049 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:27:35.049 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:35.049 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.050 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.050 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.050 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:35.050 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:35.051 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.051 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:35.051 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:27:35.051 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:35.052 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.052 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.052 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:35.052 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:27:35.052 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:35.053 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.053 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.053 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.053 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:35.054 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:35.054 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.054 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:35.054 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:27:35.055 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:35.055 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.055 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.055 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:35.055 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:27:35.056 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:35.056 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.056 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.056 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.057 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:27:35.057 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:27:35.057 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:27:35.057 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:27:35.058 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:35.058 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:35.058 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:35.058 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.059 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.059 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:27:35.059 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:27:35.059 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:35.060 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:35.060 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:35.060 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:35.060 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:35.061 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:35.061 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:35.061 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 129, 2021-12-17T18:27:35.061 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:35.061 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:35.062 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:35.062 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:35.062 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.062 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:35.063 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:27:35.063 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:35.063 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.063 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.064 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:35.064 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:27:35.064 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:35.064 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.064 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.065 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:35.065 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:35.065 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.066 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:35.066 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:27:35.066 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:35.066 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.067 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.067 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:35.067 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:27:35.067 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:35.067 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.068 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.068 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.068 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:35.068 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:35.069 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.069 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:35.069 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:27:35.069 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:35.070 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.070 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.070 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:35.070 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:27:35.070 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:35.071 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.071 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.071 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.071 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:35.072 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:35.072 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.072 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:35.072 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:27:35.073 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:35.073 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.073 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.073 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:35.074 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:27:35.074 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:35.074 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.074 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.075 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:27:35.075 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:27:35.075 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:27:35.075 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:27:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:35.077 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.077 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:35.077 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:27:35.077 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.077 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:27:35.078 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:35.078 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:35.078 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:35.078 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:35.079 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:35.079 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:27:35.079 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:35.079 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.079 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.080 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:27:35.080 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:35.080 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:35.080 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:35.081 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:35.081 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:35.081 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:27:35.081 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:35.082 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.082 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.082 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:27:35.082 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:35.082 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:35.083 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:35.083 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:35.083 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:35.083 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:27:35.084 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:35.084 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.084 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.084 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:27:35.085 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:35.085 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:35.085 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:35.085 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:35.085 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:35.086 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:27:35.086 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:35.086 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.086 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.087 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:27:35.087 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:35.087 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:35.087 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:35.088 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:35.088 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:35.088 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:27:35.088 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:35.088 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.089 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.089 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:27:35.089 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:35.089 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:35.090 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:35.090 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:35.090 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:35.090 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:27:35.091 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:35.091 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.091 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.091 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:27:35.092 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:35.092 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:35.092 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:35.092 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:35.093 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:35.093 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:27:35.093 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:35.093 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.094 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:35.094 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:27:35.094 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:35.094 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:35.095 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:35.095 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:35.095 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:35.095 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:27:35.095 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:35.096 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.096 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:35.096 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:27:35.096 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:27:35.097 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:27:35.097 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:27:35.097 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": {}, 2021-12-17T18:27:35.097 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:27:35.098 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:27:35.098 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:27:35.098 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:27:35.098 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:27:35.098 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:27:35.099 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:27:35.099 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:27:35.099 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:35.099 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:35.100 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:27:35.100 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:27:35.100 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:27:35.100 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:27:35.101 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:27:35.101 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:27:35.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.853+0000 7fa55759e700 1 -- 172.21.15.62:0/177035211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa53c0536a0 msgr2=0x7fa53c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:35.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.853+0000 7fa55759e700 1 --2- 172.21.15.62:0/177035211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa53c0536a0 0x7fa53c055b60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fa54800d000 tx=0x7fa548007ab0).stop 2021-12-17T18:27:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.853+0000 7fa55759e700 1 -- 172.21.15.62:0/177035211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa558067910 msgr2=0x7fa55813ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.853+0000 7fa55759e700 1 --2- 172.21.15.62:0/177035211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa558067910 0x7fa55813ba10 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7fa540002f70 tx=0x7fa540006f40).stop 2021-12-17T18:27:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.853+0000 7fa55759e700 1 -- 172.21.15.62:0/177035211 shutdown_connections 2021-12-17T18:27:35.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.853+0000 7fa55759e700 1 --2- 172.21.15.62:0/177035211 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa53c0536a0 0x7fa53c055b60 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.853+0000 7fa55759e700 1 --2- 172.21.15.62:0/177035211 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa5580b1c50 0x7fa55813bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.853+0000 7fa55759e700 1 --2- 172.21.15.62:0/177035211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa558067910 0x7fa55813ba10 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.853+0000 7fa55759e700 1 --2- 172.21.15.62:0/177035211 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa55805c110 0x7fa55813d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.853+0000 7fa55759e700 1 -- 172.21.15.62:0/177035211 >> 172.21.15.62:0/177035211 conn(0x7fa55805d090 msgr2=0x7fa5580b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.853+0000 7fa55759e700 1 -- 172.21.15.62:0/177035211 shutdown_connections 2021-12-17T18:27:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:34.853+0000 7fa55759e700 1 -- 172.21.15.62:0/177035211 wait complete. 2021-12-17T18:27:35.107 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:35.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff79d774700 1 Processor -- start 2021-12-17T18:27:35.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff79d774700 1 -- start start 2021-12-17T18:27:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff79d774700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff7980ba2b0 0x7ff79805bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff79d774700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7980b4200 0x7ff798143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff79d774700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff798143fb0 0x7ff798142540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff79d774700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7980b1050 con 0x7ff798143fb0 2021-12-17T18:27:35.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff79d774700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7980ba690 con 0x7ff7980ba2b0 2021-12-17T18:27:35.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff79d774700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff798143380 con 0x7ff7980b4200 2021-12-17T18:27:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff79cf73700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff798143fb0 0x7ff798142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff79cf73700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff798143fb0 0x7ff798142540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56264/0 (socket says 172.21.15.62:56264) 2021-12-17T18:27:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff79cf73700 1 -- 172.21.15.62:0/724286192 learned_addr learned my addr 172.21.15.62:0/724286192 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:35.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff797fff700 1 --2- 172.21.15.62:0/724286192 >> v2:172.21.15.109:3300/0 conn(0x7ff7980ba2b0 0x7ff79805bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff7977fe700 1 --2- 172.21.15.62:0/724286192 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7980b4200 0x7ff798143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff79cf73700 1 -- 172.21.15.62:0/724286192 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7980b4200 msgr2=0x7ff798143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:35.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff79cf73700 1 --2- 172.21.15.62:0/724286192 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7980b4200 0x7ff798143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff79cf73700 1 -- 172.21.15.62:0/724286192 >> v2:172.21.15.109:3300/0 conn(0x7ff7980ba2b0 msgr2=0x7ff79805bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:35.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff79cf73700 1 --2- 172.21.15.62:0/724286192 >> v2:172.21.15.109:3300/0 conn(0x7ff7980ba2b0 0x7ff79805bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff79cf73700 1 -- 172.21.15.62:0/724286192 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff798143620 con 0x7ff798143fb0 2021-12-17T18:27:35.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff79cf73700 1 --2- 172.21.15.62:0/724286192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff798143fb0 0x7ff798142540 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7ff7900032f0 tx=0x7ff790009290).ready entity=mon.0 client_cookie=ea68193a8703fcfd server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:35.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff796ffd700 1 -- 172.21.15.62:0/724286192 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff79000b680 con 0x7ff798143fb0 2021-12-17T18:27:35.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.217+0000 7ff796ffd700 1 -- 172.21.15.62:0/724286192 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79000b7e0 con 0x7ff798143fb0 2021-12-17T18:27:35.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff796ffd700 1 -- 172.21.15.62:0/724286192 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff79000b950 con 0x7ff798143fb0 2021-12-17T18:27:35.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79d774700 1 -- 172.21.15.62:0/724286192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff798143fb0 msgr2=0x7ff798142540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:35.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79d774700 1 --2- 172.21.15.62:0/724286192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff798143fb0 0x7ff798142540 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7ff7900032f0 tx=0x7ff790009290).stop 2021-12-17T18:27:35.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79d774700 1 -- 172.21.15.62:0/724286192 shutdown_connections 2021-12-17T18:27:35.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79d774700 1 --2- 172.21.15.62:0/724286192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff798143fb0 0x7ff798142540 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79d774700 1 --2- 172.21.15.62:0/724286192 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7980b4200 0x7ff798143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79d774700 1 --2- 172.21.15.62:0/724286192 >> v2:172.21.15.109:3300/0 conn(0x7ff7980ba2b0 0x7ff79805bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79d774700 1 -- 172.21.15.62:0/724286192 >> 172.21.15.62:0/724286192 conn(0x7ff798062320 msgr2=0x7ff7980b9860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:35.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79d774700 1 -- 172.21.15.62:0/724286192 shutdown_connections 2021-12-17T18:27:35.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79d774700 1 -- 172.21.15.62:0/724286192 wait complete. 2021-12-17T18:27:35.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79d774700 1 Processor -- start 2021-12-17T18:27:35.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79d774700 1 -- start start 2021-12-17T18:27:35.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79d774700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7980b4200 0x7ff7981134d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79d774700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff7980ba2b0 0x7ff7981416c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79d774700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff798143fb0 0x7ff798152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79d774700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff798152680 con 0x7ff798143fb0 2021-12-17T18:27:35.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79d774700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7981446f0 con 0x7ff7980ba2b0 2021-12-17T18:27:35.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79d774700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff798144990 con 0x7ff7980b4200 2021-12-17T18:27:35.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79cf73700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff798143fb0 0x7ff798152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79cf73700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff798143fb0 0x7ff798152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56268/0 (socket says 172.21.15.62:56268) 2021-12-17T18:27:35.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79cf73700 1 -- 172.21.15.62:0/3531976044 learned_addr learned my addr 172.21.15.62:0/3531976044 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:35.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff7977fe700 1 --2- 172.21.15.62:0/3531976044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff7980ba2b0 0x7ff7981416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff797fff700 1 --2- 172.21.15.62:0/3531976044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7980b4200 0x7ff7981134d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79cf73700 1 -- 172.21.15.62:0/3531976044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7980b4200 msgr2=0x7ff7981134d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:35.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79cf73700 1 --2- 172.21.15.62:0/3531976044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7980b4200 0x7ff7981134d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79cf73700 1 -- 172.21.15.62:0/3531976044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff7980ba2b0 msgr2=0x7ff7981416c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:35.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79cf73700 1 --2- 172.21.15.62:0/3531976044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff7980ba2b0 0x7ff7981416c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79cf73700 1 -- 172.21.15.62:0/3531976044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff790009530 con 0x7ff798143fb0 2021-12-17T18:27:35.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.221+0000 7ff79cf73700 1 --2- 172.21.15.62:0/3531976044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff798143fb0 0x7ff798152190 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7ff7900032f0 tx=0x7ff790017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.225+0000 7ff7957fa700 1 -- 172.21.15.62:0/3531976044 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff79001f070 con 0x7ff798143fb0 2021-12-17T18:27:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.225+0000 7ff7957fa700 1 -- 172.21.15.62:0/3531976044 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff790011e80 con 0x7ff798143fb0 2021-12-17T18:27:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.225+0000 7ff79d774700 1 -- 172.21.15.62:0/3531976044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff798155790 con 0x7ff798143fb0 2021-12-17T18:27:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.225+0000 7ff7957fa700 1 -- 172.21.15.62:0/3531976044 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff79000b680 con 0x7ff798143fb0 2021-12-17T18:27:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.225+0000 7ff79d774700 1 -- 172.21.15.62:0/3531976044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7980b30e0 con 0x7ff798143fb0 2021-12-17T18:27:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.225+0000 7ff79d774700 1 -- 172.21.15.62:0/3531976044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff798155920 con 0x7ff798143fb0 2021-12-17T18:27:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.225+0000 7ff7957fa700 1 -- 172.21.15.62:0/3531976044 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff79000f070 con 0x7ff798143fb0 2021-12-17T18:27:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.225+0000 7ff7957fa700 1 --2- 172.21.15.62:0/3531976044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff77c0536a0 0x7ff77c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.225+0000 7ff7957fa700 1 -- 172.21.15.62:0/3531976044 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff79006cde0 con 0x7ff798143fb0 2021-12-17T18:27:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.225+0000 7ff797fff700 1 --2- 172.21.15.62:0/3531976044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff77c0536a0 0x7ff77c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.225+0000 7ff797fff700 1 --2- 172.21.15.62:0/3531976044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff77c0536a0 0x7ff77c055b60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7ff78800b000 tx=0x7ff788006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:35.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.233+0000 7ff7957fa700 1 -- 172.21.15.62:0/3531976044 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff790043f40 con 0x7ff798143fb0 2021-12-17T18:27:35.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.397+0000 7ff79d774700 1 -- 172.21.15.62:0/3531976044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff79805c260 con 0x7ff798143fb0 2021-12-17T18:27:35.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.397+0000 7ff7957fa700 1 -- 172.21.15.62:0/3531976044 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2142 (secure 0 0 0) 0x7ff79000bea0 con 0x7ff798143fb0 2021-12-17T18:27:35.402 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:35.403 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7957,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6833/3542826349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3542826349},{"type":"v1","addr":"172.21.15.62:6833","nonce":3542826349}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:27:19.830173+0000","modified":"2021-12-17T18:27:20.832915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/570760267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":570760267},{"type":"v1","addr":"172.21.15.109:6835","nonce":570760267}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-12-17T18:27:35.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.397+0000 7ff79d774700 1 -- 172.21.15.62:0/3531976044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff77c0536a0 msgr2=0x7ff77c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:35.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.397+0000 7ff79d774700 1 --2- 172.21.15.62:0/3531976044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff77c0536a0 0x7ff77c055b60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7ff78800b000 tx=0x7ff788006df0).stop 2021-12-17T18:27:35.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.397+0000 7ff79d774700 1 -- 172.21.15.62:0/3531976044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff798143fb0 msgr2=0x7ff798152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:35.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.397+0000 7ff79d774700 1 --2- 172.21.15.62:0/3531976044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff798143fb0 0x7ff798152190 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7ff7900032f0 tx=0x7ff790017000).stop 2021-12-17T18:27:35.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.397+0000 7ff79d774700 1 -- 172.21.15.62:0/3531976044 shutdown_connections 2021-12-17T18:27:35.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.397+0000 7ff79d774700 1 --2- 172.21.15.62:0/3531976044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff77c0536a0 0x7ff77c055b60 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.397+0000 7ff79d774700 1 --2- 172.21.15.62:0/3531976044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff798143fb0 0x7ff798152190 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.397+0000 7ff79d774700 1 --2- 172.21.15.62:0/3531976044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff7980ba2b0 0x7ff7981416c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.397+0000 7ff79d774700 1 --2- 172.21.15.62:0/3531976044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff7980b4200 0x7ff7981134d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.397+0000 7ff79d774700 1 -- 172.21.15.62:0/3531976044 >> 172.21.15.62:0/3531976044 conn(0x7ff798062320 msgr2=0x7ff7981477e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:35.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.397+0000 7ff79d774700 1 -- 172.21.15.62:0/3531976044 shutdown_connections 2021-12-17T18:27:35.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.397+0000 7ff79d774700 1 -- 172.21.15.62:0/3531976044 wait complete. 2021-12-17T18:27:35.408 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 66 2021-12-17T18:27:35.415 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-12-17T18:27:35.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.517+0000 7fd794cc5700 1 Processor -- start 2021-12-17T18:27:35.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.517+0000 7fd794cc5700 1 -- start start 2021-12-17T18:27:35.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.517+0000 7fd794cc5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7900ab9c0 0x7fd790147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.517+0000 7fd794cc5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd7901483d0 0x7fd79014b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.517+0000 7fd794cc5700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7900b6460 con 0x7fd7900b6080 2021-12-17T18:27:35.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.517+0000 7fd794cc5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7900ac060 con 0x7fd7901483d0 2021-12-17T18:27:35.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.517+0000 7fd794cc5700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7900ac300 con 0x7fd7900ab9c0 2021-12-17T18:27:35.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.517+0000 7fd78ed9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd7901483d0 0x7fd79014b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.517+0000 7fd78ed9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd7901483d0 0x7fd79014b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56278/0 (socket says 172.21.15.62:56278) 2021-12-17T18:27:35.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.517+0000 7fd78ed9d700 1 -- 172.21.15.62:0/2442431391 learned_addr learned my addr 172.21.15.62:0/2442431391 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:35.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.517+0000 7fd78dd9b700 1 --2- 172.21.15.62:0/2442431391 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7900ab9c0 0x7fd790147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.517+0000 7fd78ed9d700 1 -- 172.21.15.62:0/2442431391 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7900ab9c0 msgr2=0x7fd790147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:35.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.517+0000 7fd78ed9d700 1 --2- 172.21.15.62:0/2442431391 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7900ab9c0 0x7fd790147ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.517+0000 7fd78ed9d700 1 -- 172.21.15.62:0/2442431391 >> v1:172.21.15.109:6789/0 conn(0x7fd7900b6080 legacy=0x7fd79014ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:35.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.517+0000 7fd78ed9d700 1 -- 172.21.15.62:0/2442431391 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7900ac5a0 con 0x7fd7901483d0 2021-12-17T18:27:35.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.517+0000 7fd78dd9b700 1 --2- 172.21.15.62:0/2442431391 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7900ab9c0 0x7fd790147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:35.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.517+0000 7fd78ed9d700 1 --2- 172.21.15.62:0/2442431391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7901483d0 0x7fd79014b470 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7fd788002f70 tx=0x7fd788006eb0).ready entity=mon.0 client_cookie=1283eb03db654fcd server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:35.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.521+0000 7fd78d59a700 1 -- 172.21.15.62:0/2442431391 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd78800d5c0 con 0x7fd7901483d0 2021-12-17T18:27:35.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.521+0000 7fd78d59a700 1 -- 172.21.15.62:0/2442431391 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd788000e90 con 0x7fd7901483d0 2021-12-17T18:27:35.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.521+0000 7fd78d59a700 1 -- 172.21.15.62:0/2442431391 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd78800d950 con 0x7fd7901483d0 2021-12-17T18:27:35.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.521+0000 7fd794cc5700 1 -- 172.21.15.62:0/2442431391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7901483d0 msgr2=0x7fd79014b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:35.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.521+0000 7fd794cc5700 1 --2- 172.21.15.62:0/2442431391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7901483d0 0x7fd79014b470 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7fd788002f70 tx=0x7fd788006eb0).stop 2021-12-17T18:27:35.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.521+0000 7fd794cc5700 1 -- 172.21.15.62:0/2442431391 shutdown_connections 2021-12-17T18:27:35.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.521+0000 7fd794cc5700 1 --2- 172.21.15.62:0/2442431391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7901483d0 0x7fd79014b470 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.521+0000 7fd794cc5700 1 --2- 172.21.15.62:0/2442431391 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7900ab9c0 0x7fd790147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.521+0000 7fd794cc5700 1 -- 172.21.15.62:0/2442431391 >> 172.21.15.62:0/2442431391 conn(0x7fd7900b2bc0 msgr2=0x7fd7900b5630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:35.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.521+0000 7fd794cc5700 1 -- 172.21.15.62:0/2442431391 shutdown_connections 2021-12-17T18:27:35.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.521+0000 7fd794cc5700 1 -- 172.21.15.62:0/2442431391 wait complete. 2021-12-17T18:27:35.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.521+0000 7fd794cc5700 1 Processor -- start 2021-12-17T18:27:35.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.521+0000 7fd794cc5700 1 -- start start 2021-12-17T18:27:35.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd794cc5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7900ab9c0 0x7fd7900658f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd794cc5700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd7900b6080 0x7fd7900947c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd794cc5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7901483d0 0x7fd790094cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd794cc5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd790093ce0 con 0x7fd7900ab9c0 2021-12-17T18:27:35.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd794cc5700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd790099b40 con 0x7fd7900b6080 2021-12-17T18:27:35.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd794cc5700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd790099de0 con 0x7fd7901483d0 2021-12-17T18:27:35.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd78e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7900ab9c0 0x7fd7900658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd78e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7900ab9c0 0x7fd7900658f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56280/0 (socket says 172.21.15.62:56280) 2021-12-17T18:27:35.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd78e59c700 1 -- 172.21.15.62:0/2776890461 learned_addr learned my addr 172.21.15.62:0/2776890461 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:35.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd78ed9d700 1 --2- 172.21.15.62:0/2776890461 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7901483d0 0x7fd790094cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd78dd9b700 1 --2- 172.21.15.62:0/2776890461 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd7900b6080 0x7fd7900947c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd78e59c700 1 -- 172.21.15.62:0/2776890461 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7901483d0 msgr2=0x7fd790094cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:35.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd78e59c700 1 --2- 172.21.15.62:0/2776890461 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7901483d0 0x7fd790094cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd78e59c700 1 -- 172.21.15.62:0/2776890461 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd7900b6080 msgr2=0x7fd7900947c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:35.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd78e59c700 1 --2- 172.21.15.62:0/2776890461 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd7900b6080 0x7fd7900947c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd78e59c700 1 -- 172.21.15.62:0/2776890461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78800b1e0 con 0x7fd7900ab9c0 2021-12-17T18:27:35.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd78dd9b700 1 --2- 172.21.15.62:0/2776890461 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd7900b6080 0x7fd7900947c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:35.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd78e59c700 1 --2- 172.21.15.62:0/2776890461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7900ab9c0 0x7fd7900658f0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7fd790069c70 tx=0x7fd784007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:35.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd77f7fe700 1 -- 172.21.15.62:0/2776890461 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd784007030 con 0x7fd7900ab9c0 2021-12-17T18:27:35.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd77f7fe700 1 -- 172.21.15.62:0/2776890461 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd784007190 con 0x7fd7900ab9c0 2021-12-17T18:27:35.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd794cc5700 1 -- 172.21.15.62:0/2776890461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79009a280 con 0x7fd7900ab9c0 2021-12-17T18:27:35.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd77f7fe700 1 -- 172.21.15.62:0/2776890461 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd784006510 con 0x7fd7900ab9c0 2021-12-17T18:27:35.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd794cc5700 1 -- 172.21.15.62:0/2776890461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd790067240 con 0x7fd7900ab9c0 2021-12-17T18:27:35.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.525+0000 7fd794cc5700 1 -- 172.21.15.62:0/2776890461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd790092450 con 0x7fd7900ab9c0 2021-12-17T18:27:35.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.529+0000 7fd77f7fe700 1 -- 172.21.15.62:0/2776890461 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd784010030 con 0x7fd7900ab9c0 2021-12-17T18:27:35.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.529+0000 7fd77f7fe700 1 --2- 172.21.15.62:0/2776890461 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd76c053580 0x7fd76c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.529+0000 7fd77f7fe700 1 -- 172.21.15.62:0/2776890461 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd78406b780 con 0x7fd7900ab9c0 2021-12-17T18:27:35.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.529+0000 7fd78dd9b700 1 --2- 172.21.15.62:0/2776890461 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd76c053580 0x7fd76c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.529+0000 7fd78dd9b700 1 --2- 172.21.15.62:0/2776890461 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd76c053580 0x7fd76c055a40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fd78000d000 tx=0x7fd780008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:35.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.533+0000 7fd77f7fe700 1 -- 172.21.15.62:0/2776890461 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd7840428e0 con 0x7fd7900ab9c0 2021-12-17T18:27:35.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.693+0000 7fd794cc5700 1 -- 172.21.15.62:0/2776890461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd790092450 con 0x7fd7900ab9c0 2021-12-17T18:27:35.738 INFO:tasks.ceph.mon.a.smithi062.stderr:2021-12-17T18:27:35.733+0000 7f8d3b366700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-12-17T18:27:35.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.745+0000 7fd77f7fe700 1 -- 172.21.15.62:0/2776890461 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd790092450 con 0x7fd7900ab9c0 2021-12-17T18:27:35.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.749+0000 7fd794cc5700 1 -- 172.21.15.62:0/2776890461 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd76c053580 msgr2=0x7fd76c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:35.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.749+0000 7fd794cc5700 1 --2- 172.21.15.62:0/2776890461 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd76c053580 0x7fd76c055a40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fd78000d000 tx=0x7fd780008040).stop 2021-12-17T18:27:35.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.749+0000 7fd794cc5700 1 -- 172.21.15.62:0/2776890461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7900ab9c0 msgr2=0x7fd7900658f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:35.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.749+0000 7fd794cc5700 1 --2- 172.21.15.62:0/2776890461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7900ab9c0 0x7fd7900658f0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7fd790069c70 tx=0x7fd784007c10).stop 2021-12-17T18:27:35.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.749+0000 7fd794cc5700 1 -- 172.21.15.62:0/2776890461 shutdown_connections 2021-12-17T18:27:35.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.749+0000 7fd794cc5700 1 --2- 172.21.15.62:0/2776890461 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd76c053580 0x7fd76c055a40 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.749+0000 7fd794cc5700 1 --2- 172.21.15.62:0/2776890461 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd7901483d0 0x7fd790094cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.749+0000 7fd794cc5700 1 --2- 172.21.15.62:0/2776890461 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd7900b6080 0x7fd7900947c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.749+0000 7fd794cc5700 1 --2- 172.21.15.62:0/2776890461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7900ab9c0 0x7fd7900658f0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.749+0000 7fd794cc5700 1 -- 172.21.15.62:0/2776890461 >> 172.21.15.62:0/2776890461 conn(0x7fd7900b2bc0 msgr2=0x7fd7900af680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:35.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.749+0000 7fd794cc5700 1 -- 172.21.15.62:0/2776890461 shutdown_connections 2021-12-17T18:27:35.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.749+0000 7fd794cc5700 1 -- 172.21.15.62:0/2776890461 wait complete. 2021-12-17T18:27:35.759 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-12-17T18:27:35.770 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:35.788 INFO:tasks.ceph.mds.b.smithi109.stdout:starting mds.b at 2021-12-17T18:27:35.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.869+0000 7fa52b59e700 1 Processor -- start 2021-12-17T18:27:35.875 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.869+0000 7fa52b59e700 1 -- start start 2021-12-17T18:27:35.877 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.869+0000 7fa52b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa52c0afea0 0x7fa52c0af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.869+0000 7fa52b59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa52c0ae6f0 0x7fa52c1465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.869+0000 7fa52b59e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52c0ad0e0 con 0x7fa52c0acd00 2021-12-17T18:27:35.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.869+0000 7fa52b59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa52c0b0540 con 0x7fa52c0ae6f0 2021-12-17T18:27:35.878 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.869+0000 7fa52b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c0b0bd0 con 0x7fa52c0afea0 2021-12-17T18:27:35.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.869+0000 7fa529d9b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa52c0afea0 0x7fa52c0af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.869+0000 7fa52ad9d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa52c0ae6f0 0x7fa52c1465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.869+0000 7fa52ad9d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa52c0ae6f0 0x7fa52c1465c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:34610/0 (socket says 172.21.15.62:34610) 2021-12-17T18:27:35.879 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.869+0000 7fa52ad9d700 1 -- 172.21.15.62:0/2480740793 learned_addr learned my addr 172.21.15.62:0/2480740793 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:35.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.869+0000 7fa529d9b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa52c0afea0 0x7fa52c0af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:49990/0 (socket says 172.21.15.62:49990) 2021-12-17T18:27:35.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa529d9b700 1 -- 172.21.15.62:0/2480740793 >> v2:172.21.15.109:3300/0 conn(0x7fa52c0ae6f0 msgr2=0x7fa52c1465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:35.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa529d9b700 1 --2- 172.21.15.62:0/2480740793 >> v2:172.21.15.109:3300/0 conn(0x7fa52c0ae6f0 0x7fa52c1465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa529d9b700 1 -- 172.21.15.62:0/2480740793 >> v1:172.21.15.109:6789/0 conn(0x7fa52c0acd00 legacy=0x7fa52c0adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:35.880 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa529d9b700 1 -- 172.21.15.62:0/2480740793 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c0af090 con 0x7fa52c0afea0 2021-12-17T18:27:35.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa529d9b700 1 --2- 172.21.15.62:0/2480740793 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa52c0afea0 0x7fa52c0af7d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fa51c002f70 tx=0x7fa51c006df0).ready entity=mon.2 client_cookie=52ee0d304990fd2f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:35.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa52959a700 1 -- 172.21.15.62:0/2480740793 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa51c00d570 con 0x7fa52c0afea0 2021-12-17T18:27:35.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa52959a700 1 -- 172.21.15.62:0/2480740793 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c000e90 con 0x7fa52c0afea0 2021-12-17T18:27:35.881 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa52959a700 1 -- 172.21.15.62:0/2480740793 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa51c00d8c0 con 0x7fa52c0afea0 2021-12-17T18:27:35.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa52b59e700 1 -- 172.21.15.62:0/2480740793 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa52c0afea0 msgr2=0x7fa52c0af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:35.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa52b59e700 1 --2- 172.21.15.62:0/2480740793 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa52c0afea0 0x7fa52c0af7d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fa51c002f70 tx=0x7fa51c006df0).stop 2021-12-17T18:27:35.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa52b59e700 1 -- 172.21.15.62:0/2480740793 shutdown_connections 2021-12-17T18:27:35.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa52b59e700 1 --2- 172.21.15.62:0/2480740793 >> v2:172.21.15.109:3300/0 conn(0x7fa52c0ae6f0 0x7fa52c1465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa52b59e700 1 --2- 172.21.15.62:0/2480740793 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa52c0afea0 0x7fa52c0af7d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa52b59e700 1 -- 172.21.15.62:0/2480740793 >> 172.21.15.62:0/2480740793 conn(0x7fa52c0b5480 msgr2=0x7fa52c0b5890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:35.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa52b59e700 1 -- 172.21.15.62:0/2480740793 shutdown_connections 2021-12-17T18:27:35.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa52b59e700 1 -- 172.21.15.62:0/2480740793 wait complete. 2021-12-17T18:27:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa52b59e700 1 Processor -- start 2021-12-17T18:27:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.873+0000 7fa52b59e700 1 -- start start 2021-12-17T18:27:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa52c0acd00 0x7fa52c065630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa52c0ae6f0 0x7fa52c0ab670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52b59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa52c0afea0 0x7fa52c0abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c0a7940 con 0x7fa52c0acd00 2021-12-17T18:27:35.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52b59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c0a7be0 con 0x7fa52c0afea0 2021-12-17T18:27:35.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c0a7e80 con 0x7fa52c0ae6f0 2021-12-17T18:27:35.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa52c0acd00 0x7fa52c065630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa52c0acd00 0x7fa52c065630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56294/0 (socket says 172.21.15.62:56294) 2021-12-17T18:27:35.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52a59c700 1 -- 172.21.15.62:0/3577528625 learned_addr learned my addr 172.21.15.62:0/3577528625 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:35.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa529d9b700 1 --2- 172.21.15.62:0/3577528625 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa52c0ae6f0 0x7fa52c0ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52ad9d700 1 --2- 172.21.15.62:0/3577528625 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa52c0afea0 0x7fa52c0abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52a59c700 1 -- 172.21.15.62:0/3577528625 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa52c0ae6f0 msgr2=0x7fa52c0ab670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:35.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52a59c700 1 --2- 172.21.15.62:0/3577528625 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa52c0ae6f0 0x7fa52c0ab670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52a59c700 1 -- 172.21.15.62:0/3577528625 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa52c0afea0 msgr2=0x7fa52c0abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:35.890 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52a59c700 1 --2- 172.21.15.62:0/3577528625 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa52c0afea0 0x7fa52c0abb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:35.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52a59c700 1 -- 172.21.15.62:0/3577528625 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c00b180 con 0x7fa52c0acd00 2021-12-17T18:27:35.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52a59c700 1 --2- 172.21.15.62:0/3577528625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa52c0acd00 0x7fa52c065630 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7fa52c0af6b0 tx=0x7fa520007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:35.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa51b7fe700 1 -- 172.21.15.62:0/3577528625 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa520007030 con 0x7fa52c0acd00 2021-12-17T18:27:35.891 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa51b7fe700 1 -- 172.21.15.62:0/3577528625 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa520007190 con 0x7fa52c0acd00 2021-12-17T18:27:35.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52b59e700 1 -- 172.21.15.62:0/3577528625 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52c0a7630 con 0x7fa52c0acd00 2021-12-17T18:27:35.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa51b7fe700 1 -- 172.21.15.62:0/3577528625 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa520006510 con 0x7fa52c0acd00 2021-12-17T18:27:35.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.877+0000 7fa52b59e700 1 -- 172.21.15.62:0/3577528625 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52c064750 con 0x7fa52c0acd00 2021-12-17T18:27:35.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.881+0000 7fa52b59e700 1 -- 172.21.15.62:0/3577528625 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa52c0a8040 con 0x7fa52c0acd00 2021-12-17T18:27:35.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.881+0000 7fa51b7fe700 1 -- 172.21.15.62:0/3577528625 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa520010030 con 0x7fa52c0acd00 2021-12-17T18:27:35.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.881+0000 7fa51b7fe700 1 --2- 172.21.15.62:0/3577528625 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa508053610 0x7fa508055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:35.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.881+0000 7fa51b7fe700 1 -- 172.21.15.62:0/3577528625 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa52006b560 con 0x7fa52c0acd00 2021-12-17T18:27:35.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.881+0000 7fa529d9b700 1 --2- 172.21.15.62:0/3577528625 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa508053610 0x7fa508055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:35.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.881+0000 7fa529d9b700 1 --2- 172.21.15.62:0/3577528625 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa508053610 0x7fa508055ad0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fa51c01a000 tx=0x7fa51c014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:35.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:35.889+0000 7fa51b7fe700 1 -- 172.21.15.62:0/3577528625 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa5200425d0 con 0x7fa52c0acd00 2021-12-17T18:27:36.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.053+0000 7fa52b59e700 1 -- 172.21.15.62:0/3577528625 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa52c0573d0 con 0x7fa52c0acd00 2021-12-17T18:27:36.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.053+0000 7fa51b7fe700 1 -- 172.21.15.62:0/3577528625 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+1782 (secure 0 0 0) 0x7fa520045bf0 con 0x7fa52c0acd00 2021-12-17T18:27:36.058 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:36.058 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":67,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7957,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6833/3542826349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3542826349},{"type":"v1","addr":"172.21.15.62:6833","nonce":3542826349}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:27:19.830173+0000","modified":"2021-12-17T18:27:35.735758+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":133,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-12-17T18:27:36.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.053+0000 7fa52b59e700 1 -- 172.21.15.62:0/3577528625 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa508053610 msgr2=0x7fa508055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:36.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.053+0000 7fa52b59e700 1 --2- 172.21.15.62:0/3577528625 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa508053610 0x7fa508055ad0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fa51c01a000 tx=0x7fa51c014000).stop 2021-12-17T18:27:36.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.053+0000 7fa52b59e700 1 -- 172.21.15.62:0/3577528625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa52c0acd00 msgr2=0x7fa52c065630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:36.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.053+0000 7fa52b59e700 1 --2- 172.21.15.62:0/3577528625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa52c0acd00 0x7fa52c065630 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7fa52c0af6b0 tx=0x7fa520007c10).stop 2021-12-17T18:27:36.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.053+0000 7fa52b59e700 1 -- 172.21.15.62:0/3577528625 shutdown_connections 2021-12-17T18:27:36.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.053+0000 7fa52b59e700 1 --2- 172.21.15.62:0/3577528625 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa508053610 0x7fa508055ad0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.053+0000 7fa52b59e700 1 --2- 172.21.15.62:0/3577528625 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa52c0afea0 0x7fa52c0abb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.053+0000 7fa52b59e700 1 --2- 172.21.15.62:0/3577528625 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa52c0ae6f0 0x7fa52c0ab670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.053+0000 7fa52b59e700 1 --2- 172.21.15.62:0/3577528625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa52c0acd00 0x7fa52c065630 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.053+0000 7fa52b59e700 1 -- 172.21.15.62:0/3577528625 >> 172.21.15.62:0/3577528625 conn(0x7fa52c0b5480 msgr2=0x7fa52c0b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:36.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.053+0000 7fa52b59e700 1 -- 172.21.15.62:0/3577528625 shutdown_connections 2021-12-17T18:27:36.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.053+0000 7fa52b59e700 1 -- 172.21.15.62:0/3577528625 wait complete. 2021-12-17T18:27:36.064 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 67 2021-12-17T18:27:36.071 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-12-17T18:27:36.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.173+0000 7f9b26a99700 1 Processor -- start 2021-12-17T18:27:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.173+0000 7f9b26a99700 1 -- start start 2021-12-17T18:27:36.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b26a99700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f9b20061bf0 0x7f9b2005c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:36.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b26a99700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9b201440e0 0x7f9b200b4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b26a99700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b20062790 con 0x7f9b200b5c70 2021-12-17T18:27:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b26a99700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b201432d0 con 0x7f9b20061bf0 2021-12-17T18:27:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b26a99700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b20061fd0 con 0x7f9b201440e0 2021-12-17T18:27:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b1ffff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9b200b5c70 0x7f9b201439d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39884/0 (socket says 172.21.15.62:39884) 2021-12-17T18:27:36.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b1ffff700 1 -- 172.21.15.62:0/1834152163 learned_addr learned my addr 172.21.15.62:0/1834152163 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:36.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b24835700 1 --2- 172.21.15.62:0/1834152163 >> v2:172.21.15.109:3300/0 conn(0x7f9b20061bf0 0x7f9b2005c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:36.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b25036700 1 --2- 172.21.15.62:0/1834152163 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9b201440e0 0x7f9b200b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:36.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b1f7fe700 1 -- 172.21.15.62:0/1834152163 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155206444 0 0) 0x7f9b14001110 con 0x7f9b200b5c70 2021-12-17T18:27:36.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b1f7fe700 1 -- 172.21.15.62:0/1834152163 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b0c003260 con 0x7f9b200b5c70 2021-12-17T18:27:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b24835700 1 -- 172.21.15.62:0/1834152163 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9b201440e0 msgr2=0x7f9b200b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b24835700 1 --2- 172.21.15.62:0/1834152163 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9b201440e0 0x7f9b200b4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b24835700 1 -- 172.21.15.62:0/1834152163 >> v1:172.21.15.62:6789/0 conn(0x7f9b200b5c70 legacy=0x7f9b201439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b24835700 1 -- 172.21.15.62:0/1834152163 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b20143530 con 0x7f9b20061bf0 2021-12-17T18:27:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b25036700 1 --2- 172.21.15.62:0/1834152163 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9b201440e0 0x7f9b200b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b24835700 1 --2- 172.21.15.62:0/1834152163 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9b20061bf0 0x7f9b2005c730 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f9b10002f70 tx=0x7f9b10006df0).ready entity=mon.1 client_cookie=9ee447b73eb21012 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b1f7fe700 1 -- 172.21.15.62:0/1834152163 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b1000d4a0 con 0x7f9b20061bf0 2021-12-17T18:27:36.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b1f7fe700 1 -- 172.21.15.62:0/1834152163 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b10000e90 con 0x7f9b20061bf0 2021-12-17T18:27:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b1f7fe700 1 -- 172.21.15.62:0/1834152163 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b1000d7f0 con 0x7f9b20061bf0 2021-12-17T18:27:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b26a99700 1 -- 172.21.15.62:0/1834152163 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9b20061bf0 msgr2=0x7f9b2005c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b26a99700 1 --2- 172.21.15.62:0/1834152163 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9b20061bf0 0x7f9b2005c730 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f9b10002f70 tx=0x7f9b10006df0).stop 2021-12-17T18:27:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b26a99700 1 -- 172.21.15.62:0/1834152163 shutdown_connections 2021-12-17T18:27:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b26a99700 1 --2- 172.21.15.62:0/1834152163 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9b201440e0 0x7f9b200b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b26a99700 1 --2- 172.21.15.62:0/1834152163 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9b20061bf0 0x7f9b2005c730 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b26a99700 1 -- 172.21.15.62:0/1834152163 >> 172.21.15.62:0/1834152163 conn(0x7f9b200b99a0 msgr2=0x7f9b200b9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b26a99700 1 -- 172.21.15.62:0/1834152163 shutdown_connections 2021-12-17T18:27:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b26a99700 1 -- 172.21.15.62:0/1834152163 wait complete. 2021-12-17T18:27:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b26a99700 1 Processor -- start 2021-12-17T18:27:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.177+0000 7f9b26a99700 1 -- start start 2021-12-17T18:27:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b26a99700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9b20061bf0 0x7f9b200b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b26a99700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b200b5c70 0x7f9b20156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b26a99700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9b201440e0 0x7f9b20144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:36.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b26a99700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2012fda0 con 0x7f9b200b5c70 2021-12-17T18:27:36.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b26a99700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b20155d00 con 0x7f9b20061bf0 2021-12-17T18:27:36.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b26a99700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b20155fa0 con 0x7f9b201440e0 2021-12-17T18:27:36.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b1ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b200b5c70 0x7f9b20156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:36.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b1ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b200b5c70 0x7f9b20156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56312/0 (socket says 172.21.15.62:56312) 2021-12-17T18:27:36.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b1ffff700 1 -- 172.21.15.62:0/2460359223 learned_addr learned my addr 172.21.15.62:0/2460359223 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:36.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b25036700 1 --2- 172.21.15.62:0/2460359223 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9b201440e0 0x7f9b20144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:36.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b24835700 1 --2- 172.21.15.62:0/2460359223 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9b20061bf0 0x7f9b200b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:36.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b1ffff700 1 -- 172.21.15.62:0/2460359223 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9b201440e0 msgr2=0x7f9b20144fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:36.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b1ffff700 1 --2- 172.21.15.62:0/2460359223 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9b201440e0 0x7f9b20144fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b1ffff700 1 -- 172.21.15.62:0/2460359223 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9b20061bf0 msgr2=0x7f9b200b8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:36.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b1ffff700 1 --2- 172.21.15.62:0/2460359223 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9b20061bf0 0x7f9b200b8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b1ffff700 1 -- 172.21.15.62:0/2460359223 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b18009470 con 0x7f9b200b5c70 2021-12-17T18:27:36.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b24835700 1 --2- 172.21.15.62:0/2460359223 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9b20061bf0 0x7f9b200b8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:36.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b25036700 1 --2- 172.21.15.62:0/2460359223 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9b201440e0 0x7f9b20144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:36.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b1ffff700 1 --2- 172.21.15.62:0/2460359223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b200b5c70 0x7f9b20156440 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f9b140012a0 tx=0x7f9b140079a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:36.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b1dffb700 1 -- 172.21.15.62:0/2460359223 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b140072e0 con 0x7f9b200b5c70 2021-12-17T18:27:36.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b1dffb700 1 -- 172.21.15.62:0/2460359223 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b14007440 con 0x7f9b200b5c70 2021-12-17T18:27:36.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b26a99700 1 -- 172.21.15.62:0/2460359223 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1000b180 con 0x7f9b200b5c70 2021-12-17T18:27:36.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b1dffb700 1 -- 172.21.15.62:0/2460359223 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b14005800 con 0x7f9b200b5c70 2021-12-17T18:27:36.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b26a99700 1 -- 172.21.15.62:0/2460359223 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2012fa20 con 0x7f9b200b5c70 2021-12-17T18:27:36.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b1dffb700 1 -- 172.21.15.62:0/2460359223 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9b14010070 con 0x7f9b200b5c70 2021-12-17T18:27:36.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.181+0000 7f9b26a99700 1 -- 172.21.15.62:0/2460359223 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2005cd00 con 0x7f9b200b5c70 2021-12-17T18:27:36.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.185+0000 7f9b1dffb700 1 --2- 172.21.15.62:0/2460359223 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9b00053610 0x7f9b00055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:36.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.185+0000 7f9b1dffb700 1 -- 172.21.15.62:0/2460359223 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9b1406aff0 con 0x7f9b200b5c70 2021-12-17T18:27:36.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.185+0000 7f9b24835700 1 --2- 172.21.15.62:0/2460359223 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9b00053610 0x7f9b00055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:36.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.185+0000 7f9b24835700 1 --2- 172.21.15.62:0/2460359223 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9b00053610 0x7f9b00055ad0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f9b10018000 tx=0x7f9b10014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:36.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.189+0000 7f9b1dffb700 1 -- 172.21.15.62:0/2460359223 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9b14042030 con 0x7f9b200b5c70 2021-12-17T18:27:36.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.349+0000 7f9b26a99700 1 -- 172.21.15.62:0/2460359223 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9b20062790 con 0x7f9b200b5c70 2021-12-17T18:27:36.763 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.757+0000 7f9b1dffb700 1 -- 172.21.15.62:0/2460359223 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9b20062790 con 0x7f9b200b5c70 2021-12-17T18:27:36.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.761+0000 7f9b26a99700 1 -- 172.21.15.62:0/2460359223 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9b00053610 msgr2=0x7f9b00055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:36.767 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.761+0000 7f9b26a99700 1 --2- 172.21.15.62:0/2460359223 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9b00053610 0x7f9b00055ad0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f9b10018000 tx=0x7f9b10014000).stop 2021-12-17T18:27:36.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.761+0000 7f9b26a99700 1 -- 172.21.15.62:0/2460359223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b200b5c70 msgr2=0x7f9b20156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:36.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.761+0000 7f9b26a99700 1 --2- 172.21.15.62:0/2460359223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b200b5c70 0x7f9b20156440 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f9b140012a0 tx=0x7f9b140079a0).stop 2021-12-17T18:27:36.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.761+0000 7f9b26a99700 1 -- 172.21.15.62:0/2460359223 shutdown_connections 2021-12-17T18:27:36.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.761+0000 7f9b26a99700 1 --2- 172.21.15.62:0/2460359223 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9b00053610 0x7f9b00055ad0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.768 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.761+0000 7f9b26a99700 1 --2- 172.21.15.62:0/2460359223 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9b201440e0 0x7f9b20144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.761+0000 7f9b26a99700 1 --2- 172.21.15.62:0/2460359223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b200b5c70 0x7f9b20156440 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.761+0000 7f9b26a99700 1 --2- 172.21.15.62:0/2460359223 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9b20061bf0 0x7f9b200b8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.761+0000 7f9b26a99700 1 -- 172.21.15.62:0/2460359223 >> 172.21.15.62:0/2460359223 conn(0x7f9b200b99a0 msgr2=0x7f9b2012b470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:36.769 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.761+0000 7f9b26a99700 1 -- 172.21.15.62:0/2460359223 shutdown_connections 2021-12-17T18:27:36.770 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.761+0000 7f9b26a99700 1 -- 172.21.15.62:0/2460359223 wait complete. 2021-12-17T18:27:36.781 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-12-17T18:27:36.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.897+0000 7efdaf77d700 1 Processor -- start 2021-12-17T18:27:36.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.897+0000 7efdaf77d700 1 -- start start 2021-12-17T18:27:36.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.897+0000 7efdaf77d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7efda80b4590 0x7efda80b6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:36.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.897+0000 7efdaf77d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efda8143c80 0x7efda813d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:36.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.897+0000 7efdaf77d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda80b51b0 con 0x7efda80b6590 2021-12-17T18:27:36.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.897+0000 7efdaf77d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda8144680 con 0x7efda80b4590 2021-12-17T18:27:36.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.897+0000 7efdaf77d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda8146d10 con 0x7efda8143c80 2021-12-17T18:27:36.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.897+0000 7efdad519700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7efda80b6590 0x7efda80b4aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39896/0 (socket says 172.21.15.62:39896) 2021-12-17T18:27:36.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.897+0000 7efdad519700 1 -- 172.21.15.62:0/2913331759 learned_addr learned my addr 172.21.15.62:0/2913331759 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:36.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efdacd18700 1 --2- 172.21.15.62:0/2913331759 >> v2:172.21.15.109:3300/0 conn(0x7efda80b4590 0x7efda80b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:36.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efdadd1a700 1 --2- 172.21.15.62:0/2913331759 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efda8143c80 0x7efda813d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:36.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efd97fff700 1 -- 172.21.15.62:0/2913331759 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1717580350 0 0) 0x7efda80b51b0 con 0x7efda80b6590 2021-12-17T18:27:36.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efd97fff700 1 -- 172.21.15.62:0/2913331759 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd90003260 con 0x7efda80b6590 2021-12-17T18:27:36.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efdadd1a700 1 -- 172.21.15.62:0/2913331759 >> v2:172.21.15.109:3300/0 conn(0x7efda80b4590 msgr2=0x7efda80b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:36.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efdadd1a700 1 --2- 172.21.15.62:0/2913331759 >> v2:172.21.15.109:3300/0 conn(0x7efda80b4590 0x7efda80b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efdadd1a700 1 -- 172.21.15.62:0/2913331759 >> v1:172.21.15.62:6789/0 conn(0x7efda80b6590 legacy=0x7efda80b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:36.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efdadd1a700 1 -- 172.21.15.62:0/2913331759 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda8143540 con 0x7efda8143c80 2021-12-17T18:27:36.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efdacd18700 1 --2- 172.21.15.62:0/2913331759 >> v2:172.21.15.109:3300/0 conn(0x7efda80b4590 0x7efda80b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:36.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efdadd1a700 1 --2- 172.21.15.62:0/2913331759 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efda8143c80 0x7efda813d080 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7efda00032f0 tx=0x7efda00091d0).ready entity=mon.2 client_cookie=dfbd0321e540c3d1 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:36.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efd97fff700 1 -- 172.21.15.62:0/2913331759 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efda000b600 con 0x7efda8143c80 2021-12-17T18:27:36.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efd97fff700 1 -- 172.21.15.62:0/2913331759 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda000b760 con 0x7efda8143c80 2021-12-17T18:27:36.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efd97fff700 1 -- 172.21.15.62:0/2913331759 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efda000b8d0 con 0x7efda8143c80 2021-12-17T18:27:36.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efdaf77d700 1 -- 172.21.15.62:0/2913331759 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efda8143c80 msgr2=0x7efda813d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:36.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efdaf77d700 1 --2- 172.21.15.62:0/2913331759 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efda8143c80 0x7efda813d080 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7efda00032f0 tx=0x7efda00091d0).stop 2021-12-17T18:27:36.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efdaf77d700 1 -- 172.21.15.62:0/2913331759 shutdown_connections 2021-12-17T18:27:36.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efdaf77d700 1 --2- 172.21.15.62:0/2913331759 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efda8143c80 0x7efda813d080 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efdaf77d700 1 --2- 172.21.15.62:0/2913331759 >> v2:172.21.15.109:3300/0 conn(0x7efda80b4590 0x7efda80b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efdaf77d700 1 -- 172.21.15.62:0/2913331759 >> 172.21.15.62:0/2913331759 conn(0x7efda8061b20 msgr2=0x7efda8061f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:36.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efdaf77d700 1 -- 172.21.15.62:0/2913331759 shutdown_connections 2021-12-17T18:27:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.901+0000 7efdaf77d700 1 -- 172.21.15.62:0/2913331759 wait complete. 2021-12-17T18:27:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdaf77d700 1 Processor -- start 2021-12-17T18:27:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdaf77d700 1 -- start start 2021-12-17T18:27:36.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdaf77d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efda80b4590 0x7efda80ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:36.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdaf77d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efda80b6590 0x7efda813cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:36.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdaf77d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efda8143c80 0x7efda80b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:36.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdaf77d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda813b190 con 0x7efda80b4590 2021-12-17T18:27:36.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdaf77d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda80b1d30 con 0x7efda8143c80 2021-12-17T18:27:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdaf77d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda80b2e30 con 0x7efda80b6590 2021-12-17T18:27:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdad519700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efda80b4590 0x7efda80ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdad519700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efda80b4590 0x7efda80ad850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56322/0 (socket says 172.21.15.62:56322) 2021-12-17T18:27:36.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdad519700 1 -- 172.21.15.62:0/2428762431 learned_addr learned my addr 172.21.15.62:0/2428762431 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdacd18700 1 --2- 172.21.15.62:0/2428762431 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efda80b6590 0x7efda813cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdadd1a700 1 --2- 172.21.15.62:0/2428762431 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efda8143c80 0x7efda80b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdad519700 1 -- 172.21.15.62:0/2428762431 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efda80b6590 msgr2=0x7efda813cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdad519700 1 --2- 172.21.15.62:0/2428762431 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efda80b6590 0x7efda813cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdad519700 1 -- 172.21.15.62:0/2428762431 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efda8143c80 msgr2=0x7efda80b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:36.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdad519700 1 --2- 172.21.15.62:0/2428762431 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efda8143c80 0x7efda80b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:36.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdad519700 1 -- 172.21.15.62:0/2428762431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda400b180 con 0x7efda80b4590 2021-12-17T18:27:36.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdadd1a700 1 --2- 172.21.15.62:0/2428762431 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efda8143c80 0x7efda80b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:36.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdacd18700 1 --2- 172.21.15.62:0/2428762431 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efda80b6590 0x7efda813cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:36.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.905+0000 7efdad519700 1 --2- 172.21.15.62:0/2428762431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efda80b4590 0x7efda80ad850 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7efda80b3670 tx=0x7efd98007b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:36.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.909+0000 7efd967fc700 1 -- 172.21.15.62:0/2428762431 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd980072e0 con 0x7efda80b4590 2021-12-17T18:27:36.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.909+0000 7efd967fc700 1 -- 172.21.15.62:0/2428762431 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd98007440 con 0x7efda80b4590 2021-12-17T18:27:36.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.909+0000 7efdaf77d700 1 -- 172.21.15.62:0/2428762431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda0009470 con 0x7efda80b4590 2021-12-17T18:27:36.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.909+0000 7efd967fc700 1 -- 172.21.15.62:0/2428762431 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd98005800 con 0x7efda80b4590 2021-12-17T18:27:36.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.909+0000 7efdaf77d700 1 -- 172.21.15.62:0/2428762431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda80b2200 con 0x7efda80b4590 2021-12-17T18:27:36.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.909+0000 7efdaf77d700 1 -- 172.21.15.62:0/2428762431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda81437e0 con 0x7efda80b4590 2021-12-17T18:27:36.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.909+0000 7efd967fc700 1 -- 172.21.15.62:0/2428762431 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efd9801a070 con 0x7efda80b4590 2021-12-17T18:27:36.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.909+0000 7efd967fc700 1 --2- 172.21.15.62:0/2428762431 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efd88053610 0x7efd88055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:36.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.909+0000 7efd967fc700 1 -- 172.21.15.62:0/2428762431 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6159+0+0 (secure 0 0 0) 0x7efd9806adb0 con 0x7efda80b4590 2021-12-17T18:27:36.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.909+0000 7efdacd18700 1 --2- 172.21.15.62:0/2428762431 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efd88053610 0x7efd88055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:36.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.913+0000 7efdacd18700 1 --2- 172.21.15.62:0/2428762431 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efd88053610 0x7efd88055ad0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7efda400b000 tx=0x7efda4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:36.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:36.917+0000 7efd967fc700 1 -- 172.21.15.62:0/2428762431 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efd98041e60 con 0x7efda80b4590 2021-12-17T18:27:37.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.045+0000 7efdaf77d700 1 -- 172.21.15.62:0/2428762431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efda80573d0 con 0x7efda80b4590 2021-12-17T18:27:37.777 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.773+0000 7efd967fc700 1 -- 172.21.15.62:0/2428762431 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v134) v1 ==== 185+0+0 (secure 0 0 0) 0x7efd98018030 con 0x7efda80b4590 2021-12-17T18:27:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.777+0000 7efdaf77d700 1 -- 172.21.15.62:0/2428762431 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efd88053610 msgr2=0x7efd88055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.777+0000 7efdaf77d700 1 --2- 172.21.15.62:0/2428762431 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efd88053610 0x7efd88055ad0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7efda400b000 tx=0x7efda4008040).stop 2021-12-17T18:27:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.777+0000 7efdaf77d700 1 -- 172.21.15.62:0/2428762431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efda80b4590 msgr2=0x7efda80ad850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.777+0000 7efdaf77d700 1 --2- 172.21.15.62:0/2428762431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efda80b4590 0x7efda80ad850 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7efda80b3670 tx=0x7efd98007b20).stop 2021-12-17T18:27:37.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.777+0000 7efdaf77d700 1 -- 172.21.15.62:0/2428762431 shutdown_connections 2021-12-17T18:27:37.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.777+0000 7efdaf77d700 1 --2- 172.21.15.62:0/2428762431 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efd88053610 0x7efd88055ad0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:37.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.777+0000 7efdaf77d700 1 --2- 172.21.15.62:0/2428762431 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efda8143c80 0x7efda80b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:37.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.777+0000 7efdaf77d700 1 --2- 172.21.15.62:0/2428762431 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efda80b6590 0x7efda813cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.777+0000 7efdaf77d700 1 --2- 172.21.15.62:0/2428762431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efda80b4590 0x7efda80ad850 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.777+0000 7efdaf77d700 1 -- 172.21.15.62:0/2428762431 >> 172.21.15.62:0/2428762431 conn(0x7efda8061b20 msgr2=0x7efda813fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.777+0000 7efdaf77d700 1 -- 172.21.15.62:0/2428762431 shutdown_connections 2021-12-17T18:27:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.777+0000 7efdaf77d700 1 -- 172.21.15.62:0/2428762431 wait complete. 2021-12-17T18:27:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2021-12-17T18:27:37.796 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-12-17T18:27:37.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f481b59e700 1 Processor -- start 2021-12-17T18:27:37.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f481b59e700 1 -- start start 2021-12-17T18:27:37.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f481b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f481c13f500 0x7f481c0add10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:37.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f481b59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f481c0b1640 0x7f481c0b2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:37.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f481b59e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f481c0ad640 con 0x7f481c0b1ab0 2021-12-17T18:27:37.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f481b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481c0b2c80 con 0x7f481c13f500 2021-12-17T18:27:37.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f481b59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481c0ad870 con 0x7f481c0b1640 2021-12-17T18:27:37.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f481a59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f481c13f500 0x7f481c0add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:37.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f481a59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f481c13f500 0x7f481c0add10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56330/0 (socket says 172.21.15.62:56330) 2021-12-17T18:27:37.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f481a59c700 1 -- 172.21.15.62:0/1750853281 learned_addr learned my addr 172.21.15.62:0/1750853281 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:37.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f4813fff700 1 --2- 172.21.15.62:0/1750853281 >> v2:172.21.15.109:3300/0 conn(0x7f481c0b1640 0x7f481c0b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:37.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f481a59c700 1 -- 172.21.15.62:0/1750853281 >> v2:172.21.15.109:3300/0 conn(0x7f481c0b1640 msgr2=0x7f481c0b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:37.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f481a59c700 1 --2- 172.21.15.62:0/1750853281 >> v2:172.21.15.109:3300/0 conn(0x7f481c0b1640 0x7f481c0b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:37.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f481a59c700 1 -- 172.21.15.62:0/1750853281 >> v1:172.21.15.109:6789/0 conn(0x7f481c0b1ab0 legacy=0x7f481c13f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:37.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f481a59c700 1 -- 172.21.15.62:0/1750853281 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c0ac070 con 0x7f481c13f500 2021-12-17T18:27:37.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f481a59c700 1 --2- 172.21.15.62:0/1750853281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f481c13f500 0x7f481c0add10 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f480c002f70 tx=0x7f480c006f40).ready entity=mon.0 client_cookie=9ae67af6378e1930 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:37.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f4819d9b700 1 -- 172.21.15.62:0/1750853281 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f480c00dc70 con 0x7f481c13f500 2021-12-17T18:27:37.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f4819d9b700 1 -- 172.21.15.62:0/1750853281 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c000e90 con 0x7f481c13f500 2021-12-17T18:27:37.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.905+0000 7f4819d9b700 1 -- 172.21.15.62:0/1750853281 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f480c00be90 con 0x7f481c13f500 2021-12-17T18:27:37.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.909+0000 7f481b59e700 1 -- 172.21.15.62:0/1750853281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f481c13f500 msgr2=0x7f481c0add10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:37.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.909+0000 7f481b59e700 1 --2- 172.21.15.62:0/1750853281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f481c13f500 0x7f481c0add10 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f480c002f70 tx=0x7f480c006f40).stop 2021-12-17T18:27:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.909+0000 7f481b59e700 1 -- 172.21.15.62:0/1750853281 shutdown_connections 2021-12-17T18:27:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.909+0000 7f481b59e700 1 --2- 172.21.15.62:0/1750853281 >> v2:172.21.15.109:3300/0 conn(0x7f481c0b1640 0x7f481c0b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:37.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.909+0000 7f481b59e700 1 --2- 172.21.15.62:0/1750853281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f481c13f500 0x7f481c0add10 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.909+0000 7f481b59e700 1 -- 172.21.15.62:0/1750853281 >> 172.21.15.62:0/1750853281 conn(0x7f481c0b39d0 msgr2=0x7f481c060840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.909+0000 7f481b59e700 1 -- 172.21.15.62:0/1750853281 shutdown_connections 2021-12-17T18:27:37.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.909+0000 7f481b59e700 1 -- 172.21.15.62:0/1750853281 wait complete. 2021-12-17T18:27:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.909+0000 7f481b59e700 1 Processor -- start 2021-12-17T18:27:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.909+0000 7f481b59e700 1 -- start start 2021-12-17T18:27:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f481b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f481c0b1640 0x7f481c142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f481b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f481c0b1ab0 0x7f481c139990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f481b59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f481c13f500 0x7f481c139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f481b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c142690 con 0x7f481c0b1ab0 2021-12-17T18:27:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f481b59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c061670 con 0x7f481c13f500 2021-12-17T18:27:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f481b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481c1413c0 con 0x7f481c0b1640 2021-12-17T18:27:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f4813fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f481c0b1ab0 0x7f481c139990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f481a59c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f481c0b1640 0x7f481c142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f481a59c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f481c0b1640 0x7f481c142fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:50038/0 (socket says 172.21.15.62:50038) 2021-12-17T18:27:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f4813fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f481c0b1ab0 0x7f481c139990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56338/0 (socket says 172.21.15.62:56338) 2021-12-17T18:27:37.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f481a59c700 1 -- 172.21.15.62:0/2040502086 learned_addr learned my addr 172.21.15.62:0/2040502086 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f481ad9d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f481c13f500 0x7f481c139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f4813fff700 1 -- 172.21.15.62:0/2040502086 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f481c0b1640 msgr2=0x7f481c142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f4813fff700 1 --2- 172.21.15.62:0/2040502086 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f481c0b1640 0x7f481c142fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:37.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f4813fff700 1 -- 172.21.15.62:0/2040502086 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f481c13f500 msgr2=0x7f481c139e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f4813fff700 1 --2- 172.21.15.62:0/2040502086 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f481c13f500 0x7f481c139e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f4813fff700 1 -- 172.21.15.62:0/2040502086 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c00b460 con 0x7f481c0b1ab0 2021-12-17T18:27:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f481ad9d700 1 --2- 172.21.15.62:0/2040502086 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f481c13f500 0x7f481c139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:37.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f481a59c700 1 --2- 172.21.15.62:0/2040502086 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f481c0b1640 0x7f481c142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f4813fff700 1 --2- 172.21.15.62:0/2040502086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f481c0b1ab0 0x7f481c139990 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f480400a000 tx=0x7f4804008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f48137fe700 1 -- 172.21.15.62:0/2040502086 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48040104f0 con 0x7f481c0b1ab0 2021-12-17T18:27:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f48137fe700 1 -- 172.21.15.62:0/2040502086 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4804010650 con 0x7f481c0b1ab0 2021-12-17T18:27:37.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f481b59e700 1 -- 172.21.15.62:0/2040502086 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481c1417c0 con 0x7f481c0b1ab0 2021-12-17T18:27:37.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f48137fe700 1 -- 172.21.15.62:0/2040502086 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48040109b0 con 0x7f481c0b1ab0 2021-12-17T18:27:37.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.913+0000 7f481b59e700 1 -- 172.21.15.62:0/2040502086 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481c151a60 con 0x7f481c0b1ab0 2021-12-17T18:27:37.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.917+0000 7f481b59e700 1 -- 172.21.15.62:0/2040502086 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481c063f30 con 0x7f481c0b1ab0 2021-12-17T18:27:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.917+0000 7f48137fe700 1 -- 172.21.15.62:0/2040502086 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f480401a030 con 0x7f481c0b1ab0 2021-12-17T18:27:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.917+0000 7f48137fe700 1 --2- 172.21.15.62:0/2040502086 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4800053610 0x7f4800055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.917+0000 7f48137fe700 1 -- 172.21.15.62:0/2040502086 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f480406b2e0 con 0x7f481c0b1ab0 2021-12-17T18:27:37.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.917+0000 7f481a59c700 1 --2- 172.21.15.62:0/2040502086 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4800053610 0x7f4800055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:37.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.917+0000 7f481a59c700 1 --2- 172.21.15.62:0/2040502086 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4800053610 0x7f4800055ad0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f480c01e000 tx=0x7f480c006f40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:37.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:37.925+0000 7f48137fe700 1 -- 172.21.15.62:0/2040502086 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4804042540 con 0x7f481c0b1ab0 2021-12-17T18:27:38.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:38.053+0000 7f481b59e700 1 -- 172.21.15.62:0/2040502086 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f481c0573d0 con 0x7f481c0b1ab0 2021-12-17T18:27:38.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:38.777+0000 7f48137fe700 1 -- 172.21.15.62:0/2040502086 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v135) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4804045b60 con 0x7f481c0b1ab0 2021-12-17T18:27:38.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:38.781+0000 7f481b59e700 1 -- 172.21.15.62:0/2040502086 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4800053610 msgr2=0x7f4800055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:38.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:38.781+0000 7f481b59e700 1 --2- 172.21.15.62:0/2040502086 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4800053610 0x7f4800055ad0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f480c01e000 tx=0x7f480c006f40).stop 2021-12-17T18:27:38.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:38.781+0000 7f481b59e700 1 -- 172.21.15.62:0/2040502086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f481c0b1ab0 msgr2=0x7f481c139990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:38.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:38.781+0000 7f481b59e700 1 --2- 172.21.15.62:0/2040502086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f481c0b1ab0 0x7f481c139990 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f480400a000 tx=0x7f4804008040).stop 2021-12-17T18:27:38.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:38.781+0000 7f481b59e700 1 -- 172.21.15.62:0/2040502086 shutdown_connections 2021-12-17T18:27:38.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:38.781+0000 7f481b59e700 1 --2- 172.21.15.62:0/2040502086 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4800053610 0x7f4800055ad0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:38.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:38.781+0000 7f481b59e700 1 --2- 172.21.15.62:0/2040502086 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f481c13f500 0x7f481c139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:38.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:38.781+0000 7f481b59e700 1 --2- 172.21.15.62:0/2040502086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f481c0b1ab0 0x7f481c139990 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:38.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:38.781+0000 7f481b59e700 1 --2- 172.21.15.62:0/2040502086 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f481c0b1640 0x7f481c142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:38.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:38.781+0000 7f481b59e700 1 -- 172.21.15.62:0/2040502086 >> 172.21.15.62:0/2040502086 conn(0x7f481c0b39d0 msgr2=0x7f481c13c180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:38.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:38.781+0000 7f481b59e700 1 -- 172.21.15.62:0/2040502086 shutdown_connections 2021-12-17T18:27:38.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:38.781+0000 7f481b59e700 1 -- 172.21.15.62:0/2040502086 wait complete. 2021-12-17T18:27:38.789 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2021-12-17T18:27:38.802 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-12-17T18:27:38.805 DEBUG:teuthology.orchestra.run.smithi109:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-12-17T18:27:38.807 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-12-17T18:27:38.810 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-12-17T18:27:38.813 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-12-17T18:27:38.833 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2021-12-17T18:27:38.833 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2021-12-17T18:27:38.833 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-12-17T18:27:38.834 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2021-12-17T18:27:38.834 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.834 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2021-12-17T18:27:38.834 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.834 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2021-12-17T18:27:38.835 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.835 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2021-12-17T18:27:38.835 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2021-12-17T18:27:38.835 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.836 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2021-12-17T18:27:38.836 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2021-12-17T18:27:38.836 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.836 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2021-12-17T18:27:38.836 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2021-12-17T18:27:38.837 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.837 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2021-12-17T18:27:38.837 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2021-12-17T18:27:38.837 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.838 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2021-12-17T18:27:38.838 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.838 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2021-12-17T18:27:38.838 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2021-12-17T18:27:38.839 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2021-12-17T18:27:38.839 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2021-12-17T18:27:38.839 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2021-12-17T18:27:38.839 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2021-12-17T18:27:38.839 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2021-12-17T18:27:38.840 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-12-17T18:27:38.840 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2021-12-17T18:27:38.840 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.840 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-12-17T18:27:38.840 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.841 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2021-12-17T18:27:38.841 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.841 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2021-12-17T18:27:38.841 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.842 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2021-12-17T18:27:38.842 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2021-12-17T18:27:38.842 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2021-12-17T18:27:38.842 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.62,172.21.15.109,[v2:172.21.15.109:3301,v1:172.21.15.109:6790]" 2021-12-17T18:27:38.843 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = bd870ae2-2b3b-4717-8d94-b4a425d11882 2021-12-17T18:27:38.843 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.843 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2021-12-17T18:27:38.843 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2021-12-17T18:27:38.844 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.844 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2021-12-17T18:27:38.844 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2021-12-17T18:27:38.844 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.844 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2021-12-17T18:27:38.845 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2021-12-17T18:27:38.845 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.845 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2021-12-17T18:27:38.846 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2021-12-17T18:27:38.846 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2021-12-17T18:27:38.846 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.846 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2021-12-17T18:27:38.846 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2021-12-17T18:27:38.847 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.847 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2021-12-17T18:27:38.847 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.847 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2021-12-17T18:27:38.848 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.848 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2021-12-17T18:27:38.848 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.848 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2021-12-17T18:27:38.849 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2021-12-17T18:27:38.849 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.849 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2021-12-17T18:27:38.849 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2021-12-17T18:27:38.849 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2021-12-17T18:27:38.850 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore compression mode = aggressive 2021-12-17T18:27:38.850 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2021-12-17T18:27:38.850 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 20 2021-12-17T18:27:38.850 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 20 2021-12-17T18:27:38.851 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-12-17T18:27:38.851 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2021-12-17T18:27:38.851 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 10 2021-12-17T18:27:38.851 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2021-12-17T18:27:38.852 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2021-12-17T18:27:38.852 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2021-12-17T18:27:38.852 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2021-12-17T18:27:38.852 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2021-12-17T18:27:38.852 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2021-12-17T18:27:38.853 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.853 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2021-12-17T18:27:38.853 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-12-17T18:27:38.853 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2021-12-17T18:27:38.854 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2021-12-17T18:27:38.854 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2021-12-17T18:27:38.854 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:38.854 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:38.854 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2021-12-17T18:27:38.855 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.855 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2021-12-17T18:27:38.855 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-12-17T18:27:38.855 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2021-12-17T18:27:38.855 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2021-12-17T18:27:38.856 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2021-12-17T18:27:38.856 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2021-12-17T18:27:38.856 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2021-12-17T18:27:38.856 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:38.857 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2021-12-17T18:27:38.857 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2021-12-17T18:27:38.857 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:38.857 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.857 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-12-17T18:27:38.858 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2021-12-17T18:27:38.858 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2021-12-17T18:27:38.858 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.859 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2021-12-17T18:27:38.859 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-12-17T18:27:38.859 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-12-17T18:27:38.860 INFO:teuthology.orchestra.run.smithi062.stdout: mon op complaint time = 120 2021-12-17T18:27:38.860 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:38.860 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2021-12-17T18:27:38.860 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2021-12-17T18:27:38.861 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2021-12-17T18:27:38.861 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2021-12-17T18:27:38.861 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-12-17T18:27:38.861 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-12-17T18:27:38.862 INFO:teuthology.orchestra.run.smithi062.stdout: client mount timeout = 600 2021-12-17T18:27:38.862 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2021-12-17T18:27:38.862 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-12-17T18:27:38.862 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 15m 2021-12-17T18:27:38.862 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 15m 2021-12-17T18:27:38.863 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2021-12-17T18:27:38.863 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2021-12-17T18:27:38.863 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2021-12-17T18:27:38.863 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2021-12-17T18:27:38.864 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2021-12-17T18:27:38.864 INFO:teuthology.orchestra.run.smithi062.stdout:[mds] 2021-12-17T18:27:38.864 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds = 20 2021-12-17T18:27:38.864 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-12-17T18:27:38.865 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal frag = True 2021-12-17T18:27:38.865 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal fragment size max = 10000 2021-12-17T18:27:38.865 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal merge size = 5 2021-12-17T18:27:38.865 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split bits = 3 2021-12-17T18:27:38.865 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split size = 100 2021-12-17T18:27:38.866 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug frag = True 2021-12-17T18:27:38.866 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug scatterstat = True 2021-12-17T18:27:38.866 INFO:teuthology.orchestra.run.smithi062.stdout: mds op complaint time = 180 2021-12-17T18:27:38.866 INFO:teuthology.orchestra.run.smithi062.stdout: mds verify scatter = True 2021-12-17T18:27:38.867 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2021-12-17T18:27:38.867 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 15m 2021-12-17T18:27:38.867 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 15m 2021-12-17T18:27:38.871 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2021-12-17T18:27:38.871 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2021-12-17T18:27:38.872 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-12-17T18:27:38.872 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2021-12-17T18:27:38.872 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.872 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2021-12-17T18:27:38.873 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.873 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2021-12-17T18:27:38.873 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.873 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2021-12-17T18:27:38.873 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2021-12-17T18:27:38.874 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.874 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2021-12-17T18:27:38.874 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2021-12-17T18:27:38.874 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.875 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2021-12-17T18:27:38.875 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2021-12-17T18:27:38.875 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.875 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2021-12-17T18:27:38.875 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2021-12-17T18:27:38.876 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.876 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2021-12-17T18:27:38.876 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.876 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2021-12-17T18:27:38.877 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2021-12-17T18:27:38.877 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2021-12-17T18:27:38.877 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2021-12-17T18:27:38.877 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2021-12-17T18:27:38.878 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2021-12-17T18:27:38.878 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2021-12-17T18:27:38.878 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-12-17T18:27:38.878 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2021-12-17T18:27:38.878 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.879 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-12-17T18:27:38.879 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.879 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2021-12-17T18:27:38.879 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.880 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2021-12-17T18:27:38.880 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.880 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2021-12-17T18:27:38.880 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2021-12-17T18:27:38.880 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2021-12-17T18:27:38.881 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = "172.21.15.62,172.21.15.109,[v2:172.21.15.109:3301,v1:172.21.15.109:6790]" 2021-12-17T18:27:38.881 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = bd870ae2-2b3b-4717-8d94-b4a425d11882 2021-12-17T18:27:38.881 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.881 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2021-12-17T18:27:38.882 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2021-12-17T18:27:38.882 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.882 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2021-12-17T18:27:38.882 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2021-12-17T18:27:38.883 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.883 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2021-12-17T18:27:38.883 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2021-12-17T18:27:38.883 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.883 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2021-12-17T18:27:38.884 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2021-12-17T18:27:38.884 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2021-12-17T18:27:38.884 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.884 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2021-12-17T18:27:38.885 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2021-12-17T18:27:38.885 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.885 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2021-12-17T18:27:38.885 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.886 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2021-12-17T18:27:38.886 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.886 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2021-12-17T18:27:38.886 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.886 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2021-12-17T18:27:38.887 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2021-12-17T18:27:38.887 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.887 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2021-12-17T18:27:38.887 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2021-12-17T18:27:38.888 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore block size = 96636764160 2021-12-17T18:27:38.888 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore compression mode = aggressive 2021-12-17T18:27:38.888 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore fsck on mount = True 2021-12-17T18:27:38.888 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluefs = 20 2021-12-17T18:27:38.889 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluestore = 20 2021-12-17T18:27:38.889 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2021-12-17T18:27:38.889 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 20 2021-12-17T18:27:38.889 INFO:teuthology.orchestra.run.smithi192.stdout: debug rocksdb = 10 2021-12-17T18:27:38.889 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull_ratio = 0.85 2021-12-17T18:27:38.890 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.9 2021-12-17T18:27:38.890 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.8 2021-12-17T18:27:38.890 INFO:teuthology.orchestra.run.smithi192.stdout: osd failsafe full ratio = 0.95 2021-12-17T18:27:38.890 INFO:teuthology.orchestra.run.smithi192.stdout: osd objectstore = bluestore 2021-12-17T18:27:38.891 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2021-12-17T18:27:38.891 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.891 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2021-12-17T18:27:38.891 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2021-12-17T18:27:38.892 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2021-12-17T18:27:38.892 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2021-12-17T18:27:38.892 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2021-12-17T18:27:38.892 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:38.893 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:38.893 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2021-12-17T18:27:38.893 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.893 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2021-12-17T18:27:38.893 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2021-12-17T18:27:38.894 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2021-12-17T18:27:38.894 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2021-12-17T18:27:38.894 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2021-12-17T18:27:38.894 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2021-12-17T18:27:38.895 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2021-12-17T18:27:38.895 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:38.895 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2021-12-17T18:27:38.895 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2021-12-17T18:27:38.895 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:38.896 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.896 INFO:teuthology.orchestra.run.smithi192.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-12-17T18:27:38.896 INFO:teuthology.orchestra.run.smithi192.stdout: auth mon ticket ttl = 660 # 11m 2021-12-17T18:27:38.896 INFO:teuthology.orchestra.run.smithi192.stdout: auth service ticket ttl = 240 # 4m 2021-12-17T18:27:38.897 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.897 INFO:teuthology.orchestra.run.smithi192.stdout: # don't complain about insecure global_id in the test suite 2021-12-17T18:27:38.897 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-12-17T18:27:38.897 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-12-17T18:27:38.898 INFO:teuthology.orchestra.run.smithi192.stdout: mon op complaint time = 120 2021-12-17T18:27:38.898 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-12-17T18:27:38.898 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2021-12-17T18:27:38.898 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2021-12-17T18:27:38.898 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2021-12-17T18:27:38.899 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2021-12-17T18:27:38.899 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-12-17T18:27:38.899 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-12-17T18:27:38.899 INFO:teuthology.orchestra.run.smithi192.stdout: client mount timeout = 600 2021-12-17T18:27:38.900 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2021-12-17T18:27:38.900 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2021-12-17T18:27:38.900 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 15m 2021-12-17T18:27:38.900 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 15m 2021-12-17T18:27:38.900 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2021-12-17T18:27:38.901 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.b] 2021-12-17T18:27:38.901 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.c] 2021-12-17T18:27:38.901 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2021-12-17T18:27:38.901 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2021-12-17T18:27:38.902 INFO:teuthology.orchestra.run.smithi192.stdout:[mds] 2021-12-17T18:27:38.902 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds = 20 2021-12-17T18:27:38.902 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2021-12-17T18:27:38.902 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal frag = True 2021-12-17T18:27:38.903 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal fragment size max = 10000 2021-12-17T18:27:38.903 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal merge size = 5 2021-12-17T18:27:38.903 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal split bits = 3 2021-12-17T18:27:38.903 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal split size = 100 2021-12-17T18:27:38.903 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug frag = True 2021-12-17T18:27:38.904 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug scatterstat = True 2021-12-17T18:27:38.904 INFO:teuthology.orchestra.run.smithi192.stdout: mds op complaint time = 180 2021-12-17T18:27:38.904 INFO:teuthology.orchestra.run.smithi192.stdout: mds verify scatter = True 2021-12-17T18:27:38.904 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2021-12-17T18:27:38.905 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 15m 2021-12-17T18:27:38.905 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 15m 2021-12-17T18:27:38.905 INFO:teuthology.orchestra.run.smithi158.stdout:[global] 2021-12-17T18:27:38.905 INFO:teuthology.orchestra.run.smithi158.stdout: chdir = "" 2021-12-17T18:27:38.906 INFO:teuthology.orchestra.run.smithi158.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-12-17T18:27:38.906 INFO:teuthology.orchestra.run.smithi158.stdout: auth supported = cephx 2021-12-17T18:27:38.906 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.906 INFO:teuthology.orchestra.run.smithi158.stdout: filestore xattr use omap = true 2021-12-17T18:27:38.907 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.907 INFO:teuthology.orchestra.run.smithi158.stdout: mon clock drift allowed = 1.000 2021-12-17T18:27:38.907 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.907 INFO:teuthology.orchestra.run.smithi158.stdout: osd crush chooseleaf type = 0 2021-12-17T18:27:38.907 INFO:teuthology.orchestra.run.smithi158.stdout: auth debug = true 2021-12-17T18:27:38.908 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.908 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on old message = true 2021-12-17T18:27:38.908 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on bug = true 2021-12-17T18:27:38.908 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.909 INFO:teuthology.orchestra.run.smithi158.stdout: mon max pg per osd = 10000 # >= luminous 2021-12-17T18:27:38.909 INFO:teuthology.orchestra.run.smithi158.stdout: mon pg warn max object skew = 0 2021-12-17T18:27:38.909 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.909 INFO:teuthology.orchestra.run.smithi158.stdout: # disable pg_autoscaler by default for new pools 2021-12-17T18:27:38.910 INFO:teuthology.orchestra.run.smithi158.stdout: osd_pool_default_pg_autoscale_mode = off 2021-12-17T18:27:38.910 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.910 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default size = 2 2021-12-17T18:27:38.910 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.910 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow primary affinity = true 2021-12-17T18:27:38.911 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow pg remap = true 2021-12-17T18:27:38.911 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on legacy crush tunables = false 2021-12-17T18:27:38.911 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on crush straw calc version zero = false 2021-12-17T18:27:38.911 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on no sortbitwise = false 2021-12-17T18:27:38.912 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on osd down out interval zero = false 2021-12-17T18:27:38.912 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on too few osds = false 2021-12-17T18:27:38.912 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-12-17T18:27:38.912 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_no_redundancy = false 2021-12-17T18:27:38.913 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.913 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-12-17T18:27:38.913 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.913 INFO:teuthology.orchestra.run.smithi158.stdout: osd default data pool replay window = 5 2021-12-17T18:27:38.913 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.914 INFO:teuthology.orchestra.run.smithi158.stdout: mon allow pool delete = true 2021-12-17T18:27:38.914 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.914 INFO:teuthology.orchestra.run.smithi158.stdout: mon cluster log file level = debug 2021-12-17T18:27:38.914 INFO:teuthology.orchestra.run.smithi158.stdout: debug asserts on shutdown = true 2021-12-17T18:27:38.915 INFO:teuthology.orchestra.run.smithi158.stdout: mon health detail to clog = false 2021-12-17T18:27:38.915 INFO:teuthology.orchestra.run.smithi158.stdout: mon host = "172.21.15.62,172.21.15.109,[v2:172.21.15.109:3301,v1:172.21.15.109:6790]" 2021-12-17T18:27:38.915 INFO:teuthology.orchestra.run.smithi158.stdout: fsid = bd870ae2-2b3b-4717-8d94-b4a425d11882 2021-12-17T18:27:38.915 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.916 INFO:teuthology.orchestra.run.smithi158.stdout:[osd] 2021-12-17T18:27:38.916 INFO:teuthology.orchestra.run.smithi158.stdout: osd journal size = 100 2021-12-17T18:27:38.916 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.916 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub load threshold = 5.0 2021-12-17T18:27:38.916 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub max interval = 600 2021-12-17T18:27:38.917 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.917 INFO:teuthology.orchestra.run.smithi158.stdout: osd recover clone overlap = true 2021-12-17T18:27:38.917 INFO:teuthology.orchestra.run.smithi158.stdout: osd recovery max chunk = 1048576 2021-12-17T18:27:38.917 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.918 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug shutdown = true 2021-12-17T18:27:38.918 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug op order = true 2021-12-17T18:27:38.918 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug verify stray on activate = true 2021-12-17T18:27:38.918 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.919 INFO:teuthology.orchestra.run.smithi158.stdout: osd open classes on start = true 2021-12-17T18:27:38.919 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug pg log writeout = true 2021-12-17T18:27:38.919 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.919 INFO:teuthology.orchestra.run.smithi158.stdout: osd deep scrub update digest min age = 30 2021-12-17T18:27:38.919 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.920 INFO:teuthology.orchestra.run.smithi158.stdout: osd map max advance = 10 2021-12-17T18:27:38.920 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.920 INFO:teuthology.orchestra.run.smithi158.stdout: journal zero on create = true 2021-12-17T18:27:38.920 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.921 INFO:teuthology.orchestra.run.smithi158.stdout: filestore ondisk finisher threads = 3 2021-12-17T18:27:38.921 INFO:teuthology.orchestra.run.smithi158.stdout: filestore apply finisher threads = 3 2021-12-17T18:27:38.921 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.921 INFO:teuthology.orchestra.run.smithi158.stdout: bdev debug aio = true 2021-12-17T18:27:38.922 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug misdirected ops = true 2021-12-17T18:27:38.922 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore block size = 96636764160 2021-12-17T18:27:38.922 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore compression mode = aggressive 2021-12-17T18:27:38.922 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore fsck on mount = True 2021-12-17T18:27:38.923 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluefs = 20 2021-12-17T18:27:38.923 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluestore = 20 2021-12-17T18:27:38.923 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2021-12-17T18:27:38.923 INFO:teuthology.orchestra.run.smithi158.stdout: debug osd = 20 2021-12-17T18:27:38.923 INFO:teuthology.orchestra.run.smithi158.stdout: debug rocksdb = 10 2021-12-17T18:27:38.924 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd backfillfull_ratio = 0.85 2021-12-17T18:27:38.924 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd full ratio = 0.9 2021-12-17T18:27:38.924 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd nearfull ratio = 0.8 2021-12-17T18:27:38.924 INFO:teuthology.orchestra.run.smithi158.stdout: osd failsafe full ratio = 0.95 2021-12-17T18:27:38.925 INFO:teuthology.orchestra.run.smithi158.stdout: osd objectstore = bluestore 2021-12-17T18:27:38.925 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2021-12-17T18:27:38.925 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.925 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr] 2021-12-17T18:27:38.925 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2021-12-17T18:27:38.926 INFO:teuthology.orchestra.run.smithi158.stdout: debug mgr = 20 2021-12-17T18:27:38.926 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2021-12-17T18:27:38.926 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2021-12-17T18:27:38.926 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:38.927 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:38.927 INFO:teuthology.orchestra.run.smithi158.stdout: mgr/telemetry/nag = false 2021-12-17T18:27:38.927 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.927 INFO:teuthology.orchestra.run.smithi158.stdout:[mon] 2021-12-17T18:27:38.928 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2021-12-17T18:27:38.928 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2021-12-17T18:27:38.928 INFO:teuthology.orchestra.run.smithi158.stdout: debug paxos = 20 2021-12-17T18:27:38.928 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2021-12-17T18:27:38.928 INFO:teuthology.orchestra.run.smithi158.stdout: mon data avail warn = 5 2021-12-17T18:27:38.929 INFO:teuthology.orchestra.run.smithi158.stdout: mon mgr mkfs grace = 240 2021-12-17T18:27:38.929 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:38.929 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd reporter subtree level = osd 2021-12-17T18:27:38.929 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd prime pg temp = true 2021-12-17T18:27:38.930 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:38.930 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.930 INFO:teuthology.orchestra.run.smithi158.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-12-17T18:27:38.930 INFO:teuthology.orchestra.run.smithi158.stdout: auth mon ticket ttl = 660 # 11m 2021-12-17T18:27:38.931 INFO:teuthology.orchestra.run.smithi158.stdout: auth service ticket ttl = 240 # 4m 2021-12-17T18:27:38.931 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.931 INFO:teuthology.orchestra.run.smithi158.stdout: # don't complain about insecure global_id in the test suite 2021-12-17T18:27:38.931 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-12-17T18:27:38.931 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-12-17T18:27:38.932 INFO:teuthology.orchestra.run.smithi158.stdout: mon op complaint time = 120 2021-12-17T18:27:38.932 INFO:teuthology.orchestra.run.smithi158.stdout: 2021-12-17T18:27:38.932 INFO:teuthology.orchestra.run.smithi158.stdout:[client] 2021-12-17T18:27:38.932 INFO:teuthology.orchestra.run.smithi158.stdout: rgw cache enabled = true 2021-12-17T18:27:38.933 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable ops log = true 2021-12-17T18:27:38.933 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable usage log = true 2021-12-17T18:27:38.933 INFO:teuthology.orchestra.run.smithi158.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-12-17T18:27:38.933 INFO:teuthology.orchestra.run.smithi158.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-12-17T18:27:38.933 INFO:teuthology.orchestra.run.smithi158.stdout: client mount timeout = 600 2021-12-17T18:27:38.934 INFO:teuthology.orchestra.run.smithi158.stdout: debug client = 20 2021-12-17T18:27:38.934 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2021-12-17T18:27:38.934 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 15m 2021-12-17T18:27:38.934 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 15m 2021-12-17T18:27:38.935 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.a] 2021-12-17T18:27:38.935 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.b] 2021-12-17T18:27:38.935 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.c] 2021-12-17T18:27:38.935 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.a] 2021-12-17T18:27:38.935 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.b] 2021-12-17T18:27:38.936 INFO:teuthology.orchestra.run.smithi158.stdout:[mds] 2021-12-17T18:27:38.936 INFO:teuthology.orchestra.run.smithi158.stdout: debug mds = 20 2021-12-17T18:27:38.936 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2021-12-17T18:27:38.936 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal frag = True 2021-12-17T18:27:38.937 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal fragment size max = 10000 2021-12-17T18:27:38.937 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal merge size = 5 2021-12-17T18:27:38.937 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal split bits = 3 2021-12-17T18:27:38.937 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal split size = 100 2021-12-17T18:27:38.938 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug frag = True 2021-12-17T18:27:38.938 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug scatterstat = True 2021-12-17T18:27:38.938 INFO:teuthology.orchestra.run.smithi158.stdout: mds op complaint time = 180 2021-12-17T18:27:38.938 INFO:teuthology.orchestra.run.smithi158.stdout: mds verify scatter = True 2021-12-17T18:27:38.938 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2021-12-17T18:27:38.939 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 15m 2021-12-17T18:27:38.939 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 15m 2021-12-17T18:27:38.939 INFO:teuthology.orchestra.run.smithi125.stdout:[global] 2021-12-17T18:27:38.939 INFO:teuthology.orchestra.run.smithi125.stdout: chdir = "" 2021-12-17T18:27:38.940 INFO:teuthology.orchestra.run.smithi125.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-12-17T18:27:38.940 INFO:teuthology.orchestra.run.smithi125.stdout: auth supported = cephx 2021-12-17T18:27:38.940 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.940 INFO:teuthology.orchestra.run.smithi125.stdout: filestore xattr use omap = true 2021-12-17T18:27:38.941 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.941 INFO:teuthology.orchestra.run.smithi125.stdout: mon clock drift allowed = 1.000 2021-12-17T18:27:38.941 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.941 INFO:teuthology.orchestra.run.smithi125.stdout: osd crush chooseleaf type = 0 2021-12-17T18:27:38.942 INFO:teuthology.orchestra.run.smithi125.stdout: auth debug = true 2021-12-17T18:27:38.942 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.942 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on old message = true 2021-12-17T18:27:38.942 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on bug = true 2021-12-17T18:27:38.942 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.943 INFO:teuthology.orchestra.run.smithi125.stdout: mon max pg per osd = 10000 # >= luminous 2021-12-17T18:27:38.943 INFO:teuthology.orchestra.run.smithi125.stdout: mon pg warn max object skew = 0 2021-12-17T18:27:38.943 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.943 INFO:teuthology.orchestra.run.smithi125.stdout: # disable pg_autoscaler by default for new pools 2021-12-17T18:27:38.944 INFO:teuthology.orchestra.run.smithi125.stdout: osd_pool_default_pg_autoscale_mode = off 2021-12-17T18:27:38.944 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.944 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default size = 2 2021-12-17T18:27:38.944 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.945 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow primary affinity = true 2021-12-17T18:27:38.945 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow pg remap = true 2021-12-17T18:27:38.945 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on legacy crush tunables = false 2021-12-17T18:27:38.945 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on crush straw calc version zero = false 2021-12-17T18:27:38.945 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on no sortbitwise = false 2021-12-17T18:27:38.946 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on osd down out interval zero = false 2021-12-17T18:27:38.946 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on too few osds = false 2021-12-17T18:27:38.946 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-12-17T18:27:38.946 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_no_redundancy = false 2021-12-17T18:27:38.947 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.947 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-12-17T18:27:38.947 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.947 INFO:teuthology.orchestra.run.smithi125.stdout: osd default data pool replay window = 5 2021-12-17T18:27:38.948 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.948 INFO:teuthology.orchestra.run.smithi125.stdout: mon allow pool delete = true 2021-12-17T18:27:38.948 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.948 INFO:teuthology.orchestra.run.smithi125.stdout: mon cluster log file level = debug 2021-12-17T18:27:38.948 INFO:teuthology.orchestra.run.smithi125.stdout: debug asserts on shutdown = true 2021-12-17T18:27:38.949 INFO:teuthology.orchestra.run.smithi125.stdout: mon health detail to clog = false 2021-12-17T18:27:38.949 INFO:teuthology.orchestra.run.smithi125.stdout: mon host = "172.21.15.62,172.21.15.109,[v2:172.21.15.109:3301,v1:172.21.15.109:6790]" 2021-12-17T18:27:38.949 INFO:teuthology.orchestra.run.smithi125.stdout: fsid = bd870ae2-2b3b-4717-8d94-b4a425d11882 2021-12-17T18:27:38.949 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.950 INFO:teuthology.orchestra.run.smithi125.stdout:[osd] 2021-12-17T18:27:38.950 INFO:teuthology.orchestra.run.smithi125.stdout: osd journal size = 100 2021-12-17T18:27:38.950 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.950 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub load threshold = 5.0 2021-12-17T18:27:38.951 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub max interval = 600 2021-12-17T18:27:38.951 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.951 INFO:teuthology.orchestra.run.smithi125.stdout: osd recover clone overlap = true 2021-12-17T18:27:38.951 INFO:teuthology.orchestra.run.smithi125.stdout: osd recovery max chunk = 1048576 2021-12-17T18:27:38.951 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.952 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug shutdown = true 2021-12-17T18:27:38.952 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug op order = true 2021-12-17T18:27:38.952 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug verify stray on activate = true 2021-12-17T18:27:38.952 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.952 INFO:teuthology.orchestra.run.smithi125.stdout: osd open classes on start = true 2021-12-17T18:27:38.953 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug pg log writeout = true 2021-12-17T18:27:38.953 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.953 INFO:teuthology.orchestra.run.smithi125.stdout: osd deep scrub update digest min age = 30 2021-12-17T18:27:38.953 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.954 INFO:teuthology.orchestra.run.smithi125.stdout: osd map max advance = 10 2021-12-17T18:27:38.954 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.954 INFO:teuthology.orchestra.run.smithi125.stdout: journal zero on create = true 2021-12-17T18:27:38.954 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.955 INFO:teuthology.orchestra.run.smithi125.stdout: filestore ondisk finisher threads = 3 2021-12-17T18:27:38.955 INFO:teuthology.orchestra.run.smithi125.stdout: filestore apply finisher threads = 3 2021-12-17T18:27:38.955 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.955 INFO:teuthology.orchestra.run.smithi125.stdout: bdev debug aio = true 2021-12-17T18:27:38.955 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug misdirected ops = true 2021-12-17T18:27:38.956 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore block size = 96636764160 2021-12-17T18:27:38.956 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore compression mode = aggressive 2021-12-17T18:27:38.956 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore fsck on mount = True 2021-12-17T18:27:38.956 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluefs = 20 2021-12-17T18:27:38.957 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluestore = 20 2021-12-17T18:27:38.957 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2021-12-17T18:27:38.957 INFO:teuthology.orchestra.run.smithi125.stdout: debug osd = 20 2021-12-17T18:27:38.957 INFO:teuthology.orchestra.run.smithi125.stdout: debug rocksdb = 10 2021-12-17T18:27:38.958 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd backfillfull_ratio = 0.85 2021-12-17T18:27:38.958 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd full ratio = 0.9 2021-12-17T18:27:38.958 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd nearfull ratio = 0.8 2021-12-17T18:27:38.958 INFO:teuthology.orchestra.run.smithi125.stdout: osd failsafe full ratio = 0.95 2021-12-17T18:27:38.958 INFO:teuthology.orchestra.run.smithi125.stdout: osd objectstore = bluestore 2021-12-17T18:27:38.959 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2021-12-17T18:27:38.959 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.959 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr] 2021-12-17T18:27:38.959 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2021-12-17T18:27:38.960 INFO:teuthology.orchestra.run.smithi125.stdout: debug mgr = 20 2021-12-17T18:27:38.960 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2021-12-17T18:27:38.960 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2021-12-17T18:27:38.960 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:38.961 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:38.961 INFO:teuthology.orchestra.run.smithi125.stdout: mgr/telemetry/nag = false 2021-12-17T18:27:38.961 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.961 INFO:teuthology.orchestra.run.smithi125.stdout:[mon] 2021-12-17T18:27:38.961 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2021-12-17T18:27:38.962 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2021-12-17T18:27:38.962 INFO:teuthology.orchestra.run.smithi125.stdout: debug paxos = 20 2021-12-17T18:27:38.962 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2021-12-17T18:27:38.962 INFO:teuthology.orchestra.run.smithi125.stdout: mon data avail warn = 5 2021-12-17T18:27:38.963 INFO:teuthology.orchestra.run.smithi125.stdout: mon mgr mkfs grace = 240 2021-12-17T18:27:38.963 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:38.963 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd reporter subtree level = osd 2021-12-17T18:27:38.963 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd prime pg temp = true 2021-12-17T18:27:38.964 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:38.964 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.964 INFO:teuthology.orchestra.run.smithi125.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-12-17T18:27:38.964 INFO:teuthology.orchestra.run.smithi125.stdout: auth mon ticket ttl = 660 # 11m 2021-12-17T18:27:38.964 INFO:teuthology.orchestra.run.smithi125.stdout: auth service ticket ttl = 240 # 4m 2021-12-17T18:27:38.965 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.965 INFO:teuthology.orchestra.run.smithi125.stdout: # don't complain about insecure global_id in the test suite 2021-12-17T18:27:38.965 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-12-17T18:27:38.965 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-12-17T18:27:38.966 INFO:teuthology.orchestra.run.smithi125.stdout: mon op complaint time = 120 2021-12-17T18:27:38.966 INFO:teuthology.orchestra.run.smithi125.stdout: 2021-12-17T18:27:38.966 INFO:teuthology.orchestra.run.smithi125.stdout:[client] 2021-12-17T18:27:38.966 INFO:teuthology.orchestra.run.smithi125.stdout: rgw cache enabled = true 2021-12-17T18:27:38.967 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable ops log = true 2021-12-17T18:27:38.967 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable usage log = true 2021-12-17T18:27:38.967 INFO:teuthology.orchestra.run.smithi125.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-12-17T18:27:38.967 INFO:teuthology.orchestra.run.smithi125.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-12-17T18:27:38.968 INFO:teuthology.orchestra.run.smithi125.stdout: client mount timeout = 600 2021-12-17T18:27:38.968 INFO:teuthology.orchestra.run.smithi125.stdout: debug client = 20 2021-12-17T18:27:38.968 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2021-12-17T18:27:38.968 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 15m 2021-12-17T18:27:38.968 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 15m 2021-12-17T18:27:38.969 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.a] 2021-12-17T18:27:38.969 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.b] 2021-12-17T18:27:38.969 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.c] 2021-12-17T18:27:38.969 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.a] 2021-12-17T18:27:38.970 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.b] 2021-12-17T18:27:38.970 INFO:teuthology.orchestra.run.smithi125.stdout:[mds] 2021-12-17T18:27:38.970 INFO:teuthology.orchestra.run.smithi125.stdout: debug mds = 20 2021-12-17T18:27:38.970 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2021-12-17T18:27:38.970 INFO:teuthology.orchestra.run.smithi125.stdout: mds bal frag = True 2021-12-17T18:27:38.971 INFO:teuthology.orchestra.run.smithi125.stdout: mds bal fragment size max = 10000 2021-12-17T18:27:38.971 INFO:teuthology.orchestra.run.smithi125.stdout: mds bal merge size = 5 2021-12-17T18:27:38.971 INFO:teuthology.orchestra.run.smithi125.stdout: mds bal split bits = 3 2021-12-17T18:27:38.971 INFO:teuthology.orchestra.run.smithi125.stdout: mds bal split size = 100 2021-12-17T18:27:38.972 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug frag = True 2021-12-17T18:27:38.972 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug scatterstat = True 2021-12-17T18:27:38.972 INFO:teuthology.orchestra.run.smithi125.stdout: mds op complaint time = 180 2021-12-17T18:27:38.972 INFO:teuthology.orchestra.run.smithi125.stdout: mds verify scatter = True 2021-12-17T18:27:38.973 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2021-12-17T18:27:38.973 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 15m 2021-12-17T18:27:38.973 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 15m 2021-12-17T18:27:38.973 INFO:teuthology.orchestra.run.smithi109.stdout:[global] 2021-12-17T18:27:38.974 INFO:teuthology.orchestra.run.smithi109.stdout: chdir = "" 2021-12-17T18:27:38.974 INFO:teuthology.orchestra.run.smithi109.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-12-17T18:27:38.974 INFO:teuthology.orchestra.run.smithi109.stdout: auth supported = cephx 2021-12-17T18:27:38.974 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.974 INFO:teuthology.orchestra.run.smithi109.stdout: filestore xattr use omap = true 2021-12-17T18:27:38.975 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.975 INFO:teuthology.orchestra.run.smithi109.stdout: mon clock drift allowed = 1.000 2021-12-17T18:27:38.975 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.975 INFO:teuthology.orchestra.run.smithi109.stdout: osd crush chooseleaf type = 0 2021-12-17T18:27:38.976 INFO:teuthology.orchestra.run.smithi109.stdout: auth debug = true 2021-12-17T18:27:38.976 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.976 INFO:teuthology.orchestra.run.smithi109.stdout: ms die on old message = true 2021-12-17T18:27:38.976 INFO:teuthology.orchestra.run.smithi109.stdout: ms die on bug = true 2021-12-17T18:27:38.977 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.977 INFO:teuthology.orchestra.run.smithi109.stdout: mon max pg per osd = 10000 # >= luminous 2021-12-17T18:27:38.977 INFO:teuthology.orchestra.run.smithi109.stdout: mon pg warn max object skew = 0 2021-12-17T18:27:38.977 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.978 INFO:teuthology.orchestra.run.smithi109.stdout: # disable pg_autoscaler by default for new pools 2021-12-17T18:27:38.978 INFO:teuthology.orchestra.run.smithi109.stdout: osd_pool_default_pg_autoscale_mode = off 2021-12-17T18:27:38.978 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.978 INFO:teuthology.orchestra.run.smithi109.stdout: osd pool default size = 2 2021-12-17T18:27:38.978 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.979 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd allow primary affinity = true 2021-12-17T18:27:38.979 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd allow pg remap = true 2021-12-17T18:27:38.979 INFO:teuthology.orchestra.run.smithi109.stdout: mon warn on legacy crush tunables = false 2021-12-17T18:27:38.979 INFO:teuthology.orchestra.run.smithi109.stdout: mon warn on crush straw calc version zero = false 2021-12-17T18:27:38.980 INFO:teuthology.orchestra.run.smithi109.stdout: mon warn on no sortbitwise = false 2021-12-17T18:27:38.980 INFO:teuthology.orchestra.run.smithi109.stdout: mon warn on osd down out interval zero = false 2021-12-17T18:27:38.980 INFO:teuthology.orchestra.run.smithi109.stdout: mon warn on too few osds = false 2021-12-17T18:27:38.980 INFO:teuthology.orchestra.run.smithi109.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-12-17T18:27:38.980 INFO:teuthology.orchestra.run.smithi109.stdout: mon_warn_on_pool_no_redundancy = false 2021-12-17T18:27:38.981 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.981 INFO:teuthology.orchestra.run.smithi109.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-12-17T18:27:38.981 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.981 INFO:teuthology.orchestra.run.smithi109.stdout: osd default data pool replay window = 5 2021-12-17T18:27:38.982 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.982 INFO:teuthology.orchestra.run.smithi109.stdout: mon allow pool delete = true 2021-12-17T18:27:38.982 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.982 INFO:teuthology.orchestra.run.smithi109.stdout: mon cluster log file level = debug 2021-12-17T18:27:38.983 INFO:teuthology.orchestra.run.smithi109.stdout: debug asserts on shutdown = true 2021-12-17T18:27:38.983 INFO:teuthology.orchestra.run.smithi109.stdout: mon health detail to clog = false 2021-12-17T18:27:38.983 INFO:teuthology.orchestra.run.smithi109.stdout: mon host = "172.21.15.62,172.21.15.109,[v2:172.21.15.109:3301,v1:172.21.15.109:6790]" 2021-12-17T18:27:38.983 INFO:teuthology.orchestra.run.smithi109.stdout: fsid = bd870ae2-2b3b-4717-8d94-b4a425d11882 2021-12-17T18:27:38.984 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.984 INFO:teuthology.orchestra.run.smithi109.stdout:[osd] 2021-12-17T18:27:38.984 INFO:teuthology.orchestra.run.smithi109.stdout: osd journal size = 100 2021-12-17T18:27:38.984 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.984 INFO:teuthology.orchestra.run.smithi109.stdout: osd scrub load threshold = 5.0 2021-12-17T18:27:38.985 INFO:teuthology.orchestra.run.smithi109.stdout: osd scrub max interval = 600 2021-12-17T18:27:38.985 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.985 INFO:teuthology.orchestra.run.smithi109.stdout: osd recover clone overlap = true 2021-12-17T18:27:38.985 INFO:teuthology.orchestra.run.smithi109.stdout: osd recovery max chunk = 1048576 2021-12-17T18:27:38.986 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.986 INFO:teuthology.orchestra.run.smithi109.stdout: osd debug shutdown = true 2021-12-17T18:27:38.986 INFO:teuthology.orchestra.run.smithi109.stdout: osd debug op order = true 2021-12-17T18:27:38.986 INFO:teuthology.orchestra.run.smithi109.stdout: osd debug verify stray on activate = true 2021-12-17T18:27:38.987 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.987 INFO:teuthology.orchestra.run.smithi109.stdout: osd open classes on start = true 2021-12-17T18:27:38.987 INFO:teuthology.orchestra.run.smithi109.stdout: osd debug pg log writeout = true 2021-12-17T18:27:38.987 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.987 INFO:teuthology.orchestra.run.smithi109.stdout: osd deep scrub update digest min age = 30 2021-12-17T18:27:38.988 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.988 INFO:teuthology.orchestra.run.smithi109.stdout: osd map max advance = 10 2021-12-17T18:27:38.988 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.988 INFO:teuthology.orchestra.run.smithi109.stdout: journal zero on create = true 2021-12-17T18:27:38.989 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.989 INFO:teuthology.orchestra.run.smithi109.stdout: filestore ondisk finisher threads = 3 2021-12-17T18:27:38.989 INFO:teuthology.orchestra.run.smithi109.stdout: filestore apply finisher threads = 3 2021-12-17T18:27:38.989 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.989 INFO:teuthology.orchestra.run.smithi109.stdout: bdev debug aio = true 2021-12-17T18:27:38.990 INFO:teuthology.orchestra.run.smithi109.stdout: osd debug misdirected ops = true 2021-12-17T18:27:38.990 INFO:teuthology.orchestra.run.smithi109.stdout: bluestore block size = 96636764160 2021-12-17T18:27:38.990 INFO:teuthology.orchestra.run.smithi109.stdout: bluestore compression mode = aggressive 2021-12-17T18:27:38.990 INFO:teuthology.orchestra.run.smithi109.stdout: bluestore fsck on mount = True 2021-12-17T18:27:38.991 INFO:teuthology.orchestra.run.smithi109.stdout: debug bluefs = 20 2021-12-17T18:27:38.991 INFO:teuthology.orchestra.run.smithi109.stdout: debug bluestore = 20 2021-12-17T18:27:38.991 INFO:teuthology.orchestra.run.smithi109.stdout: debug ms = 1 2021-12-17T18:27:38.991 INFO:teuthology.orchestra.run.smithi109.stdout: debug osd = 20 2021-12-17T18:27:38.992 INFO:teuthology.orchestra.run.smithi109.stdout: debug rocksdb = 10 2021-12-17T18:27:38.992 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd backfillfull_ratio = 0.85 2021-12-17T18:27:38.992 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd full ratio = 0.9 2021-12-17T18:27:38.992 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd nearfull ratio = 0.8 2021-12-17T18:27:38.992 INFO:teuthology.orchestra.run.smithi109.stdout: osd failsafe full ratio = 0.95 2021-12-17T18:27:38.993 INFO:teuthology.orchestra.run.smithi109.stdout: osd objectstore = bluestore 2021-12-17T18:27:38.993 INFO:teuthology.orchestra.run.smithi109.stdout: osd op complaint time = 180 2021-12-17T18:27:38.993 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.993 INFO:teuthology.orchestra.run.smithi109.stdout:[mgr] 2021-12-17T18:27:38.994 INFO:teuthology.orchestra.run.smithi109.stdout: debug ms = 1 2021-12-17T18:27:38.994 INFO:teuthology.orchestra.run.smithi109.stdout: debug mgr = 20 2021-12-17T18:27:38.994 INFO:teuthology.orchestra.run.smithi109.stdout: debug mon = 20 2021-12-17T18:27:38.994 INFO:teuthology.orchestra.run.smithi109.stdout: debug auth = 20 2021-12-17T18:27:38.994 INFO:teuthology.orchestra.run.smithi109.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:38.995 INFO:teuthology.orchestra.run.smithi109.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:38.995 INFO:teuthology.orchestra.run.smithi109.stdout: mgr/telemetry/nag = false 2021-12-17T18:27:38.995 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.995 INFO:teuthology.orchestra.run.smithi109.stdout:[mon] 2021-12-17T18:27:38.996 INFO:teuthology.orchestra.run.smithi109.stdout: debug ms = 1 2021-12-17T18:27:38.996 INFO:teuthology.orchestra.run.smithi109.stdout: debug mon = 20 2021-12-17T18:27:38.996 INFO:teuthology.orchestra.run.smithi109.stdout: debug paxos = 20 2021-12-17T18:27:38.996 INFO:teuthology.orchestra.run.smithi109.stdout: debug auth = 20 2021-12-17T18:27:38.996 INFO:teuthology.orchestra.run.smithi109.stdout: mon data avail warn = 5 2021-12-17T18:27:38.997 INFO:teuthology.orchestra.run.smithi109.stdout: mon mgr mkfs grace = 240 2021-12-17T18:27:38.997 INFO:teuthology.orchestra.run.smithi109.stdout: mon reweight min pgs per osd = 4 2021-12-17T18:27:38.997 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd reporter subtree level = osd 2021-12-17T18:27:38.997 INFO:teuthology.orchestra.run.smithi109.stdout: mon osd prime pg temp = true 2021-12-17T18:27:38.997 INFO:teuthology.orchestra.run.smithi109.stdout: mon reweight min bytes per osd = 10 2021-12-17T18:27:38.998 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.998 INFO:teuthology.orchestra.run.smithi109.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-12-17T18:27:38.998 INFO:teuthology.orchestra.run.smithi109.stdout: auth mon ticket ttl = 660 # 11m 2021-12-17T18:27:38.998 INFO:teuthology.orchestra.run.smithi109.stdout: auth service ticket ttl = 240 # 4m 2021-12-17T18:27:38.999 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:38.999 INFO:teuthology.orchestra.run.smithi109.stdout: # don't complain about insecure global_id in the test suite 2021-12-17T18:27:38.999 INFO:teuthology.orchestra.run.smithi109.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-12-17T18:27:38.999 INFO:teuthology.orchestra.run.smithi109.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-12-17T18:27:38.999 INFO:teuthology.orchestra.run.smithi109.stdout: mon op complaint time = 120 2021-12-17T18:27:39.000 INFO:teuthology.orchestra.run.smithi109.stdout: 2021-12-17T18:27:39.000 INFO:teuthology.orchestra.run.smithi109.stdout:[client] 2021-12-17T18:27:39.000 INFO:teuthology.orchestra.run.smithi109.stdout: rgw cache enabled = true 2021-12-17T18:27:39.000 INFO:teuthology.orchestra.run.smithi109.stdout: rgw enable ops log = true 2021-12-17T18:27:39.001 INFO:teuthology.orchestra.run.smithi109.stdout: rgw enable usage log = true 2021-12-17T18:27:39.001 INFO:teuthology.orchestra.run.smithi109.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-12-17T18:27:39.001 INFO:teuthology.orchestra.run.smithi109.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-12-17T18:27:39.001 INFO:teuthology.orchestra.run.smithi109.stdout: client mount timeout = 600 2021-12-17T18:27:39.002 INFO:teuthology.orchestra.run.smithi109.stdout: debug client = 20 2021-12-17T18:27:39.002 INFO:teuthology.orchestra.run.smithi109.stdout: debug ms = 1 2021-12-17T18:27:39.002 INFO:teuthology.orchestra.run.smithi109.stdout: rados mon op timeout = 15m 2021-12-17T18:27:39.002 INFO:teuthology.orchestra.run.smithi109.stdout: rados osd op timeout = 15m 2021-12-17T18:27:39.002 INFO:teuthology.orchestra.run.smithi109.stdout:[mon.a] 2021-12-17T18:27:39.003 INFO:teuthology.orchestra.run.smithi109.stdout:[mon.b] 2021-12-17T18:27:39.003 INFO:teuthology.orchestra.run.smithi109.stdout:[mon.c] 2021-12-17T18:27:39.003 INFO:teuthology.orchestra.run.smithi109.stdout:[mds.a] 2021-12-17T18:27:39.003 INFO:teuthology.orchestra.run.smithi109.stdout:[mds.b] 2021-12-17T18:27:39.004 INFO:teuthology.orchestra.run.smithi109.stdout:[mds] 2021-12-17T18:27:39.004 INFO:teuthology.orchestra.run.smithi109.stdout: debug mds = 20 2021-12-17T18:27:39.004 INFO:teuthology.orchestra.run.smithi109.stdout: debug ms = 1 2021-12-17T18:27:39.004 INFO:teuthology.orchestra.run.smithi109.stdout: mds bal frag = True 2021-12-17T18:27:39.004 INFO:teuthology.orchestra.run.smithi109.stdout: mds bal fragment size max = 10000 2021-12-17T18:27:39.005 INFO:teuthology.orchestra.run.smithi109.stdout: mds bal merge size = 5 2021-12-17T18:27:39.005 INFO:teuthology.orchestra.run.smithi109.stdout: mds bal split bits = 3 2021-12-17T18:27:39.005 INFO:teuthology.orchestra.run.smithi109.stdout: mds bal split size = 100 2021-12-17T18:27:39.005 INFO:teuthology.orchestra.run.smithi109.stdout: mds debug frag = True 2021-12-17T18:27:39.006 INFO:teuthology.orchestra.run.smithi109.stdout: mds debug scatterstat = True 2021-12-17T18:27:39.006 INFO:teuthology.orchestra.run.smithi109.stdout: mds op complaint time = 180 2021-12-17T18:27:39.006 INFO:teuthology.orchestra.run.smithi109.stdout: mds verify scatter = True 2021-12-17T18:27:39.006 INFO:teuthology.orchestra.run.smithi109.stdout: osd op complaint time = 180 2021-12-17T18:27:39.006 INFO:teuthology.orchestra.run.smithi109.stdout: rados mon op timeout = 15m 2021-12-17T18:27:39.007 INFO:teuthology.orchestra.run.smithi109.stdout: rados osd op timeout = 15m 2021-12-17T18:27:39.007 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-12-17T18:27:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.121+0000 7f935e2f6700 1 Processor -- start 2021-12-17T18:27:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.121+0000 7f935e2f6700 1 -- start start 2021-12-17T18:27:39.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.121+0000 7f935e2f6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f93580b5f60 0x7f9358144320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.121+0000 7f935e2f6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f93580b18e0 0x7f93580accf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.121+0000 7f935e2f6700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f93580b0040 0x7f93580b0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.121+0000 7f935e2f6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93580a9350 con 0x7f93580b5f60 2021-12-17T18:27:39.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.121+0000 7f935e2f6700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93581415d0 con 0x7f93580b0040 2021-12-17T18:27:39.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.121+0000 7f935e2f6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93580b6340 con 0x7f93580b18e0 2021-12-17T18:27:39.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.121+0000 7f9357fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f93580b5f60 0x7f9358144320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.121+0000 7f9357fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f93580b5f60 0x7f9358144320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56346/0 (socket says 172.21.15.62:56346) 2021-12-17T18:27:39.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.121+0000 7f9357fff700 1 -- 172.21.15.62:0/2104439279 learned_addr learned my addr 172.21.15.62:0/2104439279 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:39.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.121+0000 7f934f7fe700 1 --2- 172.21.15.62:0/2104439279 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f93580b18e0 0x7f93580accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.121+0000 7f935c893700 1 --2- 172.21.15.62:0/2104439279 >> v2:172.21.15.109:3300/0 conn(0x7f93580b0040 0x7f93580b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f9357fff700 1 -- 172.21.15.62:0/2104439279 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f93580b18e0 msgr2=0x7f93580accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:39.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f9357fff700 1 --2- 172.21.15.62:0/2104439279 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f93580b18e0 0x7f93580accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f9357fff700 1 -- 172.21.15.62:0/2104439279 >> v2:172.21.15.109:3300/0 conn(0x7f93580b0040 msgr2=0x7f93580b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:39.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f9357fff700 1 --2- 172.21.15.62:0/2104439279 >> v2:172.21.15.109:3300/0 conn(0x7f93580b0040 0x7f93580b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f9357fff700 1 -- 172.21.15.62:0/2104439279 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9358144810 con 0x7f93580b5f60 2021-12-17T18:27:39.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f9357fff700 1 --2- 172.21.15.62:0/2104439279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93580b5f60 0x7f9358144320 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f9348002f70 tx=0x7f9348006eb0).ready entity=mon.0 client_cookie=863672742850c6be server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:39.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f93577fe700 1 -- 172.21.15.62:0/2104439279 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f934800d570 con 0x7f93580b5f60 2021-12-17T18:27:39.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f93577fe700 1 -- 172.21.15.62:0/2104439279 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9348000e90 con 0x7f93580b5f60 2021-12-17T18:27:39.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f93577fe700 1 -- 172.21.15.62:0/2104439279 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f934800d900 con 0x7f93580b5f60 2021-12-17T18:27:39.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f935e2f6700 1 -- 172.21.15.62:0/2104439279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93580b5f60 msgr2=0x7f9358144320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:39.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f935e2f6700 1 --2- 172.21.15.62:0/2104439279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93580b5f60 0x7f9358144320 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f9348002f70 tx=0x7f9348006eb0).stop 2021-12-17T18:27:39.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f935e2f6700 1 -- 172.21.15.62:0/2104439279 shutdown_connections 2021-12-17T18:27:39.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f935e2f6700 1 --2- 172.21.15.62:0/2104439279 >> v2:172.21.15.109:3300/0 conn(0x7f93580b0040 0x7f93580b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f935e2f6700 1 --2- 172.21.15.62:0/2104439279 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f93580b18e0 0x7f93580accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f935e2f6700 1 --2- 172.21.15.62:0/2104439279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93580b5f60 0x7f9358144320 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f935e2f6700 1 -- 172.21.15.62:0/2104439279 >> 172.21.15.62:0/2104439279 conn(0x7f935805ca00 msgr2=0x7f935805cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:39.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f935e2f6700 1 -- 172.21.15.62:0/2104439279 shutdown_connections 2021-12-17T18:27:39.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f935e2f6700 1 -- 172.21.15.62:0/2104439279 wait complete. 2021-12-17T18:27:39.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f935e2f6700 1 Processor -- start 2021-12-17T18:27:39.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.125+0000 7f935e2f6700 1 -- start start 2021-12-17T18:27:39.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f935e2f6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f93580b0040 0x7f9358142c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f935e2f6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93580b18e0 0x7f93580aa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f935e2f6700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f93580b5f60 0x7f9358066380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f935e2f6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9358063b20 con 0x7f93580b18e0 2021-12-17T18:27:39.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f935e2f6700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93580635a0 con 0x7f93580b5f60 2021-12-17T18:27:39.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f935e2f6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9358063800 con 0x7f93580b0040 2021-12-17T18:27:39.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f934f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93580b18e0 0x7f93580aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f934f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93580b18e0 0x7f93580aa510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56352/0 (socket says 172.21.15.62:56352) 2021-12-17T18:27:39.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f934f7fe700 1 -- 172.21.15.62:0/2013196729 learned_addr learned my addr 172.21.15.62:0/2013196729 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:39.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f9357fff700 1 --2- 172.21.15.62:0/2013196729 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f93580b0040 0x7f9358142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f935c893700 1 --2- 172.21.15.62:0/2013196729 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f93580b5f60 0x7f9358066380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f934f7fe700 1 -- 172.21.15.62:0/2013196729 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f93580b0040 msgr2=0x7f9358142c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:39.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f934f7fe700 1 --2- 172.21.15.62:0/2013196729 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f93580b0040 0x7f9358142c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f934f7fe700 1 -- 172.21.15.62:0/2013196729 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f93580b5f60 msgr2=0x7f9358066380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:39.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f934f7fe700 1 --2- 172.21.15.62:0/2013196729 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f93580b5f60 0x7f9358066380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f934f7fe700 1 -- 172.21.15.62:0/2013196729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934800b1e0 con 0x7f93580b18e0 2021-12-17T18:27:39.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f934f7fe700 1 --2- 172.21.15.62:0/2013196729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93580b18e0 0x7f93580aa510 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f934000c000 tx=0x7f9340006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:39.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f9355ffb700 1 -- 172.21.15.62:0/2013196729 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9340010780 con 0x7f93580b18e0 2021-12-17T18:27:39.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f9355ffb700 1 -- 172.21.15.62:0/2013196729 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93400108e0 con 0x7f93580b18e0 2021-12-17T18:27:39.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f935e2f6700 1 -- 172.21.15.62:0/2013196729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9358065ee0 con 0x7f93580b18e0 2021-12-17T18:27:39.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f9355ffb700 1 -- 172.21.15.62:0/2013196729 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9340010c40 con 0x7f93580b18e0 2021-12-17T18:27:39.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.129+0000 7f935e2f6700 1 -- 172.21.15.62:0/2013196729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9358066ed0 con 0x7f93580b18e0 2021-12-17T18:27:39.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.133+0000 7f935e2f6700 1 -- 172.21.15.62:0/2013196729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93580a90b0 con 0x7f93580b18e0 2021-12-17T18:27:39.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.133+0000 7f9355ffb700 1 -- 172.21.15.62:0/2013196729 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f934001c460 con 0x7f93580b18e0 2021-12-17T18:27:39.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.133+0000 7f9355ffb700 1 --2- 172.21.15.62:0/2013196729 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f933c0534f0 0x7f933c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.133+0000 7f9355ffb700 1 -- 172.21.15.62:0/2013196729 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f934006bb30 con 0x7f93580b18e0 2021-12-17T18:27:39.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.133+0000 7f9357fff700 1 --2- 172.21.15.62:0/2013196729 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f933c0534f0 0x7f933c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.133+0000 7f9357fff700 1 --2- 172.21.15.62:0/2013196729 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f933c0534f0 0x7f933c0559b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f934801c000 tx=0x7f9348015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:39.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.141+0000 7f9355ffb700 1 -- 172.21.15.62:0/2013196729 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9340042e70 con 0x7f93580b18e0 2021-12-17T18:27:39.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.277+0000 7f935e2f6700 1 -- 172.21.15.62:0/2013196729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f93580573d0 con 0x7f93580b18e0 2021-12-17T18:27:39.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.281+0000 7f9355ffb700 1 -- 172.21.15.62:0/2013196729 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9340046490 con 0x7f93580b18e0 2021-12-17T18:27:39.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.285+0000 7f935e2f6700 1 -- 172.21.15.62:0/2013196729 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f933c0534f0 msgr2=0x7f933c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:39.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.285+0000 7f935e2f6700 1 --2- 172.21.15.62:0/2013196729 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f933c0534f0 0x7f933c0559b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f934801c000 tx=0x7f9348015000).stop 2021-12-17T18:27:39.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.285+0000 7f935e2f6700 1 -- 172.21.15.62:0/2013196729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93580b18e0 msgr2=0x7f93580aa510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:39.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.285+0000 7f935e2f6700 1 --2- 172.21.15.62:0/2013196729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93580b18e0 0x7f93580aa510 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f934000c000 tx=0x7f9340006df0).stop 2021-12-17T18:27:39.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.285+0000 7f935e2f6700 1 -- 172.21.15.62:0/2013196729 shutdown_connections 2021-12-17T18:27:39.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.285+0000 7f935e2f6700 1 --2- 172.21.15.62:0/2013196729 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f933c0534f0 0x7f933c0559b0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.285+0000 7f935e2f6700 1 --2- 172.21.15.62:0/2013196729 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f93580b5f60 0x7f9358066380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.285+0000 7f935e2f6700 1 --2- 172.21.15.62:0/2013196729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93580b18e0 0x7f93580aa510 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.285+0000 7f935e2f6700 1 --2- 172.21.15.62:0/2013196729 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f93580b0040 0x7f9358142c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.285+0000 7f935e2f6700 1 -- 172.21.15.62:0/2013196729 >> 172.21.15.62:0/2013196729 conn(0x7f935805ca00 msgr2=0x7f9358145a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:39.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.285+0000 7f935e2f6700 1 -- 172.21.15.62:0/2013196729 shutdown_connections 2021-12-17T18:27:39.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.285+0000 7f935e2f6700 1 -- 172.21.15.62:0/2013196729 wait complete. 2021-12-17T18:27:39.303 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-12-17T18:27:39.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.401+0000 7fd12f59e700 1 Processor -- start 2021-12-17T18:27:39.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.401+0000 7fd12f59e700 1 -- start start 2021-12-17T18:27:39.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.401+0000 7fd12f59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd13005fa70 0x7fd1300acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.401+0000 7fd12f59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd1300ac970 0x7fd1300abd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.401+0000 7fd12f59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13005fe50 con 0x7fd130060460 2021-12-17T18:27:39.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.401+0000 7fd12f59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1300b25a0 con 0x7fd13005fa70 2021-12-17T18:27:39.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.401+0000 7fd12f59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1300b17c0 con 0x7fd1300ac970 2021-12-17T18:27:39.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.401+0000 7fd12e59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd13005fa70 0x7fd1300acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.401+0000 7fd12ed9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd130060460 0x7fd1300b1e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39940/0 (socket says 172.21.15.62:39940) 2021-12-17T18:27:39.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.401+0000 7fd12ed9d700 1 -- 172.21.15.62:0/386747007 learned_addr learned my addr 172.21.15.62:0/386747007 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:39.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12dd9b700 1 --2- 172.21.15.62:0/386747007 >> v2:172.21.15.109:3300/0 conn(0x7fd1300ac970 0x7fd1300abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12d59a700 1 -- 172.21.15.62:0/386747007 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464481405 0 0) 0x7fd13005fe50 con 0x7fd130060460 2021-12-17T18:27:39.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12d59a700 1 -- 172.21.15.62:0/386747007 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd114003260 con 0x7fd130060460 2021-12-17T18:27:39.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12e59c700 1 -- 172.21.15.62:0/386747007 >> v2:172.21.15.109:3300/0 conn(0x7fd1300ac970 msgr2=0x7fd1300abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:39.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12e59c700 1 --2- 172.21.15.62:0/386747007 >> v2:172.21.15.109:3300/0 conn(0x7fd1300ac970 0x7fd1300abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12e59c700 1 -- 172.21.15.62:0/386747007 >> v1:172.21.15.62:6789/0 conn(0x7fd130060460 legacy=0x7fd1300b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:39.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12e59c700 1 -- 172.21.15.62:0/386747007 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1300b1a60 con 0x7fd13005fa70 2021-12-17T18:27:39.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12e59c700 1 --2- 172.21.15.62:0/386747007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd13005fa70 0x7fd1300acfe0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7fd120002f70 tx=0x7fd120006e80).ready entity=mon.0 client_cookie=70107ede55b24303 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:39.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12d59a700 1 -- 172.21.15.62:0/386747007 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd12000b980 con 0x7fd13005fa70 2021-12-17T18:27:39.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12d59a700 1 -- 172.21.15.62:0/386747007 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd120000e90 con 0x7fd13005fa70 2021-12-17T18:27:39.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12d59a700 1 -- 172.21.15.62:0/386747007 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd12000bcd0 con 0x7fd13005fa70 2021-12-17T18:27:39.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12f59e700 1 -- 172.21.15.62:0/386747007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd13005fa70 msgr2=0x7fd1300acfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:39.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12f59e700 1 --2- 172.21.15.62:0/386747007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd13005fa70 0x7fd1300acfe0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7fd120002f70 tx=0x7fd120006e80).stop 2021-12-17T18:27:39.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12f59e700 1 -- 172.21.15.62:0/386747007 shutdown_connections 2021-12-17T18:27:39.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12f59e700 1 --2- 172.21.15.62:0/386747007 >> v2:172.21.15.109:3300/0 conn(0x7fd1300ac970 0x7fd1300abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12f59e700 1 --2- 172.21.15.62:0/386747007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd13005fa70 0x7fd1300acfe0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12f59e700 1 -- 172.21.15.62:0/386747007 >> 172.21.15.62:0/386747007 conn(0x7fd13005c750 msgr2=0x7fd13005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:39.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12f59e700 1 -- 172.21.15.62:0/386747007 shutdown_connections 2021-12-17T18:27:39.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12f59e700 1 -- 172.21.15.62:0/386747007 wait complete. 2021-12-17T18:27:39.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12f59e700 1 Processor -- start 2021-12-17T18:27:39.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12f59e700 1 -- start start 2021-12-17T18:27:39.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12f59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd13005fa70 0x7fd1300a30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd130060460 0x7fd130152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd1300ac970 0x7fd130156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300a6660 con 0x7fd130060460 2021-12-17T18:27:39.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12f59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300aa130 con 0x7fd13005fa70 2021-12-17T18:27:39.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.405+0000 7fd12f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd130155b70 con 0x7fd1300ac970 2021-12-17T18:27:39.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd12dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd130060460 0x7fd130152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd12dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd130060460 0x7fd130152390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56366/0 (socket says 172.21.15.62:56366) 2021-12-17T18:27:39.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd12dd9b700 1 -- 172.21.15.62:0/926167610 learned_addr learned my addr 172.21.15.62:0/926167610 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:39.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd12e59c700 1 --2- 172.21.15.62:0/926167610 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd13005fa70 0x7fd1300a30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd12ed9d700 1 --2- 172.21.15.62:0/926167610 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd1300ac970 0x7fd130156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd12dd9b700 1 -- 172.21.15.62:0/926167610 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd1300ac970 msgr2=0x7fd130156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:39.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd12dd9b700 1 --2- 172.21.15.62:0/926167610 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd1300ac970 0x7fd130156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd12dd9b700 1 -- 172.21.15.62:0/926167610 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd13005fa70 msgr2=0x7fd1300a30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:39.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd12dd9b700 1 --2- 172.21.15.62:0/926167610 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd13005fa70 0x7fd1300a30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd12dd9b700 1 -- 172.21.15.62:0/926167610 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12000d410 con 0x7fd130060460 2021-12-17T18:27:39.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd12ed9d700 1 --2- 172.21.15.62:0/926167610 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd1300ac970 0x7fd130156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:39.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd12dd9b700 1 --2- 172.21.15.62:0/926167610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd130060460 0x7fd130152390 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7fd12400a000 tx=0x7fd124008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:39.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd11f7fe700 1 -- 172.21.15.62:0/926167610 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd124011850 con 0x7fd130060460 2021-12-17T18:27:39.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd12f59e700 1 -- 172.21.15.62:0/926167610 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1300a35a0 con 0x7fd130060460 2021-12-17T18:27:39.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd12f59e700 1 -- 172.21.15.62:0/926167610 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd130152880 con 0x7fd130060460 2021-12-17T18:27:39.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd11f7fe700 1 -- 172.21.15.62:0/926167610 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1240119b0 con 0x7fd130060460 2021-12-17T18:27:39.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd11f7fe700 1 -- 172.21.15.62:0/926167610 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd124011d10 con 0x7fd130060460 2021-12-17T18:27:39.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd12f59e700 1 -- 172.21.15.62:0/926167610 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd108003410 con 0x7fd130060460 2021-12-17T18:27:39.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd11f7fe700 1 -- 172.21.15.62:0/926167610 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd124012420 con 0x7fd130060460 2021-12-17T18:27:39.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd11f7fe700 1 --2- 172.21.15.62:0/926167610 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd10c053610 0x7fd10c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd11f7fe700 1 -- 172.21.15.62:0/926167610 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fd12406b610 con 0x7fd130060460 2021-12-17T18:27:39.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.409+0000 7fd12e59c700 1 --2- 172.21.15.62:0/926167610 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd10c053610 0x7fd10c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.413+0000 7fd12e59c700 1 --2- 172.21.15.62:0/926167610 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd10c053610 0x7fd10c055ad0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fd12001a000 tx=0x7fd120006e80).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:39.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.417+0000 7fd11f7fe700 1 -- 172.21.15.62:0/926167610 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd1240429f0 con 0x7fd130060460 2021-12-17T18:27:39.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.581+0000 7fd12f59e700 1 -- 172.21.15.62:0/926167610 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7fd108003c40 con 0x7fd130060460 2021-12-17T18:27:39.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.789+0000 7fd11f7fe700 1 -- 172.21.15.62:0/926167610 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v427) v1 ==== 128+0+0 (secure 0 0 0) 0x7fd124046010 con 0x7fd130060460 2021-12-17T18:27:39.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.793+0000 7fd12f59e700 1 -- 172.21.15.62:0/926167610 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd10c053610 msgr2=0x7fd10c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:39.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.793+0000 7fd12f59e700 1 --2- 172.21.15.62:0/926167610 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd10c053610 0x7fd10c055ad0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fd12001a000 tx=0x7fd120006e80).stop 2021-12-17T18:27:39.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.793+0000 7fd12f59e700 1 -- 172.21.15.62:0/926167610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd130060460 msgr2=0x7fd130152390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:39.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.793+0000 7fd12f59e700 1 --2- 172.21.15.62:0/926167610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd130060460 0x7fd130152390 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7fd12400a000 tx=0x7fd124008040).stop 2021-12-17T18:27:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.793+0000 7fd12f59e700 1 -- 172.21.15.62:0/926167610 shutdown_connections 2021-12-17T18:27:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.793+0000 7fd12f59e700 1 --2- 172.21.15.62:0/926167610 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd10c053610 0x7fd10c055ad0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.793+0000 7fd12f59e700 1 --2- 172.21.15.62:0/926167610 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd1300ac970 0x7fd130156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.793+0000 7fd12f59e700 1 --2- 172.21.15.62:0/926167610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd130060460 0x7fd130152390 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.793+0000 7fd12f59e700 1 --2- 172.21.15.62:0/926167610 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd13005fa70 0x7fd1300a30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.793+0000 7fd12f59e700 1 -- 172.21.15.62:0/926167610 >> 172.21.15.62:0/926167610 conn(0x7fd13005c750 msgr2=0x7fd1300b1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:39.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.793+0000 7fd12f59e700 1 -- 172.21.15.62:0/926167610 shutdown_connections 2021-12-17T18:27:39.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.793+0000 7fd12f59e700 1 -- 172.21.15.62:0/926167610 wait complete. 2021-12-17T18:27:39.812 INFO:tasks.cephfs_test_runner:test_getattr_caps (tasks.cephfs.test_misc.TestMisc) ... ok 2021-12-17T18:27:39.812 INFO:tasks.cephfs_test_runner:Starting test: test_root_rctime (tasks.cephfs.test_misc.TestMisc) 2021-12-17T18:27:39.813 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-12-17T18:27:39.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.913+0000 7f6629557700 1 Processor -- start 2021-12-17T18:27:39.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.913+0000 7f6629557700 1 -- start start 2021-12-17T18:27:39.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6629557700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66241472c0 0x7f66240a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6629557700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66241427b0 0x7f6624142c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6629557700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66240b1840 con 0x7f66240b5ea0 2021-12-17T18:27:39.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6629557700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66240b6280 con 0x7f66241472c0 2021-12-17T18:27:39.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6629557700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66240b1a70 con 0x7f66241427b0 2021-12-17T18:27:39.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f66237fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66241472c0 0x7f66240a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f66237fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66241472c0 0x7f66240a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56372/0 (socket says 172.21.15.62:56372) 2021-12-17T18:27:39.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f66237fe700 1 -- 172.21.15.62:0/932838968 learned_addr learned my addr 172.21.15.62:0/932838968 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:39.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6628d56700 1 --2- 172.21.15.62:0/932838968 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66241427b0 0x7f6624142c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f66237fe700 1 -- 172.21.15.62:0/932838968 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66241427b0 msgr2=0x7f6624142c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:39.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f66237fe700 1 --2- 172.21.15.62:0/932838968 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66241427b0 0x7f6624142c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f66237fe700 1 -- 172.21.15.62:0/932838968 >> v1:172.21.15.62:6789/0 conn(0x7f66240b5ea0 legacy=0x7f66240b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:39.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f66237fe700 1 -- 172.21.15.62:0/932838968 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66240b1d10 con 0x7f66241472c0 2021-12-17T18:27:39.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6628d56700 1 --2- 172.21.15.62:0/932838968 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66241427b0 0x7f6624142c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:27:39.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f66237fe700 1 --2- 172.21.15.62:0/932838968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66241472c0 0x7f66240a8d20 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f66140032f0 tx=0x7f6614009290).ready entity=mon.0 client_cookie=ad27f0d67dcc204f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:39.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6622ffd700 1 -- 172.21.15.62:0/932838968 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f661400b8a0 con 0x7f66241472c0 2021-12-17T18:27:39.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6622ffd700 1 -- 172.21.15.62:0/932838968 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661400ba00 con 0x7f66241472c0 2021-12-17T18:27:39.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6622ffd700 1 -- 172.21.15.62:0/932838968 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f661400bb70 con 0x7f66241472c0 2021-12-17T18:27:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6629557700 1 -- 172.21.15.62:0/932838968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66241472c0 msgr2=0x7f66240a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6629557700 1 --2- 172.21.15.62:0/932838968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66241472c0 0x7f66240a8d20 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f66140032f0 tx=0x7f6614009290).stop 2021-12-17T18:27:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6629557700 1 -- 172.21.15.62:0/932838968 shutdown_connections 2021-12-17T18:27:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6629557700 1 --2- 172.21.15.62:0/932838968 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66241427b0 0x7f6624142c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6629557700 1 --2- 172.21.15.62:0/932838968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66241472c0 0x7f66240a8d20 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6629557700 1 -- 172.21.15.62:0/932838968 >> 172.21.15.62:0/932838968 conn(0x7f662405d220 msgr2=0x7f66240b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6629557700 1 -- 172.21.15.62:0/932838968 shutdown_connections 2021-12-17T18:27:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.917+0000 7f6629557700 1 -- 172.21.15.62:0/932838968 wait complete. 2021-12-17T18:27:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6629557700 1 Processor -- start 2021-12-17T18:27:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6629557700 1 -- start start 2021-12-17T18:27:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6629557700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66240b5ea0 0x7f66240aa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6629557700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66241427b0 0x7f6624155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6629557700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66241472c0 0x7f66240ab790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6629557700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6624156210 con 0x7f66241472c0 2021-12-17T18:27:39.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6629557700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6624156430 con 0x7f66240b5ea0 2021-12-17T18:27:39.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6629557700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66241566d0 con 0x7f66241427b0 2021-12-17T18:27:39.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6628d56700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66241472c0 0x7f66240ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6628d56700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66241472c0 0x7f66240ab790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56382/0 (socket says 172.21.15.62:56382) 2021-12-17T18:27:39.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6628d56700 1 -- 172.21.15.62:0/940791881 learned_addr learned my addr 172.21.15.62:0/940791881 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:39.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6623fff700 1 --2- 172.21.15.62:0/940791881 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66240b5ea0 0x7f66240aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f66237fe700 1 --2- 172.21.15.62:0/940791881 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66241427b0 0x7f6624155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6628d56700 1 -- 172.21.15.62:0/940791881 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66241427b0 msgr2=0x7f6624155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6628d56700 1 --2- 172.21.15.62:0/940791881 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66241427b0 0x7f6624155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6628d56700 1 -- 172.21.15.62:0/940791881 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66240b5ea0 msgr2=0x7f66240aa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6628d56700 1 --2- 172.21.15.62:0/940791881 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66240b5ea0 0x7f66240aa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6628d56700 1 -- 172.21.15.62:0/940791881 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6614009530 con 0x7f66241472c0 2021-12-17T18:27:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6623fff700 1 --2- 172.21.15.62:0/940791881 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66240b5ea0 0x7f66240aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6628d56700 1 --2- 172.21.15.62:0/940791881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66241472c0 0x7f66240ab790 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f661c007000 tx=0x7f661c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:39.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f66217fa700 1 -- 172.21.15.62:0/940791881 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f661c015070 con 0x7f66241472c0 2021-12-17T18:27:39.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f66217fa700 1 -- 172.21.15.62:0/940791881 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c010580 con 0x7f66241472c0 2021-12-17T18:27:39.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6629557700 1 -- 172.21.15.62:0/940791881 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6624156970 con 0x7f66241472c0 2021-12-17T18:27:39.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f66217fa700 1 -- 172.21.15.62:0/940791881 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f661c0108e0 con 0x7f66241472c0 2021-12-17T18:27:39.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.921+0000 7f6629557700 1 -- 172.21.15.62:0/940791881 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662409ebe0 con 0x7f66241472c0 2021-12-17T18:27:39.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.925+0000 7f6629557700 1 -- 172.21.15.62:0/940791881 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66241525e0 con 0x7f66241472c0 2021-12-17T18:27:39.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.925+0000 7f66217fa700 1 -- 172.21.15.62:0/940791881 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f661c010a40 con 0x7f66241472c0 2021-12-17T18:27:39.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.925+0000 7f66217fa700 1 --2- 172.21.15.62:0/940791881 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6604053580 0x7f6604055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.925+0000 7f66217fa700 1 -- 172.21.15.62:0/940791881 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f661c06b210 con 0x7f66241472c0 2021-12-17T18:27:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.925+0000 7f6623fff700 1 --2- 172.21.15.62:0/940791881 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6604053580 0x7f6604055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:39.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.925+0000 7f6623fff700 1 --2- 172.21.15.62:0/940791881 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6604053580 0x7f6604055a40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f661800b000 tx=0x7f6618009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:39.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:39.933+0000 7f66217fa700 1 -- 172.21.15.62:0/940791881 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f66241525e0 con 0x7f66241472c0 2021-12-17T18:27:40.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.101+0000 7f6629557700 1 -- 172.21.15.62:0/940791881 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7f66241525e0 con 0x7f66241472c0 2021-12-17T18:27:40.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.793+0000 7f66217fa700 1 -- 172.21.15.62:0/940791881 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v428) v1 ==== 130+0+0 (secure 0 0 0) 0x7f66241525e0 con 0x7f66241472c0 2021-12-17T18:27:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.793+0000 7f6629557700 1 -- 172.21.15.62:0/940791881 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6604053580 msgr2=0x7f6604055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:40.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.793+0000 7f6629557700 1 --2- 172.21.15.62:0/940791881 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6604053580 0x7f6604055a40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f661800b000 tx=0x7f6618009040).stop 2021-12-17T18:27:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.793+0000 7f6629557700 1 -- 172.21.15.62:0/940791881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66241472c0 msgr2=0x7f66240ab790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.793+0000 7f6629557700 1 --2- 172.21.15.62:0/940791881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66241472c0 0x7f66240ab790 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f661c007000 tx=0x7f661c008040).stop 2021-12-17T18:27:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.797+0000 7f6629557700 1 -- 172.21.15.62:0/940791881 shutdown_connections 2021-12-17T18:27:40.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.797+0000 7f6629557700 1 --2- 172.21.15.62:0/940791881 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6604053580 0x7f6604055a40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.797+0000 7f6629557700 1 --2- 172.21.15.62:0/940791881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66241472c0 0x7f66240ab790 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.797+0000 7f6629557700 1 --2- 172.21.15.62:0/940791881 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f66241427b0 0x7f6624155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.797+0000 7f6629557700 1 --2- 172.21.15.62:0/940791881 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f66240b5ea0 0x7f66240aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:40.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.797+0000 7f6629557700 1 -- 172.21.15.62:0/940791881 >> 172.21.15.62:0/940791881 conn(0x7f662405d220 msgr2=0x7f662413fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.797+0000 7f6629557700 1 -- 172.21.15.62:0/940791881 shutdown_connections 2021-12-17T18:27:40.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.797+0000 7f6629557700 1 -- 172.21.15.62:0/940791881 wait complete. 2021-12-17T18:27:40.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-12-17T18:27:40.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.929+0000 7fe0df8fe700 1 Processor -- start 2021-12-17T18:27:40.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.929+0000 7fe0df8fe700 1 -- start start 2021-12-17T18:27:40.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0df8fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0d80b5dd0 0x7fe0d8146da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:40.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0df8fe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe0d80b41f0 0x7fe0d8141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:40.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0df8fe700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d80b2010 con 0x7fe0d80b05b0 2021-12-17T18:27:40.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0df8fe700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d80b0990 con 0x7fe0d80b41f0 2021-12-17T18:27:40.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0df8fe700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d8147290 con 0x7fe0d80b5dd0 2021-12-17T18:27:40.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0dde9b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe0d80b41f0 0x7fe0d8141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:40.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0dce99700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0d80b5dd0 0x7fe0d8146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:40.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0dce99700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0d80b5dd0 0x7fe0d8146da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:50090/0 (socket says 172.21.15.62:50090) 2021-12-17T18:27:40.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0dce99700 1 -- 172.21.15.62:0/1171746392 learned_addr learned my addr 172.21.15.62:0/1171746392 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:40.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0dd69a700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7fe0d80b05b0 0x7fe0d8146690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:56286/0 (socket says 172.21.15.62:56286) 2021-12-17T18:27:40.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0dce99700 1 -- 172.21.15.62:0/1171746392 >> v2:172.21.15.109:3300/0 conn(0x7fe0d80b41f0 msgr2=0x7fe0d8141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:40.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0dce99700 1 --2- 172.21.15.62:0/1171746392 >> v2:172.21.15.109:3300/0 conn(0x7fe0d80b41f0 0x7fe0d8141fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:40.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0dce99700 1 -- 172.21.15.62:0/1171746392 >> v1:172.21.15.109:6789/0 conn(0x7fe0d80b05b0 legacy=0x7fe0d8146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:40.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0dce99700 1 -- 172.21.15.62:0/1171746392 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d80b2240 con 0x7fe0d80b5dd0 2021-12-17T18:27:40.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0cffff700 1 -- 172.21.15.62:0/1171746392 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194261633 0 0) 0x7fe0d80b2010 con 0x7fe0d80b05b0 2021-12-17T18:27:40.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0dde9b700 1 --2- 172.21.15.62:0/1171746392 >> v2:172.21.15.109:3300/0 conn(0x7fe0d80b41f0 0x7fe0d8141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:40.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0dce99700 1 --2- 172.21.15.62:0/1171746392 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0d80b5dd0 0x7fe0d8146da0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fe0c8002f70 tx=0x7fe0c8006eb0).ready entity=mon.2 client_cookie=3e7c9742d16bc5c3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:40.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0cffff700 1 -- 172.21.15.62:0/1171746392 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0c800d570 con 0x7fe0d80b5dd0 2021-12-17T18:27:40.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0cffff700 1 -- 172.21.15.62:0/1171746392 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c8000e90 con 0x7fe0d80b5dd0 2021-12-17T18:27:40.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0cffff700 1 -- 172.21.15.62:0/1171746392 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0c800d8c0 con 0x7fe0d80b5dd0 2021-12-17T18:27:40.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0df8fe700 1 -- 172.21.15.62:0/1171746392 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0d80b5dd0 msgr2=0x7fe0d8146da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:40.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0df8fe700 1 --2- 172.21.15.62:0/1171746392 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0d80b5dd0 0x7fe0d8146da0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fe0c8002f70 tx=0x7fe0c8006eb0).stop 2021-12-17T18:27:40.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0df8fe700 1 -- 172.21.15.62:0/1171746392 shutdown_connections 2021-12-17T18:27:40.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0df8fe700 1 --2- 172.21.15.62:0/1171746392 >> v2:172.21.15.109:3300/0 conn(0x7fe0d80b41f0 0x7fe0d8141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:40.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0df8fe700 1 --2- 172.21.15.62:0/1171746392 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0d80b5dd0 0x7fe0d8146da0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:40.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0df8fe700 1 -- 172.21.15.62:0/1171746392 >> 172.21.15.62:0/1171746392 conn(0x7fe0d8062510 msgr2=0x7fe0d80628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:40.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0df8fe700 1 -- 172.21.15.62:0/1171746392 shutdown_connections 2021-12-17T18:27:40.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.933+0000 7fe0df8fe700 1 -- 172.21.15.62:0/1171746392 wait complete. 2021-12-17T18:27:40.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0df8fe700 1 Processor -- start 2021-12-17T18:27:40.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0df8fe700 1 -- start start 2021-12-17T18:27:40.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0df8fe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0d80b05b0 0x7fe0d813efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:40.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0df8fe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0d80b41f0 0x7fe0d8141150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:40.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0df8fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0d80b5dd0 0x7fe0d8152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:40.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0df8fe700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d80b9350 con 0x7fe0d80b5dd0 2021-12-17T18:27:40.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0df8fe700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d8140cb0 con 0x7fe0d80b41f0 2021-12-17T18:27:40.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0df8fe700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d8141640 con 0x7fe0d80b05b0 2021-12-17T18:27:40.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0dde9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0d80b5dd0 0x7fe0d8152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:40.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0dde9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0d80b5dd0 0x7fe0d8152390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56396/0 (socket says 172.21.15.62:56396) 2021-12-17T18:27:40.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0dde9b700 1 -- 172.21.15.62:0/3609381995 learned_addr learned my addr 172.21.15.62:0/3609381995 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:40.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0dce99700 1 --2- 172.21.15.62:0/3609381995 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0d80b41f0 0x7fe0d8141150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:40.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0dd69a700 1 --2- 172.21.15.62:0/3609381995 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0d80b05b0 0x7fe0d813efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:40.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0dde9b700 1 -- 172.21.15.62:0/3609381995 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0d80b05b0 msgr2=0x7fe0d813efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:40.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0dde9b700 1 --2- 172.21.15.62:0/3609381995 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0d80b05b0 0x7fe0d813efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:40.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0dde9b700 1 -- 172.21.15.62:0/3609381995 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0d80b41f0 msgr2=0x7fe0d8141150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:40.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0dde9b700 1 --2- 172.21.15.62:0/3609381995 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0d80b41f0 0x7fe0d8141150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:40.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0dde9b700 1 -- 172.21.15.62:0/3609381995 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d0009470 con 0x7fe0d80b5dd0 2021-12-17T18:27:40.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0dde9b700 1 --2- 172.21.15.62:0/3609381995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0d80b5dd0 0x7fe0d8152390 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7fe0d000c000 tx=0x7fe0d00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:40.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0ce7fc700 1 -- 172.21.15.62:0/3609381995 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0d000ee60 con 0x7fe0d80b5dd0 2021-12-17T18:27:40.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0df8fe700 1 -- 172.21.15.62:0/3609381995 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c800b1e0 con 0x7fe0d80b5dd0 2021-12-17T18:27:40.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0ce7fc700 1 -- 172.21.15.62:0/3609381995 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d000c850 con 0x7fe0d80b5dd0 2021-12-17T18:27:40.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0ce7fc700 1 -- 172.21.15.62:0/3609381995 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0d000cbb0 con 0x7fe0d80b5dd0 2021-12-17T18:27:40.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.937+0000 7fe0df8fe700 1 -- 172.21.15.62:0/3609381995 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d8146380 con 0x7fe0d80b5dd0 2021-12-17T18:27:40.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.941+0000 7fe0df8fe700 1 -- 172.21.15.62:0/3609381995 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d8140e70 con 0x7fe0d80b5dd0 2021-12-17T18:27:40.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.941+0000 7fe0ce7fc700 1 -- 172.21.15.62:0/3609381995 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe0d0022070 con 0x7fe0d80b5dd0 2021-12-17T18:27:40.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.941+0000 7fe0ce7fc700 1 --2- 172.21.15.62:0/3609381995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe0c0053580 0x7fe0c0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:40.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.941+0000 7fe0ce7fc700 1 -- 172.21.15.62:0/3609381995 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fe0d006bde0 con 0x7fe0d80b5dd0 2021-12-17T18:27:40.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.941+0000 7fe0dd69a700 1 --2- 172.21.15.62:0/3609381995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe0c0053580 0x7fe0c0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:40.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.945+0000 7fe0dd69a700 1 --2- 172.21.15.62:0/3609381995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe0c0053580 0x7fe0c0055a40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fe0d400d000 tx=0x7fe0d4007bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:40.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:40.949+0000 7fe0ce7fc700 1 -- 172.21.15.62:0/3609381995 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe0d0043180 con 0x7fe0d80b5dd0 2021-12-17T18:27:41.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.073+0000 7fe0df8fe700 1 -- 172.21.15.62:0/3609381995 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe0d80b24e0 con 0x7fe0d80b5dd0 2021-12-17T18:27:41.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.085+0000 7fe0ce7fc700 1 -- 172.21.15.62:0/3609381995 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe0d00160c0 con 0x7fe0d80b5dd0 2021-12-17T18:27:41.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.089+0000 7fe0df8fe700 1 -- 172.21.15.62:0/3609381995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe0c0053580 msgr2=0x7fe0c0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:41.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.089+0000 7fe0df8fe700 1 --2- 172.21.15.62:0/3609381995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe0c0053580 0x7fe0c0055a40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fe0d400d000 tx=0x7fe0d4007bc0).stop 2021-12-17T18:27:41.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.089+0000 7fe0df8fe700 1 -- 172.21.15.62:0/3609381995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0d80b5dd0 msgr2=0x7fe0d8152390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:41.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.089+0000 7fe0df8fe700 1 --2- 172.21.15.62:0/3609381995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0d80b5dd0 0x7fe0d8152390 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7fe0d000c000 tx=0x7fe0d00091d0).stop 2021-12-17T18:27:41.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.089+0000 7fe0df8fe700 1 -- 172.21.15.62:0/3609381995 shutdown_connections 2021-12-17T18:27:41.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.089+0000 7fe0df8fe700 1 --2- 172.21.15.62:0/3609381995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe0c0053580 0x7fe0c0055a40 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.089+0000 7fe0df8fe700 1 --2- 172.21.15.62:0/3609381995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0d80b5dd0 0x7fe0d8152390 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.089+0000 7fe0df8fe700 1 --2- 172.21.15.62:0/3609381995 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe0d80b41f0 0x7fe0d8141150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.089+0000 7fe0df8fe700 1 --2- 172.21.15.62:0/3609381995 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe0d80b05b0 0x7fe0d813efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.089+0000 7fe0df8fe700 1 -- 172.21.15.62:0/3609381995 >> 172.21.15.62:0/3609381995 conn(0x7fe0d8062510 msgr2=0x7fe0d80b97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:41.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.089+0000 7fe0df8fe700 1 -- 172.21.15.62:0/3609381995 shutdown_connections 2021-12-17T18:27:41.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.089+0000 7fe0df8fe700 1 -- 172.21.15.62:0/3609381995 wait complete. 2021-12-17T18:27:41.106 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:27:41.107 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:41.125 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:41.146 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:41.168 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:41.188 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:41.209 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:27:41.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:41.210 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:41.211 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:41.218 INFO:teuthology.orchestra.run.smithi125.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-12-17T18:27:41.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:27:41.220 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-12-17T18:27:41.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:41.221 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:41.221 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:41.228 INFO:teuthology.orchestra.run.smithi158.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:27:41.229 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:27:41.230 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-12-17T18:27:41.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:41.231 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:41.231 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:27:41.259 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:27:41.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:27:41.262 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:27:41.262 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:27:41.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.365+0000 7f8f3c05f700 1 Processor -- start 2021-12-17T18:27:41.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.365+0000 7f8f3c05f700 1 -- start start 2021-12-17T18:27:41.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f3c05f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f8f340b3eb0 0x7f8f34145110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:41.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f3c05f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f340b27c0 con 0x7f8f341406a0 2021-12-17T18:27:41.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f3c05f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f34144730 con 0x7f8f34067770 2021-12-17T18:27:41.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f3c05f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f341449d0 con 0x7f8f340b3eb0 2021-12-17T18:27:41.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f3a5fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8f341406a0 0x7f8f34140b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39984/0 (socket says 172.21.15.62:39984) 2021-12-17T18:27:41.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f3a5fc700 1 -- 172.21.15.62:0/3958478281 learned_addr learned my addr 172.21.15.62:0/3958478281 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:41.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f39dfb700 1 --2- 172.21.15.62:0/3958478281 >> v2:172.21.15.109:3300/0 conn(0x7f8f340b3eb0 0x7f8f34145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:41.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 -- 172.21.15.62:0/3958478281 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589526842 0 0) 0x7f8f340b27c0 con 0x7f8f341406a0 2021-12-17T18:27:41.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 -- 172.21.15.62:0/3958478281 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f1c003260 con 0x7f8f341406a0 2021-12-17T18:27:41.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 -- 172.21.15.62:0/3958478281 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320393730 0 0) 0x7f8f34144730 con 0x7f8f34067770 2021-12-17T18:27:41.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 -- 172.21.15.62:0/3958478281 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f340b27c0 con 0x7f8f34067770 2021-12-17T18:27:41.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 -- 172.21.15.62:0/3958478281 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 79281471 0 0) 0x7f8f1c003260 con 0x7f8f341406a0 2021-12-17T18:27:41.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 -- 172.21.15.62:0/3958478281 >> v2:172.21.15.109:3300/0 conn(0x7f8f340b3eb0 msgr2=0x7f8f34145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:41.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 --2- 172.21.15.62:0/3958478281 >> v2:172.21.15.109:3300/0 conn(0x7f8f340b3eb0 0x7f8f34145110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 -- 172.21.15.62:0/3958478281 >> v1:172.21.15.109:6789/0 conn(0x7f8f34067770 legacy=0x7f8f340b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:41.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 -- 172.21.15.62:0/3958478281 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f34144c70 con 0x7f8f341406a0 2021-12-17T18:27:41.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 -- 172.21.15.62:0/3958478281 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f8f2c0019e0 con 0x7f8f341406a0 2021-12-17T18:27:41.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 -- 172.21.15.62:0/3958478281 >> v1:172.21.15.62:6789/0 conn(0x7f8f341406a0 legacy=0x7f8f34140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:41.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 --2- 172.21.15.62:0/3958478281 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f1c003930 0x7f8f1c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:41.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 --2- 172.21.15.62:0/3958478281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f1c004500 0x7f8f1c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:41.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 --2- 172.21.15.62:0/3958478281 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f1c004e70 0x7f8f1c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:41.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 -- 172.21.15.62:0/3958478281 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f341449d0 con 0x7f8f1c004500 2021-12-17T18:27:41.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 -- 172.21.15.62:0/3958478281 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c00bd20 con 0x7f8f1c003930 2021-12-17T18:27:41.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 -- 172.21.15.62:0/3958478281 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c00bee0 con 0x7f8f1c004e70 2021-12-17T18:27:41.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f395fa700 1 --2- 172.21.15.62:0/3958478281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f1c004500 0x7f8f1c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:41.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f39dfb700 1 --2- 172.21.15.62:0/3958478281 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f1c003930 0x7f8f1c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:41.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f3a5fc700 1 --2- 172.21.15.62:0/3958478281 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f1c004e70 0x7f8f1c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:41.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f395fa700 1 -- 172.21.15.62:0/3958478281 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f1c004e70 msgr2=0x7f8f1c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:41.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f395fa700 1 --2- 172.21.15.62:0/3958478281 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f1c004e70 0x7f8f1c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f395fa700 1 -- 172.21.15.62:0/3958478281 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f1c003930 msgr2=0x7f8f1c003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:41.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f395fa700 1 --2- 172.21.15.62:0/3958478281 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f1c003930 0x7f8f1c003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f395fa700 1 -- 172.21.15.62:0/3958478281 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c003260 con 0x7f8f1c004500 2021-12-17T18:27:41.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f3a5fc700 1 -- 172.21.15.62:0/3958478281 reap_dead start 2021-12-17T18:27:41.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f395fa700 1 --2- 172.21.15.62:0/3958478281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f1c004500 0x7f8f1c004980 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f8f30001110 tx=0x7f8f30007a00).ready entity=mon.0 client_cookie=a2abcf3cf0b89109 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:41.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 -- 172.21.15.62:0/3958478281 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f30007d10 con 0x7f8f1c004500 2021-12-17T18:27:41.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 -- 172.21.15.62:0/3958478281 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f30007030 con 0x7f8f1c004500 2021-12-17T18:27:41.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.369+0000 7f8f38df9700 1 -- 172.21.15.62:0/3958478281 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f30007390 con 0x7f8f1c004500 2021-12-17T18:27:41.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.373+0000 7f8f3c05f700 1 -- 172.21.15.62:0/3958478281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f1c004500 msgr2=0x7f8f1c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:41.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.373+0000 7f8f3c05f700 1 --2- 172.21.15.62:0/3958478281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f1c004500 0x7f8f1c004980 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f8f30001110 tx=0x7f8f30007a00).stop 2021-12-17T18:27:41.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.373+0000 7f8f3c05f700 1 -- 172.21.15.62:0/3958478281 shutdown_connections 2021-12-17T18:27:41.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.373+0000 7f8f3c05f700 1 --2- 172.21.15.62:0/3958478281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f1c004500 0x7f8f1c004980 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.373+0000 7f8f3c05f700 1 -- 172.21.15.62:0/3958478281 >> 172.21.15.62:0/3958478281 conn(0x7f8f3405cb40 msgr2=0x7f8f3405cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:41.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.373+0000 7f8f3c05f700 1 -- 172.21.15.62:0/3958478281 shutdown_connections 2021-12-17T18:27:41.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.373+0000 7f8f3c05f700 1 -- 172.21.15.62:0/3958478281 wait complete. 2021-12-17T18:27:41.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.373+0000 7f8f3c05f700 1 Processor -- start 2021-12-17T18:27:41.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.373+0000 7f8f3c05f700 1 -- start start 2021-12-17T18:27:41.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f3c05f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f1c004500 0x7f8f340af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:41.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f3c05f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f340b1800 0x7f8f340649e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:41.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f3c05f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f34063700 0x7f8f340ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:41.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f3c05f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f340afd30 con 0x7f8f1c004500 2021-12-17T18:27:41.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f3c05f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3413e840 con 0x7f8f340b1800 2021-12-17T18:27:41.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f3c05f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f340645b0 con 0x7f8f34063700 2021-12-17T18:27:41.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f39dfb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f1c004500 0x7f8f340af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:41.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f39dfb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f1c004500 0x7f8f340af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56412/0 (socket says 172.21.15.62:56412) 2021-12-17T18:27:41.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f39dfb700 1 -- 172.21.15.62:0/3972377478 learned_addr learned my addr 172.21.15.62:0/3972377478 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:41.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f395fa700 1 --2- 172.21.15.62:0/3972377478 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f340b1800 0x7f8f340649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:41.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f3a5fc700 1 --2- 172.21.15.62:0/3972377478 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f34063700 0x7f8f340ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:41.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f39dfb700 1 -- 172.21.15.62:0/3972377478 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f34063700 msgr2=0x7f8f340ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:41.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f39dfb700 1 --2- 172.21.15.62:0/3972377478 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f34063700 0x7f8f340ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f39dfb700 1 -- 172.21.15.62:0/3972377478 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f340b1800 msgr2=0x7f8f340649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:41.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f39dfb700 1 --2- 172.21.15.62:0/3972377478 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f340b1800 0x7f8f340649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f39dfb700 1 -- 172.21.15.62:0/3972377478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f340b1c80 con 0x7f8f1c004500 2021-12-17T18:27:41.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f39dfb700 1 --2- 172.21.15.62:0/3972377478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f1c004500 0x7f8f340af1d0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7f8f340648c0 tx=0x7f8f24006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:41.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f22ffd700 1 -- 172.21.15.62:0/3972377478 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f2400b5f0 con 0x7f8f1c004500 2021-12-17T18:27:41.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f22ffd700 1 -- 172.21.15.62:0/3972377478 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2400f8e0 con 0x7f8f1c004500 2021-12-17T18:27:41.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f3c05f700 1 -- 172.21.15.62:0/3972377478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f340b15a0 con 0x7f8f1c004500 2021-12-17T18:27:41.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f22ffd700 1 -- 172.21.15.62:0/3972377478 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f2400fc40 con 0x7f8f1c004500 2021-12-17T18:27:41.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.377+0000 7f8f3c05f700 1 -- 172.21.15.62:0/3972377478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f34063b80 con 0x7f8f1c004500 2021-12-17T18:27:41.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.381+0000 7f8f3c05f700 1 -- 172.21.15.62:0/3972377478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f340573d0 con 0x7f8f1c004500 2021-12-17T18:27:41.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.381+0000 7f8f22ffd700 1 -- 172.21.15.62:0/3972377478 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8f2400fda0 con 0x7f8f1c004500 2021-12-17T18:27:41.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.381+0000 7f8f22ffd700 1 --2- 172.21.15.62:0/3972377478 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f14053580 0x7f8f14055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:41.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.381+0000 7f8f22ffd700 1 -- 172.21.15.62:0/3972377478 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f8f2406bc00 con 0x7f8f1c004500 2021-12-17T18:27:41.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.381+0000 7f8f395fa700 1 --2- 172.21.15.62:0/3972377478 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f14053580 0x7f8f14055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:41.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.381+0000 7f8f395fa700 1 --2- 172.21.15.62:0/3972377478 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f14053580 0x7f8f14055a40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f8f3001a000 tx=0x7f8f30016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:41.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.389+0000 7f8f22ffd700 1 -- 172.21.15.62:0/3972377478 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8f24071020 con 0x7f8f1c004500 2021-12-17T18:27:41.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.513+0000 7f8f3c05f700 1 -- 172.21.15.62:0/3972377478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8f340646f0 con 0x7f8f1c004500 2021-12-17T18:27:41.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.517+0000 7f8f22ffd700 1 -- 172.21.15.62:0/3972377478 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v135) v1 ==== 81+0+28885 (secure 0 0 0) 0x7f8f24018020 con 0x7f8f1c004500 2021-12-17T18:27:41.522 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:41.523 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:27:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 135, 2021-12-17T18:27:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:27:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:27:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:27:38.769362+0000", 2021-12-17T18:27:41.524 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:27:41.524 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:27:41.524 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:27:41.524 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:27:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:27:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:27:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:27:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:27:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:27:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:27:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:27:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:27:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:27:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:27:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 26, 2021-12-17T18:27:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:27:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:27:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:27:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:27:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:27:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:27:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:27:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:27:41.530 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:27:41.530 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:27:41.530 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:27:41.530 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:27:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:27:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:27:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:27:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:27:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:27:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:27:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:27:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:27:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:27:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:27:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:27:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:27:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:27:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:27:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:27:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:27:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:27:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:27:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:27:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:27:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:27:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:27:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:27:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:27:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:27:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:27:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:27:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:27:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:27:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:27:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:27:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:27:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:27:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:27:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:27:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:27:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:27:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:27:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:27:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:27:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:27:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:27:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:27:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:27:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:27:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:27:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:27:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:27:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:27:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:27:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:27:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:27:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:27:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:27:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:27:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:27:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:27:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:27:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:27:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:27:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:27:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:27:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:27:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:27:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:27:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:27:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:27:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:27:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:27:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:27:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:27:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:27:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:27:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:27:41.549 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:27:41.549 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:27:41.549 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:27:41.549 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:27:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:27:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:27:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:27:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:27:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:27:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:27:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:27:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:27:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:27:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:27:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:27:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:27:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:27:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:27:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:27:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:27:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:27:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:27:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:27:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:27:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:27:41.555 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:27:41.555 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:27:41.555 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:27:41.555 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:27:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:27:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:27:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:27:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:27:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:27:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:27:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:27:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:27:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:27:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:27:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:27:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:27:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:27:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:27:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:27:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:27:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:27:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:27:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:27:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:27:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:27:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:27:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 128, 2021-12-17T18:27:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:27:41.566 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:41.566 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.566 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.566 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.567 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:27:41.567 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:41.567 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.567 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.569 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:27:41.569 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:41.569 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.569 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.570 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.570 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:27:41.570 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:41.570 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.571 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:27:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:27:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:41.575 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.575 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.575 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.575 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:27:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:27:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:27:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:27:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:27:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:27:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:27:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:27:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 129, 2021-12-17T18:27:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:27:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:27:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.587 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:41.587 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.587 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.587 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.588 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:27:41.588 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:41.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.588 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:27:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:27:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:27:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:27:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:27:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.597 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:27:41.597 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:27:41.597 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:27:41.597 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:27:41.597 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:27:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:27:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:41.601 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:41.601 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 129, 2021-12-17T18:27:41.601 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:41.601 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:41.601 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:27:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:27:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:27:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:27:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.608 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:41.608 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.608 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.608 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:27:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:27:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:27:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.613 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.613 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:27:41.613 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:41.613 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:27:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:27:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:27:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:27:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:27:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:27:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 128, 2021-12-17T18:27:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:27:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:27:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:27:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:41.624 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.624 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.624 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.624 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:27:41.625 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:41.625 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.625 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.625 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.626 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:41.626 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.626 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.626 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.626 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:27:41.627 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:41.627 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.627 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.627 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.628 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:27:41.628 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:41.628 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.628 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.629 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.629 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:41.629 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.629 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.629 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.630 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:27:41.630 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:41.630 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.630 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.631 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.631 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:27:41.631 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:41.631 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.632 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.632 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.632 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:27:41.632 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:27:41.632 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:27:41.633 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:27:41.633 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:41.633 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:41.633 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:41.634 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.634 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.634 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.634 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:27:41.635 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:27:41.635 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:41.635 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:41.635 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:41.635 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:41.636 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:41.636 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:41.636 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:41.636 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 130, 2021-12-17T18:27:41.637 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:41.637 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:41.637 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:41.637 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.637 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.638 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.638 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:27:41.638 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:41.638 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.639 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.639 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.639 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:27:41.639 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:41.640 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.640 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.640 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.640 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:41.641 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.641 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.641 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.641 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:27:41.641 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:41.642 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.642 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.642 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.642 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:27:41.643 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:41.643 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.643 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.643 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.644 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:41.644 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.644 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.644 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.644 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:27:41.645 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:41.645 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.645 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.645 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.646 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:27:41.646 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:41.646 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.646 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.646 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.647 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:41.647 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.647 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.647 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.648 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:27:41.648 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:41.648 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.648 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.649 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.649 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:27:41.649 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:41.649 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.650 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.650 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.650 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:27:41.650 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:27:41.651 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:27:41.651 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:27:41.651 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:41.651 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:41.652 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:41.652 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.652 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.652 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.653 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:27:41.653 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:27:41.653 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:41.653 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:41.654 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:41.654 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:41.654 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:41.654 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:41.654 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:41.655 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 121, 2021-12-17T18:27:41.655 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:41.655 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:41.655 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:41.656 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.656 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.656 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.656 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:27:41.657 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:41.657 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.657 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.657 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.657 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:27:41.658 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:41.658 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.658 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.658 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.659 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:41.659 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.659 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.659 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.660 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:27:41.660 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:41.660 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.660 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.661 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.661 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:27:41.661 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:41.661 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.661 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.662 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.662 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:41.662 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.662 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.663 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.663 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:27:41.663 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:41.663 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.664 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.664 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.664 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:27:41.664 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:41.664 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.665 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.665 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.665 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:41.665 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.666 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.666 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.666 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:27:41.666 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:41.667 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.667 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.667 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.667 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:27:41.667 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:41.668 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.668 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.668 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.668 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:27:41.669 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:27:41.669 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:27:41.669 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:27:41.669 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:41.669 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:41.670 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:41.670 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.670 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.670 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.671 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:27:41.671 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:27:41.671 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:41.671 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:41.672 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:41.672 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:41.672 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:41.672 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:41.672 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:41.673 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 129, 2021-12-17T18:27:41.673 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:41.673 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:41.673 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:41.673 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.674 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.674 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.674 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:27:41.674 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:41.675 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.675 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.675 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.675 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:27:41.676 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:41.676 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.676 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.676 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.677 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:41.677 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.677 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.677 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.677 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:27:41.678 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:41.678 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.678 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.678 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.679 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:27:41.679 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:41.679 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.679 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.679 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.680 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:41.680 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.680 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.680 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.680 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:27:41.681 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:41.681 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.681 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.681 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.682 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:27:41.682 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:41.682 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.682 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.682 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.683 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:41.683 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.683 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.683 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.683 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:27:41.684 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:41.684 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.684 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.684 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.685 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:27:41.685 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:41.685 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.685 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.685 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.686 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:27:41.686 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:27:41.686 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:27:41.686 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:27:41.687 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:41.687 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:41.687 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:41.687 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.688 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.688 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.688 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:27:41.688 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:27:41.688 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:41.689 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:41.689 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:41.689 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:41.689 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:41.690 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:41.690 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:41.690 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 129, 2021-12-17T18:27:41.690 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:41.691 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:41.691 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:41.691 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.691 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.692 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:27:41.692 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:41.692 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.692 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.693 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.693 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:27:41.693 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:41.693 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.693 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.694 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.694 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:41.694 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.694 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.695 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.695 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:27:41.695 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:41.695 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.695 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.696 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.696 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:27:41.696 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:41.696 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.697 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.697 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.697 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:41.697 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.698 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.698 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:27:41.698 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:41.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.699 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.699 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.699 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:27:41.699 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:41.700 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.700 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.700 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.700 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:41.701 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:41.701 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.701 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:41.701 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:27:41.702 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:41.702 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.702 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.702 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:41.703 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:27:41.703 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:41.703 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.703 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.704 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:27:41.704 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:27:41.704 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:27:41.704 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:27:41.705 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:41.705 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:41.705 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:41.705 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:41.706 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.706 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:41.706 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:27:41.706 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.706 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:27:41.707 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:41.707 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:41.707 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:41.707 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:41.708 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:41.708 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:27:41.708 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:41.708 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.709 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.709 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:27:41.709 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:41.709 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:41.709 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:41.710 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:41.710 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:41.710 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:27:41.710 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:41.711 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.711 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.711 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:27:41.711 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:41.712 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:41.712 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:41.712 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:41.712 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:41.712 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:27:41.713 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:41.713 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.713 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.713 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:27:41.713 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:41.714 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:41.714 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:41.714 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:41.714 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:41.715 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:27:41.715 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:41.715 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.715 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.716 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:27:41.716 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:41.716 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:41.716 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:41.716 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:41.717 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:41.717 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:27:41.717 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:41.717 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.718 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.718 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:27:41.718 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:41.718 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:41.719 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:41.719 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:41.719 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:41.719 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:27:41.719 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:41.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.720 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.720 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:27:41.720 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:41.721 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:41.721 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:41.721 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:41.721 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:41.722 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:27:41.722 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:41.722 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.722 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:41.722 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:27:41.723 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:41.723 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:41.723 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:41.723 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:41.724 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:41.724 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:27:41.724 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:41.724 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.725 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:41.725 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:27:41.725 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:27:41.725 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:27:41.725 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:27:41.726 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": { 2021-12-17T18:27:41.726 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.109:6835/570760267": "2021-12-18T18:27:35.698071+0000", 2021-12-17T18:27:41.726 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.109:6834/570760267": "2021-12-18T18:27:35.698071+0000" 2021-12-17T18:27:41.726 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.727 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:27:41.727 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:27:41.727 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:27:41.727 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:27:41.727 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:27:41.728 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:27:41.728 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:27:41.728 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:27:41.728 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:41.729 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:41.729 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:27:41.729 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:27:41.729 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:27:41.730 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:27:41.730 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:27:41.730 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:27:41.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.517+0000 7f8f3c05f700 1 -- 172.21.15.62:0/3972377478 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f14053580 msgr2=0x7f8f14055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:41.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.517+0000 7f8f3c05f700 1 --2- 172.21.15.62:0/3972377478 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f14053580 0x7f8f14055a40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f8f3001a000 tx=0x7f8f30016000).stop 2021-12-17T18:27:41.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.517+0000 7f8f3c05f700 1 -- 172.21.15.62:0/3972377478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f1c004500 msgr2=0x7f8f340af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:41.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.517+0000 7f8f3c05f700 1 --2- 172.21.15.62:0/3972377478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f1c004500 0x7f8f340af1d0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7f8f340648c0 tx=0x7f8f24006df0).stop 2021-12-17T18:27:41.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.517+0000 7f8f3c05f700 1 -- 172.21.15.62:0/3972377478 shutdown_connections 2021-12-17T18:27:41.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.517+0000 7f8f3c05f700 1 --2- 172.21.15.62:0/3972377478 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f14053580 0x7f8f14055a40 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.517+0000 7f8f3c05f700 1 --2- 172.21.15.62:0/3972377478 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8f34063700 0x7f8f340ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.517+0000 7f8f3c05f700 1 --2- 172.21.15.62:0/3972377478 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8f340b1800 0x7f8f340649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.517+0000 7f8f3c05f700 1 --2- 172.21.15.62:0/3972377478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f1c004500 0x7f8f340af1d0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.517+0000 7f8f3c05f700 1 -- 172.21.15.62:0/3972377478 >> 172.21.15.62:0/3972377478 conn(0x7f8f3405cb40 msgr2=0x7f8f3413f140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:41.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.517+0000 7f8f3c05f700 1 -- 172.21.15.62:0/3972377478 shutdown_connections 2021-12-17T18:27:41.735 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.517+0000 7f8f3c05f700 1 -- 172.21.15.62:0/3972377478 wait complete. 2021-12-17T18:27:41.736 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:41.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75bdb15700 1 Processor -- start 2021-12-17T18:27:41.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75bdb15700 1 -- start start 2021-12-17T18:27:41.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75bdb15700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75b80b5b20 0x7f75b80b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:41.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75bdb15700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f75b80b3760 0x7f75b80b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:41.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75bdb15700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b80b5f00 con 0x7f75b80b6c70 2021-12-17T18:27:41.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75bdb15700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b80b3020 con 0x7f75b80b5b20 2021-12-17T18:27:41.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75bdb15700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b80b32c0 con 0x7f75b80b3760 2021-12-17T18:27:41.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75bcb13700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75b80b5b20 0x7f75b80b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:41.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75bcb13700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75b80b5b20 0x7f75b80b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56420/0 (socket says 172.21.15.62:56420) 2021-12-17T18:27:41.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75b7fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f75b80b3760 0x7f75b80b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:41.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75bcb13700 1 -- 172.21.15.62:0/1328903754 learned_addr learned my addr 172.21.15.62:0/1328903754 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:41.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75b7fff700 1 -- 172.21.15.62:0/1328903754 >> v2:172.21.15.62:3300/0 conn(0x7f75b80b5b20 msgr2=0x7f75b80b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:41.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75b7fff700 1 --2- 172.21.15.62:0/1328903754 >> v2:172.21.15.62:3300/0 conn(0x7f75b80b5b20 0x7f75b80b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75b7fff700 1 -- 172.21.15.62:0/1328903754 >> v1:172.21.15.109:6789/0 conn(0x7f75b80b6c70 legacy=0x7f75b8146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:41.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75b7fff700 1 -- 172.21.15.62:0/1328903754 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b80b5440 con 0x7f75b80b3760 2021-12-17T18:27:41.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75b7fff700 1 --2- 172.21.15.62:0/1328903754 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75b80b3760 0x7f75b80b6780 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f75ac002f70 tx=0x7f75ac006df0).ready entity=mon.1 client_cookie=19885dff29854633 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:41.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75b77fe700 1 -- 172.21.15.62:0/1328903754 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75ac00d570 con 0x7f75b80b3760 2021-12-17T18:27:41.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75b77fe700 1 -- 172.21.15.62:0/1328903754 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac000e90 con 0x7f75b80b3760 2021-12-17T18:27:41.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.845+0000 7f75b77fe700 1 -- 172.21.15.62:0/1328903754 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75ac00d8c0 con 0x7f75b80b3760 2021-12-17T18:27:41.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.849+0000 7f75bdb15700 1 -- 172.21.15.62:0/1328903754 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75b80b3760 msgr2=0x7f75b80b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:41.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.849+0000 7f75bdb15700 1 --2- 172.21.15.62:0/1328903754 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75b80b3760 0x7f75b80b6780 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f75ac002f70 tx=0x7f75ac006df0).stop 2021-12-17T18:27:41.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.849+0000 7f75bdb15700 1 -- 172.21.15.62:0/1328903754 shutdown_connections 2021-12-17T18:27:41.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.849+0000 7f75bdb15700 1 --2- 172.21.15.62:0/1328903754 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75b80b3760 0x7f75b80b6780 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.849+0000 7f75bdb15700 1 --2- 172.21.15.62:0/1328903754 >> v2:172.21.15.62:3300/0 conn(0x7f75b80b5b20 0x7f75b80b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.849+0000 7f75bdb15700 1 -- 172.21.15.62:0/1328903754 >> 172.21.15.62:0/1328903754 conn(0x7f75b805c750 msgr2=0x7f75b805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:41.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.849+0000 7f75bdb15700 1 -- 172.21.15.62:0/1328903754 shutdown_connections 2021-12-17T18:27:41.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.849+0000 7f75bdb15700 1 -- 172.21.15.62:0/1328903754 wait complete. 2021-12-17T18:27:41.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.849+0000 7f75bdb15700 1 Processor -- start 2021-12-17T18:27:41.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.849+0000 7f75bdb15700 1 -- start start 2021-12-17T18:27:41.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75bdb15700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75b80b5b20 0x7f75b80afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:41.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75bdb15700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75b80b6c70 0x7f75b8143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:41.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75bdb15700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75b8145840 0x7f75b80ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:41.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75bdb15700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80af070 con 0x7f75b80b6c70 2021-12-17T18:27:41.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75bdb15700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80af310 con 0x7f75b8145840 2021-12-17T18:27:41.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75bdb15700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80af5b0 con 0x7f75b80b5b20 2021-12-17T18:27:41.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75b7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75b80b6c70 0x7f75b8143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:41.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75b7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75b80b6c70 0x7f75b8143310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56428/0 (socket says 172.21.15.62:56428) 2021-12-17T18:27:41.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75b7fff700 1 -- 172.21.15.62:0/4070986117 learned_addr learned my addr 172.21.15.62:0/4070986117 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:41.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75bd314700 1 --2- 172.21.15.62:0/4070986117 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75b8145840 0x7f75b80ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:41.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75bcb13700 1 --2- 172.21.15.62:0/4070986117 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75b80b5b20 0x7f75b80afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:41.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75b7fff700 1 -- 172.21.15.62:0/4070986117 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75b80b5b20 msgr2=0x7f75b80afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:41.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75b7fff700 1 --2- 172.21.15.62:0/4070986117 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75b80b5b20 0x7f75b80afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75b7fff700 1 -- 172.21.15.62:0/4070986117 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75b8145840 msgr2=0x7f75b80ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:41.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75b7fff700 1 --2- 172.21.15.62:0/4070986117 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75b8145840 0x7f75b80ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:41.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75b7fff700 1 -- 172.21.15.62:0/4070986117 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac00b180 con 0x7f75b80b6c70 2021-12-17T18:27:41.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75bcb13700 1 --2- 172.21.15.62:0/4070986117 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75b80b5b20 0x7f75b80afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:41.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75b7fff700 1 --2- 172.21.15.62:0/4070986117 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75b80b6c70 0x7f75b8143310 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f75ac002f70 tx=0x7f75ac014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:41.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75b5ffb700 1 -- 172.21.15.62:0/4070986117 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75ac016070 con 0x7f75b80b6c70 2021-12-17T18:27:41.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75b5ffb700 1 -- 172.21.15.62:0/4070986117 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac00d8f0 con 0x7f75b80b6c70 2021-12-17T18:27:41.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75bdb15700 1 -- 172.21.15.62:0/4070986117 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b8152370 con 0x7f75b80b6c70 2021-12-17T18:27:41.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75b5ffb700 1 -- 172.21.15.62:0/4070986117 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75ac013e50 con 0x7f75b80b6c70 2021-12-17T18:27:41.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75bdb15700 1 -- 172.21.15.62:0/4070986117 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b81528a0 con 0x7f75b80b6c70 2021-12-17T18:27:41.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75bdb15700 1 -- 172.21.15.62:0/4070986117 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b80af770 con 0x7f75b80b6c70 2021-12-17T18:27:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.853+0000 7f75b5ffb700 1 -- 172.21.15.62:0/4070986117 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f75ac00f030 con 0x7f75b80b6c70 2021-12-17T18:27:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.857+0000 7f75b5ffb700 1 --2- 172.21.15.62:0/4070986117 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75980535b0 0x7f7598055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.857+0000 7f75b5ffb700 1 -- 172.21.15.62:0/4070986117 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f75ac06c300 con 0x7f75b80b6c70 2021-12-17T18:27:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.857+0000 7f75bcb13700 1 --2- 172.21.15.62:0/4070986117 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75980535b0 0x7f7598055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:41.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.857+0000 7f75bcb13700 1 --2- 172.21.15.62:0/4070986117 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75980535b0 0x7f7598055a70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f75a8008000 tx=0x7f75a8008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:41.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:41.861+0000 7f75b5ffb700 1 -- 172.21.15.62:0/4070986117 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f75ac0436a0 con 0x7f75b80b6c70 2021-12-17T18:27:42.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.029+0000 7f75bdb15700 1 -- 172.21.15.62:0/4070986117 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75b80573d0 con 0x7f75b80b6c70 2021-12-17T18:27:42.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.029+0000 7f75b5ffb700 1 -- 172.21.15.62:0/4070986117 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+1212 (secure 0 0 0) 0x7f75ac023020 con 0x7f75b80b6c70 2021-12-17T18:27:42.035 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:42.035 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":68,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7957,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6833/3542826349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3542826349},{"type":"v1","addr":"172.21.15.62:6833","nonce":3542826349}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64},{"gid":8230,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3359361865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3359361865},{"type":"v1","addr":"172.21.15.109:6835","nonce":3359361865}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":68}],"filesystems":[]} 2021-12-17T18:27:42.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.029+0000 7f75bdb15700 1 -- 172.21.15.62:0/4070986117 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75980535b0 msgr2=0x7f7598055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:42.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.029+0000 7f75bdb15700 1 --2- 172.21.15.62:0/4070986117 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75980535b0 0x7f7598055a70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f75a8008000 tx=0x7f75a8008040).stop 2021-12-17T18:27:42.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.029+0000 7f75bdb15700 1 -- 172.21.15.62:0/4070986117 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75b80b6c70 msgr2=0x7f75b8143310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:42.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.029+0000 7f75bdb15700 1 --2- 172.21.15.62:0/4070986117 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75b80b6c70 0x7f75b8143310 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f75ac002f70 tx=0x7f75ac014000).stop 2021-12-17T18:27:42.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.029+0000 7f75bdb15700 1 -- 172.21.15.62:0/4070986117 shutdown_connections 2021-12-17T18:27:42.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.029+0000 7f75bdb15700 1 --2- 172.21.15.62:0/4070986117 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75980535b0 0x7f7598055a70 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:42.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.029+0000 7f75bdb15700 1 --2- 172.21.15.62:0/4070986117 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75b8145840 0x7f75b80ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:42.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.029+0000 7f75bdb15700 1 --2- 172.21.15.62:0/4070986117 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75b80b6c70 0x7f75b8143310 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:42.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.029+0000 7f75bdb15700 1 --2- 172.21.15.62:0/4070986117 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75b80b5b20 0x7f75b80afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:42.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.029+0000 7f75bdb15700 1 -- 172.21.15.62:0/4070986117 >> 172.21.15.62:0/4070986117 conn(0x7f75b805c750 msgr2=0x7f75b805fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:42.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.033+0000 7f75bdb15700 1 -- 172.21.15.62:0/4070986117 shutdown_connections 2021-12-17T18:27:42.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.033+0000 7f75bdb15700 1 -- 172.21.15.62:0/4070986117 wait complete. 2021-12-17T18:27:42.040 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 68 2021-12-17T18:27:42.047 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:42.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.141+0000 7fb9cc945700 1 Processor -- start 2021-12-17T18:27:42.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.141+0000 7fb9cc945700 1 -- start start 2021-12-17T18:27:42.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9cc945700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fb9c80b3a40 0x7fb9c80b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:42.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9cc945700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c8143090 con 0x7fb9c80628d0 2021-12-17T18:27:42.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9cc945700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c80b3e20 con 0x7fb9c80b2b60 2021-12-17T18:27:42.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9cc945700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c8146550 con 0x7fb9c80b3a40 2021-12-17T18:27:42.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9c759e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb9c80628d0 0x7fb9c80b1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40018/0 (socket says 172.21.15.62:40018) 2021-12-17T18:27:42.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9c759e700 1 -- 172.21.15.62:0/2540680954 learned_addr learned my addr 172.21.15.62:0/2540680954 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:42.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9c6d9d700 1 --2- 172.21.15.62:0/2540680954 >> v2:172.21.15.109:3300/0 conn(0x7fb9c80b3a40 0x7fb9c80b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:42.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9c5d9b700 1 -- 172.21.15.62:0/2540680954 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239161485 0 0) 0x7fb9c8143090 con 0x7fb9c80628d0 2021-12-17T18:27:42.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9c5d9b700 1 -- 172.21.15.62:0/2540680954 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9ac003260 con 0x7fb9c80628d0 2021-12-17T18:27:42.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9c6d9d700 1 -- 172.21.15.62:0/2540680954 >> v1:172.21.15.109:6789/0 conn(0x7fb9c80b2b60 legacy=0x7fb9c8143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:42.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9c6d9d700 1 -- 172.21.15.62:0/2540680954 >> v1:172.21.15.62:6789/0 conn(0x7fb9c80628d0 legacy=0x7fb9c80b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:42.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9c5d9b700 1 -- 172.21.15.62:0/2540680954 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3835916148 0 0) 0x7fb9ac003260 con 0x7fb9c80628d0 2021-12-17T18:27:42.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9c6d9d700 1 -- 172.21.15.62:0/2540680954 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c81432c0 con 0x7fb9c80b3a40 2021-12-17T18:27:42.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9c6d9d700 1 --2- 172.21.15.62:0/2540680954 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9c80b3a40 0x7fb9c80b0ef0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fb9b8002f70 tx=0x7fb9b8006df0).ready entity=mon.1 client_cookie=696b48c1df400275 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:42.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9c5d9b700 1 -- 172.21.15.62:0/2540680954 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9b800d610 con 0x7fb9c80b3a40 2021-12-17T18:27:42.158 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9c5d9b700 1 -- 172.21.15.62:0/2540680954 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b8000e90 con 0x7fb9c80b3a40 2021-12-17T18:27:42.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9c5d9b700 1 -- 172.21.15.62:0/2540680954 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9b800d960 con 0x7fb9c80b3a40 2021-12-17T18:27:42.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9cc945700 1 -- 172.21.15.62:0/2540680954 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9c80b3a40 msgr2=0x7fb9c80b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:42.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9cc945700 1 --2- 172.21.15.62:0/2540680954 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9c80b3a40 0x7fb9c80b0ef0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fb9b8002f70 tx=0x7fb9b8006df0).stop 2021-12-17T18:27:42.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9cc945700 1 -- 172.21.15.62:0/2540680954 shutdown_connections 2021-12-17T18:27:42.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9cc945700 1 --2- 172.21.15.62:0/2540680954 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9c80b3a40 0x7fb9c80b0ef0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:42.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.145+0000 7fb9cc945700 1 -- 172.21.15.62:0/2540680954 >> 172.21.15.62:0/2540680954 conn(0x7fb9c80b7020 msgr2=0x7fb9c80b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:42.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9cc945700 1 -- 172.21.15.62:0/2540680954 shutdown_connections 2021-12-17T18:27:42.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9cc945700 1 -- 172.21.15.62:0/2540680954 wait complete. 2021-12-17T18:27:42.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9cc945700 1 Processor -- start 2021-12-17T18:27:42.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9cc945700 1 -- start start 2021-12-17T18:27:42.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9cc945700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9c80628d0 0x7fb9c812d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:42.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9cc945700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9c80b2b60 0x7fb9c8152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:42.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9cc945700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9c80b3a40 0x7fb9c8130840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:42.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9cc945700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c81525f0 con 0x7fb9c80628d0 2021-12-17T18:27:42.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9cc945700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c8152850 con 0x7fb9c80b3a40 2021-12-17T18:27:42.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9cc945700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c8152af0 con 0x7fb9c80b2b60 2021-12-17T18:27:42.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9c6d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9c80628d0 0x7fb9c812d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:42.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9c6d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9c80628d0 0x7fb9c812d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56440/0 (socket says 172.21.15.62:56440) 2021-12-17T18:27:42.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9c6d9d700 1 -- 172.21.15.62:0/1138801680 learned_addr learned my addr 172.21.15.62:0/1138801680 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:42.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9c759e700 1 --2- 172.21.15.62:0/1138801680 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9c80b3a40 0x7fb9c8130840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:42.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9c659c700 1 --2- 172.21.15.62:0/1138801680 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9c80b2b60 0x7fb9c8152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:42.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9c6d9d700 1 -- 172.21.15.62:0/1138801680 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9c80b2b60 msgr2=0x7fb9c8152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:42.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9c6d9d700 1 --2- 172.21.15.62:0/1138801680 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9c80b2b60 0x7fb9c8152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:42.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9c6d9d700 1 -- 172.21.15.62:0/1138801680 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9c80b3a40 msgr2=0x7fb9c8130840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:42.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9c6d9d700 1 --2- 172.21.15.62:0/1138801680 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9c80b3a40 0x7fb9c8130840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9c6d9d700 1 -- 172.21.15.62:0/1138801680 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b800b180 con 0x7fb9c80628d0 2021-12-17T18:27:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.149+0000 7fb9c659c700 1 --2- 172.21.15.62:0/1138801680 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9c80b2b60 0x7fb9c8152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.153+0000 7fb9c6d9d700 1 --2- 172.21.15.62:0/1138801680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9c80628d0 0x7fb9c812d110 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7fb9b8002f70 tx=0x7fb9b8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.153+0000 7fb9b7fff700 1 -- 172.21.15.62:0/1138801680 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9b8016070 con 0x7fb9c80628d0 2021-12-17T18:27:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.153+0000 7fb9b7fff700 1 -- 172.21.15.62:0/1138801680 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b800de90 con 0x7fb9c80628d0 2021-12-17T18:27:42.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.153+0000 7fb9cc945700 1 -- 172.21.15.62:0/1138801680 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c8152d90 con 0x7fb9c80628d0 2021-12-17T18:27:42.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.153+0000 7fb9b7fff700 1 -- 172.21.15.62:0/1138801680 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9b8013dd0 con 0x7fb9c80628d0 2021-12-17T18:27:42.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.153+0000 7fb9cc945700 1 -- 172.21.15.62:0/1138801680 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c8130f50 con 0x7fb9c80628d0 2021-12-17T18:27:42.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.153+0000 7fb9cc945700 1 -- 172.21.15.62:0/1138801680 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c8143e70 con 0x7fb9c80628d0 2021-12-17T18:27:42.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.153+0000 7fb9b7fff700 1 -- 172.21.15.62:0/1138801680 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb9b8025030 con 0x7fb9c80628d0 2021-12-17T18:27:42.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.153+0000 7fb9b7fff700 1 --2- 172.21.15.62:0/1138801680 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb9a4053610 0x7fb9a4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:42.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.153+0000 7fb9b7fff700 1 -- 172.21.15.62:0/1138801680 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fb9b806c660 con 0x7fb9c80628d0 2021-12-17T18:27:42.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.157+0000 7fb9c659c700 1 --2- 172.21.15.62:0/1138801680 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb9a4053610 0x7fb9a4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:42.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.157+0000 7fb9c659c700 1 --2- 172.21.15.62:0/1138801680 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb9a4053610 0x7fb9a4055ad0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fb9bc00b000 tx=0x7fb9bc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:42.169 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.161+0000 7fb9b7fff700 1 -- 172.21.15.62:0/1138801680 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb9b8043ae0 con 0x7fb9c80628d0 2021-12-17T18:27:42.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.321+0000 7fb9cc945700 1 -- 172.21.15.62:0/1138801680 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9c80573d0 con 0x7fb9c80628d0 2021-12-17T18:27:42.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.325+0000 7fb9b7fff700 1 -- 172.21.15.62:0/1138801680 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+1212 (secure 0 0 0) 0x7fb9b80234d0 con 0x7fb9c80628d0 2021-12-17T18:27:42.329 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:42.329 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":68,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7957,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6833/3542826349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3542826349},{"type":"v1","addr":"172.21.15.62:6833","nonce":3542826349}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64},{"gid":8230,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3359361865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3359361865},{"type":"v1","addr":"172.21.15.109:6835","nonce":3359361865}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":68}],"filesystems":[]} 2021-12-17T18:27:42.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.325+0000 7fb9cc945700 1 -- 172.21.15.62:0/1138801680 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb9a4053610 msgr2=0x7fb9a4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:42.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.325+0000 7fb9cc945700 1 --2- 172.21.15.62:0/1138801680 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb9a4053610 0x7fb9a4055ad0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fb9bc00b000 tx=0x7fb9bc009040).stop 2021-12-17T18:27:42.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.325+0000 7fb9cc945700 1 -- 172.21.15.62:0/1138801680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9c80628d0 msgr2=0x7fb9c812d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:42.331 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.325+0000 7fb9cc945700 1 --2- 172.21.15.62:0/1138801680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9c80628d0 0x7fb9c812d110 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7fb9b8002f70 tx=0x7fb9b8014000).stop 2021-12-17T18:27:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.325+0000 7fb9cc945700 1 -- 172.21.15.62:0/1138801680 shutdown_connections 2021-12-17T18:27:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.325+0000 7fb9cc945700 1 --2- 172.21.15.62:0/1138801680 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb9a4053610 0x7fb9a4055ad0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.325+0000 7fb9cc945700 1 --2- 172.21.15.62:0/1138801680 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb9c80b3a40 0x7fb9c8130840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.325+0000 7fb9cc945700 1 --2- 172.21.15.62:0/1138801680 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb9c80b2b60 0x7fb9c8152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.325+0000 7fb9cc945700 1 --2- 172.21.15.62:0/1138801680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9c80628d0 0x7fb9c812d110 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.325+0000 7fb9cc945700 1 -- 172.21.15.62:0/1138801680 >> 172.21.15.62:0/1138801680 conn(0x7fb9c80b7020 msgr2=0x7fb9c812b160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.325+0000 7fb9cc945700 1 -- 172.21.15.62:0/1138801680 shutdown_connections 2021-12-17T18:27:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.325+0000 7fb9cc945700 1 -- 172.21.15.62:0/1138801680 wait complete. 2021-12-17T18:27:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 68 2021-12-17T18:27:42.342 INFO:tasks.ceph.mds.a:Restarting daemon 2021-12-17T18:27:42.342 INFO:tasks.ceph.mds.a:Stopping old one... 2021-12-17T18:27:42.343 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-12-17T18:27:42.343 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:27:42.343 INFO:tasks.ceph.mds.b:Restarting daemon 2021-12-17T18:27:42.343 INFO:tasks.ceph.mds.b:Stopping old one... 2021-12-17T18:27:42.344 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-12-17T18:27:42.344 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:27:42.356 INFO:tasks.ceph.mds.a:Stopped 2021-12-17T18:27:42.356 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-12-17T18:27:42.359 INFO:tasks.ceph.mds.a:Started 2021-12-17T18:27:42.359 DEBUG:teuthology.parallel:result is None 2021-12-17T18:27:42.361 INFO:tasks.ceph.mds.b:Stopped 2021-12-17T18:27:42.361 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-12-17T18:27:42.363 INFO:tasks.ceph.mds.b:Started 2021-12-17T18:27:42.364 DEBUG:teuthology.parallel:result is None 2021-12-17T18:27:42.364 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-12-17T18:27:42.435 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:27:42.436 INFO:tasks.ceph.mds.b.smithi109.stdout:starting mds.b at 2021-12-17T18:27:42.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163f59e700 1 Processor -- start 2021-12-17T18:27:42.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163f59e700 1 -- start start 2021-12-17T18:27:42.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f164013ef50 0x7f164013f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:42.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163f59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16400b69f0 con 0x7f16400630e0 2021-12-17T18:27:42.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163f59e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16400b1c40 con 0x7f16400b6610 2021-12-17T18:27:42.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1640143800 con 0x7f164013ef50 2021-12-17T18:27:42.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163dd9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f16400630e0 0x7f16400b09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40042/0 (socket says 172.21.15.62:40042) 2021-12-17T18:27:42.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163dd9b700 1 -- 172.21.15.62:0/2548428208 learned_addr learned my addr 172.21.15.62:0/2548428208 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:42.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163ed9d700 1 --2- 172.21.15.62:0/2548428208 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f164013ef50 0x7f164013f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:42.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163d59a700 1 -- 172.21.15.62:0/2548428208 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156432191 0 0) 0x7f16400b69f0 con 0x7f16400630e0 2021-12-17T18:27:42.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163d59a700 1 -- 172.21.15.62:0/2548428208 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1624003260 con 0x7f16400630e0 2021-12-17T18:27:42.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163d59a700 1 -- 172.21.15.62:0/2548428208 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 687190531 0 0) 0x7f1624003260 con 0x7f16400630e0 2021-12-17T18:27:42.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163ed9d700 1 -- 172.21.15.62:0/2548428208 >> v1:172.21.15.109:6789/0 conn(0x7f16400b6610 legacy=0x7f16401430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:42.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163ed9d700 1 -- 172.21.15.62:0/2548428208 >> v1:172.21.15.62:6789/0 conn(0x7f16400630e0 legacy=0x7f16400b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:42.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163ed9d700 1 -- 172.21.15.62:0/2548428208 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16400b0260 con 0x7f164013ef50 2021-12-17T18:27:42.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163ed9d700 1 --2- 172.21.15.62:0/2548428208 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f164013ef50 0x7f164013f3e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f1634001800 tx=0x7f16380091d0).ready entity=mon.2 client_cookie=e0e50417b34eee1d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:42.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163d59a700 1 -- 172.21.15.62:0/2548428208 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1634001660 con 0x7f164013ef50 2021-12-17T18:27:42.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163d59a700 1 -- 172.21.15.62:0/2548428208 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163800b580 con 0x7f164013ef50 2021-12-17T18:27:42.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.465+0000 7f163d59a700 1 -- 172.21.15.62:0/2548428208 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f163800b6f0 con 0x7f164013ef50 2021-12-17T18:27:42.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163f59e700 1 -- 172.21.15.62:0/2548428208 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f164013ef50 msgr2=0x7f164013f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:42.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163f59e700 1 --2- 172.21.15.62:0/2548428208 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f164013ef50 0x7f164013f3e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f1634001800 tx=0x7f16380091d0).stop 2021-12-17T18:27:42.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163f59e700 1 -- 172.21.15.62:0/2548428208 shutdown_connections 2021-12-17T18:27:42.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163f59e700 1 --2- 172.21.15.62:0/2548428208 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f164013ef50 0x7f164013f3e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:42.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163f59e700 1 -- 172.21.15.62:0/2548428208 >> 172.21.15.62:0/2548428208 conn(0x7f164005d1c0 msgr2=0x7f16400b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:42.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163f59e700 1 -- 172.21.15.62:0/2548428208 shutdown_connections 2021-12-17T18:27:42.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163f59e700 1 -- 172.21.15.62:0/2548428208 wait complete. 2021-12-17T18:27:42.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163f59e700 1 Processor -- start 2021-12-17T18:27:42.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163f59e700 1 -- start start 2021-12-17T18:27:42.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16400630e0 0x7f16400a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:42.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163f59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f16400b6610 0x7f16401527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:42.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163f59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f164013ef50 0x7f1640152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:42.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16400a27c0 con 0x7f16400630e0 2021-12-17T18:27:42.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163f59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16401531b0 con 0x7f16400b6610 2021-12-17T18:27:42.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163f59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16400a0b00 con 0x7f164013ef50 2021-12-17T18:27:42.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16400630e0 0x7f16400a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:42.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16400630e0 0x7f16400a16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56466/0 (socket says 172.21.15.62:56466) 2021-12-17T18:27:42.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163e59c700 1 -- 172.21.15.62:0/723500127 learned_addr learned my addr 172.21.15.62:0/723500127 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:42.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163dd9b700 1 --2- 172.21.15.62:0/723500127 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f16400b6610 0x7f16401527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:42.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.469+0000 7f163ed9d700 1 --2- 172.21.15.62:0/723500127 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f164013ef50 0x7f1640152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:42.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.473+0000 7f163e59c700 1 -- 172.21.15.62:0/723500127 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f164013ef50 msgr2=0x7f1640152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:42.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.473+0000 7f163e59c700 1 --2- 172.21.15.62:0/723500127 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f164013ef50 0x7f1640152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:42.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.473+0000 7f163e59c700 1 -- 172.21.15.62:0/723500127 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f16400b6610 msgr2=0x7f16401527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:42.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.473+0000 7f163e59c700 1 --2- 172.21.15.62:0/723500127 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f16400b6610 0x7f16401527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:42.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.473+0000 7f163e59c700 1 -- 172.21.15.62:0/723500127 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1638009470 con 0x7f16400630e0 2021-12-17T18:27:42.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.473+0000 7f163e59c700 1 --2- 172.21.15.62:0/723500127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16400630e0 0x7f16400a16c0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f16400608e0 tx=0x7f1630007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:42.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.473+0000 7f162f7fe700 1 -- 172.21.15.62:0/723500127 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1630012400 con 0x7f16400630e0 2021-12-17T18:27:42.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.473+0000 7f162f7fe700 1 -- 172.21.15.62:0/723500127 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1630012560 con 0x7f16400630e0 2021-12-17T18:27:42.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.473+0000 7f163f59e700 1 -- 172.21.15.62:0/723500127 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16400a29c0 con 0x7f16400630e0 2021-12-17T18:27:42.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.473+0000 7f162f7fe700 1 -- 172.21.15.62:0/723500127 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16300128c0 con 0x7f16400630e0 2021-12-17T18:27:42.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.473+0000 7f163f59e700 1 -- 172.21.15.62:0/723500127 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16400a0580 con 0x7f16400630e0 2021-12-17T18:27:42.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.473+0000 7f162f7fe700 1 -- 172.21.15.62:0/723500127 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1630019030 con 0x7f16400630e0 2021-12-17T18:27:42.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.473+0000 7f163f59e700 1 -- 172.21.15.62:0/723500127 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16400a0c40 con 0x7f16400630e0 2021-12-17T18:27:42.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.473+0000 7f162f7fe700 1 --2- 172.21.15.62:0/723500127 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f161c053580 0x7f161c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:42.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.473+0000 7f162f7fe700 1 -- 172.21.15.62:0/723500127 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f163006aac0 con 0x7f16400630e0 2021-12-17T18:27:42.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.473+0000 7f163dd9b700 1 --2- 172.21.15.62:0/723500127 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f161c053580 0x7f161c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:42.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.477+0000 7f163dd9b700 1 --2- 172.21.15.62:0/723500127 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f161c053580 0x7f161c055a40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f163400d000 tx=0x7f1634000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:42.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.481+0000 7f162f7fe700 1 -- 172.21.15.62:0/723500127 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1630041df0 con 0x7f16400630e0 2021-12-17T18:27:42.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:42.621+0000 7f163f59e700 1 -- 172.21.15.62:0/723500127 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f16400a2b50 con 0x7f16400630e0 2021-12-17T18:27:43.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.477+0000 7f162f7fe700 1 -- 172.21.15.62:0/723500127 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v137) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1630045410 con 0x7f16400630e0 2021-12-17T18:27:43.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.481+0000 7f163f59e700 1 -- 172.21.15.62:0/723500127 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f161c053580 msgr2=0x7f161c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:43.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.481+0000 7f163f59e700 1 --2- 172.21.15.62:0/723500127 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f161c053580 0x7f161c055a40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f163400d000 tx=0x7f1634000bc0).stop 2021-12-17T18:27:43.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.481+0000 7f163f59e700 1 -- 172.21.15.62:0/723500127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16400630e0 msgr2=0x7f16400a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:43.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.481+0000 7f163f59e700 1 --2- 172.21.15.62:0/723500127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16400630e0 0x7f16400a16c0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f16400608e0 tx=0x7f1630007c50).stop 2021-12-17T18:27:43.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.481+0000 7f163f59e700 1 -- 172.21.15.62:0/723500127 shutdown_connections 2021-12-17T18:27:43.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.481+0000 7f163f59e700 1 --2- 172.21.15.62:0/723500127 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f161c053580 0x7f161c055a40 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.481+0000 7f163f59e700 1 --2- 172.21.15.62:0/723500127 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f164013ef50 0x7f1640152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.481+0000 7f163f59e700 1 --2- 172.21.15.62:0/723500127 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f16400b6610 0x7f16401527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.481+0000 7f163f59e700 1 --2- 172.21.15.62:0/723500127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16400630e0 0x7f16400a16c0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.481+0000 7f163f59e700 1 -- 172.21.15.62:0/723500127 >> 172.21.15.62:0/723500127 conn(0x7f164005d1c0 msgr2=0x7f16400acd00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:43.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.481+0000 7f163f59e700 1 -- 172.21.15.62:0/723500127 shutdown_connections 2021-12-17T18:27:43.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.481+0000 7f163f59e700 1 -- 172.21.15.62:0/723500127 wait complete. 2021-12-17T18:27:43.489 INFO:teuthology.orchestra.run.smithi062.stderr: removed all blacklist entries 2021-12-17T18:27:43.500 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-12-17T18:27:43.501 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-12-17T18:27:43.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.601+0000 7fcd0638d700 1 Processor -- start 2021-12-17T18:27:43.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.601+0000 7fcd0638d700 1 -- start start 2021-12-17T18:27:43.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.601+0000 7fcd0638d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fcd000aeaa0 0x7fcd00142500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:43.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.601+0000 7fcd0638d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd000b6280 con 0x7fcd000682c0 2021-12-17T18:27:43.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.601+0000 7fcd0638d700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd00145190 con 0x7fcd000b5ea0 2021-12-17T18:27:43.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.601+0000 7fcd0638d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd000af090 con 0x7fcd000aeaa0 2021-12-17T18:27:43.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.601+0000 7fcd04b8a700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcd000682c0 0x7fcd000abb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40058/0 (socket says 172.21.15.62:40058) 2021-12-17T18:27:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.601+0000 7fcd04b8a700 1 -- 172.21.15.62:0/2719495453 learned_addr learned my addr 172.21.15.62:0/2719495453 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd05b8c700 1 --2- 172.21.15.62:0/2719495453 >> v2:172.21.15.109:3300/0 conn(0x7fcd000aeaa0 0x7fcd00142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 -- 172.21.15.62:0/2719495453 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794923892 0 0) 0x7fcd000b6280 con 0x7fcd000682c0 2021-12-17T18:27:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 -- 172.21.15.62:0/2719495453 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcce8003260 con 0x7fcd000682c0 2021-12-17T18:27:43.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 -- 172.21.15.62:0/2719495453 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3652382040 0 0) 0x7fcce8003260 con 0x7fcd000682c0 2021-12-17T18:27:43.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 -- 172.21.15.62:0/2719495453 >> v2:172.21.15.109:3300/0 conn(0x7fcd000aeaa0 msgr2=0x7fcd00142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:43.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 --2- 172.21.15.62:0/2719495453 >> v2:172.21.15.109:3300/0 conn(0x7fcd000aeaa0 0x7fcd00142500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 -- 172.21.15.62:0/2719495453 >> v1:172.21.15.109:6789/0 conn(0x7fcd000b5ea0 legacy=0x7fcd000b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:43.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 -- 172.21.15.62:0/2719495453 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd00145430 con 0x7fcd000682c0 2021-12-17T18:27:43.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 -- 172.21.15.62:0/2719495453 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fccf0001660 con 0x7fcd000682c0 2021-12-17T18:27:43.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 -- 172.21.15.62:0/2719495453 >> v1:172.21.15.62:6789/0 conn(0x7fcd000682c0 legacy=0x7fcd000abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:43.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 --2- 172.21.15.62:0/2719495453 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcce8003750 0x7fcce8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:43.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 --2- 172.21.15.62:0/2719495453 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcce8004500 0x7fcce8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 --2- 172.21.15.62:0/2719495453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce8004e70 0x7fcce800fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 -- 172.21.15.62:0/2719495453 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8010100 con 0x7fcce8004e70 2021-12-17T18:27:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 -- 172.21.15.62:0/2719495453 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8010270 con 0x7fcce8004500 2021-12-17T18:27:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 -- 172.21.15.62:0/2719495453 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8010430 con 0x7fcce8003750 2021-12-17T18:27:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd05b8c700 1 --2- 172.21.15.62:0/2719495453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce8004e70 0x7fcce800fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd0538b700 1 --2- 172.21.15.62:0/2719495453 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcce8003750 0x7fcce8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd05b8c700 1 -- 172.21.15.62:0/2719495453 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcce8003750 msgr2=0x7fcce8003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd05b8c700 1 --2- 172.21.15.62:0/2719495453 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcce8003750 0x7fcce8003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd05b8c700 1 -- 172.21.15.62:0/2719495453 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcce8004500 msgr2=0x7fcce8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:43.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd05b8c700 1 --2- 172.21.15.62:0/2719495453 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcce8004500 0x7fcce8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-12-17T18:27:43.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd05b8c700 1 -- 172.21.15.62:0/2719495453 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce8003260 con 0x7fcce8004e70 2021-12-17T18:27:43.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd0538b700 1 --2- 172.21.15.62:0/2719495453 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcce8003750 0x7fcce8003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:27:43.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd05b8c700 1 -- 172.21.15.62:0/2719495453 reap_dead start 2021-12-17T18:27:43.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd05b8c700 1 --2- 172.21.15.62:0/2719495453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce8004e70 0x7fcce800fb60 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fccf800c000 tx=0x7fccf80091d0).ready entity=mon.0 client_cookie=6ed89689dfa5dbd6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:43.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 -- 172.21.15.62:0/2719495453 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccf800e7e0 con 0x7fcce8004e70 2021-12-17T18:27:43.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 -- 172.21.15.62:0/2719495453 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf800e940 con 0x7fcce8004e70 2021-12-17T18:27:43.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcceffff700 1 -- 172.21.15.62:0/2719495453 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccf800eca0 con 0x7fcce8004e70 2021-12-17T18:27:43.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd0638d700 1 -- 172.21.15.62:0/2719495453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce8004e70 msgr2=0x7fcce800fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:43.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd0638d700 1 --2- 172.21.15.62:0/2719495453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce8004e70 0x7fcce800fb60 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fccf800c000 tx=0x7fccf80091d0).stop 2021-12-17T18:27:43.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd0638d700 1 -- 172.21.15.62:0/2719495453 shutdown_connections 2021-12-17T18:27:43.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd0638d700 1 --2- 172.21.15.62:0/2719495453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce8004e70 0x7fcce800fb60 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd0638d700 1 -- 172.21.15.62:0/2719495453 >> 172.21.15.62:0/2719495453 conn(0x7fcd0005d220 msgr2=0x7fcd000b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:43.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd0638d700 1 -- 172.21.15.62:0/2719495453 shutdown_connections 2021-12-17T18:27:43.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.605+0000 7fcd0638d700 1 -- 172.21.15.62:0/2719495453 wait complete. 2021-12-17T18:27:43.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0638d700 1 Processor -- start 2021-12-17T18:27:43.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0638d700 1 -- start start 2021-12-17T18:27:43.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0638d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce8004e70 0x7fcd000b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:43.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0638d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcd00066270 0x7fcd00151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:43.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0638d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcd000a0250 0x7fcd000a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:43.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0638d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000a0bc0 con 0x7fcce8004e70 2021-12-17T18:27:43.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0638d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000645d0 con 0x7fcd000a0250 2021-12-17T18:27:43.625 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0638d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd001522a0 con 0x7fcd00066270 2021-12-17T18:27:43.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0538b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce8004e70 0x7fcd000b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:43.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0538b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce8004e70 0x7fcd000b3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56488/0 (socket says 172.21.15.62:56488) 2021-12-17T18:27:43.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0538b700 1 -- 172.21.15.62:0/3561080066 learned_addr learned my addr 172.21.15.62:0/3561080066 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:43.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd04b8a700 1 --2- 172.21.15.62:0/3561080066 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcd00066270 0x7fcd00151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:43.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd05b8c700 1 --2- 172.21.15.62:0/3561080066 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcd000a0250 0x7fcd000a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:43.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0538b700 1 -- 172.21.15.62:0/3561080066 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcd00066270 msgr2=0x7fcd00151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:43.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0538b700 1 --2- 172.21.15.62:0/3561080066 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcd00066270 0x7fcd00151db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0538b700 1 -- 172.21.15.62:0/3561080066 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcd000a0250 msgr2=0x7fcd000a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:43.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0538b700 1 --2- 172.21.15.62:0/3561080066 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcd000a0250 0x7fcd000a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0538b700 1 -- 172.21.15.62:0/3561080066 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd00065390 con 0x7fcce8004e70 2021-12-17T18:27:43.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd05b8c700 1 --2- 172.21.15.62:0/3561080066 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcd000a0250 0x7fcd000a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:43.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0538b700 1 --2- 172.21.15.62:0/3561080066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce8004e70 0x7fcd000b3ee0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7fcd000a0130 tx=0x7fccfc009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:43.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fccee7fc700 1 -- 172.21.15.62:0/3561080066 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccfc013470 con 0x7fcce8004e70 2021-12-17T18:27:43.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fccee7fc700 1 -- 172.21.15.62:0/3561080066 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc0135d0 con 0x7fcce8004e70 2021-12-17T18:27:43.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0638d700 1 -- 172.21.15.62:0/3561080066 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd00065630 con 0x7fcce8004e70 2021-12-17T18:27:43.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fccee7fc700 1 -- 172.21.15.62:0/3561080066 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccfc013930 con 0x7fcce8004e70 2021-12-17T18:27:43.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.609+0000 7fcd0638d700 1 -- 172.21.15.62:0/3561080066 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0009fdb0 con 0x7fcce8004e70 2021-12-17T18:27:43.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.613+0000 7fcd0638d700 1 -- 172.21.15.62:0/3561080066 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0009ff70 con 0x7fcce8004e70 2021-12-17T18:27:43.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.613+0000 7fccee7fc700 1 -- 172.21.15.62:0/3561080066 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fccfc013a90 con 0x7fcce8004e70 2021-12-17T18:27:43.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.613+0000 7fccee7fc700 1 --2- 172.21.15.62:0/3561080066 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcce0053610 0x7fcce0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:43.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.613+0000 7fccee7fc700 1 -- 172.21.15.62:0/3561080066 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fccfc06b1f0 con 0x7fcce8004e70 2021-12-17T18:27:43.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.613+0000 7fcd04b8a700 1 --2- 172.21.15.62:0/3561080066 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcce0053610 0x7fcce0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:43.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.617+0000 7fcd04b8a700 1 --2- 172.21.15.62:0/3561080066 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcce0053610 0x7fcce0055ad0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fccf000d000 tx=0x7fcd00145320).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:43.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.617+0000 7fccee7fc700 1 -- 172.21.15.62:0/3561080066 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fccfc042680 con 0x7fcce8004e70 2021-12-17T18:27:43.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.785+0000 7fcd0638d700 1 -- 172.21.15.62:0/3561080066 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcd000afdf0 con 0x7fcce8004e70 2021-12-17T18:27:43.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.785+0000 7fccee7fc700 1 -- 172.21.15.62:0/3561080066 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v41) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fccfc045ca0 con 0x7fcce8004e70 2021-12-17T18:27:43.792 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:43.792 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:27:43.792 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_dump": [ 2021-12-17T18:27:43.793 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:43.793 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.a", 2021-12-17T18:27:43.793 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhxCS0LBAAtUlkgWYg4l3fQ2au7jMUDg==", 2021-12-17T18:27:43.793 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:43.794 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:27:43.794 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:43.794 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:43.794 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:43.795 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:43.795 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:43.795 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:43.795 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.b", 2021-12-17T18:27:43.796 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhoRJAMxAAP/NmDQRwJjYip2rxJsQlYg==", 2021-12-17T18:27:43.796 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:43.796 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:27:43.796 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:43.797 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:43.797 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:43.797 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:43.797 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:43.797 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:43.798 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.0", 2021-12-17T18:27:43.798 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBA1LxhJXzhKhAAUnxP3G5VuATkQLoDALFjVg==", 2021-12-17T18:27:43.798 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:43.798 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:43.799 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:43.799 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:43.799 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:43.799 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:43.800 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:43.800 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.1", 2021-12-17T18:27:43.800 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBD1LxhregUDhAABrxQ2jQ4BwXvuWh/D9SkbQ==", 2021-12-17T18:27:43.800 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:43.801 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:43.801 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:43.801 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:43.801 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:43.801 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:43.802 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:43.802 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.2", 2021-12-17T18:27:43.802 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBF1LxhOo/SLhAAhQQLW/VKFx1sgm8chnD5tw==", 2021-12-17T18:27:43.802 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:43.803 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:43.803 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:43.803 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:43.803 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:43.804 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:43.804 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:43.804 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.3", 2021-12-17T18:27:43.804 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBI1LxhT2ZQExAA999j8V5bJAJ2PuaQqSkUOw==", 2021-12-17T18:27:43.804 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:43.805 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:43.805 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:43.805 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:43.805 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:43.806 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:43.806 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:43.806 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.4", 2021-12-17T18:27:43.806 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBN1LxhKBDzFhAAKmPF0FXnnfXtweo+6z9nxg==", 2021-12-17T18:27:43.807 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:43.807 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:43.807 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:43.807 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:43.807 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:43.808 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:43.808 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:43.808 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.5", 2021-12-17T18:27:43.808 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBP1LxhtqkAORAAVaFLVNIUMs4Sytk8WRaGNA==", 2021-12-17T18:27:43.809 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:43.809 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:43.809 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:43.809 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:43.810 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:43.810 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:43.810 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:43.810 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.6", 2021-12-17T18:27:43.811 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBS1LxhNtncGhAAgG64g1ie54CDp9Y7uldKQA==", 2021-12-17T18:27:43.811 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:43.811 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:43.811 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:43.811 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:43.812 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:43.812 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:43.812 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:43.812 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.7", 2021-12-17T18:27:43.813 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBV1Lxh3DcDABAAHVskSVtoEJ8BxCCAs3ZDVA==", 2021-12-17T18:27:43.813 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:43.813 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:43.813 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:43.814 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:43.814 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:43.814 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:43.814 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:43.814 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.0", 2021-12-17T18:27:43.815 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxh9QhCNxAALkWTJorDpbt9yrikL7/NWg==", 2021-12-17T18:27:43.815 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:43.815 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:27:43.815 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:27:43.816 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:27:43.816 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:43.816 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:43.816 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:43.817 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.1", 2021-12-17T18:27:43.817 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxhxm52OxAAbqXVaqRDmt4Ezj9xyCEODQ==", 2021-12-17T18:27:43.817 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:43.817 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:27:43.817 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:27:43.819 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:27:43.819 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:43.819 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:43.819 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:43.820 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.2", 2021-12-17T18:27:43.820 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+1LxhXu08BBAATRcUAZvMNg9ou4PLszDtmA==", 2021-12-17T18:27:43.820 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:43.820 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:27:43.821 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:27:43.821 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:27:43.821 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:43.821 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:43.822 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:43.822 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.admin", 2021-12-17T18:27:43.822 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhyAGlDRAA2ggSG5yBBFbMgK2fCBk2mQ==", 2021-12-17T18:27:43.822 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:43.823 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:27:43.823 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:27:43.823 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:27:43.823 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:43.824 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:43.824 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:43.824 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:43.824 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.x", 2021-12-17T18:27:43.825 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhzvntKRAAFQlg69Z6d2nWX0GxSshsMw==", 2021-12-17T18:27:43.825 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:43.825 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:27:43.826 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:27:43.826 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:43.826 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:43.826 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:43.827 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:43.827 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.y", 2021-12-17T18:27:43.827 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhKdTGJRAArzUN3A1U5Efw0NG9Gw2Gcw==", 2021-12-17T18:27:43.827 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:27:43.828 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:27:43.828 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:27:43.828 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:27:43.828 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:43.828 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:43.829 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:43.829 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:27:43.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.789+0000 7fcd0638d700 1 -- 172.21.15.62:0/3561080066 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcce0053610 msgr2=0x7fcce0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:43.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.789+0000 7fcd0638d700 1 --2- 172.21.15.62:0/3561080066 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcce0053610 0x7fcce0055ad0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fccf000d000 tx=0x7fcd00145320).stop 2021-12-17T18:27:43.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.789+0000 7fcd0638d700 1 -- 172.21.15.62:0/3561080066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce8004e70 msgr2=0x7fcd000b3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:43.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.789+0000 7fcd0638d700 1 --2- 172.21.15.62:0/3561080066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce8004e70 0x7fcd000b3ee0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7fcd000a0130 tx=0x7fccfc009040).stop 2021-12-17T18:27:43.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.789+0000 7fcd0638d700 1 -- 172.21.15.62:0/3561080066 shutdown_connections 2021-12-17T18:27:43.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.789+0000 7fcd0638d700 1 --2- 172.21.15.62:0/3561080066 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcce0053610 0x7fcce0055ad0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.789+0000 7fcd0638d700 1 --2- 172.21.15.62:0/3561080066 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcd000a0250 0x7fcd000a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.789+0000 7fcd0638d700 1 --2- 172.21.15.62:0/3561080066 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcd00066270 0x7fcd00151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.789+0000 7fcd0638d700 1 --2- 172.21.15.62:0/3561080066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcce8004e70 0x7fcd000b3ee0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.789+0000 7fcd0638d700 1 -- 172.21.15.62:0/3561080066 >> 172.21.15.62:0/3561080066 conn(0x7fcd0005d220 msgr2=0x7fcd00140fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:43.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.789+0000 7fcd0638d700 1 -- 172.21.15.62:0/3561080066 shutdown_connections 2021-12-17T18:27:43.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.789+0000 7fcd0638d700 1 -- 172.21.15.62:0/3561080066 wait complete. 2021-12-17T18:27:43.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:27:43.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64ffff700 1 Processor -- start 2021-12-17T18:27:43.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64ffff700 1 -- start start 2021-12-17T18:27:43.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64ffff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fb650141480 0x7fb650147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:43.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6500a8e10 0x7fb6500b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:43.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64ffff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb650147610 con 0x7fb6500b6050 2021-12-17T18:27:43.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64ffff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6501478b0 con 0x7fb650141480 2021-12-17T18:27:43.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64ffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb650147b50 con 0x7fb6500a8e10 2021-12-17T18:27:43.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64effd700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fb650141480 0x7fb650147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:43.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64e7fc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6500a8e10 0x7fb6500b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:43.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64effd700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fb650141480 0x7fb650147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:34814/0 (socket says 172.21.15.62:34814) 2021-12-17T18:27:43.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64effd700 1 -- 172.21.15.62:0/3804670435 learned_addr learned my addr 172.21.15.62:0/3804670435 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:43.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64effd700 1 -- 172.21.15.62:0/3804670435 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6500a8e10 msgr2=0x7fb6500b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:43.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64effd700 1 --2- 172.21.15.62:0/3804670435 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6500a8e10 0x7fb6500b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64effd700 1 -- 172.21.15.62:0/3804670435 >> v1:172.21.15.109:6789/0 conn(0x7fb6500b6050 legacy=0x7fb6500a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:43.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64effd700 1 -- 172.21.15.62:0/3804670435 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6500b1b90 con 0x7fb650141480 2021-12-17T18:27:43.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64effd700 1 --2- 172.21.15.62:0/3804670435 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb650141480 0x7fb650147ff0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fb6480032f0 tx=0x7fb648009290).ready entity=mon.1 client_cookie=c729ad4665ba86a9 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:43.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64dffb700 1 -- 172.21.15.62:0/3804670435 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb64800b8a0 con 0x7fb650141480 2021-12-17T18:27:43.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64dffb700 1 -- 172.21.15.62:0/3804670435 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64800ba00 con 0x7fb650141480 2021-12-17T18:27:43.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.937+0000 7fb64dffb700 1 -- 172.21.15.62:0/3804670435 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb64800bb70 con 0x7fb650141480 2021-12-17T18:27:43.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.941+0000 7fb64ffff700 1 -- 172.21.15.62:0/3804670435 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb650141480 msgr2=0x7fb650147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:43.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.941+0000 7fb64ffff700 1 --2- 172.21.15.62:0/3804670435 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb650141480 0x7fb650147ff0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fb6480032f0 tx=0x7fb648009290).stop 2021-12-17T18:27:43.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.941+0000 7fb64ffff700 1 -- 172.21.15.62:0/3804670435 shutdown_connections 2021-12-17T18:27:43.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.941+0000 7fb64ffff700 1 --2- 172.21.15.62:0/3804670435 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6500a8e10 0x7fb6500b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.941+0000 7fb64ffff700 1 --2- 172.21.15.62:0/3804670435 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb650141480 0x7fb650147ff0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.941+0000 7fb64ffff700 1 -- 172.21.15.62:0/3804670435 >> 172.21.15.62:0/3804670435 conn(0x7fb65005d220 msgr2=0x7fb6500b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:43.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.941+0000 7fb64ffff700 1 -- 172.21.15.62:0/3804670435 shutdown_connections 2021-12-17T18:27:43.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.941+0000 7fb64ffff700 1 -- 172.21.15.62:0/3804670435 wait complete. 2021-12-17T18:27:43.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.941+0000 7fb64ffff700 1 Processor -- start 2021-12-17T18:27:43.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.941+0000 7fb64ffff700 1 -- start start 2021-12-17T18:27:43.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6500a8e10 0x7fb6500ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:43.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6500b6050 0x7fb65015a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:43.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64ffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb650141480 0x7fb65015a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:43.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb650149410 con 0x7fb6500b6050 2021-12-17T18:27:43.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64ffff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb650156f40 con 0x7fb650141480 2021-12-17T18:27:43.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64ffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb650143b80 con 0x7fb6500a8e10 2021-12-17T18:27:43.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64effd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6500a8e10 0x7fb6500ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:43.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6500b6050 0x7fb65015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:43.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6500b6050 0x7fb65015a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56504/0 (socket says 172.21.15.62:56504) 2021-12-17T18:27:43.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64effd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6500a8e10 0x7fb6500ade90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:50204/0 (socket says 172.21.15.62:50204) 2021-12-17T18:27:43.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64e7fc700 1 -- 172.21.15.62:0/752607748 learned_addr learned my addr 172.21.15.62:0/752607748 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:43.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64f7fe700 1 --2- 172.21.15.62:0/752607748 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb650141480 0x7fb65015a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:43.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64e7fc700 1 -- 172.21.15.62:0/752607748 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6500a8e10 msgr2=0x7fb6500ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:43.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64e7fc700 1 --2- 172.21.15.62:0/752607748 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6500a8e10 0x7fb6500ade90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64e7fc700 1 -- 172.21.15.62:0/752607748 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb650141480 msgr2=0x7fb65015a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:43.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64e7fc700 1 --2- 172.21.15.62:0/752607748 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb650141480 0x7fb65015a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:43.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64e7fc700 1 -- 172.21.15.62:0/752607748 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb648009530 con 0x7fb6500b6050 2021-12-17T18:27:43.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64effd700 1 --2- 172.21.15.62:0/752607748 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6500a8e10 0x7fb6500ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:43.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64e7fc700 1 --2- 172.21.15.62:0/752607748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6500b6050 0x7fb65015a490 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7fb63800c000 tx=0x7fb638006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:43.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb647fff700 1 -- 172.21.15.62:0/752607748 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb638010780 con 0x7fb6500b6050 2021-12-17T18:27:43.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb647fff700 1 -- 172.21.15.62:0/752607748 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6380108e0 con 0x7fb6500b6050 2021-12-17T18:27:43.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64ffff700 1 -- 172.21.15.62:0/752607748 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb650143e20 con 0x7fb6500b6050 2021-12-17T18:27:43.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb647fff700 1 -- 172.21.15.62:0/752607748 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb638010c40 con 0x7fb6500b6050 2021-12-17T18:27:43.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.945+0000 7fb64ffff700 1 -- 172.21.15.62:0/752607748 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb650143800 con 0x7fb6500b6050 2021-12-17T18:27:43.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.949+0000 7fb64ffff700 1 -- 172.21.15.62:0/752607748 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65014b860 con 0x7fb6500b6050 2021-12-17T18:27:43.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.949+0000 7fb647fff700 1 -- 172.21.15.62:0/752607748 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb63801c460 con 0x7fb6500b6050 2021-12-17T18:27:43.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.949+0000 7fb647fff700 1 --2- 172.21.15.62:0/752607748 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb634053610 0x7fb634055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:43.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.949+0000 7fb647fff700 1 -- 172.21.15.62:0/752607748 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb63806ba40 con 0x7fb6500b6050 2021-12-17T18:27:43.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.949+0000 7fb64effd700 1 --2- 172.21.15.62:0/752607748 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb634053610 0x7fb634055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:43.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.949+0000 7fb64effd700 1 --2- 172.21.15.62:0/752607748 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb634053610 0x7fb634055ad0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fb64801b000 tx=0x7fb648016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:43.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:43.953+0000 7fb647fff700 1 -- 172.21.15.62:0/752607748 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb65014b860 con 0x7fb6500b6050 2021-12-17T18:27:44.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.081+0000 7fb64ffff700 1 -- 172.21.15.62:0/752607748 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb65014b860 con 0x7fb6500b6050 2021-12-17T18:27:44.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.085+0000 7fb647fff700 1 -- 172.21.15.62:0/752607748 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+13239 (secure 0 0 0) 0x7fb65014b860 con 0x7fb6500b6050 2021-12-17T18:27:44.089 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:44.089 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":137,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:27:43.470535+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:27:44.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.085+0000 7fb64ffff700 1 -- 172.21.15.62:0/752607748 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb634053610 msgr2=0x7fb634055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.085+0000 7fb64ffff700 1 --2- 172.21.15.62:0/752607748 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb634053610 0x7fb634055ad0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fb64801b000 tx=0x7fb648016000).stop 2021-12-17T18:27:44.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.085+0000 7fb64ffff700 1 -- 172.21.15.62:0/752607748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6500b6050 msgr2=0x7fb65015a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.085+0000 7fb64ffff700 1 --2- 172.21.15.62:0/752607748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6500b6050 0x7fb65015a490 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7fb63800c000 tx=0x7fb638006df0).stop 2021-12-17T18:27:44.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.085+0000 7fb64ffff700 1 -- 172.21.15.62:0/752607748 shutdown_connections 2021-12-17T18:27:44.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.085+0000 7fb64ffff700 1 --2- 172.21.15.62:0/752607748 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb634053610 0x7fb634055ad0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.085+0000 7fb64ffff700 1 --2- 172.21.15.62:0/752607748 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb650141480 0x7fb65015a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.085+0000 7fb64ffff700 1 --2- 172.21.15.62:0/752607748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6500b6050 0x7fb65015a490 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.085+0000 7fb64ffff700 1 --2- 172.21.15.62:0/752607748 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6500a8e10 0x7fb6500ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.085+0000 7fb64ffff700 1 -- 172.21.15.62:0/752607748 >> 172.21.15.62:0/752607748 conn(0x7fb65005d220 msgr2=0x7fb65005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:44.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.085+0000 7fb64ffff700 1 -- 172.21.15.62:0/752607748 shutdown_connections 2021-12-17T18:27:44.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.085+0000 7fb64ffff700 1 -- 172.21.15.62:0/752607748 wait complete. 2021-12-17T18:27:44.106 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-12-17T18:27:44.107 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:27:44.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.205+0000 7f01ba0ef700 1 Processor -- start 2021-12-17T18:27:44.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.205+0000 7f01ba0ef700 1 -- start start 2021-12-17T18:27:44.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.205+0000 7f01ba0ef700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f01b40b05b0 0x7f01b4146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.205+0000 7f01ba0ef700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f01b40b5dd0 0x7f01b4146b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.205+0000 7f01ba0ef700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f01b4147070 0x7f01b405f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.205+0000 7f01ba0ef700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b40b2010 con 0x7f01b4147070 2021-12-17T18:27:44.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.205+0000 7f01ba0ef700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b40b0990 con 0x7f01b40b05b0 2021-12-17T18:27:44.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.205+0000 7f01ba0ef700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b40b2240 con 0x7f01b40b5dd0 2021-12-17T18:27:44.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.205+0000 7f01b3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f01b4147070 0x7f01b405f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.205+0000 7f01b3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f01b4147070 0x7f01b405f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56514/0 (socket says 172.21.15.62:56514) 2021-12-17T18:27:44.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.205+0000 7f01b3fff700 1 -- 172.21.15.62:0/3676288507 learned_addr learned my addr 172.21.15.62:0/3676288507 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:44.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.205+0000 7f01b2ffd700 1 --2- 172.21.15.62:0/3676288507 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f01b40b5dd0 0x7f01b4146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.205+0000 7f01b37fe700 1 --2- 172.21.15.62:0/3676288507 >> v2:172.21.15.109:3300/0 conn(0x7f01b40b05b0 0x7f01b4146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01b3fff700 1 -- 172.21.15.62:0/3676288507 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f01b40b5dd0 msgr2=0x7f01b4146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:44.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01b3fff700 1 --2- 172.21.15.62:0/3676288507 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f01b40b5dd0 0x7f01b4146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01b3fff700 1 -- 172.21.15.62:0/3676288507 >> v2:172.21.15.109:3300/0 conn(0x7f01b40b05b0 msgr2=0x7f01b4146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:44.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01b3fff700 1 --2- 172.21.15.62:0/3676288507 >> v2:172.21.15.109:3300/0 conn(0x7f01b40b05b0 0x7f01b4146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01b3fff700 1 -- 172.21.15.62:0/3676288507 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b40b24e0 con 0x7f01b4147070 2021-12-17T18:27:44.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01b2ffd700 1 --2- 172.21.15.62:0/3676288507 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f01b40b5dd0 0x7f01b4146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:44.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01b37fe700 1 --2- 172.21.15.62:0/3676288507 >> v2:172.21.15.109:3300/0 conn(0x7f01b40b05b0 0x7f01b4146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:44.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01b3fff700 1 --2- 172.21.15.62:0/3676288507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01b4147070 0x7f01b405f730 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f01ac0032f0 tx=0x7f01ac009290).ready entity=mon.0 client_cookie=51a26c8db681657 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:44.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01b27fc700 1 -- 172.21.15.62:0/3676288507 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01ac00b870 con 0x7f01b4147070 2021-12-17T18:27:44.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01b27fc700 1 -- 172.21.15.62:0/3676288507 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ac00b9d0 con 0x7f01b4147070 2021-12-17T18:27:44.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01b27fc700 1 -- 172.21.15.62:0/3676288507 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01ac00bb40 con 0x7f01b4147070 2021-12-17T18:27:44.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01ba0ef700 1 -- 172.21.15.62:0/3676288507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01b4147070 msgr2=0x7f01b405f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01ba0ef700 1 --2- 172.21.15.62:0/3676288507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01b4147070 0x7f01b405f730 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f01ac0032f0 tx=0x7f01ac009290).stop 2021-12-17T18:27:44.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01ba0ef700 1 -- 172.21.15.62:0/3676288507 shutdown_connections 2021-12-17T18:27:44.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01ba0ef700 1 --2- 172.21.15.62:0/3676288507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01b4147070 0x7f01b405f730 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01ba0ef700 1 --2- 172.21.15.62:0/3676288507 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f01b40b5dd0 0x7f01b4146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01ba0ef700 1 --2- 172.21.15.62:0/3676288507 >> v2:172.21.15.109:3300/0 conn(0x7f01b40b05b0 0x7f01b4146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01ba0ef700 1 -- 172.21.15.62:0/3676288507 >> 172.21.15.62:0/3676288507 conn(0x7f01b4062510 msgr2=0x7f01b40628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:44.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01ba0ef700 1 -- 172.21.15.62:0/3676288507 shutdown_connections 2021-12-17T18:27:44.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.209+0000 7f01ba0ef700 1 -- 172.21.15.62:0/3676288507 wait complete. 2021-12-17T18:27:44.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01ba0ef700 1 Processor -- start 2021-12-17T18:27:44.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01ba0ef700 1 -- start start 2021-12-17T18:27:44.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01ba0ef700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f01b40b05b0 0x7f01b40a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01ba0ef700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01b40b5dd0 0x7f01b41517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01ba0ef700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f01b4066b00 0x7f01b4151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01ba0ef700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b40a4ca0 con 0x7f01b40b5dd0 2021-12-17T18:27:44.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01ba0ef700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b41533b0 con 0x7f01b4066b00 2021-12-17T18:27:44.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01ba0ef700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b40a6820 con 0x7f01b40b05b0 2021-12-17T18:27:44.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01b2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01b40b5dd0 0x7f01b41517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01b2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01b40b5dd0 0x7f01b41517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56518/0 (socket says 172.21.15.62:56518) 2021-12-17T18:27:44.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01b2ffd700 1 -- 172.21.15.62:0/2700631305 learned_addr learned my addr 172.21.15.62:0/2700631305 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:44.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01b37fe700 1 --2- 172.21.15.62:0/2700631305 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f01b40b05b0 0x7f01b40a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01b3fff700 1 --2- 172.21.15.62:0/2700631305 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f01b4066b00 0x7f01b4151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01b2ffd700 1 -- 172.21.15.62:0/2700631305 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f01b40b05b0 msgr2=0x7f01b40a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01b2ffd700 1 --2- 172.21.15.62:0/2700631305 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f01b40b05b0 0x7f01b40a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01b2ffd700 1 -- 172.21.15.62:0/2700631305 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f01b4066b00 msgr2=0x7f01b4151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01b2ffd700 1 --2- 172.21.15.62:0/2700631305 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f01b4066b00 0x7f01b4151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01b2ffd700 1 -- 172.21.15.62:0/2700631305 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac009530 con 0x7f01b40b5dd0 2021-12-17T18:27:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01b3fff700 1 --2- 172.21.15.62:0/2700631305 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f01b4066b00 0x7f01b4151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01b37fe700 1 --2- 172.21.15.62:0/2700631305 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f01b40b05b0 0x7f01b40a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01b2ffd700 1 --2- 172.21.15.62:0/2700631305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01b40b5dd0 0x7f01b41517f0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f01b4152e30 tx=0x7f019c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01b0ff9700 1 -- 172.21.15.62:0/2700631305 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f019c011850 con 0x7f01b40b5dd0 2021-12-17T18:27:44.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01b0ff9700 1 -- 172.21.15.62:0/2700631305 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c0119b0 con 0x7f01b40b5dd0 2021-12-17T18:27:44.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01ba0ef700 1 -- 172.21.15.62:0/2700631305 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b4065e80 con 0x7f01b40b5dd0 2021-12-17T18:27:44.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01b0ff9700 1 -- 172.21.15.62:0/2700631305 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f019c011d10 con 0x7f01b40b5dd0 2021-12-17T18:27:44.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.213+0000 7f01ba0ef700 1 -- 172.21.15.62:0/2700631305 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b41521d0 con 0x7f01b40b5dd0 2021-12-17T18:27:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.217+0000 7f01ba0ef700 1 -- 172.21.15.62:0/2700631305 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b40a63c0 con 0x7f01b40b5dd0 2021-12-17T18:27:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.217+0000 7f01b0ff9700 1 -- 172.21.15.62:0/2700631305 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f019c01c460 con 0x7f01b40b5dd0 2021-12-17T18:27:44.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.217+0000 7f01b0ff9700 1 --2- 172.21.15.62:0/2700631305 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0198053640 0x7f0198055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.217+0000 7f01b0ff9700 1 -- 172.21.15.62:0/2700631305 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f019c06bc00 con 0x7f01b40b5dd0 2021-12-17T18:27:44.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.217+0000 7f01b37fe700 1 --2- 172.21.15.62:0/2700631305 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0198053640 0x7f0198055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.217+0000 7f01b37fe700 1 --2- 172.21.15.62:0/2700631305 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0198053640 0x7f0198055b00 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f01a400c000 tx=0x7f01a4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:44.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.221+0000 7f01b0ff9700 1 -- 172.21.15.62:0/2700631305 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f019c042f20 con 0x7f01b40b5dd0 2021-12-17T18:27:44.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.349+0000 7f01ba0ef700 1 -- 172.21.15.62:0/2700631305 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f01b40b2780 con 0x7f01b40b5dd0 2021-12-17T18:27:44.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.349+0000 7f01b0ff9700 1 -- 172.21.15.62:0/2700631305 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v137) v1 ==== 110+0+10 (secure 0 0 0) 0x7f019c046540 con 0x7f01b40b5dd0 2021-12-17T18:27:44.356 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:27:44.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.353+0000 7f01ba0ef700 1 -- 172.21.15.62:0/2700631305 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0198053640 msgr2=0x7f0198055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.353+0000 7f01ba0ef700 1 --2- 172.21.15.62:0/2700631305 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0198053640 0x7f0198055b00 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f01a400c000 tx=0x7f01a4008040).stop 2021-12-17T18:27:44.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.353+0000 7f01ba0ef700 1 -- 172.21.15.62:0/2700631305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01b40b5dd0 msgr2=0x7f01b41517f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.353+0000 7f01ba0ef700 1 --2- 172.21.15.62:0/2700631305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01b40b5dd0 0x7f01b41517f0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f01b4152e30 tx=0x7f019c008040).stop 2021-12-17T18:27:44.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.353+0000 7f01ba0ef700 1 -- 172.21.15.62:0/2700631305 shutdown_connections 2021-12-17T18:27:44.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.353+0000 7f01ba0ef700 1 --2- 172.21.15.62:0/2700631305 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0198053640 0x7f0198055b00 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.353+0000 7f01ba0ef700 1 --2- 172.21.15.62:0/2700631305 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f01b4066b00 0x7f01b4151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.353+0000 7f01ba0ef700 1 --2- 172.21.15.62:0/2700631305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01b40b5dd0 0x7f01b41517f0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.360 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.353+0000 7f01ba0ef700 1 --2- 172.21.15.62:0/2700631305 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f01b40b05b0 0x7f01b40a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.353+0000 7f01ba0ef700 1 -- 172.21.15.62:0/2700631305 >> 172.21.15.62:0/2700631305 conn(0x7f01b4062510 msgr2=0x7f01b41465a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:44.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.353+0000 7f01ba0ef700 1 -- 172.21.15.62:0/2700631305 shutdown_connections 2021-12-17T18:27:44.361 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.353+0000 7f01ba0ef700 1 -- 172.21.15.62:0/2700631305 wait complete. 2021-12-17T18:27:44.369 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:27:44.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.477+0000 7f5c63fff700 1 Processor -- start 2021-12-17T18:27:44.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.477+0000 7f5c63fff700 1 -- start start 2021-12-17T18:27:44.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.477+0000 7f5c63fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c640ad430 0x7f5c64146740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.477+0000 7f5c63fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5c64146c30 0x7f5c641425e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.477+0000 7f5c63fff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c64060340 con 0x7f5c6405ca90 2021-12-17T18:27:44.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.477+0000 7f5c63fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c640adca0 con 0x7f5c64146c30 2021-12-17T18:27:44.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.477+0000 7f5c63fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6405ce70 con 0x7f5c640ad430 2021-12-17T18:27:44.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.477+0000 7f5c637fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5c64146c30 0x7f5c641425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.477+0000 7f5c637fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5c64146c30 0x7f5c641425e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56528/0 (socket says 172.21.15.62:56528) 2021-12-17T18:27:44.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.477+0000 7f5c637fe700 1 -- 172.21.15.62:0/2184196844 learned_addr learned my addr 172.21.15.62:0/2184196844 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:44.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.477+0000 7f5c5bfff700 1 --2- 172.21.15.62:0/2184196844 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c640ad430 0x7f5c64146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.481+0000 7f5c637fe700 1 -- 172.21.15.62:0/2184196844 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c640ad430 msgr2=0x7f5c64146740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:44.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.481+0000 7f5c637fe700 1 --2- 172.21.15.62:0/2184196844 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c640ad430 0x7f5c64146740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.481+0000 7f5c637fe700 1 -- 172.21.15.62:0/2184196844 >> v1:172.21.15.109:6789/0 conn(0x7f5c6405ca90 legacy=0x7f5c640b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.481+0000 7f5c637fe700 1 -- 172.21.15.62:0/2184196844 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c64060570 con 0x7f5c64146c30 2021-12-17T18:27:44.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.481+0000 7f5c637fe700 1 --2- 172.21.15.62:0/2184196844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c64146c30 0x7f5c641425e0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f5c640665d0 tx=0x7f5c5c009290).ready entity=mon.0 client_cookie=443cf3d36a64c095 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:44.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.481+0000 7f5c627fc700 1 -- 172.21.15.62:0/2184196844 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c5c00b860 con 0x7f5c64146c30 2021-12-17T18:27:44.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.481+0000 7f5c627fc700 1 -- 172.21.15.62:0/2184196844 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5c00b9c0 con 0x7f5c64146c30 2021-12-17T18:27:44.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.481+0000 7f5c627fc700 1 -- 172.21.15.62:0/2184196844 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c5c00bb30 con 0x7f5c64146c30 2021-12-17T18:27:44.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.481+0000 7f5c63fff700 1 -- 172.21.15.62:0/2184196844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c64146c30 msgr2=0x7f5c641425e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.481+0000 7f5c63fff700 1 --2- 172.21.15.62:0/2184196844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c64146c30 0x7f5c641425e0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f5c640665d0 tx=0x7f5c5c009290).stop 2021-12-17T18:27:44.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.481+0000 7f5c63fff700 1 -- 172.21.15.62:0/2184196844 shutdown_connections 2021-12-17T18:27:44.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.481+0000 7f5c63fff700 1 --2- 172.21.15.62:0/2184196844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c64146c30 0x7f5c641425e0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.481+0000 7f5c63fff700 1 --2- 172.21.15.62:0/2184196844 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c640ad430 0x7f5c64146740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.481+0000 7f5c63fff700 1 -- 172.21.15.62:0/2184196844 >> 172.21.15.62:0/2184196844 conn(0x7f5c6405be70 msgr2=0x7f5c64062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:44.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.481+0000 7f5c63fff700 1 -- 172.21.15.62:0/2184196844 shutdown_connections 2021-12-17T18:27:44.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.481+0000 7f5c63fff700 1 -- 172.21.15.62:0/2184196844 wait complete. 2021-12-17T18:27:44.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c63fff700 1 Processor -- start 2021-12-17T18:27:44.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c63fff700 1 -- start start 2021-12-17T18:27:44.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c63fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c6405ca90 0x7f5c641532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c63fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c640ad430 0x7f5c640b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c63fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c64146c30 0x7f5c640af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c63fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c640b06e0 con 0x7f5c6405ca90 2021-12-17T18:27:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c63fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c640b1320 con 0x7f5c640ad430 2021-12-17T18:27:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c62ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c6405ca90 0x7f5c641532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c63fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c640b14e0 con 0x7f5c64146c30 2021-12-17T18:27:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c62ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c6405ca90 0x7f5c641532c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56530/0 (socket says 172.21.15.62:56530) 2021-12-17T18:27:44.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c62ffd700 1 -- 172.21.15.62:0/1104585690 learned_addr learned my addr 172.21.15.62:0/1104585690 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:44.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c637fe700 1 --2- 172.21.15.62:0/1104585690 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c64146c30 0x7f5c640af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c5bfff700 1 --2- 172.21.15.62:0/1104585690 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c640ad430 0x7f5c640b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c62ffd700 1 -- 172.21.15.62:0/1104585690 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c64146c30 msgr2=0x7f5c640af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c62ffd700 1 --2- 172.21.15.62:0/1104585690 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c64146c30 0x7f5c640af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c62ffd700 1 -- 172.21.15.62:0/1104585690 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c640ad430 msgr2=0x7f5c640b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c62ffd700 1 --2- 172.21.15.62:0/1104585690 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c640ad430 0x7f5c640b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c62ffd700 1 -- 172.21.15.62:0/1104585690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c009530 con 0x7f5c6405ca90 2021-12-17T18:27:44.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c5bfff700 1 --2- 172.21.15.62:0/1104585690 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c640ad430 0x7f5c640b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:44.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c62ffd700 1 --2- 172.21.15.62:0/1104585690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c6405ca90 0x7f5c641532c0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f5c6405d430 tx=0x7f5c54007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:44.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c60ff9700 1 -- 172.21.15.62:0/1104585690 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c5400ce30 con 0x7f5c6405ca90 2021-12-17T18:27:44.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c60ff9700 1 -- 172.21.15.62:0/1104585690 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c54007020 con 0x7f5c6405ca90 2021-12-17T18:27:44.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c63fff700 1 -- 172.21.15.62:0/1104585690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c640af940 con 0x7f5c6405ca90 2021-12-17T18:27:44.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c60ff9700 1 -- 172.21.15.62:0/1104585690 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c54007380 con 0x7f5c6405ca90 2021-12-17T18:27:44.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.485+0000 7f5c63fff700 1 -- 172.21.15.62:0/1104585690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c64063300 con 0x7f5c6405ca90 2021-12-17T18:27:44.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.489+0000 7f5c63fff700 1 -- 172.21.15.62:0/1104585690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c640b08e0 con 0x7f5c6405ca90 2021-12-17T18:27:44.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.489+0000 7f5c60ff9700 1 -- 172.21.15.62:0/1104585690 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5c54010070 con 0x7f5c6405ca90 2021-12-17T18:27:44.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.489+0000 7f5c60ff9700 1 --2- 172.21.15.62:0/1104585690 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c48053610 0x7f5c48055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.489+0000 7f5c60ff9700 1 -- 172.21.15.62:0/1104585690 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5c5406a940 con 0x7f5c6405ca90 2021-12-17T18:27:44.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.489+0000 7f5c5bfff700 1 --2- 172.21.15.62:0/1104585690 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c48053610 0x7f5c48055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.489+0000 7f5c5bfff700 1 --2- 172.21.15.62:0/1104585690 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c48053610 0x7f5c48055ad0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f5c4c00c000 tx=0x7f5c4c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:44.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.497+0000 7f5c60ff9700 1 -- 172.21.15.62:0/1104585690 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5c54041dd0 con 0x7f5c6405ca90 2021-12-17T18:27:44.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.621+0000 7f5c63fff700 1 -- 172.21.15.62:0/1104585690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5c640b16a0 con 0x7f5c6405ca90 2021-12-17T18:27:44.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.621+0000 7f5c60ff9700 1 -- 172.21.15.62:0/1104585690 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v137) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5c540453f0 con 0x7f5c6405ca90 2021-12-17T18:27:44.628 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:27:44.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.625+0000 7f5c63fff700 1 -- 172.21.15.62:0/1104585690 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c48053610 msgr2=0x7f5c48055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.625+0000 7f5c63fff700 1 --2- 172.21.15.62:0/1104585690 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c48053610 0x7f5c48055ad0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f5c4c00c000 tx=0x7f5c4c008040).stop 2021-12-17T18:27:44.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.625+0000 7f5c63fff700 1 -- 172.21.15.62:0/1104585690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c6405ca90 msgr2=0x7f5c641532c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.625+0000 7f5c63fff700 1 --2- 172.21.15.62:0/1104585690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c6405ca90 0x7f5c641532c0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f5c6405d430 tx=0x7f5c54007c40).stop 2021-12-17T18:27:44.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.625+0000 7f5c63fff700 1 -- 172.21.15.62:0/1104585690 shutdown_connections 2021-12-17T18:27:44.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.625+0000 7f5c63fff700 1 --2- 172.21.15.62:0/1104585690 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c48053610 0x7f5c48055ad0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.631 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.625+0000 7f5c63fff700 1 --2- 172.21.15.62:0/1104585690 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c64146c30 0x7f5c640af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.625+0000 7f5c63fff700 1 --2- 172.21.15.62:0/1104585690 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c640ad430 0x7f5c640b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.625+0000 7f5c63fff700 1 --2- 172.21.15.62:0/1104585690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c6405ca90 0x7f5c641532c0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.625+0000 7f5c63fff700 1 -- 172.21.15.62:0/1104585690 >> 172.21.15.62:0/1104585690 conn(0x7f5c6405be70 msgr2=0x7f5c640b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:44.632 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.625+0000 7f5c63fff700 1 -- 172.21.15.62:0/1104585690 shutdown_connections 2021-12-17T18:27:44.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.625+0000 7f5c63fff700 1 -- 172.21.15.62:0/1104585690 wait complete. 2021-12-17T18:27:44.641 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-12-17T18:27:44.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.733+0000 7f6b7dbd7700 1 Processor -- start 2021-12-17T18:27:44.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.733+0000 7f6b7dbd7700 1 -- start start 2021-12-17T18:27:44.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7dbd7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6b78067830 0x7f6b780b1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7dbd7700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6b780b0690 0x7f6b781438c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7dbd7700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b780b2570 con 0x7f6b78143db0 2021-12-17T18:27:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7dbd7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b78067c10 con 0x7f6b78067830 2021-12-17T18:27:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7dbd7700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b78147520 con 0x7f6b780b0690 2021-12-17T18:27:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7cbd5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6b78067830 0x7f6b780b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7cbd5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6b78067830 0x7f6b780b1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56538/0 (socket says 172.21.15.62:56538) 2021-12-17T18:27:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b77fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f6b780b0690 0x7f6b781438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7cbd5700 1 -- 172.21.15.62:0/677423623 learned_addr learned my addr 172.21.15.62:0/677423623 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:44.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7cbd5700 1 -- 172.21.15.62:0/677423623 >> v2:172.21.15.109:3300/0 conn(0x7f6b780b0690 msgr2=0x7f6b781438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:44.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7cbd5700 1 --2- 172.21.15.62:0/677423623 >> v2:172.21.15.109:3300/0 conn(0x7f6b780b0690 0x7f6b781438c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7cbd5700 1 -- 172.21.15.62:0/677423623 >> v1:172.21.15.109:6789/0 conn(0x7f6b78143db0 legacy=0x7f6b7813cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b777fe700 1 -- 172.21.15.62:0/677423623 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918016832 0 0) 0x7f6b780b2570 con 0x7f6b78143db0 2021-12-17T18:27:44.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7cbd5700 1 -- 172.21.15.62:0/677423623 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b78143420 con 0x7f6b78067830 2021-12-17T18:27:44.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b77fff700 1 --2- 172.21.15.62:0/677423623 >> v2:172.21.15.109:3300/0 conn(0x7f6b780b0690 0x7f6b781438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:44.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7cbd5700 1 --2- 172.21.15.62:0/677423623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b78067830 0x7f6b780b1360 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f6b6c002f70 tx=0x7f6b6c006eb0).ready entity=mon.0 client_cookie=4873aa0aa173d773 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b777fe700 1 -- 172.21.15.62:0/677423623 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b6c00d5c0 con 0x7f6b78067830 2021-12-17T18:27:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b777fe700 1 -- 172.21.15.62:0/677423623 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c000e90 con 0x7f6b78067830 2021-12-17T18:27:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b777fe700 1 -- 172.21.15.62:0/677423623 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b6c00d910 con 0x7f6b78067830 2021-12-17T18:27:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7dbd7700 1 -- 172.21.15.62:0/677423623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b78067830 msgr2=0x7f6b780b1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7dbd7700 1 --2- 172.21.15.62:0/677423623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b78067830 0x7f6b780b1360 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f6b6c002f70 tx=0x7f6b6c006eb0).stop 2021-12-17T18:27:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7dbd7700 1 -- 172.21.15.62:0/677423623 shutdown_connections 2021-12-17T18:27:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7dbd7700 1 --2- 172.21.15.62:0/677423623 >> v2:172.21.15.109:3300/0 conn(0x7f6b780b0690 0x7f6b781438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7dbd7700 1 --2- 172.21.15.62:0/677423623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b78067830 0x7f6b780b1360 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.737+0000 7f6b7dbd7700 1 -- 172.21.15.62:0/677423623 >> 172.21.15.62:0/677423623 conn(0x7f6b7805c750 msgr2=0x7f6b7805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:44.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b7dbd7700 1 -- 172.21.15.62:0/677423623 shutdown_connections 2021-12-17T18:27:44.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b7dbd7700 1 -- 172.21.15.62:0/677423623 wait complete. 2021-12-17T18:27:44.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b7dbd7700 1 Processor -- start 2021-12-17T18:27:44.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b7dbd7700 1 -- start start 2021-12-17T18:27:44.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b7dbd7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6b78067830 0x7f6b7813da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b7dbd7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b780b0690 0x7f6b780b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b7dbd7700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6b78143db0 0x7f6b78155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b7dbd7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780af590 con 0x7f6b780b0690 2021-12-17T18:27:44.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b7dbd7700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7813df10 con 0x7f6b78143db0 2021-12-17T18:27:44.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b7dbd7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780b6760 con 0x7f6b78067830 2021-12-17T18:27:44.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b77fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b780b0690 0x7f6b780b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b77fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b780b0690 0x7f6b780b4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56544/0 (socket says 172.21.15.62:56544) 2021-12-17T18:27:44.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b77fff700 1 -- 172.21.15.62:0/2927854521 learned_addr learned my addr 172.21.15.62:0/2927854521 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:44.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b7cbd5700 1 --2- 172.21.15.62:0/2927854521 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6b78067830 0x7f6b7813da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b7d3d6700 1 --2- 172.21.15.62:0/2927854521 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6b78143db0 0x7f6b78155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b77fff700 1 -- 172.21.15.62:0/2927854521 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6b78067830 msgr2=0x7f6b7813da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b77fff700 1 --2- 172.21.15.62:0/2927854521 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6b78067830 0x7f6b7813da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b77fff700 1 -- 172.21.15.62:0/2927854521 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6b78143db0 msgr2=0x7f6b78155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b77fff700 1 --2- 172.21.15.62:0/2927854521 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6b78143db0 0x7f6b78155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b77fff700 1 -- 172.21.15.62:0/2927854521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6400b180 con 0x7f6b780b0690 2021-12-17T18:27:44.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.741+0000 7f6b7d3d6700 1 --2- 172.21.15.62:0/2927854521 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6b78143db0 0x7f6b78155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:44.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.745+0000 7f6b77fff700 1 --2- 172.21.15.62:0/2927854521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b780b0690 0x7f6b780b4a80 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f6b6400c000 tx=0x7f6b64006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:44.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.745+0000 7f6b75ffb700 1 -- 172.21.15.62:0/2927854521 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b6400c890 con 0x7f6b780b0690 2021-12-17T18:27:44.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.745+0000 7f6b75ffb700 1 -- 172.21.15.62:0/2927854521 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6400c9f0 con 0x7f6b780b0690 2021-12-17T18:27:44.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.745+0000 7f6b75ffb700 1 -- 172.21.15.62:0/2927854521 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b6400cd50 con 0x7f6b780b0690 2021-12-17T18:27:44.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.745+0000 7f6b7dbd7700 1 -- 172.21.15.62:0/2927854521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6c00b1e0 con 0x7f6b780b0690 2021-12-17T18:27:44.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.745+0000 7f6b7dbd7700 1 -- 172.21.15.62:0/2927854521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b780b4f70 con 0x7f6b780b0690 2021-12-17T18:27:44.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.745+0000 7f6b75ffb700 1 -- 172.21.15.62:0/2927854521 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6b6401c460 con 0x7f6b780b0690 2021-12-17T18:27:44.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.745+0000 7f6b7dbd7700 1 -- 172.21.15.62:0/2927854521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b780573d0 con 0x7f6b780b0690 2021-12-17T18:27:44.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.745+0000 7f6b75ffb700 1 --2- 172.21.15.62:0/2927854521 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6b580535b0 0x7f6b58055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:44.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.745+0000 7f6b75ffb700 1 -- 172.21.15.62:0/2927854521 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6b6406bcc0 con 0x7f6b780b0690 2021-12-17T18:27:44.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.745+0000 7f6b7cbd5700 1 --2- 172.21.15.62:0/2927854521 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6b580535b0 0x7f6b58055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:44.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.749+0000 7f6b7cbd5700 1 --2- 172.21.15.62:0/2927854521 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6b580535b0 0x7f6b58055a70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f6b6c01c000 tx=0x7f6b6c015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:44.762 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.753+0000 7f6b75ffb700 1 -- 172.21.15.62:0/2927854521 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6b64072080 con 0x7f6b780b0690 2021-12-17T18:27:44.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.881+0000 7f6b7dbd7700 1 -- 172.21.15.62:0/2927854521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6b78068f30 con 0x7f6b780b0690 2021-12-17T18:27:44.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.881+0000 7f6b75ffb700 1 -- 172.21.15.62:0/2927854521 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v137) v1 ==== 84+0+143 (secure 0 0 0) 0x7f6b64042fe0 con 0x7f6b780b0690 2021-12-17T18:27:44.889 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:44.889 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2021-12-17T18:27:44.889 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:44.889 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2021-12-17T18:27:44.890 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "device_health_metrics" 2021-12-17T18:27:44.890 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:44.890 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:44.890 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2021-12-17T18:27:44.890 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2021-12-17T18:27:44.891 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:44.891 INFO:teuthology.orchestra.run.smithi062.stdout:] 2021-12-17T18:27:44.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.885+0000 7f6b7dbd7700 1 -- 172.21.15.62:0/2927854521 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6b580535b0 msgr2=0x7f6b58055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.885+0000 7f6b7dbd7700 1 --2- 172.21.15.62:0/2927854521 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6b580535b0 0x7f6b58055a70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f6b6c01c000 tx=0x7f6b6c015000).stop 2021-12-17T18:27:44.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.885+0000 7f6b7dbd7700 1 -- 172.21.15.62:0/2927854521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b780b0690 msgr2=0x7f6b780b4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:44.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.885+0000 7f6b7dbd7700 1 --2- 172.21.15.62:0/2927854521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b780b0690 0x7f6b780b4a80 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f6b6400c000 tx=0x7f6b64006df0).stop 2021-12-17T18:27:44.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.885+0000 7f6b7dbd7700 1 -- 172.21.15.62:0/2927854521 shutdown_connections 2021-12-17T18:27:44.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.885+0000 7f6b7dbd7700 1 --2- 172.21.15.62:0/2927854521 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6b580535b0 0x7f6b58055a70 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.885+0000 7f6b7dbd7700 1 --2- 172.21.15.62:0/2927854521 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6b78143db0 0x7f6b78155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.885+0000 7f6b7dbd7700 1 --2- 172.21.15.62:0/2927854521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b780b0690 0x7f6b780b4a80 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.885+0000 7f6b7dbd7700 1 --2- 172.21.15.62:0/2927854521 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6b78067830 0x7f6b7813da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:44.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.885+0000 7f6b7dbd7700 1 -- 172.21.15.62:0/2927854521 >> 172.21.15.62:0/2927854521 conn(0x7f6b7805c750 msgr2=0x7f6b781468c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:44.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.885+0000 7f6b7dbd7700 1 -- 172.21.15.62:0/2927854521 shutdown_connections 2021-12-17T18:27:44.895 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:44.885+0000 7f6b7dbd7700 1 -- 172.21.15.62:0/2927854521 wait complete. 2021-12-17T18:27:44.901 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-12-17T18:27:44.902 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-12-17T18:27:45.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.009+0000 7fcc20ca9700 1 Processor -- start 2021-12-17T18:27:45.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.009+0000 7fcc20ca9700 1 -- start start 2021-12-17T18:27:45.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.009+0000 7fcc20ca9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcc1c0b06b0 0x7fcc1c0ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:45.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.009+0000 7fcc20ca9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1c0b2860 con 0x7fcc1c0604d0 2021-12-17T18:27:45.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.009+0000 7fcc20ca9700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1c14b300 con 0x7fcc1c05ca90 2021-12-17T18:27:45.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.009+0000 7fcc20ca9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1c1475c0 con 0x7fcc1c0b06b0 2021-12-17T18:27:45.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.009+0000 7fcc1bfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcc1c0604d0 0x7fcc1c146510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40134/0 (socket says 172.21.15.62:40134) 2021-12-17T18:27:45.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.009+0000 7fcc1bfff700 1 -- 172.21.15.62:0/2081508558 learned_addr learned my addr 172.21.15.62:0/2081508558 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:45.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.009+0000 7fcc1affd700 1 --2- 172.21.15.62:0/2081508558 >> v2:172.21.15.62:3300/0 conn(0x7fcc1c0b06b0 0x7fcc1c0ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:45.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.009+0000 7fcc1a7fc700 1 -- 172.21.15.62:0/2081508558 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882850548 0 0) 0x7fcc1c0b2860 con 0x7fcc1c0604d0 2021-12-17T18:27:45.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.009+0000 7fcc1a7fc700 1 -- 172.21.15.62:0/2081508558 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc08003260 con 0x7fcc1c0604d0 2021-12-17T18:27:45.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.009+0000 7fcc1affd700 1 -- 172.21.15.62:0/2081508558 >> v1:172.21.15.109:6789/0 conn(0x7fcc1c05ca90 legacy=0x7fcc1c14abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:45.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.009+0000 7fcc1affd700 1 -- 172.21.15.62:0/2081508558 >> v1:172.21.15.62:6789/0 conn(0x7fcc1c0604d0 legacy=0x7fcc1c146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:45.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.009+0000 7fcc1a7fc700 1 -- 172.21.15.62:0/2081508558 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2833413261 0 0) 0x7fcc08003260 con 0x7fcc1c0604d0 2021-12-17T18:27:45.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.009+0000 7fcc1affd700 1 -- 172.21.15.62:0/2081508558 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c0ac740 con 0x7fcc1c0b06b0 2021-12-17T18:27:45.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.009+0000 7fcc1affd700 1 --2- 172.21.15.62:0/2081508558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc1c0b06b0 0x7fcc1c0ace40 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7fcc14001b80 tx=0x7fcc0c006df0).ready entity=mon.0 client_cookie=14bafa03abfc666d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:45.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc1a7fc700 1 -- 172.21.15.62:0/2081508558 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc140019e0 con 0x7fcc1c0b06b0 2021-12-17T18:27:45.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc1a7fc700 1 -- 172.21.15.62:0/2081508558 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0c000e90 con 0x7fcc1c0b06b0 2021-12-17T18:27:45.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc1a7fc700 1 -- 172.21.15.62:0/2081508558 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc0c00d4f0 con 0x7fcc1c0b06b0 2021-12-17T18:27:45.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc20ca9700 1 -- 172.21.15.62:0/2081508558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc1c0b06b0 msgr2=0x7fcc1c0ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:45.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc20ca9700 1 --2- 172.21.15.62:0/2081508558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc1c0b06b0 0x7fcc1c0ace40 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7fcc14001b80 tx=0x7fcc0c006df0).stop 2021-12-17T18:27:45.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc20ca9700 1 -- 172.21.15.62:0/2081508558 shutdown_connections 2021-12-17T18:27:45.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc20ca9700 1 --2- 172.21.15.62:0/2081508558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc1c0b06b0 0x7fcc1c0ace40 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:45.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc20ca9700 1 -- 172.21.15.62:0/2081508558 >> 172.21.15.62:0/2081508558 conn(0x7fcc1c05c070 msgr2=0x7fcc1c062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:45.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc20ca9700 1 -- 172.21.15.62:0/2081508558 shutdown_connections 2021-12-17T18:27:45.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc20ca9700 1 -- 172.21.15.62:0/2081508558 wait complete. 2021-12-17T18:27:45.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc20ca9700 1 Processor -- start 2021-12-17T18:27:45.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc20ca9700 1 -- start start 2021-12-17T18:27:45.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc20ca9700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc1c05ca90 0x7fcc1c063c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:45.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc20ca9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc1c0604d0 0x7fcc1c0645d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:45.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc20ca9700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc1c0b06b0 0x7fcc1c156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:45.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc20ca9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c064f30 con 0x7fcc1c0604d0 2021-12-17T18:27:45.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc20ca9700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c066f00 con 0x7fcc1c05ca90 2021-12-17T18:27:45.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc20ca9700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c064c90 con 0x7fcc1c0b06b0 2021-12-17T18:27:45.027 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc1affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc1c0604d0 0x7fcc1c0645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:45.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc1affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc1c0604d0 0x7fcc1c0645d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56560/0 (socket says 172.21.15.62:56560) 2021-12-17T18:27:45.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc1affd700 1 -- 172.21.15.62:0/2235175063 learned_addr learned my addr 172.21.15.62:0/2235175063 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:45.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.013+0000 7fcc1b7fe700 1 --2- 172.21.15.62:0/2235175063 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc1c05ca90 0x7fcc1c063c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:45.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc1bfff700 1 --2- 172.21.15.62:0/2235175063 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc1c0b06b0 0x7fcc1c156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:45.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc1affd700 1 -- 172.21.15.62:0/2235175063 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc1c0b06b0 msgr2=0x7fcc1c156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:45.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc1affd700 1 --2- 172.21.15.62:0/2235175063 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc1c0b06b0 0x7fcc1c156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:45.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc1affd700 1 -- 172.21.15.62:0/2235175063 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc1c05ca90 msgr2=0x7fcc1c063c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:45.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc1affd700 1 --2- 172.21.15.62:0/2235175063 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc1c05ca90 0x7fcc1c063c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:45.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc1affd700 1 -- 172.21.15.62:0/2235175063 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c00b180 con 0x7fcc1c0604d0 2021-12-17T18:27:45.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc1bfff700 1 --2- 172.21.15.62:0/2235175063 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc1c0b06b0 0x7fcc1c156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:45.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc1b7fe700 1 --2- 172.21.15.62:0/2235175063 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc1c05ca90 0x7fcc1c063c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:45.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc1affd700 1 --2- 172.21.15.62:0/2235175063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc1c0604d0 0x7fcc1c0645d0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7fcc14001b80 tx=0x7fcc0c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:45.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc18ff9700 1 -- 172.21.15.62:0/2235175063 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc0c002f50 con 0x7fcc1c0604d0 2021-12-17T18:27:45.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc18ff9700 1 -- 172.21.15.62:0/2235175063 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0c00de40 con 0x7fcc1c0604d0 2021-12-17T18:27:45.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc20ca9700 1 -- 172.21.15.62:0/2235175063 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c0a1360 con 0x7fcc1c0604d0 2021-12-17T18:27:45.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc18ff9700 1 -- 172.21.15.62:0/2235175063 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc0c01e5f0 con 0x7fcc1c0604d0 2021-12-17T18:27:45.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc20ca9700 1 -- 172.21.15.62:0/2235175063 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c0a1fe0 con 0x7fcc1c0604d0 2021-12-17T18:27:45.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc18ff9700 1 -- 172.21.15.62:0/2235175063 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcc0c025030 con 0x7fcc1c0604d0 2021-12-17T18:27:45.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc20ca9700 1 -- 172.21.15.62:0/2235175063 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1c064ac0 con 0x7fcc1c0604d0 2021-12-17T18:27:45.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc18ff9700 1 --2- 172.21.15.62:0/2235175063 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcbfc0536a0 0x7fcbfc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:45.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc18ff9700 1 -- 172.21.15.62:0/2235175063 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fcc0c06c410 con 0x7fcc1c0604d0 2021-12-17T18:27:45.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.017+0000 7fcc1b7fe700 1 --2- 172.21.15.62:0/2235175063 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcbfc0536a0 0x7fcbfc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:45.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.021+0000 7fcc1b7fe700 1 --2- 172.21.15.62:0/2235175063 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcbfc0536a0 0x7fcbfc055b60 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fcc1000b000 tx=0x7fcc10009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:45.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.025+0000 7fcc18ff9700 1 -- 172.21.15.62:0/2235175063 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcc0c043790 con 0x7fcc1c0604d0 2021-12-17T18:27:45.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:45.149+0000 7fcc20ca9700 1 -- 172.21.15.62:0/2235175063 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fcc1c067070 con 0x7fcc1c0604d0 2021-12-17T18:27:46.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.109+0000 7fcc18ff9700 1 -- 172.21.15.62:0/2235175063 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v138) v1 ==== 133+0+0 (secure 0 0 0) 0x7fcc0c023020 con 0x7fcc1c0604d0 2021-12-17T18:27:46.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.109+0000 7fcc20ca9700 1 -- 172.21.15.62:0/2235175063 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcbfc0536a0 msgr2=0x7fcbfc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.109+0000 7fcc20ca9700 1 --2- 172.21.15.62:0/2235175063 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcbfc0536a0 0x7fcbfc055b60 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fcc1000b000 tx=0x7fcc10009040).stop 2021-12-17T18:27:46.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.109+0000 7fcc20ca9700 1 -- 172.21.15.62:0/2235175063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc1c0604d0 msgr2=0x7fcc1c0645d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.109+0000 7fcc20ca9700 1 --2- 172.21.15.62:0/2235175063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc1c0604d0 0x7fcc1c0645d0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7fcc14001b80 tx=0x7fcc0c014000).stop 2021-12-17T18:27:46.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.109+0000 7fcc20ca9700 1 -- 172.21.15.62:0/2235175063 shutdown_connections 2021-12-17T18:27:46.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.109+0000 7fcc20ca9700 1 --2- 172.21.15.62:0/2235175063 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fcbfc0536a0 0x7fcbfc055b60 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.109+0000 7fcc20ca9700 1 --2- 172.21.15.62:0/2235175063 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fcc1c0b06b0 0x7fcc1c156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.109+0000 7fcc20ca9700 1 --2- 172.21.15.62:0/2235175063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc1c0604d0 0x7fcc1c0645d0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.109+0000 7fcc20ca9700 1 --2- 172.21.15.62:0/2235175063 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fcc1c05ca90 0x7fcc1c063c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.109+0000 7fcc20ca9700 1 -- 172.21.15.62:0/2235175063 >> 172.21.15.62:0/2235175063 conn(0x7fcc1c05c070 msgr2=0x7fcc1c0b4770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:46.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.109+0000 7fcc20ca9700 1 -- 172.21.15.62:0/2235175063 shutdown_connections 2021-12-17T18:27:46.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.113+0000 7fcc20ca9700 1 -- 172.21.15.62:0/2235175063 wait complete. 2021-12-17T18:27:46.119 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2021-12-17T18:27:46.131 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-12-17T18:27:46.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.241+0000 7f9eccaaa700 1 Processor -- start 2021-12-17T18:27:46.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.241+0000 7f9eccaaa700 1 -- start start 2021-12-17T18:27:46.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.241+0000 7f9eccaaa700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9ec8060020 0x7f9ec80aed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.241+0000 7f9eccaaa700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f9ec813ef80 0x7f9ec813f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.241+0000 7f9eccaaa700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec80b2540 con 0x7f9ec813f8b0 2021-12-17T18:27:46.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.241+0000 7f9eccaaa700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec8060400 con 0x7f9ec813ef80 2021-12-17T18:27:46.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.241+0000 7f9eccaaa700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80ad9f0 con 0x7f9ec8060020 2021-12-17T18:27:46.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.241+0000 7f9ec5d9b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f9ec813ef80 0x7f9ec813f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.241+0000 7f9ec5d9b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f9ec813ef80 0x7f9ec813f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:34886/0 (socket says 172.21.15.62:34886) 2021-12-17T18:27:46.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.241+0000 7f9ec6d9d700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f9ec813f8b0 0x7f9ec8143280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:56470/0 (socket says 172.21.15.62:56470) 2021-12-17T18:27:46.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.241+0000 7f9ec5d9b700 1 -- 172.21.15.62:0/1388629458 learned_addr learned my addr 172.21.15.62:0/1388629458 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:46.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.241+0000 7f9ec659c700 1 --2- 172.21.15.62:0/1388629458 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9ec8060020 0x7f9ec80aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.241+0000 7f9ec5d9b700 1 -- 172.21.15.62:0/1388629458 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9ec8060020 msgr2=0x7f9ec80aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:46.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.241+0000 7f9ec5d9b700 1 --2- 172.21.15.62:0/1388629458 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9ec8060020 0x7f9ec80aed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.241+0000 7f9ec5d9b700 1 -- 172.21.15.62:0/1388629458 >> v1:172.21.15.109:6789/0 conn(0x7f9ec813f8b0 legacy=0x7f9ec8143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.241+0000 7f9ec559a700 1 -- 172.21.15.62:0/1388629458 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326614597 0 0) 0x7f9ec80b2540 con 0x7f9ec813f8b0 2021-12-17T18:27:46.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.241+0000 7f9ec5d9b700 1 -- 172.21.15.62:0/1388629458 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec80adc90 con 0x7f9ec813ef80 2021-12-17T18:27:46.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.245+0000 7f9ec5d9b700 1 --2- 172.21.15.62:0/1388629458 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9ec813ef80 0x7f9ec813f3c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f9ebc002f70 tx=0x7f9ebc006eb0).ready entity=mon.1 client_cookie=a7b016b014855812 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:46.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.245+0000 7f9ec559a700 1 -- 172.21.15.62:0/1388629458 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ebc00d570 con 0x7f9ec813ef80 2021-12-17T18:27:46.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.245+0000 7f9ec559a700 1 -- 172.21.15.62:0/1388629458 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc000e90 con 0x7f9ec813ef80 2021-12-17T18:27:46.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.245+0000 7f9ec559a700 1 -- 172.21.15.62:0/1388629458 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ebc00d8c0 con 0x7f9ec813ef80 2021-12-17T18:27:46.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.245+0000 7f9eccaaa700 1 -- 172.21.15.62:0/1388629458 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9ec813ef80 msgr2=0x7f9ec813f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.245+0000 7f9eccaaa700 1 --2- 172.21.15.62:0/1388629458 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9ec813ef80 0x7f9ec813f3c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f9ebc002f70 tx=0x7f9ebc006eb0).stop 2021-12-17T18:27:46.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.245+0000 7f9eccaaa700 1 -- 172.21.15.62:0/1388629458 shutdown_connections 2021-12-17T18:27:46.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.245+0000 7f9eccaaa700 1 --2- 172.21.15.62:0/1388629458 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9ec813ef80 0x7f9ec813f3c0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.245+0000 7f9eccaaa700 1 --2- 172.21.15.62:0/1388629458 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9ec8060020 0x7f9ec80aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.245+0000 7f9eccaaa700 1 -- 172.21.15.62:0/1388629458 >> 172.21.15.62:0/1388629458 conn(0x7f9ec805cac0 msgr2=0x7f9ec805ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:46.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.245+0000 7f9eccaaa700 1 -- 172.21.15.62:0/1388629458 shutdown_connections 2021-12-17T18:27:46.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.245+0000 7f9eccaaa700 1 -- 172.21.15.62:0/1388629458 wait complete. 2021-12-17T18:27:46.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9eccaaa700 1 Processor -- start 2021-12-17T18:27:46.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9eccaaa700 1 -- start start 2021-12-17T18:27:46.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9eccaaa700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9ec8060020 0x7f9ec8065c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9eccaaa700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9ec813ef80 0x7f9ec8150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9eccaaa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec813f8b0 0x7f9ec80b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9eccaaa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec8150540 con 0x7f9ec813f8b0 2021-12-17T18:27:46.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9eccaaa700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec8153670 con 0x7f9ec813ef80 2021-12-17T18:27:46.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9eccaaa700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec813c0c0 con 0x7f9ec8060020 2021-12-17T18:27:46.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9ec6d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec813f8b0 0x7f9ec80b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9ec5d9b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9ec813ef80 0x7f9ec8150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9ec659c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9ec8060020 0x7f9ec8065c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9ec6d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec813f8b0 0x7f9ec80b2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56576/0 (socket says 172.21.15.62:56576) 2021-12-17T18:27:46.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9ec6d9d700 1 -- 172.21.15.62:0/1663453793 learned_addr learned my addr 172.21.15.62:0/1663453793 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:46.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9ec6d9d700 1 -- 172.21.15.62:0/1663453793 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9ec8060020 msgr2=0x7f9ec8065c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9ec6d9d700 1 --2- 172.21.15.62:0/1663453793 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9ec8060020 0x7f9ec8065c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9ec6d9d700 1 -- 172.21.15.62:0/1663453793 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9ec813ef80 msgr2=0x7f9ec8150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9ec6d9d700 1 --2- 172.21.15.62:0/1663453793 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9ec813ef80 0x7f9ec8150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9ec6d9d700 1 -- 172.21.15.62:0/1663453793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc00b1e0 con 0x7f9ec813f8b0 2021-12-17T18:27:46.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9ec6d9d700 1 --2- 172.21.15.62:0/1663453793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec813f8b0 0x7f9ec80b2a20 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f9ec0001250 tx=0x7f9ec0001380).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:46.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.249+0000 7f9eb77fe700 1 -- 172.21.15.62:0/1663453793 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ec0004ab0 con 0x7f9ec813f8b0 2021-12-17T18:27:46.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.253+0000 7f9eb77fe700 1 -- 172.21.15.62:0/1663453793 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec0004c10 con 0x7f9ec813f8b0 2021-12-17T18:27:46.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.253+0000 7f9eb77fe700 1 -- 172.21.15.62:0/1663453793 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ec0007170 con 0x7f9ec813f8b0 2021-12-17T18:27:46.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.253+0000 7f9eccaaa700 1 -- 172.21.15.62:0/1663453793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec80b2f10 con 0x7f9ec813f8b0 2021-12-17T18:27:46.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.253+0000 7f9eccaaa700 1 -- 172.21.15.62:0/1663453793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec80b3250 con 0x7f9ec813f8b0 2021-12-17T18:27:46.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.253+0000 7f9eccaaa700 1 -- 172.21.15.62:0/1663453793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec813bee0 con 0x7f9ec813f8b0 2021-12-17T18:27:46.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.253+0000 7f9eb77fe700 1 -- 172.21.15.62:0/1663453793 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9ec00072d0 con 0x7f9ec813f8b0 2021-12-17T18:27:46.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.253+0000 7f9eb77fe700 1 --2- 172.21.15.62:0/1663453793 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ea4053580 0x7f9ea4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.253+0000 7f9eb77fe700 1 -- 172.21.15.62:0/1663453793 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f9ec006b430 con 0x7f9ec813f8b0 2021-12-17T18:27:46.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.253+0000 7f9ec659c700 1 --2- 172.21.15.62:0/1663453793 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ea4053580 0x7f9ea4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.257+0000 7f9ec659c700 1 --2- 172.21.15.62:0/1663453793 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ea4053580 0x7f9ea4055a40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f9eb800b000 tx=0x7f9eb8006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:46.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.261+0000 7f9eb77fe700 1 -- 172.21.15.62:0/1663453793 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ec00425f0 con 0x7f9ec813f8b0 2021-12-17T18:27:46.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.385+0000 7f9eccaaa700 1 -- 172.21.15.62:0/1663453793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f9ec80b21c0 con 0x7f9ec813f8b0 2021-12-17T18:27:46.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.493+0000 7f9eb77fe700 1 -- 172.21.15.62:0/1663453793 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v139) v1 ==== 125+0+0 (secure 0 0 0) 0x7f9ec0045c10 con 0x7f9ec813f8b0 2021-12-17T18:27:46.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.497+0000 7f9eccaaa700 1 -- 172.21.15.62:0/1663453793 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ea4053580 msgr2=0x7f9ea4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.497+0000 7f9eccaaa700 1 --2- 172.21.15.62:0/1663453793 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ea4053580 0x7f9ea4055a40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f9eb800b000 tx=0x7f9eb8006df0).stop 2021-12-17T18:27:46.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.497+0000 7f9eccaaa700 1 -- 172.21.15.62:0/1663453793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec813f8b0 msgr2=0x7f9ec80b2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.497+0000 7f9eccaaa700 1 --2- 172.21.15.62:0/1663453793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec813f8b0 0x7f9ec80b2a20 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f9ec0001250 tx=0x7f9ec0001380).stop 2021-12-17T18:27:46.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.497+0000 7f9eccaaa700 1 -- 172.21.15.62:0/1663453793 shutdown_connections 2021-12-17T18:27:46.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.497+0000 7f9eccaaa700 1 --2- 172.21.15.62:0/1663453793 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9ea4053580 0x7f9ea4055a40 secure :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0x7f9eb800b000 tx=0x7f9eb8006df0).stop 2021-12-17T18:27:46.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.497+0000 7f9eccaaa700 1 --2- 172.21.15.62:0/1663453793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec813f8b0 0x7f9ec80b2a20 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.497+0000 7f9eccaaa700 1 --2- 172.21.15.62:0/1663453793 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9ec813ef80 0x7f9ec8150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.497+0000 7f9eccaaa700 1 --2- 172.21.15.62:0/1663453793 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9ec8060020 0x7f9ec8065c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.497+0000 7f9eccaaa700 1 -- 172.21.15.62:0/1663453793 >> 172.21.15.62:0/1663453793 conn(0x7f9ec805cac0 msgr2=0x7f9ec80630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:46.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.501+0000 7f9eccaaa700 1 -- 172.21.15.62:0/1663453793 shutdown_connections 2021-12-17T18:27:46.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.501+0000 7f9eccaaa700 1 -- 172.21.15.62:0/1663453793 wait complete. 2021-12-17T18:27:46.506 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2021-12-17T18:27:46.518 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-12-17T18:27:46.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.617+0000 7f7f3c98d700 1 Processor -- start 2021-12-17T18:27:46.624 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.617+0000 7f7f3c98d700 1 -- start start 2021-12-17T18:27:46.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f3c98d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7f3805bcd0 0x7f7f380ae050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.626 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f3c98d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f380b6600 con 0x7f7f380ae540 2021-12-17T18:27:46.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f3c98d700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f380627d0 con 0x7f7f3805fa70 2021-12-17T18:27:46.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f3c98d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f380ac470 con 0x7f7f3805bcd0 2021-12-17T18:27:46.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f2effd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7f3805bcd0 0x7f7f380ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.627 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f37fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7f380ae540 0x7f7f380ae9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40162/0 (socket says 172.21.15.62:40162) 2021-12-17T18:27:46.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f37fff700 1 -- 172.21.15.62:0/1397429213 learned_addr learned my addr 172.21.15.62:0/1397429213 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:46.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f36ffd700 1 -- 172.21.15.62:0/1397429213 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1659674745 0 0) 0x7f7f380b6600 con 0x7f7f380ae540 2021-12-17T18:27:46.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f36ffd700 1 -- 172.21.15.62:0/1397429213 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f18003260 con 0x7f7f380ae540 2021-12-17T18:27:46.628 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f2effd700 1 -- 172.21.15.62:0/1397429213 >> v1:172.21.15.109:6789/0 conn(0x7f7f3805fa70 legacy=0x7f7f380b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f2effd700 1 -- 172.21.15.62:0/1397429213 >> v1:172.21.15.62:6789/0 conn(0x7f7f380ae540 legacy=0x7f7f380ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f2effd700 1 -- 172.21.15.62:0/1397429213 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3805fe50 con 0x7f7f3805bcd0 2021-12-17T18:27:46.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f2effd700 1 --2- 172.21.15.62:0/1397429213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f3805bcd0 0x7f7f380ae050 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f7f380acf50 tx=0x7f7f20006df0).ready entity=mon.0 client_cookie=23146dd5181c65da server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:46.629 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f36ffd700 1 -- 172.21.15.62:0/1397429213 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f2000d610 con 0x7f7f3805bcd0 2021-12-17T18:27:46.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f36ffd700 1 -- 172.21.15.62:0/1397429213 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f20000e90 con 0x7f7f3805bcd0 2021-12-17T18:27:46.630 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f36ffd700 1 -- 172.21.15.62:0/1397429213 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f2000d960 con 0x7f7f3805bcd0 2021-12-17T18:27:46.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f3c98d700 1 -- 172.21.15.62:0/1397429213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f3805bcd0 msgr2=0x7f7f380ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f3c98d700 1 --2- 172.21.15.62:0/1397429213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f3805bcd0 0x7f7f380ae050 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f7f380acf50 tx=0x7f7f20006df0).stop 2021-12-17T18:27:46.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f3c98d700 1 -- 172.21.15.62:0/1397429213 shutdown_connections 2021-12-17T18:27:46.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f3c98d700 1 --2- 172.21.15.62:0/1397429213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f3805bcd0 0x7f7f380ae050 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f3c98d700 1 -- 172.21.15.62:0/1397429213 >> 172.21.15.62:0/1397429213 conn(0x7f7f380b5ae0 msgr2=0x7f7f380b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:46.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f3c98d700 1 -- 172.21.15.62:0/1397429213 shutdown_connections 2021-12-17T18:27:46.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.621+0000 7f7f3c98d700 1 -- 172.21.15.62:0/1397429213 wait complete. 2021-12-17T18:27:46.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f3c98d700 1 Processor -- start 2021-12-17T18:27:46.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f3c98d700 1 -- start start 2021-12-17T18:27:46.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f3c98d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7f3805bcd0 0x7f7f38149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f3c98d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f3805fa70 0x7f7f380a4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f3c98d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f380ae540 0x7f7f381523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f3c98d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f38065a00 con 0x7f7f380ae540 2021-12-17T18:27:46.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f3c98d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f380a36e0 con 0x7f7f3805bcd0 2021-12-17T18:27:46.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f3c98d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f380a4880 con 0x7f7f3805fa70 2021-12-17T18:27:46.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f37fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f380ae540 0x7f7f381523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f37fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f380ae540 0x7f7f381523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56590/0 (socket says 172.21.15.62:56590) 2021-12-17T18:27:46.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f37fff700 1 -- 172.21.15.62:0/477613402 learned_addr learned my addr 172.21.15.62:0/477613402 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:46.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f2effd700 1 --2- 172.21.15.62:0/477613402 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f3805fa70 0x7f7f380a4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f377fe700 1 --2- 172.21.15.62:0/477613402 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7f3805bcd0 0x7f7f38149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f37fff700 1 -- 172.21.15.62:0/477613402 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f3805fa70 msgr2=0x7f7f380a4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f37fff700 1 --2- 172.21.15.62:0/477613402 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f3805fa70 0x7f7f380a4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f37fff700 1 -- 172.21.15.62:0/477613402 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7f3805bcd0 msgr2=0x7f7f38149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f37fff700 1 --2- 172.21.15.62:0/477613402 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7f3805bcd0 0x7f7f38149350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f37fff700 1 -- 172.21.15.62:0/477613402 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2000b180 con 0x7f7f380ae540 2021-12-17T18:27:46.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.625+0000 7f7f37fff700 1 --2- 172.21.15.62:0/477613402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f380ae540 0x7f7f381523c0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f7f30001490 tx=0x7f7f30007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:46.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.629+0000 7f7f357fa700 1 -- 172.21.15.62:0/477613402 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f30005ba0 con 0x7f7f380ae540 2021-12-17T18:27:46.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.629+0000 7f7f357fa700 1 -- 172.21.15.62:0/477613402 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f30005d00 con 0x7f7f380ae540 2021-12-17T18:27:46.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.629+0000 7f7f3c98d700 1 -- 172.21.15.62:0/477613402 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f380a4b20 con 0x7f7f380ae540 2021-12-17T18:27:46.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.629+0000 7f7f357fa700 1 -- 172.21.15.62:0/477613402 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f300072c0 con 0x7f7f380ae540 2021-12-17T18:27:46.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.629+0000 7f7f3c98d700 1 -- 172.21.15.62:0/477613402 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f380667c0 con 0x7f7f380ae540 2021-12-17T18:27:46.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.629+0000 7f7f3c98d700 1 -- 172.21.15.62:0/477613402 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f380a4cb0 con 0x7f7f380ae540 2021-12-17T18:27:46.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.629+0000 7f7f357fa700 1 -- 172.21.15.62:0/477613402 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7f3001a060 con 0x7f7f380ae540 2021-12-17T18:27:46.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.629+0000 7f7f357fa700 1 --2- 172.21.15.62:0/477613402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7f1c0536d0 0x7f7f1c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.629+0000 7f7f357fa700 1 -- 172.21.15.62:0/477613402 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f7f3006b270 con 0x7f7f380ae540 2021-12-17T18:27:46.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.629+0000 7f7f377fe700 1 --2- 172.21.15.62:0/477613402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7f1c0536d0 0x7f7f1c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.633+0000 7f7f377fe700 1 --2- 172.21.15.62:0/477613402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7f1c0536d0 0x7f7f1c055b90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f7f2800d000 tx=0x7f7f28007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:46.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.637+0000 7f7f357fa700 1 -- 172.21.15.62:0/477613402 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7f30042440 con 0x7f7f380ae540 2021-12-17T18:27:46.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.809+0000 7f7f3c98d700 1 -- 172.21.15.62:0/477613402 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f7f380b6830 con 0x7f7f380ae540 2021-12-17T18:27:46.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.817+0000 7f7f357fa700 1 -- 172.21.15.62:0/477613402 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 27 and data pool 28 v70) v1 ==== 189+0+0 (secure 0 0 0) 0x7f7f30018070 con 0x7f7f380ae540 2021-12-17T18:27:46.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.821+0000 7f7f3c98d700 1 -- 172.21.15.62:0/477613402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7f1c0536d0 msgr2=0x7f7f1c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.821+0000 7f7f3c98d700 1 --2- 172.21.15.62:0/477613402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7f1c0536d0 0x7f7f1c055b90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f7f2800d000 tx=0x7f7f28007b90).stop 2021-12-17T18:27:46.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.821+0000 7f7f3c98d700 1 -- 172.21.15.62:0/477613402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f380ae540 msgr2=0x7f7f381523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.821+0000 7f7f3c98d700 1 --2- 172.21.15.62:0/477613402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f380ae540 0x7f7f381523c0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f7f30001490 tx=0x7f7f30007e00).stop 2021-12-17T18:27:46.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.821+0000 7f7f3c98d700 1 -- 172.21.15.62:0/477613402 shutdown_connections 2021-12-17T18:27:46.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.821+0000 7f7f3c98d700 1 --2- 172.21.15.62:0/477613402 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7f1c0536d0 0x7f7f1c055b90 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.821+0000 7f7f3c98d700 1 --2- 172.21.15.62:0/477613402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f380ae540 0x7f7f381523c0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.821+0000 7f7f3c98d700 1 --2- 172.21.15.62:0/477613402 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7f3805fa70 0x7f7f380a4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.821+0000 7f7f3c98d700 1 --2- 172.21.15.62:0/477613402 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f7f3805bcd0 0x7f7f38149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.821+0000 7f7f3c98d700 1 -- 172.21.15.62:0/477613402 >> 172.21.15.62:0/477613402 conn(0x7f7f380b5ae0 msgr2=0x7f7f380b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:46.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.821+0000 7f7f3c98d700 1 -- 172.21.15.62:0/477613402 shutdown_connections 2021-12-17T18:27:46.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.821+0000 7f7f3c98d700 1 -- 172.21.15.62:0/477613402 wait complete. 2021-12-17T18:27:46.831 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 27 and data pool 28 2021-12-17T18:27:46.843 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:27:46.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.929+0000 7f345ffff700 1 Processor -- start 2021-12-17T18:27:46.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.929+0000 7f345ffff700 1 -- start start 2021-12-17T18:27:46.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345ffff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f34600682c0 0x7f34600afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345ffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34600ad8e0 con 0x7f34600b02e0 2021-12-17T18:27:46.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345ffff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34600b6280 con 0x7f34600b5ea0 2021-12-17T18:27:46.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345ffff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34600ad310 con 0x7f34600682c0 2021-12-17T18:27:46.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f34600b02e0 0x7f346014a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40178/0 (socket says 172.21.15.62:40178) 2021-12-17T18:27:46.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345f7fe700 1 -- 172.21.15.62:0/2245540013 learned_addr learned my addr 172.21.15.62:0/2245540013 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:46.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f3457fff700 1 --2- 172.21.15.62:0/2245540013 >> v2:172.21.15.109:3300/0 conn(0x7f34600682c0 0x7f34600afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 -- 172.21.15.62:0/2245540013 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135993254 0 0) 0x7f34600ad8e0 con 0x7f34600b02e0 2021-12-17T18:27:46.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 -- 172.21.15.62:0/2245540013 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3440003260 con 0x7f34600b02e0 2021-12-17T18:27:46.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 -- 172.21.15.62:0/2245540013 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1710148607 0 0) 0x7f3440003260 con 0x7f34600b02e0 2021-12-17T18:27:46.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 -- 172.21.15.62:0/2245540013 >> v2:172.21.15.109:3300/0 conn(0x7f34600682c0 msgr2=0x7f34600afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:46.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 --2- 172.21.15.62:0/2245540013 >> v2:172.21.15.109:3300/0 conn(0x7f34600682c0 0x7f34600afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 -- 172.21.15.62:0/2245540013 >> v1:172.21.15.109:6789/0 conn(0x7f34600b5ea0 legacy=0x7f3460140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 -- 172.21.15.62:0/2245540013 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34600ac930 con 0x7f34600b02e0 2021-12-17T18:27:46.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 -- 172.21.15.62:0/2245540013 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f34580019e0 con 0x7f34600b02e0 2021-12-17T18:27:46.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 -- 172.21.15.62:0/2245540013 >> v1:172.21.15.62:6789/0 conn(0x7f34600b02e0 legacy=0x7f346014a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 --2- 172.21.15.62:0/2245540013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3440003750 0x7f3440003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 --2- 172.21.15.62:0/2245540013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3440004500 0x7f3440004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 --2- 172.21.15.62:0/2245540013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3440004e70 0x7f344000d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 -- 172.21.15.62:0/2245540013 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34600ad310 con 0x7f3440004e70 2021-12-17T18:27:46.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 -- 172.21.15.62:0/2245540013 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3440005720 con 0x7f3440003750 2021-12-17T18:27:46.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 -- 172.21.15.62:0/2245540013 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34400058e0 con 0x7f3440004500 2021-12-17T18:27:46.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345f7fe700 1 --2- 172.21.15.62:0/2245540013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3440004e70 0x7f344000d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f3457fff700 1 --2- 172.21.15.62:0/2245540013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3440004500 0x7f3440004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345effd700 1 --2- 172.21.15.62:0/2245540013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3440003750 0x7f3440003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345f7fe700 1 -- 172.21.15.62:0/2245540013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3440004500 msgr2=0x7f3440004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:46.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345f7fe700 1 --2- 172.21.15.62:0/2245540013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3440004500 0x7f3440004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345f7fe700 1 -- 172.21.15.62:0/2245540013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3440003750 msgr2=0x7f3440003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:46.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345f7fe700 1 --2- 172.21.15.62:0/2245540013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3440003750 0x7f3440003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345f7fe700 1 -- 172.21.15.62:0/2245540013 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3440003260 con 0x7f3440004e70 2021-12-17T18:27:46.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345f7fe700 1 -- 172.21.15.62:0/2245540013 reap_dead start 2021-12-17T18:27:46.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345f7fe700 1 --2- 172.21.15.62:0/2245540013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3440004e70 0x7f344000d960 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f34580016f0 tx=0x7f3458002190).ready entity=mon.0 client_cookie=f0e637e8f12c2d97 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:46.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 -- 172.21.15.62:0/2245540013 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f345800cd10 con 0x7f3440004e70 2021-12-17T18:27:46.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 -- 172.21.15.62:0/2245540013 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345800ce70 con 0x7f3440004e70 2021-12-17T18:27:46.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.933+0000 7f345e7fc700 1 -- 172.21.15.62:0/2245540013 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3458005b80 con 0x7f3440004e70 2021-12-17T18:27:46.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.937+0000 7f345ffff700 1 -- 172.21.15.62:0/2245540013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3440004e70 msgr2=0x7f344000d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.937+0000 7f345ffff700 1 --2- 172.21.15.62:0/2245540013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3440004e70 0x7f344000d960 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f34580016f0 tx=0x7f3458002190).stop 2021-12-17T18:27:46.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.937+0000 7f345ffff700 1 -- 172.21.15.62:0/2245540013 shutdown_connections 2021-12-17T18:27:46.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.937+0000 7f345ffff700 1 --2- 172.21.15.62:0/2245540013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3440004e70 0x7f344000d960 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.937+0000 7f345ffff700 1 -- 172.21.15.62:0/2245540013 >> 172.21.15.62:0/2245540013 conn(0x7f346005d220 msgr2=0x7f34600b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:46.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.937+0000 7f345ffff700 1 -- 172.21.15.62:0/2245540013 shutdown_connections 2021-12-17T18:27:46.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.937+0000 7f345ffff700 1 -- 172.21.15.62:0/2245540013 wait complete. 2021-12-17T18:27:46.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.937+0000 7f345ffff700 1 Processor -- start 2021-12-17T18:27:46.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.937+0000 7f345ffff700 1 -- start start 2021-12-17T18:27:46.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3440004e70 0x7f346009ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3460063b10 0x7f346014e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345ffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f346014e600 0x7f3460151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346009f520 con 0x7f3440004e70 2021-12-17T18:27:46.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345ffff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346014ed50 con 0x7f346014e600 2021-12-17T18:27:46.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345ffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34601432e0 con 0x7f3460063b10 2021-12-17T18:27:46.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3440004e70 0x7f346009ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3440004e70 0x7f346009ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56606/0 (socket says 172.21.15.62:56606) 2021-12-17T18:27:46.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345effd700 1 -- 172.21.15.62:0/1102718816 learned_addr learned my addr 172.21.15.62:0/1102718816 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:46.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f3457fff700 1 --2- 172.21.15.62:0/1102718816 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3460063b10 0x7f346014e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345f7fe700 1 --2- 172.21.15.62:0/1102718816 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f346014e600 0x7f3460151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345effd700 1 -- 172.21.15.62:0/1102718816 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3460063b10 msgr2=0x7f346014e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345effd700 1 --2- 172.21.15.62:0/1102718816 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3460063b10 0x7f346014e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345effd700 1 -- 172.21.15.62:0/1102718816 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f346014e600 msgr2=0x7f3460151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:46.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345effd700 1 --2- 172.21.15.62:0/1102718816 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f346014e600 0x7f3460151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:46.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345effd700 1 -- 172.21.15.62:0/1102718816 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346014ea60 con 0x7f3440004e70 2021-12-17T18:27:46.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f3457fff700 1 --2- 172.21.15.62:0/1102718816 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3460063b10 0x7f346014e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:46.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345effd700 1 --2- 172.21.15.62:0/1102718816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3440004e70 0x7f346009ec50 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f345000b000 tx=0x7f3450009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:46.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345cff9700 1 -- 172.21.15.62:0/1102718816 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34500155f0 con 0x7f3440004e70 2021-12-17T18:27:46.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345cff9700 1 -- 172.21.15.62:0/1102718816 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3450010040 con 0x7f3440004e70 2021-12-17T18:27:46.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345ffff700 1 -- 172.21.15.62:0/1102718816 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346009f140 con 0x7f3440004e70 2021-12-17T18:27:46.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345cff9700 1 -- 172.21.15.62:0/1102718816 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3450015940 con 0x7f3440004e70 2021-12-17T18:27:46.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345ffff700 1 -- 172.21.15.62:0/1102718816 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34600638b0 con 0x7f3440004e70 2021-12-17T18:27:46.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345ffff700 1 -- 172.21.15.62:0/1102718816 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346009f660 con 0x7f3440004e70 2021-12-17T18:27:46.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.941+0000 7f345cff9700 1 -- 172.21.15.62:0/1102718816 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3450015aa0 con 0x7f3440004e70 2021-12-17T18:27:46.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.945+0000 7f345cff9700 1 --2- 172.21.15.62:0/1102718816 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f34440536a0 0x7f3444055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:46.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.945+0000 7f345cff9700 1 -- 172.21.15.62:0/1102718816 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f345006ba20 con 0x7f3440004e70 2021-12-17T18:27:46.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.945+0000 7f3457fff700 1 --2- 172.21.15.62:0/1102718816 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f34440536a0 0x7f3444055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:46.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.945+0000 7f3457fff700 1 --2- 172.21.15.62:0/1102718816 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f34440536a0 0x7f3444055b60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f344800b000 tx=0x7f3448008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:46.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:46.949+0000 7f345cff9700 1 -- 172.21.15.62:0/1102718816 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3450042b80 con 0x7f3440004e70 2021-12-17T18:27:47.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.077+0000 7f345ffff700 1 -- 172.21.15.62:0/1102718816 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34600573d0 con 0x7f3440004e70 2021-12-17T18:27:47.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.077+0000 7f345cff9700 1 -- 172.21.15.62:0/1102718816 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+16113 (secure 0 0 0) 0x7f34500461a0 con 0x7f3440004e70 2021-12-17T18:27:47.084 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:47.084 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":140,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:27:46.811702+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:27:45.207337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-12-17T18:27:46.441638+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:27:47.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.081+0000 7f345ffff700 1 -- 172.21.15.62:0/1102718816 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f34440536a0 msgr2=0x7f3444055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.081+0000 7f345ffff700 1 --2- 172.21.15.62:0/1102718816 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f34440536a0 0x7f3444055b60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f344800b000 tx=0x7f3448008040).stop 2021-12-17T18:27:47.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.081+0000 7f345ffff700 1 -- 172.21.15.62:0/1102718816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3440004e70 msgr2=0x7f346009ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.086 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.081+0000 7f345ffff700 1 --2- 172.21.15.62:0/1102718816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3440004e70 0x7f346009ec50 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f345000b000 tx=0x7f3450009040).stop 2021-12-17T18:27:47.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.081+0000 7f345ffff700 1 -- 172.21.15.62:0/1102718816 shutdown_connections 2021-12-17T18:27:47.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.081+0000 7f345ffff700 1 --2- 172.21.15.62:0/1102718816 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f34440536a0 0x7f3444055b60 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.081+0000 7f345ffff700 1 --2- 172.21.15.62:0/1102718816 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f346014e600 0x7f3460151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.081+0000 7f345ffff700 1 --2- 172.21.15.62:0/1102718816 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3460063b10 0x7f346014e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.081+0000 7f345ffff700 1 --2- 172.21.15.62:0/1102718816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3440004e70 0x7f346009ec50 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.081+0000 7f345ffff700 1 -- 172.21.15.62:0/1102718816 >> 172.21.15.62:0/1102718816 conn(0x7f346005d220 msgr2=0x7f34600b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:47.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.081+0000 7f345ffff700 1 -- 172.21.15.62:0/1102718816 shutdown_connections 2021-12-17T18:27:47.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.081+0000 7f345ffff700 1 -- 172.21.15.62:0/1102718816 wait complete. 2021-12-17T18:27:47.097 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:27:47.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.193+0000 7fb800e40700 1 Processor -- start 2021-12-17T18:27:47.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.193+0000 7fb800e40700 1 -- start start 2021-12-17T18:27:47.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.193+0000 7fb800e40700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb7fc0afcf0 0x7fb7fc13d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.193+0000 7fb800e40700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7fc0b2e20 con 0x7fb7fc0b2a40 2021-12-17T18:27:47.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.193+0000 7fb800e40700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7fc0ae860 con 0x7fb7fc13fe00 2021-12-17T18:27:47.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.193+0000 7fb800e40700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc143800 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fb7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb7fc0b2a40 0x7fb7fc13cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40194/0 (socket says 172.21.15.62:40194) 2021-12-17T18:27:47.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fb7fe700 1 -- 172.21.15.62:0/2134881152 learned_addr learned my addr 172.21.15.62:0/2134881152 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:47.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7faffd700 1 --2- 172.21.15.62:0/2134881152 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb7fc0afcf0 0x7fb7fc13d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 -- 172.21.15.62:0/2134881152 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548803771 0 0) 0x7fb7fc0b2e20 con 0x7fb7fc0b2a40 2021-12-17T18:27:47.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 -- 172.21.15.62:0/2134881152 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e8003260 con 0x7fb7fc0b2a40 2021-12-17T18:27:47.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 -- 172.21.15.62:0/2134881152 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 635825999 0 0) 0x7fb7e8003260 con 0x7fb7fc0b2a40 2021-12-17T18:27:47.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 -- 172.21.15.62:0/2134881152 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb7fc0afcf0 msgr2=0x7fb7fc13d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:47.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 --2- 172.21.15.62:0/2134881152 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb7fc0afcf0 0x7fb7fc13d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 -- 172.21.15.62:0/2134881152 >> v1:172.21.15.109:6789/0 conn(0x7fb7fc13fe00 legacy=0x7fb7fc140220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 -- 172.21.15.62:0/2134881152 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc143aa0 con 0x7fb7fc0b2a40 2021-12-17T18:27:47.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 -- 172.21.15.62:0/2134881152 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fb7ec001660 con 0x7fb7fc0b2a40 2021-12-17T18:27:47.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 -- 172.21.15.62:0/2134881152 >> v1:172.21.15.62:6789/0 conn(0x7fb7fc0b2a40 legacy=0x7fb7fc13cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 --2- 172.21.15.62:0/2134881152 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb7e8003780 0x7fb7e8003b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 --2- 172.21.15.62:0/2134881152 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb7fc0afcf0 0x7fb7e8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 --2- 172.21.15.62:0/2134881152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7e80049f0 0x7fb7e8004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 -- 172.21.15.62:0/2134881152 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc143800 con 0x7fb7e80049f0 2021-12-17T18:27:47.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 -- 172.21.15.62:0/2134881152 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e800b750 con 0x7fb7e8003780 2021-12-17T18:27:47.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 -- 172.21.15.62:0/2134881152 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e800b8e0 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fb7fe700 1 --2- 172.21.15.62:0/2134881152 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb7e8003780 0x7fb7e8003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7faffd700 1 --2- 172.21.15.62:0/2134881152 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb7fc0afcf0 0x7fb7e8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fbfff700 1 --2- 172.21.15.62:0/2134881152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7e80049f0 0x7fb7e8004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7faffd700 1 -- 172.21.15.62:0/2134881152 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb7e8003780 msgr2=0x7fb7e8003b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:47.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7faffd700 1 --2- 172.21.15.62:0/2134881152 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb7e8003780 0x7fb7e8003b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7faffd700 1 -- 172.21.15.62:0/2134881152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7e80049f0 msgr2=0x7fb7e8004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:47.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7faffd700 1 --2- 172.21.15.62:0/2134881152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7e80049f0 0x7fb7e8004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7faffd700 1 -- 172.21.15.62:0/2134881152 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e8003260 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fb7fe700 1 --2- 172.21.15.62:0/2134881152 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb7e8003780 0x7fb7e8003b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:47.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fbfff700 1 --2- 172.21.15.62:0/2134881152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7e80049f0 0x7fb7e8004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:47.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7faffd700 1 --2- 172.21.15.62:0/2134881152 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb7fc0afcf0 0x7fb7e8004500 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fb7f000c000 tx=0x7fb7f0006df0).ready entity=mon.2 client_cookie=c0815f1cd91469b0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:47.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 -- 172.21.15.62:0/2134881152 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7f000e830 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 -- 172.21.15.62:0/2134881152 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f000e990 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fa7fc700 1 -- 172.21.15.62:0/2134881152 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7f000ecf0 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb800e40700 1 -- 172.21.15.62:0/2134881152 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb7fc0afcf0 msgr2=0x7fb7e8004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb800e40700 1 --2- 172.21.15.62:0/2134881152 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb7fc0afcf0 0x7fb7e8004500 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fb7f000c000 tx=0x7fb7f0006df0).stop 2021-12-17T18:27:47.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb7fbfff700 1 -- 172.21.15.62:0/2134881152 reap_dead start 2021-12-17T18:27:47.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb800e40700 1 -- 172.21.15.62:0/2134881152 shutdown_connections 2021-12-17T18:27:47.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb800e40700 1 -- 172.21.15.62:0/2134881152 >> 172.21.15.62:0/2134881152 conn(0x7fb7fc05c750 msgr2=0x7fb7fc05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:47.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.197+0000 7fb800e40700 1 -- 172.21.15.62:0/2134881152 shutdown_connections 2021-12-17T18:27:47.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb800e40700 1 -- 172.21.15.62:0/2134881152 wait complete. 2021-12-17T18:27:47.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb800e40700 1 Processor -- start 2021-12-17T18:27:47.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb800e40700 1 -- start start 2021-12-17T18:27:47.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb800e40700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7fc0afcf0 0x7fb7fc142790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb800e40700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb7fc150000 0x7fb7fc150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb800e40700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb7fc066cd0 0x7fb7fc150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb800e40700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc151000 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb800e40700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc120760 con 0x7fb7fc066cd0 2021-12-17T18:27:47.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb800e40700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc128b30 con 0x7fb7fc150000 2021-12-17T18:27:47.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb7fb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7fc0afcf0 0x7fb7fc142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb7fb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7fc0afcf0 0x7fb7fc142790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56626/0 (socket says 172.21.15.62:56626) 2021-12-17T18:27:47.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb7fb7fe700 1 -- 172.21.15.62:0/486785058 learned_addr learned my addr 172.21.15.62:0/486785058 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:47.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb7faffd700 1 --2- 172.21.15.62:0/486785058 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb7fc150000 0x7fb7fc150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb7fbfff700 1 --2- 172.21.15.62:0/486785058 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb7fc066cd0 0x7fb7fc150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb7fb7fe700 1 -- 172.21.15.62:0/486785058 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb7fc150000 msgr2=0x7fb7fc150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb7fb7fe700 1 --2- 172.21.15.62:0/486785058 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb7fc150000 0x7fb7fc150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb7fb7fe700 1 -- 172.21.15.62:0/486785058 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb7fc066cd0 msgr2=0x7fb7fc150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb7fb7fe700 1 --2- 172.21.15.62:0/486785058 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb7fc066cd0 0x7fb7fc150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb7fb7fe700 1 -- 172.21.15.62:0/486785058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc1204c0 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb7fb7fe700 1 --2- 172.21.15.62:0/486785058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7fc0afcf0 0x7fb7fc142790 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7fb7fc11fb20 tx=0x7fb7fc143c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:47.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.201+0000 7fb7f8ff9700 1 -- 172.21.15.62:0/486785058 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7ec00f7e0 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.205+0000 7fb7f8ff9700 1 -- 172.21.15.62:0/486785058 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec00f940 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.205+0000 7fb800e40700 1 -- 172.21.15.62:0/486785058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc128860 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.205+0000 7fb7f8ff9700 1 -- 172.21.15.62:0/486785058 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7ec00fca0 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.205+0000 7fb800e40700 1 -- 172.21.15.62:0/486785058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7fc066a90 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.205+0000 7fb800e40700 1 -- 172.21.15.62:0/486785058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7fc143d40 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.205+0000 7fb7f8ff9700 1 -- 172.21.15.62:0/486785058 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb7ec012350 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.205+0000 7fb7f8ff9700 1 --2- 172.21.15.62:0/486785058 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb7dc053580 0x7fb7dc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.205+0000 7fb7f8ff9700 1 -- 172.21.15.62:0/486785058 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb7ec06b570 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.205+0000 7fb7faffd700 1 --2- 172.21.15.62:0/486785058 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb7dc053580 0x7fb7dc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.209+0000 7fb7faffd700 1 --2- 172.21.15.62:0/486785058 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb7dc053580 0x7fb7dc055a40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fb7f001e000 tx=0x7fb7f0019000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:47.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.213+0000 7fb7f8ff9700 1 -- 172.21.15.62:0/486785058 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb7ec0425d0 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.337+0000 7fb800e40700 1 -- 172.21.15.62:0/486785058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7fc0573d0 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.341+0000 7fb7f8ff9700 1 -- 172.21.15.62:0/486785058 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+16113 (secure 0 0 0) 0x7fb7ec019020 con 0x7fb7fc0afcf0 2021-12-17T18:27:47.347 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:47.347 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":140,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:27:46.811702+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:27:45.207337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-12-17T18:27:46.441638+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:27:47.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.341+0000 7fb800e40700 1 -- 172.21.15.62:0/486785058 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb7dc053580 msgr2=0x7fb7dc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.341+0000 7fb800e40700 1 --2- 172.21.15.62:0/486785058 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb7dc053580 0x7fb7dc055a40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fb7f001e000 tx=0x7fb7f0019000).stop 2021-12-17T18:27:47.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.341+0000 7fb800e40700 1 -- 172.21.15.62:0/486785058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7fc0afcf0 msgr2=0x7fb7fc142790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.341+0000 7fb800e40700 1 --2- 172.21.15.62:0/486785058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7fc0afcf0 0x7fb7fc142790 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7fb7fc11fb20 tx=0x7fb7fc143c30).stop 2021-12-17T18:27:47.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.341+0000 7fb800e40700 1 -- 172.21.15.62:0/486785058 shutdown_connections 2021-12-17T18:27:47.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.341+0000 7fb800e40700 1 --2- 172.21.15.62:0/486785058 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb7dc053580 0x7fb7dc055a40 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.350 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.341+0000 7fb800e40700 1 --2- 172.21.15.62:0/486785058 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb7fc066cd0 0x7fb7fc150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.341+0000 7fb800e40700 1 --2- 172.21.15.62:0/486785058 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb7fc150000 0x7fb7fc150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.341+0000 7fb800e40700 1 --2- 172.21.15.62:0/486785058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7fc0afcf0 0x7fb7fc142790 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.351 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.341+0000 7fb800e40700 1 -- 172.21.15.62:0/486785058 >> 172.21.15.62:0/486785058 conn(0x7fb7fc05c750 msgr2=0x7fb7fc13e930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:47.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.341+0000 7fb800e40700 1 -- 172.21.15.62:0/486785058 shutdown_connections 2021-12-17T18:27:47.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.341+0000 7fb800e40700 1 -- 172.21.15.62:0/486785058 wait complete. 2021-12-17T18:27:47.360 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-12-17T18:27:47.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.465+0000 7f07a359e700 1 Processor -- start 2021-12-17T18:27:47.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.465+0000 7f07a359e700 1 -- start start 2021-12-17T18:27:47.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.465+0000 7f07a359e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f07a405ca90 0x7f07a40b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.465+0000 7f07a359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a40b0870 con 0x7f07a40b40b0 2021-12-17T18:27:47.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.465+0000 7f07a359e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a405ce70 con 0x7f07a40b47c0 2021-12-17T18:27:47.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.465+0000 7f07a359e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a40b05d0 con 0x7f07a405ca90 2021-12-17T18:27:47.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.465+0000 7f07a2d9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f07a40b40b0 0x7f07a4143ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40218/0 (socket says 172.21.15.62:40218) 2021-12-17T18:27:47.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.465+0000 7f07a2d9d700 1 -- 172.21.15.62:0/888790416 learned_addr learned my addr 172.21.15.62:0/888790416 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:47.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.465+0000 7f07a259c700 1 --2- 172.21.15.62:0/888790416 >> v2:172.21.15.109:3300/0 conn(0x7f07a405ca90 0x7f07a40b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.465+0000 7f07a159a700 1 -- 172.21.15.62:0/888790416 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884198751 0 0) 0x7f07a40b0870 con 0x7f07a40b40b0 2021-12-17T18:27:47.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.465+0000 7f07a159a700 1 -- 172.21.15.62:0/888790416 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0784003260 con 0x7f07a40b40b0 2021-12-17T18:27:47.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 -- 172.21.15.62:0/888790416 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334817857 0 0) 0x7f07a405ce70 con 0x7f07a40b47c0 2021-12-17T18:27:47.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 -- 172.21.15.62:0/888790416 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a40b0870 con 0x7f07a40b47c0 2021-12-17T18:27:47.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 -- 172.21.15.62:0/888790416 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3473001481 0 0) 0x7f0784003260 con 0x7f07a40b40b0 2021-12-17T18:27:47.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 -- 172.21.15.62:0/888790416 >> v2:172.21.15.109:3300/0 conn(0x7f07a405ca90 msgr2=0x7f07a40b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:47.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 --2- 172.21.15.62:0/888790416 >> v2:172.21.15.109:3300/0 conn(0x7f07a405ca90 0x7f07a40b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 -- 172.21.15.62:0/888790416 >> v1:172.21.15.109:6789/0 conn(0x7f07a40b47c0 legacy=0x7f07a40b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 -- 172.21.15.62:0/888790416 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a40b5250 con 0x7f07a40b40b0 2021-12-17T18:27:47.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 -- 172.21.15.62:0/888790416 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f079c0019e0 con 0x7f07a40b40b0 2021-12-17T18:27:47.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 -- 172.21.15.62:0/888790416 >> v1:172.21.15.62:6789/0 conn(0x7f07a40b40b0 legacy=0x7f07a4143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 --2- 172.21.15.62:0/888790416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07840038e0 0x7f0784003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 --2- 172.21.15.62:0/888790416 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0784004500 0x7f0784004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 --2- 172.21.15.62:0/888790416 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0784004e70 0x7f078400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 -- 172.21.15.62:0/888790416 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40b05d0 con 0x7f07840038e0 2021-12-17T18:27:47.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 -- 172.21.15.62:0/888790416 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078400bcf0 con 0x7f0784004e70 2021-12-17T18:27:47.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 -- 172.21.15.62:0/888790416 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078400beb0 con 0x7f0784004500 2021-12-17T18:27:47.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a259c700 1 --2- 172.21.15.62:0/888790416 >> v2:172.21.15.109:3300/0 conn(0x7f07a405ca90 0x7f07a40b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:47.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a1d9b700 1 --2- 172.21.15.62:0/888790416 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0784004500 0x7f0784004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a259c700 1 --2- 172.21.15.62:0/888790416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07840038e0 0x7f0784003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a2d9d700 1 --2- 172.21.15.62:0/888790416 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0784004e70 0x7f078400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a259c700 1 -- 172.21.15.62:0/888790416 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0784004500 msgr2=0x7f0784004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:47.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a259c700 1 --2- 172.21.15.62:0/888790416 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0784004500 0x7f0784004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a259c700 1 -- 172.21.15.62:0/888790416 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0784004e70 msgr2=0x7f078400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:47.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a259c700 1 --2- 172.21.15.62:0/888790416 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0784004e70 0x7f078400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a259c700 1 -- 172.21.15.62:0/888790416 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0784003260 con 0x7f07840038e0 2021-12-17T18:27:47.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a2d9d700 1 -- 172.21.15.62:0/888790416 reap_dead start 2021-12-17T18:27:47.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a259c700 1 --2- 172.21.15.62:0/888790416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07840038e0 0x7f0784003ce0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f078c00c000 tx=0x7f078c006df0).ready entity=mon.0 client_cookie=23d80f476c466796 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 -- 172.21.15.62:0/888790416 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f078c00e800 con 0x7f07840038e0 2021-12-17T18:27:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 -- 172.21.15.62:0/888790416 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c00e960 con 0x7f07840038e0 2021-12-17T18:27:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a159a700 1 -- 172.21.15.62:0/888790416 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f078c00ecc0 con 0x7f07840038e0 2021-12-17T18:27:47.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a359e700 1 -- 172.21.15.62:0/888790416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07840038e0 msgr2=0x7f0784003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a359e700 1 --2- 172.21.15.62:0/888790416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07840038e0 0x7f0784003ce0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f078c00c000 tx=0x7f078c006df0).stop 2021-12-17T18:27:47.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a359e700 1 -- 172.21.15.62:0/888790416 shutdown_connections 2021-12-17T18:27:47.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a359e700 1 --2- 172.21.15.62:0/888790416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07840038e0 0x7f0784003ce0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a359e700 1 -- 172.21.15.62:0/888790416 >> 172.21.15.62:0/888790416 conn(0x7f07a405bcd0 msgr2=0x7f07a4062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:47.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a359e700 1 -- 172.21.15.62:0/888790416 shutdown_connections 2021-12-17T18:27:47.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.469+0000 7f07a359e700 1 -- 172.21.15.62:0/888790416 wait complete. 2021-12-17T18:27:47.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.473+0000 7f07a359e700 1 Processor -- start 2021-12-17T18:27:47.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.473+0000 7f07a359e700 1 -- start start 2021-12-17T18:27:47.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.473+0000 7f07a359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f07840038e0 0x7f07a41532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.473+0000 7f07a359e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f07a40a6000 0x7f07a4155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.473+0000 7f07a359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07a4156200 0x7f07a4156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.473+0000 7f07a359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a4156b70 con 0x7f07a4156200 2021-12-17T18:27:47.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.473+0000 7f07a359e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a41525d0 con 0x7f07a40a6000 2021-12-17T18:27:47.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.473+0000 7f07a359e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a4066f00 con 0x7f07840038e0 2021-12-17T18:27:47.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f07a2d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07a4156200 0x7f07a4156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f07a259c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f07840038e0 0x7f07a41532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f07a1d9b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f07a40a6000 0x7f07a4155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f07a259c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f07840038e0 0x7f07a41532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:50348/0 (socket says 172.21.15.62:50348) 2021-12-17T18:27:47.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f07a259c700 1 -- 172.21.15.62:0/2950920044 learned_addr learned my addr 172.21.15.62:0/2950920044 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:47.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f07a2d9d700 1 -- 172.21.15.62:0/2950920044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f07840038e0 msgr2=0x7f07a41532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f07a2d9d700 1 --2- 172.21.15.62:0/2950920044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f07840038e0 0x7f07a41532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f07a2d9d700 1 -- 172.21.15.62:0/2950920044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f07a40a6000 msgr2=0x7f07a4155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f07a2d9d700 1 --2- 172.21.15.62:0/2950920044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f07a40a6000 0x7f07a4155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f07a2d9d700 1 -- 172.21.15.62:0/2950920044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a40a6480 con 0x7f07a4156200 2021-12-17T18:27:47.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f07a259c700 1 --2- 172.21.15.62:0/2950920044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f07840038e0 0x7f07a41532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:47.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f07a2d9d700 1 --2- 172.21.15.62:0/2950920044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07a4156200 0x7f07a4156680 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7f07a4066390 tx=0x7f07a40b1c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:47.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f079b7fe700 1 -- 172.21.15.62:0/2950920044 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f079c011780 con 0x7f07a4156200 2021-12-17T18:27:47.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f079b7fe700 1 -- 172.21.15.62:0/2950920044 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079c0118e0 con 0x7f07a4156200 2021-12-17T18:27:47.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f07a359e700 1 -- 172.21.15.62:0/2950920044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a4153870 con 0x7f07a4156200 2021-12-17T18:27:47.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f079b7fe700 1 -- 172.21.15.62:0/2950920044 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f079c011c40 con 0x7f07a4156200 2021-12-17T18:27:47.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f07a359e700 1 -- 172.21.15.62:0/2950920044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a4065f30 con 0x7f07a4156200 2021-12-17T18:27:47.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.477+0000 7f07a359e700 1 -- 172.21.15.62:0/2950920044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a4067100 con 0x7f07a4156200 2021-12-17T18:27:47.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.481+0000 7f079b7fe700 1 -- 172.21.15.62:0/2950920044 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f079c01c360 con 0x7f07a4156200 2021-12-17T18:27:47.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.481+0000 7f079b7fe700 1 --2- 172.21.15.62:0/2950920044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f07880536a0 0x7f0788055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.481+0000 7f079b7fe700 1 -- 172.21.15.62:0/2950920044 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f079c06b330 con 0x7f07a4156200 2021-12-17T18:27:47.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.481+0000 7f07a259c700 1 --2- 172.21.15.62:0/2950920044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f07880536a0 0x7f0788055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.481+0000 7f07a259c700 1 --2- 172.21.15.62:0/2950920044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f07880536a0 0x7f0788055b60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f078c01b000 tx=0x7f078c019000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:47.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.485+0000 7f079b7fe700 1 -- 172.21.15.62:0/2950920044 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f079c042430 con 0x7f07a4156200 2021-12-17T18:27:47.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.649+0000 7f07a359e700 1 -- 172.21.15.62:0/2950920044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f07a40b3980 con 0x7f07a4156200 2021-12-17T18:27:47.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.817+0000 7f079b7fe700 1 -- 172.21.15.62:0/2950920044 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v71) v1 ==== 118+0+0 (secure 0 0 0) 0x7f079c019020 con 0x7f07a4156200 2021-12-17T18:27:47.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.821+0000 7f07a359e700 1 -- 172.21.15.62:0/2950920044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f07880536a0 msgr2=0x7f0788055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.821+0000 7f07a359e700 1 --2- 172.21.15.62:0/2950920044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f07880536a0 0x7f0788055b60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f078c01b000 tx=0x7f078c019000).stop 2021-12-17T18:27:47.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.821+0000 7f07a359e700 1 -- 172.21.15.62:0/2950920044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07a4156200 msgr2=0x7f07a4156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.821+0000 7f07a359e700 1 --2- 172.21.15.62:0/2950920044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07a4156200 0x7f07a4156680 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7f07a4066390 tx=0x7f07a40b1c20).stop 2021-12-17T18:27:47.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.821+0000 7f07a359e700 1 -- 172.21.15.62:0/2950920044 shutdown_connections 2021-12-17T18:27:47.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.821+0000 7f07a359e700 1 --2- 172.21.15.62:0/2950920044 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f07880536a0 0x7f0788055b60 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.821+0000 7f07a359e700 1 --2- 172.21.15.62:0/2950920044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07a4156200 0x7f07a4156680 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.821+0000 7f07a359e700 1 --2- 172.21.15.62:0/2950920044 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f07a40a6000 0x7f07a4155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.821+0000 7f07a359e700 1 --2- 172.21.15.62:0/2950920044 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f07840038e0 0x7f07a41532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.821+0000 7f07a359e700 1 -- 172.21.15.62:0/2950920044 >> 172.21.15.62:0/2950920044 conn(0x7f07a405bcd0 msgr2=0x7f07a4146900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:47.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.821+0000 7f07a359e700 1 -- 172.21.15.62:0/2950920044 shutdown_connections 2021-12-17T18:27:47.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.821+0000 7f07a359e700 1 -- 172.21.15.62:0/2950920044 wait complete. 2021-12-17T18:27:47.844 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:47.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.941+0000 7f8011270700 1 Processor -- start 2021-12-17T18:27:47.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.941+0000 7f8011270700 1 -- start start 2021-12-17T18:27:47.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.941+0000 7f8011270700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f800c0b3eb0 0x7f800c145110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.941+0000 7f8011270700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800c0b27c0 con 0x7f800c1406a0 2021-12-17T18:27:47.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.941+0000 7f8011270700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800c144730 con 0x7f800c067770 2021-12-17T18:27:47.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.941+0000 7f8011270700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800c1449d0 con 0x7f800c0b3eb0 2021-12-17T18:27:47.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.941+0000 7f800b7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f800c1406a0 0x7f800c140b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40238/0 (socket says 172.21.15.62:40238) 2021-12-17T18:27:47.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.941+0000 7f800b7fe700 1 -- 172.21.15.62:0/3001607902 learned_addr learned my addr 172.21.15.62:0/3001607902 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:47.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.941+0000 7f800affd700 1 --2- 172.21.15.62:0/3001607902 >> v2:172.21.15.109:3300/0 conn(0x7f800c0b3eb0 0x7f800c145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.941+0000 7f8009ffb700 1 -- 172.21.15.62:0/3001607902 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701697172 0 0) 0x7f800c0b27c0 con 0x7f800c1406a0 2021-12-17T18:27:47.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.941+0000 7f8009ffb700 1 -- 172.21.15.62:0/3001607902 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ff0003260 con 0x7f800c1406a0 2021-12-17T18:27:47.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.941+0000 7f8009ffb700 1 -- 172.21.15.62:0/3001607902 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199481924 0 0) 0x7f800c144730 con 0x7f800c067770 2021-12-17T18:27:47.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.941+0000 7f8009ffb700 1 -- 172.21.15.62:0/3001607902 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f800c0b27c0 con 0x7f800c067770 2021-12-17T18:27:47.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.941+0000 7f8009ffb700 1 -- 172.21.15.62:0/3001607902 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2281671420 0 0) 0x7f7ff0003260 con 0x7f800c1406a0 2021-12-17T18:27:47.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.941+0000 7f800affd700 1 -- 172.21.15.62:0/3001607902 >> v1:172.21.15.109:6789/0 conn(0x7f800c067770 legacy=0x7f800c0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.941+0000 7f800affd700 1 -- 172.21.15.62:0/3001607902 >> v1:172.21.15.62:6789/0 conn(0x7f800c1406a0 legacy=0x7f800c140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.941+0000 7f800affd700 1 -- 172.21.15.62:0/3001607902 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c144c70 con 0x7f800c0b3eb0 2021-12-17T18:27:47.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.945+0000 7f800affd700 1 --2- 172.21.15.62:0/3001607902 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f800c0b3eb0 0x7f800c145110 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f8004001490 tx=0x7f8000006df0).ready entity=mon.1 client_cookie=14bae1101f30958a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:47.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.945+0000 7f8009ffb700 1 -- 172.21.15.62:0/3001607902 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80040019e0 con 0x7f800c0b3eb0 2021-12-17T18:27:47.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.945+0000 7f8009ffb700 1 -- 172.21.15.62:0/3001607902 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8000000e90 con 0x7f800c0b3eb0 2021-12-17T18:27:47.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.945+0000 7f8009ffb700 1 -- 172.21.15.62:0/3001607902 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8000011400 con 0x7f800c0b3eb0 2021-12-17T18:27:47.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.945+0000 7f8011270700 1 -- 172.21.15.62:0/3001607902 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f800c0b3eb0 msgr2=0x7f800c145110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.945+0000 7f8011270700 1 --2- 172.21.15.62:0/3001607902 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f800c0b3eb0 0x7f800c145110 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f8004001490 tx=0x7f8000006df0).stop 2021-12-17T18:27:47.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.945+0000 7f8011270700 1 -- 172.21.15.62:0/3001607902 shutdown_connections 2021-12-17T18:27:47.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.945+0000 7f8011270700 1 --2- 172.21.15.62:0/3001607902 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f800c0b3eb0 0x7f800c145110 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.945+0000 7f8011270700 1 -- 172.21.15.62:0/3001607902 >> 172.21.15.62:0/3001607902 conn(0x7f800c05cb40 msgr2=0x7f800c05cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:47.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.945+0000 7f8011270700 1 -- 172.21.15.62:0/3001607902 shutdown_connections 2021-12-17T18:27:47.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.945+0000 7f8011270700 1 -- 172.21.15.62:0/3001607902 wait complete. 2021-12-17T18:27:47.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.945+0000 7f8011270700 1 Processor -- start 2021-12-17T18:27:47.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.945+0000 7f8011270700 1 -- start start 2021-12-17T18:27:47.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f8011270700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f800c067770 0x7f800c0643b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f8011270700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f800c0b3eb0 0x7f800c0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f8011270700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f800c1406a0 0x7f800c0abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f8011270700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c0ad280 con 0x7f800c0b3eb0 2021-12-17T18:27:47.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f8011270700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c0ad620 con 0x7f800c067770 2021-12-17T18:27:47.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f8011270700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800c0ab8a0 con 0x7f800c1406a0 2021-12-17T18:27:47.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f800a7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f800c0b3eb0 0x7f800c0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f800a7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f800c0b3eb0 0x7f800c0aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56662/0 (socket says 172.21.15.62:56662) 2021-12-17T18:27:47.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f800a7fc700 1 -- 172.21.15.62:0/2921084114 learned_addr learned my addr 172.21.15.62:0/2921084114 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:47.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f800b7fe700 1 --2- 172.21.15.62:0/2921084114 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f800c1406a0 0x7f800c0abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f800affd700 1 --2- 172.21.15.62:0/2921084114 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f800c067770 0x7f800c0643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f800a7fc700 1 -- 172.21.15.62:0/2921084114 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f800c1406a0 msgr2=0x7f800c0abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f800a7fc700 1 --2- 172.21.15.62:0/2921084114 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f800c1406a0 0x7f800c0abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f800a7fc700 1 -- 172.21.15.62:0/2921084114 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f800c067770 msgr2=0x7f800c0643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:47.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f800a7fc700 1 --2- 172.21.15.62:0/2921084114 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f800c067770 0x7f800c0643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:47.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f800a7fc700 1 -- 172.21.15.62:0/2921084114 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800000b180 con 0x7f800c0b3eb0 2021-12-17T18:27:47.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f800a7fc700 1 --2- 172.21.15.62:0/2921084114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f800c0b3eb0 0x7f800c0aebb0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f7ffc001430 tx=0x7f7ffc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:47.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f7ffbfff700 1 -- 172.21.15.62:0/2921084114 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ffc003320 con 0x7f800c0b3eb0 2021-12-17T18:27:47.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f7ffbfff700 1 -- 172.21.15.62:0/2921084114 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc001510 con 0x7f800c0b3eb0 2021-12-17T18:27:47.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f8011270700 1 -- 172.21.15.62:0/2921084114 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800c0b1a60 con 0x7f800c0b3eb0 2021-12-17T18:27:47.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f7ffbfff700 1 -- 172.21.15.62:0/2921084114 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ffc001870 con 0x7f800c0b3eb0 2021-12-17T18:27:47.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f8011270700 1 -- 172.21.15.62:0/2921084114 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800c0ae420 con 0x7f800c0b3eb0 2021-12-17T18:27:47.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f8011270700 1 -- 172.21.15.62:0/2921084114 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800c145600 con 0x7f800c0b3eb0 2021-12-17T18:27:47.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.949+0000 7f7ffbfff700 1 -- 172.21.15.62:0/2921084114 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7ffc00f030 con 0x7f800c0b3eb0 2021-12-17T18:27:47.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.953+0000 7f7ffbfff700 1 --2- 172.21.15.62:0/2921084114 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fe8053610 0x7f7fe8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:47.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.953+0000 7f7ffbfff700 1 -- 172.21.15.62:0/2921084114 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7ffc06b7c0 con 0x7f800c0b3eb0 2021-12-17T18:27:47.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.953+0000 7f800affd700 1 --2- 172.21.15.62:0/2921084114 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fe8053610 0x7f7fe8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:47.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.953+0000 7f800affd700 1 --2- 172.21.15.62:0/2921084114 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fe8053610 0x7f7fe8055ad0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f8000019000 tx=0x7f800c1448c0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:47.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:47.957+0000 7f7ffbfff700 1 -- 172.21.15.62:0/2921084114 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7ffc042850 con 0x7f800c0b3eb0 2021-12-17T18:27:48.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.121+0000 7f8011270700 1 -- 172.21.15.62:0/2921084114 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f800c0573d0 con 0x7f800c0b3eb0 2021-12-17T18:27:48.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.125+0000 7f7ffbfff700 1 -- 172.21.15.62:0/2921084114 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f7ffc045e70 con 0x7f800c0b3eb0 2021-12-17T18:27:48.130 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:48.130 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":71,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8323,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4209581820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4209581820},{"type":"v1","addr":"172.21.15.62:6833","nonce":4209581820}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:27:46.812077+0000","modified":"2021-12-17T18:27:47.814929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8326},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8326":{"gid":8326,"name":"b","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/1293726231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1293726231},{"type":"v1","addr":"172.21.15.109:6835","nonce":1293726231}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-12-17T18:27:48.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.125+0000 7f8011270700 1 -- 172.21.15.62:0/2921084114 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fe8053610 msgr2=0x7f7fe8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.125+0000 7f8011270700 1 --2- 172.21.15.62:0/2921084114 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fe8053610 0x7f7fe8055ad0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f8000019000 tx=0x7f800c1448c0).stop 2021-12-17T18:27:48.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.125+0000 7f8011270700 1 -- 172.21.15.62:0/2921084114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f800c0b3eb0 msgr2=0x7f800c0aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.125+0000 7f8011270700 1 --2- 172.21.15.62:0/2921084114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f800c0b3eb0 0x7f800c0aebb0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f7ffc001430 tx=0x7f7ffc0090f0).stop 2021-12-17T18:27:48.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.125+0000 7f8011270700 1 -- 172.21.15.62:0/2921084114 shutdown_connections 2021-12-17T18:27:48.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.125+0000 7f8011270700 1 --2- 172.21.15.62:0/2921084114 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f7fe8053610 0x7f7fe8055ad0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.125+0000 7f8011270700 1 --2- 172.21.15.62:0/2921084114 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f800c1406a0 0x7f800c0abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.125+0000 7f8011270700 1 --2- 172.21.15.62:0/2921084114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f800c0b3eb0 0x7f800c0aebb0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.125+0000 7f8011270700 1 --2- 172.21.15.62:0/2921084114 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f800c067770 0x7f800c0643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.125+0000 7f8011270700 1 -- 172.21.15.62:0/2921084114 >> 172.21.15.62:0/2921084114 conn(0x7f800c05cb40 msgr2=0x7f800c0b2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:48.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.125+0000 7f8011270700 1 -- 172.21.15.62:0/2921084114 shutdown_connections 2021-12-17T18:27:48.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.125+0000 7f8011270700 1 -- 172.21.15.62:0/2921084114 wait complete. 2021-12-17T18:27:48.135 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 71 2021-12-17T18:27:48.142 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:27:48.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2bcfea700 1 Processor -- start 2021-12-17T18:27:48.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2bcfea700 1 -- start start 2021-12-17T18:27:48.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2bcfea700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc2b8065630 0x7fc2b8066bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2bcfea700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b8065a10 con 0x7fc2b80b1ff0 2021-12-17T18:27:48.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2bcfea700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b80670c0 con 0x7fc2b8144fa0 2021-12-17T18:27:48.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2bcfea700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b8067330 con 0x7fc2b8065630 2021-12-17T18:27:48.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b6ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc2b80b1ff0 0x7fc2b8144890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40248/0 (socket says 172.21.15.62:40248) 2021-12-17T18:27:48.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b6ffd700 1 -- 172.21.15.62:0/3476101607 learned_addr learned my addr 172.21.15.62:0/3476101607 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:48.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b77fe700 1 --2- 172.21.15.62:0/3476101607 >> v2:172.21.15.109:3300/0 conn(0x7fc2b8065630 0x7fc2b8066bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b67fc700 1 -- 172.21.15.62:0/3476101607 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462879396 0 0) 0x7fc2b8065a10 con 0x7fc2b80b1ff0 2021-12-17T18:27:48.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b67fc700 1 -- 172.21.15.62:0/3476101607 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc29c003260 con 0x7fc2b80b1ff0 2021-12-17T18:27:48.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b67fc700 1 -- 172.21.15.62:0/3476101607 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 645659502 0 0) 0x7fc29c003260 con 0x7fc2b80b1ff0 2021-12-17T18:27:48.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b67fc700 1 -- 172.21.15.62:0/3476101607 >> v2:172.21.15.109:3300/0 conn(0x7fc2b8065630 msgr2=0x7fc2b8066bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:48.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b67fc700 1 --2- 172.21.15.62:0/3476101607 >> v2:172.21.15.109:3300/0 conn(0x7fc2b8065630 0x7fc2b8066bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b67fc700 1 -- 172.21.15.62:0/3476101607 >> v1:172.21.15.109:6789/0 conn(0x7fc2b8144fa0 legacy=0x7fc2b81404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b67fc700 1 -- 172.21.15.62:0/3476101607 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b80675d0 con 0x7fc2b80b1ff0 2021-12-17T18:27:48.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b67fc700 1 -- 172.21.15.62:0/3476101607 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fc2a0001660 con 0x7fc2b80b1ff0 2021-12-17T18:27:48.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b67fc700 1 -- 172.21.15.62:0/3476101607 >> v1:172.21.15.62:6789/0 conn(0x7fc2b80b1ff0 legacy=0x7fc2b8144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b67fc700 1 --2- 172.21.15.62:0/3476101607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc29c003750 0x7fc29c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b67fc700 1 --2- 172.21.15.62:0/3476101607 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc29c004500 0x7fc29c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b67fc700 1 --2- 172.21.15.62:0/3476101607 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc29c004e70 0x7fc29c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b67fc700 1 -- 172.21.15.62:0/3476101607 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b8067330 con 0x7fc29c003750 2021-12-17T18:27:48.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b67fc700 1 -- 172.21.15.62:0/3476101607 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c00bd20 con 0x7fc29c004e70 2021-12-17T18:27:48.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.237+0000 7fc2b67fc700 1 -- 172.21.15.62:0/3476101607 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c00bee0 con 0x7fc29c004500 2021-12-17T18:27:48.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2b77fe700 1 --2- 172.21.15.62:0/3476101607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc29c003750 0x7fc29c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2b6ffd700 1 --2- 172.21.15.62:0/3476101607 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc29c004500 0x7fc29c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2b7fff700 1 --2- 172.21.15.62:0/3476101607 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc29c004e70 0x7fc29c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2b6ffd700 1 -- 172.21.15.62:0/3476101607 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc29c004e70 msgr2=0x7fc29c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:48.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2b6ffd700 1 --2- 172.21.15.62:0/3476101607 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc29c004e70 0x7fc29c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2b6ffd700 1 -- 172.21.15.62:0/3476101607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc29c003750 msgr2=0x7fc29c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:48.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2b6ffd700 1 --2- 172.21.15.62:0/3476101607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc29c003750 0x7fc29c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2b6ffd700 1 -- 172.21.15.62:0/3476101607 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c003260 con 0x7fc29c004500 2021-12-17T18:27:48.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2b7fff700 1 -- 172.21.15.62:0/3476101607 reap_dead start 2021-12-17T18:27:48.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2b6ffd700 1 --2- 172.21.15.62:0/3476101607 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc29c004500 0x7fc29c004980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fc2a0001370 tx=0x7fc2b8067760).ready entity=mon.2 client_cookie=cd95fd1e2de4e80a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:48.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2b67fc700 1 -- 172.21.15.62:0/3476101607 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2a00071a0 con 0x7fc29c004500 2021-12-17T18:27:48.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2b67fc700 1 -- 172.21.15.62:0/3476101607 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a0007300 con 0x7fc29c004500 2021-12-17T18:27:48.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2b67fc700 1 -- 172.21.15.62:0/3476101607 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2a000c8f0 con 0x7fc29c004500 2021-12-17T18:27:48.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2bcfea700 1 -- 172.21.15.62:0/3476101607 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc29c004500 msgr2=0x7fc29c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2bcfea700 1 --2- 172.21.15.62:0/3476101607 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc29c004500 0x7fc29c004980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fc2a0001370 tx=0x7fc2b8067760).stop 2021-12-17T18:27:48.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2bcfea700 1 -- 172.21.15.62:0/3476101607 shutdown_connections 2021-12-17T18:27:48.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2bcfea700 1 --2- 172.21.15.62:0/3476101607 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc29c004500 0x7fc29c004980 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2bcfea700 1 -- 172.21.15.62:0/3476101607 >> 172.21.15.62:0/3476101607 conn(0x7fc2b805c750 msgr2=0x7fc2b805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:48.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2bcfea700 1 -- 172.21.15.62:0/3476101607 shutdown_connections 2021-12-17T18:27:48.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2bcfea700 1 -- 172.21.15.62:0/3476101607 wait complete. 2021-12-17T18:27:48.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2bcfea700 1 Processor -- start 2021-12-17T18:27:48.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.241+0000 7fc2bcfea700 1 -- start start 2021-12-17T18:27:48.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2bcfea700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc29c004500 0x7fc2b8064b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2bcfea700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc2b8063ac0 0x7fc2b80b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2bcfea700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc2b80b58b0 0x7fc2b80b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2bcfea700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b80638c0 con 0x7fc29c004500 2021-12-17T18:27:48.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2bcfea700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b8064ff0 con 0x7fc2b8063ac0 2021-12-17T18:27:48.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2bcfea700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b80644f0 con 0x7fc2b80b58b0 2021-12-17T18:27:48.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2b77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc29c004500 0x7fc2b8064b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2b6ffd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc2b8063ac0 0x7fc2b80b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2b77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc29c004500 0x7fc2b8064b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56680/0 (socket says 172.21.15.62:56680) 2021-12-17T18:27:48.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2b7fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc2b80b58b0 0x7fc2b80b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2b77fe700 1 -- 172.21.15.62:0/3335959776 learned_addr learned my addr 172.21.15.62:0/3335959776 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:48.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2b6ffd700 1 -- 172.21.15.62:0/3335959776 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc2b80b58b0 msgr2=0x7fc2b80b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2b6ffd700 1 --2- 172.21.15.62:0/3335959776 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc2b80b58b0 0x7fc2b80b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2b6ffd700 1 -- 172.21.15.62:0/3335959776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc29c004500 msgr2=0x7fc2b8064b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2b6ffd700 1 --2- 172.21.15.62:0/3335959776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc29c004500 0x7fc2b8064b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2b6ffd700 1 -- 172.21.15.62:0/3335959776 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b80b1520 con 0x7fc2b8063ac0 2021-12-17T18:27:48.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2b7fff700 1 --2- 172.21.15.62:0/3335959776 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc2b80b58b0 0x7fc2b80b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:48.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2b6ffd700 1 --2- 172.21.15.62:0/3335959776 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc2b8063ac0 0x7fc2b80b53c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fc2a0001370 tx=0x7fc2a0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:48.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2b4ff9700 1 -- 172.21.15.62:0/3335959776 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2a000ccb0 con 0x7fc2b8063ac0 2021-12-17T18:27:48.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2bcfea700 1 -- 172.21.15.62:0/3335959776 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b8064750 con 0x7fc2b8063ac0 2021-12-17T18:27:48.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2b4ff9700 1 -- 172.21.15.62:0/3335959776 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a000ce10 con 0x7fc2b8063ac0 2021-12-17T18:27:48.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2b4ff9700 1 -- 172.21.15.62:0/3335959776 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2a0004710 con 0x7fc2b8063ac0 2021-12-17T18:27:48.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.245+0000 7fc2bcfea700 1 -- 172.21.15.62:0/3335959776 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b80b6750 con 0x7fc2b8063ac0 2021-12-17T18:27:48.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.249+0000 7fc2bcfea700 1 -- 172.21.15.62:0/3335959776 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b80573d0 con 0x7fc2b8063ac0 2021-12-17T18:27:48.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.249+0000 7fc2b4ff9700 1 -- 172.21.15.62:0/3335959776 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc2a0026070 con 0x7fc2b8063ac0 2021-12-17T18:27:48.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.249+0000 7fc2b4ff9700 1 --2- 172.21.15.62:0/3335959776 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc290053640 0x7fc290055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.249+0000 7fc2b4ff9700 1 -- 172.21.15.62:0/3335959776 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc2a006bd20 con 0x7fc2b8063ac0 2021-12-17T18:27:48.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.249+0000 7fc2b77fe700 1 --2- 172.21.15.62:0/3335959776 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc290053640 0x7fc290055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.249+0000 7fc2b77fe700 1 --2- 172.21.15.62:0/3335959776 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc290053640 0x7fc290055b00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fc2a800b000 tx=0x7fc2a8006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:48.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.257+0000 7fc2b4ff9700 1 -- 172.21.15.62:0/3335959776 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc2a0042de0 con 0x7fc2b8063ac0 2021-12-17T18:27:48.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.385+0000 7fc2bcfea700 1 -- 172.21.15.62:0/3335959776 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2b80b3e20 con 0x7fc2b8063ac0 2021-12-17T18:27:48.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.385+0000 7fc2b4ff9700 1 -- 172.21.15.62:0/3335959776 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+16100 (secure 0 0 0) 0x7fc2a001a030 con 0x7fc2b8063ac0 2021-12-17T18:27:48.392 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:48.392 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":141,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:27:47.815591+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:27:45.207337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-12-17T18:27:46.441638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:27:48.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.389+0000 7fc2bcfea700 1 -- 172.21.15.62:0/3335959776 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc290053640 msgr2=0x7fc290055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.389+0000 7fc2bcfea700 1 --2- 172.21.15.62:0/3335959776 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc290053640 0x7fc290055b00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fc2a800b000 tx=0x7fc2a8006df0).stop 2021-12-17T18:27:48.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.389+0000 7fc2bcfea700 1 -- 172.21.15.62:0/3335959776 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc2b8063ac0 msgr2=0x7fc2b80b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.389+0000 7fc2bcfea700 1 --2- 172.21.15.62:0/3335959776 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc2b8063ac0 0x7fc2b80b53c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fc2a0001370 tx=0x7fc2a0015000).stop 2021-12-17T18:27:48.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.389+0000 7fc2bcfea700 1 -- 172.21.15.62:0/3335959776 shutdown_connections 2021-12-17T18:27:48.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.389+0000 7fc2bcfea700 1 --2- 172.21.15.62:0/3335959776 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc290053640 0x7fc290055b00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.389+0000 7fc2bcfea700 1 --2- 172.21.15.62:0/3335959776 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc2b80b58b0 0x7fc2b80b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.389+0000 7fc2bcfea700 1 --2- 172.21.15.62:0/3335959776 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc2b8063ac0 0x7fc2b80b53c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.389+0000 7fc2bcfea700 1 --2- 172.21.15.62:0/3335959776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc29c004500 0x7fc2b8064b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.389+0000 7fc2bcfea700 1 -- 172.21.15.62:0/3335959776 >> 172.21.15.62:0/3335959776 conn(0x7fc2b805c750 msgr2=0x7fc2b813cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:48.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.389+0000 7fc2bcfea700 1 -- 172.21.15.62:0/3335959776 shutdown_connections 2021-12-17T18:27:48.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.389+0000 7fc2bcfea700 1 -- 172.21.15.62:0/3335959776 wait complete. 2021-12-17T18:27:48.411 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:27:48.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.525+0000 7f58d359e700 1 Processor -- start 2021-12-17T18:27:48.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.525+0000 7f58d359e700 1 -- start start 2021-12-17T18:27:48.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.525+0000 7f58d359e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f58d405fa70 0x7f58d4061390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.525+0000 7f58d359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f58d41405f0 0x7f58d4062450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.525+0000 7f58d359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d405fe50 con 0x7f58d4064de0 2021-12-17T18:27:48.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.525+0000 7f58d359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d40646a0 con 0x7f58d41405f0 2021-12-17T18:27:48.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.525+0000 7f58d359e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d4064940 con 0x7f58d405fa70 2021-12-17T18:27:48.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d2d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f58d41405f0 0x7f58d4062450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58c9d9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f58d4064de0 0x7f58d413fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40270/0 (socket says 172.21.15.62:40270) 2021-12-17T18:27:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58c9d9b700 1 -- 172.21.15.62:0/492611623 learned_addr learned my addr 172.21.15.62:0/492611623 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d259c700 1 --2- 172.21.15.62:0/492611623 >> v2:172.21.15.109:3300/0 conn(0x7f58d405fa70 0x7f58d4061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d2d9d700 1 -- 172.21.15.62:0/492611623 >> v2:172.21.15.109:3300/0 conn(0x7f58d405fa70 msgr2=0x7f58d4061390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:48.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d2d9d700 1 --2- 172.21.15.62:0/492611623 >> v2:172.21.15.109:3300/0 conn(0x7f58d405fa70 0x7f58d4061390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d2d9d700 1 -- 172.21.15.62:0/492611623 >> v1:172.21.15.62:6789/0 conn(0x7f58d4064de0 legacy=0x7f58d413fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d2d9d700 1 -- 172.21.15.62:0/492611623 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d4142e50 con 0x7f58d41405f0 2021-12-17T18:27:48.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d2d9d700 1 --2- 172.21.15.62:0/492611623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58d41405f0 0x7f58d4062450 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f58cc0032f0 tx=0x7f58cc0091d0).ready entity=mon.0 client_cookie=c4f26b407af85ca7 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:48.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d1d9b700 1 -- 172.21.15.62:0/492611623 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58cc00b680 con 0x7f58d41405f0 2021-12-17T18:27:48.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d1d9b700 1 -- 172.21.15.62:0/492611623 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc00b7e0 con 0x7f58d41405f0 2021-12-17T18:27:48.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d1d9b700 1 -- 172.21.15.62:0/492611623 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58cc00b950 con 0x7f58d41405f0 2021-12-17T18:27:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d359e700 1 -- 172.21.15.62:0/492611623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58d41405f0 msgr2=0x7f58d4062450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d359e700 1 --2- 172.21.15.62:0/492611623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58d41405f0 0x7f58d4062450 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f58cc0032f0 tx=0x7f58cc0091d0).stop 2021-12-17T18:27:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d359e700 1 -- 172.21.15.62:0/492611623 shutdown_connections 2021-12-17T18:27:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d359e700 1 --2- 172.21.15.62:0/492611623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58d41405f0 0x7f58d4062450 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d359e700 1 --2- 172.21.15.62:0/492611623 >> v2:172.21.15.109:3300/0 conn(0x7f58d405fa70 0x7f58d4061390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d359e700 1 -- 172.21.15.62:0/492611623 >> 172.21.15.62:0/492611623 conn(0x7f58d405bcd0 msgr2=0x7f58d4063510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d359e700 1 -- 172.21.15.62:0/492611623 shutdown_connections 2021-12-17T18:27:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d359e700 1 -- 172.21.15.62:0/492611623 wait complete. 2021-12-17T18:27:48.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d359e700 1 Processor -- start 2021-12-17T18:27:48.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.529+0000 7f58d359e700 1 -- start start 2021-12-17T18:27:48.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58d359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f58d405fa70 0x7f58d41179a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58d359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58d4064de0 0x7f58d4117e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58d359e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f58d41405f0 0x7f58d40af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58d359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d4114360 con 0x7f58d4064de0 2021-12-17T18:27:48.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58d359e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d413eb00 con 0x7f58d41405f0 2021-12-17T18:27:48.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58d359e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d4153400 con 0x7f58d405fa70 2021-12-17T18:27:48.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58c9d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58d4064de0 0x7f58d4117e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58c9d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58d4064de0 0x7f58d4117e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56696/0 (socket says 172.21.15.62:56696) 2021-12-17T18:27:48.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58d259c700 1 --2- 172.21.15.62:0/2916986995 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f58d405fa70 0x7f58d41179a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58c9d9b700 1 -- 172.21.15.62:0/2916986995 learned_addr learned my addr 172.21.15.62:0/2916986995 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:48.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58d2d9d700 1 --2- 172.21.15.62:0/2916986995 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f58d41405f0 0x7f58d40af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58c9d9b700 1 -- 172.21.15.62:0/2916986995 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f58d405fa70 msgr2=0x7f58d41179a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58c9d9b700 1 --2- 172.21.15.62:0/2916986995 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f58d405fa70 0x7f58d41179a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58c9d9b700 1 -- 172.21.15.62:0/2916986995 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f58d41405f0 msgr2=0x7f58d40af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58c9d9b700 1 --2- 172.21.15.62:0/2916986995 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f58d41405f0 0x7f58d40af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58c9d9b700 1 -- 172.21.15.62:0/2916986995 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc009470 con 0x7f58d4064de0 2021-12-17T18:27:48.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58d2d9d700 1 --2- 172.21.15.62:0/2916986995 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f58d41405f0 0x7f58d40af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:48.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58c9d9b700 1 --2- 172.21.15.62:0/2916986995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58d4064de0 0x7f58d4117e90 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f58d40b0ce0 tx=0x7f58bc007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:48.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58cbfff700 1 -- 172.21.15.62:0/2916986995 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58bc00ce30 con 0x7f58d4064de0 2021-12-17T18:27:48.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58cbfff700 1 -- 172.21.15.62:0/2916986995 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc0072e0 con 0x7f58d4064de0 2021-12-17T18:27:48.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58d359e700 1 -- 172.21.15.62:0/2916986995 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d4113c20 con 0x7f58d4064de0 2021-12-17T18:27:48.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58cbfff700 1 -- 172.21.15.62:0/2916986995 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58bc005800 con 0x7f58d4064de0 2021-12-17T18:27:48.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58d359e700 1 -- 172.21.15.62:0/2916986995 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d4152f50 con 0x7f58d4064de0 2021-12-17T18:27:48.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.533+0000 7f58d359e700 1 -- 172.21.15.62:0/2916986995 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d4153260 con 0x7f58d4064de0 2021-12-17T18:27:48.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.537+0000 7f58cbfff700 1 -- 172.21.15.62:0/2916986995 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f58bc010070 con 0x7f58d4064de0 2021-12-17T18:27:48.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.537+0000 7f58cbfff700 1 --2- 172.21.15.62:0/2916986995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f58b8053610 0x7f58b8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.537+0000 7f58cbfff700 1 -- 172.21.15.62:0/2916986995 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f58bc06afa0 con 0x7f58d4064de0 2021-12-17T18:27:48.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.537+0000 7f58d259c700 1 --2- 172.21.15.62:0/2916986995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f58b8053610 0x7f58b8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.537+0000 7f58d259c700 1 --2- 172.21.15.62:0/2916986995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f58b8053610 0x7f58b8055ad0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f58c400b000 tx=0x7f58c4006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:48.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.541+0000 7f58cbfff700 1 -- 172.21.15.62:0/2916986995 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f58d4153260 con 0x7f58d4064de0 2021-12-17T18:27:48.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.705+0000 7f58d359e700 1 -- 172.21.15.62:0/2916986995 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f58d4153260 con 0x7f58d4064de0 2021-12-17T18:27:48.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.709+0000 7f58cbfff700 1 -- 172.21.15.62:0/2916986995 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v42) v1 ==== 184+0+0 (secure 0 0 0) 0x7f58d4153260 con 0x7f58d4064de0 2021-12-17T18:27:48.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.713+0000 7f58d359e700 1 -- 172.21.15.62:0/2916986995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f58b8053610 msgr2=0x7f58b8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.713+0000 7f58d359e700 1 --2- 172.21.15.62:0/2916986995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f58b8053610 0x7f58b8055ad0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f58c400b000 tx=0x7f58c4006df0).stop 2021-12-17T18:27:48.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.713+0000 7f58d359e700 1 -- 172.21.15.62:0/2916986995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58d4064de0 msgr2=0x7f58d4117e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.713+0000 7f58d359e700 1 --2- 172.21.15.62:0/2916986995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58d4064de0 0x7f58d4117e90 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f58d40b0ce0 tx=0x7f58bc007c40).stop 2021-12-17T18:27:48.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.713+0000 7f58d359e700 1 -- 172.21.15.62:0/2916986995 shutdown_connections 2021-12-17T18:27:48.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.713+0000 7f58d359e700 1 --2- 172.21.15.62:0/2916986995 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f58b8053610 0x7f58b8055ad0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.713+0000 7f58d359e700 1 --2- 172.21.15.62:0/2916986995 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f58d41405f0 0x7f58d40af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.713+0000 7f58d359e700 1 --2- 172.21.15.62:0/2916986995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58d4064de0 0x7f58d4117e90 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.713+0000 7f58d359e700 1 --2- 172.21.15.62:0/2916986995 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f58d405fa70 0x7f58d41179a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.713+0000 7f58d359e700 1 -- 172.21.15.62:0/2916986995 >> 172.21.15.62:0/2916986995 conn(0x7f58d405bcd0 msgr2=0x7f58d40b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:48.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.713+0000 7f58d359e700 1 -- 172.21.15.62:0/2916986995 shutdown_connections 2021-12-17T18:27:48.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.713+0000 7f58d359e700 1 -- 172.21.15.62:0/2916986995 wait complete. 2021-12-17T18:27:48.725 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.0 2021-12-17T18:27:48.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:27:48.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b78062700 1 Processor -- start 2021-12-17T18:27:48.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b78062700 1 -- start start 2021-12-17T18:27:48.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b78062700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8b70142d70 0x7f8b701471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b78062700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b700b51a0 0x7f8b700b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b78062700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b700b09e0 con 0x7f8b700b4340 2021-12-17T18:27:48.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b78062700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b701467d0 con 0x7f8b70142d70 2021-12-17T18:27:48.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b78062700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b70146a70 con 0x7f8b700b51a0 2021-12-17T18:27:48.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b755fd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8b70142d70 0x7f8b701471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b755fd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8b70142d70 0x7f8b701471b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56704/0 (socket says 172.21.15.62:56704) 2021-12-17T18:27:48.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b755fd700 1 -- 172.21.15.62:0/165949862 learned_addr learned my addr 172.21.15.62:0/165949862 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:48.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b765ff700 1 --2- 172.21.15.62:0/165949862 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b700b51a0 0x7f8b700b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b755fd700 1 -- 172.21.15.62:0/165949862 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b700b51a0 msgr2=0x7f8b700b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:48.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b755fd700 1 --2- 172.21.15.62:0/165949862 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b700b51a0 0x7f8b700b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b755fd700 1 -- 172.21.15.62:0/165949862 >> v1:172.21.15.109:6789/0 conn(0x7f8b700b4340 legacy=0x7f8b70142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b755fd700 1 -- 172.21.15.62:0/165949862 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b70146d10 con 0x7f8b70142d70 2021-12-17T18:27:48.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b755fd700 1 --2- 172.21.15.62:0/165949862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b70142d70 0x7f8b701471b0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f8b64002f70 tx=0x7f8b64006eb0).ready entity=mon.0 client_cookie=cd82a01f3fb58940 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:48.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b74dfc700 1 -- 172.21.15.62:0/165949862 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b6400d570 con 0x7f8b70142d70 2021-12-17T18:27:48.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.845+0000 7f8b74dfc700 1 -- 172.21.15.62:0/165949862 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b64000e90 con 0x7f8b70142d70 2021-12-17T18:27:48.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.849+0000 7f8b74dfc700 1 -- 172.21.15.62:0/165949862 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b6400d900 con 0x7f8b70142d70 2021-12-17T18:27:48.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.849+0000 7f8b78062700 1 -- 172.21.15.62:0/165949862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b70142d70 msgr2=0x7f8b701471b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.849+0000 7f8b78062700 1 --2- 172.21.15.62:0/165949862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b70142d70 0x7f8b701471b0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f8b64002f70 tx=0x7f8b64006eb0).stop 2021-12-17T18:27:48.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.849+0000 7f8b78062700 1 -- 172.21.15.62:0/165949862 shutdown_connections 2021-12-17T18:27:48.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.849+0000 7f8b78062700 1 --2- 172.21.15.62:0/165949862 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b700b51a0 0x7f8b700b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.849+0000 7f8b78062700 1 --2- 172.21.15.62:0/165949862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b70142d70 0x7f8b701471b0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.849+0000 7f8b78062700 1 -- 172.21.15.62:0/165949862 >> 172.21.15.62:0/165949862 conn(0x7f8b7005c750 msgr2=0x7f8b7005cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:48.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.849+0000 7f8b78062700 1 -- 172.21.15.62:0/165949862 shutdown_connections 2021-12-17T18:27:48.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.849+0000 7f8b78062700 1 -- 172.21.15.62:0/165949862 wait complete. 2021-12-17T18:27:48.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.849+0000 7f8b78062700 1 Processor -- start 2021-12-17T18:27:48.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.849+0000 7f8b78062700 1 -- start start 2021-12-17T18:27:48.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b78062700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b700b4340 0x7f8b70149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b78062700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b700b51a0 0x7f8b7013fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b78062700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8b70142d70 0x7f8b70140050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b78062700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b70064050 con 0x7f8b700b51a0 2021-12-17T18:27:48.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b78062700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b70140540 con 0x7f8b70142d70 2021-12-17T18:27:48.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b78062700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b700b9440 con 0x7f8b700b4340 2021-12-17T18:27:48.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b755fd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b700b51a0 0x7f8b7013fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b755fd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b700b51a0 0x7f8b7013fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56710/0 (socket says 172.21.15.62:56710) 2021-12-17T18:27:48.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b755fd700 1 -- 172.21.15.62:0/2982163474 learned_addr learned my addr 172.21.15.62:0/2982163474 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:48.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b765ff700 1 --2- 172.21.15.62:0/2982163474 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8b70142d70 0x7f8b70140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b75dfe700 1 --2- 172.21.15.62:0/2982163474 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b700b4340 0x7f8b70149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b755fd700 1 -- 172.21.15.62:0/2982163474 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b700b4340 msgr2=0x7f8b70149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b755fd700 1 --2- 172.21.15.62:0/2982163474 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b700b4340 0x7f8b70149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b755fd700 1 -- 172.21.15.62:0/2982163474 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8b70142d70 msgr2=0x7f8b70140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:48.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b755fd700 1 --2- 172.21.15.62:0/2982163474 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8b70142d70 0x7f8b70140050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:48.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b755fd700 1 -- 172.21.15.62:0/2982163474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6400b1e0 con 0x7f8b700b51a0 2021-12-17T18:27:48.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b755fd700 1 --2- 172.21.15.62:0/2982163474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b700b51a0 0x7f8b7013fb60 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f8b64002f70 tx=0x7f8b64015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:48.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b62ffd700 1 -- 172.21.15.62:0/2982163474 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b64011760 con 0x7f8b700b51a0 2021-12-17T18:27:48.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b62ffd700 1 -- 172.21.15.62:0/2982163474 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b640118c0 con 0x7f8b700b51a0 2021-12-17T18:27:48.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b78062700 1 -- 172.21.15.62:0/2982163474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b700654d0 con 0x7f8b700b51a0 2021-12-17T18:27:48.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b62ffd700 1 -- 172.21.15.62:0/2982163474 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b64011c20 con 0x7f8b700b51a0 2021-12-17T18:27:48.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.853+0000 7f8b78062700 1 -- 172.21.15.62:0/2982163474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b700b9010 con 0x7f8b700b51a0 2021-12-17T18:27:48.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.857+0000 7f8b78062700 1 -- 172.21.15.62:0/2982163474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b700ba230 con 0x7f8b700b51a0 2021-12-17T18:27:48.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.857+0000 7f8b62ffd700 1 -- 172.21.15.62:0/2982163474 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8b64025030 con 0x7f8b700b51a0 2021-12-17T18:27:48.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.857+0000 7f8b62ffd700 1 --2- 172.21.15.62:0/2982163474 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8b58053580 0x7f8b58055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:48.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.857+0000 7f8b62ffd700 1 -- 172.21.15.62:0/2982163474 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8b6406c8f0 con 0x7f8b700b51a0 2021-12-17T18:27:48.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.857+0000 7f8b75dfe700 1 --2- 172.21.15.62:0/2982163474 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8b58053580 0x7f8b58055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:48.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.857+0000 7f8b75dfe700 1 --2- 172.21.15.62:0/2982163474 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8b58053580 0x7f8b58055a40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f8b6c00d000 tx=0x7f8b6c007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:48.870 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:48.861+0000 7f8b62ffd700 1 -- 172.21.15.62:0/2982163474 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8b700ba230 con 0x7f8b700b51a0 2021-12-17T18:27:49.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.029+0000 7f8b78062700 1 -- 172.21.15.62:0/2982163474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8b700ba230 con 0x7f8b700b51a0 2021-12-17T18:27:49.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.037+0000 7f8b62ffd700 1 -- 172.21.15.62:0/2982163474 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v43) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8b700ba230 con 0x7f8b700b51a0 2021-12-17T18:27:49.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.037+0000 7f8b78062700 1 -- 172.21.15.62:0/2982163474 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8b58053580 msgr2=0x7f8b58055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:49.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.037+0000 7f8b78062700 1 --2- 172.21.15.62:0/2982163474 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8b58053580 0x7f8b58055a40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f8b6c00d000 tx=0x7f8b6c007b90).stop 2021-12-17T18:27:49.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.037+0000 7f8b78062700 1 -- 172.21.15.62:0/2982163474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b700b51a0 msgr2=0x7f8b7013fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:49.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.037+0000 7f8b78062700 1 --2- 172.21.15.62:0/2982163474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b700b51a0 0x7f8b7013fb60 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f8b64002f70 tx=0x7f8b64015000).stop 2021-12-17T18:27:49.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.037+0000 7f8b78062700 1 -- 172.21.15.62:0/2982163474 shutdown_connections 2021-12-17T18:27:49.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.037+0000 7f8b78062700 1 --2- 172.21.15.62:0/2982163474 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8b58053580 0x7f8b58055a40 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.037+0000 7f8b78062700 1 --2- 172.21.15.62:0/2982163474 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8b70142d70 0x7f8b70140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.037+0000 7f8b78062700 1 --2- 172.21.15.62:0/2982163474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b700b51a0 0x7f8b7013fb60 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.037+0000 7f8b78062700 1 --2- 172.21.15.62:0/2982163474 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8b700b4340 0x7f8b70149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.037+0000 7f8b78062700 1 -- 172.21.15.62:0/2982163474 >> 172.21.15.62:0/2982163474 conn(0x7f8b7005c750 msgr2=0x7f8b701407f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:49.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.037+0000 7f8b78062700 1 -- 172.21.15.62:0/2982163474 shutdown_connections 2021-12-17T18:27:49.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.041+0000 7f8b78062700 1 -- 172.21.15.62:0/2982163474 wait complete. 2021-12-17T18:27:49.048 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.1 2021-12-17T18:27:49.057 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:27:49.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.169+0000 7f39d2762700 1 Processor -- start 2021-12-17T18:27:49.176 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.169+0000 7f39d2762700 1 -- start start 2021-12-17T18:27:49.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d2762700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f39cc05bcd0 0x7f39cc0ae050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:49.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d2762700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f39cc0ae540 0x7f39cc0ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:49.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d2762700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39cc0b6600 con 0x7f39cc05fa70 2021-12-17T18:27:49.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d2762700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39cc0627d0 con 0x7f39cc05bcd0 2021-12-17T18:27:49.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d2762700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39cc0ac470 con 0x7f39cc0ae540 2021-12-17T18:27:49.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d0f5f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f39cc05bcd0 0x7f39cc0ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:49.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d0f5f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f39cc05bcd0 0x7f39cc0ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56720/0 (socket says 172.21.15.62:56720) 2021-12-17T18:27:49.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d0f5f700 1 -- 172.21.15.62:0/1388705003 learned_addr learned my addr 172.21.15.62:0/1388705003 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:49.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d1f61700 1 --2- 172.21.15.62:0/1388705003 >> v2:172.21.15.109:3300/0 conn(0x7f39cc0ae540 0x7f39cc0ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:49.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d0f5f700 1 -- 172.21.15.62:0/1388705003 >> v2:172.21.15.109:3300/0 conn(0x7f39cc0ae540 msgr2=0x7f39cc0ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:49.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d0f5f700 1 --2- 172.21.15.62:0/1388705003 >> v2:172.21.15.109:3300/0 conn(0x7f39cc0ae540 0x7f39cc0ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d0f5f700 1 -- 172.21.15.62:0/1388705003 >> v1:172.21.15.109:6789/0 conn(0x7f39cc05fa70 legacy=0x7f39cc0b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:49.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d0f5f700 1 -- 172.21.15.62:0/1388705003 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc05fe50 con 0x7f39cc05bcd0 2021-12-17T18:27:49.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d0f5f700 1 --2- 172.21.15.62:0/1388705003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39cc05bcd0 0x7f39cc0ae050 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f39cc0b6ad0 tx=0x7f39bc006eb0).ready entity=mon.0 client_cookie=5610f3390d5dd85b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:49.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39c3fff700 1 -- 172.21.15.62:0/1388705003 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39bc00d5c0 con 0x7f39cc05bcd0 2021-12-17T18:27:49.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39c3fff700 1 -- 172.21.15.62:0/1388705003 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc000e90 con 0x7f39cc05bcd0 2021-12-17T18:27:49.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39c3fff700 1 -- 172.21.15.62:0/1388705003 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39bc00d950 con 0x7f39cc05bcd0 2021-12-17T18:27:49.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d2762700 1 -- 172.21.15.62:0/1388705003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39cc05bcd0 msgr2=0x7f39cc0ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:49.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d2762700 1 --2- 172.21.15.62:0/1388705003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39cc05bcd0 0x7f39cc0ae050 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f39cc0b6ad0 tx=0x7f39bc006eb0).stop 2021-12-17T18:27:49.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d2762700 1 -- 172.21.15.62:0/1388705003 shutdown_connections 2021-12-17T18:27:49.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d2762700 1 --2- 172.21.15.62:0/1388705003 >> v2:172.21.15.109:3300/0 conn(0x7f39cc0ae540 0x7f39cc0ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d2762700 1 --2- 172.21.15.62:0/1388705003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39cc05bcd0 0x7f39cc0ae050 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d2762700 1 -- 172.21.15.62:0/1388705003 >> 172.21.15.62:0/1388705003 conn(0x7f39cc0b5ae0 msgr2=0x7f39cc0b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:49.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d2762700 1 -- 172.21.15.62:0/1388705003 shutdown_connections 2021-12-17T18:27:49.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.173+0000 7f39d2762700 1 -- 172.21.15.62:0/1388705003 wait complete. 2021-12-17T18:27:49.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.177+0000 7f39d2762700 1 Processor -- start 2021-12-17T18:27:49.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.177+0000 7f39d2762700 1 -- start start 2021-12-17T18:27:49.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.177+0000 7f39d2762700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39cc05bcd0 0x7f39cc0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:49.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.177+0000 7f39d2762700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39cc05fa70 0x7f39cc065eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:49.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.177+0000 7f39d2762700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f39cc0ae540 0x7f39cc0663a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:49.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.177+0000 7f39d2762700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0a3b50 con 0x7f39cc05bcd0 2021-12-17T18:27:49.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.177+0000 7f39d2762700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0a5460 con 0x7f39cc0ae540 2021-12-17T18:27:49.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.177+0000 7f39d2762700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0a51c0 con 0x7f39cc05fa70 2021-12-17T18:27:49.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.177+0000 7f39d1760700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39cc05bcd0 0x7f39cc0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:49.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.177+0000 7f39d1760700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39cc05bcd0 0x7f39cc0aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56722/0 (socket says 172.21.15.62:56722) 2021-12-17T18:27:49.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.177+0000 7f39d1760700 1 -- 172.21.15.62:0/4206606126 learned_addr learned my addr 172.21.15.62:0/4206606126 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:49.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.177+0000 7f39d1f61700 1 --2- 172.21.15.62:0/4206606126 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f39cc0ae540 0x7f39cc0663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:49.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.177+0000 7f39d0f5f700 1 --2- 172.21.15.62:0/4206606126 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39cc05fa70 0x7f39cc065eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:49.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.181+0000 7f39d1760700 1 -- 172.21.15.62:0/4206606126 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39cc05fa70 msgr2=0x7f39cc065eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:49.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.181+0000 7f39d1760700 1 --2- 172.21.15.62:0/4206606126 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39cc05fa70 0x7f39cc065eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.181+0000 7f39d1760700 1 -- 172.21.15.62:0/4206606126 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f39cc0ae540 msgr2=0x7f39cc0663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:49.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.181+0000 7f39d1760700 1 --2- 172.21.15.62:0/4206606126 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f39cc0ae540 0x7f39cc0663a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.181+0000 7f39d1760700 1 -- 172.21.15.62:0/4206606126 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc00b1e0 con 0x7f39cc05bcd0 2021-12-17T18:27:49.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.181+0000 7f39d1760700 1 --2- 172.21.15.62:0/4206606126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39cc05bcd0 0x7f39cc0aef30 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f39c8001fa0 tx=0x7f39c8007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:49.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.181+0000 7f39c27fc700 1 -- 172.21.15.62:0/4206606126 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39c8007030 con 0x7f39cc05bcd0 2021-12-17T18:27:49.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.181+0000 7f39c27fc700 1 -- 172.21.15.62:0/4206606126 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c8007190 con 0x7f39cc05bcd0 2021-12-17T18:27:49.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.181+0000 7f39c27fc700 1 -- 172.21.15.62:0/4206606126 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39c8006510 con 0x7f39cc05bcd0 2021-12-17T18:27:49.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.181+0000 7f39d2762700 1 -- 172.21.15.62:0/4206606126 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39cc064f90 con 0x7f39cc05bcd0 2021-12-17T18:27:49.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.181+0000 7f39d2762700 1 -- 172.21.15.62:0/4206606126 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39cc065430 con 0x7f39cc05bcd0 2021-12-17T18:27:49.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.181+0000 7f39d2762700 1 -- 172.21.15.62:0/4206606126 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39cc0a5010 con 0x7f39cc05bcd0 2021-12-17T18:27:49.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.181+0000 7f39c27fc700 1 -- 172.21.15.62:0/4206606126 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f39c8010030 con 0x7f39cc05bcd0 2021-12-17T18:27:49.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.181+0000 7f39c27fc700 1 --2- 172.21.15.62:0/4206606126 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f39b40535b0 0x7f39b4055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:49.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.181+0000 7f39c27fc700 1 -- 172.21.15.62:0/4206606126 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f39c806b550 con 0x7f39cc05bcd0 2021-12-17T18:27:49.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.181+0000 7f39d0f5f700 1 --2- 172.21.15.62:0/4206606126 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f39b40535b0 0x7f39b4055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:49.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.185+0000 7f39d0f5f700 1 --2- 172.21.15.62:0/4206606126 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f39b40535b0 0x7f39b4055a70 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f39bc01c000 tx=0x7f39bc015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:49.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.185+0000 7f39c27fc700 1 -- 172.21.15.62:0/4206606126 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f39c80426b0 con 0x7f39cc05bcd0 2021-12-17T18:27:49.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.353+0000 7f39d2762700 1 -- 172.21.15.62:0/4206606126 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f39cc0b6830 con 0x7f39cc05bcd0 2021-12-17T18:27:49.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.357+0000 7f39c27fc700 1 -- 172.21.15.62:0/4206606126 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v44) v1 ==== 184+0+0 (secure 0 0 0) 0x7f39c8045cd0 con 0x7f39cc05bcd0 2021-12-17T18:27:49.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.361+0000 7f39d2762700 1 -- 172.21.15.62:0/4206606126 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f39b40535b0 msgr2=0x7f39b4055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:49.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.361+0000 7f39d2762700 1 --2- 172.21.15.62:0/4206606126 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f39b40535b0 0x7f39b4055a70 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f39bc01c000 tx=0x7f39bc015000).stop 2021-12-17T18:27:49.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.361+0000 7f39d2762700 1 -- 172.21.15.62:0/4206606126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39cc05bcd0 msgr2=0x7f39cc0aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:49.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.361+0000 7f39d2762700 1 --2- 172.21.15.62:0/4206606126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39cc05bcd0 0x7f39cc0aef30 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f39c8001fa0 tx=0x7f39c8007c30).stop 2021-12-17T18:27:49.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.361+0000 7f39d2762700 1 -- 172.21.15.62:0/4206606126 shutdown_connections 2021-12-17T18:27:49.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.361+0000 7f39d2762700 1 --2- 172.21.15.62:0/4206606126 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f39b40535b0 0x7f39b4055a70 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.361+0000 7f39d2762700 1 --2- 172.21.15.62:0/4206606126 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f39cc0ae540 0x7f39cc0663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.361+0000 7f39d2762700 1 --2- 172.21.15.62:0/4206606126 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f39cc05fa70 0x7f39cc065eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.361+0000 7f39d2762700 1 --2- 172.21.15.62:0/4206606126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39cc05bcd0 0x7f39cc0aef30 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.361+0000 7f39d2762700 1 -- 172.21.15.62:0/4206606126 >> 172.21.15.62:0/4206606126 conn(0x7f39cc0b5ae0 msgr2=0x7f39cc145440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:49.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.361+0000 7f39d2762700 1 -- 172.21.15.62:0/4206606126 shutdown_connections 2021-12-17T18:27:49.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.361+0000 7f39d2762700 1 -- 172.21.15.62:0/4206606126 wait complete. 2021-12-17T18:27:49.370 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.2 2021-12-17T18:27:49.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:49.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f56933c4700 1 Processor -- start 2021-12-17T18:27:49.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f56933c4700 1 -- start start 2021-12-17T18:27:49.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f56933c4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f568c05ffe0 0x7f568c0679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:49.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f56933c4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f568c0ad360 0x7f568c0b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:49.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f56933c4700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f568c0b57e0 0x7f568c0b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:49.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f56933c4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568c0b2e90 con 0x7f568c05ffe0 2021-12-17T18:27:49.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f56933c4700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568c0b4b70 con 0x7f568c0b57e0 2021-12-17T18:27:49.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f56933c4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568c0b4e10 con 0x7f568c0ad360 2021-12-17T18:27:49.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f5691160700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f568c05ffe0 0x7f568c0679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:49.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f5691160700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f568c05ffe0 0x7f568c0679c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56732/0 (socket says 172.21.15.62:56732) 2021-12-17T18:27:49.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f5691160700 1 -- 172.21.15.62:0/2799370497 learned_addr learned my addr 172.21.15.62:0/2799370497 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:49.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f569095f700 1 --2- 172.21.15.62:0/2799370497 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f568c0ad360 0x7f568c0b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:49.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f5691961700 1 --2- 172.21.15.62:0/2799370497 >> v2:172.21.15.109:3300/0 conn(0x7f568c0b57e0 0x7f568c0b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:49.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f5691160700 1 -- 172.21.15.62:0/2799370497 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f568c0ad360 msgr2=0x7f568c0b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:49.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f5691160700 1 --2- 172.21.15.62:0/2799370497 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f568c0ad360 0x7f568c0b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f5691160700 1 -- 172.21.15.62:0/2799370497 >> v2:172.21.15.109:3300/0 conn(0x7f568c0b57e0 msgr2=0x7f568c0b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:49.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f5691160700 1 --2- 172.21.15.62:0/2799370497 >> v2:172.21.15.109:3300/0 conn(0x7f568c0b57e0 0x7f568c0b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f5691160700 1 -- 172.21.15.62:0/2799370497 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c0b52b0 con 0x7f568c05ffe0 2021-12-17T18:27:49.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f5691160700 1 --2- 172.21.15.62:0/2799370497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f568c05ffe0 0x7f568c0679c0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f5688002f70 tx=0x7f5688006eb0).ready entity=mon.0 client_cookie=940a045a6b21f50e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:49.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f567bfff700 1 -- 172.21.15.62:0/2799370497 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f568800d570 con 0x7f568c05ffe0 2021-12-17T18:27:49.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f567bfff700 1 -- 172.21.15.62:0/2799370497 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5688000e90 con 0x7f568c05ffe0 2021-12-17T18:27:49.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f567bfff700 1 -- 172.21.15.62:0/2799370497 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f568800d900 con 0x7f568c05ffe0 2021-12-17T18:27:49.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f56933c4700 1 -- 172.21.15.62:0/2799370497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f568c05ffe0 msgr2=0x7f568c0679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:49.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f56933c4700 1 --2- 172.21.15.62:0/2799370497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f568c05ffe0 0x7f568c0679c0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f5688002f70 tx=0x7f5688006eb0).stop 2021-12-17T18:27:49.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f56933c4700 1 -- 172.21.15.62:0/2799370497 shutdown_connections 2021-12-17T18:27:49.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f56933c4700 1 --2- 172.21.15.62:0/2799370497 >> v2:172.21.15.109:3300/0 conn(0x7f568c0b57e0 0x7f568c0b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f56933c4700 1 --2- 172.21.15.62:0/2799370497 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f568c0ad360 0x7f568c0b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f56933c4700 1 --2- 172.21.15.62:0/2799370497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f568c05ffe0 0x7f568c0679c0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f56933c4700 1 -- 172.21.15.62:0/2799370497 >> 172.21.15.62:0/2799370497 conn(0x7f568c0626d0 msgr2=0x7f568c05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:49.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f56933c4700 1 -- 172.21.15.62:0/2799370497 shutdown_connections 2021-12-17T18:27:49.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.481+0000 7f56933c4700 1 -- 172.21.15.62:0/2799370497 wait complete. 2021-12-17T18:27:49.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.485+0000 7f56933c4700 1 Processor -- start 2021-12-17T18:27:49.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.485+0000 7f56933c4700 1 -- start start 2021-12-17T18:27:49.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.485+0000 7f56933c4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f568c05ffe0 0x7f568c0658e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:49.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.485+0000 7f56933c4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f568c0ad360 0x7f568c153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:49.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.485+0000 7f56933c4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f568c0b57e0 0x7f568c0b8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:49.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.485+0000 7f56933c4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c065dd0 con 0x7f568c05ffe0 2021-12-17T18:27:49.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.485+0000 7f56933c4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c153980 con 0x7f568c0ad360 2021-12-17T18:27:49.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.485+0000 7f56933c4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568c152ab0 con 0x7f568c0b57e0 2021-12-17T18:27:49.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.485+0000 7f5691160700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f568c05ffe0 0x7f568c0658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:49.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f5691160700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f568c05ffe0 0x7f568c0658e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56736/0 (socket says 172.21.15.62:56736) 2021-12-17T18:27:49.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f5691160700 1 -- 172.21.15.62:0/2136478798 learned_addr learned my addr 172.21.15.62:0/2136478798 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:49.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f5691961700 1 --2- 172.21.15.62:0/2136478798 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f568c0b57e0 0x7f568c0b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:49.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f569095f700 1 --2- 172.21.15.62:0/2136478798 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f568c0ad360 0x7f568c153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:49.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f5691160700 1 -- 172.21.15.62:0/2136478798 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f568c0b57e0 msgr2=0x7f568c0b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:49.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f5691160700 1 --2- 172.21.15.62:0/2136478798 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f568c0b57e0 0x7f568c0b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f5691160700 1 -- 172.21.15.62:0/2136478798 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f568c0ad360 msgr2=0x7f568c153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:49.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f5691160700 1 --2- 172.21.15.62:0/2136478798 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f568c0ad360 0x7f568c153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f5691160700 1 -- 172.21.15.62:0/2136478798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568800b1e0 con 0x7f568c05ffe0 2021-12-17T18:27:49.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f5691160700 1 --2- 172.21.15.62:0/2136478798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f568c05ffe0 0x7f568c0658e0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f568c065f10 tx=0x7f5688015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:49.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f567a7fc700 1 -- 172.21.15.62:0/2136478798 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f568800dea0 con 0x7f568c05ffe0 2021-12-17T18:27:49.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f56933c4700 1 -- 172.21.15.62:0/2136478798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568c152d50 con 0x7f568c05ffe0 2021-12-17T18:27:49.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f567a7fc700 1 -- 172.21.15.62:0/2136478798 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5688006b40 con 0x7f568c05ffe0 2021-12-17T18:27:49.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f56933c4700 1 -- 172.21.15.62:0/2136478798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568c0b89f0 con 0x7f568c05ffe0 2021-12-17T18:27:49.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f567a7fc700 1 -- 172.21.15.62:0/2136478798 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5688011e90 con 0x7f568c05ffe0 2021-12-17T18:27:49.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f56933c4700 1 -- 172.21.15.62:0/2136478798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f568c0b3ca0 con 0x7f568c05ffe0 2021-12-17T18:27:49.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f567a7fc700 1 -- 172.21.15.62:0/2136478798 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5688025030 con 0x7f568c05ffe0 2021-12-17T18:27:49.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f567a7fc700 1 --2- 172.21.15.62:0/2136478798 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f566c0536a0 0x7f566c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:49.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.489+0000 7f567a7fc700 1 -- 172.21.15.62:0/2136478798 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f568806cc20 con 0x7f568c05ffe0 2021-12-17T18:27:49.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.493+0000 7f569095f700 1 --2- 172.21.15.62:0/2136478798 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f566c0536a0 0x7f566c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:49.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.493+0000 7f569095f700 1 --2- 172.21.15.62:0/2136478798 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f566c0536a0 0x7f566c055b60 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f567c00b000 tx=0x7f567c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:49.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.497+0000 7f567a7fc700 1 -- 172.21.15.62:0/2136478798 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5688043ca0 con 0x7f568c05ffe0 2021-12-17T18:27:49.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.661+0000 7f56933c4700 1 -- 172.21.15.62:0/2136478798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f568c0573d0 con 0x7f568c05ffe0 2021-12-17T18:27:49.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.661+0000 7f567a7fc700 1 -- 172.21.15.62:0/2136478798 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f5688023070 con 0x7f568c05ffe0 2021-12-17T18:27:49.667 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:49.668 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":71,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8323,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4209581820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4209581820},{"type":"v1","addr":"172.21.15.62:6833","nonce":4209581820}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:27:46.812077+0000","modified":"2021-12-17T18:27:47.814929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8326},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8326":{"gid":8326,"name":"b","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/1293726231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1293726231},{"type":"v1","addr":"172.21.15.109:6835","nonce":1293726231}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-12-17T18:27:49.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.661+0000 7f56933c4700 1 -- 172.21.15.62:0/2136478798 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f566c0536a0 msgr2=0x7f566c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:49.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.661+0000 7f56933c4700 1 --2- 172.21.15.62:0/2136478798 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f566c0536a0 0x7f566c055b60 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f567c00b000 tx=0x7f567c008040).stop 2021-12-17T18:27:49.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.661+0000 7f56933c4700 1 -- 172.21.15.62:0/2136478798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f568c05ffe0 msgr2=0x7f568c0658e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:49.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.661+0000 7f56933c4700 1 --2- 172.21.15.62:0/2136478798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f568c05ffe0 0x7f568c0658e0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f568c065f10 tx=0x7f5688015000).stop 2021-12-17T18:27:49.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.665+0000 7f56933c4700 1 -- 172.21.15.62:0/2136478798 shutdown_connections 2021-12-17T18:27:49.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.665+0000 7f56933c4700 1 --2- 172.21.15.62:0/2136478798 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f566c0536a0 0x7f566c055b60 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.665+0000 7f56933c4700 1 --2- 172.21.15.62:0/2136478798 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f568c0b57e0 0x7f568c0b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.665+0000 7f56933c4700 1 --2- 172.21.15.62:0/2136478798 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f568c0ad360 0x7f568c153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.665+0000 7f56933c4700 1 --2- 172.21.15.62:0/2136478798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f568c05ffe0 0x7f568c0658e0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:49.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.665+0000 7f56933c4700 1 -- 172.21.15.62:0/2136478798 >> 172.21.15.62:0/2136478798 conn(0x7f568c0626d0 msgr2=0x7f568c141d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:49.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.665+0000 7f56933c4700 1 -- 172.21.15.62:0/2136478798 shutdown_connections 2021-12-17T18:27:49.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:49.665+0000 7f56933c4700 1 -- 172.21.15.62:0/2136478798 wait complete. 2021-12-17T18:27:49.672 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 71 2021-12-17T18:27:49.882 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:27:46.812077+0000', 'modified': '2021-12-17T18:27:47.814929+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8326}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8326': {'gid': 8326, 'name': 'b', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.109:6835/1293726231', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.109:6834', 'nonce': 1293726231}, {'type': 'v1', 'addr': '172.21.15.109:6835', 'nonce': 1293726231}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:27:49.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:27:49.883 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-12-17T18:27:49.997 INFO:teuthology.orchestra.run.smithi109.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":8326,"want_state":"up:active","state":"up:active","rank_uptime":3.1691221610000002,"mdsmap_epoch":71,"osdmap_epoch":141,"osdmap_epoch_barrier":140,"uptime":7.5488871660000001} 2021-12-17T18:27:49.997 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 8326, "mdsmap_epoch": 71, "osdmap_epoch": 141, "osdmap_epoch_barrier": 140, "rank_uptime": 3.169122161, "state": "up:active", "uptime": 7.548887166, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:27:49.998 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:27:50.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe2753cc700 1 Processor -- start 2021-12-17T18:27:50.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe2753cc700 1 -- start start 2021-12-17T18:27:50.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe2753cc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe27005fa70 0x7fe2700acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe2753cc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe2700b3c30 0x7fe2701415c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe2753cc700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2700ad500 con 0x7fe2700aa620 2021-12-17T18:27:50.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe2753cc700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2700b07f0 con 0x7fe2700b3c30 2021-12-17T18:27:50.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe2753cc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700ad2e0 con 0x7fe27005fa70 2021-12-17T18:27:50.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe26f7fe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe2700b3c30 0x7fe2701415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe26effd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe27005fa70 0x7fe2700acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe26f7fe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe2700b3c30 0x7fe2701415c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:35064/0 (socket says 172.21.15.62:35064) 2021-12-17T18:27:50.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe26f7fe700 1 -- 172.21.15.62:0/667111332 learned_addr learned my addr 172.21.15.62:0/667111332 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:50.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe26f7fe700 1 -- 172.21.15.62:0/667111332 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe27005fa70 msgr2=0x7fe2700acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:50.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe26f7fe700 1 --2- 172.21.15.62:0/667111332 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe27005fa70 0x7fe2700acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe26f7fe700 1 -- 172.21.15.62:0/667111332 >> v1:172.21.15.109:6789/0 conn(0x7fe2700aa620 legacy=0x7fe2700b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe26f7fe700 1 -- 172.21.15.62:0/667111332 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27005fe50 con 0x7fe2700b3c30 2021-12-17T18:27:50.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe26effd700 1 --2- 172.21.15.62:0/667111332 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe27005fa70 0x7fe2700acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:50.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe26f7fe700 1 --2- 172.21.15.62:0/667111332 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe2700b3c30 0x7fe2701415c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fe2700b0930 tx=0x7fe268009290).ready entity=mon.1 client_cookie=aa321923d55b2a87 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:50.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe26e7fc700 1 -- 172.21.15.62:0/667111332 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe26800b860 con 0x7fe2700b3c30 2021-12-17T18:27:50.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe26e7fc700 1 -- 172.21.15.62:0/667111332 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26800b9c0 con 0x7fe2700b3c30 2021-12-17T18:27:50.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe26e7fc700 1 -- 172.21.15.62:0/667111332 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe26800bb30 con 0x7fe2700b3c30 2021-12-17T18:27:50.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe2753cc700 1 -- 172.21.15.62:0/667111332 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe2700b3c30 msgr2=0x7fe2701415c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe2753cc700 1 --2- 172.21.15.62:0/667111332 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe2700b3c30 0x7fe2701415c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fe2700b0930 tx=0x7fe268009290).stop 2021-12-17T18:27:50.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe2753cc700 1 -- 172.21.15.62:0/667111332 shutdown_connections 2021-12-17T18:27:50.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe2753cc700 1 --2- 172.21.15.62:0/667111332 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe2700b3c30 0x7fe2701415c0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe2753cc700 1 --2- 172.21.15.62:0/667111332 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe27005fa70 0x7fe2700acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe2753cc700 1 -- 172.21.15.62:0/667111332 >> 172.21.15.62:0/667111332 conn(0x7fe27005bcd0 msgr2=0x7fe2700638c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:50.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe2753cc700 1 -- 172.21.15.62:0/667111332 shutdown_connections 2021-12-17T18:27:50.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.105+0000 7fe2753cc700 1 -- 172.21.15.62:0/667111332 wait complete. 2021-12-17T18:27:50.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe2753cc700 1 Processor -- start 2021-12-17T18:27:50.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe2753cc700 1 -- start start 2021-12-17T18:27:50.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe2753cc700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe27005fa70 0x7fe2700ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe2753cc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2700aa620 0x7fe270150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe2753cc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2700b3c30 0x7fe2701542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe2753cc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe270066b90 con 0x7fe2700b3c30 2021-12-17T18:27:50.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe2753cc700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700a1520 con 0x7fe27005fa70 2021-12-17T18:27:50.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe2753cc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe270153bf0 con 0x7fe2700aa620 2021-12-17T18:27:50.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe26f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2700b3c30 0x7fe2701542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe26effd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe27005fa70 0x7fe2700ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe26f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2700b3c30 0x7fe2701542f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56754/0 (socket says 172.21.15.62:56754) 2021-12-17T18:27:50.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe26f7fe700 1 -- 172.21.15.62:0/858487854 learned_addr learned my addr 172.21.15.62:0/858487854 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:50.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe2667fc700 1 --2- 172.21.15.62:0/858487854 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2700aa620 0x7fe270150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe26f7fe700 1 -- 172.21.15.62:0/858487854 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2700aa620 msgr2=0x7fe270150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe26f7fe700 1 --2- 172.21.15.62:0/858487854 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2700aa620 0x7fe270150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe26f7fe700 1 -- 172.21.15.62:0/858487854 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe27005fa70 msgr2=0x7fe2700ac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe26f7fe700 1 --2- 172.21.15.62:0/858487854 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe27005fa70 0x7fe2700ac2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe26f7fe700 1 -- 172.21.15.62:0/858487854 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26000b180 con 0x7fe2700b3c30 2021-12-17T18:27:50.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe26f7fe700 1 --2- 172.21.15.62:0/858487854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2700b3c30 0x7fe2701542f0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7fe2700b0930 tx=0x7fe268016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:50.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe26cff9700 1 -- 172.21.15.62:0/858487854 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe26800b860 con 0x7fe2700b3c30 2021-12-17T18:27:50.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe26cff9700 1 -- 172.21.15.62:0/858487854 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe268021630 con 0x7fe2700b3c30 2021-12-17T18:27:50.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe26cff9700 1 -- 172.21.15.62:0/858487854 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe268021990 con 0x7fe2700b3c30 2021-12-17T18:27:50.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe2753cc700 1 -- 172.21.15.62:0/858487854 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe268009530 con 0x7fe2700b3c30 2021-12-17T18:27:50.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.109+0000 7fe2753cc700 1 -- 172.21.15.62:0/858487854 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe270153e50 con 0x7fe2700b3c30 2021-12-17T18:27:50.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.113+0000 7fe2753cc700 1 -- 172.21.15.62:0/858487854 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe270150cb0 con 0x7fe2700b3c30 2021-12-17T18:27:50.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.113+0000 7fe26cff9700 1 -- 172.21.15.62:0/858487854 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe268027020 con 0x7fe2700b3c30 2021-12-17T18:27:50.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.113+0000 7fe26cff9700 1 --2- 172.21.15.62:0/858487854 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe254053610 0x7fe254055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.113+0000 7fe26cff9700 1 -- 172.21.15.62:0/858487854 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe26806cc00 con 0x7fe2700b3c30 2021-12-17T18:27:50.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.113+0000 7fe26effd700 1 --2- 172.21.15.62:0/858487854 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe254053610 0x7fe254055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.117+0000 7fe26effd700 1 --2- 172.21.15.62:0/858487854 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe254053610 0x7fe254055ad0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fe26000b000 tx=0x7fe260006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:50.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.125+0000 7fe26cff9700 1 -- 172.21.15.62:0/858487854 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe268043d60 con 0x7fe2700b3c30 2021-12-17T18:27:50.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.249+0000 7fe2753cc700 1 -- 172.21.15.62:0/858487854 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe270154010 con 0x7fe2700b3c30 2021-12-17T18:27:50.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.253+0000 7fe26cff9700 1 -- 172.21.15.62:0/858487854 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+16100 (secure 0 0 0) 0x7fe268015070 con 0x7fe2700b3c30 2021-12-17T18:27:50.258 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:50.258 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":141,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:27:47.815591+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:27:45.207337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-12-17T18:27:46.441638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:27:50.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.253+0000 7fe2753cc700 1 -- 172.21.15.62:0/858487854 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe254053610 msgr2=0x7fe254055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.253+0000 7fe2753cc700 1 --2- 172.21.15.62:0/858487854 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe254053610 0x7fe254055ad0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fe26000b000 tx=0x7fe260006df0).stop 2021-12-17T18:27:50.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.253+0000 7fe2753cc700 1 -- 172.21.15.62:0/858487854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2700b3c30 msgr2=0x7fe2701542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.253+0000 7fe2753cc700 1 --2- 172.21.15.62:0/858487854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2700b3c30 0x7fe2701542f0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7fe2700b0930 tx=0x7fe268016000).stop 2021-12-17T18:27:50.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.253+0000 7fe2753cc700 1 -- 172.21.15.62:0/858487854 shutdown_connections 2021-12-17T18:27:50.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.253+0000 7fe2753cc700 1 --2- 172.21.15.62:0/858487854 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe254053610 0x7fe254055ad0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.253+0000 7fe2753cc700 1 --2- 172.21.15.62:0/858487854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2700b3c30 0x7fe2701542f0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.253+0000 7fe2753cc700 1 --2- 172.21.15.62:0/858487854 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe2700aa620 0x7fe270150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.253+0000 7fe2753cc700 1 --2- 172.21.15.62:0/858487854 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe27005fa70 0x7fe2700ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.253+0000 7fe2753cc700 1 -- 172.21.15.62:0/858487854 >> 172.21.15.62:0/858487854 conn(0x7fe27005bcd0 msgr2=0x7fe2700b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:50.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.253+0000 7fe2753cc700 1 -- 172.21.15.62:0/858487854 shutdown_connections 2021-12-17T18:27:50.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.253+0000 7fe2753cc700 1 -- 172.21.15.62:0/858487854 wait complete. 2021-12-17T18:27:50.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:27:45.207337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '140', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:27:46.441638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:27:50.271 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:27:50.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.373+0000 7f9a05fb2700 1 Processor -- start 2021-12-17T18:27:50.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.373+0000 7f9a05fb2700 1 -- start start 2021-12-17T18:27:50.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f9a05fb2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a00064110 0x7f9a00143200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f9a05fb2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9a000ad630 0x7f9a0013f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f9a05fb2700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a00067840 con 0x7f9a000b6700 2021-12-17T18:27:50.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f9a05fb2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a00066840 con 0x7f9a00064110 2021-12-17T18:27:50.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f9a05fb2700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a00064b70 con 0x7f9a000ad630 2021-12-17T18:27:50.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f99fffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a00064110 0x7f9a00143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f99fffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a00064110 0x7f9a00143200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56760/0 (socket says 172.21.15.62:56760) 2021-12-17T18:27:50.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f99fffff700 1 -- 172.21.15.62:0/768441834 learned_addr learned my addr 172.21.15.62:0/768441834 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:50.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f9a057b1700 1 --2- 172.21.15.62:0/768441834 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9a000ad630 0x7f9a0013f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f99fffff700 1 -- 172.21.15.62:0/768441834 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9a000ad630 msgr2=0x7f9a0013f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:50.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f99fffff700 1 --2- 172.21.15.62:0/768441834 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9a000ad630 0x7f9a0013f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f99fffff700 1 -- 172.21.15.62:0/768441834 >> v1:172.21.15.109:6789/0 conn(0x7f9a000b6700 legacy=0x7f9a0005f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f99ff7fe700 1 -- 172.21.15.62:0/768441834 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455872377 0 0) 0x7f9a00067840 con 0x7f9a000b6700 2021-12-17T18:27:50.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f99fffff700 1 -- 172.21.15.62:0/768441834 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a000adac0 con 0x7f9a00064110 2021-12-17T18:27:50.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f99fffff700 1 --2- 172.21.15.62:0/768441834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a00064110 0x7f9a00143200 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f99ec002f70 tx=0x7f99ec006f40).ready entity=mon.0 client_cookie=ff9400bb1d2c00ff server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:50.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f99ff7fe700 1 -- 172.21.15.62:0/768441834 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99ec00da80 con 0x7f9a00064110 2021-12-17T18:27:50.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f99ff7fe700 1 -- 172.21.15.62:0/768441834 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ec000e90 con 0x7f9a00064110 2021-12-17T18:27:50.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f99ff7fe700 1 -- 172.21.15.62:0/768441834 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99ec00ddd0 con 0x7f9a00064110 2021-12-17T18:27:50.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f9a05fb2700 1 -- 172.21.15.62:0/768441834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a00064110 msgr2=0x7f9a00143200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f9a05fb2700 1 --2- 172.21.15.62:0/768441834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a00064110 0x7f9a00143200 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f99ec002f70 tx=0x7f99ec006f40).stop 2021-12-17T18:27:50.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f9a05fb2700 1 -- 172.21.15.62:0/768441834 shutdown_connections 2021-12-17T18:27:50.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f9a05fb2700 1 --2- 172.21.15.62:0/768441834 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9a000ad630 0x7f9a0013f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f9a05fb2700 1 --2- 172.21.15.62:0/768441834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a00064110 0x7f9a00143200 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f9a05fb2700 1 -- 172.21.15.62:0/768441834 >> 172.21.15.62:0/768441834 conn(0x7f9a0005c750 msgr2=0x7f9a000b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:50.393 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f9a05fb2700 1 -- 172.21.15.62:0/768441834 shutdown_connections 2021-12-17T18:27:50.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.377+0000 7f9a05fb2700 1 -- 172.21.15.62:0/768441834 wait complete. 2021-12-17T18:27:50.394 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a05fb2700 1 Processor -- start 2021-12-17T18:27:50.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a05fb2700 1 -- start start 2021-12-17T18:27:50.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a05fb2700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9a00064110 0x7f9a0013c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a05fb2700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9a000ad630 0x7f9a00151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.395 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a05fb2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a000b6700 0x7f9a0014de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a05fb2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a00151400 con 0x7f9a000b6700 2021-12-17T18:27:50.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a05fb2700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a00152260 con 0x7f9a00064110 2021-12-17T18:27:50.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a05fb2700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a000b0580 con 0x7f9a000ad630 2021-12-17T18:27:50.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a057b1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a000b6700 0x7f9a0014de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a057b1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a000b6700 0x7f9a0014de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56768/0 (socket says 172.21.15.62:56768) 2021-12-17T18:27:50.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a057b1700 1 -- 172.21.15.62:0/466466936 learned_addr learned my addr 172.21.15.62:0/466466936 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:50.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a04fb0700 1 --2- 172.21.15.62:0/466466936 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9a00064110 0x7f9a0013c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f99fffff700 1 --2- 172.21.15.62:0/466466936 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9a000ad630 0x7f9a00151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a057b1700 1 -- 172.21.15.62:0/466466936 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9a000ad630 msgr2=0x7f9a00151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a057b1700 1 --2- 172.21.15.62:0/466466936 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9a000ad630 0x7f9a00151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a057b1700 1 -- 172.21.15.62:0/466466936 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9a00064110 msgr2=0x7f9a0013c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a057b1700 1 --2- 172.21.15.62:0/466466936 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9a00064110 0x7f9a0013c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a057b1700 1 -- 172.21.15.62:0/466466936 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec00b460 con 0x7f9a000b6700 2021-12-17T18:27:50.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.381+0000 7f9a04fb0700 1 --2- 172.21.15.62:0/466466936 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9a00064110 0x7f9a0013c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:50.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.385+0000 7f99fffff700 1 --2- 172.21.15.62:0/466466936 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9a000ad630 0x7f9a00151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:50.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.385+0000 7f9a057b1700 1 --2- 172.21.15.62:0/466466936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a000b6700 0x7f9a0014de50 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7f9a001523f0 tx=0x7f99f80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:50.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.385+0000 7f99fdffb700 1 -- 172.21.15.62:0/466466936 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99f800c850 con 0x7f9a000b6700 2021-12-17T18:27:50.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.385+0000 7f99fdffb700 1 -- 172.21.15.62:0/466466936 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f800c9b0 con 0x7f9a000b6700 2021-12-17T18:27:50.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.385+0000 7f9a05fb2700 1 -- 172.21.15.62:0/466466936 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a00151630 con 0x7f9a000b6700 2021-12-17T18:27:50.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.385+0000 7f99fdffb700 1 -- 172.21.15.62:0/466466936 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99f800cd10 con 0x7f9a000b6700 2021-12-17T18:27:50.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.385+0000 7f9a05fb2700 1 -- 172.21.15.62:0/466466936 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a00110950 con 0x7f9a000b6700 2021-12-17T18:27:50.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.385+0000 7f9a05fb2700 1 -- 172.21.15.62:0/466466936 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a00110d40 con 0x7f9a000b6700 2021-12-17T18:27:50.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.385+0000 7f99fdffb700 1 -- 172.21.15.62:0/466466936 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f99f80123f0 con 0x7f9a000b6700 2021-12-17T18:27:50.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.385+0000 7f99fdffb700 1 --2- 172.21.15.62:0/466466936 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f99e00536d0 0x7f99e0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.385+0000 7f99fdffb700 1 -- 172.21.15.62:0/466466936 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f99f806bce0 con 0x7f9a000b6700 2021-12-17T18:27:50.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.385+0000 7f9a04fb0700 1 --2- 172.21.15.62:0/466466936 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f99e00536d0 0x7f99e0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.389+0000 7f9a04fb0700 1 --2- 172.21.15.62:0/466466936 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f99e00536d0 0x7f99e0055b90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f99f400b000 tx=0x7f99f4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:50.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.389+0000 7f99fdffb700 1 -- 172.21.15.62:0/466466936 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f99f8042de0 con 0x7f9a000b6700 2021-12-17T18:27:50.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.517+0000 7f9a05fb2700 1 -- 172.21.15.62:0/466466936 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9a00067a70 con 0x7f9a000b6700 2021-12-17T18:27:50.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.517+0000 7f99fdffb700 1 -- 172.21.15.62:0/466466936 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v141) v1 ==== 110+0+10 (secure 0 0 0) 0x7f99f8046400 con 0x7f9a000b6700 2021-12-17T18:27:50.525 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:27:50.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.521+0000 7f9a05fb2700 1 -- 172.21.15.62:0/466466936 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f99e00536d0 msgr2=0x7f99e0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.521+0000 7f9a05fb2700 1 --2- 172.21.15.62:0/466466936 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f99e00536d0 0x7f99e0055b90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f99f400b000 tx=0x7f99f4009040).stop 2021-12-17T18:27:50.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.521+0000 7f9a05fb2700 1 -- 172.21.15.62:0/466466936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a000b6700 msgr2=0x7f9a0014de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.521+0000 7f9a05fb2700 1 --2- 172.21.15.62:0/466466936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a000b6700 0x7f9a0014de50 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7f9a001523f0 tx=0x7f99f80091d0).stop 2021-12-17T18:27:50.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.521+0000 7f9a05fb2700 1 -- 172.21.15.62:0/466466936 shutdown_connections 2021-12-17T18:27:50.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.521+0000 7f9a05fb2700 1 --2- 172.21.15.62:0/466466936 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f99e00536d0 0x7f99e0055b90 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.521+0000 7f9a05fb2700 1 --2- 172.21.15.62:0/466466936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a000b6700 0x7f9a0014de50 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.521+0000 7f9a05fb2700 1 --2- 172.21.15.62:0/466466936 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9a000ad630 0x7f9a00151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.521+0000 7f9a05fb2700 1 --2- 172.21.15.62:0/466466936 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9a00064110 0x7f9a0013c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.521+0000 7f9a05fb2700 1 -- 172.21.15.62:0/466466936 >> 172.21.15.62:0/466466936 conn(0x7f9a0005c750 msgr2=0x7f9a0005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:50.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.521+0000 7f9a05fb2700 1 -- 172.21.15.62:0/466466936 shutdown_connections 2021-12-17T18:27:50.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.521+0000 7f9a05fb2700 1 -- 172.21.15.62:0/466466936 wait complete. 2021-12-17T18:27:50.543 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:27:50.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56d4931700 1 Processor -- start 2021-12-17T18:27:50.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56d4931700 1 -- start start 2021-12-17T18:27:50.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56d4931700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f56d005ca90 0x7f56d014b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56d4931700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56d00ac040 0x7f56d01475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56d4931700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d0060750 con 0x7f56d0147ab0 2021-12-17T18:27:50.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56d4931700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d014ac00 con 0x7f56d005ca90 2021-12-17T18:27:50.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56d4931700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d014aea0 con 0x7f56d00ac040 2021-12-17T18:27:50.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56cffff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f56d0147ab0 0x7f56d00b1ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40356/0 (socket says 172.21.15.62:40356) 2021-12-17T18:27:50.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56cffff700 1 -- 172.21.15.62:0/2017303096 learned_addr learned my addr 172.21.15.62:0/2017303096 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:50.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56ceffd700 1 --2- 172.21.15.62:0/2017303096 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56d00ac040 0x7f56d01475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56cf7fe700 1 --2- 172.21.15.62:0/2017303096 >> v2:172.21.15.109:3300/0 conn(0x7f56d005ca90 0x7f56d014b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56ce7fc700 1 -- 172.21.15.62:0/2017303096 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858210012 0 0) 0x7f56d0060750 con 0x7f56d0147ab0 2021-12-17T18:27:50.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56ce7fc700 1 -- 172.21.15.62:0/2017303096 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56bc003260 con 0x7f56d0147ab0 2021-12-17T18:27:50.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56ceffd700 1 -- 172.21.15.62:0/2017303096 >> v2:172.21.15.109:3300/0 conn(0x7f56d005ca90 msgr2=0x7f56d014b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:50.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56ceffd700 1 --2- 172.21.15.62:0/2017303096 >> v2:172.21.15.109:3300/0 conn(0x7f56d005ca90 0x7f56d014b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56ceffd700 1 -- 172.21.15.62:0/2017303096 >> v1:172.21.15.62:6789/0 conn(0x7f56d0147ab0 legacy=0x7f56d00b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56ceffd700 1 -- 172.21.15.62:0/2017303096 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d005ce70 con 0x7f56d00ac040 2021-12-17T18:27:50.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56ceffd700 1 --2- 172.21.15.62:0/2017303096 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56d00ac040 0x7f56d01475c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f56c0002f70 tx=0x7f56c0006df0).ready entity=mon.2 client_cookie=8ee6800a42287f03 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:50.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56ce7fc700 1 -- 172.21.15.62:0/2017303096 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56c000d4a0 con 0x7f56d00ac040 2021-12-17T18:27:50.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56ce7fc700 1 -- 172.21.15.62:0/2017303096 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c0000e90 con 0x7f56d00ac040 2021-12-17T18:27:50.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56ce7fc700 1 -- 172.21.15.62:0/2017303096 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56c000d7f0 con 0x7f56d00ac040 2021-12-17T18:27:50.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56d4931700 1 -- 172.21.15.62:0/2017303096 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56d00ac040 msgr2=0x7f56d01475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56d4931700 1 --2- 172.21.15.62:0/2017303096 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56d00ac040 0x7f56d01475c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f56c0002f70 tx=0x7f56c0006df0).stop 2021-12-17T18:27:50.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56d4931700 1 -- 172.21.15.62:0/2017303096 shutdown_connections 2021-12-17T18:27:50.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56d4931700 1 --2- 172.21.15.62:0/2017303096 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56d00ac040 0x7f56d01475c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56d4931700 1 --2- 172.21.15.62:0/2017303096 >> v2:172.21.15.109:3300/0 conn(0x7f56d005ca90 0x7f56d014b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56d4931700 1 -- 172.21.15.62:0/2017303096 >> 172.21.15.62:0/2017303096 conn(0x7f56d005be70 msgr2=0x7f56d0062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:50.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56d4931700 1 -- 172.21.15.62:0/2017303096 shutdown_connections 2021-12-17T18:27:50.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.649+0000 7f56d4931700 1 -- 172.21.15.62:0/2017303096 wait complete. 2021-12-17T18:27:50.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56d4931700 1 Processor -- start 2021-12-17T18:27:50.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56d4931700 1 -- start start 2021-12-17T18:27:50.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56d4931700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56d005ca90 0x7f56d00b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56d4931700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ac040 0x7f56d0063490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56d4931700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56d0147ab0 0x7f56d00ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56d4931700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d00a21e0 con 0x7f56d00ac040 2021-12-17T18:27:50.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56d4931700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d00aeb60 con 0x7f56d0147ab0 2021-12-17T18:27:50.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56d4931700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d015a780 con 0x7f56d005ca90 2021-12-17T18:27:50.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56ceffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ac040 0x7f56d0063490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56ceffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ac040 0x7f56d0063490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56778/0 (socket says 172.21.15.62:56778) 2021-12-17T18:27:50.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56ceffd700 1 -- 172.21.15.62:0/1135762857 learned_addr learned my addr 172.21.15.62:0/1135762857 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:50.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56cffff700 1 --2- 172.21.15.62:0/1135762857 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56d0147ab0 0x7f56d00ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56cf7fe700 1 --2- 172.21.15.62:0/1135762857 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56d005ca90 0x7f56d00b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56ceffd700 1 -- 172.21.15.62:0/1135762857 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56d005ca90 msgr2=0x7f56d00b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56ceffd700 1 --2- 172.21.15.62:0/1135762857 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56d005ca90 0x7f56d00b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56ceffd700 1 -- 172.21.15.62:0/1135762857 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56d0147ab0 msgr2=0x7f56d00ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56ceffd700 1 --2- 172.21.15.62:0/1135762857 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56d0147ab0 0x7f56d00ad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56ceffd700 1 -- 172.21.15.62:0/1135762857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c000b180 con 0x7f56d00ac040 2021-12-17T18:27:50.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56ceffd700 1 --2- 172.21.15.62:0/1135762857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ac040 0x7f56d0063490 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f56c0002f70 tx=0x7f56c0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:50.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56ccff9700 1 -- 172.21.15.62:0/1135762857 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56c0016070 con 0x7f56d00ac040 2021-12-17T18:27:50.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56ccff9700 1 -- 172.21.15.62:0/1135762857 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c00138d0 con 0x7f56d00ac040 2021-12-17T18:27:50.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56d4931700 1 -- 172.21.15.62:0/1135762857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d015aa20 con 0x7f56d00ac040 2021-12-17T18:27:50.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56ccff9700 1 -- 172.21.15.62:0/1135762857 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56c0013c30 con 0x7f56d00ac040 2021-12-17T18:27:50.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.653+0000 7f56d4931700 1 -- 172.21.15.62:0/1135762857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d00a2620 con 0x7f56d00ac040 2021-12-17T18:27:50.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.657+0000 7f56d4931700 1 -- 172.21.15.62:0/1135762857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d015abb0 con 0x7f56d00ac040 2021-12-17T18:27:50.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.657+0000 7f56ccff9700 1 -- 172.21.15.62:0/1135762857 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f56c0025030 con 0x7f56d00ac040 2021-12-17T18:27:50.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.657+0000 7f56ccff9700 1 --2- 172.21.15.62:0/1135762857 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56b00535b0 0x7f56b0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.657+0000 7f56ccff9700 1 -- 172.21.15.62:0/1135762857 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f56c006c990 con 0x7f56d00ac040 2021-12-17T18:27:50.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.657+0000 7f56cf7fe700 1 --2- 172.21.15.62:0/1135762857 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56b00535b0 0x7f56b0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.657+0000 7f56cf7fe700 1 --2- 172.21.15.62:0/1135762857 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56b00535b0 0x7f56b0055a70 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f56c400b000 tx=0x7f56c4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:50.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.665+0000 7f56ccff9700 1 -- 172.21.15.62:0/1135762857 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f56c00439e0 con 0x7f56d00ac040 2021-12-17T18:27:50.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.789+0000 7f56d4931700 1 -- 172.21.15.62:0/1135762857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f56d005fcb0 con 0x7f56d00ac040 2021-12-17T18:27:50.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.789+0000 7f56ccff9700 1 -- 172.21.15.62:0/1135762857 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v141) v1 ==== 92+0+10 (secure 0 0 0) 0x7f56c00230a0 con 0x7f56d00ac040 2021-12-17T18:27:50.795 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:27:50.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.789+0000 7f56d4931700 1 -- 172.21.15.62:0/1135762857 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56b00535b0 msgr2=0x7f56b0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.789+0000 7f56d4931700 1 --2- 172.21.15.62:0/1135762857 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56b00535b0 0x7f56b0055a70 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f56c400b000 tx=0x7f56c4008040).stop 2021-12-17T18:27:50.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.789+0000 7f56d4931700 1 -- 172.21.15.62:0/1135762857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ac040 msgr2=0x7f56d0063490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.793+0000 7f56d4931700 1 --2- 172.21.15.62:0/1135762857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ac040 0x7f56d0063490 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f56c0002f70 tx=0x7f56c0014000).stop 2021-12-17T18:27:50.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.793+0000 7f56d4931700 1 -- 172.21.15.62:0/1135762857 shutdown_connections 2021-12-17T18:27:50.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.793+0000 7f56d4931700 1 --2- 172.21.15.62:0/1135762857 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f56b00535b0 0x7f56b0055a70 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.793+0000 7f56d4931700 1 --2- 172.21.15.62:0/1135762857 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f56d0147ab0 0x7f56d00ad640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.793+0000 7f56d4931700 1 --2- 172.21.15.62:0/1135762857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ac040 0x7f56d0063490 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.793+0000 7f56d4931700 1 --2- 172.21.15.62:0/1135762857 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f56d005ca90 0x7f56d00b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.793+0000 7f56d4931700 1 -- 172.21.15.62:0/1135762857 >> 172.21.15.62:0/1135762857 conn(0x7f56d005be70 msgr2=0x7f56d0143a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:50.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.793+0000 7f56d4931700 1 -- 172.21.15.62:0/1135762857 shutdown_connections 2021-12-17T18:27:50.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.793+0000 7f56d4931700 1 -- 172.21.15.62:0/1135762857 wait complete. 2021-12-17T18:27:50.808 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:27:50.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f48a3028700 1 Processor -- start 2021-12-17T18:27:50.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f48a3028700 1 -- start start 2021-12-17T18:27:50.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f48a3028700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f489c0b3a40 0x7f489c0aabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f48a3028700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f489c0b2ee0 0x7f489c142410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f48a3028700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489c063c60 con 0x7f489c063880 2021-12-17T18:27:50.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f48a3028700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489c146840 con 0x7f489c0b2ee0 2021-12-17T18:27:50.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f48a3028700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489c0b6e50 con 0x7f489c0b3a40 2021-12-17T18:27:50.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f48a15c5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f489c0b2ee0 0x7f489c142410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f48a0dc4700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f489c063880 0x7f489c0aa4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:56686/0 (socket says 172.21.15.62:56686) 2021-12-17T18:27:50.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f48a15c5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f489c0b2ee0 0x7f489c142410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56788/0 (socket says 172.21.15.62:56788) 2021-12-17T18:27:50.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f48a0dc4700 1 -- 172.21.15.62:0/2668139433 learned_addr learned my addr 172.21.15.62:0/2668139433 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:50.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f489bfff700 1 --2- 172.21.15.62:0/2668139433 >> v2:172.21.15.109:3300/0 conn(0x7f489c0b3a40 0x7f489c0aabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f48a15c5700 1 -- 172.21.15.62:0/2668139433 >> v2:172.21.15.109:3300/0 conn(0x7f489c0b3a40 msgr2=0x7f489c0aabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:50.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f48a15c5700 1 --2- 172.21.15.62:0/2668139433 >> v2:172.21.15.109:3300/0 conn(0x7f489c0b3a40 0x7f489c0aabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f48a15c5700 1 -- 172.21.15.62:0/2668139433 >> v1:172.21.15.109:6789/0 conn(0x7f489c063880 legacy=0x7f489c0aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f489b7fe700 1 -- 172.21.15.62:0/2668139433 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605594099 0 0) 0x7f489c063c60 con 0x7f489c063880 2021-12-17T18:27:50.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f48a15c5700 1 -- 172.21.15.62:0/2668139433 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c0b70f0 con 0x7f489c0b2ee0 2021-12-17T18:27:50.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f48a15c5700 1 --2- 172.21.15.62:0/2668139433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f489c0b2ee0 0x7f489c142410 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f48940032f0 tx=0x7f48940091d0).ready entity=mon.0 client_cookie=2f7545e43aaa93e2 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:50.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.913+0000 7f489b7fe700 1 -- 172.21.15.62:0/2668139433 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f489400b680 con 0x7f489c0b2ee0 2021-12-17T18:27:50.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f489b7fe700 1 -- 172.21.15.62:0/2668139433 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489400b7e0 con 0x7f489c0b2ee0 2021-12-17T18:27:50.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f489b7fe700 1 -- 172.21.15.62:0/2668139433 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f489400b950 con 0x7f489c0b2ee0 2021-12-17T18:27:50.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a3028700 1 -- 172.21.15.62:0/2668139433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f489c0b2ee0 msgr2=0x7f489c142410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a3028700 1 --2- 172.21.15.62:0/2668139433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f489c0b2ee0 0x7f489c142410 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f48940032f0 tx=0x7f48940091d0).stop 2021-12-17T18:27:50.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a3028700 1 -- 172.21.15.62:0/2668139433 shutdown_connections 2021-12-17T18:27:50.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a3028700 1 --2- 172.21.15.62:0/2668139433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f489c0b2ee0 0x7f489c142410 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a3028700 1 --2- 172.21.15.62:0/2668139433 >> v2:172.21.15.109:3300/0 conn(0x7f489c0b3a40 0x7f489c0aabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a3028700 1 -- 172.21.15.62:0/2668139433 >> 172.21.15.62:0/2668139433 conn(0x7f489c0625b0 msgr2=0x7f489c062990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:50.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a3028700 1 -- 172.21.15.62:0/2668139433 shutdown_connections 2021-12-17T18:27:50.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a3028700 1 -- 172.21.15.62:0/2668139433 wait complete. 2021-12-17T18:27:50.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a3028700 1 Processor -- start 2021-12-17T18:27:50.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a3028700 1 -- start start 2021-12-17T18:27:50.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a3028700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f489c063880 0x7f489c0af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a3028700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f489c0b2ee0 0x7f489c0ab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a3028700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f489c0b3a40 0x7f489c065710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a3028700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0abf20 con 0x7f489c0b2ee0 2021-12-17T18:27:50.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a3028700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0afcc0 con 0x7f489c0b3a40 2021-12-17T18:27:50.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a3028700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0afef0 con 0x7f489c063880 2021-12-17T18:27:50.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f489bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f489c0b2ee0 0x7f489c0ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a0dc4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f489c063880 0x7f489c0af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f489bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f489c0b2ee0 0x7f489c0ab750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56796/0 (socket says 172.21.15.62:56796) 2021-12-17T18:27:50.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f489bfff700 1 -- 172.21.15.62:0/4007149525 learned_addr learned my addr 172.21.15.62:0/4007149525 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:50.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.917+0000 7f48a15c5700 1 --2- 172.21.15.62:0/4007149525 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f489c0b3a40 0x7f489c065710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.921+0000 7f489bfff700 1 -- 172.21.15.62:0/4007149525 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f489c063880 msgr2=0x7f489c0af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.921+0000 7f489bfff700 1 --2- 172.21.15.62:0/4007149525 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f489c063880 0x7f489c0af430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.921+0000 7f489bfff700 1 -- 172.21.15.62:0/4007149525 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f489c0b3a40 msgr2=0x7f489c065710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:50.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.921+0000 7f489bfff700 1 --2- 172.21.15.62:0/4007149525 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f489c0b3a40 0x7f489c065710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:50.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.921+0000 7f489bfff700 1 -- 172.21.15.62:0/4007149525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4894009470 con 0x7f489c0b2ee0 2021-12-17T18:27:50.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.921+0000 7f48a0dc4700 1 --2- 172.21.15.62:0/4007149525 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f489c063880 0x7f489c0af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:50.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.921+0000 7f489bfff700 1 --2- 172.21.15.62:0/4007149525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f489c0b2ee0 0x7f489c0ab750 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f489c0655b0 tx=0x7f4884006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:50.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.921+0000 7f4899ffb700 1 -- 172.21.15.62:0/4007149525 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4884010780 con 0x7f489c0b2ee0 2021-12-17T18:27:50.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.921+0000 7f4899ffb700 1 -- 172.21.15.62:0/4007149525 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48840108e0 con 0x7f489c0b2ee0 2021-12-17T18:27:50.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.921+0000 7f48a3028700 1 -- 172.21.15.62:0/4007149525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c0b0190 con 0x7f489c0b2ee0 2021-12-17T18:27:50.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.921+0000 7f4899ffb700 1 -- 172.21.15.62:0/4007149525 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4884010c40 con 0x7f489c0b2ee0 2021-12-17T18:27:50.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.921+0000 7f48a3028700 1 -- 172.21.15.62:0/4007149525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489c141700 con 0x7f489c0b2ee0 2021-12-17T18:27:50.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.921+0000 7f4899ffb700 1 -- 172.21.15.62:0/4007149525 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f488401c460 con 0x7f489c0b2ee0 2021-12-17T18:27:50.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.921+0000 7f48a3028700 1 -- 172.21.15.62:0/4007149525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489c0b1ac0 con 0x7f489c0b2ee0 2021-12-17T18:27:50.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.921+0000 7f4899ffb700 1 --2- 172.21.15.62:0/4007149525 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4880053580 0x7f4880055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:50.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.921+0000 7f4899ffb700 1 -- 172.21.15.62:0/4007149525 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f488406bc60 con 0x7f489c0b2ee0 2021-12-17T18:27:50.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.921+0000 7f48a0dc4700 1 --2- 172.21.15.62:0/4007149525 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4880053580 0x7f4880055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:50.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.925+0000 7f48a0dc4700 1 --2- 172.21.15.62:0/4007149525 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4880053580 0x7f4880055a40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f488c00d000 tx=0x7f488c007a00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:50.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:50.929+0000 7f4899ffb700 1 -- 172.21.15.62:0/4007149525 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4884042d60 con 0x7f489c0b2ee0 2021-12-17T18:27:51.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.061+0000 7f48a3028700 1 -- 172.21.15.62:0/4007149525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f489c0573d0 con 0x7f489c0b2ee0 2021-12-17T18:27:51.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.061+0000 7f4899ffb700 1 -- 172.21.15.62:0/4007149525 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v141) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4884046380 con 0x7f489c0b2ee0 2021-12-17T18:27:51.068 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:27:51.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.065+0000 7f48a3028700 1 -- 172.21.15.62:0/4007149525 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4880053580 msgr2=0x7f4880055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:51.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.065+0000 7f48a3028700 1 --2- 172.21.15.62:0/4007149525 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4880053580 0x7f4880055a40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f488c00d000 tx=0x7f488c007a00).stop 2021-12-17T18:27:51.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.065+0000 7f48a3028700 1 -- 172.21.15.62:0/4007149525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f489c0b2ee0 msgr2=0x7f489c0ab750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:51.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.065+0000 7f48a3028700 1 --2- 172.21.15.62:0/4007149525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f489c0b2ee0 0x7f489c0ab750 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f489c0655b0 tx=0x7f4884006df0).stop 2021-12-17T18:27:51.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.065+0000 7f48a3028700 1 -- 172.21.15.62:0/4007149525 shutdown_connections 2021-12-17T18:27:51.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.065+0000 7f48a3028700 1 --2- 172.21.15.62:0/4007149525 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4880053580 0x7f4880055a40 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.065+0000 7f48a3028700 1 --2- 172.21.15.62:0/4007149525 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f489c0b3a40 0x7f489c065710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.065+0000 7f48a3028700 1 --2- 172.21.15.62:0/4007149525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f489c0b2ee0 0x7f489c0ab750 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.065+0000 7f48a3028700 1 --2- 172.21.15.62:0/4007149525 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f489c063880 0x7f489c0af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.065+0000 7f48a3028700 1 -- 172.21.15.62:0/4007149525 >> 172.21.15.62:0/4007149525 conn(0x7f489c0625b0 msgr2=0x7f489c0aca20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:51.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.065+0000 7f48a3028700 1 -- 172.21.15.62:0/4007149525 shutdown_connections 2021-12-17T18:27:51.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.065+0000 7f48a3028700 1 -- 172.21.15.62:0/4007149525 wait complete. 2021-12-17T18:27:51.081 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:27:51.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.189+0000 7f2400931700 1 Processor -- start 2021-12-17T18:27:51.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.189+0000 7f2400931700 1 -- start start 2021-12-17T18:27:51.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.189+0000 7f2400931700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23fc0b3540 0x7f23fc0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:51.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.189+0000 7f2400931700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f23fc0b4230 0x7f23fc0b5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:51.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.189+0000 7f2400931700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23fc05ce70 con 0x7f23fc05ca90 2021-12-17T18:27:51.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.189+0000 7f2400931700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23fc0b1bc0 con 0x7f23fc0b4230 2021-12-17T18:27:51.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.189+0000 7f2400931700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc0b1e60 con 0x7f23fc0b3540 2021-12-17T18:27:51.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f23faffd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23fc0b3540 0x7f23fc0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:51.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f23fbfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f23fc0b4230 0x7f23fc0b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:51.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f23faffd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23fc0b3540 0x7f23fc0b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:50502/0 (socket says 172.21.15.62:50502) 2021-12-17T18:27:51.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f23faffd700 1 -- 172.21.15.62:0/3785222154 learned_addr learned my addr 172.21.15.62:0/3785222154 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:51.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f23fbfff700 1 -- 172.21.15.62:0/3785222154 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23fc0b3540 msgr2=0x7f23fc0b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:51.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f23fbfff700 1 --2- 172.21.15.62:0/3785222154 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23fc0b3540 0x7f23fc0b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f23fbfff700 1 -- 172.21.15.62:0/3785222154 >> v1:172.21.15.109:6789/0 conn(0x7f23fc05ca90 legacy=0x7f23fc0b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:51.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f23fbfff700 1 -- 172.21.15.62:0/3785222154 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc0b2100 con 0x7f23fc0b4230 2021-12-17T18:27:51.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f23fbfff700 1 --2- 172.21.15.62:0/3785222154 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f23fc0b4230 0x7f23fc0b5680 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f23f40032f0 tx=0x7f23f40091d0).ready entity=mon.1 client_cookie=472dc253fdac77e4 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:51.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f23fa7fc700 1 -- 172.21.15.62:0/3785222154 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23f400b6c0 con 0x7f23fc0b4230 2021-12-17T18:27:51.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f23fa7fc700 1 -- 172.21.15.62:0/3785222154 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f400b820 con 0x7f23fc0b4230 2021-12-17T18:27:51.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f23fa7fc700 1 -- 172.21.15.62:0/3785222154 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23f400b990 con 0x7f23fc0b4230 2021-12-17T18:27:51.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f2400931700 1 -- 172.21.15.62:0/3785222154 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f23fc0b4230 msgr2=0x7f23fc0b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:51.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f2400931700 1 --2- 172.21.15.62:0/3785222154 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f23fc0b4230 0x7f23fc0b5680 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f23f40032f0 tx=0x7f23f40091d0).stop 2021-12-17T18:27:51.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f2400931700 1 -- 172.21.15.62:0/3785222154 shutdown_connections 2021-12-17T18:27:51.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f2400931700 1 --2- 172.21.15.62:0/3785222154 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f23fc0b4230 0x7f23fc0b5680 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f2400931700 1 --2- 172.21.15.62:0/3785222154 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23fc0b3540 0x7f23fc0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f2400931700 1 -- 172.21.15.62:0/3785222154 >> 172.21.15.62:0/3785222154 conn(0x7f23fc05bcd0 msgr2=0x7f23fc062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:51.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f2400931700 1 -- 172.21.15.62:0/3785222154 shutdown_connections 2021-12-17T18:27:51.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f2400931700 1 -- 172.21.15.62:0/3785222154 wait complete. 2021-12-17T18:27:51.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.193+0000 7f2400931700 1 Processor -- start 2021-12-17T18:27:51.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f2400931700 1 -- start start 2021-12-17T18:27:51.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f2400931700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f23fc05ca90 0x7f23fc066770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:51.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f2400931700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23fc0b3540 0x7f23fc145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:51.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f2400931700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23fc0b4230 0x7f23fc149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:51.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f2400931700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc1496f0 con 0x7f23fc0b4230 2021-12-17T18:27:51.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f2400931700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc143590 con 0x7f23fc05ca90 2021-12-17T18:27:51.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f2400931700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc0a40e0 con 0x7f23fc0b3540 2021-12-17T18:27:51.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f23fbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23fc0b4230 0x7f23fc149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:51.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f23fbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23fc0b4230 0x7f23fc149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56808/0 (socket says 172.21.15.62:56808) 2021-12-17T18:27:51.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f23fbfff700 1 -- 172.21.15.62:0/1448420108 learned_addr learned my addr 172.21.15.62:0/1448420108 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:51.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f23faffd700 1 --2- 172.21.15.62:0/1448420108 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23fc0b3540 0x7f23fc145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:51.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f23fb7fe700 1 --2- 172.21.15.62:0/1448420108 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f23fc05ca90 0x7f23fc066770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:51.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f23fbfff700 1 -- 172.21.15.62:0/1448420108 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23fc0b3540 msgr2=0x7f23fc145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:51.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f23fbfff700 1 --2- 172.21.15.62:0/1448420108 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23fc0b3540 0x7f23fc145d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f23fbfff700 1 -- 172.21.15.62:0/1448420108 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f23fc05ca90 msgr2=0x7f23fc066770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:51.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f23fbfff700 1 --2- 172.21.15.62:0/1448420108 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f23fc05ca90 0x7f23fc066770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f23fbfff700 1 -- 172.21.15.62:0/1448420108 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f4009470 con 0x7f23fc0b4230 2021-12-17T18:27:51.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f23fbfff700 1 --2- 172.21.15.62:0/1448420108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23fc0b4230 0x7f23fc149200 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7f23f40032f0 tx=0x7f23f4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:51.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f23f8ff9700 1 -- 172.21.15.62:0/1448420108 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23f4011d70 con 0x7f23fc0b4230 2021-12-17T18:27:51.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f23f8ff9700 1 -- 172.21.15.62:0/1448420108 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f4021440 con 0x7f23fc0b4230 2021-12-17T18:27:51.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f2400931700 1 -- 172.21.15.62:0/1448420108 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23fc149910 con 0x7f23fc0b4230 2021-12-17T18:27:51.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f23f8ff9700 1 -- 172.21.15.62:0/1448420108 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23f40217a0 con 0x7f23fc0b4230 2021-12-17T18:27:51.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.197+0000 7f2400931700 1 -- 172.21.15.62:0/1448420108 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23fc148930 con 0x7f23fc0b4230 2021-12-17T18:27:51.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.201+0000 7f2400931700 1 -- 172.21.15.62:0/1448420108 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23fc0603f0 con 0x7f23fc0b4230 2021-12-17T18:27:51.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.201+0000 7f23f8ff9700 1 -- 172.21.15.62:0/1448420108 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f23f4029070 con 0x7f23fc0b4230 2021-12-17T18:27:51.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.201+0000 7f23f8ff9700 1 --2- 172.21.15.62:0/1448420108 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f23dc0536d0 0x7f23dc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:51.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.201+0000 7f23f8ff9700 1 -- 172.21.15.62:0/1448420108 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f23f406c8a0 con 0x7f23fc0b4230 2021-12-17T18:27:51.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.201+0000 7f23fb7fe700 1 --2- 172.21.15.62:0/1448420108 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f23dc0536d0 0x7f23dc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:51.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.201+0000 7f23fb7fe700 1 --2- 172.21.15.62:0/1448420108 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f23dc0536d0 0x7f23dc055b90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f23f000d000 tx=0x7f23f0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:51.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.209+0000 7f23f8ff9700 1 -- 172.21.15.62:0/1448420108 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f23f40439e0 con 0x7f23fc0b4230 2021-12-17T18:27:51.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.336+0000 7f2400931700 1 -- 172.21.15.62:0/1448420108 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f23fc0573d0 con 0x7f23fc0b4230 2021-12-17T18:27:51.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.336+0000 7f23f8ff9700 1 -- 172.21.15.62:0/1448420108 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v141) v1 ==== 100+0+10 (secure 0 0 0) 0x7f23f4015070 con 0x7f23fc0b4230 2021-12-17T18:27:51.342 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:27:51.344 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.336+0000 7f2400931700 1 -- 172.21.15.62:0/1448420108 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f23dc0536d0 msgr2=0x7f23dc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:51.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.336+0000 7f2400931700 1 --2- 172.21.15.62:0/1448420108 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f23dc0536d0 0x7f23dc055b90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f23f000d000 tx=0x7f23f0009040).stop 2021-12-17T18:27:51.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.336+0000 7f2400931700 1 -- 172.21.15.62:0/1448420108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23fc0b4230 msgr2=0x7f23fc149200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:51.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.336+0000 7f2400931700 1 --2- 172.21.15.62:0/1448420108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23fc0b4230 0x7f23fc149200 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7f23f40032f0 tx=0x7f23f4016000).stop 2021-12-17T18:27:51.345 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.336+0000 7f2400931700 1 -- 172.21.15.62:0/1448420108 shutdown_connections 2021-12-17T18:27:51.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.336+0000 7f2400931700 1 --2- 172.21.15.62:0/1448420108 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f23dc0536d0 0x7f23dc055b90 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.336+0000 7f2400931700 1 --2- 172.21.15.62:0/1448420108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23fc0b4230 0x7f23fc149200 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.336+0000 7f2400931700 1 --2- 172.21.15.62:0/1448420108 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23fc0b3540 0x7f23fc145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.346 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.336+0000 7f2400931700 1 --2- 172.21.15.62:0/1448420108 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f23fc05ca90 0x7f23fc066770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.336+0000 7f2400931700 1 -- 172.21.15.62:0/1448420108 >> 172.21.15.62:0/1448420108 conn(0x7f23fc05bcd0 msgr2=0x7f23fc0b8910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:51.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.336+0000 7f2400931700 1 -- 172.21.15.62:0/1448420108 shutdown_connections 2021-12-17T18:27:51.347 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.336+0000 7f2400931700 1 -- 172.21.15.62:0/1448420108 wait complete. 2021-12-17T18:27:51.356 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:27:51.357 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:51.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.456+0000 7f41491b1700 1 Processor -- start 2021-12-17T18:27:51.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.456+0000 7f41491b1700 1 -- start start 2021-12-17T18:27:51.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.456+0000 7f41491b1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4144141480 0x7f4144147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:51.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.456+0000 7f41491b1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41440b6270 con 0x7f41440a71e0 2021-12-17T18:27:51.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.456+0000 7f41491b1700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4144147610 con 0x7f41440a8e10 2021-12-17T18:27:51.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.456+0000 7f41491b1700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41441478b0 con 0x7f4144141480 2021-12-17T18:27:51.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4143fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4144141480 0x7f4144147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:51.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f41489b0700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f41440a71e0 0x7f41440a7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40396/0 (socket says 172.21.15.62:40396) 2021-12-17T18:27:51.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f41489b0700 1 -- 172.21.15.62:0/1055884808 learned_addr learned my addr 172.21.15.62:0/1055884808 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:51.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 -- 172.21.15.62:0/1055884808 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435133282 0 0) 0x7f41440b6270 con 0x7f41440a71e0 2021-12-17T18:27:51.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 -- 172.21.15.62:0/1055884808 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4130003260 con 0x7f41440a71e0 2021-12-17T18:27:51.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 -- 172.21.15.62:0/1055884808 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944766864 0 0) 0x7f4144147610 con 0x7f41440a8e10 2021-12-17T18:27:51.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 -- 172.21.15.62:0/1055884808 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41440b6270 con 0x7f41440a8e10 2021-12-17T18:27:51.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 -- 172.21.15.62:0/1055884808 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1482293503 0 0) 0x7f4130003260 con 0x7f41440a71e0 2021-12-17T18:27:51.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 -- 172.21.15.62:0/1055884808 >> v2:172.21.15.62:3300/0 conn(0x7f4144141480 msgr2=0x7f4144147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:51.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 --2- 172.21.15.62:0/1055884808 >> v2:172.21.15.62:3300/0 conn(0x7f4144141480 0x7f4144147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.470 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 -- 172.21.15.62:0/1055884808 >> v1:172.21.15.109:6789/0 conn(0x7f41440a8e10 legacy=0x7f41440b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:51.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 -- 172.21.15.62:0/1055884808 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4144147b50 con 0x7f41440a71e0 2021-12-17T18:27:51.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 -- 172.21.15.62:0/1055884808 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f413c0019e0 con 0x7f41440a71e0 2021-12-17T18:27:51.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4143fff700 1 --2- 172.21.15.62:0/1055884808 >> v2:172.21.15.62:3300/0 conn(0x7f4144141480 0x7f4144147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:51.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 -- 172.21.15.62:0/1055884808 >> v1:172.21.15.62:6789/0 conn(0x7f41440a71e0 legacy=0x7f41440a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:51.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 --2- 172.21.15.62:0/1055884808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41300038e0 0x7f4130003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:51.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 --2- 172.21.15.62:0/1055884808 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4130004500 0x7f4130004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:51.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 --2- 172.21.15.62:0/1055884808 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4130004e70 0x7f413000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:51.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 -- 172.21.15.62:0/1055884808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41441478b0 con 0x7f41300038e0 2021-12-17T18:27:51.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 -- 172.21.15.62:0/1055884808 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413000bcf0 con 0x7f4130004e70 2021-12-17T18:27:51.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 -- 172.21.15.62:0/1055884808 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413000beb0 con 0x7f4130004500 2021-12-17T18:27:51.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4143fff700 1 --2- 172.21.15.62:0/1055884808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41300038e0 0x7f4130003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:51.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f41489b0700 1 --2- 172.21.15.62:0/1055884808 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4130004e70 0x7f413000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:51.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f41437fe700 1 --2- 172.21.15.62:0/1055884808 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4130004500 0x7f4130004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:51.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4143fff700 1 -- 172.21.15.62:0/1055884808 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4130004500 msgr2=0x7f4130004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:51.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4143fff700 1 --2- 172.21.15.62:0/1055884808 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4130004500 0x7f4130004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4143fff700 1 -- 172.21.15.62:0/1055884808 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4130004e70 msgr2=0x7f413000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:51.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4143fff700 1 --2- 172.21.15.62:0/1055884808 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4130004e70 0x7f413000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4143fff700 1 -- 172.21.15.62:0/1055884808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4130003260 con 0x7f41300038e0 2021-12-17T18:27:51.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f41489b0700 1 --2- 172.21.15.62:0/1055884808 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4130004e70 0x7f413000b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:51.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f41489b0700 1 -- 172.21.15.62:0/1055884808 reap_dead start 2021-12-17T18:27:51.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4143fff700 1 --2- 172.21.15.62:0/1055884808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41300038e0 0x7f4130003ce0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f413800c000 tx=0x7f4138006df0).ready entity=mon.0 client_cookie=d04d030d9ed6308e server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:51.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 -- 172.21.15.62:0/1055884808 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f413800e800 con 0x7f41300038e0 2021-12-17T18:27:51.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 -- 172.21.15.62:0/1055884808 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413800e960 con 0x7f41300038e0 2021-12-17T18:27:51.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f4142ffd700 1 -- 172.21.15.62:0/1055884808 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f413800ecc0 con 0x7f41300038e0 2021-12-17T18:27:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f41491b1700 1 -- 172.21.15.62:0/1055884808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41300038e0 msgr2=0x7f4130003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f41491b1700 1 --2- 172.21.15.62:0/1055884808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41300038e0 0x7f4130003ce0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f413800c000 tx=0x7f4138006df0).stop 2021-12-17T18:27:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f41491b1700 1 -- 172.21.15.62:0/1055884808 shutdown_connections 2021-12-17T18:27:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f41491b1700 1 --2- 172.21.15.62:0/1055884808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41300038e0 0x7f4130003ce0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f41491b1700 1 -- 172.21.15.62:0/1055884808 >> 172.21.15.62:0/1055884808 conn(0x7f414405d220 msgr2=0x7f41440b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f41491b1700 1 -- 172.21.15.62:0/1055884808 shutdown_connections 2021-12-17T18:27:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.460+0000 7f41491b1700 1 -- 172.21.15.62:0/1055884808 wait complete. 2021-12-17T18:27:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41491b1700 1 Processor -- start 2021-12-17T18:27:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41491b1700 1 -- start start 2021-12-17T18:27:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41491b1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f41300038e0 0x7f41440aa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41491b1700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f41441489d0 0x7f414415aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41491b1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41440ab500 0x7f41440ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41491b1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41440ae250 con 0x7f41440ab500 2021-12-17T18:27:51.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41491b1700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41440ae4f0 con 0x7f41441489d0 2021-12-17T18:27:51.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41491b1700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4144156ed0 con 0x7f41300038e0 2021-12-17T18:27:51.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41489b0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41440ab500 0x7f41440ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:51.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41489b0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41440ab500 0x7f41440ab980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56828/0 (socket says 172.21.15.62:56828) 2021-12-17T18:27:51.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41489b0700 1 -- 172.21.15.62:0/462999560 learned_addr learned my addr 172.21.15.62:0/462999560 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:51.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41437fe700 1 --2- 172.21.15.62:0/462999560 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f41441489d0 0x7f414415aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:51.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f4143fff700 1 --2- 172.21.15.62:0/462999560 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f41300038e0 0x7f41440aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:51.484 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41489b0700 1 -- 172.21.15.62:0/462999560 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f41300038e0 msgr2=0x7f41440aa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:51.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41489b0700 1 --2- 172.21.15.62:0/462999560 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f41300038e0 0x7f41440aa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41489b0700 1 -- 172.21.15.62:0/462999560 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f41441489d0 msgr2=0x7f414415aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:51.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41489b0700 1 --2- 172.21.15.62:0/462999560 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f41441489d0 0x7f414415aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41489b0700 1 -- 172.21.15.62:0/462999560 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41440abe70 con 0x7f41440ab500 2021-12-17T18:27:51.485 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f4143fff700 1 --2- 172.21.15.62:0/462999560 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f41300038e0 0x7f41440aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:51.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41489b0700 1 --2- 172.21.15.62:0/462999560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41440ab500 0x7f41440ab980 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f41340011d0 tx=0x7f413c002070).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:51.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41417fa700 1 -- 172.21.15.62:0/462999560 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f413c010710 con 0x7f41440ab500 2021-12-17T18:27:51.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41417fa700 1 -- 172.21.15.62:0/462999560 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c010870 con 0x7f41440ab500 2021-12-17T18:27:51.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41417fa700 1 -- 172.21.15.62:0/462999560 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f413c010bd0 con 0x7f41440ab500 2021-12-17T18:27:51.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41491b1700 1 -- 172.21.15.62:0/462999560 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41440ac060 con 0x7f41440ab500 2021-12-17T18:27:51.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.464+0000 7f41491b1700 1 -- 172.21.15.62:0/462999560 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41440a94d0 con 0x7f41440ab500 2021-12-17T18:27:51.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.468+0000 7f41417fa700 1 -- 172.21.15.62:0/462999560 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f413c010d30 con 0x7f41440ab500 2021-12-17T18:27:51.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.468+0000 7f41491b1700 1 -- 172.21.15.62:0/462999560 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41440ae870 con 0x7f41440ab500 2021-12-17T18:27:51.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.468+0000 7f41417fa700 1 --2- 172.21.15.62:0/462999560 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41240535b0 0x7f4124055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:51.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.468+0000 7f41417fa700 1 -- 172.21.15.62:0/462999560 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f413c06b1d0 con 0x7f41440ab500 2021-12-17T18:27:51.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.468+0000 7f4143fff700 1 --2- 172.21.15.62:0/462999560 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41240535b0 0x7f4124055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:51.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.468+0000 7f4143fff700 1 --2- 172.21.15.62:0/462999560 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41240535b0 0x7f4124055a70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f413801a000 tx=0x7f4138019000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:51.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.472+0000 7f41417fa700 1 -- 172.21.15.62:0/462999560 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f413c0421c0 con 0x7f41440ab500 2021-12-17T18:27:51.640 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.632+0000 7f41491b1700 1 -- 172.21.15.62:0/462999560 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41440b1b90 con 0x7f41440ab500 2021-12-17T18:27:51.641 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.636+0000 7f41417fa700 1 -- 172.21.15.62:0/462999560 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f413c0457e0 con 0x7f41440ab500 2021-12-17T18:27:51.641 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:51.641 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":71,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8323,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4209581820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4209581820},{"type":"v1","addr":"172.21.15.62:6833","nonce":4209581820}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:27:46.812077+0000","modified":"2021-12-17T18:27:47.814929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8326},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8326":{"gid":8326,"name":"b","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/1293726231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1293726231},{"type":"v1","addr":"172.21.15.109:6835","nonce":1293726231}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-12-17T18:27:51.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.636+0000 7f41491b1700 1 -- 172.21.15.62:0/462999560 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41240535b0 msgr2=0x7f4124055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:51.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.636+0000 7f41491b1700 1 --2- 172.21.15.62:0/462999560 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41240535b0 0x7f4124055a70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f413801a000 tx=0x7f4138019000).stop 2021-12-17T18:27:51.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.636+0000 7f41491b1700 1 -- 172.21.15.62:0/462999560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41440ab500 msgr2=0x7f41440ab980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:51.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.636+0000 7f41491b1700 1 --2- 172.21.15.62:0/462999560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41440ab500 0x7f41440ab980 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f41340011d0 tx=0x7f413c002070).stop 2021-12-17T18:27:51.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.636+0000 7f41491b1700 1 -- 172.21.15.62:0/462999560 shutdown_connections 2021-12-17T18:27:51.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.636+0000 7f41491b1700 1 --2- 172.21.15.62:0/462999560 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f41240535b0 0x7f4124055a70 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.636+0000 7f41491b1700 1 --2- 172.21.15.62:0/462999560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41440ab500 0x7f41440ab980 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.636+0000 7f41491b1700 1 --2- 172.21.15.62:0/462999560 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f41441489d0 0x7f414415aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.636+0000 7f41491b1700 1 --2- 172.21.15.62:0/462999560 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f41300038e0 0x7f41440aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:51.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.636+0000 7f41491b1700 1 -- 172.21.15.62:0/462999560 >> 172.21.15.62:0/462999560 conn(0x7f414405d220 msgr2=0x7f4144147fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:51.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.636+0000 7f41491b1700 1 -- 172.21.15.62:0/462999560 shutdown_connections 2021-12-17T18:27:51.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:51.636+0000 7f41491b1700 1 -- 172.21.15.62:0/462999560 wait complete. 2021-12-17T18:27:51.646 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 71 2021-12-17T18:27:51.856 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:27:46.812077+0000', 'modified': '2021-12-17T18:27:47.814929+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8326}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8326': {'gid': 8326, 'name': 'b', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.109:6835/1293726231', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.109:6834', 'nonce': 1293726231}, {'type': 'v1', 'addr': '172.21.15.109:6835', 'nonce': 1293726231}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:27:51.857 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:27:51.857 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-12-17T18:27:51.973 INFO:teuthology.orchestra.run.smithi109.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":8326,"want_state":"up:active","state":"up:active","rank_uptime":5.1452360600000002,"mdsmap_epoch":71,"osdmap_epoch":141,"osdmap_epoch_barrier":140,"uptime":9.5249967689999995} 2021-12-17T18:27:51.974 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 8326, "mdsmap_epoch": 71, "osdmap_epoch": 141, "osdmap_epoch_barrier": 140, "rank_uptime": 5.14523606, "state": "up:active", "uptime": 9.524996769, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:27:51.974 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:27:51.975 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-12-17T18:27:51.975 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-12-17T18:27:51.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:51.976 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:51.984 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:27:52.002 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:27:52.002 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:27:52.015 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:27:52.016 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:27:52.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:52.017 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:27:52.023 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:27:52.023 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:52.066 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:27:52.082 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:27:52.083 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:27:52.093 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:27:52.094 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:27:52.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:52.095 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:27:52.144 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2021-12-17T18:27:52.137+0000 7fbe19369080 -1 init, newargv = 0x558e25977c40 newargc=9ceph-fuse[15180 2021-12-17T18:27:52.145 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:]: starting ceph client 2021-12-17T18:27:52.155 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[15180]: starting fuse 2021-12-17T18:27:53.203 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:27:53.221 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:27:53.222 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:27:53.280 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:27:53.281 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:27:53.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:53.283 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:27:53.288 INFO:teuthology.orchestra.run.smithi125.stdout:52 2021-12-17T18:27:53.288 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:27:53.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:53.289 DEBUG:teuthology.orchestra.run.smithi125:> sudo python3 -c ' 2021-12-17T18:27:53.290 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2021-12-17T18:27:53.290 DEBUG:teuthology.orchestra.run.smithi125:> import re 2021-12-17T18:27:53.291 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:27:53.291 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2021-12-17T18:27:53.292 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:27:53.292 DEBUG:teuthology.orchestra.run.smithi125:> def find_socket(client_name): 2021-12-17T18:27:53.293 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-12-17T18:27:53.293 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2021-12-17T18:27:53.293 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:27:53.294 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2021-12-17T18:27:53.294 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2021-12-17T18:27:53.295 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2021-12-17T18:27:53.295 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2021-12-17T18:27:53.296 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:27:53.296 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2021-12-17T18:27:53.296 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:27:53.297 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:27:53.297 DEBUG:teuthology.orchestra.run.smithi125:> return f 2021-12-17T18:27:53.298 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:27:53.298 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:27:53.299 DEBUG:teuthology.orchestra.run.smithi125:> print(find_socket("client.0")) 2021-12-17T18:27:53.299 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:27:53.344 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.15180.asok 2021-12-17T18:27:53.349 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15180.asok 2021-12-17T18:27:53.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:53.350 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15180.asok status 2021-12-17T18:27:53.486 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2021-12-17T18:27:53.486 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2021-12-17T18:27:53.487 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:27:53.487 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:27:53.487 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2021-12-17T18:27:53.487 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2021-12-17T18:27:53.488 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-12-17T18:27:53.488 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "15180", 2021-12-17T18:27:53.488 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2021-12-17T18:27:53.488 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:27:53.489 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2021-12-17T18:27:53.489 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2021-12-17T18:27:53.489 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 8640, 2021-12-17T18:27:53.489 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2021-12-17T18:27:53.489 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2021-12-17T18:27:53.490 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2021-12-17T18:27:53.490 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 8640 2021-12-17T18:27:53.490 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:27:53.490 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:27:53.491 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:27:53.491 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:27:53.492 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 2658685660 2021-12-17T18:27:53.492 INFO:teuthology.orchestra.run.smithi125.stdout: } 2021-12-17T18:27:53.492 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:27:53.493 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:27:53.493 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:27:53.494 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:27:53.494 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 2658685660 2021-12-17T18:27:53.494 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:27:53.494 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.8640 172.21.15.125:0/2658685660", 2021-12-17T18:27:53.495 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "172.21.15.125:0/2658685660", 2021-12-17T18:27:53.495 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2021-12-17T18:27:53.495 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 71, 2021-12-17T18:27:53.496 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 141, 2021-12-17T18:27:53.496 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:27:53.496 INFO:teuthology.orchestra.run.smithi125.stdout: "blacklisted": false, 2021-12-17T18:27:53.496 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2021-12-17T18:27:53.497 INFO:teuthology.orchestra.run.smithi125.stdout:} 2021-12-17T18:27:53.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:53.498 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:53.499 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:53.507 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:27:53.509 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:27:53.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:53.511 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:53.530 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:27:53.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.636+0000 7f292ffff700 1 Processor -- start 2021-12-17T18:27:53.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.636+0000 7f292ffff700 1 -- start start 2021-12-17T18:27:53.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292ffff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f29300b1ff0 0x7f2930148720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:53.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f29300b2830 0x7f29300b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:53.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292ffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29300af1b0 con 0x7f29300aedd0 2021-12-17T18:27:53.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292ffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29300b0170 con 0x7f29300b2830 2021-12-17T18:27:53.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292ffff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29300aaca0 con 0x7f29300b1ff0 2021-12-17T18:27:53.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292f7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f29300b2830 0x7f29300b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:53.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292effd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f29300aedd0 0x7f2930148010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40412/0 (socket says 172.21.15.62:40412) 2021-12-17T18:27:53.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292effd700 1 -- 172.21.15.62:0/1151127197 learned_addr learned my addr 172.21.15.62:0/1151127197 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:53.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292e7fc700 1 --2- 172.21.15.62:0/1151127197 >> v2:172.21.15.109:3300/0 conn(0x7f29300b1ff0 0x7f2930148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:53.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292f7fe700 1 -- 172.21.15.62:0/1151127197 >> v2:172.21.15.109:3300/0 conn(0x7f29300b1ff0 msgr2=0x7f2930148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:53.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292f7fe700 1 --2- 172.21.15.62:0/1151127197 >> v2:172.21.15.109:3300/0 conn(0x7f29300b1ff0 0x7f2930148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:53.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292f7fe700 1 -- 172.21.15.62:0/1151127197 >> v1:172.21.15.62:6789/0 conn(0x7f29300aedd0 legacy=0x7f2930148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:53.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292f7fe700 1 -- 172.21.15.62:0/1151127197 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29300aaf40 con 0x7f29300b2830 2021-12-17T18:27:53.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292f7fe700 1 --2- 172.21.15.62:0/1151127197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29300b2830 0x7f29300b05f0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f2920001110 tx=0x7f29280091d0).ready entity=mon.0 client_cookie=9ab57f9a18c55c66 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:53.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292dffb700 1 -- 172.21.15.62:0/1151127197 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f292800b520 con 0x7f29300b2830 2021-12-17T18:27:53.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292dffb700 1 -- 172.21.15.62:0/1151127197 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292800b680 con 0x7f29300b2830 2021-12-17T18:27:53.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292dffb700 1 -- 172.21.15.62:0/1151127197 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f292800b7f0 con 0x7f29300b2830 2021-12-17T18:27:53.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292ffff700 1 -- 172.21.15.62:0/1151127197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29300b2830 msgr2=0x7f29300b05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:53.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292ffff700 1 --2- 172.21.15.62:0/1151127197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29300b2830 0x7f29300b05f0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f2920001110 tx=0x7f29280091d0).stop 2021-12-17T18:27:53.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292ffff700 1 -- 172.21.15.62:0/1151127197 shutdown_connections 2021-12-17T18:27:53.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292ffff700 1 --2- 172.21.15.62:0/1151127197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29300b2830 0x7f29300b05f0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:53.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292ffff700 1 --2- 172.21.15.62:0/1151127197 >> v2:172.21.15.109:3300/0 conn(0x7f29300b1ff0 0x7f2930148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:53.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292ffff700 1 -- 172.21.15.62:0/1151127197 >> 172.21.15.62:0/1151127197 conn(0x7f293005c750 msgr2=0x7f293005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:53.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292ffff700 1 -- 172.21.15.62:0/1151127197 shutdown_connections 2021-12-17T18:27:53.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.640+0000 7f292ffff700 1 -- 172.21.15.62:0/1151127197 wait complete. 2021-12-17T18:27:53.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292ffff700 1 Processor -- start 2021-12-17T18:27:53.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292ffff700 1 -- start start 2021-12-17T18:27:53.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292ffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f29300aedd0 0x7f29300652d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:53.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f29300b1ff0 0x7f29300ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:53.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29300b2830 0x7f29300ad710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:53.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29301453b0 con 0x7f29300b2830 2021-12-17T18:27:53.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292ffff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29300648f0 con 0x7f29300aedd0 2021-12-17T18:27:53.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292ffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2930064b90 con 0x7f29300b1ff0 2021-12-17T18:27:53.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29300b2830 0x7f29300ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:53.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29300b2830 0x7f29300ad710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56842/0 (socket says 172.21.15.62:56842) 2021-12-17T18:27:53.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292f7fe700 1 -- 172.21.15.62:0/1763181070 learned_addr learned my addr 172.21.15.62:0/1763181070 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:53.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292effd700 1 --2- 172.21.15.62:0/1763181070 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f29300aedd0 0x7f29300652d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:53.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292e7fc700 1 --2- 172.21.15.62:0/1763181070 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f29300b1ff0 0x7f29300ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:53.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292f7fe700 1 -- 172.21.15.62:0/1763181070 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f29300b1ff0 msgr2=0x7f29300ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:53.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292f7fe700 1 --2- 172.21.15.62:0/1763181070 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f29300b1ff0 0x7f29300ac3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:53.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292f7fe700 1 -- 172.21.15.62:0/1763181070 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f29300aedd0 msgr2=0x7f29300652d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:53.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292f7fe700 1 --2- 172.21.15.62:0/1763181070 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f29300aedd0 0x7f29300652d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:53.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292f7fe700 1 -- 172.21.15.62:0/1763181070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2928009470 con 0x7f29300b2830 2021-12-17T18:27:53.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292effd700 1 --2- 172.21.15.62:0/1763181070 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f29300aedd0 0x7f29300652d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:53.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292f7fe700 1 --2- 172.21.15.62:0/1763181070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29300b2830 0x7f29300ad710 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f2920001110 tx=0x7f2928016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:53.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f291ffff700 1 -- 172.21.15.62:0/1763181070 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f292800b520 con 0x7f29300b2830 2021-12-17T18:27:53.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f291ffff700 1 -- 172.21.15.62:0/1763181070 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29280032d0 con 0x7f29300b2830 2021-12-17T18:27:53.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292ffff700 1 -- 172.21.15.62:0/1763181070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2930064e30 con 0x7f29300b2830 2021-12-17T18:27:53.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f291ffff700 1 -- 172.21.15.62:0/1763181070 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2928021630 con 0x7f29300b2830 2021-12-17T18:27:53.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.644+0000 7f292ffff700 1 -- 172.21.15.62:0/1763181070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29300acae0 con 0x7f29300b2830 2021-12-17T18:27:53.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.648+0000 7f291ffff700 1 -- 172.21.15.62:0/1763181070 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2928027020 con 0x7f29300b2830 2021-12-17T18:27:53.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.648+0000 7f292ffff700 1 -- 172.21.15.62:0/1763181070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2930064ff0 con 0x7f29300b2830 2021-12-17T18:27:53.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.648+0000 7f291ffff700 1 --2- 172.21.15.62:0/1763181070 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f290c0534f0 0x7f290c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:53.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.648+0000 7f291ffff700 1 -- 172.21.15.62:0/1763181070 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f292806cd10 con 0x7f29300b2830 2021-12-17T18:27:53.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.648+0000 7f292effd700 1 --2- 172.21.15.62:0/1763181070 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f290c0534f0 0x7f290c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:53.664 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.648+0000 7f292effd700 1 --2- 172.21.15.62:0/1763181070 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f290c0534f0 0x7f290c0559b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f292000b000 tx=0x7f2920009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:53.665 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.652+0000 7f291ffff700 1 -- 172.21.15.62:0/1763181070 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2928043d00 con 0x7f29300b2830 2021-12-17T18:27:53.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.776+0000 7f292ffff700 1 -- 172.21.15.62:0/1763181070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29300b2c30 con 0x7f29300b2830 2021-12-17T18:27:53.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.780+0000 7f291ffff700 1 -- 172.21.15.62:0/1763181070 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f2928015090 con 0x7f29300b2830 2021-12-17T18:27:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:53.786 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":141,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:27:47.815591+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:27:45.207337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-12-17T18:27:46.441638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:27:53.788 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.780+0000 7f292ffff700 1 -- 172.21.15.62:0/1763181070 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f290c0534f0 msgr2=0x7f290c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:53.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.780+0000 7f292ffff700 1 --2- 172.21.15.62:0/1763181070 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f290c0534f0 0x7f290c0559b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f292000b000 tx=0x7f2920009040).stop 2021-12-17T18:27:53.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.780+0000 7f292ffff700 1 -- 172.21.15.62:0/1763181070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29300b2830 msgr2=0x7f29300ad710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:53.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.780+0000 7f292ffff700 1 --2- 172.21.15.62:0/1763181070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29300b2830 0x7f29300ad710 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f2920001110 tx=0x7f2928016000).stop 2021-12-17T18:27:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.780+0000 7f292ffff700 1 -- 172.21.15.62:0/1763181070 shutdown_connections 2021-12-17T18:27:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.780+0000 7f292ffff700 1 --2- 172.21.15.62:0/1763181070 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f290c0534f0 0x7f290c0559b0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.780+0000 7f292ffff700 1 --2- 172.21.15.62:0/1763181070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29300b2830 0x7f29300ad710 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.780+0000 7f292ffff700 1 --2- 172.21.15.62:0/1763181070 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f29300b1ff0 0x7f29300ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.780+0000 7f292ffff700 1 --2- 172.21.15.62:0/1763181070 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f29300aedd0 0x7f29300652d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.780+0000 7f292ffff700 1 -- 172.21.15.62:0/1763181070 >> 172.21.15.62:0/1763181070 conn(0x7f293005c750 msgr2=0x7f29300b76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.780+0000 7f292ffff700 1 -- 172.21.15.62:0/1763181070 shutdown_connections 2021-12-17T18:27:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.780+0000 7f292ffff700 1 -- 172.21.15.62:0/1763181070 wait complete. 2021-12-17T18:27:53.800 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:27:45.207337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '140', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:27:46.441638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:27:53.801 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:27:53.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.904+0000 7fc87ffff700 1 Processor -- start 2021-12-17T18:27:53.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87ffff700 1 -- start start 2021-12-17T18:27:53.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87ffff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc88005ca90 0x7fc880140420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:53.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8800b05b0 0x7fc880140910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:53.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87ffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8800abcb0 con 0x7fc8800b10d0 2021-12-17T18:27:53.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87ffff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc880140e00 con 0x7fc88005ca90 2021-12-17T18:27:53.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87ffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88005ce70 con 0x7fc8800b05b0 2021-12-17T18:27:53.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc8800b10d0 0x7fc8801433e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40428/0 (socket says 172.21.15.62:40428) 2021-12-17T18:27:53.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87f7fe700 1 -- 172.21.15.62:0/4099098380 learned_addr learned my addr 172.21.15.62:0/4099098380 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:53.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc877fff700 1 --2- 172.21.15.62:0/4099098380 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8800b05b0 0x7fc880140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:53.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87effd700 1 --2- 172.21.15.62:0/4099098380 >> v2:172.21.15.109:3300/0 conn(0x7fc88005ca90 0x7fc880140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:53.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87e7fc700 1 -- 172.21.15.62:0/4099098380 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536738504 0 0) 0x7fc8800abcb0 con 0x7fc8800b10d0 2021-12-17T18:27:53.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87e7fc700 1 -- 172.21.15.62:0/4099098380 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc860003260 con 0x7fc8800b10d0 2021-12-17T18:27:53.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87e7fc700 1 -- 172.21.15.62:0/4099098380 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2536624452 0 0) 0x7fc860003260 con 0x7fc8800b10d0 2021-12-17T18:27:53.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc877fff700 1 -- 172.21.15.62:0/4099098380 >> v2:172.21.15.109:3300/0 conn(0x7fc88005ca90 msgr2=0x7fc880140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:53.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc877fff700 1 --2- 172.21.15.62:0/4099098380 >> v2:172.21.15.109:3300/0 conn(0x7fc88005ca90 0x7fc880140420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:53.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc877fff700 1 -- 172.21.15.62:0/4099098380 >> v1:172.21.15.62:6789/0 conn(0x7fc8800b10d0 legacy=0x7fc8801433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:53.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc877fff700 1 -- 172.21.15.62:0/4099098380 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88013fe10 con 0x7fc8800b05b0 2021-12-17T18:27:53.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc877fff700 1 --2- 172.21.15.62:0/4099098380 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8800b05b0 0x7fc880140910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fc878001b80 tx=0x7fc868006e80).ready entity=mon.2 client_cookie=81b3b9ca760862f9 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:53.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87e7fc700 1 -- 172.21.15.62:0/4099098380 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8780019e0 con 0x7fc8800b05b0 2021-12-17T18:27:53.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87e7fc700 1 -- 172.21.15.62:0/4099098380 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc868000e90 con 0x7fc8800b05b0 2021-12-17T18:27:53.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87e7fc700 1 -- 172.21.15.62:0/4099098380 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc86800f8a0 con 0x7fc8800b05b0 2021-12-17T18:27:53.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87ffff700 1 -- 172.21.15.62:0/4099098380 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8800b05b0 msgr2=0x7fc880140910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:53.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87ffff700 1 --2- 172.21.15.62:0/4099098380 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8800b05b0 0x7fc880140910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fc878001b80 tx=0x7fc868006e80).stop 2021-12-17T18:27:53.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87ffff700 1 -- 172.21.15.62:0/4099098380 shutdown_connections 2021-12-17T18:27:53.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87ffff700 1 --2- 172.21.15.62:0/4099098380 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8800b05b0 0x7fc880140910 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:53.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87ffff700 1 --2- 172.21.15.62:0/4099098380 >> v2:172.21.15.109:3300/0 conn(0x7fc88005ca90 0x7fc880140420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:53.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87ffff700 1 -- 172.21.15.62:0/4099098380 >> 172.21.15.62:0/4099098380 conn(0x7fc88005c070 msgr2=0x7fc880062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:53.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87ffff700 1 -- 172.21.15.62:0/4099098380 shutdown_connections 2021-12-17T18:27:53.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.908+0000 7fc87ffff700 1 -- 172.21.15.62:0/4099098380 wait complete. 2021-12-17T18:27:53.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.912+0000 7fc87ffff700 1 Processor -- start 2021-12-17T18:27:53.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.912+0000 7fc87ffff700 1 -- start start 2021-12-17T18:27:53.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.912+0000 7fc87ffff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc88005ca90 0x7fc88014df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:53.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.912+0000 7fc87ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8800b05b0 0x7fc880141860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:53.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.912+0000 7fc87ffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8800b10d0 0x7fc8800652e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:53.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.912+0000 7fc87ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8800667c0 con 0x7fc8800b05b0 2021-12-17T18:27:53.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.912+0000 7fc87ffff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc880066a60 con 0x7fc88005ca90 2021-12-17T18:27:53.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.912+0000 7fc87ffff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc880066d00 con 0x7fc8800b10d0 2021-12-17T18:27:53.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.912+0000 7fc877fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8800b05b0 0x7fc880141860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:53.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.912+0000 7fc877fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8800b05b0 0x7fc880141860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56854/0 (socket says 172.21.15.62:56854) 2021-12-17T18:27:53.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.912+0000 7fc877fff700 1 -- 172.21.15.62:0/3999092968 learned_addr learned my addr 172.21.15.62:0/3999092968 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:53.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.912+0000 7fc87effd700 1 --2- 172.21.15.62:0/3999092968 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc88005ca90 0x7fc88014df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:53.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.912+0000 7fc87f7fe700 1 --2- 172.21.15.62:0/3999092968 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8800b10d0 0x7fc8800652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:53.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.916+0000 7fc877fff700 1 -- 172.21.15.62:0/3999092968 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8800b10d0 msgr2=0x7fc8800652e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:53.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.916+0000 7fc877fff700 1 --2- 172.21.15.62:0/3999092968 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8800b10d0 0x7fc8800652e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:53.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.916+0000 7fc877fff700 1 -- 172.21.15.62:0/3999092968 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc88005ca90 msgr2=0x7fc88014df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:53.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.916+0000 7fc877fff700 1 --2- 172.21.15.62:0/3999092968 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc88005ca90 0x7fc88014df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:53.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.916+0000 7fc877fff700 1 -- 172.21.15.62:0/3999092968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86800d410 con 0x7fc8800b05b0 2021-12-17T18:27:53.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.916+0000 7fc877fff700 1 --2- 172.21.15.62:0/3999092968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8800b05b0 0x7fc880141860 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7fc878001b80 tx=0x7fc868006e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:53.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.916+0000 7fc87cff9700 1 -- 172.21.15.62:0/3999092968 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc868010ca0 con 0x7fc8800b05b0 2021-12-17T18:27:53.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.916+0000 7fc87cff9700 1 -- 172.21.15.62:0/3999092968 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc868010e00 con 0x7fc8800b05b0 2021-12-17T18:27:53.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.916+0000 7fc87cff9700 1 -- 172.21.15.62:0/3999092968 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8680185f0 con 0x7fc8800b05b0 2021-12-17T18:27:53.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.916+0000 7fc87ffff700 1 -- 172.21.15.62:0/3999092968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8800664b0 con 0x7fc8800b05b0 2021-12-17T18:27:53.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.916+0000 7fc87ffff700 1 -- 172.21.15.62:0/3999092968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc880139470 con 0x7fc8800b05b0 2021-12-17T18:27:53.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.916+0000 7fc87ffff700 1 -- 172.21.15.62:0/3999092968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8800abee0 con 0x7fc8800b05b0 2021-12-17T18:27:53.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.916+0000 7fc87cff9700 1 -- 172.21.15.62:0/3999092968 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc868021070 con 0x7fc8800b05b0 2021-12-17T18:27:53.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.916+0000 7fc87cff9700 1 --2- 172.21.15.62:0/3999092968 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8640536d0 0x7fc864055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:53.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.920+0000 7fc87cff9700 1 -- 172.21.15.62:0/3999092968 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc86806e5c0 con 0x7fc8800b05b0 2021-12-17T18:27:53.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.920+0000 7fc87effd700 1 --2- 172.21.15.62:0/3999092968 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8640536d0 0x7fc864055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:53.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.920+0000 7fc87effd700 1 --2- 172.21.15.62:0/3999092968 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8640536d0 0x7fc864055b90 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7fc87000b000 tx=0x7fc870006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:53.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:53.928+0000 7fc87cff9700 1 -- 172.21.15.62:0/3999092968 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc868045720 con 0x7fc8800b05b0 2021-12-17T18:27:54.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.052+0000 7fc87ffff700 1 -- 172.21.15.62:0/3999092968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc8800573d0 con 0x7fc8800b05b0 2021-12-17T18:27:54.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.056+0000 7fc87cff9700 1 -- 172.21.15.62:0/3999092968 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v141) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc868048d40 con 0x7fc8800b05b0 2021-12-17T18:27:54.061 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:27:54.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.056+0000 7fc87ffff700 1 -- 172.21.15.62:0/3999092968 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8640536d0 msgr2=0x7fc864055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.056+0000 7fc87ffff700 1 --2- 172.21.15.62:0/3999092968 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8640536d0 0x7fc864055b90 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7fc87000b000 tx=0x7fc870006df0).stop 2021-12-17T18:27:54.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.056+0000 7fc87ffff700 1 -- 172.21.15.62:0/3999092968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8800b05b0 msgr2=0x7fc880141860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.056+0000 7fc87ffff700 1 --2- 172.21.15.62:0/3999092968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8800b05b0 0x7fc880141860 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7fc878001b80 tx=0x7fc868006e80).stop 2021-12-17T18:27:54.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.056+0000 7fc87ffff700 1 -- 172.21.15.62:0/3999092968 shutdown_connections 2021-12-17T18:27:54.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.056+0000 7fc87ffff700 1 --2- 172.21.15.62:0/3999092968 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc8640536d0 0x7fc864055b90 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.056+0000 7fc87ffff700 1 --2- 172.21.15.62:0/3999092968 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc8800b10d0 0x7fc8800652e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.056+0000 7fc87ffff700 1 --2- 172.21.15.62:0/3999092968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8800b05b0 0x7fc880141860 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.056+0000 7fc87ffff700 1 --2- 172.21.15.62:0/3999092968 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc88005ca90 0x7fc88014df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.056+0000 7fc87ffff700 1 -- 172.21.15.62:0/3999092968 >> 172.21.15.62:0/3999092968 conn(0x7fc88005c070 msgr2=0x7fc880144c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:54.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.056+0000 7fc87ffff700 1 -- 172.21.15.62:0/3999092968 shutdown_connections 2021-12-17T18:27:54.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.056+0000 7fc87ffff700 1 -- 172.21.15.62:0/3999092968 wait complete. 2021-12-17T18:27:54.075 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:27:54.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50aedd700 1 Processor -- start 2021-12-17T18:27:54.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50aedd700 1 -- start start 2021-12-17T18:27:54.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50aedd700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd5040b2580 0x7fd504144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:54.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50aedd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd50405f730 0x7fd504140160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:54.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50aedd700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5040b1a50 con 0x7fd504060710 2021-12-17T18:27:54.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50aedd700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5040657d0 con 0x7fd50405f730 2021-12-17T18:27:54.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50aedd700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5040b2960 con 0x7fd5040b2580 2021-12-17T18:27:54.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50947a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd50405f730 0x7fd504140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:54.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50947a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd50405f730 0x7fd504140160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56864/0 (socket says 172.21.15.62:56864) 2021-12-17T18:27:54.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd503fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd504060710 0x7fd504065c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40440/0 (socket says 172.21.15.62:40440) 2021-12-17T18:27:54.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50947a700 1 -- 172.21.15.62:0/269278806 learned_addr learned my addr 172.21.15.62:0/269278806 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:54.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd508c79700 1 --2- 172.21.15.62:0/269278806 >> v2:172.21.15.109:3300/0 conn(0x7fd5040b2580 0x7fd504144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:54.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50947a700 1 -- 172.21.15.62:0/269278806 >> v2:172.21.15.109:3300/0 conn(0x7fd5040b2580 msgr2=0x7fd504144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:54.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50947a700 1 --2- 172.21.15.62:0/269278806 >> v2:172.21.15.109:3300/0 conn(0x7fd5040b2580 0x7fd504144390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50947a700 1 -- 172.21.15.62:0/269278806 >> v1:172.21.15.62:6789/0 conn(0x7fd504060710 legacy=0x7fd504065c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd5037fe700 1 -- 172.21.15.62:0/269278806 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094232268 0 0) 0x7fd5040b1a50 con 0x7fd504060710 2021-12-17T18:27:54.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50947a700 1 -- 172.21.15.62:0/269278806 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5040b4e50 con 0x7fd50405f730 2021-12-17T18:27:54.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd508c79700 1 --2- 172.21.15.62:0/269278806 >> v2:172.21.15.109:3300/0 conn(0x7fd5040b2580 0x7fd504144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:54.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50947a700 1 --2- 172.21.15.62:0/269278806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd50405f730 0x7fd504140160 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7fd4fc0032f0 tx=0x7fd4fc009290).ready entity=mon.0 client_cookie=a2c4f8dad84a72cf server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:54.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd5037fe700 1 -- 172.21.15.62:0/269278806 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4fc00b870 con 0x7fd50405f730 2021-12-17T18:27:54.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd5037fe700 1 -- 172.21.15.62:0/269278806 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4fc00b9d0 con 0x7fd50405f730 2021-12-17T18:27:54.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd5037fe700 1 -- 172.21.15.62:0/269278806 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4fc00bb40 con 0x7fd50405f730 2021-12-17T18:27:54.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50aedd700 1 -- 172.21.15.62:0/269278806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd50405f730 msgr2=0x7fd504140160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50aedd700 1 --2- 172.21.15.62:0/269278806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd50405f730 0x7fd504140160 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7fd4fc0032f0 tx=0x7fd4fc009290).stop 2021-12-17T18:27:54.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50aedd700 1 -- 172.21.15.62:0/269278806 shutdown_connections 2021-12-17T18:27:54.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50aedd700 1 --2- 172.21.15.62:0/269278806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd50405f730 0x7fd504140160 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.184+0000 7fd50aedd700 1 --2- 172.21.15.62:0/269278806 >> v2:172.21.15.109:3300/0 conn(0x7fd5040b2580 0x7fd504144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.188+0000 7fd50aedd700 1 -- 172.21.15.62:0/269278806 >> 172.21.15.62:0/269278806 conn(0x7fd50405c750 msgr2=0x7fd50405cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:54.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.188+0000 7fd50aedd700 1 -- 172.21.15.62:0/269278806 shutdown_connections 2021-12-17T18:27:54.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.188+0000 7fd50aedd700 1 -- 172.21.15.62:0/269278806 wait complete. 2021-12-17T18:27:54.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.188+0000 7fd50aedd700 1 Processor -- start 2021-12-17T18:27:54.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.188+0000 7fd50aedd700 1 -- start start 2021-12-17T18:27:54.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.188+0000 7fd50aedd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd50405f730 0x7fd5041532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:54.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.188+0000 7fd50aedd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd504060710 0x7fd5040af020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:54.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.188+0000 7fd50aedd700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd5040b2580 0x7fd5041108c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:54.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.188+0000 7fd50aedd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd504141eb0 con 0x7fd50405f730 2021-12-17T18:27:54.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.188+0000 7fd50aedd700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd504141c10 con 0x7fd5040b2580 2021-12-17T18:27:54.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.188+0000 7fd50aedd700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5040afad0 con 0x7fd504060710 2021-12-17T18:27:54.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.188+0000 7fd508c79700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd50405f730 0x7fd5041532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:54.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.188+0000 7fd508c79700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd50405f730 0x7fd5041532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56866/0 (socket says 172.21.15.62:56866) 2021-12-17T18:27:54.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.188+0000 7fd508c79700 1 -- 172.21.15.62:0/455950573 learned_addr learned my addr 172.21.15.62:0/455950573 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:54.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.188+0000 7fd503fff700 1 --2- 172.21.15.62:0/455950573 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd504060710 0x7fd5040af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:54.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.188+0000 7fd50947a700 1 --2- 172.21.15.62:0/455950573 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd5040b2580 0x7fd5041108c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:54.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.192+0000 7fd50947a700 1 -- 172.21.15.62:0/455950573 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd504060710 msgr2=0x7fd5040af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.192+0000 7fd50947a700 1 --2- 172.21.15.62:0/455950573 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd504060710 0x7fd5040af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.192+0000 7fd50947a700 1 -- 172.21.15.62:0/455950573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd50405f730 msgr2=0x7fd5041532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.192+0000 7fd50947a700 1 --2- 172.21.15.62:0/455950573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd50405f730 0x7fd5041532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.192+0000 7fd50947a700 1 -- 172.21.15.62:0/455950573 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc009530 con 0x7fd5040b2580 2021-12-17T18:27:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.192+0000 7fd503fff700 1 --2- 172.21.15.62:0/455950573 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd504060710 0x7fd5040af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.192+0000 7fd50947a700 1 --2- 172.21.15.62:0/455950573 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd5040b2580 0x7fd5041108c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fd5040af9f0 tx=0x7fd4fc016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.192+0000 7fd501ffb700 1 -- 172.21.15.62:0/455950573 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4fc00bb40 con 0x7fd5040b2580 2021-12-17T18:27:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.192+0000 7fd501ffb700 1 -- 172.21.15.62:0/455950573 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4fc020470 con 0x7fd5040b2580 2021-12-17T18:27:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.192+0000 7fd50aedd700 1 -- 172.21.15.62:0/455950573 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5040af510 con 0x7fd5040b2580 2021-12-17T18:27:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.192+0000 7fd501ffb700 1 -- 172.21.15.62:0/455950573 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4fc00b870 con 0x7fd5040b2580 2021-12-17T18:27:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.192+0000 7fd50aedd700 1 -- 172.21.15.62:0/455950573 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5040b1380 con 0x7fd5040b2580 2021-12-17T18:27:54.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.192+0000 7fd50aedd700 1 -- 172.21.15.62:0/455950573 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5040b4bb0 con 0x7fd5040b2580 2021-12-17T18:27:54.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.192+0000 7fd501ffb700 1 -- 172.21.15.62:0/455950573 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd4fc00f070 con 0x7fd5040b2580 2021-12-17T18:27:54.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.192+0000 7fd501ffb700 1 --2- 172.21.15.62:0/455950573 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4e4053610 0x7fd4e4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:54.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.192+0000 7fd501ffb700 1 -- 172.21.15.62:0/455950573 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd4fc06c6e0 con 0x7fd5040b2580 2021-12-17T18:27:54.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.196+0000 7fd508c79700 1 --2- 172.21.15.62:0/455950573 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4e4053610 0x7fd4e4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:54.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.196+0000 7fd508c79700 1 --2- 172.21.15.62:0/455950573 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4e4053610 0x7fd4e4055ad0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7fd4f8008000 tx=0x7fd4f8008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:54.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.204+0000 7fd501ffb700 1 -- 172.21.15.62:0/455950573 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd4fc0437e0 con 0x7fd5040b2580 2021-12-17T18:27:54.336 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.328+0000 7fd50aedd700 1 -- 172.21.15.62:0/455950573 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd5040573d0 con 0x7fd5040b2580 2021-12-17T18:27:54.337 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.332+0000 7fd501ffb700 1 -- 172.21.15.62:0/455950573 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v141) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd4fc015070 con 0x7fd5040b2580 2021-12-17T18:27:54.337 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:27:54.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.332+0000 7fd50aedd700 1 -- 172.21.15.62:0/455950573 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4e4053610 msgr2=0x7fd4e4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.332+0000 7fd50aedd700 1 --2- 172.21.15.62:0/455950573 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4e4053610 0x7fd4e4055ad0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7fd4f8008000 tx=0x7fd4f8008040).stop 2021-12-17T18:27:54.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.332+0000 7fd50aedd700 1 -- 172.21.15.62:0/455950573 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd5040b2580 msgr2=0x7fd5041108c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.340 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.332+0000 7fd50aedd700 1 --2- 172.21.15.62:0/455950573 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd5040b2580 0x7fd5041108c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fd5040af9f0 tx=0x7fd4fc016000).stop 2021-12-17T18:27:54.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.332+0000 7fd50aedd700 1 -- 172.21.15.62:0/455950573 shutdown_connections 2021-12-17T18:27:54.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.332+0000 7fd50aedd700 1 --2- 172.21.15.62:0/455950573 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd4e4053610 0x7fd4e4055ad0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.332+0000 7fd50aedd700 1 --2- 172.21.15.62:0/455950573 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd5040b2580 0x7fd5041108c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.341 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.332+0000 7fd50aedd700 1 --2- 172.21.15.62:0/455950573 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd504060710 0x7fd5040af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.332+0000 7fd50aedd700 1 --2- 172.21.15.62:0/455950573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd50405f730 0x7fd5041532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.332+0000 7fd50aedd700 1 -- 172.21.15.62:0/455950573 >> 172.21.15.62:0/455950573 conn(0x7fd50405c750 msgr2=0x7fd504143b40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:54.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.332+0000 7fd50aedd700 1 -- 172.21.15.62:0/455950573 shutdown_connections 2021-12-17T18:27:54.342 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.332+0000 7fd50aedd700 1 -- 172.21.15.62:0/455950573 wait complete. 2021-12-17T18:27:54.350 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:27:54.461 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f259896b700 1 Processor -- start 2021-12-17T18:27:54.462 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f259896b700 1 -- start start 2021-12-17T18:27:54.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f259896b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f25940b5dd0 0x7f2594146da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:54.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f259896b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f25940b41f0 0x7f2594141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:54.464 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f259896b700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25940b2010 con 0x7f25940b05b0 2021-12-17T18:27:54.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f259896b700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25940b0990 con 0x7f25940b5dd0 2021-12-17T18:27:54.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f259896b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2594147290 con 0x7f25940b41f0 2021-12-17T18:27:54.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f2591d9b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f25940b5dd0 0x7f2594146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:54.465 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f2592d9d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f25940b41f0 0x7f2594141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:54.466 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f259259c700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f25940b05b0 0x7f2594146690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:56774/0 (socket says 172.21.15.62:56774) 2021-12-17T18:27:54.466 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f2591d9b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f25940b5dd0 0x7f2594146da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:35194/0 (socket says 172.21.15.62:35194) 2021-12-17T18:27:54.466 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f259259c700 1 -- 172.21.15.62:0/956863292 learned_addr learned my addr 172.21.15.62:0/956863292 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:54.466 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f2591d9b700 1 -- 172.21.15.62:0/956863292 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f25940b41f0 msgr2=0x7f2594141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:54.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f2591d9b700 1 --2- 172.21.15.62:0/956863292 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f25940b41f0 0x7f2594141fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f2591d9b700 1 -- 172.21.15.62:0/956863292 >> v1:172.21.15.109:6789/0 conn(0x7f25940b05b0 legacy=0x7f2594146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f2591d9b700 1 -- 172.21.15.62:0/956863292 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25940b2240 con 0x7f25940b5dd0 2021-12-17T18:27:54.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f2592d9d700 1 --2- 172.21.15.62:0/956863292 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f25940b41f0 0x7f2594141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:54.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f2591d9b700 1 --2- 172.21.15.62:0/956863292 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f25940b5dd0 0x7f2594146da0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f2588002f70 tx=0x7f2588006df0).ready entity=mon.1 client_cookie=422d7933662b6c38 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:54.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f259159a700 1 -- 172.21.15.62:0/956863292 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f258800d570 con 0x7f25940b5dd0 2021-12-17T18:27:54.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f259159a700 1 -- 172.21.15.62:0/956863292 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2588000e90 con 0x7f25940b5dd0 2021-12-17T18:27:54.468 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.456+0000 7f259159a700 1 -- 172.21.15.62:0/956863292 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f258800d8c0 con 0x7f25940b5dd0 2021-12-17T18:27:54.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f259896b700 1 -- 172.21.15.62:0/956863292 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f25940b5dd0 msgr2=0x7f2594146da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f259896b700 1 --2- 172.21.15.62:0/956863292 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f25940b5dd0 0x7f2594146da0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f2588002f70 tx=0x7f2588006df0).stop 2021-12-17T18:27:54.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f259896b700 1 -- 172.21.15.62:0/956863292 shutdown_connections 2021-12-17T18:27:54.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f259896b700 1 --2- 172.21.15.62:0/956863292 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f25940b41f0 0x7f2594141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f259896b700 1 --2- 172.21.15.62:0/956863292 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f25940b5dd0 0x7f2594146da0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f259896b700 1 -- 172.21.15.62:0/956863292 >> 172.21.15.62:0/956863292 conn(0x7f2594062510 msgr2=0x7f25940628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:54.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f259896b700 1 -- 172.21.15.62:0/956863292 shutdown_connections 2021-12-17T18:27:54.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f259896b700 1 -- 172.21.15.62:0/956863292 wait complete. 2021-12-17T18:27:54.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f259896b700 1 Processor -- start 2021-12-17T18:27:54.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f259896b700 1 -- start start 2021-12-17T18:27:54.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f259896b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f25940b05b0 0x7f2594153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:54.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f259896b700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f25940b41f0 0x7f25940654a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:54.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f259896b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25940b5dd0 0x7f259413db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:54.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f259896b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2594063890 con 0x7f25940b5dd0 2021-12-17T18:27:54.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f259896b700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2594063ac0 con 0x7f25940b05b0 2021-12-17T18:27:54.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f259896b700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2594063d60 con 0x7f25940b41f0 2021-12-17T18:27:54.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f2592d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25940b5dd0 0x7f259413db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:54.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f259259c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f25940b05b0 0x7f2594153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:54.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f2592d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25940b5dd0 0x7f259413db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56884/0 (socket says 172.21.15.62:56884) 2021-12-17T18:27:54.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f2592d9d700 1 -- 172.21.15.62:0/1008857013 learned_addr learned my addr 172.21.15.62:0/1008857013 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:54.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.460+0000 7f2591d9b700 1 --2- 172.21.15.62:0/1008857013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f25940b41f0 0x7f25940654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:54.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.464+0000 7f259259c700 1 -- 172.21.15.62:0/1008857013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f25940b41f0 msgr2=0x7f25940654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.464+0000 7f259259c700 1 --2- 172.21.15.62:0/1008857013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f25940b41f0 0x7f25940654a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.464+0000 7f259259c700 1 -- 172.21.15.62:0/1008857013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25940b5dd0 msgr2=0x7f259413db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.464+0000 7f259259c700 1 --2- 172.21.15.62:0/1008857013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25940b5dd0 0x7f259413db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.464+0000 7f259259c700 1 -- 172.21.15.62:0/1008857013 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c009470 con 0x7f25940b05b0 2021-12-17T18:27:54.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.464+0000 7f2591d9b700 1 --2- 172.21.15.62:0/1008857013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f25940b41f0 0x7f25940654a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:54.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.464+0000 7f2592d9d700 1 --2- 172.21.15.62:0/1008857013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25940b5dd0 0x7f259413db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:54.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.464+0000 7f259259c700 1 --2- 172.21.15.62:0/1008857013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f25940b05b0 0x7f2594153750 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f25940667c0 tx=0x7f2584007ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:54.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.464+0000 7f25837fe700 1 -- 172.21.15.62:0/1008857013 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2584007e30 con 0x7f25940b05b0 2021-12-17T18:27:54.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.464+0000 7f259896b700 1 -- 172.21.15.62:0/1008857013 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258800b180 con 0x7f25940b05b0 2021-12-17T18:27:54.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.464+0000 7f25837fe700 1 -- 172.21.15.62:0/1008857013 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2584007110 con 0x7f25940b05b0 2021-12-17T18:27:54.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.464+0000 7f25837fe700 1 -- 172.21.15.62:0/1008857013 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2584007470 con 0x7f25940b05b0 2021-12-17T18:27:54.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.464+0000 7f259896b700 1 -- 172.21.15.62:0/1008857013 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2594146060 con 0x7f25940b05b0 2021-12-17T18:27:54.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.464+0000 7f259896b700 1 -- 172.21.15.62:0/1008857013 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2594063f20 con 0x7f25940b05b0 2021-12-17T18:27:54.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.464+0000 7f25837fe700 1 -- 172.21.15.62:0/1008857013 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f258401b070 con 0x7f25940b05b0 2021-12-17T18:27:54.481 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.464+0000 7f25837fe700 1 --2- 172.21.15.62:0/1008857013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25700534f0 0x7f25700559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:54.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.464+0000 7f25837fe700 1 -- 172.21.15.62:0/1008857013 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f258406acd0 con 0x7f25940b05b0 2021-12-17T18:27:54.482 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.468+0000 7f2591d9b700 1 --2- 172.21.15.62:0/1008857013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25700534f0 0x7f25700559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:54.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.468+0000 7f2591d9b700 1 --2- 172.21.15.62:0/1008857013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25700534f0 0x7f25700559b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f258801a000 tx=0x7f2588014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:54.483 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.476+0000 7f25837fe700 1 -- 172.21.15.62:0/1008857013 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2584041d90 con 0x7f25940b05b0 2021-12-17T18:27:54.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.604+0000 7f259896b700 1 -- 172.21.15.62:0/1008857013 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f25940b24e0 con 0x7f25940b05b0 2021-12-17T18:27:54.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.604+0000 7f25837fe700 1 -- 172.21.15.62:0/1008857013 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v141) v1 ==== 104+0+10 (secure 0 0 0) 0x7f25840453b0 con 0x7f25940b05b0 2021-12-17T18:27:54.613 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:27:54.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.608+0000 7f259896b700 1 -- 172.21.15.62:0/1008857013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25700534f0 msgr2=0x7f25700559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.608+0000 7f259896b700 1 --2- 172.21.15.62:0/1008857013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25700534f0 0x7f25700559b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f258801a000 tx=0x7f2588014000).stop 2021-12-17T18:27:54.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.608+0000 7f259896b700 1 -- 172.21.15.62:0/1008857013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f25940b05b0 msgr2=0x7f2594153750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.608+0000 7f259896b700 1 --2- 172.21.15.62:0/1008857013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f25940b05b0 0x7f2594153750 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f25940667c0 tx=0x7f2584007ba0).stop 2021-12-17T18:27:54.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.608+0000 7f259896b700 1 -- 172.21.15.62:0/1008857013 shutdown_connections 2021-12-17T18:27:54.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.608+0000 7f259896b700 1 --2- 172.21.15.62:0/1008857013 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f25700534f0 0x7f25700559b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.608+0000 7f259896b700 1 --2- 172.21.15.62:0/1008857013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25940b5dd0 0x7f259413db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.608+0000 7f259896b700 1 --2- 172.21.15.62:0/1008857013 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f25940b41f0 0x7f25940654a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.608+0000 7f259896b700 1 --2- 172.21.15.62:0/1008857013 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f25940b05b0 0x7f2594153750 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.608+0000 7f259896b700 1 -- 172.21.15.62:0/1008857013 >> 172.21.15.62:0/1008857013 conn(0x7f2594062510 msgr2=0x7f2594141270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:54.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.608+0000 7f259896b700 1 -- 172.21.15.62:0/1008857013 shutdown_connections 2021-12-17T18:27:54.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.608+0000 7f259896b700 1 -- 172.21.15.62:0/1008857013 wait complete. 2021-12-17T18:27:54.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:27:54.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.732+0000 7f1a3e618700 1 Processor -- start 2021-12-17T18:27:54.739 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.732+0000 7f1a3e618700 1 -- start start 2021-12-17T18:27:54.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.732+0000 7f1a3e618700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1a380ac040 0x7f1a381475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:54.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.732+0000 7f1a3e618700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a38060750 con 0x7f1a38147ab0 2021-12-17T18:27:54.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.732+0000 7f1a3e618700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a3814ac00 con 0x7f1a3805ca90 2021-12-17T18:27:54.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.732+0000 7f1a3e618700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3814ba50 con 0x7f1a380ac040 2021-12-17T18:27:54.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.732+0000 7f1a3de17700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1a38147ab0 0x7f1a38146510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40470/0 (socket says 172.21.15.62:40470) 2021-12-17T18:27:54.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.732+0000 7f1a3ce15700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1a380ac040 0x7f1a381475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:54.742 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.732+0000 7f1a3de17700 1 -- 172.21.15.62:0/3399489757 learned_addr learned my addr 172.21.15.62:0/3399489757 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:54.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.736+0000 7f1a3ce15700 1 -- 172.21.15.62:0/3399489757 >> v1:172.21.15.109:6789/0 conn(0x7f1a3805ca90 legacy=0x7f1a3814b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.736+0000 7f1a3ce15700 1 -- 172.21.15.62:0/3399489757 >> v1:172.21.15.62:6789/0 conn(0x7f1a38147ab0 legacy=0x7f1a38146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.736+0000 7f1a3ce15700 1 -- 172.21.15.62:0/3399489757 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3814aea0 con 0x7f1a380ac040 2021-12-17T18:27:54.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.736+0000 7f1a3ce15700 1 --2- 172.21.15.62:0/3399489757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a380ac040 0x7f1a381475c0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7f1a340032f0 tx=0x7f1a340091d0).ready entity=mon.0 client_cookie=e64860d61a7d3e35 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:54.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.736+0000 7f1a2ffff700 1 -- 172.21.15.62:0/3399489757 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a34009ea0 con 0x7f1a380ac040 2021-12-17T18:27:54.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.736+0000 7f1a2ffff700 1 -- 172.21.15.62:0/3399489757 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3400b8a0 con 0x7f1a380ac040 2021-12-17T18:27:54.745 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.736+0000 7f1a2ffff700 1 -- 172.21.15.62:0/3399489757 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a3400ba10 con 0x7f1a380ac040 2021-12-17T18:27:54.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.736+0000 7f1a3e618700 1 -- 172.21.15.62:0/3399489757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a380ac040 msgr2=0x7f1a381475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.736+0000 7f1a3e618700 1 --2- 172.21.15.62:0/3399489757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a380ac040 0x7f1a381475c0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7f1a340032f0 tx=0x7f1a340091d0).stop 2021-12-17T18:27:54.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.736+0000 7f1a3e618700 1 -- 172.21.15.62:0/3399489757 shutdown_connections 2021-12-17T18:27:54.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.736+0000 7f1a3e618700 1 --2- 172.21.15.62:0/3399489757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a380ac040 0x7f1a381475c0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.736+0000 7f1a3e618700 1 -- 172.21.15.62:0/3399489757 >> 172.21.15.62:0/3399489757 conn(0x7f1a3805be70 msgr2=0x7f1a38062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:54.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.736+0000 7f1a3e618700 1 -- 172.21.15.62:0/3399489757 shutdown_connections 2021-12-17T18:27:54.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.736+0000 7f1a3e618700 1 -- 172.21.15.62:0/3399489757 wait complete. 2021-12-17T18:27:54.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.740+0000 7f1a3e618700 1 Processor -- start 2021-12-17T18:27:54.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.740+0000 7f1a3e618700 1 -- start start 2021-12-17T18:27:54.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.740+0000 7f1a3e618700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1a3805ca90 0x7f1a3814e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:54.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.740+0000 7f1a3e618700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1a380ac040 0x7f1a38156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:54.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.740+0000 7f1a3e618700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a38147ab0 0x7f1a38156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:54.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.740+0000 7f1a3e618700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a380ad760 con 0x7f1a38147ab0 2021-12-17T18:27:54.751 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.740+0000 7f1a3e618700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a380ae5d0 con 0x7f1a3805ca90 2021-12-17T18:27:54.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.740+0000 7f1a3e618700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a380ae870 con 0x7f1a380ac040 2021-12-17T18:27:54.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.740+0000 7f1a3de17700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a38147ab0 0x7f1a38156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:54.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.740+0000 7f1a3de17700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a38147ab0 0x7f1a38156e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56896/0 (socket says 172.21.15.62:56896) 2021-12-17T18:27:54.752 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.740+0000 7f1a3de17700 1 -- 172.21.15.62:0/3346264223 learned_addr learned my addr 172.21.15.62:0/3346264223 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:54.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.740+0000 7f1a3ce15700 1 --2- 172.21.15.62:0/3346264223 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1a380ac040 0x7f1a38156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:54.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.740+0000 7f1a3d616700 1 --2- 172.21.15.62:0/3346264223 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1a3805ca90 0x7f1a3814e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:54.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.744+0000 7f1a3de17700 1 -- 172.21.15.62:0/3346264223 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1a380ac040 msgr2=0x7f1a38156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.744+0000 7f1a3de17700 1 --2- 172.21.15.62:0/3346264223 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1a380ac040 0x7f1a38156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.744+0000 7f1a3de17700 1 -- 172.21.15.62:0/3346264223 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1a3805ca90 msgr2=0x7f1a3814e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.744+0000 7f1a3de17700 1 --2- 172.21.15.62:0/3346264223 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1a3805ca90 0x7f1a3814e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.744+0000 7f1a3de17700 1 -- 172.21.15.62:0/3346264223 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a34009470 con 0x7f1a38147ab0 2021-12-17T18:27:54.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.744+0000 7f1a3de17700 1 --2- 172.21.15.62:0/3346264223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a38147ab0 0x7f1a38156e30 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f1a380b1c40 tx=0x7f1a30007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:54.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.744+0000 7f1a2e7fc700 1 -- 172.21.15.62:0/3346264223 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a30001d70 con 0x7f1a38147ab0 2021-12-17T18:27:54.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.744+0000 7f1a2e7fc700 1 -- 172.21.15.62:0/3346264223 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a300070d0 con 0x7f1a38147ab0 2021-12-17T18:27:54.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.744+0000 7f1a2e7fc700 1 -- 172.21.15.62:0/3346264223 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a30007430 con 0x7f1a38147ab0 2021-12-17T18:27:54.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.744+0000 7f1a3e618700 1 -- 172.21.15.62:0/3346264223 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a380aeb10 con 0x7f1a38147ab0 2021-12-17T18:27:54.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.744+0000 7f1a3e618700 1 -- 172.21.15.62:0/3346264223 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a380ad8d0 con 0x7f1a38147ab0 2021-12-17T18:27:54.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.744+0000 7f1a3e618700 1 -- 172.21.15.62:0/3346264223 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a380aeca0 con 0x7f1a38147ab0 2021-12-17T18:27:54.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.744+0000 7f1a2e7fc700 1 -- 172.21.15.62:0/3346264223 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1a30010070 con 0x7f1a38147ab0 2021-12-17T18:27:54.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.744+0000 7f1a2e7fc700 1 --2- 172.21.15.62:0/3346264223 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1a20053610 0x7f1a20055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:54.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.744+0000 7f1a2e7fc700 1 -- 172.21.15.62:0/3346264223 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1a3006adf0 con 0x7f1a38147ab0 2021-12-17T18:27:54.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.744+0000 7f1a3d616700 1 --2- 172.21.15.62:0/3346264223 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1a20053610 0x7f1a20055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:54.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.748+0000 7f1a3d616700 1 --2- 172.21.15.62:0/3346264223 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1a20053610 0x7f1a20055ad0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f1a2800d000 tx=0x7f1a28007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:54.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.748+0000 7f1a2e7fc700 1 -- 172.21.15.62:0/3346264223 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1a30041f50 con 0x7f1a38147ab0 2021-12-17T18:27:54.882 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.876+0000 7f1a3e618700 1 -- 172.21.15.62:0/3346264223 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a3805ce70 con 0x7f1a38147ab0 2021-12-17T18:27:54.883 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.876+0000 7f1a2e7fc700 1 -- 172.21.15.62:0/3346264223 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v141) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1a30045570 con 0x7f1a38147ab0 2021-12-17T18:27:54.884 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:27:54.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.880+0000 7f1a3e618700 1 -- 172.21.15.62:0/3346264223 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1a20053610 msgr2=0x7f1a20055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.885 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.880+0000 7f1a3e618700 1 --2- 172.21.15.62:0/3346264223 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1a20053610 0x7f1a20055ad0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f1a2800d000 tx=0x7f1a28007b90).stop 2021-12-17T18:27:54.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.880+0000 7f1a3e618700 1 -- 172.21.15.62:0/3346264223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a38147ab0 msgr2=0x7f1a38156e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:54.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.880+0000 7f1a3e618700 1 --2- 172.21.15.62:0/3346264223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a38147ab0 0x7f1a38156e30 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f1a380b1c40 tx=0x7f1a30007c30).stop 2021-12-17T18:27:54.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.880+0000 7f1a3e618700 1 -- 172.21.15.62:0/3346264223 shutdown_connections 2021-12-17T18:27:54.886 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.880+0000 7f1a3e618700 1 --2- 172.21.15.62:0/3346264223 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1a20053610 0x7f1a20055ad0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.880+0000 7f1a3e618700 1 --2- 172.21.15.62:0/3346264223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a38147ab0 0x7f1a38156e30 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.880+0000 7f1a3e618700 1 --2- 172.21.15.62:0/3346264223 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1a380ac040 0x7f1a38156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.880+0000 7f1a3e618700 1 --2- 172.21.15.62:0/3346264223 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1a3805ca90 0x7f1a3814e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:54.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.880+0000 7f1a3e618700 1 -- 172.21.15.62:0/3346264223 >> 172.21.15.62:0/3346264223 conn(0x7f1a3805be70 msgr2=0x7f1a38146720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:54.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.880+0000 7f1a3e618700 1 -- 172.21.15.62:0/3346264223 shutdown_connections 2021-12-17T18:27:54.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.880+0000 7f1a3e618700 1 -- 172.21.15.62:0/3346264223 wait complete. 2021-12-17T18:27:54.897 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:27:54.897 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:55.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.988+0000 7f2d0d0f4700 1 Processor -- start 2021-12-17T18:27:55.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0d0f4700 1 -- start start 2021-12-17T18:27:55.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0d0f4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2d08143780 0x7f2d08143b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:55.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0d0f4700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f2d08067120 0x7f2d080675a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:55.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0d0f4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d080ad7f0 con 0x7f2d08067a90 2021-12-17T18:27:55.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0d0f4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d080ada90 con 0x7f2d08143780 2021-12-17T18:27:55.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0d0f4700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d080add30 con 0x7f2d08067120 2021-12-17T18:27:55.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d06d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2d08143780 0x7f2d08143b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:55.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0759e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2d08067a90 0x7f2d08140010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40484/0 (socket says 172.21.15.62:40484) 2021-12-17T18:27:55.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0759e700 1 -- 172.21.15.62:0/268694676 learned_addr learned my addr 172.21.15.62:0/268694676 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:55.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0659c700 1 --2- 172.21.15.62:0/268694676 >> v2:172.21.15.109:3300/0 conn(0x7f2d08067120 0x7f2d080675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:55.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d05d9b700 1 -- 172.21.15.62:0/268694676 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218493865 0 0) 0x7f2d080ad7f0 con 0x7f2d08067a90 2021-12-17T18:27:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d05d9b700 1 -- 172.21.15.62:0/268694676 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cec003260 con 0x7f2d08067a90 2021-12-17T18:27:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0659c700 1 -- 172.21.15.62:0/268694676 >> v2:172.21.15.62:3300/0 conn(0x7f2d08143780 msgr2=0x7f2d08143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0659c700 1 --2- 172.21.15.62:0/268694676 >> v2:172.21.15.62:3300/0 conn(0x7f2d08143780 0x7f2d08143b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0659c700 1 -- 172.21.15.62:0/268694676 >> v1:172.21.15.62:6789/0 conn(0x7f2d08067a90 legacy=0x7f2d08140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:55.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0659c700 1 -- 172.21.15.62:0/268694676 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d08144050 con 0x7f2d08067120 2021-12-17T18:27:55.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0659c700 1 --2- 172.21.15.62:0/268694676 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2d08067120 0x7f2d080675a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f2cfc002f70 tx=0x7f2cfc006df0).ready entity=mon.1 client_cookie=704b8de99f773d6d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:55.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d05d9b700 1 -- 172.21.15.62:0/268694676 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cfc00d4f0 con 0x7f2d08067120 2021-12-17T18:27:55.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d05d9b700 1 -- 172.21.15.62:0/268694676 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc000e90 con 0x7f2d08067120 2021-12-17T18:27:55.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d05d9b700 1 -- 172.21.15.62:0/268694676 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cfc00d840 con 0x7f2d08067120 2021-12-17T18:27:55.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0d0f4700 1 -- 172.21.15.62:0/268694676 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2d08067120 msgr2=0x7f2d080675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:55.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0d0f4700 1 --2- 172.21.15.62:0/268694676 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2d08067120 0x7f2d080675a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f2cfc002f70 tx=0x7f2cfc006df0).stop 2021-12-17T18:27:55.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0d0f4700 1 -- 172.21.15.62:0/268694676 shutdown_connections 2021-12-17T18:27:55.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0d0f4700 1 --2- 172.21.15.62:0/268694676 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2d08067120 0x7f2d080675a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:55.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0d0f4700 1 --2- 172.21.15.62:0/268694676 >> v2:172.21.15.62:3300/0 conn(0x7f2d08143780 0x7f2d08143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:55.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0d0f4700 1 -- 172.21.15.62:0/268694676 >> 172.21.15.62:0/268694676 conn(0x7f2d0805f730 msgr2=0x7f2d0805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:55.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0d0f4700 1 -- 172.21.15.62:0/268694676 shutdown_connections 2021-12-17T18:27:55.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.992+0000 7f2d0d0f4700 1 -- 172.21.15.62:0/268694676 wait complete. 2021-12-17T18:27:55.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.996+0000 7f2d0d0f4700 1 Processor -- start 2021-12-17T18:27:55.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:54.996+0000 7f2d0d0f4700 1 -- start start 2021-12-17T18:27:55.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0d0f4700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2d08067120 0x7f2d080aa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:55.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0d0f4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d08067a90 0x7f2d0813dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:55.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0d0f4700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2d08143780 0x7f2d081378d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:55.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0d0f4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0813e3d0 con 0x7f2d08067a90 2021-12-17T18:27:55.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0d0f4700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d080ab160 con 0x7f2d08067120 2021-12-17T18:27:55.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0d0f4700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d080ab400 con 0x7f2d08143780 2021-12-17T18:27:55.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d08067a90 0x7f2d0813dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:55.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d08067a90 0x7f2d0813dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56908/0 (socket says 172.21.15.62:56908) 2021-12-17T18:27:55.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0659c700 1 -- 172.21.15.62:0/3168536411 learned_addr learned my addr 172.21.15.62:0/3168536411 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:55.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d06d9d700 1 --2- 172.21.15.62:0/3168536411 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2d08067120 0x7f2d080aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:55.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0759e700 1 --2- 172.21.15.62:0/3168536411 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2d08143780 0x7f2d081378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:55.018 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0659c700 1 -- 172.21.15.62:0/3168536411 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2d08143780 msgr2=0x7f2d081378d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:55.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0659c700 1 --2- 172.21.15.62:0/3168536411 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2d08143780 0x7f2d081378d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:55.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0659c700 1 -- 172.21.15.62:0/3168536411 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2d08067120 msgr2=0x7f2d080aa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:55.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0659c700 1 --2- 172.21.15.62:0/3168536411 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2d08067120 0x7f2d080aa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:55.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0659c700 1 -- 172.21.15.62:0/3168536411 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc00b180 con 0x7f2d08067a90 2021-12-17T18:27:55.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0759e700 1 --2- 172.21.15.62:0/3168536411 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2d08143780 0x7f2d081378d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:55.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d06d9d700 1 --2- 172.21.15.62:0/3168536411 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2d08067120 0x7f2d080aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:55.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0659c700 1 --2- 172.21.15.62:0/3168536411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d08067a90 0x7f2d0813dbe0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f2cfc002f70 tx=0x7f2cfc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:55.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2cf7fff700 1 -- 172.21.15.62:0/3168536411 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cfc016070 con 0x7f2d08067a90 2021-12-17T18:27:55.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0d0f4700 1 -- 172.21.15.62:0/3168536411 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0813e0d0 con 0x7f2d08067a90 2021-12-17T18:27:55.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2cf7fff700 1 -- 172.21.15.62:0/3168536411 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc013a00 con 0x7f2d08067a90 2021-12-17T18:27:55.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0d0f4700 1 -- 172.21.15.62:0/3168536411 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d080ab8a0 con 0x7f2d08067a90 2021-12-17T18:27:55.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2cf7fff700 1 -- 172.21.15.62:0/3168536411 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cfc013d60 con 0x7f2d08067a90 2021-12-17T18:27:55.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2d0d0f4700 1 -- 172.21.15.62:0/3168536411 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d080573d0 con 0x7f2d08067a90 2021-12-17T18:27:55.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.000+0000 7f2cf7fff700 1 -- 172.21.15.62:0/3168536411 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2cfc00f030 con 0x7f2d08067a90 2021-12-17T18:27:55.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.004+0000 7f2cf7fff700 1 --2- 172.21.15.62:0/3168536411 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ce40534f0 0x7f2ce40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:55.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.004+0000 7f2cf7fff700 1 -- 172.21.15.62:0/3168536411 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2cfc06c5a0 con 0x7f2d08067a90 2021-12-17T18:27:55.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.004+0000 7f2d06d9d700 1 --2- 172.21.15.62:0/3168536411 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ce40534f0 0x7f2ce40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:55.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.004+0000 7f2d06d9d700 1 --2- 172.21.15.62:0/3168536411 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ce40534f0 0x7f2ce40559b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f2cf800b000 tx=0x7f2cf8008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:55.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.008+0000 7f2cf7fff700 1 -- 172.21.15.62:0/3168536411 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2cfc043710 con 0x7f2d08067a90 2021-12-17T18:27:55.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.172+0000 7f2d0d0f4700 1 -- 172.21.15.62:0/3168536411 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d08140f00 con 0x7f2d08067a90 2021-12-17T18:27:55.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.172+0000 7f2cf7fff700 1 -- 172.21.15.62:0/3168536411 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f2cfc023020 con 0x7f2d08067a90 2021-12-17T18:27:55.180 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:55.180 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":71,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8323,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4209581820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4209581820},{"type":"v1","addr":"172.21.15.62:6833","nonce":4209581820}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:27:46.812077+0000","modified":"2021-12-17T18:27:47.814929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8326},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8326":{"gid":8326,"name":"b","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/1293726231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1293726231},{"type":"v1","addr":"172.21.15.109:6835","nonce":1293726231}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-12-17T18:27:55.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.176+0000 7f2d0d0f4700 1 -- 172.21.15.62:0/3168536411 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ce40534f0 msgr2=0x7f2ce40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:55.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.176+0000 7f2d0d0f4700 1 --2- 172.21.15.62:0/3168536411 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ce40534f0 0x7f2ce40559b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f2cf800b000 tx=0x7f2cf8008040).stop 2021-12-17T18:27:55.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.176+0000 7f2d0d0f4700 1 -- 172.21.15.62:0/3168536411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d08067a90 msgr2=0x7f2d0813dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:55.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.176+0000 7f2d0d0f4700 1 --2- 172.21.15.62:0/3168536411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d08067a90 0x7f2d0813dbe0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f2cfc002f70 tx=0x7f2cfc014000).stop 2021-12-17T18:27:55.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.176+0000 7f2d0d0f4700 1 -- 172.21.15.62:0/3168536411 shutdown_connections 2021-12-17T18:27:55.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.176+0000 7f2d0d0f4700 1 --2- 172.21.15.62:0/3168536411 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2ce40534f0 0x7f2ce40559b0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:55.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.176+0000 7f2d0d0f4700 1 --2- 172.21.15.62:0/3168536411 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f2d08143780 0x7f2d081378d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:55.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.176+0000 7f2d0d0f4700 1 --2- 172.21.15.62:0/3168536411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d08067a90 0x7f2d0813dbe0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:55.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.176+0000 7f2d0d0f4700 1 --2- 172.21.15.62:0/3168536411 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2d08067120 0x7f2d080aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:55.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.176+0000 7f2d0d0f4700 1 -- 172.21.15.62:0/3168536411 >> 172.21.15.62:0/3168536411 conn(0x7f2d0805f730 msgr2=0x7f2d081384f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:55.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.176+0000 7f2d0d0f4700 1 -- 172.21.15.62:0/3168536411 shutdown_connections 2021-12-17T18:27:55.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:55.176+0000 7f2d0d0f4700 1 -- 172.21.15.62:0/3168536411 wait complete. 2021-12-17T18:27:55.185 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 71 2021-12-17T18:27:55.394 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:27:46.812077+0000', 'modified': '2021-12-17T18:27:47.814929+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8326}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8326': {'gid': 8326, 'name': 'b', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.109:6835/1293726231', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.109:6834', 'nonce': 1293726231}, {'type': 'v1', 'addr': '172.21.15.109:6835', 'nonce': 1293726231}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:27:55.395 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:27:55.396 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-12-17T18:27:55.511 INFO:teuthology.orchestra.run.smithi109.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":8326,"want_state":"up:active","state":"up:active","rank_uptime":8.6835155390000001,"mdsmap_epoch":71,"osdmap_epoch":141,"osdmap_epoch_barrier":140,"uptime":13.063284114} 2021-12-17T18:27:55.512 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 8326, "mdsmap_epoch": 71, "osdmap_epoch": 141, "osdmap_epoch_barrier": 140, "rank_uptime": 8.683515539, "state": "up:active", "uptime": 13.063284114, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:27:55.512 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:27:55.513 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-12-17T18:27:55.513 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi158.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-12-17T18:27:55.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:55.514 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:55.523 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:27:55.582 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:27:55.582 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:27:55.592 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:27:55.593 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:27:55.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:55.595 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:27:55.600 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:27:55.601 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:55.604 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:27:55.620 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:27:55.622 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:27:55.677 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:2021-12-17T18:27:55.670+0000 7f0822996080 -1 init, newargv = 0x5570ffc442c0 newargc=9ceph-fuse[14654]: starting ceph client 2021-12-17T18:27:55.677 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr: 2021-12-17T18:27:55.681 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:27:55.682 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:27:55.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:55.684 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:27:55.687 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14654]: starting fuse 2021-12-17T18:27:55.690 INFO:teuthology.orchestra.run.smithi158.stdout:52 2021-12-17T18:27:55.691 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:27:55.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:55.691 DEBUG:teuthology.orchestra.run.smithi158:> sudo python3 -c ' 2021-12-17T18:27:55.692 DEBUG:teuthology.orchestra.run.smithi158:> import glob 2021-12-17T18:27:55.692 DEBUG:teuthology.orchestra.run.smithi158:> import re 2021-12-17T18:27:55.693 DEBUG:teuthology.orchestra.run.smithi158:> import os 2021-12-17T18:27:55.693 DEBUG:teuthology.orchestra.run.smithi158:> import subprocess 2021-12-17T18:27:55.694 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:27:55.694 DEBUG:teuthology.orchestra.run.smithi158:> def find_socket(client_name): 2021-12-17T18:27:55.694 DEBUG:teuthology.orchestra.run.smithi158:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-12-17T18:27:55.695 DEBUG:teuthology.orchestra.run.smithi158:> files = glob.glob(asok_path) 2021-12-17T18:27:55.695 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:27:55.696 DEBUG:teuthology.orchestra.run.smithi158:> # Given a non-glob path, it better be there 2021-12-17T18:27:55.696 DEBUG:teuthology.orchestra.run.smithi158:> if "*" not in asok_path: 2021-12-17T18:27:55.697 DEBUG:teuthology.orchestra.run.smithi158:> assert(len(files) == 1) 2021-12-17T18:27:55.697 DEBUG:teuthology.orchestra.run.smithi158:> return files[0] 2021-12-17T18:27:55.697 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:27:55.698 DEBUG:teuthology.orchestra.run.smithi158:> for f in files: 2021-12-17T18:27:55.698 DEBUG:teuthology.orchestra.run.smithi158:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:27:55.699 DEBUG:teuthology.orchestra.run.smithi158:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:27:55.699 DEBUG:teuthology.orchestra.run.smithi158:> return f 2021-12-17T18:27:55.700 DEBUG:teuthology.orchestra.run.smithi158:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:27:55.700 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:27:55.700 DEBUG:teuthology.orchestra.run.smithi158:> print(find_socket("client.1")) 2021-12-17T18:27:55.701 DEBUG:teuthology.orchestra.run.smithi158:> ' 2021-12-17T18:27:55.742 INFO:teuthology.orchestra.run.smithi158.stdout:/var/run/ceph/ceph-client.1.14654.asok 2021-12-17T18:27:55.747 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14654.asok 2021-12-17T18:27:55.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:55.749 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14654.asok status 2021-12-17T18:27:55.883 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2021-12-17T18:27:55.883 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": { 2021-12-17T18:27:55.883 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:27:55.884 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:27:55.884 INFO:teuthology.orchestra.run.smithi158.stdout: "entity_id": "1", 2021-12-17T18:27:55.884 INFO:teuthology.orchestra.run.smithi158.stdout: "hostname": "smithi158", 2021-12-17T18:27:55.884 INFO:teuthology.orchestra.run.smithi158.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-12-17T18:27:55.885 INFO:teuthology.orchestra.run.smithi158.stdout: "pid": "14654", 2021-12-17T18:27:55.885 INFO:teuthology.orchestra.run.smithi158.stdout: "root": "/" 2021-12-17T18:27:55.885 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:27:55.885 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_count": 0, 2021-12-17T18:27:55.886 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_pinned_count": 0, 2021-12-17T18:27:55.886 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 8688, 2021-12-17T18:27:55.886 INFO:teuthology.orchestra.run.smithi158.stdout: "inst": { 2021-12-17T18:27:55.886 INFO:teuthology.orchestra.run.smithi158.stdout: "name": { 2021-12-17T18:27:55.887 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "client", 2021-12-17T18:27:55.887 INFO:teuthology.orchestra.run.smithi158.stdout: "num": 8688 2021-12-17T18:27:55.887 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:27:55.887 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:27:55.888 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:27:55.888 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:27:55.888 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 1913283983 2021-12-17T18:27:55.888 INFO:teuthology.orchestra.run.smithi158.stdout: } 2021-12-17T18:27:55.889 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:27:55.889 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:27:55.889 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:27:55.889 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:27:55.890 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 1913283983 2021-12-17T18:27:55.890 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:27:55.890 INFO:teuthology.orchestra.run.smithi158.stdout: "inst_str": "client.8688 172.21.15.158:0/1913283983", 2021-12-17T18:27:55.890 INFO:teuthology.orchestra.run.smithi158.stdout: "addr_str": "172.21.15.158:0/1913283983", 2021-12-17T18:27:55.891 INFO:teuthology.orchestra.run.smithi158.stdout: "inode_count": 1, 2021-12-17T18:27:55.891 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_epoch": 71, 2021-12-17T18:27:55.891 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch": 141, 2021-12-17T18:27:55.891 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:27:55.892 INFO:teuthology.orchestra.run.smithi158.stdout: "blacklisted": false, 2021-12-17T18:27:55.892 INFO:teuthology.orchestra.run.smithi158.stdout: "fs_name": "cephfs" 2021-12-17T18:27:55.892 INFO:teuthology.orchestra.run.smithi158.stdout:} 2021-12-17T18:27:55.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:55.894 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:55.894 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:55.901 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:27:55.902 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:27:55.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:55.903 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:55.918 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-12-17T18:27:55.919 DEBUG:teuthology.orchestra.run.smithi125:> cd /home/ubuntu/cephtest/mnt.0 && sudo getfattr --only-values -n ceph.dir.rctime . 2021-12-17T18:27:55.951 INFO:teuthology.orchestra.run.smithi125.stdout:1639765675.911955271 2021-12-17T18:27:55.951 INFO:tasks.cephfs.test_misc:rctime = 1639765675.911955271 2021-12-17T18:27:55.952 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:27:55.952 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:55.972 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:55.994 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:56.015 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:56.035 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:27:56.057 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:27:56.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:56.058 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:56.059 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:56.067 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:27:56.068 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:27:56.069 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2021-12-17T18:27:56.069 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:27:56.069 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:56.084 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[15180]: fuse finished with error 0 and tester_r 0 2021-12-17T18:27:56.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:56.088 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:56.088 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:56.135 INFO:teuthology.orchestra.run.smithi125.stdout:ext2/ext3 2021-12-17T18:27:56.136 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:27:56.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:27:56.140 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:27:56.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:56.148 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:56.148 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:56.157 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:27:56.158 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:27:56.158 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi158.front.sepia.ceph.com... 2021-12-17T18:27:56.159 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:27:56.159 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:56.216 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14654]: fuse finished with error 0 and tester_r 0 2021-12-17T18:27:56.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:56.218 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:56.219 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:56.224 INFO:teuthology.orchestra.run.smithi158.stdout:ext2/ext3 2021-12-17T18:27:56.226 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:27:56.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:27:56.271 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:27:56.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:27:56.279 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:27:56.280 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:27:56.287 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:27:56.288 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:27:56.289 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:27:56.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:27:56.290 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:27:56.296 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:27:56.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:27:56.298 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:27:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.404+0000 7f3c90c23700 1 Processor -- start 2021-12-17T18:27:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.404+0000 7f3c90c23700 1 -- start start 2021-12-17T18:27:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.404+0000 7f3c90c23700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f3c8c0b5c80 0x7f3c8c0b6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.404+0000 7f3c90c23700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c8c0afcf0 0x7f3c8c142b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.404+0000 7f3c90c23700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8c0b1540 con 0x7f3c8c143060 2021-12-17T18:27:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.404+0000 7f3c90c23700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8c0b0140 con 0x7f3c8c0b5c80 2021-12-17T18:27:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.404+0000 7f3c90c23700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c0af5b0 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.404+0000 7f3c8affd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c8c0afcf0 0x7f3c8c142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:56.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.404+0000 7f3c8b7fe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f3c8c0b5c80 0x7f3c8c0b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:56.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.404+0000 7f3c8affd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c8c0afcf0 0x7f3c8c142b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:50616/0 (socket says 172.21.15.62:50616) 2021-12-17T18:27:56.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.404+0000 7f3c8affd700 1 -- 172.21.15.62:0/2257827501 learned_addr learned my addr 172.21.15.62:0/2257827501 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:56.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.404+0000 7f3c8bfff700 1 --1- 172.21.15.62:0/2257827501 >> v1:172.21.15.109:6789/0 conn(0x7f3c8c143060 0x7f3c8c13eb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:56818/0 (socket says 172.21.15.62:56818) 2021-12-17T18:27:56.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.408+0000 7f3c8affd700 1 -- 172.21.15.62:0/2257827501 >> v2:172.21.15.109:3300/0 conn(0x7f3c8c0b5c80 msgr2=0x7f3c8c0b6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:56.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.408+0000 7f3c8affd700 1 --2- 172.21.15.62:0/2257827501 >> v2:172.21.15.109:3300/0 conn(0x7f3c8c0b5c80 0x7f3c8c0b6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:56.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.408+0000 7f3c8a7fc700 1 -- 172.21.15.62:0/2257827501 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269476220 0 0) 0x7f3c8c0b1540 con 0x7f3c8c143060 2021-12-17T18:27:56.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.408+0000 7f3c8affd700 1 -- 172.21.15.62:0/2257827501 >> v1:172.21.15.109:6789/0 conn(0x7f3c8c143060 legacy=0x7f3c8c13eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:56.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.408+0000 7f3c8affd700 1 -- 172.21.15.62:0/2257827501 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c0af850 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.408+0000 7f3c8affd700 1 --2- 172.21.15.62:0/2257827501 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c8c0afcf0 0x7f3c8c142b70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f3c7c002f70 tx=0x7f3c7c006eb0).ready entity=mon.2 client_cookie=9f232bbeff8fd0fd server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:56.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.408+0000 7f3c8a7fc700 1 -- 172.21.15.62:0/2257827501 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c7c00d570 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.408+0000 7f3c8a7fc700 1 -- 172.21.15.62:0/2257827501 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c000e90 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.408+0000 7f3c8a7fc700 1 -- 172.21.15.62:0/2257827501 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c7c00d8c0 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.408+0000 7f3c90c23700 1 -- 172.21.15.62:0/2257827501 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c8c0afcf0 msgr2=0x7f3c8c142b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:56.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.408+0000 7f3c90c23700 1 --2- 172.21.15.62:0/2257827501 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c8c0afcf0 0x7f3c8c142b70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f3c7c002f70 tx=0x7f3c7c006eb0).stop 2021-12-17T18:27:56.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.408+0000 7f3c90c23700 1 -- 172.21.15.62:0/2257827501 shutdown_connections 2021-12-17T18:27:56.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.408+0000 7f3c90c23700 1 --2- 172.21.15.62:0/2257827501 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c8c0afcf0 0x7f3c8c142b70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:56.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.408+0000 7f3c90c23700 1 --2- 172.21.15.62:0/2257827501 >> v2:172.21.15.109:3300/0 conn(0x7f3c8c0b5c80 0x7f3c8c0b6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:56.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.408+0000 7f3c90c23700 1 -- 172.21.15.62:0/2257827501 >> 172.21.15.62:0/2257827501 conn(0x7f3c8c05c750 msgr2=0x7f3c8c05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:56.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.408+0000 7f3c90c23700 1 -- 172.21.15.62:0/2257827501 shutdown_connections 2021-12-17T18:27:56.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.408+0000 7f3c90c23700 1 -- 172.21.15.62:0/2257827501 wait complete. 2021-12-17T18:27:56.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c90c23700 1 Processor -- start 2021-12-17T18:27:56.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c90c23700 1 -- start start 2021-12-17T18:27:56.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c90c23700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c0afcf0 0x7f3c8c1536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:56.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c90c23700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3c8c0b5c80 0x7f3c8c138270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:56.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c90c23700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c8c143060 0x7f3c8c13d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:56.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c90c23700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c138ae0 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c90c23700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c1397a0 con 0x7f3c8c0b5c80 2021-12-17T18:27:56.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c90c23700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c1399d0 con 0x7f3c8c143060 2021-12-17T18:27:56.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c8b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c0afcf0 0x7f3c8c1536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:56.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c8b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c0afcf0 0x7f3c8c1536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56920/0 (socket says 172.21.15.62:56920) 2021-12-17T18:27:56.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c8b7fe700 1 -- 172.21.15.62:0/138887330 learned_addr learned my addr 172.21.15.62:0/138887330 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:56.427 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c8bfff700 1 --2- 172.21.15.62:0/138887330 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c8c143060 0x7f3c8c13d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:56.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c8affd700 1 --2- 172.21.15.62:0/138887330 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3c8c0b5c80 0x7f3c8c138270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:56.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c8b7fe700 1 -- 172.21.15.62:0/138887330 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c8c143060 msgr2=0x7f3c8c13d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:56.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c8b7fe700 1 --2- 172.21.15.62:0/138887330 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c8c143060 0x7f3c8c13d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:56.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c8b7fe700 1 -- 172.21.15.62:0/138887330 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3c8c0b5c80 msgr2=0x7f3c8c138270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:56.428 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c8b7fe700 1 --2- 172.21.15.62:0/138887330 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3c8c0b5c80 0x7f3c8c138270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:56.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c8b7fe700 1 -- 172.21.15.62:0/138887330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c00b1e0 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c8affd700 1 --2- 172.21.15.62:0/138887330 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3c8c0b5c80 0x7f3c8c138270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:56.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c8b7fe700 1 --2- 172.21.15.62:0/138887330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c0afcf0 0x7f3c8c1536d0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f3c8000c000 tx=0x7f3c80006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:56.429 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c88ff9700 1 -- 172.21.15.62:0/138887330 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c80010780 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c88ff9700 1 -- 172.21.15.62:0/138887330 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c800108e0 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c90c23700 1 -- 172.21.15.62:0/138887330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8c139c70 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c88ff9700 1 -- 172.21.15.62:0/138887330 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c80010c40 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.430 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.412+0000 7f3c90c23700 1 -- 172.21.15.62:0/138887330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8c13bd20 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.416+0000 7f3c90c23700 1 -- 172.21.15.62:0/138887330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8c13aca0 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.416+0000 7f3c88ff9700 1 -- 172.21.15.62:0/138887330 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3c8001c460 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.416+0000 7f3c88ff9700 1 --2- 172.21.15.62:0/138887330 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c6c0534f0 0x7f3c6c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:56.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.416+0000 7f3c88ff9700 1 -- 172.21.15.62:0/138887330 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3c8006bcf0 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.416+0000 7f3c8affd700 1 --2- 172.21.15.62:0/138887330 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c6c0534f0 0x7f3c6c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:56.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.420+0000 7f3c8affd700 1 --2- 172.21.15.62:0/138887330 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c6c0534f0 0x7f3c6c0559b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f3c7c01c000 tx=0x7f3c7c015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:56.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.424+0000 7f3c88ff9700 1 -- 172.21.15.62:0/138887330 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3c8c13aca0 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.552+0000 7f3c90c23700 1 -- 172.21.15.62:0/138887330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3c8c13aca0 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.556+0000 7f3c88ff9700 1 -- 172.21.15.62:0/138887330 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v141) v1 ==== 81+0+33707 (secure 0 0 0) 0x7f3c8c13aca0 con 0x7f3c8c0afcf0 2021-12-17T18:27:56.562 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:56.562 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:27:56.562 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 141, 2021-12-17T18:27:56.563 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:27:56.563 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:27:56.563 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:27:47.815591+0000", 2021-12-17T18:27:56.563 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:27:56.564 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:27:56.564 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:27:56.564 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:27:56.564 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:27:56.565 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:27:56.565 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:27:56.565 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:27:56.565 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:27:56.566 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:56.566 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:27:56.566 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:27:56.566 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:27:56.566 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:27:56.567 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:27:56.567 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 28, 2021-12-17T18:27:56.567 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:27:56.567 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:27:56.568 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:27:56.568 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:27:56.568 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:27:56.568 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.569 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:27:56.569 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:27:56.569 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:27:56.569 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:27:56.569 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:27:56.570 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:27:56.570 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:27:56.570 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:27:56.570 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:27:56.571 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:27:56.571 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:27:56.571 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:27:56.571 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:27:56.571 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:27:56.572 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:27:56.572 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:27:56.572 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:27:56.572 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:27:56.573 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:27:56.573 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:27:56.573 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:27:56.573 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:27:56.574 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:27:56.574 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.574 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:27:56.574 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:27:56.575 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:27:56.575 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:27:56.575 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:27:56.575 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:27:56.576 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:27:56.576 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:27:56.576 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:27:56.576 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:27:56.577 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:27:56.577 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:27:56.577 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:27:56.577 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:27:56.578 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:27:56.578 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:27:56.578 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:27:56.578 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:27:56.579 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:27:56.579 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:27:56.579 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:27:56.579 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:27:56.579 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:27:56.580 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:27:56.580 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:27:56.580 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:27:56.580 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:27:56.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.581 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:27:56.581 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:27:56.581 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:27:56.582 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:27:56.582 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:27:56.582 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:27:56.582 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:27:56.582 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:27:56.583 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:27:56.583 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:27:56.583 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:27:56.583 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:27:56.584 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:27:56.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.584 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:27:56.584 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:27:56.585 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.585 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.585 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:27:56.586 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:27:56.586 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:27:56.586 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:27:56.586 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:27:56.586 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:27:56.587 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:27:56.587 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:27:56.587 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:27:56.587 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:27:56.588 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:27:56.588 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:27:56.588 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:27:56.588 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:27:56.589 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:27:56.589 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:27:56.589 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:27:56.589 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:27:56.589 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:27:56.590 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:27:56.590 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:27:56.590 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:27:56.590 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:27:56.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.591 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:27:56.591 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:27:56.591 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:27:56.591 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:27:56.592 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:27:56.592 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:27:56.592 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:27:56.592 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:27:56.593 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:27:56.593 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:27:56.593 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:27:56.593 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:27:56.594 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:27:56.594 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:27:56.594 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:27:56.594 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:27:56.595 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:27:56.595 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:27:56.595 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:27:56.595 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:27:56.595 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:27:56.596 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:27:56.596 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:27:56.596 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:27:56.596 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:27:56.597 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:27:56.597 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:27:56.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.597 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:27:56.598 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:27:56.598 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:27:56.598 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:27:56.598 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:27:56.599 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:27:56.599 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:27:56.599 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:27:56.599 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:27:56.600 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:27:56.600 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:27:56.600 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:27:56.600 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:27:56.600 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:27:56.601 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.601 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.601 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.601 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 27, 2021-12-17T18:27:56.602 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2021-12-17T18:27:56.602 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:27:45.207337+0000", 2021-12-17T18:27:56.602 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:27:56.602 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:27:56.603 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:27:56.603 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:27:56.603 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:27:56.603 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:27:56.604 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:27:56.604 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:27:56.604 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:27:56.604 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:27:56.605 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:27:56.605 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:27:56.605 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:27:56.605 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:27:56.606 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:27:56.606 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:27:56.606 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:27:56.606 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:27:56.607 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:27:56.607 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:27:56.607 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.607 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "140", 2021-12-17T18:27:56.607 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:27:56.608 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:27:56.608 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:27:56.608 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:27:56.608 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:27:56.609 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:27:56.609 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:27:56.609 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:27:56.609 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:27:56.609 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:27:56.610 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:27:56.610 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:27:56.610 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:27:56.610 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:27:56.610 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:27:56.611 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:27:56.611 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:27:56.611 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:27:56.611 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:27:56.612 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:27:56.612 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:27:56.612 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:27:56.612 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:27:56.612 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:27:56.613 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:27:56.613 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:27:56.613 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.613 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:27:56.613 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:27:56.614 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:27:56.614 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:27:56.614 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:27:56.614 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:27:56.615 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:27:56.615 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:27:56.615 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:27:56.615 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:27:56.616 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:27:56.616 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:27:56.616 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2021-12-17T18:27:56.616 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2021-12-17T18:27:56.617 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2021-12-17T18:27:56.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.617 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:27:56.617 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:27:56.617 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2021-12-17T18:27:56.618 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.618 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.618 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.619 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 28, 2021-12-17T18:27:56.619 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2021-12-17T18:27:56.619 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:27:46.441638+0000", 2021-12-17T18:27:56.619 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:27:56.620 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:27:56.620 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:27:56.620 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:27:56.620 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:27:56.620 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:27:56.621 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:27:56.621 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:27:56.621 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:27:56.622 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:27:56.622 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:27:56.622 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:27:56.622 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:27:56.623 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:27:56.623 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:27:56.623 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:27:56.623 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:27:56.624 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:27:56.624 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:27:56.624 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:27:56.624 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.625 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "141", 2021-12-17T18:27:56.625 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:27:56.625 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:27:56.625 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:27:56.625 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:27:56.626 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:27:56.626 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:27:56.626 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:27:56.626 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:27:56.627 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:27:56.627 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:27:56.627 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:27:56.627 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:27:56.628 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:27:56.628 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:27:56.628 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:27:56.628 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:27:56.629 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:27:56.629 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:27:56.629 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:27:56.629 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:27:56.629 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:27:56.630 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:27:56.630 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:27:56.630 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:27:56.630 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:27:56.631 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:27:56.631 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.631 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:27:56.631 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:27:56.632 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:27:56.632 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:27:56.633 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:27:56.633 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:27:56.633 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:27:56.634 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:27:56.634 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:27:56.634 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:27:56.634 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:27:56.634 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:27:56.635 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:27:56.635 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:27:56.635 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2021-12-17T18:27:56.635 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.636 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.636 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.636 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:56.636 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:27:56.637 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.637 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:27:56.637 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:27:56.637 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:56.637 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:56.638 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:56.638 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:56.638 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:56.638 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:56.639 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:56.639 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 139, 2021-12-17T18:27:56.639 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:56.639 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:56.640 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:56.640 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.640 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.640 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.641 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:27:56.641 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:56.641 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.641 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.641 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.642 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:27:56.642 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:56.642 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.642 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.643 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.643 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:56.643 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.643 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.643 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.644 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:27:56.644 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:56.644 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.644 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.645 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.645 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:27:56.645 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:56.645 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.646 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.646 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.646 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:56.646 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.647 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.647 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.647 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:27:56.647 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:56.648 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.648 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.648 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.648 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:27:56.648 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:56.649 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.649 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.649 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.649 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:56.650 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.650 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.650 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.650 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:27:56.651 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:56.651 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.651 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.651 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.652 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:27:56.652 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:27:56.652 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.652 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.652 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.653 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:27:56.653 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:27:56.653 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:27:56.653 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:27:56.654 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:56.654 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:56.654 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:56.654 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.655 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.655 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.655 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:27:56.655 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:27:56.655 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:56.656 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:56.656 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:56.656 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:56.656 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:56.657 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:56.657 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:56.657 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 139, 2021-12-17T18:27:56.657 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:56.658 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:56.658 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:56.658 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.658 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.659 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.659 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:27:56.659 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:56.659 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.660 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.660 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.660 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:27:56.660 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:56.660 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.661 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.661 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.661 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:56.661 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.662 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.662 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.662 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:27:56.662 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:56.663 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.663 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.663 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.663 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:27:56.663 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:56.664 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.664 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.664 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.664 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:56.665 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.665 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.665 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.665 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:27:56.666 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:56.666 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.666 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.666 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.666 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:27:56.667 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:56.667 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.667 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.667 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.668 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:56.668 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.668 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.668 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.668 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:27:56.669 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:56.669 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.669 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.669 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.670 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:27:56.670 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:27:56.670 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.670 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.671 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.671 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:27:56.671 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:27:56.671 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:27:56.671 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:27:56.672 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:56.672 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:56.672 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:56.672 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.673 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.673 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.673 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:27:56.673 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:27:56.674 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:56.674 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:56.674 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:56.674 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:56.675 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:56.675 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:56.675 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:56.675 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 138, 2021-12-17T18:27:56.675 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:56.676 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:56.676 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:56.676 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.676 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.676 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.677 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:27:56.677 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:56.677 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.677 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.678 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.678 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:27:56.678 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:56.678 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.679 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.679 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.679 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:56.679 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.680 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.680 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.680 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:27:56.680 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:56.680 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.681 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.681 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.681 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:27:56.681 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:56.682 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.682 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.682 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.682 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:56.683 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.683 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.683 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.683 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:27:56.684 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:56.684 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.684 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.684 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.685 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:27:56.685 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:56.685 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.685 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.685 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.686 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:56.686 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.686 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.686 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.687 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:27:56.687 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:56.687 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.687 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.688 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.688 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:27:56.688 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:27:56.688 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.688 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.689 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.689 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:27:56.689 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:27:56.689 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:27:56.690 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:27:56.690 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:56.690 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:56.690 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:56.691 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.691 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:27:56.691 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:27:56.692 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:56.692 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:56.692 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:56.692 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:56.693 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:56.693 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:56.693 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:56.693 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 128, 2021-12-17T18:27:56.694 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:56.694 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:56.694 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:56.694 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.695 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.695 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.695 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:27:56.695 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:56.695 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.696 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.696 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.696 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:27:56.696 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:56.697 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.697 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.697 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.697 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:56.698 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.698 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.698 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:27:56.698 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:56.699 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.699 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.699 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.699 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:27:56.700 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:56.700 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.700 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.700 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.701 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:56.701 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.701 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.701 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.701 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:27:56.702 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:56.702 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.702 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.702 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.703 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:27:56.703 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:56.703 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.703 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.704 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:56.704 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.704 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.705 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.705 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:27:56.705 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:56.705 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.705 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.706 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.706 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:27:56.706 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:27:56.706 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.707 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.707 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.707 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:27:56.707 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:27:56.708 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:27:56.708 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:27:56.708 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:56.708 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:56.708 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:56.709 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.709 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.709 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.709 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:27:56.710 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:27:56.710 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:56.710 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:56.710 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:56.710 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:56.711 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:56.711 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:56.711 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:56.711 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 138, 2021-12-17T18:27:56.712 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:56.712 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:56.712 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:56.712 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.713 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.713 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.713 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:27:56.713 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:56.713 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.714 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.714 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.714 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:27:56.714 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:56.715 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.715 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.715 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.715 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:56.716 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.716 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.716 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.716 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:27:56.716 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:56.717 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.717 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.717 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.717 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:27:56.718 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:56.718 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.718 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.718 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.719 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:56.719 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.719 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.719 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.719 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:27:56.720 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:56.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.720 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.720 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.721 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:27:56.721 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:56.721 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.721 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.722 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.722 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:56.722 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.722 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.722 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.723 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:27:56.723 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:56.723 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.723 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.724 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.724 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:27:56.724 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:27:56.724 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.725 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.725 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:27:56.725 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:27:56.725 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:27:56.726 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:27:56.726 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:56.726 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:56.726 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:56.727 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.727 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.727 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.727 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:27:56.728 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:27:56.728 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:56.728 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:56.728 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:56.728 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:56.729 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:56.729 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:56.729 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:56.729 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 139, 2021-12-17T18:27:56.730 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:56.730 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:56.730 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:56.730 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.731 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.731 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.731 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:27:56.731 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:56.732 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.732 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.732 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.732 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:27:56.732 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:56.733 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.733 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.733 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.733 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:56.734 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.734 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.734 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.734 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:27:56.735 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:56.735 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.735 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.735 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.736 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:27:56.736 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:56.736 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.736 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.736 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.737 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:56.737 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.737 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.737 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.738 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:27:56.738 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:56.738 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.738 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.739 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.739 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:27:56.739 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:56.739 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.740 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.740 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.740 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:56.740 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.740 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.741 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.741 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:27:56.741 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:56.741 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.742 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.742 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.742 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:27:56.742 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:27:56.743 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.743 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.743 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.743 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:27:56.743 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:27:56.744 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:27:56.744 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:27:56.744 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:56.744 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:56.745 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:56.745 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.745 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.745 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.745 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:27:56.746 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:27:56.746 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:56.746 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:56.746 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:56.747 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:56.747 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:56.747 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:56.747 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:56.748 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 139, 2021-12-17T18:27:56.748 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:56.748 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:56.748 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:56.748 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.749 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.749 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.749 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:27:56.749 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:56.750 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.750 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.750 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.750 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:27:56.750 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:56.751 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.751 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.751 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.751 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:56.752 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.752 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.752 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.752 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:27:56.753 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:56.753 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.753 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.753 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.753 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:27:56.754 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:56.754 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.754 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.754 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.755 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:56.755 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.755 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.755 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.755 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:27:56.756 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:56.756 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.756 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.756 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.757 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:27:56.757 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:56.757 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.757 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.758 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.758 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:56.758 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.758 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.758 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.759 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:27:56.759 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:56.759 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.759 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.760 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.760 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:27:56.760 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:27:56.760 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.761 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.761 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.761 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:27:56.761 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:27:56.761 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:27:56.762 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:27:56.762 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:56.762 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:56.762 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:56.763 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.763 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.763 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.763 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:27:56.763 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:27:56.764 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:27:56.764 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:27:56.764 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:27:56.764 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:27:56.765 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:27:56.765 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:27:56.765 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:27:56.765 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 139, 2021-12-17T18:27:56.766 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:27:56.766 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:27:56.766 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:27:56.766 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.766 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.767 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.767 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:27:56.767 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:56.767 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.768 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.768 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.768 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:27:56.768 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:56.768 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.769 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.769 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.769 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:27:56.769 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.770 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.770 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.770 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:27:56.770 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:56.771 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.771 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.771 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.771 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:27:56.771 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:56.772 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.772 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.772 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.772 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:27:56.773 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.773 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.773 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.773 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:27:56.773 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:56.774 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.774 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.774 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.774 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:27:56.775 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:56.775 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.775 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.775 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.776 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:27:56.776 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:27:56.776 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.776 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:27:56.776 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:27:56.777 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:56.777 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.777 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.777 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:27:56.778 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:27:56.778 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:27:56.778 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.778 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.778 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.779 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:27:56.779 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:27:56.779 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:27:56.779 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:27:56.780 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:27:56.780 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:27:56.780 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:27:56.780 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:27:56.780 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.781 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:56.781 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:27:56.781 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.781 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:27:56.782 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:56.782 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:56.782 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:56.782 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:56.783 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:56.783 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:27:56.783 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:56.783 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.783 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.784 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:27:56.784 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:56.784 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:56.784 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:56.785 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:56.785 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:56.785 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:27:56.785 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:56.786 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.786 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.786 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:27:56.786 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:56.786 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:56.787 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:56.787 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:56.787 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:56.787 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:27:56.788 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:56.788 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.788 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.788 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:27:56.789 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:56.789 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:56.789 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:56.789 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:56.789 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:56.790 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:27:56.790 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:56.790 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.790 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.791 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:27:56.791 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:56.791 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:56.791 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:56.792 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:56.792 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:56.792 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:27:56.792 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:56.792 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.793 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.793 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:27:56.793 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:56.793 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:56.794 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:56.794 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:56.794 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:56.794 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:27:56.795 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:56.795 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.795 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.795 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:27:56.795 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:56.796 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:56.796 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:56.796 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:56.796 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:56.797 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:27:56.797 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:56.797 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.797 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:27:56.798 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:27:56.798 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:27:56.798 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:27:56.798 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:27:56.798 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:27:56.799 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:27:56.799 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:27:56.799 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:27:56.799 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.800 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:27:56.800 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:27:56.800 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:27:56.800 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:27:56.801 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:27:56.801 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": {}, 2021-12-17T18:27:56.801 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:27:56.801 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:27:56.801 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:27:56.802 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:27:56.802 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:27:56.802 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:27:56.802 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:27:56.803 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:27:56.803 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:27:56.803 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:27:56.803 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:27:56.804 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:27:56.804 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:27:56.804 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:27:56.804 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:27:56.805 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:27:56.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.560+0000 7f3c90c23700 1 -- 172.21.15.62:0/138887330 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c6c0534f0 msgr2=0x7f3c6c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:56.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.560+0000 7f3c90c23700 1 --2- 172.21.15.62:0/138887330 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c6c0534f0 0x7f3c6c0559b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f3c7c01c000 tx=0x7f3c7c015000).stop 2021-12-17T18:27:56.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.560+0000 7f3c90c23700 1 -- 172.21.15.62:0/138887330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c0afcf0 msgr2=0x7f3c8c1536d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:56.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.560+0000 7f3c90c23700 1 --2- 172.21.15.62:0/138887330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c0afcf0 0x7f3c8c1536d0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f3c8000c000 tx=0x7f3c80006df0).stop 2021-12-17T18:27:56.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.560+0000 7f3c90c23700 1 -- 172.21.15.62:0/138887330 shutdown_connections 2021-12-17T18:27:56.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.560+0000 7f3c90c23700 1 --2- 172.21.15.62:0/138887330 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3c6c0534f0 0x7f3c6c0559b0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:56.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.560+0000 7f3c90c23700 1 --2- 172.21.15.62:0/138887330 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f3c8c143060 0x7f3c8c13d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:56.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.560+0000 7f3c90c23700 1 --2- 172.21.15.62:0/138887330 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f3c8c0b5c80 0x7f3c8c138270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:56.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.560+0000 7f3c90c23700 1 --2- 172.21.15.62:0/138887330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c8c0afcf0 0x7f3c8c1536d0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:56.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.560+0000 7f3c90c23700 1 -- 172.21.15.62:0/138887330 >> 172.21.15.62:0/138887330 conn(0x7f3c8c05c750 msgr2=0x7f3c8c05bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:56.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.560+0000 7f3c90c23700 1 -- 172.21.15.62:0/138887330 shutdown_connections 2021-12-17T18:27:56.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.560+0000 7f3c90c23700 1 -- 172.21.15.62:0/138887330 wait complete. 2021-12-17T18:27:56.810 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:56.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.916+0000 7fd220b60700 1 Processor -- start 2021-12-17T18:27:56.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.916+0000 7fd220b60700 1 -- start start 2021-12-17T18:27:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd220b60700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd21c063420 0x7fd21c1433e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd220b60700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21c063800 con 0x7fd21c143fe0 2021-12-17T18:27:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd220b60700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21c0ae320 con 0x7fd21c0adba0 2021-12-17T18:27:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd220b60700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd21c0ae5c0 con 0x7fd21c063420 2021-12-17T18:27:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd21b7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd21c063420 0x7fd21c1433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd21bfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd21c143fe0 0x7fd21c1400e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40512/0 (socket says 172.21.15.62:40512) 2021-12-17T18:27:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd21bfff700 1 -- 172.21.15.62:0/3617789037 learned_addr learned my addr 172.21.15.62:0/3617789037 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd21affd700 1 -- 172.21.15.62:0/3617789037 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865244134 0 0) 0x7fd21c0ae320 con 0x7fd21c0adba0 2021-12-17T18:27:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd21affd700 1 -- 172.21.15.62:0/3617789037 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1fc003260 con 0x7fd21c0adba0 2021-12-17T18:27:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd21b7fe700 1 -- 172.21.15.62:0/3617789037 >> v1:172.21.15.109:6789/0 conn(0x7fd21c0adba0 legacy=0x7fd21c1438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd21affd700 1 -- 172.21.15.62:0/3617789037 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835548344 0 0) 0x7fd21c063800 con 0x7fd21c143fe0 2021-12-17T18:27:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd21b7fe700 1 -- 172.21.15.62:0/3617789037 >> v1:172.21.15.62:6789/0 conn(0x7fd21c143fe0 legacy=0x7fd21c1400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd21b7fe700 1 -- 172.21.15.62:0/3617789037 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c0adfa0 con 0x7fd21c063420 2021-12-17T18:27:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd21b7fe700 1 --2- 172.21.15.62:0/3617789037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd21c063420 0x7fd21c1433e0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fd21c0afba0 tx=0x7fd20c006e80).ready entity=mon.0 client_cookie=aa9001e5fe9bfaa1 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd21affd700 1 -- 172.21.15.62:0/3617789037 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd20c00ba10 con 0x7fd21c063420 2021-12-17T18:27:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd21affd700 1 -- 172.21.15.62:0/3617789037 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c000e90 con 0x7fd21c063420 2021-12-17T18:27:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd21affd700 1 -- 172.21.15.62:0/3617789037 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd20c00bd60 con 0x7fd21c063420 2021-12-17T18:27:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd220b60700 1 -- 172.21.15.62:0/3617789037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd21c063420 msgr2=0x7fd21c1433e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd220b60700 1 --2- 172.21.15.62:0/3617789037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd21c063420 0x7fd21c1433e0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fd21c0afba0 tx=0x7fd20c006e80).stop 2021-12-17T18:27:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd220b60700 1 -- 172.21.15.62:0/3617789037 shutdown_connections 2021-12-17T18:27:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd220b60700 1 --2- 172.21.15.62:0/3617789037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd21c063420 0x7fd21c1433e0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:56.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd220b60700 1 -- 172.21.15.62:0/3617789037 >> 172.21.15.62:0/3617789037 conn(0x7fd21c05c750 msgr2=0x7fd21c05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:56.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd220b60700 1 -- 172.21.15.62:0/3617789037 shutdown_connections 2021-12-17T18:27:56.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.920+0000 7fd220b60700 1 -- 172.21.15.62:0/3617789037 wait complete. 2021-12-17T18:27:56.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd220b60700 1 Processor -- start 2021-12-17T18:27:56.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd220b60700 1 -- start start 2021-12-17T18:27:56.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd220b60700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd21c063420 0x7fd21c064d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:56.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd220b60700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd21c0adba0 0x7fd21c14ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:56.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd220b60700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd21c143fe0 0x7fd21c0639d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:56.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd220b60700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c14e260 con 0x7fd21c143fe0 2021-12-17T18:27:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd220b60700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c14e490 con 0x7fd21c063420 2021-12-17T18:27:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd220b60700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c14e730 con 0x7fd21c0adba0 2021-12-17T18:27:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd21bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd21c143fe0 0x7fd21c0639d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd21b7fe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd21c063420 0x7fd21c064d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd213fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd21c0adba0 0x7fd21c14ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd21bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd21c143fe0 0x7fd21c0639d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56938/0 (socket says 172.21.15.62:56938) 2021-12-17T18:27:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd21bfff700 1 -- 172.21.15.62:0/1961989815 learned_addr learned my addr 172.21.15.62:0/1961989815 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd21b7fe700 1 -- 172.21.15.62:0/1961989815 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd21c0adba0 msgr2=0x7fd21c14ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd21b7fe700 1 --2- 172.21.15.62:0/1961989815 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd21c0adba0 0x7fd21c14ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:56.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd21b7fe700 1 -- 172.21.15.62:0/1961989815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd21c143fe0 msgr2=0x7fd21c0639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:56.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd21b7fe700 1 --2- 172.21.15.62:0/1961989815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd21c143fe0 0x7fd21c0639d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:56.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd21b7fe700 1 -- 172.21.15.62:0/1961989815 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c00d410 con 0x7fd21c063420 2021-12-17T18:27:56.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd21b7fe700 1 --2- 172.21.15.62:0/1961989815 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd21c063420 0x7fd21c064d80 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7fd21c09f3d0 tx=0x7fd20c006e80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:56.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd2197fa700 1 -- 172.21.15.62:0/1961989815 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd20c020070 con 0x7fd21c063420 2021-12-17T18:27:56.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd2197fa700 1 -- 172.21.15.62:0/1961989815 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c006220 con 0x7fd21c063420 2021-12-17T18:27:56.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd2197fa700 1 -- 172.21.15.62:0/1961989815 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd20c006580 con 0x7fd21c063420 2021-12-17T18:27:56.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd220b60700 1 -- 172.21.15.62:0/1961989815 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21c065270 con 0x7fd21c063420 2021-12-17T18:27:56.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.924+0000 7fd220b60700 1 -- 172.21.15.62:0/1961989815 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21c14f0c0 con 0x7fd21c063420 2021-12-17T18:27:56.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.928+0000 7fd220b60700 1 -- 172.21.15.62:0/1961989815 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21c0ae860 con 0x7fd21c063420 2021-12-17T18:27:56.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.928+0000 7fd2197fa700 1 -- 172.21.15.62:0/1961989815 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd20c02c070 con 0x7fd21c063420 2021-12-17T18:27:56.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.928+0000 7fd2197fa700 1 --2- 172.21.15.62:0/1961989815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd200053610 0x7fd200055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:56.943 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.928+0000 7fd2197fa700 1 -- 172.21.15.62:0/1961989815 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd20c06f5f0 con 0x7fd21c063420 2021-12-17T18:27:56.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.928+0000 7fd213fff700 1 --2- 172.21.15.62:0/1961989815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd200053610 0x7fd200055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:56.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.928+0000 7fd213fff700 1 --2- 172.21.15.62:0/1961989815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd200053610 0x7fd200055ad0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fd20400d000 tx=0x7fd204007a00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:56.944 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:56.936+0000 7fd2197fa700 1 -- 172.21.15.62:0/1961989815 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd20c046750 con 0x7fd21c063420 2021-12-17T18:27:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.104+0000 7fd220b60700 1 -- 172.21.15.62:0/1961989815 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd21c0573d0 con 0x7fd21c063420 2021-12-17T18:27:57.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.104+0000 7fd2197fa700 1 -- 172.21.15.62:0/1961989815 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+2145 (secure 0 0 0) 0x7fd20c002f50 con 0x7fd21c063420 2021-12-17T18:27:57.113 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:57.113 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":71,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8323,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4209581820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4209581820},{"type":"v1","addr":"172.21.15.62:6833","nonce":4209581820}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:27:46.812077+0000","modified":"2021-12-17T18:27:47.814929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8326},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8326":{"gid":8326,"name":"b","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.109:6835/1293726231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":1293726231},{"type":"v1","addr":"172.21.15.109:6835","nonce":1293726231}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-12-17T18:27:57.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.108+0000 7fd220b60700 1 -- 172.21.15.62:0/1961989815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd200053610 msgr2=0x7fd200055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:57.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.108+0000 7fd220b60700 1 --2- 172.21.15.62:0/1961989815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd200053610 0x7fd200055ad0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fd20400d000 tx=0x7fd204007a00).stop 2021-12-17T18:27:57.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.108+0000 7fd220b60700 1 -- 172.21.15.62:0/1961989815 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd21c063420 msgr2=0x7fd21c064d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:57.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.108+0000 7fd220b60700 1 --2- 172.21.15.62:0/1961989815 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd21c063420 0x7fd21c064d80 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7fd21c09f3d0 tx=0x7fd20c006e80).stop 2021-12-17T18:27:57.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.108+0000 7fd220b60700 1 -- 172.21.15.62:0/1961989815 shutdown_connections 2021-12-17T18:27:57.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.108+0000 7fd220b60700 1 --2- 172.21.15.62:0/1961989815 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd200053610 0x7fd200055ad0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.108+0000 7fd220b60700 1 --2- 172.21.15.62:0/1961989815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd21c143fe0 0x7fd21c0639d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.108+0000 7fd220b60700 1 --2- 172.21.15.62:0/1961989815 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd21c0adba0 0x7fd21c14ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.108+0000 7fd220b60700 1 --2- 172.21.15.62:0/1961989815 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd21c063420 0x7fd21c064d80 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.108+0000 7fd220b60700 1 -- 172.21.15.62:0/1961989815 >> 172.21.15.62:0/1961989815 conn(0x7fd21c05c750 msgr2=0x7fd21c13f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:57.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.108+0000 7fd220b60700 1 -- 172.21.15.62:0/1961989815 shutdown_connections 2021-12-17T18:27:57.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.108+0000 7fd220b60700 1 -- 172.21.15.62:0/1961989815 wait complete. 2021-12-17T18:27:57.119 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 71 2021-12-17T18:27:57.131 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-12-17T18:27:57.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.228+0000 7f1b66b80700 1 Processor -- start 2021-12-17T18:27:57.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.228+0000 7f1b66b80700 1 -- start start 2021-12-17T18:27:57.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b66b80700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1b600b2230 0x7f1b600b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:57.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b66b80700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b600aec60 0x7f1b60146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:57.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b66b80700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b600b18c0 con 0x7f1b6005fa70 2021-12-17T18:27:57.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b66b80700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6005fe50 con 0x7f1b600b2230 2021-12-17T18:27:57.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b66b80700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600b1af0 con 0x7f1b600aec60 2021-12-17T18:27:57.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b65b7e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1b6005fa70 0x7f1b601465e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40522/0 (socket says 172.21.15.62:40522) 2021-12-17T18:27:57.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b65b7e700 1 -- 172.21.15.62:0/538949293 learned_addr learned my addr 172.21.15.62:0/538949293 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:57.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b6537d700 1 --2- 172.21.15.62:0/538949293 >> v2:172.21.15.109:3300/0 conn(0x7f1b600b2230 0x7f1b600b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:57.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b6637f700 1 --2- 172.21.15.62:0/538949293 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b600aec60 0x7f1b60146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:57.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b64b7c700 1 -- 172.21.15.62:0/538949293 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169819291 0 0) 0x7f1b600b18c0 con 0x7f1b6005fa70 2021-12-17T18:27:57.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b64b7c700 1 -- 172.21.15.62:0/538949293 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b48003260 con 0x7f1b6005fa70 2021-12-17T18:27:57.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b6537d700 1 -- 172.21.15.62:0/538949293 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b600aec60 msgr2=0x7f1b60146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:57.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b6537d700 1 --2- 172.21.15.62:0/538949293 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b600aec60 0x7f1b60146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b6537d700 1 -- 172.21.15.62:0/538949293 >> v1:172.21.15.62:6789/0 conn(0x7f1b6005fa70 legacy=0x7f1b601465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:57.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b6537d700 1 -- 172.21.15.62:0/538949293 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b600b1d90 con 0x7f1b600b2230 2021-12-17T18:27:57.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b6537d700 1 --2- 172.21.15.62:0/538949293 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1b600b2230 0x7f1b600b0ed0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f1b50002f70 tx=0x7f1b50006df0).ready entity=mon.1 client_cookie=fa71a5b68caa1d48 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:57.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b64b7c700 1 -- 172.21.15.62:0/538949293 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b5000d4a0 con 0x7f1b600b2230 2021-12-17T18:27:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b64b7c700 1 -- 172.21.15.62:0/538949293 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b50000e90 con 0x7f1b600b2230 2021-12-17T18:27:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b64b7c700 1 -- 172.21.15.62:0/538949293 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b5000d7f0 con 0x7f1b600b2230 2021-12-17T18:27:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b66b80700 1 -- 172.21.15.62:0/538949293 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1b600b2230 msgr2=0x7f1b600b0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b66b80700 1 --2- 172.21.15.62:0/538949293 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1b600b2230 0x7f1b600b0ed0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f1b50002f70 tx=0x7f1b50006df0).stop 2021-12-17T18:27:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b66b80700 1 -- 172.21.15.62:0/538949293 shutdown_connections 2021-12-17T18:27:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b66b80700 1 --2- 172.21.15.62:0/538949293 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b600aec60 0x7f1b60146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b66b80700 1 --2- 172.21.15.62:0/538949293 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1b600b2230 0x7f1b600b0ed0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b66b80700 1 -- 172.21.15.62:0/538949293 >> 172.21.15.62:0/538949293 conn(0x7f1b600b6320 msgr2=0x7f1b600b6700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b66b80700 1 -- 172.21.15.62:0/538949293 shutdown_connections 2021-12-17T18:27:57.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.232+0000 7f1b66b80700 1 -- 172.21.15.62:0/538949293 wait complete. 2021-12-17T18:27:57.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b66b80700 1 Processor -- start 2021-12-17T18:27:57.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b66b80700 1 -- start start 2021-12-17T18:27:57.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b66b80700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b6005fa70 0x7f1b60149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b66b80700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b600aec60 0x7f1b60142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b66b80700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1b600b2230 0x7f1b60142a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b66b80700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60152ab0 con 0x7f1b6005fa70 2021-12-17T18:27:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b66b80700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60152d50 con 0x7f1b600b2230 2021-12-17T18:27:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b66b80700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60142ef0 con 0x7f1b600aec60 2021-12-17T18:27:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b65b7e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b6005fa70 0x7f1b60149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b65b7e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b6005fa70 0x7f1b60149cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56948/0 (socket says 172.21.15.62:56948) 2021-12-17T18:27:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b65b7e700 1 -- 172.21.15.62:0/1300464253 learned_addr learned my addr 172.21.15.62:0/1300464253 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:57.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b6537d700 1 --2- 172.21.15.62:0/1300464253 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b600aec60 0x7f1b60142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:57.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b6637f700 1 --2- 172.21.15.62:0/1300464253 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1b600b2230 0x7f1b60142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:57.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b65b7e700 1 -- 172.21.15.62:0/1300464253 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b600aec60 msgr2=0x7f1b60142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:57.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b65b7e700 1 --2- 172.21.15.62:0/1300464253 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b600aec60 0x7f1b60142510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b65b7e700 1 -- 172.21.15.62:0/1300464253 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1b600b2230 msgr2=0x7f1b60142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b65b7e700 1 --2- 172.21.15.62:0/1300464253 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1b600b2230 0x7f1b60142a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b65b7e700 1 -- 172.21.15.62:0/1300464253 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5000b180 con 0x7f1b6005fa70 2021-12-17T18:27:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b65b7e700 1 --2- 172.21.15.62:0/1300464253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b6005fa70 0x7f1b60149cd0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f1b5c001110 tx=0x7f1b5c007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b4effd700 1 -- 172.21.15.62:0/1300464253 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b5c00ce20 con 0x7f1b6005fa70 2021-12-17T18:27:57.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b4effd700 1 -- 172.21.15.62:0/1300464253 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c0072e0 con 0x7f1b6005fa70 2021-12-17T18:27:57.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b66b80700 1 -- 172.21.15.62:0/1300464253 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6014a4e0 con 0x7f1b6005fa70 2021-12-17T18:27:57.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b4effd700 1 -- 172.21.15.62:0/1300464253 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b5c005800 con 0x7f1b6005fa70 2021-12-17T18:27:57.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.236+0000 7f1b66b80700 1 -- 172.21.15.62:0/1300464253 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b60064b70 con 0x7f1b6005fa70 2021-12-17T18:27:57.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.240+0000 7f1b66b80700 1 -- 172.21.15.62:0/1300464253 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b600b1680 con 0x7f1b6005fa70 2021-12-17T18:27:57.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.240+0000 7f1b4effd700 1 -- 172.21.15.62:0/1300464253 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1b5c010070 con 0x7f1b6005fa70 2021-12-17T18:27:57.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.240+0000 7f1b4effd700 1 --2- 172.21.15.62:0/1300464253 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1b400535b0 0x7f1b40055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:57.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.240+0000 7f1b4effd700 1 -- 172.21.15.62:0/1300464253 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1b5c06b0c0 con 0x7f1b6005fa70 2021-12-17T18:27:57.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.240+0000 7f1b6537d700 1 --2- 172.21.15.62:0/1300464253 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1b400535b0 0x7f1b40055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:57.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.244+0000 7f1b6537d700 1 --2- 172.21.15.62:0/1300464253 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1b400535b0 0x7f1b40055a70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f1b5001a000 tx=0x7f1b50014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:57.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.248+0000 7f1b4effd700 1 -- 172.21.15.62:0/1300464253 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1b5c042110 con 0x7f1b6005fa70 2021-12-17T18:27:57.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.412+0000 7f1b66b80700 1 -- 172.21.15.62:0/1300464253 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1b60152f10 con 0x7f1b6005fa70 2021-12-17T18:27:57.759 INFO:tasks.ceph.mon.a.smithi062.stderr:2021-12-17T18:27:57.752+0000 7f8d3b366700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-12-17T18:27:57.765 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.760+0000 7f1b4effd700 1 -- 172.21.15.62:0/1300464253 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v72) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1b5c045730 con 0x7f1b6005fa70 2021-12-17T18:27:57.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.764+0000 7f1b66b80700 1 -- 172.21.15.62:0/1300464253 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1b400535b0 msgr2=0x7f1b40055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:57.771 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.764+0000 7f1b66b80700 1 --2- 172.21.15.62:0/1300464253 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1b400535b0 0x7f1b40055a70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f1b5001a000 tx=0x7f1b50014000).stop 2021-12-17T18:27:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.764+0000 7f1b66b80700 1 -- 172.21.15.62:0/1300464253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b6005fa70 msgr2=0x7f1b60149cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.764+0000 7f1b66b80700 1 --2- 172.21.15.62:0/1300464253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b6005fa70 0x7f1b60149cd0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f1b5c001110 tx=0x7f1b5c007ad0).stop 2021-12-17T18:27:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.764+0000 7f1b66b80700 1 -- 172.21.15.62:0/1300464253 shutdown_connections 2021-12-17T18:27:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.764+0000 7f1b66b80700 1 --2- 172.21.15.62:0/1300464253 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1b400535b0 0x7f1b40055a70 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.764+0000 7f1b66b80700 1 --2- 172.21.15.62:0/1300464253 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1b600b2230 0x7f1b60142a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.764+0000 7f1b66b80700 1 --2- 172.21.15.62:0/1300464253 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1b600aec60 0x7f1b60142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.764+0000 7f1b66b80700 1 --2- 172.21.15.62:0/1300464253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b6005fa70 0x7f1b60149cd0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.764+0000 7f1b66b80700 1 -- 172.21.15.62:0/1300464253 >> 172.21.15.62:0/1300464253 conn(0x7f1b600b6320 msgr2=0x7f1b601464f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:57.773 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.764+0000 7f1b66b80700 1 -- 172.21.15.62:0/1300464253 shutdown_connections 2021-12-17T18:27:57.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.764+0000 7f1b66b80700 1 -- 172.21.15.62:0/1300464253 wait complete. 2021-12-17T18:27:57.774 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-12-17T18:27:57.787 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:27:57.793 INFO:tasks.ceph.mds.b.smithi109.stdout:starting mds.b at 2021-12-17T18:27:57.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.892+0000 7f008694a700 1 Processor -- start 2021-12-17T18:27:57.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.892+0000 7f008694a700 1 -- start start 2021-12-17T18:27:57.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.892+0000 7f008694a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0080141480 0x7f0080147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:57.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.892+0000 7f008694a700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f00800a8e10 0x7f00800b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:57.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.892+0000 7f008694a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0080147610 con 0x7f00800b6050 2021-12-17T18:27:57.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.892+0000 7f008694a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00801478b0 con 0x7f0080141480 2021-12-17T18:27:57.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.892+0000 7f008694a700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0080147b50 con 0x7f00800a8e10 2021-12-17T18:27:57.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.892+0000 7f0085948700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0080141480 0x7f0080147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:57.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.892+0000 7f0086149700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f00800b6050 0x7f00800a7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40540/0 (socket says 172.21.15.62:40540) 2021-12-17T18:27:57.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.892+0000 7f0086149700 1 -- 172.21.15.62:0/215709697 learned_addr learned my addr 172.21.15.62:0/215709697 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:57.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.892+0000 7f0085147700 1 --2- 172.21.15.62:0/215709697 >> v2:172.21.15.109:3300/0 conn(0x7f00800a8e10 0x7f00800b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:57.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.892+0000 7f0085948700 1 -- 172.21.15.62:0/215709697 >> v2:172.21.15.109:3300/0 conn(0x7f00800a8e10 msgr2=0x7f00800b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:57.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.892+0000 7f0085948700 1 --2- 172.21.15.62:0/215709697 >> v2:172.21.15.109:3300/0 conn(0x7f00800a8e10 0x7f00800b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.892+0000 7f0085948700 1 -- 172.21.15.62:0/215709697 >> v1:172.21.15.62:6789/0 conn(0x7f00800b6050 legacy=0x7f00800a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:57.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.892+0000 7f0085948700 1 -- 172.21.15.62:0/215709697 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00800b1b90 con 0x7f0080141480 2021-12-17T18:27:57.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.892+0000 7f0084946700 1 -- 172.21.15.62:0/215709697 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235464513 0 0) 0x7f0080147610 con 0x7f00800b6050 2021-12-17T18:27:57.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.892+0000 7f0085948700 1 --2- 172.21.15.62:0/215709697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0080141480 0x7f0080147ff0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f0070002f70 tx=0x7f0070006df0).ready entity=mon.0 client_cookie=c4521fee46175ea9 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:57.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.896+0000 7f0084946700 1 -- 172.21.15.62:0/215709697 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f007000d570 con 0x7f0080141480 2021-12-17T18:27:57.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.896+0000 7f0084946700 1 -- 172.21.15.62:0/215709697 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0070000e90 con 0x7f0080141480 2021-12-17T18:27:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.896+0000 7f0084946700 1 -- 172.21.15.62:0/215709697 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f007000d8c0 con 0x7f0080141480 2021-12-17T18:27:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.896+0000 7f008694a700 1 -- 172.21.15.62:0/215709697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0080141480 msgr2=0x7f0080147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.896+0000 7f008694a700 1 --2- 172.21.15.62:0/215709697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0080141480 0x7f0080147ff0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f0070002f70 tx=0x7f0070006df0).stop 2021-12-17T18:27:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.896+0000 7f008694a700 1 -- 172.21.15.62:0/215709697 shutdown_connections 2021-12-17T18:27:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.896+0000 7f008694a700 1 --2- 172.21.15.62:0/215709697 >> v2:172.21.15.109:3300/0 conn(0x7f00800a8e10 0x7f00800b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.896+0000 7f008694a700 1 --2- 172.21.15.62:0/215709697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0080141480 0x7f0080147ff0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.896+0000 7f008694a700 1 -- 172.21.15.62:0/215709697 >> 172.21.15.62:0/215709697 conn(0x7f008005d220 msgr2=0x7f00800b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.896+0000 7f008694a700 1 -- 172.21.15.62:0/215709697 shutdown_connections 2021-12-17T18:27:57.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.896+0000 7f008694a700 1 -- 172.21.15.62:0/215709697 wait complete. 2021-12-17T18:27:57.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.896+0000 7f008694a700 1 Processor -- start 2021-12-17T18:27:57.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.896+0000 7f008694a700 1 -- start start 2021-12-17T18:27:57.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f008694a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00800a8e10 0x7f00800a9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:57.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f008694a700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f00800b6050 0x7f0080156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:57.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f008694a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0080141480 0x7f00800aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:57.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f008694a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00800ab5f0 con 0x7f00800a8e10 2021-12-17T18:27:57.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f008694a700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00800ab890 con 0x7f00800b6050 2021-12-17T18:27:57.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f008694a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008014a5a0 con 0x7f0080141480 2021-12-17T18:27:57.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f0085948700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00800a8e10 0x7f00800a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:57.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f0085948700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00800a8e10 0x7f00800a9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56962/0 (socket says 172.21.15.62:56962) 2021-12-17T18:27:57.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f0085948700 1 -- 172.21.15.62:0/2484859047 learned_addr learned my addr 172.21.15.62:0/2484859047 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:57.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f0085147700 1 --2- 172.21.15.62:0/2484859047 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f00800b6050 0x7f0080156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f0086149700 1 --2- 172.21.15.62:0/2484859047 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0080141480 0x7f00800aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f0085948700 1 -- 172.21.15.62:0/2484859047 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0080141480 msgr2=0x7f00800aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f0085948700 1 --2- 172.21.15.62:0/2484859047 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0080141480 0x7f00800aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f0085948700 1 -- 172.21.15.62:0/2484859047 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f00800b6050 msgr2=0x7f0080156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f0085948700 1 --2- 172.21.15.62:0/2484859047 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f00800b6050 0x7f0080156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f0085948700 1 -- 172.21.15.62:0/2484859047 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007000b180 con 0x7f00800a8e10 2021-12-17T18:27:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f0085948700 1 --2- 172.21.15.62:0/2484859047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00800a8e10 0x7f00800a9880 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f0070002f70 tx=0x7f0070014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f0076ffd700 1 -- 172.21.15.62:0/2484859047 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f007000dea0 con 0x7f00800a8e10 2021-12-17T18:27:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f0076ffd700 1 -- 172.21.15.62:0/2484859047 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007001e400 con 0x7f00800a8e10 2021-12-17T18:27:57.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f008694a700 1 -- 172.21.15.62:0/2484859047 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00800af030 con 0x7f00800a8e10 2021-12-17T18:27:57.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f0076ffd700 1 -- 172.21.15.62:0/2484859047 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f007001e760 con 0x7f00800a8e10 2021-12-17T18:27:57.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f008694a700 1 -- 172.21.15.62:0/2484859047 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00800a94d0 con 0x7f00800a8e10 2021-12-17T18:27:57.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f008694a700 1 -- 172.21.15.62:0/2484859047 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0080141860 con 0x7f00800a8e10 2021-12-17T18:27:57.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.900+0000 7f0076ffd700 1 -- 172.21.15.62:0/2484859047 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0070025030 con 0x7f00800a8e10 2021-12-17T18:27:57.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.904+0000 7f0076ffd700 1 --2- 172.21.15.62:0/2484859047 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00680536a0 0x7f0068055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:57.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.904+0000 7f0076ffd700 1 -- 172.21.15.62:0/2484859047 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f007006c7b0 con 0x7f00800a8e10 2021-12-17T18:27:57.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.904+0000 7f0085147700 1 --2- 172.21.15.62:0/2484859047 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00680536a0 0x7f0068055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:57.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.904+0000 7f0085147700 1 --2- 172.21.15.62:0/2484859047 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00680536a0 0x7f0068055b60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f007c00b000 tx=0x7f007c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:57.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:57.908+0000 7f0076ffd700 1 -- 172.21.15.62:0/2484859047 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f00700438c0 con 0x7f00800a8e10 2021-12-17T18:27:58.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.064+0000 7f008694a700 1 -- 172.21.15.62:0/2484859047 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00800573d0 con 0x7f00800a8e10 2021-12-17T18:27:58.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.064+0000 7f0076ffd700 1 -- 172.21.15.62:0/2484859047 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+1782 (secure 0 0 0) 0x7f0070023020 con 0x7f00800a8e10 2021-12-17T18:27:58.072 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:27:58.073 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":72,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8323,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4209581820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4209581820},{"type":"v1","addr":"172.21.15.62:6833","nonce":4209581820}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69}],"filesystems":[{"mdsmap":{"epoch":72,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:27:46.812077+0000","modified":"2021-12-17T18:27:57.756793+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":142,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-12-17T18:27:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.068+0000 7f008694a700 1 -- 172.21.15.62:0/2484859047 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00680536a0 msgr2=0x7f0068055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.068+0000 7f008694a700 1 --2- 172.21.15.62:0/2484859047 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00680536a0 0x7f0068055b60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f007c00b000 tx=0x7f007c008040).stop 2021-12-17T18:27:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.068+0000 7f008694a700 1 -- 172.21.15.62:0/2484859047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00800a8e10 msgr2=0x7f00800a9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.068+0000 7f008694a700 1 --2- 172.21.15.62:0/2484859047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00800a8e10 0x7f00800a9880 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f0070002f70 tx=0x7f0070014000).stop 2021-12-17T18:27:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.068+0000 7f008694a700 1 -- 172.21.15.62:0/2484859047 shutdown_connections 2021-12-17T18:27:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.068+0000 7f008694a700 1 --2- 172.21.15.62:0/2484859047 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f00680536a0 0x7f0068055b60 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.068+0000 7f008694a700 1 --2- 172.21.15.62:0/2484859047 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0080141480 0x7f00800aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.068+0000 7f008694a700 1 --2- 172.21.15.62:0/2484859047 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f00800b6050 0x7f0080156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.068+0000 7f008694a700 1 --2- 172.21.15.62:0/2484859047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00800a8e10 0x7f00800a9880 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.068+0000 7f008694a700 1 -- 172.21.15.62:0/2484859047 >> 172.21.15.62:0/2484859047 conn(0x7f008005d220 msgr2=0x7f00800b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:58.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.068+0000 7f008694a700 1 -- 172.21.15.62:0/2484859047 shutdown_connections 2021-12-17T18:27:58.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.068+0000 7f008694a700 1 -- 172.21.15.62:0/2484859047 wait complete. 2021-12-17T18:27:58.079 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 72 2021-12-17T18:27:58.086 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-12-17T18:27:58.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.188+0000 7fe9ea39e700 1 Processor -- start 2021-12-17T18:27:58.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.188+0000 7fe9ea39e700 1 -- start start 2021-12-17T18:27:58.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9ea39e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe9e4060950 0x7fe9e4140640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9ea39e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe9e40b41e0 0x7fe9e40b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9ea39e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e40b6ee0 con 0x7fe9e40b65b0 2021-12-17T18:27:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9ea39e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e40b1c40 con 0x7fe9e4060950 2021-12-17T18:27:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9ea39e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e40b6990 con 0x7fe9e40b41e0 2021-12-17T18:27:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9e8b9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe9e4060950 0x7fe9e4140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9e8b9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe9e4060950 0x7fe9e4140640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56972/0 (socket says 172.21.15.62:56972) 2021-12-17T18:27:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9e8b9b700 1 -- 172.21.15.62:0/2915330265 learned_addr learned my addr 172.21.15.62:0/2915330265 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9e8b9b700 1 -- 172.21.15.62:0/2915330265 >> v2:172.21.15.109:3300/0 conn(0x7fe9e40b41e0 msgr2=0x7fe9e40b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9e9b9d700 1 --2- 172.21.15.62:0/2915330265 >> v2:172.21.15.109:3300/0 conn(0x7fe9e40b41e0 0x7fe9e40b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:58.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9e8b9b700 1 --2- 172.21.15.62:0/2915330265 >> v2:172.21.15.109:3300/0 conn(0x7fe9e40b41e0 0x7fe9e40b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9e8b9b700 1 -- 172.21.15.62:0/2915330265 >> v1:172.21.15.109:6789/0 conn(0x7fe9e40b65b0 legacy=0x7fe9e413ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:58.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9e8b9b700 1 -- 172.21.15.62:0/2915330265 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e40b5e20 con 0x7fe9e4060950 2021-12-17T18:27:58.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9e9b9d700 1 --2- 172.21.15.62:0/2915330265 >> v2:172.21.15.109:3300/0 conn(0x7fe9e40b41e0 0x7fe9e40b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:27:58.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9e8b9b700 1 --2- 172.21.15.62:0/2915330265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9e4060950 0x7fe9e4140640 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7fe9d4002f70 tx=0x7fe9d4006eb0).ready entity=mon.0 client_cookie=bc18fefa29b6b20b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:58.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9d3fff700 1 -- 172.21.15.62:0/2915330265 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9d400d610 con 0x7fe9e4060950 2021-12-17T18:27:58.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9d3fff700 1 -- 172.21.15.62:0/2915330265 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d4000e90 con 0x7fe9e4060950 2021-12-17T18:27:58.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9d3fff700 1 -- 172.21.15.62:0/2915330265 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9d400d9a0 con 0x7fe9e4060950 2021-12-17T18:27:58.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9ea39e700 1 -- 172.21.15.62:0/2915330265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9e4060950 msgr2=0x7fe9e4140640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:58.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9ea39e700 1 --2- 172.21.15.62:0/2915330265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9e4060950 0x7fe9e4140640 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7fe9d4002f70 tx=0x7fe9d4006eb0).stop 2021-12-17T18:27:58.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9ea39e700 1 -- 172.21.15.62:0/2915330265 shutdown_connections 2021-12-17T18:27:58.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9ea39e700 1 --2- 172.21.15.62:0/2915330265 >> v2:172.21.15.109:3300/0 conn(0x7fe9e40b41e0 0x7fe9e40b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9ea39e700 1 --2- 172.21.15.62:0/2915330265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9e4060950 0x7fe9e4140640 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9ea39e700 1 -- 172.21.15.62:0/2915330265 >> 172.21.15.62:0/2915330265 conn(0x7fe9e405c750 msgr2=0x7fe9e405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:58.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9ea39e700 1 -- 172.21.15.62:0/2915330265 shutdown_connections 2021-12-17T18:27:58.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.192+0000 7fe9ea39e700 1 -- 172.21.15.62:0/2915330265 wait complete. 2021-12-17T18:27:58.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9ea39e700 1 Processor -- start 2021-12-17T18:27:58.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9ea39e700 1 -- start start 2021-12-17T18:27:58.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9ea39e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9e4060950 0x7fe9e4113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:58.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9ea39e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9e40b41e0 0x7fe9e4152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:58.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9ea39e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9e40b65b0 0x7fe9e413e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:58.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9ea39e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e4066c30 con 0x7fe9e4060950 2021-12-17T18:27:58.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9ea39e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e4113a60 con 0x7fe9e40b41e0 2021-12-17T18:27:58.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9ea39e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e4112d40 con 0x7fe9e40b65b0 2021-12-17T18:27:58.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9e939c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9e4060950 0x7fe9e4113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:58.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9e939c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9e4060950 0x7fe9e4113570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56976/0 (socket says 172.21.15.62:56976) 2021-12-17T18:27:58.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9e939c700 1 -- 172.21.15.62:0/4082407970 learned_addr learned my addr 172.21.15.62:0/4082407970 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:58.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9e8b9b700 1 --2- 172.21.15.62:0/4082407970 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9e40b41e0 0x7fe9e4152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:58.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9e9b9d700 1 --2- 172.21.15.62:0/4082407970 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9e40b65b0 0x7fe9e413e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:58.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9e939c700 1 -- 172.21.15.62:0/4082407970 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9e40b65b0 msgr2=0x7fe9e413e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:58.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9e939c700 1 --2- 172.21.15.62:0/4082407970 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9e40b65b0 0x7fe9e413e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9e939c700 1 -- 172.21.15.62:0/4082407970 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9e40b41e0 msgr2=0x7fe9e4152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:58.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9e939c700 1 --2- 172.21.15.62:0/4082407970 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9e40b41e0 0x7fe9e4152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9e939c700 1 -- 172.21.15.62:0/4082407970 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d400b1e0 con 0x7fe9e4060950 2021-12-17T18:27:58.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9e9b9d700 1 --2- 172.21.15.62:0/4082407970 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9e40b65b0 0x7fe9e413e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:27:58.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9e939c700 1 --2- 172.21.15.62:0/4082407970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9e4060950 0x7fe9e4113570 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7fe9e405f540 tx=0x7fe9e0007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:58.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9d27fc700 1 -- 172.21.15.62:0/4082407970 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e000ce30 con 0x7fe9e4060950 2021-12-17T18:27:58.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9d27fc700 1 -- 172.21.15.62:0/4082407970 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e000f470 con 0x7fe9e4060950 2021-12-17T18:27:58.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9ea39e700 1 -- 172.21.15.62:0/4082407970 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e4155ae0 con 0x7fe9e4060950 2021-12-17T18:27:58.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9d27fc700 1 -- 172.21.15.62:0/4082407970 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e000f7d0 con 0x7fe9e4060950 2021-12-17T18:27:58.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.196+0000 7fe9ea39e700 1 -- 172.21.15.62:0/4082407970 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e4152880 con 0x7fe9e4060950 2021-12-17T18:27:58.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.200+0000 7fe9ea39e700 1 -- 172.21.15.62:0/4082407970 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e40573d0 con 0x7fe9e4060950 2021-12-17T18:27:58.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.200+0000 7fe9d27fc700 1 -- 172.21.15.62:0/4082407970 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe9e0019030 con 0x7fe9e4060950 2021-12-17T18:27:58.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.200+0000 7fe9d27fc700 1 --2- 172.21.15.62:0/4082407970 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe9c40534f0 0x7fe9c40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:58.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.200+0000 7fe9d27fc700 1 -- 172.21.15.62:0/4082407970 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe9e006ad80 con 0x7fe9e4060950 2021-12-17T18:27:58.215 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.200+0000 7fe9e8b9b700 1 --2- 172.21.15.62:0/4082407970 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe9c40534f0 0x7fe9c40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:58.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.200+0000 7fe9e8b9b700 1 --2- 172.21.15.62:0/4082407970 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe9c40534f0 0x7fe9c40559b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fe9d401a000 tx=0x7fe9d4015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:58.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.208+0000 7fe9d27fc700 1 -- 172.21.15.62:0/4082407970 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe9e0041e90 con 0x7fe9e4060950 2021-12-17T18:27:58.375 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.368+0000 7fe9ea39e700 1 -- 172.21.15.62:0/4082407970 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe9e4068f30 con 0x7fe9e4060950 2021-12-17T18:27:58.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.772+0000 7fe9d27fc700 1 -- 172.21.15.62:0/4082407970 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v73) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe9e006c020 con 0x7fe9e4060950 2021-12-17T18:27:58.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.776+0000 7fe9ea39e700 1 -- 172.21.15.62:0/4082407970 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe9c40534f0 msgr2=0x7fe9c40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:58.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.776+0000 7fe9ea39e700 1 --2- 172.21.15.62:0/4082407970 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe9c40534f0 0x7fe9c40559b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fe9d401a000 tx=0x7fe9d4015000).stop 2021-12-17T18:27:58.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.776+0000 7fe9ea39e700 1 -- 172.21.15.62:0/4082407970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9e4060950 msgr2=0x7fe9e4113570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:58.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.776+0000 7fe9ea39e700 1 --2- 172.21.15.62:0/4082407970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9e4060950 0x7fe9e4113570 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7fe9e405f540 tx=0x7fe9e0007c50).stop 2021-12-17T18:27:58.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.776+0000 7fe9ea39e700 1 -- 172.21.15.62:0/4082407970 shutdown_connections 2021-12-17T18:27:58.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.776+0000 7fe9ea39e700 1 --2- 172.21.15.62:0/4082407970 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe9c40534f0 0x7fe9c40559b0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.776+0000 7fe9ea39e700 1 --2- 172.21.15.62:0/4082407970 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe9e40b65b0 0x7fe9e413e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.776+0000 7fe9ea39e700 1 --2- 172.21.15.62:0/4082407970 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe9e40b41e0 0x7fe9e4152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.776+0000 7fe9ea39e700 1 --2- 172.21.15.62:0/4082407970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9e4060950 0x7fe9e4113570 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.776+0000 7fe9ea39e700 1 -- 172.21.15.62:0/4082407970 >> 172.21.15.62:0/4082407970 conn(0x7fe9e405c750 msgr2=0x7fe9e413dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:58.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.776+0000 7fe9ea39e700 1 -- 172.21.15.62:0/4082407970 shutdown_connections 2021-12-17T18:27:58.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.776+0000 7fe9ea39e700 1 -- 172.21.15.62:0/4082407970 wait complete. 2021-12-17T18:27:58.799 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-12-17T18:27:58.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.908+0000 7f239c649700 1 Processor -- start 2021-12-17T18:27:58.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.908+0000 7f239c649700 1 -- start start 2021-12-17T18:27:58.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.908+0000 7f239c649700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f23940afce0 0x7f23940b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:58.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.908+0000 7f239c649700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f23940620a0 0x7f2394140590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:58.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.908+0000 7f239c649700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23940628b0 con 0x7f2394140a80 2021-12-17T18:27:58.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.908+0000 7f239c649700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2394140ee0 con 0x7f23940620a0 2021-12-17T18:27:58.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.908+0000 7f239c649700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2394062ae0 con 0x7f23940afce0 2021-12-17T18:27:58.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.908+0000 7f2399be4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f23940620a0 0x7f2394140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:58.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.908+0000 7f239abe6700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2394140a80 0x7f23940aa6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40566/0 (socket says 172.21.15.62:40566) 2021-12-17T18:27:58.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.908+0000 7f239abe6700 1 -- 172.21.15.62:0/117396988 learned_addr learned my addr 172.21.15.62:0/117396988 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:58.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.908+0000 7f239a3e5700 1 --2- 172.21.15.62:0/117396988 >> v2:172.21.15.109:3300/0 conn(0x7f23940afce0 0x7f23940b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:58.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.908+0000 7f2399be4700 1 -- 172.21.15.62:0/117396988 >> v2:172.21.15.109:3300/0 conn(0x7f23940afce0 msgr2=0x7f23940b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:58.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.908+0000 7f2399be4700 1 --2- 172.21.15.62:0/117396988 >> v2:172.21.15.109:3300/0 conn(0x7f23940afce0 0x7f23940b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.908+0000 7f23993e3700 1 -- 172.21.15.62:0/117396988 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117240935 0 0) 0x7f23940628b0 con 0x7f2394140a80 2021-12-17T18:27:58.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.908+0000 7f2399be4700 1 -- 172.21.15.62:0/117396988 >> v1:172.21.15.62:6789/0 conn(0x7f2394140a80 legacy=0x7f23940aa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:58.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.908+0000 7f2399be4700 1 -- 172.21.15.62:0/117396988 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2394062d80 con 0x7f23940620a0 2021-12-17T18:27:58.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f2399be4700 1 --2- 172.21.15.62:0/117396988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23940620a0 0x7f2394140590 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f2384002f70 tx=0x7f2384006df0).ready entity=mon.0 client_cookie=99933942bafbbe server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:58.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f23993e3700 1 -- 172.21.15.62:0/117396988 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f238400d570 con 0x7f23940620a0 2021-12-17T18:27:58.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f23993e3700 1 -- 172.21.15.62:0/117396988 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2384000e90 con 0x7f23940620a0 2021-12-17T18:27:58.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f23993e3700 1 -- 172.21.15.62:0/117396988 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f238400d8c0 con 0x7f23940620a0 2021-12-17T18:27:58.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f239c649700 1 -- 172.21.15.62:0/117396988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23940620a0 msgr2=0x7f2394140590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:58.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f239c649700 1 --2- 172.21.15.62:0/117396988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23940620a0 0x7f2394140590 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f2384002f70 tx=0x7f2384006df0).stop 2021-12-17T18:27:58.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f239c649700 1 -- 172.21.15.62:0/117396988 shutdown_connections 2021-12-17T18:27:58.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f239c649700 1 --2- 172.21.15.62:0/117396988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23940620a0 0x7f2394140590 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f239c649700 1 --2- 172.21.15.62:0/117396988 >> v2:172.21.15.109:3300/0 conn(0x7f23940afce0 0x7f23940b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f239c649700 1 -- 172.21.15.62:0/117396988 >> 172.21.15.62:0/117396988 conn(0x7f23940b64f0 msgr2=0x7f23940b68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:58.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f239c649700 1 -- 172.21.15.62:0/117396988 shutdown_connections 2021-12-17T18:27:58.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f239c649700 1 -- 172.21.15.62:0/117396988 wait complete. 2021-12-17T18:27:58.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f239c649700 1 Processor -- start 2021-12-17T18:27:58.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f239c649700 1 -- start start 2021-12-17T18:27:58.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f239c649700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23940620a0 0x7f23940aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:58.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f239c649700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23940afce0 0x7f2394156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:58.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f239c649700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2394140a80 0x7f2394156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:58.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f239c649700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2394066860 con 0x7f23940620a0 2021-12-17T18:27:58.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f239c649700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2394066b80 con 0x7f2394140a80 2021-12-17T18:27:58.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f239c649700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2394066e20 con 0x7f23940afce0 2021-12-17T18:27:58.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.912+0000 7f239a3e5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23940620a0 0x7f23940aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:58.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f239a3e5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23940620a0 0x7f23940aba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56992/0 (socket says 172.21.15.62:56992) 2021-12-17T18:27:58.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f239a3e5700 1 -- 172.21.15.62:0/3073598451 learned_addr learned my addr 172.21.15.62:0/3073598451 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:58.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f239abe6700 1 --2- 172.21.15.62:0/3073598451 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2394140a80 0x7f2394156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:58.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f2399be4700 1 --2- 172.21.15.62:0/3073598451 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23940afce0 0x7f2394156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:58.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f239a3e5700 1 -- 172.21.15.62:0/3073598451 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23940afce0 msgr2=0x7f2394156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:58.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f239a3e5700 1 --2- 172.21.15.62:0/3073598451 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23940afce0 0x7f2394156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f239a3e5700 1 -- 172.21.15.62:0/3073598451 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2394140a80 msgr2=0x7f2394156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:58.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f239a3e5700 1 --2- 172.21.15.62:0/3073598451 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2394140a80 0x7f2394156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:58.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f239a3e5700 1 -- 172.21.15.62:0/3073598451 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238400b180 con 0x7f23940620a0 2021-12-17T18:27:58.932 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f239abe6700 1 --2- 172.21.15.62:0/3073598451 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2394140a80 0x7f2394156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:27:58.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f239a3e5700 1 --2- 172.21.15.62:0/3073598451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23940620a0 0x7f23940aba50 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f239000c000 tx=0x7f2390006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:58.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f23837fe700 1 -- 172.21.15.62:0/3073598451 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2390010780 con 0x7f23940620a0 2021-12-17T18:27:58.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f23837fe700 1 -- 172.21.15.62:0/3073598451 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23900108e0 con 0x7f23940620a0 2021-12-17T18:27:58.933 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f23837fe700 1 -- 172.21.15.62:0/3073598451 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2390010c40 con 0x7f23940620a0 2021-12-17T18:27:58.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f239c649700 1 -- 172.21.15.62:0/3073598451 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2394152af0 con 0x7f23940620a0 2021-12-17T18:27:58.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f239c649700 1 -- 172.21.15.62:0/3073598451 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2394067230 con 0x7f23940620a0 2021-12-17T18:27:58.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f239c649700 1 -- 172.21.15.62:0/3073598451 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23940af740 con 0x7f23940620a0 2021-12-17T18:27:58.934 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f23837fe700 1 -- 172.21.15.62:0/3073598451 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f239001c460 con 0x7f23940620a0 2021-12-17T18:27:58.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.916+0000 7f23837fe700 1 --2- 172.21.15.62:0/3073598451 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2374053580 0x7f2374055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:58.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.920+0000 7f23837fe700 1 -- 172.21.15.62:0/3073598451 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f239006bd50 con 0x7f23940620a0 2021-12-17T18:27:58.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.920+0000 7f2399be4700 1 --2- 172.21.15.62:0/3073598451 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2374053580 0x7f2374055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:58.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.920+0000 7f2399be4700 1 --2- 172.21.15.62:0/3073598451 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2374053580 0x7f2374055a40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f238401a000 tx=0x7f2384014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:58.936 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:58.924+0000 7f23837fe700 1 -- 172.21.15.62:0/3073598451 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f23940af740 con 0x7f23940620a0 2021-12-17T18:27:59.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.052+0000 7f239c649700 1 -- 172.21.15.62:0/3073598451 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f23940af740 con 0x7f23940620a0 2021-12-17T18:27:59.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.792+0000 7f23837fe700 1 -- 172.21.15.62:0/3073598451 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v143) v1 ==== 185+0+0 (secure 0 0 0) 0x7f23940af740 con 0x7f23940620a0 2021-12-17T18:27:59.803 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.796+0000 7f239c649700 1 -- 172.21.15.62:0/3073598451 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2374053580 msgr2=0x7f2374055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:59.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.796+0000 7f239c649700 1 --2- 172.21.15.62:0/3073598451 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2374053580 0x7f2374055a40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f238401a000 tx=0x7f2384014000).stop 2021-12-17T18:27:59.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.796+0000 7f239c649700 1 -- 172.21.15.62:0/3073598451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23940620a0 msgr2=0x7f23940aba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:59.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.796+0000 7f239c649700 1 --2- 172.21.15.62:0/3073598451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23940620a0 0x7f23940aba50 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f239000c000 tx=0x7f2390006df0).stop 2021-12-17T18:27:59.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.796+0000 7f239c649700 1 -- 172.21.15.62:0/3073598451 shutdown_connections 2021-12-17T18:27:59.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.796+0000 7f239c649700 1 --2- 172.21.15.62:0/3073598451 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f2374053580 0x7f2374055a40 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:59.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.796+0000 7f239c649700 1 --2- 172.21.15.62:0/3073598451 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f2394140a80 0x7f2394156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:59.806 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.796+0000 7f239c649700 1 --2- 172.21.15.62:0/3073598451 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f23940afce0 0x7f2394156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:59.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.796+0000 7f239c649700 1 --2- 172.21.15.62:0/3073598451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23940620a0 0x7f23940aba50 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:59.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.796+0000 7f239c649700 1 -- 172.21.15.62:0/3073598451 >> 172.21.15.62:0/3073598451 conn(0x7f23940b64f0 msgr2=0x7f239413e160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:59.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.796+0000 7f239c649700 1 -- 172.21.15.62:0/3073598451 shutdown_connections 2021-12-17T18:27:59.807 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.796+0000 7f239c649700 1 -- 172.21.15.62:0/3073598451 wait complete. 2021-12-17T18:27:59.808 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2021-12-17T18:27:59.817 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-12-17T18:27:59.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.928+0000 7f0dbc836700 1 Processor -- start 2021-12-17T18:27:59.935 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.928+0000 7f0dbc836700 1 -- start start 2021-12-17T18:27:59.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.928+0000 7f0dbc836700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0db805ca90 0x7f0db80b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:59.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.928+0000 7f0dbc836700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db80b34b0 0x7f0db8145b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:59.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.928+0000 7f0dbc836700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db805ce70 con 0x7f0db80604b0 2021-12-17T18:27:59.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.928+0000 7f0dbc836700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db80b2d70 con 0x7f0db805ca90 2021-12-17T18:27:59.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.928+0000 7f0dbc836700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80b3010 con 0x7f0db80b34b0 2021-12-17T18:27:59.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.928+0000 7f0db759e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0db80604b0 0x7f0db8146010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40580/0 (socket says 172.21.15.62:40580) 2021-12-17T18:27:59.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.928+0000 7f0db6d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0db805ca90 0x7f0db80b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:59.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.928+0000 7f0db759e700 1 -- 172.21.15.62:0/2383517563 learned_addr learned my addr 172.21.15.62:0/2383517563 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:27:59.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0db659c700 1 --2- 172.21.15.62:0/2383517563 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db80b34b0 0x7f0db8145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:59.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0db5d9b700 1 -- 172.21.15.62:0/2383517563 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434022746 0 0) 0x7f0db805ce70 con 0x7f0db80604b0 2021-12-17T18:27:59.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0db5d9b700 1 -- 172.21.15.62:0/2383517563 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d9c003260 con 0x7f0db80604b0 2021-12-17T18:27:59.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0db6d9d700 1 -- 172.21.15.62:0/2383517563 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db80b34b0 msgr2=0x7f0db8145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:27:59.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0db6d9d700 1 --2- 172.21.15.62:0/2383517563 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db80b34b0 0x7f0db8145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:59.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0db6d9d700 1 -- 172.21.15.62:0/2383517563 >> v1:172.21.15.62:6789/0 conn(0x7f0db80604b0 legacy=0x7f0db8146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:59.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0db6d9d700 1 -- 172.21.15.62:0/2383517563 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db80b2ab0 con 0x7f0db805ca90 2021-12-17T18:27:59.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0db6d9d700 1 --2- 172.21.15.62:0/2383517563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db805ca90 0x7f0db80b2470 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f0dac002f70 tx=0x7f0dac006df0).ready entity=mon.0 client_cookie=4788ca662d1e0375 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:59.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0db5d9b700 1 -- 172.21.15.62:0/2383517563 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dac00d570 con 0x7f0db805ca90 2021-12-17T18:27:59.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0db5d9b700 1 -- 172.21.15.62:0/2383517563 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac000e90 con 0x7f0db805ca90 2021-12-17T18:27:59.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0db5d9b700 1 -- 172.21.15.62:0/2383517563 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dac00d8c0 con 0x7f0db805ca90 2021-12-17T18:27:59.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0dbc836700 1 -- 172.21.15.62:0/2383517563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db805ca90 msgr2=0x7f0db80b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:59.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0dbc836700 1 --2- 172.21.15.62:0/2383517563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db805ca90 0x7f0db80b2470 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f0dac002f70 tx=0x7f0dac006df0).stop 2021-12-17T18:27:59.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0dbc836700 1 -- 172.21.15.62:0/2383517563 shutdown_connections 2021-12-17T18:27:59.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0dbc836700 1 --2- 172.21.15.62:0/2383517563 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db80b34b0 0x7f0db8145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:59.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0dbc836700 1 --2- 172.21.15.62:0/2383517563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db805ca90 0x7f0db80b2470 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:59.947 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0dbc836700 1 -- 172.21.15.62:0/2383517563 >> 172.21.15.62:0/2383517563 conn(0x7f0db805bcd0 msgr2=0x7f0db8062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:27:59.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0dbc836700 1 -- 172.21.15.62:0/2383517563 shutdown_connections 2021-12-17T18:27:59.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0dbc836700 1 -- 172.21.15.62:0/2383517563 wait complete. 2021-12-17T18:27:59.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0dbc836700 1 Processor -- start 2021-12-17T18:27:59.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0dbc836700 1 -- start start 2021-12-17T18:27:59.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0dbc836700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0db805ca90 0x7f0db80638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:59.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0dbc836700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db80604b0 0x7f0db80a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:59.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0dbc836700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db80b34b0 0x7f0db80a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:59.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0dbc836700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80a4090 con 0x7f0db80604b0 2021-12-17T18:27:59.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0dbc836700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80a3e30 con 0x7f0db805ca90 2021-12-17T18:27:59.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0dbc836700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80665c0 con 0x7f0db80b34b0 2021-12-17T18:27:59.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.932+0000 7f0db659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db80604b0 0x7f0db80a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:59.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0db659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db80604b0 0x7f0db80a54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57004/0 (socket says 172.21.15.62:57004) 2021-12-17T18:27:59.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0db659c700 1 -- 172.21.15.62:0/3515269172 learned_addr learned my addr 172.21.15.62:0/3515269172 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:27:59.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0db6d9d700 1 --2- 172.21.15.62:0/3515269172 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0db805ca90 0x7f0db80638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:59.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0db759e700 1 --2- 172.21.15.62:0/3515269172 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db80b34b0 0x7f0db80a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:59.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0db659c700 1 -- 172.21.15.62:0/3515269172 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db80b34b0 msgr2=0x7f0db80a59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:59.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0db659c700 1 --2- 172.21.15.62:0/3515269172 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db80b34b0 0x7f0db80a59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:59.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0db659c700 1 -- 172.21.15.62:0/3515269172 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0db805ca90 msgr2=0x7f0db80638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:27:59.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0db659c700 1 --2- 172.21.15.62:0/3515269172 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0db805ca90 0x7f0db80638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:27:59.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0db659c700 1 -- 172.21.15.62:0/3515269172 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac00b180 con 0x7f0db80604b0 2021-12-17T18:27:59.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0db6d9d700 1 --2- 172.21.15.62:0/3515269172 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0db805ca90 0x7f0db80638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:27:59.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0db659c700 1 --2- 172.21.15.62:0/3515269172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db80604b0 0x7f0db80a54d0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f0da80030b0 tx=0x7f0da8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:59.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0da7fff700 1 -- 172.21.15.62:0/3515269172 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da80106e0 con 0x7f0db80604b0 2021-12-17T18:27:59.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0da7fff700 1 -- 172.21.15.62:0/3515269172 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da8010840 con 0x7f0db80604b0 2021-12-17T18:27:59.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0dbc836700 1 -- 172.21.15.62:0/3515269172 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db80b0200 con 0x7f0db80604b0 2021-12-17T18:27:59.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0da7fff700 1 -- 172.21.15.62:0/3515269172 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da8010ba0 con 0x7f0db80604b0 2021-12-17T18:27:59.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0dbc836700 1 -- 172.21.15.62:0/3515269172 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db80662e0 con 0x7f0db80604b0 2021-12-17T18:27:59.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0da7fff700 1 -- 172.21.15.62:0/3515269172 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0da801a030 con 0x7f0db80604b0 2021-12-17T18:27:59.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0dbc836700 1 -- 172.21.15.62:0/3515269172 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db80667c0 con 0x7f0db80604b0 2021-12-17T18:27:59.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0da7fff700 1 --2- 172.21.15.62:0/3515269172 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0d94053610 0x7f0d94055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:27:59.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0da7fff700 1 -- 172.21.15.62:0/3515269172 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f0da806b560 con 0x7f0db80604b0 2021-12-17T18:27:59.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.936+0000 7f0db6d9d700 1 --2- 172.21.15.62:0/3515269172 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0d94053610 0x7f0d94055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:27:59.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.940+0000 7f0db6d9d700 1 --2- 172.21.15.62:0/3515269172 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0d94053610 0x7f0d94055ad0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f0dac018000 tx=0x7f0dac014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:27:59.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:27:59.940+0000 7f0da7fff700 1 -- 172.21.15.62:0/3515269172 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0da8042750 con 0x7f0db80604b0 2021-12-17T18:28:00.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.072+0000 7f0dbc836700 1 -- 172.21.15.62:0/3515269172 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0db80b4500 con 0x7f0db80604b0 2021-12-17T18:28:00.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.804+0000 7f0da7fff700 1 -- 172.21.15.62:0/3515269172 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v144) v1 ==== 173+0+0 (secure 0 0 0) 0x7f0da8045d70 con 0x7f0db80604b0 2021-12-17T18:28:00.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.808+0000 7f0dbc836700 1 -- 172.21.15.62:0/3515269172 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0d94053610 msgr2=0x7f0d94055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:00.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.808+0000 7f0dbc836700 1 --2- 172.21.15.62:0/3515269172 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0d94053610 0x7f0d94055ad0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f0dac018000 tx=0x7f0dac014000).stop 2021-12-17T18:28:00.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.808+0000 7f0dbc836700 1 -- 172.21.15.62:0/3515269172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db80604b0 msgr2=0x7f0db80a54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:00.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.808+0000 7f0dbc836700 1 --2- 172.21.15.62:0/3515269172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db80604b0 0x7f0db80a54d0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f0da80030b0 tx=0x7f0da8008040).stop 2021-12-17T18:28:00.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.808+0000 7f0dbc836700 1 -- 172.21.15.62:0/3515269172 shutdown_connections 2021-12-17T18:28:00.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.808+0000 7f0dbc836700 1 --2- 172.21.15.62:0/3515269172 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0d94053610 0x7f0d94055ad0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:00.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.808+0000 7f0dbc836700 1 --2- 172.21.15.62:0/3515269172 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db80b34b0 0x7f0db80a59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:00.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.808+0000 7f0dbc836700 1 --2- 172.21.15.62:0/3515269172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db80604b0 0x7f0db80a54d0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:00.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.808+0000 7f0dbc836700 1 --2- 172.21.15.62:0/3515269172 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0db805ca90 0x7f0db80638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:00.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.808+0000 7f0dbc836700 1 -- 172.21.15.62:0/3515269172 >> 172.21.15.62:0/3515269172 conn(0x7f0db805bcd0 msgr2=0x7f0db80b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:00.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.808+0000 7f0dbc836700 1 -- 172.21.15.62:0/3515269172 shutdown_connections 2021-12-17T18:28:00.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.808+0000 7f0dbc836700 1 -- 172.21.15.62:0/3515269172 wait complete. 2021-12-17T18:28:00.819 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2021-12-17T18:28:00.829 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-12-17T18:28:00.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.928+0000 7f744759e700 1 Processor -- start 2021-12-17T18:28:00.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.928+0000 7f744759e700 1 -- start start 2021-12-17T18:28:00.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.928+0000 7f744759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f74480afe10 0x7f74480b6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:00.938 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.928+0000 7f744759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74480ad290 con 0x7f74480b14d0 2021-12-17T18:28:00.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.928+0000 7f744759e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74480ad4c0 con 0x7f74480b5f90 2021-12-17T18:28:00.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.928+0000 7f744759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74480ad760 con 0x7f74480afe10 2021-12-17T18:28:00.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.928+0000 7f7445d9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f74480b14d0 0x7f74480b2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40592/0 (socket says 172.21.15.62:40592) 2021-12-17T18:28:00.939 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.928+0000 7f7445d9b700 1 -- 172.21.15.62:0/1965769532 learned_addr learned my addr 172.21.15.62:0/1965769532 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:00.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.928+0000 7f7446d9d700 1 --2- 172.21.15.62:0/1965769532 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f74480afe10 0x7f74480b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:00.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.928+0000 7f744559a700 1 -- 172.21.15.62:0/1965769532 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354634845 0 0) 0x7f74480ad290 con 0x7f74480b14d0 2021-12-17T18:28:00.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.928+0000 7f744559a700 1 -- 172.21.15.62:0/1965769532 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f742c003260 con 0x7f74480b14d0 2021-12-17T18:28:00.940 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.928+0000 7f744559a700 1 -- 172.21.15.62:0/1965769532 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794526379 0 0) 0x7f74480ad4c0 con 0x7f74480b5f90 2021-12-17T18:28:00.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.928+0000 7f744559a700 1 -- 172.21.15.62:0/1965769532 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74480ad290 con 0x7f74480b5f90 2021-12-17T18:28:00.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.928+0000 7f7446d9d700 1 -- 172.21.15.62:0/1965769532 >> v1:172.21.15.109:6789/0 conn(0x7f74480b5f90 legacy=0x7f744813eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:00.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.928+0000 7f7446d9d700 1 -- 172.21.15.62:0/1965769532 >> v1:172.21.15.62:6789/0 conn(0x7f74480b14d0 legacy=0x7f74480b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:00.941 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.928+0000 7f7446d9d700 1 -- 172.21.15.62:0/1965769532 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74480b23e0 con 0x7f74480afe10 2021-12-17T18:28:00.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.932+0000 7f7446d9d700 1 --2- 172.21.15.62:0/1965769532 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f74480afe10 0x7f74480b6370 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f7440002f70 tx=0x7f7440006e80).ready entity=mon.2 client_cookie=258c830bc1ad6da3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:00.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.932+0000 7f744559a700 1 -- 172.21.15.62:0/1965769532 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7440014070 con 0x7f74480afe10 2021-12-17T18:28:00.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.932+0000 7f744559a700 1 -- 172.21.15.62:0/1965769532 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7440000e90 con 0x7f74480afe10 2021-12-17T18:28:00.942 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.932+0000 7f744559a700 1 -- 172.21.15.62:0/1965769532 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74400107f0 con 0x7f74480afe10 2021-12-17T18:28:00.948 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.932+0000 7f744759e700 1 -- 172.21.15.62:0/1965769532 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f74480afe10 msgr2=0x7f74480b6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:00.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.932+0000 7f744759e700 1 --2- 172.21.15.62:0/1965769532 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f74480afe10 0x7f74480b6370 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f7440002f70 tx=0x7f7440006e80).stop 2021-12-17T18:28:00.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.932+0000 7f744759e700 1 -- 172.21.15.62:0/1965769532 shutdown_connections 2021-12-17T18:28:00.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.932+0000 7f744759e700 1 --2- 172.21.15.62:0/1965769532 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f74480afe10 0x7f74480b6370 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:00.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.932+0000 7f744759e700 1 -- 172.21.15.62:0/1965769532 >> 172.21.15.62:0/1965769532 conn(0x7f744805c750 msgr2=0x7f744805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:00.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.932+0000 7f744759e700 1 -- 172.21.15.62:0/1965769532 shutdown_connections 2021-12-17T18:28:00.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.932+0000 7f744759e700 1 -- 172.21.15.62:0/1965769532 wait complete. 2021-12-17T18:28:00.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f744759e700 1 Processor -- start 2021-12-17T18:28:00.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f744759e700 1 -- start start 2021-12-17T18:28:00.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f744759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f74480afe10 0x7f74480a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:00.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f744759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74480b14d0 0x7f74480a8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:00.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f744759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f74480b5f90 0x7f74480a9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:00.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f744759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74480a6fd0 con 0x7f74480b14d0 2021-12-17T18:28:00.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f744759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74480a7270 con 0x7f74480afe10 2021-12-17T18:28:00.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f744759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74480a7510 con 0x7f74480b5f90 2021-12-17T18:28:00.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f7445d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74480b14d0 0x7f74480a8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:00.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f7445d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74480b14d0 0x7f74480a8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57018/0 (socket says 172.21.15.62:57018) 2021-12-17T18:28:00.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f7445d9b700 1 -- 172.21.15.62:0/4052555708 learned_addr learned my addr 172.21.15.62:0/4052555708 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:00.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f744659c700 1 --2- 172.21.15.62:0/4052555708 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f74480afe10 0x7f74480a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:00.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f7446d9d700 1 --2- 172.21.15.62:0/4052555708 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f74480b5f90 0x7f74480a9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:00.956 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f7445d9b700 1 -- 172.21.15.62:0/4052555708 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f74480b5f90 msgr2=0x7f74480a9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:00.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f7445d9b700 1 --2- 172.21.15.62:0/4052555708 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f74480b5f90 0x7f74480a9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:00.957 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f7445d9b700 1 -- 172.21.15.62:0/4052555708 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f74480afe10 msgr2=0x7f74480a5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:00.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f7445d9b700 1 --2- 172.21.15.62:0/4052555708 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f74480afe10 0x7f74480a5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:00.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f7445d9b700 1 -- 172.21.15.62:0/4052555708 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744000c310 con 0x7f74480b14d0 2021-12-17T18:28:00.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f7445d9b700 1 --2- 172.21.15.62:0/4052555708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74480b14d0 0x7f74480a8d10 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f743c0011d0 tx=0x7f743c007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:00.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f74377fe700 1 -- 172.21.15.62:0/4052555708 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f743c0070d0 con 0x7f74480b14d0 2021-12-17T18:28:00.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f74377fe700 1 -- 172.21.15.62:0/4052555708 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c007230 con 0x7f74480b14d0 2021-12-17T18:28:00.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f744759e700 1 -- 172.21.15.62:0/4052555708 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74480a5930 con 0x7f74480b14d0 2021-12-17T18:28:00.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f74377fe700 1 -- 172.21.15.62:0/4052555708 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f743c005610 con 0x7f74480b14d0 2021-12-17T18:28:00.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.936+0000 7f744759e700 1 -- 172.21.15.62:0/4052555708 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74480ab470 con 0x7f74480b14d0 2021-12-17T18:28:00.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.940+0000 7f744759e700 1 -- 172.21.15.62:0/4052555708 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74480a6dc0 con 0x7f74480b14d0 2021-12-17T18:28:00.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.940+0000 7f74377fe700 1 -- 172.21.15.62:0/4052555708 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f743c01a060 con 0x7f74480b14d0 2021-12-17T18:28:00.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.940+0000 7f74377fe700 1 --2- 172.21.15.62:0/4052555708 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f74240536a0 0x7f7424055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:00.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.940+0000 7f74377fe700 1 -- 172.21.15.62:0/4052555708 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f743c06ae10 con 0x7f74480b14d0 2021-12-17T18:28:00.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.940+0000 7f744659c700 1 --2- 172.21.15.62:0/4052555708 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f74240536a0 0x7f7424055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:00.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.940+0000 7f744659c700 1 --2- 172.21.15.62:0/4052555708 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f74240536a0 0x7f7424055b60 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f743800d000 tx=0x7f7438007da0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:00.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:00.944+0000 7f74377fe700 1 -- 172.21.15.62:0/4052555708 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f743c0421d0 con 0x7f74480b14d0 2021-12-17T18:28:01.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.072+0000 7f744759e700 1 -- 172.21.15.62:0/4052555708 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f74480573d0 con 0x7f74480b14d0 2021-12-17T18:28:01.087 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.080+0000 7f74377fe700 1 -- 172.21.15.62:0/4052555708 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f743c018020 con 0x7f74480b14d0 2021-12-17T18:28:01.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.084+0000 7f744759e700 1 -- 172.21.15.62:0/4052555708 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f74240536a0 msgr2=0x7f7424055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:01.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.084+0000 7f744759e700 1 --2- 172.21.15.62:0/4052555708 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f74240536a0 0x7f7424055b60 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f743800d000 tx=0x7f7438007da0).stop 2021-12-17T18:28:01.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.084+0000 7f744759e700 1 -- 172.21.15.62:0/4052555708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74480b14d0 msgr2=0x7f74480a8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:01.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.084+0000 7f744759e700 1 --2- 172.21.15.62:0/4052555708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74480b14d0 0x7f74480a8d10 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f743c0011d0 tx=0x7f743c007b50).stop 2021-12-17T18:28:01.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.084+0000 7f744759e700 1 -- 172.21.15.62:0/4052555708 shutdown_connections 2021-12-17T18:28:01.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.084+0000 7f744759e700 1 --2- 172.21.15.62:0/4052555708 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f74240536a0 0x7f7424055b60 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.084+0000 7f744759e700 1 --2- 172.21.15.62:0/4052555708 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f74480b5f90 0x7f74480a9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.084+0000 7f744759e700 1 --2- 172.21.15.62:0/4052555708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74480b14d0 0x7f74480a8d10 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.084+0000 7f744759e700 1 --2- 172.21.15.62:0/4052555708 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f74480afe10 0x7f74480a5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.084+0000 7f744759e700 1 -- 172.21.15.62:0/4052555708 >> 172.21.15.62:0/4052555708 conn(0x7f744805c750 msgr2=0x7f74480ac080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:01.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.084+0000 7f744759e700 1 -- 172.21.15.62:0/4052555708 shutdown_connections 2021-12-17T18:28:01.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.084+0000 7f744759e700 1 -- 172.21.15.62:0/4052555708 wait complete. 2021-12-17T18:28:01.106 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-12-17T18:28:01.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.224+0000 7f766e2fb700 1 Processor -- start 2021-12-17T18:28:01.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.224+0000 7f766e2fb700 1 -- start start 2021-12-17T18:28:01.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766e2fb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f76680b21b0 0x7f76680b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:01.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766e2fb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7668146580 0x7f76681469d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:01.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766e2fb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76680b1840 con 0x7f76680b04f0 2021-12-17T18:28:01.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766e2fb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7668147630 con 0x7f76680b21b0 2021-12-17T18:28:01.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766e2fb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76680b2590 con 0x7f7668146580 2021-12-17T18:28:01.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766caf8700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f76680b04f0 0x7f76680b1130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40604/0 (socket says 172.21.15.62:40604) 2021-12-17T18:28:01.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766caf8700 1 -- 172.21.15.62:0/1988197357 learned_addr learned my addr 172.21.15.62:0/1988197357 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:01.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766d2f9700 1 --2- 172.21.15.62:0/1988197357 >> v2:172.21.15.62:3300/0 conn(0x7f76680b21b0 0x7f76680b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:01.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 -- 172.21.15.62:0/1988197357 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134350656 0 0) 0x7f76680b1840 con 0x7f76680b04f0 2021-12-17T18:28:01.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 -- 172.21.15.62:0/1988197357 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f764c003260 con 0x7f76680b04f0 2021-12-17T18:28:01.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766dafa700 1 --2- 172.21.15.62:0/1988197357 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7668146580 0x7f76681469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:01.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 -- 172.21.15.62:0/1988197357 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1189904551 0 0) 0x7f764c003260 con 0x7f76680b04f0 2021-12-17T18:28:01.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 -- 172.21.15.62:0/1988197357 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7668146580 msgr2=0x7f76681469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:01.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 --2- 172.21.15.62:0/1988197357 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7668146580 0x7f76681469d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 -- 172.21.15.62:0/1988197357 >> v2:172.21.15.62:3300/0 conn(0x7f76680b21b0 msgr2=0x7f76680b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:01.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 --2- 172.21.15.62:0/1988197357 >> v2:172.21.15.62:3300/0 conn(0x7f76680b21b0 0x7f76680b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 -- 172.21.15.62:0/1988197357 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76680b0210 con 0x7f76680b04f0 2021-12-17T18:28:01.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 -- 172.21.15.62:0/1988197357 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f7664001680 con 0x7f76680b04f0 2021-12-17T18:28:01.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 -- 172.21.15.62:0/1988197357 >> v1:172.21.15.62:6789/0 conn(0x7f76680b04f0 legacy=0x7f76680b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:01.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 --2- 172.21.15.62:0/1988197357 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f764c003750 0x7f764c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:01.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 --2- 172.21.15.62:0/1988197357 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7668146580 0x7f764c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:01.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 --2- 172.21.15.62:0/1988197357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f764c0049f0 0x7f764c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:01.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 -- 172.21.15.62:0/1988197357 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7668147630 con 0x7f764c0049f0 2021-12-17T18:28:01.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 -- 172.21.15.62:0/1988197357 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76680b2590 con 0x7f764c003750 2021-12-17T18:28:01.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 -- 172.21.15.62:0/1988197357 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c00b750 con 0x7f7668146580 2021-12-17T18:28:01.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766dafa700 1 --2- 172.21.15.62:0/1988197357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f764c0049f0 0x7f764c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:01.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766d2f9700 1 --2- 172.21.15.62:0/1988197357 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f764c003750 0x7f764c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:01.243 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766caf8700 1 --2- 172.21.15.62:0/1988197357 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7668146580 0x7f764c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:01.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766d2f9700 1 -- 172.21.15.62:0/1988197357 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7668146580 msgr2=0x7f764c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:01.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766d2f9700 1 --2- 172.21.15.62:0/1988197357 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7668146580 0x7f764c004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766d2f9700 1 -- 172.21.15.62:0/1988197357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f764c0049f0 msgr2=0x7f764c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:01.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766d2f9700 1 --2- 172.21.15.62:0/1988197357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f764c0049f0 0x7f764c004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.244 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766d2f9700 1 -- 172.21.15.62:0/1988197357 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c003260 con 0x7f764c003750 2021-12-17T18:28:01.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766dafa700 1 --2- 172.21.15.62:0/1988197357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f764c0049f0 0x7f764c004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:28:01.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f766d2f9700 1 --2- 172.21.15.62:0/1988197357 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f764c003750 0x7f764c003b70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f765800c000 tx=0x7f7658006df0).ready entity=mon.1 client_cookie=36e290124d37d872 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:01.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 -- 172.21.15.62:0/1988197357 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f765800e830 con 0x7f764c003750 2021-12-17T18:28:01.245 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 -- 172.21.15.62:0/1988197357 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765800e990 con 0x7f764c003750 2021-12-17T18:28:01.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.228+0000 7f765ffff700 1 -- 172.21.15.62:0/1988197357 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f765800ecf0 con 0x7f764c003750 2021-12-17T18:28:01.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766e2fb700 1 -- 172.21.15.62:0/1988197357 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f764c003750 msgr2=0x7f764c003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:01.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766e2fb700 1 --2- 172.21.15.62:0/1988197357 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f764c003750 0x7f764c003b70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f765800c000 tx=0x7f7658006df0).stop 2021-12-17T18:28:01.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766dafa700 1 -- 172.21.15.62:0/1988197357 reap_dead start 2021-12-17T18:28:01.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766e2fb700 1 -- 172.21.15.62:0/1988197357 shutdown_connections 2021-12-17T18:28:01.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766e2fb700 1 -- 172.21.15.62:0/1988197357 >> 172.21.15.62:0/1988197357 conn(0x7f766805c750 msgr2=0x7f766805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:01.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766e2fb700 1 -- 172.21.15.62:0/1988197357 shutdown_connections 2021-12-17T18:28:01.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766e2fb700 1 -- 172.21.15.62:0/1988197357 wait complete. 2021-12-17T18:28:01.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766e2fb700 1 Processor -- start 2021-12-17T18:28:01.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766e2fb700 1 -- start start 2021-12-17T18:28:01.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766e2fb700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f764c003750 0x7f7668148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:01.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766e2fb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f766814b610 0x7f7668144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:01.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766e2fb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7668159d00 0x7f766815a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:01.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766e2fb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7668148b50 con 0x7f766814b610 2021-12-17T18:28:01.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766e2fb700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76680b3270 con 0x7f764c003750 2021-12-17T18:28:01.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766e2fb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76680b3510 con 0x7f7668159d00 2021-12-17T18:28:01.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766caf8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f766814b610 0x7f7668144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:01.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766caf8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f766814b610 0x7f7668144770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57038/0 (socket says 172.21.15.62:57038) 2021-12-17T18:28:01.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766caf8700 1 -- 172.21.15.62:0/2077143421 learned_addr learned my addr 172.21.15.62:0/2077143421 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:01.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766d2f9700 1 --2- 172.21.15.62:0/2077143421 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f764c003750 0x7f7668148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:01.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.232+0000 7f766dafa700 1 --2- 172.21.15.62:0/2077143421 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7668159d00 0x7f766815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:01.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.236+0000 7f766caf8700 1 -- 172.21.15.62:0/2077143421 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7668159d00 msgr2=0x7f766815a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:01.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.236+0000 7f766caf8700 1 --2- 172.21.15.62:0/2077143421 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7668159d00 0x7f766815a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.236+0000 7f766caf8700 1 -- 172.21.15.62:0/2077143421 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f764c003750 msgr2=0x7f7668148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:01.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.236+0000 7f766caf8700 1 --2- 172.21.15.62:0/2077143421 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f764c003750 0x7f7668148f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.236+0000 7f766caf8700 1 -- 172.21.15.62:0/2077143421 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766815a670 con 0x7f766814b610 2021-12-17T18:28:01.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.236+0000 7f766caf8700 1 --2- 172.21.15.62:0/2077143421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f766814b610 0x7f7668144770 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f766400d000 tx=0x7f7664001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:01.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.236+0000 7f765e7fc700 1 -- 172.21.15.62:0/2077143421 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76640116b0 con 0x7f766814b610 2021-12-17T18:28:01.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.236+0000 7f765e7fc700 1 -- 172.21.15.62:0/2077143421 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7664011810 con 0x7f766814b610 2021-12-17T18:28:01.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.236+0000 7f766e2fb700 1 -- 172.21.15.62:0/2077143421 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76680b4a10 con 0x7f766814b610 2021-12-17T18:28:01.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.236+0000 7f765e7fc700 1 -- 172.21.15.62:0/2077143421 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7664011b70 con 0x7f766814b610 2021-12-17T18:28:01.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.236+0000 7f766e2fb700 1 -- 172.21.15.62:0/2077143421 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76680b4810 con 0x7f766814b610 2021-12-17T18:28:01.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.236+0000 7f766e2fb700 1 -- 172.21.15.62:0/2077143421 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76680ace00 con 0x7f766814b610 2021-12-17T18:28:01.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.236+0000 7f765e7fc700 1 -- 172.21.15.62:0/2077143421 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f766401b030 con 0x7f766814b610 2021-12-17T18:28:01.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.236+0000 7f765e7fc700 1 --2- 172.21.15.62:0/2077143421 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f76500536a0 0x7f7650055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:01.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.240+0000 7f765e7fc700 1 -- 172.21.15.62:0/2077143421 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f766406b240 con 0x7f766814b610 2021-12-17T18:28:01.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.240+0000 7f766d2f9700 1 --2- 172.21.15.62:0/2077143421 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f76500536a0 0x7f7650055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:01.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.240+0000 7f766d2f9700 1 --2- 172.21.15.62:0/2077143421 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f76500536a0 0x7f7650055b60 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f765801e000 tx=0x7f7658019000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:01.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.244+0000 7f765e7fc700 1 -- 172.21.15.62:0/2077143421 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7664042680 con 0x7f766814b610 2021-12-17T18:28:01.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.412+0000 7f766e2fb700 1 -- 172.21.15.62:0/2077143421 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7f76680573d0 con 0x7f766814b610 2021-12-17T18:28:01.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.804+0000 7f765e7fc700 1 -- 172.21.15.62:0/2077143421 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v447) v1 ==== 127+0+0 (secure 0 0 0) 0x7f7664019030 con 0x7f766814b610 2021-12-17T18:28:01.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.808+0000 7f766e2fb700 1 -- 172.21.15.62:0/2077143421 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f76500536a0 msgr2=0x7f7650055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:01.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.808+0000 7f766e2fb700 1 --2- 172.21.15.62:0/2077143421 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f76500536a0 0x7f7650055b60 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f765801e000 tx=0x7f7658019000).stop 2021-12-17T18:28:01.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.808+0000 7f766e2fb700 1 -- 172.21.15.62:0/2077143421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f766814b610 msgr2=0x7f7668144770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:01.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.808+0000 7f766e2fb700 1 --2- 172.21.15.62:0/2077143421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f766814b610 0x7f7668144770 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f766400d000 tx=0x7f7664001e70).stop 2021-12-17T18:28:01.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.808+0000 7f766e2fb700 1 -- 172.21.15.62:0/2077143421 shutdown_connections 2021-12-17T18:28:01.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.808+0000 7f766e2fb700 1 --2- 172.21.15.62:0/2077143421 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f76500536a0 0x7f7650055b60 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.808+0000 7f766e2fb700 1 --2- 172.21.15.62:0/2077143421 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f7668159d00 0x7f766815a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.808+0000 7f766e2fb700 1 --2- 172.21.15.62:0/2077143421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f766814b610 0x7f7668144770 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.808+0000 7f766e2fb700 1 --2- 172.21.15.62:0/2077143421 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f764c003750 0x7f7668148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.808+0000 7f766e2fb700 1 -- 172.21.15.62:0/2077143421 >> 172.21.15.62:0/2077143421 conn(0x7f766805c750 msgr2=0x7f7668145bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:01.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.808+0000 7f766e2fb700 1 -- 172.21.15.62:0/2077143421 shutdown_connections 2021-12-17T18:28:01.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.812+0000 7f766e2fb700 1 -- 172.21.15.62:0/2077143421 wait complete. 2021-12-17T18:28:01.833 INFO:tasks.cephfs_test_runner:test_root_rctime (tasks.cephfs.test_misc.TestMisc) ... ok 2021-12-17T18:28:01.833 INFO:tasks.cephfs_test_runner:Starting test: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-12-17T18:28:01.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs' 2021-12-17T18:28:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f856ba50700 1 Processor -- start 2021-12-17T18:28:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f856ba50700 1 -- start start 2021-12-17T18:28:01.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f856ba50700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85640b1730 0x7f85640ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:01.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f856ba50700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f85640a7bb0 0x7f8564067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:01.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f856ba50700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85640b2ce0 con 0x7f85640b21f0 2021-12-17T18:28:01.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f856ba50700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856414b5b0 con 0x7f85640a7bb0 2021-12-17T18:28:01.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f856ba50700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8564147870 con 0x7f85640b1730 2021-12-17T18:28:01.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f85697ec700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f85640b21f0 0x7f856414aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40624/0 (socket says 172.21.15.62:40624) 2021-12-17T18:28:01.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f85697ec700 1 -- 172.21.15.62:0/3684749731 learned_addr learned my addr 172.21.15.62:0/3684749731 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:01.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f8569fed700 1 --2- 172.21.15.62:0/3684749731 >> v2:172.21.15.62:3300/0 conn(0x7f85640a7bb0 0x7f8564067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:01.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f8568feb700 1 --2- 172.21.15.62:0/3684749731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85640b1730 0x7f85640ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:01.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f8563fff700 1 -- 172.21.15.62:0/3684749731 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81620929 0 0) 0x7f85640b2ce0 con 0x7f85640b21f0 2021-12-17T18:28:01.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f8563fff700 1 -- 172.21.15.62:0/3684749731 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8544003260 con 0x7f85640b21f0 2021-12-17T18:28:01.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f8569fed700 1 -- 172.21.15.62:0/3684749731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85640b1730 msgr2=0x7f85640ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:01.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f8563fff700 1 -- 172.21.15.62:0/3684749731 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4188398346 0 0) 0x7f8544003260 con 0x7f85640b21f0 2021-12-17T18:28:01.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f8569fed700 1 --2- 172.21.15.62:0/3684749731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85640b1730 0x7f85640ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f8569fed700 1 -- 172.21.15.62:0/3684749731 >> v1:172.21.15.62:6789/0 conn(0x7f85640b21f0 legacy=0x7f856414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:01.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f8569fed700 1 -- 172.21.15.62:0/3684749731 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85640aca60 con 0x7f85640a7bb0 2021-12-17T18:28:01.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f8569fed700 1 --2- 172.21.15.62:0/3684749731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85640a7bb0 0x7f8564067120 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f854c001800 tx=0x7f855c006df0).ready entity=mon.0 client_cookie=96dcc19012df09ea server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:01.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f8563fff700 1 -- 172.21.15.62:0/3684749731 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f854c001660 con 0x7f85640a7bb0 2021-12-17T18:28:01.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f8563fff700 1 -- 172.21.15.62:0/3684749731 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855c000e90 con 0x7f85640a7bb0 2021-12-17T18:28:01.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f8563fff700 1 -- 172.21.15.62:0/3684749731 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f855c012460 con 0x7f85640a7bb0 2021-12-17T18:28:01.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f856ba50700 1 -- 172.21.15.62:0/3684749731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85640a7bb0 msgr2=0x7f8564067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:01.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.940+0000 7f856ba50700 1 --2- 172.21.15.62:0/3684749731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85640a7bb0 0x7f8564067120 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f854c001800 tx=0x7f855c006df0).stop 2021-12-17T18:28:01.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f856ba50700 1 -- 172.21.15.62:0/3684749731 shutdown_connections 2021-12-17T18:28:01.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f856ba50700 1 --2- 172.21.15.62:0/3684749731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85640a7bb0 0x7f8564067120 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f856ba50700 1 --2- 172.21.15.62:0/3684749731 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85640b1730 0x7f85640ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f856ba50700 1 -- 172.21.15.62:0/3684749731 >> 172.21.15.62:0/3684749731 conn(0x7f856405f730 msgr2=0x7f856405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:01.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f856ba50700 1 -- 172.21.15.62:0/3684749731 shutdown_connections 2021-12-17T18:28:01.955 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f856ba50700 1 -- 172.21.15.62:0/3684749731 wait complete. 2021-12-17T18:28:01.958 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f856ba50700 1 Processor -- start 2021-12-17T18:28:01.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f856ba50700 1 -- start start 2021-12-17T18:28:01.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f856ba50700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85640a7bb0 0x7f8564064fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:01.959 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f856ba50700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85640b1730 0x7f85640642e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:01.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f856ba50700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f85640b21f0 0x7f85640659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:01.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f856ba50700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856411d400 con 0x7f85640b1730 2021-12-17T18:28:01.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f856ba50700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8564066150 con 0x7f85640b21f0 2021-12-17T18:28:01.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f856ba50700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856411d630 con 0x7f85640a7bb0 2021-12-17T18:28:01.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f8568feb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85640b1730 0x7f85640642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:01.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f8568feb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85640b1730 0x7f85640642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57052/0 (socket says 172.21.15.62:57052) 2021-12-17T18:28:01.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f8568feb700 1 -- 172.21.15.62:0/4036547847 learned_addr learned my addr 172.21.15.62:0/4036547847 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:01.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f85697ec700 1 --2- 172.21.15.62:0/4036547847 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85640a7bb0 0x7f8564064fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:01.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.944+0000 7f8569fed700 1 --2- 172.21.15.62:0/4036547847 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f85640b21f0 0x7f85640659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:01.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.948+0000 7f8568feb700 1 -- 172.21.15.62:0/4036547847 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85640a7bb0 msgr2=0x7f8564064fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:01.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.948+0000 7f8568feb700 1 --2- 172.21.15.62:0/4036547847 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85640a7bb0 0x7f8564064fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.948+0000 7f8568feb700 1 -- 172.21.15.62:0/4036547847 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f85640b21f0 msgr2=0x7f85640659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:01.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.948+0000 7f8568feb700 1 --2- 172.21.15.62:0/4036547847 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f85640b21f0 0x7f85640659e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:01.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.948+0000 7f8568feb700 1 -- 172.21.15.62:0/4036547847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c00b180 con 0x7f85640b1730 2021-12-17T18:28:01.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.948+0000 7f8568feb700 1 --2- 172.21.15.62:0/4036547847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85640b1730 0x7f85640642e0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f855400c000 tx=0x7f85540091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:01.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.948+0000 7f85627fc700 1 -- 172.21.15.62:0/4036547847 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f855400c6a0 con 0x7f85640b1730 2021-12-17T18:28:01.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.948+0000 7f85627fc700 1 -- 172.21.15.62:0/4036547847 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855400c800 con 0x7f85640b1730 2021-12-17T18:28:01.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.948+0000 7f85627fc700 1 -- 172.21.15.62:0/4036547847 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f855400cb60 con 0x7f85640b1730 2021-12-17T18:28:01.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.948+0000 7f856ba50700 1 -- 172.21.15.62:0/4036547847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856411d8d0 con 0x7f85640b1730 2021-12-17T18:28:01.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.948+0000 7f856ba50700 1 -- 172.21.15.62:0/4036547847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856411e090 con 0x7f85640b1730 2021-12-17T18:28:01.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.948+0000 7f856ba50700 1 -- 172.21.15.62:0/4036547847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85640b2f10 con 0x7f85640b1730 2021-12-17T18:28:01.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.948+0000 7f85627fc700 1 -- 172.21.15.62:0/4036547847 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8554022070 con 0x7f85640b1730 2021-12-17T18:28:01.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.948+0000 7f85627fc700 1 --2- 172.21.15.62:0/4036547847 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8548053610 0x7f8548055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:01.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.948+0000 7f85627fc700 1 -- 172.21.15.62:0/4036547847 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f855406bc90 con 0x7f85640b1730 2021-12-17T18:28:01.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.952+0000 7f85697ec700 1 --2- 172.21.15.62:0/4036547847 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8548053610 0x7f8548055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:01.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.952+0000 7f85697ec700 1 --2- 172.21.15.62:0/4036547847 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8548053610 0x7f8548055ad0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f854c00d000 tx=0x7f854c001da0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:01.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:01.956+0000 7f85627fc700 1 -- 172.21.15.62:0/4036547847 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f85540430d0 con 0x7f85640b1730 2021-12-17T18:28:02.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.128+0000 7f856ba50700 1 -- 172.21.15.62:0/4036547847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]} v 0) v1 -- 0x7f85640573d0 con 0x7f85640b1730 2021-12-17T18:28:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.808+0000 7f85627fc700 1 -- 172.21.15.62:0/4036547847 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]}]=0 v448) v1 ==== 139+0+0 (secure 0 0 0) 0x7f85540466f0 con 0x7f85640b1730 2021-12-17T18:28:02.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.812+0000 7f856ba50700 1 -- 172.21.15.62:0/4036547847 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8548053610 msgr2=0x7f8548055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:02.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.812+0000 7f856ba50700 1 --2- 172.21.15.62:0/4036547847 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8548053610 0x7f8548055ad0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f854c00d000 tx=0x7f854c001da0).stop 2021-12-17T18:28:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.812+0000 7f856ba50700 1 -- 172.21.15.62:0/4036547847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85640b1730 msgr2=0x7f85640642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.812+0000 7f856ba50700 1 --2- 172.21.15.62:0/4036547847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85640b1730 0x7f85640642e0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f855400c000 tx=0x7f85540091d0).stop 2021-12-17T18:28:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.812+0000 7f856ba50700 1 -- 172.21.15.62:0/4036547847 shutdown_connections 2021-12-17T18:28:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.812+0000 7f856ba50700 1 --2- 172.21.15.62:0/4036547847 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8548053610 0x7f8548055ad0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.812+0000 7f856ba50700 1 --2- 172.21.15.62:0/4036547847 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f85640b21f0 0x7f85640659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.812+0000 7f856ba50700 1 --2- 172.21.15.62:0/4036547847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85640b1730 0x7f85640642e0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.812+0000 7f856ba50700 1 --2- 172.21.15.62:0/4036547847 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f85640a7bb0 0x7f8564064fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.812+0000 7f856ba50700 1 -- 172.21.15.62:0/4036547847 >> 172.21.15.62:0/4036547847 conn(0x7f856405f730 msgr2=0x7f856414adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.812+0000 7f856ba50700 1 -- 172.21.15.62:0/4036547847 shutdown_connections 2021-12-17T18:28:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.812+0000 7f856ba50700 1 -- 172.21.15.62:0/4036547847 wait complete. 2021-12-17T18:28:02.836 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-12-17T18:28:02.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd84b27700 1 Processor -- start 2021-12-17T18:28:02.954 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd84b27700 1 -- start start 2021-12-17T18:28:02.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd84b27700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fdd800b5330 0x7fdd800b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:02.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd84b27700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdd80147440 0x7fdd8005fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:02.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd84b27700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd800606e0 con 0x7fdd800b07c0 2021-12-17T18:28:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd84b27700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd80141950 con 0x7fdd80147440 2021-12-17T18:28:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd84b27700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8005fa10 con 0x7fdd800b5330 2021-12-17T18:28:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd75d9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdd800b07c0 0x7fdd80147b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40640/0 (socket says 172.21.15.62:40640) 2021-12-17T18:28:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd75d9b700 1 -- 172.21.15.62:0/4153871151 learned_addr learned my addr 172.21.15.62:0/4153871151 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7ed9d700 1 --2- 172.21.15.62:0/4153871151 >> v2:172.21.15.62:3300/0 conn(0x7fdd80147440 0x7fdd8005fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7e59c700 1 --2- 172.21.15.62:0/4153871151 >> v2:172.21.15.109:3300/0 conn(0x7fdd800b5330 0x7fdd800b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7dd9b700 1 -- 172.21.15.62:0/4153871151 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781436638 0 0) 0x7fdd800606e0 con 0x7fdd800b07c0 2021-12-17T18:28:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7dd9b700 1 -- 172.21.15.62:0/4153871151 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd60003260 con 0x7fdd800b07c0 2021-12-17T18:28:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7dd9b700 1 -- 172.21.15.62:0/4153871151 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4116313183 0 0) 0x7fdd60003260 con 0x7fdd800b07c0 2021-12-17T18:28:02.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7dd9b700 1 -- 172.21.15.62:0/4153871151 >> v2:172.21.15.109:3300/0 conn(0x7fdd800b5330 msgr2=0x7fdd800b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:02.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7dd9b700 1 --2- 172.21.15.62:0/4153871151 >> v2:172.21.15.109:3300/0 conn(0x7fdd800b5330 0x7fdd800b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:02.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7dd9b700 1 -- 172.21.15.62:0/4153871151 >> v2:172.21.15.62:3300/0 conn(0x7fdd80147440 msgr2=0x7fdd8005fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7dd9b700 1 --2- 172.21.15.62:0/4153871151 >> v2:172.21.15.62:3300/0 conn(0x7fdd80147440 0x7fdd8005fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7dd9b700 1 -- 172.21.15.62:0/4153871151 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd80060980 con 0x7fdd800b07c0 2021-12-17T18:28:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7dd9b700 1 -- 172.21.15.62:0/4153871151 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7fdd68001660 con 0x7fdd800b07c0 2021-12-17T18:28:02.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7e59c700 1 --2- 172.21.15.62:0/4153871151 >> v2:172.21.15.109:3300/0 conn(0x7fdd800b5330 0x7fdd800b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:28:02.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7ed9d700 1 --2- 172.21.15.62:0/4153871151 >> v2:172.21.15.62:3300/0 conn(0x7fdd80147440 0x7fdd8005fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:28:02.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7dd9b700 1 -- 172.21.15.62:0/4153871151 >> v1:172.21.15.62:6789/0 conn(0x7fdd800b07c0 legacy=0x7fdd80147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:02.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7dd9b700 1 --2- 172.21.15.62:0/4153871151 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd60003750 0x7fdd60003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:02.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7dd9b700 1 --2- 172.21.15.62:0/4153871151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd60004500 0x7fdd60004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:02.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7dd9b700 1 --2- 172.21.15.62:0/4153871151 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdd60004e70 0x7fdd6000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:02.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7dd9b700 1 -- 172.21.15.62:0/4153871151 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd80141950 con 0x7fdd60004500 2021-12-17T18:28:02.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7dd9b700 1 -- 172.21.15.62:0/4153871151 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6000bc40 con 0x7fdd60003750 2021-12-17T18:28:02.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.948+0000 7fdd7dd9b700 1 -- 172.21.15.62:0/4153871151 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6000bd80 con 0x7fdd60004e70 2021-12-17T18:28:02.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd75d9b700 1 --2- 172.21.15.62:0/4153871151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd60004500 0x7fdd60004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:02.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd7e59c700 1 --2- 172.21.15.62:0/4153871151 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd60003750 0x7fdd60003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:02.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd7ed9d700 1 --2- 172.21.15.62:0/4153871151 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdd60004e70 0x7fdd6000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:02.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd75d9b700 1 -- 172.21.15.62:0/4153871151 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdd60004e70 msgr2=0x7fdd6000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:02.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd75d9b700 1 --2- 172.21.15.62:0/4153871151 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdd60004e70 0x7fdd6000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:02.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd75d9b700 1 -- 172.21.15.62:0/4153871151 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd60003750 msgr2=0x7fdd60003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:02.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd75d9b700 1 --2- 172.21.15.62:0/4153871151 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd60003750 0x7fdd60003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:02.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd75d9b700 1 -- 172.21.15.62:0/4153871151 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd60003260 con 0x7fdd60004500 2021-12-17T18:28:02.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd7ed9d700 1 -- 172.21.15.62:0/4153871151 reap_dead start 2021-12-17T18:28:02.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd75d9b700 1 --2- 172.21.15.62:0/4153871151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd60004500 0x7fdd60004980 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fdd68001370 tx=0x7fdd80060b10).ready entity=mon.0 client_cookie=4940e4b261cac4d6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd7dd9b700 1 -- 172.21.15.62:0/4153871151 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd680071a0 con 0x7fdd60004500 2021-12-17T18:28:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd7dd9b700 1 -- 172.21.15.62:0/4153871151 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd68007300 con 0x7fdd60004500 2021-12-17T18:28:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd7dd9b700 1 -- 172.21.15.62:0/4153871151 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd6800cad0 con 0x7fdd60004500 2021-12-17T18:28:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd84b27700 1 -- 172.21.15.62:0/4153871151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd60004500 msgr2=0x7fdd60004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd84b27700 1 --2- 172.21.15.62:0/4153871151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd60004500 0x7fdd60004980 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fdd68001370 tx=0x7fdd80060b10).stop 2021-12-17T18:28:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd84b27700 1 -- 172.21.15.62:0/4153871151 shutdown_connections 2021-12-17T18:28:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd84b27700 1 --2- 172.21.15.62:0/4153871151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd60004500 0x7fdd60004980 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd84b27700 1 -- 172.21.15.62:0/4153871151 >> 172.21.15.62:0/4153871151 conn(0x7fdd8005c750 msgr2=0x7fdd8005cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd84b27700 1 -- 172.21.15.62:0/4153871151 shutdown_connections 2021-12-17T18:28:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd84b27700 1 -- 172.21.15.62:0/4153871151 wait complete. 2021-12-17T18:28:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd84b27700 1 Processor -- start 2021-12-17T18:28:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd84b27700 1 -- start start 2021-12-17T18:28:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd84b27700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdd60004500 0x7fdd800af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd84b27700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd800acfc0 0x7fdd8014d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:02.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd84b27700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd800ac830 0x7fdd800ae370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:02.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd84b27700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd801443c0 con 0x7fdd800acfc0 2021-12-17T18:28:02.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd84b27700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8014dce0 con 0x7fdd800ac830 2021-12-17T18:28:02.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.952+0000 7fdd84b27700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd801446c0 con 0x7fdd60004500 2021-12-17T18:28:02.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.956+0000 7fdd75d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd800acfc0 0x7fdd8014d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:02.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.956+0000 7fdd75d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd800acfc0 0x7fdd8014d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57072/0 (socket says 172.21.15.62:57072) 2021-12-17T18:28:02.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.956+0000 7fdd75d9b700 1 -- 172.21.15.62:0/779892925 learned_addr learned my addr 172.21.15.62:0/779892925 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:02.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.956+0000 7fdd7ed9d700 1 --2- 172.21.15.62:0/779892925 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd800ac830 0x7fdd800ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:02.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.956+0000 7fdd7e59c700 1 --2- 172.21.15.62:0/779892925 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdd60004500 0x7fdd800af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.956+0000 7fdd75d9b700 1 -- 172.21.15.62:0/779892925 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdd60004500 msgr2=0x7fdd800af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.956+0000 7fdd75d9b700 1 --2- 172.21.15.62:0/779892925 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdd60004500 0x7fdd800af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.956+0000 7fdd75d9b700 1 -- 172.21.15.62:0/779892925 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd800ac830 msgr2=0x7fdd800ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.956+0000 7fdd75d9b700 1 --2- 172.21.15.62:0/779892925 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd800ac830 0x7fdd800ae370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.956+0000 7fdd75d9b700 1 -- 172.21.15.62:0/779892925 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd80144960 con 0x7fdd800acfc0 2021-12-17T18:28:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.956+0000 7fdd75d9b700 1 --2- 172.21.15.62:0/779892925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd800acfc0 0x7fdd8014d7f0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7fdd8014de70 tx=0x7fdd68013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.956+0000 7fdd77fff700 1 -- 172.21.15.62:0/779892925 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd6801a070 con 0x7fdd800acfc0 2021-12-17T18:28:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.956+0000 7fdd77fff700 1 -- 172.21.15.62:0/779892925 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd68004710 con 0x7fdd800acfc0 2021-12-17T18:28:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.956+0000 7fdd84b27700 1 -- 172.21.15.62:0/779892925 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd80144c00 con 0x7fdd800acfc0 2021-12-17T18:28:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.956+0000 7fdd77fff700 1 -- 172.21.15.62:0/779892925 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd68004a70 con 0x7fdd800acfc0 2021-12-17T18:28:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.956+0000 7fdd84b27700 1 -- 172.21.15.62:0/779892925 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd800aea00 con 0x7fdd800acfc0 2021-12-17T18:28:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.956+0000 7fdd84b27700 1 -- 172.21.15.62:0/779892925 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd800573d0 con 0x7fdd800acfc0 2021-12-17T18:28:02.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.960+0000 7fdd77fff700 1 -- 172.21.15.62:0/779892925 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdd68010070 con 0x7fdd800acfc0 2021-12-17T18:28:02.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.960+0000 7fdd77fff700 1 --2- 172.21.15.62:0/779892925 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdd64053610 0x7fdd64055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:02.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.960+0000 7fdd77fff700 1 -- 172.21.15.62:0/779892925 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fdd6806b5a0 con 0x7fdd800acfc0 2021-12-17T18:28:02.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.960+0000 7fdd7e59c700 1 --2- 172.21.15.62:0/779892925 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdd64053610 0x7fdd64055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:02.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.960+0000 7fdd7e59c700 1 --2- 172.21.15.62:0/779892925 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdd64053610 0x7fdd64055ad0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fdd7000b000 tx=0x7fdd70006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:02.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:02.964+0000 7fdd77fff700 1 -- 172.21.15.62:0/779892925 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdd680429e0 con 0x7fdd800acfc0 2021-12-17T18:28:03.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.092+0000 7fdd84b27700 1 -- 172.21.15.62:0/779892925 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdd80060ec0 con 0x7fdd800acfc0 2021-12-17T18:28:03.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.100+0000 7fdd77fff700 1 -- 172.21.15.62:0/779892925 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdd68046000 con 0x7fdd800acfc0 2021-12-17T18:28:03.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.104+0000 7fdd84b27700 1 -- 172.21.15.62:0/779892925 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdd64053610 msgr2=0x7fdd64055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:03.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.104+0000 7fdd84b27700 1 --2- 172.21.15.62:0/779892925 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdd64053610 0x7fdd64055ad0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fdd7000b000 tx=0x7fdd70006df0).stop 2021-12-17T18:28:03.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.104+0000 7fdd84b27700 1 -- 172.21.15.62:0/779892925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd800acfc0 msgr2=0x7fdd8014d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:03.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.104+0000 7fdd84b27700 1 --2- 172.21.15.62:0/779892925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd800acfc0 0x7fdd8014d7f0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7fdd8014de70 tx=0x7fdd68013000).stop 2021-12-17T18:28:03.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.104+0000 7fdd84b27700 1 -- 172.21.15.62:0/779892925 shutdown_connections 2021-12-17T18:28:03.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.104+0000 7fdd84b27700 1 --2- 172.21.15.62:0/779892925 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fdd64053610 0x7fdd64055ad0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.104+0000 7fdd84b27700 1 --2- 172.21.15.62:0/779892925 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fdd800ac830 0x7fdd800ae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.104+0000 7fdd84b27700 1 --2- 172.21.15.62:0/779892925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd800acfc0 0x7fdd8014d7f0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.104+0000 7fdd84b27700 1 --2- 172.21.15.62:0/779892925 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fdd60004500 0x7fdd800af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.104+0000 7fdd84b27700 1 -- 172.21.15.62:0/779892925 >> 172.21.15.62:0/779892925 conn(0x7fdd8005c750 msgr2=0x7fdd800b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:03.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.104+0000 7fdd84b27700 1 -- 172.21.15.62:0/779892925 shutdown_connections 2021-12-17T18:28:03.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.104+0000 7fdd84b27700 1 -- 172.21.15.62:0/779892925 wait complete. 2021-12-17T18:28:03.122 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:28:03.123 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:28:03.137 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:28:03.158 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:28:03.180 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:28:03.201 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:28:03.221 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:28:03.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:03.222 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:28:03.222 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:28:03.230 INFO:teuthology.orchestra.run.smithi125.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-12-17T18:28:03.230 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:28:03.231 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-12-17T18:28:03.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:03.232 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:28:03.233 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:28:03.239 INFO:teuthology.orchestra.run.smithi158.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-12-17T18:28:03.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:28:03.241 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-12-17T18:28:03.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:03.242 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:28:03.242 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-12-17T18:28:03.250 INFO:teuthology.orchestra.run.smithi192.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-12-17T18:28:03.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:28:03.251 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-12-17T18:28:03.252 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:28:03.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9992ff6700 1 Processor -- start 2021-12-17T18:28:03.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9992ff6700 1 -- start start 2021-12-17T18:28:03.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9992ff6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f998c05f8d0 0x7f998c0b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:03.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9992ff6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f998c0b2ed0 0x7f998c0aec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:03.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9992ff6700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998c0ae4e0 con 0x7f998c0af370 2021-12-17T18:28:03.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9992ff6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998c0ae780 con 0x7f998c05f8d0 2021-12-17T18:28:03.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9992ff6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0af110 con 0x7f998c0b2ed0 2021-12-17T18:28:03.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9990d92700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f998c05f8d0 0x7f998c0b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:03.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9990d92700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f998c05f8d0 0x7f998c0b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57080/0 (socket says 172.21.15.62:57080) 2021-12-17T18:28:03.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9990d92700 1 -- 172.21.15.62:0/3825554581 learned_addr learned my addr 172.21.15.62:0/3825554581 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:03.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f998bfff700 1 --2- 172.21.15.62:0/3825554581 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f998c0b2ed0 0x7f998c0aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:03.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9990d92700 1 -- 172.21.15.62:0/3825554581 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f998c0b2ed0 msgr2=0x7f998c0aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:03.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9990d92700 1 --2- 172.21.15.62:0/3825554581 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f998c0b2ed0 0x7f998c0aec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9990d92700 1 -- 172.21.15.62:0/3825554581 >> v1:172.21.15.109:6789/0 conn(0x7f998c0af370 legacy=0x7f998c0b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:03.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9990d92700 1 -- 172.21.15.62:0/3825554581 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c0b12e0 con 0x7f998c05f8d0 2021-12-17T18:28:03.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9990d92700 1 --2- 172.21.15.62:0/3825554581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f998c05f8d0 0x7f998c0b36b0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f9974002f70 tx=0x7f9974006eb0).ready entity=mon.0 client_cookie=293973a7d0cad280 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:03.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f998b7fe700 1 -- 172.21.15.62:0/3825554581 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f997400d570 con 0x7f998c05f8d0 2021-12-17T18:28:03.372 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f998b7fe700 1 -- 172.21.15.62:0/3825554581 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9974000e90 con 0x7f998c05f8d0 2021-12-17T18:28:03.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f998b7fe700 1 -- 172.21.15.62:0/3825554581 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f997400d900 con 0x7f998c05f8d0 2021-12-17T18:28:03.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9992ff6700 1 -- 172.21.15.62:0/3825554581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f998c05f8d0 msgr2=0x7f998c0b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:03.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9992ff6700 1 --2- 172.21.15.62:0/3825554581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f998c05f8d0 0x7f998c0b36b0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f9974002f70 tx=0x7f9974006eb0).stop 2021-12-17T18:28:03.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9992ff6700 1 -- 172.21.15.62:0/3825554581 shutdown_connections 2021-12-17T18:28:03.373 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9992ff6700 1 --2- 172.21.15.62:0/3825554581 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f998c0b2ed0 0x7f998c0aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9992ff6700 1 --2- 172.21.15.62:0/3825554581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f998c05f8d0 0x7f998c0b36b0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9992ff6700 1 -- 172.21.15.62:0/3825554581 >> 172.21.15.62:0/3825554581 conn(0x7f998c05bcd0 msgr2=0x7f998c0638c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:03.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.360+0000 7f9992ff6700 1 -- 172.21.15.62:0/3825554581 shutdown_connections 2021-12-17T18:28:03.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9992ff6700 1 -- 172.21.15.62:0/3825554581 wait complete. 2021-12-17T18:28:03.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9992ff6700 1 Processor -- start 2021-12-17T18:28:03.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9992ff6700 1 -- start start 2021-12-17T18:28:03.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9992ff6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f998c05f8d0 0x7f998c0b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:03.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9992ff6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f998c0af370 0x7f998c15a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:03.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9992ff6700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f998c0b2ed0 0x7f998c15ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:03.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9992ff6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0a1930 con 0x7f998c05f8d0 2021-12-17T18:28:03.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9992ff6700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0a1b60 con 0x7f998c0b2ed0 2021-12-17T18:28:03.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9992ff6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0b73d0 con 0x7f998c0af370 2021-12-17T18:28:03.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9990d92700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f998c05f8d0 0x7f998c0b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:03.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9990d92700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f998c05f8d0 0x7f998c0b6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57084/0 (socket says 172.21.15.62:57084) 2021-12-17T18:28:03.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9990d92700 1 -- 172.21.15.62:0/992036704 learned_addr learned my addr 172.21.15.62:0/992036704 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:03.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f998bfff700 1 --2- 172.21.15.62:0/992036704 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f998c0af370 0x7f998c15a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:03.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9991593700 1 --2- 172.21.15.62:0/992036704 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f998c0b2ed0 0x7f998c15ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:03.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9990d92700 1 -- 172.21.15.62:0/992036704 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f998c0af370 msgr2=0x7f998c15a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:03.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9990d92700 1 --2- 172.21.15.62:0/992036704 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f998c0af370 0x7f998c15a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9990d92700 1 -- 172.21.15.62:0/992036704 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f998c0b2ed0 msgr2=0x7f998c15ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:03.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9990d92700 1 --2- 172.21.15.62:0/992036704 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f998c0b2ed0 0x7f998c15ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9990d92700 1 -- 172.21.15.62:0/992036704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997400b1e0 con 0x7f998c05f8d0 2021-12-17T18:28:03.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9990d92700 1 --2- 172.21.15.62:0/992036704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f998c05f8d0 0x7f998c0b6ee0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f9974002f70 tx=0x7f9974015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:03.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.364+0000 7f9989ffb700 1 -- 172.21.15.62:0/992036704 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99740116e0 con 0x7f998c05f8d0 2021-12-17T18:28:03.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.368+0000 7f9989ffb700 1 -- 172.21.15.62:0/992036704 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9974011840 con 0x7f998c05f8d0 2021-12-17T18:28:03.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.368+0000 7f9992ff6700 1 -- 172.21.15.62:0/992036704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998c15b110 con 0x7f998c05f8d0 2021-12-17T18:28:03.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.368+0000 7f9989ffb700 1 -- 172.21.15.62:0/992036704 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9974011ba0 con 0x7f998c05f8d0 2021-12-17T18:28:03.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.368+0000 7f9992ff6700 1 -- 172.21.15.62:0/992036704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998c066d50 con 0x7f998c05f8d0 2021-12-17T18:28:03.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.368+0000 7f9989ffb700 1 -- 172.21.15.62:0/992036704 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9974025030 con 0x7f998c05f8d0 2021-12-17T18:28:03.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.368+0000 7f9992ff6700 1 -- 172.21.15.62:0/992036704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998c0a1d20 con 0x7f998c05f8d0 2021-12-17T18:28:03.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.368+0000 7f9989ffb700 1 --2- 172.21.15.62:0/992036704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9970053580 0x7f9970055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:03.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.368+0000 7f9989ffb700 1 -- 172.21.15.62:0/992036704 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f997406c6f0 con 0x7f998c05f8d0 2021-12-17T18:28:03.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.368+0000 7f998bfff700 1 --2- 172.21.15.62:0/992036704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9970053580 0x7f9970055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:03.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.368+0000 7f998bfff700 1 --2- 172.21.15.62:0/992036704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9970053580 0x7f9970055a40 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f997c00b000 tx=0x7f997c0091d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:03.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.372+0000 7f9989ffb700 1 -- 172.21.15.62:0/992036704 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9974043b30 con 0x7f998c05f8d0 2021-12-17T18:28:03.509 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.504+0000 7f9992ff6700 1 -- 172.21.15.62:0/992036704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f998c05fcb0 con 0x7f998c05f8d0 2021-12-17T18:28:03.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.504+0000 7f9989ffb700 1 -- 172.21.15.62:0/992036704 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v144) v1 ==== 81+0+28887 (secure 0 0 0) 0x7f9974023020 con 0x7f998c05f8d0 2021-12-17T18:28:03.512 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:03.512 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:28:03.512 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 144, 2021-12-17T18:28:03.513 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:28:03.513 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:28:03.513 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:28:00.791379+0000", 2021-12-17T18:28:03.513 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:28:03.513 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:28:03.514 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:28:03.514 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:28:03.514 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:28:03.514 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:28:03.515 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:28:03.515 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:28:03.515 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:28:03.516 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:28:03.516 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:28:03.516 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:28:03.516 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:28:03.517 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:28:03.517 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:28:03.517 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 28, 2021-12-17T18:28:03.517 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:28:03.518 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:28:03.518 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:28:03.518 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:28:03.518 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:28:03.518 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.519 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:28:03.519 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:28:03.519 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:28:03.519 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:28:03.520 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:28:03.520 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:28:03.520 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:28:03.520 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:28:03.521 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:28:03.521 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:28:03.521 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:28:03.521 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:28:03.522 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:28:03.522 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:28:03.522 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:28:03.522 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:28:03.522 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:28:03.523 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:28:03.523 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:28:03.523 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:28:03.523 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:28:03.524 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:28:03.524 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:28:03.524 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.524 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:28:03.525 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:28:03.525 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:28:03.525 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:28:03.525 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:28:03.525 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:28:03.526 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:28:03.526 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:28:03.526 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:28:03.526 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:28:03.527 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:28:03.527 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:28:03.527 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:28:03.527 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:28:03.528 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:28:03.528 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:28:03.528 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:28:03.528 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:28:03.529 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:28:03.529 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:28:03.529 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:28:03.529 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:28:03.529 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:28:03.530 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:28:03.530 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:28:03.530 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:28:03.530 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:28:03.531 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.531 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:28:03.531 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:28:03.531 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:28:03.532 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:28:03.532 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:28:03.532 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:28:03.532 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:28:03.533 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:28:03.533 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:28:03.533 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:28:03.533 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:28:03.533 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:28:03.534 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:28:03.534 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.534 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:28:03.534 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:28:03.535 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.535 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.535 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.535 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:28:03.536 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:28:03.536 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:28:03.536 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:28:03.536 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:28:03.536 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:28:03.537 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:28:03.537 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:28:03.537 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:28:03.537 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:28:03.538 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:28:03.538 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:28:03.538 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:28:03.538 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:28:03.539 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:28:03.539 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:28:03.539 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:28:03.539 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:28:03.539 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:28:03.540 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:28:03.540 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:28:03.540 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:28:03.541 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:28:03.541 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.541 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:28:03.541 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:28:03.542 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:28:03.542 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:28:03.542 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:28:03.542 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:28:03.542 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:28:03.543 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:28:03.543 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:28:03.543 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:28:03.543 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:28:03.544 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:28:03.544 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:28:03.544 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:28:03.544 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:28:03.545 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:28:03.545 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:28:03.545 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:28:03.545 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:28:03.545 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:28:03.546 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:28:03.546 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:28:03.546 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:28:03.546 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:28:03.547 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:28:03.547 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:28:03.547 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:28:03.547 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.548 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:28:03.548 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:28:03.548 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:28:03.548 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:28:03.548 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:28:03.549 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:28:03.549 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:28:03.549 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:28:03.549 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:28:03.550 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:28:03.550 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:28:03.550 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:28:03.550 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:28:03.551 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:28:03.551 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.551 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.551 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:28:03.552 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:28:03.552 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.552 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:28:03.552 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:28:03.553 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:28:03.553 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:28:03.553 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:28:03.553 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:28:03.554 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:28:03.554 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:28:03.554 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:28:03.554 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 139, 2021-12-17T18:28:03.555 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:28:03.555 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:28:03.555 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:28:03.555 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.555 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.556 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.556 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:28:03.556 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:28:03.556 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.557 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.557 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.557 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:28:03.557 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:28:03.558 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.558 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.558 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.558 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:28:03.558 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.559 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.559 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.559 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:28:03.559 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:28:03.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.560 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.560 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.560 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:28:03.561 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:28:03.561 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.561 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.561 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:28:03.562 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.562 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.562 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.562 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:28:03.563 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:28:03.563 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.563 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.563 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.564 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:28:03.564 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:28:03.564 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.564 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.565 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.565 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:28:03.565 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.566 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.566 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:28:03.566 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:28:03.566 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.567 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.567 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.567 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:28:03.567 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:28:03.568 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.568 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.568 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.568 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:28:03.569 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:28:03.569 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:28:03.569 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:28:03.569 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:28:03.570 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:28:03.570 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:28:03.570 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.571 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.571 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.571 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:28:03.571 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:28:03.572 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:28:03.572 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:28:03.572 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:28:03.572 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:28:03.573 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:28:03.573 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:28:03.573 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:28:03.573 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 139, 2021-12-17T18:28:03.574 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:28:03.574 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:28:03.574 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:28:03.574 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.575 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.575 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.575 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:28:03.575 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:28:03.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.576 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.576 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.576 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:28:03.577 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:28:03.577 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.577 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.577 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.577 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:28:03.578 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.578 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.578 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.578 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:28:03.579 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:28:03.579 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.579 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.579 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.580 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:28:03.580 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:28:03.580 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.580 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.581 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:28:03.581 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.581 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.581 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.582 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:28:03.582 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:28:03.582 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.582 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.583 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.583 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:28:03.583 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:28:03.583 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.583 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.584 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:28:03.584 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.584 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.585 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.585 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:28:03.585 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:28:03.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.585 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.586 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.586 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:28:03.586 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:28:03.586 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.587 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.587 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:28:03.587 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:28:03.588 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:28:03.588 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:28:03.588 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:28:03.588 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:28:03.588 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:28:03.589 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.589 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.589 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:28:03.590 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:28:03.590 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:28:03.590 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:28:03.590 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:28:03.591 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:28:03.591 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:28:03.591 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:28:03.591 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:28:03.591 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 138, 2021-12-17T18:28:03.592 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:28:03.592 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:28:03.592 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:28:03.592 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.593 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.593 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.593 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:28:03.593 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:28:03.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.594 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.594 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.594 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:28:03.594 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:28:03.595 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.595 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.595 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:28:03.596 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.596 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.596 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.596 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:28:03.597 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:28:03.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.597 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.597 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.597 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:28:03.598 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:28:03.598 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.598 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.599 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:28:03.599 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.599 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.599 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.600 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:28:03.600 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:28:03.600 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.600 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.600 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.601 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:28:03.601 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:28:03.601 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.601 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.602 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.602 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:28:03.602 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.602 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.603 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.603 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:28:03.603 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:28:03.603 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.603 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.604 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.604 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:28:03.604 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:28:03.604 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.605 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.605 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.605 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:28:03.605 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:28:03.606 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:28:03.606 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:28:03.606 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:28:03.606 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:28:03.607 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:28:03.607 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.607 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.607 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.608 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:28:03.608 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:28:03.608 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:28:03.608 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:28:03.608 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:28:03.609 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:28:03.609 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:28:03.609 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:28:03.609 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:28:03.610 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 128, 2021-12-17T18:28:03.610 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:28:03.610 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:28:03.610 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:28:03.611 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.611 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.611 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.611 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:28:03.611 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:28:03.612 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.612 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.612 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.612 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:28:03.613 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:28:03.613 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.613 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.613 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.614 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:28:03.614 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.614 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.614 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.615 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:28:03.615 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:28:03.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.615 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.615 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.616 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:28:03.616 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:28:03.616 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.616 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.617 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:28:03.617 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.618 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.618 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:28:03.618 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:28:03.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.619 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.619 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.619 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:28:03.620 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:28:03.620 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.620 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.620 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.620 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:28:03.621 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.621 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.621 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.622 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:28:03.622 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:28:03.622 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.623 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.623 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.623 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:28:03.624 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:28:03.624 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.624 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.624 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.625 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:28:03.625 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:28:03.625 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:28:03.625 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:28:03.626 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:28:03.626 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:28:03.626 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:28:03.626 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.627 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.627 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.627 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:28:03.627 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:28:03.628 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:28:03.628 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:28:03.628 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:28:03.628 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:28:03.628 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:28:03.629 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:28:03.629 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:28:03.629 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 138, 2021-12-17T18:28:03.629 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:28:03.630 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:28:03.630 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:28:03.630 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.630 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.631 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.631 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:28:03.631 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:28:03.631 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.631 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.632 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.632 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:28:03.632 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:28:03.632 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.633 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.633 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.633 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:28:03.633 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.634 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.634 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.634 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:28:03.634 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:28:03.635 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.635 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.635 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.635 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:28:03.635 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:28:03.636 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.636 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.636 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.636 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:28:03.637 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.637 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.637 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.637 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:28:03.638 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:28:03.638 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.638 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.638 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.638 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:28:03.639 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:28:03.639 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.639 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.639 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.640 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:28:03.640 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.640 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.640 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.641 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:28:03.641 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:28:03.641 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.641 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.642 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.642 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:28:03.642 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:28:03.642 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.643 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.643 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.643 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:28:03.643 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:28:03.643 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:28:03.644 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:28:03.644 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:28:03.644 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:28:03.644 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:28:03.645 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.645 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.645 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.645 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:28:03.645 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:28:03.646 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:28:03.646 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:28:03.646 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:28:03.646 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:28:03.647 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:28:03.647 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:28:03.647 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:28:03.648 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 139, 2021-12-17T18:28:03.648 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:28:03.648 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:28:03.648 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:28:03.648 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.649 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.649 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.649 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:28:03.649 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:28:03.650 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.650 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.650 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.650 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:28:03.651 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:28:03.651 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.651 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.651 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.651 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:28:03.652 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.652 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.652 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.652 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:28:03.653 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:28:03.653 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.653 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.653 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.654 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:28:03.654 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:28:03.654 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.654 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.654 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.655 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:28:03.655 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.655 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.655 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.656 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:28:03.656 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:28:03.656 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.656 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.657 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.657 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:28:03.657 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:28:03.657 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.657 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.658 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.658 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:28:03.658 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.658 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.659 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.659 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:28:03.659 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:28:03.659 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.660 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.660 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.660 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:28:03.660 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:28:03.660 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.661 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.661 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.661 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:28:03.661 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:28:03.662 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:28:03.662 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:28:03.662 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:28:03.662 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:28:03.663 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:28:03.663 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.663 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.663 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.663 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:28:03.664 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:28:03.664 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:28:03.664 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:28:03.664 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:28:03.665 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:28:03.665 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:28:03.665 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:28:03.665 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:28:03.665 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 139, 2021-12-17T18:28:03.666 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:28:03.666 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:28:03.666 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:28:03.666 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.667 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.667 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.667 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:28:03.667 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:28:03.668 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.668 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.668 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.668 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:28:03.669 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:28:03.669 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.669 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.669 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.670 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:28:03.670 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.670 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.670 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.670 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:28:03.671 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:28:03.671 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.671 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.671 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.672 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:28:03.672 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:28:03.672 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.672 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.673 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.673 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:28:03.673 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.673 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.674 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.674 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:28:03.674 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:28:03.674 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.675 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.675 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.675 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:28:03.675 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:28:03.676 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.676 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.676 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.676 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:28:03.677 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.677 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.677 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.677 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:28:03.678 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:28:03.678 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.678 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.678 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.679 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:28:03.679 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:28:03.679 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.679 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.680 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.680 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:28:03.680 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:28:03.681 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:28:03.681 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:28:03.681 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:28:03.681 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:28:03.682 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:28:03.682 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.682 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.683 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.683 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:28:03.683 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:28:03.683 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:28:03.684 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:28:03.684 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:28:03.684 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:28:03.684 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:28:03.684 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:28:03.685 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:28:03.685 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 139, 2021-12-17T18:28:03.685 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:28:03.685 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:28:03.686 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:28:03.686 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.686 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.687 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.687 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:28:03.687 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:28:03.687 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.688 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.688 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.688 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:28:03.688 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:28:03.689 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.689 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.689 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.689 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:28:03.689 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.690 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.690 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.690 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:28:03.691 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:28:03.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.691 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.692 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:28:03.692 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:28:03.692 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.692 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.692 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.693 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:28:03.693 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.693 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.693 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.694 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:28:03.694 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:28:03.694 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.694 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.695 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.695 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:28:03.695 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:28:03.695 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.696 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.696 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.696 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:28:03.696 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:03.696 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.697 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:03.697 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:28:03.697 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:28:03.697 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.698 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:03.698 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:28:03.698 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:28:03.699 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.699 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.699 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.699 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:28:03.700 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:28:03.700 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:28:03.700 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:28:03.700 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:28:03.701 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:28:03.701 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:28:03.701 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:03.701 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.702 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:28:03.702 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:28:03.702 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.702 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:28:03.703 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:28:03.703 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:28:03.703 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:28:03.703 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:28:03.704 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:28:03.704 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:28:03.704 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:28:03.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.705 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.705 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:28:03.705 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:28:03.705 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:28:03.705 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:28:03.706 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:28:03.706 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:28:03.706 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:28:03.706 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:28:03.707 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.707 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.707 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:28:03.707 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:28:03.708 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:28:03.708 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:28:03.708 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:28:03.708 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:28:03.709 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:28:03.709 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:28:03.709 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.709 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.709 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:28:03.710 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:28:03.710 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:28:03.710 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:28:03.710 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:28:03.711 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:28:03.711 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:28:03.711 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:28:03.711 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.712 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.712 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:28:03.712 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:28:03.712 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:28:03.713 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:28:03.713 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:28:03.713 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:28:03.713 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:28:03.713 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:28:03.714 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.714 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.714 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:28:03.714 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:28:03.715 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:28:03.715 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:28:03.715 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:28:03.715 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:28:03.716 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:28:03.716 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:28:03.716 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.716 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.716 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:28:03.717 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:28:03.717 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:28:03.717 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:28:03.717 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:28:03.718 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:28:03.718 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:28:03.718 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:28:03.718 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.719 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:03.719 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:28:03.719 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:28:03.719 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:28:03.720 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:28:03.720 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:28:03.720 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:28:03.720 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:28:03.720 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:28:03.721 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.721 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:28:03.721 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:28:03.721 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:28:03.722 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:28:03.722 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:28:03.722 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": { 2021-12-17T18:28:03.722 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.109:6835/1293726231": "2021-12-18T18:27:57.415626+0000", 2021-12-17T18:28:03.723 INFO:teuthology.orchestra.run.smithi062.stdout: "172.21.15.109:6834/1293726231": "2021-12-18T18:27:57.415626+0000" 2021-12-17T18:28:03.723 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.723 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:28:03.723 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:28:03.723 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:28:03.724 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:28:03.724 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:28:03.724 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:28:03.724 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:28:03.725 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:28:03.725 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:03.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:03.725 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:28:03.726 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:28:03.726 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:28:03.726 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:28:03.726 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:28:03.726 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:28:03.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.508+0000 7f9992ff6700 1 -- 172.21.15.62:0/992036704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9970053580 msgr2=0x7f9970055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:03.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.508+0000 7f9992ff6700 1 --2- 172.21.15.62:0/992036704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9970053580 0x7f9970055a40 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f997c00b000 tx=0x7f997c0091d0).stop 2021-12-17T18:28:03.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.508+0000 7f9992ff6700 1 -- 172.21.15.62:0/992036704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f998c05f8d0 msgr2=0x7f998c0b6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:03.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.508+0000 7f9992ff6700 1 --2- 172.21.15.62:0/992036704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f998c05f8d0 0x7f998c0b6ee0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f9974002f70 tx=0x7f9974015000).stop 2021-12-17T18:28:03.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.508+0000 7f9992ff6700 1 -- 172.21.15.62:0/992036704 shutdown_connections 2021-12-17T18:28:03.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.508+0000 7f9992ff6700 1 --2- 172.21.15.62:0/992036704 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9970053580 0x7f9970055a40 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.508+0000 7f9992ff6700 1 --2- 172.21.15.62:0/992036704 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f998c0b2ed0 0x7f998c15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.508+0000 7f9992ff6700 1 --2- 172.21.15.62:0/992036704 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f998c0af370 0x7f998c15a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.508+0000 7f9992ff6700 1 --2- 172.21.15.62:0/992036704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f998c05f8d0 0x7f998c0b6ee0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.508+0000 7f9992ff6700 1 -- 172.21.15.62:0/992036704 >> 172.21.15.62:0/992036704 conn(0x7f998c05bcd0 msgr2=0x7f998c0afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:03.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.508+0000 7f9992ff6700 1 -- 172.21.15.62:0/992036704 shutdown_connections 2021-12-17T18:28:03.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.508+0000 7f9992ff6700 1 -- 172.21.15.62:0/992036704 wait complete. 2021-12-17T18:28:03.732 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:28:03.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.836+0000 7f729fad3700 1 Processor -- start 2021-12-17T18:28:03.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.836+0000 7f729fad3700 1 -- start start 2021-12-17T18:28:03.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.836+0000 7f729fad3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f72980aee10 0x7f72980b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:03.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.836+0000 7f729fad3700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7298144fa0 0x7f72981406d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:03.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.836+0000 7f729fad3700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72980a8e00 con 0x7f72980aaca0 2021-12-17T18:28:03.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.836+0000 7f729fad3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72980a90a0 con 0x7f72980aee10 2021-12-17T18:28:03.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.836+0000 7f729fad3700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72980af8b0 con 0x7f7298144fa0 2021-12-17T18:28:03.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.836+0000 7f729d86f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f72980aee10 0x7f72980b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:03.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729d86f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f72980aee10 0x7f72980b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57094/0 (socket says 172.21.15.62:57094) 2021-12-17T18:28:03.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729e070700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f7298144fa0 0x7f72981406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:03.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729d86f700 1 -- 172.21.15.62:0/3122110855 learned_addr learned my addr 172.21.15.62:0/3122110855 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:03.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729d06e700 1 --1- 172.21.15.62:0/3122110855 >> v1:172.21.15.109:6789/0 conn(0x7f72980aaca0 0x7f7298144890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:56992/0 (socket says 172.21.15.62:56992) 2021-12-17T18:28:03.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729d86f700 1 -- 172.21.15.62:0/3122110855 >> v2:172.21.15.109:3300/0 conn(0x7f7298144fa0 msgr2=0x7f72981406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:03.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729d86f700 1 --2- 172.21.15.62:0/3122110855 >> v2:172.21.15.109:3300/0 conn(0x7f7298144fa0 0x7f72981406d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729d86f700 1 -- 172.21.15.62:0/3122110855 >> v1:172.21.15.109:6789/0 conn(0x7f72980aaca0 legacy=0x7f7298144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:03.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729d86f700 1 -- 172.21.15.62:0/3122110855 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72980b2da0 con 0x7f72980aee10 2021-12-17T18:28:03.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729e070700 1 --2- 172.21.15.62:0/3122110855 >> v2:172.21.15.109:3300/0 conn(0x7f7298144fa0 0x7f72981406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:28:03.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729d86f700 1 --2- 172.21.15.62:0/3122110855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72980aee10 0x7f72980b1610 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f7288002f70 tx=0x7f7288006eb0).ready entity=mon.0 client_cookie=472c74bfd2990d75 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:03.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729c86d700 1 -- 172.21.15.62:0/3122110855 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f728800d5c0 con 0x7f72980aee10 2021-12-17T18:28:03.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729c86d700 1 -- 172.21.15.62:0/3122110855 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7288000e90 con 0x7f72980aee10 2021-12-17T18:28:03.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729c86d700 1 -- 172.21.15.62:0/3122110855 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f728800d950 con 0x7f72980aee10 2021-12-17T18:28:03.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729fad3700 1 -- 172.21.15.62:0/3122110855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72980aee10 msgr2=0x7f72980b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:03.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729fad3700 1 --2- 172.21.15.62:0/3122110855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72980aee10 0x7f72980b1610 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f7288002f70 tx=0x7f7288006eb0).stop 2021-12-17T18:28:03.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729fad3700 1 -- 172.21.15.62:0/3122110855 shutdown_connections 2021-12-17T18:28:03.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729fad3700 1 --2- 172.21.15.62:0/3122110855 >> v2:172.21.15.109:3300/0 conn(0x7f7298144fa0 0x7f72981406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729fad3700 1 --2- 172.21.15.62:0/3122110855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72980aee10 0x7f72980b1610 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729fad3700 1 -- 172.21.15.62:0/3122110855 >> 172.21.15.62:0/3122110855 conn(0x7f729805f730 msgr2=0x7f729805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:03.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729fad3700 1 -- 172.21.15.62:0/3122110855 shutdown_connections 2021-12-17T18:28:03.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729fad3700 1 -- 172.21.15.62:0/3122110855 wait complete. 2021-12-17T18:28:03.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729fad3700 1 Processor -- start 2021-12-17T18:28:03.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.840+0000 7f729fad3700 1 -- start start 2021-12-17T18:28:03.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729fad3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72980aaca0 0x7f7298066cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:03.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729fad3700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72980aee10 0x7f7298150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:03.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729fad3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7298144fa0 0x7f7298153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:03.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729fad3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7298150a60 con 0x7f7298144fa0 2021-12-17T18:28:03.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729fad3700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7298150c50 con 0x7f72980aee10 2021-12-17T18:28:03.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729fad3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7298150ef0 con 0x7f72980aaca0 2021-12-17T18:28:03.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729e070700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7298144fa0 0x7f7298153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:03.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729d86f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72980aaca0 0x7f7298066cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:03.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729d06e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72980aee10 0x7f7298150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:03.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729e070700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7298144fa0 0x7f7298153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57102/0 (socket says 172.21.15.62:57102) 2021-12-17T18:28:03.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729d86f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72980aaca0 0x7f7298066cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:50800/0 (socket says 172.21.15.62:50800) 2021-12-17T18:28:03.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729e070700 1 -- 172.21.15.62:0/4171296194 learned_addr learned my addr 172.21.15.62:0/4171296194 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:03.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729d06e700 1 -- 172.21.15.62:0/4171296194 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72980aaca0 msgr2=0x7f7298066cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:03.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729d06e700 1 --2- 172.21.15.62:0/4171296194 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72980aaca0 0x7f7298066cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729d06e700 1 -- 172.21.15.62:0/4171296194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7298144fa0 msgr2=0x7f7298153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:03.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729d06e700 1 --2- 172.21.15.62:0/4171296194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7298144fa0 0x7f7298153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:03.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729d06e700 1 -- 172.21.15.62:0/4171296194 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7290009470 con 0x7f72980aee10 2021-12-17T18:28:03.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729d86f700 1 --2- 172.21.15.62:0/4171296194 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72980aaca0 0x7f7298066cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:28:03.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729e070700 1 --2- 172.21.15.62:0/4171296194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7298144fa0 0x7f7298153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:28:03.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729d06e700 1 --2- 172.21.15.62:0/4171296194 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72980aee10 0x7f7298150570 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f7298061080 tx=0x7f7294007b40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:03.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f7286ffd700 1 -- 172.21.15.62:0/4171296194 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72940070d0 con 0x7f72980aee10 2021-12-17T18:28:03.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f7286ffd700 1 -- 172.21.15.62:0/4171296194 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7294007230 con 0x7f72980aee10 2021-12-17T18:28:03.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729fad3700 1 -- 172.21.15.62:0/4171296194 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f728800b1e0 con 0x7f72980aee10 2021-12-17T18:28:03.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f7286ffd700 1 -- 172.21.15.62:0/4171296194 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7294005740 con 0x7f72980aee10 2021-12-17T18:28:03.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.844+0000 7f729fad3700 1 -- 172.21.15.62:0/4171296194 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7298154070 con 0x7f72980aee10 2021-12-17T18:28:03.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.848+0000 7f729fad3700 1 -- 172.21.15.62:0/4171296194 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72980573d0 con 0x7f72980aee10 2021-12-17T18:28:03.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.848+0000 7f7286ffd700 1 -- 172.21.15.62:0/4171296194 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7294010070 con 0x7f72980aee10 2021-12-17T18:28:03.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.848+0000 7f7286ffd700 1 --2- 172.21.15.62:0/4171296194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f72780535b0 0x7f7278055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:03.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.848+0000 7f7286ffd700 1 -- 172.21.15.62:0/4171296194 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f729406aaa0 con 0x7f72980aee10 2021-12-17T18:28:03.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.848+0000 7f729d86f700 1 --2- 172.21.15.62:0/4171296194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f72780535b0 0x7f7278055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:03.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.848+0000 7f729d86f700 1 --2- 172.21.15.62:0/4171296194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f72780535b0 0x7f7278055a70 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f728801c000 tx=0x7f7288015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:03.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:03.856+0000 7f7286ffd700 1 -- 172.21.15.62:0/4171296194 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7294041dd0 con 0x7f72980aee10 2021-12-17T18:28:04.025 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.020+0000 7f729fad3700 1 -- 172.21.15.62:0/4171296194 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f729806a2b0 con 0x7f72980aee10 2021-12-17T18:28:04.026 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.020+0000 7f7286ffd700 1 -- 172.21.15.62:0/4171296194 <== mon.1 v2:172.21.15.109:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+1212 (secure 0 0 0) 0x7f7294018030 con 0x7f72980aee10 2021-12-17T18:28:04.027 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:04.027 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":73,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8323,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4209581820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4209581820},{"type":"v1","addr":"172.21.15.62:6833","nonce":4209581820}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69},{"gid":8575,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/4213056764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":4213056764},{"type":"v1","addr":"172.21.15.109:6835","nonce":4213056764}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73}],"filesystems":[]} 2021-12-17T18:28:04.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.024+0000 7f729fad3700 1 -- 172.21.15.62:0/4171296194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f72780535b0 msgr2=0x7f7278055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:04.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.024+0000 7f729fad3700 1 --2- 172.21.15.62:0/4171296194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f72780535b0 0x7f7278055a70 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f728801c000 tx=0x7f7288015000).stop 2021-12-17T18:28:04.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.024+0000 7f729fad3700 1 -- 172.21.15.62:0/4171296194 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72980aee10 msgr2=0x7f7298150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:04.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.024+0000 7f729fad3700 1 --2- 172.21.15.62:0/4171296194 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72980aee10 0x7f7298150570 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f7298061080 tx=0x7f7294007b40).stop 2021-12-17T18:28:04.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.024+0000 7f729fad3700 1 -- 172.21.15.62:0/4171296194 shutdown_connections 2021-12-17T18:28:04.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.024+0000 7f729fad3700 1 --2- 172.21.15.62:0/4171296194 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f72780535b0 0x7f7278055a70 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:04.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.024+0000 7f729fad3700 1 --2- 172.21.15.62:0/4171296194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7298144fa0 0x7f7298153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:04.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.024+0000 7f729fad3700 1 --2- 172.21.15.62:0/4171296194 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f72980aee10 0x7f7298150570 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:04.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.024+0000 7f729fad3700 1 --2- 172.21.15.62:0/4171296194 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f72980aaca0 0x7f7298066cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:04.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.024+0000 7f729fad3700 1 -- 172.21.15.62:0/4171296194 >> 172.21.15.62:0/4171296194 conn(0x7f729805f730 msgr2=0x7f7298142c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:04.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.024+0000 7f729fad3700 1 -- 172.21.15.62:0/4171296194 shutdown_connections 2021-12-17T18:28:04.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.024+0000 7f729fad3700 1 -- 172.21.15.62:0/4171296194 wait complete. 2021-12-17T18:28:04.033 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 73 2021-12-17T18:28:04.044 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:28:04.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.140+0000 7f1ff4924700 1 Processor -- start 2021-12-17T18:28:04.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.140+0000 7f1ff4924700 1 -- start start 2021-12-17T18:28:04.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.140+0000 7f1ff4924700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1ff00b21f0 0x7f1ff014aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:04.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.140+0000 7f1ff4924700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1ff00a7bb0 0x7f1ff0067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:04.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.140+0000 7f1ff4924700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff00b2ce0 con 0x7f1ff00b1730 2021-12-17T18:28:04.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.140+0000 7f1ff4924700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff0147870 con 0x7f1ff00b21f0 2021-12-17T18:28:04.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.140+0000 7f1ff4924700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff00b2f10 con 0x7f1ff00a7bb0 2021-12-17T18:28:04.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.140+0000 7f1fee59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1ff00b21f0 0x7f1ff014aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:04.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.140+0000 7f1fee59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1ff00b21f0 0x7f1ff014aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57108/0 (socket says 172.21.15.62:57108) 2021-12-17T18:28:04.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.140+0000 7f1feed9d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1ff00a7bb0 0x7f1ff0067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:04.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.140+0000 7f1fee59c700 1 -- 172.21.15.62:0/790457900 learned_addr learned my addr 172.21.15.62:0/790457900 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:04.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.140+0000 7f1fee59c700 1 -- 172.21.15.62:0/790457900 >> v2:172.21.15.109:3300/0 conn(0x7f1ff00a7bb0 msgr2=0x7f1ff0067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:04.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.140+0000 7f1fee59c700 1 --2- 172.21.15.62:0/790457900 >> v2:172.21.15.109:3300/0 conn(0x7f1ff00a7bb0 0x7f1ff0067120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:04.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.140+0000 7f1fee59c700 1 -- 172.21.15.62:0/790457900 >> v1:172.21.15.109:6789/0 conn(0x7f1ff00b1730 legacy=0x7f1ff00ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:04.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.140+0000 7f1fee59c700 1 -- 172.21.15.62:0/790457900 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff00aca60 con 0x7f1ff00b21f0 2021-12-17T18:28:04.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.140+0000 7f1fee59c700 1 --2- 172.21.15.62:0/790457900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ff00b21f0 0x7f1ff014aea0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f1ff00b1c00 tx=0x7f1fe4006eb0).ready entity=mon.0 client_cookie=b240a4079aa204b3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:04.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.144+0000 7f1fed59a700 1 -- 172.21.15.62:0/790457900 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fe400d610 con 0x7f1ff00b21f0 2021-12-17T18:28:04.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.144+0000 7f1fed59a700 1 -- 172.21.15.62:0/790457900 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe4000e90 con 0x7f1ff00b21f0 2021-12-17T18:28:04.153 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.144+0000 7f1fed59a700 1 -- 172.21.15.62:0/790457900 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fe400d9a0 con 0x7f1ff00b21f0 2021-12-17T18:28:04.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.144+0000 7f1ff4924700 1 -- 172.21.15.62:0/790457900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ff00b21f0 msgr2=0x7f1ff014aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:04.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.144+0000 7f1ff4924700 1 --2- 172.21.15.62:0/790457900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ff00b21f0 0x7f1ff014aea0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f1ff00b1c00 tx=0x7f1fe4006eb0).stop 2021-12-17T18:28:04.154 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.144+0000 7f1ff4924700 1 -- 172.21.15.62:0/790457900 shutdown_connections 2021-12-17T18:28:04.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.144+0000 7f1ff4924700 1 --2- 172.21.15.62:0/790457900 >> v2:172.21.15.109:3300/0 conn(0x7f1ff00a7bb0 0x7f1ff0067120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:04.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.144+0000 7f1ff4924700 1 --2- 172.21.15.62:0/790457900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ff00b21f0 0x7f1ff014aea0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:04.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.144+0000 7f1ff4924700 1 -- 172.21.15.62:0/790457900 >> 172.21.15.62:0/790457900 conn(0x7f1ff005f730 msgr2=0x7f1ff005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:04.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.144+0000 7f1ff4924700 1 -- 172.21.15.62:0/790457900 shutdown_connections 2021-12-17T18:28:04.155 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.144+0000 7f1ff4924700 1 -- 172.21.15.62:0/790457900 wait complete. 2021-12-17T18:28:04.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.144+0000 7f1ff4924700 1 Processor -- start 2021-12-17T18:28:04.156 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1ff4924700 1 -- start start 2021-12-17T18:28:04.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1ff4924700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1ff00a7bb0 0x7f1ff015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:04.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1ff4924700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ff00b1730 0x7f1ff00b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:04.159 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1ff4924700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1ff00b21f0 0x7f1ff0063bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:04.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1ff4924700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff00a95a0 con 0x7f1ff00b1730 2021-12-17T18:28:04.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1ff4924700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff00a9840 con 0x7f1ff00a7bb0 2021-12-17T18:28:04.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1ff4924700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff014d830 con 0x7f1ff00b21f0 2021-12-17T18:28:04.160 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1fedd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ff00b1730 0x7f1ff00b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:04.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1fee59c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1ff00a7bb0 0x7f1ff015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:04.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1fedd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ff00b1730 0x7f1ff00b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57114/0 (socket says 172.21.15.62:57114) 2021-12-17T18:28:04.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1fedd9b700 1 -- 172.21.15.62:0/1605567504 learned_addr learned my addr 172.21.15.62:0/1605567504 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:04.161 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1feed9d700 1 --2- 172.21.15.62:0/1605567504 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1ff00b21f0 0x7f1ff0063bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:04.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1fedd9b700 1 -- 172.21.15.62:0/1605567504 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1ff00b21f0 msgr2=0x7f1ff0063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:04.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1fedd9b700 1 --2- 172.21.15.62:0/1605567504 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1ff00b21f0 0x7f1ff0063bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:04.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1fedd9b700 1 -- 172.21.15.62:0/1605567504 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1ff00a7bb0 msgr2=0x7f1ff015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:04.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1fedd9b700 1 --2- 172.21.15.62:0/1605567504 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1ff00a7bb0 0x7f1ff015a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:04.162 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1fedd9b700 1 -- 172.21.15.62:0/1605567504 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe400b1e0 con 0x7f1ff00b1730 2021-12-17T18:28:04.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1feed9d700 1 --2- 172.21.15.62:0/1605567504 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1ff00b21f0 0x7f1ff0063bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:28:04.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1fedd9b700 1 --2- 172.21.15.62:0/1605567504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ff00b1730 0x7f1ff00b4750 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f1ff00a88d0 tx=0x7f1fe0007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:04.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1fdf7fe700 1 -- 172.21.15.62:0/1605567504 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fe0012400 con 0x7f1ff00b1730 2021-12-17T18:28:04.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1fdf7fe700 1 -- 172.21.15.62:0/1605567504 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe0012560 con 0x7f1ff00b1730 2021-12-17T18:28:04.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1fdf7fe700 1 -- 172.21.15.62:0/1605567504 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fe00128c0 con 0x7f1ff00b1730 2021-12-17T18:28:04.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1ff4924700 1 -- 172.21.15.62:0/1605567504 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff00a9bf0 con 0x7f1ff00b1730 2021-12-17T18:28:04.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.148+0000 7f1ff4924700 1 -- 172.21.15.62:0/1605567504 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff00aa970 con 0x7f1ff00b1730 2021-12-17T18:28:04.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.152+0000 7f1fdf7fe700 1 -- 172.21.15.62:0/1605567504 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1fe0019030 con 0x7f1ff00b1730 2021-12-17T18:28:04.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.152+0000 7f1ff4924700 1 -- 172.21.15.62:0/1605567504 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff00ad5a0 con 0x7f1ff00b1730 2021-12-17T18:28:04.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.152+0000 7f1fdf7fe700 1 --2- 172.21.15.62:0/1605567504 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fcc0536a0 0x7f1fcc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:04.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.152+0000 7f1fdf7fe700 1 -- 172.21.15.62:0/1605567504 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f1fe006aa50 con 0x7f1ff00b1730 2021-12-17T18:28:04.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.152+0000 7f1fee59c700 1 --2- 172.21.15.62:0/1605567504 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fcc0536a0 0x7f1fcc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:04.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.152+0000 7f1fee59c700 1 --2- 172.21.15.62:0/1605567504 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fcc0536a0 0x7f1fcc055b60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f1fe401c000 tx=0x7f1fe4015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:04.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.156+0000 7f1fdf7fe700 1 -- 172.21.15.62:0/1605567504 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1fe0041e90 con 0x7f1ff00b1730 2021-12-17T18:28:04.328 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.320+0000 7f1ff4924700 1 -- 172.21.15.62:0/1605567504 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ff00573d0 con 0x7f1ff00b1730 2021-12-17T18:28:04.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.324+0000 7f1fdf7fe700 1 -- 172.21.15.62:0/1605567504 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+1212 (secure 0 0 0) 0x7f1fe00454b0 con 0x7f1ff00b1730 2021-12-17T18:28:04.329 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:04.330 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":73,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8323,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/4209581820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4209581820},{"type":"v1","addr":"172.21.15.62:6833","nonce":4209581820}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69},{"gid":8575,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/4213056764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":4213056764},{"type":"v1","addr":"172.21.15.109:6835","nonce":4213056764}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73}],"filesystems":[]} 2021-12-17T18:28:04.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.324+0000 7f1ff4924700 1 -- 172.21.15.62:0/1605567504 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fcc0536a0 msgr2=0x7f1fcc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:04.332 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.324+0000 7f1ff4924700 1 --2- 172.21.15.62:0/1605567504 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fcc0536a0 0x7f1fcc055b60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f1fe401c000 tx=0x7f1fe4015000).stop 2021-12-17T18:28:04.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.324+0000 7f1ff4924700 1 -- 172.21.15.62:0/1605567504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ff00b1730 msgr2=0x7f1ff00b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:04.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.324+0000 7f1ff4924700 1 --2- 172.21.15.62:0/1605567504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ff00b1730 0x7f1ff00b4750 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f1ff00a88d0 tx=0x7f1fe0007c50).stop 2021-12-17T18:28:04.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.324+0000 7f1ff4924700 1 -- 172.21.15.62:0/1605567504 shutdown_connections 2021-12-17T18:28:04.333 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.324+0000 7f1ff4924700 1 --2- 172.21.15.62:0/1605567504 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1fcc0536a0 0x7f1fcc055b60 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:04.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.324+0000 7f1ff4924700 1 --2- 172.21.15.62:0/1605567504 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1ff00b21f0 0x7f1ff0063bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:04.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.324+0000 7f1ff4924700 1 --2- 172.21.15.62:0/1605567504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ff00b1730 0x7f1ff00b4750 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:04.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.324+0000 7f1ff4924700 1 --2- 172.21.15.62:0/1605567504 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1ff00a7bb0 0x7f1ff015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:04.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.324+0000 7f1ff4924700 1 -- 172.21.15.62:0/1605567504 >> 172.21.15.62:0/1605567504 conn(0x7f1ff005f730 msgr2=0x7f1ff00ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:04.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.324+0000 7f1ff4924700 1 -- 172.21.15.62:0/1605567504 shutdown_connections 2021-12-17T18:28:04.335 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.324+0000 7f1ff4924700 1 -- 172.21.15.62:0/1605567504 wait complete. 2021-12-17T18:28:04.335 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 73 2021-12-17T18:28:04.346 INFO:tasks.ceph.mds.a:Restarting daemon 2021-12-17T18:28:04.347 INFO:tasks.ceph.mds.a:Stopping old one... 2021-12-17T18:28:04.347 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-12-17T18:28:04.347 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:28:04.348 INFO:tasks.ceph.mds.b:Restarting daemon 2021-12-17T18:28:04.348 INFO:tasks.ceph.mds.b:Stopping old one... 2021-12-17T18:28:04.348 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-12-17T18:28:04.349 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T18:28:04.360 INFO:tasks.ceph.mds.a:Stopped 2021-12-17T18:28:04.361 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-12-17T18:28:04.363 INFO:tasks.ceph.mds.a:Started 2021-12-17T18:28:04.364 DEBUG:teuthology.parallel:result is None 2021-12-17T18:28:04.365 INFO:tasks.ceph.mds.b:Stopped 2021-12-17T18:28:04.365 DEBUG:teuthology.orchestra.run.smithi109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-12-17T18:28:04.368 INFO:tasks.ceph.mds.b:Started 2021-12-17T18:28:04.368 DEBUG:teuthology.parallel:result is None 2021-12-17T18:28:04.369 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-12-17T18:28:04.447 INFO:tasks.ceph.mds.b.smithi109.stdout:starting mds.b at 2021-12-17T18:28:04.449 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:28:04.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.468+0000 7efe0e71e700 1 Processor -- start 2021-12-17T18:28:04.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.468+0000 7efe0e71e700 1 -- start start 2021-12-17T18:28:04.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.468+0000 7efe0e71e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7efe08143610 0x7efe0814e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:04.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.468+0000 7efe0e71e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe08146e30 con 0x7efe0813ce80 2021-12-17T18:28:04.477 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.468+0000 7efe0e71e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe08062a00 con 0x7efe08062620 2021-12-17T18:28:04.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.468+0000 7efe0e71e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe080b59e0 con 0x7efe08143610 2021-12-17T18:28:04.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.472+0000 7efe0cf1b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7efe0813ce80 0x7efe08142f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40714/0 (socket says 172.21.15.62:40714) 2021-12-17T18:28:04.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.472+0000 7efe0cf1b700 1 -- 172.21.15.62:0/3535075473 learned_addr learned my addr 172.21.15.62:0/3535075473 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:04.478 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.472+0000 7efe0df1d700 1 --2- 172.21.15.62:0/3535075473 >> v2:172.21.15.109:3300/0 conn(0x7efe08143610 0x7efe0814e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:04.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.472+0000 7efe0df1d700 1 -- 172.21.15.62:0/3535075473 >> v1:172.21.15.109:6789/0 conn(0x7efe08062620 legacy=0x7efe0813c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:04.479 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.472+0000 7efe0df1d700 1 -- 172.21.15.62:0/3535075473 >> v1:172.21.15.62:6789/0 conn(0x7efe0813ce80 legacy=0x7efe08142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:04.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.472+0000 7efe0df1d700 1 -- 172.21.15.62:0/3535075473 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe08147060 con 0x7efe08143610 2021-12-17T18:28:04.480 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.472+0000 7efe0df1d700 1 --2- 172.21.15.62:0/3535075473 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efe08143610 0x7efe0814e730 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7efe000032f0 tx=0x7efe000091d0).ready entity=mon.1 client_cookie=e7d0e052e52f10ea server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:04.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.480+0000 7efdfffff700 1 -- 172.21.15.62:0/3535075473 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe00009ea0 con 0x7efe08143610 2021-12-17T18:28:04.486 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.480+0000 7efdfffff700 1 -- 172.21.15.62:0/3535075473 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0000b8a0 con 0x7efe08143610 2021-12-17T18:28:04.487 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.480+0000 7efdfffff700 1 -- 172.21.15.62:0/3535075473 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe0000ba10 con 0x7efe08143610 2021-12-17T18:28:04.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.480+0000 7efe0e71e700 1 -- 172.21.15.62:0/3535075473 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efe08143610 msgr2=0x7efe0814e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:04.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.480+0000 7efe0e71e700 1 --2- 172.21.15.62:0/3535075473 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efe08143610 0x7efe0814e730 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7efe000032f0 tx=0x7efe000091d0).stop 2021-12-17T18:28:04.488 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.480+0000 7efe0e71e700 1 -- 172.21.15.62:0/3535075473 shutdown_connections 2021-12-17T18:28:04.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.480+0000 7efe0e71e700 1 --2- 172.21.15.62:0/3535075473 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efe08143610 0x7efe0814e730 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:04.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.480+0000 7efe0e71e700 1 -- 172.21.15.62:0/3535075473 >> 172.21.15.62:0/3535075473 conn(0x7efe0805c750 msgr2=0x7efe0805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:04.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.480+0000 7efe0e71e700 1 -- 172.21.15.62:0/3535075473 shutdown_connections 2021-12-17T18:28:04.489 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.480+0000 7efe0e71e700 1 -- 172.21.15.62:0/3535075473 wait complete. 2021-12-17T18:28:04.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0e71e700 1 Processor -- start 2021-12-17T18:28:04.492 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0e71e700 1 -- start start 2021-12-17T18:28:04.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0e71e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efe08062620 0x7efe0813ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:04.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0e71e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe0813ce80 0x7efe08062f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:04.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0e71e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efe08143610 0x7efe08063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:04.493 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0e71e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0813efa0 con 0x7efe0813ce80 2021-12-17T18:28:04.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0e71e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe08066930 con 0x7efe08062620 2021-12-17T18:28:04.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0e71e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe08066bd0 con 0x7efe08143610 2021-12-17T18:28:04.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0cf1b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe0813ce80 0x7efe08062f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:04.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0cf1b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe0813ce80 0x7efe08062f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57140/0 (socket says 172.21.15.62:57140) 2021-12-17T18:28:04.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0cf1b700 1 -- 172.21.15.62:0/1010793129 learned_addr learned my addr 172.21.15.62:0/1010793129 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:04.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0df1d700 1 --2- 172.21.15.62:0/1010793129 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efe08143610 0x7efe08063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:04.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0d71c700 1 --2- 172.21.15.62:0/1010793129 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efe08062620 0x7efe0813ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:04.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0df1d700 1 -- 172.21.15.62:0/1010793129 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efe08062620 msgr2=0x7efe0813ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:04.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0df1d700 1 --2- 172.21.15.62:0/1010793129 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efe08062620 0x7efe0813ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:04.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0df1d700 1 -- 172.21.15.62:0/1010793129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe0813ce80 msgr2=0x7efe08062f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:04.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0df1d700 1 --2- 172.21.15.62:0/1010793129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe0813ce80 0x7efe08062f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:04.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0df1d700 1 -- 172.21.15.62:0/1010793129 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe00009470 con 0x7efe08143610 2021-12-17T18:28:04.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0cf1b700 1 --2- 172.21.15.62:0/1010793129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe0813ce80 0x7efe08062f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:28:04.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0df1d700 1 --2- 172.21.15.62:0/1010793129 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efe08143610 0x7efe08063470 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7efe000032f0 tx=0x7efe00016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:04.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efdfe7fc700 1 -- 172.21.15.62:0/1010793129 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe00009ea0 con 0x7efe08143610 2021-12-17T18:28:04.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efdfe7fc700 1 -- 172.21.15.62:0/1010793129 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0001f3f0 con 0x7efe08143610 2021-12-17T18:28:04.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efdfe7fc700 1 -- 172.21.15.62:0/1010793129 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe0001f750 con 0x7efe08143610 2021-12-17T18:28:04.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0e71e700 1 -- 172.21.15.62:0/1010793129 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe08066670 con 0x7efe08143610 2021-12-17T18:28:04.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.484+0000 7efe0e71e700 1 -- 172.21.15.62:0/1010793129 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe08067070 con 0x7efe08143610 2021-12-17T18:28:04.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.488+0000 7efe0e71e700 1 -- 172.21.15.62:0/1010793129 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe080573d0 con 0x7efe08143610 2021-12-17T18:28:04.499 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.488+0000 7efdfe7fc700 1 -- 172.21.15.62:0/1010793129 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efe0000f070 con 0x7efe08143610 2021-12-17T18:28:04.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.488+0000 7efdfe7fc700 1 --2- 172.21.15.62:0/1010793129 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efdf00536a0 0x7efdf0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:04.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.488+0000 7efe0d71c700 1 --2- 172.21.15.62:0/1010793129 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efdf00536a0 0x7efdf0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:04.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.488+0000 7efe0d71c700 1 --2- 172.21.15.62:0/1010793129 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efdf00536a0 0x7efdf0055b60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7efe0400d000 tx=0x7efe04007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:04.500 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.492+0000 7efdfe7fc700 1 -- 172.21.15.62:0/1010793129 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5339+0+0 (secure 0 0 0) 0x7efe00046ed0 con 0x7efe08143610 2021-12-17T18:28:04.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.496+0000 7efdfe7fc700 1 -- 172.21.15.62:0/1010793129 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efe00043270 con 0x7efe08143610 2021-12-17T18:28:04.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:04.628+0000 7efe0e71e700 1 -- 172.21.15.62:0/1010793129 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7efe08060ec0 con 0x7efe08143610 2021-12-17T18:28:04.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:28:04.791 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:28:04.793 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:28:04.796 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:28:04.798 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:28:05.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.500+0000 7efdfe7fc700 1 -- 172.21.15.62:0/1010793129 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v147) v1 ==== 97+0+0 (secure 0 0 0) 0x7efe00024070 con 0x7efe08143610 2021-12-17T18:28:05.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.504+0000 7efe0e71e700 1 -- 172.21.15.62:0/1010793129 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efdf00536a0 msgr2=0x7efdf0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:05.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.504+0000 7efe0e71e700 1 --2- 172.21.15.62:0/1010793129 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efdf00536a0 0x7efdf0055b60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7efe0400d000 tx=0x7efe04007b90).stop 2021-12-17T18:28:05.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.504+0000 7efe0e71e700 1 -- 172.21.15.62:0/1010793129 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efe08143610 msgr2=0x7efe08063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:05.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.504+0000 7efe0e71e700 1 --2- 172.21.15.62:0/1010793129 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efe08143610 0x7efe08063470 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7efe000032f0 tx=0x7efe00016000).stop 2021-12-17T18:28:05.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.504+0000 7efe0e71e700 1 -- 172.21.15.62:0/1010793129 shutdown_connections 2021-12-17T18:28:05.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.504+0000 7efe0e71e700 1 --2- 172.21.15.62:0/1010793129 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7efdf00536a0 0x7efdf0055b60 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.504+0000 7efe0e71e700 1 --2- 172.21.15.62:0/1010793129 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7efe08143610 0x7efe08063470 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.504+0000 7efe0e71e700 1 --2- 172.21.15.62:0/1010793129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe0813ce80 0x7efe08062f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.504+0000 7efe0e71e700 1 --2- 172.21.15.62:0/1010793129 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7efe08062620 0x7efe0813ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.504+0000 7efe0e71e700 1 -- 172.21.15.62:0/1010793129 >> 172.21.15.62:0/1010793129 conn(0x7efe0805c750 msgr2=0x7efe080b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:05.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.504+0000 7efe0e71e700 1 -- 172.21.15.62:0/1010793129 shutdown_connections 2021-12-17T18:28:05.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.504+0000 7efe0e71e700 1 -- 172.21.15.62:0/1010793129 wait complete. 2021-12-17T18:28:05.514 INFO:teuthology.orchestra.run.smithi062.stderr: removed all blacklist entries 2021-12-17T18:28:05.526 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-12-17T18:28:05.527 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-12-17T18:28:05.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.632+0000 7f8442cbc700 1 Processor -- start 2021-12-17T18:28:05.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.632+0000 7f8442cbc700 1 -- start start 2021-12-17T18:28:05.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.632+0000 7f8442cbc700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f843c0b1730 0x7f843c0ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:05.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.632+0000 7f8442cbc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f843c0a7bb0 0x7f843c067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:05.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.632+0000 7f8442cbc700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843c0b2ce0 con 0x7f843c0b21f0 2021-12-17T18:28:05.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.632+0000 7f8442cbc700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843c14b5b0 con 0x7f843c0b1730 2021-12-17T18:28:05.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.632+0000 7f8442cbc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c147870 con 0x7f843c0a7bb0 2021-12-17T18:28:05.643 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.632+0000 7f8441259700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f843c0a7bb0 0x7f843c067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:05.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.632+0000 7f843bfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f843c0b1730 0x7f843c0ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:05.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.632+0000 7f8441259700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f843c0a7bb0 0x7f843c067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:50854/0 (socket says 172.21.15.62:50854) 2021-12-17T18:28:05.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.632+0000 7f843bfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f843c0b1730 0x7f843c0ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:35468/0 (socket says 172.21.15.62:35468) 2021-12-17T18:28:05.644 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.632+0000 7f8440a58700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f843c0b21f0 0x7f843c14aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:57048/0 (socket says 172.21.15.62:57048) 2021-12-17T18:28:05.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.632+0000 7f8441259700 1 -- 172.21.15.62:0/691450558 learned_addr learned my addr 172.21.15.62:0/691450558 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:05.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.632+0000 7f8441259700 1 -- 172.21.15.62:0/691450558 >> v2:172.21.15.109:3300/0 conn(0x7f843c0b1730 msgr2=0x7f843c0ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:05.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.632+0000 7f8441259700 1 --2- 172.21.15.62:0/691450558 >> v2:172.21.15.109:3300/0 conn(0x7f843c0b1730 0x7f843c0ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.645 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.632+0000 7f8441259700 1 -- 172.21.15.62:0/691450558 >> v1:172.21.15.109:6789/0 conn(0x7f843c0b21f0 legacy=0x7f843c14aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:05.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.632+0000 7f8441259700 1 -- 172.21.15.62:0/691450558 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c0aca60 con 0x7f843c0a7bb0 2021-12-17T18:28:05.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.636+0000 7f8441259700 1 --2- 172.21.15.62:0/691450558 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f843c0a7bb0 0x7f843c067120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f84340032f0 tx=0x7f8434009290).ready entity=mon.2 client_cookie=ae45595a5cc7e39c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:05.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.636+0000 7f843b7fe700 1 -- 172.21.15.62:0/691450558 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f843400b8a0 con 0x7f843c0a7bb0 2021-12-17T18:28:05.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.636+0000 7f843b7fe700 1 -- 172.21.15.62:0/691450558 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843400ba00 con 0x7f843c0a7bb0 2021-12-17T18:28:05.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.636+0000 7f843b7fe700 1 -- 172.21.15.62:0/691450558 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f843400bb70 con 0x7f843c0a7bb0 2021-12-17T18:28:05.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.636+0000 7f8442cbc700 1 -- 172.21.15.62:0/691450558 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f843c0a7bb0 msgr2=0x7f843c067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:05.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.636+0000 7f8442cbc700 1 --2- 172.21.15.62:0/691450558 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f843c0a7bb0 0x7f843c067120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f84340032f0 tx=0x7f8434009290).stop 2021-12-17T18:28:05.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.636+0000 7f8442cbc700 1 -- 172.21.15.62:0/691450558 shutdown_connections 2021-12-17T18:28:05.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.636+0000 7f8442cbc700 1 --2- 172.21.15.62:0/691450558 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f843c0a7bb0 0x7f843c067120 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.636+0000 7f8442cbc700 1 --2- 172.21.15.62:0/691450558 >> v2:172.21.15.109:3300/0 conn(0x7f843c0b1730 0x7f843c0ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.636+0000 7f8442cbc700 1 -- 172.21.15.62:0/691450558 >> 172.21.15.62:0/691450558 conn(0x7f843c05f730 msgr2=0x7f843c05fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:05.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.636+0000 7f8442cbc700 1 -- 172.21.15.62:0/691450558 shutdown_connections 2021-12-17T18:28:05.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.636+0000 7f8442cbc700 1 -- 172.21.15.62:0/691450558 wait complete. 2021-12-17T18:28:05.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.636+0000 7f8442cbc700 1 Processor -- start 2021-12-17T18:28:05.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.636+0000 7f8442cbc700 1 -- start start 2021-12-17T18:28:05.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8442cbc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f843c0a7bb0 0x7f843c0663c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:05.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8442cbc700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f843c0b1730 0x7f843c0ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:05.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8442cbc700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f843c0b21f0 0x7f843c15a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:05.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8442cbc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c147b60 con 0x7f843c0a7bb0 2021-12-17T18:28:05.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8442cbc700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c147e00 con 0x7f843c0b21f0 2021-12-17T18:28:05.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8442cbc700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c1480a0 con 0x7f843c0b1730 2021-12-17T18:28:05.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8440a58700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f843c0a7bb0 0x7f843c0663c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:05.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8440a58700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f843c0a7bb0 0x7f843c0663c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57154/0 (socket says 172.21.15.62:57154) 2021-12-17T18:28:05.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8440a58700 1 -- 172.21.15.62:0/2417838059 learned_addr learned my addr 172.21.15.62:0/2417838059 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:05.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f843bfff700 1 --2- 172.21.15.62:0/2417838059 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f843c0b1730 0x7f843c0ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:05.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8441259700 1 --2- 172.21.15.62:0/2417838059 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f843c0b21f0 0x7f843c15a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:05.658 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8440a58700 1 -- 172.21.15.62:0/2417838059 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f843c0b1730 msgr2=0x7f843c0ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:05.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8440a58700 1 --2- 172.21.15.62:0/2417838059 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f843c0b1730 0x7f843c0ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8440a58700 1 -- 172.21.15.62:0/2417838059 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f843c0b21f0 msgr2=0x7f843c15a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:05.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8440a58700 1 --2- 172.21.15.62:0/2417838059 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f843c0b21f0 0x7f843c15a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8440a58700 1 -- 172.21.15.62:0/2417838059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8434009530 con 0x7f843c0a7bb0 2021-12-17T18:28:05.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8440a58700 1 --2- 172.21.15.62:0/2417838059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f843c0a7bb0 0x7f843c0663c0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f843c061080 tx=0x7f8430007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:05.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8439ffb700 1 -- 172.21.15.62:0/2417838059 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84300070d0 con 0x7f843c0a7bb0 2021-12-17T18:28:05.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8439ffb700 1 -- 172.21.15.62:0/2417838059 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8430007230 con 0x7f843c0a7bb0 2021-12-17T18:28:05.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8439ffb700 1 -- 172.21.15.62:0/2417838059 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8430005550 con 0x7f843c0a7bb0 2021-12-17T18:28:05.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8442cbc700 1 -- 172.21.15.62:0/2417838059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843c0ac0e0 con 0x7f843c0a7bb0 2021-12-17T18:28:05.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8442cbc700 1 -- 172.21.15.62:0/2417838059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843c15ab90 con 0x7f843c0a7bb0 2021-12-17T18:28:05.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8442cbc700 1 -- 172.21.15.62:0/2417838059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843c0b2f10 con 0x7f843c0a7bb0 2021-12-17T18:28:05.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.640+0000 7f8439ffb700 1 -- 172.21.15.62:0/2417838059 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8430010070 con 0x7f843c0a7bb0 2021-12-17T18:28:05.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.644+0000 7f8439ffb700 1 --2- 172.21.15.62:0/2417838059 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f841c053610 0x7f841c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:05.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.644+0000 7f8439ffb700 1 -- 172.21.15.62:0/2417838059 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f843006ac00 con 0x7f843c0a7bb0 2021-12-17T18:28:05.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.644+0000 7f843bfff700 1 --2- 172.21.15.62:0/2417838059 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f841c053610 0x7f841c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:05.662 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.644+0000 7f843bfff700 1 --2- 172.21.15.62:0/2417838059 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f841c053610 0x7f841c055ad0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f842c00b000 tx=0x7f842c006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:05.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.648+0000 7f8439ffb700 1 -- 172.21.15.62:0/2417838059 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8430070020 con 0x7f843c0a7bb0 2021-12-17T18:28:05.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.816+0000 7f8442cbc700 1 -- 172.21.15.62:0/2417838059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f843c0573d0 con 0x7f843c0a7bb0 2021-12-17T18:28:05.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.816+0000 7f8439ffb700 1 -- 172.21.15.62:0/2417838059 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v44) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f8430018020 con 0x7f843c0a7bb0 2021-12-17T18:28:05.822 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:05.822 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:28:05.823 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_dump": [ 2021-12-17T18:28:05.823 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:05.823 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.a", 2021-12-17T18:28:05.824 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhxCS0LBAAtUlkgWYg4l3fQ2au7jMUDg==", 2021-12-17T18:28:05.824 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:28:05.824 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:28:05.824 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:28:05.825 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:28:05.825 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:28:05.825 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:05.826 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:05.826 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:05.826 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.b", 2021-12-17T18:28:05.827 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhoRJAMxAAP/NmDQRwJjYip2rxJsQlYg==", 2021-12-17T18:28:05.827 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:28:05.827 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:28:05.827 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:28:05.828 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:28:05.828 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:28:05.828 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:05.828 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:05.829 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:05.829 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.0", 2021-12-17T18:28:05.829 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBA1LxhJXzhKhAAUnxP3G5VuATkQLoDALFjVg==", 2021-12-17T18:28:05.829 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:28:05.830 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:28:05.830 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:28:05.830 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:28:05.830 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:05.831 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:05.831 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:05.831 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.1", 2021-12-17T18:28:05.831 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBD1LxhregUDhAABrxQ2jQ4BwXvuWh/D9SkbQ==", 2021-12-17T18:28:05.832 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:28:05.832 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:28:05.832 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:28:05.832 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:28:05.833 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:05.833 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:05.833 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:05.834 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.2", 2021-12-17T18:28:05.834 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBF1LxhOo/SLhAAhQQLW/VKFx1sgm8chnD5tw==", 2021-12-17T18:28:05.834 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:28:05.835 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:28:05.835 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:28:05.835 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:28:05.836 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:05.836 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:05.836 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:05.836 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.3", 2021-12-17T18:28:05.837 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBI1LxhT2ZQExAA999j8V5bJAJ2PuaQqSkUOw==", 2021-12-17T18:28:05.837 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:28:05.837 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:28:05.837 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:28:05.838 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:28:05.838 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:05.838 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:05.838 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:05.839 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.4", 2021-12-17T18:28:05.839 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBN1LxhKBDzFhAAKmPF0FXnnfXtweo+6z9nxg==", 2021-12-17T18:28:05.839 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:28:05.839 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:28:05.840 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:28:05.840 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:28:05.840 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:05.840 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:05.841 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:05.841 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.5", 2021-12-17T18:28:05.841 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBP1LxhtqkAORAAVaFLVNIUMs4Sytk8WRaGNA==", 2021-12-17T18:28:05.841 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:28:05.842 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:28:05.842 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:28:05.842 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:28:05.842 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:05.843 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:05.843 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:05.843 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.6", 2021-12-17T18:28:05.843 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBS1LxhNtncGhAAgG64g1ie54CDp9Y7uldKQA==", 2021-12-17T18:28:05.844 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:28:05.844 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:28:05.844 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:28:05.845 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:28:05.845 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:05.845 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:05.846 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:05.846 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.7", 2021-12-17T18:28:05.846 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBV1Lxh3DcDABAAHVskSVtoEJ8BxCCAs3ZDVA==", 2021-12-17T18:28:05.847 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:28:05.847 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:28:05.847 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:28:05.847 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:28:05.848 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:05.848 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:05.848 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:05.848 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.0", 2021-12-17T18:28:05.848 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxh9QhCNxAALkWTJorDpbt9yrikL7/NWg==", 2021-12-17T18:28:05.849 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:28:05.849 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:28:05.849 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:28:05.849 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:28:05.850 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:05.850 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:05.850 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:05.850 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.1", 2021-12-17T18:28:05.851 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91Lxhxm52OxAAbqXVaqRDmt4Ezj9xyCEODQ==", 2021-12-17T18:28:05.851 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:28:05.851 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:28:05.852 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:28:05.852 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:28:05.852 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:05.852 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:05.853 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:05.853 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.2", 2021-12-17T18:28:05.853 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+1LxhXu08BBAATRcUAZvMNg9ou4PLszDtmA==", 2021-12-17T18:28:05.854 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:28:05.854 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2021-12-17T18:28:05.854 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2021-12-17T18:28:05.855 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw pool=cephfs_data" 2021-12-17T18:28:05.855 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:05.855 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:05.855 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:05.856 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.admin", 2021-12-17T18:28:05.856 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhyAGlDRAA2ggSG5yBBFbMgK2fCBk2mQ==", 2021-12-17T18:28:05.856 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:28:05.856 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:28:05.857 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2021-12-17T18:28:05.857 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2021-12-17T18:28:05.857 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:28:05.857 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:05.858 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:05.858 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:05.858 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.x", 2021-12-17T18:28:05.858 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhzvntKRAAFQlg69Z6d2nWX0GxSshsMw==", 2021-12-17T18:28:05.859 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:28:05.859 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:28:05.859 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:28:05.859 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:28:05.860 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:05.860 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:05.860 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:05.860 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.y", 2021-12-17T18:28:05.861 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA91LxhKdTGJRAArzUN3A1U5Efw0NG9Gw2Gcw==", 2021-12-17T18:28:05.861 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2021-12-17T18:28:05.861 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2021-12-17T18:28:05.861 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2021-12-17T18:28:05.862 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2021-12-17T18:28:05.862 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:05.862 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:05.862 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:05.863 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:28:05.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.816+0000 7f8442cbc700 1 -- 172.21.15.62:0/2417838059 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f841c053610 msgr2=0x7f841c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:05.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.816+0000 7f8442cbc700 1 --2- 172.21.15.62:0/2417838059 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f841c053610 0x7f841c055ad0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f842c00b000 tx=0x7f842c006df0).stop 2021-12-17T18:28:05.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.816+0000 7f8442cbc700 1 -- 172.21.15.62:0/2417838059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f843c0a7bb0 msgr2=0x7f843c0663c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:05.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.816+0000 7f8442cbc700 1 --2- 172.21.15.62:0/2417838059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f843c0a7bb0 0x7f843c0663c0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f843c061080 tx=0x7f8430007c40).stop 2021-12-17T18:28:05.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.816+0000 7f8442cbc700 1 -- 172.21.15.62:0/2417838059 shutdown_connections 2021-12-17T18:28:05.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.816+0000 7f8442cbc700 1 --2- 172.21.15.62:0/2417838059 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f841c053610 0x7f841c055ad0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.816+0000 7f8442cbc700 1 --2- 172.21.15.62:0/2417838059 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f843c0b21f0 0x7f843c15a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.816+0000 7f8442cbc700 1 --2- 172.21.15.62:0/2417838059 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f843c0b1730 0x7f843c0ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.816+0000 7f8442cbc700 1 --2- 172.21.15.62:0/2417838059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f843c0a7bb0 0x7f843c0663c0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.816+0000 7f8442cbc700 1 -- 172.21.15.62:0/2417838059 >> 172.21.15.62:0/2417838059 conn(0x7f843c05f730 msgr2=0x7f843c146ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:05.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.816+0000 7f8442cbc700 1 -- 172.21.15.62:0/2417838059 shutdown_connections 2021-12-17T18:28:05.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.816+0000 7f8442cbc700 1 -- 172.21.15.62:0/2417838059 wait complete. 2021-12-17T18:28:05.869 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:28:05.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.968+0000 7f75ab59e700 1 Processor -- start 2021-12-17T18:28:05.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.968+0000 7f75ab59e700 1 -- start start 2021-12-17T18:28:05.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75ab59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75ac0b5b20 0x7f75ac0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:05.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75ab59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f75ac0b3760 0x7f75ac0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:05.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75ab59e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ac0b5f00 con 0x7f75ac0b6c70 2021-12-17T18:28:05.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75ab59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ac0b3020 con 0x7f75ac0b5b20 2021-12-17T18:28:05.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75ab59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ac0b32c0 con 0x7f75ac0b3760 2021-12-17T18:28:05.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75aa59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75ac0b5b20 0x7f75ac0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:05.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75a9d9b700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f75ac0b3760 0x7f75ac0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:05.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75aa59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75ac0b5b20 0x7f75ac0b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57166/0 (socket says 172.21.15.62:57166) 2021-12-17T18:28:05.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75aad9d700 1 --1- 172.21.15.62:0/2029978512 >> v1:172.21.15.109:6789/0 conn(0x7f75ac0b6c70 0x7f75ac146980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:57064/0 (socket says 172.21.15.62:57064) 2021-12-17T18:28:05.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75aa59c700 1 -- 172.21.15.62:0/2029978512 learned_addr learned my addr 172.21.15.62:0/2029978512 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:05.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75a9d9b700 1 -- 172.21.15.62:0/2029978512 >> v2:172.21.15.62:3300/0 conn(0x7f75ac0b5b20 msgr2=0x7f75ac0b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:05.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75a9d9b700 1 --2- 172.21.15.62:0/2029978512 >> v2:172.21.15.62:3300/0 conn(0x7f75ac0b5b20 0x7f75ac0b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75a9d9b700 1 -- 172.21.15.62:0/2029978512 >> v1:172.21.15.109:6789/0 conn(0x7f75ac0b6c70 legacy=0x7f75ac146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:05.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75a9d9b700 1 -- 172.21.15.62:0/2029978512 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac0b5440 con 0x7f75ac0b3760 2021-12-17T18:28:05.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75a9d9b700 1 --2- 172.21.15.62:0/2029978512 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75ac0b3760 0x7f75ac0b6780 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f75a0002f70 tx=0x7f75a0006df0).ready entity=mon.1 client_cookie=6013e795f5441c9 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:05.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75a959a700 1 -- 172.21.15.62:0/2029978512 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75a000d570 con 0x7f75ac0b3760 2021-12-17T18:28:05.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75a959a700 1 -- 172.21.15.62:0/2029978512 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a0000e90 con 0x7f75ac0b3760 2021-12-17T18:28:05.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75a959a700 1 -- 172.21.15.62:0/2029978512 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75a000d8c0 con 0x7f75ac0b3760 2021-12-17T18:28:05.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75ab59e700 1 -- 172.21.15.62:0/2029978512 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75ac0b3760 msgr2=0x7f75ac0b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:05.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75ab59e700 1 --2- 172.21.15.62:0/2029978512 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75ac0b3760 0x7f75ac0b6780 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f75a0002f70 tx=0x7f75a0006df0).stop 2021-12-17T18:28:05.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75ab59e700 1 -- 172.21.15.62:0/2029978512 shutdown_connections 2021-12-17T18:28:05.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75ab59e700 1 --2- 172.21.15.62:0/2029978512 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75ac0b3760 0x7f75ac0b6780 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75ab59e700 1 --2- 172.21.15.62:0/2029978512 >> v2:172.21.15.62:3300/0 conn(0x7f75ac0b5b20 0x7f75ac0b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75ab59e700 1 -- 172.21.15.62:0/2029978512 >> 172.21.15.62:0/2029978512 conn(0x7f75ac05c750 msgr2=0x7f75ac05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:05.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75ab59e700 1 -- 172.21.15.62:0/2029978512 shutdown_connections 2021-12-17T18:28:05.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.972+0000 7f75ab59e700 1 -- 172.21.15.62:0/2029978512 wait complete. 2021-12-17T18:28:05.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.976+0000 7f75ab59e700 1 Processor -- start 2021-12-17T18:28:05.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.976+0000 7f75ab59e700 1 -- start start 2021-12-17T18:28:05.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.976+0000 7f75ab59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75ac0b5b20 0x7f75ac0afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:05.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.976+0000 7f75ab59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75ac0b6c70 0x7f75ac143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:05.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.976+0000 7f75ab59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac145840 0x7f75ac0ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:05.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.976+0000 7f75ab59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0af070 con 0x7f75ac145840 2021-12-17T18:28:05.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.976+0000 7f75ab59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0af310 con 0x7f75ac0b5b20 2021-12-17T18:28:05.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.976+0000 7f75ab59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0af5b0 con 0x7f75ac0b6c70 2021-12-17T18:28:05.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.976+0000 7f75aad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac145840 0x7f75ac0ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:05.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.976+0000 7f75aad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac145840 0x7f75ac0ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57172/0 (socket says 172.21.15.62:57172) 2021-12-17T18:28:05.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.976+0000 7f75aad9d700 1 -- 172.21.15.62:0/209473029 learned_addr learned my addr 172.21.15.62:0/209473029 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:05.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.976+0000 7f75a9d9b700 1 --2- 172.21.15.62:0/209473029 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75ac0b6c70 0x7f75ac143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:05.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.976+0000 7f75aa59c700 1 --2- 172.21.15.62:0/209473029 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75ac0b5b20 0x7f75ac0afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:05.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.980+0000 7f75aad9d700 1 -- 172.21.15.62:0/209473029 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75ac0b6c70 msgr2=0x7f75ac143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:05.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.980+0000 7f75aad9d700 1 --2- 172.21.15.62:0/209473029 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75ac0b6c70 0x7f75ac143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.980+0000 7f75aad9d700 1 -- 172.21.15.62:0/209473029 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75ac0b5b20 msgr2=0x7f75ac0afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:05.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.980+0000 7f75aad9d700 1 --2- 172.21.15.62:0/209473029 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75ac0b5b20 0x7f75ac0afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:05.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.980+0000 7f75aad9d700 1 -- 172.21.15.62:0/209473029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a000b180 con 0x7f75ac145840 2021-12-17T18:28:05.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.980+0000 7f75aad9d700 1 --2- 172.21.15.62:0/209473029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac145840 0x7f75ac0ae030 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f75ac0b97b0 tx=0x7f75a40013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:05.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.980+0000 7f759b7fe700 1 -- 172.21.15.62:0/209473029 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75a4005ae0 con 0x7f75ac145840 2021-12-17T18:28:05.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.980+0000 7f759b7fe700 1 -- 172.21.15.62:0/209473029 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a4005c40 con 0x7f75ac145840 2021-12-17T18:28:05.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.980+0000 7f759b7fe700 1 -- 172.21.15.62:0/209473029 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75a40070d0 con 0x7f75ac145840 2021-12-17T18:28:05.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.980+0000 7f75ab59e700 1 -- 172.21.15.62:0/209473029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ac152370 con 0x7f75ac145840 2021-12-17T18:28:05.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.980+0000 7f75ab59e700 1 -- 172.21.15.62:0/209473029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ac152890 con 0x7f75ac145840 2021-12-17T18:28:05.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.980+0000 7f75ab59e700 1 -- 172.21.15.62:0/209473029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ac0af770 con 0x7f75ac145840 2021-12-17T18:28:05.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.980+0000 7f759b7fe700 1 -- 172.21.15.62:0/209473029 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f75a4010070 con 0x7f75ac145840 2021-12-17T18:28:05.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.980+0000 7f759b7fe700 1 --2- 172.21.15.62:0/209473029 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75880535b0 0x7f7588055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:05.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.980+0000 7f759b7fe700 1 -- 172.21.15.62:0/209473029 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f75a406aeb0 con 0x7f75ac145840 2021-12-17T18:28:05.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.980+0000 7f75aa59c700 1 --2- 172.21.15.62:0/209473029 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75880535b0 0x7f7588055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:05.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.984+0000 7f75aa59c700 1 --2- 172.21.15.62:0/209473029 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75880535b0 0x7f7588055a70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f759c008000 tx=0x7f759c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:05.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:05.988+0000 7f759b7fe700 1 -- 172.21.15.62:0/209473029 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f75a4042340 con 0x7f75ac145840 2021-12-17T18:28:06.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.116+0000 7f75ab59e700 1 -- 172.21.15.62:0/209473029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75ac152e20 con 0x7f75ac145840 2021-12-17T18:28:06.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.120+0000 7f759b7fe700 1 -- 172.21.15.62:0/209473029 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+13239 (secure 0 0 0) 0x7f75a4045960 con 0x7f75ac145840 2021-12-17T18:28:06.127 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:06.127 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":147,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:28:05.490277+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:28:06.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.120+0000 7f75ab59e700 1 -- 172.21.15.62:0/209473029 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75880535b0 msgr2=0x7f7588055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.120+0000 7f75ab59e700 1 --2- 172.21.15.62:0/209473029 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75880535b0 0x7f7588055a70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f759c008000 tx=0x7f759c008040).stop 2021-12-17T18:28:06.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.120+0000 7f75ab59e700 1 -- 172.21.15.62:0/209473029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac145840 msgr2=0x7f75ac0ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.120+0000 7f75ab59e700 1 --2- 172.21.15.62:0/209473029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac145840 0x7f75ac0ae030 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f75ac0b97b0 tx=0x7f75a40013a0).stop 2021-12-17T18:28:06.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.120+0000 7f75ab59e700 1 -- 172.21.15.62:0/209473029 shutdown_connections 2021-12-17T18:28:06.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.120+0000 7f75ab59e700 1 --2- 172.21.15.62:0/209473029 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f75880535b0 0x7f7588055a70 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.120+0000 7f75ab59e700 1 --2- 172.21.15.62:0/209473029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac145840 0x7f75ac0ae030 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.120+0000 7f75ab59e700 1 --2- 172.21.15.62:0/209473029 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f75ac0b6c70 0x7f75ac143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.120+0000 7f75ab59e700 1 --2- 172.21.15.62:0/209473029 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f75ac0b5b20 0x7f75ac0afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.120+0000 7f75ab59e700 1 -- 172.21.15.62:0/209473029 >> 172.21.15.62:0/209473029 conn(0x7f75ac05c750 msgr2=0x7f75ac05fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:06.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.124+0000 7f75ab59e700 1 -- 172.21.15.62:0/209473029 shutdown_connections 2021-12-17T18:28:06.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.124+0000 7f75ab59e700 1 -- 172.21.15.62:0/209473029 wait complete. 2021-12-17T18:28:06.140 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-12-17T18:28:06.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:28:06.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.244+0000 7fe383bc5700 1 Processor -- start 2021-12-17T18:28:06.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.244+0000 7fe383bc5700 1 -- start start 2021-12-17T18:28:06.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.244+0000 7fe383bc5700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe37c0b78e0 0x7fe37c0664c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:06.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.244+0000 7fe383bc5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe37c1414e0 0x7fe37c144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:06.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.244+0000 7fe383bc5700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37c0b7cc0 con 0x7fe37c0adc60 2021-12-17T18:28:06.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.244+0000 7fe383bc5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37c1452c0 con 0x7fe37c1414e0 2021-12-17T18:28:06.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.244+0000 7fe383bc5700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37c1443f0 con 0x7fe37c0b78e0 2021-12-17T18:28:06.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.244+0000 7fe382162700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe37c1414e0 0x7fe37c144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:06.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.244+0000 7fe382162700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe37c1414e0 0x7fe37c144dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57180/0 (socket says 172.21.15.62:57180) 2021-12-17T18:28:06.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.244+0000 7fe382162700 1 -- 172.21.15.62:0/2064509723 learned_addr learned my addr 172.21.15.62:0/2064509723 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:06.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.244+0000 7fe381961700 1 --2- 172.21.15.62:0/2064509723 >> v2:172.21.15.109:3300/0 conn(0x7fe37c0b78e0 0x7fe37c0664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:06.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.244+0000 7fe382162700 1 -- 172.21.15.62:0/2064509723 >> v2:172.21.15.109:3300/0 conn(0x7fe37c0b78e0 msgr2=0x7fe37c0664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:06.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.244+0000 7fe382162700 1 --2- 172.21.15.62:0/2064509723 >> v2:172.21.15.109:3300/0 conn(0x7fe37c0b78e0 0x7fe37c0664c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.244+0000 7fe382162700 1 -- 172.21.15.62:0/2064509723 >> v1:172.21.15.109:6789/0 conn(0x7fe37c0adc60 legacy=0x7fe37c140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.244+0000 7fe382162700 1 -- 172.21.15.62:0/2064509723 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c144690 con 0x7fe37c1414e0 2021-12-17T18:28:06.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.244+0000 7fe382162700 1 --2- 172.21.15.62:0/2064509723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c1414e0 0x7fe37c144dd0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7fe374002f70 tx=0x7fe374006eb0).ready entity=mon.0 client_cookie=b7de08d4c4b6565d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:06.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.248+0000 7fe38095f700 1 -- 172.21.15.62:0/2064509723 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37400d5c0 con 0x7fe37c1414e0 2021-12-17T18:28:06.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.248+0000 7fe38095f700 1 -- 172.21.15.62:0/2064509723 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe374000e90 con 0x7fe37c1414e0 2021-12-17T18:28:06.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.248+0000 7fe38095f700 1 -- 172.21.15.62:0/2064509723 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37400d950 con 0x7fe37c1414e0 2021-12-17T18:28:06.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.248+0000 7fe383bc5700 1 -- 172.21.15.62:0/2064509723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c1414e0 msgr2=0x7fe37c144dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.248+0000 7fe383bc5700 1 --2- 172.21.15.62:0/2064509723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c1414e0 0x7fe37c144dd0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7fe374002f70 tx=0x7fe374006eb0).stop 2021-12-17T18:28:06.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.248+0000 7fe383bc5700 1 -- 172.21.15.62:0/2064509723 shutdown_connections 2021-12-17T18:28:06.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.248+0000 7fe383bc5700 1 --2- 172.21.15.62:0/2064509723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c1414e0 0x7fe37c144dd0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.248+0000 7fe383bc5700 1 --2- 172.21.15.62:0/2064509723 >> v2:172.21.15.109:3300/0 conn(0x7fe37c0b78e0 0x7fe37c0664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.248+0000 7fe383bc5700 1 -- 172.21.15.62:0/2064509723 >> 172.21.15.62:0/2064509723 conn(0x7fe37c062510 msgr2=0x7fe37c062920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:06.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.248+0000 7fe383bc5700 1 -- 172.21.15.62:0/2064509723 shutdown_connections 2021-12-17T18:28:06.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.248+0000 7fe383bc5700 1 -- 172.21.15.62:0/2064509723 wait complete. 2021-12-17T18:28:06.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.248+0000 7fe383bc5700 1 Processor -- start 2021-12-17T18:28:06.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe383bc5700 1 -- start start 2021-12-17T18:28:06.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe383bc5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0adc60 0x7fe37c0b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:06.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe383bc5700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe37c0b78e0 0x7fe37c111a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:06.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe383bc5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe37c1414e0 0x7fe37c13d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:06.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe383bc5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c111f70 con 0x7fe37c0adc60 2021-12-17T18:28:06.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe383bc5700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c1121b0 con 0x7fe37c0b78e0 2021-12-17T18:28:06.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe383bc5700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c0b0310 con 0x7fe37c1414e0 2021-12-17T18:28:06.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe381961700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0adc60 0x7fe37c0b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:06.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe381961700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0adc60 0x7fe37c0b1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57182/0 (socket says 172.21.15.62:57182) 2021-12-17T18:28:06.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe381961700 1 -- 172.21.15.62:0/2433005655 learned_addr learned my addr 172.21.15.62:0/2433005655 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:06.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe381160700 1 --2- 172.21.15.62:0/2433005655 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe37c0b78e0 0x7fe37c111a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:06.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe382162700 1 --2- 172.21.15.62:0/2433005655 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe37c1414e0 0x7fe37c13d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:06.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe381961700 1 -- 172.21.15.62:0/2433005655 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe37c1414e0 msgr2=0x7fe37c13d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe381961700 1 --2- 172.21.15.62:0/2433005655 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe37c1414e0 0x7fe37c13d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe381961700 1 -- 172.21.15.62:0/2433005655 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe37c0b78e0 msgr2=0x7fe37c111a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe381961700 1 --2- 172.21.15.62:0/2433005655 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe37c0b78e0 0x7fe37c111a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe381961700 1 -- 172.21.15.62:0/2433005655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37400b1e0 con 0x7fe37c0adc60 2021-12-17T18:28:06.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe381961700 1 --2- 172.21.15.62:0/2433005655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0adc60 0x7fe37c0b1590 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7fe37800c000 tx=0x7fe3780091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:06.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe36affd700 1 -- 172.21.15.62:0/2433005655 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37800c6a0 con 0x7fe37c0adc60 2021-12-17T18:28:06.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe36affd700 1 -- 172.21.15.62:0/2433005655 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37800c800 con 0x7fe37c0adc60 2021-12-17T18:28:06.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe383bc5700 1 -- 172.21.15.62:0/2433005655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37c0af180 con 0x7fe37c0adc60 2021-12-17T18:28:06.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe36affd700 1 -- 172.21.15.62:0/2433005655 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37800cb60 con 0x7fe37c0adc60 2021-12-17T18:28:06.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.252+0000 7fe383bc5700 1 -- 172.21.15.62:0/2433005655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37c0af700 con 0x7fe37c0adc60 2021-12-17T18:28:06.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.256+0000 7fe383bc5700 1 -- 172.21.15.62:0/2433005655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37c144930 con 0x7fe37c0adc60 2021-12-17T18:28:06.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.256+0000 7fe36affd700 1 -- 172.21.15.62:0/2433005655 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe378022070 con 0x7fe37c0adc60 2021-12-17T18:28:06.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.256+0000 7fe36affd700 1 --2- 172.21.15.62:0/2433005655 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe35c0536d0 0x7fe35c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:06.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.256+0000 7fe36affd700 1 -- 172.21.15.62:0/2433005655 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe37806bbd0 con 0x7fe37c0adc60 2021-12-17T18:28:06.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.256+0000 7fe381160700 1 --2- 172.21.15.62:0/2433005655 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe35c0536d0 0x7fe35c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:06.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.256+0000 7fe381160700 1 --2- 172.21.15.62:0/2433005655 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe35c0536d0 0x7fe35c055b90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fe36c00d000 tx=0x7fe36c007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:06.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.264+0000 7fe36affd700 1 -- 172.21.15.62:0/2433005655 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe378043060 con 0x7fe37c0adc60 2021-12-17T18:28:06.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.396+0000 7fe383bc5700 1 -- 172.21.15.62:0/2433005655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe37c0573d0 con 0x7fe37c0adc60 2021-12-17T18:28:06.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.396+0000 7fe36affd700 1 -- 172.21.15.62:0/2433005655 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v147) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe378046680 con 0x7fe37c0adc60 2021-12-17T18:28:06.403 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:28:06.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.396+0000 7fe383bc5700 1 -- 172.21.15.62:0/2433005655 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe35c0536d0 msgr2=0x7fe35c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.396+0000 7fe383bc5700 1 --2- 172.21.15.62:0/2433005655 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe35c0536d0 0x7fe35c055b90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fe36c00d000 tx=0x7fe36c007b90).stop 2021-12-17T18:28:06.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.396+0000 7fe383bc5700 1 -- 172.21.15.62:0/2433005655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0adc60 msgr2=0x7fe37c0b1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.396+0000 7fe383bc5700 1 --2- 172.21.15.62:0/2433005655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0adc60 0x7fe37c0b1590 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7fe37800c000 tx=0x7fe3780091d0).stop 2021-12-17T18:28:06.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.396+0000 7fe383bc5700 1 -- 172.21.15.62:0/2433005655 shutdown_connections 2021-12-17T18:28:06.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.396+0000 7fe383bc5700 1 --2- 172.21.15.62:0/2433005655 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe35c0536d0 0x7fe35c055b90 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.396+0000 7fe383bc5700 1 --2- 172.21.15.62:0/2433005655 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe37c1414e0 0x7fe37c13d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.396+0000 7fe383bc5700 1 --2- 172.21.15.62:0/2433005655 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe37c0b78e0 0x7fe37c111a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.396+0000 7fe383bc5700 1 --2- 172.21.15.62:0/2433005655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0adc60 0x7fe37c0b1590 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.396+0000 7fe383bc5700 1 -- 172.21.15.62:0/2433005655 >> 172.21.15.62:0/2433005655 conn(0x7fe37c062510 msgr2=0x7fe37c13eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:06.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.396+0000 7fe383bc5700 1 -- 172.21.15.62:0/2433005655 shutdown_connections 2021-12-17T18:28:06.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.396+0000 7fe383bc5700 1 -- 172.21.15.62:0/2433005655 wait complete. 2021-12-17T18:28:06.415 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:28:06.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a762d700 1 Processor -- start 2021-12-17T18:28:06.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a762d700 1 -- start start 2021-12-17T18:28:06.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a762d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f38a00b0440 0x7f38a00adad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:06.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a762d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a00adfc0 con 0x7f38a0139960 2021-12-17T18:28:06.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a762d700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a00b01e0 con 0x7f38a00b2330 2021-12-17T18:28:06.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a762d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a00b2e20 con 0x7f38a00b0440 2021-12-17T18:28:06.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a4bc8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f38a00b0440 0x7f38a00adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:06.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a5bca700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f38a0139960 0x7f38a013fc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40774/0 (socket says 172.21.15.62:40774) 2021-12-17T18:28:06.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a4bc8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f38a00b0440 0x7f38a00adad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57190/0 (socket says 172.21.15.62:57190) 2021-12-17T18:28:06.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a5bca700 1 -- 172.21.15.62:0/4881701 learned_addr learned my addr 172.21.15.62:0/4881701 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:06.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a4bc8700 1 -- 172.21.15.62:0/4881701 >> v1:172.21.15.109:6789/0 conn(0x7f38a00b2330 legacy=0x7f38a00b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a4bc8700 1 -- 172.21.15.62:0/4881701 >> v1:172.21.15.62:6789/0 conn(0x7f38a0139960 legacy=0x7f38a013fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f3897fff700 1 -- 172.21.15.62:0/4881701 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033527699 0 0) 0x7f38a00b01e0 con 0x7f38a00b2330 2021-12-17T18:28:06.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a4bc8700 1 -- 172.21.15.62:0/4881701 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a00b1760 con 0x7f38a00b0440 2021-12-17T18:28:06.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a4bc8700 1 --2- 172.21.15.62:0/4881701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38a00b0440 0x7f38a00adad0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f3898001490 tx=0x7f389c006df0).ready entity=mon.0 client_cookie=7e379d0b71721189 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:06.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f3897fff700 1 -- 172.21.15.62:0/4881701 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f389c00d5c0 con 0x7f38a00b0440 2021-12-17T18:28:06.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f3897fff700 1 -- 172.21.15.62:0/4881701 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c000e90 con 0x7f38a00b0440 2021-12-17T18:28:06.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f3897fff700 1 -- 172.21.15.62:0/4881701 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f389c00d910 con 0x7f38a00b0440 2021-12-17T18:28:06.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a762d700 1 -- 172.21.15.62:0/4881701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38a00b0440 msgr2=0x7f38a00adad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a762d700 1 --2- 172.21.15.62:0/4881701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38a00b0440 0x7f38a00adad0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f3898001490 tx=0x7f389c006df0).stop 2021-12-17T18:28:06.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a762d700 1 -- 172.21.15.62:0/4881701 shutdown_connections 2021-12-17T18:28:06.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a762d700 1 --2- 172.21.15.62:0/4881701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38a00b0440 0x7f38a00adad0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a762d700 1 -- 172.21.15.62:0/4881701 >> 172.21.15.62:0/4881701 conn(0x7f38a00b64d0 msgr2=0x7f38a00b68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:06.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a762d700 1 -- 172.21.15.62:0/4881701 shutdown_connections 2021-12-17T18:28:06.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.516+0000 7f38a762d700 1 -- 172.21.15.62:0/4881701 wait complete. 2021-12-17T18:28:06.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a762d700 1 Processor -- start 2021-12-17T18:28:06.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a762d700 1 -- start start 2021-12-17T18:28:06.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a762d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38a00b0440 0x7f38a013c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:06.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a762d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38a00b2330 0x7f38a01309b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:06.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a762d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38a0139960 0x7f38a0130ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:06.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a762d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a0137460 con 0x7f38a00b0440 2021-12-17T18:28:06.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a762d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a01382d0 con 0x7f38a00b2330 2021-12-17T18:28:06.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a762d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a013e3d0 con 0x7f38a0139960 2021-12-17T18:28:06.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a53c9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38a00b0440 0x7f38a013c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:06.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a53c9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38a00b0440 0x7f38a013c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57196/0 (socket says 172.21.15.62:57196) 2021-12-17T18:28:06.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a53c9700 1 -- 172.21.15.62:0/980362613 learned_addr learned my addr 172.21.15.62:0/980362613 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:06.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a4bc8700 1 --2- 172.21.15.62:0/980362613 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38a00b2330 0x7f38a01309b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:06.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a5bca700 1 --2- 172.21.15.62:0/980362613 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38a0139960 0x7f38a0130ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:06.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a53c9700 1 -- 172.21.15.62:0/980362613 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38a0139960 msgr2=0x7f38a0130ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a53c9700 1 --2- 172.21.15.62:0/980362613 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38a0139960 0x7f38a0130ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a53c9700 1 -- 172.21.15.62:0/980362613 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38a00b2330 msgr2=0x7f38a01309b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a53c9700 1 --2- 172.21.15.62:0/980362613 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38a00b2330 0x7f38a01309b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a53c9700 1 -- 172.21.15.62:0/980362613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389c00b180 con 0x7f38a00b0440 2021-12-17T18:28:06.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a4bc8700 1 --2- 172.21.15.62:0/980362613 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38a00b2330 0x7f38a01309b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:28:06.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a5bca700 1 --2- 172.21.15.62:0/980362613 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38a0139960 0x7f38a0130ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:28:06.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a53c9700 1 --2- 172.21.15.62:0/980362613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38a00b0440 0x7f38a013c7b0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f3890000ed0 tx=0x7f3890007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:06.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38967fc700 1 -- 172.21.15.62:0/980362613 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f389000ce20 con 0x7f38a00b0440 2021-12-17T18:28:06.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38967fc700 1 -- 172.21.15.62:0/980362613 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389000f470 con 0x7f38a00b0440 2021-12-17T18:28:06.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a762d700 1 -- 172.21.15.62:0/980362613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a0138770 con 0x7f38a00b0440 2021-12-17T18:28:06.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38967fc700 1 -- 172.21.15.62:0/980362613 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f389000f810 con 0x7f38a00b0440 2021-12-17T18:28:06.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.520+0000 7f38a762d700 1 -- 172.21.15.62:0/980362613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a0136fc0 con 0x7f38a00b0440 2021-12-17T18:28:06.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.524+0000 7f38a762d700 1 -- 172.21.15.62:0/980362613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a0137660 con 0x7f38a00b0440 2021-12-17T18:28:06.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.524+0000 7f38967fc700 1 -- 172.21.15.62:0/980362613 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3890019030 con 0x7f38a00b0440 2021-12-17T18:28:06.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.524+0000 7f38967fc700 1 --2- 172.21.15.62:0/980362613 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3888053580 0x7f3888055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:06.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.524+0000 7f38967fc700 1 -- 172.21.15.62:0/980362613 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f389006a960 con 0x7f38a00b0440 2021-12-17T18:28:06.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.524+0000 7f38a4bc8700 1 --2- 172.21.15.62:0/980362613 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3888053580 0x7f3888055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:06.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.524+0000 7f38a4bc8700 1 --2- 172.21.15.62:0/980362613 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3888053580 0x7f3888055a40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f389c018000 tx=0x7f389c014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:06.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.528+0000 7f38967fc700 1 -- 172.21.15.62:0/980362613 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3890041ea0 con 0x7f38a00b0440 2021-12-17T18:28:06.661 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.656+0000 7f38a762d700 1 -- 172.21.15.62:0/980362613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f38a0138490 con 0x7f38a00b0440 2021-12-17T18:28:06.663 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.656+0000 7f38967fc700 1 -- 172.21.15.62:0/980362613 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v147) v1 ==== 92+0+10 (secure 0 0 0) 0x7f38900454c0 con 0x7f38a00b0440 2021-12-17T18:28:06.663 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:28:06.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.656+0000 7f38a762d700 1 -- 172.21.15.62:0/980362613 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3888053580 msgr2=0x7f3888055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.656+0000 7f38a762d700 1 --2- 172.21.15.62:0/980362613 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3888053580 0x7f3888055a40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f389c018000 tx=0x7f389c014000).stop 2021-12-17T18:28:06.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.656+0000 7f38a762d700 1 -- 172.21.15.62:0/980362613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38a00b0440 msgr2=0x7f38a013c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.667 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.656+0000 7f38a762d700 1 --2- 172.21.15.62:0/980362613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38a00b0440 0x7f38a013c7b0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f3890000ed0 tx=0x7f3890007ac0).stop 2021-12-17T18:28:06.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.656+0000 7f38a762d700 1 -- 172.21.15.62:0/980362613 shutdown_connections 2021-12-17T18:28:06.668 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.656+0000 7f38a762d700 1 --2- 172.21.15.62:0/980362613 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3888053580 0x7f3888055a40 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.656+0000 7f38a762d700 1 --2- 172.21.15.62:0/980362613 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38a0139960 0x7f38a0130ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.669 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.656+0000 7f38a762d700 1 --2- 172.21.15.62:0/980362613 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38a00b2330 0x7f38a01309b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.656+0000 7f38a762d700 1 --2- 172.21.15.62:0/980362613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38a00b0440 0x7f38a013c7b0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.656+0000 7f38a762d700 1 -- 172.21.15.62:0/980362613 >> 172.21.15.62:0/980362613 conn(0x7f38a00b64d0 msgr2=0x7f38a00601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:06.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.656+0000 7f38a762d700 1 -- 172.21.15.62:0/980362613 shutdown_connections 2021-12-17T18:28:06.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.656+0000 7f38a762d700 1 -- 172.21.15.62:0/980362613 wait complete. 2021-12-17T18:28:06.675 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-12-17T18:28:06.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c96b43700 1 Processor -- start 2021-12-17T18:28:06.778 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c96b43700 1 -- start start 2021-12-17T18:28:06.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c96b43700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5c90141480 0x7f5c90147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:06.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c96b43700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c900a71e0 0x7f5c900a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:06.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c96b43700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c900b6270 con 0x7f5c900a8e10 2021-12-17T18:28:06.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c96b43700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c90147610 con 0x7f5c90141480 2021-12-17T18:28:06.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c96b43700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c901478b0 con 0x7f5c900a71e0 2021-12-17T18:28:06.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c95b41700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5c90141480 0x7f5c90147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:06.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c95b41700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5c90141480 0x7f5c90147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57204/0 (socket says 172.21.15.62:57204) 2021-12-17T18:28:06.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c95b41700 1 -- 172.21.15.62:0/2524875890 learned_addr learned my addr 172.21.15.62:0/2524875890 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:06.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c96342700 1 --2- 172.21.15.62:0/2524875890 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c900a71e0 0x7f5c900a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:06.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c95b41700 1 -- 172.21.15.62:0/2524875890 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c900a71e0 msgr2=0x7f5c900a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:06.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c95b41700 1 --2- 172.21.15.62:0/2524875890 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c900a71e0 0x7f5c900a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c95b41700 1 -- 172.21.15.62:0/2524875890 >> v1:172.21.15.109:6789/0 conn(0x7f5c900a8e10 legacy=0x7f5c900b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c95b41700 1 -- 172.21.15.62:0/2524875890 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c90147b50 con 0x7f5c90141480 2021-12-17T18:28:06.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c95b41700 1 --2- 172.21.15.62:0/2524875890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c90141480 0x7f5c90147ff0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f5c84002f70 tx=0x7f5c84006eb0).ready entity=mon.0 client_cookie=cb1df6a98be56a55 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:06.783 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c94b3f700 1 -- 172.21.15.62:0/2524875890 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c8400d5c0 con 0x7f5c90141480 2021-12-17T18:28:06.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c94b3f700 1 -- 172.21.15.62:0/2524875890 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c84000e90 con 0x7f5c90141480 2021-12-17T18:28:06.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c94b3f700 1 -- 172.21.15.62:0/2524875890 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c8400d950 con 0x7f5c90141480 2021-12-17T18:28:06.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c96b43700 1 -- 172.21.15.62:0/2524875890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c90141480 msgr2=0x7f5c90147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c96b43700 1 --2- 172.21.15.62:0/2524875890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c90141480 0x7f5c90147ff0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f5c84002f70 tx=0x7f5c84006eb0).stop 2021-12-17T18:28:06.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c96b43700 1 -- 172.21.15.62:0/2524875890 shutdown_connections 2021-12-17T18:28:06.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.772+0000 7f5c96b43700 1 --2- 172.21.15.62:0/2524875890 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c900a71e0 0x7f5c900a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.776+0000 7f5c96b43700 1 --2- 172.21.15.62:0/2524875890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c90141480 0x7f5c90147ff0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.776+0000 7f5c96b43700 1 -- 172.21.15.62:0/2524875890 >> 172.21.15.62:0/2524875890 conn(0x7f5c9005d220 msgr2=0x7f5c900b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:06.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.776+0000 7f5c96b43700 1 -- 172.21.15.62:0/2524875890 shutdown_connections 2021-12-17T18:28:06.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.776+0000 7f5c96b43700 1 -- 172.21.15.62:0/2524875890 wait complete. 2021-12-17T18:28:06.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.776+0000 7f5c96b43700 1 Processor -- start 2021-12-17T18:28:06.789 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.776+0000 7f5c96b43700 1 -- start start 2021-12-17T18:28:06.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.776+0000 7f5c96b43700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c900a71e0 0x7f5c90149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:06.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.776+0000 7f5c96b43700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c900a8e10 0x7f5c9013ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:06.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.776+0000 7f5c96b43700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c90141480 0x7f5c9013bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:06.790 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c96b43700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c900af070 con 0x7f5c900a71e0 2021-12-17T18:28:06.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c96b43700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9013c3e0 con 0x7f5c90141480 2021-12-17T18:28:06.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c96b43700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c900af2a0 con 0x7f5c900a8e10 2021-12-17T18:28:06.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c95b41700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c900a71e0 0x7f5c90149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:06.791 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c95b41700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c900a71e0 0x7f5c90149000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57210/0 (socket says 172.21.15.62:57210) 2021-12-17T18:28:06.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c95b41700 1 -- 172.21.15.62:0/1739178407 learned_addr learned my addr 172.21.15.62:0/1739178407 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:06.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c96342700 1 --2- 172.21.15.62:0/1739178407 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c90141480 0x7f5c9013bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:06.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c95340700 1 --2- 172.21.15.62:0/1739178407 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c900a8e10 0x7f5c9013ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:06.792 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c95b41700 1 -- 172.21.15.62:0/1739178407 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c900a8e10 msgr2=0x7f5c9013ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c95b41700 1 --2- 172.21.15.62:0/1739178407 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c900a8e10 0x7f5c9013ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c95b41700 1 -- 172.21.15.62:0/1739178407 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c90141480 msgr2=0x7f5c9013bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c95b41700 1 --2- 172.21.15.62:0/1739178407 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c90141480 0x7f5c9013bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c95b41700 1 -- 172.21.15.62:0/1739178407 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8400b1e0 con 0x7f5c900a71e0 2021-12-17T18:28:06.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c95340700 1 --2- 172.21.15.62:0/1739178407 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c900a8e10 0x7f5c9013ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:28:06.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c95b41700 1 --2- 172.21.15.62:0/1739178407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c900a71e0 0x7f5c90149000 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f5c84002f70 tx=0x7f5c84015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:06.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c8effd700 1 -- 172.21.15.62:0/1739178407 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c840117e0 con 0x7f5c900a71e0 2021-12-17T18:28:06.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c8effd700 1 -- 172.21.15.62:0/1739178407 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c84011940 con 0x7f5c900a71e0 2021-12-17T18:28:06.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c96b43700 1 -- 172.21.15.62:0/1739178407 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c901571f0 con 0x7f5c900a71e0 2021-12-17T18:28:06.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c8effd700 1 -- 172.21.15.62:0/1739178407 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c84011ca0 con 0x7f5c900a71e0 2021-12-17T18:28:06.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c96b43700 1 -- 172.21.15.62:0/1739178407 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c900ac7c0 con 0x7f5c900a71e0 2021-12-17T18:28:06.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.780+0000 7f5c96b43700 1 -- 172.21.15.62:0/1739178407 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c9014a430 con 0x7f5c900a71e0 2021-12-17T18:28:06.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.784+0000 7f5c8effd700 1 -- 172.21.15.62:0/1739178407 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5c84025030 con 0x7f5c900a71e0 2021-12-17T18:28:06.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.784+0000 7f5c8effd700 1 --2- 172.21.15.62:0/1739178407 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c70053610 0x7f5c70055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:06.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.784+0000 7f5c8effd700 1 -- 172.21.15.62:0/1739178407 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5c8406c8c0 con 0x7f5c900a71e0 2021-12-17T18:28:06.796 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.784+0000 7f5c95340700 1 --2- 172.21.15.62:0/1739178407 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c70053610 0x7f5c70055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:06.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.784+0000 7f5c95340700 1 --2- 172.21.15.62:0/1739178407 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c70053610 0x7f5c70055ad0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f5c8800b000 tx=0x7f5c88009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:06.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.788+0000 7f5c8effd700 1 -- 172.21.15.62:0/1739178407 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5c9014a430 con 0x7f5c900a71e0 2021-12-17T18:28:06.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.916+0000 7f5c96b43700 1 -- 172.21.15.62:0/1739178407 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5c9014a430 con 0x7f5c900a71e0 2021-12-17T18:28:06.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.916+0000 7f5c8effd700 1 -- 172.21.15.62:0/1739178407 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v147) v1 ==== 84+0+143 (secure 0 0 0) 0x7f5c9014a430 con 0x7f5c900a71e0 2021-12-17T18:28:06.923 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:06.923 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2021-12-17T18:28:06.924 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:06.924 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2021-12-17T18:28:06.924 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "device_health_metrics" 2021-12-17T18:28:06.924 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:06.925 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:06.925 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2021-12-17T18:28:06.926 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2021-12-17T18:28:06.926 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:06.927 INFO:teuthology.orchestra.run.smithi062.stdout:] 2021-12-17T18:28:06.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.916+0000 7f5c96b43700 1 -- 172.21.15.62:0/1739178407 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c70053610 msgr2=0x7f5c70055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.916+0000 7f5c96b43700 1 --2- 172.21.15.62:0/1739178407 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c70053610 0x7f5c70055ad0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f5c8800b000 tx=0x7f5c88009040).stop 2021-12-17T18:28:06.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.916+0000 7f5c96b43700 1 -- 172.21.15.62:0/1739178407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c900a71e0 msgr2=0x7f5c90149000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:06.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.916+0000 7f5c96b43700 1 --2- 172.21.15.62:0/1739178407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c900a71e0 0x7f5c90149000 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f5c84002f70 tx=0x7f5c84015000).stop 2021-12-17T18:28:06.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.916+0000 7f5c96b43700 1 -- 172.21.15.62:0/1739178407 shutdown_connections 2021-12-17T18:28:06.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.916+0000 7f5c96b43700 1 --2- 172.21.15.62:0/1739178407 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5c70053610 0x7f5c70055ad0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.916+0000 7f5c96b43700 1 --2- 172.21.15.62:0/1739178407 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5c90141480 0x7f5c9013bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.916+0000 7f5c96b43700 1 --2- 172.21.15.62:0/1739178407 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5c900a8e10 0x7f5c9013ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.916+0000 7f5c96b43700 1 --2- 172.21.15.62:0/1739178407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c900a71e0 0x7f5c90149000 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:06.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.916+0000 7f5c96b43700 1 -- 172.21.15.62:0/1739178407 >> 172.21.15.62:0/1739178407 conn(0x7f5c9005d220 msgr2=0x7f5c9005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:06.930 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.916+0000 7f5c96b43700 1 -- 172.21.15.62:0/1739178407 shutdown_connections 2021-12-17T18:28:06.931 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:06.916+0000 7f5c96b43700 1 -- 172.21.15.62:0/1739178407 wait complete. 2021-12-17T18:28:06.935 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-12-17T18:28:06.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-12-17T18:28:07.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.036+0000 7fb25703c700 1 Processor -- start 2021-12-17T18:28:07.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.036+0000 7fb25703c700 1 -- start start 2021-12-17T18:28:07.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb25703c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fb250063880 0x7fb2500b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:07.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb25703c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb250143610 0x7fb250143a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:07.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb25703c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb250063c60 con 0x7fb2500b0f20 2021-12-17T18:28:07.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb25703c700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2500b3e90 con 0x7fb250063880 2021-12-17T18:28:07.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb25703c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500b1430 con 0x7fb250143610 2021-12-17T18:28:07.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb247fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb2500b0f20 0x7fb2500aba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40800/0 (socket says 172.21.15.62:40800) 2021-12-17T18:28:07.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb247fff700 1 -- 172.21.15.62:0/1333949179 learned_addr learned my addr 172.21.15.62:0/1333949179 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:07.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb2555d9700 1 --2- 172.21.15.62:0/1333949179 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb250143610 0x7fb250143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:07.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb254dd8700 1 --2- 172.21.15.62:0/1333949179 >> v2:172.21.15.109:3300/0 conn(0x7fb250063880 0x7fb2500b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:07.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb2477fe700 1 -- 172.21.15.62:0/1333949179 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419633052 0 0) 0x7fb250063c60 con 0x7fb2500b0f20 2021-12-17T18:28:07.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb2477fe700 1 -- 172.21.15.62:0/1333949179 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb23c003260 con 0x7fb2500b0f20 2021-12-17T18:28:07.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb2555d9700 1 -- 172.21.15.62:0/1333949179 >> v2:172.21.15.109:3300/0 conn(0x7fb250063880 msgr2=0x7fb2500b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:07.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb2555d9700 1 --2- 172.21.15.62:0/1333949179 >> v2:172.21.15.109:3300/0 conn(0x7fb250063880 0x7fb2500b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:07.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb2555d9700 1 -- 172.21.15.62:0/1333949179 >> v1:172.21.15.62:6789/0 conn(0x7fb2500b0f20 legacy=0x7fb2500aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:07.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb2555d9700 1 -- 172.21.15.62:0/1333949179 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2500ab5a0 con 0x7fb250143610 2021-12-17T18:28:07.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb2555d9700 1 --2- 172.21.15.62:0/1333949179 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb250143610 0x7fb250143a70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fb2480032f0 tx=0x7fb2480091d0).ready entity=mon.2 client_cookie=6ab8587d2e9340d8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:07.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb2477fe700 1 -- 172.21.15.62:0/1333949179 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb24800b600 con 0x7fb250143610 2021-12-17T18:28:07.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb2477fe700 1 -- 172.21.15.62:0/1333949179 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24800b760 con 0x7fb250143610 2021-12-17T18:28:07.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb2477fe700 1 -- 172.21.15.62:0/1333949179 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb24800b8d0 con 0x7fb250143610 2021-12-17T18:28:07.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb25703c700 1 -- 172.21.15.62:0/1333949179 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb250143610 msgr2=0x7fb250143a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:07.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb25703c700 1 --2- 172.21.15.62:0/1333949179 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb250143610 0x7fb250143a70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fb2480032f0 tx=0x7fb2480091d0).stop 2021-12-17T18:28:07.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb25703c700 1 -- 172.21.15.62:0/1333949179 shutdown_connections 2021-12-17T18:28:07.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb25703c700 1 --2- 172.21.15.62:0/1333949179 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb250143610 0x7fb250143a70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:07.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb25703c700 1 --2- 172.21.15.62:0/1333949179 >> v2:172.21.15.109:3300/0 conn(0x7fb250063880 0x7fb2500b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:07.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb25703c700 1 -- 172.21.15.62:0/1333949179 >> 172.21.15.62:0/1333949179 conn(0x7fb2500625b0 msgr2=0x7fb250062990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:07.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb25703c700 1 -- 172.21.15.62:0/1333949179 shutdown_connections 2021-12-17T18:28:07.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.040+0000 7fb25703c700 1 -- 172.21.15.62:0/1333949179 wait complete. 2021-12-17T18:28:07.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb25703c700 1 Processor -- start 2021-12-17T18:28:07.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb25703c700 1 -- start start 2021-12-17T18:28:07.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb25703c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb250063880 0x7fb250066f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:07.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb25703c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2500b0f20 0x7fb25013d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:07.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb25703c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb250143610 0x7fb25013d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:07.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb25703c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb250152a60 con 0x7fb2500b0f20 2021-12-17T18:28:07.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb25703c700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb250153380 con 0x7fb250063880 2021-12-17T18:28:07.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb25703c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb250152c80 con 0x7fb250143610 2021-12-17T18:28:07.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb247fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2500b0f20 0x7fb25013d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:07.061 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb247fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2500b0f20 0x7fb25013d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57226/0 (socket says 172.21.15.62:57226) 2021-12-17T18:28:07.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb247fff700 1 -- 172.21.15.62:0/3557227469 learned_addr learned my addr 172.21.15.62:0/3557227469 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:07.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb2555d9700 1 --2- 172.21.15.62:0/3557227469 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb250143610 0x7fb25013d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:07.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb254dd8700 1 --2- 172.21.15.62:0/3557227469 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb250063880 0x7fb250066f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:07.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb247fff700 1 -- 172.21.15.62:0/3557227469 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb250143610 msgr2=0x7fb25013d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:07.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb247fff700 1 --2- 172.21.15.62:0/3557227469 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb250143610 0x7fb25013d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:07.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb247fff700 1 -- 172.21.15.62:0/3557227469 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb250063880 msgr2=0x7fb250066f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:07.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb247fff700 1 --2- 172.21.15.62:0/3557227469 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb250063880 0x7fb250066f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:07.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.044+0000 7fb247fff700 1 -- 172.21.15.62:0/3557227469 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb248009470 con 0x7fb2500b0f20 2021-12-17T18:28:07.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.048+0000 7fb247fff700 1 --2- 172.21.15.62:0/3557227469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2500b0f20 0x7fb25013d3c0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7fb2501534c0 tx=0x7fb240007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:07.064 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.048+0000 7fb245ffb700 1 -- 172.21.15.62:0/3557227469 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb24000ce10 con 0x7fb2500b0f20 2021-12-17T18:28:07.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.048+0000 7fb245ffb700 1 -- 172.21.15.62:0/3557227469 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2400072e0 con 0x7fb2500b0f20 2021-12-17T18:28:07.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.048+0000 7fb25703c700 1 -- 172.21.15.62:0/3557227469 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb250152ee0 con 0x7fb2500b0f20 2021-12-17T18:28:07.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.048+0000 7fb245ffb700 1 -- 172.21.15.62:0/3557227469 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb240005800 con 0x7fb2500b0f20 2021-12-17T18:28:07.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.048+0000 7fb25703c700 1 -- 172.21.15.62:0/3557227469 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2500b45f0 con 0x7fb2500b0f20 2021-12-17T18:28:07.065 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.048+0000 7fb25703c700 1 -- 172.21.15.62:0/3557227469 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2500573d0 con 0x7fb2500b0f20 2021-12-17T18:28:07.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.048+0000 7fb245ffb700 1 -- 172.21.15.62:0/3557227469 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb240010070 con 0x7fb2500b0f20 2021-12-17T18:28:07.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.048+0000 7fb245ffb700 1 --2- 172.21.15.62:0/3557227469 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2300534f0 0x7fb2300559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:07.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.048+0000 7fb245ffb700 1 -- 172.21.15.62:0/3557227469 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb24006ac90 con 0x7fb2500b0f20 2021-12-17T18:28:07.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.048+0000 7fb254dd8700 1 --2- 172.21.15.62:0/3557227469 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2300534f0 0x7fb2300559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:07.067 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.052+0000 7fb254dd8700 1 --2- 172.21.15.62:0/3557227469 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2300534f0 0x7fb2300559b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fb24c00b000 tx=0x7fb24c006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:07.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.052+0000 7fb245ffb700 1 -- 172.21.15.62:0/3557227469 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb240042120 con 0x7fb2500b0f20 2021-12-17T18:28:07.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:07.176+0000 7fb25703c700 1 -- 172.21.15.62:0/3557227469 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fb250060ec0 con 0x7fb2500b0f20 2021-12-17T18:28:08.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.128+0000 7fb245ffb700 1 -- 172.21.15.62:0/3557227469 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v148) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb240045740 con 0x7fb2500b0f20 2021-12-17T18:28:08.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.132+0000 7fb25703c700 1 -- 172.21.15.62:0/3557227469 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2300534f0 msgr2=0x7fb2300559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:08.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.132+0000 7fb25703c700 1 --2- 172.21.15.62:0/3557227469 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2300534f0 0x7fb2300559b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fb24c00b000 tx=0x7fb24c006df0).stop 2021-12-17T18:28:08.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.132+0000 7fb25703c700 1 -- 172.21.15.62:0/3557227469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2500b0f20 msgr2=0x7fb25013d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:08.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.132+0000 7fb25703c700 1 --2- 172.21.15.62:0/3557227469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2500b0f20 0x7fb25013d3c0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7fb2501534c0 tx=0x7fb240007ad0).stop 2021-12-17T18:28:08.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.132+0000 7fb25703c700 1 -- 172.21.15.62:0/3557227469 shutdown_connections 2021-12-17T18:28:08.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.132+0000 7fb25703c700 1 --2- 172.21.15.62:0/3557227469 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb2300534f0 0x7fb2300559b0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:08.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.132+0000 7fb25703c700 1 --2- 172.21.15.62:0/3557227469 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb250143610 0x7fb25013d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:08.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.132+0000 7fb25703c700 1 --2- 172.21.15.62:0/3557227469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2500b0f20 0x7fb25013d3c0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:08.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.132+0000 7fb25703c700 1 --2- 172.21.15.62:0/3557227469 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb250063880 0x7fb250066f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:08.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.132+0000 7fb25703c700 1 -- 172.21.15.62:0/3557227469 >> 172.21.15.62:0/3557227469 conn(0x7fb2500625b0 msgr2=0x7fb25005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:08.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.132+0000 7fb25703c700 1 -- 172.21.15.62:0/3557227469 shutdown_connections 2021-12-17T18:28:08.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.132+0000 7fb25703c700 1 -- 172.21.15.62:0/3557227469 wait complete. 2021-12-17T18:28:08.145 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2021-12-17T18:28:08.153 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-12-17T18:28:08.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.256+0000 7f4f51db0700 1 Processor -- start 2021-12-17T18:28:08.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.256+0000 7f4f51db0700 1 -- start start 2021-12-17T18:28:08.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.256+0000 7f4f51db0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f4c0b4e80 0x7f4f4c0b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:08.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.256+0000 7f4f51db0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4c05ce70 con 0x7f4f4c05ca90 2021-12-17T18:28:08.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.256+0000 7f4f51db0700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4c0605d0 con 0x7f4f4c143f60 2021-12-17T18:28:08.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.256+0000 7f4f51db0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0b5400 con 0x7f4f4c0b4e80 2021-12-17T18:28:08.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.256+0000 7f4f4b7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4f4c05ca90 0x7f4f4c143850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40812/0 (socket says 172.21.15.62:40812) 2021-12-17T18:28:08.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.256+0000 7f4f4b7fe700 1 -- 172.21.15.62:0/3856605874 learned_addr learned my addr 172.21.15.62:0/3856605874 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:08.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.256+0000 7f4f4bfff700 1 --2- 172.21.15.62:0/3856605874 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f4c0b4e80 0x7f4f4c0b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:08.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.256+0000 7f4f4a7fc700 1 -- 172.21.15.62:0/3856605874 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593367299 0 0) 0x7f4f4c0605d0 con 0x7f4f4c143f60 2021-12-17T18:28:08.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.256+0000 7f4f4a7fc700 1 -- 172.21.15.62:0/3856605874 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f38003260 con 0x7f4f4c143f60 2021-12-17T18:28:08.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.256+0000 7f4f4a7fc700 1 -- 172.21.15.62:0/3856605874 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090728161 0 0) 0x7f4f4c05ce70 con 0x7f4f4c05ca90 2021-12-17T18:28:08.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.256+0000 7f4f4bfff700 1 -- 172.21.15.62:0/3856605874 >> v1:172.21.15.109:6789/0 conn(0x7f4f4c143f60 legacy=0x7f4f4c142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:08.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.256+0000 7f4f4bfff700 1 -- 172.21.15.62:0/3856605874 >> v1:172.21.15.62:6789/0 conn(0x7f4f4c05ca90 legacy=0x7f4f4c143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:08.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.256+0000 7f4f4bfff700 1 -- 172.21.15.62:0/3856605874 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c1433b0 con 0x7f4f4c0b4e80 2021-12-17T18:28:08.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.256+0000 7f4f4bfff700 1 --2- 172.21.15.62:0/3856605874 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f4c0b4e80 0x7f4f4c0b5b30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f4f40002f70 tx=0x7f4f40006df0).ready entity=mon.2 client_cookie=999bcdbda1541c08 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:08.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.260+0000 7f4f4a7fc700 1 -- 172.21.15.62:0/3856605874 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f4000d570 con 0x7f4f4c0b4e80 2021-12-17T18:28:08.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.260+0000 7f4f4a7fc700 1 -- 172.21.15.62:0/3856605874 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f40000e90 con 0x7f4f4c0b4e80 2021-12-17T18:28:08.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.260+0000 7f4f4a7fc700 1 -- 172.21.15.62:0/3856605874 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f4000d8c0 con 0x7f4f4c0b4e80 2021-12-17T18:28:08.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.260+0000 7f4f51db0700 1 -- 172.21.15.62:0/3856605874 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f4c0b4e80 msgr2=0x7f4f4c0b5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:08.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.260+0000 7f4f51db0700 1 --2- 172.21.15.62:0/3856605874 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f4c0b4e80 0x7f4f4c0b5b30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f4f40002f70 tx=0x7f4f40006df0).stop 2021-12-17T18:28:08.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.260+0000 7f4f51db0700 1 -- 172.21.15.62:0/3856605874 shutdown_connections 2021-12-17T18:28:08.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.260+0000 7f4f51db0700 1 --2- 172.21.15.62:0/3856605874 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f4c0b4e80 0x7f4f4c0b5b30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:08.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.260+0000 7f4f51db0700 1 -- 172.21.15.62:0/3856605874 >> 172.21.15.62:0/3856605874 conn(0x7f4f4c062430 msgr2=0x7f4f4c062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:08.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.260+0000 7f4f51db0700 1 -- 172.21.15.62:0/3856605874 shutdown_connections 2021-12-17T18:28:08.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.260+0000 7f4f51db0700 1 -- 172.21.15.62:0/3856605874 wait complete. 2021-12-17T18:28:08.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f51db0700 1 Processor -- start 2021-12-17T18:28:08.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f51db0700 1 -- start start 2021-12-17T18:28:08.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f51db0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f4c05ca90 0x7f4f4c0b84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:08.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f51db0700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f4c0b4e80 0x7f4f4c063490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:08.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f51db0700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f4c143f60 0x7f4f4c063980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:08.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f51db0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c066de0 con 0x7f4f4c05ca90 2021-12-17T18:28:08.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f51db0700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c065b20 con 0x7f4f4c0b4e80 2021-12-17T18:28:08.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f51db0700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c065d80 con 0x7f4f4c143f60 2021-12-17T18:28:08.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f4b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f4c05ca90 0x7f4f4c0b84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:08.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f4b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f4c05ca90 0x7f4f4c0b84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57238/0 (socket says 172.21.15.62:57238) 2021-12-17T18:28:08.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f4b7fe700 1 -- 172.21.15.62:0/4253319929 learned_addr learned my addr 172.21.15.62:0/4253319929 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:08.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f4bfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f4c143f60 0x7f4f4c063980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:08.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f4affd700 1 --2- 172.21.15.62:0/4253319929 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f4c0b4e80 0x7f4f4c063490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:08.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f4bfff700 1 -- 172.21.15.62:0/4253319929 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f4c0b4e80 msgr2=0x7f4f4c063490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:08.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f4bfff700 1 --2- 172.21.15.62:0/4253319929 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f4c0b4e80 0x7f4f4c063490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:08.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f4bfff700 1 -- 172.21.15.62:0/4253319929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f4c05ca90 msgr2=0x7f4f4c0b84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:08.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f4bfff700 1 --2- 172.21.15.62:0/4253319929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f4c05ca90 0x7f4f4c0b84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:08.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f4bfff700 1 -- 172.21.15.62:0/4253319929 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4000b180 con 0x7f4f4c143f60 2021-12-17T18:28:08.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f4bfff700 1 --2- 172.21.15.62:0/4253319929 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f4c143f60 0x7f4f4c063980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f4f40002f70 tx=0x7f4f40014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:08.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f48ff9700 1 -- 172.21.15.62:0/4253319929 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f40013da0 con 0x7f4f4c143f60 2021-12-17T18:28:08.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f48ff9700 1 -- 172.21.15.62:0/4253319929 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4000de80 con 0x7f4f4c143f60 2021-12-17T18:28:08.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f51db0700 1 -- 172.21.15.62:0/4253319929 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4c067170 con 0x7f4f4c143f60 2021-12-17T18:28:08.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.264+0000 7f4f48ff9700 1 -- 172.21.15.62:0/4253319929 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f4001e5f0 con 0x7f4f4c143f60 2021-12-17T18:28:08.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.268+0000 7f4f51db0700 1 -- 172.21.15.62:0/4253319929 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4c145b30 con 0x7f4f4c143f60 2021-12-17T18:28:08.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.268+0000 7f4f51db0700 1 -- 172.21.15.62:0/4253319929 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4c0573d0 con 0x7f4f4c143f60 2021-12-17T18:28:08.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.268+0000 7f4f48ff9700 1 -- 172.21.15.62:0/4253319929 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4f40025030 con 0x7f4f4c143f60 2021-12-17T18:28:08.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.268+0000 7f4f48ff9700 1 --2- 172.21.15.62:0/4253319929 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f2c053580 0x7f4f2c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.268+0000 7f4f48ff9700 1 -- 172.21.15.62:0/4253319929 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f4f4006c380 con 0x7f4f4c143f60 2021-12-17T18:28:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.268+0000 7f4f4b7fe700 1 --2- 172.21.15.62:0/4253319929 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f2c053580 0x7f4f2c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.268+0000 7f4f4b7fe700 1 --2- 172.21.15.62:0/4253319929 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f2c053580 0x7f4f2c055a40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f4f4400d000 tx=0x7f4f44007ac0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.276+0000 7f4f48ff9700 1 -- 172.21.15.62:0/4253319929 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4f400436b0 con 0x7f4f4c143f60 2021-12-17T18:28:08.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:08.404+0000 7f4f51db0700 1 -- 172.21.15.62:0/4253319929 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f4f4c060ec0 con 0x7f4f4c143f60 2021-12-17T18:28:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.136+0000 7f4f48ff9700 1 -- 172.21.15.62:0/4253319929 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v149) v1 ==== 125+0+0 (secure 0 0 0) 0x7f4f400230a0 con 0x7f4f4c143f60 2021-12-17T18:28:09.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.140+0000 7f4f51db0700 1 -- 172.21.15.62:0/4253319929 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f2c053580 msgr2=0x7f4f2c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.140+0000 7f4f51db0700 1 --2- 172.21.15.62:0/4253319929 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f2c053580 0x7f4f2c055a40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f4f4400d000 tx=0x7f4f44007ac0).stop 2021-12-17T18:28:09.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.140+0000 7f4f51db0700 1 -- 172.21.15.62:0/4253319929 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f4c143f60 msgr2=0x7f4f4c063980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.140+0000 7f4f51db0700 1 --2- 172.21.15.62:0/4253319929 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f4c143f60 0x7f4f4c063980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f4f40002f70 tx=0x7f4f40014000).stop 2021-12-17T18:28:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.140+0000 7f4f51db0700 1 -- 172.21.15.62:0/4253319929 shutdown_connections 2021-12-17T18:28:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.140+0000 7f4f51db0700 1 --2- 172.21.15.62:0/4253319929 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f4f2c053580 0x7f4f2c055a40 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.140+0000 7f4f51db0700 1 --2- 172.21.15.62:0/4253319929 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f4f4c143f60 0x7f4f4c063980 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.140+0000 7f4f51db0700 1 --2- 172.21.15.62:0/4253319929 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f4f4c0b4e80 0x7f4f4c063490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.140+0000 7f4f51db0700 1 --2- 172.21.15.62:0/4253319929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f4c05ca90 0x7f4f4c0b84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.140+0000 7f4f51db0700 1 -- 172.21.15.62:0/4253319929 >> 172.21.15.62:0/4253319929 conn(0x7f4f4c062430 msgr2=0x7f4f4c146ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:09.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.140+0000 7f4f51db0700 1 -- 172.21.15.62:0/4253319929 shutdown_connections 2021-12-17T18:28:09.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.140+0000 7f4f51db0700 1 -- 172.21.15.62:0/4253319929 wait complete. 2021-12-17T18:28:09.149 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2021-12-17T18:28:09.160 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-12-17T18:28:09.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.260+0000 7f10bb685700 1 Processor -- start 2021-12-17T18:28:09.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.260+0000 7f10bb685700 1 -- start start 2021-12-17T18:28:09.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10bb685700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f10b405ff80 0x7f10b40b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:09.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10bb685700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10b4066550 0x7f10b40669e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:09.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10bb685700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b40b26c0 con 0x7f10b4063d00 2021-12-17T18:28:09.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10bb685700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b4060360 con 0x7f10b405ff80 2021-12-17T18:28:09.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10bb685700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40635c0 con 0x7f10b4066550 2021-12-17T18:28:09.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10b8c20700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f10b4063d00 0x7f10b4144600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40830/0 (socket says 172.21.15.62:40830) 2021-12-17T18:28:09.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10b8c20700 1 -- 172.21.15.62:0/451855996 learned_addr learned my addr 172.21.15.62:0/451855996 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:09.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10b9c22700 1 --2- 172.21.15.62:0/451855996 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10b4066550 0x7f10b40669e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:09.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10b9421700 1 --2- 172.21.15.62:0/451855996 >> v2:172.21.15.109:3300/0 conn(0x7f10b405ff80 0x7f10b40b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:09.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10a3fff700 1 -- 172.21.15.62:0/451855996 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469505171 0 0) 0x7f10b40b26c0 con 0x7f10b4063d00 2021-12-17T18:28:09.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10a3fff700 1 -- 172.21.15.62:0/451855996 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f109c003260 con 0x7f10b4063d00 2021-12-17T18:28:09.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10b9c22700 1 -- 172.21.15.62:0/451855996 >> v2:172.21.15.109:3300/0 conn(0x7f10b405ff80 msgr2=0x7f10b40b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:09.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10b9c22700 1 --2- 172.21.15.62:0/451855996 >> v2:172.21.15.109:3300/0 conn(0x7f10b405ff80 0x7f10b40b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10b9c22700 1 -- 172.21.15.62:0/451855996 >> v1:172.21.15.62:6789/0 conn(0x7f10b4063d00 legacy=0x7f10b4144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10b9c22700 1 -- 172.21.15.62:0/451855996 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b4063860 con 0x7f10b4066550 2021-12-17T18:28:09.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10b9c22700 1 --2- 172.21.15.62:0/451855996 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10b4066550 0x7f10b40669e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f10ac0032f0 tx=0x7f10ac0091d0).ready entity=mon.2 client_cookie=2fd7a18cac004c7c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:09.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10a3fff700 1 -- 172.21.15.62:0/451855996 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10ac00b600 con 0x7f10b4066550 2021-12-17T18:28:09.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10a3fff700 1 -- 172.21.15.62:0/451855996 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ac00b760 con 0x7f10b4066550 2021-12-17T18:28:09.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10a3fff700 1 -- 172.21.15.62:0/451855996 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10ac00b8d0 con 0x7f10b4066550 2021-12-17T18:28:09.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10bb685700 1 -- 172.21.15.62:0/451855996 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10b4066550 msgr2=0x7f10b40669e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10bb685700 1 --2- 172.21.15.62:0/451855996 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10b4066550 0x7f10b40669e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f10ac0032f0 tx=0x7f10ac0091d0).stop 2021-12-17T18:28:09.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10bb685700 1 -- 172.21.15.62:0/451855996 shutdown_connections 2021-12-17T18:28:09.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10bb685700 1 --2- 172.21.15.62:0/451855996 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10b4066550 0x7f10b40669e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10bb685700 1 --2- 172.21.15.62:0/451855996 >> v2:172.21.15.109:3300/0 conn(0x7f10b405ff80 0x7f10b40b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10bb685700 1 -- 172.21.15.62:0/451855996 >> 172.21.15.62:0/451855996 conn(0x7f10b4062430 msgr2=0x7f10b4062840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:09.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10bb685700 1 -- 172.21.15.62:0/451855996 shutdown_connections 2021-12-17T18:28:09.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.264+0000 7f10bb685700 1 -- 172.21.15.62:0/451855996 wait complete. 2021-12-17T18:28:09.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10bb685700 1 Processor -- start 2021-12-17T18:28:09.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10bb685700 1 -- start start 2021-12-17T18:28:09.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10bb685700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10b405ff80 0x7f10b40a1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:09.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10bb685700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10b4063d00 0x7f10b40a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:09.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10bb685700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b4066550 0x7f10b40a27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:09.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10bb685700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b4150140 con 0x7f10b4066550 2021-12-17T18:28:09.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10bb685700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b41503e0 con 0x7f10b4063d00 2021-12-17T18:28:09.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10bb685700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b4150680 con 0x7f10b405ff80 2021-12-17T18:28:09.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10b9c22700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b4066550 0x7f10b40a27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:09.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10b9c22700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b4066550 0x7f10b40a27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57256/0 (socket says 172.21.15.62:57256) 2021-12-17T18:28:09.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10b9c22700 1 -- 172.21.15.62:0/234629379 learned_addr learned my addr 172.21.15.62:0/234629379 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:09.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10b9421700 1 --2- 172.21.15.62:0/234629379 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10b405ff80 0x7f10b40a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:09.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10b8c20700 1 --2- 172.21.15.62:0/234629379 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10b4063d00 0x7f10b40a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:09.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10b9c22700 1 -- 172.21.15.62:0/234629379 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10b405ff80 msgr2=0x7f10b40a1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10b9c22700 1 --2- 172.21.15.62:0/234629379 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10b405ff80 0x7f10b40a1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10b9c22700 1 -- 172.21.15.62:0/234629379 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10b4063d00 msgr2=0x7f10b40a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10b9c22700 1 --2- 172.21.15.62:0/234629379 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10b4063d00 0x7f10b40a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10b9c22700 1 -- 172.21.15.62:0/234629379 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac009470 con 0x7f10b4066550 2021-12-17T18:28:09.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10b8c20700 1 --2- 172.21.15.62:0/234629379 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10b4063d00 0x7f10b40a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:28:09.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.268+0000 7f10b9c22700 1 --2- 172.21.15.62:0/234629379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b4066550 0x7f10b40a27a0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f10ac0032f0 tx=0x7f10ac016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:09.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.272+0000 7f10a27fc700 1 -- 172.21.15.62:0/234629379 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10ac00b600 con 0x7f10b4066550 2021-12-17T18:28:09.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.272+0000 7f10a27fc700 1 -- 172.21.15.62:0/234629379 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ac020400 con 0x7f10b4066550 2021-12-17T18:28:09.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.272+0000 7f10bb685700 1 -- 172.21.15.62:0/234629379 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b40a1c70 con 0x7f10b4066550 2021-12-17T18:28:09.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.272+0000 7f10a27fc700 1 -- 172.21.15.62:0/234629379 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10ac020760 con 0x7f10b4066550 2021-12-17T18:28:09.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.272+0000 7f10bb685700 1 -- 172.21.15.62:0/234629379 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b4150b20 con 0x7f10b4066550 2021-12-17T18:28:09.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.272+0000 7f10bb685700 1 -- 172.21.15.62:0/234629379 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b414ffa0 con 0x7f10b4066550 2021-12-17T18:28:09.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.272+0000 7f10a27fc700 1 -- 172.21.15.62:0/234629379 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f10ac027030 con 0x7f10b4066550 2021-12-17T18:28:09.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.272+0000 7f10a27fc700 1 --2- 172.21.15.62:0/234629379 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f10940535b0 0x7f1094055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:09.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.272+0000 7f10a27fc700 1 -- 172.21.15.62:0/234629379 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f10ac06c870 con 0x7f10b4066550 2021-12-17T18:28:09.295 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.272+0000 7f10b9421700 1 --2- 172.21.15.62:0/234629379 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f10940535b0 0x7f1094055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:09.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.276+0000 7f10b9421700 1 --2- 172.21.15.62:0/234629379 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f10940535b0 0x7f1094055a70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f10b000b000 tx=0x7f10b0006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:09.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.284+0000 7f10a27fc700 1 -- 172.21.15.62:0/234629379 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f10b414ffa0 con 0x7f10b4066550 2021-12-17T18:28:09.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.448+0000 7f10bb685700 1 -- 172.21.15.62:0/234629379 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f10b414ffa0 con 0x7f10b4066550 2021-12-17T18:28:09.467 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.460+0000 7f10a27fc700 1 -- 172.21.15.62:0/234629379 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 29 and data pool 30 v75) v1 ==== 189+0+0 (secure 0 0 0) 0x7f10b414ffa0 con 0x7f10b4066550 2021-12-17T18:28:09.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.464+0000 7f10bb685700 1 -- 172.21.15.62:0/234629379 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f10940535b0 msgr2=0x7f1094055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.464+0000 7f10bb685700 1 --2- 172.21.15.62:0/234629379 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f10940535b0 0x7f1094055a70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f10b000b000 tx=0x7f10b0006df0).stop 2021-12-17T18:28:09.471 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.464+0000 7f10bb685700 1 -- 172.21.15.62:0/234629379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b4066550 msgr2=0x7f10b40a27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.464+0000 7f10bb685700 1 --2- 172.21.15.62:0/234629379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b4066550 0x7f10b40a27a0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f10ac0032f0 tx=0x7f10ac016000).stop 2021-12-17T18:28:09.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.464+0000 7f10bb685700 1 -- 172.21.15.62:0/234629379 shutdown_connections 2021-12-17T18:28:09.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.464+0000 7f10bb685700 1 --2- 172.21.15.62:0/234629379 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f10940535b0 0x7f1094055a70 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.464+0000 7f10bb685700 1 --2- 172.21.15.62:0/234629379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b4066550 0x7f10b40a27a0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.464+0000 7f10bb685700 1 --2- 172.21.15.62:0/234629379 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f10b4063d00 0x7f10b40a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.464+0000 7f10bb685700 1 --2- 172.21.15.62:0/234629379 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f10b405ff80 0x7f10b40a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.464+0000 7f10bb685700 1 -- 172.21.15.62:0/234629379 >> 172.21.15.62:0/234629379 conn(0x7f10b4062430 msgr2=0x7f10b4066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:09.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.464+0000 7f10bb685700 1 -- 172.21.15.62:0/234629379 shutdown_connections 2021-12-17T18:28:09.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.464+0000 7f10bb685700 1 -- 172.21.15.62:0/234629379 wait complete. 2021-12-17T18:28:09.474 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 29 and data pool 30 2021-12-17T18:28:09.486 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:28:09.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.572+0000 7fd98bfff700 1 Processor -- start 2021-12-17T18:28:09.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.572+0000 7fd98bfff700 1 -- start start 2021-12-17T18:28:09.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd98bfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd98c0b2a40 0x7fd98c0afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:09.585 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd98bfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd98c13fe00 0x7fd98c140250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:09.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd98bfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd98c0b2e20 con 0x7fd98c13cd40 2021-12-17T18:28:09.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd98bfff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98c13d8e0 con 0x7fd98c0b2a40 2021-12-17T18:28:09.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd98bfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c0ae860 con 0x7fd98c13fe00 2021-12-17T18:28:09.586 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd98a7fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd98c13cd40 0x7fd98c13d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40848/0 (socket says 172.21.15.62:40848) 2021-12-17T18:28:09.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd98a7fc700 1 -- 172.21.15.62:0/2640382037 learned_addr learned my addr 172.21.15.62:0/2640382037 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:09.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd98affd700 1 --2- 172.21.15.62:0/2640382037 >> v2:172.21.15.109:3300/0 conn(0x7fd98c0b2a40 0x7fd98c0afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:09.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd98b7fe700 1 --2- 172.21.15.62:0/2640382037 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd98c13fe00 0x7fd98c140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:09.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd989ffb700 1 -- 172.21.15.62:0/2640382037 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907004499 0 0) 0x7fd98c0b2e20 con 0x7fd98c13cd40 2021-12-17T18:28:09.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd989ffb700 1 -- 172.21.15.62:0/2640382037 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd970003260 con 0x7fd98c13cd40 2021-12-17T18:28:09.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd98affd700 1 -- 172.21.15.62:0/2640382037 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd98c13fe00 msgr2=0x7fd98c140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:09.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd98affd700 1 --2- 172.21.15.62:0/2640382037 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd98c13fe00 0x7fd98c140250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.588 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd98affd700 1 -- 172.21.15.62:0/2640382037 >> v1:172.21.15.62:6789/0 conn(0x7fd98c13cd40 legacy=0x7fd98c13d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd98affd700 1 -- 172.21.15.62:0/2640382037 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c143800 con 0x7fd98c0b2a40 2021-12-17T18:28:09.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd98affd700 1 --2- 172.21.15.62:0/2640382037 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd98c0b2a40 0x7fd98c0afcf0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fd97c002f70 tx=0x7fd97c006df0).ready entity=mon.1 client_cookie=a20dc3b5e3232661 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:09.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd989ffb700 1 -- 172.21.15.62:0/2640382037 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd97c00d4a0 con 0x7fd98c0b2a40 2021-12-17T18:28:09.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd989ffb700 1 -- 172.21.15.62:0/2640382037 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c000e90 con 0x7fd98c0b2a40 2021-12-17T18:28:09.589 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd989ffb700 1 -- 172.21.15.62:0/2640382037 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd97c00d7f0 con 0x7fd98c0b2a40 2021-12-17T18:28:09.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd98bfff700 1 -- 172.21.15.62:0/2640382037 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd98c0b2a40 msgr2=0x7fd98c0afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.576+0000 7fd98bfff700 1 --2- 172.21.15.62:0/2640382037 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd98c0b2a40 0x7fd98c0afcf0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fd97c002f70 tx=0x7fd97c006df0).stop 2021-12-17T18:28:09.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98bfff700 1 -- 172.21.15.62:0/2640382037 shutdown_connections 2021-12-17T18:28:09.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98bfff700 1 --2- 172.21.15.62:0/2640382037 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd98c13fe00 0x7fd98c140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.590 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98bfff700 1 --2- 172.21.15.62:0/2640382037 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd98c0b2a40 0x7fd98c0afcf0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98bfff700 1 -- 172.21.15.62:0/2640382037 >> 172.21.15.62:0/2640382037 conn(0x7fd98c05c750 msgr2=0x7fd98c05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:09.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98bfff700 1 -- 172.21.15.62:0/2640382037 shutdown_connections 2021-12-17T18:28:09.591 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98bfff700 1 -- 172.21.15.62:0/2640382037 wait complete. 2021-12-17T18:28:09.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98bfff700 1 Processor -- start 2021-12-17T18:28:09.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98bfff700 1 -- start start 2021-12-17T18:28:09.597 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd98c0b2a40 0x7fd98c0b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98bfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd98c13cd40 0x7fd98c1504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98bfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd98c13fe00 0x7fd98c1509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c13df10 con 0x7fd98c0b2a40 2021-12-17T18:28:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98bfff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c067440 con 0x7fd98c13fe00 2021-12-17T18:28:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98bfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c120d60 con 0x7fd98c13cd40 2021-12-17T18:28:09.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd98c0b2a40 0x7fd98c0b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:09.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd98c0b2a40 0x7fd98c0b42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57272/0 (socket says 172.21.15.62:57272) 2021-12-17T18:28:09.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98affd700 1 -- 172.21.15.62:0/1899704556 learned_addr learned my addr 172.21.15.62:0/1899704556 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:09.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98a7fc700 1 --2- 172.21.15.62:0/1899704556 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd98c13cd40 0x7fd98c1504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98b7fe700 1 --2- 172.21.15.62:0/1899704556 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd98c13fe00 0x7fd98c1509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98affd700 1 -- 172.21.15.62:0/1899704556 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd98c13cd40 msgr2=0x7fd98c1504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98affd700 1 --2- 172.21.15.62:0/1899704556 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd98c13cd40 0x7fd98c1504d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98affd700 1 -- 172.21.15.62:0/1899704556 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd98c13fe00 msgr2=0x7fd98c1509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98affd700 1 --2- 172.21.15.62:0/1899704556 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd98c13fe00 0x7fd98c1509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.580+0000 7fd98affd700 1 -- 172.21.15.62:0/1899704556 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c00b180 con 0x7fd98c0b2a40 2021-12-17T18:28:09.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.584+0000 7fd98affd700 1 --2- 172.21.15.62:0/1899704556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd98c0b2a40 0x7fd98c0b42e0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7fd97c002f70 tx=0x7fd97c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:09.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.584+0000 7fd97bfff700 1 -- 172.21.15.62:0/1899704556 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd97c016070 con 0x7fd98c0b2a40 2021-12-17T18:28:09.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.584+0000 7fd97bfff700 1 -- 172.21.15.62:0/1899704556 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c0137d0 con 0x7fd98c0b2a40 2021-12-17T18:28:09.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.584+0000 7fd98bfff700 1 -- 172.21.15.62:0/1899704556 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98c121000 con 0x7fd98c0b2a40 2021-12-17T18:28:09.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.584+0000 7fd97bfff700 1 -- 172.21.15.62:0/1899704556 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd97c013b30 con 0x7fd98c0b2a40 2021-12-17T18:28:09.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.584+0000 7fd98bfff700 1 -- 172.21.15.62:0/1899704556 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c067130 con 0x7fd98c0b2a40 2021-12-17T18:28:09.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.584+0000 7fd98bfff700 1 -- 172.21.15.62:0/1899704556 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98c1534f0 con 0x7fd98c0b2a40 2021-12-17T18:28:09.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.584+0000 7fd97bfff700 1 -- 172.21.15.62:0/1899704556 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd97c025030 con 0x7fd98c0b2a40 2021-12-17T18:28:09.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.584+0000 7fd97bfff700 1 --2- 172.21.15.62:0/1899704556 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd9680535b0 0x7fd968055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:09.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.584+0000 7fd97bfff700 1 -- 172.21.15.62:0/1899704556 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd97c06c6b0 con 0x7fd98c0b2a40 2021-12-17T18:28:09.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.588+0000 7fd98a7fc700 1 --2- 172.21.15.62:0/1899704556 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd9680535b0 0x7fd968055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:09.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.588+0000 7fd98a7fc700 1 --2- 172.21.15.62:0/1899704556 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd9680535b0 0x7fd968055a70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fd98000d000 tx=0x7fd980009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:09.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.592+0000 7fd97bfff700 1 -- 172.21.15.62:0/1899704556 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd97c043810 con 0x7fd98c0b2a40 2021-12-17T18:28:09.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.720+0000 7fd98bfff700 1 -- 172.21.15.62:0/1899704556 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd98c143aa0 con 0x7fd98c0b2a40 2021-12-17T18:28:09.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.720+0000 7fd97bfff700 1 -- 172.21.15.62:0/1899704556 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16113 (secure 0 0 0) 0x7fd97c023090 con 0x7fd98c0b2a40 2021-12-17T18:28:09.729 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:09.730 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":150,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:28:09.455376+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:28:07.237227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-12-17T18:28:08.465122+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:28:09.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.724+0000 7fd98bfff700 1 -- 172.21.15.62:0/1899704556 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd9680535b0 msgr2=0x7fd968055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.724+0000 7fd98bfff700 1 --2- 172.21.15.62:0/1899704556 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd9680535b0 0x7fd968055a70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fd98000d000 tx=0x7fd980009040).stop 2021-12-17T18:28:09.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.724+0000 7fd98bfff700 1 -- 172.21.15.62:0/1899704556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd98c0b2a40 msgr2=0x7fd98c0b42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.724+0000 7fd98bfff700 1 --2- 172.21.15.62:0/1899704556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd98c0b2a40 0x7fd98c0b42e0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7fd97c002f70 tx=0x7fd97c014000).stop 2021-12-17T18:28:09.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.724+0000 7fd98bfff700 1 -- 172.21.15.62:0/1899704556 shutdown_connections 2021-12-17T18:28:09.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.724+0000 7fd98bfff700 1 --2- 172.21.15.62:0/1899704556 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd9680535b0 0x7fd968055a70 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.724+0000 7fd98bfff700 1 --2- 172.21.15.62:0/1899704556 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd98c13fe00 0x7fd98c1509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.724+0000 7fd98bfff700 1 --2- 172.21.15.62:0/1899704556 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd98c13cd40 0x7fd98c1504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.724+0000 7fd98bfff700 1 --2- 172.21.15.62:0/1899704556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd98c0b2a40 0x7fd98c0b42e0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.724+0000 7fd98bfff700 1 -- 172.21.15.62:0/1899704556 >> 172.21.15.62:0/1899704556 conn(0x7fd98c05c750 msgr2=0x7fd98c0ad130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:09.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.724+0000 7fd98bfff700 1 -- 172.21.15.62:0/1899704556 shutdown_connections 2021-12-17T18:28:09.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.724+0000 7fd98bfff700 1 -- 172.21.15.62:0/1899704556 wait complete. 2021-12-17T18:28:09.743 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:28:09.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.840+0000 7f5a3759e700 1 Processor -- start 2021-12-17T18:28:09.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.840+0000 7f5a3759e700 1 -- start start 2021-12-17T18:28:09.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.844+0000 7f5a3759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5a380b5c80 0x7f5a380b6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:09.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.844+0000 7f5a3759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a380b1540 con 0x7f5a380afcf0 2021-12-17T18:28:09.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.844+0000 7f5a3759e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3813ffd0 con 0x7f5a3813fb60 2021-12-17T18:28:09.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.844+0000 7f5a3759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a380b0140 con 0x7f5a380b5c80 2021-12-17T18:28:09.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.844+0000 7f5a3659c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5a380b5c80 0x7f5a380b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:09.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.844+0000 7f5a3659c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5a380b5c80 0x7f5a380b6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57280/0 (socket says 172.21.15.62:57280) 2021-12-17T18:28:09.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.844+0000 7f5a3659c700 1 -- 172.21.15.62:0/3783239223 learned_addr learned my addr 172.21.15.62:0/3783239223 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:09.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.844+0000 7f5a3659c700 1 -- 172.21.15.62:0/3783239223 >> v1:172.21.15.109:6789/0 conn(0x7f5a3813fb60 legacy=0x7f5a38143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:09.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.844+0000 7f5a3659c700 1 -- 172.21.15.62:0/3783239223 >> v1:172.21.15.62:6789/0 conn(0x7f5a380afcf0 legacy=0x7f5a38142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.844+0000 7f5a3659c700 1 -- 172.21.15.62:0/3783239223 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a38143990 con 0x7f5a380b5c80 2021-12-17T18:28:09.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.844+0000 7f5a3659c700 1 --2- 172.21.15.62:0/3783239223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a380b5c80 0x7f5a380b6060 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f5a28002f70 tx=0x7f5a28006e40).ready entity=mon.0 client_cookie=fc0966532a18234d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:09.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.844+0000 7f5a3559a700 1 -- 172.21.15.62:0/3783239223 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a2800bcf0 con 0x7f5a380b5c80 2021-12-17T18:28:09.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.844+0000 7f5a3559a700 1 -- 172.21.15.62:0/3783239223 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a28000e90 con 0x7f5a380b5c80 2021-12-17T18:28:09.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.844+0000 7f5a3559a700 1 -- 172.21.15.62:0/3783239223 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a280155e0 con 0x7f5a380b5c80 2021-12-17T18:28:09.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.848+0000 7f5a3759e700 1 -- 172.21.15.62:0/3783239223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a380b5c80 msgr2=0x7f5a380b6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.848+0000 7f5a3759e700 1 --2- 172.21.15.62:0/3783239223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a380b5c80 0x7f5a380b6060 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f5a28002f70 tx=0x7f5a28006e40).stop 2021-12-17T18:28:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.848+0000 7f5a3759e700 1 -- 172.21.15.62:0/3783239223 shutdown_connections 2021-12-17T18:28:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.848+0000 7f5a3759e700 1 --2- 172.21.15.62:0/3783239223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a380b5c80 0x7f5a380b6060 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.848+0000 7f5a3759e700 1 -- 172.21.15.62:0/3783239223 >> 172.21.15.62:0/3783239223 conn(0x7f5a3805c750 msgr2=0x7f5a3805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.848+0000 7f5a3759e700 1 -- 172.21.15.62:0/3783239223 shutdown_connections 2021-12-17T18:28:09.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.848+0000 7f5a3759e700 1 -- 172.21.15.62:0/3783239223 wait complete. 2021-12-17T18:28:09.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.848+0000 7f5a3759e700 1 Processor -- start 2021-12-17T18:28:09.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.848+0000 7f5a3759e700 1 -- start start 2021-12-17T18:28:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a3759e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5a380afcf0 0x7f5a38066c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a3759e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5a380b5c80 0x7f5a3814f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:09.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a3759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3813fb60 0x7f5a38151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:09.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a3759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3813bdf0 con 0x7f5a3813fb60 2021-12-17T18:28:09.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a3759e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a380acb10 con 0x7f5a380b5c80 2021-12-17T18:28:09.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a3759e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a380ac5d0 con 0x7f5a380afcf0 2021-12-17T18:28:09.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a36d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3813fb60 0x7f5a38151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:09.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a36d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3813fb60 0x7f5a38151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57290/0 (socket says 172.21.15.62:57290) 2021-12-17T18:28:09.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a36d9d700 1 -- 172.21.15.62:0/28735214 learned_addr learned my addr 172.21.15.62:0/28735214 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:09.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a3659c700 1 --2- 172.21.15.62:0/28735214 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5a380afcf0 0x7f5a38066c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:09.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a35d9b700 1 --2- 172.21.15.62:0/28735214 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5a380b5c80 0x7f5a3814f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:09.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a36d9d700 1 -- 172.21.15.62:0/28735214 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5a380afcf0 msgr2=0x7f5a38066c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a36d9d700 1 --2- 172.21.15.62:0/28735214 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5a380afcf0 0x7f5a38066c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a36d9d700 1 -- 172.21.15.62:0/28735214 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5a380b5c80 msgr2=0x7f5a3814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:09.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a36d9d700 1 --2- 172.21.15.62:0/28735214 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5a380b5c80 0x7f5a3814f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:09.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a36d9d700 1 -- 172.21.15.62:0/28735214 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2800d4d0 con 0x7f5a3813fb60 2021-12-17T18:28:09.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a35d9b700 1 --2- 172.21.15.62:0/28735214 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5a380b5c80 0x7f5a3814f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:28:09.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a36d9d700 1 --2- 172.21.15.62:0/28735214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3813fb60 0x7f5a38151a30 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f5a380afbd0 tx=0x7f5a30001330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:09.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a277fe700 1 -- 172.21.15.62:0/28735214 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3000f470 con 0x7f5a3813fb60 2021-12-17T18:28:09.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a277fe700 1 -- 172.21.15.62:0/28735214 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3000f5d0 con 0x7f5a3813fb60 2021-12-17T18:28:09.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a277fe700 1 -- 172.21.15.62:0/28735214 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3000f930 con 0x7f5a3813fb60 2021-12-17T18:28:09.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a3759e700 1 -- 172.21.15.62:0/28735214 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a380ac870 con 0x7f5a3813fb60 2021-12-17T18:28:09.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a3759e700 1 -- 172.21.15.62:0/28735214 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3809e9d0 con 0x7f5a3813fb60 2021-12-17T18:28:09.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a3759e700 1 -- 172.21.15.62:0/28735214 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a380af5b0 con 0x7f5a3813fb60 2021-12-17T18:28:09.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.852+0000 7f5a277fe700 1 -- 172.21.15.62:0/28735214 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5a30019030 con 0x7f5a3813fb60 2021-12-17T18:28:09.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.856+0000 7f5a277fe700 1 --2- 172.21.15.62:0/28735214 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5a14053610 0x7f5a14055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:09.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.856+0000 7f5a277fe700 1 -- 172.21.15.62:0/28735214 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5a3006ad80 con 0x7f5a3813fb60 2021-12-17T18:28:09.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.856+0000 7f5a3659c700 1 --2- 172.21.15.62:0/28735214 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5a14053610 0x7f5a14055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.856+0000 7f5a3659c700 1 --2- 172.21.15.62:0/28735214 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5a14053610 0x7f5a14055ad0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f5a28019000 tx=0x7f5a28018000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.860+0000 7f5a277fe700 1 -- 172.21.15.62:0/28735214 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5a30041ee0 con 0x7f5a3813fb60 2021-12-17T18:28:09.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.992+0000 7f5a3759e700 1 -- 172.21.15.62:0/28735214 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a3813ffd0 con 0x7f5a3813fb60 2021-12-17T18:28:09.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.992+0000 7f5a277fe700 1 -- 172.21.15.62:0/28735214 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16113 (secure 0 0 0) 0x7f5a3813ffd0 con 0x7f5a3813fb60 2021-12-17T18:28:09.999 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:10.000 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":150,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:28:09.455376+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:28:07.237227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-12-17T18:28:08.465122+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:28:10.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.996+0000 7f5a3759e700 1 -- 172.21.15.62:0/28735214 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5a14053610 msgr2=0x7f5a14055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.996+0000 7f5a3759e700 1 --2- 172.21.15.62:0/28735214 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5a14053610 0x7f5a14055ad0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f5a28019000 tx=0x7f5a28018000).stop 2021-12-17T18:28:10.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.996+0000 7f5a3759e700 1 -- 172.21.15.62:0/28735214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3813fb60 msgr2=0x7f5a38151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.996+0000 7f5a3759e700 1 --2- 172.21.15.62:0/28735214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3813fb60 0x7f5a38151a30 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f5a380afbd0 tx=0x7f5a30001330).stop 2021-12-17T18:28:10.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.996+0000 7f5a3759e700 1 -- 172.21.15.62:0/28735214 shutdown_connections 2021-12-17T18:28:10.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.996+0000 7f5a3759e700 1 --2- 172.21.15.62:0/28735214 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5a14053610 0x7f5a14055ad0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.996+0000 7f5a3759e700 1 --2- 172.21.15.62:0/28735214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3813fb60 0x7f5a38151a30 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.996+0000 7f5a3759e700 1 --2- 172.21.15.62:0/28735214 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5a380b5c80 0x7f5a3814f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.996+0000 7f5a3759e700 1 --2- 172.21.15.62:0/28735214 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5a380afcf0 0x7f5a38066c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.996+0000 7f5a3759e700 1 -- 172.21.15.62:0/28735214 >> 172.21.15.62:0/28735214 conn(0x7f5a3805c750 msgr2=0x7f5a380ad4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:10.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.996+0000 7f5a3759e700 1 -- 172.21.15.62:0/28735214 shutdown_connections 2021-12-17T18:28:10.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:09.996+0000 7f5a3759e700 1 -- 172.21.15.62:0/28735214 wait complete. 2021-12-17T18:28:10.013 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-12-17T18:28:10.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.116+0000 7fc9ece5e700 1 Processor -- start 2021-12-17T18:28:10.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9ece5e700 1 -- start start 2021-12-17T18:28:10.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9ece5e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fc9e80b5dd0 0x7fc9e8146da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:10.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9ece5e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e80b2010 con 0x7fc9e80b05b0 2021-12-17T18:28:10.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9ece5e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e80b0990 con 0x7fc9e80b41f0 2021-12-17T18:28:10.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9ece5e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e8147290 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9e659c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc9e80b05b0 0x7fc9e8146690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40874/0 (socket says 172.21.15.62:40874) 2021-12-17T18:28:10.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9e659c700 1 -- 172.21.15.62:0/3689783776 learned_addr learned my addr 172.21.15.62:0/3689783776 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:10.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9e5d9b700 1 --2- 172.21.15.62:0/3689783776 >> v2:172.21.15.109:3300/0 conn(0x7fc9e80b5dd0 0x7fc9e8146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:10.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9e559a700 1 -- 172.21.15.62:0/3689783776 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218928229 0 0) 0x7fc9e80b2010 con 0x7fc9e80b05b0 2021-12-17T18:28:10.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9e559a700 1 -- 172.21.15.62:0/3689783776 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9c8003260 con 0x7fc9e80b05b0 2021-12-17T18:28:10.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9e559a700 1 -- 172.21.15.62:0/3689783776 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776756869 0 0) 0x7fc9e80b0990 con 0x7fc9e80b41f0 2021-12-17T18:28:10.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9e559a700 1 -- 172.21.15.62:0/3689783776 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9e80b2010 con 0x7fc9e80b41f0 2021-12-17T18:28:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9e5d9b700 1 -- 172.21.15.62:0/3689783776 >> v1:172.21.15.109:6789/0 conn(0x7fc9e80b41f0 legacy=0x7fc9e8141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9e5d9b700 1 -- 172.21.15.62:0/3689783776 >> v1:172.21.15.62:6789/0 conn(0x7fc9e80b05b0 legacy=0x7fc9e8146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9e5d9b700 1 -- 172.21.15.62:0/3689783776 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e80b2240 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9e5d9b700 1 --2- 172.21.15.62:0/3689783776 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc9e80b5dd0 0x7fc9e8146da0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fc9e80b15f0 tx=0x7fc9d8006df0).ready entity=mon.1 client_cookie=a1ced28b9b8933b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9e559a700 1 -- 172.21.15.62:0/3689783776 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9d800d610 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9e559a700 1 -- 172.21.15.62:0/3689783776 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d8000e90 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9e559a700 1 -- 172.21.15.62:0/3689783776 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9d800d960 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9ece5e700 1 -- 172.21.15.62:0/3689783776 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc9e80b5dd0 msgr2=0x7fc9e8146da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9ece5e700 1 --2- 172.21.15.62:0/3689783776 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc9e80b5dd0 0x7fc9e8146da0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fc9e80b15f0 tx=0x7fc9d8006df0).stop 2021-12-17T18:28:10.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9ece5e700 1 -- 172.21.15.62:0/3689783776 shutdown_connections 2021-12-17T18:28:10.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9ece5e700 1 --2- 172.21.15.62:0/3689783776 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc9e80b5dd0 0x7fc9e8146da0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9ece5e700 1 -- 172.21.15.62:0/3689783776 >> 172.21.15.62:0/3689783776 conn(0x7fc9e8062510 msgr2=0x7fc9e80628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9ece5e700 1 -- 172.21.15.62:0/3689783776 shutdown_connections 2021-12-17T18:28:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.120+0000 7fc9ece5e700 1 -- 172.21.15.62:0/3689783776 wait complete. 2021-12-17T18:28:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9ece5e700 1 Processor -- start 2021-12-17T18:28:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9ece5e700 1 -- start start 2021-12-17T18:28:10.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9ece5e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc9e80b05b0 0x7fc9e80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:10.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9ece5e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc9e80b41f0 0x7fc9e813cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9ece5e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9e80b5dd0 0x7fc9e813d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9ece5e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e8063f70 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9ece5e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e80650c0 con 0x7fc9e80b05b0 2021-12-17T18:28:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9ece5e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e81415a0 con 0x7fc9e80b41f0 2021-12-17T18:28:10.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9e6d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9e80b5dd0 0x7fc9e813d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:10.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9e6d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9e80b5dd0 0x7fc9e813d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57300/0 (socket says 172.21.15.62:57300) 2021-12-17T18:28:10.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9e6d9d700 1 -- 172.21.15.62:0/3875780969 learned_addr learned my addr 172.21.15.62:0/3875780969 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:10.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9e5d9b700 1 --2- 172.21.15.62:0/3875780969 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc9e80b41f0 0x7fc9e813cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9e659c700 1 --2- 172.21.15.62:0/3875780969 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc9e80b05b0 0x7fc9e80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9e6d9d700 1 -- 172.21.15.62:0/3875780969 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc9e80b41f0 msgr2=0x7fc9e813cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9e6d9d700 1 --2- 172.21.15.62:0/3875780969 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc9e80b41f0 0x7fc9e813cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9e6d9d700 1 -- 172.21.15.62:0/3875780969 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc9e80b05b0 msgr2=0x7fc9e80b8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9e6d9d700 1 --2- 172.21.15.62:0/3875780969 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc9e80b05b0 0x7fc9e80b8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9e6d9d700 1 -- 172.21.15.62:0/3875780969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d800b180 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9e5d9b700 1 --2- 172.21.15.62:0/3875780969 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc9e80b41f0 0x7fc9e813cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:28:10.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9e6d9d700 1 --2- 172.21.15.62:0/3875780969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9e80b5dd0 0x7fc9e813d190 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fc9e0001490 tx=0x7fc9e0007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:10.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9df7fe700 1 -- 172.21.15.62:0/3875780969 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9e0002310 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9ece5e700 1 -- 172.21.15.62:0/3875780969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e8063cd0 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9df7fe700 1 -- 172.21.15.62:0/3875780969 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e0002470 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9df7fe700 1 -- 172.21.15.62:0/3875780969 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9e0001840 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.124+0000 7fc9ece5e700 1 -- 172.21.15.62:0/3875780969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e8063780 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.128+0000 7fc9ece5e700 1 -- 172.21.15.62:0/3875780969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e80b2780 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.128+0000 7fc9df7fe700 1 -- 172.21.15.62:0/3875780969 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc9e0010030 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.128+0000 7fc9df7fe700 1 --2- 172.21.15.62:0/3875780969 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9cc053610 0x7fc9cc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:10.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.128+0000 7fc9df7fe700 1 -- 172.21.15.62:0/3875780969 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc9e006ba00 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.128+0000 7fc9e659c700 1 --2- 172.21.15.62:0/3875780969 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9cc053610 0x7fc9cc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:10.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.132+0000 7fc9e659c700 1 --2- 172.21.15.62:0/3875780969 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9cc053610 0x7fc9cc055ad0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fc9d000b000 tx=0x7fc9d0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:10.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.136+0000 7fc9df7fe700 1 -- 172.21.15.62:0/3875780969 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc9e0042b60 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.305 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.300+0000 7fc9ece5e700 1 -- 172.21.15.62:0/3875780969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc9e80573d0 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.469 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.464+0000 7fc9df7fe700 1 -- 172.21.15.62:0/3875780969 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v76) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc9e0046180 con 0x7fc9e80b5dd0 2021-12-17T18:28:10.472 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.464+0000 7fc9ece5e700 1 -- 172.21.15.62:0/3875780969 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9cc053610 msgr2=0x7fc9cc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.464+0000 7fc9ece5e700 1 --2- 172.21.15.62:0/3875780969 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9cc053610 0x7fc9cc055ad0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fc9d000b000 tx=0x7fc9d0009040).stop 2021-12-17T18:28:10.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.464+0000 7fc9ece5e700 1 -- 172.21.15.62:0/3875780969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9e80b5dd0 msgr2=0x7fc9e813d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.473 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.464+0000 7fc9ece5e700 1 --2- 172.21.15.62:0/3875780969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9e80b5dd0 0x7fc9e813d190 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fc9e0001490 tx=0x7fc9e0007dd0).stop 2021-12-17T18:28:10.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.468+0000 7fc9ece5e700 1 -- 172.21.15.62:0/3875780969 shutdown_connections 2021-12-17T18:28:10.474 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.468+0000 7fc9ece5e700 1 --2- 172.21.15.62:0/3875780969 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc9cc053610 0x7fc9cc055ad0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.468+0000 7fc9ece5e700 1 --2- 172.21.15.62:0/3875780969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9e80b5dd0 0x7fc9e813d190 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.468+0000 7fc9ece5e700 1 --2- 172.21.15.62:0/3875780969 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc9e80b41f0 0x7fc9e813cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.468+0000 7fc9ece5e700 1 --2- 172.21.15.62:0/3875780969 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc9e80b05b0 0x7fc9e80b8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.468+0000 7fc9ece5e700 1 -- 172.21.15.62:0/3875780969 >> 172.21.15.62:0/3875780969 conn(0x7fc9e8062510 msgr2=0x7fc9e813deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:10.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.468+0000 7fc9ece5e700 1 -- 172.21.15.62:0/3875780969 shutdown_connections 2021-12-17T18:28:10.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.468+0000 7fc9ece5e700 1 -- 172.21.15.62:0/3875780969 wait complete. 2021-12-17T18:28:10.490 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:28:10.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.588+0000 7f703b59e700 1 Processor -- start 2021-12-17T18:28:10.596 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.588+0000 7f703b59e700 1 -- start start 2021-12-17T18:28:10.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.588+0000 7f703b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f703c141480 0x7f703c147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:10.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.588+0000 7f703b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c0b6270 con 0x7f703c0a8e10 2021-12-17T18:28:10.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.588+0000 7f703b59e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c147610 con 0x7f703c0a71e0 2021-12-17T18:28:10.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.588+0000 7f703b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703c1478b0 con 0x7f703c141480 2021-12-17T18:28:10.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.588+0000 7f703a59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f703c141480 0x7f703c147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:10.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.588+0000 7f7039d9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f703c0a8e10 0x7f703c0b5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40888/0 (socket says 172.21.15.62:40888) 2021-12-17T18:28:10.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.588+0000 7f7039d9b700 1 -- 172.21.15.62:0/2620390708 learned_addr learned my addr 172.21.15.62:0/2620390708 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:10.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.592+0000 7f703a59c700 1 -- 172.21.15.62:0/2620390708 >> v1:172.21.15.109:6789/0 conn(0x7f703c0a71e0 legacy=0x7f703c0a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.592+0000 7f703a59c700 1 -- 172.21.15.62:0/2620390708 >> v1:172.21.15.62:6789/0 conn(0x7f703c0a8e10 legacy=0x7f703c0b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.592+0000 7f703a59c700 1 -- 172.21.15.62:0/2620390708 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c147b50 con 0x7f703c141480 2021-12-17T18:28:10.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.592+0000 7f703959a700 1 -- 172.21.15.62:0/2620390708 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768293023 0 0) 0x7f703c0b6270 con 0x7f703c0a8e10 2021-12-17T18:28:10.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.592+0000 7f703a59c700 1 --2- 172.21.15.62:0/2620390708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f703c141480 0x7f703c147ff0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f7030002f70 tx=0x7f7030006df0).ready entity=mon.0 client_cookie=9ae87ceebf24d487 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:10.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.592+0000 7f703959a700 1 -- 172.21.15.62:0/2620390708 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f703000d610 con 0x7f703c141480 2021-12-17T18:28:10.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.592+0000 7f703959a700 1 -- 172.21.15.62:0/2620390708 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7030000e90 con 0x7f703c141480 2021-12-17T18:28:10.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.592+0000 7f703959a700 1 -- 172.21.15.62:0/2620390708 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f703000d960 con 0x7f703c141480 2021-12-17T18:28:10.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.592+0000 7f703b59e700 1 -- 172.21.15.62:0/2620390708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f703c141480 msgr2=0x7f703c147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.592+0000 7f703b59e700 1 --2- 172.21.15.62:0/2620390708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f703c141480 0x7f703c147ff0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f7030002f70 tx=0x7f7030006df0).stop 2021-12-17T18:28:10.602 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.592+0000 7f703b59e700 1 -- 172.21.15.62:0/2620390708 shutdown_connections 2021-12-17T18:28:10.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.592+0000 7f703b59e700 1 --2- 172.21.15.62:0/2620390708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f703c141480 0x7f703c147ff0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.592+0000 7f703b59e700 1 -- 172.21.15.62:0/2620390708 >> 172.21.15.62:0/2620390708 conn(0x7f703c05d220 msgr2=0x7f703c0b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:10.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.592+0000 7f703b59e700 1 -- 172.21.15.62:0/2620390708 shutdown_connections 2021-12-17T18:28:10.603 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.592+0000 7f703b59e700 1 -- 172.21.15.62:0/2620390708 wait complete. 2021-12-17T18:28:10.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.592+0000 7f703b59e700 1 Processor -- start 2021-12-17T18:28:10.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.592+0000 7f703b59e700 1 -- start start 2021-12-17T18:28:10.607 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f703b59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f703c0a71e0 0x7f703c0b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:10.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f703b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f703c0a8e10 0x7f703c0ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:10.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f703b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f703c141480 0x7f703c14b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:10.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f703b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c144e30 con 0x7f703c0a8e10 2021-12-17T18:28:10.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f703b59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c144bd0 con 0x7f703c0a71e0 2021-12-17T18:28:10.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f703b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c14ada0 con 0x7f703c141480 2021-12-17T18:28:10.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f7039d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f703c0a8e10 0x7f703c0ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:10.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f7039d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f703c0a8e10 0x7f703c0ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57316/0 (socket says 172.21.15.62:57316) 2021-12-17T18:28:10.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f7039d9b700 1 -- 172.21.15.62:0/1324432026 learned_addr learned my addr 172.21.15.62:0/1324432026 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:10.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f703a59c700 1 --2- 172.21.15.62:0/1324432026 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f703c0a71e0 0x7f703c0b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:10.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f703ad9d700 1 --2- 172.21.15.62:0/1324432026 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f703c141480 0x7f703c14b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:10.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f7039d9b700 1 -- 172.21.15.62:0/1324432026 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f703c141480 msgr2=0x7f703c14b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f7039d9b700 1 --2- 172.21.15.62:0/1324432026 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f703c141480 0x7f703c14b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f7039d9b700 1 -- 172.21.15.62:0/1324432026 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f703c0a71e0 msgr2=0x7f703c0b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f7039d9b700 1 --2- 172.21.15.62:0/1324432026 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f703c0a71e0 0x7f703c0b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f7039d9b700 1 -- 172.21.15.62:0/1324432026 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703000b180 con 0x7f703c0a8e10 2021-12-17T18:28:10.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f7039d9b700 1 --2- 172.21.15.62:0/1324432026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f703c0a8e10 0x7f703c0ab130 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f702c000bc0 tx=0x7f702c007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:10.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f702b7fe700 1 -- 172.21.15.62:0/1324432026 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f702c0070d0 con 0x7f703c0a8e10 2021-12-17T18:28:10.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f702b7fe700 1 -- 172.21.15.62:0/1324432026 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c007230 con 0x7f703c0a8e10 2021-12-17T18:28:10.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f703b59e700 1 -- 172.21.15.62:0/1324432026 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703c149f70 con 0x7f703c0a8e10 2021-12-17T18:28:10.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f702b7fe700 1 -- 172.21.15.62:0/1324432026 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f702c005610 con 0x7f703c0a8e10 2021-12-17T18:28:10.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f703b59e700 1 -- 172.21.15.62:0/1324432026 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703c0ab7c0 con 0x7f703c0a8e10 2021-12-17T18:28:10.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.596+0000 7f703b59e700 1 -- 172.21.15.62:0/1324432026 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703c0b1b90 con 0x7f703c0a8e10 2021-12-17T18:28:10.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.600+0000 7f702b7fe700 1 -- 172.21.15.62:0/1324432026 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f702c010070 con 0x7f703c0a8e10 2021-12-17T18:28:10.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.600+0000 7f702b7fe700 1 --2- 172.21.15.62:0/1324432026 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f70180536a0 0x7f7018055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:10.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.600+0000 7f702b7fe700 1 -- 172.21.15.62:0/1324432026 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f702c06b0a0 con 0x7f703c0a8e10 2021-12-17T18:28:10.613 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.600+0000 7f703a59c700 1 --2- 172.21.15.62:0/1324432026 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f70180536a0 0x7f7018055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:10.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.600+0000 7f703a59c700 1 --2- 172.21.15.62:0/1324432026 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f70180536a0 0x7f7018055b60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f703001c000 tx=0x7f7030015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:10.614 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.604+0000 7f702b7fe700 1 -- 172.21.15.62:0/1324432026 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f702c042070 con 0x7f703c0a8e10 2021-12-17T18:28:10.774 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.768+0000 7f703b59e700 1 -- 172.21.15.62:0/1324432026 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f703c0573d0 con 0x7f703c0a8e10 2021-12-17T18:28:10.775 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.768+0000 7f702b7fe700 1 -- 172.21.15.62:0/1324432026 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f702c045690 con 0x7f703c0a8e10 2021-12-17T18:28:10.775 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:10.776 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":76,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3486639655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3486639655},{"type":"v1","addr":"172.21.15.109:6835","nonce":3486639655}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:28:09.455753+0000","modified":"2021-12-17T18:28:10.458774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7397},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7397":{"gid":7397,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/2348194620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2348194620},{"type":"v1","addr":"172.21.15.62:6833","nonce":2348194620}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-12-17T18:28:10.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.772+0000 7f703b59e700 1 -- 172.21.15.62:0/1324432026 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f70180536a0 msgr2=0x7f7018055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.772+0000 7f703b59e700 1 --2- 172.21.15.62:0/1324432026 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f70180536a0 0x7f7018055b60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f703001c000 tx=0x7f7030015000).stop 2021-12-17T18:28:10.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.772+0000 7f703b59e700 1 -- 172.21.15.62:0/1324432026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f703c0a8e10 msgr2=0x7f703c0ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.780 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.772+0000 7f703b59e700 1 --2- 172.21.15.62:0/1324432026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f703c0a8e10 0x7f703c0ab130 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f702c000bc0 tx=0x7f702c007a60).stop 2021-12-17T18:28:10.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.772+0000 7f703b59e700 1 -- 172.21.15.62:0/1324432026 shutdown_connections 2021-12-17T18:28:10.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.772+0000 7f703b59e700 1 --2- 172.21.15.62:0/1324432026 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f70180536a0 0x7f7018055b60 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.772+0000 7f703b59e700 1 --2- 172.21.15.62:0/1324432026 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f703c141480 0x7f703c14b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.772+0000 7f703b59e700 1 --2- 172.21.15.62:0/1324432026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f703c0a8e10 0x7f703c0ab130 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.772+0000 7f703b59e700 1 --2- 172.21.15.62:0/1324432026 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f703c0a71e0 0x7f703c0b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.772+0000 7f703b59e700 1 -- 172.21.15.62:0/1324432026 >> 172.21.15.62:0/1324432026 conn(0x7f703c05d220 msgr2=0x7f703c0b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:10.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.772+0000 7f703b59e700 1 -- 172.21.15.62:0/1324432026 shutdown_connections 2021-12-17T18:28:10.782 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.772+0000 7f703b59e700 1 -- 172.21.15.62:0/1324432026 wait complete. 2021-12-17T18:28:10.782 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 76 2021-12-17T18:28:10.794 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:28:10.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.892+0000 7ff0a3fff700 1 Processor -- start 2021-12-17T18:28:10.899 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.892+0000 7ff0a3fff700 1 -- start start 2021-12-17T18:28:10.902 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.892+0000 7ff0a3fff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff0a40aedd0 0x7ff0a40b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:10.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.892+0000 7ff0a3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff0a41470d0 0x7ff0a40b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:10.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.892+0000 7ff0a3fff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a40b0630 con 0x7ff0a40b01c0 2021-12-17T18:28:10.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.892+0000 7ff0a3fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a40af1b0 con 0x7ff0a41470d0 2021-12-17T18:28:10.903 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.892+0000 7ff0a3fff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a40b0890 con 0x7ff0a40aedd0 2021-12-17T18:28:10.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.892+0000 7ff0a37fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff0a41470d0 0x7ff0a40b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:10.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a37fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff0a41470d0 0x7ff0a40b2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57326/0 (socket says 172.21.15.62:57326) 2021-12-17T18:28:10.904 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a37fe700 1 -- 172.21.15.62:0/3460189541 learned_addr learned my addr 172.21.15.62:0/3460189541 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:10.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a2ffd700 1 --2- 172.21.15.62:0/3460189541 >> v2:172.21.15.109:3300/0 conn(0x7ff0a40aedd0 0x7ff0a40b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:10.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a37fe700 1 -- 172.21.15.62:0/3460189541 >> v2:172.21.15.109:3300/0 conn(0x7ff0a40aedd0 msgr2=0x7ff0a40b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:10.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a37fe700 1 --2- 172.21.15.62:0/3460189541 >> v2:172.21.15.109:3300/0 conn(0x7ff0a40aedd0 0x7ff0a40b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a37fe700 1 -- 172.21.15.62:0/3460189541 >> v1:172.21.15.109:6789/0 conn(0x7ff0a40b01c0 legacy=0x7ff0a41469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a37fe700 1 -- 172.21.15.62:0/3460189541 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a40b0b30 con 0x7ff0a41470d0 2021-12-17T18:28:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a37fe700 1 --2- 172.21.15.62:0/3460189541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0a41470d0 0x7ff0a40b2910 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7ff09c0032f0 tx=0x7ff09c009290).ready entity=mon.0 client_cookie=9b0a519d98c1dc40 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a27fc700 1 -- 172.21.15.62:0/3460189541 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff09c00b870 con 0x7ff0a41470d0 2021-12-17T18:28:10.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a27fc700 1 -- 172.21.15.62:0/3460189541 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09c00b9d0 con 0x7ff0a41470d0 2021-12-17T18:28:10.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a27fc700 1 -- 172.21.15.62:0/3460189541 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff09c00bb40 con 0x7ff0a41470d0 2021-12-17T18:28:10.907 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a3fff700 1 -- 172.21.15.62:0/3460189541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0a41470d0 msgr2=0x7ff0a40b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a3fff700 1 --2- 172.21.15.62:0/3460189541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0a41470d0 0x7ff0a40b2910 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7ff09c0032f0 tx=0x7ff09c009290).stop 2021-12-17T18:28:10.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a3fff700 1 -- 172.21.15.62:0/3460189541 shutdown_connections 2021-12-17T18:28:10.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a3fff700 1 --2- 172.21.15.62:0/3460189541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0a41470d0 0x7ff0a40b2910 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a3fff700 1 --2- 172.21.15.62:0/3460189541 >> v2:172.21.15.109:3300/0 conn(0x7ff0a40aedd0 0x7ff0a40b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a3fff700 1 -- 172.21.15.62:0/3460189541 >> 172.21.15.62:0/3460189541 conn(0x7ff0a405c750 msgr2=0x7ff0a405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:10.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a3fff700 1 -- 172.21.15.62:0/3460189541 shutdown_connections 2021-12-17T18:28:10.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a3fff700 1 -- 172.21.15.62:0/3460189541 wait complete. 2021-12-17T18:28:10.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a3fff700 1 Processor -- start 2021-12-17T18:28:10.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.896+0000 7ff0a3fff700 1 -- start start 2021-12-17T18:28:10.914 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a3fff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0a40aedd0 0x7ff0a414a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:10.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a3fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0a40b01c0 0x7ff0a4063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:10.915 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0a41470d0 0x7ff0a4142830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a3fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a4064490 con 0x7ff0a41470d0 2021-12-17T18:28:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a3fff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40adfc0 con 0x7ff0a40aedd0 2021-12-17T18:28:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a3fff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40ada80 con 0x7ff0a40b01c0 2021-12-17T18:28:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0a41470d0 0x7ff0a4142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0a41470d0 0x7ff0a4142830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57332/0 (socket says 172.21.15.62:57332) 2021-12-17T18:28:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a37fe700 1 -- 172.21.15.62:0/3637733972 learned_addr learned my addr 172.21.15.62:0/3637733972 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:10.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a2ffd700 1 --2- 172.21.15.62:0/3637733972 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0a40aedd0 0x7ff0a414a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:10.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff09a7fc700 1 --2- 172.21.15.62:0/3637733972 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0a40b01c0 0x7ff0a4063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:10.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a37fe700 1 -- 172.21.15.62:0/3637733972 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0a40b01c0 msgr2=0x7ff0a4063fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a37fe700 1 --2- 172.21.15.62:0/3637733972 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0a40b01c0 0x7ff0a4063fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a37fe700 1 -- 172.21.15.62:0/3637733972 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0a40aedd0 msgr2=0x7ff0a414a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a37fe700 1 --2- 172.21.15.62:0/3637733972 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0a40aedd0 0x7ff0a414a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a37fe700 1 -- 172.21.15.62:0/3637733972 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c009530 con 0x7ff0a41470d0 2021-12-17T18:28:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff09a7fc700 1 --2- 172.21.15.62:0/3637733972 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0a40b01c0 0x7ff0a4063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:28:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a37fe700 1 --2- 172.21.15.62:0/3637733972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0a41470d0 0x7ff0a4142830 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7ff09c0032f0 tx=0x7ff09c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a0ff9700 1 -- 172.21.15.62:0/3637733972 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff09c021440 con 0x7ff0a41470d0 2021-12-17T18:28:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a0ff9700 1 -- 172.21.15.62:0/3637733972 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09c0215a0 con 0x7ff0a41470d0 2021-12-17T18:28:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a3fff700 1 -- 172.21.15.62:0/3637733972 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a40add20 con 0x7ff0a41470d0 2021-12-17T18:28:10.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a0ff9700 1 -- 172.21.15.62:0/3637733972 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff09c021900 con 0x7ff0a41470d0 2021-12-17T18:28:10.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a3fff700 1 -- 172.21.15.62:0/3637733972 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a40ad370 con 0x7ff0a41470d0 2021-12-17T18:28:10.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a3fff700 1 -- 172.21.15.62:0/3637733972 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a40b0dd0 con 0x7ff0a41470d0 2021-12-17T18:28:10.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.900+0000 7ff0a0ff9700 1 -- 172.21.15.62:0/3637733972 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff09c027020 con 0x7ff0a41470d0 2021-12-17T18:28:10.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.904+0000 7ff0a0ff9700 1 --2- 172.21.15.62:0/3637733972 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff0880536a0 0x7ff088055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:10.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.904+0000 7ff0a0ff9700 1 -- 172.21.15.62:0/3637733972 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff09c06d320 con 0x7ff0a41470d0 2021-12-17T18:28:10.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.904+0000 7ff0a2ffd700 1 --2- 172.21.15.62:0/3637733972 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff0880536a0 0x7ff088055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:10.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.904+0000 7ff0a2ffd700 1 --2- 172.21.15.62:0/3637733972 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff0880536a0 0x7ff088055b60 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7ff09400c000 tx=0x7ff094008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:10.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:10.908+0000 7ff0a0ff9700 1 -- 172.21.15.62:0/3637733972 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff09c044400 con 0x7ff0a41470d0 2021-12-17T18:28:11.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.036+0000 7ff0a3fff700 1 -- 172.21.15.62:0/3637733972 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0a40573d0 con 0x7ff0a41470d0 2021-12-17T18:28:11.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.036+0000 7ff0a0ff9700 1 -- 172.21.15.62:0/3637733972 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+16113 (secure 0 0 0) 0x7ff09c015070 con 0x7ff0a41470d0 2021-12-17T18:28:11.045 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:11.045 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":151,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:28:10.459635+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:28:07.237227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-12-17T18:28:08.465122+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:28:11.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.040+0000 7ff0a3fff700 1 -- 172.21.15.62:0/3637733972 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff0880536a0 msgr2=0x7ff088055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:11.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.040+0000 7ff0a3fff700 1 --2- 172.21.15.62:0/3637733972 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff0880536a0 0x7ff088055b60 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7ff09400c000 tx=0x7ff094008040).stop 2021-12-17T18:28:11.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.040+0000 7ff0a3fff700 1 -- 172.21.15.62:0/3637733972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0a41470d0 msgr2=0x7ff0a4142830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:11.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.040+0000 7ff0a3fff700 1 --2- 172.21.15.62:0/3637733972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0a41470d0 0x7ff0a4142830 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7ff09c0032f0 tx=0x7ff09c016000).stop 2021-12-17T18:28:11.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.040+0000 7ff0a3fff700 1 -- 172.21.15.62:0/3637733972 shutdown_connections 2021-12-17T18:28:11.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.040+0000 7ff0a3fff700 1 --2- 172.21.15.62:0/3637733972 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff0880536a0 0x7ff088055b60 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.040+0000 7ff0a3fff700 1 --2- 172.21.15.62:0/3637733972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0a41470d0 0x7ff0a4142830 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.040+0000 7ff0a3fff700 1 --2- 172.21.15.62:0/3637733972 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff0a40b01c0 0x7ff0a4063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.040+0000 7ff0a3fff700 1 --2- 172.21.15.62:0/3637733972 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff0a40aedd0 0x7ff0a414a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.040+0000 7ff0a3fff700 1 -- 172.21.15.62:0/3637733972 >> 172.21.15.62:0/3637733972 conn(0x7ff0a405c750 msgr2=0x7ff0a41450b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.040+0000 7ff0a3fff700 1 -- 172.21.15.62:0/3637733972 shutdown_connections 2021-12-17T18:28:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.040+0000 7ff0a3fff700 1 -- 172.21.15.62:0/3637733972 wait complete. 2021-12-17T18:28:11.057 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:28:11.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d8d82700 1 Processor -- start 2021-12-17T18:28:11.174 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d8d82700 1 -- start start 2021-12-17T18:28:11.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d8d82700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb6d405f730 0x7fb6d405fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d8d82700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d4062730 0x7fb6d41471c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d8d82700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d4143210 con 0x7fb6d4143bf0 2021-12-17T18:28:11.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d8d82700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d41476b0 con 0x7fb6d405f730 2021-12-17T18:28:11.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d8d82700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d41434b0 con 0x7fb6d4062730 2021-12-17T18:28:11.178 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d259c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb6d405f730 0x7fb6d405fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d259c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb6d405f730 0x7fb6d405fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57336/0 (socket says 172.21.15.62:57336) 2021-12-17T18:28:11.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d259c700 1 -- 172.21.15.62:0/3291713439 learned_addr learned my addr 172.21.15.62:0/3291713439 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:11.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d1d9b700 1 --2- 172.21.15.62:0/3291713439 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d4062730 0x7fb6d41471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d259c700 1 -- 172.21.15.62:0/3291713439 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d4062730 msgr2=0x7fb6d41471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:11.179 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d259c700 1 --2- 172.21.15.62:0/3291713439 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d4062730 0x7fb6d41471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d259c700 1 -- 172.21.15.62:0/3291713439 >> v1:172.21.15.109:6789/0 conn(0x7fb6d4143bf0 legacy=0x7fb6d40b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:11.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d259c700 1 -- 172.21.15.62:0/3291713439 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d4143750 con 0x7fb6d405f730 2021-12-17T18:28:11.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d259c700 1 --2- 172.21.15.62:0/3291713439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6d405f730 0x7fb6d405fb10 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7fb6bc002f70 tx=0x7fb6bc006eb0).ready entity=mon.0 client_cookie=9014f4945f390fd server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:11.180 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d159a700 1 -- 172.21.15.62:0/3291713439 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6bc00d5c0 con 0x7fb6d405f730 2021-12-17T18:28:11.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d159a700 1 -- 172.21.15.62:0/3291713439 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc000e90 con 0x7fb6d405f730 2021-12-17T18:28:11.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.168+0000 7fb6d159a700 1 -- 172.21.15.62:0/3291713439 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6bc00d950 con 0x7fb6d405f730 2021-12-17T18:28:11.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d8d82700 1 -- 172.21.15.62:0/3291713439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6d405f730 msgr2=0x7fb6d405fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:11.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d8d82700 1 --2- 172.21.15.62:0/3291713439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6d405f730 0x7fb6d405fb10 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7fb6bc002f70 tx=0x7fb6bc006eb0).stop 2021-12-17T18:28:11.181 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d8d82700 1 -- 172.21.15.62:0/3291713439 shutdown_connections 2021-12-17T18:28:11.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d8d82700 1 --2- 172.21.15.62:0/3291713439 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d4062730 0x7fb6d41471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d8d82700 1 --2- 172.21.15.62:0/3291713439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6d405f730 0x7fb6d405fb10 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d8d82700 1 -- 172.21.15.62:0/3291713439 >> 172.21.15.62:0/3291713439 conn(0x7fb6d40b64f0 msgr2=0x7fb6d40b68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:11.182 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d8d82700 1 -- 172.21.15.62:0/3291713439 shutdown_connections 2021-12-17T18:28:11.183 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d8d82700 1 -- 172.21.15.62:0/3291713439 wait complete. 2021-12-17T18:28:11.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d8d82700 1 Processor -- start 2021-12-17T18:28:11.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d8d82700 1 -- start start 2021-12-17T18:28:11.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d8d82700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6d405f730 0x7fb6d4146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.186 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d8d82700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb6d4062730 0x7fb6d413f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d8d82700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d4143bf0 0x7fb6d413fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d8d82700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d4063f70 con 0x7fb6d405f730 2021-12-17T18:28:11.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d8d82700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40641a0 con 0x7fb6d4062730 2021-12-17T18:28:11.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d8d82700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d4064440 con 0x7fb6d4143bf0 2021-12-17T18:28:11.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6d405f730 0x7fb6d4146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6d405f730 0x7fb6d4146300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57342/0 (socket says 172.21.15.62:57342) 2021-12-17T18:28:11.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d259c700 1 -- 172.21.15.62:0/2347763633 learned_addr learned my addr 172.21.15.62:0/2347763633 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:11.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d1d9b700 1 --2- 172.21.15.62:0/2347763633 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb6d4062730 0x7fb6d413f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.172+0000 7fb6d2d9d700 1 --2- 172.21.15.62:0/2347763633 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d4143bf0 0x7fb6d413fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.176+0000 7fb6d259c700 1 -- 172.21.15.62:0/2347763633 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d4143bf0 msgr2=0x7fb6d413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:11.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.176+0000 7fb6d259c700 1 --2- 172.21.15.62:0/2347763633 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d4143bf0 0x7fb6d413fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.176+0000 7fb6d259c700 1 -- 172.21.15.62:0/2347763633 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb6d4062730 msgr2=0x7fb6d413f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:11.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.176+0000 7fb6d259c700 1 --2- 172.21.15.62:0/2347763633 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb6d4062730 0x7fb6d413f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.176+0000 7fb6d259c700 1 -- 172.21.15.62:0/2347763633 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc00b1e0 con 0x7fb6d405f730 2021-12-17T18:28:11.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.176+0000 7fb6d259c700 1 --2- 172.21.15.62:0/2347763633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6d405f730 0x7fb6d4146300 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7fb6bc002f70 tx=0x7fb6bc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:11.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.176+0000 7fb6cb7fe700 1 -- 172.21.15.62:0/2347763633 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6bc00de80 con 0x7fb6d405f730 2021-12-17T18:28:11.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.176+0000 7fb6cb7fe700 1 -- 172.21.15.62:0/2347763633 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc011b40 con 0x7fb6d405f730 2021-12-17T18:28:11.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.176+0000 7fb6d8d82700 1 -- 172.21.15.62:0/2347763633 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d4140170 con 0x7fb6d405f730 2021-12-17T18:28:11.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.176+0000 7fb6cb7fe700 1 -- 172.21.15.62:0/2347763633 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6bc011ea0 con 0x7fb6d405f730 2021-12-17T18:28:11.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.176+0000 7fb6d8d82700 1 -- 172.21.15.62:0/2347763633 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d40ac830 con 0x7fb6d405f730 2021-12-17T18:28:11.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.176+0000 7fb6d8d82700 1 -- 172.21.15.62:0/2347763633 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d40b1d40 con 0x7fb6d405f730 2021-12-17T18:28:11.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.176+0000 7fb6cb7fe700 1 -- 172.21.15.62:0/2347763633 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb6bc025030 con 0x7fb6d405f730 2021-12-17T18:28:11.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.176+0000 7fb6cb7fe700 1 --2- 172.21.15.62:0/2347763633 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb6b8053610 0x7fb6b8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.176+0000 7fb6cb7fe700 1 -- 172.21.15.62:0/2347763633 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb6bc06cba0 con 0x7fb6d405f730 2021-12-17T18:28:11.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.176+0000 7fb6d1d9b700 1 --2- 172.21.15.62:0/2347763633 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb6b8053610 0x7fb6b8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.180+0000 7fb6d1d9b700 1 --2- 172.21.15.62:0/2347763633 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb6b8053610 0x7fb6b8055ad0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fb6c400d000 tx=0x7fb6c4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:11.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.184+0000 7fb6cb7fe700 1 -- 172.21.15.62:0/2347763633 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb6bc043d00 con 0x7fb6d405f730 2021-12-17T18:28:11.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.352+0000 7fb6d8d82700 1 -- 172.21.15.62:0/2347763633 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fb6d40573d0 con 0x7fb6d405f730 2021-12-17T18:28:11.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.360+0000 7fb6cb7fe700 1 -- 172.21.15.62:0/2347763633 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v45) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb6bc023070 con 0x7fb6d405f730 2021-12-17T18:28:11.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.360+0000 7fb6d8d82700 1 -- 172.21.15.62:0/2347763633 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb6b8053610 msgr2=0x7fb6b8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:11.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.360+0000 7fb6d8d82700 1 --2- 172.21.15.62:0/2347763633 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb6b8053610 0x7fb6b8055ad0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fb6c400d000 tx=0x7fb6c4008040).stop 2021-12-17T18:28:11.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.360+0000 7fb6d8d82700 1 -- 172.21.15.62:0/2347763633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6d405f730 msgr2=0x7fb6d4146300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:11.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.360+0000 7fb6d8d82700 1 --2- 172.21.15.62:0/2347763633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6d405f730 0x7fb6d4146300 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7fb6bc002f70 tx=0x7fb6bc015000).stop 2021-12-17T18:28:11.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.360+0000 7fb6d8d82700 1 -- 172.21.15.62:0/2347763633 shutdown_connections 2021-12-17T18:28:11.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.360+0000 7fb6d8d82700 1 --2- 172.21.15.62:0/2347763633 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb6b8053610 0x7fb6b8055ad0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.360+0000 7fb6d8d82700 1 --2- 172.21.15.62:0/2347763633 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb6d4143bf0 0x7fb6d413fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.360+0000 7fb6d8d82700 1 --2- 172.21.15.62:0/2347763633 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb6d4062730 0x7fb6d413f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.360+0000 7fb6d8d82700 1 --2- 172.21.15.62:0/2347763633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6d405f730 0x7fb6d4146300 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.360+0000 7fb6d8d82700 1 -- 172.21.15.62:0/2347763633 >> 172.21.15.62:0/2347763633 conn(0x7fb6d40b64f0 msgr2=0x7fb6d4140610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:11.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.360+0000 7fb6d8d82700 1 -- 172.21.15.62:0/2347763633 shutdown_connections 2021-12-17T18:28:11.371 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.360+0000 7fb6d8d82700 1 -- 172.21.15.62:0/2347763633 wait complete. 2021-12-17T18:28:11.372 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.0 2021-12-17T18:28:11.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:28:11.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0fbfff700 1 Processor -- start 2021-12-17T18:28:11.498 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0fbfff700 1 -- start start 2021-12-17T18:28:11.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0fbfff700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fb0fc05ca90 0x7fb0fc05f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0fbfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb0fc060540 0x7fb0fc0b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.502 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0fbfff700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0fc05ce70 con 0x7fb0fc0aca40 2021-12-17T18:28:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0fbfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0fc0afc70 con 0x7fb0fc060540 2021-12-17T18:28:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0fbfff700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0fc0abf30 con 0x7fb0fc05ca90 2021-12-17T18:28:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0fa7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb0fc060540 0x7fb0fc0b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0fa7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb0fc060540 0x7fb0fc0b1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57352/0 (socket says 172.21.15.62:57352) 2021-12-17T18:28:11.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0fa7fc700 1 -- 172.21.15.62:0/120728896 learned_addr learned my addr 172.21.15.62:0/120728896 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:11.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0faffd700 1 --2- 172.21.15.62:0/120728896 >> v2:172.21.15.109:3300/0 conn(0x7fb0fc05ca90 0x7fb0fc05f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0fa7fc700 1 -- 172.21.15.62:0/120728896 >> v2:172.21.15.109:3300/0 conn(0x7fb0fc05ca90 msgr2=0x7fb0fc05f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:11.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0fa7fc700 1 --2- 172.21.15.62:0/120728896 >> v2:172.21.15.109:3300/0 conn(0x7fb0fc05ca90 0x7fb0fc05f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.504 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0fa7fc700 1 -- 172.21.15.62:0/120728896 >> v1:172.21.15.109:6789/0 conn(0x7fb0fc0aca40 legacy=0x7fb0fc0acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:11.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0fa7fc700 1 -- 172.21.15.62:0/120728896 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc0ac1d0 con 0x7fb0fc060540 2021-12-17T18:28:11.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0fa7fc700 1 --2- 172.21.15.62:0/120728896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0fc060540 0x7fb0fc0b1bf0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7fb0f0002f70 tx=0x7fb0f0006eb0).ready entity=mon.0 client_cookie=bf8f8dc6550e6090 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:11.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0f9ffb700 1 -- 172.21.15.62:0/120728896 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0f000d610 con 0x7fb0fc060540 2021-12-17T18:28:11.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0f9ffb700 1 -- 172.21.15.62:0/120728896 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f0000e90 con 0x7fb0fc060540 2021-12-17T18:28:11.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0f9ffb700 1 -- 172.21.15.62:0/120728896 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0f000d9a0 con 0x7fb0fc060540 2021-12-17T18:28:11.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0fbfff700 1 -- 172.21.15.62:0/120728896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0fc060540 msgr2=0x7fb0fc0b1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:11.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.492+0000 7fb0fbfff700 1 --2- 172.21.15.62:0/120728896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0fc060540 0x7fb0fc0b1bf0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7fb0f0002f70 tx=0x7fb0f0006eb0).stop 2021-12-17T18:28:11.506 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fbfff700 1 -- 172.21.15.62:0/120728896 shutdown_connections 2021-12-17T18:28:11.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fbfff700 1 --2- 172.21.15.62:0/120728896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0fc060540 0x7fb0fc0b1bf0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fbfff700 1 --2- 172.21.15.62:0/120728896 >> v2:172.21.15.109:3300/0 conn(0x7fb0fc05ca90 0x7fb0fc05f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fbfff700 1 -- 172.21.15.62:0/120728896 >> 172.21.15.62:0/120728896 conn(0x7fb0fc05be70 msgr2=0x7fb0fc062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:11.507 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fbfff700 1 -- 172.21.15.62:0/120728896 shutdown_connections 2021-12-17T18:28:11.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fbfff700 1 -- 172.21.15.62:0/120728896 wait complete. 2021-12-17T18:28:11.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fbfff700 1 Processor -- start 2021-12-17T18:28:11.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fbfff700 1 -- start start 2021-12-17T18:28:11.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fbfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb0fc05ca90 0x7fb0fc149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fbfff700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb0fc060540 0x7fb0fc145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0fc0aca40 0x7fb0fc146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fbfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc144770 con 0x7fb0fc0aca40 2021-12-17T18:28:11.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fbfff700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc1440d0 con 0x7fb0fc060540 2021-12-17T18:28:11.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fbfff700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc1453a0 con 0x7fb0fc05ca90 2021-12-17T18:28:11.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0fc0aca40 0x7fb0fc146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0fc0aca40 0x7fb0fc146070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57358/0 (socket says 172.21.15.62:57358) 2021-12-17T18:28:11.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fb7fe700 1 -- 172.21.15.62:0/1294580354 learned_addr learned my addr 172.21.15.62:0/1294580354 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:11.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fa7fc700 1 --2- 172.21.15.62:0/1294580354 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb0fc060540 0x7fb0fc145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0faffd700 1 --2- 172.21.15.62:0/1294580354 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb0fc05ca90 0x7fb0fc149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fb7fe700 1 -- 172.21.15.62:0/1294580354 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb0fc05ca90 msgr2=0x7fb0fc149d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:11.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fb7fe700 1 --2- 172.21.15.62:0/1294580354 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb0fc05ca90 0x7fb0fc149d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fb7fe700 1 -- 172.21.15.62:0/1294580354 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb0fc060540 msgr2=0x7fb0fc145b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:11.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fb7fe700 1 --2- 172.21.15.62:0/1294580354 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb0fc060540 0x7fb0fc145b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fb7fe700 1 -- 172.21.15.62:0/1294580354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f000b1e0 con 0x7fb0fc0aca40 2021-12-17T18:28:11.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fb7fe700 1 --2- 172.21.15.62:0/1294580354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0fc0aca40 0x7fb0fc146070 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7fb0fc144210 tx=0x7fb0f4007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:11.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0ebfff700 1 -- 172.21.15.62:0/1294580354 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0f4006b70 con 0x7fb0fc0aca40 2021-12-17T18:28:11.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0ebfff700 1 -- 172.21.15.62:0/1294580354 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f4006cd0 con 0x7fb0fc0aca40 2021-12-17T18:28:11.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0ebfff700 1 -- 172.21.15.62:0/1294580354 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0f4007220 con 0x7fb0fc0aca40 2021-12-17T18:28:11.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fbfff700 1 -- 172.21.15.62:0/1294580354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0fc148560 con 0x7fb0fc0aca40 2021-12-17T18:28:11.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.496+0000 7fb0fbfff700 1 -- 172.21.15.62:0/1294580354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0fc063630 con 0x7fb0fc0aca40 2021-12-17T18:28:11.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.500+0000 7fb0ebfff700 1 -- 172.21.15.62:0/1294580354 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb0f4010030 con 0x7fb0fc0aca40 2021-12-17T18:28:11.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.500+0000 7fb0fbfff700 1 -- 172.21.15.62:0/1294580354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0fc1459f0 con 0x7fb0fc0aca40 2021-12-17T18:28:11.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.500+0000 7fb0ebfff700 1 --2- 172.21.15.62:0/1294580354 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb0d80536a0 0x7fb0d8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.500+0000 7fb0ebfff700 1 -- 172.21.15.62:0/1294580354 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb0f406b9b0 con 0x7fb0fc0aca40 2021-12-17T18:28:11.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.500+0000 7fb0faffd700 1 --2- 172.21.15.62:0/1294580354 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb0d80536a0 0x7fb0d8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.500+0000 7fb0faffd700 1 --2- 172.21.15.62:0/1294580354 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb0d80536a0 0x7fb0d8055b60 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fb0ec00c000 tx=0x7fb0ec008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:11.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.504+0000 7fb0ebfff700 1 -- 172.21.15.62:0/1294580354 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb0f4042a00 con 0x7fb0fc0aca40 2021-12-17T18:28:11.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.668+0000 7fb0fbfff700 1 -- 172.21.15.62:0/1294580354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fb0fc0573d0 con 0x7fb0fc0aca40 2021-12-17T18:28:11.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.676+0000 7fb0ebfff700 1 -- 172.21.15.62:0/1294580354 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v46) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb0f4046020 con 0x7fb0fc0aca40 2021-12-17T18:28:11.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.676+0000 7fb0fbfff700 1 -- 172.21.15.62:0/1294580354 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb0d80536a0 msgr2=0x7fb0d8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:11.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.676+0000 7fb0fbfff700 1 --2- 172.21.15.62:0/1294580354 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb0d80536a0 0x7fb0d8055b60 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fb0ec00c000 tx=0x7fb0ec008040).stop 2021-12-17T18:28:11.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.676+0000 7fb0fbfff700 1 -- 172.21.15.62:0/1294580354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0fc0aca40 msgr2=0x7fb0fc146070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:11.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.676+0000 7fb0fbfff700 1 --2- 172.21.15.62:0/1294580354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0fc0aca40 0x7fb0fc146070 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7fb0fc144210 tx=0x7fb0f4007f70).stop 2021-12-17T18:28:11.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.676+0000 7fb0fbfff700 1 -- 172.21.15.62:0/1294580354 shutdown_connections 2021-12-17T18:28:11.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.676+0000 7fb0fbfff700 1 --2- 172.21.15.62:0/1294580354 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb0d80536a0 0x7fb0d8055b60 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.676+0000 7fb0fbfff700 1 --2- 172.21.15.62:0/1294580354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0fc0aca40 0x7fb0fc146070 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.676+0000 7fb0fbfff700 1 --2- 172.21.15.62:0/1294580354 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb0fc060540 0x7fb0fc145b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.676+0000 7fb0fbfff700 1 --2- 172.21.15.62:0/1294580354 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb0fc05ca90 0x7fb0fc149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.676+0000 7fb0fbfff700 1 -- 172.21.15.62:0/1294580354 >> 172.21.15.62:0/1294580354 conn(0x7fb0fc05be70 msgr2=0x7fb0fc0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:11.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.680+0000 7fb0fbfff700 1 -- 172.21.15.62:0/1294580354 shutdown_connections 2021-12-17T18:28:11.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.680+0000 7fb0fbfff700 1 -- 172.21.15.62:0/1294580354 wait complete. 2021-12-17T18:28:11.689 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.1 2021-12-17T18:28:11.697 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-12-17T18:28:11.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.804+0000 7fa7698df700 1 Processor -- start 2021-12-17T18:28:11.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.804+0000 7fa7698df700 1 -- start start 2021-12-17T18:28:11.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.804+0000 7fa7698df700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa76405ca90 0x7fa76414abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.804+0000 7fa7698df700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7640b5810 0x7fa76414b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.804+0000 7fa7698df700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7640b3130 con 0x7fa76414b590 2021-12-17T18:28:11.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.804+0000 7fa7698df700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76405ce70 con 0x7fa76405ca90 2021-12-17T18:28:11.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.804+0000 7fa7698df700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76414b9f0 con 0x7fa7640b5810 2021-12-17T18:28:11.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.804+0000 7fa75bfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7640b5810 0x7fa76414b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.804+0000 7fa7688dd700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa76405ca90 0x7fa76414abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.804+0000 7fa75bfff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7640b5810 0x7fa76414b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:51068/0 (socket says 172.21.15.62:51068) 2021-12-17T18:28:11.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.804+0000 7fa75bfff700 1 -- 172.21.15.62:0/3427275799 learned_addr learned my addr 172.21.15.62:0/3427275799 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:11.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.804+0000 7fa7690de700 1 --1- 172.21.15.62:0/3427275799 >> v1:172.21.15.109:6789/0 conn(0x7fa76414b590 0x7fa764146510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:57268/0 (socket says 172.21.15.62:57268) 2021-12-17T18:28:11.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.804+0000 7fa75bfff700 1 -- 172.21.15.62:0/3427275799 >> v2:172.21.15.109:3300/0 conn(0x7fa76405ca90 msgr2=0x7fa76414abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:11.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.804+0000 7fa75bfff700 1 --2- 172.21.15.62:0/3427275799 >> v2:172.21.15.109:3300/0 conn(0x7fa76405ca90 0x7fa76414abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.804+0000 7fa75bfff700 1 -- 172.21.15.62:0/3427275799 >> v1:172.21.15.109:6789/0 conn(0x7fa76414b590 legacy=0x7fa764146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:11.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.804+0000 7fa75bfff700 1 -- 172.21.15.62:0/3427275799 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7640b4a60 con 0x7fa7640b5810 2021-12-17T18:28:11.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.804+0000 7fa75bfff700 1 --2- 172.21.15.62:0/3427275799 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7640b5810 0x7fa76414b0a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fa754002f70 tx=0x7fa754006eb0).ready entity=mon.2 client_cookie=bb72e6c2fb4f4ad5 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:11.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.808+0000 7fa75b7fe700 1 -- 172.21.15.62:0/3427275799 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa75400d570 con 0x7fa7640b5810 2021-12-17T18:28:11.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.808+0000 7fa75b7fe700 1 -- 172.21.15.62:0/3427275799 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa754000e90 con 0x7fa7640b5810 2021-12-17T18:28:11.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.808+0000 7fa75b7fe700 1 -- 172.21.15.62:0/3427275799 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa75400d900 con 0x7fa7640b5810 2021-12-17T18:28:11.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.808+0000 7fa7698df700 1 -- 172.21.15.62:0/3427275799 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7640b5810 msgr2=0x7fa76414b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:11.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.808+0000 7fa7698df700 1 --2- 172.21.15.62:0/3427275799 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7640b5810 0x7fa76414b0a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fa754002f70 tx=0x7fa754006eb0).stop 2021-12-17T18:28:11.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.808+0000 7fa7698df700 1 -- 172.21.15.62:0/3427275799 shutdown_connections 2021-12-17T18:28:11.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.808+0000 7fa7698df700 1 --2- 172.21.15.62:0/3427275799 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7640b5810 0x7fa76414b0a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.808+0000 7fa7698df700 1 --2- 172.21.15.62:0/3427275799 >> v2:172.21.15.109:3300/0 conn(0x7fa76405ca90 0x7fa76414abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.808+0000 7fa7698df700 1 -- 172.21.15.62:0/3427275799 >> 172.21.15.62:0/3427275799 conn(0x7fa76405bcd0 msgr2=0x7fa764062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:11.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.808+0000 7fa7698df700 1 -- 172.21.15.62:0/3427275799 shutdown_connections 2021-12-17T18:28:11.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.808+0000 7fa7698df700 1 -- 172.21.15.62:0/3427275799 wait complete. 2021-12-17T18:28:11.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.808+0000 7fa7698df700 1 Processor -- start 2021-12-17T18:28:11.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.808+0000 7fa7698df700 1 -- start start 2021-12-17T18:28:11.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa7698df700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa76405ca90 0x7fa764065b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa7698df700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7640b5810 0x7fa764064610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa7698df700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa76414b590 0x7fa764064b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa7698df700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7641579e0 con 0x7fa7640b5810 2021-12-17T18:28:11.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa7698df700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa764157000 con 0x7fa76414b590 2021-12-17T18:28:11.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa7698df700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7641572a0 con 0x7fa76405ca90 2021-12-17T18:28:11.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa75bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7640b5810 0x7fa764064610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa75bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7640b5810 0x7fa764064610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57372/0 (socket says 172.21.15.62:57372) 2021-12-17T18:28:11.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa75bfff700 1 -- 172.21.15.62:0/1811239891 learned_addr learned my addr 172.21.15.62:0/1811239891 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:11.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa7688dd700 1 --2- 172.21.15.62:0/1811239891 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa76405ca90 0x7fa764065b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa7690de700 1 --2- 172.21.15.62:0/1811239891 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa76414b590 0x7fa764064b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa75bfff700 1 -- 172.21.15.62:0/1811239891 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa76405ca90 msgr2=0x7fa764065b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:11.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa75bfff700 1 --2- 172.21.15.62:0/1811239891 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa76405ca90 0x7fa764065b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa75bfff700 1 -- 172.21.15.62:0/1811239891 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa76414b590 msgr2=0x7fa764064b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:11.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa75bfff700 1 --2- 172.21.15.62:0/1811239891 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa76414b590 0x7fa764064b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:11.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa75bfff700 1 -- 172.21.15.62:0/1811239891 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75400b1e0 con 0x7fa7640b5810 2021-12-17T18:28:11.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa75bfff700 1 --2- 172.21.15.62:0/1811239891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7640b5810 0x7fa764064610 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7fa754002f70 tx=0x7fa754015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:11.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa759ffb700 1 -- 172.21.15.62:0/1811239891 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa754011760 con 0x7fa7640b5810 2021-12-17T18:28:11.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa759ffb700 1 -- 172.21.15.62:0/1811239891 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7540118c0 con 0x7fa7640b5810 2021-12-17T18:28:11.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa7698df700 1 -- 172.21.15.62:0/1811239891 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa764157540 con 0x7fa7640b5810 2021-12-17T18:28:11.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa759ffb700 1 -- 172.21.15.62:0/1811239891 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa754011c20 con 0x7fa7640b5810 2021-12-17T18:28:11.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa7698df700 1 -- 172.21.15.62:0/1811239891 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa764156a80 con 0x7fa7640b5810 2021-12-17T18:28:11.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa7698df700 1 -- 172.21.15.62:0/1811239891 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa764156e40 con 0x7fa7640b5810 2021-12-17T18:28:11.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.812+0000 7fa759ffb700 1 -- 172.21.15.62:0/1811239891 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa754025030 con 0x7fa7640b5810 2021-12-17T18:28:11.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.816+0000 7fa759ffb700 1 --2- 172.21.15.62:0/1811239891 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa744053580 0x7fa744055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:11.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.816+0000 7fa759ffb700 1 -- 172.21.15.62:0/1811239891 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa75406cb10 con 0x7fa7640b5810 2021-12-17T18:28:11.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.816+0000 7fa7688dd700 1 --2- 172.21.15.62:0/1811239891 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa744053580 0x7fa744055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:11.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.816+0000 7fa7688dd700 1 --2- 172.21.15.62:0/1811239891 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa744053580 0x7fa744055a40 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fa76000b000 tx=0x7fa760006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:11.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.820+0000 7fa759ffb700 1 -- 172.21.15.62:0/1811239891 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa754043c70 con 0x7fa7640b5810 2021-12-17T18:28:11.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.984+0000 7fa7698df700 1 -- 172.21.15.62:0/1811239891 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa7641576d0 con 0x7fa7640b5810 2021-12-17T18:28:11.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.992+0000 7fa759ffb700 1 -- 172.21.15.62:0/1811239891 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v47) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa754023020 con 0x7fa7640b5810 2021-12-17T18:28:12.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.996+0000 7fa7698df700 1 -- 172.21.15.62:0/1811239891 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa744053580 msgr2=0x7fa744055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:12.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.996+0000 7fa7698df700 1 --2- 172.21.15.62:0/1811239891 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa744053580 0x7fa744055a40 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fa76000b000 tx=0x7fa760006df0).stop 2021-12-17T18:28:12.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.996+0000 7fa7698df700 1 -- 172.21.15.62:0/1811239891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7640b5810 msgr2=0x7fa764064610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:12.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.996+0000 7fa7698df700 1 --2- 172.21.15.62:0/1811239891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7640b5810 0x7fa764064610 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7fa754002f70 tx=0x7fa754015000).stop 2021-12-17T18:28:12.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.996+0000 7fa7698df700 1 -- 172.21.15.62:0/1811239891 shutdown_connections 2021-12-17T18:28:12.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.996+0000 7fa7698df700 1 --2- 172.21.15.62:0/1811239891 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa744053580 0x7fa744055a40 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.996+0000 7fa7698df700 1 --2- 172.21.15.62:0/1811239891 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa76414b590 0x7fa764064b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.996+0000 7fa7698df700 1 --2- 172.21.15.62:0/1811239891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7640b5810 0x7fa764064610 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.996+0000 7fa7698df700 1 --2- 172.21.15.62:0/1811239891 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa76405ca90 0x7fa764065b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.996+0000 7fa7698df700 1 -- 172.21.15.62:0/1811239891 >> 172.21.15.62:0/1811239891 conn(0x7fa76405bcd0 msgr2=0x7fa7640b74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:12.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.996+0000 7fa7698df700 1 -- 172.21.15.62:0/1811239891 shutdown_connections 2021-12-17T18:28:12.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:11.996+0000 7fa7698df700 1 -- 172.21.15.62:0/1811239891 wait complete. 2021-12-17T18:28:12.005 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.2 2021-12-17T18:28:12.015 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:28:12.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb6c2f700 1 Processor -- start 2021-12-17T18:28:12.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb6c2f700 1 -- start start 2021-12-17T18:28:12.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb6c2f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8fb00ad360 0x7f8fb00679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:12.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb6c2f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8fb00b57e0 0x7f8fb00b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:12.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb6c2f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb00b2e90 con 0x7f8fb005ffe0 2021-12-17T18:28:12.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb6c2f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb00b4b70 con 0x7f8fb00b57e0 2021-12-17T18:28:12.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb6c2f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00b4e10 con 0x7f8fb00ad360 2021-12-17T18:28:12.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb49cb700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8fb005ffe0 0x7f8fb00b32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40958/0 (socket says 172.21.15.62:40958) 2021-12-17T18:28:12.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb49cb700 1 -- 172.21.15.62:0/3018843287 learned_addr learned my addr 172.21.15.62:0/3018843287 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:12.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb51cc700 1 --2- 172.21.15.62:0/3018843287 >> v2:172.21.15.62:3300/0 conn(0x7f8fb00b57e0 0x7f8fb00b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:12.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8faffff700 1 --2- 172.21.15.62:0/3018843287 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8fb00ad360 0x7f8fb00679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:12.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8faf7fe700 1 -- 172.21.15.62:0/3018843287 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151987164 0 0) 0x7f8fb00b2e90 con 0x7f8fb005ffe0 2021-12-17T18:28:12.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8faf7fe700 1 -- 172.21.15.62:0/3018843287 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f90003260 con 0x7f8fb005ffe0 2021-12-17T18:28:12.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8faffff700 1 -- 172.21.15.62:0/3018843287 >> v2:172.21.15.62:3300/0 conn(0x7f8fb00b57e0 msgr2=0x7f8fb00b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:12.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8faffff700 1 --2- 172.21.15.62:0/3018843287 >> v2:172.21.15.62:3300/0 conn(0x7f8fb00b57e0 0x7f8fb00b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8faffff700 1 -- 172.21.15.62:0/3018843287 >> v1:172.21.15.62:6789/0 conn(0x7f8fb005ffe0 legacy=0x7f8fb00b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:12.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8faffff700 1 -- 172.21.15.62:0/3018843287 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb00b52b0 con 0x7f8fb00ad360 2021-12-17T18:28:12.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8faffff700 1 --2- 172.21.15.62:0/3018843287 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8fb00ad360 0x7f8fb00679c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f8f98002f70 tx=0x7f8f98006df0).ready entity=mon.2 client_cookie=a2ad315b2654895c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:12.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8faf7fe700 1 -- 172.21.15.62:0/3018843287 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f9800d4a0 con 0x7f8fb00ad360 2021-12-17T18:28:12.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8faf7fe700 1 -- 172.21.15.62:0/3018843287 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f98000e90 con 0x7f8fb00ad360 2021-12-17T18:28:12.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8faf7fe700 1 -- 172.21.15.62:0/3018843287 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f9800d7f0 con 0x7f8fb00ad360 2021-12-17T18:28:12.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb6c2f700 1 -- 172.21.15.62:0/3018843287 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8fb00ad360 msgr2=0x7f8fb00679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:12.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb6c2f700 1 --2- 172.21.15.62:0/3018843287 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8fb00ad360 0x7f8fb00679c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f8f98002f70 tx=0x7f8f98006df0).stop 2021-12-17T18:28:12.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb6c2f700 1 -- 172.21.15.62:0/3018843287 shutdown_connections 2021-12-17T18:28:12.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb6c2f700 1 --2- 172.21.15.62:0/3018843287 >> v2:172.21.15.62:3300/0 conn(0x7f8fb00b57e0 0x7f8fb00b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb6c2f700 1 --2- 172.21.15.62:0/3018843287 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8fb00ad360 0x7f8fb00679c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb6c2f700 1 -- 172.21.15.62:0/3018843287 >> 172.21.15.62:0/3018843287 conn(0x7f8fb00626d0 msgr2=0x7f8fb005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:12.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb6c2f700 1 -- 172.21.15.62:0/3018843287 shutdown_connections 2021-12-17T18:28:12.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.112+0000 7f8fb6c2f700 1 -- 172.21.15.62:0/3018843287 wait complete. 2021-12-17T18:28:12.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb6c2f700 1 Processor -- start 2021-12-17T18:28:12.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb6c2f700 1 -- start start 2021-12-17T18:28:12.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb6c2f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8fb005ffe0 0x7f8fb00adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:12.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb6c2f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8fb00ad360 0x7f8fb0066850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:12.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb6c2f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8fb00b57e0 0x7f8fb0155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:12.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb6c2f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00675c0 con 0x7f8fb00b57e0 2021-12-17T18:28:12.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb6c2f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0066110 con 0x7f8fb005ffe0 2021-12-17T18:28:12.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb6c2f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00663b0 con 0x7f8fb00ad360 2021-12-17T18:28:12.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb51cc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8fb00b57e0 0x7f8fb0155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:12.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb51cc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8fb00b57e0 0x7f8fb0155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57386/0 (socket says 172.21.15.62:57386) 2021-12-17T18:28:12.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb51cc700 1 -- 172.21.15.62:0/2585041487 learned_addr learned my addr 172.21.15.62:0/2585041487 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:12.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8faffff700 1 --2- 172.21.15.62:0/2585041487 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8fb00ad360 0x7f8fb0066850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:12.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb49cb700 1 --2- 172.21.15.62:0/2585041487 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8fb005ffe0 0x7f8fb00adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:12.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb51cc700 1 -- 172.21.15.62:0/2585041487 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8fb00ad360 msgr2=0x7f8fb0066850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:12.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb51cc700 1 --2- 172.21.15.62:0/2585041487 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8fb00ad360 0x7f8fb0066850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb51cc700 1 -- 172.21.15.62:0/2585041487 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8fb005ffe0 msgr2=0x7f8fb00adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:12.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb51cc700 1 --2- 172.21.15.62:0/2585041487 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8fb005ffe0 0x7f8fb00adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb51cc700 1 -- 172.21.15.62:0/2585041487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9800b180 con 0x7f8fb00b57e0 2021-12-17T18:28:12.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb49cb700 1 --2- 172.21.15.62:0/2585041487 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8fb005ffe0 0x7f8fb00adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T18:28:12.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb51cc700 1 --2- 172.21.15.62:0/2585041487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8fb00b57e0 0x7f8fb0155e50 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f8fa000c000 tx=0x7f8fa0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:12.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fadffb700 1 -- 172.21.15.62:0/2585041487 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fa0010780 con 0x7f8fb00b57e0 2021-12-17T18:28:12.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fadffb700 1 -- 172.21.15.62:0/2585041487 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa00108e0 con 0x7f8fb00b57e0 2021-12-17T18:28:12.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb6c2f700 1 -- 172.21.15.62:0/2585041487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb0064c30 con 0x7f8fb00b57e0 2021-12-17T18:28:12.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fadffb700 1 -- 172.21.15.62:0/2585041487 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fa0010c40 con 0x7f8fb00b57e0 2021-12-17T18:28:12.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fb6c2f700 1 -- 172.21.15.62:0/2585041487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb0067100 con 0x7f8fb00b57e0 2021-12-17T18:28:12.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.116+0000 7f8fadffb700 1 -- 172.21.15.62:0/2585041487 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8fa001c460 con 0x7f8fb00b57e0 2021-12-17T18:28:12.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.120+0000 7f8fadffb700 1 --2- 172.21.15.62:0/2585041487 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f94053580 0x7f8f94055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:12.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.120+0000 7f8fb6c2f700 1 -- 172.21.15.62:0/2585041487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb0066570 con 0x7f8fb00b57e0 2021-12-17T18:28:12.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.120+0000 7f8fadffb700 1 -- 172.21.15.62:0/2585041487 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8fa006bdd0 con 0x7f8fb00b57e0 2021-12-17T18:28:12.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.120+0000 7f8fb49cb700 1 --2- 172.21.15.62:0/2585041487 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f94053580 0x7f8f94055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:12.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.120+0000 7f8fb49cb700 1 --2- 172.21.15.62:0/2585041487 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f94053580 0x7f8f94055a40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f8fa8008000 tx=0x7f8fa8009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:12.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.124+0000 7f8fadffb700 1 -- 172.21.15.62:0/2585041487 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8fa0046900 con 0x7f8fb00b57e0 2021-12-17T18:28:12.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.284+0000 7f8fb6c2f700 1 -- 172.21.15.62:0/2585041487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fb00573d0 con 0x7f8fb00b57e0 2021-12-17T18:28:12.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.288+0000 7f8fadffb700 1 -- 172.21.15.62:0/2585041487 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f8fa00464f0 con 0x7f8fb00b57e0 2021-12-17T18:28:12.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:12.295 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":76,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3486639655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3486639655},{"type":"v1","addr":"172.21.15.109:6835","nonce":3486639655}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:28:09.455753+0000","modified":"2021-12-17T18:28:10.458774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7397},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7397":{"gid":7397,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/2348194620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2348194620},{"type":"v1","addr":"172.21.15.62:6833","nonce":2348194620}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-12-17T18:28:12.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.288+0000 7f8fb6c2f700 1 -- 172.21.15.62:0/2585041487 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f94053580 msgr2=0x7f8f94055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:12.296 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.288+0000 7f8fb6c2f700 1 --2- 172.21.15.62:0/2585041487 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f94053580 0x7f8f94055a40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f8fa8008000 tx=0x7f8fa8009040).stop 2021-12-17T18:28:12.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.288+0000 7f8fb6c2f700 1 -- 172.21.15.62:0/2585041487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8fb00b57e0 msgr2=0x7f8fb0155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:12.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.288+0000 7f8fb6c2f700 1 --2- 172.21.15.62:0/2585041487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8fb00b57e0 0x7f8fb0155e50 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f8fa000c000 tx=0x7f8fa0006df0).stop 2021-12-17T18:28:12.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.288+0000 7f8fb6c2f700 1 -- 172.21.15.62:0/2585041487 shutdown_connections 2021-12-17T18:28:12.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.288+0000 7f8fb6c2f700 1 --2- 172.21.15.62:0/2585041487 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8f94053580 0x7f8f94055a40 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.288+0000 7f8fb6c2f700 1 --2- 172.21.15.62:0/2585041487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8fb00b57e0 0x7f8fb0155e50 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.288+0000 7f8fb6c2f700 1 --2- 172.21.15.62:0/2585041487 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8fb00ad360 0x7f8fb0066850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.288+0000 7f8fb6c2f700 1 --2- 172.21.15.62:0/2585041487 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8fb005ffe0 0x7f8fb00adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.288+0000 7f8fb6c2f700 1 -- 172.21.15.62:0/2585041487 >> 172.21.15.62:0/2585041487 conn(0x7f8fb00626d0 msgr2=0x7f8fb00b6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:12.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.288+0000 7f8fb6c2f700 1 -- 172.21.15.62:0/2585041487 shutdown_connections 2021-12-17T18:28:12.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.288+0000 7f8fb6c2f700 1 -- 172.21.15.62:0/2585041487 wait complete. 2021-12-17T18:28:12.300 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 76 2021-12-17T18:28:12.509 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:28:09.455753+0000', 'modified': '2021-12-17T18:28:10.458774+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7397}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7397': {'gid': 7397, 'name': 'a', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/2348194620', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 2348194620}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 2348194620}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:28:12.510 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:28:12.511 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:28:12.631 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":7397,"want_state":"up:active","state":"up:active","rank_uptime":3.1561887660000001,"mdsmap_epoch":76,"osdmap_epoch":152,"osdmap_epoch_barrier":150,"uptime":8.1697376419999994} 2021-12-17T18:28:12.632 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 7397, "mdsmap_epoch": 76, "osdmap_epoch": 152, "osdmap_epoch_barrier": 150, "rank_uptime": 3.156188766, "state": "up:active", "uptime": 8.169737642, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:28:12.632 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:28:12.740 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.732+0000 7f9122d0c700 1 Processor -- start 2021-12-17T18:28:12.741 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.732+0000 7f9122d0c700 1 -- start start 2021-12-17T18:28:12.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.736+0000 7f9122d0c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f911c0b6060 0x7f911c13fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:12.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.736+0000 7f9122d0c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911c0b1540 con 0x7f911c0afcf0 2021-12-17T18:28:12.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.736+0000 7f9122d0c700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911c0b0160 con 0x7f911c0b5c80 2021-12-17T18:28:12.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.736+0000 7f9122d0c700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f911c143990 con 0x7f911c0b6060 2021-12-17T18:28:12.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.736+0000 7f912250b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f911c0afcf0 0x7f911c143280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40976/0 (socket says 172.21.15.62:40976) 2021-12-17T18:28:12.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.736+0000 7f912250b700 1 -- 172.21.15.62:0/1247209880 learned_addr learned my addr 172.21.15.62:0/1247209880 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:12.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.736+0000 7f9121509700 1 --2- 172.21.15.62:0/1247209880 >> v2:172.21.15.109:3300/0 conn(0x7f911c0b6060 0x7f911c13fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:12.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.736+0000 7f9120d08700 1 -- 172.21.15.62:0/1247209880 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744844399 0 0) 0x7f911c0b0160 con 0x7f911c0b5c80 2021-12-17T18:28:12.746 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.736+0000 7f9120d08700 1 -- 172.21.15.62:0/1247209880 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9104003260 con 0x7f911c0b5c80 2021-12-17T18:28:12.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.736+0000 7f9121509700 1 -- 172.21.15.62:0/1247209880 >> v1:172.21.15.109:6789/0 conn(0x7f911c0b5c80 legacy=0x7f911c142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:12.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.736+0000 7f9121509700 1 -- 172.21.15.62:0/1247209880 >> v1:172.21.15.62:6789/0 conn(0x7f911c0afcf0 legacy=0x7f911c143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:12.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.736+0000 7f9121509700 1 -- 172.21.15.62:0/1247209880 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c0af5b0 con 0x7f911c0b6060 2021-12-17T18:28:12.747 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.736+0000 7f9121509700 1 --2- 172.21.15.62:0/1247209880 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f911c0b6060 0x7f911c13fb60 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f910c002f70 tx=0x7f910c006e80).ready entity=mon.1 client_cookie=59d6b42ed6458556 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:12.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9120d08700 1 -- 172.21.15.62:0/1247209880 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f910c00f730 con 0x7f911c0b6060 2021-12-17T18:28:12.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9120d08700 1 -- 172.21.15.62:0/1247209880 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910c000e90 con 0x7f911c0b6060 2021-12-17T18:28:12.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9120d08700 1 -- 172.21.15.62:0/1247209880 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f910c00fa80 con 0x7f911c0b6060 2021-12-17T18:28:12.748 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9122d0c700 1 -- 172.21.15.62:0/1247209880 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f911c0b6060 msgr2=0x7f911c13fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:12.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9122d0c700 1 --2- 172.21.15.62:0/1247209880 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f911c0b6060 0x7f911c13fb60 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f910c002f70 tx=0x7f910c006e80).stop 2021-12-17T18:28:12.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9122d0c700 1 -- 172.21.15.62:0/1247209880 shutdown_connections 2021-12-17T18:28:12.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9122d0c700 1 --2- 172.21.15.62:0/1247209880 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f911c0b6060 0x7f911c13fb60 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.749 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9122d0c700 1 -- 172.21.15.62:0/1247209880 >> 172.21.15.62:0/1247209880 conn(0x7f911c05c750 msgr2=0x7f911c05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:12.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9122d0c700 1 -- 172.21.15.62:0/1247209880 shutdown_connections 2021-12-17T18:28:12.750 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9122d0c700 1 -- 172.21.15.62:0/1247209880 wait complete. 2021-12-17T18:28:12.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9122d0c700 1 Processor -- start 2021-12-17T18:28:12.753 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9122d0c700 1 -- start start 2021-12-17T18:28:12.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9122d0c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f911c0afcf0 0x7f911c0a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:12.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9122d0c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f911c0b5c80 0x7f911c066310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:12.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9122d0c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f911c0b6060 0x7f911c0647d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:12.754 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9122d0c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c13e0d0 con 0x7f911c0b6060 2021-12-17T18:28:12.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9122d0c700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c0a67e0 con 0x7f911c0b5c80 2021-12-17T18:28:12.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9122d0c700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911c065bd0 con 0x7f911c0afcf0 2021-12-17T18:28:12.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f912250b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f911c0b6060 0x7f911c0647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:12.755 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f912250b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f911c0b6060 0x7f911c0647d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57402/0 (socket says 172.21.15.62:57402) 2021-12-17T18:28:12.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f912250b700 1 -- 172.21.15.62:0/1002066146 learned_addr learned my addr 172.21.15.62:0/1002066146 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:12.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9121d0a700 1 --2- 172.21.15.62:0/1002066146 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f911c0afcf0 0x7f911c0a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:12.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.740+0000 7f9121509700 1 --2- 172.21.15.62:0/1002066146 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f911c0b5c80 0x7f911c066310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:12.756 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.744+0000 7f912250b700 1 -- 172.21.15.62:0/1002066146 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f911c0afcf0 msgr2=0x7f911c0a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:12.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.744+0000 7f912250b700 1 --2- 172.21.15.62:0/1002066146 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f911c0afcf0 0x7f911c0a6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.744+0000 7f912250b700 1 -- 172.21.15.62:0/1002066146 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f911c0b5c80 msgr2=0x7f911c066310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:12.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.744+0000 7f912250b700 1 --2- 172.21.15.62:0/1002066146 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f911c0b5c80 0x7f911c066310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.757 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.744+0000 7f912250b700 1 -- 172.21.15.62:0/1002066146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c00c310 con 0x7f911c0b6060 2021-12-17T18:28:12.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.744+0000 7f912250b700 1 --2- 172.21.15.62:0/1002066146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f911c0b6060 0x7f911c0647d0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f911c0af340 tx=0x7f9114007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:12.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.744+0000 7f910affd700 1 -- 172.21.15.62:0/1002066146 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9114005ba0 con 0x7f911c0b6060 2021-12-17T18:28:12.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.744+0000 7f910affd700 1 -- 172.21.15.62:0/1002066146 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114005d00 con 0x7f911c0b6060 2021-12-17T18:28:12.758 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.744+0000 7f9122d0c700 1 -- 172.21.15.62:0/1002066146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911c065e70 con 0x7f911c0b6060 2021-12-17T18:28:12.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.744+0000 7f910affd700 1 -- 172.21.15.62:0/1002066146 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91140072c0 con 0x7f911c0b6060 2021-12-17T18:28:12.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.744+0000 7f9122d0c700 1 -- 172.21.15.62:0/1002066146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911c0a6410 con 0x7f911c0b6060 2021-12-17T18:28:12.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.744+0000 7f9122d0c700 1 -- 172.21.15.62:0/1002066146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911c066000 con 0x7f911c0b6060 2021-12-17T18:28:12.759 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.744+0000 7f910affd700 1 -- 172.21.15.62:0/1002066146 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f911401a060 con 0x7f911c0b6060 2021-12-17T18:28:12.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.744+0000 7f910affd700 1 --2- 172.21.15.62:0/1002066146 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f90fc053610 0x7f90fc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:12.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.744+0000 7f910affd700 1 -- 172.21.15.62:0/1002066146 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f911406b330 con 0x7f911c0b6060 2021-12-17T18:28:12.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.748+0000 7f9121d0a700 1 --2- 172.21.15.62:0/1002066146 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f90fc053610 0x7f90fc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:12.760 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.748+0000 7f9121d0a700 1 --2- 172.21.15.62:0/1002066146 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f90fc053610 0x7f90fc055ad0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f911800d000 tx=0x7f9118007a20).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:12.761 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.752+0000 7f910affd700 1 -- 172.21.15.62:0/1002066146 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9114042490 con 0x7f911c0b6060 2021-12-17T18:28:12.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.880+0000 7f9122d0c700 1 -- 172.21.15.62:0/1002066146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f911c0573d0 con 0x7f911c0b6060 2021-12-17T18:28:12.889 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.884+0000 7f910affd700 1 -- 172.21.15.62:0/1002066146 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f9114018070 con 0x7f911c0b6060 2021-12-17T18:28:12.890 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:12.890 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":152,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:28:11.469406+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:28:07.237227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-12-17T18:28:08.465122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:28:12.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.884+0000 7f9122d0c700 1 -- 172.21.15.62:0/1002066146 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f90fc053610 msgr2=0x7f90fc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:12.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.884+0000 7f9122d0c700 1 --2- 172.21.15.62:0/1002066146 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f90fc053610 0x7f90fc055ad0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f911800d000 tx=0x7f9118007a20).stop 2021-12-17T18:28:12.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.884+0000 7f9122d0c700 1 -- 172.21.15.62:0/1002066146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f911c0b6060 msgr2=0x7f911c0647d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:12.892 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.884+0000 7f9122d0c700 1 --2- 172.21.15.62:0/1002066146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f911c0b6060 0x7f911c0647d0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f911c0af340 tx=0x7f9114007f40).stop 2021-12-17T18:28:12.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.884+0000 7f9122d0c700 1 -- 172.21.15.62:0/1002066146 shutdown_connections 2021-12-17T18:28:12.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.884+0000 7f9122d0c700 1 --2- 172.21.15.62:0/1002066146 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f90fc053610 0x7f90fc055ad0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.884+0000 7f9122d0c700 1 --2- 172.21.15.62:0/1002066146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f911c0b6060 0x7f911c0647d0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.884+0000 7f9122d0c700 1 --2- 172.21.15.62:0/1002066146 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f911c0b5c80 0x7f911c066310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.893 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.884+0000 7f9122d0c700 1 --2- 172.21.15.62:0/1002066146 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f911c0afcf0 0x7f911c0a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:12.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.884+0000 7f9122d0c700 1 -- 172.21.15.62:0/1002066146 >> 172.21.15.62:0/1002066146 conn(0x7f911c05c750 msgr2=0x7f911c142f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:12.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.884+0000 7f9122d0c700 1 -- 172.21.15.62:0/1002066146 shutdown_connections 2021-12-17T18:28:12.894 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:12.884+0000 7f9122d0c700 1 -- 172.21.15.62:0/1002066146 wait complete. 2021-12-17T18:28:12.903 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:28:07.237227+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '150', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:28:08.465122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:28:12.904 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:28:13.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.008+0000 7fef6f3f7700 1 Processor -- start 2021-12-17T18:28:13.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.008+0000 7fef6f3f7700 1 -- start start 2021-12-17T18:28:13.019 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6f3f7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef680b07c0 0x7fef680b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6f3f7700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef680606e0 con 0x7fef68147440 2021-12-17T18:28:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6f3f7700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef68060980 con 0x7fef680b5330 2021-12-17T18:28:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6f3f7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef68141950 con 0x7fef680b07c0 2021-12-17T18:28:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6d994700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fef68147440 0x7fef6814ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40988/0 (socket says 172.21.15.62:40988) 2021-12-17T18:28:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6d994700 1 -- 172.21.15.62:0/1666440064 learned_addr learned my addr 172.21.15.62:0/1666440064 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6c992700 1 --2- 172.21.15.62:0/1666440064 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef680b07c0 0x7fef680b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef5bfff700 1 -- 172.21.15.62:0/1666440064 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116980461 0 0) 0x7fef680606e0 con 0x7fef68147440 2021-12-17T18:28:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef5bfff700 1 -- 172.21.15.62:0/1666440064 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef4c003260 con 0x7fef68147440 2021-12-17T18:28:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef5bfff700 1 -- 172.21.15.62:0/1666440064 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089111609 0 0) 0x7fef68060980 con 0x7fef680b5330 2021-12-17T18:28:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef5bfff700 1 -- 172.21.15.62:0/1666440064 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef680606e0 con 0x7fef680b5330 2021-12-17T18:28:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef5bfff700 1 -- 172.21.15.62:0/1666440064 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 678043636 0 0) 0x7fef4c003260 con 0x7fef68147440 2021-12-17T18:28:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6c992700 1 -- 172.21.15.62:0/1666440064 >> v1:172.21.15.109:6789/0 conn(0x7fef680b5330 legacy=0x7fef68147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6c992700 1 -- 172.21.15.62:0/1666440064 >> v1:172.21.15.62:6789/0 conn(0x7fef68147440 legacy=0x7fef6814ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6c992700 1 -- 172.21.15.62:0/1666440064 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef68148250 con 0x7fef680b07c0 2021-12-17T18:28:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6c992700 1 --2- 172.21.15.62:0/1666440064 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef680b07c0 0x7fef680b5710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fef60001b80 tx=0x7fef64006df0).ready entity=mon.2 client_cookie=ce27104494a12540 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef5bfff700 1 -- 172.21.15.62:0/1666440064 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef600019e0 con 0x7fef680b07c0 2021-12-17T18:28:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef5bfff700 1 -- 172.21.15.62:0/1666440064 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef64000e90 con 0x7fef680b07c0 2021-12-17T18:28:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef5bfff700 1 -- 172.21.15.62:0/1666440064 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef64012460 con 0x7fef680b07c0 2021-12-17T18:28:13.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6f3f7700 1 -- 172.21.15.62:0/1666440064 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef680b07c0 msgr2=0x7fef680b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6f3f7700 1 --2- 172.21.15.62:0/1666440064 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef680b07c0 0x7fef680b5710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fef60001b80 tx=0x7fef64006df0).stop 2021-12-17T18:28:13.028 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6f3f7700 1 -- 172.21.15.62:0/1666440064 shutdown_connections 2021-12-17T18:28:13.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6f3f7700 1 --2- 172.21.15.62:0/1666440064 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef680b07c0 0x7fef680b5710 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6f3f7700 1 -- 172.21.15.62:0/1666440064 >> 172.21.15.62:0/1666440064 conn(0x7fef6805c750 msgr2=0x7fef6805cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:13.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6f3f7700 1 -- 172.21.15.62:0/1666440064 shutdown_connections 2021-12-17T18:28:13.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.012+0000 7fef6f3f7700 1 -- 172.21.15.62:0/1666440064 wait complete. 2021-12-17T18:28:13.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6f3f7700 1 Processor -- start 2021-12-17T18:28:13.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6f3f7700 1 -- start start 2021-12-17T18:28:13.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6f3f7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef680b07c0 0x7fef68141dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6f3f7700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fef680b5330 0x7fef68144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6f3f7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef68147440 0x7fef68143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6f3f7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef68144c70 con 0x7fef68147440 2021-12-17T18:28:13.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6f3f7700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef680aea20 con 0x7fef680b5330 2021-12-17T18:28:13.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6f3f7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef680aecc0 con 0x7fef680b07c0 2021-12-17T18:28:13.031 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6d994700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef68147440 0x7fef68143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6d994700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef68147440 0x7fef68143700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57414/0 (socket says 172.21.15.62:57414) 2021-12-17T18:28:13.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6d994700 1 -- 172.21.15.62:0/1978645426 learned_addr learned my addr 172.21.15.62:0/1978645426 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:13.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6c992700 1 --2- 172.21.15.62:0/1978645426 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fef680b5330 0x7fef68144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6d193700 1 --2- 172.21.15.62:0/1978645426 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef680b07c0 0x7fef68141dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6d994700 1 -- 172.21.15.62:0/1978645426 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef680b07c0 msgr2=0x7fef68141dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6d994700 1 --2- 172.21.15.62:0/1978645426 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef680b07c0 0x7fef68141dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6d994700 1 -- 172.21.15.62:0/1978645426 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fef680b5330 msgr2=0x7fef68144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6d994700 1 --2- 172.21.15.62:0/1978645426 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fef680b5330 0x7fef68144780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.033 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6d994700 1 -- 172.21.15.62:0/1978645426 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6400b180 con 0x7fef68147440 2021-12-17T18:28:13.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6d994700 1 --2- 172.21.15.62:0/1978645426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef68147440 0x7fef68143700 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7fef60001360 tx=0x7fef60001bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:13.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef5a7fc700 1 -- 172.21.15.62:0/1978645426 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef60004ab0 con 0x7fef68147440 2021-12-17T18:28:13.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef5a7fc700 1 -- 172.21.15.62:0/1978645426 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef60004c10 con 0x7fef68147440 2021-12-17T18:28:13.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef5a7fc700 1 -- 172.21.15.62:0/1978645426 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef60007170 con 0x7fef68147440 2021-12-17T18:28:13.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6f3f7700 1 -- 172.21.15.62:0/1978645426 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef680aef60 con 0x7fef68147440 2021-12-17T18:28:13.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.016+0000 7fef6f3f7700 1 -- 172.21.15.62:0/1978645426 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef680af620 con 0x7fef68147440 2021-12-17T18:28:13.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.020+0000 7fef6f3f7700 1 -- 172.21.15.62:0/1978645426 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef680ae1e0 con 0x7fef68147440 2021-12-17T18:28:13.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.020+0000 7fef5a7fc700 1 -- 172.21.15.62:0/1978645426 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fef600072d0 con 0x7fef68147440 2021-12-17T18:28:13.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.020+0000 7fef5a7fc700 1 --2- 172.21.15.62:0/1978645426 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fef50053520 0x7fef500559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.020+0000 7fef5a7fc700 1 -- 172.21.15.62:0/1978645426 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fef6006b630 con 0x7fef68147440 2021-12-17T18:28:13.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.020+0000 7fef6d193700 1 --2- 172.21.15.62:0/1978645426 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fef50053520 0x7fef500559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.020+0000 7fef6d193700 1 --2- 172.21.15.62:0/1978645426 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fef50053520 0x7fef500559e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fef5c00b000 tx=0x7fef5c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:13.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.028+0000 7fef5a7fc700 1 -- 172.21.15.62:0/1978645426 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fef680ae1e0 con 0x7fef68147440 2021-12-17T18:28:13.163 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.156+0000 7fef6f3f7700 1 -- 172.21.15.62:0/1978645426 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fef680ae1e0 con 0x7fef68147440 2021-12-17T18:28:13.164 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.156+0000 7fef5a7fc700 1 -- 172.21.15.62:0/1978645426 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v152) v1 ==== 110+0+10 (secure 0 0 0) 0x7fef680ae1e0 con 0x7fef68147440 2021-12-17T18:28:13.164 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:28:13.165 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.160+0000 7fef6f3f7700 1 -- 172.21.15.62:0/1978645426 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fef50053520 msgr2=0x7fef500559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.160+0000 7fef6f3f7700 1 --2- 172.21.15.62:0/1978645426 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fef50053520 0x7fef500559e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fef5c00b000 tx=0x7fef5c009040).stop 2021-12-17T18:28:13.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.160+0000 7fef6f3f7700 1 -- 172.21.15.62:0/1978645426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef68147440 msgr2=0x7fef68143700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.160+0000 7fef6f3f7700 1 --2- 172.21.15.62:0/1978645426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef68147440 0x7fef68143700 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7fef60001360 tx=0x7fef60001bc0).stop 2021-12-17T18:28:13.166 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.160+0000 7fef6f3f7700 1 -- 172.21.15.62:0/1978645426 shutdown_connections 2021-12-17T18:28:13.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.160+0000 7fef6f3f7700 1 --2- 172.21.15.62:0/1978645426 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fef50053520 0x7fef500559e0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.160+0000 7fef6f3f7700 1 --2- 172.21.15.62:0/1978645426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef68147440 0x7fef68143700 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.160+0000 7fef6f3f7700 1 --2- 172.21.15.62:0/1978645426 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fef680b5330 0x7fef68144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.167 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.160+0000 7fef6f3f7700 1 --2- 172.21.15.62:0/1978645426 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fef680b07c0 0x7fef68141dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.160+0000 7fef6f3f7700 1 -- 172.21.15.62:0/1978645426 >> 172.21.15.62:0/1978645426 conn(0x7fef6805c750 msgr2=0x7fef6805cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:13.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.160+0000 7fef6f3f7700 1 -- 172.21.15.62:0/1978645426 shutdown_connections 2021-12-17T18:28:13.168 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.160+0000 7fef6f3f7700 1 -- 172.21.15.62:0/1978645426 wait complete. 2021-12-17T18:28:13.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:28:13.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135b76700 1 Processor -- start 2021-12-17T18:28:13.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135b76700 1 -- start start 2021-12-17T18:28:13.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135b76700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd1300ac040 0x7fd1301475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135b76700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd130147ab0 0x7fd130146510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135b76700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd130060750 con 0x7fd13005ca90 2021-12-17T18:28:13.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135b76700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13014ba50 con 0x7fd130147ab0 2021-12-17T18:28:13.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135b76700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13014ac00 con 0x7fd1300ac040 2021-12-17T18:28:13.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135375700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd130147ab0 0x7fd130146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135375700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd130147ab0 0x7fd130146510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57424/0 (socket says 172.21.15.62:57424) 2021-12-17T18:28:13.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135375700 1 -- 172.21.15.62:0/3557475792 learned_addr learned my addr 172.21.15.62:0/3557475792 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:13.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd127fff700 1 --2- 172.21.15.62:0/3557475792 >> v2:172.21.15.109:3300/0 conn(0x7fd1300ac040 0x7fd1301475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135375700 1 -- 172.21.15.62:0/3557475792 >> v2:172.21.15.109:3300/0 conn(0x7fd1300ac040 msgr2=0x7fd1301475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:13.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135375700 1 --2- 172.21.15.62:0/3557475792 >> v2:172.21.15.109:3300/0 conn(0x7fd1300ac040 0x7fd1301475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135375700 1 -- 172.21.15.62:0/3557475792 >> v1:172.21.15.62:6789/0 conn(0x7fd13005ca90 legacy=0x7fd13014b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135375700 1 -- 172.21.15.62:0/3557475792 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13014aea0 con 0x7fd130147ab0 2021-12-17T18:28:13.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd127fff700 1 --2- 172.21.15.62:0/3557475792 >> v2:172.21.15.109:3300/0 conn(0x7fd1300ac040 0x7fd1301475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:28:13.291 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135375700 1 --2- 172.21.15.62:0/3557475792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd130147ab0 0x7fd130146510 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7fd1280032f0 tx=0x7fd128009290).ready entity=mon.0 client_cookie=60b4877255802864 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:13.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd1277fe700 1 -- 172.21.15.62:0/3557475792 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd12800b870 con 0x7fd130147ab0 2021-12-17T18:28:13.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd1277fe700 1 -- 172.21.15.62:0/3557475792 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12800b9d0 con 0x7fd130147ab0 2021-12-17T18:28:13.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd1277fe700 1 -- 172.21.15.62:0/3557475792 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd12800bb40 con 0x7fd130147ab0 2021-12-17T18:28:13.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135b76700 1 -- 172.21.15.62:0/3557475792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd130147ab0 msgr2=0x7fd130146510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.292 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135b76700 1 --2- 172.21.15.62:0/3557475792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd130147ab0 0x7fd130146510 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7fd1280032f0 tx=0x7fd128009290).stop 2021-12-17T18:28:13.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135b76700 1 -- 172.21.15.62:0/3557475792 shutdown_connections 2021-12-17T18:28:13.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135b76700 1 --2- 172.21.15.62:0/3557475792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd130147ab0 0x7fd130146510 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135b76700 1 --2- 172.21.15.62:0/3557475792 >> v2:172.21.15.109:3300/0 conn(0x7fd1300ac040 0x7fd1301475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.293 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135b76700 1 -- 172.21.15.62:0/3557475792 >> 172.21.15.62:0/3557475792 conn(0x7fd13005be70 msgr2=0x7fd130062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:13.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135b76700 1 -- 172.21.15.62:0/3557475792 shutdown_connections 2021-12-17T18:28:13.294 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.280+0000 7fd135b76700 1 -- 172.21.15.62:0/3557475792 wait complete. 2021-12-17T18:28:13.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd135b76700 1 Processor -- start 2021-12-17T18:28:13.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd135b76700 1 -- start start 2021-12-17T18:28:13.297 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd135b76700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd13005ca90 0x7fd13009e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd135b76700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1300ac040 0x7fd13009fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd135b76700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd130147ab0 0x7fd130155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd135b76700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300ae830 con 0x7fd1300ac040 2021-12-17T18:28:13.298 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd135b76700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300af0c0 con 0x7fd130147ab0 2021-12-17T18:28:13.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd135b76700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300ae590 con 0x7fd13005ca90 2021-12-17T18:28:13.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd127fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1300ac040 0x7fd13009fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd127fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1300ac040 0x7fd13009fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57428/0 (socket says 172.21.15.62:57428) 2021-12-17T18:28:13.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd127fff700 1 -- 172.21.15.62:0/871378867 learned_addr learned my addr 172.21.15.62:0/871378867 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:13.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd134b74700 1 --2- 172.21.15.62:0/871378867 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd13005ca90 0x7fd13009e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd135375700 1 --2- 172.21.15.62:0/871378867 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd130147ab0 0x7fd130155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd127fff700 1 -- 172.21.15.62:0/871378867 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd13005ca90 msgr2=0x7fd13009e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd127fff700 1 --2- 172.21.15.62:0/871378867 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd13005ca90 0x7fd13009e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd127fff700 1 -- 172.21.15.62:0/871378867 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd130147ab0 msgr2=0x7fd130155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd127fff700 1 --2- 172.21.15.62:0/871378867 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd130147ab0 0x7fd130155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd127fff700 1 -- 172.21.15.62:0/871378867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128009530 con 0x7fd1300ac040 2021-12-17T18:28:13.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd127fff700 1 --2- 172.21.15.62:0/871378867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1300ac040 0x7fd13009fea0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7fd120006940 tx=0x7fd120008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:13.301 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd125ffb700 1 -- 172.21.15.62:0/871378867 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd120011780 con 0x7fd1300ac040 2021-12-17T18:28:13.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd125ffb700 1 -- 172.21.15.62:0/871378867 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1200118e0 con 0x7fd1300ac040 2021-12-17T18:28:13.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd135b76700 1 -- 172.21.15.62:0/871378867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd130064330 con 0x7fd1300ac040 2021-12-17T18:28:13.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd125ffb700 1 -- 172.21.15.62:0/871378867 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd120011c40 con 0x7fd1300ac040 2021-12-17T18:28:13.302 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.284+0000 7fd135b76700 1 -- 172.21.15.62:0/871378867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1300a0390 con 0x7fd1300ac040 2021-12-17T18:28:13.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.288+0000 7fd135b76700 1 -- 172.21.15.62:0/871378867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1300644c0 con 0x7fd1300ac040 2021-12-17T18:28:13.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.288+0000 7fd125ffb700 1 -- 172.21.15.62:0/871378867 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd120012420 con 0x7fd1300ac040 2021-12-17T18:28:13.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.288+0000 7fd125ffb700 1 --2- 172.21.15.62:0/871378867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd110053580 0x7fd110055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.288+0000 7fd125ffb700 1 -- 172.21.15.62:0/871378867 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd12006b720 con 0x7fd1300ac040 2021-12-17T18:28:13.303 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.288+0000 7fd134b74700 1 --2- 172.21.15.62:0/871378867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd110053580 0x7fd110055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.288+0000 7fd134b74700 1 --2- 172.21.15.62:0/871378867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd110053580 0x7fd110055a40 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fd12c00d000 tx=0x7fd12c000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:13.304 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.296+0000 7fd125ffb700 1 -- 172.21.15.62:0/871378867 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd120042710 con 0x7fd1300ac040 2021-12-17T18:28:13.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.428+0000 7fd135b76700 1 -- 172.21.15.62:0/871378867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd13005ce70 con 0x7fd1300ac040 2021-12-17T18:28:13.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.428+0000 7fd125ffb700 1 -- 172.21.15.62:0/871378867 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v152) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd120045d30 con 0x7fd1300ac040 2021-12-17T18:28:13.436 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:28:13.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.432+0000 7fd135b76700 1 -- 172.21.15.62:0/871378867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd110053580 msgr2=0x7fd110055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.432+0000 7fd135b76700 1 --2- 172.21.15.62:0/871378867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd110053580 0x7fd110055a40 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fd12c00d000 tx=0x7fd12c000bc0).stop 2021-12-17T18:28:13.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.432+0000 7fd135b76700 1 -- 172.21.15.62:0/871378867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1300ac040 msgr2=0x7fd13009fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.432+0000 7fd135b76700 1 --2- 172.21.15.62:0/871378867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1300ac040 0x7fd13009fea0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7fd120006940 tx=0x7fd120008040).stop 2021-12-17T18:28:13.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.432+0000 7fd135b76700 1 -- 172.21.15.62:0/871378867 shutdown_connections 2021-12-17T18:28:13.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.432+0000 7fd135b76700 1 --2- 172.21.15.62:0/871378867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd110053580 0x7fd110055a40 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.432+0000 7fd135b76700 1 --2- 172.21.15.62:0/871378867 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd130147ab0 0x7fd130155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.432+0000 7fd135b76700 1 --2- 172.21.15.62:0/871378867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1300ac040 0x7fd13009fea0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.432+0000 7fd135b76700 1 --2- 172.21.15.62:0/871378867 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd13005ca90 0x7fd13009e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.432+0000 7fd135b76700 1 -- 172.21.15.62:0/871378867 >> 172.21.15.62:0/871378867 conn(0x7fd13005be70 msgr2=0x7fd1301449a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:13.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.432+0000 7fd135b76700 1 -- 172.21.15.62:0/871378867 shutdown_connections 2021-12-17T18:28:13.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.432+0000 7fd135b76700 1 -- 172.21.15.62:0/871378867 wait complete. 2021-12-17T18:28:13.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:28:13.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb39ffe700 1 Processor -- start 2021-12-17T18:28:13.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb39ffe700 1 -- start start 2021-12-17T18:28:13.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb39ffe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffb3405ca90 0x7ffb340b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb39ffe700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ffb340b47c0 0x7ffb340b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb39ffe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb340b5be0 0x7ffb34143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb39ffe700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb340b0870 con 0x7ffb3405ca90 2021-12-17T18:28:13.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb39ffe700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb3405ce70 con 0x7ffb340b47c0 2021-12-17T18:28:13.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb39ffe700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340b05d0 con 0x7ffb340b5be0 2021-12-17T18:28:13.566 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb38ffc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffb3405ca90 0x7ffb340b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb38ffc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffb3405ca90 0x7ffb340b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57434/0 (socket says 172.21.15.62:57434) 2021-12-17T18:28:13.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb38ffc700 1 -- 172.21.15.62:0/200765216 learned_addr learned my addr 172.21.15.62:0/200765216 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:13.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb33fff700 1 --2- 172.21.15.62:0/200765216 >> v2:172.21.15.109:3300/0 conn(0x7ffb340b47c0 0x7ffb340b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.567 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb397fd700 1 --2- 172.21.15.62:0/200765216 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb340b5be0 0x7ffb34143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb38ffc700 1 -- 172.21.15.62:0/200765216 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb340b5be0 msgr2=0x7ffb34143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:13.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb38ffc700 1 --2- 172.21.15.62:0/200765216 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb340b5be0 0x7ffb34143ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb38ffc700 1 -- 172.21.15.62:0/200765216 >> v2:172.21.15.109:3300/0 conn(0x7ffb340b47c0 msgr2=0x7ffb340b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:13.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb38ffc700 1 --2- 172.21.15.62:0/200765216 >> v2:172.21.15.109:3300/0 conn(0x7ffb340b47c0 0x7ffb340b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.556+0000 7ffb38ffc700 1 -- 172.21.15.62:0/200765216 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb340b5250 con 0x7ffb3405ca90 2021-12-17T18:28:13.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb38ffc700 1 --2- 172.21.15.62:0/200765216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb3405ca90 0x7ffb340b1d60 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7ffb28002f70 tx=0x7ffb28006eb0).ready entity=mon.0 client_cookie=cc33165a2b37e5f6 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:13.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb337fe700 1 -- 172.21.15.62:0/200765216 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb2800d570 con 0x7ffb3405ca90 2021-12-17T18:28:13.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb337fe700 1 -- 172.21.15.62:0/200765216 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb28000e90 con 0x7ffb3405ca90 2021-12-17T18:28:13.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb337fe700 1 -- 172.21.15.62:0/200765216 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb2800d900 con 0x7ffb3405ca90 2021-12-17T18:28:13.573 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb39ffe700 1 -- 172.21.15.62:0/200765216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb3405ca90 msgr2=0x7ffb340b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb39ffe700 1 --2- 172.21.15.62:0/200765216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb3405ca90 0x7ffb340b1d60 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7ffb28002f70 tx=0x7ffb28006eb0).stop 2021-12-17T18:28:13.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb39ffe700 1 -- 172.21.15.62:0/200765216 shutdown_connections 2021-12-17T18:28:13.574 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb39ffe700 1 --2- 172.21.15.62:0/200765216 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb340b5be0 0x7ffb34143ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb39ffe700 1 --2- 172.21.15.62:0/200765216 >> v2:172.21.15.109:3300/0 conn(0x7ffb340b47c0 0x7ffb340b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb39ffe700 1 --2- 172.21.15.62:0/200765216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb3405ca90 0x7ffb340b1d60 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb39ffe700 1 -- 172.21.15.62:0/200765216 >> 172.21.15.62:0/200765216 conn(0x7ffb3405bcd0 msgr2=0x7ffb34062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:13.575 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb39ffe700 1 -- 172.21.15.62:0/200765216 shutdown_connections 2021-12-17T18:28:13.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb39ffe700 1 -- 172.21.15.62:0/200765216 wait complete. 2021-12-17T18:28:13.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb39ffe700 1 Processor -- start 2021-12-17T18:28:13.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb39ffe700 1 -- start start 2021-12-17T18:28:13.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb39ffe700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb3405ca90 0x7ffb340a3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.576 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb39ffe700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb340b47c0 0x7ffb340af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb39ffe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb340b5be0 0x7ffb340afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb39ffe700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb341472e0 con 0x7ffb340b5be0 2021-12-17T18:28:13.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb39ffe700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340a4960 con 0x7ffb3405ca90 2021-12-17T18:28:13.577 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb39ffe700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340a4c00 con 0x7ffb340b47c0 2021-12-17T18:28:13.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb397fd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb340b5be0 0x7ffb340afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb397fd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb340b5be0 0x7ffb340afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57442/0 (socket says 172.21.15.62:57442) 2021-12-17T18:28:13.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb397fd700 1 -- 172.21.15.62:0/2454060419 learned_addr learned my addr 172.21.15.62:0/2454060419 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:13.578 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb33fff700 1 --2- 172.21.15.62:0/2454060419 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb340b47c0 0x7ffb340af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb38ffc700 1 --2- 172.21.15.62:0/2454060419 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb3405ca90 0x7ffb340a3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb397fd700 1 -- 172.21.15.62:0/2454060419 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb340b47c0 msgr2=0x7ffb340af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb397fd700 1 --2- 172.21.15.62:0/2454060419 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb340b47c0 0x7ffb340af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb397fd700 1 -- 172.21.15.62:0/2454060419 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb3405ca90 msgr2=0x7ffb340a3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.579 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb397fd700 1 --2- 172.21.15.62:0/2454060419 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb3405ca90 0x7ffb340a3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.560+0000 7ffb397fd700 1 -- 172.21.15.62:0/2454060419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2800b1e0 con 0x7ffb340b5be0 2021-12-17T18:28:13.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.564+0000 7ffb397fd700 1 --2- 172.21.15.62:0/2454060419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb340b5be0 0x7ffb340afd80 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7ffb2c006e00 tx=0x7ffb2c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:13.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.564+0000 7ffb31ffb700 1 -- 172.21.15.62:0/2454060419 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb2c00c7f0 con 0x7ffb340b5be0 2021-12-17T18:28:13.580 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.564+0000 7ffb31ffb700 1 -- 172.21.15.62:0/2454060419 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c00c950 con 0x7ffb340b5be0 2021-12-17T18:28:13.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.564+0000 7ffb31ffb700 1 -- 172.21.15.62:0/2454060419 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb2c00ccb0 con 0x7ffb340b5be0 2021-12-17T18:28:13.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.564+0000 7ffb39ffe700 1 -- 172.21.15.62:0/2454060419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb340a4ea0 con 0x7ffb340b5be0 2021-12-17T18:28:13.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.564+0000 7ffb39ffe700 1 -- 172.21.15.62:0/2454060419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb34148650 con 0x7ffb340b5be0 2021-12-17T18:28:13.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.564+0000 7ffb39ffe700 1 -- 172.21.15.62:0/2454060419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb340a4770 con 0x7ffb340b5be0 2021-12-17T18:28:13.581 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.564+0000 7ffb31ffb700 1 -- 172.21.15.62:0/2454060419 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffb2c0123f0 con 0x7ffb340b5be0 2021-12-17T18:28:13.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.564+0000 7ffb31ffb700 1 --2- 172.21.15.62:0/2454060419 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb14053610 0x7ffb14055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.564+0000 7ffb31ffb700 1 -- 172.21.15.62:0/2454060419 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffb2c06bbc0 con 0x7ffb340b5be0 2021-12-17T18:28:13.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.564+0000 7ffb38ffc700 1 --2- 172.21.15.62:0/2454060419 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb14053610 0x7ffb14055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.582 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.568+0000 7ffb38ffc700 1 --2- 172.21.15.62:0/2454060419 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb14053610 0x7ffb14055ad0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7ffb2801a000 tx=0x7ffb28015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:13.583 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.568+0000 7ffb31ffb700 1 -- 172.21.15.62:0/2454060419 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffb2c042cc0 con 0x7ffb340b5be0 2021-12-17T18:28:13.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.692+0000 7ffb39ffe700 1 -- 172.21.15.62:0/2454060419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb340b3980 con 0x7ffb340b5be0 2021-12-17T18:28:13.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.692+0000 7ffb31ffb700 1 -- 172.21.15.62:0/2454060419 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v152) v1 ==== 104+0+10 (secure 0 0 0) 0x7ffb2c0462e0 con 0x7ffb340b5be0 2021-12-17T18:28:13.700 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:28:13.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.696+0000 7ffb39ffe700 1 -- 172.21.15.62:0/2454060419 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb14053610 msgr2=0x7ffb14055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.696+0000 7ffb39ffe700 1 --2- 172.21.15.62:0/2454060419 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb14053610 0x7ffb14055ad0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7ffb2801a000 tx=0x7ffb28015000).stop 2021-12-17T18:28:13.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.696+0000 7ffb39ffe700 1 -- 172.21.15.62:0/2454060419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb340b5be0 msgr2=0x7ffb340afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.696+0000 7ffb39ffe700 1 --2- 172.21.15.62:0/2454060419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb340b5be0 0x7ffb340afd80 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7ffb2c006e00 tx=0x7ffb2c0091d0).stop 2021-12-17T18:28:13.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.696+0000 7ffb39ffe700 1 -- 172.21.15.62:0/2454060419 shutdown_connections 2021-12-17T18:28:13.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.696+0000 7ffb39ffe700 1 --2- 172.21.15.62:0/2454060419 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ffb14053610 0x7ffb14055ad0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.696+0000 7ffb39ffe700 1 --2- 172.21.15.62:0/2454060419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb340b5be0 0x7ffb340afd80 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.696+0000 7ffb39ffe700 1 --2- 172.21.15.62:0/2454060419 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ffb340b47c0 0x7ffb340af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.696+0000 7ffb39ffe700 1 --2- 172.21.15.62:0/2454060419 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ffb3405ca90 0x7ffb340a3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.696+0000 7ffb39ffe700 1 -- 172.21.15.62:0/2454060419 >> 172.21.15.62:0/2454060419 conn(0x7ffb3405bcd0 msgr2=0x7ffb340b7540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:13.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.696+0000 7ffb39ffe700 1 -- 172.21.15.62:0/2454060419 shutdown_connections 2021-12-17T18:28:13.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.696+0000 7ffb39ffe700 1 -- 172.21.15.62:0/2454060419 wait complete. 2021-12-17T18:28:13.713 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:28:13.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.816+0000 7fe7b0813700 1 Processor -- start 2021-12-17T18:28:13.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.816+0000 7fe7b0813700 1 -- start start 2021-12-17T18:28:13.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7b0813700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe7ac13e420 0x7fe7ac144320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7b0813700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe7ac0af160 0x7fe7ac063fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7b0813700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe7ac0af5c0 0x7fe7ac0b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7b0813700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7ac05bff0 con 0x7fe7ac0af160 2021-12-17T18:28:13.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7b0813700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7ac063bb0 con 0x7fe7ac0af5c0 2021-12-17T18:28:13.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7b0813700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac13e800 con 0x7fe7ac13e420 2021-12-17T18:28:13.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7a3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe7ac0af160 0x7fe7ac063fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7a3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe7ac0af160 0x7fe7ac063fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57452/0 (socket says 172.21.15.62:57452) 2021-12-17T18:28:13.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7a3fff700 1 -- 172.21.15.62:0/28946878 learned_addr learned my addr 172.21.15.62:0/28946878 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:13.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7abfff700 1 --2- 172.21.15.62:0/28946878 >> v2:172.21.15.109:3300/0 conn(0x7fe7ac0af5c0 0x7fe7ac0b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7ab7fe700 1 --2- 172.21.15.62:0/28946878 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe7ac13e420 0x7fe7ac144320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7a3fff700 1 -- 172.21.15.62:0/28946878 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe7ac13e420 msgr2=0x7fe7ac144320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:13.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7a3fff700 1 --2- 172.21.15.62:0/28946878 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe7ac13e420 0x7fe7ac144320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7a3fff700 1 -- 172.21.15.62:0/28946878 >> v2:172.21.15.109:3300/0 conn(0x7fe7ac0af5c0 msgr2=0x7fe7ac0b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:13.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7a3fff700 1 --2- 172.21.15.62:0/28946878 >> v2:172.21.15.109:3300/0 conn(0x7fe7ac0af5c0 0x7fe7ac0b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7a3fff700 1 -- 172.21.15.62:0/28946878 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac05c220 con 0x7fe7ac0af160 2021-12-17T18:28:13.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7a3fff700 1 --2- 172.21.15.62:0/28946878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7ac0af160 0x7fe7ac063fe0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fe794002f70 tx=0x7fe794006eb0).ready entity=mon.0 client_cookie=f3ed65227d63afd1 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:13.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7aaffd700 1 -- 172.21.15.62:0/28946878 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe79400d570 con 0x7fe7ac0af160 2021-12-17T18:28:13.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7aaffd700 1 -- 172.21.15.62:0/28946878 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe794000e90 con 0x7fe7ac0af160 2021-12-17T18:28:13.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7aaffd700 1 -- 172.21.15.62:0/28946878 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe79400d900 con 0x7fe7ac0af160 2021-12-17T18:28:13.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7b0813700 1 -- 172.21.15.62:0/28946878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7ac0af160 msgr2=0x7fe7ac063fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7b0813700 1 --2- 172.21.15.62:0/28946878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7ac0af160 0x7fe7ac063fe0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fe794002f70 tx=0x7fe794006eb0).stop 2021-12-17T18:28:13.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7b0813700 1 -- 172.21.15.62:0/28946878 shutdown_connections 2021-12-17T18:28:13.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7b0813700 1 --2- 172.21.15.62:0/28946878 >> v2:172.21.15.109:3300/0 conn(0x7fe7ac0af5c0 0x7fe7ac0b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7b0813700 1 --2- 172.21.15.62:0/28946878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7ac0af160 0x7fe7ac063fe0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7b0813700 1 --2- 172.21.15.62:0/28946878 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe7ac13e420 0x7fe7ac144320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7b0813700 1 -- 172.21.15.62:0/28946878 >> 172.21.15.62:0/28946878 conn(0x7fe7ac05c750 msgr2=0x7fe7ac05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:13.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7b0813700 1 -- 172.21.15.62:0/28946878 shutdown_connections 2021-12-17T18:28:13.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.820+0000 7fe7b0813700 1 -- 172.21.15.62:0/28946878 wait complete. 2021-12-17T18:28:13.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7b0813700 1 Processor -- start 2021-12-17T18:28:13.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7b0813700 1 -- start start 2021-12-17T18:28:13.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7b0813700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe7ac0af160 0x7fe7ac0adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7b0813700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe7ac0af5c0 0x7fe7ac063f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7b0813700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7ac13e420 0x7fe7ac152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7b0813700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0671e0 con 0x7fe7ac13e420 2021-12-17T18:28:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7b0813700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac152710 con 0x7fe7ac0af160 2021-12-17T18:28:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7b0813700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac1529b0 con 0x7fe7ac0af5c0 2021-12-17T18:28:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7abfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7ac13e420 0x7fe7ac152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7a3fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe7ac0af5c0 0x7fe7ac063f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7abfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7ac13e420 0x7fe7ac152e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57458/0 (socket says 172.21.15.62:57458) 2021-12-17T18:28:13.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7a3fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe7ac0af5c0 0x7fe7ac063f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:51156/0 (socket says 172.21.15.62:51156) 2021-12-17T18:28:13.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7abfff700 1 -- 172.21.15.62:0/547310113 learned_addr learned my addr 172.21.15.62:0/547310113 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:13.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7ab7fe700 1 --2- 172.21.15.62:0/547310113 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe7ac0af160 0x7fe7ac0adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7abfff700 1 -- 172.21.15.62:0/547310113 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe7ac0af5c0 msgr2=0x7fe7ac063f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7abfff700 1 --2- 172.21.15.62:0/547310113 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe7ac0af5c0 0x7fe7ac063f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7abfff700 1 -- 172.21.15.62:0/547310113 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe7ac0af160 msgr2=0x7fe7ac0adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7abfff700 1 --2- 172.21.15.62:0/547310113 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe7ac0af160 0x7fe7ac0adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7abfff700 1 -- 172.21.15.62:0/547310113 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79400b1e0 con 0x7fe7ac13e420 2021-12-17T18:28:13.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.824+0000 7fe7a3fff700 1 --2- 172.21.15.62:0/547310113 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe7ac0af5c0 0x7fe7ac063f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:28:13.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.828+0000 7fe7abfff700 1 --2- 172.21.15.62:0/547310113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7ac13e420 0x7fe7ac152e50 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7fe7a4006e00 tx=0x7fe7a40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:13.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.828+0000 7fe7a97fa700 1 -- 172.21.15.62:0/547310113 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7a400c640 con 0x7fe7ac13e420 2021-12-17T18:28:13.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.828+0000 7fe7a97fa700 1 -- 172.21.15.62:0/547310113 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a400c7a0 con 0x7fe7ac13e420 2021-12-17T18:28:13.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.828+0000 7fe7b0813700 1 -- 172.21.15.62:0/547310113 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ac0ae730 con 0x7fe7ac13e420 2021-12-17T18:28:13.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.828+0000 7fe7a97fa700 1 -- 172.21.15.62:0/547310113 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7a400cb00 con 0x7fe7ac13e420 2021-12-17T18:28:13.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.828+0000 7fe7b0813700 1 -- 172.21.15.62:0/547310113 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7ac064590 con 0x7fe7ac13e420 2021-12-17T18:28:13.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.828+0000 7fe7b0813700 1 -- 172.21.15.62:0/547310113 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7ac067d60 con 0x7fe7ac13e420 2021-12-17T18:28:13.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.828+0000 7fe7a97fa700 1 -- 172.21.15.62:0/547310113 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe7a400cc60 con 0x7fe7ac13e420 2021-12-17T18:28:13.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.828+0000 7fe7a97fa700 1 --2- 172.21.15.62:0/547310113 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe7840534f0 0x7fe7840559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:13.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.828+0000 7fe7a97fa700 1 -- 172.21.15.62:0/547310113 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe7a406bb60 con 0x7fe7ac13e420 2021-12-17T18:28:13.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.828+0000 7fe7ab7fe700 1 --2- 172.21.15.62:0/547310113 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe7840534f0 0x7fe7840559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:13.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.832+0000 7fe7ab7fe700 1 --2- 172.21.15.62:0/547310113 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe7840534f0 0x7fe7840559b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fe79c00b000 tx=0x7fe79c006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:13.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.836+0000 7fe7a97fa700 1 -- 172.21.15.62:0/547310113 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe7a4042cc0 con 0x7fe7ac13e420 2021-12-17T18:28:13.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.964+0000 7fe7b0813700 1 -- 172.21.15.62:0/547310113 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe7ac0573d0 con 0x7fe7ac13e420 2021-12-17T18:28:13.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.964+0000 7fe7a97fa700 1 -- 172.21.15.62:0/547310113 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v152) v1 ==== 100+0+10 (secure 0 0 0) 0x7fe7a40462e0 con 0x7fe7ac13e420 2021-12-17T18:28:13.972 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:28:13.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.968+0000 7fe7b0813700 1 -- 172.21.15.62:0/547310113 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe7840534f0 msgr2=0x7fe7840559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.968+0000 7fe7b0813700 1 --2- 172.21.15.62:0/547310113 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe7840534f0 0x7fe7840559b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fe79c00b000 tx=0x7fe79c006df0).stop 2021-12-17T18:28:13.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.968+0000 7fe7b0813700 1 -- 172.21.15.62:0/547310113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7ac13e420 msgr2=0x7fe7ac152e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:13.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.968+0000 7fe7b0813700 1 --2- 172.21.15.62:0/547310113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7ac13e420 0x7fe7ac152e50 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7fe7a4006e00 tx=0x7fe7a40091d0).stop 2021-12-17T18:28:13.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.968+0000 7fe7b0813700 1 -- 172.21.15.62:0/547310113 shutdown_connections 2021-12-17T18:28:13.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.968+0000 7fe7b0813700 1 --2- 172.21.15.62:0/547310113 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe7840534f0 0x7fe7840559b0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.968+0000 7fe7b0813700 1 --2- 172.21.15.62:0/547310113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7ac13e420 0x7fe7ac152e50 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.968+0000 7fe7b0813700 1 --2- 172.21.15.62:0/547310113 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe7ac0af5c0 0x7fe7ac063f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.968+0000 7fe7b0813700 1 --2- 172.21.15.62:0/547310113 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe7ac0af160 0x7fe7ac0adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:13.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.968+0000 7fe7b0813700 1 -- 172.21.15.62:0/547310113 >> 172.21.15.62:0/547310113 conn(0x7fe7ac05c750 msgr2=0x7fe7ac13b230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:13.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.968+0000 7fe7b0813700 1 -- 172.21.15.62:0/547310113 shutdown_connections 2021-12-17T18:28:13.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:13.968+0000 7fe7b0813700 1 -- 172.21.15.62:0/547310113 wait complete. 2021-12-17T18:28:13.985 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:28:13.986 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:28:14.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4b59e700 1 Processor -- start 2021-12-17T18:28:14.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4b59e700 1 -- start start 2021-12-17T18:28:14.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee4c0a8e10 0x7fee4c147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:14.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fee4c0a71e0 0x7fee4c0a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:14.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4b59e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c0b6270 con 0x7fee4c141480 2021-12-17T18:28:14.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c147610 con 0x7fee4c0a71e0 2021-12-17T18:28:14.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c1478b0 con 0x7fee4c0a8e10 2021-12-17T18:28:14.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4ad9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fee4c0a71e0 0x7fee4c0a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:14.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4ad9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fee4c0a71e0 0x7fee4c0a7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57466/0 (socket says 172.21.15.62:57466) 2021-12-17T18:28:14.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4ad9d700 1 -- 172.21.15.62:0/3984550595 learned_addr learned my addr 172.21.15.62:0/3984550595 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:14.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee49d9b700 1 --2- 172.21.15.62:0/3984550595 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee4c0a8e10 0x7fee4c147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:14.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4ad9d700 1 -- 172.21.15.62:0/3984550595 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee4c0a8e10 msgr2=0x7fee4c147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:14.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4ad9d700 1 --2- 172.21.15.62:0/3984550595 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee4c0a8e10 0x7fee4c147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:14.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4ad9d700 1 -- 172.21.15.62:0/3984550595 >> v1:172.21.15.109:6789/0 conn(0x7fee4c141480 legacy=0x7fee4c0b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:14.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4ad9d700 1 -- 172.21.15.62:0/3984550595 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c147b50 con 0x7fee4c0a71e0 2021-12-17T18:28:14.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4ad9d700 1 --2- 172.21.15.62:0/3984550595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee4c0a71e0 0x7fee4c0a7900 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7fee44002f70 tx=0x7fee44006eb0).ready entity=mon.0 client_cookie=c144405ccaad46f8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:14.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4959a700 1 -- 172.21.15.62:0/3984550595 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee4400d570 con 0x7fee4c0a71e0 2021-12-17T18:28:14.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4959a700 1 -- 172.21.15.62:0/3984550595 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee44000e90 con 0x7fee4c0a71e0 2021-12-17T18:28:14.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.084+0000 7fee4959a700 1 -- 172.21.15.62:0/3984550595 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee4400d900 con 0x7fee4c0a71e0 2021-12-17T18:28:14.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4b59e700 1 -- 172.21.15.62:0/3984550595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee4c0a71e0 msgr2=0x7fee4c0a7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:14.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4b59e700 1 --2- 172.21.15.62:0/3984550595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee4c0a71e0 0x7fee4c0a7900 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7fee44002f70 tx=0x7fee44006eb0).stop 2021-12-17T18:28:14.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4b59e700 1 -- 172.21.15.62:0/3984550595 shutdown_connections 2021-12-17T18:28:14.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4b59e700 1 --2- 172.21.15.62:0/3984550595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee4c0a71e0 0x7fee4c0a7900 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4b59e700 1 --2- 172.21.15.62:0/3984550595 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee4c0a8e10 0x7fee4c147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4b59e700 1 -- 172.21.15.62:0/3984550595 >> 172.21.15.62:0/3984550595 conn(0x7fee4c05d220 msgr2=0x7fee4c0b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4b59e700 1 -- 172.21.15.62:0/3984550595 shutdown_connections 2021-12-17T18:28:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4b59e700 1 -- 172.21.15.62:0/3984550595 wait complete. 2021-12-17T18:28:14.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4b59e700 1 Processor -- start 2021-12-17T18:28:14.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4b59e700 1 -- start start 2021-12-17T18:28:14.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee4c0a71e0 0x7fee4c0ab780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:14.103 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee4c0a8e10 0x7fee4c157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:14.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4b59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fee4c141480 0x7fee4c0662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:14.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c065170 con 0x7fee4c0a8e10 2021-12-17T18:28:14.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4b59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c157780 con 0x7fee4c141480 2021-12-17T18:28:14.104 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c1579a0 con 0x7fee4c0a71e0 2021-12-17T18:28:14.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee49d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee4c0a8e10 0x7fee4c157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:14.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee49d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee4c0a8e10 0x7fee4c157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57470/0 (socket says 172.21.15.62:57470) 2021-12-17T18:28:14.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee49d9b700 1 -- 172.21.15.62:0/1821386324 learned_addr learned my addr 172.21.15.62:0/1821386324 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:14.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4a59c700 1 --2- 172.21.15.62:0/1821386324 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee4c0a71e0 0x7fee4c0ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:14.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.088+0000 7fee4ad9d700 1 --2- 172.21.15.62:0/1821386324 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fee4c141480 0x7fee4c0662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:14.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.092+0000 7fee49d9b700 1 -- 172.21.15.62:0/1821386324 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee4c0a71e0 msgr2=0x7fee4c0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:14.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.092+0000 7fee49d9b700 1 --2- 172.21.15.62:0/1821386324 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee4c0a71e0 0x7fee4c0ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:14.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.092+0000 7fee49d9b700 1 -- 172.21.15.62:0/1821386324 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fee4c141480 msgr2=0x7fee4c0662e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:14.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.092+0000 7fee49d9b700 1 --2- 172.21.15.62:0/1821386324 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fee4c141480 0x7fee4c0662e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:14.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.092+0000 7fee49d9b700 1 -- 172.21.15.62:0/1821386324 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4400b1e0 con 0x7fee4c0a8e10 2021-12-17T18:28:14.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.092+0000 7fee49d9b700 1 --2- 172.21.15.62:0/1821386324 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee4c0a8e10 0x7fee4c157290 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7fee4c1578c0 tx=0x7fee3c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:14.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.092+0000 7fee3b7fe700 1 -- 172.21.15.62:0/1821386324 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee3c00eec0 con 0x7fee4c0a8e10 2021-12-17T18:28:14.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.092+0000 7fee3b7fe700 1 -- 172.21.15.62:0/1821386324 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c00c850 con 0x7fee4c0a8e10 2021-12-17T18:28:14.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.092+0000 7fee3b7fe700 1 -- 172.21.15.62:0/1821386324 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee3c00cbb0 con 0x7fee4c0a8e10 2021-12-17T18:28:14.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.092+0000 7fee4b59e700 1 -- 172.21.15.62:0/1821386324 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c157c40 con 0x7fee4c0a8e10 2021-12-17T18:28:14.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.092+0000 7fee4b59e700 1 -- 172.21.15.62:0/1821386324 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c0644e0 con 0x7fee4c0a8e10 2021-12-17T18:28:14.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.092+0000 7fee4b59e700 1 -- 172.21.15.62:0/1821386324 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4c157dd0 con 0x7fee4c0a8e10 2021-12-17T18:28:14.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.092+0000 7fee3b7fe700 1 -- 172.21.15.62:0/1821386324 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fee3c022070 con 0x7fee4c0a8e10 2021-12-17T18:28:14.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.092+0000 7fee3b7fe700 1 --2- 172.21.15.62:0/1821386324 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fee280536a0 0x7fee28055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:14.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.092+0000 7fee3b7fe700 1 -- 172.21.15.62:0/1821386324 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fee3c06bfe0 con 0x7fee4c0a8e10 2021-12-17T18:28:14.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.096+0000 7fee4a59c700 1 --2- 172.21.15.62:0/1821386324 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fee280536a0 0x7fee28055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:14.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.096+0000 7fee4a59c700 1 --2- 172.21.15.62:0/1821386324 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fee280536a0 0x7fee28055b60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fee4000d000 tx=0x7fee40007b70).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:14.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.100+0000 7fee3b7fe700 1 -- 172.21.15.62:0/1821386324 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fee3c043120 con 0x7fee4c0a8e10 2021-12-17T18:28:14.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.264+0000 7fee4b59e700 1 -- 172.21.15.62:0/1821386324 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee4c158060 con 0x7fee4c0a8e10 2021-12-17T18:28:14.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.264+0000 7fee3b7fe700 1 -- 172.21.15.62:0/1821386324 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+2145 (secure 0 0 0) 0x7fee3c046740 con 0x7fee4c0a8e10 2021-12-17T18:28:14.272 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:14.272 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":76,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3486639655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3486639655},{"type":"v1","addr":"172.21.15.109:6835","nonce":3486639655}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:28:09.455753+0000","modified":"2021-12-17T18:28:10.458774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7397},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7397":{"gid":7397,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/2348194620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2348194620},{"type":"v1","addr":"172.21.15.62:6833","nonce":2348194620}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-12-17T18:28:14.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.268+0000 7fee4b59e700 1 -- 172.21.15.62:0/1821386324 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fee280536a0 msgr2=0x7fee28055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:14.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.268+0000 7fee4b59e700 1 --2- 172.21.15.62:0/1821386324 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fee280536a0 0x7fee28055b60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fee4000d000 tx=0x7fee40007b70).stop 2021-12-17T18:28:14.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.268+0000 7fee4b59e700 1 -- 172.21.15.62:0/1821386324 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee4c0a8e10 msgr2=0x7fee4c157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:14.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.268+0000 7fee4b59e700 1 --2- 172.21.15.62:0/1821386324 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee4c0a8e10 0x7fee4c157290 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7fee4c1578c0 tx=0x7fee3c0091d0).stop 2021-12-17T18:28:14.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.268+0000 7fee4b59e700 1 -- 172.21.15.62:0/1821386324 shutdown_connections 2021-12-17T18:28:14.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.268+0000 7fee4b59e700 1 --2- 172.21.15.62:0/1821386324 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fee280536a0 0x7fee28055b60 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:14.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.268+0000 7fee4b59e700 1 --2- 172.21.15.62:0/1821386324 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fee4c141480 0x7fee4c0662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:14.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.268+0000 7fee4b59e700 1 --2- 172.21.15.62:0/1821386324 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee4c0a8e10 0x7fee4c157290 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:14.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.268+0000 7fee4b59e700 1 --2- 172.21.15.62:0/1821386324 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fee4c0a71e0 0x7fee4c0ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:14.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.268+0000 7fee4b59e700 1 -- 172.21.15.62:0/1821386324 >> 172.21.15.62:0/1821386324 conn(0x7fee4c05d220 msgr2=0x7fee4c13f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:14.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.268+0000 7fee4b59e700 1 -- 172.21.15.62:0/1821386324 shutdown_connections 2021-12-17T18:28:14.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:14.268+0000 7fee4b59e700 1 -- 172.21.15.62:0/1821386324 wait complete. 2021-12-17T18:28:14.278 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 76 2021-12-17T18:28:14.487 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:28:09.455753+0000', 'modified': '2021-12-17T18:28:10.458774+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7397}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7397': {'gid': 7397, 'name': 'a', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/2348194620', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 2348194620}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 2348194620}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:28:14.488 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:28:14.489 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:28:14.604 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":7397,"want_state":"up:active","state":"up:active","rank_uptime":5.1299574310000002,"mdsmap_epoch":76,"osdmap_epoch":152,"osdmap_epoch_barrier":150,"uptime":10.143505816999999} 2021-12-17T18:28:14.605 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 7397, "mdsmap_epoch": 76, "osdmap_epoch": 152, "osdmap_epoch_barrier": 150, "rank_uptime": 5.129957431, "state": "up:active", "uptime": 10.143505817, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:28:14.605 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:28:14.605 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-12-17T18:28:14.606 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-12-17T18:28:14.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:14.607 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:28:14.615 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:28:14.633 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:28:14.633 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:28:14.648 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:28:14.648 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:28:14.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:14.650 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:28:14.699 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:28:14.699 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:28:14.702 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:28:14.718 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:28:14.719 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:28:14.777 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:28:14.778 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:28:14.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:14.779 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:28:14.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2021-12-17T18:28:14.776+0000 7f3d471c7080 -1 init, newargv = 0x5601c61d9cb0 newargc=9 2021-12-17T18:28:14.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[15265]: starting ceph client 2021-12-17T18:28:14.790 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[15265]: starting fuse 2021-12-17T18:28:15.888 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2021-12-17T18:28:15.907 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:28:15.908 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:28:15.920 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:28:15.921 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:28:15.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:15.923 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2021-12-17T18:28:15.971 INFO:teuthology.orchestra.run.smithi125.stdout:52 2021-12-17T18:28:15.972 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:28:15.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:15.973 DEBUG:teuthology.orchestra.run.smithi125:> sudo python3 -c ' 2021-12-17T18:28:15.973 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2021-12-17T18:28:15.974 DEBUG:teuthology.orchestra.run.smithi125:> import re 2021-12-17T18:28:15.974 DEBUG:teuthology.orchestra.run.smithi125:> import os 2021-12-17T18:28:15.974 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2021-12-17T18:28:15.975 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:28:15.975 DEBUG:teuthology.orchestra.run.smithi125:> def find_socket(client_name): 2021-12-17T18:28:15.976 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-12-17T18:28:15.976 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2021-12-17T18:28:15.977 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:28:15.977 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2021-12-17T18:28:15.977 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2021-12-17T18:28:15.978 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2021-12-17T18:28:15.978 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2021-12-17T18:28:15.979 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:28:15.979 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2021-12-17T18:28:15.980 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:28:15.980 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:28:15.980 DEBUG:teuthology.orchestra.run.smithi125:> return f 2021-12-17T18:28:15.981 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:28:15.981 DEBUG:teuthology.orchestra.run.smithi125:> 2021-12-17T18:28:15.982 DEBUG:teuthology.orchestra.run.smithi125:> print(find_socket("client.0")) 2021-12-17T18:28:15.982 DEBUG:teuthology.orchestra.run.smithi125:> ' 2021-12-17T18:28:16.027 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.15265.asok 2021-12-17T18:28:16.032 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15265.asok 2021-12-17T18:28:16.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:16.033 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15265.asok status 2021-12-17T18:28:16.119 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2021-12-17T18:28:16.120 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2021-12-17T18:28:16.120 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:28:16.120 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:28:16.120 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2021-12-17T18:28:16.121 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2021-12-17T18:28:16.122 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-12-17T18:28:16.122 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "15265", 2021-12-17T18:28:16.123 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2021-12-17T18:28:16.123 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:28:16.123 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2021-12-17T18:28:16.123 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2021-12-17T18:28:16.124 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 7511, 2021-12-17T18:28:16.124 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2021-12-17T18:28:16.124 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2021-12-17T18:28:16.124 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2021-12-17T18:28:16.125 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 7511 2021-12-17T18:28:16.125 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:28:16.125 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:28:16.125 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:28:16.125 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:28:16.126 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 788226811 2021-12-17T18:28:16.126 INFO:teuthology.orchestra.run.smithi125.stdout: } 2021-12-17T18:28:16.126 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:28:16.126 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2021-12-17T18:28:16.127 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2021-12-17T18:28:16.127 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2021-12-17T18:28:16.127 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 788226811 2021-12-17T18:28:16.127 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2021-12-17T18:28:16.128 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.7511 172.21.15.125:0/788226811", 2021-12-17T18:28:16.128 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "172.21.15.125:0/788226811", 2021-12-17T18:28:16.128 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2021-12-17T18:28:16.128 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 76, 2021-12-17T18:28:16.129 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 152, 2021-12-17T18:28:16.129 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:28:16.129 INFO:teuthology.orchestra.run.smithi125.stdout: "blacklisted": false, 2021-12-17T18:28:16.129 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2021-12-17T18:28:16.130 INFO:teuthology.orchestra.run.smithi125.stdout:} 2021-12-17T18:28:16.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:16.131 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:28:16.132 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:28:16.139 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2021-12-17T18:28:16.140 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-12-17T18:28:16.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:16.141 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:28:16.158 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T18:28:16.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.264+0000 7ff4855d5700 1 Processor -- start 2021-12-17T18:28:16.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.264+0000 7ff4855d5700 1 -- start start 2021-12-17T18:28:16.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.264+0000 7ff4855d5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4800a8e10 0x7ff480147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.264+0000 7ff4855d5700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4800b6270 con 0x7ff4800a71e0 2021-12-17T18:28:16.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.264+0000 7ff4855d5700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff480147610 con 0x7ff480141480 2021-12-17T18:28:16.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.264+0000 7ff4855d5700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4801478b0 con 0x7ff4800a8e10 2021-12-17T18:28:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.264+0000 7ff484dd4700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff4800a71e0 0x7ff4800a7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41060/0 (socket says 172.21.15.62:41060) 2021-12-17T18:28:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.264+0000 7ff484dd4700 1 -- 172.21.15.62:0/3591228446 learned_addr learned my addr 172.21.15.62:0/3591228446 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.264+0000 7ff47f7fe700 1 --2- 172.21.15.62:0/3591228446 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4800a8e10 0x7ff480147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.264+0000 7ff47f7fe700 1 -- 172.21.15.62:0/3591228446 >> v1:172.21.15.109:6789/0 conn(0x7ff480141480 legacy=0x7ff4800b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.264+0000 7ff47f7fe700 1 -- 172.21.15.62:0/3591228446 >> v1:172.21.15.62:6789/0 conn(0x7ff4800a71e0 legacy=0x7ff4800a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.264+0000 7ff47effd700 1 -- 172.21.15.62:0/3591228446 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722513983 0 0) 0x7ff4800b6270 con 0x7ff4800a71e0 2021-12-17T18:28:16.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.264+0000 7ff47f7fe700 1 -- 172.21.15.62:0/3591228446 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff480147b50 con 0x7ff4800a8e10 2021-12-17T18:28:16.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.268+0000 7ff47f7fe700 1 --2- 172.21.15.62:0/3591228446 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4800a8e10 0x7ff480147ff0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7ff474001110 tx=0x7ff4700091d0).ready entity=mon.2 client_cookie=ebb33357551661b3 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:16.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.268+0000 7ff47effd700 1 -- 172.21.15.62:0/3591228446 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff47000b630 con 0x7ff4800a8e10 2021-12-17T18:28:16.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.268+0000 7ff47effd700 1 -- 172.21.15.62:0/3591228446 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47000b790 con 0x7ff4800a8e10 2021-12-17T18:28:16.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.268+0000 7ff47effd700 1 -- 172.21.15.62:0/3591228446 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff47000b900 con 0x7ff4800a8e10 2021-12-17T18:28:16.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.268+0000 7ff4855d5700 1 -- 172.21.15.62:0/3591228446 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4800a8e10 msgr2=0x7ff480147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.268+0000 7ff4855d5700 1 --2- 172.21.15.62:0/3591228446 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4800a8e10 0x7ff480147ff0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7ff474001110 tx=0x7ff4700091d0).stop 2021-12-17T18:28:16.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.268+0000 7ff4855d5700 1 -- 172.21.15.62:0/3591228446 shutdown_connections 2021-12-17T18:28:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.268+0000 7ff4855d5700 1 --2- 172.21.15.62:0/3591228446 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4800a8e10 0x7ff480147ff0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.268+0000 7ff4855d5700 1 -- 172.21.15.62:0/3591228446 >> 172.21.15.62:0/3591228446 conn(0x7ff48005d220 msgr2=0x7ff4800b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.268+0000 7ff4855d5700 1 -- 172.21.15.62:0/3591228446 shutdown_connections 2021-12-17T18:28:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.268+0000 7ff4855d5700 1 -- 172.21.15.62:0/3591228446 wait complete. 2021-12-17T18:28:16.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.268+0000 7ff4855d5700 1 Processor -- start 2021-12-17T18:28:16.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.268+0000 7ff4855d5700 1 -- start start 2021-12-17T18:28:16.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff4855d5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4800a71e0 0x7ff4800ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff4855d5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4800a8e10 0x7ff48013e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff4855d5700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff480141480 0x7ff48013e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff4855d5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48014a4b0 con 0x7ff4800a71e0 2021-12-17T18:28:16.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff4855d5700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48015a570 con 0x7ff480141480 2021-12-17T18:28:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff4855d5700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48014a210 con 0x7ff4800a8e10 2021-12-17T18:28:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff47ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4800a71e0 0x7ff4800ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff47ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4800a71e0 0x7ff4800ae690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57482/0 (socket says 172.21.15.62:57482) 2021-12-17T18:28:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff47ffff700 1 -- 172.21.15.62:0/3659612671 learned_addr learned my addr 172.21.15.62:0/3659612671 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff47f7fe700 1 --2- 172.21.15.62:0/3659612671 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4800a8e10 0x7ff48013e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff484dd4700 1 --2- 172.21.15.62:0/3659612671 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff480141480 0x7ff48013e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff47ffff700 1 -- 172.21.15.62:0/3659612671 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4800a8e10 msgr2=0x7ff48013e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff47ffff700 1 --2- 172.21.15.62:0/3659612671 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4800a8e10 0x7ff48013e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff47ffff700 1 -- 172.21.15.62:0/3659612671 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff480141480 msgr2=0x7ff48013e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff47ffff700 1 --2- 172.21.15.62:0/3659612671 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff480141480 0x7ff48013e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff47ffff700 1 -- 172.21.15.62:0/3659612671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff470009470 con 0x7ff4800a71e0 2021-12-17T18:28:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff484dd4700 1 --2- 172.21.15.62:0/3659612671 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff480141480 0x7ff48013e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:28:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff47ffff700 1 --2- 172.21.15.62:0/3659612671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4800a71e0 0x7ff4800ae690 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7ff474001150 tx=0x7ff474007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff47d7fa700 1 -- 172.21.15.62:0/3659612671 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff47400cea0 con 0x7ff4800a71e0 2021-12-17T18:28:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff47d7fa700 1 -- 172.21.15.62:0/3659612671 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff474007240 con 0x7ff4800a71e0 2021-12-17T18:28:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff4855d5700 1 -- 172.21.15.62:0/3659612671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4800a9810 con 0x7ff4800a71e0 2021-12-17T18:28:16.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff47d7fa700 1 -- 172.21.15.62:0/3659612671 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff474006700 con 0x7ff4800a71e0 2021-12-17T18:28:16.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.272+0000 7ff4855d5700 1 -- 172.21.15.62:0/3659612671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4800aeb80 con 0x7ff4800a71e0 2021-12-17T18:28:16.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.276+0000 7ff4855d5700 1 -- 172.21.15.62:0/3659612671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4800a99a0 con 0x7ff4800a71e0 2021-12-17T18:28:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.276+0000 7ff47d7fa700 1 -- 172.21.15.62:0/3659612671 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff474010030 con 0x7ff4800a71e0 2021-12-17T18:28:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.276+0000 7ff47d7fa700 1 --2- 172.21.15.62:0/3659612671 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff460053610 0x7ff460055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.276+0000 7ff47d7fa700 1 -- 172.21.15.62:0/3659612671 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff47406b6b0 con 0x7ff4800a71e0 2021-12-17T18:28:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.276+0000 7ff47f7fe700 1 --2- 172.21.15.62:0/3659612671 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff460053610 0x7ff460055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.276+0000 7ff47f7fe700 1 --2- 172.21.15.62:0/3659612671 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff460053610 0x7ff460055ad0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7ff47001b000 tx=0x7ff470016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.280+0000 7ff47d7fa700 1 -- 172.21.15.62:0/3659612671 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff474042810 con 0x7ff4800a71e0 2021-12-17T18:28:16.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.408+0000 7ff4855d5700 1 -- 172.21.15.62:0/3659612671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4800b1b90 con 0x7ff4800a71e0 2021-12-17T18:28:16.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.408+0000 7ff47d7fa700 1 -- 172.21.15.62:0/3659612671 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+16100 (secure 0 0 0) 0x7ff474045e30 con 0x7ff4800a71e0 2021-12-17T18:28:16.417 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:16.417 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":152,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:28:11.469406+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-12-17T18:28:07.237227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-12-17T18:28:08.465122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T18:28:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.412+0000 7ff4855d5700 1 -- 172.21.15.62:0/3659612671 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff460053610 msgr2=0x7ff460055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.412+0000 7ff4855d5700 1 --2- 172.21.15.62:0/3659612671 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff460053610 0x7ff460055ad0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7ff47001b000 tx=0x7ff470016000).stop 2021-12-17T18:28:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.412+0000 7ff4855d5700 1 -- 172.21.15.62:0/3659612671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4800a71e0 msgr2=0x7ff4800ae690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.412+0000 7ff4855d5700 1 --2- 172.21.15.62:0/3659612671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4800a71e0 0x7ff4800ae690 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7ff474001150 tx=0x7ff474007c00).stop 2021-12-17T18:28:16.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.412+0000 7ff4855d5700 1 -- 172.21.15.62:0/3659612671 shutdown_connections 2021-12-17T18:28:16.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.412+0000 7ff4855d5700 1 --2- 172.21.15.62:0/3659612671 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff460053610 0x7ff460055ad0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.412+0000 7ff4855d5700 1 --2- 172.21.15.62:0/3659612671 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff480141480 0x7ff48013e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.412+0000 7ff4855d5700 1 --2- 172.21.15.62:0/3659612671 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff4800a8e10 0x7ff48013e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.412+0000 7ff4855d5700 1 --2- 172.21.15.62:0/3659612671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4800a71e0 0x7ff4800ae690 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.412+0000 7ff4855d5700 1 -- 172.21.15.62:0/3659612671 >> 172.21.15.62:0/3659612671 conn(0x7ff48005d220 msgr2=0x7ff48005f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.412+0000 7ff4855d5700 1 -- 172.21.15.62:0/3659612671 shutdown_connections 2021-12-17T18:28:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.412+0000 7ff4855d5700 1 -- 172.21.15.62:0/3659612671 wait complete. 2021-12-17T18:28:16.430 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-12-17T18:18:05.577519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-12-17T18:18:13.880759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-12-17T18:28:07.237227+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '150', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-12-17T18:28:08.465122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-12-17T18:28:16.431 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-12-17T18:28:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.536+0000 7f1d11bca700 1 Processor -- start 2021-12-17T18:28:16.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.536+0000 7f1d11bca700 1 -- start start 2021-12-17T18:28:16.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.536+0000 7f1d11bca700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1d0c05ca90 0x7f1d0c0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.536+0000 7f1d11bca700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d0c0b40b0 0x7f1d0c143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.536+0000 7f1d11bca700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d0c0b0870 con 0x7f1d0c0b47c0 2021-12-17T18:28:16.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.536+0000 7f1d11bca700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d0c05ce70 con 0x7f1d0c05ca90 2021-12-17T18:28:16.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.536+0000 7f1d11bca700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c0b05d0 con 0x7f1d0c0b40b0 2021-12-17T18:28:16.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d113c9700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d0c0b40b0 0x7f1d0c143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d10bc8700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1d0c05ca90 0x7f1d0c0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d113c9700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d0c0b40b0 0x7f1d0c143ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:51196/0 (socket says 172.21.15.62:51196) 2021-12-17T18:28:16.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d10bc8700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f1d0c05ca90 0x7f1d0c0b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:35808/0 (socket says 172.21.15.62:35808) 2021-12-17T18:28:16.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d113c9700 1 -- 172.21.15.62:0/3978930428 learned_addr learned my addr 172.21.15.62:0/3978930428 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:16.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d0bfff700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f1d0c0b47c0 0x7f1d0c0b56f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:57392/0 (socket says 172.21.15.62:57392) 2021-12-17T18:28:16.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d113c9700 1 -- 172.21.15.62:0/3978930428 >> v2:172.21.15.109:3300/0 conn(0x7f1d0c05ca90 msgr2=0x7f1d0c0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:16.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d113c9700 1 --2- 172.21.15.62:0/3978930428 >> v2:172.21.15.109:3300/0 conn(0x7f1d0c05ca90 0x7f1d0c0b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d113c9700 1 -- 172.21.15.62:0/3978930428 >> v1:172.21.15.109:6789/0 conn(0x7f1d0c0b47c0 legacy=0x7f1d0c0b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d113c9700 1 -- 172.21.15.62:0/3978930428 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c0b5250 con 0x7f1d0c0b40b0 2021-12-17T18:28:16.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d113c9700 1 --2- 172.21.15.62:0/3978930428 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d0c0b40b0 0x7f1d0c143ba0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f1d040032f0 tx=0x7f1d04009290).ready entity=mon.2 client_cookie=8b3d51f6a0ad2f1f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:16.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d0b7fe700 1 -- 172.21.15.62:0/3978930428 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d0400b8a0 con 0x7f1d0c0b40b0 2021-12-17T18:28:16.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d0b7fe700 1 -- 172.21.15.62:0/3978930428 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0400ba00 con 0x7f1d0c0b40b0 2021-12-17T18:28:16.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d0b7fe700 1 -- 172.21.15.62:0/3978930428 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d0400bb70 con 0x7f1d0c0b40b0 2021-12-17T18:28:16.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d11bca700 1 -- 172.21.15.62:0/3978930428 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d0c0b40b0 msgr2=0x7f1d0c143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d11bca700 1 --2- 172.21.15.62:0/3978930428 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d0c0b40b0 0x7f1d0c143ba0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f1d040032f0 tx=0x7f1d04009290).stop 2021-12-17T18:28:16.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d11bca700 1 -- 172.21.15.62:0/3978930428 shutdown_connections 2021-12-17T18:28:16.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d11bca700 1 --2- 172.21.15.62:0/3978930428 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d0c0b40b0 0x7f1d0c143ba0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d11bca700 1 --2- 172.21.15.62:0/3978930428 >> v2:172.21.15.109:3300/0 conn(0x7f1d0c05ca90 0x7f1d0c0b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d11bca700 1 -- 172.21.15.62:0/3978930428 >> 172.21.15.62:0/3978930428 conn(0x7f1d0c05bcd0 msgr2=0x7f1d0c062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:16.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d11bca700 1 -- 172.21.15.62:0/3978930428 shutdown_connections 2021-12-17T18:28:16.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.540+0000 7f1d11bca700 1 -- 172.21.15.62:0/3978930428 wait complete. 2021-12-17T18:28:16.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.544+0000 7f1d11bca700 1 Processor -- start 2021-12-17T18:28:16.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.544+0000 7f1d11bca700 1 -- start start 2021-12-17T18:28:16.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.544+0000 7f1d11bca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d0c05ca90 0x7f1d0c146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.544+0000 7f1d11bca700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1d0c0b40b0 0x7f1d0c063ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.544+0000 7f1d11bca700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d0c0b47c0 0x7f1d0c152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.544+0000 7f1d11bca700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c0a4b70 con 0x7f1d0c05ca90 2021-12-17T18:28:16.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.544+0000 7f1d11bca700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c0635a0 con 0x7f1d0c0b40b0 2021-12-17T18:28:16.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.544+0000 7f1d11bca700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c063840 con 0x7f1d0c0b47c0 2021-12-17T18:28:16.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.544+0000 7f1d10bc8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d0c05ca90 0x7f1d0c146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.544+0000 7f1d10bc8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d0c05ca90 0x7f1d0c146d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57496/0 (socket says 172.21.15.62:57496) 2021-12-17T18:28:16.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.544+0000 7f1d10bc8700 1 -- 172.21.15.62:0/3664641388 learned_addr learned my addr 172.21.15.62:0/3664641388 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:16.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.544+0000 7f1d0bfff700 1 --2- 172.21.15.62:0/3664641388 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1d0c0b40b0 0x7f1d0c063ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.548+0000 7f1d113c9700 1 --2- 172.21.15.62:0/3664641388 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d0c0b47c0 0x7f1d0c152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.548+0000 7f1d10bc8700 1 -- 172.21.15.62:0/3664641388 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d0c0b47c0 msgr2=0x7f1d0c152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.548+0000 7f1d10bc8700 1 --2- 172.21.15.62:0/3664641388 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d0c0b47c0 0x7f1d0c152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.548+0000 7f1d10bc8700 1 -- 172.21.15.62:0/3664641388 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1d0c0b40b0 msgr2=0x7f1d0c063ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.548+0000 7f1d10bc8700 1 --2- 172.21.15.62:0/3664641388 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1d0c0b40b0 0x7f1d0c063ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.548+0000 7f1d10bc8700 1 -- 172.21.15.62:0/3664641388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d04009530 con 0x7f1d0c05ca90 2021-12-17T18:28:16.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.548+0000 7f1d0bfff700 1 --2- 172.21.15.62:0/3664641388 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1d0c0b40b0 0x7f1d0c063ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:28:16.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.548+0000 7f1d10bc8700 1 --2- 172.21.15.62:0/3664641388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d0c05ca90 0x7f1d0c146d40 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f1cf400c000 tx=0x7f1cf4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:16.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.548+0000 7f1d09ffb700 1 -- 172.21.15.62:0/3664641388 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cf4010780 con 0x7f1d0c05ca90 2021-12-17T18:28:16.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.548+0000 7f1d09ffb700 1 -- 172.21.15.62:0/3664641388 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf40108e0 con 0x7f1d0c05ca90 2021-12-17T18:28:16.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.548+0000 7f1d11bca700 1 -- 172.21.15.62:0/3664641388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0c065480 con 0x7f1d0c05ca90 2021-12-17T18:28:16.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.548+0000 7f1d09ffb700 1 -- 172.21.15.62:0/3664641388 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cf4010c40 con 0x7f1d0c05ca90 2021-12-17T18:28:16.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.548+0000 7f1d11bca700 1 -- 172.21.15.62:0/3664641388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0c0641d0 con 0x7f1d0c05ca90 2021-12-17T18:28:16.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.548+0000 7f1d11bca700 1 -- 172.21.15.62:0/3664641388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0c0a4960 con 0x7f1d0c05ca90 2021-12-17T18:28:16.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.548+0000 7f1d09ffb700 1 -- 172.21.15.62:0/3664641388 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1cf401c460 con 0x7f1d0c05ca90 2021-12-17T18:28:16.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.552+0000 7f1d09ffb700 1 --2- 172.21.15.62:0/3664641388 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cf0053640 0x7f1cf0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.552+0000 7f1d09ffb700 1 -- 172.21.15.62:0/3664641388 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1cf406be20 con 0x7f1d0c05ca90 2021-12-17T18:28:16.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.552+0000 7f1d0bfff700 1 --2- 172.21.15.62:0/3664641388 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cf0053640 0x7f1cf0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.552+0000 7f1d0bfff700 1 --2- 172.21.15.62:0/3664641388 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cf0053640 0x7f1cf0055b00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f1cfc00d000 tx=0x7f1cfc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:16.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.560+0000 7f1d09ffb700 1 -- 172.21.15.62:0/3664641388 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1cf4042d90 con 0x7f1d0c05ca90 2021-12-17T18:28:16.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.688+0000 7f1d11bca700 1 -- 172.21.15.62:0/3664641388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1d0c0b3980 con 0x7f1d0c05ca90 2021-12-17T18:28:16.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.688+0000 7f1d09ffb700 1 -- 172.21.15.62:0/3664641388 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v152) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1cf40463b0 con 0x7f1d0c05ca90 2021-12-17T18:28:16.700 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2021-12-17T18:28:16.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.688+0000 7f1d11bca700 1 -- 172.21.15.62:0/3664641388 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cf0053640 msgr2=0x7f1cf0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.688+0000 7f1d11bca700 1 --2- 172.21.15.62:0/3664641388 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cf0053640 0x7f1cf0055b00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f1cfc00d000 tx=0x7f1cfc009040).stop 2021-12-17T18:28:16.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.688+0000 7f1d11bca700 1 -- 172.21.15.62:0/3664641388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d0c05ca90 msgr2=0x7f1d0c146d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.688+0000 7f1d11bca700 1 --2- 172.21.15.62:0/3664641388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d0c05ca90 0x7f1d0c146d40 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f1cf400c000 tx=0x7f1cf4006df0).stop 2021-12-17T18:28:16.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.692+0000 7f1d11bca700 1 -- 172.21.15.62:0/3664641388 shutdown_connections 2021-12-17T18:28:16.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.692+0000 7f1d11bca700 1 --2- 172.21.15.62:0/3664641388 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1cf0053640 0x7f1cf0055b00 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.692+0000 7f1d11bca700 1 --2- 172.21.15.62:0/3664641388 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1d0c0b47c0 0x7f1d0c152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.692+0000 7f1d11bca700 1 --2- 172.21.15.62:0/3664641388 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1d0c0b40b0 0x7f1d0c063ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.692+0000 7f1d11bca700 1 --2- 172.21.15.62:0/3664641388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d0c05ca90 0x7f1d0c146d40 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.692+0000 7f1d11bca700 1 -- 172.21.15.62:0/3664641388 >> 172.21.15.62:0/3664641388 conn(0x7f1d0c05bcd0 msgr2=0x7f1d0c0b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:16.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.692+0000 7f1d11bca700 1 -- 172.21.15.62:0/3664641388 shutdown_connections 2021-12-17T18:28:16.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.692+0000 7f1d11bca700 1 -- 172.21.15.62:0/3664641388 wait complete. 2021-12-17T18:28:16.708 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-12-17T18:28:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.808+0000 7f130d83f700 1 Processor -- start 2021-12-17T18:28:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.808+0000 7f130d83f700 1 -- start start 2021-12-17T18:28:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d83f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f130805ca90 0x7f130814b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d83f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13080ac040 0x7f13081475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d83f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1308147ab0 0x7f13080b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d83f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1308060750 con 0x7f1308147ab0 2021-12-17T18:28:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d83f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130814ac00 con 0x7f130805ca90 2021-12-17T18:28:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d83f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130814aea0 con 0x7f13080ac040 2021-12-17T18:28:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d03e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1308147ab0 0x7f13080b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d03e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1308147ab0 0x7f13080b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57508/0 (socket says 172.21.15.62:57508) 2021-12-17T18:28:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f1307fff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13080ac040 0x7f13081475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130c83d700 1 --2- 172.21.15.62:0/1359783364 >> v2:172.21.15.109:3300/0 conn(0x7f130805ca90 0x7f130814b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d03e700 1 -- 172.21.15.62:0/1359783364 learned_addr learned my addr 172.21.15.62:0/1359783364 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:16.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d03e700 1 -- 172.21.15.62:0/1359783364 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13080ac040 msgr2=0x7f13081475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:16.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d03e700 1 --2- 172.21.15.62:0/1359783364 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13080ac040 0x7f13081475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d03e700 1 -- 172.21.15.62:0/1359783364 >> v2:172.21.15.109:3300/0 conn(0x7f130805ca90 msgr2=0x7f130814b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:16.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d03e700 1 --2- 172.21.15.62:0/1359783364 >> v2:172.21.15.109:3300/0 conn(0x7f130805ca90 0x7f130814b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d03e700 1 -- 172.21.15.62:0/1359783364 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130805ce70 con 0x7f1308147ab0 2021-12-17T18:28:16.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f1307fff700 1 --2- 172.21.15.62:0/1359783364 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13080ac040 0x7f13081475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:28:16.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d03e700 1 --2- 172.21.15.62:0/1359783364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1308147ab0 0x7f13080b1ca0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f1300002f70 tx=0x7f1300006eb0).ready entity=mon.0 client_cookie=a06e0e25310fb772 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:16.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f13077fe700 1 -- 172.21.15.62:0/1359783364 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f130000d570 con 0x7f1308147ab0 2021-12-17T18:28:16.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f13077fe700 1 -- 172.21.15.62:0/1359783364 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1300000e90 con 0x7f1308147ab0 2021-12-17T18:28:16.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f13077fe700 1 -- 172.21.15.62:0/1359783364 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f130000d900 con 0x7f1308147ab0 2021-12-17T18:28:16.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d83f700 1 -- 172.21.15.62:0/1359783364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1308147ab0 msgr2=0x7f13080b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d83f700 1 --2- 172.21.15.62:0/1359783364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1308147ab0 0x7f13080b1ca0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f1300002f70 tx=0x7f1300006eb0).stop 2021-12-17T18:28:16.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d83f700 1 -- 172.21.15.62:0/1359783364 shutdown_connections 2021-12-17T18:28:16.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d83f700 1 --2- 172.21.15.62:0/1359783364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1308147ab0 0x7f13080b1ca0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d83f700 1 --2- 172.21.15.62:0/1359783364 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f13080ac040 0x7f13081475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d83f700 1 --2- 172.21.15.62:0/1359783364 >> v2:172.21.15.109:3300/0 conn(0x7f130805ca90 0x7f130814b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d83f700 1 -- 172.21.15.62:0/1359783364 >> 172.21.15.62:0/1359783364 conn(0x7f130805be70 msgr2=0x7f1308062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:16.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d83f700 1 -- 172.21.15.62:0/1359783364 shutdown_connections 2021-12-17T18:28:16.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.812+0000 7f130d83f700 1 -- 172.21.15.62:0/1359783364 wait complete. 2021-12-17T18:28:16.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d83f700 1 Processor -- start 2021-12-17T18:28:16.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d83f700 1 -- start start 2021-12-17T18:28:16.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d83f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f130805ca90 0x7f13081566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d83f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13080ac040 0x7f13080adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d83f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1308147ab0 0x7f130809ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d83f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13080a21f0 con 0x7f1308147ab0 2021-12-17T18:28:16.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d83f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1308156bd0 con 0x7f13080ac040 2021-12-17T18:28:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d83f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13080a1cb0 con 0x7f130805ca90 2021-12-17T18:28:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d03e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1308147ab0 0x7f130809ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130c83d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f130805ca90 0x7f13081566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d03e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1308147ab0 0x7f130809ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57514/0 (socket says 172.21.15.62:57514) 2021-12-17T18:28:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d03e700 1 -- 172.21.15.62:0/1296758390 learned_addr learned my addr 172.21.15.62:0/1296758390 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f1307fff700 1 --2- 172.21.15.62:0/1296758390 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13080ac040 0x7f13080adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d03e700 1 -- 172.21.15.62:0/1296758390 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f130805ca90 msgr2=0x7f13081566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d03e700 1 --2- 172.21.15.62:0/1296758390 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f130805ca90 0x7f13081566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d03e700 1 -- 172.21.15.62:0/1296758390 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13080ac040 msgr2=0x7f13080adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d03e700 1 --2- 172.21.15.62:0/1296758390 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13080ac040 0x7f13080adf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d03e700 1 -- 172.21.15.62:0/1296758390 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f8009470 con 0x7f1308147ab0 2021-12-17T18:28:16.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d03e700 1 --2- 172.21.15.62:0/1296758390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1308147ab0 0x7f130809ef80 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f1300002f70 tx=0x7f1300015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:16.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f1305ffb700 1 -- 172.21.15.62:0/1296758390 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13000116e0 con 0x7f1308147ab0 2021-12-17T18:28:16.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f1305ffb700 1 -- 172.21.15.62:0/1296758390 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1300011840 con 0x7f1308147ab0 2021-12-17T18:28:16.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f1305ffb700 1 -- 172.21.15.62:0/1296758390 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1300011ba0 con 0x7f1308147ab0 2021-12-17T18:28:16.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d83f700 1 -- 172.21.15.62:0/1296758390 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130000b1e0 con 0x7f1308147ab0 2021-12-17T18:28:16.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.816+0000 7f130d83f700 1 -- 172.21.15.62:0/1296758390 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13080ae480 con 0x7f1308147ab0 2021-12-17T18:28:16.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.820+0000 7f130d83f700 1 -- 172.21.15.62:0/1296758390 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13080573d0 con 0x7f1308147ab0 2021-12-17T18:28:16.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.820+0000 7f1305ffb700 1 -- 172.21.15.62:0/1296758390 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f130001a040 con 0x7f1308147ab0 2021-12-17T18:28:16.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.820+0000 7f1305ffb700 1 --2- 172.21.15.62:0/1296758390 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12ec053610 0x7f12ec055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:16.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.820+0000 7f1305ffb700 1 -- 172.21.15.62:0/1296758390 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f130006c7d0 con 0x7f1308147ab0 2021-12-17T18:28:16.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.820+0000 7f130c83d700 1 --2- 172.21.15.62:0/1296758390 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12ec053610 0x7f12ec055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.820+0000 7f130c83d700 1 --2- 172.21.15.62:0/1296758390 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12ec053610 0x7f12ec055ad0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f12f000b000 tx=0x7f12f0006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.828+0000 7f1305ffb700 1 -- 172.21.15.62:0/1296758390 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f13000438e0 con 0x7f1308147ab0 2021-12-17T18:28:16.960 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.952+0000 7f130d83f700 1 -- 172.21.15.62:0/1296758390 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1308060c80 con 0x7f1308147ab0 2021-12-17T18:28:16.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.956+0000 7f1305ffb700 1 -- 172.21.15.62:0/1296758390 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v152) v1 ==== 92+0+10 (secure 0 0 0) 0x7f13000230a0 con 0x7f1308147ab0 2021-12-17T18:28:16.961 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:28:16.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.956+0000 7f130d83f700 1 -- 172.21.15.62:0/1296758390 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12ec053610 msgr2=0x7f12ec055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.956+0000 7f130d83f700 1 --2- 172.21.15.62:0/1296758390 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12ec053610 0x7f12ec055ad0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f12f000b000 tx=0x7f12f0006df0).stop 2021-12-17T18:28:16.963 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.956+0000 7f130d83f700 1 -- 172.21.15.62:0/1296758390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1308147ab0 msgr2=0x7f130809ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:16.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.956+0000 7f130d83f700 1 --2- 172.21.15.62:0/1296758390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1308147ab0 0x7f130809ef80 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f1300002f70 tx=0x7f1300015000).stop 2021-12-17T18:28:16.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.956+0000 7f130d83f700 1 -- 172.21.15.62:0/1296758390 shutdown_connections 2021-12-17T18:28:16.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.956+0000 7f130d83f700 1 --2- 172.21.15.62:0/1296758390 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f12ec053610 0x7f12ec055ad0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.964 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.956+0000 7f130d83f700 1 --2- 172.21.15.62:0/1296758390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1308147ab0 0x7f130809ef80 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.956+0000 7f130d83f700 1 --2- 172.21.15.62:0/1296758390 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f13080ac040 0x7f13080adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.956+0000 7f130d83f700 1 --2- 172.21.15.62:0/1296758390 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f130805ca90 0x7f13081566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:16.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.956+0000 7f130d83f700 1 -- 172.21.15.62:0/1296758390 >> 172.21.15.62:0/1296758390 conn(0x7f130805be70 msgr2=0x7f1308144900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:16.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.956+0000 7f130d83f700 1 -- 172.21.15.62:0/1296758390 shutdown_connections 2021-12-17T18:28:16.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:16.956+0000 7f130d83f700 1 -- 172.21.15.62:0/1296758390 wait complete. 2021-12-17T18:28:16.973 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-12-17T18:28:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.072+0000 7f386d7a5700 1 Processor -- start 2021-12-17T18:28:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.072+0000 7f386d7a5700 1 -- start start 2021-12-17T18:28:17.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f386d7a5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3868065520 0x7f38680b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:17.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f386d7a5700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3868065900 con 0x7f38680ae0e0 2021-12-17T18:28:17.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f386d7a5700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38680ad700 con 0x7f38680648d0 2021-12-17T18:28:17.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f386d7a5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38680ad9a0 con 0x7f3868065520 2021-12-17T18:28:17.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f3867fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3868065520 0x7f38680b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:17.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f38677fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f38680ae0e0 0x7f3868143130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41100/0 (socket says 172.21.15.62:41100) 2021-12-17T18:28:17.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f3867fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3868065520 0x7f38680b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57518/0 (socket says 172.21.15.62:57518) 2021-12-17T18:28:17.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f38677fe700 1 -- 172.21.15.62:0/2249350851 learned_addr learned my addr 172.21.15.62:0/2249350851 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:17.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f3867fff700 1 -- 172.21.15.62:0/2249350851 >> v1:172.21.15.109:6789/0 conn(0x7f38680648d0 legacy=0x7f386813eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f3867fff700 1 -- 172.21.15.62:0/2249350851 >> v1:172.21.15.62:6789/0 conn(0x7f38680ae0e0 legacy=0x7f3868143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f3866ffd700 1 -- 172.21.15.62:0/2249350851 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590777794 0 0) 0x7f3868065900 con 0x7f38680ae0e0 2021-12-17T18:28:17.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f3867fff700 1 -- 172.21.15.62:0/2249350851 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38680adc40 con 0x7f3868065520 2021-12-17T18:28:17.084 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f3867fff700 1 --2- 172.21.15.62:0/2249350851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3868065520 0x7f38680b6780 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f3858002f70 tx=0x7f3858006df0).ready entity=mon.0 client_cookie=6e09b0eec4609c server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:17.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f3866ffd700 1 -- 172.21.15.62:0/2249350851 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f385800d610 con 0x7f3868065520 2021-12-17T18:28:17.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f3866ffd700 1 -- 172.21.15.62:0/2249350851 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3858000e90 con 0x7f3868065520 2021-12-17T18:28:17.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f3866ffd700 1 -- 172.21.15.62:0/2249350851 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f385800d960 con 0x7f3868065520 2021-12-17T18:28:17.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f386d7a5700 1 -- 172.21.15.62:0/2249350851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3868065520 msgr2=0x7f38680b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f386d7a5700 1 --2- 172.21.15.62:0/2249350851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3868065520 0x7f38680b6780 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f3858002f70 tx=0x7f3858006df0).stop 2021-12-17T18:28:17.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f386d7a5700 1 -- 172.21.15.62:0/2249350851 shutdown_connections 2021-12-17T18:28:17.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f386d7a5700 1 --2- 172.21.15.62:0/2249350851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3868065520 0x7f38680b6780 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f386d7a5700 1 -- 172.21.15.62:0/2249350851 >> 172.21.15.62:0/2249350851 conn(0x7f386805c750 msgr2=0x7f38680b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:17.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f386d7a5700 1 -- 172.21.15.62:0/2249350851 shutdown_connections 2021-12-17T18:28:17.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.076+0000 7f386d7a5700 1 -- 172.21.15.62:0/2249350851 wait complete. 2021-12-17T18:28:17.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f386d7a5700 1 Processor -- start 2021-12-17T18:28:17.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f386d7a5700 1 -- start start 2021-12-17T18:28:17.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f386d7a5700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38680648d0 0x7f3868153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:17.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f386d7a5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3868065520 0x7f3868136a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:17.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f386d7a5700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38680ae0e0 0x7f386814ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:17.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f386d7a5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3868136820 con 0x7f3868065520 2021-12-17T18:28:17.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f386d7a5700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38681535f0 con 0x7f38680ae0e0 2021-12-17T18:28:17.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f386d7a5700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3868153890 con 0x7f38680648d0 2021-12-17T18:28:17.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f38677fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3868065520 0x7f3868136a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:17.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f38677fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3868065520 0x7f3868136a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57526/0 (socket says 172.21.15.62:57526) 2021-12-17T18:28:17.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f38677fe700 1 -- 172.21.15.62:0/355295470 learned_addr learned my addr 172.21.15.62:0/355295470 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:17.093 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f386cfa4700 1 --2- 172.21.15.62:0/355295470 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38680ae0e0 0x7f386814ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:17.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f3867fff700 1 --2- 172.21.15.62:0/355295470 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38680648d0 0x7f3868153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:17.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f38677fe700 1 -- 172.21.15.62:0/355295470 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38680648d0 msgr2=0x7f3868153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f38677fe700 1 --2- 172.21.15.62:0/355295470 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38680648d0 0x7f3868153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f38677fe700 1 -- 172.21.15.62:0/355295470 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38680ae0e0 msgr2=0x7f386814ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f38677fe700 1 --2- 172.21.15.62:0/355295470 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38680ae0e0 0x7f386814ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f38677fe700 1 -- 172.21.15.62:0/355295470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385800b180 con 0x7f3868065520 2021-12-17T18:28:17.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f38677fe700 1 --2- 172.21.15.62:0/355295470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3868065520 0x7f3868136a20 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f385c000bc0 tx=0x7f385c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:17.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f38657fa700 1 -- 172.21.15.62:0/355295470 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f385c00ce00 con 0x7f3868065520 2021-12-17T18:28:17.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f38657fa700 1 -- 172.21.15.62:0/355295470 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c0070d0 con 0x7f3868065520 2021-12-17T18:28:17.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f386d7a5700 1 -- 172.21.15.62:0/355295470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3868153b30 con 0x7f3868065520 2021-12-17T18:28:17.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f38657fa700 1 -- 172.21.15.62:0/355295470 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f385c007430 con 0x7f3868065520 2021-12-17T18:28:17.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.080+0000 7f386d7a5700 1 -- 172.21.15.62:0/355295470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3868137130 con 0x7f3868065520 2021-12-17T18:28:17.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.084+0000 7f386d7a5700 1 -- 172.21.15.62:0/355295470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3868153cc0 con 0x7f3868065520 2021-12-17T18:28:17.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.084+0000 7f38657fa700 1 -- 172.21.15.62:0/355295470 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f385c010070 con 0x7f3868065520 2021-12-17T18:28:17.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.084+0000 7f38657fa700 1 --2- 172.21.15.62:0/355295470 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38480536d0 0x7f3848055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:17.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.084+0000 7f38657fa700 1 -- 172.21.15.62:0/355295470 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f385c06ae50 con 0x7f3868065520 2021-12-17T18:28:17.098 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.084+0000 7f3867fff700 1 --2- 172.21.15.62:0/355295470 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38480536d0 0x7f3848055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:17.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.084+0000 7f3867fff700 1 --2- 172.21.15.62:0/355295470 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38480536d0 0x7f3848055b90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f385801c000 tx=0x7f3858015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:17.099 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.088+0000 7f38657fa700 1 -- 172.21.15.62:0/355295470 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f385c041fb0 con 0x7f3868065520 2021-12-17T18:28:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.216+0000 7f386d7a5700 1 -- 172.21.15.62:0/355295470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38680573d0 con 0x7f3868065520 2021-12-17T18:28:17.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.220+0000 7f38657fa700 1 -- 172.21.15.62:0/355295470 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v152) v1 ==== 104+0+10 (secure 0 0 0) 0x7f385c0455d0 con 0x7f3868065520 2021-12-17T18:28:17.225 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:28:17.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.220+0000 7f386d7a5700 1 -- 172.21.15.62:0/355295470 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38480536d0 msgr2=0x7f3848055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.220+0000 7f386d7a5700 1 --2- 172.21.15.62:0/355295470 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38480536d0 0x7f3848055b90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f385801c000 tx=0x7f3858015000).stop 2021-12-17T18:28:17.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.220+0000 7f386d7a5700 1 -- 172.21.15.62:0/355295470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3868065520 msgr2=0x7f3868136a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.228 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.220+0000 7f386d7a5700 1 --2- 172.21.15.62:0/355295470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3868065520 0x7f3868136a20 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f385c000bc0 tx=0x7f385c007c90).stop 2021-12-17T18:28:17.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.220+0000 7f386d7a5700 1 -- 172.21.15.62:0/355295470 shutdown_connections 2021-12-17T18:28:17.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.220+0000 7f386d7a5700 1 --2- 172.21.15.62:0/355295470 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f38480536d0 0x7f3848055b90 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.229 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.220+0000 7f386d7a5700 1 --2- 172.21.15.62:0/355295470 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f38680ae0e0 0x7f386814ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.220+0000 7f386d7a5700 1 --2- 172.21.15.62:0/355295470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3868065520 0x7f3868136a20 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.220+0000 7f386d7a5700 1 --2- 172.21.15.62:0/355295470 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f38680648d0 0x7f3868153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.220+0000 7f386d7a5700 1 -- 172.21.15.62:0/355295470 >> 172.21.15.62:0/355295470 conn(0x7f386805c750 msgr2=0x7f38680b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:17.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.220+0000 7f386d7a5700 1 -- 172.21.15.62:0/355295470 shutdown_connections 2021-12-17T18:28:17.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.220+0000 7f386d7a5700 1 -- 172.21.15.62:0/355295470 wait complete. 2021-12-17T18:28:17.238 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-12-17T18:28:17.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4ea17a700 1 Processor -- start 2021-12-17T18:28:17.349 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4ea17a700 1 -- start start 2021-12-17T18:28:17.352 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4ea17a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4e405ca90 0x7fe4e414b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:17.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4ea17a700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe4e40ac040 0x7fe4e41475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:17.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4ea17a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4e4147ab0 0x7fe4e40b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:17.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4ea17a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e4060750 con 0x7fe4e405ca90 2021-12-17T18:28:17.353 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4ea17a700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e414ac00 con 0x7fe4e40ac040 2021-12-17T18:28:17.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4ea17a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e414aea0 con 0x7fe4e4147ab0 2021-12-17T18:28:17.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4e9178700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4e405ca90 0x7fe4e414b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:17.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4e9178700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4e405ca90 0x7fe4e414b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57532/0 (socket says 172.21.15.62:57532) 2021-12-17T18:28:17.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4e9178700 1 -- 172.21.15.62:0/4127989323 learned_addr learned my addr 172.21.15.62:0/4127989323 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:17.354 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4e9979700 1 --2- 172.21.15.62:0/4127989323 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4e4147ab0 0x7fe4e40b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:17.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4e8977700 1 --2- 172.21.15.62:0/4127989323 >> v2:172.21.15.109:3300/0 conn(0x7fe4e40ac040 0x7fe4e41475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:17.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4e9178700 1 -- 172.21.15.62:0/4127989323 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4e4147ab0 msgr2=0x7fe4e40b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:17.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4e9178700 1 --2- 172.21.15.62:0/4127989323 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4e4147ab0 0x7fe4e40b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.355 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4e9178700 1 -- 172.21.15.62:0/4127989323 >> v2:172.21.15.109:3300/0 conn(0x7fe4e40ac040 msgr2=0x7fe4e41475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:17.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4e9178700 1 --2- 172.21.15.62:0/4127989323 >> v2:172.21.15.109:3300/0 conn(0x7fe4e40ac040 0x7fe4e41475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4e9178700 1 -- 172.21.15.62:0/4127989323 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e405ce70 con 0x7fe4e405ca90 2021-12-17T18:28:17.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4e9178700 1 --2- 172.21.15.62:0/4127989323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e405ca90 0x7fe4e414b340 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7fe4e0002f70 tx=0x7fe4e0006eb0).ready entity=mon.0 client_cookie=8eae966f1574a6fc server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:17.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4dbfff700 1 -- 172.21.15.62:0/4127989323 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4e000d570 con 0x7fe4e405ca90 2021-12-17T18:28:17.356 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4dbfff700 1 -- 172.21.15.62:0/4127989323 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e0000e90 con 0x7fe4e405ca90 2021-12-17T18:28:17.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4dbfff700 1 -- 172.21.15.62:0/4127989323 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4e000d900 con 0x7fe4e405ca90 2021-12-17T18:28:17.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4ea17a700 1 -- 172.21.15.62:0/4127989323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e405ca90 msgr2=0x7fe4e414b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4ea17a700 1 --2- 172.21.15.62:0/4127989323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e405ca90 0x7fe4e414b340 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7fe4e0002f70 tx=0x7fe4e0006eb0).stop 2021-12-17T18:28:17.357 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4ea17a700 1 -- 172.21.15.62:0/4127989323 shutdown_connections 2021-12-17T18:28:17.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4ea17a700 1 --2- 172.21.15.62:0/4127989323 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4e4147ab0 0x7fe4e40b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4ea17a700 1 --2- 172.21.15.62:0/4127989323 >> v2:172.21.15.109:3300/0 conn(0x7fe4e40ac040 0x7fe4e41475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4ea17a700 1 --2- 172.21.15.62:0/4127989323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e405ca90 0x7fe4e414b340 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4ea17a700 1 -- 172.21.15.62:0/4127989323 >> 172.21.15.62:0/4127989323 conn(0x7fe4e405be70 msgr2=0x7fe4e4062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:17.358 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4ea17a700 1 -- 172.21.15.62:0/4127989323 shutdown_connections 2021-12-17T18:28:17.359 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.344+0000 7fe4ea17a700 1 -- 172.21.15.62:0/4127989323 wait complete. 2021-12-17T18:28:17.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4ea17a700 1 Processor -- start 2021-12-17T18:28:17.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4ea17a700 1 -- start start 2021-12-17T18:28:17.362 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4ea17a700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4e405ca90 0x7fe4e40b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:17.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4ea17a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e40ac040 0x7fe4e4064990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:17.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4ea17a700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe4e4147ab0 0x7fe4e409e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:17.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4ea17a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e4156820 con 0x7fe4e40ac040 2021-12-17T18:28:17.363 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4ea17a700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e4156a50 con 0x7fe4e4147ab0 2021-12-17T18:28:17.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4ea17a700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e4064e80 con 0x7fe4e405ca90 2021-12-17T18:28:17.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4e8977700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e40ac040 0x7fe4e4064990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:17.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4e8977700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e40ac040 0x7fe4e4064990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57540/0 (socket says 172.21.15.62:57540) 2021-12-17T18:28:17.364 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4e8977700 1 -- 172.21.15.62:0/337938546 learned_addr learned my addr 172.21.15.62:0/337938546 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:17.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4e9979700 1 --2- 172.21.15.62:0/337938546 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe4e4147ab0 0x7fe4e409e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:17.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4e9178700 1 --2- 172.21.15.62:0/337938546 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4e405ca90 0x7fe4e40b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:17.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4e8977700 1 -- 172.21.15.62:0/337938546 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4e405ca90 msgr2=0x7fe4e40b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4e8977700 1 --2- 172.21.15.62:0/337938546 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4e405ca90 0x7fe4e40b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.365 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4e8977700 1 -- 172.21.15.62:0/337938546 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe4e4147ab0 msgr2=0x7fe4e409e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4e8977700 1 --2- 172.21.15.62:0/337938546 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe4e4147ab0 0x7fe4e409e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4e8977700 1 -- 172.21.15.62:0/337938546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e000b1e0 con 0x7fe4e40ac040 2021-12-17T18:28:17.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4e9979700 1 --2- 172.21.15.62:0/337938546 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe4e4147ab0 0x7fe4e409e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:28:17.366 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4e8977700 1 --2- 172.21.15.62:0/337938546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e40ac040 0x7fe4e4064990 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7fe4d40030b0 tx=0x7fe4d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:17.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4da7fc700 1 -- 172.21.15.62:0/337938546 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4d4011780 con 0x7fe4e40ac040 2021-12-17T18:28:17.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4da7fc700 1 -- 172.21.15.62:0/337938546 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d40118e0 con 0x7fe4e40ac040 2021-12-17T18:28:17.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4ea17a700 1 -- 172.21.15.62:0/337938546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e40a01a0 con 0x7fe4e40ac040 2021-12-17T18:28:17.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4ea17a700 1 -- 172.21.15.62:0/337938546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e409fc20 con 0x7fe4e40ac040 2021-12-17T18:28:17.367 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.348+0000 7fe4da7fc700 1 -- 172.21.15.62:0/337938546 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4d4011c40 con 0x7fe4e40ac040 2021-12-17T18:28:17.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.352+0000 7fe4ea17a700 1 -- 172.21.15.62:0/337938546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e4156c10 con 0x7fe4e40ac040 2021-12-17T18:28:17.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.352+0000 7fe4da7fc700 1 -- 172.21.15.62:0/337938546 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe4d401c460 con 0x7fe4e40ac040 2021-12-17T18:28:17.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.352+0000 7fe4da7fc700 1 --2- 172.21.15.62:0/337938546 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe4cc053520 0x7fe4cc0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:17.368 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.352+0000 7fe4da7fc700 1 -- 172.21.15.62:0/337938546 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe4d406bcb0 con 0x7fe4e40ac040 2021-12-17T18:28:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.352+0000 7fe4e9178700 1 --2- 172.21.15.62:0/337938546 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe4cc053520 0x7fe4cc0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.352+0000 7fe4e9178700 1 --2- 172.21.15.62:0/337938546 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe4cc053520 0x7fe4cc0559e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fe4e001a000 tx=0x7fe4e0015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.356+0000 7fe4da7fc700 1 -- 172.21.15.62:0/337938546 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe4d4042d10 con 0x7fe4e40ac040 2021-12-17T18:28:17.490 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.484+0000 7fe4ea17a700 1 -- 172.21.15.62:0/337938546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe4e40573d0 con 0x7fe4e40ac040 2021-12-17T18:28:17.491 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.484+0000 7fe4da7fc700 1 -- 172.21.15.62:0/337938546 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v152) v1 ==== 100+0+10 (secure 0 0 0) 0x7fe4d4046330 con 0x7fe4e40ac040 2021-12-17T18:28:17.492 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2021-12-17T18:28:17.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.488+0000 7fe4ea17a700 1 -- 172.21.15.62:0/337938546 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe4cc053520 msgr2=0x7fe4cc0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.488+0000 7fe4ea17a700 1 --2- 172.21.15.62:0/337938546 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe4cc053520 0x7fe4cc0559e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fe4e001a000 tx=0x7fe4e0015000).stop 2021-12-17T18:28:17.494 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.488+0000 7fe4ea17a700 1 -- 172.21.15.62:0/337938546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e40ac040 msgr2=0x7fe4e4064990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.488+0000 7fe4ea17a700 1 --2- 172.21.15.62:0/337938546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e40ac040 0x7fe4e4064990 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7fe4d40030b0 tx=0x7fe4d4008040).stop 2021-12-17T18:28:17.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.488+0000 7fe4ea17a700 1 -- 172.21.15.62:0/337938546 shutdown_connections 2021-12-17T18:28:17.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.488+0000 7fe4ea17a700 1 --2- 172.21.15.62:0/337938546 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe4cc053520 0x7fe4cc0559e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.495 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.488+0000 7fe4ea17a700 1 --2- 172.21.15.62:0/337938546 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe4e4147ab0 0x7fe4e409e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.488+0000 7fe4ea17a700 1 --2- 172.21.15.62:0/337938546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e40ac040 0x7fe4e4064990 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.488+0000 7fe4ea17a700 1 --2- 172.21.15.62:0/337938546 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe4e405ca90 0x7fe4e40b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.488+0000 7fe4ea17a700 1 -- 172.21.15.62:0/337938546 >> 172.21.15.62:0/337938546 conn(0x7fe4e405be70 msgr2=0x7fe4e4144aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:17.496 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.488+0000 7fe4ea17a700 1 -- 172.21.15.62:0/337938546 shutdown_connections 2021-12-17T18:28:17.497 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.488+0000 7fe4ea17a700 1 -- 172.21.15.62:0/337938546 wait complete. 2021-12-17T18:28:17.505 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-12-17T18:28:17.505 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:28:17.604 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.596+0000 7fe674888700 1 Processor -- start 2021-12-17T18:28:17.605 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.596+0000 7fe674888700 1 -- start start 2021-12-17T18:28:17.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe674888700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe6700aca60 0x7fe670147050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:17.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe674888700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe670067c10 con 0x7fe670067830 2021-12-17T18:28:17.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe674888700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe670060520 con 0x7fe670147540 2021-12-17T18:28:17.608 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe674888700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6700acf00 con 0x7fe6700aca60 2021-12-17T18:28:17.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe66dd9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe6700aca60 0x7fe670147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:17.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe66e59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe670067830 0x7fe670146940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41128/0 (socket says 172.21.15.62:41128) 2021-12-17T18:28:17.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe66e59c700 1 -- 172.21.15.62:0/249790836 learned_addr learned my addr 172.21.15.62:0/249790836 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:17.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe66dd9b700 1 -- 172.21.15.62:0/249790836 >> v1:172.21.15.109:6789/0 conn(0x7fe670147540 legacy=0x7fe6700b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:17.609 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe66dd9b700 1 -- 172.21.15.62:0/249790836 >> v1:172.21.15.62:6789/0 conn(0x7fe670067830 legacy=0x7fe670146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe66dd9b700 1 -- 172.21.15.62:0/249790836 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6700b12a0 con 0x7fe6700aca60 2021-12-17T18:28:17.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe66dd9b700 1 --2- 172.21.15.62:0/249790836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6700aca60 0x7fe670147050 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7fe6700b1af0 tx=0x7fe660006df0).ready entity=mon.0 client_cookie=8b43c45bef1430fd server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:17.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe66d59a700 1 -- 172.21.15.62:0/249790836 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe66000d610 con 0x7fe6700aca60 2021-12-17T18:28:17.610 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe66d59a700 1 -- 172.21.15.62:0/249790836 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe660000e90 con 0x7fe6700aca60 2021-12-17T18:28:17.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe66d59a700 1 -- 172.21.15.62:0/249790836 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe66000d960 con 0x7fe6700aca60 2021-12-17T18:28:17.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe674888700 1 -- 172.21.15.62:0/249790836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6700aca60 msgr2=0x7fe670147050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe674888700 1 --2- 172.21.15.62:0/249790836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6700aca60 0x7fe670147050 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7fe6700b1af0 tx=0x7fe660006df0).stop 2021-12-17T18:28:17.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe674888700 1 -- 172.21.15.62:0/249790836 shutdown_connections 2021-12-17T18:28:17.611 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe674888700 1 --2- 172.21.15.62:0/249790836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6700aca60 0x7fe670147050 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe674888700 1 -- 172.21.15.62:0/249790836 >> 172.21.15.62:0/249790836 conn(0x7fe67005f730 msgr2=0x7fe67005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:17.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe674888700 1 -- 172.21.15.62:0/249790836 shutdown_connections 2021-12-17T18:28:17.612 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe674888700 1 -- 172.21.15.62:0/249790836 wait complete. 2021-12-17T18:28:17.615 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe674888700 1 Processor -- start 2021-12-17T18:28:17.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.600+0000 7fe674888700 1 -- start start 2021-12-17T18:28:17.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe674888700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe670067830 0x7fe670152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:17.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe674888700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6700aca60 0x7fe6700a87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:17.616 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe674888700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe670147540 0x7fe6700a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:17.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe674888700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe670140a30 con 0x7fe670067830 2021-12-17T18:28:17.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe674888700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe670153de0 con 0x7fe6700aca60 2021-12-17T18:28:17.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe674888700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700a2b20 con 0x7fe670147540 2021-12-17T18:28:17.617 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe66e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe670067830 0x7fe670152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:17.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe66e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe670067830 0x7fe670152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57552/0 (socket says 172.21.15.62:57552) 2021-12-17T18:28:17.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe66e59c700 1 -- 172.21.15.62:0/4214995103 learned_addr learned my addr 172.21.15.62:0/4214995103 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:17.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe66dd9b700 1 --2- 172.21.15.62:0/4214995103 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6700aca60 0x7fe6700a87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:17.618 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe66ed9d700 1 --2- 172.21.15.62:0/4214995103 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe670147540 0x7fe6700a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:17.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe66e59c700 1 -- 172.21.15.62:0/4214995103 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe670147540 msgr2=0x7fe6700a9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe66e59c700 1 --2- 172.21.15.62:0/4214995103 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe670147540 0x7fe6700a9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.619 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe66e59c700 1 -- 172.21.15.62:0/4214995103 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6700aca60 msgr2=0x7fe6700a87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe66e59c700 1 --2- 172.21.15.62:0/4214995103 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6700aca60 0x7fe6700a87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe66e59c700 1 -- 172.21.15.62:0/4214995103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66000b180 con 0x7fe670067830 2021-12-17T18:28:17.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe66ed9d700 1 --2- 172.21.15.62:0/4214995103 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe670147540 0x7fe6700a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:28:17.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe66e59c700 1 --2- 172.21.15.62:0/4214995103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe670067830 0x7fe670152b60 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7fe6700ad820 tx=0x7fe664007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:17.620 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe65f7fe700 1 -- 172.21.15.62:0/4214995103 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6640070d0 con 0x7fe670067830 2021-12-17T18:28:17.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe65f7fe700 1 -- 172.21.15.62:0/4214995103 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe664007230 con 0x7fe670067830 2021-12-17T18:28:17.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe674888700 1 -- 172.21.15.62:0/4214995103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67009f9c0 con 0x7fe670067830 2021-12-17T18:28:17.621 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe65f7fe700 1 -- 172.21.15.62:0/4214995103 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe664005610 con 0x7fe670067830 2021-12-17T18:28:17.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe674888700 1 -- 172.21.15.62:0/4214995103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6700ac460 con 0x7fe670067830 2021-12-17T18:28:17.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.604+0000 7fe674888700 1 -- 172.21.15.62:0/4214995103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6700a2ce0 con 0x7fe670067830 2021-12-17T18:28:17.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.608+0000 7fe65f7fe700 1 -- 172.21.15.62:0/4214995103 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe664010070 con 0x7fe670067830 2021-12-17T18:28:17.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.608+0000 7fe65f7fe700 1 --2- 172.21.15.62:0/4214995103 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe64c0535b0 0x7fe64c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:17.622 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.608+0000 7fe65f7fe700 1 -- 172.21.15.62:0/4214995103 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe66406aeb0 con 0x7fe670067830 2021-12-17T18:28:17.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.608+0000 7fe66dd9b700 1 --2- 172.21.15.62:0/4214995103 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe64c0535b0 0x7fe64c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:17.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.608+0000 7fe66dd9b700 1 --2- 172.21.15.62:0/4214995103 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe64c0535b0 0x7fe64c055a70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fe66001c000 tx=0x7fe660015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:17.623 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.612+0000 7fe65f7fe700 1 -- 172.21.15.62:0/4214995103 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe6700a2ce0 con 0x7fe670067830 2021-12-17T18:28:17.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.772+0000 7fe674888700 1 -- 172.21.15.62:0/4214995103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6700a2ce0 con 0x7fe670067830 2021-12-17T18:28:17.781 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.776+0000 7fe65f7fe700 1 -- 172.21.15.62:0/4214995103 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+2145 (secure 0 0 0) 0x7fe6700a2ce0 con 0x7fe670067830 2021-12-17T18:28:17.782 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:17.782 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":76,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3486639655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3486639655},{"type":"v1","addr":"172.21.15.109:6835","nonce":3486639655}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:28:09.455753+0000","modified":"2021-12-17T18:28:10.458774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7397},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7397":{"gid":7397,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/2348194620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2348194620},{"type":"v1","addr":"172.21.15.62:6833","nonce":2348194620}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-12-17T18:28:17.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.776+0000 7fe674888700 1 -- 172.21.15.62:0/4214995103 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe64c0535b0 msgr2=0x7fe64c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.776+0000 7fe674888700 1 --2- 172.21.15.62:0/4214995103 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe64c0535b0 0x7fe64c055a70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fe66001c000 tx=0x7fe660015000).stop 2021-12-17T18:28:17.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.776+0000 7fe674888700 1 -- 172.21.15.62:0/4214995103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe670067830 msgr2=0x7fe670152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:17.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.776+0000 7fe674888700 1 --2- 172.21.15.62:0/4214995103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe670067830 0x7fe670152b60 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7fe6700ad820 tx=0x7fe664007c40).stop 2021-12-17T18:28:17.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.776+0000 7fe674888700 1 -- 172.21.15.62:0/4214995103 shutdown_connections 2021-12-17T18:28:17.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.776+0000 7fe674888700 1 --2- 172.21.15.62:0/4214995103 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe64c0535b0 0x7fe64c055a70 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.776+0000 7fe674888700 1 --2- 172.21.15.62:0/4214995103 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe670147540 0x7fe6700a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.776+0000 7fe674888700 1 --2- 172.21.15.62:0/4214995103 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe6700aca60 0x7fe6700a87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.776+0000 7fe674888700 1 --2- 172.21.15.62:0/4214995103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe670067830 0x7fe670152b60 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.776+0000 7fe674888700 1 -- 172.21.15.62:0/4214995103 >> 172.21.15.62:0/4214995103 conn(0x7fe67005f730 msgr2=0x7fe6701460a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.776+0000 7fe674888700 1 -- 172.21.15.62:0/4214995103 shutdown_connections 2021-12-17T18:28:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:17.776+0000 7fe674888700 1 -- 172.21.15.62:0/4214995103 wait complete. 2021-12-17T18:28:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 76 2021-12-17T18:28:17.996 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-12-17T18:28:09.455753+0000', 'modified': '2021-12-17T18:28:10.458774+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7397}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7397': {'gid': 7397, 'name': 'a', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6833/2348194620', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 2348194620}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 2348194620}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-12-17T18:28:17.997 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-12-17T18:28:17.998 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-12-17T18:28:18.116 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","whoami":0,"id":7397,"want_state":"up:active","state":"up:active","rank_uptime":8.641421866,"mdsmap_epoch":76,"osdmap_epoch":152,"osdmap_epoch_barrier":150,"uptime":13.654970222999999} 2021-12-17T18:28:18.116 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", "id": 7397, "mdsmap_epoch": 76, "osdmap_epoch": 152, "osdmap_epoch_barrier": 150, "rank_uptime": 8.641421866, "state": "up:active", "uptime": 13.654970223, "want_state": "up:active", "whoami": 0 } 2021-12-17T18:28:18.117 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-12-17T18:28:18.117 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-12-17T18:28:18.118 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi158.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-12-17T18:28:18.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:18.118 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:28:18.127 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:28:18.145 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:28:18.145 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:28:18.204 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:28:18.205 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:28:18.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:18.206 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:28:18.213 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-12-17T18:28:18.214 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:28:18.217 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:28:18.232 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:28:18.233 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:28:18.290 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:28:18.291 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:28:18.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:18.292 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:28:18.293 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:2021-12-17T18:28:18.286+0000 7fe911f6d080 -1 init, newargv = 0x559902f28d00 newargc=9 2021-12-17T18:28:18.294 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14734]: starting ceph client 2021-12-17T18:28:18.304 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14734]: starting fuse 2021-12-17T18:28:19.400 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2021-12-17T18:28:19.419 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-12-17T18:28:19.420 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-12-17T18:28:19.431 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-12-17T18:28:19.432 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-12-17T18:28:19.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:19.434 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2021-12-17T18:28:19.439 INFO:teuthology.orchestra.run.smithi158.stdout:52 2021-12-17T18:28:19.440 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-12-17T18:28:19.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:19.440 DEBUG:teuthology.orchestra.run.smithi158:> sudo python3 -c ' 2021-12-17T18:28:19.441 DEBUG:teuthology.orchestra.run.smithi158:> import glob 2021-12-17T18:28:19.441 DEBUG:teuthology.orchestra.run.smithi158:> import re 2021-12-17T18:28:19.442 DEBUG:teuthology.orchestra.run.smithi158:> import os 2021-12-17T18:28:19.442 DEBUG:teuthology.orchestra.run.smithi158:> import subprocess 2021-12-17T18:28:19.443 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:28:19.443 DEBUG:teuthology.orchestra.run.smithi158:> def find_socket(client_name): 2021-12-17T18:28:19.444 DEBUG:teuthology.orchestra.run.smithi158:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-12-17T18:28:19.444 DEBUG:teuthology.orchestra.run.smithi158:> files = glob.glob(asok_path) 2021-12-17T18:28:19.444 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:28:19.445 DEBUG:teuthology.orchestra.run.smithi158:> # Given a non-glob path, it better be there 2021-12-17T18:28:19.445 DEBUG:teuthology.orchestra.run.smithi158:> if "*" not in asok_path: 2021-12-17T18:28:19.446 DEBUG:teuthology.orchestra.run.smithi158:> assert(len(files) == 1) 2021-12-17T18:28:19.446 DEBUG:teuthology.orchestra.run.smithi158:> return files[0] 2021-12-17T18:28:19.446 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:28:19.447 DEBUG:teuthology.orchestra.run.smithi158:> for f in files: 2021-12-17T18:28:19.447 DEBUG:teuthology.orchestra.run.smithi158:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-12-17T18:28:19.448 DEBUG:teuthology.orchestra.run.smithi158:> if os.path.exists("/proc/{0}".format(pid)): 2021-12-17T18:28:19.448 DEBUG:teuthology.orchestra.run.smithi158:> return f 2021-12-17T18:28:19.449 DEBUG:teuthology.orchestra.run.smithi158:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-12-17T18:28:19.449 DEBUG:teuthology.orchestra.run.smithi158:> 2021-12-17T18:28:19.449 DEBUG:teuthology.orchestra.run.smithi158:> print(find_socket("client.1")) 2021-12-17T18:28:19.450 DEBUG:teuthology.orchestra.run.smithi158:> ' 2021-12-17T18:28:19.524 INFO:teuthology.orchestra.run.smithi158.stdout:/var/run/ceph/ceph-client.1.14734.asok 2021-12-17T18:28:19.529 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14734.asok 2021-12-17T18:28:19.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:19.530 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14734.asok status 2021-12-17T18:28:19.623 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2021-12-17T18:28:19.624 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": { 2021-12-17T18:28:19.624 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_sha1": "05c319fc280f505b26f579a01ab4d14d2f130a5b", 2021-12-17T18:28:19.624 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 15.2.15-105-g05c319fc (05c319fc280f505b26f579a01ab4d14d2f130a5b) octopus (stable)", 2021-12-17T18:28:19.625 INFO:teuthology.orchestra.run.smithi158.stdout: "entity_id": "1", 2021-12-17T18:28:19.625 INFO:teuthology.orchestra.run.smithi158.stdout: "hostname": "smithi158", 2021-12-17T18:28:19.625 INFO:teuthology.orchestra.run.smithi158.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-12-17T18:28:19.625 INFO:teuthology.orchestra.run.smithi158.stdout: "pid": "14734", 2021-12-17T18:28:19.625 INFO:teuthology.orchestra.run.smithi158.stdout: "root": "/" 2021-12-17T18:28:19.626 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:28:19.626 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_count": 0, 2021-12-17T18:28:19.626 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_pinned_count": 0, 2021-12-17T18:28:19.626 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 7547, 2021-12-17T18:28:19.627 INFO:teuthology.orchestra.run.smithi158.stdout: "inst": { 2021-12-17T18:28:19.627 INFO:teuthology.orchestra.run.smithi158.stdout: "name": { 2021-12-17T18:28:19.627 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "client", 2021-12-17T18:28:19.627 INFO:teuthology.orchestra.run.smithi158.stdout: "num": 7547 2021-12-17T18:28:19.628 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:28:19.628 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:28:19.628 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:28:19.628 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:28:19.629 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 3124791850 2021-12-17T18:28:19.629 INFO:teuthology.orchestra.run.smithi158.stdout: } 2021-12-17T18:28:19.629 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:28:19.629 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2021-12-17T18:28:19.630 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2021-12-17T18:28:19.630 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2021-12-17T18:28:19.630 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 3124791850 2021-12-17T18:28:19.630 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2021-12-17T18:28:19.631 INFO:teuthology.orchestra.run.smithi158.stdout: "inst_str": "client.7547 172.21.15.158:0/3124791850", 2021-12-17T18:28:19.631 INFO:teuthology.orchestra.run.smithi158.stdout: "addr_str": "172.21.15.158:0/3124791850", 2021-12-17T18:28:19.631 INFO:teuthology.orchestra.run.smithi158.stdout: "inode_count": 1, 2021-12-17T18:28:19.631 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_epoch": 76, 2021-12-17T18:28:19.632 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch": 152, 2021-12-17T18:28:19.632 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch_barrier": 0, 2021-12-17T18:28:19.632 INFO:teuthology.orchestra.run.smithi158.stdout: "blacklisted": false, 2021-12-17T18:28:19.632 INFO:teuthology.orchestra.run.smithi158.stdout: "fs_name": "cephfs" 2021-12-17T18:28:19.633 INFO:teuthology.orchestra.run.smithi158.stdout:} 2021-12-17T18:28:19.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:19.634 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:28:19.635 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:28:19.642 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:28:19.643 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:28:19.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:19.644 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:28:19.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:19.703 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:28:19.703 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:28:19.710 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:28:19.711 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:28:19.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:19.712 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:28:19.712 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:28:19.719 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2021-12-17T18:28:19.720 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-12-17T18:28:19.721 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi158.front.sepia.ceph.com... 2021-12-17T18:28:19.721 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-12-17T18:28:19.722 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:28:19.775 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14734]: fuse finished with error 0 and tester_r 0 2021-12-17T18:28:19.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:19.778 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:28:19.778 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:28:19.784 INFO:teuthology.orchestra.run.smithi158.stdout:ext2/ext3 2021-12-17T18:28:19.786 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-12-17T18:28:19.786 INFO:teuthology.orchestra.run:waiting for 900 2021-12-17T18:28:19.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-12-17T18:28:19.889 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-12-17T18:28:19.897 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-12-17T18:28:19.897 DEBUG:teuthology.orchestra.run.smithi125:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-12-17T18:28:19.918 INFO:teuthology.orchestra.run.smithi125.stdout: File: "." 2021-12-17T18:28:19.918 INFO:teuthology.orchestra.run.smithi125.stdout: ID: 0 Namelen: 255 Type: fuseblk 2021-12-17T18:28:19.919 INFO:teuthology.orchestra.run.smithi125.stdout:Block size: 4194304 Fundamental block size: 4194304 2021-12-17T18:28:19.919 INFO:teuthology.orchestra.run.smithi125.stdout:Blocks: Total: 86526 Free: 86526 Available: 86526 2021-12-17T18:28:19.919 INFO:teuthology.orchestra.run.smithi125.stdout:Inodes: Total: 1 Free: 0 2021-12-17T18:28:19.920 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-12-17T18:28:20.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.024+0000 7fc210498700 1 Processor -- start 2021-12-17T18:28:20.032 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.024+0000 7fc210498700 1 -- start start 2021-12-17T18:28:20.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.024+0000 7fc210498700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc2081416b0 0x7fc20814bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:20.034 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.024+0000 7fc210498700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2080b27c0 con 0x7fc2080b3eb0 2021-12-17T18:28:20.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.024+0000 7fc210498700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc208144730 con 0x7fc208067770 2021-12-17T18:28:20.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.024+0000 7fc210498700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2081449d0 con 0x7fc2081416b0 2021-12-17T18:28:20.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc20e234700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc2080b3eb0 0x7fc208145110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41140/0 (socket says 172.21.15.62:41140) 2021-12-17T18:28:20.035 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc20e234700 1 -- 172.21.15.62:0/4014309814 learned_addr learned my addr 172.21.15.62:0/4014309814 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:20.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc20ea35700 1 --2- 172.21.15.62:0/4014309814 >> v2:172.21.15.62:3300/0 conn(0x7fc2081416b0 0x7fc20814bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:20.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc20d232700 1 -- 172.21.15.62:0/4014309814 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681152121 0 0) 0x7fc2080b27c0 con 0x7fc2080b3eb0 2021-12-17T18:28:20.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc20d232700 1 -- 172.21.15.62:0/4014309814 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1f0003260 con 0x7fc2080b3eb0 2021-12-17T18:28:20.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc20d232700 1 -- 172.21.15.62:0/4014309814 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613227912 0 0) 0x7fc208144730 con 0x7fc208067770 2021-12-17T18:28:20.036 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc20d232700 1 -- 172.21.15.62:0/4014309814 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2080b27c0 con 0x7fc208067770 2021-12-17T18:28:20.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc20ea35700 1 -- 172.21.15.62:0/4014309814 >> v1:172.21.15.109:6789/0 conn(0x7fc208067770 legacy=0x7fc2080b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:20.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc20ea35700 1 -- 172.21.15.62:0/4014309814 >> v1:172.21.15.62:6789/0 conn(0x7fc2080b3eb0 legacy=0x7fc208145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:20.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc20ea35700 1 -- 172.21.15.62:0/4014309814 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc208144c70 con 0x7fc2081416b0 2021-12-17T18:28:20.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc20ea35700 1 --2- 172.21.15.62:0/4014309814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2081416b0 0x7fc20814bad0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7fc2000032f0 tx=0x7fc2000091d0).ready entity=mon.0 client_cookie=537e53a7c75482ce server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:20.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc20d232700 1 -- 172.21.15.62:0/4014309814 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc20000b650 con 0x7fc2081416b0 2021-12-17T18:28:20.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc20d232700 1 -- 172.21.15.62:0/4014309814 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20000b7b0 con 0x7fc2081416b0 2021-12-17T18:28:20.038 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc20d232700 1 -- 172.21.15.62:0/4014309814 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc20000b920 con 0x7fc2081416b0 2021-12-17T18:28:20.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc210498700 1 -- 172.21.15.62:0/4014309814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2081416b0 msgr2=0x7fc20814bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:20.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc210498700 1 --2- 172.21.15.62:0/4014309814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2081416b0 0x7fc20814bad0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7fc2000032f0 tx=0x7fc2000091d0).stop 2021-12-17T18:28:20.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc210498700 1 -- 172.21.15.62:0/4014309814 shutdown_connections 2021-12-17T18:28:20.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc210498700 1 --2- 172.21.15.62:0/4014309814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2081416b0 0x7fc20814bad0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc210498700 1 -- 172.21.15.62:0/4014309814 >> 172.21.15.62:0/4014309814 conn(0x7fc20805cb40 msgr2=0x7fc20805cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:20.042 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc210498700 1 -- 172.21.15.62:0/4014309814 shutdown_connections 2021-12-17T18:28:20.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.028+0000 7fc210498700 1 -- 172.21.15.62:0/4014309814 wait complete. 2021-12-17T18:28:20.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc210498700 1 Processor -- start 2021-12-17T18:28:20.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc210498700 1 -- start start 2021-12-17T18:28:20.043 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc210498700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc208067770 0x7fc20813ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:20.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc210498700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2080b3eb0 0x7fc20813f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:20.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc210498700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc2081416b0 0x7fc2080ad130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:20.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc210498700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2080b1900 con 0x7fc2080b3eb0 2021-12-17T18:28:20.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc210498700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2080afee0 con 0x7fc2081416b0 2021-12-17T18:28:20.044 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc210498700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2080ac710 con 0x7fc208067770 2021-12-17T18:28:20.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc20da33700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2080b3eb0 0x7fc20813f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:20.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc20da33700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2080b3eb0 0x7fc20813f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57568/0 (socket says 172.21.15.62:57568) 2021-12-17T18:28:20.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc20da33700 1 -- 172.21.15.62:0/2333231032 learned_addr learned my addr 172.21.15.62:0/2333231032 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:20.045 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc20e234700 1 --2- 172.21.15.62:0/2333231032 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc208067770 0x7fc20813ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:20.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc20ea35700 1 --2- 172.21.15.62:0/2333231032 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc2081416b0 0x7fc2080ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:20.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc20da33700 1 -- 172.21.15.62:0/2333231032 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc208067770 msgr2=0x7fc20813ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:20.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc20da33700 1 --2- 172.21.15.62:0/2333231032 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc208067770 0x7fc20813ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc20da33700 1 -- 172.21.15.62:0/2333231032 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc2081416b0 msgr2=0x7fc2080ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:20.046 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc20da33700 1 --2- 172.21.15.62:0/2333231032 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc2081416b0 0x7fc2080ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc20da33700 1 -- 172.21.15.62:0/2333231032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc200009470 con 0x7fc2080b3eb0 2021-12-17T18:28:20.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc20da33700 1 --2- 172.21.15.62:0/2333231032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2080b3eb0 0x7fc20813f630 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7fc1f8001110 tx=0x7fc1f8007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:20.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc1f77fe700 1 -- 172.21.15.62:0/2333231032 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1f8012400 con 0x7fc2080b3eb0 2021-12-17T18:28:20.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc1f77fe700 1 -- 172.21.15.62:0/2333231032 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f8012560 con 0x7fc2080b3eb0 2021-12-17T18:28:20.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc210498700 1 -- 172.21.15.62:0/2333231032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2080ad620 con 0x7fc2080b3eb0 2021-12-17T18:28:20.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc1f77fe700 1 -- 172.21.15.62:0/2333231032 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1f80128c0 con 0x7fc2080b3eb0 2021-12-17T18:28:20.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.032+0000 7fc210498700 1 -- 172.21.15.62:0/2333231032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2080abfb0 con 0x7fc2080b3eb0 2021-12-17T18:28:20.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.036+0000 7fc210498700 1 -- 172.21.15.62:0/2333231032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2080b1b00 con 0x7fc2080b3eb0 2021-12-17T18:28:20.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.036+0000 7fc1f77fe700 1 -- 172.21.15.62:0/2333231032 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc1f8019030 con 0x7fc2080b3eb0 2021-12-17T18:28:20.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.036+0000 7fc1f77fe700 1 --2- 172.21.15.62:0/2333231032 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1e8053580 0x7fc1e8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:20.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.036+0000 7fc1f77fe700 1 -- 172.21.15.62:0/2333231032 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc1f806ad80 con 0x7fc2080b3eb0 2021-12-17T18:28:20.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.036+0000 7fc20e234700 1 --2- 172.21.15.62:0/2333231032 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1e8053580 0x7fc1e8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:20.050 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.036+0000 7fc20e234700 1 --2- 172.21.15.62:0/2333231032 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1e8053580 0x7fc1e8055a40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fc20400d000 tx=0x7fc204009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:20.051 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.040+0000 7fc1f77fe700 1 -- 172.21.15.62:0/2333231032 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc1f8041ee0 con 0x7fc2080b3eb0 2021-12-17T18:28:20.175 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.168+0000 7fc210498700 1 -- 172.21.15.62:0/2333231032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc2080573d0 con 0x7fc2080b3eb0 2021-12-17T18:28:20.177 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.172+0000 7fc1f77fe700 1 -- 172.21.15.62:0/2333231032 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v152) v1 ==== 81+0+33707 (secure 0 0 0) 0x7fc1f806c070 con 0x7fc2080b3eb0 2021-12-17T18:28:20.179 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:20.179 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T18:28:20.179 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 152, 2021-12-17T18:28:20.179 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "bd870ae2-2b3b-4717-8d94-b4a425d11882", 2021-12-17T18:28:20.180 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2021-12-17T18:18:02.762904+0000", 2021-12-17T18:28:20.180 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2021-12-17T18:28:11.469406+0000", 2021-12-17T18:28:20.180 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:28:20.180 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2021-12-17T18:18:09.551618+0000", 2021-12-17T18:28:20.181 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-12-17T18:28:20.181 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2021-12-17T18:28:20.181 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2021-12-17T18:28:20.181 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2021-12-17T18:28:20.182 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2021-12-17T18:28:20.182 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2021-12-17T18:28:20.182 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2021-12-17T18:28:20.182 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:28:20.183 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2021-12-17T18:28:20.183 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2021-12-17T18:28:20.183 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-12-17T18:28:20.183 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2021-12-17T18:28:20.183 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2021-12-17T18:28:20.184 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 30, 2021-12-17T18:28:20.184 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 8, 2021-12-17T18:28:20.184 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "jewel", 2021-12-17T18:28:20.184 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2021-12-17T18:28:20.185 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "octopus", 2021-12-17T18:28:20.185 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2021-12-17T18:28:20.185 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.185 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2021-12-17T18:28:20.185 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "device_health_metrics", 2021-12-17T18:28:20.186 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:05.577519+0000", 2021-12-17T18:28:20.186 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:28:20.186 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:28:20.186 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:28:20.187 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:28:20.187 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:28:20.187 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:28:20.187 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:28:20.188 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:28:20.188 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2021-12-17T18:28:20.188 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2021-12-17T18:28:20.188 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2021-12-17T18:28:20.189 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2021-12-17T18:28:20.189 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2021-12-17T18:28:20.189 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:28:20.189 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:28:20.189 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:28:20.190 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:28:20.190 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:28:20.190 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:28:20.190 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:28:20.191 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.191 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "16", 2021-12-17T18:28:20.191 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:28:20.191 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:28:20.192 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:28:20.192 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:28:20.192 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:28:20.192 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:28:20.192 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:28:20.193 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:28:20.193 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:28:20.193 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:28:20.193 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:28:20.193 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:28:20.194 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:28:20.194 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:28:20.194 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:28:20.194 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:28:20.195 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:28:20.195 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:28:20.195 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:28:20.195 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:28:20.196 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:28:20.196 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:28:20.196 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:28:20.196 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:28:20.196 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:28:20.197 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:28:20.197 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.197 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:28:20.197 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:28:20.198 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:28:20.198 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:28:20.198 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:28:20.198 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:28:20.199 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:28:20.199 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:28:20.199 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:28:20.199 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:28:20.199 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:28:20.200 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:28:20.200 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2021-12-17T18:28:20.200 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.200 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:28:20.201 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_devicehealth": {} 2021-12-17T18:28:20.201 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.201 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.201 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.201 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2021-12-17T18:28:20.202 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2021-12-17T18:28:20.202 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:18:13.880759+0000", 2021-12-17T18:28:20.202 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:28:20.202 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:28:20.203 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:28:20.203 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:28:20.203 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:28:20.203 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:28:20.204 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:28:20.204 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:28:20.204 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:28:20.204 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:28:20.205 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:28:20.205 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:28:20.205 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:28:20.205 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:28:20.205 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:28:20.206 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:28:20.206 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:28:20.206 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:28:20.206 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:28:20.207 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:28:20.207 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.207 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2021-12-17T18:28:20.207 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:28:20.208 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:28:20.208 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:28:20.208 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:28:20.208 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:28:20.208 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:28:20.209 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:28:20.209 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:28:20.209 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:28:20.209 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:28:20.210 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:28:20.210 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:28:20.210 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:28:20.211 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:28:20.211 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:28:20.211 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:28:20.211 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:28:20.212 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:28:20.212 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:28:20.212 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:28:20.212 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:28:20.212 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:28:20.213 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:28:20.213 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:28:20.213 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:28:20.213 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:28:20.214 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.214 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:28:20.214 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:28:20.214 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:28:20.215 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:28:20.215 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:28:20.215 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:28:20.215 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:28:20.216 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:28:20.216 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:28:20.216 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:28:20.216 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:28:20.216 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:28:20.217 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:28:20.217 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2021-12-17T18:28:20.217 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.217 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.218 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.218 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 29, 2021-12-17T18:28:20.218 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2021-12-17T18:28:20.218 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:28:07.237227+0000", 2021-12-17T18:28:20.219 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:28:20.219 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:28:20.219 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:28:20.219 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:28:20.219 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:28:20.220 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:28:20.220 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:28:20.220 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:28:20.220 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:28:20.221 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:28:20.221 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:28:20.221 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:28:20.221 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:28:20.221 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:28:20.222 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:28:20.222 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:28:20.222 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:28:20.222 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:28:20.223 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:28:20.223 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:28:20.223 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.223 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "150", 2021-12-17T18:28:20.224 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:28:20.224 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:28:20.224 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:28:20.224 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:28:20.224 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:28:20.225 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:28:20.225 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:28:20.225 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:28:20.225 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:28:20.226 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:28:20.226 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:28:20.226 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:28:20.226 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:28:20.227 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:28:20.227 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:28:20.227 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:28:20.227 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:28:20.228 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:28:20.228 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:28:20.228 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:28:20.228 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:28:20.228 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:28:20.229 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:28:20.229 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:28:20.229 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:28:20.229 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:28:20.230 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.230 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:28:20.230 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:28:20.230 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:28:20.231 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:28:20.231 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:28:20.231 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:28:20.231 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:28:20.231 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:28:20.232 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:28:20.232 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:28:20.232 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:28:20.232 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2021-12-17T18:28:20.233 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2021-12-17T18:28:20.233 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2021-12-17T18:28:20.233 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2021-12-17T18:28:20.233 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.233 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:28:20.234 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:28:20.234 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2021-12-17T18:28:20.234 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.234 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.235 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.235 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.235 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 30, 2021-12-17T18:28:20.235 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2021-12-17T18:28:20.236 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2021-12-17T18:28:08.465122+0000", 2021-12-17T18:28:20.236 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2021-12-17T18:28:20.236 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2021-12-17T18:28:20.236 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2021-12-17T18:28:20.237 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2021-12-17T18:28:20.237 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2021-12-17T18:28:20.237 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2021-12-17T18:28:20.237 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2021-12-17T18:28:20.237 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2021-12-17T18:28:20.238 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2021-12-17T18:28:20.238 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2021-12-17T18:28:20.238 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2021-12-17T18:28:20.238 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2021-12-17T18:28:20.239 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2021-12-17T18:28:20.239 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2021-12-17T18:28:20.239 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2021-12-17T18:28:20.239 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2021-12-17T18:28:20.239 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2021-12-17T18:28:20.240 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2021-12-17T18:28:20.240 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2021-12-17T18:28:20.240 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2021-12-17T18:28:20.240 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.241 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "152", 2021-12-17T18:28:20.241 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2021-12-17T18:28:20.241 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2021-12-17T18:28:20.241 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2021-12-17T18:28:20.241 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2021-12-17T18:28:20.242 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2021-12-17T18:28:20.242 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2021-12-17T18:28:20.242 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2021-12-17T18:28:20.242 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2021-12-17T18:28:20.243 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2021-12-17T18:28:20.243 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2021-12-17T18:28:20.243 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2021-12-17T18:28:20.243 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2021-12-17T18:28:20.244 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2021-12-17T18:28:20.244 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2021-12-17T18:28:20.244 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2021-12-17T18:28:20.244 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2021-12-17T18:28:20.244 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2021-12-17T18:28:20.245 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2021-12-17T18:28:20.245 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-12-17T18:28:20.245 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-12-17T18:28:20.245 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2021-12-17T18:28:20.246 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2021-12-17T18:28:20.246 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2021-12-17T18:28:20.246 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2021-12-17T18:28:20.246 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2021-12-17T18:28:20.247 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2021-12-17T18:28:20.247 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.247 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2021-12-17T18:28:20.247 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2021-12-17T18:28:20.247 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2021-12-17T18:28:20.248 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2021-12-17T18:28:20.248 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2021-12-17T18:28:20.248 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2021-12-17T18:28:20.248 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2021-12-17T18:28:20.249 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2021-12-17T18:28:20.249 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2021-12-17T18:28:20.249 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2021-12-17T18:28:20.249 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2021-12-17T18:28:20.250 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2021-12-17T18:28:20.250 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2021-12-17T18:28:20.250 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2021-12-17T18:28:20.250 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2021-12-17T18:28:20.250 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.251 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.251 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.251 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:28:20.251 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2021-12-17T18:28:20.252 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.252 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:28:20.252 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "c51e75ac-d8f3-4558-b672-587f12786690", 2021-12-17T18:28:20.252 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:28:20.252 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:28:20.253 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:28:20.253 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:28:20.253 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:28:20.253 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:28:20.254 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:28:20.254 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 149, 2021-12-17T18:28:20.254 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:28:20.254 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:28:20.255 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:28:20.255 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.255 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.255 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.256 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2021-12-17T18:28:20.256 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:28:20.256 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.256 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.256 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.257 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2021-12-17T18:28:20.257 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:28:20.257 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.257 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.258 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.258 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:28:20.258 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.258 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.259 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.259 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6802", 2021-12-17T18:28:20.259 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:28:20.259 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.260 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.260 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.260 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6803", 2021-12-17T18:28:20.260 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:28:20.260 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.261 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.261 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.261 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:28:20.261 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.262 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.262 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.262 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6806", 2021-12-17T18:28:20.262 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:28:20.262 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.263 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.263 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.263 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6807", 2021-12-17T18:28:20.263 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:28:20.264 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.264 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.264 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.264 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:28:20.265 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.265 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.265 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.265 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6804", 2021-12-17T18:28:20.265 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:28:20.266 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.266 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.266 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.266 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6805", 2021-12-17T18:28:20.267 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14759 2021-12-17T18:28:20.267 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.267 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.267 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.267 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6801/14759", 2021-12-17T18:28:20.268 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6803/14759", 2021-12-17T18:28:20.268 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6807/14759", 2021-12-17T18:28:20.268 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6805/14759", 2021-12-17T18:28:20.268 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:28:20.269 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:28:20.269 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:28:20.269 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.269 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.269 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.270 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:28:20.270 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "886ecd5b-c84b-4b74-a0ac-52eb120d0da6", 2021-12-17T18:28:20.270 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:28:20.270 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:28:20.271 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:28:20.271 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:28:20.271 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:28:20.271 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:28:20.271 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:28:20.272 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 148, 2021-12-17T18:28:20.272 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:28:20.272 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:28:20.272 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:28:20.273 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.273 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.273 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.273 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6824", 2021-12-17T18:28:20.273 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:28:20.274 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.274 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.274 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.274 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6825", 2021-12-17T18:28:20.275 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:28:20.275 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.275 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.275 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.276 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:28:20.276 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.276 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.276 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.276 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6826", 2021-12-17T18:28:20.277 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:28:20.277 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.277 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.277 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.278 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6827", 2021-12-17T18:28:20.278 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:28:20.278 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.278 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.278 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.279 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:28:20.279 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.279 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.279 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.280 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6830", 2021-12-17T18:28:20.280 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:28:20.280 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.280 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.280 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.281 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6831", 2021-12-17T18:28:20.281 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:28:20.281 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.281 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.281 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.282 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:28:20.282 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.282 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.282 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.283 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6828", 2021-12-17T18:28:20.283 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:28:20.283 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.283 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.284 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.284 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6829", 2021-12-17T18:28:20.284 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14763 2021-12-17T18:28:20.284 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.284 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.285 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.285 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6825/14763", 2021-12-17T18:28:20.285 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6827/14763", 2021-12-17T18:28:20.285 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6831/14763", 2021-12-17T18:28:20.286 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6829/14763", 2021-12-17T18:28:20.286 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:28:20.286 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:28:20.286 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:28:20.286 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.287 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.287 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.287 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:28:20.287 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "cdcbd8f0-be3e-4fff-8b63-62f30371135a", 2021-12-17T18:28:20.288 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:28:20.288 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:28:20.288 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:28:20.288 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:28:20.288 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:28:20.289 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:28:20.289 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:28:20.289 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 149, 2021-12-17T18:28:20.289 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:28:20.289 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:28:20.290 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:28:20.290 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.290 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.290 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.291 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6808", 2021-12-17T18:28:20.291 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:28:20.291 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.291 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.292 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.292 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6809", 2021-12-17T18:28:20.292 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:28:20.292 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.293 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.293 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.293 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:28:20.293 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.294 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.294 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.294 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6810", 2021-12-17T18:28:20.294 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:28:20.295 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.295 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.295 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.295 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6811", 2021-12-17T18:28:20.295 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:28:20.296 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.296 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.296 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.296 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:28:20.297 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.297 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.297 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.297 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6814", 2021-12-17T18:28:20.298 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:28:20.298 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.298 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.298 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.298 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6815", 2021-12-17T18:28:20.299 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:28:20.299 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.299 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.299 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.300 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:28:20.300 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.300 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.300 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.301 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6812", 2021-12-17T18:28:20.301 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:28:20.301 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.301 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.301 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.302 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6813", 2021-12-17T18:28:20.302 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14760 2021-12-17T18:28:20.302 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.302 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.303 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.303 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6809/14760", 2021-12-17T18:28:20.303 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6811/14760", 2021-12-17T18:28:20.303 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6815/14760", 2021-12-17T18:28:20.303 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6813/14760", 2021-12-17T18:28:20.304 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:28:20.304 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:28:20.304 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:28:20.304 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.305 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.305 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.305 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:28:20.305 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "80f42567-d96d-4bb0-81d4-4030752e3935", 2021-12-17T18:28:20.305 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:28:20.306 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:28:20.306 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:28:20.306 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:28:20.306 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:28:20.307 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:28:20.307 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:28:20.307 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 150, 2021-12-17T18:28:20.307 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:28:20.307 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:28:20.308 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:28:20.308 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.308 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.308 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.309 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6816", 2021-12-17T18:28:20.309 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:28:20.309 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.309 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.310 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.310 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6817", 2021-12-17T18:28:20.310 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:28:20.310 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.310 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.311 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.311 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:28:20.311 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.311 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.312 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.312 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6818", 2021-12-17T18:28:20.312 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:28:20.312 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.313 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.313 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.313 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6819", 2021-12-17T18:28:20.313 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:28:20.313 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.314 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.314 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.314 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:28:20.314 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.315 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.315 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.315 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6822", 2021-12-17T18:28:20.315 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:28:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6823", 2021-12-17T18:28:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:28:20.317 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.317 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.317 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.317 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:28:20.318 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.318 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.318 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.318 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6820", 2021-12-17T18:28:20.318 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:28:20.319 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.319 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.319 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.319 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6821", 2021-12-17T18:28:20.320 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 14762 2021-12-17T18:28:20.320 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.320 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.320 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.320 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.62:6817/14762", 2021-12-17T18:28:20.321 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.62:6819/14762", 2021-12-17T18:28:20.321 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.62:6823/14762", 2021-12-17T18:28:20.321 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.62:6821/14762", 2021-12-17T18:28:20.321 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:28:20.322 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:28:20.322 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:28:20.322 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.322 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.322 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.323 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:28:20.323 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "02486a2c-1a65-460b-9d75-ed180962ba0a", 2021-12-17T18:28:20.323 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:28:20.323 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:28:20.324 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:28:20.324 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:28:20.324 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:28:20.324 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:28:20.324 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:28:20.325 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 148, 2021-12-17T18:28:20.325 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:28:20.325 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:28:20.325 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:28:20.326 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.326 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.326 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.326 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6810", 2021-12-17T18:28:20.327 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:28:20.327 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.327 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.327 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.327 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6811", 2021-12-17T18:28:20.328 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:28:20.328 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.328 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.328 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.329 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:28:20.329 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.329 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.329 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.329 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6812", 2021-12-17T18:28:20.330 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:28:20.330 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.330 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.330 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.331 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6813", 2021-12-17T18:28:20.331 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:28:20.331 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.331 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.332 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.332 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:28:20.332 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.332 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.333 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.333 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6816", 2021-12-17T18:28:20.333 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:28:20.333 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.333 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.334 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.334 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6817", 2021-12-17T18:28:20.334 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:28:20.334 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.335 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.335 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.335 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:28:20.335 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.336 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.336 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.336 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6814", 2021-12-17T18:28:20.336 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:28:20.336 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.337 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.337 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.337 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6815", 2021-12-17T18:28:20.337 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15017 2021-12-17T18:28:20.338 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.338 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.338 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.338 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6811/15017", 2021-12-17T18:28:20.338 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6813/15017", 2021-12-17T18:28:20.339 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6817/15017", 2021-12-17T18:28:20.339 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6815/15017", 2021-12-17T18:28:20.339 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:28:20.339 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:28:20.340 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:28:20.340 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.340 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.340 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.340 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:28:20.341 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "410bbb54-127f-4e2e-bc1c-373ce84935c0", 2021-12-17T18:28:20.341 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:28:20.341 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:28:20.341 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:28:20.342 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:28:20.342 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:28:20.342 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:28:20.342 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:28:20.342 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 149, 2021-12-17T18:28:20.343 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:28:20.343 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:28:20.343 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:28:20.343 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.344 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.344 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.344 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6802", 2021-12-17T18:28:20.344 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:28:20.344 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.345 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.345 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.345 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6803", 2021-12-17T18:28:20.345 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:28:20.346 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.346 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.346 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.346 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:28:20.346 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.347 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.347 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.347 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6804", 2021-12-17T18:28:20.347 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:28:20.348 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.348 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.348 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.348 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6805", 2021-12-17T18:28:20.349 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:28:20.349 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.349 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.349 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.349 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:28:20.350 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.350 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.350 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.350 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6808", 2021-12-17T18:28:20.351 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:28:20.351 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.351 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.351 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.352 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6809", 2021-12-17T18:28:20.352 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:28:20.352 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.352 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.353 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.353 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:28:20.353 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.353 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.353 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.354 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6806", 2021-12-17T18:28:20.354 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:28:20.354 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.354 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.355 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.355 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6807", 2021-12-17T18:28:20.355 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15019 2021-12-17T18:28:20.355 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.355 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.356 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.356 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6803/15019", 2021-12-17T18:28:20.356 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6805/15019", 2021-12-17T18:28:20.356 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6809/15019", 2021-12-17T18:28:20.357 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6807/15019", 2021-12-17T18:28:20.357 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:28:20.357 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:28:20.357 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:28:20.357 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.358 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.358 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.358 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:28:20.358 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29", 2021-12-17T18:28:20.359 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:28:20.359 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:28:20.359 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:28:20.359 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:28:20.359 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:28:20.360 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:28:20.360 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:28:20.360 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 149, 2021-12-17T18:28:20.360 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:28:20.361 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:28:20.361 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:28:20.361 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.361 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.361 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.362 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6826", 2021-12-17T18:28:20.362 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:28:20.362 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.362 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.363 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.363 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6827", 2021-12-17T18:28:20.363 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:28:20.363 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.363 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.364 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.364 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:28:20.364 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.364 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.365 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.365 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6828", 2021-12-17T18:28:20.365 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:28:20.365 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.365 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.366 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.366 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6829", 2021-12-17T18:28:20.366 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:28:20.366 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.367 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.367 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.367 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:28:20.367 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.367 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.368 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.368 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6832", 2021-12-17T18:28:20.368 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:28:20.368 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.369 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.369 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.369 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6833", 2021-12-17T18:28:20.369 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:28:20.369 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.370 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.370 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.370 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:28:20.370 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.371 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.371 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.371 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6830", 2021-12-17T18:28:20.371 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:28:20.372 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.372 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.372 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.372 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6831", 2021-12-17T18:28:20.372 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15028 2021-12-17T18:28:20.373 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.373 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.373 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.373 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6827/15028", 2021-12-17T18:28:20.373 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6829/15028", 2021-12-17T18:28:20.374 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6833/15028", 2021-12-17T18:28:20.374 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6831/15028", 2021-12-17T18:28:20.374 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:28:20.374 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:28:20.375 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:28:20.375 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.375 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.375 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.376 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:28:20.376 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "f47c0a1f-4b7b-439a-8a64-4e8086324870", 2021-12-17T18:28:20.376 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2021-12-17T18:28:20.376 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2021-12-17T18:28:20.376 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2021-12-17T18:28:20.377 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2021-12-17T18:28:20.377 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2021-12-17T18:28:20.377 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2021-12-17T18:28:20.377 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 14, 2021-12-17T18:28:20.377 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 149, 2021-12-17T18:28:20.378 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2021-12-17T18:28:20.378 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2021-12-17T18:28:20.378 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2021-12-17T18:28:20.378 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.379 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.379 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.379 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6818", 2021-12-17T18:28:20.379 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:28:20.380 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.380 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.380 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.380 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6819", 2021-12-17T18:28:20.380 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:28:20.381 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.381 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.381 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2021-12-17T18:28:20.382 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.382 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.382 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.382 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6820", 2021-12-17T18:28:20.382 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:28:20.383 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.383 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.383 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.383 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6821", 2021-12-17T18:28:20.384 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:28:20.384 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.384 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.384 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2021-12-17T18:28:20.385 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.385 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.385 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.385 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6824", 2021-12-17T18:28:20.386 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:28:20.386 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.386 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.386 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.387 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6825", 2021-12-17T18:28:20.387 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:28:20.387 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.387 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.388 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.388 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2021-12-17T18:28:20.388 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2021-12-17T18:28:20.388 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.388 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2021-12-17T18:28:20.389 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6822", 2021-12-17T18:28:20.389 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:28:20.389 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.389 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.389 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2021-12-17T18:28:20.390 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.109:6823", 2021-12-17T18:28:20.390 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 15018 2021-12-17T18:28:20.390 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.390 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.391 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.391 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.109:6819/15018", 2021-12-17T18:28:20.391 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.109:6821/15018", 2021-12-17T18:28:20.391 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.109:6825/15018", 2021-12-17T18:28:20.392 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.109:6823/15018", 2021-12-17T18:28:20.392 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2021-12-17T18:28:20.392 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2021-12-17T18:28:20.392 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2021-12-17T18:28:20.392 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2021-12-17T18:28:20.393 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.393 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:28:20.393 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2021-12-17T18:28:20.393 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.394 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2021-12-17T18:28:20.394 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:28:20.394 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:28:20.394 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:28:20.395 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:28:20.395 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:28:20.395 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.027604+0000", 2021-12-17T18:28:20.395 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:28:20.395 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.396 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.396 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2021-12-17T18:28:20.396 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:28:20.396 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:28:20.397 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:28:20.397 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:28:20.397 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:28:20.397 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.373149+0000", 2021-12-17T18:28:20.398 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:28:20.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.398 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.398 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2021-12-17T18:28:20.398 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:28:20.399 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:28:20.399 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:28:20.399 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:28:20.399 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:28:20.400 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.281347+0000", 2021-12-17T18:28:20.400 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:28:20.400 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.400 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.400 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 3, 2021-12-17T18:28:20.401 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:28:20.401 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:28:20.401 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:28:20.401 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:28:20.402 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:28:20.402 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.276238+0000", 2021-12-17T18:28:20.402 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:28:20.402 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.402 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.403 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 4, 2021-12-17T18:28:20.403 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:28:20.403 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:28:20.403 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:28:20.404 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:28:20.404 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:28:20.404 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.263643+0000", 2021-12-17T18:28:20.404 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:28:20.405 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.405 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.405 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 5, 2021-12-17T18:28:20.405 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:28:20.405 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:28:20.406 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:28:20.406 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:28:20.406 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:28:20.406 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.057914+0000", 2021-12-17T18:28:20.407 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:28:20.407 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.407 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.407 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 6, 2021-12-17T18:28:20.407 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:28:20.408 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:28:20.408 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:28:20.408 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:28:20.408 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:28:20.409 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.352672+0000", 2021-12-17T18:28:20.409 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:28:20.409 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.409 INFO:teuthology.orchestra.run.smithi062.stdout: { 2021-12-17T18:28:20.410 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 7, 2021-12-17T18:28:20.410 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2021-12-17T18:28:20.410 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2021-12-17T18:28:20.410 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2021-12-17T18:28:20.410 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540138292840890367, 2021-12-17T18:28:20.411 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2021-12-17T18:28:20.411 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2021-12-17T18:18:08.326472+0000", 2021-12-17T18:28:20.411 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2021-12-17T18:28:20.411 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.412 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2021-12-17T18:28:20.412 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2021-12-17T18:28:20.412 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2021-12-17T18:28:20.412 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2021-12-17T18:28:20.412 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2021-12-17T18:28:20.413 INFO:teuthology.orchestra.run.smithi062.stdout: "blacklist": {}, 2021-12-17T18:28:20.413 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2021-12-17T18:28:20.413 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2021-12-17T18:28:20.413 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2021-12-17T18:28:20.414 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2021-12-17T18:28:20.414 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2021-12-17T18:28:20.414 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2021-12-17T18:28:20.414 INFO:teuthology.orchestra.run.smithi062.stdout: "ruleset-failure-domain": "osd", 2021-12-17T18:28:20.415 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2021-12-17T18:28:20.415 INFO:teuthology.orchestra.run.smithi062.stdout: } 2021-12-17T18:28:20.415 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2021-12-17T18:28:20.415 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2021-12-17T18:28:20.415 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2021-12-17T18:28:20.416 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2021-12-17T18:28:20.416 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2021-12-17T18:28:20.416 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {} 2021-12-17T18:28:20.416 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T18:28:20.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.172+0000 7fc210498700 1 -- 172.21.15.62:0/2333231032 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1e8053580 msgr2=0x7fc1e8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:20.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.172+0000 7fc210498700 1 --2- 172.21.15.62:0/2333231032 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1e8053580 0x7fc1e8055a40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fc20400d000 tx=0x7fc204009040).stop 2021-12-17T18:28:20.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.172+0000 7fc210498700 1 -- 172.21.15.62:0/2333231032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2080b3eb0 msgr2=0x7fc20813f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:20.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.172+0000 7fc210498700 1 --2- 172.21.15.62:0/2333231032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2080b3eb0 0x7fc20813f630 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7fc1f8001110 tx=0x7fc1f8007ae0).stop 2021-12-17T18:28:20.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.172+0000 7fc210498700 1 -- 172.21.15.62:0/2333231032 shutdown_connections 2021-12-17T18:28:20.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.172+0000 7fc210498700 1 --2- 172.21.15.62:0/2333231032 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fc1e8053580 0x7fc1e8055a40 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.172+0000 7fc210498700 1 --2- 172.21.15.62:0/2333231032 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fc2081416b0 0x7fc2080ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.172+0000 7fc210498700 1 --2- 172.21.15.62:0/2333231032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2080b3eb0 0x7fc20813f630 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.172+0000 7fc210498700 1 --2- 172.21.15.62:0/2333231032 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fc208067770 0x7fc20813ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.172+0000 7fc210498700 1 -- 172.21.15.62:0/2333231032 >> 172.21.15.62:0/2333231032 conn(0x7fc20805cb40 msgr2=0x7fc2080b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:20.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.172+0000 7fc210498700 1 -- 172.21.15.62:0/2333231032 shutdown_connections 2021-12-17T18:28:20.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.172+0000 7fc210498700 1 -- 172.21.15.62:0/2333231032 wait complete. 2021-12-17T18:28:20.422 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:28:20.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.528+0000 7f860b59e700 1 Processor -- start 2021-12-17T18:28:20.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.528+0000 7f860b59e700 1 -- start start 2021-12-17T18:28:20.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.528+0000 7f860b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f860c141480 0x7f860c147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:20.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.528+0000 7f860b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f860c0a8e10 0x7f860c0b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:20.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.528+0000 7f860b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c147610 con 0x7f860c0b6050 2021-12-17T18:28:20.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.528+0000 7f860b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860c1478b0 con 0x7f860c0a8e10 2021-12-17T18:28:20.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.528+0000 7f860b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c147b50 con 0x7f860c141480 2021-12-17T18:28:20.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.528+0000 7f8609d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f860c0a8e10 0x7f860c0b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:20.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.528+0000 7f8609d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f860c0a8e10 0x7f860c0b5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57574/0 (socket says 172.21.15.62:57574) 2021-12-17T18:28:20.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.528+0000 7f8609d9b700 1 -- 172.21.15.62:0/2507734989 learned_addr learned my addr 172.21.15.62:0/2507734989 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:20.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.528+0000 7f860a59c700 1 --2- 172.21.15.62:0/2507734989 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f860c141480 0x7f860c147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:20.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.532+0000 7f8609d9b700 1 -- 172.21.15.62:0/2507734989 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f860c141480 msgr2=0x7f860c147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:20.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.532+0000 7f8609d9b700 1 --2- 172.21.15.62:0/2507734989 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f860c141480 0x7f860c147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.532+0000 7f860959a700 1 -- 172.21.15.62:0/2507734989 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705350839 0 0) 0x7f860c147610 con 0x7f860c0b6050 2021-12-17T18:28:20.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.532+0000 7f8609d9b700 1 -- 172.21.15.62:0/2507734989 >> v1:172.21.15.62:6789/0 conn(0x7f860c0b6050 legacy=0x7f860c0a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:20.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.532+0000 7f8609d9b700 1 -- 172.21.15.62:0/2507734989 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c0b1b90 con 0x7f860c0a8e10 2021-12-17T18:28:20.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.532+0000 7f8609d9b700 1 --2- 172.21.15.62:0/2507734989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f860c0a8e10 0x7f860c0b5b60 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f85fc0032f0 tx=0x7f85fc009290).ready entity=mon.0 client_cookie=174f1a1237355a69 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:20.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.532+0000 7f860959a700 1 -- 172.21.15.62:0/2507734989 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85fc00b8a0 con 0x7f860c0a8e10 2021-12-17T18:28:20.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.532+0000 7f860959a700 1 -- 172.21.15.62:0/2507734989 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85fc00ba00 con 0x7f860c0a8e10 2021-12-17T18:28:20.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.532+0000 7f860959a700 1 -- 172.21.15.62:0/2507734989 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85fc00bb70 con 0x7f860c0a8e10 2021-12-17T18:28:20.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.532+0000 7f860b59e700 1 -- 172.21.15.62:0/2507734989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f860c0a8e10 msgr2=0x7f860c0b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:20.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.532+0000 7f860b59e700 1 --2- 172.21.15.62:0/2507734989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f860c0a8e10 0x7f860c0b5b60 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f85fc0032f0 tx=0x7f85fc009290).stop 2021-12-17T18:28:20.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.532+0000 7f860b59e700 1 -- 172.21.15.62:0/2507734989 shutdown_connections 2021-12-17T18:28:20.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.532+0000 7f860b59e700 1 --2- 172.21.15.62:0/2507734989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f860c0a8e10 0x7f860c0b5b60 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.532+0000 7f860b59e700 1 --2- 172.21.15.62:0/2507734989 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f860c141480 0x7f860c147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.532+0000 7f860b59e700 1 -- 172.21.15.62:0/2507734989 >> 172.21.15.62:0/2507734989 conn(0x7f860c05d220 msgr2=0x7f860c0b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:20.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.532+0000 7f860b59e700 1 -- 172.21.15.62:0/2507734989 shutdown_connections 2021-12-17T18:28:20.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.532+0000 7f860b59e700 1 -- 172.21.15.62:0/2507734989 wait complete. 2021-12-17T18:28:20.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860b59e700 1 Processor -- start 2021-12-17T18:28:20.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860b59e700 1 -- start start 2021-12-17T18:28:20.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860b59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f860c0a8e10 0x7f860c14b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:20.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860b59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f860c0b6050 0x7f860c0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:20.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f860c141480 0x7f860c1489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:20.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c13f480 con 0x7f860c141480 2021-12-17T18:28:20.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860b59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c156b10 con 0x7f860c0a8e10 2021-12-17T18:28:20.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860b59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c14aa40 con 0x7f860c0b6050 2021-12-17T18:28:20.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860ad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f860c141480 0x7f860c1489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:20.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860ad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f860c141480 0x7f860c1489d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57584/0 (socket says 172.21.15.62:57584) 2021-12-17T18:28:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860ad9d700 1 -- 172.21.15.62:0/117602958 learned_addr learned my addr 172.21.15.62:0/117602958 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f8609d9b700 1 --2- 172.21.15.62:0/117602958 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f860c0b6050 0x7f860c0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860a59c700 1 --2- 172.21.15.62:0/117602958 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f860c0a8e10 0x7f860c14b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860ad9d700 1 -- 172.21.15.62:0/117602958 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f860c0b6050 msgr2=0x7f860c0aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:20.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860ad9d700 1 --2- 172.21.15.62:0/117602958 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f860c0b6050 0x7f860c0aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860ad9d700 1 -- 172.21.15.62:0/117602958 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f860c0a8e10 msgr2=0x7f860c14b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:20.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860ad9d700 1 --2- 172.21.15.62:0/117602958 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f860c0a8e10 0x7f860c14b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860ad9d700 1 -- 172.21.15.62:0/117602958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc009530 con 0x7f860c141480 2021-12-17T18:28:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860a59c700 1 --2- 172.21.15.62:0/117602958 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f860c0a8e10 0x7f860c14b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T18:28:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.536+0000 7f860ad9d700 1 --2- 172.21.15.62:0/117602958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f860c141480 0x7f860c1489d0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f8604000ed0 tx=0x7f8604007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.540+0000 7f85fb7fe700 1 -- 172.21.15.62:0/117602958 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8604012400 con 0x7f860c141480 2021-12-17T18:28:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.540+0000 7f85fb7fe700 1 -- 172.21.15.62:0/117602958 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8604012560 con 0x7f860c141480 2021-12-17T18:28:20.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.540+0000 7f860b59e700 1 -- 172.21.15.62:0/117602958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860c156d00 con 0x7f860c141480 2021-12-17T18:28:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.540+0000 7f85fb7fe700 1 -- 172.21.15.62:0/117602958 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86040128c0 con 0x7f860c141480 2021-12-17T18:28:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.540+0000 7f860b59e700 1 -- 172.21.15.62:0/117602958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860c0ac180 con 0x7f860c141480 2021-12-17T18:28:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.540+0000 7f860b59e700 1 -- 172.21.15.62:0/117602958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860c156e90 con 0x7f860c141480 2021-12-17T18:28:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.540+0000 7f85fb7fe700 1 -- 172.21.15.62:0/117602958 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8604019030 con 0x7f860c141480 2021-12-17T18:28:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.540+0000 7f85fb7fe700 1 --2- 172.21.15.62:0/117602958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85e8053610 0x7f85e8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.540+0000 7f85fb7fe700 1 -- 172.21.15.62:0/117602958 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f860406ad40 con 0x7f860c141480 2021-12-17T18:28:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.540+0000 7f860a59c700 1 --2- 172.21.15.62:0/117602958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85e8053610 0x7f85e8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.540+0000 7f860a59c700 1 --2- 172.21.15.62:0/117602958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85e8053610 0x7f85e8055ad0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f860000b000 tx=0x7f8600008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:20.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.548+0000 7f85fb7fe700 1 -- 172.21.15.62:0/117602958 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8604041ea0 con 0x7f860c141480 2021-12-17T18:28:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.712+0000 7f860b59e700 1 -- 172.21.15.62:0/117602958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f860c141860 con 0x7f860c141480 2021-12-17T18:28:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.716+0000 7f85fb7fe700 1 -- 172.21.15.62:0/117602958 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f86040454c0 con 0x7f860c141480 2021-12-17T18:28:20.722 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:20.722 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":76,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3486639655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3486639655},{"type":"v1","addr":"172.21.15.109:6835","nonce":3486639655}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:28:09.455753+0000","modified":"2021-12-17T18:28:10.458774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7397},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7397":{"gid":7397,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6833/2348194620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2348194620},{"type":"v1","addr":"172.21.15.62:6833","nonce":2348194620}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-12-17T18:28:20.723 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.716+0000 7f860b59e700 1 -- 172.21.15.62:0/117602958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85e8053610 msgr2=0x7f85e8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:20.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.716+0000 7f860b59e700 1 --2- 172.21.15.62:0/117602958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85e8053610 0x7f85e8055ad0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f860000b000 tx=0x7f8600008040).stop 2021-12-17T18:28:20.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.716+0000 7f860b59e700 1 -- 172.21.15.62:0/117602958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f860c141480 msgr2=0x7f860c1489d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:20.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.716+0000 7f860b59e700 1 --2- 172.21.15.62:0/117602958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f860c141480 0x7f860c1489d0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f8604000ed0 tx=0x7f8604007a40).stop 2021-12-17T18:28:20.724 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.716+0000 7f860b59e700 1 -- 172.21.15.62:0/117602958 shutdown_connections 2021-12-17T18:28:20.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.716+0000 7f860b59e700 1 --2- 172.21.15.62:0/117602958 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f85e8053610 0x7f85e8055ad0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.716+0000 7f860b59e700 1 --2- 172.21.15.62:0/117602958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f860c141480 0x7f860c1489d0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.716+0000 7f860b59e700 1 --2- 172.21.15.62:0/117602958 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f860c0b6050 0x7f860c0aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.716+0000 7f860b59e700 1 --2- 172.21.15.62:0/117602958 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f860c0a8e10 0x7f860c14b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.725 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.716+0000 7f860b59e700 1 -- 172.21.15.62:0/117602958 >> 172.21.15.62:0/117602958 conn(0x7f860c05d220 msgr2=0x7f860c0601b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.716+0000 7f860b59e700 1 -- 172.21.15.62:0/117602958 shutdown_connections 2021-12-17T18:28:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.716+0000 7f860b59e700 1 -- 172.21.15.62:0/117602958 wait complete. 2021-12-17T18:28:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 76 2021-12-17T18:28:20.735 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-12-17T18:28:20.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.828+0000 7f6dd6187700 1 Processor -- start 2021-12-17T18:28:20.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.828+0000 7f6dd6187700 1 -- start start 2021-12-17T18:28:20.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dd6187700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6dd0067120 0x7f6dd00675a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:20.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dd6187700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd00ad7f0 con 0x7f6dd0143780 2021-12-17T18:28:20.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dd6187700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd00ada90 con 0x7f6dd0067a90 2021-12-17T18:28:20.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dd6187700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd00add30 con 0x7f6dd0067120 2021-12-17T18:28:20.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dceffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6dd0067120 0x7f6dd00675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:20.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dceffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6dd0067120 0x7f6dd00675a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57588/0 (socket says 172.21.15.62:57588) 2021-12-17T18:28:20.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dceffd700 1 -- 172.21.15.62:0/1616066855 learned_addr learned my addr 172.21.15.62:0/1616066855 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:20.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dceffd700 1 -- 172.21.15.62:0/1616066855 >> v1:172.21.15.109:6789/0 conn(0x7f6dd0067a90 legacy=0x7f6dd00b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:20.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dceffd700 1 -- 172.21.15.62:0/1616066855 >> v1:172.21.15.62:6789/0 conn(0x7f6dd0143780 legacy=0x7f6dd0143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:20.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dceffd700 1 -- 172.21.15.62:0/1616066855 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd00ad3c0 con 0x7f6dd0067120 2021-12-17T18:28:20.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dceffd700 1 --2- 172.21.15.62:0/1616066855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dd0067120 0x7f6dd00675a0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f6dd0062150 tx=0x7f6db8006eb0).ready entity=mon.0 client_cookie=df5439e9a7fef136 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:20.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dce7fc700 1 -- 172.21.15.62:0/1616066855 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6db800d610 con 0x7f6dd0067120 2021-12-17T18:28:20.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dce7fc700 1 -- 172.21.15.62:0/1616066855 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db8000e90 con 0x7f6dd0067120 2021-12-17T18:28:20.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dce7fc700 1 -- 172.21.15.62:0/1616066855 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6db800d960 con 0x7f6dd0067120 2021-12-17T18:28:20.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dd6187700 1 -- 172.21.15.62:0/1616066855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dd0067120 msgr2=0x7f6dd00675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:20.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dd6187700 1 --2- 172.21.15.62:0/1616066855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dd0067120 0x7f6dd00675a0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f6dd0062150 tx=0x7f6db8006eb0).stop 2021-12-17T18:28:20.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dd6187700 1 -- 172.21.15.62:0/1616066855 shutdown_connections 2021-12-17T18:28:20.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dd6187700 1 --2- 172.21.15.62:0/1616066855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dd0067120 0x7f6dd00675a0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dd6187700 1 -- 172.21.15.62:0/1616066855 >> 172.21.15.62:0/1616066855 conn(0x7f6dd005f730 msgr2=0x7f6dd005fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:20.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dd6187700 1 -- 172.21.15.62:0/1616066855 shutdown_connections 2021-12-17T18:28:20.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.832+0000 7f6dd6187700 1 -- 172.21.15.62:0/1616066855 wait complete. 2021-12-17T18:28:20.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.836+0000 7f6dd6187700 1 Processor -- start 2021-12-17T18:28:20.859 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.836+0000 7f6dd6187700 1 -- start start 2021-12-17T18:28:20.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.836+0000 7f6dd6187700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6dd0067120 0x7f6dd0140200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:20.860 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.836+0000 7f6dd6187700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dd0067a90 0x7f6dd00b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:20.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.836+0000 7f6dd6187700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6dd0143780 0x7f6dd00b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:20.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.836+0000 7f6dd6187700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00b3450 con 0x7f6dd0067a90 2021-12-17T18:28:20.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.836+0000 7f6dd6187700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00a8fc0 con 0x7f6dd0143780 2021-12-17T18:28:20.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.836+0000 7f6dd6187700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00b3680 con 0x7f6dd0067120 2021-12-17T18:28:20.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.836+0000 7f6dceffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dd0067a90 0x7f6dd00b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:20.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.836+0000 7f6dceffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dd0067a90 0x7f6dd00b3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57594/0 (socket says 172.21.15.62:57594) 2021-12-17T18:28:20.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.836+0000 7f6dceffd700 1 -- 172.21.15.62:0/846480239 learned_addr learned my addr 172.21.15.62:0/846480239 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:20.863 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.836+0000 7f6dcf7fe700 1 --2- 172.21.15.62:0/846480239 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6dd0067120 0x7f6dd0140200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:20.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.836+0000 7f6dcffff700 1 --2- 172.21.15.62:0/846480239 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6dd0143780 0x7f6dd00b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:20.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.840+0000 7f6dceffd700 1 -- 172.21.15.62:0/846480239 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6dd0067120 msgr2=0x7f6dd0140200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:20.864 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.840+0000 7f6dceffd700 1 --2- 172.21.15.62:0/846480239 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6dd0067120 0x7f6dd0140200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.840+0000 7f6dceffd700 1 -- 172.21.15.62:0/846480239 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6dd0143780 msgr2=0x7f6dd00b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:20.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.840+0000 7f6dceffd700 1 --2- 172.21.15.62:0/846480239 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6dd0143780 0x7f6dd00b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:20.865 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.840+0000 7f6dceffd700 1 -- 172.21.15.62:0/846480239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db800b1e0 con 0x7f6dd0067a90 2021-12-17T18:28:20.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.840+0000 7f6dceffd700 1 --2- 172.21.15.62:0/846480239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dd0067a90 0x7f6dd00b3af0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7f6dd0062150 tx=0x7f6db8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:20.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.840+0000 7f6dccff9700 1 -- 172.21.15.62:0/846480239 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6db8011860 con 0x7f6dd0067a90 2021-12-17T18:28:20.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.840+0000 7f6dccff9700 1 -- 172.21.15.62:0/846480239 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db80119c0 con 0x7f6dd0067a90 2021-12-17T18:28:20.866 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.840+0000 7f6dd6187700 1 -- 172.21.15.62:0/846480239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd00a8d20 con 0x7f6dd0067a90 2021-12-17T18:28:20.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.840+0000 7f6dccff9700 1 -- 172.21.15.62:0/846480239 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6db8011d20 con 0x7f6dd0067a90 2021-12-17T18:28:20.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.840+0000 7f6dd6187700 1 -- 172.21.15.62:0/846480239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd00abd20 con 0x7f6dd0067a90 2021-12-17T18:28:20.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.840+0000 7f6dd6187700 1 -- 172.21.15.62:0/846480239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd00573d0 con 0x7f6dd0067a90 2021-12-17T18:28:20.867 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.840+0000 7f6dccff9700 1 -- 172.21.15.62:0/846480239 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6db8025030 con 0x7f6dd0067a90 2021-12-17T18:28:20.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.844+0000 7f6dccff9700 1 --2- 172.21.15.62:0/846480239 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6db40534f0 0x7f6db40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:20.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.844+0000 7f6dccff9700 1 -- 172.21.15.62:0/846480239 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6db806cca0 con 0x7f6dd0067a90 2021-12-17T18:28:20.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.844+0000 7f6dcf7fe700 1 --2- 172.21.15.62:0/846480239 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6db40534f0 0x7f6db40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:20.868 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.844+0000 7f6dcf7fe700 1 --2- 172.21.15.62:0/846480239 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6db40534f0 0x7f6db40559b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f6dc000d000 tx=0x7f6dc0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:20.869 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:20.848+0000 7f6dccff9700 1 -- 172.21.15.62:0/846480239 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6db8071070 con 0x7f6dd0067a90 2021-12-17T18:28:21.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.020+0000 7f6dd6187700 1 -- 172.21.15.62:0/846480239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6dd006a2b0 con 0x7f6dd0067a90 2021-12-17T18:28:21.768 INFO:tasks.ceph.mon.a.smithi062.stderr:2021-12-17T18:28:21.760+0000 7f8d3b366700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-12-17T18:28:21.779 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.772+0000 7f6dccff9700 1 -- 172.21.15.62:0/846480239 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6db8023020 con 0x7f6dd0067a90 2021-12-17T18:28:21.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.776+0000 7f6dd6187700 1 -- 172.21.15.62:0/846480239 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6db40534f0 msgr2=0x7f6db40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:21.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.776+0000 7f6dd6187700 1 --2- 172.21.15.62:0/846480239 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6db40534f0 0x7f6db40559b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f6dc000d000 tx=0x7f6dc0009040).stop 2021-12-17T18:28:21.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.776+0000 7f6dd6187700 1 -- 172.21.15.62:0/846480239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dd0067a90 msgr2=0x7f6dd00b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:21.784 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.776+0000 7f6dd6187700 1 --2- 172.21.15.62:0/846480239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dd0067a90 0x7f6dd00b3af0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7f6dd0062150 tx=0x7f6db8015000).stop 2021-12-17T18:28:21.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.776+0000 7f6dd6187700 1 -- 172.21.15.62:0/846480239 shutdown_connections 2021-12-17T18:28:21.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.776+0000 7f6dd6187700 1 --2- 172.21.15.62:0/846480239 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f6db40534f0 0x7f6db40559b0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:21.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.776+0000 7f6dd6187700 1 --2- 172.21.15.62:0/846480239 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f6dd0143780 0x7f6dd00b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:21.785 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.776+0000 7f6dd6187700 1 --2- 172.21.15.62:0/846480239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dd0067a90 0x7f6dd00b3af0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:21.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.776+0000 7f6dd6187700 1 --2- 172.21.15.62:0/846480239 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f6dd0067120 0x7f6dd0140200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:21.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.776+0000 7f6dd6187700 1 -- 172.21.15.62:0/846480239 >> 172.21.15.62:0/846480239 conn(0x7f6dd005f730 msgr2=0x7f6dd00b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:21.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.776+0000 7f6dd6187700 1 -- 172.21.15.62:0/846480239 shutdown_connections 2021-12-17T18:28:21.786 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.776+0000 7f6dd6187700 1 -- 172.21.15.62:0/846480239 wait complete. 2021-12-17T18:28:21.787 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-12-17T18:28:21.800 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-12-17T18:28:21.811 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2021-12-17T18:28:21.905 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32b5b76700 1 Processor -- start 2021-12-17T18:28:21.906 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32b5b76700 1 -- start start 2021-12-17T18:28:21.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32b5b76700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f32b00b3a40 0x7f32b0063cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:21.909 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32b5b76700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b00b1990 con 0x7f32b013fd90 2021-12-17T18:28:21.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32b5b76700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b0063620 con 0x7f32b00af8a0 2021-12-17T18:28:21.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32b5b76700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b00b3e20 con 0x7f32b00b3a40 2021-12-17T18:28:21.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32b4b74700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f32b00b3a40 0x7f32b0063cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:21.910 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32b5375700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f32b013fd90 0x7f32b0140220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41196/0 (socket says 172.21.15.62:41196) 2021-12-17T18:28:21.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32b5375700 1 -- 172.21.15.62:0/575836964 learned_addr learned my addr 172.21.15.62:0/575836964 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:21.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32af7fe700 1 -- 172.21.15.62:0/575836964 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1908895189 0 0) 0x7f32b0063620 con 0x7f32b00af8a0 2021-12-17T18:28:21.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32af7fe700 1 -- 172.21.15.62:0/575836964 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f329c003260 con 0x7f32b00af8a0 2021-12-17T18:28:21.911 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32b4b74700 1 -- 172.21.15.62:0/575836964 >> v1:172.21.15.109:6789/0 conn(0x7f32b00af8a0 legacy=0x7f32b0144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:21.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32b4b74700 1 -- 172.21.15.62:0/575836964 >> v1:172.21.15.62:6789/0 conn(0x7f32b013fd90 legacy=0x7f32b0140220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:21.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32b4b74700 1 -- 172.21.15.62:0/575836964 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b0062760 con 0x7f32b00b3a40 2021-12-17T18:28:21.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32b4b74700 1 --2- 172.21.15.62:0/575836964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32b00b3a40 0x7f32b0063cf0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f32a0002f70 tx=0x7f32a0006df0).ready entity=mon.0 client_cookie=62fa69fbc0a002f8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:21.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32af7fe700 1 -- 172.21.15.62:0/575836964 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32a000d610 con 0x7f32b00b3a40 2021-12-17T18:28:21.912 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32af7fe700 1 -- 172.21.15.62:0/575836964 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a0000e90 con 0x7f32b00b3a40 2021-12-17T18:28:21.913 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.900+0000 7f32af7fe700 1 -- 172.21.15.62:0/575836964 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32a000d960 con 0x7f32b00b3a40 2021-12-17T18:28:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.904+0000 7f32b5b76700 1 -- 172.21.15.62:0/575836964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32b00b3a40 msgr2=0x7f32b0063cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.904+0000 7f32b5b76700 1 --2- 172.21.15.62:0/575836964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32b00b3a40 0x7f32b0063cf0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f32a0002f70 tx=0x7f32a0006df0).stop 2021-12-17T18:28:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.904+0000 7f32b5b76700 1 -- 172.21.15.62:0/575836964 shutdown_connections 2021-12-17T18:28:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.904+0000 7f32b5b76700 1 --2- 172.21.15.62:0/575836964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32b00b3a40 0x7f32b0063cf0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:21.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.904+0000 7f32b5b76700 1 -- 172.21.15.62:0/575836964 >> 172.21.15.62:0/575836964 conn(0x7f32b00b7020 msgr2=0x7f32b00b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:21.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.904+0000 7f32b5b76700 1 -- 172.21.15.62:0/575836964 shutdown_connections 2021-12-17T18:28:21.919 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.904+0000 7f32b5b76700 1 -- 172.21.15.62:0/575836964 wait complete. 2021-12-17T18:28:21.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.904+0000 7f32b5b76700 1 Processor -- start 2021-12-17T18:28:21.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.904+0000 7f32b5b76700 1 -- start start 2021-12-17T18:28:21.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32b5b76700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f32b00af8a0 0x7f32b01534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:21.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32b5b76700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32b00b3a40 0x7f32b0141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:21.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32b5b76700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f32b013fd90 0x7f32b01134b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:21.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32b5b76700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b0110e00 con 0x7f32b00b3a40 2021-12-17T18:28:21.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32b5b76700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b010f8c0 con 0x7f32b013fd90 2021-12-17T18:28:21.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32b5b76700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b0111c80 con 0x7f32b00af8a0 2021-12-17T18:28:21.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32affff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32b00b3a40 0x7f32b0141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:21.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32affff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32b00b3a40 0x7f32b0141900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57620/0 (socket says 172.21.15.62:57620) 2021-12-17T18:28:21.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32affff700 1 -- 172.21.15.62:0/341399507 learned_addr learned my addr 172.21.15.62:0/341399507 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:21.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32b5375700 1 --2- 172.21.15.62:0/341399507 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f32b013fd90 0x7f32b01134b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:21.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32b4b74700 1 --2- 172.21.15.62:0/341399507 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f32b00af8a0 0x7f32b01534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:21.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32affff700 1 -- 172.21.15.62:0/341399507 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f32b00af8a0 msgr2=0x7f32b01534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:21.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32affff700 1 --2- 172.21.15.62:0/341399507 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f32b00af8a0 0x7f32b01534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:21.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32affff700 1 -- 172.21.15.62:0/341399507 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f32b013fd90 msgr2=0x7f32b01134b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:21.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32affff700 1 --2- 172.21.15.62:0/341399507 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f32b013fd90 0x7f32b01134b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:21.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32affff700 1 -- 172.21.15.62:0/341399507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a000b180 con 0x7f32b00b3a40 2021-12-17T18:28:21.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32affff700 1 --2- 172.21.15.62:0/341399507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32b00b3a40 0x7f32b0141900 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f32a4001110 tx=0x7f32a4007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:21.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32adffb700 1 -- 172.21.15.62:0/341399507 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32a4012400 con 0x7f32b00b3a40 2021-12-17T18:28:21.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32adffb700 1 -- 172.21.15.62:0/341399507 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a4012560 con 0x7f32b00b3a40 2021-12-17T18:28:21.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32b5b76700 1 -- 172.21.15.62:0/341399507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b00670a0 con 0x7f32b00b3a40 2021-12-17T18:28:21.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32adffb700 1 -- 172.21.15.62:0/341399507 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32a40128c0 con 0x7f32b00b3a40 2021-12-17T18:28:21.925 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32b5b76700 1 -- 172.21.15.62:0/341399507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b010ff70 con 0x7f32b00b3a40 2021-12-17T18:28:21.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.908+0000 7f32b5b76700 1 -- 172.21.15.62:0/341399507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b0110c20 con 0x7f32b00b3a40 2021-12-17T18:28:21.926 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.912+0000 7f32adffb700 1 -- 172.21.15.62:0/341399507 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f32a4019030 con 0x7f32b00b3a40 2021-12-17T18:28:21.927 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.912+0000 7f32adffb700 1 --2- 172.21.15.62:0/341399507 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3290053580 0x7f3290055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:21.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.912+0000 7f32adffb700 1 -- 172.21.15.62:0/341399507 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f32a406ae90 con 0x7f32b00b3a40 2021-12-17T18:28:21.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.912+0000 7f32b4b74700 1 --2- 172.21.15.62:0/341399507 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3290053580 0x7f3290055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:21.928 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.912+0000 7f32b4b74700 1 --2- 172.21.15.62:0/341399507 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3290053580 0x7f3290055a40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f32a001a000 tx=0x7f32a0014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:21.929 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:21.920+0000 7f32adffb700 1 -- 172.21.15.62:0/341399507 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f32a4041e90 con 0x7f32b00b3a40 2021-12-17T18:28:22.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.084+0000 7f32b5b76700 1 -- 172.21.15.62:0/341399507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32b0062990 con 0x7f32b00b3a40 2021-12-17T18:28:22.092 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.084+0000 7f32adffb700 1 -- 172.21.15.62:0/341399507 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+1785 (secure 0 0 0) 0x7f32a406c070 con 0x7f32b00b3a40 2021-12-17T18:28:22.093 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T18:28:22.093 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":77,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7394,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.109:6835/3486639655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6834","nonce":3486639655},{"type":"v1","addr":"172.21.15.109:6835","nonce":3486639655}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":77,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-12-17T18:28:09.455753+0000","modified":"2021-12-17T18:28:21.766013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":153,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-12-17T18:28:22.094 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.088+0000 7f32b5b76700 1 -- 172.21.15.62:0/341399507 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3290053580 msgr2=0x7f3290055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:22.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.088+0000 7f32b5b76700 1 --2- 172.21.15.62:0/341399507 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3290053580 0x7f3290055a40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f32a001a000 tx=0x7f32a0014000).stop 2021-12-17T18:28:22.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.088+0000 7f32b5b76700 1 -- 172.21.15.62:0/341399507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32b00b3a40 msgr2=0x7f32b0141900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:22.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.088+0000 7f32b5b76700 1 --2- 172.21.15.62:0/341399507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32b00b3a40 0x7f32b0141900 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f32a4001110 tx=0x7f32a4007ae0).stop 2021-12-17T18:28:22.095 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.088+0000 7f32b5b76700 1 -- 172.21.15.62:0/341399507 shutdown_connections 2021-12-17T18:28:22.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.088+0000 7f32b5b76700 1 --2- 172.21.15.62:0/341399507 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f3290053580 0x7f3290055a40 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:22.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.088+0000 7f32b5b76700 1 --2- 172.21.15.62:0/341399507 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f32b013fd90 0x7f32b01134b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:22.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.088+0000 7f32b5b76700 1 --2- 172.21.15.62:0/341399507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32b00b3a40 0x7f32b0141900 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:22.096 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.088+0000 7f32b5b76700 1 --2- 172.21.15.62:0/341399507 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f32b00af8a0 0x7f32b01534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:22.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.088+0000 7f32b5b76700 1 -- 172.21.15.62:0/341399507 >> 172.21.15.62:0/341399507 conn(0x7f32b00b7020 msgr2=0x7f32b0144290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:22.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.088+0000 7f32b5b76700 1 -- 172.21.15.62:0/341399507 shutdown_connections 2021-12-17T18:28:22.097 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.088+0000 7f32b5b76700 1 -- 172.21.15.62:0/341399507 wait complete. 2021-12-17T18:28:22.098 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 77 2021-12-17T18:28:22.106 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-12-17T18:28:22.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0dbc903700 1 Processor -- start 2021-12-17T18:28:22.214 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0dbc903700 1 -- start start 2021-12-17T18:28:22.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0dbc903700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db80b3a80 0x7f0db80b4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:22.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0dbc903700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f0db81478d0 0x7f0db8067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:22.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0dbc903700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db814b880 con 0x7f0db80b4260 2021-12-17T18:28:22.217 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0dbc903700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db80af9d0 con 0x7f0db81478d0 2021-12-17T18:28:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0dbc903700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db814bab0 con 0x7f0db80b3a80 2021-12-17T18:28:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0db659c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0db80b4260 0x7f0db80b3370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41206/0 (socket says 172.21.15.62:41206) 2021-12-17T18:28:22.218 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0db659c700 1 -- 172.21.15.62:0/3045608216 learned_addr learned my addr 172.21.15.62:0/3045608216 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0daffff700 1 --2- 172.21.15.62:0/3045608216 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db80b3a80 0x7f0db80b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0db6d9d700 1 --2- 172.21.15.62:0/3045608216 >> v2:172.21.15.109:3300/0 conn(0x7f0db81478d0 0x7f0db8067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0db5d9b700 1 -- 172.21.15.62:0/3045608216 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223100518 0 0) 0x7f0db814b880 con 0x7f0db80b4260 2021-12-17T18:28:22.219 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0db5d9b700 1 -- 172.21.15.62:0/3045608216 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d9c003260 con 0x7f0db80b4260 2021-12-17T18:28:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0daffff700 1 -- 172.21.15.62:0/3045608216 >> v2:172.21.15.109:3300/0 conn(0x7f0db81478d0 msgr2=0x7f0db8067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0daffff700 1 --2- 172.21.15.62:0/3045608216 >> v2:172.21.15.109:3300/0 conn(0x7f0db81478d0 0x7f0db8067120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:22.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0daffff700 1 -- 172.21.15.62:0/3045608216 >> v1:172.21.15.62:6789/0 conn(0x7f0db80b4260 legacy=0x7f0db80b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0daffff700 1 -- 172.21.15.62:0/3045608216 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db8147d40 con 0x7f0db80b3a80 2021-12-17T18:28:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0db5d9b700 1 -- 172.21.15.62:0/3045608216 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1059186321 0 0) 0x7f0d9c003260 con 0x7f0db80b4260 2021-12-17T18:28:22.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0daffff700 1 --2- 172.21.15.62:0/3045608216 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db80b3a80 0x7f0db80b4640 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f0da0001800 tx=0x7f0da8006df0).ready entity=mon.2 client_cookie=14591d687bcf503b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:22.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0db5d9b700 1 -- 172.21.15.62:0/3045608216 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da0001660 con 0x7f0db80b3a80 2021-12-17T18:28:22.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0db5d9b700 1 -- 172.21.15.62:0/3045608216 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da8000e90 con 0x7f0db80b3a80 2021-12-17T18:28:22.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.208+0000 7f0db5d9b700 1 -- 172.21.15.62:0/3045608216 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da8012460 con 0x7f0db80b3a80 2021-12-17T18:28:22.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.212+0000 7f0dbc903700 1 -- 172.21.15.62:0/3045608216 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db80b3a80 msgr2=0x7f0db80b4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:22.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.212+0000 7f0dbc903700 1 --2- 172.21.15.62:0/3045608216 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db80b3a80 0x7f0db80b4640 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f0da0001800 tx=0x7f0da8006df0).stop 2021-12-17T18:28:22.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.212+0000 7f0dbc903700 1 -- 172.21.15.62:0/3045608216 shutdown_connections 2021-12-17T18:28:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.212+0000 7f0dbc903700 1 --2- 172.21.15.62:0/3045608216 >> v2:172.21.15.109:3300/0 conn(0x7f0db81478d0 0x7f0db8067120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.212+0000 7f0dbc903700 1 --2- 172.21.15.62:0/3045608216 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db80b3a80 0x7f0db80b4640 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.212+0000 7f0dbc903700 1 -- 172.21.15.62:0/3045608216 >> 172.21.15.62:0/3045608216 conn(0x7f0db805cb40 msgr2=0x7f0db805cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:22.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.212+0000 7f0dbc903700 1 -- 172.21.15.62:0/3045608216 shutdown_connections 2021-12-17T18:28:22.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.212+0000 7f0dbc903700 1 -- 172.21.15.62:0/3045608216 wait complete. 2021-12-17T18:28:22.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.212+0000 7f0dbc903700 1 Processor -- start 2021-12-17T18:28:22.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.212+0000 7f0dbc903700 1 -- start start 2021-12-17T18:28:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0dbc903700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0db80b3a80 0x7f0db80b8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0dbc903700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db80b4260 0x7f0db8146a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0dbc903700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db81478d0 0x7f0db8146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0dbc903700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8067330 con 0x7f0db80b4260 2021-12-17T18:28:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0dbc903700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80a1f90 con 0x7f0db80b3a80 2021-12-17T18:28:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0dbc903700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80a2230 con 0x7f0db81478d0 2021-12-17T18:28:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0daffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db80b4260 0x7f0db8146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0daffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db80b4260 0x7f0db8146a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57634/0 (socket says 172.21.15.62:57634) 2021-12-17T18:28:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0daffff700 1 -- 172.21.15.62:0/3810639145 learned_addr learned my addr 172.21.15.62:0/3810639145 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:22.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0db659c700 1 --2- 172.21.15.62:0/3810639145 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0db80b3a80 0x7f0db80b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:22.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0db6d9d700 1 --2- 172.21.15.62:0/3810639145 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db81478d0 0x7f0db8146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:22.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0daffff700 1 -- 172.21.15.62:0/3810639145 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db81478d0 msgr2=0x7f0db8146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:22.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0daffff700 1 --2- 172.21.15.62:0/3810639145 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db81478d0 0x7f0db8146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:22.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0daffff700 1 -- 172.21.15.62:0/3810639145 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0db80b3a80 msgr2=0x7f0db80b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:22.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0daffff700 1 --2- 172.21.15.62:0/3810639145 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0db80b3a80 0x7f0db80b8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:22.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0daffff700 1 -- 172.21.15.62:0/3810639145 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da800b180 con 0x7f0db80b4260 2021-12-17T18:28:22.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0daffff700 1 --2- 172.21.15.62:0/3810639145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db80b4260 0x7f0db8146a60 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f0da0001800 tx=0x7f0da8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:22.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0daf7fe700 1 -- 172.21.15.62:0/3810639145 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da8016030 con 0x7f0db80b4260 2021-12-17T18:28:22.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0daf7fe700 1 -- 172.21.15.62:0/3810639145 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da8013e40 con 0x7f0db80b4260 2021-12-17T18:28:22.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0dbc903700 1 -- 172.21.15.62:0/3810639145 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db8067760 con 0x7f0db80b4260 2021-12-17T18:28:22.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0daf7fe700 1 -- 172.21.15.62:0/3810639145 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da800dd00 con 0x7f0db80b4260 2021-12-17T18:28:22.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.216+0000 7f0dbc903700 1 -- 172.21.15.62:0/3810639145 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db8147440 con 0x7f0db80b4260 2021-12-17T18:28:22.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.220+0000 7f0dbc903700 1 -- 172.21.15.62:0/3810639145 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db80674a0 con 0x7f0db80b4260 2021-12-17T18:28:22.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.220+0000 7f0daf7fe700 1 -- 172.21.15.62:0/3810639145 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0da8024020 con 0x7f0db80b4260 2021-12-17T18:28:22.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.220+0000 7f0daf7fe700 1 --2- 172.21.15.62:0/3810639145 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0d900535b0 0x7f0d90055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:22.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.220+0000 7f0daf7fe700 1 -- 172.21.15.62:0/3810639145 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0da8017070 con 0x7f0db80b4260 2021-12-17T18:28:22.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.220+0000 7f0db659c700 1 --2- 172.21.15.62:0/3810639145 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0d900535b0 0x7f0d90055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:22.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.220+0000 7f0db659c700 1 --2- 172.21.15.62:0/3810639145 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0d900535b0 0x7f0d90055a70 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f0da000d000 tx=0x7f0da0001de0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:22.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.224+0000 7f0daf7fe700 1 -- 172.21.15.62:0/3810639145 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0db80674a0 con 0x7f0db80b4260 2021-12-17T18:28:22.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:22.388+0000 7f0dbc903700 1 -- 172.21.15.62:0/3810639145 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0db80adf20 con 0x7f0db80b4260 2021-12-17T18:28:23.041 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.036+0000 7f0daf7fe700 1 -- 172.21.15.62:0/3810639145 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0da80439b0 con 0x7f0db80b4260 2021-12-17T18:28:23.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.036+0000 7f0dbc903700 1 -- 172.21.15.62:0/3810639145 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0d900535b0 msgr2=0x7f0d90055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:23.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.036+0000 7f0dbc903700 1 --2- 172.21.15.62:0/3810639145 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0d900535b0 0x7f0d90055a70 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f0da000d000 tx=0x7f0da0001de0).stop 2021-12-17T18:28:23.047 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.036+0000 7f0dbc903700 1 -- 172.21.15.62:0/3810639145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db80b4260 msgr2=0x7f0db8146a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:23.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.040+0000 7f0dbc903700 1 --2- 172.21.15.62:0/3810639145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db80b4260 0x7f0db8146a60 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f0da0001800 tx=0x7f0da8014000).stop 2021-12-17T18:28:23.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.040+0000 7f0dbc903700 1 -- 172.21.15.62:0/3810639145 shutdown_connections 2021-12-17T18:28:23.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.040+0000 7f0dbc903700 1 --2- 172.21.15.62:0/3810639145 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f0d900535b0 0x7f0d90055a70 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:23.048 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.040+0000 7f0dbc903700 1 --2- 172.21.15.62:0/3810639145 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f0db81478d0 0x7f0db8146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:23.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.040+0000 7f0dbc903700 1 --2- 172.21.15.62:0/3810639145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0db80b4260 0x7f0db8146a60 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:23.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.040+0000 7f0dbc903700 1 --2- 172.21.15.62:0/3810639145 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f0db80b3a80 0x7f0db80b8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:23.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.040+0000 7f0dbc903700 1 -- 172.21.15.62:0/3810639145 >> 172.21.15.62:0/3810639145 conn(0x7f0db805cb40 msgr2=0x7f0db806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:23.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.040+0000 7f0dbc903700 1 -- 172.21.15.62:0/3810639145 shutdown_connections 2021-12-17T18:28:23.049 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.040+0000 7f0dbc903700 1 -- 172.21.15.62:0/3810639145 wait complete. 2021-12-17T18:28:23.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-12-17T18:28:23.184 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.176+0000 7fa21f001700 1 Processor -- start 2021-12-17T18:28:23.185 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.176+0000 7fa21f001700 1 -- start start 2021-12-17T18:28:23.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21f001700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fa21805ca90 0x7fa2181445d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:23.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21f001700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa21805f730 0x7fa218144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:23.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21f001700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa21805ce70 con 0x7fa2180af2a0 2021-12-17T18:28:23.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21f001700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21805fbd0 con 0x7fa21805ca90 2021-12-17T18:28:23.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21f001700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180abdf0 con 0x7fa21805f730 2021-12-17T18:28:23.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21e800700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa2180af2a0 0x7fa2181412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41220/0 (socket says 172.21.15.62:41220) 2021-12-17T18:28:23.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21e800700 1 -- 172.21.15.62:0/3925422077 learned_addr learned my addr 172.21.15.62:0/3925422077 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T18:28:23.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21d7fe700 1 --2- 172.21.15.62:0/3925422077 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa21805f730 0x7fa218144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:23.189 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21dfff700 1 --2- 172.21.15.62:0/3925422077 >> v2:172.21.15.109:3300/0 conn(0x7fa21805ca90 0x7fa2181445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:23.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21cffd700 1 -- 172.21.15.62:0/3925422077 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192038357 0 0) 0x7fa21805ce70 con 0x7fa2180af2a0 2021-12-17T18:28:23.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21cffd700 1 -- 172.21.15.62:0/3925422077 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa204003260 con 0x7fa2180af2a0 2021-12-17T18:28:23.190 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21d7fe700 1 -- 172.21.15.62:0/3925422077 >> v2:172.21.15.109:3300/0 conn(0x7fa21805ca90 msgr2=0x7fa2181445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:23.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21d7fe700 1 --2- 172.21.15.62:0/3925422077 >> v2:172.21.15.109:3300/0 conn(0x7fa21805ca90 0x7fa2181445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:23.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21d7fe700 1 -- 172.21.15.62:0/3925422077 >> v1:172.21.15.62:6789/0 conn(0x7fa2180af2a0 legacy=0x7fa2181412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:23.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21d7fe700 1 -- 172.21.15.62:0/3925422077 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2180ac090 con 0x7fa21805f730 2021-12-17T18:28:23.191 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21d7fe700 1 --2- 172.21.15.62:0/3925422077 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa21805f730 0x7fa218144ac0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fa20c002f70 tx=0x7fa20c006df0).ready entity=mon.2 client_cookie=b8e1ae7aed882b63 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:23.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21cffd700 1 -- 172.21.15.62:0/3925422077 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa20c00d4a0 con 0x7fa21805f730 2021-12-17T18:28:23.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21cffd700 1 -- 172.21.15.62:0/3925422077 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c000e90 con 0x7fa21805f730 2021-12-17T18:28:23.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21cffd700 1 -- 172.21.15.62:0/3925422077 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa20c00d7f0 con 0x7fa21805f730 2021-12-17T18:28:23.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21f001700 1 -- 172.21.15.62:0/3925422077 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa21805f730 msgr2=0x7fa218144ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:23.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21f001700 1 --2- 172.21.15.62:0/3925422077 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa21805f730 0x7fa218144ac0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fa20c002f70 tx=0x7fa20c006df0).stop 2021-12-17T18:28:23.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21f001700 1 -- 172.21.15.62:0/3925422077 shutdown_connections 2021-12-17T18:28:23.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21f001700 1 --2- 172.21.15.62:0/3925422077 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa21805f730 0x7fa218144ac0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:23.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21f001700 1 --2- 172.21.15.62:0/3925422077 >> v2:172.21.15.109:3300/0 conn(0x7fa21805ca90 0x7fa2181445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:23.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21f001700 1 -- 172.21.15.62:0/3925422077 >> 172.21.15.62:0/3925422077 conn(0x7fa21805be70 msgr2=0x7fa218062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:23.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21f001700 1 -- 172.21.15.62:0/3925422077 shutdown_connections 2021-12-17T18:28:23.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.180+0000 7fa21f001700 1 -- 172.21.15.62:0/3925422077 wait complete. 2021-12-17T18:28:23.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21f001700 1 Processor -- start 2021-12-17T18:28:23.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21f001700 1 -- start start 2021-12-17T18:28:23.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21f001700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa21805ca90 0x7fa2181437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:23.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21f001700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa21805f730 0x7fa218066870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:23.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21f001700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa2180af2a0 0x7fa218066d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:23.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21f001700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21813ff20 con 0x7fa21805f730 2021-12-17T18:28:23.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21f001700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21813f6d0 con 0x7fa2180af2a0 2021-12-17T18:28:23.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21f001700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21813f9e0 con 0x7fa21805ca90 2021-12-17T18:28:23.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21d7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa21805f730 0x7fa218066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:23.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21d7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa21805f730 0x7fa218066870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57648/0 (socket says 172.21.15.62:57648) 2021-12-17T18:28:23.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21d7fe700 1 -- 172.21.15.62:0/2000215632 learned_addr learned my addr 172.21.15.62:0/2000215632 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:23.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21e800700 1 --2- 172.21.15.62:0/2000215632 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa2180af2a0 0x7fa218066d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:23.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21dfff700 1 --2- 172.21.15.62:0/2000215632 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa21805ca90 0x7fa2181437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:23.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21d7fe700 1 -- 172.21.15.62:0/2000215632 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa21805ca90 msgr2=0x7fa2181437a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:23.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21d7fe700 1 --2- 172.21.15.62:0/2000215632 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa21805ca90 0x7fa2181437a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:23.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21d7fe700 1 -- 172.21.15.62:0/2000215632 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa2180af2a0 msgr2=0x7fa218066d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:23.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21d7fe700 1 --2- 172.21.15.62:0/2000215632 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa2180af2a0 0x7fa218066d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:23.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21d7fe700 1 -- 172.21.15.62:0/2000215632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c00b180 con 0x7fa21805f730 2021-12-17T18:28:23.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21e800700 1 --2- 172.21.15.62:0/2000215632 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa2180af2a0 0x7fa218066d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:28:23.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21dfff700 1 --2- 172.21.15.62:0/2000215632 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa21805ca90 0x7fa2181437a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T18:28:23.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21d7fe700 1 --2- 172.21.15.62:0/2000215632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa21805f730 0x7fa218066870 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7fa20c002f70 tx=0x7fa20c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:23.209 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa216ffd700 1 -- 172.21.15.62:0/2000215632 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa20c016070 con 0x7fa21805f730 2021-12-17T18:28:23.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa216ffd700 1 -- 172.21.15.62:0/2000215632 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c0137d0 con 0x7fa21805f730 2021-12-17T18:28:23.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21f001700 1 -- 172.21.15.62:0/2000215632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21813fc80 con 0x7fa21805f730 2021-12-17T18:28:23.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa216ffd700 1 -- 172.21.15.62:0/2000215632 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa20c013b30 con 0x7fa21805f730 2021-12-17T18:28:23.210 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.184+0000 7fa21f001700 1 -- 172.21.15.62:0/2000215632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2180655c0 con 0x7fa21805f730 2021-12-17T18:28:23.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.188+0000 7fa21f001700 1 -- 172.21.15.62:0/2000215632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2180573d0 con 0x7fa21805f730 2021-12-17T18:28:23.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.188+0000 7fa216ffd700 1 -- 172.21.15.62:0/2000215632 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa20c025030 con 0x7fa21805f730 2021-12-17T18:28:23.211 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.188+0000 7fa216ffd700 1 --2- 172.21.15.62:0/2000215632 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa1f8053610 0x7fa1f8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:23.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.188+0000 7fa216ffd700 1 -- 172.21.15.62:0/2000215632 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa20c06c890 con 0x7fa21805f730 2021-12-17T18:28:23.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.188+0000 7fa21dfff700 1 --2- 172.21.15.62:0/2000215632 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa1f8053610 0x7fa1f8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:23.212 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.188+0000 7fa21dfff700 1 --2- 172.21.15.62:0/2000215632 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa1f8053610 0x7fa1f8055ad0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7fa20800b000 tx=0x7fa2080091d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:23.213 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.192+0000 7fa216ffd700 1 -- 172.21.15.62:0/2000215632 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa20c0439a0 con 0x7fa21805f730 2021-12-17T18:28:23.329 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:23.324+0000 7fa21f001700 1 -- 172.21.15.62:0/2000215632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa218060c80 con 0x7fa21805f730 2021-12-17T18:28:24.052 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.044+0000 7fa216ffd700 1 -- 172.21.15.62:0/2000215632 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v154) v1 ==== 185+0+0 (secure 0 0 0) 0x7fa20c046fc0 con 0x7fa21805f730 2021-12-17T18:28:24.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.048+0000 7fa21f001700 1 -- 172.21.15.62:0/2000215632 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa1f8053610 msgr2=0x7fa1f8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:24.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.048+0000 7fa21f001700 1 --2- 172.21.15.62:0/2000215632 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa1f8053610 0x7fa1f8055ad0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7fa20800b000 tx=0x7fa2080091d0).stop 2021-12-17T18:28:24.056 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.048+0000 7fa21f001700 1 -- 172.21.15.62:0/2000215632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa21805f730 msgr2=0x7fa218066870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.048+0000 7fa21f001700 1 --2- 172.21.15.62:0/2000215632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa21805f730 0x7fa218066870 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7fa20c002f70 tx=0x7fa20c014000).stop 2021-12-17T18:28:24.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.048+0000 7fa21f001700 1 -- 172.21.15.62:0/2000215632 shutdown_connections 2021-12-17T18:28:24.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.048+0000 7fa21f001700 1 --2- 172.21.15.62:0/2000215632 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa1f8053610 0x7fa1f8055ad0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:24.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.048+0000 7fa21f001700 1 --2- 172.21.15.62:0/2000215632 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa2180af2a0 0x7fa218066d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:24.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.048+0000 7fa21f001700 1 --2- 172.21.15.62:0/2000215632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa21805f730 0x7fa218066870 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:24.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.048+0000 7fa21f001700 1 --2- 172.21.15.62:0/2000215632 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa21805ca90 0x7fa2181437a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:24.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.048+0000 7fa21f001700 1 -- 172.21.15.62:0/2000215632 >> 172.21.15.62:0/2000215632 conn(0x7fa21805be70 msgr2=0x7fa2180b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:24.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.048+0000 7fa21f001700 1 -- 172.21.15.62:0/2000215632 shutdown_connections 2021-12-17T18:28:24.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.052+0000 7fa21f001700 1 -- 172.21.15.62:0/2000215632 wait complete. 2021-12-17T18:28:24.060 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2021-12-17T18:28:24.071 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-12-17T18:28:24.187 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.180+0000 7f289d91f700 1 Processor -- start 2021-12-17T18:28:24.188 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.180+0000 7f289d91f700 1 -- start start 2021-12-17T18:28:24.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d91f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f28980ae400 0x7f2898146680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:24.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d91f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f28980b27e0 0x7f2898142550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:24.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d91f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2898146b70 con 0x7f289805ca90 2021-12-17T18:28:24.192 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d91f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28980ad7b0 con 0x7f28980b27e0 2021-12-17T18:28:24.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d91f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28980ada50 con 0x7f28980ae400 2021-12-17T18:28:24.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d11e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f28980b27e0 0x7f2898142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:24.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d11e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f28980b27e0 0x7f2898142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57658/0 (socket says 172.21.15.62:57658) 2021-12-17T18:28:24.193 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d11e700 1 -- 172.21.15.62:0/3250314084 learned_addr learned my addr 172.21.15.62:0/3250314084 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:24.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f2897fff700 1 --2- 172.21.15.62:0/3250314084 >> v2:172.21.15.109:3300/0 conn(0x7f28980ae400 0x7f2898146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:24.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d11e700 1 -- 172.21.15.62:0/3250314084 >> v2:172.21.15.109:3300/0 conn(0x7f28980ae400 msgr2=0x7f2898146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T18:28:24.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d11e700 1 --2- 172.21.15.62:0/3250314084 >> v2:172.21.15.109:3300/0 conn(0x7f28980ae400 0x7f2898146680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:24.194 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d11e700 1 -- 172.21.15.62:0/3250314084 >> v1:172.21.15.109:6789/0 conn(0x7f289805ca90 legacy=0x7f2898065bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:24.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d11e700 1 -- 172.21.15.62:0/3250314084 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2898065730 con 0x7f28980b27e0 2021-12-17T18:28:24.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d11e700 1 --2- 172.21.15.62:0/3250314084 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28980b27e0 0x7f2898142550 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f28900032f0 tx=0x7f2890009290).ready entity=mon.0 client_cookie=add87bb087e1d208 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:24.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f28977fe700 1 -- 172.21.15.62:0/3250314084 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f289000b870 con 0x7f28980b27e0 2021-12-17T18:28:24.195 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f28977fe700 1 -- 172.21.15.62:0/3250314084 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289000b9d0 con 0x7f28980b27e0 2021-12-17T18:28:24.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f28977fe700 1 -- 172.21.15.62:0/3250314084 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f289000bb40 con 0x7f28980b27e0 2021-12-17T18:28:24.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d91f700 1 -- 172.21.15.62:0/3250314084 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28980b27e0 msgr2=0x7f2898142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:24.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d91f700 1 --2- 172.21.15.62:0/3250314084 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28980b27e0 0x7f2898142550 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f28900032f0 tx=0x7f2890009290).stop 2021-12-17T18:28:24.196 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d91f700 1 -- 172.21.15.62:0/3250314084 shutdown_connections 2021-12-17T18:28:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d91f700 1 --2- 172.21.15.62:0/3250314084 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28980b27e0 0x7f2898142550 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d91f700 1 --2- 172.21.15.62:0/3250314084 >> v2:172.21.15.109:3300/0 conn(0x7f28980ae400 0x7f2898146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d91f700 1 -- 172.21.15.62:0/3250314084 >> 172.21.15.62:0/3250314084 conn(0x7f2898062430 msgr2=0x7f2898062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d91f700 1 -- 172.21.15.62:0/3250314084 shutdown_connections 2021-12-17T18:28:24.198 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.184+0000 7f289d91f700 1 -- 172.21.15.62:0/3250314084 wait complete. 2021-12-17T18:28:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f289d91f700 1 Processor -- start 2021-12-17T18:28:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f289d91f700 1 -- start start 2021-12-17T18:28:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f289d91f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289805ca90 0x7f28980b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:24.201 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f289d91f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28980ae400 0x7f2898141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f289d91f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28980b27e0 0x7f28981559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f289d91f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28980b5430 con 0x7f289805ca90 2021-12-17T18:28:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f289d91f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28980b56d0 con 0x7f28980b27e0 2021-12-17T18:28:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f289d91f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2898149070 con 0x7f28980ae400 2021-12-17T18:28:24.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f289c91d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289805ca90 0x7f28980b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:24.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f289c91d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289805ca90 0x7f28980b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57660/0 (socket says 172.21.15.62:57660) 2021-12-17T18:28:24.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f289c91d700 1 -- 172.21.15.62:0/733998019 learned_addr learned my addr 172.21.15.62:0/733998019 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T18:28:24.203 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f2897fff700 1 --2- 172.21.15.62:0/733998019 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28980ae400 0x7f2898141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f289d11e700 1 --2- 172.21.15.62:0/733998019 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28980b27e0 0x7f28981559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f289c91d700 1 -- 172.21.15.62:0/733998019 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28980ae400 msgr2=0x7f2898141490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f289c91d700 1 --2- 172.21.15.62:0/733998019 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28980ae400 0x7f2898141490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f289c91d700 1 -- 172.21.15.62:0/733998019 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28980b27e0 msgr2=0x7f28981559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:24.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f289c91d700 1 --2- 172.21.15.62:0/733998019 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28980b27e0 0x7f28981559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:24.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.188+0000 7f289c91d700 1 -- 172.21.15.62:0/733998019 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2890009530 con 0x7f289805ca90 2021-12-17T18:28:24.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.192+0000 7f289c91d700 1 --2- 172.21.15.62:0/733998019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289805ca90 0x7f28980b5b70 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f289805d200 tx=0x7f2888007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:24.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.192+0000 7f2895ffb700 1 -- 172.21.15.62:0/733998019 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2888007030 con 0x7f289805ca90 2021-12-17T18:28:24.205 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.192+0000 7f2895ffb700 1 -- 172.21.15.62:0/733998019 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2888007190 con 0x7f289805ca90 2021-12-17T18:28:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.192+0000 7f289d91f700 1 -- 172.21.15.62:0/733998019 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2898142cf0 con 0x7f289805ca90 2021-12-17T18:28:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.192+0000 7f2895ffb700 1 -- 172.21.15.62:0/733998019 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2888006510 con 0x7f289805ca90 2021-12-17T18:28:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.192+0000 7f289d91f700 1 -- 172.21.15.62:0/733998019 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28981495a0 con 0x7f289805ca90 2021-12-17T18:28:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.192+0000 7f2895ffb700 1 -- 172.21.15.62:0/733998019 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f288801b070 con 0x7f289805ca90 2021-12-17T18:28:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.192+0000 7f289d91f700 1 -- 172.21.15.62:0/733998019 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289805ce70 con 0x7f289805ca90 2021-12-17T18:28:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.192+0000 7f2895ffb700 1 --2- 172.21.15.62:0/733998019 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f287c0536d0 0x7f287c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T18:28:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.192+0000 7f2895ffb700 1 -- 172.21.15.62:0/733998019 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f288806ac80 con 0x7f289805ca90 2021-12-17T18:28:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.192+0000 7f2897fff700 1 --2- 172.21.15.62:0/733998019 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f287c0536d0 0x7f287c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T18:28:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.192+0000 7f2897fff700 1 --2- 172.21.15.62:0/733998019 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f287c0536d0 0x7f287c055b90 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f288000c000 tx=0x7f2880008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T18:28:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.200+0000 7f2895ffb700 1 -- 172.21.15.62:0/733998019 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2888041f40 con 0x7f289805ca90 2021-12-17T18:28:24.334 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:24.328+0000 7f289d91f700 1 -- 172.21.15.62:0/733998019 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f28980573d0 con 0x7f289805ca90 2021-12-17T18:28:25.054 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:25.048+0000 7f2895ffb700 1 -- 172.21.15.62:0/733998019 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v155) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2888045560 con 0x7f289805ca90 2021-12-17T18:28:25.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:25.052+0000 7f289d91f700 1 -- 172.21.15.62:0/733998019 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f287c0536d0 msgr2=0x7f287c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:25.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:25.052+0000 7f289d91f700 1 --2- 172.21.15.62:0/733998019 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f287c0536d0 0x7f287c055b90 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f288000c000 tx=0x7f2880008040).stop 2021-12-17T18:28:25.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:25.052+0000 7f289d91f700 1 -- 172.21.15.62:0/733998019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289805ca90 msgr2=0x7f28980b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T18:28:25.058 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:25.052+0000 7f289d91f700 1 --2- 172.21.15.62:0/733998019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289805ca90 0x7f28980b5b70 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f289805d200 tx=0x7f2888007c00).stop 2021-12-17T18:28:25.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:25.052+0000 7f289d91f700 1 -- 172.21.15.62:0/733998019 shutdown_connections 2021-12-17T18:28:25.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:25.052+0000 7f289d91f700 1 --2- 172.21.15.62:0/733998019 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f287c0536d0 0x7f287c055b90 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:25.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:25.052+0000 7f289d91f700 1 --2- 172.21.15.62:0/733998019 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f28980b27e0 0x7f28981559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:25.059 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:25.052+0000 7f289d91f700 1 --2- 172.21.15.62:0/733998019 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f28980ae400 0x7f2898141490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:25.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:25.052+0000 7f289d91f700 1 --2- 172.21.15.62:0/733998019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289805ca90 0x7f28980b5b70 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T18:28:25.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:25.052+0000 7f289d91f700 1 -- 172.21.15.62:0/733998019 >> 172.21.15.62:0/733998019 conn(0x7f2898062430 msgr2=0x7f2898066700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T18:28:25.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:25.052+0000 7f289d91f700 1 -- 172.21.15.62:0/733998019 shutdown_connections 2021-12-17T18:28:25.060 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T18:28:25.052+0000 7f289d91f700 1 -- 172.21.15.62:0/733998019 wait complete. 2021-12-17T18:28:25.061 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2021-12-17T18:28:25.075 INFO:teuthology.orchestra.run:Running command with timeout 60 2021-12-17T18:28:25.075 DEBUG:teuthology.orchestra.run.smithi125:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-12-17T18:28:34.874 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:28:34.878 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:28:34.881 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:28:34.884 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:28:34.886 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:28:55.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:28:55.180 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:28:55.181 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:29:04.940 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:29:04.943 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:29:04.946 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:29:04.949 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:29:04.951 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:29:25.081 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-12-17T18:29:25.085 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-12-17T18:29:35.010 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:29:35.013 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:29:35.016 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:29:35.018 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:29:35.025 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:30:05.127 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:30:05.133 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:30:05.161 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:30:05.169 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:30:05.197 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:30:35.257 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:30:35.261 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:30:35.263 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:30:35.267 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:30:35.270 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:31:05.348 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:31:05.351 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:31:05.354 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:31:05.357 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:31:05.359 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:31:35.410 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:31:35.414 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:31:35.416 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:31:35.419 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:31:35.421 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:32:05.497 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:32:05.501 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:32:05.503 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:32:05.506 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:32:05.509 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:32:35.569 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:32:35.572 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:32:35.575 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:32:35.578 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:32:35.580 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:33:05.705 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:33:05.708 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:33:05.711 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:33:05.713 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:33:05.716 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:33:35.843 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:33:35.847 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:33:35.850 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:33:35.853 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:33:35.855 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:34:06.189 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:34:06.192 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:34:06.195 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:34:06.197 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:34:06.201 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:34:36.257 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:34:36.261 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:34:36.263 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:34:36.266 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:34:36.269 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:35:06.332 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:35:06.335 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:35:06.338 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:35:06.340 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:35:06.343 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:35:36.412 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:35:36.416 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:35:36.419 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:35:36.423 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:35:36.425 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:36:06.532 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:36:06.535 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:36:06.538 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:36:06.541 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:36:06.543 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:36:36.673 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:36:36.677 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:36:36.680 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:36:36.683 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:36:36.685 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:37:06.777 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:37:06.781 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:37:06.784 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:37:06.786 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:37:06.789 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:37:36.846 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:37:36.849 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:37:36.853 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:37:36.856 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:37:36.860 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:38:06.918 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:38:06.922 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:38:06.925 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:38:06.928 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:38:06.931 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:38:36.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:38:36.995 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:38:36.998 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:38:37.000 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:38:37.003 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:39:07.059 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:39:07.063 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:39:07.067 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:39:07.072 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:39:07.076 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:39:37.186 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:39:37.190 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:39:37.192 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:39:37.195 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:39:37.197 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:40:07.245 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:40:07.248 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:40:07.251 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:40:07.254 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:40:07.257 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:40:37.333 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:40:37.337 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:40:37.339 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:40:37.342 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:40:37.345 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:41:07.478 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:41:07.482 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:41:07.485 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:41:07.487 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:41:07.490 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:41:37.784 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:41:37.787 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:41:37.791 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:41:37.794 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:41:37.797 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:42:07.881 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:42:07.884 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:42:07.887 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:42:07.889 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:42:07.892 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:42:37.952 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:42:37.955 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:42:37.958 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:42:37.961 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:42:37.963 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:43:08.047 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:43:08.050 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:43:08.053 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:43:08.055 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:43:08.058 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:43:38.119 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:43:38.122 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:43:38.125 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:43:38.127 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:43:38.130 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:43:55.185 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-12-17T18:43:55.187 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-12-17T18:43:55.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:43:55.194 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-12-17T18:43:55.195 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:43:55.217 DEBUG:teuthology.orchestra.run.smithi109:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:43:55.240 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:43:55.263 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:43:55.284 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-12-17T18:43:55.305 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-12-17T18:43:55.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:43:55.307 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:43:55.308 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:44:08.222 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:44:08.225 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:44:08.228 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:44:08.231 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:44:08.233 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:44:38.516 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:44:38.520 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:44:38.523 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:44:38.525 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:44:38.528 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:45:08.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:45:08.875 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:45:08.878 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:45:08.880 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:45:08.883 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:45:38.935 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:45:38.939 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:45:38.942 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:45:38.945 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:45:38.948 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:46:09.006 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:46:09.009 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:46:09.012 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:46:09.015 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:46:09.017 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:46:39.152 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:46:39.157 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:46:39.159 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:46:39.162 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:46:39.164 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:47:09.239 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:47:09.243 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:47:09.245 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:47:09.248 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:47:09.251 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:47:39.302 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:47:39.305 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:47:39.308 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:47:39.314 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:47:39.317 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:48:09.381 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:48:09.385 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:48:09.388 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:48:09.391 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:48:09.393 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:48:39.455 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:48:39.459 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:48:39.461 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:48:39.464 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:48:39.466 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:49:09.697 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:49:09.700 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:49:09.703 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:49:09.706 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:49:09.709 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:49:39.763 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:49:39.767 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:49:39.770 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:49:39.773 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:49:39.775 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:50:09.827 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:50:09.830 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:50:09.833 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:50:09.837 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:50:09.841 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:50:39.919 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:50:39.924 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:50:39.927 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:50:39.929 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:50:39.932 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:51:09.989 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:51:09.994 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:51:09.996 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:51:09.999 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:51:10.002 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:51:40.268 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:51:40.271 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:51:40.274 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:51:40.277 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:51:40.279 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:52:10.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:52:10.374 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:52:10.376 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:52:10.382 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:52:10.385 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:52:40.455 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:52:40.458 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:52:40.461 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:52:40.463 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:52:40.466 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:53:10.558 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:53:10.561 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:53:10.563 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:53:10.566 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:53:10.568 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:53:40.741 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:53:40.745 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:53:40.748 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:53:40.751 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:53:40.753 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:54:10.816 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:54:10.819 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:54:10.822 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:54:10.824 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:54:10.827 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:54:40.921 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:54:40.925 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:54:40.928 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:54:40.931 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:54:40.933 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:55:11.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:55:11.005 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:55:11.008 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:55:11.011 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:55:11.013 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:55:41.357 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:55:41.360 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:55:41.363 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:55:41.365 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:55:41.368 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:56:11.433 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:56:11.436 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:56:11.439 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:56:11.441 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:56:11.444 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:56:41.505 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:56:41.508 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:56:41.511 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:56:41.513 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:56:41.516 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:57:11.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:57:11.593 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:57:11.596 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:57:11.599 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:57:11.601 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:57:41.678 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:57:41.682 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:57:41.684 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:57:41.687 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:57:41.690 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:58:11.749 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:58:11.753 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:58:11.756 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:58:11.759 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:58:11.762 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:58:41.934 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:58:41.937 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:58:41.940 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:58:41.943 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:58:41.946 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:58:55.312 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-12-17T18:58:55.313 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-12-17T18:58:55.315 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T18:58:55.321 INFO:tasks.cephfs_test_runner:test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) ... ERROR 2021-12-17T18:58:55.323 INFO:tasks.cephfs_test_runner:ERROR 2021-12-17T18:58:55.324 INFO:tasks.cephfs_test_runner: 2021-12-17T18:58:55.324 INFO:tasks.cephfs_test_runner:====================================================================== 2021-12-17T18:58:55.325 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-12-17T18:58:55.325 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-12-17T18:58:55.326 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-12-17T18:58:55.326 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-12-17T18:58:55.327 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-12-17T18:58:55.327 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-12-17T18:58:55.328 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-12-17T18:58:55.329 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-12-17T18:58:55.329 INFO:tasks.cephfs_test_runner: 2021-12-17T18:58:55.330 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-12-17T18:58:55.330 INFO:tasks.cephfs_test_runner: 2021-12-17T18:58:55.331 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-12-17T18:58:55.331 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-12-17T18:58:55.332 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-12-17T18:58:55.333 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-12-17T18:58:55.333 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-12-17T18:58:55.334 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-12-17T18:58:55.334 INFO:tasks.cephfs_test_runner: proc.wait() 2021-12-17T18:58:55.335 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 148, in wait 2021-12-17T18:58:55.335 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-12-17T18:58:55.336 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-12-17T18:58:55.336 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-12-17T18:58:55.337 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-12-17T18:58:55.337 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-12-17T18:58:55.338 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-12-17T18:58:55.339 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-12-17T18:58:55.339 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-12-17T18:58:55.340 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-12-17T18:58:55.340 INFO:tasks.cephfs_test_runner: for line in f: 2021-12-17T18:58:55.341 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-12-17T18:58:55.341 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-12-17T18:58:55.342 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-12-17T18:58:55.342 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-12-17T18:58:55.343 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-12-17T18:58:55.343 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-12-17T18:58:55.344 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-12-17T18:58:55.344 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-12-17T18:58:55.345 INFO:tasks.cephfs_test_runner:socket.timeout 2021-12-17T18:58:55.345 INFO:tasks.cephfs_test_runner: 2021-12-17T18:58:55.346 INFO:tasks.cephfs_test_runner:====================================================================== 2021-12-17T18:58:55.346 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-12-17T18:58:55.347 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-12-17T18:58:55.347 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-12-17T18:58:55.348 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-12-17T18:58:55.348 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-12-17T18:58:55.349 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-12-17T18:58:55.350 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-12-17T18:58:55.350 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-12-17T18:58:55.351 INFO:tasks.cephfs_test_runner: 2021-12-17T18:58:55.351 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-12-17T18:58:55.352 INFO:tasks.cephfs_test_runner: 2021-12-17T18:58:55.352 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-12-17T18:58:55.353 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-12-17T18:58:55.353 INFO:tasks.cephfs_test_runner: m.teardown() 2021-12-17T18:58:55.354 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-12-17T18:58:55.354 INFO:tasks.cephfs_test_runner: self.umount() 2021-12-17T18:58:55.355 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-12-17T18:58:55.355 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-12-17T18:58:55.356 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-12-17T18:58:55.356 INFO:tasks.cephfs_test_runner: proc.wait() 2021-12-17T18:58:55.357 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 148, in wait 2021-12-17T18:58:55.357 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-12-17T18:58:55.358 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-12-17T18:58:55.358 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-12-17T18:58:55.359 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-12-17T18:58:55.359 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-12-17T18:58:55.360 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-12-17T18:58:55.360 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-12-17T18:58:55.361 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-12-17T18:58:55.361 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-12-17T18:58:55.362 INFO:tasks.cephfs_test_runner: for line in f: 2021-12-17T18:58:55.362 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-12-17T18:58:55.363 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-12-17T18:58:55.363 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-12-17T18:58:55.364 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-12-17T18:58:55.365 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-12-17T18:58:55.365 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-12-17T18:58:55.366 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-12-17T18:58:55.366 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-12-17T18:58:55.366 INFO:tasks.cephfs_test_runner:socket.timeout 2021-12-17T18:58:55.367 INFO:tasks.cephfs_test_runner: 2021-12-17T18:58:55.367 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-12-17T18:58:55.367 INFO:tasks.cephfs_test_runner:Ran 12 tests in 2408.720s 2021-12-17T18:58:55.367 INFO:tasks.cephfs_test_runner: 2021-12-17T18:58:55.368 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2021-12-17T18:58:55.368 INFO:tasks.cephfs_test_runner: 2021-12-17T18:58:55.368 INFO:tasks.cephfs_test_runner:====================================================================== 2021-12-17T18:58:55.369 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-12-17T18:58:55.369 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-12-17T18:58:55.369 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-12-17T18:58:55.370 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-12-17T18:58:55.370 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-12-17T18:58:55.370 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-12-17T18:58:55.370 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-12-17T18:58:55.371 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-12-17T18:58:55.371 INFO:tasks.cephfs_test_runner: 2021-12-17T18:58:55.371 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-12-17T18:58:55.372 INFO:tasks.cephfs_test_runner: 2021-12-17T18:58:55.372 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-12-17T18:58:55.372 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-12-17T18:58:55.372 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-12-17T18:58:55.373 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-12-17T18:58:55.373 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-12-17T18:58:55.373 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-12-17T18:58:55.374 INFO:tasks.cephfs_test_runner: proc.wait() 2021-12-17T18:58:55.374 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 148, in wait 2021-12-17T18:58:55.374 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-12-17T18:58:55.374 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-12-17T18:58:55.375 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-12-17T18:58:55.375 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-12-17T18:58:55.375 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-12-17T18:58:55.376 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-12-17T18:58:55.376 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-12-17T18:58:55.376 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-12-17T18:58:55.376 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-12-17T18:58:55.377 INFO:tasks.cephfs_test_runner: for line in f: 2021-12-17T18:58:55.377 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-12-17T18:58:55.377 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-12-17T18:58:55.378 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-12-17T18:58:55.378 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-12-17T18:58:55.378 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-12-17T18:58:55.379 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-12-17T18:58:55.379 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-12-17T18:58:55.379 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-12-17T18:58:55.379 INFO:tasks.cephfs_test_runner:socket.timeout 2021-12-17T18:58:55.380 INFO:tasks.cephfs_test_runner: 2021-12-17T18:58:55.380 INFO:tasks.cephfs_test_runner:====================================================================== 2021-12-17T18:58:55.380 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-12-17T18:58:55.381 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-12-17T18:58:55.381 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-12-17T18:58:55.381 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-12-17T18:58:55.382 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-12-17T18:58:55.382 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-12-17T18:58:55.382 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-12-17T18:58:55.382 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-12-17T18:58:55.383 INFO:tasks.cephfs_test_runner: 2021-12-17T18:58:55.383 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-12-17T18:58:55.383 INFO:tasks.cephfs_test_runner: 2021-12-17T18:58:55.384 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-12-17T18:58:55.384 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-12-17T18:58:55.384 INFO:tasks.cephfs_test_runner: m.teardown() 2021-12-17T18:58:55.384 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-12-17T18:58:55.385 INFO:tasks.cephfs_test_runner: self.umount() 2021-12-17T18:58:55.385 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-12-17T18:58:55.385 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-12-17T18:58:55.385 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-12-17T18:58:55.386 INFO:tasks.cephfs_test_runner: proc.wait() 2021-12-17T18:58:55.386 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 148, in wait 2021-12-17T18:58:55.386 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-12-17T18:58:55.387 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-12-17T18:58:55.387 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-12-17T18:58:55.387 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-12-17T18:58:55.387 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-12-17T18:58:55.388 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-12-17T18:58:55.388 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-12-17T18:58:55.388 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-12-17T18:58:55.389 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-12-17T18:58:55.389 INFO:tasks.cephfs_test_runner: for line in f: 2021-12-17T18:58:55.389 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-12-17T18:58:55.389 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-12-17T18:58:55.390 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-12-17T18:58:55.390 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-12-17T18:58:55.390 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-12-17T18:58:55.391 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-12-17T18:58:55.391 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-12-17T18:58:55.391 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-12-17T18:58:55.392 INFO:tasks.cephfs_test_runner:socket.timeout 2021-12-17T18:58:55.392 INFO:tasks.cephfs_test_runner: 2021-12-17T18:58:55.392 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-12-17T18:58:55.709 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=55b35162e0c04af38732518f26aacc38 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-12-17T18:58:55.711 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2021-12-17T18:58:55.720 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2021-12-17T18:58:55.747 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2021-12-17T18:58:55.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-12-17T18:58:55.749 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-12-17T18:58:55.750 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-12-17T18:59:12.028 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:59:12.032 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:59:12.035 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:59:12.038 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:59:12.040 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:59:42.104 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:59:42.108 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:59:42.111 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:59:42.113 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T18:59:42.117 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:00:12.180 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:00:12.184 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:00:12.187 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:00:12.189 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:00:12.193 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:00:42.363 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:00:42.367 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:00:42.370 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:00:42.373 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:00:42.376 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:01:12.485 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:01:12.488 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:01:12.491 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:01:12.494 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:01:12.497 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:01:42.707 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:01:42.711 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:01:42.713 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:01:42.716 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:01:42.719 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:02:12.807 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:02:12.810 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:02:12.815 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:02:12.818 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:02:12.821 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:02:42.945 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:02:42.949 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:02:42.953 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:02:42.957 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:02:42.959 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:03:13.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:03:13.039 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:03:13.042 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:03:13.045 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:03:13.047 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:03:43.266 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:03:43.270 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:03:43.273 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:03:43.276 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:03:43.279 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:04:13.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:04:13.570 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:04:13.573 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:04:13.576 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:04:13.579 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:04:43.697 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:04:43.701 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:04:43.704 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:04:43.707 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:04:43.709 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:05:13.756 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:05:13.761 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:05:13.764 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:05:13.767 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:05:13.770 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:05:43.959 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:05:43.964 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:05:43.967 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:05:43.969 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:05:43.973 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:06:14.093 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:06:14.097 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:06:14.100 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:06:14.102 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:06:14.106 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:06:44.478 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:06:44.482 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:06:44.485 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:06:44.487 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:06:44.490 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:07:14.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:07:14.820 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:07:14.824 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:07:14.826 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:07:14.829 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:07:44.949 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:07:44.954 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:07:44.957 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:07:44.959 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:07:44.962 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:08:15.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:08:15.107 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:08:15.110 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:08:15.113 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:08:15.116 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:08:45.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:08:45.244 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:08:45.247 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:08:45.250 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:08:45.253 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:09:15.310 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:09:15.313 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:09:15.316 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:09:15.318 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:09:15.322 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:09:45.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:09:45.420 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:09:45.423 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:09:45.425 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:09:45.428 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:10:15.526 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:10:15.530 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:10:15.533 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:10:15.535 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:10:15.538 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:10:45.709 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:10:45.713 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:10:45.716 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:10:45.719 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:10:45.722 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:11:15.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:11:15.838 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:11:15.840 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:11:15.843 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:11:15.846 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:11:46.111 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:11:46.115 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:11:46.118 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:11:46.120 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:11:46.123 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:12:16.283 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:12:16.287 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:12:16.289 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:12:16.292 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:12:16.295 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:12:46.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:12:46.556 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:12:46.559 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:12:46.562 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:12:46.564 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:13:16.887 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:13:16.892 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:13:16.896 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:13:16.899 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:13:16.902 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:13:47.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:13:47.040 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:13:47.043 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:13:47.046 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:13:47.049 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:13:55.766 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-12-17T19:13:55.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T19:13:55.805 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/ceph_fuse.py", line 159, in task if mount.is_mounted(): File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-12-17T19:13:55.813 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-12-17T19:13:55.829 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2021-12-17T19:13:55.845 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2021-12-17T19:13:55.847 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T19:13:55.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f27015c1700 1 Processor -- start 2021-12-17T19:13:55.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f27015c1700 1 -- start start 2021-12-17T19:13:55.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f27015c1700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f26fc0a8e10 0x7f26fc147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:55.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f27015c1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26fc0a71e0 0x7f26fc0a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:55.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f27015c1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26fc0b6270 con 0x7f26fc141480 2021-12-17T19:13:55.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f27015c1700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26fc147610 con 0x7f26fc0a8e10 2021-12-17T19:13:55.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f27015c1700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc1478b0 con 0x7f26fc0a71e0 2021-12-17T19:13:55.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f26fbfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f26fc141480 0x7f26fc0b5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41286/0 (socket says 172.21.15.62:41286) 2021-12-17T19:13:55.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f26fbfff700 1 -- 172.21.15.62:0/1844394981 learned_addr learned my addr 172.21.15.62:0/1844394981 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T19:13:55.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f26fb7fe700 1 --2- 172.21.15.62:0/1844394981 >> v2:172.21.15.109:3300/0 conn(0x7f26fc0a8e10 0x7f26fc147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:55.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f2700dc0700 1 --2- 172.21.15.62:0/1844394981 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26fc0a71e0 0x7f26fc0a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:55.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f26faffd700 1 -- 172.21.15.62:0/1844394981 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016059039 0 0) 0x7f26fc0b6270 con 0x7f26fc141480 2021-12-17T19:13:55.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f26faffd700 1 -- 172.21.15.62:0/1844394981 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26e8003260 con 0x7f26fc141480 2021-12-17T19:13:55.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f26fb7fe700 1 -- 172.21.15.62:0/1844394981 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26fc0a71e0 msgr2=0x7f26fc0a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:13:55.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f26fb7fe700 1 --2- 172.21.15.62:0/1844394981 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26fc0a71e0 0x7f26fc0a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:55.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f26fb7fe700 1 -- 172.21.15.62:0/1844394981 >> v1:172.21.15.62:6789/0 conn(0x7f26fc141480 legacy=0x7f26fc0b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f26fb7fe700 1 -- 172.21.15.62:0/1844394981 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc147b50 con 0x7f26fc0a8e10 2021-12-17T19:13:55.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.979+0000 7f26fb7fe700 1 --2- 172.21.15.62:0/1844394981 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26fc0a8e10 0x7f26fc147ff0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f26ec0032f0 tx=0x7f26ec0091d0).ready entity=mon.1 client_cookie=42fdb57231311444 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:55.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.983+0000 7f26faffd700 1 -- 172.21.15.62:0/1844394981 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26ec00b600 con 0x7f26fc0a8e10 2021-12-17T19:13:55.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.983+0000 7f26faffd700 1 -- 172.21.15.62:0/1844394981 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ec00b760 con 0x7f26fc0a8e10 2021-12-17T19:13:56.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.983+0000 7f26faffd700 1 -- 172.21.15.62:0/1844394981 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26ec00b8d0 con 0x7f26fc0a8e10 2021-12-17T19:13:56.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.983+0000 7f27015c1700 1 -- 172.21.15.62:0/1844394981 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26fc0a8e10 msgr2=0x7f26fc147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:56.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.983+0000 7f27015c1700 1 --2- 172.21.15.62:0/1844394981 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26fc0a8e10 0x7f26fc147ff0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f26ec0032f0 tx=0x7f26ec0091d0).stop 2021-12-17T19:13:56.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.983+0000 7f27015c1700 1 -- 172.21.15.62:0/1844394981 shutdown_connections 2021-12-17T19:13:56.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.983+0000 7f27015c1700 1 --2- 172.21.15.62:0/1844394981 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26fc0a71e0 0x7f26fc0a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.983+0000 7f27015c1700 1 --2- 172.21.15.62:0/1844394981 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26fc0a8e10 0x7f26fc147ff0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.983+0000 7f27015c1700 1 -- 172.21.15.62:0/1844394981 >> 172.21.15.62:0/1844394981 conn(0x7f26fc05d220 msgr2=0x7f26fc0b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:56.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.983+0000 7f27015c1700 1 -- 172.21.15.62:0/1844394981 shutdown_connections 2021-12-17T19:13:56.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.983+0000 7f27015c1700 1 -- 172.21.15.62:0/1844394981 wait complete. 2021-12-17T19:13:56.006 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f27015c1700 1 Processor -- start 2021-12-17T19:13:56.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f27015c1700 1 -- start start 2021-12-17T19:13:56.007 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f27015c1700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26fc0a71e0 0x7f26fc149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:56.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f27015c1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26fc0a8e10 0x7f26fc0b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:56.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f27015c1700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26fc141480 0x7f26fc13d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:56.008 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f27015c1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc14a1a0 con 0x7f26fc0a8e10 2021-12-17T19:13:56.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f27015c1700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc14a990 con 0x7f26fc141480 2021-12-17T19:13:56.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f27015c1700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc14ac30 con 0x7f26fc0a71e0 2021-12-17T19:13:56.009 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f26fb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26fc0a8e10 0x7f26fc0b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:56.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f26fb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26fc0a8e10 0x7f26fc0b4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57712/0 (socket says 172.21.15.62:57712) 2021-12-17T19:13:56.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f26fb7fe700 1 -- 172.21.15.62:0/3280575306 learned_addr learned my addr 172.21.15.62:0/3280575306 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:56.010 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f26fbfff700 1 --2- 172.21.15.62:0/3280575306 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26fc0a71e0 0x7f26fc149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:56.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f2700dc0700 1 --2- 172.21.15.62:0/3280575306 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26fc141480 0x7f26fc13d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:56.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f26fbfff700 1 -- 172.21.15.62:0/3280575306 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26fc141480 msgr2=0x7f26fc13d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:56.011 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f26fbfff700 1 --2- 172.21.15.62:0/3280575306 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26fc141480 0x7f26fc13d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f26fbfff700 1 -- 172.21.15.62:0/3280575306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26fc0a8e10 msgr2=0x7f26fc0b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:56.012 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f26fbfff700 1 --2- 172.21.15.62:0/3280575306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26fc0a8e10 0x7f26fc0b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f26fbfff700 1 -- 172.21.15.62:0/3280575306 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ec009470 con 0x7f26fc0a71e0 2021-12-17T19:13:56.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f26fbfff700 1 --2- 172.21.15.62:0/3280575306 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26fc0a71e0 0x7f26fc149b70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f26fc14a2e0 tx=0x7f26f00079e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:56.013 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f26f97fa700 1 -- 172.21.15.62:0/3280575306 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f000cda0 con 0x7f26fc0a71e0 2021-12-17T19:13:56.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f26f97fa700 1 -- 172.21.15.62:0/3280575306 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f0007110 con 0x7f26fc0a71e0 2021-12-17T19:13:56.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f27015c1700 1 -- 172.21.15.62:0/3280575306 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26fc14b0d0 con 0x7f26fc0a71e0 2021-12-17T19:13:56.014 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.987+0000 7f26f97fa700 1 -- 172.21.15.62:0/3280575306 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f0007470 con 0x7f26fc0a71e0 2021-12-17T19:13:56.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.991+0000 7f27015c1700 1 -- 172.21.15.62:0/3280575306 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26fc14b710 con 0x7f26fc0a71e0 2021-12-17T19:13:56.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.991+0000 7f27015c1700 1 -- 172.21.15.62:0/3280575306 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26fc0af870 con 0x7f26fc0a71e0 2021-12-17T19:13:56.015 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.991+0000 7f26f97fa700 1 -- 172.21.15.62:0/3280575306 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f26f001b070 con 0x7f26fc0a71e0 2021-12-17T19:13:56.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.991+0000 7f26f97fa700 1 --2- 172.21.15.62:0/3280575306 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f26dc053640 0x7f26dc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:56.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.991+0000 7f26f97fa700 1 -- 172.21.15.62:0/3280575306 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f26f006ab60 con 0x7f26fc0a71e0 2021-12-17T19:13:56.016 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.991+0000 7f26fb7fe700 1 --2- 172.21.15.62:0/3280575306 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f26dc053640 0x7f26dc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:56.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:55.991+0000 7f26fb7fe700 1 --2- 172.21.15.62:0/3280575306 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f26dc053640 0x7f26dc055b00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f26ec01b000 tx=0x7f26ec016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:56.017 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.003+0000 7f26f97fa700 1 -- 172.21.15.62:0/3280575306 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f26f0041e90 con 0x7f26fc0a71e0 2021-12-17T19:13:56.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.131+0000 7f27015c1700 1 -- 172.21.15.62:0/3280575306 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26fc0b1b90 con 0x7f26fc0a71e0 2021-12-17T19:13:56.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.135+0000 7f26f97fa700 1 -- 172.21.15.62:0/3280575306 <== mon.2 v2:172.21.15.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+13368 (secure 0 0 0) 0x7f26f00454b0 con 0x7f26fc0a71e0 2021-12-17T19:13:56.144 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T19:13:56.144 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":155,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:28:25.044583+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.62:6833/2348194620":"2021-12-18T18:28:21.027098+0000","172.21.15.62:6832/2348194620":"2021-12-18T18:28:21.027098+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T19:13:56.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.135+0000 7f27015c1700 1 -- 172.21.15.62:0/3280575306 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f26dc053640 msgr2=0x7f26dc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:56.147 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.135+0000 7f27015c1700 1 --2- 172.21.15.62:0/3280575306 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f26dc053640 0x7f26dc055b00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f26ec01b000 tx=0x7f26ec016000).stop 2021-12-17T19:13:56.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.135+0000 7f27015c1700 1 -- 172.21.15.62:0/3280575306 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26fc0a71e0 msgr2=0x7f26fc149b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:56.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.135+0000 7f27015c1700 1 --2- 172.21.15.62:0/3280575306 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26fc0a71e0 0x7f26fc149b70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f26fc14a2e0 tx=0x7f26f00079e0).stop 2021-12-17T19:13:56.148 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.135+0000 7f27015c1700 1 -- 172.21.15.62:0/3280575306 shutdown_connections 2021-12-17T19:13:56.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.135+0000 7f27015c1700 1 --2- 172.21.15.62:0/3280575306 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f26dc053640 0x7f26dc055b00 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.135+0000 7f27015c1700 1 --2- 172.21.15.62:0/3280575306 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f26fc141480 0x7f26fc13d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.135+0000 7f27015c1700 1 --2- 172.21.15.62:0/3280575306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26fc0a8e10 0x7f26fc0b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.135+0000 7f27015c1700 1 --2- 172.21.15.62:0/3280575306 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f26fc0a71e0 0x7f26fc149b70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.135+0000 7f27015c1700 1 -- 172.21.15.62:0/3280575306 >> 172.21.15.62:0/3280575306 conn(0x7f26fc05d220 msgr2=0x7f26fc1450d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:56.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.135+0000 7f27015c1700 1 -- 172.21.15.62:0/3280575306 shutdown_connections 2021-12-17T19:13:56.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.135+0000 7f27015c1700 1 -- 172.21.15.62:0/3280575306 wait complete. 2021-12-17T19:13:56.157 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-12-17T19:13:56.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.251+0000 7f540c45d700 1 Processor -- start 2021-12-17T19:13:56.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.251+0000 7f540c45d700 1 -- start start 2021-12-17T19:13:56.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f540c45d700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f54040b1730 0x7f54040ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:56.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f540c45d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54040b2ce0 con 0x7f54040b21f0 2021-12-17T19:13:56.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f540c45d700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54040aca60 con 0x7f54040a7bb0 2021-12-17T19:13:56.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f540c45d700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540414b5b0 con 0x7f54040b1730 2021-12-17T19:13:56.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f540a1f9700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f54040b21f0 0x7f540414aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41300/0 (socket says 172.21.15.62:41300) 2021-12-17T19:13:56.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f540a1f9700 1 -- 172.21.15.62:0/2911618053 learned_addr learned my addr 172.21.15.62:0/2911618053 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T19:13:56.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f54099f8700 1 --2- 172.21.15.62:0/2911618053 >> v2:172.21.15.109:3300/0 conn(0x7f54040b1730 0x7f54040ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:56.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f54091f7700 1 -- 172.21.15.62:0/2911618053 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49800943 0 0) 0x7f54040b2ce0 con 0x7f54040b21f0 2021-12-17T19:13:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f54091f7700 1 -- 172.21.15.62:0/2911618053 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53ec003260 con 0x7f54040b21f0 2021-12-17T19:13:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f54091f7700 1 -- 172.21.15.62:0/2911618053 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123505889 0 0) 0x7f54040aca60 con 0x7f54040a7bb0 2021-12-17T19:13:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f54091f7700 1 -- 172.21.15.62:0/2911618053 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54040b2ce0 con 0x7f54040a7bb0 2021-12-17T19:13:56.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f54099f8700 1 -- 172.21.15.62:0/2911618053 >> v1:172.21.15.109:6789/0 conn(0x7f54040a7bb0 legacy=0x7f5404067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:56.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f54099f8700 1 -- 172.21.15.62:0/2911618053 >> v1:172.21.15.62:6789/0 conn(0x7f54040b21f0 legacy=0x7f540414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:56.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f54099f8700 1 -- 172.21.15.62:0/2911618053 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54040b2f10 con 0x7f54040b1730 2021-12-17T19:13:56.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f54099f8700 1 --2- 172.21.15.62:0/2911618053 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54040b1730 0x7f54040ace90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f54040b1c00 tx=0x7f5400006df0).ready entity=mon.1 client_cookie=4df563b01af33770 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:56.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f54091f7700 1 -- 172.21.15.62:0/2911618053 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540000d610 con 0x7f54040b1730 2021-12-17T19:13:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f54091f7700 1 -- 172.21.15.62:0/2911618053 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5400000e90 con 0x7f54040b1730 2021-12-17T19:13:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f54091f7700 1 -- 172.21.15.62:0/2911618053 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540000d960 con 0x7f54040b1730 2021-12-17T19:13:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f540c45d700 1 -- 172.21.15.62:0/2911618053 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54040b1730 msgr2=0x7f54040ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f540c45d700 1 --2- 172.21.15.62:0/2911618053 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54040b1730 0x7f54040ace90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f54040b1c00 tx=0x7f5400006df0).stop 2021-12-17T19:13:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f540c45d700 1 -- 172.21.15.62:0/2911618053 shutdown_connections 2021-12-17T19:13:56.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f540c45d700 1 --2- 172.21.15.62:0/2911618053 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54040b1730 0x7f54040ace90 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f540c45d700 1 -- 172.21.15.62:0/2911618053 >> 172.21.15.62:0/2911618053 conn(0x7f540405f730 msgr2=0x7f540405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:56.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f540c45d700 1 -- 172.21.15.62:0/2911618053 shutdown_connections 2021-12-17T19:13:56.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.255+0000 7f540c45d700 1 -- 172.21.15.62:0/2911618053 wait complete. 2021-12-17T19:13:56.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540c45d700 1 Processor -- start 2021-12-17T19:13:56.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540c45d700 1 -- start start 2021-12-17T19:13:56.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540c45d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54040a7bb0 0x7f540414e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540c45d700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54040b1730 0x7f540414e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540c45d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54040b21f0 0x7f5404066aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:56.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540c45d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540414dc30 con 0x7f54040b21f0 2021-12-17T19:13:56.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540c45d700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5404064670 con 0x7f54040b1730 2021-12-17T19:13:56.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540c45d700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5404064150 con 0x7f54040a7bb0 2021-12-17T19:13:56.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540a9fa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54040b21f0 0x7f5404066aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:56.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540a9fa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54040b21f0 0x7f5404066aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57728/0 (socket says 172.21.15.62:57728) 2021-12-17T19:13:56.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540a9fa700 1 -- 172.21.15.62:0/3151358867 learned_addr learned my addr 172.21.15.62:0/3151358867 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:56.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540a1f9700 1 --2- 172.21.15.62:0/3151358867 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54040a7bb0 0x7f540414e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:56.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f54099f8700 1 --2- 172.21.15.62:0/3151358867 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54040b1730 0x7f540414e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:56.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540a9fa700 1 -- 172.21.15.62:0/3151358867 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54040a7bb0 msgr2=0x7f540414e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:56.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540a9fa700 1 --2- 172.21.15.62:0/3151358867 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54040a7bb0 0x7f540414e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540a9fa700 1 -- 172.21.15.62:0/3151358867 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54040b1730 msgr2=0x7f540414e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:56.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540a9fa700 1 --2- 172.21.15.62:0/3151358867 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54040b1730 0x7f540414e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540a9fa700 1 -- 172.21.15.62:0/3151358867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540000b180 con 0x7f54040b21f0 2021-12-17T19:13:56.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540a9fa700 1 --2- 172.21.15.62:0/3151358867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54040b21f0 0x7f5404066aa0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f53fc001490 tx=0x7f53fc007d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:56.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f53f37fe700 1 -- 172.21.15.62:0/3151358867 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53fc00f470 con 0x7f54040b21f0 2021-12-17T19:13:56.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f53f37fe700 1 -- 172.21.15.62:0/3151358867 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc00f5d0 con 0x7f54040b21f0 2021-12-17T19:13:56.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540c45d700 1 -- 172.21.15.62:0/3151358867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54040643d0 con 0x7f54040b21f0 2021-12-17T19:13:56.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f53f37fe700 1 -- 172.21.15.62:0/3151358867 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53fc00f930 con 0x7f54040b21f0 2021-12-17T19:13:56.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.259+0000 7f540c45d700 1 -- 172.21.15.62:0/3151358867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540414d790 con 0x7f54040b21f0 2021-12-17T19:13:56.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.263+0000 7f540c45d700 1 -- 172.21.15.62:0/3151358867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540414daa0 con 0x7f54040b21f0 2021-12-17T19:13:56.287 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.263+0000 7f53f37fe700 1 -- 172.21.15.62:0/3151358867 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f53fc019030 con 0x7f54040b21f0 2021-12-17T19:13:56.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.263+0000 7f53f37fe700 1 --2- 172.21.15.62:0/3151358867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f53e4053580 0x7f53e4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:56.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.263+0000 7f53f37fe700 1 -- 172.21.15.62:0/3151358867 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f53fc06ac80 con 0x7f54040b21f0 2021-12-17T19:13:56.288 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.263+0000 7f540a1f9700 1 --2- 172.21.15.62:0/3151358867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f53e4053580 0x7f53e4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:56.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.263+0000 7f540a1f9700 1 --2- 172.21.15.62:0/3151358867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f53e4053580 0x7f53e4055a40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f53f400d000 tx=0x7f53f4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:56.289 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.271+0000 7f53f37fe700 1 -- 172.21.15.62:0/3151358867 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f53fc0420c0 con 0x7f54040b21f0 2021-12-17T19:13:56.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.387+0000 7f540c45d700 1 -- 172.21.15.62:0/3151358867 --> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f540414ce40 con 0x7f53e4053580 2021-12-17T19:13:56.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.395+0000 7f53f37fe700 1 -- 172.21.15.62:0/3151358867 <== mgr.4103 v2:172.21.15.109:6800/14658 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68691 (secure 0 0 0) 0x7f53f4001350 con 0x7f53e4053580 2021-12-17T19:13:56.407 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T19:13:56.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.399+0000 7f540c45d700 1 -- 172.21.15.62:0/3151358867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f53e4053580 msgr2=0x7f53e4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:56.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.399+0000 7f540c45d700 1 --2- 172.21.15.62:0/3151358867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f53e4053580 0x7f53e4055a40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f53f400d000 tx=0x7f53f4009040).stop 2021-12-17T19:13:56.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.399+0000 7f540c45d700 1 -- 172.21.15.62:0/3151358867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54040b21f0 msgr2=0x7f5404066aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:56.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.399+0000 7f540c45d700 1 --2- 172.21.15.62:0/3151358867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54040b21f0 0x7f5404066aa0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f53fc001490 tx=0x7f53fc007d60).stop 2021-12-17T19:13:56.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.399+0000 7f540c45d700 1 -- 172.21.15.62:0/3151358867 shutdown_connections 2021-12-17T19:13:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.399+0000 7f540c45d700 1 --2- 172.21.15.62:0/3151358867 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f53e4053580 0x7f53e4055a40 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.399+0000 7f540c45d700 1 --2- 172.21.15.62:0/3151358867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54040b21f0 0x7f5404066aa0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.399+0000 7f540c45d700 1 --2- 172.21.15.62:0/3151358867 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54040b1730 0x7f540414e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.399+0000 7f540c45d700 1 --2- 172.21.15.62:0/3151358867 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54040a7bb0 0x7f540414e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.399+0000 7f540c45d700 1 -- 172.21.15.62:0/3151358867 >> 172.21.15.62:0/3151358867 conn(0x7f540405f730 msgr2=0x7f54040afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.399+0000 7f540c45d700 1 -- 172.21.15.62:0/3151358867 shutdown_connections 2021-12-17T19:13:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.399+0000 7f540c45d700 1 -- 172.21.15.62:0/3151358867 wait complete. 2021-12-17T19:13:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2021-12-17T19:13:56.420 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":1820,"stamp":"2021-12-17T19:13:54.457489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8404092,"kb_used_data":15420,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746570628,"statfs":{"total":773094113280,"available":764488323072,"internally_reserved":8589934592,"allocated":15790080,"data_stored":7320534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003450"},"pg_stats":[{"pgid":"1.0","version":"16'2","reported_seq":140,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.056643+0000","last_change":"2021-12-17T18:18:11.029535+0000","last_active":"2021-12-17T18:28:24.056643+0000","last_peered":"2021-12-17T18:28:24.056643+0000","last_clean":"2021-12-17T18:28:24.056643+0000","last_became_active":"2021-12-17T18:18:11.028573+0000","last_became_peered":"2021-12-17T18:18:11.028573+0000","last_unstale":"2021-12-17T18:28:24.056643+0000","last_undegraded":"2021-12-17T18:28:24.056643+0000","last_fullsized":"2021-12-17T18:28:24.056643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:06.521383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:06.521383+0000","last_clean_scrub_stamp":"2021-12-17T18:18:06.521383+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":138,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.961823+0000","last_change":"2021-12-17T18:18:15.745704+0000","last_active":"2021-12-17T18:28:24.961823+0000","last_peered":"2021-12-17T18:28:24.961823+0000","last_clean":"2021-12-17T18:28:24.961823+0000","last_became_active":"2021-12-17T18:18:15.744953+0000","last_became_peered":"2021-12-17T18:18:15.744953+0000","last_unstale":"2021-12-17T18:28:24.961823+0000","last_undegraded":"2021-12-17T18:28:24.961823+0000","last_fullsized":"2021-12-17T18:28:24.961823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.056559+0000","last_change":"2021-12-17T18:18:15.740336+0000","last_active":"2021-12-17T18:28:24.056559+0000","last_peered":"2021-12-17T18:28:24.056559+0000","last_clean":"2021-12-17T18:28:24.056559+0000","last_became_active":"2021-12-17T18:18:15.739646+0000","last_became_peered":"2021-12-17T18:18:15.739646+0000","last_unstale":"2021-12-17T18:28:24.056559+0000","last_undegraded":"2021-12-17T18:28:24.056559+0000","last_fullsized":"2021-12-17T18:28:24.056559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":138,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.960387+0000","last_change":"2021-12-17T18:18:16.000008+0000","last_active":"2021-12-17T18:28:24.960387+0000","last_peered":"2021-12-17T18:28:24.960387+0000","last_clean":"2021-12-17T18:28:24.960387+0000","last_became_active":"2021-12-17T18:18:15.998977+0000","last_became_peered":"2021-12-17T18:18:15.998977+0000","last_unstale":"2021-12-17T18:28:24.960387+0000","last_undegraded":"2021-12-17T18:28:24.960387+0000","last_fullsized":"2021-12-17T18:28:24.960387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":138,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.961825+0000","last_change":"2021-12-17T18:18:15.744111+0000","last_active":"2021-12-17T18:28:24.961825+0000","last_peered":"2021-12-17T18:28:24.961825+0000","last_clean":"2021-12-17T18:28:24.961825+0000","last_became_active":"2021-12-17T18:18:15.743756+0000","last_became_peered":"2021-12-17T18:18:15.743756+0000","last_unstale":"2021-12-17T18:28:24.961825+0000","last_undegraded":"2021-12-17T18:28:24.961825+0000","last_fullsized":"2021-12-17T18:28:24.961825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":145,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.049374+0000","last_change":"2021-12-17T18:18:16.004167+0000","last_active":"2021-12-17T18:28:24.049374+0000","last_peered":"2021-12-17T18:28:24.049374+0000","last_clean":"2021-12-17T18:28:24.049374+0000","last_became_active":"2021-12-17T18:18:16.003760+0000","last_became_peered":"2021-12-17T18:18:16.003760+0000","last_unstale":"2021-12-17T18:28:24.049374+0000","last_undegraded":"2021-12-17T18:28:24.049374+0000","last_fullsized":"2021-12-17T18:28:24.049374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":135,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.057024+0000","last_change":"2021-12-17T18:18:16.007390+0000","last_active":"2021-12-17T18:28:24.057024+0000","last_peered":"2021-12-17T18:28:24.057024+0000","last_clean":"2021-12-17T18:28:24.057024+0000","last_became_active":"2021-12-17T18:18:16.006472+0000","last_became_peered":"2021-12-17T18:18:16.006472+0000","last_unstale":"2021-12-17T18:28:24.057024+0000","last_undegraded":"2021-12-17T18:28:24.057024+0000","last_fullsized":"2021-12-17T18:28:24.057024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":145,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.049474+0000","last_change":"2021-12-17T18:18:15.740372+0000","last_active":"2021-12-17T18:28:24.049474+0000","last_peered":"2021-12-17T18:28:24.049474+0000","last_clean":"2021-12-17T18:28:24.049474+0000","last_became_active":"2021-12-17T18:18:15.739493+0000","last_became_peered":"2021-12-17T18:18:15.739493+0000","last_unstale":"2021-12-17T18:28:24.049474+0000","last_undegraded":"2021-12-17T18:28:24.049474+0000","last_fullsized":"2021-12-17T18:28:24.049474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":136,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.461869+0000","last_change":"2021-12-17T18:18:15.743498+0000","last_active":"2021-12-17T18:28:24.461869+0000","last_peered":"2021-12-17T18:28:24.461869+0000","last_clean":"2021-12-17T18:28:24.461869+0000","last_became_active":"2021-12-17T18:18:15.742720+0000","last_became_peered":"2021-12-17T18:18:15.742720+0000","last_unstale":"2021-12-17T18:28:24.461869+0000","last_undegraded":"2021-12-17T18:28:24.461869+0000","last_fullsized":"2021-12-17T18:28:24.461869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542815,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.79300000000000004,"15min":0.78500000000000003},"min":{"1min":0.64500000000000002,"5min":0.55600000000000005,"15min":0.49299999999999999},"max":{"1min":1.0049999999999999,"5min":1.0940000000000001,"15min":1.103},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.57499999999999996,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.002,"5min":1.0229999999999999,"15min":1.069},"last":0.89800000000000002}]},{"osd":1,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.79900000000000004,"15min":0.78900000000000003},"min":{"1min":0.62,"5min":0.56699999999999995,"15min":0.54900000000000004},"max":{"1min":0.98299999999999998,"5min":1.145,"15min":1.179},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80700000000000005,"15min":0.81100000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.54300000000000004},"max":{"1min":1.0329999999999999,"5min":1.1220000000000001,"15min":1.179},"last":0.78000000000000003}]},{"osd":2,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.82699999999999996,"15min":0.81699999999999995},"min":{"1min":0.58899999999999997,"5min":0.57899999999999996,"15min":0.56399999999999995},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.337},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.81799999999999995,"15min":0.82499999999999996},"min":{"1min":0.63,"5min":0.61499999999999999,"15min":0.57699999999999996},"max":{"1min":1.0389999999999999,"5min":1.0649999999999999,"15min":1.1879999999999999},"last":0.89100000000000001}]},{"osd":3,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.55300000000000005},"max":{"1min":1.101,"5min":1.101,"15min":1.3839999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.871,"15min":0.86299999999999999},"min":{"1min":0.69499999999999995,"5min":0.66300000000000003,"15min":0.625},"max":{"1min":1.0900000000000001,"5min":1.107,"15min":1.171},"last":0.84699999999999998}]},{"osd":4,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77300000000000002,"15min":0.78800000000000003},"min":{"1min":0.53000000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0269999999999999,"5min":1.0489999999999999,"15min":1.3200000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.90800000000000003,"15min":0.91200000000000003},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.50900000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.482},"last":0.94299999999999995}]},{"osd":5,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.622,"5min":0.60199999999999998,"15min":0.57599999999999996},"max":{"1min":1.1459999999999999,"5min":1.2430000000000001,"15min":1.4470000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.877,"5min":0.84599999999999997,"15min":0.85399999999999998},"min":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.52000000000000002},"max":{"1min":1.1200000000000001,"5min":1.2070000000000001,"15min":1.2549999999999999},"last":1.0229999999999999}]},{"osd":6,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.89800000000000002,"15min":0.90500000000000003},"min":{"1min":0.66200000000000003,"5min":0.64300000000000002,"15min":0.59899999999999998},"max":{"1min":1.1559999999999999,"5min":1.173,"15min":1.286},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.92300000000000004,"15min":0.91000000000000003},"min":{"1min":0.67600000000000005,"5min":0.60699999999999998,"15min":0.53400000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.431},"last":0.73399999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542815,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:12:50 2021","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.79100000000000004,"15min":0.79400000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.51800000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.165},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.58499999999999996,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.94499999999999995,"5min":1.028,"15min":1.2370000000000001},"last":0.69399999999999995}]},{"osd":1,"last update":"Fri Dec 17 19:12:50 2021","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77100000000000002,"15min":0.76800000000000002},"min":{"1min":0.627,"5min":0.57899999999999996,"15min":0.52300000000000002},"max":{"1min":1.0189999999999999,"5min":1.0669999999999999,"15min":1.151},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.64500000000000002,"5min":0.56899999999999995,"15min":0.52700000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.127},"last":0.92700000000000005}]},{"osd":2,"last update":"Fri Dec 17 19:12:50 2021","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81499999999999995,"15min":0.83099999999999996},"min":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.55400000000000005},"max":{"1min":1.032,"5min":1.097,"15min":1.155},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.86399999999999999,"15min":0.85599999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0620000000000001,"5min":1.1659999999999999,"15min":1.2050000000000001},"last":0.76200000000000001}]},{"osd":3,"last update":"Fri Dec 17 19:12:50 2021","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.84399999999999997,"15min":0.85299999999999998},"min":{"1min":0.58899999999999997,"5min":0.58799999999999997,"15min":0.54300000000000004},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.153},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.92800000000000005,"15min":0.92900000000000005},"min":{"1min":0.80100000000000005,"5min":0.69899999999999995,"15min":0.57199999999999995},"max":{"1min":1.095,"5min":1.2270000000000001,"15min":1.2809999999999999},"last":1.093}]},{"osd":4,"last update":"Fri Dec 17 19:12:50 2021","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.78500000000000003,"15min":0.77900000000000003},"min":{"1min":0.54800000000000004,"5min":0.53000000000000003,"15min":0.504},"max":{"1min":1.018,"5min":1.1299999999999999,"15min":1.141},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.60199999999999998,"5min":0.55300000000000005,"15min":0.41999999999999998},"max":{"1min":1.0389999999999999,"5min":1.276,"15min":1.3149999999999999},"last":0.96599999999999997}]},{"osd":5,"last update":"Fri Dec 17 19:12:50 2021","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.78400000000000003,"15min":0.78600000000000003},"min":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.441},"max":{"1min":0.98199999999999998,"5min":1.244,"15min":1.381},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.874,"15min":0.88700000000000001},"min":{"1min":0.59599999999999997,"5min":0.57399999999999995,"15min":0.52200000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.3420000000000001},"last":1.008}]},{"osd":7,"last update":"Fri Dec 17 19:12:50 2021","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.89100000000000001,"15min":0.91500000000000004},"min":{"1min":0.61399999999999999,"5min":0.58499999999999996,"15min":0.52200000000000002},"max":{"1min":1.0229999999999999,"5min":1.177,"15min":1.353},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.92000000000000004,"15min":0.93500000000000005},"min":{"1min":0.65700000000000003,"5min":0.55700000000000005,"15min":0.51100000000000001},"max":{"1min":1.095,"5min":1.29,"15min":1.47},"last":1.0700000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542815,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:12:59 2021","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.77000000000000002,"15min":0.76700000000000002},"min":{"1min":0.57099999999999995,"5min":0.52600000000000002,"15min":0.48999999999999999},"max":{"1min":1.0069999999999999,"5min":1.071,"15min":1.1539999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.53700000000000003},"max":{"1min":1.109,"5min":1.151,"15min":1.1619999999999999},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri Dec 17 19:12:59 2021","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.877,"15min":0.86099999999999999},"min":{"1min":0.70899999999999996,"5min":0.60899999999999999,"15min":0.52700000000000002},"max":{"1min":1.0209999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.86899999999999999,"15min":0.88200000000000001},"min":{"1min":0.72099999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97599999999999998,"5min":1.0489999999999999,"15min":1.4490000000000001},"last":0.71899999999999997}]},{"osd":2,"last update":"Fri Dec 17 19:12:59 2021","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.80500000000000005},"min":{"1min":0.61899999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0660000000000001,"5min":1.0720000000000001,"15min":1.306},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84999999999999998,"15min":0.82299999999999995},"min":{"1min":0.68600000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0549999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri Dec 17 19:12:59 2021","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.60399999999999998,"5min":0.59299999999999997,"15min":0.56599999999999995},"max":{"1min":0.90200000000000002,"5min":1.0840000000000001,"15min":1.117},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.876,"5min":0.879,"15min":0.86799999999999999},"min":{"1min":0.65700000000000003,"5min":0.629,"15min":0.59699999999999998},"max":{"1min":1.071,"5min":1.0940000000000001,"15min":1.1160000000000001},"last":0.94399999999999995}]},{"osd":4,"last update":"Fri Dec 17 19:12:59 2021","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.503},"max":{"1min":0.95699999999999996,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82599999999999996,"15min":0.83099999999999996},"min":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.51900000000000002},"max":{"1min":1.0349999999999999,"5min":1.133,"15min":1.1910000000000001},"last":0.629}]},{"osd":6,"last update":"Fri Dec 17 19:12:59 2021","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.83799999999999997,"15min":0.81999999999999995},"min":{"1min":0.58899999999999997,"5min":0.55600000000000005,"15min":0.54200000000000004},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.214},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.91500000000000004,"15min":0.89000000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.57599999999999996},"max":{"1min":1.133,"5min":1.1819999999999999,"15min":1.2370000000000001},"last":0.86099999999999999}]},{"osd":7,"last update":"Fri Dec 17 19:12:59 2021","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.91500000000000004,"15min":0.90900000000000003},"min":{"1min":0.67100000000000004,"5min":0.59299999999999997,"15min":0.53500000000000003},"max":{"1min":1.103,"5min":1.296,"15min":1.5580000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.97099999999999997,"15min":0.95399999999999996},"min":{"1min":0.82099999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.746}]}]},{"osd":4,"up_from":14,"seq":60129542814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:13:00 2021","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.81599999999999995,"15min":0.79500000000000004},"min":{"1min":0.59299999999999997,"5min":0.57299999999999995,"15min":0.42599999999999999},"max":{"1min":1.0269999999999999,"5min":1.111,"15min":1.111},"last":1.044},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78900000000000003,"15min":0.80400000000000005},"min":{"1min":0.58199999999999996,"5min":0.52600000000000002,"15min":0.51600000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.099},"last":1.0369999999999999}]},{"osd":1,"last update":"Fri Dec 17 19:13:00 2021","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.77400000000000002,"15min":0.79400000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.495},"max":{"1min":1.0129999999999999,"5min":1.107,"15min":1.1779999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.80800000000000005},"min":{"1min":0.57999999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.999,"5min":1.071,"15min":1.234},"last":0.93899999999999995}]},{"osd":2,"last update":"Fri Dec 17 19:13:00 2021","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79800000000000004,"15min":0.80500000000000005},"min":{"1min":0.65000000000000002,"5min":0.53900000000000003,"15min":0.51700000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.252},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83399999999999996,"15min":0.83199999999999996},"min":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.96499999999999997,"5min":1.077,"15min":1.577},"last":0.71299999999999997}]},{"osd":3,"last update":"Fri Dec 17 19:13:00 2021","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.82999999999999996,"15min":0.84599999999999997},"min":{"1min":0.65400000000000003,"5min":0.58699999999999997,"15min":0.53400000000000003},"max":{"1min":1.0780000000000001,"5min":1.105,"15min":1.141},"last":1.117},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93799999999999994,"15min":0.93700000000000006},"min":{"1min":0.81299999999999994,"5min":0.66500000000000004,"15min":0.621},"max":{"1min":1.1499999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.90900000000000003}]},{"osd":5,"last update":"Fri Dec 17 19:13:00 2021","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79400000000000004,"15min":0.79800000000000004},"min":{"1min":0.60999999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0700000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.85299999999999998,"15min":0.84099999999999997},"min":{"1min":0.56699999999999995,"5min":0.54500000000000004,"15min":0.52800000000000002},"max":{"1min":1.0209999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.1559999999999999}]},{"osd":6,"last update":"Fri Dec 17 19:13:00 2021","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86299999999999999,"15min":0.84699999999999998},"min":{"1min":0.60199999999999998,"5min":0.52400000000000002,"15min":0.51700000000000002},"max":{"1min":1.0449999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.71799999999999997,"5min":0.68700000000000006,"15min":0.56200000000000006},"max":{"1min":1.002,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.96999999999999997}]},{"osd":7,"last update":"Fri Dec 17 19:13:00 2021","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.95099999999999996,"15min":0.93300000000000005},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.59899999999999998},"max":{"1min":1.1140000000000001,"5min":1.331,"15min":1.339},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98399999999999999,"15min":0.98099999999999998},"min":{"1min":0.69599999999999995,"5min":0.61599999999999999,"15min":0.58899999999999997},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.998}]}]},{"osd":3,"up_from":14,"seq":60129542814,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81999999999999995,"5min":1.099,"15min":1.1000000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65800000000000003,"15min":0.65100000000000002},"min":{"1min":0.498,"5min":0.48599999999999999,"15min":0.46500000000000002},"max":{"1min":0.88900000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63100000000000001,"15min":0.61699999999999999},"min":{"1min":0.52200000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.1830000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.53600000000000003,"5min":0.499,"15min":0.48199999999999998},"max":{"1min":0.91600000000000004,"5min":1.0229999999999999,"15min":1.04},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.746,"15min":0.748},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90300000000000002,"5min":1.101,"15min":1.101},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.78600000000000003},"min":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.52900000000000003},"max":{"1min":1.0089999999999999,"5min":1.1899999999999999,"15min":1.1930000000000001},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.85599999999999998,"15min":0.85199999999999998},"min":{"1min":0.69399999999999995,"5min":0.63900000000000001,"15min":0.61499999999999999},"max":{"1min":1.0629999999999999,"5min":1.226,"15min":1.226},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.90800000000000003,"15min":0.90200000000000002},"min":{"1min":0.68000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.069,"5min":1.248,"15min":1.248},"last":0.88}]},{"osd":5,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.98499999999999999,"15min":0.97099999999999997},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71599999999999997},"max":{"1min":1.143,"5min":1.4139999999999999,"15min":1.534},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91400000000000003,"15min":0.90300000000000002},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.62},"max":{"1min":1.2509999999999999,"5min":1.413,"15min":1.413},"last":0.90900000000000003}]},{"osd":6,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.97299999999999998,"15min":0.97199999999999998},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.68500000000000005},"max":{"1min":1.159,"5min":1.3009999999999999,"15min":1.365},"last":1.052},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.048,"15min":1.0309999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.2210000000000001,"5min":1.4550000000000001,"15min":1.486},"last":0.89400000000000002}]},{"osd":7,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.016,"15min":0.996},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.67400000000000004},"max":{"1min":1.169,"5min":1.3839999999999999,"15min":1.387},"last":1.028},{"interface":"front","average":{"1min":0.999,"5min":1.0489999999999999,"15min":1.046},"min":{"1min":0.81399999999999995,"5min":0.80700000000000005,"15min":0.73999999999999999},"max":{"1min":1.278,"5min":1.3620000000000001,"15min":1.3680000000000001},"last":0.93899999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542815,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.45300000000000001,"5min":0.44400000000000001,"15min":0.438},"max":{"1min":0.82899999999999996,"5min":0.84799999999999998,"15min":0.95799999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.499,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.022,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.56699999999999995}]},{"osd":1,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.80200000000000005,"15min":0.81399999999999995},"min":{"1min":0.621,"5min":0.59799999999999998,"15min":0.56899999999999995},"max":{"1min":1.077,"5min":1.133,"15min":1.133},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68400000000000005,"15min":0.68500000000000005},"min":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.45900000000000002},"max":{"1min":0.92300000000000004,"5min":0.94799999999999995,"15min":1.004},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.86199999999999999,"5min":1,"15min":1.083},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.036,"5min":1.1339999999999999,"15min":1.2310000000000001},"last":1.036}]},{"osd":4,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.85099999999999998,"15min":0.84999999999999998},"min":{"1min":0.67400000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.302},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94299999999999995,"15min":0.95899999999999996},"min":{"1min":0.77800000000000002,"5min":0.68999999999999995,"15min":0.66200000000000003},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.472},"last":1.1000000000000001}]},{"osd":5,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.877,"15min":0.876},"min":{"1min":0.71099999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2829999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.90900000000000003,"15min":0.91500000000000004},"min":{"1min":0.70199999999999996,"5min":0.68999999999999995,"15min":0.66500000000000004},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3600000000000001},"last":0.92100000000000004}]},{"osd":6,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0029999999999999},"min":{"1min":0.83099999999999996,"5min":0.745,"15min":0.66900000000000004},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.3919999999999999},"last":1.179},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.93600000000000005,"15min":0.94999999999999996},"min":{"1min":0.65000000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2070000000000001,"5min":1.236,"15min":1.3480000000000001},"last":1.2050000000000001}]},{"osd":7,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0329999999999999,"15min":1.04},"min":{"1min":0.89600000000000002,"5min":0.78000000000000003,"15min":0.73399999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.5369999999999999},"last":1.238},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.97799999999999998,"15min":0.98799999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68200000000000005},"max":{"1min":1.2090000000000001,"5min":1.284,"15min":1.4870000000000001},"last":1.125}]}]},{"osd":1,"up_from":14,"seq":60129542814,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:12:51 2021","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.47899999999999998,"5min":0.438,"15min":0.433},"max":{"1min":0.71999999999999997,"5min":0.97099999999999997,"15min":1.032},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68999999999999995,"15min":0.67500000000000004},"min":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.45900000000000002},"max":{"1min":1.0029999999999999,"5min":1.125,"15min":1.125},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Dec 17 19:12:51 2021","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60699999999999998,"15min":0.59999999999999998},"min":{"1min":0.50900000000000001,"5min":0.46000000000000002,"15min":0.442},"max":{"1min":0.77400000000000002,"5min":1.0249999999999999,"15min":1.1539999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71799999999999997,"15min":0.72599999999999998},"min":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.44500000000000001},"max":{"1min":0.93999999999999995,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Dec 17 19:12:51 2021","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78500000000000003,"15min":0.78400000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.52100000000000002},"max":{"1min":0.93700000000000006,"5min":1.046,"15min":1.1240000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72999999999999998},"min":{"1min":0.51500000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0209999999999999,"5min":1.054,"15min":1.054},"last":0.78800000000000003}]},{"osd":4,"last update":"Fri Dec 17 19:12:51 2021","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.82199999999999995,"15min":0.84499999999999997},"min":{"1min":0.68100000000000005,"5min":0.60599999999999998,"15min":0.60299999999999998},"max":{"1min":1.0289999999999999,"5min":1.1200000000000001,"15min":1.1970000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.93000000000000005,"15min":0.93899999999999995},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70299999999999996},"max":{"1min":1.1459999999999999,"5min":1.2869999999999999,"15min":1.323},"last":1.1379999999999999}]},{"osd":5,"last update":"Fri Dec 17 19:12:51 2021","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.92800000000000005,"15min":0.94399999999999995},"min":{"1min":0.77400000000000002,"5min":0.67000000000000004,"15min":0.65300000000000002},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.482},"last":0.876},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.92900000000000005,"15min":0.92500000000000004},"min":{"1min":0.753,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2290000000000001,"5min":1.343,"15min":1.4790000000000001},"last":0.93799999999999994}]},{"osd":6,"last update":"Fri Dec 17 19:12:51 2021","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96599999999999997,"15min":0.97799999999999998},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.66100000000000003},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.5269999999999999},"last":1.113},{"interface":"front","average":{"1min":1.032,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.83899999999999997,"5min":0.71599999999999997,"15min":0.69599999999999995},"max":{"1min":1.294,"5min":1.4219999999999999,"15min":1.4690000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Dec 17 19:12:51 2021","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.026,"15min":1.026},"min":{"1min":0.89900000000000002,"5min":0.749,"15min":0.68200000000000005},"max":{"1min":1.1020000000000001,"5min":1.373,"15min":1.472},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.96399999999999997,"5min":0.753,"15min":0.73699999999999999},"max":{"1min":1.2809999999999999,"5min":1.363,"15min":1.4359999999999999},"last":1.04}]}]},{"osd":0,"up_from":14,"seq":60129542815,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050508,"kb_used_data":1924,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321332,"statfs":{"total":96636764160,"available":95561043968,"internally_reserved":1073741824,"allocated":1970176,"data_stored":914561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 17 19:13:02 2021","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54900000000000004,"15min":0.57099999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.41299999999999998},"max":{"1min":0.75800000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63,"15min":0.64400000000000002},"min":{"1min":0.49199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.1240000000000001},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Dec 17 19:13:02 2021","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.68200000000000005,"15min":0.69099999999999995},"min":{"1min":0.51700000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.871,"5min":1.079,"15min":1.151},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77900000000000003,"15min":0.77400000000000002},"min":{"1min":0.61199999999999999,"5min":0.59799999999999998,"15min":0.56899999999999995},"max":{"1min":0.93799999999999994,"5min":1.0229999999999999,"15min":1.2050000000000001},"last":0.876}]},{"osd":3,"last update":"Fri Dec 17 19:13:02 2021","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46300000000000002},"max":{"1min":0.79600000000000004,"5min":1.093,"15min":1.093},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.754,"15min":0.755},"min":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.52100000000000002},"max":{"1min":0.94799999999999995,"5min":1.276,"15min":1.276},"last":0.84499999999999997}]},{"osd":4,"last update":"Fri Dec 17 19:13:02 2021","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.84899999999999998,"15min":0.84399999999999997},"min":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.61899999999999999},"max":{"1min":1.04,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.88900000000000001,"15min":0.90300000000000002},"min":{"1min":0.75700000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0629999999999999,"5min":1.2090000000000001,"15min":1.337},"last":0.93600000000000005}]},{"osd":5,"last update":"Fri Dec 17 19:13:02 2021","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90700000000000003,"15min":0.91500000000000004},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.628},"max":{"1min":1.1279999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.90000000000000002,"15min":0.90300000000000002},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.206,"5min":1.2669999999999999,"15min":1.3320000000000001},"last":0.81699999999999995}]},{"osd":6,"last update":"Fri Dec 17 19:13:02 2021","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.94599999999999995,"15min":0.95799999999999996},"min":{"1min":0.69099999999999995,"5min":0.68100000000000005,"15min":0.67700000000000005},"max":{"1min":1.103,"5min":1.3380000000000001,"15min":1.4550000000000001},"last":1.004},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96099999999999997,"15min":0.97299999999999998},"min":{"1min":0.82099999999999995,"5min":0.70499999999999996,"15min":0.69399999999999995},"max":{"1min":1.1559999999999999,"5min":1.1970000000000001,"15min":1.3089999999999999},"last":1.1479999999999999}]},{"osd":7,"last update":"Fri Dec 17 19:13:02 2021","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.99099999999999999,"15min":0.996},"min":{"1min":0.753,"5min":0.73099999999999998,"15min":0.66500000000000004},"max":{"1min":1.2030000000000001,"5min":1.2929999999999999,"15min":1.3240000000000001},"last":1.105},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.98899999999999999,"15min":0.98599999999999999},"min":{"1min":0.83199999999999996,"5min":0.76200000000000001,"15min":0.67900000000000005},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.534},"last":0.95599999999999996}]}]}]}} 2021-12-17T19:13:56.422 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-12-17T19:13:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3ab59e700 1 Processor -- start 2021-12-17T19:13:56.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3ab59e700 1 -- start start 2021-12-17T19:13:56.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3ab59e700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7ff3ac0b5b20 0x7ff3ac0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:56.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3ab59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3ac0b3760 0x7ff3ac0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3ab59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff3ac0b6c70 0x7ff3ac146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3ab59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3ac0b5f00 con 0x7ff3ac0b6c70 2021-12-17T19:13:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3ab59e700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3ac0b3020 con 0x7ff3ac0b5b20 2021-12-17T19:13:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3ab59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac0b32c0 con 0x7ff3ac0b3760 2021-12-17T19:13:56.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3aad9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff3ac0b6c70 0x7ff3ac146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3aad9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff3ac0b6c70 0x7ff3ac146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57736/0 (socket says 172.21.15.62:57736) 2021-12-17T19:13:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3aad9d700 1 -- 172.21.15.62:0/1538833792 learned_addr learned my addr 172.21.15.62:0/1538833792 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:56.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3a9d9b700 1 --2- 172.21.15.62:0/1538833792 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3ac0b3760 0x7ff3ac0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:56.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3aa59c700 1 --2- 172.21.15.62:0/1538833792 >> v2:172.21.15.109:3300/0 conn(0x7ff3ac0b5b20 0x7ff3ac0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:56.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3a9d9b700 1 -- 172.21.15.62:0/1538833792 >> v2:172.21.15.109:3300/0 conn(0x7ff3ac0b5b20 msgr2=0x7ff3ac0b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:13:56.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3a9d9b700 1 --2- 172.21.15.62:0/1538833792 >> v2:172.21.15.109:3300/0 conn(0x7ff3ac0b5b20 0x7ff3ac0b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3a9d9b700 1 -- 172.21.15.62:0/1538833792 >> v2:172.21.15.62:3300/0 conn(0x7ff3ac0b6c70 msgr2=0x7ff3ac146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:13:56.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3a9d9b700 1 --2- 172.21.15.62:0/1538833792 >> v2:172.21.15.62:3300/0 conn(0x7ff3ac0b6c70 0x7ff3ac146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3a9d9b700 1 -- 172.21.15.62:0/1538833792 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ac0b5440 con 0x7ff3ac0b3760 2021-12-17T19:13:56.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3aad9d700 1 --2- 172.21.15.62:0/1538833792 >> v2:172.21.15.62:3300/0 conn(0x7ff3ac0b6c70 0x7ff3ac146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T19:13:56.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.519+0000 7ff3a9d9b700 1 --2- 172.21.15.62:0/1538833792 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3ac0b3760 0x7ff3ac0b6780 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7ff394002f70 tx=0x7ff394006df0).ready entity=mon.2 client_cookie=a03c3f0525ac77ff server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:56.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.523+0000 7ff3a959a700 1 -- 172.21.15.62:0/1538833792 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff39400d4a0 con 0x7ff3ac0b3760 2021-12-17T19:13:56.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.523+0000 7ff3a959a700 1 -- 172.21.15.62:0/1538833792 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff394000e90 con 0x7ff3ac0b3760 2021-12-17T19:13:56.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.523+0000 7ff3a959a700 1 -- 172.21.15.62:0/1538833792 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff39400d7f0 con 0x7ff3ac0b3760 2021-12-17T19:13:56.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.523+0000 7ff3ab59e700 1 -- 172.21.15.62:0/1538833792 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3ac0b3760 msgr2=0x7ff3ac0b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:56.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.523+0000 7ff3ab59e700 1 --2- 172.21.15.62:0/1538833792 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3ac0b3760 0x7ff3ac0b6780 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7ff394002f70 tx=0x7ff394006df0).stop 2021-12-17T19:13:56.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.523+0000 7ff3ab59e700 1 -- 172.21.15.62:0/1538833792 shutdown_connections 2021-12-17T19:13:56.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.523+0000 7ff3ab59e700 1 --2- 172.21.15.62:0/1538833792 >> v2:172.21.15.62:3300/0 conn(0x7ff3ac0b6c70 0x7ff3ac146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.523+0000 7ff3ab59e700 1 --2- 172.21.15.62:0/1538833792 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3ac0b3760 0x7ff3ac0b6780 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.523+0000 7ff3ab59e700 1 --2- 172.21.15.62:0/1538833792 >> v2:172.21.15.109:3300/0 conn(0x7ff3ac0b5b20 0x7ff3ac0b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.523+0000 7ff3ab59e700 1 -- 172.21.15.62:0/1538833792 >> 172.21.15.62:0/1538833792 conn(0x7ff3ac05c750 msgr2=0x7ff3ac05cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.523+0000 7ff3ab59e700 1 -- 172.21.15.62:0/1538833792 shutdown_connections 2021-12-17T19:13:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.523+0000 7ff3ab59e700 1 -- 172.21.15.62:0/1538833792 wait complete. 2021-12-17T19:13:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3ab59e700 1 Processor -- start 2021-12-17T19:13:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3ab59e700 1 -- start start 2021-12-17T19:13:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3ab59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3ac0b5b20 0x7ff3ac142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3ab59e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3ac0b6c70 0x7ff3ac13e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3ab59e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3ac144e50 0x7ff3ac13eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3ab59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac1480b0 con 0x7ff3ac0b5b20 2021-12-17T19:13:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3ab59e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac148350 con 0x7ff3ac144e50 2021-12-17T19:13:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3ab59e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac145330 con 0x7ff3ac0b6c70 2021-12-17T19:13:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3aa59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3ac0b5b20 0x7ff3ac142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3aa59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3ac0b5b20 0x7ff3ac142520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57738/0 (socket says 172.21.15.62:57738) 2021-12-17T19:13:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3aa59c700 1 -- 172.21.15.62:0/4170303246 learned_addr learned my addr 172.21.15.62:0/4170303246 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3aad9d700 1 --2- 172.21.15.62:0/4170303246 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3ac144e50 0x7ff3ac13eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:56.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3a9d9b700 1 --2- 172.21.15.62:0/4170303246 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3ac0b6c70 0x7ff3ac13e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3aa59c700 1 -- 172.21.15.62:0/4170303246 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3ac0b6c70 msgr2=0x7ff3ac13e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:56.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3aa59c700 1 --2- 172.21.15.62:0/4170303246 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3ac0b6c70 0x7ff3ac13e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3aa59c700 1 -- 172.21.15.62:0/4170303246 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3ac144e50 msgr2=0x7ff3ac13eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3aa59c700 1 --2- 172.21.15.62:0/4170303246 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3ac144e50 0x7ff3ac13eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3aa59c700 1 -- 172.21.15.62:0/4170303246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a4009530 con 0x7ff3ac0b5b20 2021-12-17T19:13:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3aa59c700 1 --2- 172.21.15.62:0/4170303246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3ac0b5b20 0x7ff3ac142520 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7ff39c00c000 tx=0x7ff39c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3a37fe700 1 -- 172.21.15.62:0/4170303246 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff39c010780 con 0x7ff3ac0b5b20 2021-12-17T19:13:56.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3a37fe700 1 -- 172.21.15.62:0/4170303246 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39c0108e0 con 0x7ff3ac0b5b20 2021-12-17T19:13:56.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3ab59e700 1 -- 172.21.15.62:0/4170303246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39400b180 con 0x7ff3ac0b5b20 2021-12-17T19:13:56.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3a37fe700 1 -- 172.21.15.62:0/4170303246 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff39c010c40 con 0x7ff3ac0b5b20 2021-12-17T19:13:56.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.527+0000 7ff3ab59e700 1 -- 172.21.15.62:0/4170303246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ac142ce0 con 0x7ff3ac0b5b20 2021-12-17T19:13:56.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.531+0000 7ff3ab59e700 1 -- 172.21.15.62:0/4170303246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3ac0573d0 con 0x7ff3ac0b5b20 2021-12-17T19:13:56.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.531+0000 7ff3a37fe700 1 -- 172.21.15.62:0/4170303246 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff39c01c460 con 0x7ff3ac0b5b20 2021-12-17T19:13:56.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.531+0000 7ff3a37fe700 1 --2- 172.21.15.62:0/4170303246 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff384053580 0x7ff384055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:56.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.531+0000 7ff3a37fe700 1 -- 172.21.15.62:0/4170303246 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7ff39c06bb30 con 0x7ff3ac0b5b20 2021-12-17T19:13:56.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.531+0000 7ff3a9d9b700 1 --2- 172.21.15.62:0/4170303246 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff384053580 0x7ff384055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:56.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.531+0000 7ff3a9d9b700 1 --2- 172.21.15.62:0/4170303246 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff384053580 0x7ff384055a40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7ff39401a000 tx=0x7ff394014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:56.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.535+0000 7ff3a37fe700 1 -- 172.21.15.62:0/4170303246 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff39c042d80 con 0x7ff3ac0b5b20 2021-12-17T19:13:56.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.663+0000 7ff3ab59e700 1 -- 172.21.15.62:0/4170303246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3ac142f60 con 0x7ff3ac0b5b20 2021-12-17T19:13:56.674 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.663+0000 7ff3a37fe700 1 -- 172.21.15.62:0/4170303246 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+13368 (secure 0 0 0) 0x7ff39c0463a0 con 0x7ff3ac0b5b20 2021-12-17T19:13:56.674 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T19:13:56.675 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":155,"fsid":"bd870ae2-2b3b-4717-8d94-b4a425d11882","created":"2021-12-17T18:18:02.762904+0000","modified":"2021-12-17T18:28:25.044583+0000","last_up_change":"2021-12-17T18:18:09.551618+0000","last_in_change":"2021-12-17T18:18:09.551618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-12-17T18:18:05.577519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-12-17T18:18:13.880759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c51e75ac-d8f3-4558-b672-587f12786690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14759},{"type":"v1","addr":"172.21.15.62:6801","nonce":14759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14759},{"type":"v1","addr":"172.21.15.62:6803","nonce":14759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14759},{"type":"v1","addr":"172.21.15.62:6807","nonce":14759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14759},{"type":"v1","addr":"172.21.15.62:6805","nonce":14759}]},"public_addr":"172.21.15.62:6801/14759","cluster_addr":"172.21.15.62:6803/14759","heartbeat_back_addr":"172.21.15.62:6807/14759","heartbeat_front_addr":"172.21.15.62:6805/14759","state":["exists","up"]},{"osd":1,"uuid":"886ecd5b-c84b-4b74-a0ac-52eb120d0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14763},{"type":"v1","addr":"172.21.15.62:6825","nonce":14763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14763},{"type":"v1","addr":"172.21.15.62:6827","nonce":14763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14763},{"type":"v1","addr":"172.21.15.62:6831","nonce":14763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14763},{"type":"v1","addr":"172.21.15.62:6829","nonce":14763}]},"public_addr":"172.21.15.62:6825/14763","cluster_addr":"172.21.15.62:6827/14763","heartbeat_back_addr":"172.21.15.62:6831/14763","heartbeat_front_addr":"172.21.15.62:6829/14763","state":["exists","up"]},{"osd":2,"uuid":"cdcbd8f0-be3e-4fff-8b63-62f30371135a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14760},{"type":"v1","addr":"172.21.15.62:6809","nonce":14760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14760},{"type":"v1","addr":"172.21.15.62:6811","nonce":14760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14760},{"type":"v1","addr":"172.21.15.62:6815","nonce":14760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14760},{"type":"v1","addr":"172.21.15.62:6813","nonce":14760}]},"public_addr":"172.21.15.62:6809/14760","cluster_addr":"172.21.15.62:6811/14760","heartbeat_back_addr":"172.21.15.62:6815/14760","heartbeat_front_addr":"172.21.15.62:6813/14760","state":["exists","up"]},{"osd":3,"uuid":"80f42567-d96d-4bb0-81d4-4030752e3935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":14762},{"type":"v1","addr":"172.21.15.62:6817","nonce":14762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14762},{"type":"v1","addr":"172.21.15.62:6819","nonce":14762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14762},{"type":"v1","addr":"172.21.15.62:6823","nonce":14762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":14762},{"type":"v1","addr":"172.21.15.62:6821","nonce":14762}]},"public_addr":"172.21.15.62:6817/14762","cluster_addr":"172.21.15.62:6819/14762","heartbeat_back_addr":"172.21.15.62:6823/14762","heartbeat_front_addr":"172.21.15.62:6821/14762","state":["exists","up"]},{"osd":4,"uuid":"02486a2c-1a65-460b-9d75-ed180962ba0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":15017},{"type":"v1","addr":"172.21.15.109:6811","nonce":15017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":15017},{"type":"v1","addr":"172.21.15.109:6813","nonce":15017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":15017},{"type":"v1","addr":"172.21.15.109:6817","nonce":15017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":15017},{"type":"v1","addr":"172.21.15.109:6815","nonce":15017}]},"public_addr":"172.21.15.109:6811/15017","cluster_addr":"172.21.15.109:6813/15017","heartbeat_back_addr":"172.21.15.109:6817/15017","heartbeat_front_addr":"172.21.15.109:6815/15017","state":["exists","up"]},{"osd":5,"uuid":"410bbb54-127f-4e2e-bc1c-373ce84935c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":15019},{"type":"v1","addr":"172.21.15.109:6803","nonce":15019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":15019},{"type":"v1","addr":"172.21.15.109:6805","nonce":15019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":15019},{"type":"v1","addr":"172.21.15.109:6809","nonce":15019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":15019},{"type":"v1","addr":"172.21.15.109:6807","nonce":15019}]},"public_addr":"172.21.15.109:6803/15019","cluster_addr":"172.21.15.109:6805/15019","heartbeat_back_addr":"172.21.15.109:6809/15019","heartbeat_front_addr":"172.21.15.109:6807/15019","state":["exists","up"]},{"osd":6,"uuid":"fb6d3de9-ddd2-4ffe-91ac-71e1ebd4cd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":15028},{"type":"v1","addr":"172.21.15.109:6827","nonce":15028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":15028},{"type":"v1","addr":"172.21.15.109:6829","nonce":15028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6832","nonce":15028},{"type":"v1","addr":"172.21.15.109:6833","nonce":15028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":15028},{"type":"v1","addr":"172.21.15.109:6831","nonce":15028}]},"public_addr":"172.21.15.109:6827/15028","cluster_addr":"172.21.15.109:6829/15028","heartbeat_back_addr":"172.21.15.109:6833/15028","heartbeat_front_addr":"172.21.15.109:6831/15028","state":["exists","up"]},{"osd":7,"uuid":"f47c0a1f-4b7b-439a-8a64-4e8086324870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":15018},{"type":"v1","addr":"172.21.15.109:6819","nonce":15018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":15018},{"type":"v1","addr":"172.21.15.109:6821","nonce":15018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6824","nonce":15018},{"type":"v1","addr":"172.21.15.109:6825","nonce":15018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":15018},{"type":"v1","addr":"172.21.15.109:6823","nonce":15018}]},"public_addr":"172.21.15.109:6819/15018","cluster_addr":"172.21.15.109:6821/15018","heartbeat_back_addr":"172.21.15.109:6825/15018","heartbeat_front_addr":"172.21.15.109:6823/15018","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.027604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.373149+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.281347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.276238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.263643+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.057914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.352672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-12-17T18:18:08.326472+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.62:6833/2348194620":"2021-12-18T18:28:21.027098+0000","172.21.15.62:6832/2348194620":"2021-12-18T18:28:21.027098+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-12-17T19:13:56.676 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.667+0000 7ff3ab59e700 1 -- 172.21.15.62:0/4170303246 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff384053580 msgr2=0x7ff384055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:56.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.667+0000 7ff3ab59e700 1 --2- 172.21.15.62:0/4170303246 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff384053580 0x7ff384055a40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7ff39401a000 tx=0x7ff394014000).stop 2021-12-17T19:13:56.677 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.667+0000 7ff3ab59e700 1 -- 172.21.15.62:0/4170303246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3ac0b5b20 msgr2=0x7ff3ac142520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:56.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.667+0000 7ff3ab59e700 1 --2- 172.21.15.62:0/4170303246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3ac0b5b20 0x7ff3ac142520 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7ff39c00c000 tx=0x7ff39c006df0).stop 2021-12-17T19:13:56.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.667+0000 7ff3ab59e700 1 -- 172.21.15.62:0/4170303246 shutdown_connections 2021-12-17T19:13:56.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.667+0000 7ff3ab59e700 1 --2- 172.21.15.62:0/4170303246 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7ff384053580 0x7ff384055a40 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.667+0000 7ff3ab59e700 1 --2- 172.21.15.62:0/4170303246 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7ff3ac144e50 0x7ff3ac13eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.667+0000 7ff3ab59e700 1 --2- 172.21.15.62:0/4170303246 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7ff3ac0b6c70 0x7ff3ac13e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.667+0000 7ff3ab59e700 1 --2- 172.21.15.62:0/4170303246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3ac0b5b20 0x7ff3ac142520 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.667+0000 7ff3ab59e700 1 -- 172.21.15.62:0/4170303246 >> 172.21.15.62:0/4170303246 conn(0x7ff3ac05c750 msgr2=0x7ff3ac1412a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.667+0000 7ff3ab59e700 1 -- 172.21.15.62:0/4170303246 shutdown_connections 2021-12-17T19:13:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:56.667+0000 7ff3ab59e700 1 -- 172.21.15.62:0/4170303246 wait complete. 2021-12-17T19:13:57.688 INFO:tasks.ceph:Scrubbing osd.0 2021-12-17T19:13:57.690 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2021-12-17T19:13:57.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.803+0000 7fa7e4cf3700 1 Processor -- start 2021-12-17T19:13:57.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.803+0000 7fa7e4cf3700 1 -- start start 2021-12-17T19:13:57.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.803+0000 7fa7e4cf3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa7e00b51a0 0x7fa7e01471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:57.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.803+0000 7fa7e4cf3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e00b09e0 con 0x7fa7e0142d70 2021-12-17T19:13:57.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.803+0000 7fa7e4cf3700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e01467d0 con 0x7fa7e00b4340 2021-12-17T19:13:57.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.803+0000 7fa7e4cf3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e0146a70 con 0x7fa7e00b51a0 2021-12-17T19:13:57.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.807+0000 7fa7ded9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa7e00b51a0 0x7fa7e01471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:57.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.807+0000 7fa7ddd9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa7e0142d70 0x7fa7e00b5a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41328/0 (socket says 172.21.15.62:41328) 2021-12-17T19:13:57.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.807+0000 7fa7ddd9b700 1 -- 172.21.15.62:0/1930245991 learned_addr learned my addr 172.21.15.62:0/1930245991 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T19:13:57.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.807+0000 7fa7ded9d700 1 -- 172.21.15.62:0/1930245991 >> v1:172.21.15.109:6789/0 conn(0x7fa7e00b4340 legacy=0x7fa7e0142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:57.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.807+0000 7fa7ded9d700 1 -- 172.21.15.62:0/1930245991 >> v1:172.21.15.62:6789/0 conn(0x7fa7e0142d70 legacy=0x7fa7e00b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:57.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.807+0000 7fa7ded9d700 1 -- 172.21.15.62:0/1930245991 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0146d10 con 0x7fa7e00b51a0 2021-12-17T19:13:57.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.807+0000 7fa7ded9d700 1 --2- 172.21.15.62:0/1930245991 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7e00b51a0 0x7fa7e01471b0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7fa7d80032f0 tx=0x7fa7d80091d0).ready entity=mon.0 client_cookie=70c0f9bbd795203f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:57.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.807+0000 7fa7dd59a700 1 -- 172.21.15.62:0/1930245991 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7d8009ea0 con 0x7fa7e00b51a0 2021-12-17T19:13:57.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.807+0000 7fa7dd59a700 1 -- 172.21.15.62:0/1930245991 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d800b8a0 con 0x7fa7e00b51a0 2021-12-17T19:13:57.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.807+0000 7fa7dd59a700 1 -- 172.21.15.62:0/1930245991 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7d800ba10 con 0x7fa7e00b51a0 2021-12-17T19:13:57.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.807+0000 7fa7e4cf3700 1 -- 172.21.15.62:0/1930245991 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7e00b51a0 msgr2=0x7fa7e01471b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.807+0000 7fa7e4cf3700 1 --2- 172.21.15.62:0/1930245991 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7e00b51a0 0x7fa7e01471b0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7fa7d80032f0 tx=0x7fa7d80091d0).stop 2021-12-17T19:13:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.807+0000 7fa7e4cf3700 1 -- 172.21.15.62:0/1930245991 shutdown_connections 2021-12-17T19:13:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.807+0000 7fa7e4cf3700 1 --2- 172.21.15.62:0/1930245991 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7e00b51a0 0x7fa7e01471b0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:57.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.807+0000 7fa7e4cf3700 1 -- 172.21.15.62:0/1930245991 >> 172.21.15.62:0/1930245991 conn(0x7fa7e005c750 msgr2=0x7fa7e005cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:57.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.807+0000 7fa7e4cf3700 1 -- 172.21.15.62:0/1930245991 shutdown_connections 2021-12-17T19:13:57.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.807+0000 7fa7e4cf3700 1 -- 172.21.15.62:0/1930245991 wait complete. 2021-12-17T19:13:57.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7e4cf3700 1 Processor -- start 2021-12-17T19:13:57.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7e4cf3700 1 -- start start 2021-12-17T19:13:57.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7e4cf3700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7e00b4340 0x7fa7e014a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:57.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7e4cf3700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa7e00b51a0 0x7fa7e0144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:57.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7e4cf3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7e0142d70 0x7fa7e0156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:57.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7e4cf3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e013fa00 con 0x7fa7e0142d70 2021-12-17T19:13:57.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7e4cf3700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e01559e0 con 0x7fa7e00b51a0 2021-12-17T19:13:57.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7e4cf3700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e0155c80 con 0x7fa7e00b4340 2021-12-17T19:13:57.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7ded9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7e0142d70 0x7fa7e0156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:57.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7de59c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7e00b4340 0x7fa7e014a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:57.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7ded9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7e0142d70 0x7fa7e0156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57756/0 (socket says 172.21.15.62:57756) 2021-12-17T19:13:57.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7ddd9b700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa7e00b51a0 0x7fa7e0144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:57.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7ded9d700 1 -- 172.21.15.62:0/3556209196 learned_addr learned my addr 172.21.15.62:0/3556209196 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:57.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7de59c700 1 -- 172.21.15.62:0/3556209196 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa7e00b51a0 msgr2=0x7fa7e0144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:57.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7de59c700 1 --2- 172.21.15.62:0/3556209196 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fa7e00b51a0 0x7fa7e0144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:57.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7de59c700 1 -- 172.21.15.62:0/3556209196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7e0142d70 msgr2=0x7fa7e0156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:57.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7de59c700 1 --2- 172.21.15.62:0/3556209196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7e0142d70 0x7fa7e0156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:57.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7de59c700 1 -- 172.21.15.62:0/3556209196 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d8009470 con 0x7fa7e00b4340 2021-12-17T19:13:57.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7ded9d700 1 --2- 172.21.15.62:0/3556209196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7e0142d70 0x7fa7e0156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T19:13:57.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7de59c700 1 --2- 172.21.15.62:0/3556209196 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7e00b4340 0x7fa7e014a460 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fa7e0061b00 tx=0x7fa7d0007b50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:57.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7d77fe700 1 -- 172.21.15.62:0/3556209196 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7d0007030 con 0x7fa7e00b4340 2021-12-17T19:13:57.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7d77fe700 1 -- 172.21.15.62:0/3556209196 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d0007190 con 0x7fa7e00b4340 2021-12-17T19:13:57.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7e4cf3700 1 -- 172.21.15.62:0/3556209196 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e013f680 con 0x7fa7e00b4340 2021-12-17T19:13:57.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7d77fe700 1 -- 172.21.15.62:0/3556209196 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7d0006510 con 0x7fa7e00b4340 2021-12-17T19:13:57.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.811+0000 7fa7e4cf3700 1 -- 172.21.15.62:0/3556209196 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e0156610 con 0x7fa7e00b4340 2021-12-17T19:13:57.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.815+0000 7fa7e4cf3700 1 -- 172.21.15.62:0/3556209196 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa7e01401e0 con 0x7fa7e00b4340 2021-12-17T19:13:57.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.815+0000 7fa7d77fe700 1 -- 172.21.15.62:0/3556209196 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa7d0010030 con 0x7fa7e00b4340 2021-12-17T19:13:57.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.815+0000 7fa7d77fe700 1 --2- 172.21.15.62:0/3556209196 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa7c4053610 0x7fa7c4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:57.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.815+0000 7fa7d77fe700 1 -- 172.21.15.62:0/3556209196 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fa7d006ba60 con 0x7fa7e00b4340 2021-12-17T19:13:57.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.815+0000 7fa7ddd9b700 1 --2- 172.21.15.62:0/3556209196 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa7c4053610 0x7fa7c4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:57.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.815+0000 7fa7d77fe700 1 --2- 172.21.15.62:0/3556209196 >> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] conn(0x7fa7c4059d90 0x7fa7c405c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:57.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.815+0000 7fa7d77fe700 1 -- 172.21.15.62:0/3556209196 --> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7c405c770 con 0x7fa7c4059d90 2021-12-17T19:13:57.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.815+0000 7fa7d77fe700 1 -- 172.21.15.62:0/3556209196 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_get_version_reply(handle=1 version=155) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7d006bdc0 con 0x7fa7e00b4340 2021-12-17T19:13:57.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.815+0000 7fa7ded9d700 1 --2- 172.21.15.62:0/3556209196 >> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] conn(0x7fa7c4059d90 0x7fa7c405c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:57.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.815+0000 7fa7ddd9b700 1 --2- 172.21.15.62:0/3556209196 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa7c4053610 0x7fa7c4055ad0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7fa7c800d000 tx=0x7fa7c8007be0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:57.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.815+0000 7fa7ded9d700 1 --2- 172.21.15.62:0/3556209196 >> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] conn(0x7fa7c4059d90 0x7fa7c405c1b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:57.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.819+0000 7fa7d77fe700 1 -- 172.21.15.62:0/3556209196 <== osd.0 v2:172.21.15.62:6800/14759 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fa7c405c770 con 0x7fa7c4059d90 2021-12-17T19:13:57.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.835+0000 7fa7e4cf3700 1 -- 172.21.15.62:0/3556209196 --> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa7e01568c0 con 0x7fa7c4059d90 2021-12-17T19:13:57.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.835+0000 7fa7d77fe700 1 -- 172.21.15.62:0/3556209196 <== osd.0 v2:172.21.15.62:6800/14759 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa7e01568c0 con 0x7fa7c4059d90 2021-12-17T19:13:57.846 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T19:13:57.846 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-12-17T19:13:57.846 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T19:13:57.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.835+0000 7fa7e4cf3700 1 -- 172.21.15.62:0/3556209196 >> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] conn(0x7fa7c4059d90 msgr2=0x7fa7c405c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:57.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.835+0000 7fa7e4cf3700 1 --2- 172.21.15.62:0/3556209196 >> [v2:172.21.15.62:6800/14759,v1:172.21.15.62:6801/14759] conn(0x7fa7c4059d90 0x7fa7c405c1b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:57.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.835+0000 7fa7e4cf3700 1 -- 172.21.15.62:0/3556209196 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa7c4053610 msgr2=0x7fa7c4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:57.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.835+0000 7fa7e4cf3700 1 --2- 172.21.15.62:0/3556209196 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fa7c4053610 0x7fa7c4055ad0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7fa7c800d000 tx=0x7fa7c8007be0).stop 2021-12-17T19:13:57.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.835+0000 7fa7e4cf3700 1 -- 172.21.15.62:0/3556209196 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7e00b4340 msgr2=0x7fa7e014a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.835+0000 7fa7e4cf3700 1 --2- 172.21.15.62:0/3556209196 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fa7e00b4340 0x7fa7e014a460 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fa7e0061b00 tx=0x7fa7d0007b50).stop 2021-12-17T19:13:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.835+0000 7fa7ded9d700 1 -- 172.21.15.62:0/3556209196 reap_dead start 2021-12-17T19:13:57.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.835+0000 7fa7e4cf3700 1 -- 172.21.15.62:0/3556209196 shutdown_connections 2021-12-17T19:13:57.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.835+0000 7fa7e4cf3700 1 -- 172.21.15.62:0/3556209196 >> 172.21.15.62:0/3556209196 conn(0x7fa7e005c750 msgr2=0x7fa7e00b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:57.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.835+0000 7fa7e4cf3700 1 -- 172.21.15.62:0/3556209196 shutdown_connections 2021-12-17T19:13:57.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.835+0000 7fa7e4cf3700 1 -- 172.21.15.62:0/3556209196 wait complete. 2021-12-17T19:13:57.858 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2021-12-17T19:13:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.963+0000 7fe121e70700 1 Processor -- start 2021-12-17T19:13:57.977 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.963+0000 7fe121e70700 1 -- start start 2021-12-17T19:13:57.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe121e70700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fe11c143780 0x7fe11c143b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:57.978 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe121e70700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe11c067120 0x7fe11c0675a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:57.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe121e70700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c0ad7f0 con 0x7fe11c067a90 2021-12-17T19:13:57.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe121e70700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c0ada90 con 0x7fe11c143780 2021-12-17T19:13:57.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe121e70700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0add30 con 0x7fe11c067120 2021-12-17T19:13:57.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe11affd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe11c067120 0x7fe11c0675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:57.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe11affd700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe11c067120 0x7fe11c0675a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:51466/0 (socket says 172.21.15.62:51466) 2021-12-17T19:13:57.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe11affd700 1 -- 172.21.15.62:0/891930868 learned_addr learned my addr 172.21.15.62:0/891930868 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:57.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe11b7fe700 1 --2- 172.21.15.62:0/891930868 >> v2:172.21.15.109:3300/0 conn(0x7fe11c143780 0x7fe11c143b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:57.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe11affd700 1 -- 172.21.15.62:0/891930868 >> v2:172.21.15.109:3300/0 conn(0x7fe11c143780 msgr2=0x7fe11c143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:13:57.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe11affd700 1 --2- 172.21.15.62:0/891930868 >> v2:172.21.15.109:3300/0 conn(0x7fe11c143780 0x7fe11c143b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:57.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe11affd700 1 -- 172.21.15.62:0/891930868 >> v1:172.21.15.109:6789/0 conn(0x7fe11c067a90 legacy=0x7fe11c140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:57.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe11affd700 1 -- 172.21.15.62:0/891930868 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c144050 con 0x7fe11c067120 2021-12-17T19:13:57.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe11affd700 1 --2- 172.21.15.62:0/891930868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe11c067120 0x7fe11c0675a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fe104002f70 tx=0x7fe104006eb0).ready entity=mon.2 client_cookie=7613d2efc6ad8abd server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:57.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe11a7fc700 1 -- 172.21.15.62:0/891930868 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe10400f970 con 0x7fe11c067120 2021-12-17T19:13:57.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe11a7fc700 1 -- 172.21.15.62:0/891930868 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe104000e90 con 0x7fe11c067120 2021-12-17T19:13:57.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe11a7fc700 1 -- 172.21.15.62:0/891930868 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe10400fd00 con 0x7fe11c067120 2021-12-17T19:13:57.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe121e70700 1 -- 172.21.15.62:0/891930868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe11c067120 msgr2=0x7fe11c0675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:57.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe121e70700 1 --2- 172.21.15.62:0/891930868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe11c067120 0x7fe11c0675a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fe104002f70 tx=0x7fe104006eb0).stop 2021-12-17T19:13:57.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe121e70700 1 -- 172.21.15.62:0/891930868 shutdown_connections 2021-12-17T19:13:57.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe121e70700 1 --2- 172.21.15.62:0/891930868 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe11c067120 0x7fe11c0675a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:57.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe121e70700 1 --2- 172.21.15.62:0/891930868 >> v2:172.21.15.109:3300/0 conn(0x7fe11c143780 0x7fe11c143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:57.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe121e70700 1 -- 172.21.15.62:0/891930868 >> 172.21.15.62:0/891930868 conn(0x7fe11c05f730 msgr2=0x7fe11c05fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:57.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe121e70700 1 -- 172.21.15.62:0/891930868 shutdown_connections 2021-12-17T19:13:57.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.967+0000 7fe121e70700 1 -- 172.21.15.62:0/891930868 wait complete. 2021-12-17T19:13:57.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.971+0000 7fe121e70700 1 Processor -- start 2021-12-17T19:13:57.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.971+0000 7fe121e70700 1 -- start start 2021-12-17T19:13:57.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.971+0000 7fe121e70700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe11c067120 0x7fe11c0b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:57.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.971+0000 7fe121e70700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe11c067a90 0x7fe11c0ab220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.971+0000 7fe121e70700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe11c143780 0x7fe11c137a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.971+0000 7fe121e70700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c13dec0 con 0x7fe11c067120 2021-12-17T19:13:57.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe121e70700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c140300 con 0x7fe11c143780 2021-12-17T19:13:57.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe121e70700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c1405a0 con 0x7fe11c067a90 2021-12-17T19:13:57.995 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe11b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe11c067120 0x7fe11c0b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:57.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe11b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe11c067120 0x7fe11c0b4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57768/0 (socket says 172.21.15.62:57768) 2021-12-17T19:13:57.996 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe11b7fe700 1 -- 172.21.15.62:0/718939802 learned_addr learned my addr 172.21.15.62:0/718939802 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:57.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe11affd700 1 --2- 172.21.15.62:0/718939802 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe11c067a90 0x7fe11c0ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:57.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe11bfff700 1 --2- 172.21.15.62:0/718939802 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe11c143780 0x7fe11c137a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:57.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe11b7fe700 1 -- 172.21.15.62:0/718939802 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe11c067a90 msgr2=0x7fe11c0ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:57.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe11b7fe700 1 --2- 172.21.15.62:0/718939802 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe11c067a90 0x7fe11c0ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:57.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe11b7fe700 1 -- 172.21.15.62:0/718939802 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe11c143780 msgr2=0x7fe11c137a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:57.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe11b7fe700 1 --2- 172.21.15.62:0/718939802 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe11c143780 0x7fe11c137a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:57.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe11b7fe700 1 -- 172.21.15.62:0/718939802 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10400b1e0 con 0x7fe11c067120 2021-12-17T19:13:57.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe11b7fe700 1 --2- 172.21.15.62:0/718939802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe11c067120 0x7fe11c0b4c50 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7fe10c00c000 tx=0x7fe10c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:58.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe118ff9700 1 -- 172.21.15.62:0/718939802 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe10c011750 con 0x7fe11c067120 2021-12-17T19:13:58.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe118ff9700 1 -- 172.21.15.62:0/718939802 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c0118b0 con 0x7fe11c067120 2021-12-17T19:13:58.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe121e70700 1 -- 172.21.15.62:0/718939802 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c0ac090 con 0x7fe11c067120 2021-12-17T19:13:58.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe118ff9700 1 -- 172.21.15.62:0/718939802 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe10c011c10 con 0x7fe11c067120 2021-12-17T19:13:58.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe121e70700 1 -- 172.21.15.62:0/718939802 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c13e2f0 con 0x7fe11c067120 2021-12-17T19:13:58.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe121e70700 1 -- 172.21.15.62:0/718939802 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11c13e030 con 0x7fe11c067120 2021-12-17T19:13:58.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.975+0000 7fe118ff9700 1 -- 172.21.15.62:0/718939802 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe10c011d70 con 0x7fe11c067120 2021-12-17T19:13:58.002 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.979+0000 7fe118ff9700 1 --2- 172.21.15.62:0/718939802 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe100053520 0x7fe1000559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.003 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.979+0000 7fe118ff9700 1 -- 172.21.15.62:0/718939802 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fe10c06ba20 con 0x7fe11c067120 2021-12-17T19:13:58.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.979+0000 7fe11affd700 1 --2- 172.21.15.62:0/718939802 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe100053520 0x7fe1000559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.004 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.979+0000 7fe11affd700 1 --2- 172.21.15.62:0/718939802 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe100053520 0x7fe1000559e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fe10401c000 tx=0x7fe104017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:58.005 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:57.983+0000 7fe118ff9700 1 -- 172.21.15.62:0/718939802 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe11c13e030 con 0x7fe11c067120 2021-12-17T19:13:58.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.115+0000 7fe121e70700 1 -- 172.21.15.62:0/718939802 --> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fe11c0a9270 con 0x7fe100053520 2021-12-17T19:13:58.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.115+0000 7fe118ff9700 1 -- 172.21.15.62:0/718939802 <== mgr.4103 v2:172.21.15.109:6800/14658 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe11c0a9270 con 0x7fe100053520 2021-12-17T19:13:58.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.119+0000 7fe121e70700 1 -- 172.21.15.62:0/718939802 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe100053520 msgr2=0x7fe1000559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.119+0000 7fe121e70700 1 --2- 172.21.15.62:0/718939802 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe100053520 0x7fe1000559e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fe10401c000 tx=0x7fe104017000).stop 2021-12-17T19:13:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.119+0000 7fe121e70700 1 -- 172.21.15.62:0/718939802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe11c067120 msgr2=0x7fe11c0b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.119+0000 7fe121e70700 1 --2- 172.21.15.62:0/718939802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe11c067120 0x7fe11c0b4c50 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7fe10c00c000 tx=0x7fe10c006df0).stop 2021-12-17T19:13:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.119+0000 7fe121e70700 1 -- 172.21.15.62:0/718939802 shutdown_connections 2021-12-17T19:13:58.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.119+0000 7fe121e70700 1 --2- 172.21.15.62:0/718939802 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fe100053520 0x7fe1000559e0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.119+0000 7fe121e70700 1 --2- 172.21.15.62:0/718939802 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fe11c143780 0x7fe11c137a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.119+0000 7fe121e70700 1 --2- 172.21.15.62:0/718939802 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fe11c067a90 0x7fe11c0ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.119+0000 7fe121e70700 1 --2- 172.21.15.62:0/718939802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe11c067120 0x7fe11c0b4c50 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.119+0000 7fe121e70700 1 -- 172.21.15.62:0/718939802 >> 172.21.15.62:0/718939802 conn(0x7fe11c05f730 msgr2=0x7fe11c1427d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:58.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.119+0000 7fe121e70700 1 -- 172.21.15.62:0/718939802 shutdown_connections 2021-12-17T19:13:58.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.119+0000 7fe121e70700 1 -- 172.21.15.62:0/718939802 wait complete. 2021-12-17T19:13:58.131 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 0 to deep-scrub 2021-12-17T19:13:58.138 INFO:tasks.ceph:Scrubbing osd.1 2021-12-17T19:13:58.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2021-12-17T19:13:58.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.239+0000 7f17b6f72700 1 Processor -- start 2021-12-17T19:13:58.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.239+0000 7f17b6f72700 1 -- start start 2021-12-17T19:13:58.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.239+0000 7f17b6f72700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17b00b34b0 0x7f17b00b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.239+0000 7f17b6f72700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f17b00604b0 0x7f17b0146230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.239+0000 7f17b6f72700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b005ce70 con 0x7f17b005ca90 2021-12-17T19:13:58.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.239+0000 7f17b6f72700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b00b2d70 con 0x7f17b00604b0 2021-12-17T19:13:58.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.239+0000 7f17b6f72700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00b3010 con 0x7f17b00b34b0 2021-12-17T19:13:58.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.239+0000 7f17b6771700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f17b00604b0 0x7f17b0146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.239+0000 7f17b6771700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f17b00604b0 0x7f17b0146230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57780/0 (socket says 172.21.15.62:57780) 2021-12-17T19:13:58.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.239+0000 7f17b5f70700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f17b005ca90 0x7f17b0145b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41356/0 (socket says 172.21.15.62:41356) 2021-12-17T19:13:58.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.239+0000 7f17b6771700 1 -- 172.21.15.62:0/1881202512 learned_addr learned my addr 172.21.15.62:0/1881202512 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:58.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.239+0000 7f17b576f700 1 --2- 172.21.15.62:0/1881202512 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17b00b34b0 0x7f17b00b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.239+0000 7f17b6771700 1 -- 172.21.15.62:0/1881202512 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17b00b34b0 msgr2=0x7f17b00b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:13:58.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.239+0000 7f17b6771700 1 --2- 172.21.15.62:0/1881202512 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17b00b34b0 0x7f17b00b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.239+0000 7f17b6771700 1 -- 172.21.15.62:0/1881202512 >> v1:172.21.15.62:6789/0 conn(0x7f17b005ca90 legacy=0x7f17b0145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.243+0000 7f17b4f6e700 1 -- 172.21.15.62:0/1881202512 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167117438 0 0) 0x7f17b005ce70 con 0x7f17b005ca90 2021-12-17T19:13:58.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.243+0000 7f17b6771700 1 -- 172.21.15.62:0/1881202512 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b00b2ab0 con 0x7f17b00604b0 2021-12-17T19:13:58.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.243+0000 7f17b6771700 1 --2- 172.21.15.62:0/1881202512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17b00604b0 0x7f17b0146230 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7f17a80032f0 tx=0x7f17a8009290).ready entity=mon.0 client_cookie=6b24cfdbcf031e18 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:58.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.243+0000 7f17b4f6e700 1 -- 172.21.15.62:0/1881202512 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17a800b8a0 con 0x7f17b00604b0 2021-12-17T19:13:58.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.243+0000 7f17b4f6e700 1 -- 172.21.15.62:0/1881202512 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a800ba00 con 0x7f17b00604b0 2021-12-17T19:13:58.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.243+0000 7f17b4f6e700 1 -- 172.21.15.62:0/1881202512 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17a800bb70 con 0x7f17b00604b0 2021-12-17T19:13:58.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.243+0000 7f17b6f72700 1 -- 172.21.15.62:0/1881202512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17b00604b0 msgr2=0x7f17b0146230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.243+0000 7f17b6f72700 1 --2- 172.21.15.62:0/1881202512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17b00604b0 0x7f17b0146230 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7f17a80032f0 tx=0x7f17a8009290).stop 2021-12-17T19:13:58.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.243+0000 7f17b6f72700 1 -- 172.21.15.62:0/1881202512 shutdown_connections 2021-12-17T19:13:58.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.243+0000 7f17b6f72700 1 --2- 172.21.15.62:0/1881202512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17b00604b0 0x7f17b0146230 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.243+0000 7f17b6f72700 1 --2- 172.21.15.62:0/1881202512 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17b00b34b0 0x7f17b00b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.243+0000 7f17b6f72700 1 -- 172.21.15.62:0/1881202512 >> 172.21.15.62:0/1881202512 conn(0x7f17b005bcd0 msgr2=0x7f17b0062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:58.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.243+0000 7f17b6f72700 1 -- 172.21.15.62:0/1881202512 shutdown_connections 2021-12-17T19:13:58.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.243+0000 7f17b6f72700 1 -- 172.21.15.62:0/1881202512 wait complete. 2021-12-17T19:13:58.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.243+0000 7f17b6f72700 1 Processor -- start 2021-12-17T19:13:58.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.243+0000 7f17b6f72700 1 -- start start 2021-12-17T19:13:58.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b6f72700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17b005ca90 0x7f17b00a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b6f72700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17b00604b0 0x7f17b0066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b6f72700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17b00b34b0 0x7f17b0141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b6f72700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00a32f0 con 0x7f17b00604b0 2021-12-17T19:13:58.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b6f72700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00a3090 con 0x7f17b00b34b0 2021-12-17T19:13:58.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b6f72700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00a5fb0 con 0x7f17b005ca90 2021-12-17T19:13:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b576f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17b00604b0 0x7f17b0066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b576f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17b00604b0 0x7f17b0066cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57784/0 (socket says 172.21.15.62:57784) 2021-12-17T19:13:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b576f700 1 -- 172.21.15.62:0/3565325214 learned_addr learned my addr 172.21.15.62:0/3565325214 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:58.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b6771700 1 --2- 172.21.15.62:0/3565325214 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17b00b34b0 0x7f17b0141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b5f70700 1 --2- 172.21.15.62:0/3565325214 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17b005ca90 0x7f17b00a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b576f700 1 -- 172.21.15.62:0/3565325214 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17b005ca90 msgr2=0x7f17b00a39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b576f700 1 --2- 172.21.15.62:0/3565325214 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f17b005ca90 0x7f17b00a39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b576f700 1 -- 172.21.15.62:0/3565325214 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17b00b34b0 msgr2=0x7f17b0141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b576f700 1 --2- 172.21.15.62:0/3565325214 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f17b00b34b0 0x7f17b0141e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b576f700 1 -- 172.21.15.62:0/3565325214 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a8009530 con 0x7f17b00604b0 2021-12-17T19:13:58.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b576f700 1 --2- 172.21.15.62:0/3565325214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17b00604b0 0x7f17b0066cf0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f17ac00c000 tx=0x7f17ac006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:58.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f179effd700 1 -- 172.21.15.62:0/3565325214 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17ac010780 con 0x7f17b00604b0 2021-12-17T19:13:58.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f179effd700 1 -- 172.21.15.62:0/3565325214 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ac0108e0 con 0x7f17b00604b0 2021-12-17T19:13:58.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b6f72700 1 -- 172.21.15.62:0/3565325214 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b00671e0 con 0x7f17b00604b0 2021-12-17T19:13:58.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f179effd700 1 -- 172.21.15.62:0/3565325214 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17ac010c40 con 0x7f17b00604b0 2021-12-17T19:13:58.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b6f72700 1 -- 172.21.15.62:0/3565325214 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b00affd0 con 0x7f17b00604b0 2021-12-17T19:13:58.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f17b6f72700 1 -- 172.21.15.62:0/3565325214 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f17b00b0220 con 0x7f17b00604b0 2021-12-17T19:13:58.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f179effd700 1 -- 172.21.15.62:0/3565325214 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f17ac026430 con 0x7f17b00604b0 2021-12-17T19:13:58.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.247+0000 7f179effd700 1 --2- 172.21.15.62:0/3565325214 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f17900536a0 0x7f1790055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.251+0000 7f179effd700 1 -- 172.21.15.62:0/3565325214 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f17ac06c4d0 con 0x7f17b00604b0 2021-12-17T19:13:58.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.251+0000 7f179effd700 1 --2- 172.21.15.62:0/3565325214 >> [v2:172.21.15.62:6824/14763,v1:172.21.15.62:6825/14763] conn(0x7f1790059e20 0x7f179005c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.251+0000 7f179effd700 1 -- 172.21.15.62:0/3565325214 --> [v2:172.21.15.62:6824/14763,v1:172.21.15.62:6825/14763] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f179005c800 con 0x7f1790059e20 2021-12-17T19:13:58.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.251+0000 7f179effd700 1 -- 172.21.15.62:0/3565325214 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=155) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17ac06c8b0 con 0x7f17b00604b0 2021-12-17T19:13:58.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.251+0000 7f17b5f70700 1 --2- 172.21.15.62:0/3565325214 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f17900536a0 0x7f1790055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.251+0000 7f17b6771700 1 --2- 172.21.15.62:0/3565325214 >> [v2:172.21.15.62:6824/14763,v1:172.21.15.62:6825/14763] conn(0x7f1790059e20 0x7f179005c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.251+0000 7f17b6771700 1 --2- 172.21.15.62:0/3565325214 >> [v2:172.21.15.62:6824/14763,v1:172.21.15.62:6825/14763] conn(0x7f1790059e20 0x7f179005c240 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:58.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.251+0000 7f17b5f70700 1 --2- 172.21.15.62:0/3565325214 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f17900536a0 0x7f1790055b60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f17a000b000 tx=0x7f17a0007160).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:58.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.251+0000 7f179effd700 1 -- 172.21.15.62:0/3565325214 <== osd.1 v2:172.21.15.62:6824/14763 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f179005c800 con 0x7f1790059e20 2021-12-17T19:13:58.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.267+0000 7f17b6f72700 1 -- 172.21.15.62:0/3565325214 --> [v2:172.21.15.62:6824/14763,v1:172.21.15.62:6825/14763] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f17b0143290 con 0x7f1790059e20 2021-12-17T19:13:58.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.271+0000 7f179effd700 1 -- 172.21.15.62:0/3565325214 <== osd.1 v2:172.21.15.62:6824/14763 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f17b0143290 con 0x7f1790059e20 2021-12-17T19:13:58.281 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T19:13:58.281 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-12-17T19:13:58.282 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T19:13:58.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.271+0000 7f17b6f72700 1 -- 172.21.15.62:0/3565325214 >> [v2:172.21.15.62:6824/14763,v1:172.21.15.62:6825/14763] conn(0x7f1790059e20 msgr2=0x7f179005c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.271+0000 7f17b6f72700 1 --2- 172.21.15.62:0/3565325214 >> [v2:172.21.15.62:6824/14763,v1:172.21.15.62:6825/14763] conn(0x7f1790059e20 0x7f179005c240 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.271+0000 7f17b6f72700 1 -- 172.21.15.62:0/3565325214 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f17900536a0 msgr2=0x7f1790055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.271+0000 7f17b6f72700 1 --2- 172.21.15.62:0/3565325214 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f17900536a0 0x7f1790055b60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f17a000b000 tx=0x7f17a0007160).stop 2021-12-17T19:13:58.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.271+0000 7f17b6f72700 1 -- 172.21.15.62:0/3565325214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17b00604b0 msgr2=0x7f17b0066cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.271+0000 7f17b6f72700 1 --2- 172.21.15.62:0/3565325214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17b00604b0 0x7f17b0066cf0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f17ac00c000 tx=0x7f17ac006df0).stop 2021-12-17T19:13:58.285 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.271+0000 7f17b6771700 1 -- 172.21.15.62:0/3565325214 reap_dead start 2021-12-17T19:13:58.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.271+0000 7f17b6f72700 1 -- 172.21.15.62:0/3565325214 shutdown_connections 2021-12-17T19:13:58.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.271+0000 7f17b6f72700 1 -- 172.21.15.62:0/3565325214 >> 172.21.15.62:0/3565325214 conn(0x7f17b005bcd0 msgr2=0x7f17b00b6760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:58.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.271+0000 7f17b6f72700 1 -- 172.21.15.62:0/3565325214 shutdown_connections 2021-12-17T19:13:58.286 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.271+0000 7f17b6f72700 1 -- 172.21.15.62:0/3565325214 wait complete. 2021-12-17T19:13:58.290 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2021-12-17T19:13:58.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.391+0000 7f829495f700 1 Processor -- start 2021-12-17T19:13:58.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.391+0000 7f829495f700 1 -- start start 2021-12-17T19:13:58.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.391+0000 7f829495f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f829013ce80 0x7f8290142f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.391+0000 7f829495f700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f82901433f0 0x7f8290143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.391+0000 7f829495f700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8290146e30 con 0x7f8290062620 2021-12-17T19:13:58.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.391+0000 7f829495f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8290143d00 con 0x7f829013ce80 2021-12-17T19:13:58.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.391+0000 7f829495f700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8290062a00 con 0x7f82901433f0 2021-12-17T19:13:58.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.391+0000 7f828659c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f829013ce80 0x7f8290142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.391+0000 7f828659c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f829013ce80 0x7f8290142f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57794/0 (socket says 172.21.15.62:57794) 2021-12-17T19:13:58.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.391+0000 7f828659c700 1 -- 172.21.15.62:0/1602933945 learned_addr learned my addr 172.21.15.62:0/1602933945 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:58.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.391+0000 7f828f59e700 1 --2- 172.21.15.62:0/1602933945 >> v2:172.21.15.109:3300/0 conn(0x7f82901433f0 0x7f8290143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.395+0000 7f828659c700 1 -- 172.21.15.62:0/1602933945 >> v2:172.21.15.109:3300/0 conn(0x7f82901433f0 msgr2=0x7f8290143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:13:58.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.395+0000 7f828659c700 1 --2- 172.21.15.62:0/1602933945 >> v2:172.21.15.109:3300/0 conn(0x7f82901433f0 0x7f8290143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.395+0000 7f828659c700 1 -- 172.21.15.62:0/1602933945 >> v1:172.21.15.109:6789/0 conn(0x7f8290062620 legacy=0x7f829013c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.395+0000 7f828659c700 1 -- 172.21.15.62:0/1602933945 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82900b59e0 con 0x7f829013ce80 2021-12-17T19:13:58.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.395+0000 7f828f59e700 1 --2- 172.21.15.62:0/1602933945 >> v2:172.21.15.109:3300/0 conn(0x7f82901433f0 0x7f8290143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T19:13:58.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.395+0000 7f828659c700 1 --2- 172.21.15.62:0/1602933945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f829013ce80 0x7f8290142f00 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f8278002f70 tx=0x7f8278006eb0).ready entity=mon.0 client_cookie=b2ec2d1d135da61a server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:58.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.395+0000 7f828e59c700 1 -- 172.21.15.62:0/1602933945 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f827800d5c0 con 0x7f829013ce80 2021-12-17T19:13:58.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.395+0000 7f828e59c700 1 -- 172.21.15.62:0/1602933945 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8278000e90 con 0x7f829013ce80 2021-12-17T19:13:58.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.395+0000 7f828e59c700 1 -- 172.21.15.62:0/1602933945 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f827800d950 con 0x7f829013ce80 2021-12-17T19:13:58.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.395+0000 7f829495f700 1 -- 172.21.15.62:0/1602933945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f829013ce80 msgr2=0x7f8290142f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.395+0000 7f829495f700 1 --2- 172.21.15.62:0/1602933945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f829013ce80 0x7f8290142f00 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f8278002f70 tx=0x7f8278006eb0).stop 2021-12-17T19:13:58.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.395+0000 7f829495f700 1 -- 172.21.15.62:0/1602933945 shutdown_connections 2021-12-17T19:13:58.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.395+0000 7f829495f700 1 --2- 172.21.15.62:0/1602933945 >> v2:172.21.15.109:3300/0 conn(0x7f82901433f0 0x7f8290143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.395+0000 7f829495f700 1 --2- 172.21.15.62:0/1602933945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f829013ce80 0x7f8290142f00 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.395+0000 7f829495f700 1 -- 172.21.15.62:0/1602933945 >> 172.21.15.62:0/1602933945 conn(0x7f829005c750 msgr2=0x7f829005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:58.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.395+0000 7f829495f700 1 -- 172.21.15.62:0/1602933945 shutdown_connections 2021-12-17T19:13:58.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.395+0000 7f829495f700 1 -- 172.21.15.62:0/1602933945 wait complete. 2021-12-17T19:13:58.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f829495f700 1 Processor -- start 2021-12-17T19:13:58.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f829495f700 1 -- start start 2021-12-17T19:13:58.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f829495f700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8290062620 0x7f8290145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f829495f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f829013ce80 0x7f829013ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.417 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f829495f700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82901433f0 0x7f8290064b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f829495f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829013fc50 con 0x7f829013ce80 2021-12-17T19:13:58.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f829495f700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829013fef0 con 0x7f8290062620 2021-12-17T19:13:58.418 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f829495f700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8290140190 con 0x7f82901433f0 2021-12-17T19:13:58.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f828659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f829013ce80 0x7f829013ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f828659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f829013ce80 0x7f829013ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57798/0 (socket says 172.21.15.62:57798) 2021-12-17T19:13:58.419 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f828659c700 1 -- 172.21.15.62:0/3607436274 learned_addr learned my addr 172.21.15.62:0/3607436274 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:58.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f828f59e700 1 --2- 172.21.15.62:0/3607436274 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82901433f0 0x7f8290064b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f828ed9d700 1 --2- 172.21.15.62:0/3607436274 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8290062620 0x7f8290145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.420 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f828659c700 1 -- 172.21.15.62:0/3607436274 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82901433f0 msgr2=0x7f8290064b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f828659c700 1 --2- 172.21.15.62:0/3607436274 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82901433f0 0x7f8290064b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f828659c700 1 -- 172.21.15.62:0/3607436274 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8290062620 msgr2=0x7f8290145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.421 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f828659c700 1 --2- 172.21.15.62:0/3607436274 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8290062620 0x7f8290145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f828659c700 1 -- 172.21.15.62:0/3607436274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8288009470 con 0x7f829013ce80 2021-12-17T19:13:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f828659c700 1 --2- 172.21.15.62:0/3607436274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f829013ce80 0x7f829013ee10 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7f8278002f70 tx=0x7f8278015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f828cd99700 1 -- 172.21.15.62:0/3607436274 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8278011860 con 0x7f829013ce80 2021-12-17T19:13:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f828cd99700 1 -- 172.21.15.62:0/3607436274 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82780119c0 con 0x7f829013ce80 2021-12-17T19:13:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f829495f700 1 -- 172.21.15.62:0/3607436274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827800b1e0 con 0x7f829013ce80 2021-12-17T19:13:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f828cd99700 1 -- 172.21.15.62:0/3607436274 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8278011d20 con 0x7f829013ce80 2021-12-17T19:13:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.399+0000 7f829495f700 1 -- 172.21.15.62:0/3607436274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8290063650 con 0x7f829013ce80 2021-12-17T19:13:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.403+0000 7f829495f700 1 -- 172.21.15.62:0/3607436274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8290140350 con 0x7f829013ce80 2021-12-17T19:13:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.403+0000 7f828cd99700 1 -- 172.21.15.62:0/3607436274 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8278025030 con 0x7f829013ce80 2021-12-17T19:13:58.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.403+0000 7f828cd99700 1 --2- 172.21.15.62:0/3607436274 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8274053640 0x7f8274055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.403+0000 7f828cd99700 1 -- 172.21.15.62:0/3607436274 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f827806c8b0 con 0x7f829013ce80 2021-12-17T19:13:58.425 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.403+0000 7f828ed9d700 1 --2- 172.21.15.62:0/3607436274 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8274053640 0x7f8274055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.403+0000 7f828ed9d700 1 --2- 172.21.15.62:0/3607436274 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8274053640 0x7f8274055b00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f828000b000 tx=0x7f8280009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:58.426 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.411+0000 7f828cd99700 1 -- 172.21.15.62:0/3607436274 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8278043cf0 con 0x7f829013ce80 2021-12-17T19:13:58.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.543+0000 7f829495f700 1 -- 172.21.15.62:0/3607436274 --> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f82900573d0 con 0x7f8274053640 2021-12-17T19:13:58.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.543+0000 7f828cd99700 1 -- 172.21.15.62:0/3607436274 <== mgr.4103 v2:172.21.15.109:6800/14658 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f82900573d0 con 0x7f8274053640 2021-12-17T19:13:58.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.547+0000 7f829495f700 1 -- 172.21.15.62:0/3607436274 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8274053640 msgr2=0x7f8274055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.547+0000 7f829495f700 1 --2- 172.21.15.62:0/3607436274 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8274053640 0x7f8274055b00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f828000b000 tx=0x7f8280009040).stop 2021-12-17T19:13:58.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.547+0000 7f829495f700 1 -- 172.21.15.62:0/3607436274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f829013ce80 msgr2=0x7f829013ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.547+0000 7f829495f700 1 --2- 172.21.15.62:0/3607436274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f829013ce80 0x7f829013ee10 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7f8278002f70 tx=0x7f8278015000).stop 2021-12-17T19:13:58.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.547+0000 7f829495f700 1 -- 172.21.15.62:0/3607436274 shutdown_connections 2021-12-17T19:13:58.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.547+0000 7f829495f700 1 --2- 172.21.15.62:0/3607436274 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8274053640 0x7f8274055b00 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.547+0000 7f829495f700 1 --2- 172.21.15.62:0/3607436274 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f82901433f0 0x7f8290064b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.547+0000 7f829495f700 1 --2- 172.21.15.62:0/3607436274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f829013ce80 0x7f829013ee10 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.547+0000 7f829495f700 1 --2- 172.21.15.62:0/3607436274 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8290062620 0x7f8290145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.547+0000 7f829495f700 1 -- 172.21.15.62:0/3607436274 >> 172.21.15.62:0/3607436274 conn(0x7f829005c750 msgr2=0x7f82900b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:58.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.547+0000 7f829495f700 1 -- 172.21.15.62:0/3607436274 shutdown_connections 2021-12-17T19:13:58.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.547+0000 7f829495f700 1 -- 172.21.15.62:0/3607436274 wait complete. 2021-12-17T19:13:58.561 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 1 to deep-scrub 2021-12-17T19:13:58.571 INFO:tasks.ceph:Scrubbing osd.2 2021-12-17T19:13:58.571 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2021-12-17T19:13:58.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.671+0000 7f8bfdc44700 1 Processor -- start 2021-12-17T19:13:58.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.671+0000 7f8bfdc44700 1 -- start start 2021-12-17T19:13:58.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfdc44700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8bf805fa70 0x7f8bf8142c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfdc44700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf80b6600 con 0x7f8bf8143830 2021-12-17T19:13:58.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfdc44700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf805fe50 con 0x7f8bf80ad130 2021-12-17T19:13:58.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfdc44700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf80adba0 con 0x7f8bf805fa70 2021-12-17T19:13:58.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfd443700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8bf8143830 0x7f8bf813fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41390/0 (socket says 172.21.15.62:41390) 2021-12-17T19:13:58.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfd443700 1 -- 172.21.15.62:0/1508984131 learned_addr learned my addr 172.21.15.62:0/1508984131 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T19:13:58.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfcc42700 1 --2- 172.21.15.62:0/1508984131 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8bf805fa70 0x7f8bf8142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bf77fe700 1 -- 172.21.15.62:0/1508984131 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876298987 0 0) 0x7f8bf80b6600 con 0x7f8bf8143830 2021-12-17T19:13:58.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bf77fe700 1 -- 172.21.15.62:0/1508984131 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bdc003260 con 0x7f8bf8143830 2021-12-17T19:13:58.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bf77fe700 1 -- 172.21.15.62:0/1508984131 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520679706 0 0) 0x7f8bf805fe50 con 0x7f8bf80ad130 2021-12-17T19:13:58.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bf77fe700 1 -- 172.21.15.62:0/1508984131 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bf80b6600 con 0x7f8bf80ad130 2021-12-17T19:13:58.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfcc42700 1 -- 172.21.15.62:0/1508984131 >> v1:172.21.15.109:6789/0 conn(0x7f8bf80ad130 legacy=0x7f8bf8143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfcc42700 1 -- 172.21.15.62:0/1508984131 >> v1:172.21.15.62:6789/0 conn(0x7f8bf8143830 legacy=0x7f8bf813fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bf77fe700 1 -- 172.21.15.62:0/1508984131 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1158647414 0 0) 0x7f8bdc003260 con 0x7f8bf8143830 2021-12-17T19:13:58.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfcc42700 1 -- 172.21.15.62:0/1508984131 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf80b6830 con 0x7f8bf805fa70 2021-12-17T19:13:58.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfcc42700 1 --2- 172.21.15.62:0/1508984131 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8bf805fa70 0x7f8bf8142c30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f8bf0001490 tx=0x7f8bec006e80).ready entity=mon.2 client_cookie=79900897d80cdb1 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:58.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bf77fe700 1 -- 172.21.15.62:0/1508984131 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bec014070 con 0x7f8bf805fa70 2021-12-17T19:13:58.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bf77fe700 1 -- 172.21.15.62:0/1508984131 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bec000e90 con 0x7f8bf805fa70 2021-12-17T19:13:58.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bf77fe700 1 -- 172.21.15.62:0/1508984131 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bf00019e0 con 0x7f8bf805fa70 2021-12-17T19:13:58.696 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfdc44700 1 -- 172.21.15.62:0/1508984131 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8bf805fa70 msgr2=0x7f8bf8142c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfdc44700 1 --2- 172.21.15.62:0/1508984131 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8bf805fa70 0x7f8bf8142c30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f8bf0001490 tx=0x7f8bec006e80).stop 2021-12-17T19:13:58.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfdc44700 1 -- 172.21.15.62:0/1508984131 shutdown_connections 2021-12-17T19:13:58.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfdc44700 1 --2- 172.21.15.62:0/1508984131 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8bf805fa70 0x7f8bf8142c30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfdc44700 1 -- 172.21.15.62:0/1508984131 >> 172.21.15.62:0/1508984131 conn(0x7f8bf80b5ae0 msgr2=0x7f8bf80b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:58.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfdc44700 1 -- 172.21.15.62:0/1508984131 shutdown_connections 2021-12-17T19:13:58.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.675+0000 7f8bfdc44700 1 -- 172.21.15.62:0/1508984131 wait complete. 2021-12-17T19:13:58.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bfdc44700 1 Processor -- start 2021-12-17T19:13:58.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bfdc44700 1 -- start start 2021-12-17T19:13:58.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bfdc44700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8bf805fa70 0x7f8bf80b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bfdc44700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8bf80ad130 0x7f8bf8142a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bfdc44700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8bf8143830 0x7f8bf81368c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bfdc44700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf8149730 con 0x7f8bf80ad130 2021-12-17T19:13:58.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bfdc44700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf813cfc0 con 0x7f8bf805fa70 2021-12-17T19:13:58.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bfdc44700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf8156680 con 0x7f8bf8143830 2021-12-17T19:13:58.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bf7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8bf80ad130 0x7f8bf8142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bf7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8bf80ad130 0x7f8bf8142a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57814/0 (socket says 172.21.15.62:57814) 2021-12-17T19:13:58.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bf7fff700 1 -- 172.21.15.62:0/2485427566 learned_addr learned my addr 172.21.15.62:0/2485427566 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:58.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bfcc42700 1 --2- 172.21.15.62:0/2485427566 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8bf805fa70 0x7f8bf80b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bfd443700 1 --2- 172.21.15.62:0/2485427566 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8bf8143830 0x7f8bf81368c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bf7fff700 1 -- 172.21.15.62:0/2485427566 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8bf8143830 msgr2=0x7f8bf81368c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bf7fff700 1 --2- 172.21.15.62:0/2485427566 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8bf8143830 0x7f8bf81368c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bf7fff700 1 -- 172.21.15.62:0/2485427566 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8bf805fa70 msgr2=0x7f8bf80b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bf7fff700 1 --2- 172.21.15.62:0/2485427566 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8bf805fa70 0x7f8bf80b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bf7fff700 1 -- 172.21.15.62:0/2485427566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec00c310 con 0x7f8bf80ad130 2021-12-17T19:13:58.705 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bfd443700 1 --2- 172.21.15.62:0/2485427566 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8bf8143830 0x7f8bf81368c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T19:13:58.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bf7fff700 1 --2- 172.21.15.62:0/2485427566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8bf80ad130 0x7f8bf8142a00 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f8be4001110 tx=0x7f8be4007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:58.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bf5ffb700 1 -- 172.21.15.62:0/2485427566 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8be4012400 con 0x7f8bf80ad130 2021-12-17T19:13:58.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bf5ffb700 1 -- 172.21.15.62:0/2485427566 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be4012560 con 0x7f8bf80ad130 2021-12-17T19:13:58.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bf5ffb700 1 -- 172.21.15.62:0/2485427566 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8be40128c0 con 0x7f8bf80ad130 2021-12-17T19:13:58.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bfdc44700 1 -- 172.21.15.62:0/2485427566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf8156920 con 0x7f8bf80ad130 2021-12-17T19:13:58.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.679+0000 7f8bfdc44700 1 -- 172.21.15.62:0/2485427566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf8143090 con 0x7f8bf80ad130 2021-12-17T19:13:58.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.683+0000 7f8bfdc44700 1 -- 172.21.15.62:0/2485427566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8bf8156500 con 0x7f8bf80ad130 2021-12-17T19:13:58.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.683+0000 7f8bf5ffb700 1 -- 172.21.15.62:0/2485427566 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8be4019030 con 0x7f8bf80ad130 2021-12-17T19:13:58.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.683+0000 7f8bf5ffb700 1 --2- 172.21.15.62:0/2485427566 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8bd8053640 0x7f8bd8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.683+0000 7f8bf5ffb700 1 -- 172.21.15.62:0/2485427566 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f8be406aa80 con 0x7f8bf80ad130 2021-12-17T19:13:58.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.683+0000 7f8bf5ffb700 1 --2- 172.21.15.62:0/2485427566 >> [v2:172.21.15.62:6808/14760,v1:172.21.15.62:6809/14760] conn(0x7f8bd8059dc0 0x7f8bd805c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.683+0000 7f8bf5ffb700 1 -- 172.21.15.62:0/2485427566 --> [v2:172.21.15.62:6808/14760,v1:172.21.15.62:6809/14760] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8bd805c7a0 con 0x7f8bd8059dc0 2021-12-17T19:13:58.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.683+0000 7f8bf5ffb700 1 -- 172.21.15.62:0/2485427566 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=155) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8be406f240 con 0x7f8bf80ad130 2021-12-17T19:13:58.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.683+0000 7f8bfcc42700 1 --2- 172.21.15.62:0/2485427566 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8bd8053640 0x7f8bd8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.683+0000 7f8bfd443700 1 --2- 172.21.15.62:0/2485427566 >> [v2:172.21.15.62:6808/14760,v1:172.21.15.62:6809/14760] conn(0x7f8bd8059dc0 0x7f8bd805c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.683+0000 7f8bfd443700 1 --2- 172.21.15.62:0/2485427566 >> [v2:172.21.15.62:6808/14760,v1:172.21.15.62:6809/14760] conn(0x7f8bd8059dc0 0x7f8bd805c1e0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:58.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.683+0000 7f8bfcc42700 1 --2- 172.21.15.62:0/2485427566 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8bd8053640 0x7f8bd8055b00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f8bec01a000 tx=0x7f8bf806a0a0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:58.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.683+0000 7f8bf5ffb700 1 -- 172.21.15.62:0/2485427566 <== osd.2 v2:172.21.15.62:6808/14760 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f8bd805c7a0 con 0x7f8bd8059dc0 2021-12-17T19:13:58.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.703+0000 7f8bfdc44700 1 -- 172.21.15.62:0/2485427566 --> [v2:172.21.15.62:6808/14760,v1:172.21.15.62:6809/14760] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8bf8137050 con 0x7f8bd8059dc0 2021-12-17T19:13:58.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.703+0000 7f8bf5ffb700 1 -- 172.21.15.62:0/2485427566 <== osd.2 v2:172.21.15.62:6808/14760 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8bf8137050 con 0x7f8bd8059dc0 2021-12-17T19:13:58.714 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T19:13:58.714 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-12-17T19:13:58.714 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T19:13:58.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.703+0000 7f8bfdc44700 1 -- 172.21.15.62:0/2485427566 >> [v2:172.21.15.62:6808/14760,v1:172.21.15.62:6809/14760] conn(0x7f8bd8059dc0 msgr2=0x7f8bd805c1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.703+0000 7f8bfdc44700 1 --2- 172.21.15.62:0/2485427566 >> [v2:172.21.15.62:6808/14760,v1:172.21.15.62:6809/14760] conn(0x7f8bd8059dc0 0x7f8bd805c1e0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.703+0000 7f8bfdc44700 1 -- 172.21.15.62:0/2485427566 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8bd8053640 msgr2=0x7f8bd8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.703+0000 7f8bfdc44700 1 --2- 172.21.15.62:0/2485427566 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8bd8053640 0x7f8bd8055b00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f8bec01a000 tx=0x7f8bf806a0a0).stop 2021-12-17T19:13:58.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.703+0000 7f8bfdc44700 1 -- 172.21.15.62:0/2485427566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8bf80ad130 msgr2=0x7f8bf8142a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.703+0000 7f8bfdc44700 1 --2- 172.21.15.62:0/2485427566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8bf80ad130 0x7f8bf8142a00 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f8be4001110 tx=0x7f8be4007ae0).stop 2021-12-17T19:13:58.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.703+0000 7f8bfd443700 1 -- 172.21.15.62:0/2485427566 reap_dead start 2021-12-17T19:13:58.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.703+0000 7f8bfdc44700 1 -- 172.21.15.62:0/2485427566 shutdown_connections 2021-12-17T19:13:58.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.703+0000 7f8bfdc44700 1 -- 172.21.15.62:0/2485427566 >> 172.21.15.62:0/2485427566 conn(0x7f8bf80b5ae0 msgr2=0x7f8bf8140b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:58.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.703+0000 7f8bfdc44700 1 -- 172.21.15.62:0/2485427566 shutdown_connections 2021-12-17T19:13:58.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.703+0000 7f8bfdc44700 1 -- 172.21.15.62:0/2485427566 wait complete. 2021-12-17T19:13:58.723 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2021-12-17T19:13:58.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.823+0000 7f5d28878700 1 Processor -- start 2021-12-17T19:13:58.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.823+0000 7f5d28878700 1 -- start start 2021-12-17T19:13:58.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.823+0000 7f5d28878700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f5d24143610 0x7f5d2414e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.823+0000 7f5d28878700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d24146e30 con 0x7f5d24062620 2021-12-17T19:13:58.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.823+0000 7f5d28878700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d24062a00 con 0x7f5d2413ce80 2021-12-17T19:13:58.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.823+0000 7f5d28878700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d240b59e0 con 0x7f5d24143610 2021-12-17T19:13:58.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.823+0000 7f5d237fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5d24062620 0x7f5d2413c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41402/0 (socket says 172.21.15.62:41402) 2021-12-17T19:13:58.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.823+0000 7f5d237fe700 1 -- 172.21.15.62:0/3334603079 learned_addr learned my addr 172.21.15.62:0/3334603079 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T19:13:58.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.823+0000 7f5d23fff700 1 --2- 172.21.15.62:0/3334603079 >> v2:172.21.15.109:3300/0 conn(0x7f5d24143610 0x7f5d2414e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.827+0000 7f5d23fff700 1 -- 172.21.15.62:0/3334603079 >> v1:172.21.15.109:6789/0 conn(0x7f5d2413ce80 legacy=0x7f5d24142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.827+0000 7f5d23fff700 1 -- 172.21.15.62:0/3334603079 >> v1:172.21.15.62:6789/0 conn(0x7f5d24062620 legacy=0x7f5d2413c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.827+0000 7f5d23fff700 1 -- 172.21.15.62:0/3334603079 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d24147060 con 0x7f5d24143610 2021-12-17T19:13:58.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.827+0000 7f5d23fff700 1 --2- 172.21.15.62:0/3334603079 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d24143610 0x7f5d2414e730 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f5d1c002f70 tx=0x7f5d1c006df0).ready entity=mon.1 client_cookie=e784cf89e29b5b82 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:58.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d227fc700 1 -- 172.21.15.62:0/3334603079 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d1c00d610 con 0x7f5d24143610 2021-12-17T19:13:58.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d227fc700 1 -- 172.21.15.62:0/3334603079 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c000e90 con 0x7f5d24143610 2021-12-17T19:13:58.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d227fc700 1 -- 172.21.15.62:0/3334603079 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d1c00d960 con 0x7f5d24143610 2021-12-17T19:13:58.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d28878700 1 -- 172.21.15.62:0/3334603079 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d24143610 msgr2=0x7f5d2414e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d28878700 1 --2- 172.21.15.62:0/3334603079 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d24143610 0x7f5d2414e730 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f5d1c002f70 tx=0x7f5d1c006df0).stop 2021-12-17T19:13:58.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d28878700 1 -- 172.21.15.62:0/3334603079 shutdown_connections 2021-12-17T19:13:58.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d28878700 1 --2- 172.21.15.62:0/3334603079 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d24143610 0x7f5d2414e730 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d28878700 1 -- 172.21.15.62:0/3334603079 >> 172.21.15.62:0/3334603079 conn(0x7f5d2405c750 msgr2=0x7f5d2405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:58.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d28878700 1 -- 172.21.15.62:0/3334603079 shutdown_connections 2021-12-17T19:13:58.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d28878700 1 -- 172.21.15.62:0/3334603079 wait complete. 2021-12-17T19:13:58.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d28878700 1 Processor -- start 2021-12-17T19:13:58.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d28878700 1 -- start start 2021-12-17T19:13:58.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d28878700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d24062620 0x7f5d24152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d28878700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d2413ce80 0x7f5d24145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d28878700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d24143610 0x7f5d2413b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d28878700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d240644d0 con 0x7f5d24062620 2021-12-17T19:13:58.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d28878700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d240b7580 con 0x7f5d2413ce80 2021-12-17T19:13:58.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.831+0000 7f5d28878700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d240b9e00 con 0x7f5d24143610 2021-12-17T19:13:58.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d237fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d24062620 0x7f5d24152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d237fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d24062620 0x7f5d24152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57828/0 (socket says 172.21.15.62:57828) 2021-12-17T19:13:58.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d237fe700 1 -- 172.21.15.62:0/1789027774 learned_addr learned my addr 172.21.15.62:0/1789027774 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:58.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d22ffd700 1 --2- 172.21.15.62:0/1789027774 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d2413ce80 0x7f5d24145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d23fff700 1 --2- 172.21.15.62:0/1789027774 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d24143610 0x7f5d2413b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d237fe700 1 -- 172.21.15.62:0/1789027774 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d24143610 msgr2=0x7f5d2413b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d237fe700 1 --2- 172.21.15.62:0/1789027774 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d24143610 0x7f5d2413b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d237fe700 1 -- 172.21.15.62:0/1789027774 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d2413ce80 msgr2=0x7f5d24145d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d237fe700 1 --2- 172.21.15.62:0/1789027774 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d2413ce80 0x7f5d24145d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d237fe700 1 -- 172.21.15.62:0/1789027774 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c00b180 con 0x7f5d24062620 2021-12-17T19:13:58.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d237fe700 1 --2- 172.21.15.62:0/1789027774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d24062620 0x7f5d24152c70 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f5d24146d50 tx=0x7f5d140014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:58.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d20ff9700 1 -- 172.21.15.62:0/1789027774 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d14005ba0 con 0x7f5d24062620 2021-12-17T19:13:58.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d20ff9700 1 -- 172.21.15.62:0/1789027774 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d14005d00 con 0x7f5d24062620 2021-12-17T19:13:58.853 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d28878700 1 -- 172.21.15.62:0/1789027774 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d240ba0a0 con 0x7f5d24062620 2021-12-17T19:13:58.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d20ff9700 1 -- 172.21.15.62:0/1789027774 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d14007300 con 0x7f5d24062620 2021-12-17T19:13:58.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d28878700 1 -- 172.21.15.62:0/1789027774 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d240b9290 con 0x7f5d24062620 2021-12-17T19:13:58.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d28878700 1 -- 172.21.15.62:0/1789027774 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d240b9c40 con 0x7f5d24062620 2021-12-17T19:13:58.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.835+0000 7f5d20ff9700 1 -- 172.21.15.62:0/1789027774 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5d14010030 con 0x7f5d24062620 2021-12-17T19:13:58.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.839+0000 7f5d20ff9700 1 --2- 172.21.15.62:0/1789027774 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5d08053610 0x7f5d08055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:58.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.839+0000 7f5d20ff9700 1 -- 172.21.15.62:0/1789027774 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f5d1406b590 con 0x7f5d24062620 2021-12-17T19:13:58.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.839+0000 7f5d22ffd700 1 --2- 172.21.15.62:0/1789027774 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5d08053610 0x7f5d08055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:58.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.839+0000 7f5d22ffd700 1 --2- 172.21.15.62:0/1789027774 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5d08053610 0x7f5d08055ad0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f5d0c00b000 tx=0x7f5d0c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:58.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.843+0000 7f5d20ff9700 1 -- 172.21.15.62:0/1789027774 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5d140429d0 con 0x7f5d24062620 2021-12-17T19:13:58.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.971+0000 7f5d28878700 1 -- 172.21.15.62:0/1789027774 --> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d240573d0 con 0x7f5d08053610 2021-12-17T19:13:58.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.971+0000 7f5d20ff9700 1 -- 172.21.15.62:0/1789027774 <== mgr.4103 v2:172.21.15.109:6800/14658 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5d240573d0 con 0x7f5d08053610 2021-12-17T19:13:58.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.975+0000 7f5d28878700 1 -- 172.21.15.62:0/1789027774 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5d08053610 msgr2=0x7f5d08055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.975+0000 7f5d28878700 1 --2- 172.21.15.62:0/1789027774 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5d08053610 0x7f5d08055ad0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f5d0c00b000 tx=0x7f5d0c009040).stop 2021-12-17T19:13:58.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.975+0000 7f5d28878700 1 -- 172.21.15.62:0/1789027774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d24062620 msgr2=0x7f5d24152c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:58.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.975+0000 7f5d28878700 1 --2- 172.21.15.62:0/1789027774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d24062620 0x7f5d24152c70 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f5d24146d50 tx=0x7f5d140014a0).stop 2021-12-17T19:13:58.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.975+0000 7f5d28878700 1 -- 172.21.15.62:0/1789027774 shutdown_connections 2021-12-17T19:13:58.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.975+0000 7f5d28878700 1 --2- 172.21.15.62:0/1789027774 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f5d08053610 0x7f5d08055ad0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.975+0000 7f5d28878700 1 --2- 172.21.15.62:0/1789027774 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f5d24143610 0x7f5d2413b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.975+0000 7f5d28878700 1 --2- 172.21.15.62:0/1789027774 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f5d2413ce80 0x7f5d24145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.975+0000 7f5d28878700 1 --2- 172.21.15.62:0/1789027774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d24062620 0x7f5d24152c70 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:58.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.975+0000 7f5d28878700 1 -- 172.21.15.62:0/1789027774 >> 172.21.15.62:0/1789027774 conn(0x7f5d2405c750 msgr2=0x7f5d2405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:58.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.975+0000 7f5d28878700 1 -- 172.21.15.62:0/1789027774 shutdown_connections 2021-12-17T19:13:58.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:58.975+0000 7f5d28878700 1 -- 172.21.15.62:0/1789027774 wait complete. 2021-12-17T19:13:58.988 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 2 to deep-scrub 2021-12-17T19:13:58.999 INFO:tasks.ceph:Scrubbing osd.3 2021-12-17T19:13:58.999 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2021-12-17T19:13:59.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.103+0000 7f815e907700 1 Processor -- start 2021-12-17T19:13:59.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.103+0000 7f815e907700 1 -- start start 2021-12-17T19:13:59.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815e907700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f815805ca90 0x7f81580b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815e907700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81580b34b0 0x7f8158145b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815e907700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f815805ce70 con 0x7f81580604b0 2021-12-17T19:13:59.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815e907700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81580b2d70 con 0x7f815805ca90 2021-12-17T19:13:59.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815e907700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81580b3010 con 0x7f81580b34b0 2021-12-17T19:13:59.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815d104700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81580b34b0 0x7f8158145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815d905700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f815805ca90 0x7f81580b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815d104700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81580b34b0 0x7f8158145b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:51538/0 (socket says 172.21.15.62:51538) 2021-12-17T19:13:59.122 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815e106700 1 --1- >> v1:172.21.15.109:6789/0 conn(0x7f81580604b0 0x7f8158146010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.109:6789/0 says I am v1:172.21.15.62:57736/0 (socket says 172.21.15.62:57736) 2021-12-17T19:13:59.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815d104700 1 -- 172.21.15.62:0/1916748647 learned_addr learned my addr 172.21.15.62:0/1916748647 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:59.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815d104700 1 -- 172.21.15.62:0/1916748647 >> v2:172.21.15.109:3300/0 conn(0x7f815805ca90 msgr2=0x7f81580b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:13:59.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815d104700 1 --2- 172.21.15.62:0/1916748647 >> v2:172.21.15.109:3300/0 conn(0x7f815805ca90 0x7f81580b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815d104700 1 -- 172.21.15.62:0/1916748647 >> v1:172.21.15.109:6789/0 conn(0x7f81580604b0 legacy=0x7f8158146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815d104700 1 -- 172.21.15.62:0/1916748647 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81580b2ab0 con 0x7f81580b34b0 2021-12-17T19:13:59.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815d104700 1 --2- 172.21.15.62:0/1916748647 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81580b34b0 0x7f8158145b20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f814c002f70 tx=0x7f814c006eb0).ready entity=mon.2 client_cookie=e6e7639ba6df1c6f server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815c903700 1 -- 172.21.15.62:0/1916748647 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f814c00d570 con 0x7f81580b34b0 2021-12-17T19:13:59.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815c903700 1 -- 172.21.15.62:0/1916748647 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814c000e90 con 0x7f81580b34b0 2021-12-17T19:13:59.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815c903700 1 -- 172.21.15.62:0/1916748647 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f814c00d900 con 0x7f81580b34b0 2021-12-17T19:13:59.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815e907700 1 -- 172.21.15.62:0/1916748647 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81580b34b0 msgr2=0x7f8158145b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815e907700 1 --2- 172.21.15.62:0/1916748647 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81580b34b0 0x7f8158145b20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f814c002f70 tx=0x7f814c006eb0).stop 2021-12-17T19:13:59.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815e907700 1 -- 172.21.15.62:0/1916748647 shutdown_connections 2021-12-17T19:13:59.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815e907700 1 --2- 172.21.15.62:0/1916748647 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81580b34b0 0x7f8158145b20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815e907700 1 --2- 172.21.15.62:0/1916748647 >> v2:172.21.15.109:3300/0 conn(0x7f815805ca90 0x7f81580b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815e907700 1 -- 172.21.15.62:0/1916748647 >> 172.21.15.62:0/1916748647 conn(0x7f815805bcd0 msgr2=0x7f8158062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:59.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815e907700 1 -- 172.21.15.62:0/1916748647 shutdown_connections 2021-12-17T19:13:59.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.107+0000 7f815e907700 1 -- 172.21.15.62:0/1916748647 wait complete. 2021-12-17T19:13:59.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815e907700 1 Processor -- start 2021-12-17T19:13:59.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815e907700 1 -- start start 2021-12-17T19:13:59.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815e907700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f815805ca90 0x7f8158066c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815e907700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f81580604b0 0x7f8158155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815e907700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81580b34b0 0x7f8158155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815e907700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8158064e10 con 0x7f81580b34b0 2021-12-17T19:13:59.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815e907700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81580aff60 con 0x7f81580604b0 2021-12-17T19:13:59.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815e907700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81580b0200 con 0x7f815805ca90 2021-12-17T19:13:59.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815e106700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81580b34b0 0x7f8158155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815e106700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81580b34b0 0x7f8158155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57846/0 (socket says 172.21.15.62:57846) 2021-12-17T19:13:59.135 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815e106700 1 -- 172.21.15.62:0/3638034340 learned_addr learned my addr 172.21.15.62:0/3638034340 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:59.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815d104700 1 --2- 172.21.15.62:0/3638034340 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f81580604b0 0x7f8158155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815d905700 1 --2- 172.21.15.62:0/3638034340 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f815805ca90 0x7f8158066c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.136 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815d104700 1 -- 172.21.15.62:0/3638034340 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f815805ca90 msgr2=0x7f8158066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815d104700 1 --2- 172.21.15.62:0/3638034340 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f815805ca90 0x7f8158066c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815d104700 1 -- 172.21.15.62:0/3638034340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81580b34b0 msgr2=0x7f8158155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.137 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815d104700 1 --2- 172.21.15.62:0/3638034340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81580b34b0 0x7f8158155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815d104700 1 -- 172.21.15.62:0/3638034340 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c00b1e0 con 0x7f81580604b0 2021-12-17T19:13:59.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815e106700 1 --2- 172.21.15.62:0/3638034340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81580b34b0 0x7f8158155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T19:13:59.138 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815d104700 1 --2- 172.21.15.62:0/3638034340 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f81580604b0 0x7f8158155920 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f814c002f70 tx=0x7f814c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f814affd700 1 -- 172.21.15.62:0/3638034340 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f814c011760 con 0x7f81580604b0 2021-12-17T19:13:59.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f814affd700 1 -- 172.21.15.62:0/3638034340 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814c0118c0 con 0x7f81580604b0 2021-12-17T19:13:59.139 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815e907700 1 -- 172.21.15.62:0/3638034340 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81580b04a0 con 0x7f81580604b0 2021-12-17T19:13:59.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f814affd700 1 -- 172.21.15.62:0/3638034340 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f814c011c20 con 0x7f81580604b0 2021-12-17T19:13:59.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.111+0000 7f815e907700 1 -- 172.21.15.62:0/3638034340 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8158067310 con 0x7f81580604b0 2021-12-17T19:13:59.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.115+0000 7f815e907700 1 -- 172.21.15.62:0/3638034340 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f81580afde0 con 0x7f81580604b0 2021-12-17T19:13:59.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.115+0000 7f814affd700 1 -- 172.21.15.62:0/3638034340 <== mon.1 v2:172.21.15.109:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f814c025030 con 0x7f81580604b0 2021-12-17T19:13:59.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.115+0000 7f814affd700 1 --2- 172.21.15.62:0/3638034340 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8138053610 0x7f8138055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.115+0000 7f814affd700 1 -- 172.21.15.62:0/3638034340 <== mon.1 v2:172.21.15.109:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f814c06c740 con 0x7f81580604b0 2021-12-17T19:13:59.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.115+0000 7f815d905700 1 --2- 172.21.15.62:0/3638034340 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8138053610 0x7f8138055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.115+0000 7f814affd700 1 --2- 172.21.15.62:0/3638034340 >> [v2:172.21.15.62:6816/14762,v1:172.21.15.62:6817/14762] conn(0x7f8138059d90 0x7f813805c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.115+0000 7f814affd700 1 -- 172.21.15.62:0/3638034340 --> [v2:172.21.15.62:6816/14762,v1:172.21.15.62:6817/14762] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f813805c770 con 0x7f8138059d90 2021-12-17T19:13:59.143 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.115+0000 7f814affd700 1 -- 172.21.15.62:0/3638034340 <== mon.1 v2:172.21.15.109:3300/0 6 ==== mon_get_version_reply(handle=1 version=155) v2 ==== 24+0+0 (secure 0 0 0) 0x7f814c06edd0 con 0x7f81580604b0 2021-12-17T19:13:59.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.115+0000 7f815e106700 1 --2- 172.21.15.62:0/3638034340 >> [v2:172.21.15.62:6816/14762,v1:172.21.15.62:6817/14762] conn(0x7f8138059d90 0x7f813805c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.115+0000 7f815d905700 1 --2- 172.21.15.62:0/3638034340 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8138053610 0x7f8138055ad0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f815400b000 tx=0x7f8154006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.144 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.115+0000 7f815e106700 1 --2- 172.21.15.62:0/3638034340 >> [v2:172.21.15.62:6816/14762,v1:172.21.15.62:6817/14762] conn(0x7f8138059d90 0x7f813805c1b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.119+0000 7f814affd700 1 -- 172.21.15.62:0/3638034340 <== osd.3 v2:172.21.15.62:6816/14762 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f813805c770 con 0x7f8138059d90 2021-12-17T19:13:59.145 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.135+0000 7f815e907700 1 -- 172.21.15.62:0/3638034340 --> [v2:172.21.15.62:6816/14762,v1:172.21.15.62:6817/14762] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8158156620 con 0x7f8138059d90 2021-12-17T19:13:59.146 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.135+0000 7f814affd700 1 -- 172.21.15.62:0/3638034340 <== osd.3 v2:172.21.15.62:6816/14762 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8158156620 con 0x7f8138059d90 2021-12-17T19:13:59.146 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T19:13:59.147 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-12-17T19:13:59.147 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T19:13:59.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.135+0000 7f815e907700 1 -- 172.21.15.62:0/3638034340 >> [v2:172.21.15.62:6816/14762,v1:172.21.15.62:6817/14762] conn(0x7f8138059d90 msgr2=0x7f813805c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.135+0000 7f815e907700 1 --2- 172.21.15.62:0/3638034340 >> [v2:172.21.15.62:6816/14762,v1:172.21.15.62:6817/14762] conn(0x7f8138059d90 0x7f813805c1b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.149 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.135+0000 7f815e907700 1 -- 172.21.15.62:0/3638034340 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8138053610 msgr2=0x7f8138055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.135+0000 7f815e907700 1 --2- 172.21.15.62:0/3638034340 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8138053610 0x7f8138055ad0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f815400b000 tx=0x7f8154006df0).stop 2021-12-17T19:13:59.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.135+0000 7f815e907700 1 -- 172.21.15.62:0/3638034340 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f81580604b0 msgr2=0x7f8158155920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.150 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.135+0000 7f815e907700 1 --2- 172.21.15.62:0/3638034340 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f81580604b0 0x7f8158155920 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f814c002f70 tx=0x7f814c015000).stop 2021-12-17T19:13:59.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.135+0000 7f815e106700 1 -- 172.21.15.62:0/3638034340 reap_dead start 2021-12-17T19:13:59.151 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.135+0000 7f815e907700 1 -- 172.21.15.62:0/3638034340 shutdown_connections 2021-12-17T19:13:59.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.135+0000 7f815e907700 1 -- 172.21.15.62:0/3638034340 >> 172.21.15.62:0/3638034340 conn(0x7f815805bcd0 msgr2=0x7f81580b6900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:59.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.135+0000 7f815e907700 1 -- 172.21.15.62:0/3638034340 shutdown_connections 2021-12-17T19:13:59.152 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.135+0000 7f815e907700 1 -- 172.21.15.62:0/3638034340 wait complete. 2021-12-17T19:13:59.155 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2021-12-17T19:13:59.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.247+0000 7f54dbb71700 1 Processor -- start 2021-12-17T19:13:59.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.247+0000 7f54dbb71700 1 -- start start 2021-12-17T19:13:59.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.247+0000 7f54dbb71700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f54d40b1730 0x7f54d40ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.247+0000 7f54dbb71700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54d40a7bb0 0x7f54d4067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.247+0000 7f54dbb71700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d40b2ce0 con 0x7f54d40b21f0 2021-12-17T19:13:59.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.247+0000 7f54dbb71700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d414b5b0 con 0x7f54d40b1730 2021-12-17T19:13:59.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54dbb71700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d4147870 con 0x7f54d40a7bb0 2021-12-17T19:13:59.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54d910c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f54d40b1730 0x7f54d40ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54d910c700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f54d40b1730 0x7f54d40ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:36172/0 (socket says 172.21.15.62:36172) 2021-12-17T19:13:59.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54d910c700 1 -- 172.21.15.62:0/3155796132 learned_addr learned my addr 172.21.15.62:0/3155796132 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:59.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54da10e700 1 --2- 172.21.15.62:0/3155796132 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54d40a7bb0 0x7f54d4067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54d910c700 1 -- 172.21.15.62:0/3155796132 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54d40a7bb0 msgr2=0x7f54d4067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:13:59.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54d910c700 1 --2- 172.21.15.62:0/3155796132 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54d40a7bb0 0x7f54d4067120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54d910c700 1 -- 172.21.15.62:0/3155796132 >> v1:172.21.15.109:6789/0 conn(0x7f54d40b21f0 legacy=0x7f54d414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54d910c700 1 -- 172.21.15.62:0/3155796132 --> v2:172.21.15.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d40aca60 con 0x7f54d40b1730 2021-12-17T19:13:59.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54d890b700 1 -- 172.21.15.62:0/3155796132 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023655078 0 0) 0x7f54d40b2ce0 con 0x7f54d40b21f0 2021-12-17T19:13:59.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54d910c700 1 --2- 172.21.15.62:0/3155796132 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54d40b1730 0x7f54d40ace90 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f54d0002f70 tx=0x7f54d0006eb0).ready entity=mon.1 client_cookie=f2179e7510ed7748 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54d890b700 1 -- 172.21.15.62:0/3155796132 <== mon.1 v2:172.21.15.109:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d000d570 con 0x7f54d40b1730 2021-12-17T19:13:59.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54d890b700 1 -- 172.21.15.62:0/3155796132 <== mon.1 v2:172.21.15.109:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d0000e90 con 0x7f54d40b1730 2021-12-17T19:13:59.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54d890b700 1 -- 172.21.15.62:0/3155796132 <== mon.1 v2:172.21.15.109:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d000d8c0 con 0x7f54d40b1730 2021-12-17T19:13:59.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54dbb71700 1 -- 172.21.15.62:0/3155796132 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54d40b1730 msgr2=0x7f54d40ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54dbb71700 1 --2- 172.21.15.62:0/3155796132 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54d40b1730 0x7f54d40ace90 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f54d0002f70 tx=0x7f54d0006eb0).stop 2021-12-17T19:13:59.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54dbb71700 1 -- 172.21.15.62:0/3155796132 shutdown_connections 2021-12-17T19:13:59.271 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54dbb71700 1 --2- 172.21.15.62:0/3155796132 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54d40a7bb0 0x7f54d4067120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54dbb71700 1 --2- 172.21.15.62:0/3155796132 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54d40b1730 0x7f54d40ace90 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54dbb71700 1 -- 172.21.15.62:0/3155796132 >> 172.21.15.62:0/3155796132 conn(0x7f54d405f730 msgr2=0x7f54d405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:59.272 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54dbb71700 1 -- 172.21.15.62:0/3155796132 shutdown_connections 2021-12-17T19:13:59.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.251+0000 7f54dbb71700 1 -- 172.21.15.62:0/3155796132 wait complete. 2021-12-17T19:13:59.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54dbb71700 1 Processor -- start 2021-12-17T19:13:59.273 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54dbb71700 1 -- start start 2021-12-17T19:13:59.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54dbb71700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54d40a7bb0 0x7f54d4156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54dbb71700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54d40b1730 0x7f54d4148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.274 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54dbb71700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54d40b21f0 0x7f54d40aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54dbb71700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d414aea0 con 0x7f54d40a7bb0 2021-12-17T19:13:59.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54dbb71700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d414b0d0 con 0x7f54d40b1730 2021-12-17T19:13:59.275 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54dbb71700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d4157700 con 0x7f54d40b21f0 2021-12-17T19:13:59.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54d990d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54d40a7bb0 0x7f54d4156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54d990d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54d40a7bb0 0x7f54d4156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57858/0 (socket says 172.21.15.62:57858) 2021-12-17T19:13:59.276 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54d990d700 1 -- 172.21.15.62:0/2827300542 learned_addr learned my addr 172.21.15.62:0/2827300542 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:59.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54da10e700 1 --2- 172.21.15.62:0/2827300542 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54d40b21f0 0x7f54d40aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54d910c700 1 --2- 172.21.15.62:0/2827300542 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54d40b1730 0x7f54d4148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.277 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54da10e700 1 -- 172.21.15.62:0/2827300542 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54d40b1730 msgr2=0x7f54d4148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54da10e700 1 --2- 172.21.15.62:0/2827300542 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54d40b1730 0x7f54d4148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.278 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54da10e700 1 -- 172.21.15.62:0/2827300542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54d40a7bb0 msgr2=0x7f54d4156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54da10e700 1 --2- 172.21.15.62:0/2827300542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54d40a7bb0 0x7f54d4156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54da10e700 1 -- 172.21.15.62:0/2827300542 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d000b1e0 con 0x7f54d40b21f0 2021-12-17T19:13:59.279 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54d990d700 1 --2- 172.21.15.62:0/2827300542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54d40a7bb0 0x7f54d4156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T19:13:59.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54da10e700 1 --2- 172.21.15.62:0/2827300542 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54d40b21f0 0x7f54d40aad40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f54cc00c000 tx=0x7f54cc0091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54c2ffd700 1 -- 172.21.15.62:0/2827300542 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54cc012600 con 0x7f54d40b21f0 2021-12-17T19:13:59.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54c2ffd700 1 -- 172.21.15.62:0/2827300542 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc012760 con 0x7f54d40b21f0 2021-12-17T19:13:59.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54dbb71700 1 -- 172.21.15.62:0/2827300542 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d41573e0 con 0x7f54d40b21f0 2021-12-17T19:13:59.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54c2ffd700 1 -- 172.21.15.62:0/2827300542 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54cc012ac0 con 0x7f54d40b21f0 2021-12-17T19:13:59.281 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.255+0000 7f54dbb71700 1 -- 172.21.15.62:0/2827300542 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d4066c80 con 0x7f54d40b21f0 2021-12-17T19:13:59.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.259+0000 7f54dbb71700 1 -- 172.21.15.62:0/2827300542 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d41578c0 con 0x7f54d40b21f0 2021-12-17T19:13:59.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.259+0000 7f54c2ffd700 1 -- 172.21.15.62:0/2827300542 <== mon.2 v2:172.21.15.109:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f54cc022070 con 0x7f54d40b21f0 2021-12-17T19:13:59.282 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.259+0000 7f54c2ffd700 1 --2- 172.21.15.62:0/2827300542 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f54b4053610 0x7f54b4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.259+0000 7f54c2ffd700 1 -- 172.21.15.62:0/2827300542 <== mon.2 v2:172.21.15.109:3301/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f54cc06bde0 con 0x7f54d40b21f0 2021-12-17T19:13:59.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.259+0000 7f54d990d700 1 --2- 172.21.15.62:0/2827300542 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f54b4053610 0x7f54b4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.283 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.259+0000 7f54d990d700 1 --2- 172.21.15.62:0/2827300542 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f54b4053610 0x7f54b4055ad0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f54c400d000 tx=0x7f54c4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.284 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.267+0000 7f54c2ffd700 1 -- 172.21.15.62:0/2827300542 <== mon.2 v2:172.21.15.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f54cc043030 con 0x7f54d40b21f0 2021-12-17T19:13:59.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.395+0000 7f54dbb71700 1 -- 172.21.15.62:0/2827300542 --> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f54d40b2f10 con 0x7f54b4053610 2021-12-17T19:13:59.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.395+0000 7f54c2ffd700 1 -- 172.21.15.62:0/2827300542 <== mgr.4103 v2:172.21.15.109:6800/14658 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f54d40b2f10 con 0x7f54b4053610 2021-12-17T19:13:59.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.395+0000 7f54dbb71700 1 -- 172.21.15.62:0/2827300542 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f54b4053610 msgr2=0x7f54b4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.395+0000 7f54dbb71700 1 --2- 172.21.15.62:0/2827300542 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f54b4053610 0x7f54b4055ad0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f54c400d000 tx=0x7f54c4009040).stop 2021-12-17T19:13:59.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.395+0000 7f54dbb71700 1 -- 172.21.15.62:0/2827300542 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54d40b21f0 msgr2=0x7f54d40aad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.395+0000 7f54dbb71700 1 --2- 172.21.15.62:0/2827300542 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54d40b21f0 0x7f54d40aad40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f54cc00c000 tx=0x7f54cc0091d0).stop 2021-12-17T19:13:59.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.395+0000 7f54dbb71700 1 -- 172.21.15.62:0/2827300542 shutdown_connections 2021-12-17T19:13:59.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.395+0000 7f54dbb71700 1 --2- 172.21.15.62:0/2827300542 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f54b4053610 0x7f54b4055ad0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.395+0000 7f54dbb71700 1 --2- 172.21.15.62:0/2827300542 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f54d40b21f0 0x7f54d40aad40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.395+0000 7f54dbb71700 1 --2- 172.21.15.62:0/2827300542 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f54d40b1730 0x7f54d4148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.395+0000 7f54dbb71700 1 --2- 172.21.15.62:0/2827300542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54d40a7bb0 0x7f54d4156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.395+0000 7f54dbb71700 1 -- 172.21.15.62:0/2827300542 >> 172.21.15.62:0/2827300542 conn(0x7f54d405f730 msgr2=0x7f54d4148440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:59.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.395+0000 7f54dbb71700 1 -- 172.21.15.62:0/2827300542 shutdown_connections 2021-12-17T19:13:59.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.399+0000 7f54dbb71700 1 -- 172.21.15.62:0/2827300542 wait complete. 2021-12-17T19:13:59.410 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 3 to deep-scrub 2021-12-17T19:13:59.418 INFO:tasks.ceph:Scrubbing osd.4 2021-12-17T19:13:59.419 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2021-12-17T19:13:59.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.523+0000 7f1de5ea6700 1 Processor -- start 2021-12-17T19:13:59.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.523+0000 7f1de5ea6700 1 -- start start 2021-12-17T19:13:59.534 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.523+0000 7f1de5ea6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1de00b6520 0x7f1de00b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.523+0000 7f1de5ea6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1de0141b30 0x7f1de013dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.523+0000 7f1de5ea6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de01450f0 con 0x7f1de005fcd0 2021-12-17T19:13:59.535 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.523+0000 7f1de5ea6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de0140d90 con 0x7f1de00b6520 2021-12-17T19:13:59.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.523+0000 7f1de5ea6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de0140f80 con 0x7f1de0141b30 2021-12-17T19:13:59.536 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.523+0000 7f1ddf7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1de00b6520 0x7f1de00b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.523+0000 7f1ddeffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1de005fcd0 0x7f1de0141420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41448/0 (socket says 172.21.15.62:41448) 2021-12-17T19:13:59.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.523+0000 7f1ddf7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1de00b6520 0x7f1de00b0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57866/0 (socket says 172.21.15.62:57866) 2021-12-17T19:13:59.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.523+0000 7f1ddeffd700 1 -- 172.21.15.62:0/1760935400 learned_addr learned my addr 172.21.15.62:0/1760935400 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T19:13:59.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.523+0000 7f1ddffff700 1 --2- 172.21.15.62:0/1760935400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1de0141b30 0x7f1de013dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.523+0000 7f1ddf7fe700 1 -- 172.21.15.62:0/1760935400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1de0141b30 msgr2=0x7f1de013dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:13:59.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.523+0000 7f1ddf7fe700 1 --2- 172.21.15.62:0/1760935400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1de0141b30 0x7f1de013dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.523+0000 7f1ddf7fe700 1 -- 172.21.15.62:0/1760935400 >> v1:172.21.15.62:6789/0 conn(0x7f1de005fcd0 legacy=0x7f1de0141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.523+0000 7f1ddf7fe700 1 -- 172.21.15.62:0/1760935400 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de0144d70 con 0x7f1de00b6520 2021-12-17T19:13:59.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.523+0000 7f1ddf7fe700 1 --2- 172.21.15.62:0/1760935400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de00b6520 0x7f1de00b0b20 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7f1dd0002f70 tx=0x7f1dd0006df0).ready entity=mon.0 client_cookie=f6892701f29f1b99 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.527+0000 7f1dde7fc700 1 -- 172.21.15.62:0/1760935400 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dd000d570 con 0x7f1de00b6520 2021-12-17T19:13:59.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.527+0000 7f1dde7fc700 1 -- 172.21.15.62:0/1760935400 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd0000e90 con 0x7f1de00b6520 2021-12-17T19:13:59.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.527+0000 7f1dde7fc700 1 -- 172.21.15.62:0/1760935400 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dd000d8c0 con 0x7f1de00b6520 2021-12-17T19:13:59.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.527+0000 7f1de5ea6700 1 -- 172.21.15.62:0/1760935400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de00b6520 msgr2=0x7f1de00b0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.527+0000 7f1de5ea6700 1 --2- 172.21.15.62:0/1760935400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de00b6520 0x7f1de00b0b20 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7f1dd0002f70 tx=0x7f1dd0006df0).stop 2021-12-17T19:13:59.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.527+0000 7f1de5ea6700 1 -- 172.21.15.62:0/1760935400 shutdown_connections 2021-12-17T19:13:59.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.527+0000 7f1de5ea6700 1 --2- 172.21.15.62:0/1760935400 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1de0141b30 0x7f1de013dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.527+0000 7f1de5ea6700 1 --2- 172.21.15.62:0/1760935400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de00b6520 0x7f1de00b0b20 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.527+0000 7f1de5ea6700 1 -- 172.21.15.62:0/1760935400 >> 172.21.15.62:0/1760935400 conn(0x7f1de005d220 msgr2=0x7f1de00b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:59.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.527+0000 7f1de5ea6700 1 -- 172.21.15.62:0/1760935400 shutdown_connections 2021-12-17T19:13:59.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.527+0000 7f1de5ea6700 1 -- 172.21.15.62:0/1760935400 wait complete. 2021-12-17T19:13:59.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.527+0000 7f1de5ea6700 1 Processor -- start 2021-12-17T19:13:59.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.527+0000 7f1de5ea6700 1 -- start start 2021-12-17T19:13:59.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1de5ea6700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1de005fcd0 0x7f1de00b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1de5ea6700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1de00b6520 0x7f1de0153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1de5ea6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de0141b30 0x7f1de00a2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1de5ea6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de00b3530 con 0x7f1de0141b30 2021-12-17T19:13:59.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1de5ea6700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de00a2800 con 0x7f1de005fcd0 2021-12-17T19:13:59.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1de5ea6700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de00a0ee0 con 0x7f1de00b6520 2021-12-17T19:13:59.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1ddffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de0141b30 0x7f1de00a2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1ddffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de0141b30 0x7f1de00a2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57876/0 (socket says 172.21.15.62:57876) 2021-12-17T19:13:59.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1ddffff700 1 -- 172.21.15.62:0/1606334488 learned_addr learned my addr 172.21.15.62:0/1606334488 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:59.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1ddeffd700 1 --2- 172.21.15.62:0/1606334488 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1de00b6520 0x7f1de0153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1ddf7fe700 1 --2- 172.21.15.62:0/1606334488 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1de005fcd0 0x7f1de00b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1ddffff700 1 -- 172.21.15.62:0/1606334488 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1de00b6520 msgr2=0x7f1de0153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1ddffff700 1 --2- 172.21.15.62:0/1606334488 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f1de00b6520 0x7f1de0153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1ddffff700 1 -- 172.21.15.62:0/1606334488 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1de005fcd0 msgr2=0x7f1de00b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1ddffff700 1 --2- 172.21.15.62:0/1606334488 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f1de005fcd0 0x7f1de00b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1ddffff700 1 -- 172.21.15.62:0/1606334488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd000b180 con 0x7f1de0141b30 2021-12-17T19:13:59.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1ddffff700 1 --2- 172.21.15.62:0/1606334488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de0141b30 0x7f1de00a2c60 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f1dd800c000 tx=0x7f1dd80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1ddcff9700 1 -- 172.21.15.62:0/1606334488 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dd8012600 con 0x7f1de0141b30 2021-12-17T19:13:59.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1ddcff9700 1 -- 172.21.15.62:0/1606334488 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd8012760 con 0x7f1de0141b30 2021-12-17T19:13:59.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1de5ea6700 1 -- 172.21.15.62:0/1606334488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de00a0c40 con 0x7f1de0141b30 2021-12-17T19:13:59.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1ddcff9700 1 -- 172.21.15.62:0/1606334488 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dd8012ac0 con 0x7f1de0141b30 2021-12-17T19:13:59.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1de5ea6700 1 -- 172.21.15.62:0/1606334488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de009ffb0 con 0x7f1de0141b30 2021-12-17T19:13:59.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.531+0000 7f1de5ea6700 1 -- 172.21.15.62:0/1606334488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1de00a0260 con 0x7f1de0141b30 2021-12-17T19:13:59.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.535+0000 7f1ddcff9700 1 -- 172.21.15.62:0/1606334488 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1dd8022070 con 0x7f1de0141b30 2021-12-17T19:13:59.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.535+0000 7f1ddcff9700 1 --2- 172.21.15.62:0/1606334488 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1dc0053610 0x7f1dc0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.535+0000 7f1ddcff9700 1 -- 172.21.15.62:0/1606334488 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f1dd806bc20 con 0x7f1de0141b30 2021-12-17T19:13:59.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.535+0000 7f1ddcff9700 1 --2- 172.21.15.62:0/1606334488 >> [v2:172.21.15.109:6810/15017,v1:172.21.15.109:6811/15017] conn(0x7f1dc0059d90 0x7f1dc005c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.535+0000 7f1ddcff9700 1 -- 172.21.15.62:0/1606334488 --> [v2:172.21.15.109:6810/15017,v1:172.21.15.109:6811/15017] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1dc005c770 con 0x7f1dc0059d90 2021-12-17T19:13:59.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.535+0000 7f1ddcff9700 1 -- 172.21.15.62:0/1606334488 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=155) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dd806e290 con 0x7f1de0141b30 2021-12-17T19:13:59.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.535+0000 7f1ddf7fe700 1 --2- 172.21.15.62:0/1606334488 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1dc0053610 0x7f1dc0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.535+0000 7f1ddeffd700 1 --2- 172.21.15.62:0/1606334488 >> [v2:172.21.15.109:6810/15017,v1:172.21.15.109:6811/15017] conn(0x7f1dc0059d90 0x7f1dc005c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.535+0000 7f1ddeffd700 1 --2- 172.21.15.62:0/1606334488 >> [v2:172.21.15.109:6810/15017,v1:172.21.15.109:6811/15017] conn(0x7f1dc0059d90 0x7f1dc005c1b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.535+0000 7f1ddf7fe700 1 --2- 172.21.15.62:0/1606334488 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1dc0053610 0x7f1dc0055ad0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f1dd001a000 tx=0x7f1dd0014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.535+0000 7f1ddcff9700 1 -- 172.21.15.62:0/1606334488 <== osd.4 v2:172.21.15.109:6810/15017 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f1dc005c770 con 0x7f1dc0059d90 2021-12-17T19:13:59.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.555+0000 7f1de5ea6700 1 -- 172.21.15.62:0/1606334488 --> [v2:172.21.15.109:6810/15017,v1:172.21.15.109:6811/15017] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1de00a2970 con 0x7f1dc0059d90 2021-12-17T19:13:59.565 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.555+0000 7f1ddcff9700 1 -- 172.21.15.62:0/1606334488 <== osd.4 v2:172.21.15.109:6810/15017 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1de00a2970 con 0x7f1dc0059d90 2021-12-17T19:13:59.566 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T19:13:59.566 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-12-17T19:13:59.567 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T19:13:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.559+0000 7f1de5ea6700 1 -- 172.21.15.62:0/1606334488 >> [v2:172.21.15.109:6810/15017,v1:172.21.15.109:6811/15017] conn(0x7f1dc0059d90 msgr2=0x7f1dc005c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.559+0000 7f1de5ea6700 1 --2- 172.21.15.62:0/1606334488 >> [v2:172.21.15.109:6810/15017,v1:172.21.15.109:6811/15017] conn(0x7f1dc0059d90 0x7f1dc005c1b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.559+0000 7f1de5ea6700 1 -- 172.21.15.62:0/1606334488 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1dc0053610 msgr2=0x7f1dc0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.559+0000 7f1de5ea6700 1 --2- 172.21.15.62:0/1606334488 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1dc0053610 0x7f1dc0055ad0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f1dd001a000 tx=0x7f1dd0014000).stop 2021-12-17T19:13:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.559+0000 7f1de5ea6700 1 -- 172.21.15.62:0/1606334488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de0141b30 msgr2=0x7f1de00a2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.559+0000 7f1de5ea6700 1 --2- 172.21.15.62:0/1606334488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de0141b30 0x7f1de00a2c60 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f1dd800c000 tx=0x7f1dd80091d0).stop 2021-12-17T19:13:59.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.559+0000 7f1ddffff700 1 -- 172.21.15.62:0/1606334488 reap_dead start 2021-12-17T19:13:59.570 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.559+0000 7f1de5ea6700 1 -- 172.21.15.62:0/1606334488 shutdown_connections 2021-12-17T19:13:59.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.559+0000 7f1de5ea6700 1 -- 172.21.15.62:0/1606334488 >> 172.21.15.62:0/1606334488 conn(0x7f1de005d220 msgr2=0x7f1de013e130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:59.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.559+0000 7f1de5ea6700 1 -- 172.21.15.62:0/1606334488 shutdown_connections 2021-12-17T19:13:59.571 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.559+0000 7f1de5ea6700 1 -- 172.21.15.62:0/1606334488 wait complete. 2021-12-17T19:13:59.578 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-12-17T19:13:59.681 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.671+0000 7f8d08945700 1 Processor -- start 2021-12-17T19:13:59.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.671+0000 7f8d08945700 1 -- start start 2021-12-17T19:13:59.687 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d08945700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8d04143c30 0x7f8d040b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d08945700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d04067c10 con 0x7f8d0412c460 2021-12-17T19:13:59.688 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d08945700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d040b06c0 con 0x7f8d04067830 2021-12-17T19:13:59.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d08945700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d040b0960 con 0x7f8d04143c30 2021-12-17T19:13:59.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d0259c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8d0412c460 0x7f8d04143520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41464/0 (socket says 172.21.15.62:41464) 2021-12-17T19:13:59.689 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d0259c700 1 -- 172.21.15.62:0/2411103869 learned_addr learned my addr 172.21.15.62:0/2411103869 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T19:13:59.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d0359e700 1 --2- 172.21.15.62:0/2411103869 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8d04143c30 0x7f8d040b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 -- 172.21.15.62:0/2411103869 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935250395 0 0) 0x7f8d04067c10 con 0x7f8d0412c460 2021-12-17T19:13:59.690 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 -- 172.21.15.62:0/2411103869 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ce8003260 con 0x7f8d0412c460 2021-12-17T19:13:59.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 -- 172.21.15.62:0/2411103869 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591809033 0 0) 0x7f8d040b06c0 con 0x7f8d04067830 2021-12-17T19:13:59.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 -- 172.21.15.62:0/2411103869 --> v1:172.21.15.109:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d04067c10 con 0x7f8d04067830 2021-12-17T19:13:59.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 -- 172.21.15.62:0/2411103869 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1501835088 0 0) 0x7f8ce8003260 con 0x7f8d0412c460 2021-12-17T19:13:59.691 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 -- 172.21.15.62:0/2411103869 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8d04143c30 msgr2=0x7f8d040b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:13:59.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 --2- 172.21.15.62:0/2411103869 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8d04143c30 0x7f8d040b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 -- 172.21.15.62:0/2411103869 >> v1:172.21.15.109:6789/0 conn(0x7f8d04067830 legacy=0x7f8d0412bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.692 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 -- 172.21.15.62:0/2411103869 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d040b0260 con 0x7f8d0412c460 2021-12-17T19:13:59.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 -- 172.21.15.62:0/2411103869 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 765246700 0 0) 0x7f8cf8001660 con 0x7f8d0412c460 2021-12-17T19:13:59.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 -- 172.21.15.62:0/2411103869 >> v1:172.21.15.62:6789/0 conn(0x7f8d0412c460 legacy=0x7f8d04143520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.693 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 --2- 172.21.15.62:0/2411103869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ce8003910 0x7f8ce8003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 --2- 172.21.15.62:0/2411103869 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8ce8004500 0x7f8ce8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.694 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 --2- 172.21.15.62:0/2411103869 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8ce8004e70 0x7f8ce800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 -- 172.21.15.62:0/2411103869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d040b0960 con 0x7f8ce8003910 2021-12-17T19:13:59.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 -- 172.21.15.62:0/2411103869 --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce800bc40 con 0x7f8ce8004e70 2021-12-17T19:13:59.695 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 -- 172.21.15.62:0/2411103869 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce800be00 con 0x7f8ce8004500 2021-12-17T19:13:59.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d0359e700 1 --2- 172.21.15.62:0/2411103869 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8d04143c30 0x7f8d040b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T19:13:59.697 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d02d9d700 1 --2- 172.21.15.62:0/2411103869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ce8003910 0x7f8ce8003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d0259c700 1 --2- 172.21.15.62:0/2411103869 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8ce8004500 0x7f8ce8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d0359e700 1 --2- 172.21.15.62:0/2411103869 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8ce8004e70 0x7f8ce800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.698 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d02d9d700 1 -- 172.21.15.62:0/2411103869 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8ce8004500 msgr2=0x7f8ce8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:13:59.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d02d9d700 1 --2- 172.21.15.62:0/2411103869 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8ce8004500 0x7f8ce8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d02d9d700 1 -- 172.21.15.62:0/2411103869 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8ce8004e70 msgr2=0x7f8ce800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:13:59.699 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d02d9d700 1 --2- 172.21.15.62:0/2411103869 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8ce8004e70 0x7f8ce800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d02d9d700 1 -- 172.21.15.62:0/2411103869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce8003260 con 0x7f8ce8003910 2021-12-17T19:13:59.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d0259c700 1 --2- 172.21.15.62:0/2411103869 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8ce8004500 0x7f8ce8004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T19:13:59.700 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d0359e700 1 --2- 172.21.15.62:0/2411103869 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8ce8004e70 0x7f8ce800b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T19:13:59.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d02d9d700 1 --2- 172.21.15.62:0/2411103869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ce8003910 0x7f8ce8003d10 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7f8cf4001490 tx=0x7f8cf4007d40).ready entity=mon.0 client_cookie=1bf3dd6bdecca38b server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 -- 172.21.15.62:0/2411103869 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cf4006890 con 0x7f8ce8003910 2021-12-17T19:13:59.701 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 -- 172.21.15.62:0/2411103869 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf40069f0 con 0x7f8ce8003910 2021-12-17T19:13:59.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.675+0000 7f8d01d9b700 1 -- 172.21.15.62:0/2411103869 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cf4006d50 con 0x7f8ce8003910 2021-12-17T19:13:59.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d08945700 1 -- 172.21.15.62:0/2411103869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ce8003910 msgr2=0x7f8ce8003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.702 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d08945700 1 --2- 172.21.15.62:0/2411103869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ce8003910 0x7f8ce8003d10 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7f8cf4001490 tx=0x7f8cf4007d40).stop 2021-12-17T19:13:59.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d0359e700 1 -- 172.21.15.62:0/2411103869 reap_dead start 2021-12-17T19:13:59.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d08945700 1 -- 172.21.15.62:0/2411103869 shutdown_connections 2021-12-17T19:13:59.703 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d08945700 1 -- 172.21.15.62:0/2411103869 >> 172.21.15.62:0/2411103869 conn(0x7f8d0405d1c0 msgr2=0x7f8d040b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:59.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d08945700 1 -- 172.21.15.62:0/2411103869 shutdown_connections 2021-12-17T19:13:59.704 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d08945700 1 -- 172.21.15.62:0/2411103869 wait complete. 2021-12-17T19:13:59.707 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d08945700 1 Processor -- start 2021-12-17T19:13:59.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d08945700 1 -- start start 2021-12-17T19:13:59.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d08945700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8ce8003910 0x7f8d040a2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.708 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d08945700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8d040a2870 0x7f8d0412b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d08945700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d04140230 0x7f8d0412bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d08945700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d04146cb0 con 0x7f8d04140230 2021-12-17T19:13:59.709 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d08945700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0412c2d0 con 0x7f8d040a2870 2021-12-17T19:13:59.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d08945700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d04152fc0 con 0x7f8ce8003910 2021-12-17T19:13:59.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d0359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d04140230 0x7f8d0412bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.710 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d0259c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8d040a2870 0x7f8d0412b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d02d9d700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8ce8003910 0x7f8d040a2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d0259c700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8d040a2870 0x7f8d0412b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3300/0 says I am v2:172.21.15.62:36214/0 (socket says 172.21.15.62:36214) 2021-12-17T19:13:59.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.679+0000 7f8d0259c700 1 -- 172.21.15.62:0/1008839810 learned_addr learned my addr 172.21.15.62:0/1008839810 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:59.711 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.683+0000 7f8d0359e700 1 -- 172.21.15.62:0/1008839810 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8ce8003910 msgr2=0x7f8d040a2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.683+0000 7f8d0359e700 1 --2- 172.21.15.62:0/1008839810 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8ce8003910 0x7f8d040a2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.683+0000 7f8d0359e700 1 -- 172.21.15.62:0/1008839810 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8d040a2870 msgr2=0x7f8d0412b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.683+0000 7f8d0359e700 1 --2- 172.21.15.62:0/1008839810 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8d040a2870 0x7f8d0412b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.683+0000 7f8d0359e700 1 -- 172.21.15.62:0/1008839810 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d04153260 con 0x7f8d04140230 2021-12-17T19:13:59.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.683+0000 7f8d0359e700 1 --2- 172.21.15.62:0/1008839810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d04140230 0x7f8d0412bde0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f8cfc000b60 tx=0x7f8cfc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.713 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.683+0000 7f8cf3fff700 1 -- 172.21.15.62:0/1008839810 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cfc014650 con 0x7f8d04140230 2021-12-17T19:13:59.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.683+0000 7f8cf3fff700 1 -- 172.21.15.62:0/1008839810 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cfc0147b0 con 0x7f8d04140230 2021-12-17T19:13:59.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.683+0000 7f8d08945700 1 -- 172.21.15.62:0/1008839810 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0409ea70 con 0x7f8d04140230 2021-12-17T19:13:59.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.683+0000 7f8cf3fff700 1 -- 172.21.15.62:0/1008839810 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cfc014b10 con 0x7f8d04140230 2021-12-17T19:13:59.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.683+0000 7f8d08945700 1 -- 172.21.15.62:0/1008839810 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d040a2e30 con 0x7f8d04140230 2021-12-17T19:13:59.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.683+0000 7f8d08945700 1 -- 172.21.15.62:0/1008839810 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0409ec00 con 0x7f8d04140230 2021-12-17T19:13:59.715 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.683+0000 7f8cf3fff700 1 -- 172.21.15.62:0/1008839810 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8cfc01b030 con 0x7f8d04140230 2021-12-17T19:13:59.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.683+0000 7f8cf3fff700 1 --2- 172.21.15.62:0/1008839810 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ce00536d0 0x7f8ce0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.683+0000 7f8cf3fff700 1 -- 172.21.15.62:0/1008839810 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f8cfc06b2e0 con 0x7f8d04140230 2021-12-17T19:13:59.716 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.683+0000 7f8d02d9d700 1 --2- 172.21.15.62:0/1008839810 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ce00536d0 0x7f8ce0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.687+0000 7f8d02d9d700 1 --2- 172.21.15.62:0/1008839810 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ce00536d0 0x7f8ce0055b90 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f8cf401b000 tx=0x7f8cf4016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.691+0000 7f8cf3fff700 1 -- 172.21.15.62:0/1008839810 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8cfc042720 con 0x7f8d04140230 2021-12-17T19:13:59.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.823+0000 7f8d08945700 1 -- 172.21.15.62:0/1008839810 --> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d040573d0 con 0x7f8ce00536d0 2021-12-17T19:13:59.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.823+0000 7f8cf3fff700 1 -- 172.21.15.62:0/1008839810 <== mgr.4103 v2:172.21.15.109:6800/14658 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8d040573d0 con 0x7f8ce00536d0 2021-12-17T19:13:59.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.827+0000 7f8d08945700 1 -- 172.21.15.62:0/1008839810 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ce00536d0 msgr2=0x7f8ce0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.827+0000 7f8d08945700 1 --2- 172.21.15.62:0/1008839810 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ce00536d0 0x7f8ce0055b90 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f8cf401b000 tx=0x7f8cf4016000).stop 2021-12-17T19:13:59.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.827+0000 7f8d08945700 1 -- 172.21.15.62:0/1008839810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d04140230 msgr2=0x7f8d0412bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.827+0000 7f8d08945700 1 --2- 172.21.15.62:0/1008839810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d04140230 0x7f8d0412bde0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f8cfc000b60 tx=0x7f8cfc008040).stop 2021-12-17T19:13:59.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.827+0000 7f8d08945700 1 -- 172.21.15.62:0/1008839810 shutdown_connections 2021-12-17T19:13:59.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.827+0000 7f8d08945700 1 --2- 172.21.15.62:0/1008839810 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f8ce00536d0 0x7f8ce0055b90 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.827+0000 7f8d08945700 1 --2- 172.21.15.62:0/1008839810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d04140230 0x7f8d0412bde0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.827+0000 7f8d08945700 1 --2- 172.21.15.62:0/1008839810 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f8d040a2870 0x7f8d0412b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.827+0000 7f8d08945700 1 --2- 172.21.15.62:0/1008839810 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f8ce8003910 0x7f8d040a2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.827+0000 7f8d08945700 1 -- 172.21.15.62:0/1008839810 >> 172.21.15.62:0/1008839810 conn(0x7f8d0405d1c0 msgr2=0x7f8d040aeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:59.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.827+0000 7f8d08945700 1 -- 172.21.15.62:0/1008839810 shutdown_connections 2021-12-17T19:13:59.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.827+0000 7f8d08945700 1 -- 172.21.15.62:0/1008839810 wait complete. 2021-12-17T19:13:59.840 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 4 to deep-scrub 2021-12-17T19:13:59.852 INFO:tasks.ceph:Scrubbing osd.5 2021-12-17T19:13:59.853 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2021-12-17T19:13:59.961 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.951+0000 7f81eb275700 1 Processor -- start 2021-12-17T19:13:59.962 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.951+0000 7f81eb275700 1 -- start start 2021-12-17T19:13:59.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.951+0000 7f81eb275700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f81e405ca90 0x7f81e405f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.951+0000 7f81eb275700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f81e40ad150 0x7f81e40b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81eb275700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e405ce70 con 0x7f81e4060540 2021-12-17T19:13:59.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81eb275700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e40afc70 con 0x7f81e405ca90 2021-12-17T19:13:59.966 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81eb275700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e40abf30 con 0x7f81e40ad150 2021-12-17T19:13:59.967 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81e9a72700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f81e4060540 0x7f81e40aca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41482/0 (socket says 172.21.15.62:41482) 2021-12-17T19:13:59.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81e9a72700 1 -- 172.21.15.62:0/2134322003 learned_addr learned my addr 172.21.15.62:0/2134322003 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T19:13:59.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81ea273700 1 --2- 172.21.15.62:0/2134322003 >> v2:172.21.15.62:3300/0 conn(0x7f81e405ca90 0x7f81e405f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81e9271700 1 -- 172.21.15.62:0/2134322003 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282900474 0 0) 0x7f81e405ce70 con 0x7f81e4060540 2021-12-17T19:13:59.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81eaa74700 1 --2- 172.21.15.62:0/2134322003 >> v2:172.21.15.109:3300/0 conn(0x7f81e40ad150 0x7f81e40b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81e9271700 1 -- 172.21.15.62:0/2134322003 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81cc003260 con 0x7f81e4060540 2021-12-17T19:13:59.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81e9271700 1 -- 172.21.15.62:0/2134322003 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 557028412 0 0) 0x7f81cc003260 con 0x7f81e4060540 2021-12-17T19:13:59.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81ea273700 1 -- 172.21.15.62:0/2134322003 >> v2:172.21.15.109:3300/0 conn(0x7f81e40ad150 msgr2=0x7f81e40b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:13:59.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81ea273700 1 --2- 172.21.15.62:0/2134322003 >> v2:172.21.15.109:3300/0 conn(0x7f81e40ad150 0x7f81e40b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81ea273700 1 -- 172.21.15.62:0/2134322003 >> v1:172.21.15.62:6789/0 conn(0x7f81e4060540 legacy=0x7f81e40aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81ea273700 1 -- 172.21.15.62:0/2134322003 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e40ac1d0 con 0x7f81e405ca90 2021-12-17T19:13:59.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81ea273700 1 --2- 172.21.15.62:0/2134322003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81e405ca90 0x7f81e405f730 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f81e0001b80 tx=0x7f81d4006df0).ready entity=mon.0 client_cookie=6a0e413bf3824460 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81e9271700 1 -- 172.21.15.62:0/2134322003 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e00019e0 con 0x7f81e405ca90 2021-12-17T19:13:59.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81e9271700 1 -- 172.21.15.62:0/2134322003 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d4000e90 con 0x7f81e405ca90 2021-12-17T19:13:59.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81e9271700 1 -- 172.21.15.62:0/2134322003 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d4012460 con 0x7f81e405ca90 2021-12-17T19:13:59.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81eb275700 1 -- 172.21.15.62:0/2134322003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81e405ca90 msgr2=0x7f81e405f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81eb275700 1 --2- 172.21.15.62:0/2134322003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81e405ca90 0x7f81e405f730 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f81e0001b80 tx=0x7f81d4006df0).stop 2021-12-17T19:13:59.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81eb275700 1 -- 172.21.15.62:0/2134322003 shutdown_connections 2021-12-17T19:13:59.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81eb275700 1 --2- 172.21.15.62:0/2134322003 >> v2:172.21.15.109:3300/0 conn(0x7f81e40ad150 0x7f81e40b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81eb275700 1 --2- 172.21.15.62:0/2134322003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81e405ca90 0x7f81e405f730 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81eb275700 1 -- 172.21.15.62:0/2134322003 >> 172.21.15.62:0/2134322003 conn(0x7f81e405be70 msgr2=0x7f81e4062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:13:59.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81eb275700 1 -- 172.21.15.62:0/2134322003 shutdown_connections 2021-12-17T19:13:59.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.955+0000 7f81eb275700 1 -- 172.21.15.62:0/2134322003 wait complete. 2021-12-17T19:13:59.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eb275700 1 Processor -- start 2021-12-17T19:13:59.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eb275700 1 -- start start 2021-12-17T19:13:59.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eb275700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f81e405ca90 0x7f81e4148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eb275700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81e4060540 0x7f81e4146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eb275700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81e40ad150 0x7f81e40b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eb275700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e41459d0 con 0x7f81e40ad150 2021-12-17T19:13:59.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eb275700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e40b3f70 con 0x7f81e405ca90 2021-12-17T19:13:59.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eb275700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4145c00 con 0x7f81e4060540 2021-12-17T19:13:59.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eaa74700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81e40ad150 0x7f81e40b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eaa74700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81e40ad150 0x7f81e40b3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57912/0 (socket says 172.21.15.62:57912) 2021-12-17T19:13:59.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eaa74700 1 -- 172.21.15.62:0/453401974 learned_addr learned my addr 172.21.15.62:0/453401974 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:13:59.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81e9a72700 1 --2- 172.21.15.62:0/453401974 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81e4060540 0x7f81e4146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81ea273700 1 --2- 172.21.15.62:0/453401974 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f81e405ca90 0x7f81e4148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eaa74700 1 -- 172.21.15.62:0/453401974 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81e4060540 msgr2=0x7f81e4146340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eaa74700 1 --2- 172.21.15.62:0/453401974 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f81e4060540 0x7f81e4146340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eaa74700 1 -- 172.21.15.62:0/453401974 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f81e405ca90 msgr2=0x7f81e4148220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eaa74700 1 --2- 172.21.15.62:0/453401974 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f81e405ca90 0x7f81e4148220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eaa74700 1 -- 172.21.15.62:0/453401974 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d400b180 con 0x7f81e40ad150 2021-12-17T19:13:59.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eaa74700 1 --2- 172.21.15.62:0/453401974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81e40ad150 0x7f81e40b3a80 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f81dc00c000 tx=0x7f81dc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81d37fe700 1 -- 172.21.15.62:0/453401974 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81dc011750 con 0x7f81e40ad150 2021-12-17T19:13:59.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81d37fe700 1 -- 172.21.15.62:0/453401974 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc0118b0 con 0x7f81e40ad150 2021-12-17T19:13:59.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81d37fe700 1 -- 172.21.15.62:0/453401974 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81dc011c10 con 0x7f81e40ad150 2021-12-17T19:13:59.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eb275700 1 -- 172.21.15.62:0/453401974 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e4145ea0 con 0x7f81e40ad150 2021-12-17T19:13:59.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.959+0000 7f81eb275700 1 -- 172.21.15.62:0/453401974 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e40a1540 con 0x7f81e40ad150 2021-12-17T19:13:59.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.963+0000 7f81eb275700 1 -- 172.21.15.62:0/453401974 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f81e40573d0 con 0x7f81e40ad150 2021-12-17T19:13:59.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.963+0000 7f81d37fe700 1 -- 172.21.15.62:0/453401974 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f81dc011d70 con 0x7f81e40ad150 2021-12-17T19:13:59.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.963+0000 7f81d37fe700 1 --2- 172.21.15.62:0/453401974 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f81c4053610 0x7f81c4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.963+0000 7f81d37fe700 1 -- 172.21.15.62:0/453401974 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f81dc06b940 con 0x7f81e40ad150 2021-12-17T19:13:59.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.963+0000 7f81d37fe700 1 --2- 172.21.15.62:0/453401974 >> [v2:172.21.15.109:6802/15019,v1:172.21.15.109:6803/15019] conn(0x7f81c4059d90 0x7f81c405c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:13:59.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.963+0000 7f81d37fe700 1 -- 172.21.15.62:0/453401974 --> [v2:172.21.15.109:6802/15019,v1:172.21.15.109:6803/15019] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f81c405c770 con 0x7f81c4059d90 2021-12-17T19:13:59.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.963+0000 7f81d37fe700 1 -- 172.21.15.62:0/453401974 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=155) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81dc070240 con 0x7f81e40ad150 2021-12-17T19:13:59.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.963+0000 7f81ea273700 1 --2- 172.21.15.62:0/453401974 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f81c4053610 0x7f81c4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.963+0000 7f81e9a72700 1 --2- 172.21.15.62:0/453401974 >> [v2:172.21.15.109:6802/15019,v1:172.21.15.109:6803/15019] conn(0x7f81c4059d90 0x7f81c405c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:13:59.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.963+0000 7f81ea273700 1 --2- 172.21.15.62:0/453401974 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f81c4053610 0x7f81c4055ad0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f81d401a000 tx=0x7f81d4014000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.963+0000 7f81e9a72700 1 --2- 172.21.15.62:0/453401974 >> [v2:172.21.15.109:6802/15019,v1:172.21.15.109:6803/15019] conn(0x7f81c4059d90 0x7f81c405c1b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:13:59.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.967+0000 7f81d37fe700 1 -- 172.21.15.62:0/453401974 <== osd.5 v2:172.21.15.109:6802/15019 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f81c405c770 con 0x7f81c4059d90 2021-12-17T19:13:59.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.979+0000 7f81eb275700 1 -- 172.21.15.62:0/453401974 --> [v2:172.21.15.109:6802/15019,v1:172.21.15.109:6803/15019] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f81e4146030 con 0x7f81c4059d90 2021-12-17T19:13:59.994 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.983+0000 7f81d37fe700 1 -- 172.21.15.62:0/453401974 <== osd.5 v2:172.21.15.109:6802/15019 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f81e4146030 con 0x7f81c4059d90 2021-12-17T19:13:59.995 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T19:13:59.996 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-12-17T19:13:59.996 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T19:13:59.997 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.983+0000 7f81eb275700 1 -- 172.21.15.62:0/453401974 >> [v2:172.21.15.109:6802/15019,v1:172.21.15.109:6803/15019] conn(0x7f81c4059d90 msgr2=0x7f81c405c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.983+0000 7f81eb275700 1 --2- 172.21.15.62:0/453401974 >> [v2:172.21.15.109:6802/15019,v1:172.21.15.109:6803/15019] conn(0x7f81c4059d90 0x7f81c405c1b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:13:59.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.983+0000 7f81eb275700 1 -- 172.21.15.62:0/453401974 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f81c4053610 msgr2=0x7f81c4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.998 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.983+0000 7f81eb275700 1 --2- 172.21.15.62:0/453401974 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f81c4053610 0x7f81c4055ad0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f81d401a000 tx=0x7f81d4014000).stop 2021-12-17T19:13:59.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.983+0000 7f81eb275700 1 -- 172.21.15.62:0/453401974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81e40ad150 msgr2=0x7f81e40b3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:13:59.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.983+0000 7f81eb275700 1 --2- 172.21.15.62:0/453401974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81e40ad150 0x7f81e40b3a80 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f81dc00c000 tx=0x7f81dc006df0).stop 2021-12-17T19:13:59.999 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.983+0000 7f81eaa74700 1 -- 172.21.15.62:0/453401974 reap_dead start 2021-12-17T19:14:00.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.983+0000 7f81eb275700 1 -- 172.21.15.62:0/453401974 shutdown_connections 2021-12-17T19:14:00.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.983+0000 7f81eb275700 1 -- 172.21.15.62:0/453401974 >> 172.21.15.62:0/453401974 conn(0x7f81e405be70 msgr2=0x7f81e40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:14:00.000 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.983+0000 7f81eb275700 1 -- 172.21.15.62:0/453401974 shutdown_connections 2021-12-17T19:14:00.001 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:13:59.983+0000 7f81eb275700 1 -- 172.21.15.62:0/453401974 wait complete. 2021-12-17T19:14:00.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2021-12-17T19:14:00.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febd6791700 1 Processor -- start 2021-12-17T19:14:00.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febd6791700 1 -- start start 2021-12-17T19:14:00.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febd6791700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7febd005fa70 0x7febd01424a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febd6791700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febd0143fb0 0x7febd00afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febd6791700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd0060650 con 0x7febd0060230 2021-12-17T19:14:00.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febd6791700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd005fe50 con 0x7febd005fa70 2021-12-17T19:14:00.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febd6791700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd00ad220 con 0x7febd0143fb0 2021-12-17T19:14:00.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febcffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7febd005fa70 0x7febd01424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febcffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7febd005fa70 0x7febd01424a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57920/0 (socket says 172.21.15.62:57920) 2021-12-17T19:14:00.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febcffff700 1 -- 172.21.15.62:0/68105031 learned_addr learned my addr 172.21.15.62:0/68105031 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:14:00.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febd4d2e700 1 --2- 172.21.15.62:0/68105031 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febd0143fb0 0x7febd00afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febceffd700 1 -- 172.21.15.62:0/68105031 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943497902 0 0) 0x7febd0060650 con 0x7febd0060230 2021-12-17T19:14:00.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febcffff700 1 -- 172.21.15.62:0/68105031 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febd0143fb0 msgr2=0x7febd00afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:14:00.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febcffff700 1 --2- 172.21.15.62:0/68105031 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febd0143fb0 0x7febd00afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febcffff700 1 -- 172.21.15.62:0/68105031 >> v1:172.21.15.109:6789/0 conn(0x7febd0060230 legacy=0x7febd0142990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febcffff700 1 -- 172.21.15.62:0/68105031 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd0060880 con 0x7febd005fa70 2021-12-17T19:14:00.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febcffff700 1 --2- 172.21.15.62:0/68105031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febd005fa70 0x7febd01424a0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7febc4002f70 tx=0x7febc4006eb0).ready entity=mon.0 client_cookie=8d309c1baff18ed1 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:00.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febceffd700 1 -- 172.21.15.62:0/68105031 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc400d570 con 0x7febd005fa70 2021-12-17T19:14:00.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febceffd700 1 -- 172.21.15.62:0/68105031 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc4000e90 con 0x7febd005fa70 2021-12-17T19:14:00.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.099+0000 7febceffd700 1 -- 172.21.15.62:0/68105031 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc400d8c0 con 0x7febd005fa70 2021-12-17T19:14:00.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febd6791700 1 -- 172.21.15.62:0/68105031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febd005fa70 msgr2=0x7febd01424a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febd6791700 1 --2- 172.21.15.62:0/68105031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febd005fa70 0x7febd01424a0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7febc4002f70 tx=0x7febc4006eb0).stop 2021-12-17T19:14:00.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febd6791700 1 -- 172.21.15.62:0/68105031 shutdown_connections 2021-12-17T19:14:00.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febd6791700 1 --2- 172.21.15.62:0/68105031 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febd0143fb0 0x7febd00afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febd6791700 1 --2- 172.21.15.62:0/68105031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febd005fa70 0x7febd01424a0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febd6791700 1 -- 172.21.15.62:0/68105031 >> 172.21.15.62:0/68105031 conn(0x7febd00b53d0 msgr2=0x7febd00b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:14:00.119 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febd6791700 1 -- 172.21.15.62:0/68105031 shutdown_connections 2021-12-17T19:14:00.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febd6791700 1 -- 172.21.15.62:0/68105031 wait complete. 2021-12-17T19:14:00.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febd6791700 1 Processor -- start 2021-12-17T19:14:00.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febd6791700 1 -- start start 2021-12-17T19:14:00.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febd6791700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febd005fa70 0x7febd00b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febd6791700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7febd0060230 0x7febd0152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febd6791700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febd0143fb0 0x7febd0152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febd6791700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd013e320 con 0x7febd005fa70 2021-12-17T19:14:00.125 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febd6791700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd0153130 con 0x7febd0060230 2021-12-17T19:14:00.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febd6791700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd01416e0 con 0x7febd0143fb0 2021-12-17T19:14:00.126 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febcffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febd005fa70 0x7febd00b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febcffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febd005fa70 0x7febd00b39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57924/0 (socket says 172.21.15.62:57924) 2021-12-17T19:14:00.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febcffff700 1 -- 172.21.15.62:0/2295635406 learned_addr learned my addr 172.21.15.62:0/2295635406 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:14:00.127 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febd4d2e700 1 --2- 172.21.15.62:0/2295635406 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febd0143fb0 0x7febd0152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.103+0000 7febcf7fe700 1 --2- 172.21.15.62:0/2295635406 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7febd0060230 0x7febd0152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.107+0000 7febcffff700 1 -- 172.21.15.62:0/2295635406 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febd0143fb0 msgr2=0x7febd0152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.128 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.107+0000 7febcffff700 1 --2- 172.21.15.62:0/2295635406 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febd0143fb0 0x7febd0152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.107+0000 7febcffff700 1 -- 172.21.15.62:0/2295635406 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7febd0060230 msgr2=0x7febd0152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.107+0000 7febcffff700 1 --2- 172.21.15.62:0/2295635406 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7febd0060230 0x7febd0152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.129 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.107+0000 7febcffff700 1 -- 172.21.15.62:0/2295635406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc400b1e0 con 0x7febd005fa70 2021-12-17T19:14:00.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.107+0000 7febcf7fe700 1 --2- 172.21.15.62:0/2295635406 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7febd0060230 0x7febd0152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T19:14:00.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.107+0000 7febcffff700 1 --2- 172.21.15.62:0/2295635406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febd005fa70 0x7febd00b39d0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7febc4002f70 tx=0x7febc4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:00.130 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.107+0000 7febcd7fa700 1 -- 172.21.15.62:0/2295635406 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc40068b0 con 0x7febd005fa70 2021-12-17T19:14:00.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.107+0000 7febcd7fa700 1 -- 172.21.15.62:0/2295635406 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc400d8f0 con 0x7febd005fa70 2021-12-17T19:14:00.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.107+0000 7febd6791700 1 -- 172.21.15.62:0/2295635406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd013e550 con 0x7febd005fa70 2021-12-17T19:14:00.131 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.107+0000 7febcd7fa700 1 -- 172.21.15.62:0/2295635406 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc4011e20 con 0x7febd005fa70 2021-12-17T19:14:00.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.107+0000 7febd6791700 1 -- 172.21.15.62:0/2295635406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd00b3ec0 con 0x7febd005fa70 2021-12-17T19:14:00.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.107+0000 7febd6791700 1 -- 172.21.15.62:0/2295635406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd00573d0 con 0x7febd005fa70 2021-12-17T19:14:00.132 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.107+0000 7febcd7fa700 1 -- 172.21.15.62:0/2295635406 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7febc4025030 con 0x7febd005fa70 2021-12-17T19:14:00.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.111+0000 7febcd7fa700 1 --2- 172.21.15.62:0/2295635406 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7febb0053580 0x7febb0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.111+0000 7febcd7fa700 1 -- 172.21.15.62:0/2295635406 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7febc406c6d0 con 0x7febd005fa70 2021-12-17T19:14:00.133 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.111+0000 7febcf7fe700 1 --2- 172.21.15.62:0/2295635406 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7febb0053580 0x7febb0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.111+0000 7febcf7fe700 1 --2- 172.21.15.62:0/2295635406 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7febb0053580 0x7febb0055a40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7febc000b000 tx=0x7febc0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:00.134 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.115+0000 7febcd7fa700 1 -- 172.21.15.62:0/2295635406 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7febc4043b10 con 0x7febd005fa70 2021-12-17T19:14:00.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.243+0000 7febd6791700 1 -- 172.21.15.62:0/2295635406 --> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7febd013e6e0 con 0x7febb0053580 2021-12-17T19:14:00.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.243+0000 7febcd7fa700 1 -- 172.21.15.62:0/2295635406 <== mgr.4103 v2:172.21.15.109:6800/14658 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7febc0013420 con 0x7febb0053580 2021-12-17T19:14:00.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.243+0000 7febd6791700 1 -- 172.21.15.62:0/2295635406 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7febb0053580 msgr2=0x7febb0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.243+0000 7febd6791700 1 --2- 172.21.15.62:0/2295635406 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7febb0053580 0x7febb0055a40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7febc000b000 tx=0x7febc0009040).stop 2021-12-17T19:14:00.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.243+0000 7febd6791700 1 -- 172.21.15.62:0/2295635406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febd005fa70 msgr2=0x7febd00b39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.243+0000 7febd6791700 1 --2- 172.21.15.62:0/2295635406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febd005fa70 0x7febd00b39d0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7febc4002f70 tx=0x7febc4015000).stop 2021-12-17T19:14:00.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.243+0000 7febd6791700 1 -- 172.21.15.62:0/2295635406 shutdown_connections 2021-12-17T19:14:00.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.243+0000 7febd6791700 1 --2- 172.21.15.62:0/2295635406 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7febb0053580 0x7febb0055a40 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.243+0000 7febd6791700 1 --2- 172.21.15.62:0/2295635406 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7febd0143fb0 0x7febd0152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.243+0000 7febd6791700 1 --2- 172.21.15.62:0/2295635406 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7febd0060230 0x7febd0152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.243+0000 7febd6791700 1 --2- 172.21.15.62:0/2295635406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febd005fa70 0x7febd00b39d0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.243+0000 7febd6791700 1 -- 172.21.15.62:0/2295635406 >> 172.21.15.62:0/2295635406 conn(0x7febd00b53d0 msgr2=0x7febd00afd70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:14:00.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.243+0000 7febd6791700 1 -- 172.21.15.62:0/2295635406 shutdown_connections 2021-12-17T19:14:00.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.243+0000 7febd6791700 1 -- 172.21.15.62:0/2295635406 wait complete. 2021-12-17T19:14:00.258 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 5 to deep-scrub 2021-12-17T19:14:00.265 INFO:tasks.ceph:Scrubbing osd.6 2021-12-17T19:14:00.265 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2021-12-17T19:14:00.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.367+0000 7fd0a1c46700 1 Processor -- start 2021-12-17T19:14:00.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.367+0000 7fd0a1c46700 1 -- start start 2021-12-17T19:14:00.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.367+0000 7fd0a1c46700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fd09c05ca90 0x7fd09c0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.367+0000 7fd0a1c46700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd09c0604b0 0x7fd09c146230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.367+0000 7fd0a1c46700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09c05ce70 con 0x7fd09c0b34b0 2021-12-17T19:14:00.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.367+0000 7fd0a1c46700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09c0b2d70 con 0x7fd09c0604b0 2021-12-17T19:14:00.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.367+0000 7fd0a1c46700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09c0b3010 con 0x7fd09c05ca90 2021-12-17T19:14:00.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.367+0000 7fd0a1445700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd09c0604b0 0x7fd09c146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.384 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.367+0000 7fd0a1445700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd09c0604b0 0x7fd09c146230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57934/0 (socket says 172.21.15.62:57934) 2021-12-17T19:14:00.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.367+0000 7fd09bfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd09c0b34b0 0x7fd09c145b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41514/0 (socket says 172.21.15.62:41514) 2021-12-17T19:14:00.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.367+0000 7fd09bfff700 1 -- 172.21.15.62:0/384834351 learned_addr learned my addr 172.21.15.62:0/384834351 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T19:14:00.385 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.367+0000 7fd0a0c44700 1 --2- 172.21.15.62:0/384834351 >> v2:172.21.15.109:3300/0 conn(0x7fd09c05ca90 0x7fd09c0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd09b7fe700 1 -- 172.21.15.62:0/384834351 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478009248 0 0) 0x7fd09c05ce70 con 0x7fd09c0b34b0 2021-12-17T19:14:00.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd0a1445700 1 -- 172.21.15.62:0/384834351 >> v2:172.21.15.109:3300/0 conn(0x7fd09c05ca90 msgr2=0x7fd09c0b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:14:00.386 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd0a1445700 1 --2- 172.21.15.62:0/384834351 >> v2:172.21.15.109:3300/0 conn(0x7fd09c05ca90 0x7fd09c0b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd0a1445700 1 -- 172.21.15.62:0/384834351 >> v1:172.21.15.62:6789/0 conn(0x7fd09c0b34b0 legacy=0x7fd09c145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.387 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd0a1445700 1 -- 172.21.15.62:0/384834351 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c0b2ab0 con 0x7fd09c0604b0 2021-12-17T19:14:00.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd0a1445700 1 --2- 172.21.15.62:0/384834351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd09c0604b0 0x7fd09c146230 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7fd0940032f0 tx=0x7fd0940091d0).ready entity=mon.0 client_cookie=d48045b510c32fc8 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:00.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd09b7fe700 1 -- 172.21.15.62:0/384834351 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd09400b680 con 0x7fd09c0604b0 2021-12-17T19:14:00.388 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd09b7fe700 1 -- 172.21.15.62:0/384834351 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09400b7e0 con 0x7fd09c0604b0 2021-12-17T19:14:00.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd09b7fe700 1 -- 172.21.15.62:0/384834351 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd09400b950 con 0x7fd09c0604b0 2021-12-17T19:14:00.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd0a1c46700 1 -- 172.21.15.62:0/384834351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd09c0604b0 msgr2=0x7fd09c146230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.389 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd0a1c46700 1 --2- 172.21.15.62:0/384834351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd09c0604b0 0x7fd09c146230 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7fd0940032f0 tx=0x7fd0940091d0).stop 2021-12-17T19:14:00.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd0a1c46700 1 -- 172.21.15.62:0/384834351 shutdown_connections 2021-12-17T19:14:00.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd0a1c46700 1 --2- 172.21.15.62:0/384834351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd09c0604b0 0x7fd09c146230 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.390 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd0a1c46700 1 --2- 172.21.15.62:0/384834351 >> v2:172.21.15.109:3300/0 conn(0x7fd09c05ca90 0x7fd09c0b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd0a1c46700 1 -- 172.21.15.62:0/384834351 >> 172.21.15.62:0/384834351 conn(0x7fd09c05bcd0 msgr2=0x7fd09c062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:14:00.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd0a1c46700 1 -- 172.21.15.62:0/384834351 shutdown_connections 2021-12-17T19:14:00.391 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd0a1c46700 1 -- 172.21.15.62:0/384834351 wait complete. 2021-12-17T19:14:00.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd0a1c46700 1 Processor -- start 2021-12-17T19:14:00.392 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.371+0000 7fd0a1c46700 1 -- start start 2021-12-17T19:14:00.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1c46700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd09c05ca90 0x7fd09c065ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.396 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1c46700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd09c0604b0 0x7fd09c0a3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1c46700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd09c0b34b0 0x7fd09c141720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1c46700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c066bb0 con 0x7fd09c0b34b0 2021-12-17T19:14:00.397 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1c46700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0670f0 con 0x7fd09c05ca90 2021-12-17T19:14:00.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1c46700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0a5c90 con 0x7fd09c0604b0 2021-12-17T19:14:00.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1445700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd09c0b34b0 0x7fd09c141720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.398 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1445700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd09c0b34b0 0x7fd09c141720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57940/0 (socket says 172.21.15.62:57940) 2021-12-17T19:14:00.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1445700 1 -- 172.21.15.62:0/4200912505 learned_addr learned my addr 172.21.15.62:0/4200912505 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:14:00.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a0c44700 1 --2- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd09c05ca90 0x7fd09c065ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.399 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd09bfff700 1 --2- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd09c0604b0 0x7fd09c0a3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1445700 1 -- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd09c0604b0 msgr2=0x7fd09c0a3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1445700 1 --2- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd09c0604b0 0x7fd09c0a3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.400 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1445700 1 -- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd09c05ca90 msgr2=0x7fd09c065ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1445700 1 --2- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd09c05ca90 0x7fd09c065ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1445700 1 -- 172.21.15.62:0/4200912505 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd094009470 con 0x7fd09c0b34b0 2021-12-17T19:14:00.401 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a0c44700 1 --2- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fd09c05ca90 0x7fd09c065ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T19:14:00.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd09bfff700 1 --2- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fd09c0604b0 0x7fd09c0a3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-12-17T19:14:00.402 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1445700 1 --2- 172.21.15.62:0/4200912505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd09c0b34b0 0x7fd09c141720 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7fd0940032f0 tx=0x7fd094016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:00.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd099ffb700 1 -- 172.21.15.62:0/4200912505 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd09400b680 con 0x7fd09c0b34b0 2021-12-17T19:14:00.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd099ffb700 1 -- 172.21.15.62:0/4200912505 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0940107a0 con 0x7fd09c0b34b0 2021-12-17T19:14:00.403 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1c46700 1 -- 172.21.15.62:0/4200912505 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09c142970 con 0x7fd09c0b34b0 2021-12-17T19:14:00.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd099ffb700 1 -- 172.21.15.62:0/4200912505 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd094010b00 con 0x7fd09c0b34b0 2021-12-17T19:14:00.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1c46700 1 -- 172.21.15.62:0/4200912505 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09c066530 con 0x7fd09c0b34b0 2021-12-17T19:14:00.404 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.375+0000 7fd0a1c46700 1 -- 172.21.15.62:0/4200912505 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd09c0a5e90 con 0x7fd09c0b34b0 2021-12-17T19:14:00.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.379+0000 7fd099ffb700 1 -- 172.21.15.62:0/4200912505 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd094028070 con 0x7fd09c0b34b0 2021-12-17T19:14:00.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.379+0000 7fd099ffb700 1 --2- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd080053580 0x7fd080055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.405 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.379+0000 7fd099ffb700 1 -- 172.21.15.62:0/4200912505 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fd09406c760 con 0x7fd09c0b34b0 2021-12-17T19:14:00.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.379+0000 7fd0a0c44700 1 --2- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd080053580 0x7fd080055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.379+0000 7fd099ffb700 1 --2- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:6826/15028,v1:172.21.15.109:6827/15028] conn(0x7fd080059d00 0x7fd08005c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.406 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.379+0000 7fd099ffb700 1 -- 172.21.15.62:0/4200912505 --> [v2:172.21.15.109:6826/15028,v1:172.21.15.109:6827/15028] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd08005c780 con 0x7fd080059d00 2021-12-17T19:14:00.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.379+0000 7fd099ffb700 1 -- 172.21.15.62:0/4200912505 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=155) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd09406edf0 con 0x7fd09c0b34b0 2021-12-17T19:14:00.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.379+0000 7fd09bfff700 1 --2- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:6826/15028,v1:172.21.15.109:6827/15028] conn(0x7fd080059d00 0x7fd08005c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.407 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.379+0000 7fd0a0c44700 1 --2- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd080053580 0x7fd080055a40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fd08400b000 tx=0x7fd084008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:00.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.379+0000 7fd09bfff700 1 --2- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:6826/15028,v1:172.21.15.109:6827/15028] conn(0x7fd080059d00 0x7fd08005c120 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:00.408 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.379+0000 7fd099ffb700 1 -- 172.21.15.62:0/4200912505 <== osd.6 v2:172.21.15.109:6826/15028 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fd08005c780 con 0x7fd080059d00 2021-12-17T19:14:00.409 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.399+0000 7fd0a1c46700 1 -- 172.21.15.62:0/4200912505 --> [v2:172.21.15.109:6826/15028,v1:172.21.15.109:6827/15028] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd09c0b4500 con 0x7fd080059d00 2021-12-17T19:14:00.410 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.399+0000 7fd099ffb700 1 -- 172.21.15.62:0/4200912505 <== osd.6 v2:172.21.15.109:6826/15028 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd09c0b4500 con 0x7fd080059d00 2021-12-17T19:14:00.410 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T19:14:00.411 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-12-17T19:14:00.411 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T19:14:00.412 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.399+0000 7fd0a1c46700 1 -- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:6826/15028,v1:172.21.15.109:6827/15028] conn(0x7fd080059d00 msgr2=0x7fd08005c120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.399+0000 7fd0a1c46700 1 --2- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:6826/15028,v1:172.21.15.109:6827/15028] conn(0x7fd080059d00 0x7fd08005c120 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.399+0000 7fd0a1c46700 1 -- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd080053580 msgr2=0x7fd080055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.413 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.399+0000 7fd0a1c46700 1 --2- 172.21.15.62:0/4200912505 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fd080053580 0x7fd080055a40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fd08400b000 tx=0x7fd084008040).stop 2021-12-17T19:14:00.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.399+0000 7fd0a1c46700 1 -- 172.21.15.62:0/4200912505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd09c0b34b0 msgr2=0x7fd09c141720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.399+0000 7fd0a1c46700 1 --2- 172.21.15.62:0/4200912505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd09c0b34b0 0x7fd09c141720 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7fd0940032f0 tx=0x7fd094016000).stop 2021-12-17T19:14:00.414 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.399+0000 7fd0a1445700 1 -- 172.21.15.62:0/4200912505 reap_dead start 2021-12-17T19:14:00.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.399+0000 7fd0a1c46700 1 -- 172.21.15.62:0/4200912505 shutdown_connections 2021-12-17T19:14:00.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.399+0000 7fd0a1c46700 1 -- 172.21.15.62:0/4200912505 >> 172.21.15.62:0/4200912505 conn(0x7fd09c05bcd0 msgr2=0x7fd09c1458f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:14:00.415 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.399+0000 7fd0a1c46700 1 -- 172.21.15.62:0/4200912505 shutdown_connections 2021-12-17T19:14:00.416 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.399+0000 7fd0a1c46700 1 -- 172.21.15.62:0/4200912505 wait complete. 2021-12-17T19:14:00.420 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2021-12-17T19:14:00.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f1071611700 1 Processor -- start 2021-12-17T19:14:00.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f1071611700 1 -- start start 2021-12-17T19:14:00.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f1071611700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f106c0afba0 0x7f106c0b0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f1071611700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106c13fe40 con 0x7f106c0ac650 2021-12-17T19:14:00.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f1071611700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106c1400e0 con 0x7f106c0ae4c0 2021-12-17T19:14:00.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f1071611700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106c0af660 con 0x7f106c0afba0 2021-12-17T19:14:00.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f106bfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f106c0ac650 0x7f106c140820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41528/0 (socket says 172.21.15.62:41528) 2021-12-17T19:14:00.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f106bfff700 1 -- 172.21.15.62:0/3714868915 learned_addr learned my addr 172.21.15.62:0/3714868915 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T19:14:00.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f1070e10700 1 --2- 172.21.15.62:0/3714868915 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f106c0afba0 0x7f106c0b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f106b7fe700 1 -- 172.21.15.62:0/3714868915 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552067980 0 0) 0x7f106c13fe40 con 0x7f106c0ac650 2021-12-17T19:14:00.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f106b7fe700 1 -- 172.21.15.62:0/3714868915 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f104c003260 con 0x7f106c0ac650 2021-12-17T19:14:00.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f106b7fe700 1 -- 172.21.15.62:0/3714868915 <== mon.1 v1:172.21.15.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502783865 0 0) 0x7f106c1400e0 con 0x7f106c0ae4c0 2021-12-17T19:14:00.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f1070e10700 1 -- 172.21.15.62:0/3714868915 >> v1:172.21.15.109:6789/0 conn(0x7f106c0ae4c0 legacy=0x7f106c0aca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f1070e10700 1 -- 172.21.15.62:0/3714868915 >> v1:172.21.15.62:6789/0 conn(0x7f106c0ac650 legacy=0x7f106c140820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f1070e10700 1 -- 172.21.15.62:0/3714868915 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c140380 con 0x7f106c0afba0 2021-12-17T19:14:00.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f1070e10700 1 --2- 172.21.15.62:0/3714868915 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f106c0afba0 0x7f106c0b0010 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f10640032f0 tx=0x7f10640091d0).ready entity=mon.2 client_cookie=a732d73658d5904d server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:00.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f106b7fe700 1 -- 172.21.15.62:0/3714868915 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f106400b6c0 con 0x7f106c0afba0 2021-12-17T19:14:00.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f106b7fe700 1 -- 172.21.15.62:0/3714868915 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106400b820 con 0x7f106c0afba0 2021-12-17T19:14:00.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.527+0000 7f106b7fe700 1 -- 172.21.15.62:0/3714868915 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f106400b990 con 0x7f106c0afba0 2021-12-17T19:14:00.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1071611700 1 -- 172.21.15.62:0/3714868915 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f106c0afba0 msgr2=0x7f106c0b0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1071611700 1 --2- 172.21.15.62:0/3714868915 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f106c0afba0 0x7f106c0b0010 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f10640032f0 tx=0x7f10640091d0).stop 2021-12-17T19:14:00.549 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1071611700 1 -- 172.21.15.62:0/3714868915 shutdown_connections 2021-12-17T19:14:00.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1071611700 1 --2- 172.21.15.62:0/3714868915 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f106c0afba0 0x7f106c0b0010 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1071611700 1 -- 172.21.15.62:0/3714868915 >> 172.21.15.62:0/3714868915 conn(0x7f106c0623c0 msgr2=0x7f106c0627d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:14:00.550 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1071611700 1 -- 172.21.15.62:0/3714868915 shutdown_connections 2021-12-17T19:14:00.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1071611700 1 -- 172.21.15.62:0/3714868915 wait complete. 2021-12-17T19:14:00.551 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1071611700 1 Processor -- start 2021-12-17T19:14:00.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1071611700 1 -- start start 2021-12-17T19:14:00.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1071611700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f106c0ac650 0x7f106c13e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.552 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1071611700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f106c0ae4c0 0x7f106c066690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1071611700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f106c0afba0 0x7f106c0651d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1071611700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c145150 con 0x7f106c0afba0 2021-12-17T19:14:00.553 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1071611700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c1453f0 con 0x7f106c0ae4c0 2021-12-17T19:14:00.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1071611700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106c145690 con 0x7f106c0ac650 2021-12-17T19:14:00.554 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1070e10700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f106c0afba0 0x7f106c0651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1070e10700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f106c0afba0 0x7f106c0651d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57958/0 (socket says 172.21.15.62:57958) 2021-12-17T19:14:00.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1070e10700 1 -- 172.21.15.62:0/4026178119 learned_addr learned my addr 172.21.15.62:0/4026178119 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:14:00.555 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f106bfff700 1 --2- 172.21.15.62:0/4026178119 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f106c0ac650 0x7f106c13e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1063fff700 1 --2- 172.21.15.62:0/4026178119 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f106c0ae4c0 0x7f106c066690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1070e10700 1 -- 172.21.15.62:0/4026178119 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f106c0ac650 msgr2=0x7f106c13e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.556 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1070e10700 1 --2- 172.21.15.62:0/4026178119 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f106c0ac650 0x7f106c13e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1070e10700 1 -- 172.21.15.62:0/4026178119 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f106c0ae4c0 msgr2=0x7f106c066690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1070e10700 1 --2- 172.21.15.62:0/4026178119 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f106c0ae4c0 0x7f106c066690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.557 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1070e10700 1 -- 172.21.15.62:0/4026178119 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1064009470 con 0x7f106c0afba0 2021-12-17T19:14:00.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1070e10700 1 --2- 172.21.15.62:0/4026178119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f106c0afba0 0x7f106c0651d0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f10640032f0 tx=0x7f1064016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:00.558 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1069ffb700 1 -- 172.21.15.62:0/4026178119 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f106400b990 con 0x7f106c0afba0 2021-12-17T19:14:00.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1069ffb700 1 -- 172.21.15.62:0/4026178119 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10640205f0 con 0x7f106c0afba0 2021-12-17T19:14:00.559 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1071611700 1 -- 172.21.15.62:0/4026178119 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106c066b80 con 0x7f106c0afba0 2021-12-17T19:14:00.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1069ffb700 1 -- 172.21.15.62:0/4026178119 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f106400b6c0 con 0x7f106c0afba0 2021-12-17T19:14:00.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.531+0000 7f1071611700 1 -- 172.21.15.62:0/4026178119 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106c0656c0 con 0x7f106c0afba0 2021-12-17T19:14:00.560 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.535+0000 7f1069ffb700 1 -- 172.21.15.62:0/4026178119 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1064027030 con 0x7f106c0afba0 2021-12-17T19:14:00.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.535+0000 7f1071611700 1 -- 172.21.15.62:0/4026178119 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106c13f070 con 0x7f106c0afba0 2021-12-17T19:14:00.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.535+0000 7f1069ffb700 1 --2- 172.21.15.62:0/4026178119 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1050053640 0x7f1050055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.561 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.535+0000 7f1069ffb700 1 -- 172.21.15.62:0/4026178119 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f106406c700 con 0x7f106c0afba0 2021-12-17T19:14:00.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.535+0000 7f106bfff700 1 --2- 172.21.15.62:0/4026178119 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1050053640 0x7f1050055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.562 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.535+0000 7f106bfff700 1 --2- 172.21.15.62:0/4026178119 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1050053640 0x7f1050055b00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f105c00d000 tx=0x7f105c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:00.563 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.539+0000 7f1069ffb700 1 -- 172.21.15.62:0/4026178119 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1064043a30 con 0x7f106c0afba0 2021-12-17T19:14:00.678 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.667+0000 7f1071611700 1 -- 172.21.15.62:0/4026178119 --> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f106c0573d0 con 0x7f1050053640 2021-12-17T19:14:00.679 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.671+0000 7f1069ffb700 1 -- 172.21.15.62:0/4026178119 <== mgr.4103 v2:172.21.15.109:6800/14658 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f106c0573d0 con 0x7f1050053640 2021-12-17T19:14:00.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.671+0000 7f1071611700 1 -- 172.21.15.62:0/4026178119 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1050053640 msgr2=0x7f1050055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.682 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.671+0000 7f1071611700 1 --2- 172.21.15.62:0/4026178119 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1050053640 0x7f1050055b00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f105c00d000 tx=0x7f105c009040).stop 2021-12-17T19:14:00.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.671+0000 7f1071611700 1 -- 172.21.15.62:0/4026178119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f106c0afba0 msgr2=0x7f106c0651d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.671+0000 7f1071611700 1 --2- 172.21.15.62:0/4026178119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f106c0afba0 0x7f106c0651d0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f10640032f0 tx=0x7f1064016000).stop 2021-12-17T19:14:00.683 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.671+0000 7f1071611700 1 -- 172.21.15.62:0/4026178119 shutdown_connections 2021-12-17T19:14:00.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.671+0000 7f1071611700 1 --2- 172.21.15.62:0/4026178119 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f1050053640 0x7f1050055b00 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.684 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.671+0000 7f1071611700 1 --2- 172.21.15.62:0/4026178119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f106c0afba0 0x7f106c0651d0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.671+0000 7f1071611700 1 --2- 172.21.15.62:0/4026178119 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f106c0ae4c0 0x7f106c066690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.671+0000 7f1071611700 1 --2- 172.21.15.62:0/4026178119 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f106c0ac650 0x7f106c13e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.685 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.671+0000 7f1071611700 1 -- 172.21.15.62:0/4026178119 >> 172.21.15.62:0/4026178119 conn(0x7f106c0623c0 msgr2=0x7f106c0b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:14:00.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.671+0000 7f1071611700 1 -- 172.21.15.62:0/4026178119 shutdown_connections 2021-12-17T19:14:00.686 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.671+0000 7f1071611700 1 -- 172.21.15.62:0/4026178119 wait complete. 2021-12-17T19:14:00.687 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 6 to deep-scrub 2021-12-17T19:14:00.693 INFO:tasks.ceph:Scrubbing osd.7 2021-12-17T19:14:00.694 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2021-12-17T19:14:00.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.795+0000 7fb1958cf700 1 Processor -- start 2021-12-17T19:14:00.805 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.795+0000 7fb1958cf700 1 -- start start 2021-12-17T19:14:00.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.795+0000 7fb1958cf700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb19005ca90 0x7fb1900b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.795+0000 7fb1958cf700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fb1900604b0 0x7fb190146230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.795+0000 7fb1958cf700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19005ce70 con 0x7fb1900b34b0 2021-12-17T19:14:00.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.795+0000 7fb1958cf700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1900b2d70 con 0x7fb19005ca90 2021-12-17T19:14:00.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.795+0000 7fb1958cf700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1900b3010 con 0x7fb1900604b0 2021-12-17T19:14:00.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.795+0000 7fb1948cd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb19005ca90 0x7fb1900b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.795+0000 7fb1948cd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb19005ca90 0x7fb1900b2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57962/0 (socket says 172.21.15.62:57962) 2021-12-17T19:14:00.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.795+0000 7fb1948cd700 1 -- 172.21.15.62:0/2519799750 learned_addr learned my addr 172.21.15.62:0/2519799750 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:14:00.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.795+0000 7fb1950ce700 1 --2- 172.21.15.62:0/2519799750 >> v2:172.21.15.109:3300/0 conn(0x7fb1900604b0 0x7fb190146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.795+0000 7fb1948cd700 1 -- 172.21.15.62:0/2519799750 >> v2:172.21.15.109:3300/0 conn(0x7fb1900604b0 msgr2=0x7fb190146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:14:00.826 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.795+0000 7fb1948cd700 1 --2- 172.21.15.62:0/2519799750 >> v2:172.21.15.109:3300/0 conn(0x7fb1900604b0 0x7fb190146230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.827 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.795+0000 7fb1948cd700 1 -- 172.21.15.62:0/2519799750 >> v1:172.21.15.109:6789/0 conn(0x7fb1900b34b0 legacy=0x7fb190145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.795+0000 7fb1948cd700 1 -- 172.21.15.62:0/2519799750 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1900b2ab0 con 0x7fb19005ca90 2021-12-17T19:14:00.828 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.799+0000 7fb1948cd700 1 --2- 172.21.15.62:0/2519799750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb19005ca90 0x7fb1900b2470 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7fb184002f70 tx=0x7fb184006eb0).ready entity=mon.0 client_cookie=dbc5bc6db69ac44 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:00.829 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.799+0000 7fb18f7fe700 1 -- 172.21.15.62:0/2519799750 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb18400d5c0 con 0x7fb19005ca90 2021-12-17T19:14:00.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.799+0000 7fb18f7fe700 1 -- 172.21.15.62:0/2519799750 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb184000e90 con 0x7fb19005ca90 2021-12-17T19:14:00.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.799+0000 7fb18f7fe700 1 -- 172.21.15.62:0/2519799750 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb18400d950 con 0x7fb19005ca90 2021-12-17T19:14:00.831 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.799+0000 7fb1958cf700 1 -- 172.21.15.62:0/2519799750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb19005ca90 msgr2=0x7fb1900b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.799+0000 7fb1958cf700 1 --2- 172.21.15.62:0/2519799750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb19005ca90 0x7fb1900b2470 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7fb184002f70 tx=0x7fb184006eb0).stop 2021-12-17T19:14:00.832 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.799+0000 7fb1958cf700 1 -- 172.21.15.62:0/2519799750 shutdown_connections 2021-12-17T19:14:00.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.799+0000 7fb1958cf700 1 --2- 172.21.15.62:0/2519799750 >> v2:172.21.15.109:3300/0 conn(0x7fb1900604b0 0x7fb190146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.799+0000 7fb1958cf700 1 --2- 172.21.15.62:0/2519799750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb19005ca90 0x7fb1900b2470 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.799+0000 7fb1958cf700 1 -- 172.21.15.62:0/2519799750 >> 172.21.15.62:0/2519799750 conn(0x7fb19005bcd0 msgr2=0x7fb190062430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:14:00.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.799+0000 7fb1958cf700 1 -- 172.21.15.62:0/2519799750 shutdown_connections 2021-12-17T19:14:00.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.799+0000 7fb1958cf700 1 -- 172.21.15.62:0/2519799750 wait complete. 2021-12-17T19:14:00.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.799+0000 7fb1958cf700 1 Processor -- start 2021-12-17T19:14:00.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.799+0000 7fb1958cf700 1 -- start start 2021-12-17T19:14:00.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.799+0000 7fb1958cf700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb19005ca90 0x7fb190064520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.799+0000 7fb1958cf700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb1900604b0 0x7fb1900659b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.799+0000 7fb1958cf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1900b34b0 0x7fb190065ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb1958cf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb190153660 con 0x7fb1900b34b0 2021-12-17T19:14:00.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb1958cf700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb190066750 con 0x7fb1900604b0 2021-12-17T19:14:00.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb1958cf700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1900a3fd0 con 0x7fb19005ca90 2021-12-17T19:14:00.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb1950ce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1900b34b0 0x7fb190065ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb1950ce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1900b34b0 0x7fb190065ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57972/0 (socket says 172.21.15.62:57972) 2021-12-17T19:14:00.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb1950ce700 1 -- 172.21.15.62:0/1881258002 learned_addr learned my addr 172.21.15.62:0/1881258002 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:14:00.840 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb18ffff700 1 --2- 172.21.15.62:0/1881258002 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb1900604b0 0x7fb1900659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb1948cd700 1 --2- 172.21.15.62:0/1881258002 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb19005ca90 0x7fb190064520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb1950ce700 1 -- 172.21.15.62:0/1881258002 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb19005ca90 msgr2=0x7fb190064520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb1950ce700 1 --2- 172.21.15.62:0/1881258002 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fb19005ca90 0x7fb190064520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb1950ce700 1 -- 172.21.15.62:0/1881258002 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb1900604b0 msgr2=0x7fb1900659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.842 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb1950ce700 1 --2- 172.21.15.62:0/1881258002 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fb1900604b0 0x7fb1900659b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb1950ce700 1 -- 172.21.15.62:0/1881258002 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18400b1e0 con 0x7fb1900b34b0 2021-12-17T19:14:00.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb1950ce700 1 --2- 172.21.15.62:0/1881258002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1900b34b0 0x7fb190065ea0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7fb188006e00 tx=0x7fb1880091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:00.843 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb18dffb700 1 -- 172.21.15.62:0/1881258002 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb18800c640 con 0x7fb1900b34b0 2021-12-17T19:14:00.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb18dffb700 1 -- 172.21.15.62:0/1881258002 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18800c7a0 con 0x7fb1900b34b0 2021-12-17T19:14:00.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb1958cf700 1 -- 172.21.15.62:0/1881258002 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1900a4270 con 0x7fb1900b34b0 2021-12-17T19:14:00.844 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb18dffb700 1 -- 172.21.15.62:0/1881258002 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb18800cb00 con 0x7fb1900b34b0 2021-12-17T19:14:00.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb1958cf700 1 -- 172.21.15.62:0/1881258002 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1900637d0 con 0x7fb1900b34b0 2021-12-17T19:14:00.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb1958cf700 1 -- 172.21.15.62:0/1881258002 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb1900665e0 con 0x7fb1900b34b0 2021-12-17T19:14:00.845 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb18dffb700 1 -- 172.21.15.62:0/1881258002 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb188022070 con 0x7fb1900b34b0 2021-12-17T19:14:00.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb18dffb700 1 --2- 172.21.15.62:0/1881258002 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb170053610 0x7fb170055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb18dffb700 1 -- 172.21.15.62:0/1881258002 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fb18806bcf0 con 0x7fb1900b34b0 2021-12-17T19:14:00.846 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb18dffb700 1 --2- 172.21.15.62:0/1881258002 >> [v2:172.21.15.109:6818/15018,v1:172.21.15.109:6819/15018] conn(0x7fb170059d90 0x7fb17005c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb18dffb700 1 -- 172.21.15.62:0/1881258002 --> [v2:172.21.15.109:6818/15018,v1:172.21.15.109:6819/15018] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb17005c770 con 0x7fb170059d90 2021-12-17T19:14:00.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb18dffb700 1 -- 172.21.15.62:0/1881258002 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=155) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb18806e380 con 0x7fb1900b34b0 2021-12-17T19:14:00.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.803+0000 7fb1948cd700 1 --2- 172.21.15.62:0/1881258002 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb170053610 0x7fb170055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.807+0000 7fb18ffff700 1 --2- 172.21.15.62:0/1881258002 >> [v2:172.21.15.109:6818/15018,v1:172.21.15.109:6819/15018] conn(0x7fb170059d90 0x7fb17005c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.807+0000 7fb1948cd700 1 --2- 172.21.15.62:0/1881258002 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb170053610 0x7fb170055ad0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fb18401c000 tx=0x7fb184015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:00.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.807+0000 7fb18ffff700 1 --2- 172.21.15.62:0/1881258002 >> [v2:172.21.15.109:6818/15018,v1:172.21.15.109:6819/15018] conn(0x7fb170059d90 0x7fb17005c1b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:00.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.807+0000 7fb18dffb700 1 -- 172.21.15.62:0/1881258002 <== osd.7 v2:172.21.15.109:6818/15018 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fb17005c770 con 0x7fb170059d90 2021-12-17T19:14:00.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.827+0000 7fb1958cf700 1 -- 172.21.15.62:0/1881258002 --> [v2:172.21.15.109:6818/15018,v1:172.21.15.109:6819/15018] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb190145c10 con 0x7fb170059d90 2021-12-17T19:14:00.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.827+0000 7fb18dffb700 1 -- 172.21.15.62:0/1881258002 <== osd.7 v2:172.21.15.109:6818/15018 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb190145c10 con 0x7fb170059d90 2021-12-17T19:14:00.851 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2021-12-17T19:14:00.851 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-12-17T19:14:00.852 INFO:teuthology.orchestra.run.smithi062.stdout:} 2021-12-17T19:14:00.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.827+0000 7fb1958cf700 1 -- 172.21.15.62:0/1881258002 >> [v2:172.21.15.109:6818/15018,v1:172.21.15.109:6819/15018] conn(0x7fb170059d90 msgr2=0x7fb17005c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.827+0000 7fb1958cf700 1 --2- 172.21.15.62:0/1881258002 >> [v2:172.21.15.109:6818/15018,v1:172.21.15.109:6819/15018] conn(0x7fb170059d90 0x7fb17005c1b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.831+0000 7fb1958cf700 1 -- 172.21.15.62:0/1881258002 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb170053610 msgr2=0x7fb170055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.831+0000 7fb1958cf700 1 --2- 172.21.15.62:0/1881258002 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fb170053610 0x7fb170055ad0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fb18401c000 tx=0x7fb184015000).stop 2021-12-17T19:14:00.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.831+0000 7fb1958cf700 1 -- 172.21.15.62:0/1881258002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1900b34b0 msgr2=0x7fb190065ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.855 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.831+0000 7fb1958cf700 1 --2- 172.21.15.62:0/1881258002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1900b34b0 0x7fb190065ea0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7fb188006e00 tx=0x7fb1880091d0).stop 2021-12-17T19:14:00.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.831+0000 7fb1950ce700 1 -- 172.21.15.62:0/1881258002 reap_dead start 2021-12-17T19:14:00.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.831+0000 7fb1958cf700 1 -- 172.21.15.62:0/1881258002 shutdown_connections 2021-12-17T19:14:00.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.831+0000 7fb1958cf700 1 -- 172.21.15.62:0/1881258002 >> 172.21.15.62:0/1881258002 conn(0x7fb19005bcd0 msgr2=0x7fb190144610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:14:00.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.831+0000 7fb1958cf700 1 -- 172.21.15.62:0/1881258002 shutdown_connections 2021-12-17T19:14:00.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.831+0000 7fb1958cf700 1 -- 172.21.15.62:0/1881258002 wait complete. 2021-12-17T19:14:00.858 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2021-12-17T19:14:00.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.955+0000 7f42cb3c7700 1 Processor -- start 2021-12-17T19:14:00.965 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.955+0000 7f42cb3c7700 1 -- start start 2021-12-17T19:14:00.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cb3c7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42c413ce80 0x7f42c4142f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.968 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cb3c7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42c41433f0 0x7f42c4143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cb3c7700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c4146e30 con 0x7f42c4062620 2021-12-17T19:14:00.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cb3c7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c4143d00 con 0x7f42c413ce80 2021-12-17T19:14:00.969 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cb3c7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4062a00 con 0x7f42c41433f0 2021-12-17T19:14:00.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42c9bc4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42c413ce80 0x7f42c4142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.970 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42ca3c5700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f42c4062620 0x7f42c413c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41558/0 (socket says 172.21.15.62:41558) 2021-12-17T19:14:00.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42ca3c5700 1 -- 172.21.15.62:0/633531625 learned_addr learned my addr 172.21.15.62:0/633531625 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-12-17T19:14:00.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cabc6700 1 --2- 172.21.15.62:0/633531625 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42c41433f0 0x7f42c4143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.971 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cabc6700 1 -- 172.21.15.62:0/633531625 >> v2:172.21.15.62:3300/0 conn(0x7f42c413ce80 msgr2=0x7f42c4142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:14:00.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cabc6700 1 --2- 172.21.15.62:0/633531625 >> v2:172.21.15.62:3300/0 conn(0x7f42c413ce80 0x7f42c4142f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cabc6700 1 -- 172.21.15.62:0/633531625 >> v1:172.21.15.62:6789/0 conn(0x7f42c4062620 legacy=0x7f42c413c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.972 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cabc6700 1 -- 172.21.15.62:0/633531625 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c40b59e0 con 0x7f42c41433f0 2021-12-17T19:14:00.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42c93c3700 1 -- 172.21.15.62:0/633531625 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122564356 0 0) 0x7f42c4146e30 con 0x7f42c4062620 2021-12-17T19:14:00.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42c9bc4700 1 --2- 172.21.15.62:0/633531625 >> v2:172.21.15.62:3300/0 conn(0x7f42c413ce80 0x7f42c4142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T19:14:00.973 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cabc6700 1 --2- 172.21.15.62:0/633531625 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42c41433f0 0x7f42c4143810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f42bc0032f0 tx=0x7f42bc0091d0).ready entity=mon.2 client_cookie=882909f5dbf7d8ac server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:00.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42c93c3700 1 -- 172.21.15.62:0/633531625 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42bc00b6c0 con 0x7f42c41433f0 2021-12-17T19:14:00.974 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42c93c3700 1 -- 172.21.15.62:0/633531625 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc00b820 con 0x7f42c41433f0 2021-12-17T19:14:00.975 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42c93c3700 1 -- 172.21.15.62:0/633531625 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42bc00b990 con 0x7f42c41433f0 2021-12-17T19:14:00.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cb3c7700 1 -- 172.21.15.62:0/633531625 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42c41433f0 msgr2=0x7f42c4143810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.979 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cb3c7700 1 --2- 172.21.15.62:0/633531625 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42c41433f0 0x7f42c4143810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f42bc0032f0 tx=0x7f42bc0091d0).stop 2021-12-17T19:14:00.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cb3c7700 1 -- 172.21.15.62:0/633531625 shutdown_connections 2021-12-17T19:14:00.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cb3c7700 1 --2- 172.21.15.62:0/633531625 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42c41433f0 0x7f42c4143810 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.980 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cb3c7700 1 --2- 172.21.15.62:0/633531625 >> v2:172.21.15.62:3300/0 conn(0x7f42c413ce80 0x7f42c4142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cb3c7700 1 -- 172.21.15.62:0/633531625 >> 172.21.15.62:0/633531625 conn(0x7f42c405c750 msgr2=0x7f42c405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:14:00.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cb3c7700 1 -- 172.21.15.62:0/633531625 shutdown_connections 2021-12-17T19:14:00.981 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.959+0000 7f42cb3c7700 1 -- 172.21.15.62:0/633531625 wait complete. 2021-12-17T19:14:00.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42cb3c7700 1 Processor -- start 2021-12-17T19:14:00.982 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42cb3c7700 1 -- start start 2021-12-17T19:14:00.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42cb3c7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42c4062620 0x7f42c40b8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42cb3c7700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42c413ce80 0x7f42c40656b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.983 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42cb3c7700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42c41433f0 0x7f42c4062bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42cb3c7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4064420 con 0x7f42c4062620 2021-12-17T19:14:00.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42cb3c7700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40669d0 con 0x7f42c413ce80 2021-12-17T19:14:00.984 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42cb3c7700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4140750 con 0x7f42c41433f0 2021-12-17T19:14:00.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42ca3c5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42c4062620 0x7f42c40b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42ca3c5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42c4062620 0x7f42c40b8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57984/0 (socket says 172.21.15.62:57984) 2021-12-17T19:14:00.985 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42ca3c5700 1 -- 172.21.15.62:0/1875317261 learned_addr learned my addr 172.21.15.62:0/1875317261 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:14:00.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42cabc6700 1 --2- 172.21.15.62:0/1875317261 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42c41433f0 0x7f42c4062bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42c9bc4700 1 --2- 172.21.15.62:0/1875317261 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42c413ce80 0x7f42c40656b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.986 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42ca3c5700 1 -- 172.21.15.62:0/1875317261 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42c41433f0 msgr2=0x7f42c4062bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42ca3c5700 1 --2- 172.21.15.62:0/1875317261 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42c41433f0 0x7f42c4062bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42ca3c5700 1 -- 172.21.15.62:0/1875317261 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42c413ce80 msgr2=0x7f42c40656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:00.987 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42ca3c5700 1 --2- 172.21.15.62:0/1875317261 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42c413ce80 0x7f42c40656b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:00.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42ca3c5700 1 -- 172.21.15.62:0/1875317261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b800b180 con 0x7f42c4062620 2021-12-17T19:14:00.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42ca3c5700 1 --2- 172.21.15.62:0/1875317261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42c4062620 0x7f42c40b8120 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7f42c4064d70 tx=0x7f42c0007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:00.988 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42b77fe700 1 -- 172.21.15.62:0/1875317261 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42c00070d0 con 0x7f42c4062620 2021-12-17T19:14:00.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42b77fe700 1 -- 172.21.15.62:0/1875317261 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c0007230 con 0x7f42c4062620 2021-12-17T19:14:00.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42cb3c7700 1 -- 172.21.15.62:0/1875317261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42bc009470 con 0x7f42c4062620 2021-12-17T19:14:00.989 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.963+0000 7f42b77fe700 1 -- 172.21.15.62:0/1875317261 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42c0005610 con 0x7f42c4062620 2021-12-17T19:14:00.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.967+0000 7f42cb3c7700 1 -- 172.21.15.62:0/1875317261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c4140440 con 0x7f42c4062620 2021-12-17T19:14:00.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.967+0000 7f42b77fe700 1 -- 172.21.15.62:0/1875317261 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f42c0010070 con 0x7f42c4062620 2021-12-17T19:14:00.990 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.967+0000 7f42cb3c7700 1 -- 172.21.15.62:0/1875317261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c4065060 con 0x7f42c4062620 2021-12-17T19:14:00.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.967+0000 7f42b77fe700 1 --2- 172.21.15.62:0/1875317261 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f42a4053580 0x7f42a4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:00.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.967+0000 7f42b77fe700 1 -- 172.21.15.62:0/1875317261 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f42c006ad10 con 0x7f42c4062620 2021-12-17T19:14:00.991 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.967+0000 7f42c9bc4700 1 --2- 172.21.15.62:0/1875317261 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f42a4053580 0x7f42a4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:00.992 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.967+0000 7f42c9bc4700 1 --2- 172.21.15.62:0/1875317261 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f42a4053580 0x7f42a4055a40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f42b800b000 tx=0x7f42b8006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:00.993 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:00.975+0000 7f42b77fe700 1 -- 172.21.15.62:0/1875317261 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f42c00420b0 con 0x7f42c4062620 2021-12-17T19:14:01.111 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.099+0000 7f42cb3c7700 1 -- 172.21.15.62:0/1875317261 --> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f42c4065410 con 0x7f42a4053580 2021-12-17T19:14:01.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.103+0000 7f42b77fe700 1 -- 172.21.15.62:0/1875317261 <== mgr.4103 v2:172.21.15.109:6800/14658 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f42b800be10 con 0x7f42a4053580 2021-12-17T19:14:01.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.103+0000 7f42cb3c7700 1 -- 172.21.15.62:0/1875317261 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f42a4053580 msgr2=0x7f42a4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:01.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.103+0000 7f42cb3c7700 1 --2- 172.21.15.62:0/1875317261 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f42a4053580 0x7f42a4055a40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f42b800b000 tx=0x7f42b8006df0).stop 2021-12-17T19:14:01.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.103+0000 7f42cb3c7700 1 -- 172.21.15.62:0/1875317261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42c4062620 msgr2=0x7f42c40b8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:01.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.103+0000 7f42cb3c7700 1 --2- 172.21.15.62:0/1875317261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42c4062620 0x7f42c40b8120 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7f42c4064d70 tx=0x7f42c0007ac0).stop 2021-12-17T19:14:01.114 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.103+0000 7f42cb3c7700 1 -- 172.21.15.62:0/1875317261 shutdown_connections 2021-12-17T19:14:01.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.103+0000 7f42cb3c7700 1 --2- 172.21.15.62:0/1875317261 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f42a4053580 0x7f42a4055a40 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:01.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.103+0000 7f42cb3c7700 1 --2- 172.21.15.62:0/1875317261 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f42c41433f0 0x7f42c4062bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:01.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.103+0000 7f42cb3c7700 1 --2- 172.21.15.62:0/1875317261 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f42c413ce80 0x7f42c40656b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:01.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.103+0000 7f42cb3c7700 1 --2- 172.21.15.62:0/1875317261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42c4062620 0x7f42c40b8120 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:01.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.103+0000 7f42cb3c7700 1 -- 172.21.15.62:0/1875317261 >> 172.21.15.62:0/1875317261 conn(0x7f42c405c750 msgr2=0x7f42c40b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:14:01.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.103+0000 7f42cb3c7700 1 -- 172.21.15.62:0/1875317261 shutdown_connections 2021-12-17T19:14:01.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.103+0000 7f42cb3c7700 1 -- 172.21.15.62:0/1875317261 wait complete. 2021-12-17T19:14:01.118 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 7 to deep-scrub 2021-12-17T19:14:01.124 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-12-17T19:14:01.230 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1359e700 1 Processor -- start 2021-12-17T19:14:01.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1359e700 1 -- start start 2021-12-17T19:14:01.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9d140acbd0 0x7f9d1405fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:01.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9d140b19c0 0x7f9d140b1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:01.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1359e700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d14067530 con 0x7f9d140b1520 2021-12-17T19:14:01.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d140b6270 con 0x7f9d140acbd0 2021-12-17T19:14:01.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1359e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140acfb0 con 0x7f9d140b19c0 2021-12-17T19:14:01.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1259c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9d140acbd0 0x7f9d1405fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:01.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1259c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9d140acbd0 0x7f9d1405fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57994/0 (socket says 172.21.15.62:57994) 2021-12-17T19:14:01.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1259c700 1 -- 172.21.15.62:0/3076240623 learned_addr learned my addr 172.21.15.62:0/3076240623 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:14:01.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d11d9b700 1 --2- 172.21.15.62:0/3076240623 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9d140b19c0 0x7f9d140b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:01.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1259c700 1 -- 172.21.15.62:0/3076240623 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9d140b19c0 msgr2=0x7f9d140b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:14:01.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1259c700 1 --2- 172.21.15.62:0/3076240623 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9d140b19c0 0x7f9d140b1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:01.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1259c700 1 -- 172.21.15.62:0/3076240623 >> v1:172.21.15.109:6789/0 conn(0x7f9d140b1520 legacy=0x7f9d140b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:01.238 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1259c700 1 -- 172.21.15.62:0/3076240623 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d14140290 con 0x7f9d140acbd0 2021-12-17T19:14:01.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1259c700 1 --2- 172.21.15.62:0/3076240623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d140acbd0 0x7f9d1405fbd0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f9d04002f70 tx=0x7f9d04006eb0).ready entity=mon.0 client_cookie=203cc48c6a2518d5 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:01.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1159a700 1 -- 172.21.15.62:0/3076240623 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d0400d570 con 0x7f9d140acbd0 2021-12-17T19:14:01.239 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1159a700 1 -- 172.21.15.62:0/3076240623 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d04000e90 con 0x7f9d140acbd0 2021-12-17T19:14:01.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1159a700 1 -- 172.21.15.62:0/3076240623 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d0400d900 con 0x7f9d140acbd0 2021-12-17T19:14:01.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1359e700 1 -- 172.21.15.62:0/3076240623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d140acbd0 msgr2=0x7f9d1405fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:01.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1359e700 1 --2- 172.21.15.62:0/3076240623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d140acbd0 0x7f9d1405fbd0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f9d04002f70 tx=0x7f9d04006eb0).stop 2021-12-17T19:14:01.240 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1359e700 1 -- 172.21.15.62:0/3076240623 shutdown_connections 2021-12-17T19:14:01.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1359e700 1 --2- 172.21.15.62:0/3076240623 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9d140b19c0 0x7f9d140b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:01.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1359e700 1 --2- 172.21.15.62:0/3076240623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d140acbd0 0x7f9d1405fbd0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:01.241 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1359e700 1 -- 172.21.15.62:0/3076240623 >> 172.21.15.62:0/3076240623 conn(0x7f9d1405d220 msgr2=0x7f9d140b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:14:01.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1359e700 1 -- 172.21.15.62:0/3076240623 shutdown_connections 2021-12-17T19:14:01.242 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.223+0000 7f9d1359e700 1 -- 172.21.15.62:0/3076240623 wait complete. 2021-12-17T19:14:01.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d1359e700 1 Processor -- start 2021-12-17T19:14:01.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d1359e700 1 -- start start 2021-12-17T19:14:01.246 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d1359e700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9d140acbd0 0x7f9d140a9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:01.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d1359e700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9d140b1520 0x7f9d140b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:01.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d1359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d140b19c0 0x7f9d140b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:01.247 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d1359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140646e0 con 0x7f9d140b19c0 2021-12-17T19:14:01.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d1359e700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d14064440 con 0x7f9d140b1520 2021-12-17T19:14:01.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d1359e700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140a9440 con 0x7f9d140acbd0 2021-12-17T19:14:01.248 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d1259c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9d140acbd0 0x7f9d140a9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:01.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d12d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d140b19c0 0x7f9d140b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:01.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d1259c700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9d140acbd0 0x7f9d140a9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:51700/0 (socket says 172.21.15.62:51700) 2021-12-17T19:14:01.249 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d1259c700 1 -- 172.21.15.62:0/148054949 learned_addr learned my addr 172.21.15.62:0/148054949 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:14:01.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d11d9b700 1 --2- 172.21.15.62:0/148054949 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9d140b1520 0x7f9d140b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:01.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d12d9d700 1 -- 172.21.15.62:0/148054949 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9d140acbd0 msgr2=0x7f9d140a9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:01.250 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d12d9d700 1 --2- 172.21.15.62:0/148054949 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9d140acbd0 0x7f9d140a9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:01.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d12d9d700 1 -- 172.21.15.62:0/148054949 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9d140b1520 msgr2=0x7f9d140b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:01.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d12d9d700 1 --2- 172.21.15.62:0/148054949 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9d140b1520 0x7f9d140b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:01.251 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d12d9d700 1 -- 172.21.15.62:0/148054949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0400b1e0 con 0x7f9d140b19c0 2021-12-17T19:14:01.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d1259c700 1 --2- 172.21.15.62:0/148054949 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9d140acbd0 0x7f9d140a9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-12-17T19:14:01.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.227+0000 7f9d12d9d700 1 --2- 172.21.15.62:0/148054949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d140b19c0 0x7f9d140b3170 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7f9d14068840 tx=0x7f9d0c007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:01.252 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.231+0000 7f9d037fe700 1 -- 172.21.15.62:0/148054949 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d0c00f470 con 0x7f9d140b19c0 2021-12-17T19:14:01.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.231+0000 7f9d037fe700 1 -- 172.21.15.62:0/148054949 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c00f5d0 con 0x7f9d140b19c0 2021-12-17T19:14:01.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.231+0000 7f9d1359e700 1 -- 172.21.15.62:0/148054949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d14066c80 con 0x7f9d140b19c0 2021-12-17T19:14:01.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.231+0000 7f9d037fe700 1 -- 172.21.15.62:0/148054949 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d0c00f930 con 0x7f9d140b19c0 2021-12-17T19:14:01.253 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.231+0000 7f9d1359e700 1 -- 172.21.15.62:0/148054949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d140b3880 con 0x7f9d140b19c0 2021-12-17T19:14:01.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.231+0000 7f9d1359e700 1 -- 172.21.15.62:0/148054949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d140a9600 con 0x7f9d140b19c0 2021-12-17T19:14:01.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.231+0000 7f9d037fe700 1 -- 172.21.15.62:0/148054949 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9d0c010070 con 0x7f9d140b19c0 2021-12-17T19:14:01.254 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.231+0000 7f9d037fe700 1 --2- 172.21.15.62:0/148054949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9cf0053610 0x7f9cf0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:01.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.231+0000 7f9d037fe700 1 -- 172.21.15.62:0/148054949 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f9d0c06ab40 con 0x7f9d140b19c0 2021-12-17T19:14:01.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.231+0000 7f9d1259c700 1 --2- 172.21.15.62:0/148054949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9cf0053610 0x7f9cf0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:01.255 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.235+0000 7f9d1259c700 1 --2- 172.21.15.62:0/148054949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9cf0053610 0x7f9cf0055ad0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f9d0401c000 tx=0x7f9d04015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:01.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.239+0000 7f9d037fe700 1 -- 172.21.15.62:0/148054949 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9d0c041f80 con 0x7f9d140b19c0 2021-12-17T19:14:01.370 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.359+0000 7f9d1359e700 1 -- 172.21.15.62:0/148054949 --> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9d14066fb0 con 0x7f9cf0053610 2021-12-17T19:14:01.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.371+0000 7f9d037fe700 1 -- 172.21.15.62:0/148054949 <== mgr.4103 v2:172.21.15.109:6800/14658 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68718 (secure 0 0 0) 0x7f9d0400d7d0 con 0x7f9cf0053610 2021-12-17T19:14:01.378 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T19:14:01.379 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.371+0000 7f9d1359e700 1 -- 172.21.15.62:0/148054949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9cf0053610 msgr2=0x7f9cf0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.371+0000 7f9d1359e700 1 --2- 172.21.15.62:0/148054949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9cf0053610 0x7f9cf0055ad0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f9d0401c000 tx=0x7f9d04015000).stop 2021-12-17T19:14:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.371+0000 7f9d1359e700 1 -- 172.21.15.62:0/148054949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d140b19c0 msgr2=0x7f9d140b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.371+0000 7f9d1359e700 1 --2- 172.21.15.62:0/148054949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d140b19c0 0x7f9d140b3170 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7f9d14068840 tx=0x7f9d0c007eb0).stop 2021-12-17T19:14:01.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.371+0000 7f9d1359e700 1 -- 172.21.15.62:0/148054949 shutdown_connections 2021-12-17T19:14:01.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.371+0000 7f9d1359e700 1 --2- 172.21.15.62:0/148054949 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f9cf0053610 0x7f9cf0055ad0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:01.381 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.371+0000 7f9d1359e700 1 --2- 172.21.15.62:0/148054949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d140b19c0 0x7f9d140b3170 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:01.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.371+0000 7f9d1359e700 1 --2- 172.21.15.62:0/148054949 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f9d140b1520 0x7f9d140b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:01.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.371+0000 7f9d1359e700 1 --2- 172.21.15.62:0/148054949 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f9d140acbd0 0x7f9d140a9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:01.382 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.371+0000 7f9d1359e700 1 -- 172.21.15.62:0/148054949 >> 172.21.15.62:0/148054949 conn(0x7f9d1405d220 msgr2=0x7f9d14146d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:14:01.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.371+0000 7f9d1359e700 1 -- 172.21.15.62:0/148054949 shutdown_connections 2021-12-17T19:14:01.383 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:01.371+0000 7f9d1359e700 1 -- 172.21.15.62:0/148054949 wait complete. 2021-12-17T19:14:01.384 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2021-12-17T19:14:01.390 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":1823,"stamp":"2021-12-17T19:14:00.459108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8404092,"kb_used_data":15420,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746570628,"statfs":{"total":773094113280,"available":764488323072,"internally_reserved":8589934592,"allocated":15790080,"data_stored":7320534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003316"},"pg_stats":[{"pgid":"1.0","version":"16'2","reported_seq":140,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.056643+0000","last_change":"2021-12-17T18:18:11.029535+0000","last_active":"2021-12-17T18:28:24.056643+0000","last_peered":"2021-12-17T18:28:24.056643+0000","last_clean":"2021-12-17T18:28:24.056643+0000","last_became_active":"2021-12-17T18:18:11.028573+0000","last_became_peered":"2021-12-17T18:18:11.028573+0000","last_unstale":"2021-12-17T18:28:24.056643+0000","last_undegraded":"2021-12-17T18:28:24.056643+0000","last_fullsized":"2021-12-17T18:28:24.056643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:06.521383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:06.521383+0000","last_clean_scrub_stamp":"2021-12-17T18:18:06.521383+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":138,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.961823+0000","last_change":"2021-12-17T18:18:15.745704+0000","last_active":"2021-12-17T18:28:24.961823+0000","last_peered":"2021-12-17T18:28:24.961823+0000","last_clean":"2021-12-17T18:28:24.961823+0000","last_became_active":"2021-12-17T18:18:15.744953+0000","last_became_peered":"2021-12-17T18:18:15.744953+0000","last_unstale":"2021-12-17T18:28:24.961823+0000","last_undegraded":"2021-12-17T18:28:24.961823+0000","last_fullsized":"2021-12-17T18:28:24.961823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.056559+0000","last_change":"2021-12-17T18:18:15.740336+0000","last_active":"2021-12-17T18:28:24.056559+0000","last_peered":"2021-12-17T18:28:24.056559+0000","last_clean":"2021-12-17T18:28:24.056559+0000","last_became_active":"2021-12-17T18:18:15.739646+0000","last_became_peered":"2021-12-17T18:18:15.739646+0000","last_unstale":"2021-12-17T18:28:24.056559+0000","last_undegraded":"2021-12-17T18:28:24.056559+0000","last_fullsized":"2021-12-17T18:28:24.056559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":138,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.960387+0000","last_change":"2021-12-17T18:18:16.000008+0000","last_active":"2021-12-17T18:28:24.960387+0000","last_peered":"2021-12-17T18:28:24.960387+0000","last_clean":"2021-12-17T18:28:24.960387+0000","last_became_active":"2021-12-17T18:18:15.998977+0000","last_became_peered":"2021-12-17T18:18:15.998977+0000","last_unstale":"2021-12-17T18:28:24.960387+0000","last_undegraded":"2021-12-17T18:28:24.960387+0000","last_fullsized":"2021-12-17T18:28:24.960387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":138,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.961825+0000","last_change":"2021-12-17T18:18:15.744111+0000","last_active":"2021-12-17T18:28:24.961825+0000","last_peered":"2021-12-17T18:28:24.961825+0000","last_clean":"2021-12-17T18:28:24.961825+0000","last_became_active":"2021-12-17T18:18:15.743756+0000","last_became_peered":"2021-12-17T18:18:15.743756+0000","last_unstale":"2021-12-17T18:28:24.961825+0000","last_undegraded":"2021-12-17T18:28:24.961825+0000","last_fullsized":"2021-12-17T18:28:24.961825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":145,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.049374+0000","last_change":"2021-12-17T18:18:16.004167+0000","last_active":"2021-12-17T18:28:24.049374+0000","last_peered":"2021-12-17T18:28:24.049374+0000","last_clean":"2021-12-17T18:28:24.049374+0000","last_became_active":"2021-12-17T18:18:16.003760+0000","last_became_peered":"2021-12-17T18:18:16.003760+0000","last_unstale":"2021-12-17T18:28:24.049374+0000","last_undegraded":"2021-12-17T18:28:24.049374+0000","last_fullsized":"2021-12-17T18:28:24.049374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":135,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.057024+0000","last_change":"2021-12-17T18:18:16.007390+0000","last_active":"2021-12-17T18:28:24.057024+0000","last_peered":"2021-12-17T18:28:24.057024+0000","last_clean":"2021-12-17T18:28:24.057024+0000","last_became_active":"2021-12-17T18:18:16.006472+0000","last_became_peered":"2021-12-17T18:18:16.006472+0000","last_unstale":"2021-12-17T18:28:24.057024+0000","last_undegraded":"2021-12-17T18:28:24.057024+0000","last_fullsized":"2021-12-17T18:28:24.057024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":145,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.049474+0000","last_change":"2021-12-17T18:18:15.740372+0000","last_active":"2021-12-17T18:28:24.049474+0000","last_peered":"2021-12-17T18:28:24.049474+0000","last_clean":"2021-12-17T18:28:24.049474+0000","last_became_active":"2021-12-17T18:18:15.739493+0000","last_became_peered":"2021-12-17T18:18:15.739493+0000","last_unstale":"2021-12-17T18:28:24.049474+0000","last_undegraded":"2021-12-17T18:28:24.049474+0000","last_fullsized":"2021-12-17T18:28:24.049474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":136,"reported_epoch":154,"state":"active+clean","last_fresh":"2021-12-17T18:28:24.461869+0000","last_change":"2021-12-17T18:18:15.743498+0000","last_active":"2021-12-17T18:28:24.461869+0000","last_peered":"2021-12-17T18:28:24.461869+0000","last_clean":"2021-12-17T18:28:24.461869+0000","last_became_active":"2021-12-17T18:18:15.742720+0000","last_became_peered":"2021-12-17T18:18:15.742720+0000","last_unstale":"2021-12-17T18:28:24.461869+0000","last_undegraded":"2021-12-17T18:28:24.461869+0000","last_fullsized":"2021-12-17T18:28:24.461869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T18:18:14.719162+0000","last_clean_scrub_stamp":"2021-12-17T18:18:14.719162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542816,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.79300000000000004,"15min":0.78500000000000003},"min":{"1min":0.64500000000000002,"5min":0.55600000000000005,"15min":0.49299999999999999},"max":{"1min":1.0049999999999999,"5min":1.0940000000000001,"15min":1.103},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.57499999999999996,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.002,"5min":1.0229999999999999,"15min":1.069},"last":0.93200000000000005}]},{"osd":1,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.79900000000000004,"15min":0.78900000000000003},"min":{"1min":0.62,"5min":0.56699999999999995,"15min":0.54900000000000004},"max":{"1min":0.98299999999999998,"5min":1.145,"15min":1.179},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80700000000000005,"15min":0.81100000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.54300000000000004},"max":{"1min":1.0329999999999999,"5min":1.1220000000000001,"15min":1.179},"last":0.73899999999999999}]},{"osd":2,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.82699999999999996,"15min":0.81699999999999995},"min":{"1min":0.58899999999999997,"5min":0.57899999999999996,"15min":0.56399999999999995},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.337},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.81799999999999995,"15min":0.82499999999999996},"min":{"1min":0.63,"5min":0.61499999999999999,"15min":0.57699999999999996},"max":{"1min":1.0389999999999999,"5min":1.0649999999999999,"15min":1.1879999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.55300000000000005},"max":{"1min":1.101,"5min":1.101,"15min":1.3839999999999999},"last":1.018},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.871,"15min":0.86299999999999999},"min":{"1min":0.69499999999999995,"5min":0.66300000000000003,"15min":0.625},"max":{"1min":1.0900000000000001,"5min":1.107,"15min":1.171},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77300000000000002,"15min":0.78800000000000003},"min":{"1min":0.53000000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0269999999999999,"5min":1.0489999999999999,"15min":1.3200000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.90800000000000003,"15min":0.91200000000000003},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.50900000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.482},"last":0.83599999999999997}]},{"osd":5,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.622,"5min":0.60199999999999998,"15min":0.57599999999999996},"max":{"1min":1.1459999999999999,"5min":1.2430000000000001,"15min":1.4470000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.84599999999999997,"15min":0.85399999999999998},"min":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.52000000000000002},"max":{"1min":1.1200000000000001,"5min":1.2070000000000001,"15min":1.2549999999999999},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.89800000000000002,"15min":0.90500000000000003},"min":{"1min":0.66200000000000003,"5min":0.64300000000000002,"15min":0.59899999999999998},"max":{"1min":1.1559999999999999,"5min":1.173,"15min":1.286},"last":0.88},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.92300000000000004,"15min":0.91000000000000003},"min":{"1min":0.67600000000000005,"5min":0.60699999999999998,"15min":0.53400000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.431},"last":0.95299999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542816,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:13:52 2021","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98899999999999999,"5min":1.1180000000000001,"15min":1.165},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77700000000000002,"15min":0.78100000000000003},"min":{"1min":0.56399999999999995,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.95999999999999996,"5min":1.028,"15min":1.2370000000000001},"last":0.59499999999999997}]},{"osd":1,"last update":"Fri Dec 17 19:13:52 2021","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52300000000000002},"max":{"1min":0.97999999999999998,"5min":1.0669999999999999,"15min":1.151},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80400000000000005,"15min":0.80600000000000005},"min":{"1min":0.59299999999999997,"5min":0.56899999999999995,"15min":0.52700000000000002},"max":{"1min":0.96299999999999997,"5min":1.101,"15min":1.127},"last":0.61699999999999999}]},{"osd":2,"last update":"Fri Dec 17 19:13:52 2021","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.64100000000000001,"5min":0.58299999999999996,"15min":0.55400000000000005},"max":{"1min":1.0089999999999999,"5min":1.097,"15min":1.155},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.84599999999999997,"15min":0.85799999999999998},"min":{"1min":0.58199999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.028,"5min":1.1659999999999999,"15min":1.2050000000000001},"last":0.88500000000000001}]},{"osd":3,"last update":"Fri Dec 17 19:13:52 2021","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84899999999999998,"15min":0.85199999999999998},"min":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.54300000000000004},"max":{"1min":1.032,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.91100000000000003,"15min":0.92700000000000005},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.57199999999999995},"max":{"1min":1.093,"5min":1.2270000000000001,"15min":1.2809999999999999},"last":0.76700000000000002}]},{"osd":4,"last update":"Fri Dec 17 19:13:52 2021","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.504},"max":{"1min":1.0529999999999999,"5min":1.1279999999999999,"15min":1.141},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.79900000000000004,"15min":0.80300000000000005},"min":{"1min":0.58499999999999996,"5min":0.55300000000000005,"15min":0.41999999999999998},"max":{"1min":1.151,"5min":1.276,"15min":1.3149999999999999},"last":0.85699999999999998}]},{"osd":5,"last update":"Fri Dec 17 19:13:52 2021","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.57799999999999996,"5min":0.53600000000000003,"15min":0.441},"max":{"1min":1.0580000000000001,"5min":1.131,"15min":1.381},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.86299999999999999,"15min":0.88700000000000001},"min":{"1min":0.69799999999999995,"5min":0.58599999999999997,"15min":0.54200000000000004},"max":{"1min":1.008,"5min":1.1799999999999999,"15min":1.3420000000000001},"last":0.90900000000000003}]},{"osd":7,"last update":"Fri Dec 17 19:13:52 2021","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89100000000000001,"15min":0.91600000000000004},"min":{"1min":0.66600000000000004,"5min":0.59899999999999998,"15min":0.52200000000000002},"max":{"1min":1.0620000000000001,"5min":1.177,"15min":1.353},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.90700000000000003,"15min":0.93999999999999995},"min":{"1min":0.77000000000000002,"5min":0.55700000000000005,"15min":0.51100000000000001},"max":{"1min":1.101,"5min":1.214,"15min":1.47},"last":0.97399999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542816,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:12:59 2021","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.77000000000000002,"15min":0.76700000000000002},"min":{"1min":0.57099999999999995,"5min":0.52600000000000002,"15min":0.48999999999999999},"max":{"1min":1.0069999999999999,"5min":1.071,"15min":1.1539999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.53700000000000003},"max":{"1min":1.109,"5min":1.151,"15min":1.1619999999999999},"last":0.98999999999999999}]},{"osd":1,"last update":"Fri Dec 17 19:12:59 2021","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.877,"15min":0.86099999999999999},"min":{"1min":0.70899999999999996,"5min":0.60899999999999999,"15min":0.52700000000000002},"max":{"1min":1.0209999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.86899999999999999,"15min":0.88200000000000001},"min":{"1min":0.72099999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97599999999999998,"5min":1.0489999999999999,"15min":1.4490000000000001},"last":0.97399999999999998}]},{"osd":2,"last update":"Fri Dec 17 19:12:59 2021","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.80500000000000005},"min":{"1min":0.61899999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0660000000000001,"5min":1.0720000000000001,"15min":1.306},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84999999999999998,"15min":0.82299999999999995},"min":{"1min":0.68600000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0549999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.72199999999999998}]},{"osd":3,"last update":"Fri Dec 17 19:12:59 2021","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.60399999999999998,"5min":0.59299999999999997,"15min":0.56599999999999995},"max":{"1min":0.90200000000000002,"5min":1.0840000000000001,"15min":1.117},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.879,"15min":0.86799999999999999},"min":{"1min":0.65700000000000003,"5min":0.629,"15min":0.59699999999999998},"max":{"1min":1.071,"5min":1.0940000000000001,"15min":1.1160000000000001},"last":0.93799999999999994}]},{"osd":4,"last update":"Fri Dec 17 19:12:59 2021","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.503},"max":{"1min":0.95699999999999996,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.872},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82599999999999996,"15min":0.83099999999999996},"min":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.51900000000000002},"max":{"1min":1.0349999999999999,"5min":1.133,"15min":1.1910000000000001},"last":0.76400000000000001}]},{"osd":6,"last update":"Fri Dec 17 19:12:59 2021","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.83799999999999997,"15min":0.81999999999999995},"min":{"1min":0.58899999999999997,"5min":0.55600000000000005,"15min":0.54200000000000004},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.214},"last":1.026},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.91500000000000004,"15min":0.89000000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.57599999999999996},"max":{"1min":1.133,"5min":1.1819999999999999,"15min":1.2370000000000001},"last":1.0069999999999999}]},{"osd":7,"last update":"Fri Dec 17 19:12:59 2021","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.91500000000000004,"15min":0.90900000000000003},"min":{"1min":0.67100000000000004,"5min":0.59299999999999997,"15min":0.53500000000000003},"max":{"1min":1.103,"5min":1.296,"15min":1.5580000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.97099999999999997,"15min":0.95399999999999996},"min":{"1min":0.82099999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0669999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542815,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:13:00 2021","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.81599999999999995,"15min":0.79500000000000004},"min":{"1min":0.59299999999999997,"5min":0.57299999999999995,"15min":0.42599999999999999},"max":{"1min":1.0269999999999999,"5min":1.111,"15min":1.111},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78900000000000003,"15min":0.80400000000000005},"min":{"1min":0.58199999999999996,"5min":0.52600000000000002,"15min":0.51600000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.099},"last":0.80700000000000005}]},{"osd":1,"last update":"Fri Dec 17 19:13:00 2021","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.77400000000000002,"15min":0.79400000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.495},"max":{"1min":1.0129999999999999,"5min":1.107,"15min":1.1779999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.80800000000000005},"min":{"1min":0.57999999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.999,"5min":1.071,"15min":1.234},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Dec 17 19:13:00 2021","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79800000000000004,"15min":0.80500000000000005},"min":{"1min":0.65000000000000002,"5min":0.53900000000000003,"15min":0.51700000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.252},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83399999999999996,"15min":0.83199999999999996},"min":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.96499999999999997,"5min":1.077,"15min":1.577},"last":0.93500000000000005}]},{"osd":3,"last update":"Fri Dec 17 19:13:00 2021","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.82999999999999996,"15min":0.84599999999999997},"min":{"1min":0.65400000000000003,"5min":0.58699999999999997,"15min":0.53400000000000003},"max":{"1min":1.0780000000000001,"5min":1.105,"15min":1.141},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93799999999999994,"15min":0.93700000000000006},"min":{"1min":0.81299999999999994,"5min":0.66500000000000004,"15min":0.621},"max":{"1min":1.1499999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.879}]},{"osd":5,"last update":"Fri Dec 17 19:13:00 2021","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79400000000000004,"15min":0.79800000000000004},"min":{"1min":0.60999999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0700000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.85299999999999998,"15min":0.84099999999999997},"min":{"1min":0.56699999999999995,"5min":0.54500000000000004,"15min":0.52800000000000002},"max":{"1min":1.0209999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.90200000000000002}]},{"osd":6,"last update":"Fri Dec 17 19:13:00 2021","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86299999999999999,"15min":0.84699999999999998},"min":{"1min":0.60199999999999998,"5min":0.52400000000000002,"15min":0.51700000000000002},"max":{"1min":1.0449999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.71799999999999997,"5min":0.68700000000000006,"15min":0.56200000000000006},"max":{"1min":1.002,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.024}]},{"osd":7,"last update":"Fri Dec 17 19:13:00 2021","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.95099999999999996,"15min":0.93300000000000005},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.59899999999999998},"max":{"1min":1.1140000000000001,"5min":1.331,"15min":1.339},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98399999999999999,"15min":0.98099999999999998},"min":{"1min":0.69599999999999995,"5min":0.61599999999999999,"15min":0.58899999999999997},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.048}]}]},{"osd":3,"up_from":14,"seq":60129542815,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81999999999999995,"5min":1.099,"15min":1.1000000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65800000000000003,"15min":0.65100000000000002},"min":{"1min":0.498,"5min":0.48599999999999999,"15min":0.46500000000000002},"max":{"1min":0.88900000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.51700000000000002}]},{"osd":1,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63100000000000001,"15min":0.61699999999999999},"min":{"1min":0.52200000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.1830000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.53600000000000003,"5min":0.499,"15min":0.48199999999999998},"max":{"1min":0.91600000000000004,"5min":1.0229999999999999,"15min":1.04},"last":0.85399999999999998}]},{"osd":2,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.746,"15min":0.748},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90300000000000002,"5min":1.101,"15min":1.101},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.78600000000000003},"min":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.52900000000000003},"max":{"1min":1.0089999999999999,"5min":1.1899999999999999,"15min":1.1930000000000001},"last":0.73999999999999999}]},{"osd":4,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.85599999999999998,"15min":0.85199999999999998},"min":{"1min":0.69399999999999995,"5min":0.63900000000000001,"15min":0.61499999999999999},"max":{"1min":1.0629999999999999,"5min":1.226,"15min":1.226},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.90800000000000003,"15min":0.90200000000000002},"min":{"1min":0.68000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.069,"5min":1.248,"15min":1.248},"last":0.89200000000000002}]},{"osd":5,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.98499999999999999,"15min":0.97099999999999997},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71599999999999997},"max":{"1min":1.143,"5min":1.4139999999999999,"15min":1.534},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91400000000000003,"15min":0.90300000000000002},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.62},"max":{"1min":1.2509999999999999,"5min":1.413,"15min":1.413},"last":0.86899999999999999}]},{"osd":6,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.97299999999999998,"15min":0.97199999999999998},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.68500000000000005},"max":{"1min":1.159,"5min":1.3009999999999999,"15min":1.365},"last":1.093},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.048,"15min":1.0309999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.2210000000000001,"5min":1.4550000000000001,"15min":1.486},"last":1.034}]},{"osd":7,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.016,"15min":0.996},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.67400000000000004},"max":{"1min":1.169,"5min":1.3839999999999999,"15min":1.387},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.999,"5min":1.0489999999999999,"15min":1.046},"min":{"1min":0.81399999999999995,"5min":0.80700000000000005,"15min":0.73999999999999999},"max":{"1min":1.278,"5min":1.3620000000000001,"15min":1.3680000000000001},"last":1.1559999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542816,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.45300000000000001,"5min":0.44400000000000001,"15min":0.438},"max":{"1min":0.82899999999999996,"5min":0.84799999999999998,"15min":0.95799999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.499,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.022,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.80200000000000005,"15min":0.81399999999999995},"min":{"1min":0.621,"5min":0.59799999999999998,"15min":0.56899999999999995},"max":{"1min":1.077,"5min":1.133,"15min":1.133},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68400000000000005,"15min":0.68500000000000005},"min":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.45900000000000002},"max":{"1min":0.92300000000000004,"5min":0.94799999999999995,"15min":1.004},"last":0.81299999999999994}]},{"osd":3,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.86199999999999999,"5min":1,"15min":1.083},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.036,"5min":1.1339999999999999,"15min":1.2310000000000001},"last":0.70099999999999996}]},{"osd":4,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.85099999999999998,"15min":0.84999999999999998},"min":{"1min":0.67400000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.302},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94299999999999995,"15min":0.95899999999999996},"min":{"1min":0.77800000000000002,"5min":0.68999999999999995,"15min":0.66200000000000003},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.472},"last":1.0820000000000001}]},{"osd":5,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.877,"15min":0.876},"min":{"1min":0.71099999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2829999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.90900000000000003,"15min":0.91500000000000004},"min":{"1min":0.70199999999999996,"5min":0.68999999999999995,"15min":0.66500000000000004},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3600000000000001},"last":0.97299999999999998}]},{"osd":6,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0029999999999999},"min":{"1min":0.83099999999999996,"5min":0.745,"15min":0.66900000000000004},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.3919999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.93600000000000005,"15min":0.94999999999999996},"min":{"1min":0.65000000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2070000000000001,"5min":1.236,"15min":1.3480000000000001},"last":0.93000000000000005}]},{"osd":7,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0329999999999999,"15min":1.04},"min":{"1min":0.89600000000000002,"5min":0.78000000000000003,"15min":0.73399999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.5369999999999999},"last":1.117},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.97799999999999998,"15min":0.98799999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68200000000000005},"max":{"1min":1.2090000000000001,"5min":1.284,"15min":1.4870000000000001},"last":0.88}]}]},{"osd":1,"up_from":14,"seq":60129542815,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:13:53 2021","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58399999999999996,"15min":0.58499999999999996},"min":{"1min":0.48899999999999999,"5min":0.438,"15min":0.433},"max":{"1min":0.85099999999999998,"5min":0.97099999999999997,"15min":1.032},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.45900000000000002},"max":{"1min":0.94499999999999995,"5min":1.109,"15min":1.125},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Dec 17 19:13:53 2021","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.47899999999999998,"5min":0.46000000000000002,"15min":0.442},"max":{"1min":0.83699999999999997,"5min":1.0249999999999999,"15min":1.1539999999999999},"last":0.505},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.56399999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1359999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Dec 17 19:13:53 2021","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78900000000000003,"15min":0.78600000000000003},"min":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.52100000000000002},"max":{"1min":0.998,"5min":1.036,"15min":1.1240000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73099999999999998,"15min":0.73499999999999999},"min":{"1min":0.53900000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.002,"5min":1.054,"15min":1.054},"last":1.002}]},{"osd":4,"last update":"Fri Dec 17 19:13:53 2021","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.81899999999999995,"15min":0.84799999999999998},"min":{"1min":0.68200000000000005,"5min":0.60599999999999998,"15min":0.60299999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.94599999999999995,"15min":0.94199999999999995},"min":{"1min":0.80700000000000005,"5min":0.70599999999999996,"15min":0.70299999999999996},"max":{"1min":1.254,"5min":1.2869999999999999,"15min":1.323},"last":0.96699999999999997}]},{"osd":5,"last update":"Fri Dec 17 19:13:53 2021","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92300000000000004,"15min":0.94399999999999995},"min":{"1min":0.70699999999999996,"5min":0.67000000000000004,"15min":0.65300000000000002},"max":{"1min":1.329,"5min":1.3500000000000001,"15min":1.482},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.92100000000000004,"15min":0.92500000000000004},"min":{"1min":0.73499999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.4790000000000001},"last":0.86099999999999999}]},{"osd":6,"last update":"Fri Dec 17 19:13:53 2021","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.96199999999999997,"15min":0.97699999999999998},"min":{"1min":0.70699999999999996,"5min":0.67900000000000005,"15min":0.66100000000000003},"max":{"1min":1.292,"5min":1.3180000000000001,"15min":1.5269999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.95499999999999996,"15min":0.97699999999999998},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69599999999999995},"max":{"1min":1.272,"5min":1.294,"15min":1.4690000000000001},"last":0.94199999999999995}]},{"osd":7,"last update":"Fri Dec 17 19:13:53 2021","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.04,"15min":1.0289999999999999},"min":{"1min":0.88600000000000001,"5min":0.749,"15min":0.68200000000000005},"max":{"1min":1.294,"5min":1.373,"15min":1.472},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0409999999999999,"15min":1.048},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.341,"5min":1.363,"15min":1.4359999999999999},"last":0.91500000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542816,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050508,"kb_used_data":1924,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321332,"statfs":{"total":96636764160,"available":95561043968,"internally_reserved":1073741824,"allocated":1970176,"data_stored":914561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 17 19:13:02 2021","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54900000000000004,"15min":0.57099999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.41299999999999998},"max":{"1min":0.75800000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63,"15min":0.64400000000000002},"min":{"1min":0.49199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.1240000000000001},"last":0.505}]},{"osd":2,"last update":"Fri Dec 17 19:13:02 2021","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.68200000000000005,"15min":0.69099999999999995},"min":{"1min":0.51700000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.871,"5min":1.079,"15min":1.151},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77900000000000003,"15min":0.77400000000000002},"min":{"1min":0.61199999999999999,"5min":0.59799999999999998,"15min":0.56899999999999995},"max":{"1min":0.93799999999999994,"5min":1.0229999999999999,"15min":1.2050000000000001},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Dec 17 19:13:02 2021","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46300000000000002},"max":{"1min":0.79600000000000004,"5min":1.093,"15min":1.093},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.754,"15min":0.755},"min":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.52100000000000002},"max":{"1min":0.94799999999999995,"5min":1.276,"15min":1.276},"last":0.64400000000000002}]},{"osd":4,"last update":"Fri Dec 17 19:13:02 2021","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.84899999999999998,"15min":0.84399999999999997},"min":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.61899999999999999},"max":{"1min":1.04,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.88900000000000001,"15min":0.90300000000000002},"min":{"1min":0.75700000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0629999999999999,"5min":1.2090000000000001,"15min":1.337},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Dec 17 19:13:02 2021","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90700000000000003,"15min":0.91500000000000004},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.628},"max":{"1min":1.1279999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.90000000000000002,"15min":0.90300000000000002},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.206,"5min":1.2669999999999999,"15min":1.3320000000000001},"last":0.76800000000000002}]},{"osd":6,"last update":"Fri Dec 17 19:13:02 2021","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.94599999999999995,"15min":0.95799999999999996},"min":{"1min":0.69099999999999995,"5min":0.68100000000000005,"15min":0.67700000000000005},"max":{"1min":1.103,"5min":1.3380000000000001,"15min":1.4550000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96099999999999997,"15min":0.97299999999999998},"min":{"1min":0.82099999999999995,"5min":0.70499999999999996,"15min":0.69399999999999995},"max":{"1min":1.1559999999999999,"5min":1.1970000000000001,"15min":1.3089999999999999},"last":0.94299999999999995}]},{"osd":7,"last update":"Fri Dec 17 19:13:02 2021","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.99099999999999999,"15min":0.996},"min":{"1min":0.753,"5min":0.73099999999999998,"15min":0.66500000000000004},"max":{"1min":1.2030000000000001,"5min":1.2929999999999999,"15min":1.3240000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.98899999999999999,"15min":0.98599999999999999},"min":{"1min":0.83199999999999996,"5min":0.76200000000000001,"15min":0.67900000000000005},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.534},"last":0.92300000000000004}]}]}]}} 2021-12-17T19:14:01.396 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2021-12-17T18:18:06.521383+0000 time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=18, tm_min=18, tm_sec=6, tm_wday=4, tm_yday=351, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=19, tm_min=13, tm_sec=56, tm_wday=4, tm_yday=351, tm_isdst=0) 2021-12-17T19:14:01.397 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2021-12-17T18:18:14.719162+0000 time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=18, tm_min=18, tm_sec=14, tm_wday=4, tm_yday=351, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=19, tm_min=13, tm_sec=56, tm_wday=4, tm_yday=351, tm_isdst=0) 2021-12-17T19:14:01.397 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2021-12-17T18:18:14.719162+0000 time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=18, tm_min=18, tm_sec=14, tm_wday=4, tm_yday=351, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=19, tm_min=13, tm_sec=56, tm_wday=4, tm_yday=351, tm_isdst=0) 2021-12-17T19:14:01.398 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2021-12-17T18:18:14.719162+0000 time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=18, tm_min=18, tm_sec=14, tm_wday=4, tm_yday=351, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=19, tm_min=13, tm_sec=56, tm_wday=4, tm_yday=351, tm_isdst=0) 2021-12-17T19:14:01.399 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-12-17T18:18:14.719162+0000 time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=18, tm_min=18, tm_sec=14, tm_wday=4, tm_yday=351, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=19, tm_min=13, tm_sec=56, tm_wday=4, tm_yday=351, tm_isdst=0) 2021-12-17T19:14:01.399 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2021-12-17T18:18:14.719162+0000 time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=18, tm_min=18, tm_sec=14, tm_wday=4, tm_yday=351, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=19, tm_min=13, tm_sec=56, tm_wday=4, tm_yday=351, tm_isdst=0) 2021-12-17T19:14:01.400 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2021-12-17T18:18:14.719162+0000 time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=18, tm_min=18, tm_sec=14, tm_wday=4, tm_yday=351, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=19, tm_min=13, tm_sec=56, tm_wday=4, tm_yday=351, tm_isdst=0) 2021-12-17T19:14:01.401 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2021-12-17T18:18:14.719162+0000 time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=18, tm_min=18, tm_sec=14, tm_wday=4, tm_yday=351, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=19, tm_min=13, tm_sec=56, tm_wday=4, tm_yday=351, tm_isdst=0) 2021-12-17T19:14:01.401 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2021-12-17T18:18:14.719162+0000 time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=18, tm_min=18, tm_sec=14, tm_wday=4, tm_yday=351, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=12, tm_mday=17, tm_hour=19, tm_min=13, tm_sec=56, tm_wday=4, tm_yday=351, tm_isdst=0) 2021-12-17T19:14:01.402 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2021-12-17T19:14:17.165 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:14:17.169 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:14:17.172 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:14:17.175 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:14:17.177 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:14:21.403 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-12-17T19:14:21.519 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddfa4fb700 1 Processor -- start 2021-12-17T19:14:21.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddfa4fb700 1 -- start start 2021-12-17T19:14:21.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddfa4fb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fddf40b6a10 0x7fddf40b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:21.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddfa4fb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fddf40b20b0 0x7fddf40af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:21.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddfa4fb700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7fddf40b0410 0x7fddf4140a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:21.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddfa4fb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf40ae8c0 con 0x7fddf40b6a10 2021-12-17T19:14:21.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddfa4fb700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf40b6df0 con 0x7fddf40b0410 2021-12-17T19:14:21.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddfa4fb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf40aa350 con 0x7fddf40b20b0 2021-12-17T19:14:21.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddf3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fddf40b6a10 0x7fddf40b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:21.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddf3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fddf40b6a10 0x7fddf40b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58006/0 (socket says 172.21.15.62:58006) 2021-12-17T19:14:21.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddf3fff700 1 -- 172.21.15.62:0/2593697960 learned_addr learned my addr 172.21.15.62:0/2593697960 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:14:21.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddf37fe700 1 --2- 172.21.15.62:0/2593697960 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fddf40b20b0 0x7fddf40af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:21.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddf8a98700 1 --2- 172.21.15.62:0/2593697960 >> v2:172.21.15.109:3300/0 conn(0x7fddf40b0410 0x7fddf4140a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:21.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddf3fff700 1 -- 172.21.15.62:0/2593697960 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fddf40b20b0 msgr2=0x7fddf40af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:14:21.527 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddf3fff700 1 --2- 172.21.15.62:0/2593697960 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fddf40b20b0 0x7fddf40af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddf3fff700 1 -- 172.21.15.62:0/2593697960 >> v2:172.21.15.109:3300/0 conn(0x7fddf40b0410 msgr2=0x7fddf4140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:14:21.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddf3fff700 1 --2- 172.21.15.62:0/2593697960 >> v2:172.21.15.109:3300/0 conn(0x7fddf40b0410 0x7fddf4140a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddf3fff700 1 -- 172.21.15.62:0/2593697960 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf40b1470 con 0x7fddf40b6a10 2021-12-17T19:14:21.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddf3fff700 1 --2- 172.21.15.62:0/2593697960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf40b6a10 0x7fddf40b24d0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7fdde40032f0 tx=0x7fdde400b530).ready entity=mon.0 client_cookie=f73f5fdce6666ed server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:21.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddf2ffd700 1 -- 172.21.15.62:0/2593697960 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdde400dd40 con 0x7fddf40b6a10 2021-12-17T19:14:21.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddf2ffd700 1 -- 172.21.15.62:0/2593697960 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde4010470 con 0x7fddf40b6a10 2021-12-17T19:14:21.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddf2ffd700 1 -- 172.21.15.62:0/2593697960 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdde400dea0 con 0x7fddf40b6a10 2021-12-17T19:14:21.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddfa4fb700 1 -- 172.21.15.62:0/2593697960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf40b6a10 msgr2=0x7fddf40b24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:21.530 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.511+0000 7fddfa4fb700 1 --2- 172.21.15.62:0/2593697960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf40b6a10 0x7fddf40b24d0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7fdde40032f0 tx=0x7fdde400b530).stop 2021-12-17T19:14:21.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddfa4fb700 1 -- 172.21.15.62:0/2593697960 shutdown_connections 2021-12-17T19:14:21.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddfa4fb700 1 --2- 172.21.15.62:0/2593697960 >> v2:172.21.15.109:3300/0 conn(0x7fddf40b0410 0x7fddf4140a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.531 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddfa4fb700 1 --2- 172.21.15.62:0/2593697960 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fddf40b20b0 0x7fddf40af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddfa4fb700 1 --2- 172.21.15.62:0/2593697960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf40b6a10 0x7fddf40b24d0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.532 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddfa4fb700 1 -- 172.21.15.62:0/2593697960 >> 172.21.15.62:0/2593697960 conn(0x7fddf405bcd0 msgr2=0x7fddf40638c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:14:21.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddfa4fb700 1 -- 172.21.15.62:0/2593697960 shutdown_connections 2021-12-17T19:14:21.533 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddfa4fb700 1 -- 172.21.15.62:0/2593697960 wait complete. 2021-12-17T19:14:21.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddfa4fb700 1 Processor -- start 2021-12-17T19:14:21.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddfa4fb700 1 -- start start 2021-12-17T19:14:21.537 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddfa4fb700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fddf40b0410 0x7fddf40b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:21.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddfa4fb700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fddf40b20b0 0x7fddf4151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:21.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddfa4fb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf40b6a10 0x7fddf4152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:21.538 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddfa4fb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf4152640 con 0x7fddf40b6a10 2021-12-17T19:14:21.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddfa4fb700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf40b6400 con 0x7fddf40b0410 2021-12-17T19:14:21.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddfa4fb700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf4067360 con 0x7fddf40b20b0 2021-12-17T19:14:21.539 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddf8a98700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf40b6a10 0x7fddf4152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:21.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddf8a98700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf40b6a10 0x7fddf4152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58016/0 (socket says 172.21.15.62:58016) 2021-12-17T19:14:21.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddf8a98700 1 -- 172.21.15.62:0/3120644104 learned_addr learned my addr 172.21.15.62:0/3120644104 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:14:21.540 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddf3fff700 1 --2- 172.21.15.62:0/3120644104 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fddf40b0410 0x7fddf40b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:21.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddf37fe700 1 --2- 172.21.15.62:0/3120644104 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fddf40b20b0 0x7fddf4151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:21.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddf8a98700 1 -- 172.21.15.62:0/3120644104 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fddf40b20b0 msgr2=0x7fddf4151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:21.541 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddf8a98700 1 --2- 172.21.15.62:0/3120644104 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fddf40b20b0 0x7fddf4151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddf8a98700 1 -- 172.21.15.62:0/3120644104 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fddf40b0410 msgr2=0x7fddf40b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:21.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddf8a98700 1 --2- 172.21.15.62:0/3120644104 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fddf40b0410 0x7fddf40b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.542 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddf8a98700 1 -- 172.21.15.62:0/3120644104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde400b7d0 con 0x7fddf40b6a10 2021-12-17T19:14:21.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddf3fff700 1 --2- 172.21.15.62:0/3120644104 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fddf40b0410 0x7fddf40b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-12-17T19:14:21.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddf8a98700 1 --2- 172.21.15.62:0/3120644104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf40b6a10 0x7fddf4152150 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7fddec00c000 tx=0x7fddec006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:21.543 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.515+0000 7fddf17fa700 1 -- 172.21.15.62:0/3120644104 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddec010780 con 0x7fddf40b6a10 2021-12-17T19:14:21.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.519+0000 7fddf17fa700 1 -- 172.21.15.62:0/3120644104 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec0108e0 con 0x7fddf40b6a10 2021-12-17T19:14:21.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.519+0000 7fddfa4fb700 1 -- 172.21.15.62:0/3120644104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf4067600 con 0x7fddf40b6a10 2021-12-17T19:14:21.544 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.519+0000 7fddf17fa700 1 -- 172.21.15.62:0/3120644104 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddec010c40 con 0x7fddf40b6a10 2021-12-17T19:14:21.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.519+0000 7fddfa4fb700 1 -- 172.21.15.62:0/3120644104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf413c820 con 0x7fddf40b6a10 2021-12-17T19:14:21.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.519+0000 7fddfa4fb700 1 -- 172.21.15.62:0/3120644104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf413c400 con 0x7fddf40b6a10 2021-12-17T19:14:21.545 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.519+0000 7fddf17fa700 1 -- 172.21.15.62:0/3120644104 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fddec01c460 con 0x7fddf40b6a10 2021-12-17T19:14:21.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.519+0000 7fddf17fa700 1 --2- 172.21.15.62:0/3120644104 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fddd8053580 0x7fddd8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:21.546 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.519+0000 7fddf17fa700 1 -- 172.21.15.62:0/3120644104 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fddec06bb40 con 0x7fddf40b6a10 2021-12-17T19:14:21.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.519+0000 7fddf3fff700 1 --2- 172.21.15.62:0/3120644104 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fddd8053580 0x7fddd8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:21.547 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.523+0000 7fddf3fff700 1 --2- 172.21.15.62:0/3120644104 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fddd8053580 0x7fddd8055a40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fdde401c000 tx=0x7fdde400b530).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:21.548 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.527+0000 7fddf17fa700 1 -- 172.21.15.62:0/3120644104 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fddec042e10 con 0x7fddf40b6a10 2021-12-17T19:14:21.660 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.651+0000 7fddfa4fb700 1 -- 172.21.15.62:0/3120644104 --> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fddf40b0a80 con 0x7fddd8053580 2021-12-17T19:14:21.666 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.659+0000 7fddf17fa700 1 -- 172.21.15.62:0/3120644104 <== mgr.4103 v2:172.21.15.109:6800/14658 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68587 (secure 0 0 0) 0x7fddf40b0a80 con 0x7fddd8053580 2021-12-17T19:14:21.668 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-12-17T19:14:21.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.659+0000 7fddfa4fb700 1 -- 172.21.15.62:0/3120644104 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fddd8053580 msgr2=0x7fddd8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:21.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.659+0000 7fddfa4fb700 1 --2- 172.21.15.62:0/3120644104 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fddd8053580 0x7fddd8055a40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fdde401c000 tx=0x7fdde400b530).stop 2021-12-17T19:14:21.670 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.659+0000 7fddfa4fb700 1 -- 172.21.15.62:0/3120644104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf40b6a10 msgr2=0x7fddf4152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.659+0000 7fddfa4fb700 1 --2- 172.21.15.62:0/3120644104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf40b6a10 0x7fddf4152150 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7fddec00c000 tx=0x7fddec006df0).stop 2021-12-17T19:14:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.659+0000 7fddfa4fb700 1 -- 172.21.15.62:0/3120644104 shutdown_connections 2021-12-17T19:14:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.659+0000 7fddfa4fb700 1 --2- 172.21.15.62:0/3120644104 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7fddd8053580 0x7fddd8055a40 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.659+0000 7fddfa4fb700 1 --2- 172.21.15.62:0/3120644104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf40b6a10 0x7fddf4152150 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.659+0000 7fddfa4fb700 1 --2- 172.21.15.62:0/3120644104 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7fddf40b20b0 0x7fddf4151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.672 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.659+0000 7fddfa4fb700 1 --2- 172.21.15.62:0/3120644104 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7fddf40b0410 0x7fddf40b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.659+0000 7fddfa4fb700 1 -- 172.21.15.62:0/3120644104 >> 172.21.15.62:0/3120644104 conn(0x7fddf405bcd0 msgr2=0x7fddf40b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:14:21.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.659+0000 7fddfa4fb700 1 -- 172.21.15.62:0/3120644104 shutdown_connections 2021-12-17T19:14:21.673 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.659+0000 7fddfa4fb700 1 -- 172.21.15.62:0/3120644104 wait complete. 2021-12-17T19:14:21.674 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2021-12-17T19:14:21.680 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":1833,"stamp":"2021-12-17T19:14:20.464801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9687,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8404092,"kb_used_data":15420,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746570628,"statfs":{"total":773094113280,"available":764488323072,"internally_reserved":8589934592,"allocated":15790080,"data_stored":7320534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003358"},"pg_stats":[{"pgid":"1.0","version":"155'4","reported_seq":145,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-12-17T19:14:02.880891+0000","last_change":"2021-12-17T19:14:02.881076+0000","last_active":"2021-12-17T19:14:02.880891+0000","last_peered":"2021-12-17T19:14:02.880891+0000","last_clean":"2021-12-17T19:14:02.880891+0000","last_became_active":"2021-12-17T18:18:11.028573+0000","last_became_peered":"2021-12-17T18:18:11.028573+0000","last_unstale":"2021-12-17T19:14:02.880891+0000","last_undegraded":"2021-12-17T19:14:02.880891+0000","last_fullsized":"2021-12-17T19:14:02.880891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'4","last_scrub_stamp":"2021-12-17T19:14:02.880891+0000","last_deep_scrub":"155'4","last_deep_scrub_stamp":"2021-12-17T19:14:02.880891+0000","last_clean_scrub_stamp":"2021-12-17T19:14:02.880891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9687,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":141,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-12-17T19:14:01.695833+0000","last_change":"2021-12-17T19:14:01.696021+0000","last_active":"2021-12-17T19:14:01.695833+0000","last_peered":"2021-12-17T19:14:01.695833+0000","last_clean":"2021-12-17T19:14:01.695833+0000","last_became_active":"2021-12-17T18:18:15.744953+0000","last_became_peered":"2021-12-17T18:18:15.744953+0000","last_unstale":"2021-12-17T19:14:01.695833+0000","last_undegraded":"2021-12-17T19:14:01.695833+0000","last_fullsized":"2021-12-17T19:14:01.695833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T19:14:01.695832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T19:14:01.695832+0000","last_clean_scrub_stamp":"2021-12-17T19:14:01.695832+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":138,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-12-17T19:14:03.864617+0000","last_change":"2021-12-17T19:14:03.864797+0000","last_active":"2021-12-17T19:14:03.864617+0000","last_peered":"2021-12-17T19:14:03.864617+0000","last_clean":"2021-12-17T19:14:03.864617+0000","last_became_active":"2021-12-17T18:18:15.739646+0000","last_became_peered":"2021-12-17T18:18:15.739646+0000","last_unstale":"2021-12-17T19:14:03.864617+0000","last_undegraded":"2021-12-17T19:14:03.864617+0000","last_fullsized":"2021-12-17T19:14:03.864617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T19:14:03.864617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T19:14:03.864617+0000","last_clean_scrub_stamp":"2021-12-17T19:14:03.864617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":141,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-12-17T19:13:59.511159+0000","last_change":"2021-12-17T19:13:59.511240+0000","last_active":"2021-12-17T19:13:59.511159+0000","last_peered":"2021-12-17T19:13:59.511159+0000","last_clean":"2021-12-17T19:13:59.511159+0000","last_became_active":"2021-12-17T18:18:15.998977+0000","last_became_peered":"2021-12-17T18:18:15.998977+0000","last_unstale":"2021-12-17T19:13:59.511159+0000","last_undegraded":"2021-12-17T19:13:59.511159+0000","last_fullsized":"2021-12-17T19:13:59.511159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T19:13:59.511158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T19:13:59.511158+0000","last_clean_scrub_stamp":"2021-12-17T19:13:59.511158+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":141,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-12-17T19:14:00.657046+0000","last_change":"2021-12-17T19:14:00.657126+0000","last_active":"2021-12-17T19:14:00.657046+0000","last_peered":"2021-12-17T19:14:00.657046+0000","last_clean":"2021-12-17T19:14:00.657046+0000","last_became_active":"2021-12-17T18:18:15.743756+0000","last_became_peered":"2021-12-17T18:18:15.743756+0000","last_unstale":"2021-12-17T19:14:00.657046+0000","last_undegraded":"2021-12-17T19:14:00.657046+0000","last_fullsized":"2021-12-17T19:14:00.657046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T19:14:00.657045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T19:14:00.657045+0000","last_clean_scrub_stamp":"2021-12-17T19:14:00.657045+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":148,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-12-17T19:14:00.973545+0000","last_change":"2021-12-17T19:14:00.973716+0000","last_active":"2021-12-17T19:14:00.973545+0000","last_peered":"2021-12-17T19:14:00.973545+0000","last_clean":"2021-12-17T19:14:00.973545+0000","last_became_active":"2021-12-17T18:18:16.003760+0000","last_became_peered":"2021-12-17T18:18:16.003760+0000","last_unstale":"2021-12-17T19:14:00.973545+0000","last_undegraded":"2021-12-17T19:14:00.973545+0000","last_fullsized":"2021-12-17T19:14:00.973545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T19:14:00.973544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T19:14:00.973544+0000","last_clean_scrub_stamp":"2021-12-17T19:14:00.973544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":138,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-12-17T19:14:06.963133+0000","last_change":"2021-12-17T19:14:06.963219+0000","last_active":"2021-12-17T19:14:06.963133+0000","last_peered":"2021-12-17T19:14:06.963133+0000","last_clean":"2021-12-17T19:14:06.963133+0000","last_became_active":"2021-12-17T18:18:16.006472+0000","last_became_peered":"2021-12-17T18:18:16.006472+0000","last_unstale":"2021-12-17T19:14:06.963133+0000","last_undegraded":"2021-12-17T19:14:06.963133+0000","last_fullsized":"2021-12-17T19:14:06.963133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T19:14:06.963133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T19:14:06.963133+0000","last_clean_scrub_stamp":"2021-12-17T19:14:06.963133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":148,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-12-17T19:14:03.885503+0000","last_change":"2021-12-17T19:14:03.885694+0000","last_active":"2021-12-17T19:14:03.885503+0000","last_peered":"2021-12-17T19:14:03.885503+0000","last_clean":"2021-12-17T19:14:03.885503+0000","last_became_active":"2021-12-17T18:18:15.739493+0000","last_became_peered":"2021-12-17T18:18:15.739493+0000","last_unstale":"2021-12-17T19:14:03.885503+0000","last_undegraded":"2021-12-17T19:14:03.885503+0000","last_fullsized":"2021-12-17T19:14:03.885503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T19:14:03.885503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T19:14:03.885503+0000","last_clean_scrub_stamp":"2021-12-17T19:14:03.885503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":155,"state":"active+clean","last_fresh":"2021-12-17T19:14:01.546565+0000","last_change":"2021-12-17T19:14:01.546648+0000","last_active":"2021-12-17T19:14:01.546565+0000","last_peered":"2021-12-17T19:14:01.546565+0000","last_clean":"2021-12-17T19:14:01.546565+0000","last_became_active":"2021-12-17T18:18:15.742720+0000","last_became_peered":"2021-12-17T18:18:15.742720+0000","last_unstale":"2021-12-17T19:14:01.546565+0000","last_undegraded":"2021-12-17T19:14:01.546565+0000","last_fullsized":"2021-12-17T19:14:01.546565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-12-17T19:14:01.546564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-12-17T19:14:01.546564+0000","last_clean_scrub_stamp":"2021-12-17T19:14:01.546564+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9687,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542820,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.79300000000000004,"15min":0.78500000000000003},"min":{"1min":0.64500000000000002,"5min":0.55600000000000005,"15min":0.49299999999999999},"max":{"1min":1.0049999999999999,"5min":1.0940000000000001,"15min":1.103},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.57499999999999996,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.002,"5min":1.0229999999999999,"15min":1.069},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.79900000000000004,"15min":0.78900000000000003},"min":{"1min":0.62,"5min":0.56699999999999995,"15min":0.54900000000000004},"max":{"1min":0.98299999999999998,"5min":1.145,"15min":1.179},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80700000000000005,"15min":0.81100000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.54300000000000004},"max":{"1min":1.0329999999999999,"5min":1.1220000000000001,"15min":1.179},"last":0.753}]},{"osd":2,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.82699999999999996,"15min":0.81699999999999995},"min":{"1min":0.58899999999999997,"5min":0.57899999999999996,"15min":0.56399999999999995},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.337},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.81799999999999995,"15min":0.82499999999999996},"min":{"1min":0.63,"5min":0.61499999999999999,"15min":0.57699999999999996},"max":{"1min":1.0389999999999999,"5min":1.0649999999999999,"15min":1.1879999999999999},"last":0.85599999999999998}]},{"osd":3,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.55300000000000005},"max":{"1min":1.101,"5min":1.101,"15min":1.3839999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.871,"15min":0.86299999999999999},"min":{"1min":0.69499999999999995,"5min":0.66300000000000003,"15min":0.625},"max":{"1min":1.0900000000000001,"5min":1.107,"15min":1.171},"last":0.73699999999999999}]},{"osd":4,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77300000000000002,"15min":0.78800000000000003},"min":{"1min":0.53000000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0269999999999999,"5min":1.0489999999999999,"15min":1.3200000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.90800000000000003,"15min":0.91200000000000003},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.50900000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.482},"last":0.97299999999999998}]},{"osd":5,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.622,"5min":0.60199999999999998,"15min":0.57599999999999996},"max":{"1min":1.1459999999999999,"5min":1.2430000000000001,"15min":1.4470000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.877,"5min":0.84599999999999997,"15min":0.85399999999999998},"min":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.52000000000000002},"max":{"1min":1.1200000000000001,"5min":1.2070000000000001,"15min":1.2549999999999999},"last":0.79500000000000004}]},{"osd":6,"last update":"Fri Dec 17 19:13:45 2021","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.89800000000000002,"15min":0.90500000000000003},"min":{"1min":0.66200000000000003,"5min":0.64300000000000002,"15min":0.59899999999999998},"max":{"1min":1.1559999999999999,"5min":1.173,"15min":1.286},"last":0.874},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.92300000000000004,"15min":0.91000000000000003},"min":{"1min":0.67600000000000005,"5min":0.60699999999999998,"15min":0.53400000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.431},"last":0.625}]}]},{"osd":6,"up_from":14,"seq":60129542820,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:13:52 2021","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98899999999999999,"5min":1.1180000000000001,"15min":1.165},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77700000000000002,"15min":0.78100000000000003},"min":{"1min":0.56399999999999995,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.95999999999999996,"5min":1.028,"15min":1.2370000000000001},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Dec 17 19:13:52 2021","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52300000000000002},"max":{"1min":0.97999999999999998,"5min":1.0669999999999999,"15min":1.151},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80400000000000005,"15min":0.80600000000000005},"min":{"1min":0.59299999999999997,"5min":0.56899999999999995,"15min":0.52700000000000002},"max":{"1min":0.96299999999999997,"5min":1.101,"15min":1.127},"last":0.80400000000000005}]},{"osd":2,"last update":"Fri Dec 17 19:13:52 2021","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.64100000000000001,"5min":0.58299999999999996,"15min":0.55400000000000005},"max":{"1min":1.0089999999999999,"5min":1.097,"15min":1.155},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.84599999999999997,"15min":0.85799999999999998},"min":{"1min":0.58199999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.028,"5min":1.1659999999999999,"15min":1.2050000000000001},"last":0.89900000000000002}]},{"osd":3,"last update":"Fri Dec 17 19:13:52 2021","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84899999999999998,"15min":0.85199999999999998},"min":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.54300000000000004},"max":{"1min":1.032,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.75},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.91100000000000003,"15min":0.92700000000000005},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.57199999999999995},"max":{"1min":1.093,"5min":1.2270000000000001,"15min":1.2809999999999999},"last":1.006}]},{"osd":4,"last update":"Fri Dec 17 19:13:52 2021","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.504},"max":{"1min":1.0529999999999999,"5min":1.1279999999999999,"15min":1.141},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.79900000000000004,"15min":0.80300000000000005},"min":{"1min":0.58499999999999996,"5min":0.55300000000000005,"15min":0.41999999999999998},"max":{"1min":1.151,"5min":1.276,"15min":1.3149999999999999},"last":0.92400000000000004}]},{"osd":5,"last update":"Fri Dec 17 19:13:52 2021","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.57799999999999996,"5min":0.53600000000000003,"15min":0.441},"max":{"1min":1.0580000000000001,"5min":1.131,"15min":1.381},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.86299999999999999,"15min":0.88700000000000001},"min":{"1min":0.69799999999999995,"5min":0.58599999999999997,"15min":0.54200000000000004},"max":{"1min":1.008,"5min":1.1799999999999999,"15min":1.3420000000000001},"last":0.873}]},{"osd":7,"last update":"Fri Dec 17 19:13:52 2021","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89100000000000001,"15min":0.91600000000000004},"min":{"1min":0.66600000000000004,"5min":0.59899999999999998,"15min":0.52200000000000002},"max":{"1min":1.0620000000000001,"5min":1.177,"15min":1.353},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.90700000000000003,"15min":0.93999999999999995},"min":{"1min":0.77000000000000002,"5min":0.55700000000000005,"15min":0.51100000000000001},"max":{"1min":1.101,"5min":1.214,"15min":1.47},"last":0.98399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542820,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:14:01 2021","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.54000000000000004,"5min":0.52600000000000002,"15min":0.48999999999999999},"max":{"1min":0.96699999999999997,"5min":1.071,"15min":1.1539999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.53700000000000003},"max":{"1min":0.98999999999999999,"5min":1.151,"15min":1.1619999999999999},"last":0.872}]},{"osd":1,"last update":"Fri Dec 17 19:14:01 2021","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.877,"15min":0.85999999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.52700000000000002},"max":{"1min":1.032,"5min":1.0960000000000001,"15min":1.2310000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.86299999999999999,"15min":0.88100000000000001},"min":{"1min":0.71899999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0249999999999999,"5min":1.038,"15min":1.149},"last":0.72899999999999998}]},{"osd":2,"last update":"Fri Dec 17 19:14:01 2021","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.80300000000000005,"15min":0.79800000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.97699999999999998,"5min":1.0720000000000001,"15min":1.2410000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.82699999999999996,"15min":0.81999999999999995},"min":{"1min":0.66200000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.91500000000000004,"5min":1.0549999999999999,"15min":1.1259999999999999},"last":0.81899999999999995}]},{"osd":3,"last update":"Fri Dec 17 19:14:01 2021","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0429999999999999,"5min":1.0840000000000001,"15min":1.117},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.87,"15min":0.86399999999999999},"min":{"1min":0.63200000000000001,"5min":0.629,"15min":0.59699999999999998},"max":{"1min":1.046,"5min":1.0940000000000001,"15min":1.1160000000000001},"last":0.76600000000000001}]},{"osd":4,"last update":"Fri Dec 17 19:14:01 2021","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.753,"15min":0.76400000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.503},"max":{"1min":0.98199999999999998,"5min":1.1359999999999999,"15min":1.1870000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.82299999999999995,"15min":0.83499999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.51900000000000002},"max":{"1min":1.075,"5min":1.0820000000000001,"15min":1.1910000000000001},"last":0.61199999999999999}]},{"osd":6,"last update":"Fri Dec 17 19:14:01 2021","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.83999999999999997,"15min":0.82499999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.54200000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.1919999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.90400000000000003,"15min":0.89200000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.57599999999999996},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.2370000000000001},"last":0.65400000000000003}]},{"osd":7,"last update":"Fri Dec 17 19:14:01 2021","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.90200000000000002,"15min":0.90500000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.53500000000000003},"max":{"1min":1.196,"5min":1.214,"15min":1.296},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":0.95199999999999996},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.246,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.1080000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542819,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:14:02 2021","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.80800000000000005,"15min":0.79300000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.42599999999999999},"max":{"1min":1.044,"5min":1.111,"15min":1.111},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80000000000000004,"15min":0.80600000000000005},"min":{"1min":0.63100000000000001,"5min":0.52600000000000002,"15min":0.51600000000000001},"max":{"1min":1.0369999999999999,"5min":1.097,"15min":1.099},"last":0.64900000000000002}]},{"osd":1,"last update":"Fri Dec 17 19:14:02 2021","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.61099999999999999,"5min":0.56399999999999995,"15min":0.495},"max":{"1min":1.0389999999999999,"5min":1.107,"15min":1.1779999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82299999999999995,"15min":0.81000000000000005},"min":{"1min":0.57399999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.024,"5min":1.071,"15min":1.234},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri Dec 17 19:14:02 2021","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.79800000000000004,"15min":0.80300000000000005},"min":{"1min":0.63,"5min":0.53900000000000003,"15min":0.51700000000000002},"max":{"1min":0.99099999999999999,"5min":1.0620000000000001,"15min":1.252},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83099999999999996,"15min":0.83299999999999996},"min":{"1min":0.68300000000000005,"5min":0.61599999999999999,"15min":0.58999999999999997},"max":{"1min":1.002,"5min":1.077,"15min":1.577},"last":0.97099999999999997}]},{"osd":3,"last update":"Fri Dec 17 19:14:02 2021","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.85199999999999998,"15min":0.84799999999999998},"min":{"1min":0.67200000000000004,"5min":0.58699999999999997,"15min":0.53400000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.141},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.93799999999999994},"min":{"1min":0.74099999999999999,"5min":0.66500000000000004,"15min":0.621},"max":{"1min":1.052,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.99399999999999999}]},{"osd":5,"last update":"Fri Dec 17 19:14:02 2021","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.59099999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0269999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.87,"15min":0.84499999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.52800000000000002},"max":{"1min":1.1559999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.0169999999999999}]},{"osd":6,"last update":"Fri Dec 17 19:14:02 2021","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86599999999999999,"15min":0.85399999999999998},"min":{"1min":0.57399999999999995,"5min":0.52400000000000002,"15min":0.51700000000000002},"max":{"1min":1.1299999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.90800000000000003,"15min":0.90700000000000003},"min":{"1min":0.69999999999999996,"5min":0.68700000000000006,"15min":0.56200000000000006},"max":{"1min":1.089,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0569999999999999}]},{"osd":7,"last update":"Fri Dec 17 19:14:02 2021","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96499999999999997,"15min":0.93799999999999994},"min":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.59899999999999998},"max":{"1min":1.2569999999999999,"5min":1.331,"15min":1.339},"last":1.089},{"interface":"front","average":{"1min":0.996,"5min":0.98699999999999999,"15min":0.98399999999999999},"min":{"1min":0.73299999999999998,"5min":0.61599999999999999,"15min":0.58899999999999997},"max":{"1min":1.212,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.042}]}]},{"osd":3,"up_from":14,"seq":60129542819,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81999999999999995,"5min":1.099,"15min":1.1000000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65800000000000003,"15min":0.65100000000000002},"min":{"1min":0.498,"5min":0.48599999999999999,"15min":0.46500000000000002},"max":{"1min":0.88900000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.65000000000000002}]},{"osd":1,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63100000000000001,"15min":0.61699999999999999},"min":{"1min":0.52200000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.1830000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.53600000000000003,"5min":0.499,"15min":0.48199999999999998},"max":{"1min":0.91600000000000004,"5min":1.0229999999999999,"15min":1.04},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.746,"15min":0.748},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90300000000000002,"5min":1.101,"15min":1.101},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.78600000000000003},"min":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.52900000000000003},"max":{"1min":1.0089999999999999,"5min":1.1899999999999999,"15min":1.1930000000000001},"last":0.80100000000000005}]},{"osd":4,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.85599999999999998,"15min":0.85199999999999998},"min":{"1min":0.69399999999999995,"5min":0.63900000000000001,"15min":0.61499999999999999},"max":{"1min":1.0629999999999999,"5min":1.226,"15min":1.226},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.90800000000000003,"15min":0.90200000000000002},"min":{"1min":0.68000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.069,"5min":1.248,"15min":1.248},"last":0.72599999999999998}]},{"osd":5,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.98499999999999999,"15min":0.97099999999999997},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71599999999999997},"max":{"1min":1.143,"5min":1.4139999999999999,"15min":1.534},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91400000000000003,"15min":0.90300000000000002},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.62},"max":{"1min":1.2509999999999999,"5min":1.413,"15min":1.413},"last":0.89700000000000002}]},{"osd":6,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.97299999999999998,"15min":0.97199999999999998},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.68500000000000005},"max":{"1min":1.159,"5min":1.3009999999999999,"15min":1.365},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.048,"15min":1.0309999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.2210000000000001,"5min":1.4550000000000001,"15min":1.486},"last":0.96399999999999997}]},{"osd":7,"last update":"Fri Dec 17 19:13:46 2021","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.016,"15min":0.996},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.67400000000000004},"max":{"1min":1.169,"5min":1.3839999999999999,"15min":1.387},"last":1.03},{"interface":"front","average":{"1min":0.999,"5min":1.0489999999999999,"15min":1.046},"min":{"1min":0.81399999999999995,"5min":0.80700000000000005,"15min":0.73999999999999999},"max":{"1min":1.278,"5min":1.3620000000000001,"15min":1.3680000000000001},"last":0.78900000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542820,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.45300000000000001,"5min":0.44400000000000001,"15min":0.438},"max":{"1min":0.82899999999999996,"5min":0.84799999999999998,"15min":0.95799999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.499,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.022,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.51300000000000001}]},{"osd":1,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.80200000000000005,"15min":0.81399999999999995},"min":{"1min":0.621,"5min":0.59799999999999998,"15min":0.56899999999999995},"max":{"1min":1.077,"5min":1.133,"15min":1.133},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68400000000000005,"15min":0.68500000000000005},"min":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.45900000000000002},"max":{"1min":0.92300000000000004,"5min":0.94799999999999995,"15min":1.004},"last":0.55200000000000005}]},{"osd":3,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.86199999999999999,"5min":1,"15min":1.083},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.036,"5min":1.1339999999999999,"15min":1.2310000000000001},"last":0.622}]},{"osd":4,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.85099999999999998,"15min":0.84999999999999998},"min":{"1min":0.67400000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.302},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94299999999999995,"15min":0.95899999999999996},"min":{"1min":0.77800000000000002,"5min":0.68999999999999995,"15min":0.66200000000000003},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.472},"last":0.97199999999999998}]},{"osd":5,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.877,"15min":0.876},"min":{"1min":0.71099999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2829999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.90900000000000003,"15min":0.91500000000000004},"min":{"1min":0.70199999999999996,"5min":0.68999999999999995,"15min":0.66500000000000004},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3600000000000001},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0029999999999999},"min":{"1min":0.83099999999999996,"5min":0.745,"15min":0.66900000000000004},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.3919999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.93600000000000005,"15min":0.94999999999999996},"min":{"1min":0.65000000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2070000000000001,"5min":1.236,"15min":1.3480000000000001},"last":0.91000000000000003}]},{"osd":7,"last update":"Fri Dec 17 19:13:47 2021","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0329999999999999,"15min":1.04},"min":{"1min":0.89600000000000002,"5min":0.78000000000000003,"15min":0.73399999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.5369999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.97799999999999998,"15min":0.98799999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68200000000000005},"max":{"1min":1.2090000000000001,"5min":1.284,"15min":1.4870000000000001},"last":1.014}]}]},{"osd":1,"up_from":14,"seq":60129542819,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050512,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321328,"statfs":{"total":96636764160,"available":95561039872,"internally_reserved":1073741824,"allocated":1974272,"data_stored":915139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 17 19:13:53 2021","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58399999999999996,"15min":0.58499999999999996},"min":{"1min":0.48899999999999999,"5min":0.438,"15min":0.433},"max":{"1min":0.85099999999999998,"5min":0.97099999999999997,"15min":1.032},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.45900000000000002},"max":{"1min":0.94499999999999995,"5min":1.109,"15min":1.125},"last":0.89100000000000001}]},{"osd":2,"last update":"Fri Dec 17 19:13:53 2021","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.47899999999999998,"5min":0.46000000000000002,"15min":0.442},"max":{"1min":0.83699999999999997,"5min":1.0249999999999999,"15min":1.1539999999999999},"last":0.624},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.56399999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1359999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.59099999999999997}]},{"osd":3,"last update":"Fri Dec 17 19:13:53 2021","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78900000000000003,"15min":0.78600000000000003},"min":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.52100000000000002},"max":{"1min":0.998,"5min":1.036,"15min":1.1240000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73099999999999998,"15min":0.73499999999999999},"min":{"1min":0.53900000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.002,"5min":1.054,"15min":1.054},"last":0.70199999999999996}]},{"osd":4,"last update":"Fri Dec 17 19:13:53 2021","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.81899999999999995,"15min":0.84799999999999998},"min":{"1min":0.68200000000000005,"5min":0.60599999999999998,"15min":0.60299999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.94599999999999995,"15min":0.94199999999999995},"min":{"1min":0.80700000000000005,"5min":0.70599999999999996,"15min":0.70299999999999996},"max":{"1min":1.254,"5min":1.2869999999999999,"15min":1.323},"last":0.81999999999999995}]},{"osd":5,"last update":"Fri Dec 17 19:13:53 2021","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92300000000000004,"15min":0.94399999999999995},"min":{"1min":0.70699999999999996,"5min":0.67000000000000004,"15min":0.65300000000000002},"max":{"1min":1.329,"5min":1.3500000000000001,"15min":1.482},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.92100000000000004,"15min":0.92500000000000004},"min":{"1min":0.73499999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.4790000000000001},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Dec 17 19:13:53 2021","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.96199999999999997,"15min":0.97699999999999998},"min":{"1min":0.70699999999999996,"5min":0.67900000000000005,"15min":0.66100000000000003},"max":{"1min":1.292,"5min":1.3180000000000001,"15min":1.5269999999999999},"last":1.026},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.95499999999999996,"15min":0.97699999999999998},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69599999999999995},"max":{"1min":1.272,"5min":1.294,"15min":1.4690000000000001},"last":1.0009999999999999}]},{"osd":7,"last update":"Fri Dec 17 19:13:53 2021","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.04,"15min":1.0289999999999999},"min":{"1min":0.88600000000000001,"5min":0.749,"15min":0.68200000000000005},"max":{"1min":1.294,"5min":1.373,"15min":1.472},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0409999999999999,"15min":1.048},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.341,"5min":1.363,"15min":1.4359999999999999},"last":1.2050000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542820,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050508,"kb_used_data":1924,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321332,"statfs":{"total":96636764160,"available":95561043968,"internally_reserved":1073741824,"allocated":1970176,"data_stored":914561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 17 19:14:03 2021","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54000000000000004,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.68000000000000005,"5min":0.95799999999999996,"15min":0.95999999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63100000000000001,"15min":0.64200000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.1240000000000001},"last":0.751}]},{"osd":2,"last update":"Fri Dec 17 19:14:03 2021","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67300000000000004,"15min":0.68999999999999995},"min":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94999999999999996,"5min":1.014,"15min":1.151},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76800000000000002,"15min":0.77500000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93799999999999994,"5min":1.0229999999999999,"15min":1.2050000000000001},"last":0.85499999999999998}]},{"osd":3,"last update":"Fri Dec 17 19:14:03 2021","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.48699999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.83699999999999997,"5min":1.093,"15min":1.093},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.54300000000000004,"5min":0.53700000000000003,"15min":0.52100000000000002},"max":{"1min":0.89800000000000002,"5min":1.276,"15min":1.276},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri Dec 17 19:14:03 2021","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.84099999999999997,"15min":0.84299999999999997},"min":{"1min":0.68700000000000006,"5min":0.65100000000000002,"15min":0.61899999999999999},"max":{"1min":0.92400000000000004,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.88900000000000001,"15min":0.90300000000000002},"min":{"1min":0.70699999999999996,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1899999999999999,"5min":1.2090000000000001,"15min":1.337},"last":0.98699999999999999}]},{"osd":5,"last update":"Fri Dec 17 19:14:03 2021","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.89900000000000002,"15min":0.91500000000000004},"min":{"1min":0.68000000000000005,"5min":0.63400000000000001,"15min":0.628},"max":{"1min":1.036,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.89700000000000002,"15min":0.90300000000000002},"min":{"1min":0.68700000000000006,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.0409999999999999,"5min":1.2669999999999999,"15min":1.3320000000000001},"last":0.78900000000000003}]},{"osd":6,"last update":"Fri Dec 17 19:14:03 2021","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.92900000000000005,"15min":0.95599999999999996},"min":{"1min":0.71699999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.101,"5min":1.3380000000000001,"15min":1.4550000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.95599999999999996,"15min":0.97199999999999998},"min":{"1min":0.75,"5min":0.70499999999999996,"15min":0.69399999999999995},"max":{"1min":1.1479999999999999,"5min":1.194,"15min":1.3089999999999999},"last":0.93500000000000005}]},{"osd":7,"last update":"Fri Dec 17 19:14:03 2021","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.97899999999999998,"15min":0.99299999999999999},"min":{"1min":0.76100000000000001,"5min":0.73099999999999998,"15min":0.66500000000000004},"max":{"1min":1.2589999999999999,"5min":1.2929999999999999,"15min":1.3240000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.98199999999999998,"15min":0.98599999999999999},"min":{"1min":0.79600000000000004,"5min":0.76200000000000001,"15min":0.67900000000000005},"max":{"1min":1.236,"5min":1.3169999999999999,"15min":1.534},"last":0.84599999999999997}]}]}]}} 2021-12-17T19:14:21.684 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2021-12-17T19:14:21.794 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68c7051700 1 Processor -- start 2021-12-17T19:14:21.795 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68c7051700 1 -- start start 2021-12-17T19:14:21.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68c7051700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f68c0067690 0x7f68c0142f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:21.797 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68c7051700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68c0140200 0x7f68c0140640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:21.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68c7051700 1 -- --> v1:172.21.15.109:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c0060520 con 0x7f68c00aec80 2021-12-17T19:14:21.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68c7051700 1 -- --> v2:172.21.15.109:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c00b1b30 con 0x7f68c0067690 2021-12-17T19:14:21.798 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68c7051700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00b0780 con 0x7f68c0140200 2021-12-17T19:14:21.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68bffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68c0140200 0x7f68c0140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:21.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68c4ded700 1 --2- >> v2:172.21.15.109:3300/0 conn(0x7f68c0067690 0x7f68c0142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:21.799 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68bffff700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68c0140200 0x7f68c0140640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.109:3301/0 says I am v2:172.21.15.62:51724/0 (socket says 172.21.15.62:51724) 2021-12-17T19:14:21.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68bffff700 1 -- 172.21.15.62:0/3376786869 learned_addr learned my addr 172.21.15.62:0/3376786869 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:14:21.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68bffff700 1 -- 172.21.15.62:0/3376786869 >> v2:172.21.15.109:3300/0 conn(0x7f68c0067690 msgr2=0x7f68c0142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-12-17T19:14:21.800 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68bffff700 1 --2- 172.21.15.62:0/3376786869 >> v2:172.21.15.109:3300/0 conn(0x7f68c0067690 0x7f68c0142f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68bffff700 1 -- 172.21.15.62:0/3376786869 >> v1:172.21.15.109:6789/0 conn(0x7f68c00aec80 legacy=0x7f68c00af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:21.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68bffff700 1 -- 172.21.15.62:0/3376786869 --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c0067a70 con 0x7f68c0140200 2021-12-17T19:14:21.801 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68bffff700 1 --2- 172.21.15.62:0/3376786869 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68c0140200 0x7f68c0140640 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f68ac002f70 tx=0x7f68ac006eb0).ready entity=mon.2 client_cookie=edf6ec4a244e335 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:21.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68bf7fe700 1 -- 172.21.15.62:0/3376786869 <== mon.2 v2:172.21.15.109:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68ac00d570 con 0x7f68c0140200 2021-12-17T19:14:21.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68bf7fe700 1 -- 172.21.15.62:0/3376786869 <== mon.2 v2:172.21.15.109:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac000e90 con 0x7f68c0140200 2021-12-17T19:14:21.802 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68bf7fe700 1 -- 172.21.15.62:0/3376786869 <== mon.2 v2:172.21.15.109:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68ac00d900 con 0x7f68c0140200 2021-12-17T19:14:21.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68c7051700 1 -- 172.21.15.62:0/3376786869 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68c0140200 msgr2=0x7f68c0140640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:21.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68c7051700 1 --2- 172.21.15.62:0/3376786869 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68c0140200 0x7f68c0140640 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f68ac002f70 tx=0x7f68ac006eb0).stop 2021-12-17T19:14:21.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68c7051700 1 -- 172.21.15.62:0/3376786869 shutdown_connections 2021-12-17T19:14:21.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68c7051700 1 --2- 172.21.15.62:0/3376786869 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68c0140200 0x7f68c0140640 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68c7051700 1 --2- 172.21.15.62:0/3376786869 >> v2:172.21.15.109:3300/0 conn(0x7f68c0067690 0x7f68c0142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68c7051700 1 -- 172.21.15.62:0/3376786869 >> 172.21.15.62:0/3376786869 conn(0x7f68c005cac0 msgr2=0x7f68c005ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:14:21.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.787+0000 7f68c7051700 1 -- 172.21.15.62:0/3376786869 shutdown_connections 2021-12-17T19:14:21.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68c7051700 1 -- 172.21.15.62:0/3376786869 wait complete. 2021-12-17T19:14:21.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68c7051700 1 Processor -- start 2021-12-17T19:14:21.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68c7051700 1 -- start start 2021-12-17T19:14:21.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68c7051700 1 --2- >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68c0067690 0x7f68c014a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:21.814 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68c7051700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68c00aec80 0x7f68c0152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:21.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68c7051700 1 --2- >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f68c0140200 0x7f68c0111680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:21.815 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68c7051700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c01462f0 con 0x7f68c00aec80 2021-12-17T19:14:21.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68c7051700 1 -- --> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0146540 con 0x7f68c0140200 2021-12-17T19:14:21.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68c7051700 1 -- --> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c010fce0 con 0x7f68c0067690 2021-12-17T19:14:21.816 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68bffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68c00aec80 0x7f68c0152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:21.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68bffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68c00aec80 0x7f68c0152350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58028/0 (socket says 172.21.15.62:58028) 2021-12-17T19:14:21.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68bffff700 1 -- 172.21.15.62:0/1815622699 learned_addr learned my addr 172.21.15.62:0/1815622699 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-12-17T19:14:21.817 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68c4ded700 1 --2- 172.21.15.62:0/1815622699 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68c0067690 0x7f68c014a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:21.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68c55ee700 1 --2- 172.21.15.62:0/1815622699 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f68c0140200 0x7f68c0111680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:21.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68bffff700 1 -- 172.21.15.62:0/1815622699 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68c0067690 msgr2=0x7f68c014a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:21.818 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68bffff700 1 --2- 172.21.15.62:0/1815622699 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68c0067690 0x7f68c014a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68bffff700 1 -- 172.21.15.62:0/1815622699 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f68c0140200 msgr2=0x7f68c0111680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:21.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68bffff700 1 --2- 172.21.15.62:0/1815622699 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f68c0140200 0x7f68c0111680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.819 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68bffff700 1 -- 172.21.15.62:0/1815622699 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac00b1e0 con 0x7f68c00aec80 2021-12-17T19:14:21.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.791+0000 7f68bffff700 1 --2- 172.21.15.62:0/1815622699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68c00aec80 0x7f68c0152350 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f68ac002f70 tx=0x7f68ac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:21.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.795+0000 7f68bdffb700 1 -- 172.21.15.62:0/1815622699 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68ac0117e0 con 0x7f68c00aec80 2021-12-17T19:14:21.820 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.795+0000 7f68bdffb700 1 -- 172.21.15.62:0/1815622699 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac011940 con 0x7f68c00aec80 2021-12-17T19:14:21.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.795+0000 7f68c7051700 1 -- 172.21.15.62:0/1815622699 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c010eef0 con 0x7f68c00aec80 2021-12-17T19:14:21.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.795+0000 7f68bdffb700 1 -- 172.21.15.62:0/1815622699 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68ac011ca0 con 0x7f68c00aec80 2021-12-17T19:14:21.821 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.795+0000 7f68c7051700 1 -- 172.21.15.62:0/1815622699 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c0147290 con 0x7f68c00aec80 2021-12-17T19:14:21.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.795+0000 7f68c7051700 1 -- 172.21.15.62:0/1815622699 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c0146700 con 0x7f68c00aec80 2021-12-17T19:14:21.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.795+0000 7f68bdffb700 1 -- 172.21.15.62:0/1815622699 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f68ac025030 con 0x7f68c00aec80 2021-12-17T19:14:21.822 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.795+0000 7f68bdffb700 1 --2- 172.21.15.62:0/1815622699 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68a00536a0 0x7f68a0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-12-17T19:14:21.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.795+0000 7f68bdffb700 1 -- 172.21.15.62:0/1815622699 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f68ac06c770 con 0x7f68c00aec80 2021-12-17T19:14:21.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.795+0000 7f68c4ded700 1 --2- 172.21.15.62:0/1815622699 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68a00536a0 0x7f68a0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-12-17T19:14:21.823 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.799+0000 7f68c4ded700 1 --2- 172.21.15.62:0/1815622699 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68a00536a0 0x7f68a0055b60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f68b400b000 tx=0x7f68b4006df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-12-17T19:14:21.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.803+0000 7f68bdffb700 1 -- 172.21.15.62:0/1815622699 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f68ac043b10 con 0x7f68c00aec80 2021-12-17T19:14:21.937 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.927+0000 7f68c7051700 1 -- 172.21.15.62:0/1815622699 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f68c010f0b0 con 0x7f68c00aec80 2021-12-17T19:14:21.945 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.935+0000 7f68bdffb700 1 -- 172.21.15.62:0/1815622699 <== mon.0 v2:172.21.15.62:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f68ac043b10 con 0x7f68c00aec80 2021-12-17T19:14:21.946 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.935+0000 7f68bdffb700 1 -- 172.21.15.62:0/1815622699 <== mon.0 v2:172.21.15.62:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v25)=0 v25) v1 ==== 123+0+0 (secure 0 0 0) 0x7f68ac023020 con 0x7f68c00aec80 2021-12-17T19:14:21.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.939+0000 7f68c7051700 1 -- 172.21.15.62:0/1815622699 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68a00536a0 msgr2=0x7f68a0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:21.949 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.939+0000 7f68c7051700 1 --2- 172.21.15.62:0/1815622699 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68a00536a0 0x7f68a0055b60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f68b400b000 tx=0x7f68b4006df0).stop 2021-12-17T19:14:21.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.939+0000 7f68c7051700 1 -- 172.21.15.62:0/1815622699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68c00aec80 msgr2=0x7f68c0152350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-12-17T19:14:21.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.939+0000 7f68c7051700 1 --2- 172.21.15.62:0/1815622699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68c00aec80 0x7f68c0152350 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f68ac002f70 tx=0x7f68ac015000).stop 2021-12-17T19:14:21.950 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.939+0000 7f68c7051700 1 -- 172.21.15.62:0/1815622699 shutdown_connections 2021-12-17T19:14:21.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.939+0000 7f68c7051700 1 --2- 172.21.15.62:0/1815622699 >> [v2:172.21.15.109:6800/14658,v1:172.21.15.109:6801/14658] conn(0x7f68a00536a0 0x7f68a0055b60 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.939+0000 7f68c7051700 1 --2- 172.21.15.62:0/1815622699 >> [v2:172.21.15.109:3300/0,v1:172.21.15.109:6789/0] conn(0x7f68c0140200 0x7f68c0111680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.951 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.939+0000 7f68c7051700 1 --2- 172.21.15.62:0/1815622699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68c00aec80 0x7f68c0152350 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.939+0000 7f68c7051700 1 --2- 172.21.15.62:0/1815622699 >> [v2:172.21.15.109:3301/0,v1:172.21.15.109:6790/0] conn(0x7f68c0067690 0x7f68c014a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-12-17T19:14:21.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.939+0000 7f68c7051700 1 -- 172.21.15.62:0/1815622699 >> 172.21.15.62:0/1815622699 conn(0x7f68c005cac0 msgr2=0x7f68c013f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-12-17T19:14:21.952 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.939+0000 7f68c7051700 1 -- 172.21.15.62:0/1815622699 shutdown_connections 2021-12-17T19:14:21.953 INFO:teuthology.orchestra.run.smithi062.stderr:2021-12-17T19:14:21.939+0000 7f68c7051700 1 -- 172.21.15.62:0/1815622699 wait complete. 2021-12-17T19:14:21.961 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/ceph.py", line 1839, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/ceph_fuse.py", line 159, in task if mount.is_mounted(): File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-12-17T19:14:21.965 INFO:teuthology.misc:Shutting down mds daemons... 2021-12-17T19:14:21.966 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-12-17T19:14:21.966 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T19:14:21.979 INFO:tasks.ceph.mds.a:Stopped 2021-12-17T19:14:21.980 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-12-17T19:14:21.981 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T19:14:21.997 INFO:tasks.ceph.mds.b:Stopped 2021-12-17T19:14:21.998 INFO:teuthology.misc:Shutting down osd daemons... 2021-12-17T19:14:21.999 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2021-12-17T19:14:22.000 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T19:14:22.071 INFO:tasks.ceph.osd.0:Stopped 2021-12-17T19:14:22.072 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2021-12-17T19:14:22.073 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T19:14:22.158 INFO:tasks.ceph.osd.1:Stopped 2021-12-17T19:14:22.159 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2021-12-17T19:14:22.160 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T19:14:22.248 INFO:tasks.ceph.osd.2:Stopped 2021-12-17T19:14:22.250 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2021-12-17T19:14:22.251 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T19:14:22.338 INFO:tasks.ceph.osd.3:Stopped 2021-12-17T19:14:22.339 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2021-12-17T19:14:22.340 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T19:14:22.404 INFO:tasks.ceph.osd.4:Stopped 2021-12-17T19:14:22.407 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2021-12-17T19:14:22.408 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T19:14:22.499 INFO:tasks.ceph.osd.5:Stopped 2021-12-17T19:14:22.501 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2021-12-17T19:14:22.501 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T19:14:22.574 INFO:tasks.ceph.osd.6:Stopped 2021-12-17T19:14:22.576 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2021-12-17T19:14:22.576 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T19:14:22.631 INFO:tasks.ceph.osd.7:Stopped 2021-12-17T19:14:22.632 INFO:teuthology.misc:Shutting down mgr daemons... 2021-12-17T19:14:22.633 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2021-12-17T19:14:22.633 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T19:14:22.661 INFO:tasks.ceph.mgr.y:Stopped 2021-12-17T19:14:22.662 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2021-12-17T19:14:22.663 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T19:14:22.686 INFO:tasks.ceph.mgr.x:Stopped 2021-12-17T19:14:22.687 INFO:teuthology.misc:Shutting down mon daemons... 2021-12-17T19:14:22.688 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2021-12-17T19:14:22.689 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T19:14:22.715 INFO:tasks.ceph.mon.a:Stopped 2021-12-17T19:14:22.716 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2021-12-17T19:14:22.717 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T19:14:22.752 INFO:tasks.ceph.mon.b:Stopped 2021-12-17T19:14:22.753 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2021-12-17T19:14:22.754 INFO:teuthology.orchestra.run:waiting for 300 2021-12-17T19:14:22.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2021-12-17T19:14:22.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2021-12-17T19:14:22.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2021-12-17T19:14:22.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2021-12-17T19:14:22.776 INFO:tasks.ceph.mon.c:Stopped 2021-12-17T19:14:22.777 INFO:tasks.ceph:Checking cluster log for badness... 2021-12-17T19:14:22.778 DEBUG:teuthology.orchestra.run.smithi062:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'has not responded to cap revoke by MDS for over' | egrep -v MDS_CLIENT_LATE_RELEASE | egrep -v 'responding to mclientcaps' | head -n 1 2021-12-17T19:14:22.800 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi062.front.sepia.ceph.com 2021-12-17T19:14:22.801 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2021-12-17T19:14:23.090 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi062.front.sepia.ceph.com 2021-12-17T19:14:23.091 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-12-17T19:14:23.357 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi062.front.sepia.ceph.com 2021-12-17T19:14:23.358 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2021-12-17T19:14:23.532 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi062.front.sepia.ceph.com 2021-12-17T19:14:23.533 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2021-12-17T19:14:23.716 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi109.front.sepia.ceph.com 2021-12-17T19:14:23.717 DEBUG:teuthology.orchestra.run.smithi109:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2021-12-17T19:14:23.989 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi109.front.sepia.ceph.com 2021-12-17T19:14:23.990 DEBUG:teuthology.orchestra.run.smithi109:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2021-12-17T19:14:24.194 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi109.front.sepia.ceph.com 2021-12-17T19:14:24.195 DEBUG:teuthology.orchestra.run.smithi109:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2021-12-17T19:14:24.373 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi109.front.sepia.ceph.com 2021-12-17T19:14:24.374 DEBUG:teuthology.orchestra.run.smithi109:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2021-12-17T19:14:24.539 INFO:tasks.ceph:Archiving mon data... 2021-12-17T19:14:24.541 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/data/mon.a.tgz 2021-12-17T19:14:24.542 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-12-17T19:14:24.549 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.8X4iFMbh2j 2021-12-17T19:14:24.550 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.8X4iFMbh2j 2021-12-17T19:14:24.803 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.8X4iFMbh2j 2021-12-17T19:14:24.822 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.8X4iFMbh2j is 480KB 2021-12-17T19:14:24.892 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.8X4iFMbh2j 2021-12-17T19:14:24.900 DEBUG:teuthology.misc:Transferring archived files from smithi109:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/data/mon.b.tgz 2021-12-17T19:14:24.900 DEBUG:teuthology.orchestra.run.smithi109:> mktemp 2021-12-17T19:14:24.907 INFO:teuthology.orchestra.run.smithi109.stdout:/tmp/tmp.rXMC0bBI2u 2021-12-17T19:14:24.908 DEBUG:teuthology.orchestra.run.smithi109:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.rXMC0bBI2u 2021-12-17T19:14:25.119 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod 0666 /tmp/tmp.rXMC0bBI2u 2021-12-17T19:14:25.185 DEBUG:teuthology.orchestra.remote:smithi109:/tmp/tmp.rXMC0bBI2u is 538KB 2021-12-17T19:14:25.253 DEBUG:teuthology.orchestra.run.smithi109:> rm -fr /tmp/tmp.rXMC0bBI2u 2021-12-17T19:14:25.261 DEBUG:teuthology.misc:Transferring archived files from smithi109:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/data/mon.c.tgz 2021-12-17T19:14:25.262 DEBUG:teuthology.orchestra.run.smithi109:> mktemp 2021-12-17T19:14:25.269 INFO:teuthology.orchestra.run.smithi109.stdout:/tmp/tmp.3H5EdtIhpM 2021-12-17T19:14:25.270 DEBUG:teuthology.orchestra.run.smithi109:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.3H5EdtIhpM 2021-12-17T19:14:25.520 DEBUG:teuthology.orchestra.run.smithi109:> sudo chmod 0666 /tmp/tmp.3H5EdtIhpM 2021-12-17T19:14:25.543 DEBUG:teuthology.orchestra.remote:smithi109:/tmp/tmp.3H5EdtIhpM is 538KB 2021-12-17T19:14:25.609 DEBUG:teuthology.orchestra.run.smithi109:> rm -fr /tmp/tmp.3H5EdtIhpM 2021-12-17T19:14:25.616 INFO:tasks.ceph:Cleaning ceph cluster... 2021-12-17T19:14:25.617 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-12-17T19:14:25.621 DEBUG:teuthology.orchestra.run.smithi109:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-12-17T19:14:25.624 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-12-17T19:14:25.627 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-12-17T19:14:25.629 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-12-17T19:14:25.646 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2021-12-17T19:14:25.647 DEBUG:teuthology.orchestra.run.smithi062:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-12-17T19:14:25.679 DEBUG:teuthology.orchestra.run.smithi109:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-12-17T19:14:25.683 DEBUG:teuthology.orchestra.run.smithi125:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-12-17T19:14:25.686 DEBUG:teuthology.orchestra.run.smithi158:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-12-17T19:14:25.689 DEBUG:teuthology.orchestra.run.smithi192:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-12-17T19:14:25.706 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-12-17T19:14:25.707 INFO:teuthology.orchestra.run.smithi109.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-12-17T19:14:25.710 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-12-17T19:14:25.712 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-12-17T19:14:25.783 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-12-17T19:14:25.792 INFO:tasks.ceph:Archiving crash dumps... 2021-12-17T19:14:25.795 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/remote/smithi062/crash 2021-12-17T19:14:25.797 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-12-17T19:14:25.819 DEBUG:teuthology.misc:Transferring archived files from smithi109:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/remote/smithi109/crash 2021-12-17T19:14:25.820 DEBUG:teuthology.orchestra.run.smithi109:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-12-17T19:14:25.841 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/remote/smithi125/crash 2021-12-17T19:14:25.843 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-12-17T19:14:25.864 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/remote/smithi158/crash 2021-12-17T19:14:25.866 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-12-17T19:14:25.887 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/remote/smithi192/crash 2021-12-17T19:14:25.888 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-12-17T19:14:25.909 INFO:tasks.ceph:Shutting down logrotate 2021-12-17T19:14:25.911 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:14:25.914 DEBUG:teuthology.orchestra.run.smithi109:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:14:25.917 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:14:25.920 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:14:25.922 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-12-17T19:14:25.976 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-12-17T19:14:25.993 DEBUG:teuthology.orchestra.run.smithi109:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-12-17T19:14:26.009 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-12-17T19:14:26.025 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-12-17T19:14:26.041 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-12-17T19:14:26.061 INFO:tasks.ceph:Compressing logs... 2021-12-17T19:14:26.062 DEBUG:teuthology.orchestra.run.smithi062:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-12-17T19:14:26.065 DEBUG:teuthology.orchestra.run.smithi109:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-12-17T19:14:26.068 DEBUG:teuthology.orchestra.run.smithi125:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-12-17T19:14:26.070 DEBUG:teuthology.orchestra.run.smithi158:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-12-17T19:14:26.083 DEBUG:teuthology.orchestra.run.smithi192:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-12-17T19:14:27.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2021-12-17T19:14:27.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2021-12-17T19:14:27.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2021-12-17T19:14:27.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2021-12-17T19:14:38.987 INFO:tasks.ceph:Archiving logs... 2021-12-17T19:14:38.988 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/remote/smithi062/log 2021-12-17T19:14:38.990 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/log/ceph -- . 2021-12-17T19:14:42.363 DEBUG:teuthology.misc:Transferring archived files from smithi109:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/remote/smithi109/log 2021-12-17T19:14:42.364 DEBUG:teuthology.orchestra.run.smithi109:> sudo tar cz -f - -C /var/log/ceph -- . 2021-12-17T19:14:44.837 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/remote/smithi125/log 2021-12-17T19:14:44.839 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar cz -f - -C /var/log/ceph -- . 2021-12-17T19:14:45.268 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/remote/smithi158/log 2021-12-17T19:14:45.270 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar cz -f - -C /var/log/ceph -- . 2021-12-17T19:14:45.304 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/remote/smithi192/log 2021-12-17T19:14:45.306 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/log/ceph -- . 2021-12-17T19:14:45.328 DEBUG:teuthology.run_tasks:Unwinding manager install 2021-12-17T19:14:45.342 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/task/install/__init__.py", line 619, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/ceph_fuse.py", line 159, in task if mount.is_mounted(): File "/home/teuthworker/src/github.com_ceph_ceph_05c319fc280f505b26f579a01ab4d14d2f130a5b/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-12-17T19:14:45.346 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2021-12-17T19:14:45.346 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-12-17T19:14:45.350 DEBUG:teuthology.orchestra.run.smithi109:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-12-17T19:14:45.352 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-12-17T19:14:45.355 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-12-17T19:14:45.358 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-12-17T19:14:45.493 DEBUG:teuthology.run_tasks:Unwinding manager clock 2021-12-17T19:14:45.505 INFO:teuthology.task.clock:Checking final clock skew... 2021-12-17T19:14:45.506 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-12-17T19:14:45.509 DEBUG:teuthology.orchestra.run.smithi109:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-12-17T19:14:45.513 DEBUG:teuthology.orchestra.run.smithi125:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-12-17T19:14:45.515 DEBUG:teuthology.orchestra.run.smithi158:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-12-17T19:14:45.519 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-12-17T19:14:45.527 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2021-12-17T19:14:45.527 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2021-12-17T19:14:45.528 INFO:teuthology.orchestra.run.smithi062.stdout:-hv01.front.sepi 216.240.36.24 3 u 87 128 377 0.147 16.435 0.395 2021-12-17T19:14:45.528 INFO:teuthology.orchestra.run.smithi062.stdout:*hv02.front.sepi 163.237.218.18 2 u 109 128 377 0.182 5.387 0.727 2021-12-17T19:14:45.528 INFO:teuthology.orchestra.run.smithi062.stdout:+hv03.front.sepi 216.229.4.69 3 u 71 128 377 0.151 6.361 0.685 2021-12-17T19:14:45.529 INFO:teuthology.orchestra.run.smithi062.stdout:+hv04.front.sepi 96.245.170.99 3 u 80 128 377 0.169 5.055 0.943 2021-12-17T19:14:45.532 INFO:teuthology.orchestra.run.smithi109.stdout: remote refid st t when poll reach delay offset jitter 2021-12-17T19:14:45.533 INFO:teuthology.orchestra.run.smithi109.stdout:============================================================================== 2021-12-17T19:14:45.533 INFO:teuthology.orchestra.run.smithi109.stdout:-hv01.front.sepi 216.240.36.24 3 u 113 128 377 0.180 16.635 0.489 2021-12-17T19:14:45.533 INFO:teuthology.orchestra.run.smithi109.stdout:*hv02.front.sepi 163.237.218.18 2 u 24 128 377 0.133 5.978 0.696 2021-12-17T19:14:45.534 INFO:teuthology.orchestra.run.smithi109.stdout:+hv03.front.sepi 216.229.4.69 3 u 134 128 377 0.189 7.283 0.516 2021-12-17T19:14:45.534 INFO:teuthology.orchestra.run.smithi109.stdout:+hv04.front.sepi 96.245.170.99 3 u 30 128 377 0.141 4.886 0.727 2021-12-17T19:14:45.536 INFO:teuthology.orchestra.run.smithi125.stdout: remote refid st t when poll reach delay offset jitter 2021-12-17T19:14:45.536 INFO:teuthology.orchestra.run.smithi125.stdout:============================================================================== 2021-12-17T19:14:45.537 INFO:teuthology.orchestra.run.smithi125.stdout:-hv01.front.sepi 216.240.36.24 3 u 47 128 377 0.153 14.527 0.758 2021-12-17T19:14:45.537 INFO:teuthology.orchestra.run.smithi125.stdout:*hv02.front.sepi 163.237.218.18 2 u 98 128 377 0.147 2.451 1.096 2021-12-17T19:14:45.538 INFO:teuthology.orchestra.run.smithi125.stdout:+hv03.front.sepi 216.229.4.69 3 u 43 128 377 0.162 4.713 0.571 2021-12-17T19:14:45.538 INFO:teuthology.orchestra.run.smithi125.stdout:+hv04.front.sepi 96.245.170.99 3 u 102 128 377 0.152 2.789 0.965 2021-12-17T19:14:45.539 INFO:teuthology.orchestra.run.smithi158.stdout: remote refid st t when poll reach delay offset jitter 2021-12-17T19:14:45.539 INFO:teuthology.orchestra.run.smithi158.stdout:============================================================================== 2021-12-17T19:14:45.540 INFO:teuthology.orchestra.run.smithi158.stdout:-hv01.front.sepi 216.240.36.24 3 u 21 64 377 0.063 11.936 0.394 2021-12-17T19:14:45.540 INFO:teuthology.orchestra.run.smithi158.stdout:*hv02.front.sepi 163.237.218.18 2 u 22 64 377 0.108 1.269 0.186 2021-12-17T19:14:45.540 INFO:teuthology.orchestra.run.smithi158.stdout:+hv03.front.sepi 216.229.4.69 3 u 41 64 377 0.095 2.087 0.272 2021-12-17T19:14:45.541 INFO:teuthology.orchestra.run.smithi158.stdout:+hv04.front.sepi 96.245.170.99 3 u 32 64 377 0.080 -0.123 0.149 2021-12-17T19:14:45.542 INFO:teuthology.orchestra.run.smithi192.stdout: remote refid st t when poll reach delay offset jitter 2021-12-17T19:14:45.543 INFO:teuthology.orchestra.run.smithi192.stdout:============================================================================== 2021-12-17T19:14:45.543 INFO:teuthology.orchestra.run.smithi192.stdout:-hv01.front.sepi 216.240.36.24 3 u 26 128 377 0.082 11.192 0.510 2021-12-17T19:14:45.543 INFO:teuthology.orchestra.run.smithi192.stdout:*hv02.front.sepi 163.237.218.18 2 u 29 128 377 0.081 0.658 0.113 2021-12-17T19:14:45.544 INFO:teuthology.orchestra.run.smithi192.stdout:+hv03.front.sepi 216.229.4.69 3 u 107 128 377 0.095 1.681 0.146 2021-12-17T19:14:45.544 INFO:teuthology.orchestra.run.smithi192.stdout:+hv04.front.sepi 96.245.170.99 3 u 28 128 377 0.069 -0.600 0.124 2021-12-17T19:14:45.545 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2021-12-17T19:14:45.568 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2021-12-17T19:14:45.569 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2021-12-17T19:14:45.594 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-12-17T19:14:45.619 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2021-12-17T19:14:45.644 INFO:teuthology.task.internal:Duration was 3803.819027 seconds 2021-12-17T19:14:45.646 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2021-12-17T19:14:45.670 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-12-17T19:14:45.671 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-12-17T19:14:45.674 DEBUG:teuthology.orchestra.run.smithi109:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-12-17T19:14:45.676 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-12-17T19:14:45.679 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-12-17T19:14:45.682 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-12-17T19:14:45.732 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-12-17T19:14:45.733 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2021-12-17T19:14:45.734 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-12-17T19:14:45.749 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi109.front.sepia.ceph.com 2021-12-17T19:14:45.750 DEBUG:teuthology.orchestra.run.smithi109:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-12-17T19:14:45.766 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi125.front.sepia.ceph.com 2021-12-17T19:14:45.767 DEBUG:teuthology.orchestra.run.smithi125:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-12-17T19:14:45.785 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi158.front.sepia.ceph.com 2021-12-17T19:14:45.786 DEBUG:teuthology.orchestra.run.smithi158:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-12-17T19:14:45.802 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2021-12-17T19:14:45.803 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-12-17T19:14:45.820 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2021-12-17T19:14:45.821 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-12-17T19:14:45.824 DEBUG:teuthology.orchestra.run.smithi109:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-12-17T19:14:45.827 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-12-17T19:14:45.830 DEBUG:teuthology.orchestra.run.smithi158:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-12-17T19:14:45.832 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-12-17T19:14:45.893 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2021-12-17T19:14:45.894 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2021-12-17T19:14:45.903 DEBUG:teuthology.orchestra.run.smithi109:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2021-12-17T19:14:45.907 DEBUG:teuthology.orchestra.run.smithi125:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2021-12-17T19:14:45.909 DEBUG:teuthology.orchestra.run.smithi158:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2021-12-17T19:14:45.912 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2021-12-17T19:14:45.981 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2021-12-17T19:14:45.995 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2021-12-17T19:14:45.996 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-12-17T19:14:46.013 DEBUG:teuthology.orchestra.run.smithi109:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-12-17T19:14:46.030 DEBUG:teuthology.orchestra.run.smithi125:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-12-17T19:14:46.046 DEBUG:teuthology.orchestra.run.smithi158:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-12-17T19:14:46.064 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-12-17T19:14:46.081 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2021-12-17T19:14:46.099 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-12-17T19:14:46.103 DEBUG:teuthology.orchestra.run.smithi109:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-12-17T19:14:46.107 DEBUG:teuthology.orchestra.run.smithi125:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-12-17T19:14:46.109 DEBUG:teuthology.orchestra.run.smithi158:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-12-17T19:14:46.112 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-12-17T19:14:46.116 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2021-12-17T19:14:46.119 INFO:teuthology.orchestra.run.smithi109.stdout:kernel.core_pattern = core 2021-12-17T19:14:46.122 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = core 2021-12-17T19:14:46.124 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = core 2021-12-17T19:14:46.139 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2021-12-17T19:14:46.155 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2021-12-17T19:14:46.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T19:14:46.163 DEBUG:teuthology.orchestra.run.smithi109:> test -e /home/ubuntu/cephtest/archive/coredump 2021-12-17T19:14:46.199 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T19:14:46.200 DEBUG:teuthology.orchestra.run.smithi125:> test -e /home/ubuntu/cephtest/archive/coredump 2021-12-17T19:14:46.206 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T19:14:46.207 DEBUG:teuthology.orchestra.run.smithi158:> test -e /home/ubuntu/cephtest/archive/coredump 2021-12-17T19:14:46.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T19:14:46.214 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2021-12-17T19:14:46.220 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-12-17T19:14:46.221 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2021-12-17T19:14:46.234 INFO:teuthology.task.internal:Transferring archived files... 2021-12-17T19:14:46.235 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/remote/smithi062 2021-12-17T19:14:46.236 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-12-17T19:14:46.275 DEBUG:teuthology.misc:Transferring archived files from smithi109:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/remote/smithi109 2021-12-17T19:14:46.276 DEBUG:teuthology.orchestra.run.smithi109:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-12-17T19:14:46.314 DEBUG:teuthology.misc:Transferring archived files from smithi125:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/remote/smithi125 2021-12-17T19:14:46.315 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-12-17T19:14:46.353 DEBUG:teuthology.misc:Transferring archived files from smithi158:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/remote/smithi158 2021-12-17T19:14:46.354 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-12-17T19:14:46.392 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-12-17_04:10:02-fs-octopus-distro-default-smithi/6567154/remote/smithi192 2021-12-17T19:14:46.393 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-12-17T19:14:46.427 INFO:teuthology.task.internal:Removing archive directory... 2021-12-17T19:14:46.428 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2021-12-17T19:14:46.431 DEBUG:teuthology.orchestra.run.smithi109:> rm -rf -- /home/ubuntu/cephtest/archive 2021-12-17T19:14:46.434 DEBUG:teuthology.orchestra.run.smithi125:> rm -rf -- /home/ubuntu/cephtest/archive 2021-12-17T19:14:46.437 DEBUG:teuthology.orchestra.run.smithi158:> rm -rf -- /home/ubuntu/cephtest/archive 2021-12-17T19:14:46.440 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2021-12-17T19:14:46.448 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2021-12-17T19:14:46.462 INFO:teuthology.task.internal:Not uploading archives. 2021-12-17T19:14:46.463 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2021-12-17T19:14:46.496 INFO:teuthology.task.internal:Tidying up after the test... 2021-12-17T19:14:46.497 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-12-17T19:14:46.500 DEBUG:teuthology.orchestra.run.smithi109:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-12-17T19:14:46.503 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-12-17T19:14:46.505 INFO:teuthology.orchestra.run.smithi062.stdout: 655382 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 17 19:14 /home/ubuntu/cephtest 2021-12-17T19:14:46.506 DEBUG:teuthology.orchestra.run.smithi158:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-12-17T19:14:46.508 INFO:teuthology.orchestra.run.smithi109.stdout: 655399 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 17 19:14 /home/ubuntu/cephtest 2021-12-17T19:14:46.510 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-12-17T19:14:46.515 INFO:teuthology.orchestra.run.smithi158.stdout: 655398 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 17 19:14 /home/ubuntu/cephtest 2021-12-17T19:14:46.519 INFO:teuthology.orchestra.run.smithi192.stdout: 655401 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 17 19:14 /home/ubuntu/cephtest 2021-12-18T06:08:39.749 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-12-18T06:08:39.793 DEBUG:teuthology.task.console_log:Killing console logger for smithi062 2021-12-18T06:08:39.795 DEBUG:teuthology.task.console_log:Killing console logger for smithi109 2021-12-18T06:08:39.795 DEBUG:teuthology.task.console_log:Killing console logger for smithi125 2021-12-18T06:08:39.796 DEBUG:teuthology.task.console_log:Killing console logger for smithi158 2021-12-18T06:08:39.796 DEBUG:teuthology.task.console_log:Killing console logger for smithi192 2021-12-18T06:08:39.797 DEBUG:teuthology.exit:Finished running handlers